-- Logs begin at Sat 2022-05-21 20:01:16 UTC, end at Sat 2022-05-21 22:40:59 UTC. -- May 21 20:58:09.610404 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... May 21 20:58:09.620852 ncdv-master-1 devstack@n-api.service[115505]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 21 20:58:09.621733 ncdv-master-1 devstack@n-api.service[115505]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat May 21 20:58:09 2022] *** May 21 20:58:09.621733 ncdv-master-1 devstack@n-api.service[115505]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 21 20:58:09.621733 ncdv-master-1 devstack@n-api.service[115505]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 21 20:58:09.621733 ncdv-master-1 devstack@n-api.service[115505]: nodename: ncdv-master-1 May 21 20:58:09.621733 ncdv-master-1 devstack@n-api.service[115505]: machine: x86_64 May 21 20:58:09.621733 ncdv-master-1 devstack@n-api.service[115505]: clock source: unix May 21 20:58:09.621733 ncdv-master-1 devstack@n-api.service[115505]: pcre jit disabled May 21 20:58:09.621733 ncdv-master-1 devstack@n-api.service[115505]: detected number of CPU cores: 4 May 21 20:58:09.621733 ncdv-master-1 devstack@n-api.service[115505]: current working directory: / May 21 20:58:09.621733 ncdv-master-1 devstack@n-api.service[115505]: detected binary path: /usr/bin/uwsgi-core May 21 20:58:09.621733 ncdv-master-1 devstack@n-api.service[115505]: your processes number limit is 47680 May 21 20:58:09.622415 ncdv-master-1 devstack@n-api.service[115505]: your memory page size is 4096 bytes May 21 20:58:09.622415 ncdv-master-1 devstack@n-api.service[115505]: detected max file descriptor number: 2048 May 21 20:58:09.622415 ncdv-master-1 devstack@n-api.service[115505]: lock engine: pthread robust mutexes May 21 20:58:09.622415 ncdv-master-1 devstack@n-api.service[115505]: thunder lock: enabled May 21 20:58:09.622415 ncdv-master-1 devstack@n-api.service[115505]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 21 20:58:09.622415 ncdv-master-1 devstack@n-api.service[115505]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 21 20:58:09.672126 ncdv-master-1 devstack@n-api.service[115505]: Python main interpreter initialized at 0x561f4c0679c0 May 21 20:58:09.672126 ncdv-master-1 devstack@n-api.service[115505]: python threads support enabled May 21 20:58:09.672126 ncdv-master-1 devstack@n-api.service[115505]: your server socket listen backlog is limited to 100 connections May 21 20:58:09.672126 ncdv-master-1 devstack@n-api.service[115505]: your mercy for graceful operations on workers is 90 seconds May 21 20:58:09.672512 ncdv-master-1 devstack@n-api.service[115505]: mapped 403077 bytes (393 KB) for 2 cores May 21 20:58:09.672608 ncdv-master-1 devstack@n-api.service[115505]: *** Operational MODE: preforking *** May 21 20:58:09.672823 ncdv-master-1 devstack@n-api.service[115505]: *** uWSGI is running in multiple interpreter mode *** May 21 20:58:09.672823 ncdv-master-1 devstack@n-api.service[115505]: spawned uWSGI master process (pid: 115505) May 21 20:58:09.673026 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. May 21 20:58:09.673870 ncdv-master-1 devstack@n-api.service[115505]: spawned uWSGI worker 1 (pid: 115506, cores: 1) May 21 20:58:09.673971 ncdv-master-1 devstack@n-api.service[115505]: spawned uWSGI worker 2 (pid: 115507, cores: 1) May 21 20:58:09.674108 ncdv-master-1 devstack@n-api.service[115505]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 21 20:58:10.924228 ncdv-master-1 devstack@n-api.service[115506]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 21 20:58:10.955277 ncdv-master-1 devstack@n-api.service[115507]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 21 20:58:11.654159 ncdv-master-1 devstack@n-api.service[115506]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 21 20:58:11.654159 ncdv-master-1 devstack@n-api.service[115506]: from cryptography.utils import int_from_bytes May 21 20:58:11.654688 ncdv-master-1 devstack@n-api.service[115506]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 21 20:58:11.654688 ncdv-master-1 devstack@n-api.service[115506]: from cryptography.utils import int_from_bytes May 21 20:58:11.674034 ncdv-master-1 devstack@n-api.service[115507]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 21 20:58:11.674034 ncdv-master-1 devstack@n-api.service[115507]: from cryptography.utils import int_from_bytes May 21 20:58:11.674561 ncdv-master-1 devstack@n-api.service[115507]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 21 20:58:11.674561 ncdv-master-1 devstack@n-api.service[115507]: from cryptography.utils import int_from_bytes May 21 20:58:14.285904 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 21 20:58:14.286567 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 21 20:58:14.286659 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 21 20:58:14.286998 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 21 20:58:14.287251 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 21 20:58:14.287636 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.287955 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.288275 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.288389 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 21 20:58:14.288756 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.288850 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 21 20:58:14.288944 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.289125 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 21 20:58:14.289216 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.289488 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 21 20:58:14.289580 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.289744 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 21 20:58:14.289832 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.290129 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.290226 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.290387 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.290477 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.290701 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.290796 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.291021 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.291120 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.291337 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.291425 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.291647 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.292329 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.292599 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.292862 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.293007 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.293143 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.293271 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.293402 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.293612 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.293743 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.293874 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.294006 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.294132 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.294356 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.295682 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.295682 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.295947 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.296082 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.296216 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.296384 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.296513 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.296639 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.296773 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.296909 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.297034 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.297158 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.297282 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.297282 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.297517 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.297677 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.297816 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.297942 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.298066 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.298190 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.298304 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.298435 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.298567 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.298692 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.298818 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.298943 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.299076 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.299208 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.299340 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.299340 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.299574 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.299705 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.299844 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.299966 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.300098 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.300098 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.300373 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.300515 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.300649 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.300784 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.300918 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.301059 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.301186 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.301318 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.301452 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.301698 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.301831 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.301958 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.302083 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.302216 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.302331 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.302463 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.302603 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.302764 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.302893 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.303019 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.303215 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.303356 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.303533 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.303671 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.303826 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.303961 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.304128 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.304266 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.304470 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.304609 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.304779 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.304939 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.305077 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.305203 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.305339 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.305472 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.305597 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.305732 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.305865 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.305992 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.306157 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.306288 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.306461 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.306601 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.306764 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.306900 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.307066 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.307197 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.307966 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.308270 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.308558 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.308705 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.308705 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.308947 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.309082 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.309210 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.309210 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.309447 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.309573 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.309697 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.309838 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.309965 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.310098 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.310229 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.310364 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.310501 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.310661 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.310798 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.310969 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.311098 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.311275 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.311421 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.311555 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.311688 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.311897 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.312035 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.312188 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.312385 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.312517 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.312641 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.312819 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.312949 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.313134 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.313271 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.313434 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.313573 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.313739 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.313870 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.314038 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.314177 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.314352 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.314488 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.314672 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.314810 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.314972 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.315111 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.315245 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.315378 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.315504 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.315630 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.315789 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.315920 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.316102 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.316239 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.316428 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.316566 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.316731 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.316869 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.317030 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.317167 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.317325 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.317455 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.317625 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.317763 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.317925 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.318053 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.318222 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.318365 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.318522 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.318652 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.318822 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.318953 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.319121 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.319329 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.319465 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.319590 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.319723 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.319863 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.319994 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.320135 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.320308 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.320439 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.320614 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.320743 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.320916 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.321058 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.321218 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.321348 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.321517 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.321645 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.321816 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.322085 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.322230 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.322356 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.322481 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.322613 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.322738 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.323504 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.323691 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.323859 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.323990 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.324110 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.324251 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.324404 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.324530 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.324669 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.324806 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.324932 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.325103 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.325242 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.325410 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.325547 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.325716 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.325846 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.326019 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.326148 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.326330 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.326459 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.326633 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.326761 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.326937 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.327067 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.327235 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.327366 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.327535 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.327666 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.327837 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.327960 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.328140 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.328269 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.328453 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.328636 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.328780 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.328907 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.329067 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.329197 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.329329 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.329504 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.329648 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.329774 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.329934 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.330062 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.330211 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.330384 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.330522 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.330649 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.330806 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.330932 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.331103 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.331283 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.331412 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.331573 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.331711 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.331837 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.332067 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.332208 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.332417 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.332567 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.332738 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.332874 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.333044 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.333175 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.333351 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.333481 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:58:14.333662 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.333792 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.333983 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.334114 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.334291 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.334421 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.334597 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.334736 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.334904 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.335035 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.335219 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.335349 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.335533 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.335672 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.335858 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.335997 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.336169 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.336333 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.336507 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.336657 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.336819 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.336969 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.337106 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.337239 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.337423 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.337555 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.337741 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.337869 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.338056 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.338184 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.338365 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.338503 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.339253 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.339390 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.339549 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.339679 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.339860 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.339999 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.340171 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.340341 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.340509 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.340637 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.340818 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.341034 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.341164 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.341290 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.341415 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.341548 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.341719 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.341861 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.342055 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.342262 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.342393 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.342519 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.342654 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.342792 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.342958 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.343099 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.343266 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.343397 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.343573 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.343704 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.343880 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.344012 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.344188 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.344446 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.344594 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.344729 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.344863 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.344990 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.345123 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.345251 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.345437 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.345572 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.345749 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.345877 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.346055 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.346193 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.346360 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.346489 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.346668 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.346797 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.346967 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.347105 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.347268 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.347399 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.347569 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.347699 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.347875 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.348020 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.348155 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.348315 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.348502 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.348633 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.348819 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.348958 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.349119 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.349250 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.349421 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.349557 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.349726 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.349866 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.350030 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.350161 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.350337 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.350468 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.350641 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.350777 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.350946 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.351076 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.351256 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.351386 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.351563 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.351694 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.351864 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.351995 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.352182 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.352422 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.352571 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.352699 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.352825 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.352951 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.353104 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.353235 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.353441 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.353571 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.353747 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.353879 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.354058 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.354215 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.354451 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.354614 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.354742 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.354938 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.355079 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.355217 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.355344 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.355471 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.355637 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.355776 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.355942 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.356087 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.356247 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.356401 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.356586 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.356717 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.356896 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.357041 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.357204 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.357340 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.357511 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.357641 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.357821 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.357960 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.358131 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.358260 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.358433 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.358565 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.358739 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.358878 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.359041 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.359170 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.359340 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.359471 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.359640 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.359778 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.359942 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.360086 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.360241 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.360397 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.360572 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.360705 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.360873 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.361004 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.361172 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.361313 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.361472 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.361610 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.361787 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.362463 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.362660 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.362809 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.362809 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.363049 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.363182 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.363309 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.363435 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.363570 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.363570 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.363827 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.363955 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.364087 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.364214 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.364395 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.364526 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.364651 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.364777 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.364903 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.365038 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.365171 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.365306 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.365433 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.365558 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.365682 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.365837 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.365966 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.366100 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.366228 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.366353 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.366478 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.366613 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.366743 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.366893 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.367024 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.367197 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.367325 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.367513 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.367643 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.367817 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.367954 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.368126 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.368265 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.368456 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.368578 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.368766 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.368895 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.369064 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.369269 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.369398 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.369532 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.369682 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.369833 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.370027 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.370169 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.370339 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.370478 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.370663 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.370793 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.370974 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.371117 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.371293 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.371423 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.371597 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.371734 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.371912 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.372036 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.372249 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.372432 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.372581 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.372786 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.372930 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.373065 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.373198 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.373325 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.373488 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.373617 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.373791 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.373930 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.374109 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.374237 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.374414 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.374543 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.374721 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.374848 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.375016 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.375150 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.375326 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.375463 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.375632 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.375760 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.375951 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.376087 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.376256 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.376421 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.376587 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.376726 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.376897 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.377037 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.377200 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.377339 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.377505 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.377638 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.377809 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.377946 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.378110 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.378256 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.378411 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.378550 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.378715 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.378845 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.379024 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.379164 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.379327 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.379457 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.379630 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.379768 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.379929 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.380068 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.380237 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.380390 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.380565 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.380687 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.380864 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.380995 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.381161 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.381291 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.381465 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.381595 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.381771 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.381899 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.382078 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.382207 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.382377 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.382512 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.382690 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.382893 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.383022 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.383155 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.383282 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.383418 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.383572 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.383702 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.383876 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.384007 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.384174 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.384377 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.384507 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.384633 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.384767 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.384894 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.385108 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.385248 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.385932 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.386066 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.386283 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.386452 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.386622 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.386817 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.386949 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.387076 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.387202 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.387327 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.387489 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.387629 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.387794 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.387926 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.388136 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.388275 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.388473 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.388606 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.388778 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.388908 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.389093 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.389225 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.389399 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.389537 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.389706 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.389837 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.390011 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.390150 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.390316 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.390447 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.390624 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.390761 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.390928 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.391067 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.391234 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.391366 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.391538 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.391667 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.391835 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.391976 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.392138 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.392269 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.392472 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.392601 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.392782 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.393041 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.393190 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.393371 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.393511 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.393682 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.393813 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.393996 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.394127 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.394298 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.394426 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.394608 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.394747 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.394924 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.395055 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.395246 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.395486 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.395623 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.395820 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.395953 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.396162 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.396324 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.396465 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.396594 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.396766 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.396906 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.397071 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.397202 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.397372 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.397503 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.397672 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.397811 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.397969 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.398100 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.398304 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.398451 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.398585 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.398722 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.398858 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.398976 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.399137 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.399276 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.399435 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.399575 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.399742 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.399887 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.400043 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.400174 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.400354 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.400483 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.400657 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.401095 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.401277 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.401414 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.401583 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.401737 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.401877 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.402043 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.402174 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.402344 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.402481 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.402627 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.402756 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.402976 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.403202 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.403332 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.403457 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.403591 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.403719 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.403908 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.404037 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.404224 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.404441 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.404583 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.404712 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.404837 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.404970 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.405154 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.405291 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.405456 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.405583 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.405754 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.405891 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.406054 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.406189 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.406357 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.406486 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.406660 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.406790 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.406956 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.407101 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.407261 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.407391 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.407562 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.407699 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.407865 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.408005 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.408168 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.408353 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.408481 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.408606 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.408780 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.408911 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.409077 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.409207 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.409385 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.409511 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.409686 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.409814 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.409983 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.410120 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.410280 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.410412 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.410579 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.410706 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.410879 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.411017 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.411177 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.411314 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.411479 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.411617 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.411776 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.411905 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.412076 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.412216 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.412396 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.412537 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.412696 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.412816 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.413029 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.413186 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.413382 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.413512 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.413639 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.413772 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.413899 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.414034 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.414164 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.414289 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.414460 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.414591 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.414761 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.414903 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.415062 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.415194 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.415366 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.415504 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.415665 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.415796 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.415962 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.416093 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.416265 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.416431 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.416601 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.417247 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.417486 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.417710 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.417929 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.418059 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.418244 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.418387 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.418550 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.418689 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.418888 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.419010 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.419191 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.419309 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.419496 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.419621 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.419796 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.419922 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.420095 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.420219 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.420420 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.429187 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.429318 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.429422 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.429496 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.429576 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.429576 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.429733 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.429815 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.429904 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.429987 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.430068 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.430156 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.430246 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.430328 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.430485 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.430569 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.430650 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.430740 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.430829 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.430926 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.431015 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.431098 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.431178 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.431258 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.431346 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.431436 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.431519 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.431599 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.431679 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.431759 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.431839 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.432882 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.433026 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.433139 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.433268 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.433378 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.433485 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.433580 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.433670 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.433754 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.433841 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.433841 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.434000 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.434091 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.434174 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.434255 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.434335 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.434415 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.434514 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.434597 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.434679 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.434768 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.434852 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.434852 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.435007 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.435090 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.435178 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.435267 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.435349 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.435349 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.435514 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.435597 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.435678 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.435759 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.435840 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.435920 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.436013 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.436102 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.436185 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.436266 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.436364 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.436459 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.436543 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.436623 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.436704 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.436784 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.436864 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.436953 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.437035 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.437116 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.437197 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.437277 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.437357 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.437446 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.437446 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.437601 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.437601 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.437750 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.437831 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.437922 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.437922 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.438232 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.438316 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.438405 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.438497 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.438581 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.438661 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.438741 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.438822 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.438902 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.438902 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.439061 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.439150 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.439237 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.439325 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.439457 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.439557 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.439648 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.439731 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.439811 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.439891 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.439970 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.440060 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.440142 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.440222 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.440337 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.440337 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.440554 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.440554 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.440716 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.440798 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.440877 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.440958 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.441048 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.441131 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.441212 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.441292 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.441372 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.441453 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.441548 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.441639 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.441721 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.441721 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.441868 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.441949 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.442039 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.442128 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.442217 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.442311 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.442394 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.442488 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.442571 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.442651 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.442731 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.442811 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.442891 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.442984 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.443067 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.443147 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.443227 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.443306 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.443386 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.443713 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.443804 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.444017 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.444117 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.444344 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.444439 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.444665 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.444757 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.444982 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.445072 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.445300 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.445399 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.445601 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.445692 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.445909 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.446004 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.446212 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.446390 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.446531 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.446701 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.446848 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.447012 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.447154 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.447332 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.447463 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.447653 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.447746 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.448627 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.448732 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.448978 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.449068 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.449298 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.449388 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.449615 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.449777 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.449943 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.450077 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.450267 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.450407 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.450579 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.450710 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.450895 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.451040 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.451200 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.451331 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.451523 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.451655 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.451820 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.451968 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.452127 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.452259 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.452452 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.452583 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.452755 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.452962 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.453095 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.453289 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.453419 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.453603 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.453735 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.453926 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.454058 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.454239 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.454368 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.454537 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.454676 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.454835 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.454967 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.455149 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.455278 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.455446 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.455585 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.455750 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.455880 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.456059 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.456188 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.456471 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.456612 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.456741 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.456876 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.457011 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.457140 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.457663 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.457797 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.457926 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.458054 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.458183 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.458309 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.458309 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.458583 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.458782 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.458913 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.459039 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.459164 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.459304 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.459430 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.459555 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.459679 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.459804 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.459937 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.460072 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.460206 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.460347 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.460474 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.460599 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.460724 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.460892 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.461023 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.461194 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.461331 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.461497 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.461700 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.461829 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.461953 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.462101 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.462231 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.462400 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.462541 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.462705 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.462837 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.463004 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.463143 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.463301 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.463481 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.464235 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.464400 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.464591 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.464736 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.464919 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.465060 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.465238 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.465378 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.465558 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.465696 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.465884 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.466002 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.466188 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.466319 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.466497 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.466620 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.466801 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.466919 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.467101 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.467216 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.467403 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.467528 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.467704 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.467822 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.468004 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.468118 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.468354 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.468493 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.469321 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.469443 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.469572 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.469700 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.469700 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.469948 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.470083 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.470218 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.470345 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.470470 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.470597 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.470733 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.470733 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.470973 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.471099 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.471225 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.471225 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.471472 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.471608 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.471736 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.471871 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.471998 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.472125 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.472260 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.472411 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.472537 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.472663 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.472789 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.472929 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.473057 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.473206 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.473337 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.473518 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.473649 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.473881 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.474046 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.474199 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.474371 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.474502 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.474691 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.474833 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.474989 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.475132 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.475296 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.475427 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.475604 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.475748 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.475944 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.476073 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.476219 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.476397 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.476538 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.476690 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.476843 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.477148 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.477279 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.477472 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.477611 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.477788 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.477918 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.478108 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.478239 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.478438 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.478579 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.478749 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.478893 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.479080 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.479235 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.479445 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.479575 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.479760 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.479882 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.480072 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.480202 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.480408 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.480540 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.480731 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.480859 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.481042 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.481180 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.481353 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.481482 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.481664 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.481794 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.481972 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.482120 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.482279 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.482411 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.482590 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.482717 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.482898 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.483035 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.483205 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.483335 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.483511 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.483640 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.483821 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.483952 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.484136 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.484266 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.484459 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.484593 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.484773 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.484910 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.485089 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.485223 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.485404 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.485532 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.485715 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.485845 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.486026 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.486165 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.486338 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.486542 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.486673 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.486851 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.486981 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.487179 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.487308 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.487500 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.487632 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.487820 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.487951 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.488134 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.488273 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.488474 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.488602 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.488824 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.488961 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.489097 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.489301 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.489432 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.489670 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.489800 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.489973 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.490111 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.490272 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.490412 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.490588 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.490720 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.490892 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.491022 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.491228 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.491357 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.491497 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.491626 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.491779 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.491910 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.492117 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.492334 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.492485 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.492672 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.492805 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.493016 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.493154 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.493306 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.493423 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.493627 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.493743 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.493945 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.494063 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.494248 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.494363 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.494562 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.494684 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.494893 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.495048 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.495194 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.495506 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.495817 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.496121 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.496351 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.496477 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.497336 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.497483 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.497626 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.497764 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.497764 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.498012 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.498141 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.498141 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.498379 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.498670 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.498984 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.499343 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.499578 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.499709 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.499879 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.500053 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.500185 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.500489 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.500620 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.500790 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.500921 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.501099 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.501233 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.501402 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.501535 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.501707 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.501852 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.502009 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.502141 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.502315 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.502447 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.502616 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.502756 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.502920 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.503052 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.503273 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.503404 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.503578 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.503721 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.503889 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.504019 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.504190 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.504353 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.504528 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.504673 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.504838 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.504977 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.505157 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.505296 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.505468 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.505601 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.505778 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.505918 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.506105 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.506243 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.506415 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.506547 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.506723 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.506943 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.507074 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.507273 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.507414 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.507591 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.507722 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.507915 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.508043 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.508239 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.508403 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.508570 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.508710 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.508872 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.509007 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.509175 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.509306 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.509513 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.509651 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.509778 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.509904 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.510086 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.510211 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.510901 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.511051 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.511313 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.511441 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.511578 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.511707 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.511834 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.511969 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.512097 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.512233 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.512439 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.512588 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.512684 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.512939 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.513030 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.513257 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.513350 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.513571 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.513799 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.513890 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.514141 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.514313 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.514468 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.514608 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.514781 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.514929 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.515109 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.515269 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.515411 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.515549 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.515710 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.515858 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.516008 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.516154 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.516321 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.516480 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.516684 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.516840 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.516992 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.517133 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.517268 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.517387 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.517528 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.517645 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.517830 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.517956 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.518173 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.518287 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.518484 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.518610 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.518795 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.518910 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.519104 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.519220 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.519415 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.519540 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.519743 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.519884 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.520037 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.520129 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.520367 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.520482 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.520686 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.520777 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.520991 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.521082 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.521314 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.521406 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.521631 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.521728 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.521947 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.522046 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.522259 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.522351 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.522557 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.522647 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.522858 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.522947 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.523157 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.523264 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.523460 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.523559 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.523773 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.523872 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.524077 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.524175 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.524403 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.524535 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.524702 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.524845 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.525122 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.525254 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.525364 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.525501 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.525629 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.525765 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.526774 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.527264 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.527646 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.527777 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.527989 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.528123 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.528516 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.528654 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.528764 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.528871 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.528994 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.529105 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.529285 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.529402 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.529590 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.529723 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.529887 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.530001 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.530186 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.530303 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.530489 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.530635 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.530788 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.530946 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.531089 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.531256 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.531385 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.531559 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.531701 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.531871 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.532030 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.532191 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.532366 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.532513 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.532687 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.532818 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.532993 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.533132 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.533310 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.533451 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.533614 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.533746 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.533930 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.534061 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.534247 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.534383 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.534563 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.534694 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.534867 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.534999 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.535192 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.535325 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.535500 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.535631 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.535805 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.535979 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.536124 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.536251 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.536429 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.536559 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.536715 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.536847 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.537017 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.537147 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.537317 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.537446 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.537622 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.537754 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.537922 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.538061 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.538226 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.538365 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.538528 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.538749 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.538881 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.539009 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.539144 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.539272 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.539439 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.539579 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.539766 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.539897 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.540072 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.540211 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.540400 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.540548 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.540713 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.540854 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.541018 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.541149 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.541323 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.541455 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.541634 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.541787 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.542075 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.542220 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.542358 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.542544 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.542676 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.542864 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.542996 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.543182 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.543323 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.543496 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.543635 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.543813 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.543952 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.544125 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.544268 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.544462 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.544594 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.544795 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.544927 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.545125 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.545269 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.545434 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.545565 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.545739 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.545869 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.546005 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 21 20:58:14.546156 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.546376 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.546695 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.547009 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.547342 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.547654 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.547965 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.548302 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.548614 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.548928 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.549245 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.549560 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.549887 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.550215 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.550528 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.550862 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.551191 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.551543 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.551857 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.552206 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.552572 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.552890 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.553203 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.553509 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:58:14.553753 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 21 20:58:14.609202 ncdv-master-1 devstack@n-api.service[115507]: INFO dbcounter [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] Registered counter for database nova_api May 21 20:58:14.617997 ncdv-master-1 devstack@n-api.service[115506]: INFO dbcounter [None req-8283a148-97c2-4c13-9c0f-090dc133ed24 None None] Registered counter for database nova_api May 21 20:58:14.630474 ncdv-master-1 devstack@n-api.service[115507]: DEBUG oslo_db.sqlalchemy.engines [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 21 20:58:14.637648 ncdv-master-1 devstack@n-api.service[115507]: DEBUG dbcounter [-] [115507] Writer thread running {{(pid=115507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 21 20:58:14.639041 ncdv-master-1 devstack@n-api.service[115506]: DEBUG oslo_db.sqlalchemy.engines [None req-8283a148-97c2-4c13-9c0f-090dc133ed24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115506) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 21 20:58:14.645589 ncdv-master-1 devstack@n-api.service[115506]: DEBUG dbcounter [-] [115506] Writer thread running {{(pid=115506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 21 20:58:14.694794 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.context [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4f046ce9-ac6c-44d8-b1fb-b7063eef06e7(cell1) {{(pid=115507) load_cells /opt/stack/nova/nova/context.py:464}} May 21 20:58:14.699642 ncdv-master-1 devstack@n-api.service[115507]: DEBUG oslo_concurrency.lockutils [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 20:58:14.701220 ncdv-master-1 devstack@n-api.service[115507]: DEBUG oslo_concurrency.lockutils [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 20:58:14.702014 ncdv-master-1 devstack@n-api.service[115507]: DEBUG oslo_concurrency.lockutils [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 20:58:14.703547 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.context [None req-8283a148-97c2-4c13-9c0f-090dc133ed24 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4f046ce9-ac6c-44d8-b1fb-b7063eef06e7(cell1) {{(pid=115506) load_cells /opt/stack/nova/nova/context.py:464}} May 21 20:58:14.703975 ncdv-master-1 devstack@n-api.service[115507]: DEBUG oslo_concurrency.lockutils [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 20:58:14.705944 ncdv-master-1 devstack@n-api.service[115507]: INFO dbcounter [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] Registered counter for database nova_cell0 May 21 20:58:14.707634 ncdv-master-1 devstack@n-api.service[115506]: DEBUG oslo_concurrency.lockutils [None req-8283a148-97c2-4c13-9c0f-090dc133ed24 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 20:58:14.709226 ncdv-master-1 devstack@n-api.service[115506]: DEBUG oslo_concurrency.lockutils [None req-8283a148-97c2-4c13-9c0f-090dc133ed24 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 20:58:14.709864 ncdv-master-1 devstack@n-api.service[115507]: INFO dbcounter [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] Registered counter for database nova_cell1 May 21 20:58:14.710187 ncdv-master-1 devstack@n-api.service[115506]: DEBUG oslo_concurrency.lockutils [None req-8283a148-97c2-4c13-9c0f-090dc133ed24 None None] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 20:58:14.712170 ncdv-master-1 devstack@n-api.service[115506]: DEBUG oslo_concurrency.lockutils [None req-8283a148-97c2-4c13-9c0f-090dc133ed24 None None] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 20:58:14.714397 ncdv-master-1 devstack@n-api.service[115506]: INFO dbcounter [None req-8283a148-97c2-4c13-9c0f-090dc133ed24 None None] Registered counter for database nova_cell0 May 21 20:58:14.717589 ncdv-master-1 devstack@n-api.service[115507]: DEBUG oslo_db.sqlalchemy.engines [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 21 20:58:14.718553 ncdv-master-1 devstack@n-api.service[115506]: INFO dbcounter [None req-8283a148-97c2-4c13-9c0f-090dc133ed24 None None] Registered counter for database nova_cell1 May 21 20:58:14.719217 ncdv-master-1 devstack@n-api.service[115507]: DEBUG oslo_db.sqlalchemy.engines [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 21 20:58:14.725418 ncdv-master-1 devstack@n-api.service[115507]: DEBUG dbcounter [-] [115507] Writer thread running {{(pid=115507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 21 20:58:14.725555 ncdv-master-1 devstack@n-api.service[115506]: DEBUG oslo_db.sqlalchemy.engines [None req-8283a148-97c2-4c13-9c0f-090dc133ed24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115506) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 21 20:58:14.727061 ncdv-master-1 devstack@n-api.service[115507]: DEBUG dbcounter [-] [115507] Writer thread running {{(pid=115507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 21 20:58:14.727676 ncdv-master-1 devstack@n-api.service[115506]: DEBUG oslo_db.sqlalchemy.engines [None req-8283a148-97c2-4c13-9c0f-090dc133ed24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115506) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 21 20:58:14.734733 ncdv-master-1 devstack@n-api.service[115506]: DEBUG dbcounter [-] [115506] Writer thread running {{(pid=115506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 21 20:58:14.736452 ncdv-master-1 devstack@n-api.service[115506]: DEBUG dbcounter [-] [115506] Writer thread running {{(pid=115506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 21 20:58:14.882148 ncdv-master-1 devstack@n-api.service[115507]: INFO dbcounter [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] Registered counter for database nova_cell0 May 21 20:58:14.884212 ncdv-master-1 devstack@n-api.service[115506]: INFO dbcounter [None req-8283a148-97c2-4c13-9c0f-090dc133ed24 None None] Registered counter for database nova_cell0 May 21 20:58:14.891555 ncdv-master-1 devstack@n-api.service[115507]: DEBUG oslo_db.sqlalchemy.engines [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 21 20:58:14.893240 ncdv-master-1 devstack@n-api.service[115506]: DEBUG oslo_db.sqlalchemy.engines [None req-8283a148-97c2-4c13-9c0f-090dc133ed24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115506) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 21 20:58:14.895926 ncdv-master-1 devstack@n-api.service[115507]: DEBUG dbcounter [-] [115507] Writer thread running {{(pid=115507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 21 20:58:14.897497 ncdv-master-1 devstack@n-api.service[115506]: DEBUG dbcounter [-] [115506] Writer thread running {{(pid=115506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 21 20:58:15.318975 ncdv-master-1 devstack@n-api.service[115507]: WARNING keystonemiddleware.auth_token [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 21 20:58:15.326594 ncdv-master-1 devstack@n-api.service[115507]: WARNING keystonemiddleware.auth_token [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 21 20:58:15.423403 ncdv-master-1 devstack@n-api.service[115506]: WARNING keystonemiddleware.auth_token [None req-8283a148-97c2-4c13-9c0f-090dc133ed24 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 21 20:58:15.431030 ncdv-master-1 devstack@n-api.service[115506]: WARNING keystonemiddleware.auth_token [None req-8283a148-97c2-4c13-9c0f-090dc133ed24 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 21 20:58:15.673342 ncdv-master-1 devstack@n-api.service[115507]: WARNING keystonemiddleware.auth_token [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 21 20:58:15.679231 ncdv-master-1 devstack@n-api.service[115507]: WARNING keystonemiddleware.auth_token [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 21 20:58:15.685064 ncdv-master-1 devstack@n-api.service[115507]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561f4c0679c0 pid: 115507 (default app) May 21 20:58:15.687111 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 20:58:15.688317 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001740 May 21 20:58:15.688722 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Sat May 21 20:58:15 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 20:58:15.769039 ncdv-master-1 devstack@n-api.service[115506]: WARNING keystonemiddleware.auth_token [None req-8283a148-97c2-4c13-9c0f-090dc133ed24 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 21 20:58:15.774984 ncdv-master-1 devstack@n-api.service[115506]: WARNING keystonemiddleware.auth_token [None req-8283a148-97c2-4c13-9c0f-090dc133ed24 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 21 20:58:15.781080 ncdv-master-1 devstack@n-api.service[115506]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561f4c0679c0 pid: 115506 (default app) May 21 20:59:40.566064 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 20:59:40.567070 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 21 20:59:40.567534 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 930 bytes} [Sat May 21 20:59:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 20:59:40.586360 ncdv-master-1 devstack@n-api.service[115506]: DEBUG dbcounter [-] [115506] Writing DB stats nova_api:SELECT=3 {{(pid=115506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 20:59:40.588159 ncdv-master-1 devstack@n-api.service[115506]: DEBUG dbcounter [-] [115506] Writing DB stats nova_cell0:SELECT=3 {{(pid=115506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 20:59:40.589538 ncdv-master-1 devstack@n-api.service[115506]: DEBUG dbcounter [-] [115506] Writing DB stats nova_cell1:SELECT=3 {{(pid=115506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 20:59:40.590967 ncdv-master-1 devstack@n-api.service[115506]: DEBUG dbcounter [-] [115506] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 20:59:41.041958 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-847af9c9-8f1f-4a09-9b5c-7fc7e3e7728d admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 20:59:41.075448 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-847af9c9-8f1f-4a09-9b5c-7fc7e3e7728d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.498994 May 21 20:59:41.088315 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1291 bytes} [Sat May 21 20:59:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 20:59:43.518187 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 20:59:43.519192 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-b8d7df0d-7c96-495e-9ecc-d14cf56bb689 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 May 21 20:59:43.525394 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 930 bytes} [Sat May 21 20:59:43 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 20:59:43.580057 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-22753f8f-04e8-44b1-835e-79794832928d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "swap": 0, "name": "cirros256", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1"}} {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 20:59:43.598042 ncdv-master-1 devstack@n-api.service[115506]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 20:59:43.598042 ncdv-master-1 devstack@n-api.service[115506]: warnings.warn(msg) May 21 20:59:43.669630 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-22753f8f-04e8-44b1-835e-79794832928d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.142858 May 21 20:59:43.673607 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1282 bytes} [Sat May 21 20:59:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 20:59:43.684744 ncdv-master-1 devstack@n-api.service[115507]: DEBUG dbcounter [-] [115507] Writing DB stats nova_api:SELECT=3 {{(pid=115507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 20:59:43.685953 ncdv-master-1 devstack@n-api.service[115507]: DEBUG dbcounter [-] [115507] Writing DB stats nova_cell0:SELECT=3 {{(pid=115507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 20:59:43.686707 ncdv-master-1 devstack@n-api.service[115507]: DEBUG dbcounter [-] [115507] Writing DB stats nova_cell1:SELECT=3 {{(pid=115507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 20:59:43.687522 ncdv-master-1 devstack@n-api.service[115507]: DEBUG dbcounter [-] [115507] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 20:59:43.890743 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-9cec09ba-8a80-4b20-9f21-ba6d0aa5d7a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 20:59:43.893250 ncdv-master-1 devstack@n-api.service[115507]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 20:59:43.893250 ncdv-master-1 devstack@n-api.service[115507]: warnings.warn(msg) May 21 20:59:43.987007 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-9cec09ba-8a80-4b20-9f21-ba6d0aa5d7a2 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.308409 May 21 20:59:43.993444 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1335 bytes} [Sat May 21 20:59:43 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 20:59:46.345110 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-22753f8f-04e8-44b1-835e-79794832928d admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 20:59:46.346035 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-22753f8f-04e8-44b1-835e-79794832928d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 May 21 20:59:46.346589 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 930 bytes} [Sat May 21 20:59:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 20:59:46.455340 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-fe8af29d-574c-4307-80d9-d63e6472da91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M", "vcpus": 1}} {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 20:59:46.473187 ncdv-master-1 devstack@n-api.service[115507]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 20:59:46.473187 ncdv-master-1 devstack@n-api.service[115507]: warnings.warn(msg) May 21 20:59:46.557737 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-fe8af29d-574c-4307-80d9-d63e6472da91 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.204443 May 21 20:59:46.558483 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1282 bytes} [Sat May 21 20:59:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 20:59:46.570610 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-05595fc4-d3bf-4aed-8b55-3446b3991f54 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 20:59:46.572171 ncdv-master-1 devstack@n-api.service[115506]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 20:59:46.572171 ncdv-master-1 devstack@n-api.service[115506]: warnings.warn(msg) May 21 20:59:46.639761 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-05595fc4-d3bf-4aed-8b55-3446b3991f54 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073396 May 21 20:59:46.640369 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1335 bytes} [Sat May 21 20:59:46 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 20:59:49.057040 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-fe8af29d-574c-4307-80d9-d63e6472da91 admin admin] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 20:59:49.058777 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-fe8af29d-574c-4307-80d9-d63e6472da91 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002219 May 21 20:59:49.059403 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 930 bytes} [Sat May 21 20:59:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 20:59:49.160810 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-42f49168-c933-4e20-9a74-698f6e4f6ad2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "id": "d2", "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 20:59:49.244757 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-42f49168-c933-4e20-9a74-698f6e4f6ad2 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.178467 May 21 20:59:49.245589 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1282 bytes} [Sat May 21 20:59:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 20:59:49.259448 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-6092893e-ae74-402a-be52-f21edda4337a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 20:59:49.351459 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-6092893e-ae74-402a-be52-f21edda4337a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096638 May 21 20:59:49.352967 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1335 bytes} [Sat May 21 20:59:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 20:59:52.272389 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-42f49168-c933-4e20-9a74-698f6e4f6ad2 admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 20:59:52.272389 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-42f49168-c933-4e20-9a74-698f6e4f6ad2 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001670 May 21 20:59:52.272389 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 930 bytes} [Sat May 21 20:59:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 20:59:52.334833 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-ee50b122-6265-4a53-9d23-27053e2e644f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "ds2G", "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3", "disk": 10, "os-flavor-access:is_public": true}} {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 20:59:52.670000 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-ee50b122-6265-4a53-9d23-27053e2e644f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.403651 May 21 20:59:52.681299 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1282 bytes} [Sat May 21 20:59:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 20:59:52.685439 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-4769a1b6-e301-4209-821f-d31170c9fb92 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 20:59:52.938123 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-4769a1b6-e301-4209-821f-d31170c9fb92 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.148066 May 21 20:59:52.938123 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1335 bytes} [Sat May 21 20:59:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 20:59:55.432691 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-ee50b122-6265-4a53-9d23-27053e2e644f admin admin] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 20:59:55.433702 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-ee50b122-6265-4a53-9d23-27053e2e644f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 May 21 20:59:55.434129 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 930 bytes} [Sat May 21 20:59:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 20:59:55.496400 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-1e1dd1a5-e87d-417a-8a5b-4c9068be1aaf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "ram": 4096, "id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0}} {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 20:59:55.595671 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-1e1dd1a5-e87d-417a-8a5b-4c9068be1aaf admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.155417 May 21 20:59:55.596244 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1282 bytes} [Sat May 21 20:59:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 20:59:55.608819 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-931f7b28-d7fc-461a-b6f0-f12b56b8b357 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 20:59:55.674013 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-931f7b28-d7fc-461a-b6f0-f12b56b8b357 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068974 May 21 20:59:55.674609 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1335 bytes} [Sat May 21 20:59:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 20:59:58.406250 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-1e1dd1a5-e87d-417a-8a5b-4c9068be1aaf admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 20:59:58.407252 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-1e1dd1a5-e87d-417a-8a5b-4c9068be1aaf admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 21 20:59:58.407652 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 930 bytes} [Sat May 21 20:59:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 20:59:58.469971 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-0e4d02f1-4c4c-4322-8626-664c30a65c6b admin admin] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 20:59:58.496040 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-0e4d02f1-4c4c-4322-8626-664c30a65c6b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080314 May 21 20:59:58.497135 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1291 bytes} [Sat May 21 20:59:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:00:00.932081 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-1e1dd1a5-e87d-417a-8a5b-4c9068be1aaf admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:00.935839 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-1e1dd1a5-e87d-417a-8a5b-4c9068be1aaf admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004153 May 21 21:00:00.936441 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 930 bytes} [Sat May 21 21:00:00 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:00:00.995950 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-b5008836-7354-4912-b73f-7edb24be6283 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "id": "1", "ram": 512, "name": "m1.tiny"}} {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:00:01.070607 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-b5008836-7354-4912-b73f-7edb24be6283 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.128248 May 21 21:00:01.072445 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1282 bytes} [Sat May 21 21:00:00 2022] POST /compute/v2.1/flavors => generated 402 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:00:01.084070 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-a5697d70-409d-4b4f-b42b-bbeaf9735f5f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:00:01.172791 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-a5697d70-409d-4b4f-b42b-bbeaf9735f5f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092663 May 21 21:00:01.180540 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1332 bytes} [Sat May 21 21:00:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:00:03.588579 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-b5008836-7354-4912-b73f-7edb24be6283 admin admin] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:03.589601 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-b5008836-7354-4912-b73f-7edb24be6283 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001708 May 21 21:00:03.590000 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 930 bytes} [Sat May 21 21:00:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:00:03.663474 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-30ca036d-8f33-49a8-a115-3070f6fc9d78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:00:03.727722 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-30ca036d-8f33-49a8-a115-3070f6fc9d78 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.127807 May 21 21:00:03.728703 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1282 bytes} [Sat May 21 21:00:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:00:03.741906 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-0499d995-d267-41a5-a4f0-67e93ccce415 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:00:03.979268 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-0499d995-d267-41a5-a4f0-67e93ccce415 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.241145 May 21 21:00:03.980047 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1332 bytes} [Sat May 21 21:00:03 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:00:06.505723 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-30ca036d-8f33-49a8-a115-3070f6fc9d78 admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:06.507417 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-30ca036d-8f33-49a8-a115-3070f6fc9d78 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002204 May 21 21:00:06.508056 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 930 bytes} [Sat May 21 21:00:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:00:06.569697 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-06ae2d11-b1f2-42c9-9d65-47482cb268a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium", "disk": 40, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:00:06.634706 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-06ae2d11-b1f2-42c9-9d65-47482cb268a2 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.120257 May 21 21:00:06.773965 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1282 bytes} [Sat May 21 21:00:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:00:06.774763 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-94033be4-f3ee-4423-8ed9-7b25d6a34a88 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:00:06.977013 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-94033be4-f3ee-4423-8ed9-7b25d6a34a88 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.332836 May 21 21:00:06.977608 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1332 bytes} [Sat May 21 21:00:06 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:00:09.519710 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-06ae2d11-b1f2-42c9-9d65-47482cb268a2 admin admin] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:09.520774 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-06ae2d11-b1f2-42c9-9d65-47482cb268a2 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 May 21 21:00:09.521168 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 930 bytes} [Sat May 21 21:00:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:00:09.582697 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-5814f281-7650-4ead-a5c0-ddfd03305a27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "rxtx_factor": 1.0, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "ram": 8192}} {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:00:09.657798 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-5814f281-7650-4ead-a5c0-ddfd03305a27 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.130102 May 21 21:00:09.658343 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1282 bytes} [Sat May 21 21:00:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:00:09.670979 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-bb4e7060-535f-4689-b053-f09d180ee795 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:00:09.747732 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-bb4e7060-535f-4689-b053-f09d180ee795 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080467 May 21 21:00:09.748355 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1332 bytes} [Sat May 21 21:00:09 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:00:12.080676 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-5814f281-7650-4ead-a5c0-ddfd03305a27 admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:12.081686 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-5814f281-7650-4ead-a5c0-ddfd03305a27 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 May 21 21:00:12.082241 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 930 bytes} [Sat May 21 21:00:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:00:12.143410 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-cac74e0e-c1f3-4837-9ceb-b62e61d65d5c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "vcpus": 8, "swap": 0, "ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160}} {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:00:12.246309 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-cac74e0e-c1f3-4837-9ceb-b62e61d65d5c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.156751 May 21 21:00:12.246860 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1282 bytes} [Sat May 21 21:00:12 2022] POST /compute/v2.1/flavors => generated 408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:00:12.258876 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-a6dcb1f9-5b05-4ed0-988b-9edc17e6259a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:00:12.262447 ncdv-master-1 devstack@n-api.service[115506]: DEBUG dbcounter [-] [115506] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=115506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:00:12.363584 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-a6dcb1f9-5b05-4ed0-988b-9edc17e6259a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108314 May 21 21:00:12.364162 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1332 bytes} [Sat May 21 21:00:12 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:00:39.495616 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-cac74e0e-c1f3-4837-9ceb-b62e61d65d5c admin admin] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:39.496685 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-cac74e0e-c1f3-4837-9ceb-b62e61d65d5c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 21 21:00:39.497083 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 930 bytes} [Sat May 21 21:00:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:00:39.558192 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-0d729c69-0c2d-45ea-99fc-ee6863df3523 admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:39.575958 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-0d729c69-0c2d-45ea-99fc-ee6863df3523 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071291 May 21 21:00:39.576518 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1291 bytes} [Sat May 21 21:00:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:00:40.603486 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-cac74e0e-c1f3-4837-9ceb-b62e61d65d5c admin admin] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:40.604516 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-cac74e0e-c1f3-4837-9ceb-b62e61d65d5c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 21 21:00:40.604917 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Sat May 21 21:00:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:00:40.856898 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-7e623d7a-b96f-4d45-b7e4-a093ef9c0b6f admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:40.862559 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.wsgi [None req-7e623d7a-b96f-4d45-b7e4-a093ef9c0b6f admin admin] HTTP exception thrown: Flavor 42 could not be found. May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-7e623d7a-b96f-4d45-b7e4-a093ef9c0b6f admin admin] Request method failure captured: May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: Accept: application/json May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: Accept-Encoding: gzip, deflate May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: Connection: keep-alive May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: Content-Length: 0 May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: Host: 10.222.0.49 May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: Openstack-Api-Version: compute 2.90 May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: Openstack-System-Scope: None May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: User-Agent: python-novaclient May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: X-Auth-Token: gAAAAABiiVL4het9w6Ksf5jGQ3MIqQT22Ge6PRGDPE1WrGdJ9BpzCWqgJzdc_tiZPtMi6adHms2UDtpjRx1PClf2R9ODATmvtO6lAYtWfk4CZDCdfn9fiM6PdJXYgek2bWWgRbxGVQlTtd77VbZPC-FdQ04voBoXK3vwN9lpKvy2GUH8Y1JTr_4 May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: X-Domain-Id: None May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: X-Domain-Name: None May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: X-Identity-Status: Confirmed May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: X-Is-Admin-Project: True May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: X-Openstack-Nova-Api-Version: 2.90 May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: X-Project-Domain-Id: default May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: X-Project-Domain-Name: Default May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: X-Project-Id: b5593f8cb452404083dfa177b4ee68b8 May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: X-Project-Name: admin May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: X-Role: reader,admin,member May 21 21:00:40.891034 ncdv-master-1 devstack@n-api.service[115506]: X-Roles: reader,admin,member May 21 21:00:40.892995 ncdv-master-1 devstack@n-api.service[115506]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b5593f8cb452404083dfa177b4ee68b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5593f8cb452404083dfa177b4ee68b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b5593f8cb452404083dfa177b4ee68b8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5593f8cb452404083dfa177b4ee68b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:00:40.892995 ncdv-master-1 devstack@n-api.service[115506]: X-Tenant: admin May 21 21:00:40.892995 ncdv-master-1 devstack@n-api.service[115506]: X-Tenant-Id: b5593f8cb452404083dfa177b4ee68b8 May 21 21:00:40.892995 ncdv-master-1 devstack@n-api.service[115506]: X-Tenant-Name: admin May 21 21:00:40.892995 ncdv-master-1 devstack@n-api.service[115506]: X-User: admin May 21 21:00:40.892995 ncdv-master-1 devstack@n-api.service[115506]: X-User-Domain-Id: default May 21 21:00:40.892995 ncdv-master-1 devstack@n-api.service[115506]: X-User-Domain-Name: Default May 21 21:00:40.892995 ncdv-master-1 devstack@n-api.service[115506]: X-User-Id: 291e5d00cba94693b9ef1c99dd62f6a4 May 21 21:00:40.892995 ncdv-master-1 devstack@n-api.service[115506]: X-User-Name: admin May 21 21:00:40.892995 ncdv-master-1 devstack@n-api.service[115506]: method: > May 21 21:00:40.892995 ncdv-master-1 devstack@n-api.service[115506]: exception: Flavor 42 could not be found. May 21 21:00:40.892995 ncdv-master-1 devstack@n-api.service[115506]: action_args: {'id': '42'} May 21 21:00:40.892995 ncdv-master-1 devstack@n-api.service[115506]: {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:00:40.892995 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:00:40.894088 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 21 21:00:40.894088 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 21 21:00:40.894088 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 21 21:00:40.894088 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 21 21:00:40.894088 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:00:40.894088 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:00:40.894088 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 21 21:00:40.894088 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 21 21:00:40.894088 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 21 21:00:40.894088 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:00:40.894088 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 21 21:00:40.894088 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 21 21:00:40.894088 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 21 21:00:40.894088 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi May 21 21:00:40.894088 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:00:40.894088 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi May 21 21:00:40.894088 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:00:40.894088 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:00:40.894088 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:00:40.895958 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:00:40.895958 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:00:40.895958 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:00:40.895958 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:00:40.895958 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 21 21:00:40.895958 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:00:40.895958 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 21 21:00:40.895958 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi May 21 21:00:40.895958 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:00:40.895958 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi May 21 21:00:40.895958 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:00:40.895958 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:00:40.895958 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:00:40.895958 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:00:40.895958 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:00:40.895958 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 21 21:00:40.895958 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi May 21 21:00:40.895958 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-7e623d7a-b96f-4d45-b7e4-a093ef9c0b6f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115506) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:00:40.897371 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-7e623d7a-b96f-4d45-b7e4-a093ef9c0b6f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.087134 May 21 21:00:40.897371 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Sat May 21 21:00:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 21 21:00:40.902685 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-8b81c945-48f8-4175-a198-dbdd66c1fe44 admin admin] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:40.905651 ncdv-master-1 devstack@n-api.service[115507]: DEBUG dbcounter [-] [115507] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=115507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:00:40.923883 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-8b81c945-48f8-4175-a198-dbdd66c1fe44 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024885 May 21 21:00:40.924447 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Sat May 21 21:00:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:00:40.934766 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-9c0f7846-4183-4f6e-a6ff-4427b3f74a1f admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:40.956273 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-9c0f7846-4183-4f6e-a6ff-4427b3f74a1f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025161 May 21 21:00:40.956806 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Sat May 21 21:00:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:00:40.966450 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-e615ed6a-d7d8-4c23-bf3c-9e3758148606 admin admin] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:40.972494 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.wsgi [None req-e615ed6a-d7d8-4c23-bf3c-9e3758148606 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-e615ed6a-d7d8-4c23-bf3c-9e3758148606 admin admin] Request method failure captured: May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: Accept: application/json May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: Accept-Encoding: gzip, deflate May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: Connection: keep-alive May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: Content-Length: 0 May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: Host: 10.222.0.49 May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: Openstack-Api-Version: compute 2.90 May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: Openstack-System-Scope: None May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: User-Agent: python-novaclient May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: X-Auth-Token: gAAAAABiiVL4het9w6Ksf5jGQ3MIqQT22Ge6PRGDPE1WrGdJ9BpzCWqgJzdc_tiZPtMi6adHms2UDtpjRx1PClf2R9ODATmvtO6lAYtWfk4CZDCdfn9fiM6PdJXYgek2bWWgRbxGVQlTtd77VbZPC-FdQ04voBoXK3vwN9lpKvy2GUH8Y1JTr_4 May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: X-Domain-Id: None May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: X-Domain-Name: None May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: X-Identity-Status: Confirmed May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: X-Is-Admin-Project: True May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: X-Openstack-Nova-Api-Version: 2.90 May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: X-Project-Domain-Id: default May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: X-Project-Domain-Name: Default May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: X-Project-Id: b5593f8cb452404083dfa177b4ee68b8 May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: X-Project-Name: admin May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: X-Role: reader,admin,member May 21 21:00:40.975857 ncdv-master-1 devstack@n-api.service[115507]: X-Roles: reader,admin,member May 21 21:00:40.982902 ncdv-master-1 devstack@n-api.service[115507]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b5593f8cb452404083dfa177b4ee68b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5593f8cb452404083dfa177b4ee68b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b5593f8cb452404083dfa177b4ee68b8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5593f8cb452404083dfa177b4ee68b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:00:40.982902 ncdv-master-1 devstack@n-api.service[115507]: X-Tenant: admin May 21 21:00:40.982902 ncdv-master-1 devstack@n-api.service[115507]: X-Tenant-Id: b5593f8cb452404083dfa177b4ee68b8 May 21 21:00:40.982902 ncdv-master-1 devstack@n-api.service[115507]: X-Tenant-Name: admin May 21 21:00:40.982902 ncdv-master-1 devstack@n-api.service[115507]: X-User: admin May 21 21:00:40.982902 ncdv-master-1 devstack@n-api.service[115507]: X-User-Domain-Id: default May 21 21:00:40.982902 ncdv-master-1 devstack@n-api.service[115507]: X-User-Domain-Name: Default May 21 21:00:40.982902 ncdv-master-1 devstack@n-api.service[115507]: X-User-Id: 291e5d00cba94693b9ef1c99dd62f6a4 May 21 21:00:40.982902 ncdv-master-1 devstack@n-api.service[115507]: X-User-Name: admin May 21 21:00:40.982902 ncdv-master-1 devstack@n-api.service[115507]: method: > May 21 21:00:40.982902 ncdv-master-1 devstack@n-api.service[115507]: exception: Flavor 42 could not be found. May 21 21:00:40.982902 ncdv-master-1 devstack@n-api.service[115507]: action_args: {'id': '42'} May 21 21:00:40.982902 ncdv-master-1 devstack@n-api.service[115507]: {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:00:40.982902 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:00:40.984020 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 21 21:00:40.984020 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 21 21:00:40.984020 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 21 21:00:40.984020 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 21 21:00:40.984020 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:00:40.984020 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:00:40.984020 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 21 21:00:40.984020 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 21 21:00:40.984020 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 21 21:00:40.984020 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:00:40.984020 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 21 21:00:40.984020 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 21 21:00:40.984020 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 21 21:00:40.984020 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi May 21 21:00:40.984020 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:00:40.984020 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi May 21 21:00:40.984020 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:00:40.984020 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:00:40.984020 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:00:40.985387 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:00:40.985387 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:00:40.985387 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:00:40.985387 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:00:40.985387 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 21 21:00:40.985387 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:00:40.985387 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 21 21:00:40.985387 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi May 21 21:00:40.985387 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:00:40.985387 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi May 21 21:00:40.985387 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:00:40.985387 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:00:40.985387 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:00:40.985387 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:00:40.985387 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:00:40.985387 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 21 21:00:40.985387 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi May 21 21:00:40.985387 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-e615ed6a-d7d8-4c23-bf3c-9e3758148606 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:00:40.986674 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-e615ed6a-d7d8-4c23-bf3c-9e3758148606 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014745 May 21 21:00:40.986674 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Sat May 21 21:00:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 21 21:00:41.868390 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-9c0f7846-4183-4f6e-a6ff-4427b3f74a1f admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:41.869407 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-9c0f7846-4183-4f6e-a6ff-4427b3f74a1f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 21 21:00:41.869799 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Sat May 21 21:00:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:00:42.069580 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-69b58a73-23aa-467e-8ebb-9074048ba9de admin admin] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:42.074565 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.wsgi [None req-69b58a73-23aa-467e-8ebb-9074048ba9de admin admin] HTTP exception thrown: Flavor 84 could not be found. May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-69b58a73-23aa-467e-8ebb-9074048ba9de admin admin] Request method failure captured: May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: Accept: application/json May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: Accept-Encoding: gzip, deflate May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: Connection: keep-alive May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: Content-Length: 0 May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: Host: 10.222.0.49 May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: Openstack-Api-Version: compute 2.90 May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: Openstack-System-Scope: None May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: User-Agent: python-novaclient May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: X-Auth-Token: gAAAAABiiVL5wLs8y0Wx7THGpvTbJRnxwzp_8cLbbjiHgnbMQNtWLLrSuLbils2KxgoRNRvyZJL5VelkCgFOxWWn6r3lRM7Ki6zNbF6kHQyM5TO3GJmavClv_z9qoyxCOi-w1Q3HFnXsA6oRcidrsILHWV5kA89QgWi8x8Y5W8zBhEonYsyamkQ May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: X-Domain-Id: None May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: X-Domain-Name: None May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: X-Identity-Status: Confirmed May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: X-Is-Admin-Project: True May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: X-Openstack-Nova-Api-Version: 2.90 May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: X-Project-Domain-Id: default May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: X-Project-Domain-Name: Default May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: X-Project-Id: b5593f8cb452404083dfa177b4ee68b8 May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: X-Project-Name: admin May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: X-Role: reader,admin,member May 21 21:00:42.076036 ncdv-master-1 devstack@n-api.service[115507]: X-Roles: reader,admin,member May 21 21:00:42.077676 ncdv-master-1 devstack@n-api.service[115507]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b5593f8cb452404083dfa177b4ee68b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5593f8cb452404083dfa177b4ee68b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b5593f8cb452404083dfa177b4ee68b8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5593f8cb452404083dfa177b4ee68b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:00:42.077676 ncdv-master-1 devstack@n-api.service[115507]: X-Tenant: admin May 21 21:00:42.077676 ncdv-master-1 devstack@n-api.service[115507]: X-Tenant-Id: b5593f8cb452404083dfa177b4ee68b8 May 21 21:00:42.077676 ncdv-master-1 devstack@n-api.service[115507]: X-Tenant-Name: admin May 21 21:00:42.077676 ncdv-master-1 devstack@n-api.service[115507]: X-User: admin May 21 21:00:42.077676 ncdv-master-1 devstack@n-api.service[115507]: X-User-Domain-Id: default May 21 21:00:42.077676 ncdv-master-1 devstack@n-api.service[115507]: X-User-Domain-Name: Default May 21 21:00:42.077676 ncdv-master-1 devstack@n-api.service[115507]: X-User-Id: 291e5d00cba94693b9ef1c99dd62f6a4 May 21 21:00:42.077676 ncdv-master-1 devstack@n-api.service[115507]: X-User-Name: admin May 21 21:00:42.077676 ncdv-master-1 devstack@n-api.service[115507]: method: > May 21 21:00:42.077676 ncdv-master-1 devstack@n-api.service[115507]: exception: Flavor 84 could not be found. May 21 21:00:42.077676 ncdv-master-1 devstack@n-api.service[115507]: action_args: {'id': '84'} May 21 21:00:42.077676 ncdv-master-1 devstack@n-api.service[115507]: {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:00:42.077676 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:00:42.078783 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 21 21:00:42.078783 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 21 21:00:42.078783 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 21 21:00:42.078783 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 21 21:00:42.078783 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:00:42.078783 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:00:42.078783 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 21 21:00:42.078783 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 21 21:00:42.078783 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 21 21:00:42.078783 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:00:42.078783 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 21 21:00:42.078783 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 21 21:00:42.078783 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 21 21:00:42.078783 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi May 21 21:00:42.078783 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:00:42.078783 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi May 21 21:00:42.078783 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:00:42.078783 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:00:42.078783 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:00:42.080221 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:00:42.080221 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:00:42.080221 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:00:42.080221 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:00:42.080221 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 21 21:00:42.080221 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:00:42.080221 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 21 21:00:42.080221 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi May 21 21:00:42.080221 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:00:42.080221 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi May 21 21:00:42.080221 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:00:42.080221 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:00:42.080221 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:00:42.080221 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:00:42.080221 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:00:42.080221 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 21 21:00:42.080221 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi May 21 21:00:42.080221 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-69b58a73-23aa-467e-8ebb-9074048ba9de admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:00:42.081663 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-69b58a73-23aa-467e-8ebb-9074048ba9de admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.064336 May 21 21:00:42.081663 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Sat May 21 21:00:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 21 21:00:42.087371 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-b04f70a6-d71c-40bd-9ebb-4d8a852ebb3a admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:42.101746 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-b04f70a6-d71c-40bd-9ebb-4d8a852ebb3a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018015 May 21 21:00:42.102267 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Sat May 21 21:00:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:00:42.111409 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-e5f92091-4396-4dd7-991b-c21c49f0194e admin admin] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:42.125828 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-e5f92091-4396-4dd7-991b-c21c49f0194e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017884 May 21 21:00:42.126348 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Sat May 21 21:00:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:00:42.135673 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-80e44e14-9cbb-489b-9316-10424705bcff admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:42.141190 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.wsgi [None req-80e44e14-9cbb-489b-9316-10424705bcff admin admin] HTTP exception thrown: Flavor 84 could not be found. May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-80e44e14-9cbb-489b-9316-10424705bcff admin admin] Request method failure captured: May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: Accept: application/json May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: Accept-Encoding: gzip, deflate May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: Connection: keep-alive May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: Content-Length: 0 May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: Host: 10.222.0.49 May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: Openstack-Api-Version: compute 2.90 May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: Openstack-System-Scope: None May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: User-Agent: python-novaclient May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: X-Auth-Token: gAAAAABiiVL5wLs8y0Wx7THGpvTbJRnxwzp_8cLbbjiHgnbMQNtWLLrSuLbils2KxgoRNRvyZJL5VelkCgFOxWWn6r3lRM7Ki6zNbF6kHQyM5TO3GJmavClv_z9qoyxCOi-w1Q3HFnXsA6oRcidrsILHWV5kA89QgWi8x8Y5W8zBhEonYsyamkQ May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: X-Domain-Id: None May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: X-Domain-Name: None May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: X-Identity-Status: Confirmed May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: X-Is-Admin-Project: True May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: X-Openstack-Nova-Api-Version: 2.90 May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: X-Project-Domain-Id: default May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: X-Project-Domain-Name: Default May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: X-Project-Id: b5593f8cb452404083dfa177b4ee68b8 May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: X-Project-Name: admin May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: X-Role: reader,admin,member May 21 21:00:42.142900 ncdv-master-1 devstack@n-api.service[115506]: X-Roles: reader,admin,member May 21 21:00:42.144438 ncdv-master-1 devstack@n-api.service[115506]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b5593f8cb452404083dfa177b4ee68b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5593f8cb452404083dfa177b4ee68b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b5593f8cb452404083dfa177b4ee68b8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5593f8cb452404083dfa177b4ee68b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:00:42.144438 ncdv-master-1 devstack@n-api.service[115506]: X-Tenant: admin May 21 21:00:42.144438 ncdv-master-1 devstack@n-api.service[115506]: X-Tenant-Id: b5593f8cb452404083dfa177b4ee68b8 May 21 21:00:42.144438 ncdv-master-1 devstack@n-api.service[115506]: X-Tenant-Name: admin May 21 21:00:42.144438 ncdv-master-1 devstack@n-api.service[115506]: X-User: admin May 21 21:00:42.144438 ncdv-master-1 devstack@n-api.service[115506]: X-User-Domain-Id: default May 21 21:00:42.144438 ncdv-master-1 devstack@n-api.service[115506]: X-User-Domain-Name: Default May 21 21:00:42.144438 ncdv-master-1 devstack@n-api.service[115506]: X-User-Id: 291e5d00cba94693b9ef1c99dd62f6a4 May 21 21:00:42.144438 ncdv-master-1 devstack@n-api.service[115506]: X-User-Name: admin May 21 21:00:42.144438 ncdv-master-1 devstack@n-api.service[115506]: method: > May 21 21:00:42.144438 ncdv-master-1 devstack@n-api.service[115506]: exception: Flavor 84 could not be found. May 21 21:00:42.144438 ncdv-master-1 devstack@n-api.service[115506]: action_args: {'id': '84'} May 21 21:00:42.144438 ncdv-master-1 devstack@n-api.service[115506]: {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:00:42.144438 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:00:42.148425 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 21 21:00:42.148425 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 21 21:00:42.148425 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 21 21:00:42.148425 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 21 21:00:42.148425 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:00:42.148425 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:00:42.148425 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 21 21:00:42.148425 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 21 21:00:42.148425 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 21 21:00:42.148425 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:00:42.148425 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 21 21:00:42.148425 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 21 21:00:42.148425 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 21 21:00:42.148425 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi May 21 21:00:42.148425 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:00:42.148425 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi May 21 21:00:42.148425 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:00:42.148425 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:00:42.148425 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:00:42.149774 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:00:42.149774 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:00:42.149774 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:00:42.149774 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:00:42.149774 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 21 21:00:42.149774 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:00:42.149774 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 21 21:00:42.149774 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi May 21 21:00:42.149774 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:00:42.149774 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi May 21 21:00:42.149774 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:00:42.149774 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:00:42.149774 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:00:42.149774 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:00:42.149774 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:00:42.149774 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 21 21:00:42.149774 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi May 21 21:00:42.149774 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-80e44e14-9cbb-489b-9316-10424705bcff admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115506) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:00:42.151093 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-80e44e14-9cbb-489b-9316-10424705bcff admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011868 May 21 21:00:42.151093 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Sat May 21 21:00:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 21 21:00:43.033509 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-e5f92091-4396-4dd7-991b-c21c49f0194e admin admin] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:43.034588 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-e5f92091-4396-4dd7-991b-c21c49f0194e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 21 21:00:43.034972 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Sat May 21 21:00:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:00:43.232776 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-aa65b47e-db11-46d9-b759-8057b35561a4 admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:43.238529 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.wsgi [None req-aa65b47e-db11-46d9-b759-8057b35561a4 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-aa65b47e-db11-46d9-b759-8057b35561a4 admin admin] Request method failure captured: May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: Accept: application/json May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: Accept-Encoding: gzip, deflate May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: Connection: keep-alive May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: Content-Length: 0 May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: Host: 10.222.0.49 May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: Openstack-Api-Version: compute 2.90 May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: Openstack-System-Scope: None May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: User-Agent: python-novaclient May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: X-Auth-Token: gAAAAABiiVL7XXSJYnN28WzJqs6955e-vmAMXcxyVvRsPzJ9oSK_eye4_gfRM7CA7aqOhftqlCyXoLGsInx2ZiQwm8mjXHnQleEvdgTT9qbED5dtZKrSE-tCBO5Vnn_iua7Uo4AoeXN2jmDND5Xh8dGLBBk3PxchvYKJBwD3z27trOpcfGpbNh4 May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: X-Domain-Id: None May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: X-Domain-Name: None May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: X-Identity-Status: Confirmed May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: X-Is-Admin-Project: True May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: X-Openstack-Nova-Api-Version: 2.90 May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: X-Project-Domain-Id: default May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: X-Project-Domain-Name: Default May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: X-Project-Id: b5593f8cb452404083dfa177b4ee68b8 May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: X-Project-Name: admin May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: X-Role: reader,admin,member May 21 21:00:43.241152 ncdv-master-1 devstack@n-api.service[115506]: X-Roles: reader,admin,member May 21 21:00:43.246962 ncdv-master-1 devstack@n-api.service[115506]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b5593f8cb452404083dfa177b4ee68b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5593f8cb452404083dfa177b4ee68b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b5593f8cb452404083dfa177b4ee68b8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5593f8cb452404083dfa177b4ee68b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:00:43.246962 ncdv-master-1 devstack@n-api.service[115506]: X-Tenant: admin May 21 21:00:43.246962 ncdv-master-1 devstack@n-api.service[115506]: X-Tenant-Id: b5593f8cb452404083dfa177b4ee68b8 May 21 21:00:43.246962 ncdv-master-1 devstack@n-api.service[115506]: X-Tenant-Name: admin May 21 21:00:43.246962 ncdv-master-1 devstack@n-api.service[115506]: X-User: admin May 21 21:00:43.246962 ncdv-master-1 devstack@n-api.service[115506]: X-User-Domain-Id: default May 21 21:00:43.246962 ncdv-master-1 devstack@n-api.service[115506]: X-User-Domain-Name: Default May 21 21:00:43.246962 ncdv-master-1 devstack@n-api.service[115506]: X-User-Id: 291e5d00cba94693b9ef1c99dd62f6a4 May 21 21:00:43.246962 ncdv-master-1 devstack@n-api.service[115506]: X-User-Name: admin May 21 21:00:43.246962 ncdv-master-1 devstack@n-api.service[115506]: method: > May 21 21:00:43.246962 ncdv-master-1 devstack@n-api.service[115506]: exception: Flavor 451 could not be found. May 21 21:00:43.246962 ncdv-master-1 devstack@n-api.service[115506]: action_args: {'id': '451'} May 21 21:00:43.246962 ncdv-master-1 devstack@n-api.service[115506]: {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:00:43.246962 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:00:43.247940 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 21 21:00:43.247940 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 21 21:00:43.247940 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 21 21:00:43.247940 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 21 21:00:43.247940 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:00:43.247940 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:00:43.247940 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 21 21:00:43.247940 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 21 21:00:43.247940 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 21 21:00:43.247940 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:00:43.247940 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 21 21:00:43.247940 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 21 21:00:43.247940 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 21 21:00:43.247940 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi May 21 21:00:43.247940 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:00:43.247940 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi May 21 21:00:43.247940 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:00:43.247940 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:00:43.247940 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:00:43.249336 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:00:43.249336 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:00:43.249336 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:00:43.249336 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:00:43.249336 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 21 21:00:43.249336 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:00:43.249336 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 21 21:00:43.249336 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi May 21 21:00:43.249336 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:00:43.249336 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi May 21 21:00:43.249336 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:00:43.249336 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:00:43.249336 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:00:43.249336 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:00:43.249336 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:00:43.249336 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 21 21:00:43.249336 ncdv-master-1 devstack@n-api.service[115506]: ERROR nova.api.openstack.wsgi May 21 21:00:43.249336 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-aa65b47e-db11-46d9-b759-8057b35561a4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115506) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:00:43.250634 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-aa65b47e-db11-46d9-b759-8057b35561a4 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061975 May 21 21:00:43.250634 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Sat May 21 21:00:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 21 21:00:43.251992 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-fc28d599-d643-4dbb-8691-104814038f5d admin admin] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:43.266663 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-fc28d599-d643-4dbb-8691-104814038f5d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018180 May 21 21:00:43.267177 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Sat May 21 21:00:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:00:43.278308 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-ca002582-824f-4c68-b7cd-f998806d4827 admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:43.291883 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-ca002582-824f-4c68-b7cd-f998806d4827 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017121 May 21 21:00:43.292429 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Sat May 21 21:00:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:00:43.302768 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-0ee4ce57-fecb-4f66-93be-2be56bf23228 admin admin] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:43.308102 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.wsgi [None req-0ee4ce57-fecb-4f66-93be-2be56bf23228 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-0ee4ce57-fecb-4f66-93be-2be56bf23228 admin admin] Request method failure captured: May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: Accept: application/json May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: Accept-Encoding: gzip, deflate May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: Connection: keep-alive May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: Content-Length: 0 May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: Host: 10.222.0.49 May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: Openstack-Api-Version: compute 2.90 May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: Openstack-System-Scope: None May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: User-Agent: python-novaclient May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: X-Auth-Token: gAAAAABiiVL7XXSJYnN28WzJqs6955e-vmAMXcxyVvRsPzJ9oSK_eye4_gfRM7CA7aqOhftqlCyXoLGsInx2ZiQwm8mjXHnQleEvdgTT9qbED5dtZKrSE-tCBO5Vnn_iua7Uo4AoeXN2jmDND5Xh8dGLBBk3PxchvYKJBwD3z27trOpcfGpbNh4 May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: X-Domain-Id: None May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: X-Domain-Name: None May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: X-Identity-Status: Confirmed May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: X-Is-Admin-Project: True May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: X-Openstack-Nova-Api-Version: 2.90 May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: X-Project-Domain-Id: default May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: X-Project-Domain-Name: Default May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: X-Project-Id: b5593f8cb452404083dfa177b4ee68b8 May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: X-Project-Name: admin May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: X-Role: reader,admin,member May 21 21:00:43.309662 ncdv-master-1 devstack@n-api.service[115507]: X-Roles: reader,admin,member May 21 21:00:43.311066 ncdv-master-1 devstack@n-api.service[115507]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b5593f8cb452404083dfa177b4ee68b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5593f8cb452404083dfa177b4ee68b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b5593f8cb452404083dfa177b4ee68b8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5593f8cb452404083dfa177b4ee68b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:00:43.311066 ncdv-master-1 devstack@n-api.service[115507]: X-Tenant: admin May 21 21:00:43.311066 ncdv-master-1 devstack@n-api.service[115507]: X-Tenant-Id: b5593f8cb452404083dfa177b4ee68b8 May 21 21:00:43.311066 ncdv-master-1 devstack@n-api.service[115507]: X-Tenant-Name: admin May 21 21:00:43.311066 ncdv-master-1 devstack@n-api.service[115507]: X-User: admin May 21 21:00:43.311066 ncdv-master-1 devstack@n-api.service[115507]: X-User-Domain-Id: default May 21 21:00:43.311066 ncdv-master-1 devstack@n-api.service[115507]: X-User-Domain-Name: Default May 21 21:00:43.311066 ncdv-master-1 devstack@n-api.service[115507]: X-User-Id: 291e5d00cba94693b9ef1c99dd62f6a4 May 21 21:00:43.311066 ncdv-master-1 devstack@n-api.service[115507]: X-User-Name: admin May 21 21:00:43.311066 ncdv-master-1 devstack@n-api.service[115507]: method: > May 21 21:00:43.311066 ncdv-master-1 devstack@n-api.service[115507]: exception: Flavor 451 could not be found. May 21 21:00:43.311066 ncdv-master-1 devstack@n-api.service[115507]: action_args: {'id': '451'} May 21 21:00:43.311066 ncdv-master-1 devstack@n-api.service[115507]: {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:00:43.311066 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:00:43.312921 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 21 21:00:43.312921 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 21 21:00:43.312921 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 21 21:00:43.312921 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 21 21:00:43.312921 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:00:43.312921 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:00:43.312921 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 21 21:00:43.312921 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 21 21:00:43.312921 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 21 21:00:43.312921 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:00:43.312921 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 21 21:00:43.312921 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 21 21:00:43.312921 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 21 21:00:43.312921 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi May 21 21:00:43.312921 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:00:43.312921 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi May 21 21:00:43.312921 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:00:43.312921 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:00:43.312921 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:00:43.315073 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:00:43.315073 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:00:43.315073 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:00:43.315073 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:00:43.315073 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 21 21:00:43.315073 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:00:43.315073 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 21 21:00:43.315073 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi May 21 21:00:43.315073 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:00:43.315073 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi May 21 21:00:43.315073 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:00:43.315073 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:00:43.315073 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:00:43.315073 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:00:43.315073 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:00:43.315073 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 21 21:00:43.315073 ncdv-master-1 devstack@n-api.service[115507]: ERROR nova.api.openstack.wsgi May 21 21:00:43.315073 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-0ee4ce57-fecb-4f66-93be-2be56bf23228 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:00:43.316812 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-0ee4ce57-fecb-4f66-93be-2be56bf23228 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012823 May 21 21:00:43.316812 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Sat May 21 21:00:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 21 21:00:44.203552 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-ca002582-824f-4c68-b7cd-f998806d4827 admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:44.204569 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-ca002582-824f-4c68-b7cd-f998806d4827 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 May 21 21:00:44.204962 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Sat May 21 21:00:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:00:44.404954 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-9466839e-8137-4a45-87c1-13ae65bccc7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:00:44.496392 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-9466839e-8137-4a45-87c1-13ae65bccc7f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.143493 May 21 21:00:44.496863 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Sat May 21 21:00:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:00:45.378667 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-ca002582-824f-4c68-b7cd-f998806d4827 admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:45.380443 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-ca002582-824f-4c68-b7cd-f998806d4827 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002143 May 21 21:00:45.380838 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Sat May 21 21:00:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:00:45.582932 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-451a1817-90d8-481e-8792-44034c5f19c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:00:45.684337 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-451a1817-90d8-481e-8792-44034c5f19c9 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.155286 May 21 21:00:45.684892 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Sat May 21 21:00:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:00:46.565383 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-ca002582-824f-4c68-b7cd-f998806d4827 admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:46.566383 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-ca002582-824f-4c68-b7cd-f998806d4827 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 May 21 21:00:46.567465 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Sat May 21 21:00:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:00:46.766996 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-824293da-c5d2-4b48-a082-1ec7b404fac6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:00:46.843643 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-824293da-c5d2-4b48-a082-1ec7b404fac6 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.128794 May 21 21:00:46.844131 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Sat May 21 21:00:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:00:47.729208 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-ca002582-824f-4c68-b7cd-f998806d4827 admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:47.730203 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-ca002582-824f-4c68-b7cd-f998806d4827 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 May 21 21:00:47.730594 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Sat May 21 21:00:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:00:47.926813 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-c7f39160-5bde-4c17-b7b5-0343385ce637 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:00:48.015515 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-c7f39160-5bde-4c17-b7b5-0343385ce637 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.142175 May 21 21:00:48.015979 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Sat May 21 21:00:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:00:48.896446 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-ca002582-824f-4c68-b7cd-f998806d4827 admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:48.897685 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-ca002582-824f-4c68-b7cd-f998806d4827 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001638 May 21 21:00:48.898192 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Sat May 21 21:00:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:00:49.095191 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-dfe7a5da-8108-404d-b5d1-f10ef1429422 admin admin] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:00:49.114891 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-dfe7a5da-8108-404d-b5d1-f10ef1429422 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071528 May 21 21:00:49.115409 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Sat May 21 21:00:49 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:01:54.407928 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-ca002582-824f-4c68-b7cd-f998806d4827 admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:01:54.408975 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-ca002582-824f-4c68-b7cd-f998806d4827 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 21 21:01:54.409362 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 930 bytes} [Sat May 21 21:01:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:01:54.418231 ncdv-master-1 devstack@n-api.service[115507]: DEBUG dbcounter [-] [115507] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:01:54.470361 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-0a760a2a-e2bb-4c43-9864-2c65444dacea admin admin] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:01:54.490174 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-0a760a2a-e2bb-4c43-9864-2c65444dacea admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073503 May 21 21:01:54.490706 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1291 bytes} [Sat May 21 21:01:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:01:54.511352 ncdv-master-1 devstack@n-api.service[115506]: DEBUG dbcounter [-] [115506] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=115506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:01:54.515638 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-d0fd55ca-8a9c-4b89-a40e-059301f2765d admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:01:54.523606 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-d0fd55ca-8a9c-4b89-a40e-059301f2765d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013623 May 21 21:01:54.524122 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1282 bytes} [Sat May 21 21:01:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:01:54.536107 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-3eca3698-cde1-45bb-9004-caeb46fc2012 admin admin] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:01:54.543746 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-3eca3698-cde1-45bb-9004-caeb46fc2012 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011294 May 21 21:01:54.544405 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1285 bytes} [Sat May 21 21:01:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:01:54.556028 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-74af41e9-01a4-4fe8-a8ca-e44d91cc2cd6 admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:01:54.564576 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-74af41e9-01a4-4fe8-a8ca-e44d91cc2cd6 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012465 May 21 21:01:54.568414 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1285 bytes} [Sat May 21 21:01:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:01:54.576474 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-4e7d54a7-4ac0-4fe5-8b34-281702d9f5af admin admin] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:01:54.584722 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-4e7d54a7-4ac0-4fe5-8b34-281702d9f5af admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011781 May 21 21:01:54.585424 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1282 bytes} [Sat May 21 21:01:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:08:18.226763 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-74af41e9-01a4-4fe8-a8ca-e44d91cc2cd6 admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:08:18.227767 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-74af41e9-01a4-4fe8-a8ca-e44d91cc2cd6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 21 21:08:18.228161 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Sat May 21 21:08:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:08:18.388711 ncdv-master-1 devstack@n-api.service[115507]: DEBUG dbcounter [-] [115507] Writing DB stats nova_api:SELECT=6 {{(pid=115507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:08:18.501224 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-629e65aa-c6c6-4707-a775-b1f99cb051cb admin admin] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:08:18.502381 ncdv-master-1 devstack@n-api.service[115507]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:08:18.502381 ncdv-master-1 devstack@n-api.service[115507]: warnings.warn(msg) May 21 21:08:18.503601 ncdv-master-1 devstack@n-api.service[115507]: DEBUG oslo_concurrency.lockutils [None req-629e65aa-c6c6-4707-a775-b1f99cb051cb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:08:18.504039 ncdv-master-1 devstack@n-api.service[115507]: DEBUG oslo_concurrency.lockutils [None req-629e65aa-c6c6-4707-a775-b1f99cb051cb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:08:18.505372 ncdv-master-1 devstack@n-api.service[115507]: DEBUG oslo_concurrency.lockutils [None req-629e65aa-c6c6-4707-a775-b1f99cb051cb admin admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:08:18.505796 ncdv-master-1 devstack@n-api.service[115507]: DEBUG oslo_concurrency.lockutils [None req-629e65aa-c6c6-4707-a775-b1f99cb051cb admin admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:08:18.546179 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-629e65aa-c6c6-4707-a775-b1f99cb051cb admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.159018 May 21 21:08:18.546748 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Sat May 21 21:08:18 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:08:19.433579 ncdv-master-1 devstack@n-api.service[115506]: DEBUG nova.api.openstack.wsgi [None req-74af41e9-01a4-4fe8-a8ca-e44d91cc2cd6 admin admin] Calling method '>' {{(pid=115506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:08:19.434595 ncdv-master-1 devstack@n-api.service[115506]: INFO nova.api.openstack.requestlog [None req-74af41e9-01a4-4fe8-a8ca-e44d91cc2cd6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 21 21:08:19.434989 ncdv-master-1 devstack@n-api.service[115506]: [pid: 115506|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Sat May 21 21:08:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:08:19.633857 ncdv-master-1 devstack@n-api.service[115507]: DEBUG nova.api.openstack.wsgi [None req-3829fb12-8b9f-4291-9c49-b2450bb87e4f admin admin] Calling method '>' {{(pid=115507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:08:19.635061 ncdv-master-1 devstack@n-api.service[115507]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:08:19.635061 ncdv-master-1 devstack@n-api.service[115507]: warnings.warn(msg) May 21 21:08:19.636263 ncdv-master-1 devstack@n-api.service[115507]: DEBUG oslo_concurrency.lockutils [None req-3829fb12-8b9f-4291-9c49-b2450bb87e4f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:08:19.636738 ncdv-master-1 devstack@n-api.service[115507]: DEBUG oslo_concurrency.lockutils [None req-3829fb12-8b9f-4291-9c49-b2450bb87e4f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:08:19.637522 ncdv-master-1 devstack@n-api.service[115507]: DEBUG oslo_concurrency.lockutils [None req-3829fb12-8b9f-4291-9c49-b2450bb87e4f admin admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:08:19.637949 ncdv-master-1 devstack@n-api.service[115507]: DEBUG oslo_concurrency.lockutils [None req-3829fb12-8b9f-4291-9c49-b2450bb87e4f admin admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:08:19.662494 ncdv-master-1 devstack@n-api.service[115507]: INFO nova.api.openstack.requestlog [None req-3829fb12-8b9f-4291-9c49-b2450bb87e4f admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.080676 May 21 21:08:19.662958 ncdv-master-1 devstack@n-api.service[115507]: [pid: 115507|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Sat May 21 21:08:19 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:09:07.676886 ncdv-master-1 devstack@n-api.service[115505]: Sat May 21 21:09:07 2022 - graceful shutdown triggered... May 21 21:09:07.676523 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... May 21 21:09:07.677982 ncdv-master-1 devstack@n-api.service[115506]: Gracefully killing worker 1 (pid: 115506)... May 21 21:09:07.678495 ncdv-master-1 devstack@n-api.service[115507]: Gracefully killing worker 2 (pid: 115507)... May 21 21:09:08.677347 ncdv-master-1 devstack@n-api.service[115505]: worker 1 buried after 1 seconds May 21 21:09:08.677347 ncdv-master-1 devstack@n-api.service[115505]: worker 2 buried after 1 seconds May 21 21:09:08.677347 ncdv-master-1 devstack@n-api.service[115505]: goodbye to uWSGI. May 21 21:09:08.678894 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. May 21 21:09:08.680145 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. May 21 21:09:08.683055 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... May 21 21:09:08.719628 ncdv-master-1 devstack@n-api.service[131267]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 21 21:09:08.721579 ncdv-master-1 devstack@n-api.service[131267]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat May 21 21:09:08 2022] *** May 21 21:09:08.721579 ncdv-master-1 devstack@n-api.service[131267]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 21 21:09:08.721579 ncdv-master-1 devstack@n-api.service[131267]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 21 21:09:08.721579 ncdv-master-1 devstack@n-api.service[131267]: nodename: ncdv-master-1 May 21 21:09:08.721579 ncdv-master-1 devstack@n-api.service[131267]: machine: x86_64 May 21 21:09:08.721579 ncdv-master-1 devstack@n-api.service[131267]: clock source: unix May 21 21:09:08.721579 ncdv-master-1 devstack@n-api.service[131267]: pcre jit disabled May 21 21:09:08.721579 ncdv-master-1 devstack@n-api.service[131267]: detected number of CPU cores: 4 May 21 21:09:08.721579 ncdv-master-1 devstack@n-api.service[131267]: current working directory: / May 21 21:09:08.721579 ncdv-master-1 devstack@n-api.service[131267]: detected binary path: /usr/bin/uwsgi-core May 21 21:09:08.722370 ncdv-master-1 devstack@n-api.service[131267]: your processes number limit is 47680 May 21 21:09:08.722370 ncdv-master-1 devstack@n-api.service[131267]: your memory page size is 4096 bytes May 21 21:09:08.722370 ncdv-master-1 devstack@n-api.service[131267]: detected max file descriptor number: 2048 May 21 21:09:08.722370 ncdv-master-1 devstack@n-api.service[131267]: lock engine: pthread robust mutexes May 21 21:09:08.722370 ncdv-master-1 devstack@n-api.service[131267]: thunder lock: enabled May 21 21:09:08.722370 ncdv-master-1 devstack@n-api.service[131267]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 21 21:09:08.722370 ncdv-master-1 devstack@n-api.service[131267]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 21 21:09:08.773772 ncdv-master-1 devstack@n-api.service[131267]: Python main interpreter initialized at 0x5591331a19c0 May 21 21:09:08.773772 ncdv-master-1 devstack@n-api.service[131267]: python threads support enabled May 21 21:09:08.773772 ncdv-master-1 devstack@n-api.service[131267]: your server socket listen backlog is limited to 100 connections May 21 21:09:08.773772 ncdv-master-1 devstack@n-api.service[131267]: your mercy for graceful operations on workers is 90 seconds May 21 21:09:08.774169 ncdv-master-1 devstack@n-api.service[131267]: mapped 403077 bytes (393 KB) for 2 cores May 21 21:09:08.774261 ncdv-master-1 devstack@n-api.service[131267]: *** Operational MODE: preforking *** May 21 21:09:08.774466 ncdv-master-1 devstack@n-api.service[131267]: *** uWSGI is running in multiple interpreter mode *** May 21 21:09:08.774466 ncdv-master-1 devstack@n-api.service[131267]: spawned uWSGI master process (pid: 131267) May 21 21:09:08.774675 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. May 21 21:09:08.775422 ncdv-master-1 devstack@n-api.service[131267]: spawned uWSGI worker 1 (pid: 131277, cores: 1) May 21 21:09:08.775658 ncdv-master-1 devstack@n-api.service[131267]: spawned uWSGI worker 2 (pid: 131278, cores: 1) May 21 21:09:08.775828 ncdv-master-1 devstack@n-api.service[131267]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 21 21:09:10.055345 ncdv-master-1 devstack@n-api.service[131277]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 21 21:09:10.055934 ncdv-master-1 devstack@n-api.service[131278]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 21 21:09:10.887115 ncdv-master-1 devstack@n-api.service[131278]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 21 21:09:10.887115 ncdv-master-1 devstack@n-api.service[131278]: from cryptography.utils import int_from_bytes May 21 21:09:10.887454 ncdv-master-1 devstack@n-api.service[131278]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 21 21:09:10.887454 ncdv-master-1 devstack@n-api.service[131278]: from cryptography.utils import int_from_bytes May 21 21:09:10.887726 ncdv-master-1 devstack@n-api.service[131277]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 21 21:09:10.887726 ncdv-master-1 devstack@n-api.service[131277]: from cryptography.utils import int_from_bytes May 21 21:09:10.888049 ncdv-master-1 devstack@n-api.service[131277]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 21 21:09:10.888049 ncdv-master-1 devstack@n-api.service[131277]: from cryptography.utils import int_from_bytes May 21 21:09:13.369769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 21 21:09:13.370449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 21 21:09:13.370449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 21 21:09:13.370881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 21 21:09:13.370969 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 21 21:09:13.371060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 21 21:09:13.371153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 21 21:09:13.371239 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 21 21:09:13.371321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 21 21:09:13.371406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 21 21:09:13.371800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.371919 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.372016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.372102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.372184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.372269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.372542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.372646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.372892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.373020 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.373207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.373316 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.373539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.373653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.373872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.373980 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.374216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.374326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.374513 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.374628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.374807 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.374985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.375144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.375298 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.375536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.375693 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.375847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.376026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.376199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.376379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.376566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.376729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.376888 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.377035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.377227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.377389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.377548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.377709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.377857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.379300 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.379300 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.379793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.380022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.380256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.380522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.380744 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.380973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.381200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.381422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.381649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.381863 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.382077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.382077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.382509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.382751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.382968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.383203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.383430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.383659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.383901 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.384123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.384363 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.384615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.384814 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.384814 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.385331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.386234 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.386435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.386616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.386788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.386958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.387113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.387269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.387417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.387607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.387909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.388071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.388219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.388416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.388579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.388727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.388893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.389041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.389188 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.389345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.389508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.389663 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.389811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.389970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.390125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.390354 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.390516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.390699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.390849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.391018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.391172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.391328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.391491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.391639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.391787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.391941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.392095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.392515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.392685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.392846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.393005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.393159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.393326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.393485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.393646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.393799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.393955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.394104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.394268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.394425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.394583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.394738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.394898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.395082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.395417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.395605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.396233 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.396491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.396660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.396821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.396979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.397139 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.397286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.397440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.398210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.398375 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.398524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.398671 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.398817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.398963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.399121 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.399288 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.399445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.399592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.399745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.399900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.400047 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.400218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.400416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.400572 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.400719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.400865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.401022 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.401177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.401368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.401519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.401667 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.401820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.401977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.402130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.402298 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.402445 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.402599 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.402752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.402909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.403056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.403210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.403365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.403520 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.403675 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.403872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.404028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.404183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.404389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.404552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.404715 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.404870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.405017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.405163 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.405736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.406775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.406954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.407105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.407252 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.407407 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.407582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.407731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.407890 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.408046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.408323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.408497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.408655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.408812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.408973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.409129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.409285 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.409441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.409595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.409764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.409922 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.410077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.410224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.410382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.410538 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.410778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.410929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.411094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.411094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.411434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.411586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.411744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.411913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.412069 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.412225 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.412438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.412596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.412757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.412905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.413251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.413924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.414075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.414374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.414543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.414731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.414897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.415057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.415213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.415361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.415628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.415868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.416022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.416187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.416948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.417123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.417287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.417435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.417590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.417758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.417913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.418088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.418237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.418493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.418655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.418812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.418968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.419137 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.419291 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.419438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.419585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.419739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.419908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.420067 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.420224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.420411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.420558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.420718 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.420874 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.421034 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.421195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.421354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.421511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.421665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.421833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.421981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.422140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.422288 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.422442 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.422596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.422758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.422905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.423058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.423207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.423372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.423519 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.423675 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.423841 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.423987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.424133 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.424300 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 21:09:13.424454 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.424614 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.424761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.424915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.425070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.425215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.425377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.425543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.425770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.426029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.426193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.426350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.427106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.427274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.427431 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.427587 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.427735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.427891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.428053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.428209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.428402 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.428679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.428894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.429100 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.429346 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.429501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.429669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.429817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.429964 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.430125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.430286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.430441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.430601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.430769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.430980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.431140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.431299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.431454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.431602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.431748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.431903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.432065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.432222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.432435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.432584 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.432741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.432908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.433055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.433211 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.433400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.433560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.433718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.433865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.434025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.434180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.434335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.434489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.434636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.434792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.434963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.435119 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.435274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.435429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.435583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.435758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.436025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.436258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.436430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.436732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.437355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.437524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.437689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.437850 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.438006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.438153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.438309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.438456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.438617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.438909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.439062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.439209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.439365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.439524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.439729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.439889 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.440046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.440203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.440395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.440638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.440788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.440934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.441090 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.441244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.441390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.441549 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.441697 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.441852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.442021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.442169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.442315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.442477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.442634 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.442790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.442937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.443082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.443240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.443388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.443575 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.443730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.443877 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.444042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.444205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.444457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.444622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.444770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.444929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.445218 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.445376 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.445533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.445680 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.445826 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.446087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.446272 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.446527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.446699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.447491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.447651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.447807 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.447971 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.448121 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.448268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.448561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.448721 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.448886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.449143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.449304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.449474 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.449631 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.449787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.449943 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.450101 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.450257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.450412 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.450569 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.450724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.450881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.451044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.451192 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.451358 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.451507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.451665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.451830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.451978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.452126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.452273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.452494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.452645 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.452801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.452957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.453104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.453258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.453425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.453573 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.453730 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.453878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.454031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.454189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.454344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.454664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.454830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.454979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.455125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.455271 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.455416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.455589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.455738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.455885 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.456052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.457704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.457872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.458041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.458191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.458339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.458495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.458651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.458799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.458961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.459148 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.459398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.459550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.459697 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.459844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.460689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.461083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.461242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.461242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.461543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.461701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.461856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.462017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.462173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.462320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.462466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.462466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.462778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.462778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.463080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.463080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.463379 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.463544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.463706 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.463706 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.464016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.464169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.464416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.464589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.464745 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.464906 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.465060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.465224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.465388 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.465584 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.465747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.465900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.466052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.466247 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.466505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.466683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.466839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.467240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.467793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.468045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.468216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.468433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.468598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.468761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.468915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.469077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.469256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.469439 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.469695 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.469863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.470027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.470181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.470344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.470499 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.470652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.470804 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.471001 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.471175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.471330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.471503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.471771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.472008 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.472180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.472376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.472537 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.472691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.472852 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.473014 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.473168 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.473331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.473485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.473661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.473822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.473977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.474139 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.474309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.474472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.474627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.474788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.474942 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.475179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.475335 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.475535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.475752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.475927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.476089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.476258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.476560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.476723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.476877 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.477039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.477419 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.477943 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.478205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.478366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.478520 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.478520 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.478841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.479049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.479214 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.479368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.479530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.479710 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.479970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.480138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.480319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.480491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.480646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.480806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.480972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.481138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.481300 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.481454 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.481608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.481761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.481930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.482100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.482254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.482541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.482710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.482865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.483034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.483189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.483353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.483515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.483668 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.483829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.483995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.484158 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.484332 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.484493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.484657 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.484832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.484987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.485139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.485304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.485464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.485625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.485794 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.485956 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.486110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.486270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.486438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.486616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.486864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.487034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.487198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.487566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.488160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.488477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.488654 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.488819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.488982 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.489146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.489301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.489465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.489619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.489772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.489925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.490089 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.490356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.490544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.490699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.490852 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.491005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.491157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.491867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.492102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.492272 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.492454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.492706 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.492876 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.493031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.493198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.493373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.493538 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.493700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.493854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.494016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.494179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.494340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.494511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.494674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.494837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.495005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.495159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.495325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.495491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.495646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.495799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.495962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.496115 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.496293 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.496469 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.496634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.496797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.497061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.497229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.497229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.497783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.498247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.498424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.498424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.498837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.499039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.499205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.499360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.499524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.499687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.499841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.500003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.500157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.500356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.500618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.500790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.500945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.501117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.501117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.501117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.501612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.501777 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.501962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.502718 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.503012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.503226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.503226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.503549 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.503705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.503866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.504029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.504191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.504422 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.504594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.504757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.504911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.505074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.505228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.505402 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.505565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.505728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.505891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.506057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.506211 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.506376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.506530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.506684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.506854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.507098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.507350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.507521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.507932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.508411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.508576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.508844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.509022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.509187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.509352 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.509517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.509679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.509833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.509997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.510159 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.510323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.510497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.510768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.510938 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.511214 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.511386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.511542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.511697 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.511849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.512016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.512179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.512365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.512525 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.512699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.512854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.513105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.513958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.514142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.514570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.514746 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.514903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.515078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.515235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.515400 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.515564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.515726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.515901 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.516072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.516227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.516419 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.516587 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.516757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.516929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.517092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.517247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.517495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.517665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.518044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.518518 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.518705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.518877 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.519124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.519285 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.519439 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.519608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.519773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.519937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.520099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.520253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.520447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.520685 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.520964 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.521146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.521302 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.521455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.521624 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.521787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.521942 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.522103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.522258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.522417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.523120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.523349 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.523507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.523660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.523824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.523988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.524157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.524388 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.524549 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.524703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.524857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.525010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.525173 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.525327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.525490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.525644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.525808 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.525978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.526133 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.526294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.526448 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.526610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.526765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.526933 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.527089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.527261 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.527425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.527677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.527838 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.528235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.528717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.528881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.529036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.529296 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.529457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.529621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.529777 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.529939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.530105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.530260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.530684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.530849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.531131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.531302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.531459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.532218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.532421 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.532589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.532744 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.532907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.533075 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.533240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.533503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.533673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.533842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.533842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.534148 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.534304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.534467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.534620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.534774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.534942 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.535140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.535140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.535447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.535602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.535755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.535930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.536084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.536248 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.536476 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.536631 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.536785 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.536951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.537113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.537113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.537113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.537577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.537840 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.538011 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.538459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.538941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.539096 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.539260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.539552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.539793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.539961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.540116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.540315 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.540479 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.540648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.540804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.540968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.541161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.541439 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.541600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.541771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.541771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.541771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.542239 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.542395 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.542549 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.542714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.542869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.543031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.543196 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.543359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.543635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.543787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.543945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.544100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.544253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.544444 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.544610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.544766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.544919 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.545074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.545200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.545323 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.545469 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.546158 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.546269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.546371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.546462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.546560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.546660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.546760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.546849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.546938 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.547026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.547133 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.547133 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.547133 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.547387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.547487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.547584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.547687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.547777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.547941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.548035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.548035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.548217 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.548385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.548675 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.548950 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.549062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.549062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.549237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.549347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.549438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.549527 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.549625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.549625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.549807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.549898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.549986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.550082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.550195 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.550294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.550398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.550489 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.550577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.550577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.550746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.550843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.550942 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.551041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.551132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.551221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.551308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.551414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.551590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.551691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.551789 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.551879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.551967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.552069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.552464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.552579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.552681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.552779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.552779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.552779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.553027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.553027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.553199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.553289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.553386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.553485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.553603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.553749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.554423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.554528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.554614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.554703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.554787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.554877 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.554877 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.555050 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.555151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.555242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.555339 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.555437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.555437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.555437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.555681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.555771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.555858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.555946 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.556041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.556138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.556237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.556493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.556587 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.556690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.556789 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.556895 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.556895 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.557070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.557158 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.557246 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.557348 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.557438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.557538 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.557636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.557636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.557823 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.557922 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.558021 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.558176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.558279 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.558383 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.558483 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.558738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.558914 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.559063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.559198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.559294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.559399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.559492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.559590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.559679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.559767 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.559855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.559953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.560043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.560203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.560364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.560458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.560548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.560652 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.560752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.560851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.560941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.561031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.561129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.561228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.561318 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.561407 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.561495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.561585 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.561689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.561871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.561977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.562069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.562157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.562246 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.562344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.562442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.562580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.562686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.562777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.562881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.562981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.562981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.563155 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.563244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.563342 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.563442 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.563532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.563620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.563716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.563853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.563954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.563954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.563954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.564311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.564440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.564555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.564733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.564844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.564943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.565040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.565131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.565228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.565325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.565426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.565525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.565615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.565712 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.565811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.565911 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.566010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.566099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.566197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.566297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.566394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.566559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.566660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.566758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.566855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.566953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.567042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.567142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.567231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.567319 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.567419 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.567518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.567616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.567715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.567812 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.567902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.567998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.568094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.568094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.568376 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.568474 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.568552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.568552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.568920 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.569061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.569184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.569308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.569477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.569602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.569732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.569876 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.570001 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.570128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.570243 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.570371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.570491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.570626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.570725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.570802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.570875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.570962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.571065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.571165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.571301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.571426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.571541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.571656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.571785 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.571900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.572022 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.572139 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.572253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.572470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.572598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.572722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.572838 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.572960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.573076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.573199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.573199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.573425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.573425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.573656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.573787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.573913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.574051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.574175 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.574290 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.574404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.574518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.574657 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.574657 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.574873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.574994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.575163 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.575287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.575412 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.575547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.575806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.575937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.576053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.576176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.576333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.576521 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.576650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.576789 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.576931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.577077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.577244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.577393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.577528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.577662 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.577795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.577947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.578042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.578142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.578243 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.578334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.578464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.578578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.578670 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.578768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.578973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.579072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.579173 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.579272 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.579370 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.579460 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.579550 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.579728 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.579901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.580003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.580102 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.580200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.580364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.580493 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.580493 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.580714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.580714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.581000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.581104 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.581210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.581302 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.581400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.581492 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.581589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.581679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.581783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.581874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.581960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.582036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.582138 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.582236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.582336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.582434 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.582434 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.582596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.582769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.582882 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.582976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.583073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.583171 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.583260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.583431 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.583600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.583758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.583856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.583946 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.584035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.584035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.584212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.584305 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.584409 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.584513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.584612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.584612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.584612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.584612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.584612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.584612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.585641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.585747 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.585914 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.586013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.586112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.586210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.586210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.586406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.586498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.586595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.586693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.586783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.586885 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.586975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.587072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.587170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.587259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.587356 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.587459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.587556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.587654 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.587732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.587812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.587812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.588051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.588152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.588249 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.588411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.588411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.588644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.588744 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.588883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.588996 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.589096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.589194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.589298 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.589396 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.589493 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.589582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.589679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.589778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.589778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.589959 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.590035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.590131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.590220 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.590309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.590404 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.590482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.590570 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.590646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.590720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.590720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.590869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.590966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.591054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.591143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.591237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.591341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.591438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.591529 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.591625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.591715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.591715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.591884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.591974 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.592062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.592150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.592247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.592354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.592452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.592538 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.592613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.592695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.592769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.592858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.592934 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.593007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.593089 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.593171 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.593259 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.593356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.593356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.593534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.593534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.593706 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.593802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.593900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.593989 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.594085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.594174 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.594270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.594359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.594457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.594554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.594650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.594740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.594837 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.595048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.595160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.595356 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.595463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.595688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.595786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.596003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.596101 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.596340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.596655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.596763 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.596971 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.597080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.597281 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.597378 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.599607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.599775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.599912 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.600050 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.600177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.600380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.600520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.600710 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.600915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.601051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.601169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.601293 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.601409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.601525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.601652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.601769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.601886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.602000 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.602115 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.602238 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.602238 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.602472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.602587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.602710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.602827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.602949 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.603076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.603206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.603322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.603437 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.603562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.603688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.603854 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.603985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.604111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.604227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.604441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.604579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.604698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.604821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.604937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.605080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.605280 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.605417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.605552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.809716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.809854 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.809979 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.810093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.810205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.810318 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.810428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.810547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.810547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.810769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.811206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.811340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.811456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.811581 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.811709 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.811709 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.811709 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.811709 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.815625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.815850 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.815971 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.816088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.816202 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.816401 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.816586 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.816735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.816857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.816857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.817088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.817206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.817322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.817438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.817551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.817672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.817805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.817919 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.818032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.818032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.818032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.818032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.818459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.818575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.818575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.818786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.818908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.819022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.819135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.819246 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.819359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.819967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.820160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.820277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.820417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.820417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.820630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.820743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.820870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.821003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.821470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.821592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.821706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.821819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.821942 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.822057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.822170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.822283 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.822396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.822517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.822632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.822745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.822745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.822965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.823082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.823195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.823360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.823656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.823775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.823775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.823999 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.824124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.824273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.824494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.824494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.824494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.825067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.825182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.825296 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.825410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.825410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.825761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.825878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.825991 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.826157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.826157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.826385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.826499 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.826499 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.826710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.826832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.826832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.827045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.827157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.827369 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.827486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.827486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.827738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.827853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.827967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.828080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.828201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.828345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.828345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.828613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.828613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.828613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.828613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.828613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.828613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.828613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.828613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.829552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.829552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.829552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.829552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.829552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.829552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.829552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.829552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.830377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.830491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.830491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.830705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.830705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.830926 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.831042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.831042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.831270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.831872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.831997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.832125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.836584 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.836815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.837045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.837167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.837336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.837481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.837601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.837717 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.837833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.837948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.838225 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.838360 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.838592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.838709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.838870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.839016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.839240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.839343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.839550 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.839724 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.839841 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.840112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.840361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.840589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.840711 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.840816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.840912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.841026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.841155 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.841262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.841359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.841456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.841707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.842054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.842185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.842290 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.842387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.842482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.842579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.842752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.842853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.842949 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.843045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.843140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.843236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.843342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.843440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.843535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.843787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.843888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.844005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 21 21:09:13.844227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.844227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.844227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.844227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.844227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.844227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.844227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.844227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.845000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.845000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.845000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.845000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.845000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.845000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.845000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.845000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.846037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.846037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.846037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.846037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.846037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.846037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.846037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.846037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.847198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 21:09:13.847198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 21 21:09:13.847388 ncdv-master-1 devstack@n-api.service[131278]: INFO dbcounter [None req-8790f3de-b976-4bc3-9d3f-3cf0c49b7e37 None None] Registered counter for database nova_api May 21 21:09:13.847689 ncdv-master-1 devstack@n-api.service[131277]: INFO dbcounter [None req-4ec7579c-42b5-402c-9bcd-59744cd374ae None None] Registered counter for database nova_api May 21 21:09:13.847817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_db.sqlalchemy.engines [None req-8790f3de-b976-4bc3-9d3f-3cf0c49b7e37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 21 21:09:13.847947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_db.sqlalchemy.engines [None req-4ec7579c-42b5-402c-9bcd-59744cd374ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 21 21:09:13.847947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writer thread running {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 21 21:09:13.848138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writer thread running {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 21 21:09:13.848253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.context [None req-4ec7579c-42b5-402c-9bcd-59744cd374ae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4f046ce9-ac6c-44d8-b1fb-b7063eef06e7(cell1) {{(pid=131277) load_cells /opt/stack/nova/nova/context.py:464}} May 21 21:09:13.848253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ec7579c-42b5-402c-9bcd-59744cd374ae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:09:13.848585 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.context [None req-8790f3de-b976-4bc3-9d3f-3cf0c49b7e37 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4f046ce9-ac6c-44d8-b1fb-b7063eef06e7(cell1) {{(pid=131278) load_cells /opt/stack/nova/nova/context.py:464}} May 21 21:09:13.848706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ec7579c-42b5-402c-9bcd-59744cd374ae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:09:13.848706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ec7579c-42b5-402c-9bcd-59744cd374ae None None] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:09:13.848928 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8790f3de-b976-4bc3-9d3f-3cf0c49b7e37 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:09:13.849130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ec7579c-42b5-402c-9bcd-59744cd374ae None None] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:09:13.849259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8790f3de-b976-4bc3-9d3f-3cf0c49b7e37 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:09:13.849259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8790f3de-b976-4bc3-9d3f-3cf0c49b7e37 None None] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:09:13.849481 ncdv-master-1 devstack@n-api.service[131277]: INFO dbcounter [None req-4ec7579c-42b5-402c-9bcd-59744cd374ae None None] Registered counter for database nova_cell0 May 21 21:09:13.849596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8790f3de-b976-4bc3-9d3f-3cf0c49b7e37 None None] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:09:13.849596 ncdv-master-1 devstack@n-api.service[131278]: INFO dbcounter [None req-8790f3de-b976-4bc3-9d3f-3cf0c49b7e37 None None] Registered counter for database nova_cell0 May 21 21:09:13.849795 ncdv-master-1 devstack@n-api.service[131277]: INFO dbcounter [None req-4ec7579c-42b5-402c-9bcd-59744cd374ae None None] Registered counter for database nova_cell1 May 21 21:09:13.849990 ncdv-master-1 devstack@n-api.service[131278]: INFO dbcounter [None req-8790f3de-b976-4bc3-9d3f-3cf0c49b7e37 None None] Registered counter for database nova_cell1 May 21 21:09:13.850109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_db.sqlalchemy.engines [None req-4ec7579c-42b5-402c-9bcd-59744cd374ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 21 21:09:13.852387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_db.sqlalchemy.engines [None req-8790f3de-b976-4bc3-9d3f-3cf0c49b7e37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 21 21:09:13.853793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writer thread running {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 21 21:09:13.866221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_db.sqlalchemy.engines [None req-8790f3de-b976-4bc3-9d3f-3cf0c49b7e37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 21 21:09:13.870534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writer thread running {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 21 21:09:14.000139 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_db.sqlalchemy.engines [None req-4ec7579c-42b5-402c-9bcd-59744cd374ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 21 21:09:14.005765 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writer thread running {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 21 21:09:14.014937 ncdv-master-1 devstack@n-api.service[131277]: INFO dbcounter [None req-4ec7579c-42b5-402c-9bcd-59744cd374ae None None] Registered counter for database nova_cell0 May 21 21:09:14.021619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_db.sqlalchemy.engines [None req-4ec7579c-42b5-402c-9bcd-59744cd374ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 21 21:09:14.025723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writer thread running {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 21 21:09:14.026081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writer thread running {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 21 21:09:14.034984 ncdv-master-1 devstack@n-api.service[131278]: INFO dbcounter [None req-8790f3de-b976-4bc3-9d3f-3cf0c49b7e37 None None] Registered counter for database nova_cell0 May 21 21:09:14.042544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_db.sqlalchemy.engines [None req-8790f3de-b976-4bc3-9d3f-3cf0c49b7e37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 21 21:09:14.047224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writer thread running {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 21 21:09:14.461515 ncdv-master-1 devstack@n-api.service[131277]: WARNING keystonemiddleware.auth_token [None req-4ec7579c-42b5-402c-9bcd-59744cd374ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 21 21:09:14.469020 ncdv-master-1 devstack@n-api.service[131277]: WARNING keystonemiddleware.auth_token [None req-4ec7579c-42b5-402c-9bcd-59744cd374ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 21 21:09:14.485902 ncdv-master-1 devstack@n-api.service[131278]: WARNING keystonemiddleware.auth_token [None req-8790f3de-b976-4bc3-9d3f-3cf0c49b7e37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 21 21:09:14.494021 ncdv-master-1 devstack@n-api.service[131278]: WARNING keystonemiddleware.auth_token [None req-8790f3de-b976-4bc3-9d3f-3cf0c49b7e37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 21 21:09:14.694633 ncdv-master-1 devstack@n-api.service[131277]: WARNING keystonemiddleware.auth_token [None req-4ec7579c-42b5-402c-9bcd-59744cd374ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 21 21:09:14.702702 ncdv-master-1 devstack@n-api.service[131277]: WARNING keystonemiddleware.auth_token [None req-4ec7579c-42b5-402c-9bcd-59744cd374ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 21 21:09:14.705922 ncdv-master-1 devstack@n-api.service[131277]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5591331a19c0 pid: 131277 (default app) May 21 21:09:14.720922 ncdv-master-1 devstack@n-api.service[131278]: WARNING keystonemiddleware.auth_token [None req-8790f3de-b976-4bc3-9d3f-3cf0c49b7e37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 21 21:09:14.727453 ncdv-master-1 devstack@n-api.service[131278]: WARNING keystonemiddleware.auth_token [None req-8790f3de-b976-4bc3-9d3f-3cf0c49b7e37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 21 21:09:14.732806 ncdv-master-1 devstack@n-api.service[131278]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5591331a19c0 pid: 131278 (default app) May 21 21:10:03.606218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:03.607374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:03.608016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:03.608756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:05.048587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:05.049735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:05.050586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:05.054649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:05.471367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f424dbcc-67ad-4e5f-9dcc-2f0462c1d7e5 tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] Calling method '.version_select at 0x7fc829f50f70>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:05.473764 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:05.473764 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:05.480941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f424dbcc-67ad-4e5f-9dcc-2f0462c1d7e5 tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4f046ce9-ac6c-44d8-b1fb-b7063eef06e7(cell1) {{(pid=131277) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 21 21:10:05.481782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f424dbcc-67ad-4e5f-9dcc-2f0462c1d7e5 tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:05.482416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f424dbcc-67ad-4e5f-9dcc-2f0462c1d7e5 tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:05.510594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f424dbcc-67ad-4e5f-9dcc-2f0462c1d7e5 tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:05.511242 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f424dbcc-67ad-4e5f-9dcc-2f0462c1d7e5 tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:05.527763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f424dbcc-67ad-4e5f-9dcc-2f0462c1d7e5 tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:05.528588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f424dbcc-67ad-4e5f-9dcc-2f0462c1d7e5 tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:05.538099 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f424dbcc-67ad-4e5f-9dcc-2f0462c1d7e5 tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.936993 May 21 21:10:05.539258 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1207 bytes} [Sat May 21 21:10:03 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:10:05.765355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-49c38ab1-bb4f-4554-8eac-867d208814cf tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1239393815", "id": 1733017243, "os-flavor-access:is_public": "True"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:05.805148 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:05.805148 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:05.864724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-86b9d010-50bc-4f32-a896-9ee161d3c195 tempest-FlavorsV261TestJSON-1272007294 tempest-FlavorsV261TestJSON-1272007294-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-2143694941", "id": 656093443, "os-flavor-access:is_public": "True"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:05.884921 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:05.884921 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:05.937438 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-49c38ab1-bb4f-4554-8eac-867d208814cf tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.396786 May 21 21:10:05.938296 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2/2] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:05 2022] POST /compute/v2.1/flavors => generated 430 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:06.041663 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-86b9d010-50bc-4f32-a896-9ee161d3c195 tempest-FlavorsV261TestJSON-1272007294 tempest-FlavorsV261TestJSON-1272007294-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.997645 May 21 21:10:06.042479 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1/3] 10.222.0.49 () {62 vars in 1187 bytes} [Sat May 21 21:10:05 2022] POST /compute/v2.1/flavors => generated 465 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:06.129791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e24a939a-802c-4a75-a8e0-92c1c3798f00 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:06.129791 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:06.129791 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:06.131143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e24a939a-802c-4a75-a8e0-92c1c3798f00 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:06.133178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e24a939a-802c-4a75-a8e0-92c1c3798f00 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:06.134159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e24a939a-802c-4a75-a8e0-92c1c3798f00 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:06.134670 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e24a939a-802c-4a75-a8e0-92c1c3798f00 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:06.186970 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e24a939a-802c-4a75-a8e0-92c1c3798f00 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.246701 May 21 21:10:06.196943 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3/4] 10.222.0.49 () {58 vars in 1175 bytes} [Sat May 21 21:10:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:06.281573 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-09e34033-6480-4b5f-958e-88d052274049 tempest-FlavorMetadataValidation-1697051885 tempest-FlavorMetadataValidation-1697051885-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1698629146", "id": 567386988, "os-flavor-access:is_public": "True"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:06.389001 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-09e34033-6480-4b5f-958e-88d052274049 tempest-FlavorMetadataValidation-1697051885 tempest-FlavorMetadataValidation-1697051885-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.343507 May 21 21:10:06.391365 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2/5] 10.222.0.49 () {62 vars in 1187 bytes} [Sat May 21 21:10:06 2022] POST /compute/v2.1/flavors => generated 468 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:06.396460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-808c4e61-c743-4b4c-9efa-854e6030e36d tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-291727753"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:06.398425 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:06.398425 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:06.399714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.aggregate [None req-808c4e61-c743-4b4c-9efa-854e6030e36d tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] Generated uuid 5073b182-f4d5-4cdf-9b18-191e3c6b2324 for aggregate {{(pid=131278) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 21 21:10:06.474370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a74fb329-c042-492d-966a-e05b458926fa tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '.version_select at 0x7fc829d2ae50>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:06.475320 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:06.475320 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:06.476548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a74fb329-c042-492d-966a-e05b458926fa tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:06.477563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a74fb329-c042-492d-966a-e05b458926fa tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:06.497074 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a74fb329-c042-492d-966a-e05b458926fa tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:06.497544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a74fb329-c042-492d-966a-e05b458926fa tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:06.513313 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a74fb329-c042-492d-966a-e05b458926fa tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:06.513764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a74fb329-c042-492d-966a-e05b458926fa tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:06.520196 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a74fb329-c042-492d-966a-e05b458926fa tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.321944 May 21 21:10:06.521254 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 4/6] 10.222.0.49 () {58 vars in 1166 bytes} [Sat May 21 21:10:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:06.526444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e00af51f-68b8-4232-8ef0-081a7b470b5d tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:06.527351 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:06.527351 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:06.554305 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-808c4e61-c743-4b4c-9efa-854e6030e36d tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.161390 May 21 21:10:06.554930 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3/7] 10.222.0.49 () {62 vars in 1204 bytes} [Sat May 21 21:10:06 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:06.692423 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e00af51f-68b8-4232-8ef0-081a7b470b5d tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1733017243" status: 202 len: 0 microversion: 2.1 time: 0.168281 May 21 21:10:06.694128 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 5/8] 10.222.0.49 () {58 vars in 1160 bytes} [Sat May 21 21:10:06 2022] DELETE /compute/v2.1/flavors/1733017243 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:10:06.700237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7f30d519-1195-4ccf-8479-6c94255b8029 tempest-FlavorMetadataValidation-1697051885 tempest-FlavorMetadataValidation-1697051885-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:06.704110 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:06.704110 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:06.726923 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-736884d7-48c2-4d48-ab11-bbd31c08b393 tempest-FlavorsV261TestJSON-1684132685 tempest-FlavorsV261TestJSON-1684132685-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:06.750397 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-736884d7-48c2-4d48-ab11-bbd31c08b393 tempest-FlavorsV261TestJSON-1684132685 tempest-FlavorsV261TestJSON-1684132685-project] 10.222.0.49 "GET /compute/v2.1/flavors/656093443" status: 200 len: 465 microversion: 2.61 time: 0.194052 May 21 21:10:06.751592 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 4/9] 10.222.0.49 () {60 vars in 1195 bytes} [Sat May 21 21:10:06 2022] GET /compute/v2.1/flavors/656093443 => generated 465 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:06.758101 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-33de9a0a-a9e9-435e-9c9d-32c3772799fa tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2085390236"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:06.868567 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:06.868567 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:07.018795 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7f30d519-1195-4ccf-8479-6c94255b8029 tempest-FlavorMetadataValidation-1697051885 tempest-FlavorMetadataValidation-1697051885-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/567386988/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.323291 May 21 21:10:07.020843 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 6/10] 10.222.0.49 () {62 vars in 1261 bytes} [Sat May 21 21:10:06 2022] POST /compute/v2.1/flavors/567386988/os-extra_specs => generated 62 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:07.036040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5dd2e571-c61d-47bc-b572-5589c4274733 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:07.047707 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-33de9a0a-a9e9-435e-9c9d-32c3772799fa tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.294734 May 21 21:10:07.049040 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 5/11] 10.222.0.49 () {62 vars in 1209 bytes} [Sat May 21 21:10:06 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:07.057769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8fdaeb47-7bd4-4f87-8842-56a29a851173 tempest-FlavorsV261TestJSON-1272007294 tempest-FlavorsV261TestJSON-1272007294-project-admin] Action: 'update', calling method: .version_select at 0x7fc82a2d1af0>, body: {"flavor": {"description": "new"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:07.073632 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:07.073632 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:07.109173 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5dd2e571-c61d-47bc-b572-5589c4274733 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5825 microversion: 2.1 time: 0.084944 May 21 21:10:07.110086 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 7/12] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:07 2022] GET /compute/v2.1/flavors/detail => generated 5825 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:07.119739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dd8ec2da-8f0a-4d3d-9076-4f9bf23ad071 tempest-FlavorMetadataValidation-1697051885 tempest-FlavorMetadataValidation-1697051885-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:07.193538 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8fdaeb47-7bd4-4f87-8842-56a29a851173 tempest-FlavorsV261TestJSON-1272007294 tempest-FlavorsV261TestJSON-1272007294-project-admin] 10.222.0.49 "PUT /compute/v2.1/flavors/656093443" status: 200 len: 466 microversion: 2.61 time: 0.142398 May 21 21:10:07.197797 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 6/13] 10.222.0.49 () {62 vars in 1215 bytes} [Sat May 21 21:10:07 2022] PUT /compute/v2.1/flavors/656093443 => generated 466 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:07.198865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4e5374b4-af76-49c8-af72-fd1301d714ba tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:07.199865 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:07.199865 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:07.218209 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4e5374b4-af76-49c8-af72-fd1301d714ba tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.022878 May 21 21:10:07.223018 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dd8ec2da-8f0a-4d3d-9076-4f9bf23ad071 tempest-FlavorMetadataValidation-1697051885 tempest-FlavorMetadataValidation-1697051885-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/567386988" status: 202 len: 0 microversion: 2.86 time: 0.110854 May 21 21:10:07.223957 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 7/14] 10.222.0.49 () {60 vars in 1189 bytes} [Sat May 21 21:10:07 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:07.224376 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 8/15] 10.222.0.49 () {60 vars in 1198 bytes} [Sat May 21 21:10:07 2022] DELETE /compute/v2.1/flavors/567386988 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 21 21:10:07.230721 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5deb0a81-f862-480c-adad-6ae66d04f5da tempest-FlavorsV261TestJSON-1684132685 tempest-FlavorsV261TestJSON-1684132685-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:07.235931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-626ff6c4-7d23-424d-90ce-b457f52490b8 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1229697993", "id": 779224052, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:07.238083 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:07.238083 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:07.287270 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5deb0a81-f862-480c-adad-6ae66d04f5da tempest-FlavorsV261TestJSON-1684132685 tempest-FlavorsV261TestJSON-1684132685-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.061040 May 21 21:10:07.288145 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 9/16] 10.222.0.49 () {60 vars in 1186 bytes} [Sat May 21 21:10:07 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:10:07.293030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b029eb56-a4fb-4743-a07d-f77ae087ff15 tempest-FlavorMetadataValidation-1697051885 tempest-FlavorMetadataValidation-1697051885-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:07.319039 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b029eb56-a4fb-4743-a07d-f77ae087ff15 tempest-FlavorMetadataValidation-1697051885 tempest-FlavorMetadataValidation-1697051885-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 6232 microversion: 2.86 time: 0.028526 May 21 21:10:07.319850 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 10/17] 10.222.0.49 () {60 vars in 1186 bytes} [Sat May 21 21:10:07 2022] GET /compute/v2.1/flavors/detail => generated 6232 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:10:07.325113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c686fcfb-e1ee-4c8a-b450-c6f400452bd7 tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:07.326589 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:07.326589 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:07.346134 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-626ff6c4-7d23-424d-90ce-b457f52490b8 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.120224 May 21 21:10:07.348092 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 8/18] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:07 2022] POST /compute/v2.1/flavors => generated 414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:07.371416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-19f0798d-55e7-4e4e-8fd0-398da3a3d8b7 tempest-FlavorsV261TestJSON-1684132685 tempest-FlavorsV261TestJSON-1684132685-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:07.417986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c686fcfb-e1ee-4c8a-b450-c6f400452bd7 tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:07.418448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c686fcfb-e1ee-4c8a-b450-c6f400452bd7 tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:07.428993 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-19f0798d-55e7-4e4e-8fd0-398da3a3d8b7 tempest-FlavorsV261TestJSON-1684132685 tempest-FlavorsV261TestJSON-1684132685-project] 10.222.0.49 "GET /compute/v2.1/flavors" status: 200 len: 3405 microversion: 2.61 time: 0.074582 May 21 21:10:07.444718 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 9/19] 10.222.0.49 () {60 vars in 1165 bytes} [Sat May 21 21:10:07 2022] GET /compute/v2.1/flavors => generated 3405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:10:07.445659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-48dfc390-0976-4c8c-a337-cf306a32a0aa tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:07.480676 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-48dfc390-0976-4c8c-a337-cf306a32a0aa tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5810 microversion: 2.1 time: 0.046633 May 21 21:10:07.481937 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 10/20] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:07 2022] GET /compute/v2.1/flavors/detail => generated 5810 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:07.486952 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2bcc928d-eb87-4a21-bc1a-9d2c01497242 tempest-FlavorsV261TestJSON-1272007294 tempest-FlavorsV261TestJSON-1272007294-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:07.487941 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:07.487941 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:07.622926 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2bcc928d-eb87-4a21-bc1a-9d2c01497242 tempest-FlavorsV261TestJSON-1272007294 tempest-FlavorsV261TestJSON-1272007294-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/656093443" status: 202 len: 0 microversion: 2.61 time: 0.139179 May 21 21:10:07.623700 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 11/21] 10.222.0.49 () {60 vars in 1198 bytes} [Sat May 21 21:10:07 2022] DELETE /compute/v2.1/flavors/656093443 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 21 21:10:07.637782 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6622296d-7705-4ae9-bb11-4af48ebc66ac tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:07.770661 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6622296d-7705-4ae9-bb11-4af48ebc66ac tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/779224052" status: 202 len: 0 microversion: 2.1 time: 0.145475 May 21 21:10:07.771809 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 12/22] 10.222.0.49 () {58 vars in 1157 bytes} [Sat May 21 21:10:07 2022] DELETE /compute/v2.1/flavors/779224052 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:10:07.776542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f9bd5b35-5fcb-4762-a6fe-4b92a62fde7d tempest-FlavorsV261TestJSON-1272007294 tempest-FlavorsV261TestJSON-1272007294-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:07.810908 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f9bd5b35-5fcb-4762-a6fe-4b92a62fde7d tempest-FlavorsV261TestJSON-1272007294 tempest-FlavorsV261TestJSON-1272007294-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.037944 May 21 21:10:07.811711 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 13/23] 10.222.0.49 () {60 vars in 1186 bytes} [Sat May 21 21:10:07 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:10:07.818322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cf1866cc-bfe6-48a8-8eef-84c0d907b251 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:07.852097 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cf1866cc-bfe6-48a8-8eef-84c0d907b251 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037300 May 21 21:10:07.869354 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 14/24] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:07.881310 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-08ae2f0f-4503-40ef-9b80-0f31c5493ae0 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1257533922", "id": 686030455, "os-flavor-access:is_public": "True"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:07.983135 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-08ae2f0f-4503-40ef-9b80-0f31c5493ae0 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.112420 May 21 21:10:07.984472 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 15/25] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:07 2022] POST /compute/v2.1/flavors => generated 426 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:07.997133 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f4692cf7-353c-4988-a4dd-8aecba4c8b64 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:08.079784 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f4692cf7-353c-4988-a4dd-8aecba4c8b64 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/686030455" status: 202 len: 0 microversion: 2.1 time: 0.087812 May 21 21:10:08.083592 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 16/26] 10.222.0.49 () {58 vars in 1157 bytes} [Sat May 21 21:10:07 2022] DELETE /compute/v2.1/flavors/686030455 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:10:08.403789 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0547992d-7d4c-4c33-9bc6-11d3d7fab787 tempest-AZAdminV2TestJSON-1777113860 tempest-AZAdminV2TestJSON-1777113860-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:08.405657 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0547992d-7d4c-4c33-9bc6-11d3d7fab787 tempest-AZAdminV2TestJSON-1777113860 tempest-AZAdminV2TestJSON-1777113860-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:08.410590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0547992d-7d4c-4c33-9bc6-11d3d7fab787 tempest-AZAdminV2TestJSON-1777113860 tempest-AZAdminV2TestJSON-1777113860-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:08.410706 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c686fcfb-e1ee-4c8a-b450-c6f400452bd7 tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 1.085460 May 21 21:10:08.411136 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0547992d-7d4c-4c33-9bc6-11d3d7fab787 tempest-AZAdminV2TestJSON-1777113860 tempest-AZAdminV2TestJSON-1777113860-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:08.411209 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 11/27] 10.222.0.49 () {62 vars in 1231 bytes} [Sat May 21 21:10:07 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:08.411275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0547992d-7d4c-4c33-9bc6-11d3d7fab787 tempest-AZAdminV2TestJSON-1777113860 tempest-AZAdminV2TestJSON-1777113860-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:08.417830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fef5844b-a439-4f1a-8b10-055d26f40789 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:08.457751 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fef5844b-a439-4f1a-8b10-055d26f40789 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048270 May 21 21:10:08.460386 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 12/28] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:08.475033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-af3e2147-7ac2-4ab4-b255-ac34f2568a77 tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:08.477691 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:08.477691 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:08.499036 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0547992d-7d4c-4c33-9bc6-11d3d7fab787 tempest-AZAdminV2TestJSON-1777113860 tempest-AZAdminV2TestJSON-1777113860-project-admin] 10.222.0.49 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.417154 May 21 21:10:08.499887 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 17/29] 10.222.0.49 () {58 vars in 1163 bytes} [Sat May 21 21:10:08 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:10:08.505198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af3e2147-7ac2-4ab4-b255-ac34f2568a77 tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:08.507960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af3e2147-7ac2-4ab4-b255-ac34f2568a77 tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:08.514858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0faa5fe3-058d-426d-812f-433c46c64a5a tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1536195785", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:08.520100 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:08.520100 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:08.623114 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0faa5fe3-058d-426d-812f-433c46c64a5a tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.121821 May 21 21:10:08.634913 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 18/30] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:08 2022] POST /compute/v2.1/flavors => generated 507 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:08.646976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9c5a9aaa-4a3e-4251-a015-861e1f9091fc tempest-AZAdminV2TestJSON-1777113860 tempest-AZAdminV2TestJSON-1777113860-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:08.650034 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:08.650034 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:08.653206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c5a9aaa-4a3e-4251-a015-861e1f9091fc tempest-AZAdminV2TestJSON-1777113860 tempest-AZAdminV2TestJSON-1777113860-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:08.654126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c5a9aaa-4a3e-4251-a015-861e1f9091fc tempest-AZAdminV2TestJSON-1777113860 tempest-AZAdminV2TestJSON-1777113860-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:08.656072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c5a9aaa-4a3e-4251-a015-861e1f9091fc tempest-AZAdminV2TestJSON-1777113860 tempest-AZAdminV2TestJSON-1777113860-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:08.657142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c5a9aaa-4a3e-4251-a015-861e1f9091fc tempest-AZAdminV2TestJSON-1777113860 tempest-AZAdminV2TestJSON-1777113860-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:08.703916 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9c5a9aaa-4a3e-4251-a015-861e1f9091fc tempest-AZAdminV2TestJSON-1777113860 tempest-AZAdminV2TestJSON-1777113860-project-admin] 10.222.0.49 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.066322 May 21 21:10:08.705308 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 19/31] 10.222.0.49 () {58 vars in 1184 bytes} [Sat May 21 21:10:08 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:08.723712 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f50816e8-8c53-4f65-9e10-be2c86709f77 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:08.725296 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:08.725296 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:08.831285 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f50816e8-8c53-4f65-9e10-be2c86709f77 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/e6b9b33a-4ad3-460d-b98a-0cfc8cf75c83" status: 202 len: 0 microversion: 2.1 time: 0.124647 May 21 21:10:08.831971 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 20/32] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:10:08 2022] DELETE /compute/v2.1/flavors/e6b9b33a-4ad3-460d-b98a-0cfc8cf75c83 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:10:08.847043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7e96aec8-4609-42d4-a6b2-9092f360e4b0 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:08.869764 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-af3e2147-7ac2-4ab4-b255-ac34f2568a77 tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.407786 May 21 21:10:08.879991 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 13/33] 10.222.0.49 () {62 vars in 1231 bytes} [Sat May 21 21:10:08 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:08.887466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2de02056-a958-4d93-880c-3b799383bbbb tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:08.891145 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:08.891145 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:08.908043 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7e96aec8-4609-42d4-a6b2-9092f360e4b0 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065043 May 21 21:10:08.908697 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 21/34] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:10:08.929762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-db159088-a3c9-4bdd-8c72-ad24ea0fee05 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-465934221", "id": "914fbf27-c002-4d69-9aa7-be608766ec50", "os-flavor-access:is_public": "True"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:08.936711 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:08.936711 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:09.017657 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2de02056-a958-4d93-880c-3b799383bbbb tempest-AggregatesAdminTestV241-97442846 tempest-AggregatesAdminTestV241-97442846-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.135675 May 21 21:10:09.018419 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 14/35] 10.222.0.49 () {60 vars in 1192 bytes} [Sat May 21 21:10:08 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:10:09.056983 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-db159088-a3c9-4bdd-8c72-ad24ea0fee05 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.132510 May 21 21:10:09.060411 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 22/36] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:08 2022] POST /compute/v2.1/flavors => generated 506 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:09.061972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-58365548-74ff-4d9f-807f-0c88be5e78a0 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2106859043"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:09.069716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9ac2b22f-d17a-437c-9922-77daf8e9bb81 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:09.085273 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:09.085273 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:09.086629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.aggregate [None req-58365548-74ff-4d9f-807f-0c88be5e78a0 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Generated uuid 48dabb23-d15a-46d5-a38d-524009cd6af7 for aggregate {{(pid=131277) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 21 21:10:09.187981 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9ac2b22f-d17a-437c-9922-77daf8e9bb81 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/914fbf27-c002-4d69-9aa7-be608766ec50" status: 202 len: 0 microversion: 2.1 time: 0.123165 May 21 21:10:09.188921 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 23/37] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:10:09 2022] DELETE /compute/v2.1/flavors/914fbf27-c002-4d69-9aa7-be608766ec50 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 21 21:10:09.202700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c54a1df4-13b3-4984-b4cd-8fff3a550d65 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:09.206376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7,nova_api:UPDATE=2,nova_api:DELETE=15 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:09.222799 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-58365548-74ff-4d9f-807f-0c88be5e78a0 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.167741 May 21 21:10:09.227061 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 15/38] 10.222.0.49 () {60 vars in 1163 bytes} [Sat May 21 21:10:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:10:09.237220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-495eae52-7563-4bb5-ac0b-236643edd24a tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:09.238923 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:09.238923 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:09.242538 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c54a1df4-13b3-4984-b4cd-8fff3a550d65 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043415 May 21 21:10:09.253993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-495eae52-7563-4bb5-ac0b-236643edd24a tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:09.253993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-495eae52-7563-4bb5-ac0b-236643edd24a tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:09.261693 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 24/39] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:10:09.266745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0fd9d8e4-3e42-4320-9402-082b4163f0dd tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-848429582", "id": 2006178189, "os-flavor-access:is_public": "True"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:09.399235 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0fd9d8e4-3e42-4320-9402-082b4163f0dd tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.136302 May 21 21:10:09.403053 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 25/40] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:09 2022] POST /compute/v2.1/flavors => generated 413 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:09.413142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-34d029c1-be2c-4662-83fe-15670dc7a256 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:09.433020 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-34d029c1-be2c-4662-83fe-15670dc7a256 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/2006178189" status: 200 len: 413 microversion: 2.1 time: 0.023589 May 21 21:10:09.434030 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 26/41] 10.222.0.49 () {58 vars in 1157 bytes} [Sat May 21 21:10:09 2022] GET /compute/v2.1/flavors/2006178189 => generated 413 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:09.544136 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-495eae52-7563-4bb5-ac0b-236643edd24a tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.311656 May 21 21:10:09.544780 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 16/42] 10.222.0.49 () {60 vars in 1190 bytes} [Sat May 21 21:10:09 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:09.555939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-11adb446-ec53-4906-83cb-9a4828628162 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:09.557250 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:09.557250 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:09.565203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-11adb446-ec53-4906-83cb-9a4828628162 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:09.565663 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-11adb446-ec53-4906-83cb-9a4828628162 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:09.650639 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-11adb446-ec53-4906-83cb-9a4828628162 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] HTTP exception thrown: Aggregate 2 already has host nch2-master-1. May 21 21:10:09.695745 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-11adb446-ec53-4906-83cb-9a4828628162 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Request method failure captured: May 21 21:10:09.695745 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 May 21 21:10:09.695745 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:09.695745 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:09.695745 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:09.695745 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 39 May 21 21:10:09.695745 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:09.695745 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:09.695745 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:09.695745 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:09.695745 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVUtXoSJ6VszP1U-oSZcLfMM7HYXvJXhpF39QKode8HEZSIad3dvZNMVnM7NipekWfPeDS9X_y3nSjfA8qN7aKQpw7-9HSQWUXK9vEl3R8enRfwRO-p9lsbngVLl9EqL39DiWOhS9LQQ2lhmdaY4N0lVaBWLUuunh7nFRPyKyzFxNy0 May 21 21:10:09.695745 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:09.695745 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:09.695745 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:09.695745 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:09.695745 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:09.695745 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:09.695745 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 194a569eab164ba1b3752b2830e8f92e May 21 21:10:09.695745 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:09.695745 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:10:09.695745 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:10:09.697191 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_194a569eab164ba1b3752b2830e8f92e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:09.697191 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:09.697191 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 194a569eab164ba1b3752b2830e8f92e May 21 21:10:09.697191 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:09.697191 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin May 21 21:10:09.697191 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:09.697191 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:09.697191 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 1004a63485ce499499be9b3a3f2c1380 May 21 21:10:09.697191 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin May 21 21:10:09.697191 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:10:09.697191 ncdv-master-1 devstack@n-api.service[131277]: {"add_host": {"host": "nch2-master-1"}} May 21 21:10:09.697191 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:10:09.697191 ncdv-master-1 devstack@n-api.service[131277]: exception: Aggregate 2 already has host nch2-master-1. May 21 21:10:09.698071 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '2', 'body': {'add_host': {'host': 'nch2-master-1'}}} May 21 21:10:09.698071 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:09.698071 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:09.698071 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 21 21:10:09.698071 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 21 21:10:09.698071 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 21 21:10:09.698071 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 21 21:10:09.698071 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 21 21:10:09.698071 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = self._query(query) May 21 21:10:09.698071 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 21 21:10:09.698071 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi conn.query(q) May 21 21:10:09.698071 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 21 21:10:09.698071 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 21 21:10:09.698071 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 21 21:10:09.698071 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result.read() May 21 21:10:09.698071 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 21 21:10:09.698071 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 21 21:10:09.698071 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 21 21:10:09.698071 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 21 21:10:09.699435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 21 21:10:09.699435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 21 21:10:09.699435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 21 21:10:09.699435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 21 21:10:09.699435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'nch2-master-1-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") May 21 21:10:09.699435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:09.699435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 21 21:10:09.699435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:09.699435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:09.699435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db May 21 21:10:09.699435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) May 21 21:10:09.699435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 21 21:10:09.699435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi session.flush() May 21 21:10:09.699435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 21 21:10:09.699435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._flush(objects) May 21 21:10:09.699435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 21 21:10:09.699435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 21 21:10:09.699435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 21 21:10:09.699435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi compat.raise_( May 21 21:10:09.702884 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 21 21:10:09.702884 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception May 21 21:10:09.702884 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 21 21:10:09.702884 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi flush_context.execute() May 21 21:10:09.702884 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 21 21:10:09.702884 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi rec.execute(self) May 21 21:10:09.702884 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 21 21:10:09.702884 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 21 21:10:09.702884 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 21 21:10:09.702884 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 21 21:10:09.702884 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 21 21:10:09.702884 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 21 21:10:09.702884 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 21 21:10:09.702884 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 21 21:10:09.702884 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 21 21:10:09.702884 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 21 21:10:09.702884 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 21 21:10:09.702884 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 21 21:10:09.704158 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 21 21:10:09.704158 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 21 21:10:09.704158 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 21 21:10:09.704158 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 21 21:10:09.704158 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 21 21:10:09.704158 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception May 21 21:10:09.704158 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 21 21:10:09.704158 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 21 21:10:09.704158 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 21 21:10:09.704158 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 21 21:10:09.704158 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 21 21:10:09.704158 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = self._query(query) May 21 21:10:09.704158 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 21 21:10:09.704158 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi conn.query(q) May 21 21:10:09.704158 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 21 21:10:09.704158 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 21 21:10:09.704158 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 21 21:10:09.704158 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result.read() May 21 21:10:09.705347 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 21 21:10:09.705347 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 21 21:10:09.705347 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 21 21:10:09.705347 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 21 21:10:09.705347 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 21 21:10:09.705347 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 21 21:10:09.705347 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 21 21:10:09.705347 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 21 21:10:09.705347 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nch2-master-1-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") May 21 21:10:09.705347 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] May 21 21:10:09.705347 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 21, 21, 10, 9, 581311), 'updated_at': None, 'host': 'nch2-master-1', 'aggregate_id': 2}] May 21 21:10:09.705347 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 21 21:10:09.705347 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:09.705347 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:09.705347 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:09.705347 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:09.705347 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host May 21 21:10:09.706414 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) May 21 21:10:09.706414 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 21 21:10:09.706414 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 21 21:10:09.706414 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:09.706414 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:09.706414 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:09.706414 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:09.706414 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 21 21:10:09.706414 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 21 21:10:09.706414 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate May 21 21:10:09.706414 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) May 21 21:10:09.706414 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 21 21:10:09.706414 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 21 21:10:09.706414 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host May 21 21:10:09.706414 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) May 21 21:10:09.706414 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db May 21 21:10:09.706414 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, May 21 21:10:09.706414 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host nch2-master-1. May 21 21:10:09.706414 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:09.706414 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:09.707708 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:09.707708 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:09.707708 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:09.707708 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:09.707708 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:09.707708 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:09.707708 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:09.707708 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:09.707708 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:10:09.707708 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:10:09.707708 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host May 21 21:10:09.707708 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) May 21 21:10:09.707708 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host nch2-master-1. May 21 21:10:09.707708 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:09.707708 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:09.707708 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:09.707708 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:09.707708 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:09.707708 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:09.707708 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:09.707708 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:09.709016 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host nch2-master-1. May 21 21:10:09.709016 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:09.721396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-11adb446-ec53-4906-83cb-9a4828628162 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Returning 409 to user: Aggregate 2 already has host nch2-master-1. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:09.725014 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-11adb446-ec53-4906-83cb-9a4828628162 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.171258 May 21 21:10:09.725985 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 17/43] 10.222.0.49 () {60 vars in 1190 bytes} [Sat May 21 21:10:09 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 175 msecs (HTTP/1.1 409) 9 headers in 377 bytes (2 switches on core 0) May 21 21:10:09.739181 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f734abfd-5d49-40ca-b17e-26ab21cbc661 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:09.741529 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:09.741529 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:09.766230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f734abfd-5d49-40ca-b17e-26ab21cbc661 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:09.766230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f734abfd-5d49-40ca-b17e-26ab21cbc661 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:10.035669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-579059ea-830f-4092-911f-0175ffead6d9 tempest-FlavorsAdminTestJSON-1337035739 tempest-FlavorsAdminTestJSON-1337035739-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:10.072208 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-579059ea-830f-4092-911f-0175ffead6d9 tempest-FlavorsAdminTestJSON-1337035739 tempest-FlavorsAdminTestJSON-1337035739-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.631724 May 21 21:10:10.073899 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 27/44] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:09 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:10:10.087356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5361187a-1738-44eb-9ea5-04a63e6127d4 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:10.106988 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f734abfd-5d49-40ca-b17e-26ab21cbc661 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.375602 May 21 21:10:10.108555 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 18/45] 10.222.0.49 () {60 vars in 1190 bytes} [Sat May 21 21:10:09 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:10.121312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-78f453dc-6179-4360-bf07-be945d03a748 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:10.122358 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:10.122358 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:10.148040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7,nova_api:DELETE=10,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:10.215557 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5361187a-1738-44eb-9ea5-04a63e6127d4 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/2006178189" status: 202 len: 0 microversion: 2.1 time: 0.131980 May 21 21:10:10.219844 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 28/46] 10.222.0.49 () {58 vars in 1160 bytes} [Sat May 21 21:10:10 2022] DELETE /compute/v2.1/flavors/2006178189 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:10:10.224969 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-16c4cbb7-0e6f-4b77-877c-634d57cfce13 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:10.237084 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-78f453dc-6179-4360-bf07-be945d03a748 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.119922 May 21 21:10:10.241844 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 19/47] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:10:10 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 21 21:10:10.261582 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-16c4cbb7-0e6f-4b77-877c-634d57cfce13 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040225 May 21 21:10:10.269850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-246ce295-2c1f-41a0-a969-5ba07d705f35 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1960189512"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:10.273162 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 29/48] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:10.274874 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:10.274874 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:10.277265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.aggregate [None req-246ce295-2c1f-41a0-a969-5ba07d705f35 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Generated uuid ded8c8af-691b-4e66-8d71-6c34c284b475 for aggregate {{(pid=131277) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 21 21:10:10.280563 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0a5cc7c6-7bb2-4157-a794-dead2eb11a39 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1724289736", "id": 716336034, "os-flavor-access:is_public": "False"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:10.404459 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-246ce295-2c1f-41a0-a969-5ba07d705f35 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.158014 May 21 21:10:10.404662 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0a5cc7c6-7bb2-4157-a794-dead2eb11a39 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.128136 May 21 21:10:10.408675 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 30/49] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:10 2022] POST /compute/v2.1/flavors => generated 427 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:10:10.411044 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 20/50] 10.222.0.49 () {60 vars in 1163 bytes} [Sat May 21 21:10:10 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:10.415796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-125eecf4-7258-4975-ac63-cd5239601cb4 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-397334092", "name": "tempest-test_aggregate-691495909"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:10.435310 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:10.435310 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:10.436407 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.aggregate [None req-125eecf4-7258-4975-ac63-cd5239601cb4 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Generated uuid b605f752-7961-4c5f-a63d-63630dba7607 for aggregate {{(pid=131278) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 21 21:10:10.541696 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-125eecf4-7258-4975-ac63-cd5239601cb4 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.131665 May 21 21:10:10.548596 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 31/51] 10.222.0.49 () {60 vars in 1164 bytes} [Sat May 21 21:10:10 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:10.559218 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b522bf64-6aef-47db-bd7d-3265350ec569 tempest-FlavorsAdminTestJSON-1337035739 tempest-FlavorsAdminTestJSON-1337035739-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "716336034"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:10.582707 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-b522bf64-6aef-47db-bd7d-3265350ec569 tempest-FlavorsAdminTestJSON-1337035739 tempest-FlavorsAdminTestJSON-1337035739-project] HTTP exception thrown: Flavor 716336034 could not be found. May 21 21:10:10.608583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b522bf64-6aef-47db-bd7d-3265350ec569 tempest-FlavorsAdminTestJSON-1337035739 tempest-FlavorsAdminTestJSON-1337035739-project] Request method failure captured: May 21 21:10:10.608583 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:10:10.608583 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:10.608583 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:10.608583 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:10.608583 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 106 May 21 21:10:10.608583 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:10.608583 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:10.608583 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:10.608583 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:10.608583 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVUp_aVYHgUvFHQtwz01wBDu9uB_4pcJVhvNX-Dnsc0WZAL_8qJvb-YDsWVT5JqnkSvgGEK6B4CWUBKZidOnTrcwKm2QIUKUh2rCY1yVbBEYMCDaw_OUPFM6PmeujTaTEtSHnys7r0mrmXfK3j5ZPqWjmzP-lhnlqM5vLkPD5MlPEZE May 21 21:10:10.608583 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:10.608583 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:10.608583 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:10.608583 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:10.608583 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:10.608583 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:10.608583 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: bc50ed2b7c0942c6a2ea0d05e9e15d1f May 21 21:10:10.608583 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-FlavorsAdminTestJSON-1337035739 May 21 21:10:10.608583 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:10:10.608583 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:10:10.610017 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bc50ed2b7c0942c6a2ea0d05e9e15d1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bc50ed2b7c0942c6a2ea0d05e9e15d1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bc50ed2b7c0942c6a2ea0d05e9e15d1f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bc50ed2b7c0942c6a2ea0d05e9e15d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:10.610017 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-FlavorsAdminTestJSON-1337035739 May 21 21:10:10.610017 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: bc50ed2b7c0942c6a2ea0d05e9e15d1f May 21 21:10:10.610017 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1337035739 May 21 21:10:10.610017 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-FlavorsAdminTestJSON-1337035739-project May 21 21:10:10.610017 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:10.610017 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:10.610017 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 781ce75e0c6a437baa482c19504eb69c May 21 21:10:10.610017 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-FlavorsAdminTestJSON-1337035739-project May 21 21:10:10.610017 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:10:10.610017 ncdv-master-1 devstack@n-api.service[131278]: {"server": {"name": "test", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "716336034"}} May 21 21:10:10.610017 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:10:10.610017 ncdv-master-1 devstack@n-api.service[131278]: exception: Flavor 716336034 could not be found. May 21 21:10:10.610933 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '716336034'}}} May 21 21:10:10.610933 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:10.610933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:10.610933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create May 21 21:10:10.610933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( May 21 21:10:10.610933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 21 21:10:10.610933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 21 21:10:10.610933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:10:10.610933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:10:10.610933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 21 21:10:10.610933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 21 21:10:10.610933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 21 21:10:10.610933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:10.610933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 21 21:10:10.610933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 21 21:10:10.610933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 716336034 could not be found. May 21 21:10:10.610933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:10.610933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:10.610933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:10.610933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:10.612137 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:10.612137 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:10.612137 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:10.612137 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:10.612137 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:10.612137 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:10.612137 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:10:10.612137 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:10:10.612137 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:10:10.612137 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:10:10.612137 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:10:10.612137 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:10:10.612137 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 21 21:10:10.612137 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 21 21:10:10.612137 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 21 21:10:10.612137 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 716336034 could not be found. May 21 21:10:10.612137 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:10.612137 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:10.612137 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:10.612137 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:10.612137 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:10.618032 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:10.618032 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:10.618032 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:10.618032 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 716336034 could not be found. May 21 21:10:10.618032 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:10.618032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b522bf64-6aef-47db-bd7d-3265350ec569 tempest-FlavorsAdminTestJSON-1337035739 tempest-FlavorsAdminTestJSON-1337035739-project] Returning 400 to user: Flavor 716336034 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:10.618032 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b522bf64-6aef-47db-bd7d-3265350ec569 tempest-FlavorsAdminTestJSON-1337035739 tempest-FlavorsAdminTestJSON-1337035739-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.061363 May 21 21:10:10.618032 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 32/52] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:10 2022] POST /compute/v2.1/servers => generated 80 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 21 21:10:10.618621 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-52554aa4-d9e3-4979-80d1-3ca0b24d3d72 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:10.619559 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:10.619559 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:10.631126 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-52554aa4-d9e3-4979-80d1-3ca0b24d3d72 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 200 len: 514 microversion: 2.1 time: 0.017631 May 21 21:10:10.632122 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 33/53] 10.222.0.49 () {58 vars in 1142 bytes} [Sat May 21 21:10:10 2022] GET /compute/v2.1/os-aggregates => generated 514 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:10.636762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-55d76af7-6d8b-4dc2-9168-dcd162962ccb tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:10.637507 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:10.637507 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:10.750132 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-55d76af7-6d8b-4dc2-9168-dcd162962ccb tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/716336034" status: 202 len: 0 microversion: 2.1 time: 0.116529 May 21 21:10:10.752317 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 34/54] 10.222.0.49 () {58 vars in 1157 bytes} [Sat May 21 21:10:10 2022] DELETE /compute/v2.1/flavors/716336034 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:10:10.762040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0a854542-d4b1-4f0e-88b4-a7a1962c9113 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:10.764234 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:10.764234 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:10.782557 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a854542-d4b1-4f0e-88b4-a7a1962c9113 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:10.782945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a854542-d4b1-4f0e-88b4-a7a1962c9113 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:10.928915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7152d772-09b1-4278-bd21-233f04a7ee8d tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:10.930222 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:10.930222 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:10.931087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7152d772-09b1-4278-bd21-233f04a7ee8d tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'dc272ac8b07342829bcb11cfeb0646cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2926f5876ac4d439fb39c6d8baa1c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:10.940883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7152d772-09b1-4278-bd21-233f04a7ee8d tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Request method failure captured: May 21 21:10:10.940883 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 May 21 21:10:10.940883 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:10.940883 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:10.940883 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:10.940883 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 39 May 21 21:10:10.940883 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:10.940883 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:10.940883 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:10.940883 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:10.940883 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVUpvM8fezsHPo8FJ3g5sqfBFVfMmZv4yYLruMAfgdWJq7eufXBlWOrl9L_njcGFxgGrXtGG9z1QoUD9yIUsYQkiq0c7gSHaV1Ge_DLwc5RSKLDXZy0JmpCiJQyqZIdu5GrDxFyPjn1xUNjk5BUhoVQs5SbR6SgRw1Ix9YyRLPgFSag May 21 21:10:10.940883 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:10.940883 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:10.940883 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:10.940883 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:10.940883 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:10.940883 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:10.940883 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: e2926f5876ac4d439fb39c6d8baa1c8a May 21 21:10:10.940883 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1205282029 May 21 21:10:10.940883 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:10:10.940883 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:10:10.942194 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e2926f5876ac4d439fb39c6d8baa1c8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2926f5876ac4d439fb39c6d8baa1c8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e2926f5876ac4d439fb39c6d8baa1c8a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2926f5876ac4d439fb39c6d8baa1c8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:10.942194 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1205282029 May 21 21:10:10.942194 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: e2926f5876ac4d439fb39c6d8baa1c8a May 21 21:10:10.942194 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1205282029 May 21 21:10:10.942194 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AggregatesAdminNegativeTestJSON-1205282029-project May 21 21:10:10.942194 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:10.942194 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:10.942194 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: dc272ac8b07342829bcb11cfeb0646cc May 21 21:10:10.942194 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1205282029-project May 21 21:10:10.942194 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:10:10.942194 ncdv-master-1 devstack@n-api.service[131277]: {"add_host": {"host": "nch2-master-1"}} May 21 21:10:10.942194 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:10:10.942194 ncdv-master-1 devstack@n-api.service[131277]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 21 21:10:10.943624 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '3', 'body': {'add_host': {'host': 'nch2-master-1'}}} May 21 21:10:10.943624 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:10.943624 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:10.943624 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:10.943624 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:10.943624 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:10.943624 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:10.943624 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:10.943624 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:10.943624 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:10:10.943624 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:10:10.943624 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host May 21 21:10:10.943624 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) May 21 21:10:10.943624 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:10:10.943624 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:10:10.943624 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:10:10.943624 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:10:10.943624 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:10.943624 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:10.949773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:10.949773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:10.949773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:10:10.949773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:10:10.949773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:10:10.949773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:10:10.949773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:10:10.949773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:10:10.949773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 21 21:10:10.949773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:10.949773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:10.949773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:10.949773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:10.949773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:10.949773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:10.949773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:10:10.949773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:10:10.949773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 21 21:10:10.949773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:10.951156 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7152d772-09b1-4278-bd21-233f04a7ee8d tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:10.951156 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7152d772-09b1-4278-bd21-233f04a7ee8d tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] 10.222.0.49 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.529631 May 21 21:10:10.951156 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 21/55] 10.222.0.49 () {60 vars in 1190 bytes} [Sat May 21 21:10:10 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 539 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:10.963342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-64fbd6cb-0954-4b47-b353-a2f7110601b2 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:10.997025 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-64fbd6cb-0954-4b47-b353-a2f7110601b2 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044592 May 21 21:10:10.998102 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 22/56] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:11.011729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-001a685e-41cc-4386-ba05-de76da2102f9 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:11.012931 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:11.012931 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:11.082356 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-001a685e-41cc-4386-ba05-de76da2102f9 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.082937 May 21 21:10:11.087885 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 23/57] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:10:10 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 21 21:10:11.092808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e168f640-51a6-4307-8394-6046d2366eb7 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1341282478", "id": 1583608732, "os-flavor-access:is_public": "False"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:11.094324 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:11.094324 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:11.250960 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e168f640-51a6-4307-8394-6046d2366eb7 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.161847 May 21 21:10:11.257802 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 24/58] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:11 2022] POST /compute/v2.1/flavors => generated 415 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:11.266892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-788cbd78-3930-49a1-9573-310c5245146b tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-440403664"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:11.271256 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:11.271256 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:11.271256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.aggregate [None req-788cbd78-3930-49a1-9573-310c5245146b tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Generated uuid 9c781f58-5a8b-4b39-8778-de5fd77c9ac6 for aggregate {{(pid=131277) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 21 21:10:11.395617 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-788cbd78-3930-49a1-9573-310c5245146b tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.134526 May 21 21:10:11.404085 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 25/59] 10.222.0.49 () {60 vars in 1163 bytes} [Sat May 21 21:10:11 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:11.411563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d8b2f744-13e3-4472-8eb1-bfa59f98acf2 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-437094662", "id": 1249761171, "os-flavor-access:is_public": "True"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:11.413575 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:11.413575 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:11.521964 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d8b2f744-13e3-4472-8eb1-bfa59f98acf2 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.113611 May 21 21:10:11.524711 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 26/60] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:11 2022] POST /compute/v2.1/flavors => generated 413 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:11.538472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2f3d535f-54f8-487d-95ee-a592580ebe0e tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1331882877"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:11.541180 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:11.541180 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:11.562366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f3d535f-54f8-487d-95ee-a592580ebe0e tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:11.562983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f3d535f-54f8-487d-95ee-a592580ebe0e tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:11.585117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f3d535f-54f8-487d-95ee-a592580ebe0e tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:11.588768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f3d535f-54f8-487d-95ee-a592580ebe0e tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:11.612465 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-2f3d535f-54f8-487d-95ee-a592580ebe0e tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1331882877 could not be found. May 21 21:10:11.623141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2f3d535f-54f8-487d-95ee-a592580ebe0e tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Request method failure captured: May 21 21:10:11.623141 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 May 21 21:10:11.623141 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:11.623141 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:11.623141 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:11.623141 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 58 May 21 21:10:11.623141 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:11.623141 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:11.623141 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:11.623141 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:11.623141 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVUtXoSJ6VszP1U-oSZcLfMM7HYXvJXhpF39QKode8HEZSIad3dvZNMVnM7NipekWfPeDS9X_y3nSjfA8qN7aKQpw7-9HSQWUXK9vEl3R8enRfwRO-p9lsbngVLl9EqL39DiWOhS9LQQ2lhmdaY4N0lVaBWLUuunh7nFRPyKyzFxNy0 May 21 21:10:11.623141 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:11.623141 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:11.623141 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:11.623141 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:11.623141 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:11.623141 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:11.623141 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 194a569eab164ba1b3752b2830e8f92e May 21 21:10:11.623141 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:11.623141 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:10:11.623141 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:10:11.624632 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_194a569eab164ba1b3752b2830e8f92e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:11.624632 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:11.624632 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 194a569eab164ba1b3752b2830e8f92e May 21 21:10:11.624632 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:11.624632 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin May 21 21:10:11.624632 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:11.624632 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:11.624632 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 1004a63485ce499499be9b3a3f2c1380 May 21 21:10:11.624632 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin May 21 21:10:11.624632 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:10:11.624632 ncdv-master-1 devstack@n-api.service[131277]: {"add_host": {"host": "tempest-nonexist_host-1331882877"}} May 21 21:10:11.624632 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:10:11.624632 ncdv-master-1 devstack@n-api.service[131277]: exception: Compute host tempest-nonexist_host-1331882877 could not be found. May 21 21:10:11.625479 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-1331882877'}}} May 21 21:10:11.625479 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:11.625479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:11.625479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host May 21 21:10:11.625479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 21 21:10:11.625479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:10:11.625479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:10:11.625479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 21 21:10:11.625479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 21 21:10:11.625479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:10:11.625479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:10:11.625479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 21 21:10:11.625479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 21 21:10:11.625479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1331882877' is not mapped to any cell May 21 21:10:11.625479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.625479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:11.625479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.625479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:11.625479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host May 21 21:10:11.626751 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) May 21 21:10:11.626751 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 21 21:10:11.626751 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 21 21:10:11.626751 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 21 21:10:11.626751 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.626751 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:11.626751 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.626751 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:11.626751 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host May 21 21:10:11.626751 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) May 21 21:10:11.626751 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 21 21:10:11.626751 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 21 21:10:11.626751 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:11.626751 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:11.626751 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:11.626751 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:11.626751 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 21 21:10:11.626751 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 21 21:10:11.626751 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate May 21 21:10:11.626751 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) May 21 21:10:11.627991 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host May 21 21:10:11.627991 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) May 21 21:10:11.627991 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1331882877 could not be found. May 21 21:10:11.627991 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.627991 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:11.627991 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.627991 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:11.627991 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:11.627991 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:11.627991 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:11.627991 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:11.627991 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:11.627991 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:11.627991 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:10:11.627991 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:10:11.627991 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host May 21 21:10:11.627991 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:10:11.627991 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1331882877 could not be found. May 21 21:10:11.627991 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.627991 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:11.627991 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.629493 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:11.629493 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:11.629493 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:11.629493 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:11.629493 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:11.629493 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1331882877 could not be found. May 21 21:10:11.629493 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.632224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2f3d535f-54f8-487d-95ee-a592580ebe0e tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1331882877 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:11.636037 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2f3d535f-54f8-487d-95ee-a592580ebe0e tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 111 microversion: 2.1 time: 0.110168 May 21 21:10:11.638784 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 27/61] 10.222.0.49 () {60 vars in 1190 bytes} [Sat May 21 21:10:11 2022] POST /compute/v2.1/os-aggregates/5/action => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:11.652508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ec2f343c-a9b7-4814-b4f0-11656d54b6fc tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:11.688899 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ec2f343c-a9b7-4814-b4f0-11656d54b6fc tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.048718 May 21 21:10:11.690046 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 28/62] 10.222.0.49 () {58 vars in 1168 bytes} [Sat May 21 21:10:11 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:11.700874 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2e156bf7-378c-4195-bfae-2a8eeb56ff93 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:11.702457 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:11.702457 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:11.834689 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2e156bf7-378c-4195-bfae-2a8eeb56ff93 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.143241 May 21 21:10:11.835864 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 29/63] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:10:11 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 21 21:10:11.856064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-78b87495-9647-4929-a97e-a596e5c03513 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:11.872408 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-78b87495-9647-4929-a97e-a596e5c03513 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.035158 May 21 21:10:11.873001 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 30/64] 10.222.0.49 () {58 vars in 1176 bytes} [Sat May 21 21:10:11 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:11.884529 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4889c40e-8313-468c-8ffd-0daee0b59ee8 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:11.900097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4889c40e-8313-468c-8ffd-0daee0b59ee8 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Request method failure captured: May 21 21:10:11.900097 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 21 21:10:11.900097 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:11.900097 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:11.900097 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:11.900097 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 283 May 21 21:10:11.900097 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:11.900097 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:11.900097 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:11.900097 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:11.900097 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVUtXoSJ6VszP1U-oSZcLfMM7HYXvJXhpF39QKode8HEZSIad3dvZNMVnM7NipekWfPeDS9X_y3nSjfA8qN7aKQpw7-9HSQWUXK9vEl3R8enRfwRO-p9lsbngVLl9EqL39DiWOhS9LQQ2lhmdaY4N0lVaBWLUuunh7nFRPyKyzFxNy0 May 21 21:10:11.900097 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:11.900097 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:11.900097 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:11.900097 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:11.900097 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:11.900097 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:11.900097 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 194a569eab164ba1b3752b2830e8f92e May 21 21:10:11.900097 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:11.900097 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:10:11.900097 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:10:11.901632 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_194a569eab164ba1b3752b2830e8f92e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:11.901632 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:11.901632 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 194a569eab164ba1b3752b2830e8f92e May 21 21:10:11.901632 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:11.901632 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin May 21 21:10:11.901632 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:11.901632 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:11.901632 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 1004a63485ce499499be9b3a3f2c1380 May 21 21:10:11.901632 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin May 21 21:10:11.901632 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:10:11.901632 ncdv-master-1 devstack@n-api.service[131277]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 21 21:10:11.902352 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:10:11.902352 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 21 21:10:11.902352 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 21 21:10:11.902352 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:11.902352 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:11.902352 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:10:11.902352 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:10:11.902352 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:10:11.902352 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise error May 21 21:10:11.902352 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 21 21:10:11.902352 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.903119 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: May 21 21:10:11.903119 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 21 21:10:11.903119 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.903119 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi On instance['aggregate']: May 21 21:10:11.903119 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 21 21:10:11.903119 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.903119 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:11.903119 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.903119 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:11.903119 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:11.903119 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:11.903119 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:11.903119 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:11.903119 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:11.903119 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:11.903119 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:10:11.903119 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:10:11.903119 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:10:11.903119 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:10:11.904459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:10:11.904459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:10:11.904459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:10:11.904459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:10:11.904459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 21 21:10:11.904459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.904459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:11.904459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.904459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:11.904459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:11.904459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:11.904459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:10:11.904459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:10:11.906711 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 21 21:10:11.906711 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.906711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4889c40e-8313-468c-8ffd-0daee0b59ee8 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:11.907096 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4889c40e-8313-468c-8ffd-0daee0b59ee8 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.031449 May 21 21:10:11.908154 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 31/65] 10.222.0.49 () {60 vars in 1164 bytes} [Sat May 21 21:10:11 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:10:11.917897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2fcabe30-0fe1-4c92-99e0-42f1ec6a7773 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:11.932636 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2fcabe30-0fe1-4c92-99e0-42f1ec6a7773 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.018770 May 21 21:10:11.933747 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 32/66] 10.222.0.49 () {58 vars in 1170 bytes} [Sat May 21 21:10:11 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:11.945570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-20552be4-da2a-4f16-b60b-0b4bb7edcbec tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:11.948827 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-20552be4-da2a-4f16-b60b-0b4bb7edcbec tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Request method failure captured: May 21 21:10:11.948827 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 21 21:10:11.948827 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:11.948827 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:11.948827 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:11.948827 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 27 May 21 21:10:11.948827 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:11.948827 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:11.948827 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:11.948827 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:11.948827 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVUtXoSJ6VszP1U-oSZcLfMM7HYXvJXhpF39QKode8HEZSIad3dvZNMVnM7NipekWfPeDS9X_y3nSjfA8qN7aKQpw7-9HSQWUXK9vEl3R8enRfwRO-p9lsbngVLl9EqL39DiWOhS9LQQ2lhmdaY4N0lVaBWLUuunh7nFRPyKyzFxNy0 May 21 21:10:11.948827 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:11.948827 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:11.948827 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:11.948827 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:11.948827 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:11.948827 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:11.948827 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 194a569eab164ba1b3752b2830e8f92e May 21 21:10:11.948827 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:11.948827 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:10:11.948827 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:10:11.949928 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_194a569eab164ba1b3752b2830e8f92e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:11.949928 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:11.949928 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 194a569eab164ba1b3752b2830e8f92e May 21 21:10:11.949928 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:11.949928 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin May 21 21:10:11.949928 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:11.949928 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:11.949928 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 1004a63485ce499499be9b3a3f2c1380 May 21 21:10:11.949928 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin May 21 21:10:11.949928 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:10:11.949928 ncdv-master-1 devstack@n-api.service[131277]: {"aggregate": {"name": ""}} May 21 21:10:11.949928 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:10:11.949928 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid input for field/attribute name. Value: . '' is too short May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'aggregate': {'name': ''}}} May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise error May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi On instance['aggregate']: May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi '' May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:11.950661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:11.951852 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:11.951852 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:10:11.951852 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:10:11.951852 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:10:11.951852 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:10:11.951852 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:10:11.951852 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:10:11.951852 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:10:11.951852 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:10:11.951852 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 21 21:10:11.951852 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.951852 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:11.951852 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.951852 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:11.951852 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:11.951852 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:11.951852 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:10:11.951852 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:10:11.951852 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 21 21:10:11.951852 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.961712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-20552be4-da2a-4f16-b60b-0b4bb7edcbec tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:11.961712 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-20552be4-da2a-4f16-b60b-0b4bb7edcbec tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.015871 May 21 21:10:11.961712 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1163 bytes} [Sat May 21 21:10:11 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:10:11.961712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c0b16416-15f3-4a09-8464-c55de2b62003 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:11.967389 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c0b16416-15f3-4a09-8464-c55de2b62003 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.015220 May 21 21:10:11.974522 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 34/68] 10.222.0.49 () {58 vars in 1168 bytes} [Sat May 21 21:10:11 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:11.974522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7d7355e5-c30f-4dbb-82e0-baa0ca5254ae tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-369558954"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:11.975799 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:11.975799 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:11.976875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7d7355e5-c30f-4dbb-82e0-baa0ca5254ae tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'dc272ac8b07342829bcb11cfeb0646cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2926f5876ac4d439fb39c6d8baa1c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:11.978610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7d7355e5-c30f-4dbb-82e0-baa0ca5254ae tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Request method failure captured: May 21 21:10:11.978610 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 21 21:10:11.978610 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:11.978610 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:11.978610 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:11.978610 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 59 May 21 21:10:11.978610 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:11.978610 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:11.978610 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:11.978610 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:11.978610 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVUpvM8fezsHPo8FJ3g5sqfBFVfMmZv4yYLruMAfgdWJq7eufXBlWOrl9L_njcGFxgGrXtGG9z1QoUD9yIUsYQkiq0c7gSHaV1Ge_DLwc5RSKLDXZy0JmpCiJQyqZIdu5GrDxFyPjn1xUNjk5BUhoVQs5SbR6SgRw1Ix9YyRLPgFSag May 21 21:10:11.978610 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:11.978610 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:11.978610 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:11.978610 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:11.978610 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:11.978610 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:11.978610 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: e2926f5876ac4d439fb39c6d8baa1c8a May 21 21:10:11.978610 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1205282029 May 21 21:10:11.978610 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:10:11.978610 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:10:11.979773 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e2926f5876ac4d439fb39c6d8baa1c8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2926f5876ac4d439fb39c6d8baa1c8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e2926f5876ac4d439fb39c6d8baa1c8a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2926f5876ac4d439fb39c6d8baa1c8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:11.979773 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1205282029 May 21 21:10:11.979773 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: e2926f5876ac4d439fb39c6d8baa1c8a May 21 21:10:11.979773 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1205282029 May 21 21:10:11.979773 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AggregatesAdminNegativeTestJSON-1205282029-project May 21 21:10:11.979773 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:11.979773 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:11.979773 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: dc272ac8b07342829bcb11cfeb0646cc May 21 21:10:11.979773 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1205282029-project May 21 21:10:11.979773 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:10:11.979773 ncdv-master-1 devstack@n-api.service[131277]: {"aggregate": {"name": "tempest-test_aggregate-369558954"}} May 21 21:10:11.979773 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:10:11.979773 ncdv-master-1 devstack@n-api.service[131277]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 21 21:10:11.980475 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-369558954'}}} May 21 21:10:11.980475 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:11.980475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:11.980475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:11.980475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:11.980475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:11.980475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:11.980475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:11.980475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:11.980475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:10:11.980475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:10:11.980475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:10:11.980475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:10:11.980475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create May 21 21:10:11.980475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) May 21 21:10:11.980475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:10:11.980475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:10:11.980475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:10:11.980475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:10:11.981427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:11.981427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:11.981427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:11.981427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:11.981427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:10:11.981427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:10:11.981427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:10:11.981427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:10:11.981427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:10:11.981427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:10:11.981427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 21 21:10:11.981427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.981427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:11.981427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.981427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:11.981427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:11.981427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:11.981427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:10:11.981427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:10:11.981427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 21 21:10:11.982517 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:11.982517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7d7355e5-c30f-4dbb-82e0-baa0ca5254ae tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:11.982517 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7d7355e5-c30f-4dbb-82e0-baa0ca5254ae tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.011461 May 21 21:10:11.986138 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 35/69] 10.222.0.49 () {60 vars in 1163 bytes} [Sat May 21 21:10:11 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:11.999168 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7a883704-5a46-4dbc-ac89-379174794647 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:12.011292 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7a883704-5a46-4dbc-ac89-379174794647 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.024088 May 21 21:10:12.012326 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 36/70] 10.222.0.49 () {58 vars in 1168 bytes} [Sat May 21 21:10:11 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:12.016462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6adbdcb9-3e06-4f9a-969d-4f29613b3190 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1743684460"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:12.018649 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.aggregate [None req-6adbdcb9-3e06-4f9a-969d-4f29613b3190 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Generated uuid 65d10aa8-605d-4859-9427-68e776d9a48f for aggregate {{(pid=131277) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 21 21:10:12.169536 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6adbdcb9-3e06-4f9a-969d-4f29613b3190 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.156151 May 21 21:10:12.170344 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 37/71] 10.222.0.49 () {60 vars in 1163 bytes} [Sat May 21 21:10:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:12.185029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d437e87c-7f3d-47dd-88f7-fd376df05189 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:12.232370 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d437e87c-7f3d-47dd-88f7-fd376df05189 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.051847 May 21 21:10:12.234924 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 38/72] 10.222.0.49 () {58 vars in 1174 bytes} [Sat May 21 21:10:12 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:12.243802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-017f534e-67b3-417a-8d6d-31930e076cee tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1743684460"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:12.246614 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:12.246614 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:12.250228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.aggregate [None req-017f534e-67b3-417a-8d6d-31930e076cee tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Generated uuid 6bd12bb0-943f-4c8b-989d-5f5cd6990d94 for aggregate {{(pid=131277) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 21 21:10:12.272705 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-017f534e-67b3-417a-8d6d-31930e076cee tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1743684460 already exists. May 21 21:10:12.274534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-017f534e-67b3-417a-8d6d-31930e076cee tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Request method failure captured: May 21 21:10:12.274534 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 21 21:10:12.274534 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:12.274534 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:12.274534 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:12.274534 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 60 May 21 21:10:12.274534 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:12.274534 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:12.274534 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:12.274534 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:12.274534 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVUtXoSJ6VszP1U-oSZcLfMM7HYXvJXhpF39QKode8HEZSIad3dvZNMVnM7NipekWfPeDS9X_y3nSjfA8qN7aKQpw7-9HSQWUXK9vEl3R8enRfwRO-p9lsbngVLl9EqL39DiWOhS9LQQ2lhmdaY4N0lVaBWLUuunh7nFRPyKyzFxNy0 May 21 21:10:12.274534 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:12.274534 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:12.274534 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:12.274534 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:12.274534 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:12.274534 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:12.274534 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 194a569eab164ba1b3752b2830e8f92e May 21 21:10:12.274534 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:12.274534 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:10:12.274534 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:10:12.275955 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_194a569eab164ba1b3752b2830e8f92e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:12.275955 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:12.275955 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 194a569eab164ba1b3752b2830e8f92e May 21 21:10:12.275955 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:12.275955 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin May 21 21:10:12.275955 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:12.275955 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:12.275955 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 1004a63485ce499499be9b3a3f2c1380 May 21 21:10:12.275955 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin May 21 21:10:12.275955 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:10:12.275955 ncdv-master-1 devstack@n-api.service[131277]: {"aggregate": {"name": "tempest-test_aggregate-1743684460"}} May 21 21:10:12.275955 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:10:12.275955 ncdv-master-1 devstack@n-api.service[131277]: exception: Aggregate tempest-test_aggregate-1743684460 already exists. May 21 21:10:12.276825 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1743684460'}}} May 21 21:10:12.276825 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:12.276825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:12.276825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create May 21 21:10:12.276825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) May 21 21:10:12.276825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 21 21:10:12.276825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 21 21:10:12.276825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:12.276825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:12.276825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:12.276825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:12.276825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 21 21:10:12.276825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 21 21:10:12.276825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate May 21 21:10:12.276825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi aggregate.create() May 21 21:10:12.276825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 21 21:10:12.276825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 21 21:10:12.276825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create May 21 21:10:12.276825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, May 21 21:10:12.278035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:10:12.278035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:10:12.278035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db May 21 21:10:12.278035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) May 21 21:10:12.278035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1743684460 already exists. May 21 21:10:12.278035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:12.278035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:12.278035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:12.278035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:12.278035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:12.278035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:12.278035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:12.278035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:12.278035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:12.278035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:12.278035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:10:12.278035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:10:12.278035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:10:12.278035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:10:12.278035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create May 21 21:10:12.279284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) May 21 21:10:12.279284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1743684460 already exists. May 21 21:10:12.279284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:12.279284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:12.279284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:12.279284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:12.279284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:12.279284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:12.279284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:12.279284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:12.279284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1743684460 already exists. May 21 21:10:12.279284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:12.279284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-017f534e-67b3-417a-8d6d-31930e076cee tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1743684460 already exists. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:12.280153 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-017f534e-67b3-417a-8d6d-31930e076cee tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.041366 May 21 21:10:12.280815 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 39/73] 10.222.0.49 () {60 vars in 1163 bytes} [Sat May 21 21:10:12 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 21 21:10:12.288585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b19c71b0-c818-4a52-817b-834002b22b12 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:12.309610 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b19c71b0-c818-4a52-817b-834002b22b12 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.026839 May 21 21:10:12.310772 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 40/74] 10.222.0.49 () {58 vars in 1172 bytes} [Sat May 21 21:10:12 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:12.315432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-eb43d739-30ff-445f-a8d3-1b8ff4edbe72 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:12.316496 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:12.316496 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:12.427836 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-eb43d739-30ff-445f-a8d3-1b8ff4edbe72 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.115626 May 21 21:10:12.433558 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 41/75] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:10:12 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 21 21:10:12.437341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-019ac523-351f-40c5-980a-f34121a991bf tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:12.484950 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-019ac523-351f-40c5-980a-f34121a991bf tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.054166 May 21 21:10:12.490373 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 42/76] 10.222.0.49 () {58 vars in 1168 bytes} [Sat May 21 21:10:12 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:12.509935 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aaf1b44c-07ee-468d-96c9-44006b710e9e tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-659040059"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:12.511340 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:12.511340 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:12.512145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.aggregate [None req-aaf1b44c-07ee-468d-96c9-44006b710e9e tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Generated uuid 58d60b9e-d315-4225-9275-52b08ccd0c89 for aggregate {{(pid=131277) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 21 21:10:12.666877 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aaf1b44c-07ee-468d-96c9-44006b710e9e tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.175180 May 21 21:10:12.667729 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 43/77] 10.222.0.49 () {60 vars in 1163 bytes} [Sat May 21 21:10:12 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:12.678241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f5ccd6a6-27ae-4dc5-bcb1-018db9a6245d tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:12.679268 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:12.679268 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:12.791793 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f5ccd6a6-27ae-4dc5-bcb1-018db9a6245d tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1249761171" status: 202 len: 0 microversion: 2.1 time: 0.117636 May 21 21:10:12.792577 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 44/78] 10.222.0.49 () {58 vars in 1160 bytes} [Sat May 21 21:10:12 2022] DELETE /compute/v2.1/flavors/1249761171 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:10:12.799288 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cd94f551-5be7-49cd-9a6e-2dba1e345c43 tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:12.800149 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:12.800149 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:12.801487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cd94f551-5be7-49cd-9a6e-2dba1e345c43 tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'dc272ac8b07342829bcb11cfeb0646cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2926f5876ac4d439fb39c6d8baa1c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:12.803989 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cd94f551-5be7-49cd-9a6e-2dba1e345c43 tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Request method failure captured: May 21 21:10:12.803989 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 May 21 21:10:12.803989 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:12.803989 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:12.803989 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:12.803989 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:10:12.803989 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:12.803989 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:12.803989 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:12.803989 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:12.803989 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVUpvM8fezsHPo8FJ3g5sqfBFVfMmZv4yYLruMAfgdWJq7eufXBlWOrl9L_njcGFxgGrXtGG9z1QoUD9yIUsYQkiq0c7gSHaV1Ge_DLwc5RSKLDXZy0JmpCiJQyqZIdu5GrDxFyPjn1xUNjk5BUhoVQs5SbR6SgRw1Ix9YyRLPgFSag May 21 21:10:12.803989 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:12.803989 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:12.803989 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:12.803989 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:12.803989 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:12.803989 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:12.803989 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: e2926f5876ac4d439fb39c6d8baa1c8a May 21 21:10:12.803989 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1205282029 May 21 21:10:12.803989 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:10:12.803989 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:10:12.805568 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e2926f5876ac4d439fb39c6d8baa1c8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2926f5876ac4d439fb39c6d8baa1c8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e2926f5876ac4d439fb39c6d8baa1c8a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2926f5876ac4d439fb39c6d8baa1c8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:12.805568 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1205282029 May 21 21:10:12.805568 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: e2926f5876ac4d439fb39c6d8baa1c8a May 21 21:10:12.805568 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1205282029 May 21 21:10:12.805568 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AggregatesAdminNegativeTestJSON-1205282029-project May 21 21:10:12.805568 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:12.805568 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:12.805568 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: dc272ac8b07342829bcb11cfeb0646cc May 21 21:10:12.805568 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1205282029-project May 21 21:10:12.805568 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:10:12.805568 ncdv-master-1 devstack@n-api.service[131277]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 21 21:10:12.805568 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '7'} May 21 21:10:12.806209 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:12.806209 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:12.806209 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:12.806209 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:12.806209 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:12.806209 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:12.806209 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:12.806209 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:12.806209 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete May 21 21:10:12.806209 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) May 21 21:10:12.806209 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:10:12.806209 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:10:12.806209 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:10:12.806209 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:10:12.806209 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:12.806209 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:12.806209 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:12.806209 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:12.806209 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:10:12.807171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:10:12.807171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:10:12.807171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:10:12.807171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:10:12.807171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:10:12.807171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 21 21:10:12.807171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:12.807171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:12.807171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:12.807171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:12.807171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:12.807171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:12.807171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:10:12.807171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:10:12.807171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 21 21:10:12.807171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:12.807171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cd94f551-5be7-49cd-9a6e-2dba1e345c43 tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:12.808020 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cd94f551-5be7-49cd-9a6e-2dba1e345c43 tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.012264 May 21 21:10:12.808020 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 45/79] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:10:12 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:12.814955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-56044ed3-1608-44ed-b786-4a5cb47e56d3 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:12.836032 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-56044ed3-1608-44ed-b786-4a5cb47e56d3 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028847 May 21 21:10:12.837268 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 46/80] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:12.847315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fd09a94a-07d8-4fd9-85c9-01a229e7e9a0 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:12.991507 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fd09a94a-07d8-4fd9-85c9-01a229e7e9a0 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.152969 May 21 21:10:12.997521 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 47/81] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:10:12 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 21 21:10:13.002888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3c840fd5-9bdf-4ab1-bd4f-943c8bd7af5e tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:13.003649 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:13.003649 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:13.157768 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3c840fd5-9bdf-4ab1-bd4f-943c8bd7af5e tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1583608732" status: 202 len: 0 microversion: 2.1 time: 0.158108 May 21 21:10:13.163355 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 48/82] 10.222.0.49 () {58 vars in 1160 bytes} [Sat May 21 21:10:12 2022] DELETE /compute/v2.1/flavors/1583608732 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:10:13.167734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-baf6e8bc-9138-4c35-8a6d-a1bfebe6fe10 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:13.169898 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:13.169898 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:13.185377 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-baf6e8bc-9138-4c35-8a6d-a1bfebe6fe10 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] HTTP exception thrown: Aggregate -1 could not be found. May 21 21:10:13.187350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-baf6e8bc-9138-4c35-8a6d-a1bfebe6fe10 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Request method failure captured: May 21 21:10:13.187350 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 May 21 21:10:13.187350 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:13.187350 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:13.187350 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:13.187350 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:10:13.187350 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:13.187350 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:13.187350 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:13.187350 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:13.187350 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVUtXoSJ6VszP1U-oSZcLfMM7HYXvJXhpF39QKode8HEZSIad3dvZNMVnM7NipekWfPeDS9X_y3nSjfA8qN7aKQpw7-9HSQWUXK9vEl3R8enRfwRO-p9lsbngVLl9EqL39DiWOhS9LQQ2lhmdaY4N0lVaBWLUuunh7nFRPyKyzFxNy0 May 21 21:10:13.187350 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:13.187350 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:13.187350 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:13.187350 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:13.187350 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:13.187350 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:13.187350 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 194a569eab164ba1b3752b2830e8f92e May 21 21:10:13.187350 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:13.187350 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:10:13.187350 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:10:13.188775 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_194a569eab164ba1b3752b2830e8f92e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:13.188775 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:13.188775 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 194a569eab164ba1b3752b2830e8f92e May 21 21:10:13.188775 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:13.188775 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin May 21 21:10:13.188775 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:13.188775 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:13.188775 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 1004a63485ce499499be9b3a3f2c1380 May 21 21:10:13.188775 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin May 21 21:10:13.188775 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:10:13.188775 ncdv-master-1 devstack@n-api.service[131277]: exception: Aggregate -1 could not be found. May 21 21:10:13.188775 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '-1'} May 21 21:10:13.189511 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:13.189511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:13.189511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 21 21:10:13.189511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 21 21:10:13.189511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 21 21:10:13.189511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 21 21:10:13.189511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:13.189511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:13.189511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:13.189511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:13.189511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 21 21:10:13.189511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 21 21:10:13.189511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate May 21 21:10:13.189511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 21 21:10:13.189511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:10:13.189511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:10:13.189511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 21 21:10:13.189511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 21 21:10:13.189511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:10:13.190688 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:10:13.190688 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 21 21:10:13.190688 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 21 21:10:13.190688 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. May 21 21:10:13.190688 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:13.190688 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:13.190688 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:13.190688 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:13.190688 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:13.190688 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:13.190688 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:13.190688 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:13.190688 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:13.190688 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:13.190688 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 21 21:10:13.190688 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:10:13.190688 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. May 21 21:10:13.190688 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:13.190688 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:13.190688 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:13.190688 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:13.191973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:13.191973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:13.191973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:13.191973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:13.191973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. May 21 21:10:13.191973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:13.195398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-baf6e8bc-9138-4c35-8a6d-a1bfebe6fe10 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:13.196455 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-baf6e8bc-9138-4c35-8a6d-a1bfebe6fe10 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.035903 May 21 21:10:13.203860 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 49/83] 10.222.0.49 () {58 vars in 1154 bytes} [Sat May 21 21:10:13 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:10:13.209997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7ef0888a-ae08-47a0-aa1c-a64ff505ce9d tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:13.231914 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7ef0888a-ae08-47a0-aa1c-a64ff505ce9d tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026832 May 21 21:10:13.233045 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 50/84] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:13.237966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c6defe2b-9ab5-4e14-971c-54eba5762413 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1029829656"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:13.244433 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:13.244433 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:13.244433 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.aggregate [None req-c6defe2b-9ab5-4e14-971c-54eba5762413 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Generated uuid d7deadd3-cb21-493e-bcca-96afe795e77f for aggregate {{(pid=131277) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 21 21:10:13.332800 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0a854542-d4b1-4f0e-88b4-a7a1962c9113 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 312 microversion: 2.1 time: 2.577945 May 21 21:10:13.333467 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 35/85] 10.222.0.49 () {60 vars in 1190 bytes} [Sat May 21 21:10:10 2022] POST /compute/v2.1/os-aggregates/4/action => generated 312 bytes in 2580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:13.346497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6b60ba1c-2f45-47e9-9a02-a04d3963f8b6 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1741234451", "id": 1671164660, "os-flavor-access:is_public": "False"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:13.348560 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:13.348560 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:13.352902 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c6defe2b-9ab5-4e14-971c-54eba5762413 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.118463 May 21 21:10:13.353759 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 51/86] 10.222.0.49 () {60 vars in 1163 bytes} [Sat May 21 21:10:13 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:13.365719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-04b03627-b93b-4091-9a23-c42401bbeef2 tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:13.366763 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:13.366763 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:13.367779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-04b03627-b93b-4091-9a23-c42401bbeef2 tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'dc272ac8b07342829bcb11cfeb0646cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2926f5876ac4d439fb39c6d8baa1c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:13.373417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-04b03627-b93b-4091-9a23-c42401bbeef2 tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Request method failure captured: May 21 21:10:13.373417 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 May 21 21:10:13.373417 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:13.373417 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:13.373417 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:13.373417 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:10:13.373417 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:13.373417 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:13.373417 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:13.373417 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:13.373417 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVUpvM8fezsHPo8FJ3g5sqfBFVfMmZv4yYLruMAfgdWJq7eufXBlWOrl9L_njcGFxgGrXtGG9z1QoUD9yIUsYQkiq0c7gSHaV1Ge_DLwc5RSKLDXZy0JmpCiJQyqZIdu5GrDxFyPjn1xUNjk5BUhoVQs5SbR6SgRw1Ix9YyRLPgFSag May 21 21:10:13.373417 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:13.373417 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:13.373417 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:13.373417 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:13.373417 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:13.373417 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:13.373417 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: e2926f5876ac4d439fb39c6d8baa1c8a May 21 21:10:13.373417 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1205282029 May 21 21:10:13.373417 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:10:13.373417 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:10:13.374898 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e2926f5876ac4d439fb39c6d8baa1c8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2926f5876ac4d439fb39c6d8baa1c8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e2926f5876ac4d439fb39c6d8baa1c8a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2926f5876ac4d439fb39c6d8baa1c8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:13.374898 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1205282029 May 21 21:10:13.374898 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: e2926f5876ac4d439fb39c6d8baa1c8a May 21 21:10:13.374898 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1205282029 May 21 21:10:13.374898 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AggregatesAdminNegativeTestJSON-1205282029-project May 21 21:10:13.374898 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:13.374898 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:13.374898 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: dc272ac8b07342829bcb11cfeb0646cc May 21 21:10:13.374898 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1205282029-project May 21 21:10:13.374898 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:10:13.374898 ncdv-master-1 devstack@n-api.service[131277]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 21 21:10:13.374898 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '8'} May 21 21:10:13.375705 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:13.375705 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:13.375705 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:13.375705 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:13.375705 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:13.375705 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:13.375705 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:13.375705 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:13.375705 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show May 21 21:10:13.375705 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) May 21 21:10:13.375705 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:10:13.375705 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:10:13.375705 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:10:13.375705 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:10:13.375705 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:13.375705 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:13.375705 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:13.375705 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:13.375705 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:10:13.376997 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:10:13.376997 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:10:13.376997 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:10:13.376997 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:10:13.376997 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:10:13.376997 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 21 21:10:13.376997 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:13.376997 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:13.376997 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:13.376997 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:13.376997 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:13.376997 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:13.376997 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:10:13.376997 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:10:13.376997 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 21 21:10:13.376997 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:13.376997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-04b03627-b93b-4091-9a23-c42401bbeef2 tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:13.378659 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-04b03627-b93b-4091-9a23-c42401bbeef2 tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] 10.222.0.49 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.018592 May 21 21:10:13.381354 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 52/87] 10.222.0.49 () {58 vars in 1148 bytes} [Sat May 21 21:10:13 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:13.393599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-39aa7186-5ed1-4c44-9cab-952a839edb37 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:13.394896 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:13.394896 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:13.409139 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:DELETE=16,nova_api:SELECT=77,nova_api:INSERT=7 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:13.497789 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6b60ba1c-2f45-47e9-9a02-a04d3963f8b6 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.163077 May 21 21:10:13.503674 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 36/88] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:13 2022] POST /compute/v2.1/flavors => generated 415 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:13.511805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1058525b-a2a5-47b1-8769-9c8fae08a695 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:13.524679 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-39aa7186-5ed1-4c44-9cab-952a839edb37 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.135576 May 21 21:10:13.525266 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 53/89] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:10:13 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 21 21:10:13.535520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-68e578d1-173e-4279-8fec-e4a6a16f04cd tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:13.537029 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:13.537029 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:13.546914 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-68e578d1-173e-4279-8fec-e4a6a16f04cd tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] HTTP exception thrown: Aggregate -1 could not be found. May 21 21:10:13.548504 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-68e578d1-173e-4279-8fec-e4a6a16f04cd tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Request method failure captured: May 21 21:10:13.548504 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 May 21 21:10:13.548504 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:13.548504 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:13.548504 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:13.548504 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:10:13.548504 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:13.548504 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:13.548504 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:13.548504 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:13.548504 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVUtXoSJ6VszP1U-oSZcLfMM7HYXvJXhpF39QKode8HEZSIad3dvZNMVnM7NipekWfPeDS9X_y3nSjfA8qN7aKQpw7-9HSQWUXK9vEl3R8enRfwRO-p9lsbngVLl9EqL39DiWOhS9LQQ2lhmdaY4N0lVaBWLUuunh7nFRPyKyzFxNy0 May 21 21:10:13.548504 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:13.548504 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:13.548504 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:13.548504 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:13.548504 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:13.548504 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:13.548504 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 194a569eab164ba1b3752b2830e8f92e May 21 21:10:13.548504 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:13.548504 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:10:13.548504 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:10:13.549852 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_194a569eab164ba1b3752b2830e8f92e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:13.549852 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:13.549852 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 194a569eab164ba1b3752b2830e8f92e May 21 21:10:13.549852 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:13.549852 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin May 21 21:10:13.549852 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:13.549852 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:13.549852 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 1004a63485ce499499be9b3a3f2c1380 May 21 21:10:13.549852 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin May 21 21:10:13.549852 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:10:13.549852 ncdv-master-1 devstack@n-api.service[131277]: exception: Aggregate -1 could not be found. May 21 21:10:13.549852 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '-1'} May 21 21:10:13.550584 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:13.550584 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:13.550584 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 21 21:10:13.550584 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 21 21:10:13.550584 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate May 21 21:10:13.550584 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 21 21:10:13.550584 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:10:13.550584 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:10:13.550584 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 21 21:10:13.550584 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 21 21:10:13.550584 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:10:13.550584 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:10:13.550584 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 21 21:10:13.550584 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 21 21:10:13.550584 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. May 21 21:10:13.550584 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:13.550584 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:13.550584 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:13.550584 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:13.550584 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:13.551830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:13.551830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:13.551830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:13.551830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:13.551830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:13.551830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 21 21:10:13.551830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:10:13.551830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. May 21 21:10:13.551830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:13.551830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:13.551830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:13.551830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:13.551830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:13.551830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:13.551830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:13.551830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:13.551830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. May 21 21:10:13.551830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:13.557173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-68e578d1-173e-4279-8fec-e4a6a16f04cd tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:13.557173 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-68e578d1-173e-4279-8fec-e4a6a16f04cd tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.022950 May 21 21:10:13.557173 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 54/90] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:10:13 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 21 21:10:13.558671 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1058525b-a2a5-47b1-8769-9c8fae08a695 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053584 May 21 21:10:13.564321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c6d07971-a40d-49d3-a67f-7533c73c66b2 tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:13.565236 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:13.565236 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:13.566440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c6d07971-a40d-49d3-a67f-7533c73c66b2 tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'dc272ac8b07342829bcb11cfeb0646cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2926f5876ac4d439fb39c6d8baa1c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:13.568604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c6d07971-a40d-49d3-a67f-7533c73c66b2 tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Request method failure captured: May 21 21:10:13.568604 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 May 21 21:10:13.568604 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:13.568604 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:13.568604 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:13.568604 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:10:13.568604 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:13.568604 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:13.568604 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:13.568604 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:13.568604 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVUpvM8fezsHPo8FJ3g5sqfBFVfMmZv4yYLruMAfgdWJq7eufXBlWOrl9L_njcGFxgGrXtGG9z1QoUD9yIUsYQkiq0c7gSHaV1Ge_DLwc5RSKLDXZy0JmpCiJQyqZIdu5GrDxFyPjn1xUNjk5BUhoVQs5SbR6SgRw1Ix9YyRLPgFSag May 21 21:10:13.568604 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:13.568604 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:13.568604 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:13.568604 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:13.568604 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:13.568604 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:13.568604 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: e2926f5876ac4d439fb39c6d8baa1c8a May 21 21:10:13.568604 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1205282029 May 21 21:10:13.568604 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:10:13.568604 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:10:13.569733 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e2926f5876ac4d439fb39c6d8baa1c8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2926f5876ac4d439fb39c6d8baa1c8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e2926f5876ac4d439fb39c6d8baa1c8a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2926f5876ac4d439fb39c6d8baa1c8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:13.569733 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1205282029 May 21 21:10:13.569733 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: e2926f5876ac4d439fb39c6d8baa1c8a May 21 21:10:13.569733 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1205282029 May 21 21:10:13.569733 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AggregatesAdminNegativeTestJSON-1205282029-project May 21 21:10:13.569733 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:13.569733 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:13.569733 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: dc272ac8b07342829bcb11cfeb0646cc May 21 21:10:13.569733 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1205282029-project May 21 21:10:13.569733 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:10:13.569733 ncdv-master-1 devstack@n-api.service[131277]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 21 21:10:13.569733 ncdv-master-1 devstack@n-api.service[131277]: action_args: {} May 21 21:10:13.570354 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:13.570354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:13.570354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:13.570354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:13.570354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:13.570354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:13.570354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:13.570354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:13.570354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index May 21 21:10:13.570354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) May 21 21:10:13.570354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:10:13.570354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:10:13.570354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:10:13.570354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:10:13.570354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:13.570354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:13.570354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:13.570354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:13.570354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:10:13.571283 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:10:13.571283 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:10:13.571283 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:10:13.571283 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:10:13.571283 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:10:13.571283 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 21 21:10:13.571283 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:13.571283 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:13.571283 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:13.571283 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:13.571283 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:13.571283 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:13.571283 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:10:13.571283 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:10:13.571283 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 21 21:10:13.571283 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:13.571283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c6d07971-a40d-49d3-a67f-7533c73c66b2 tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:13.572121 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c6d07971-a40d-49d3-a67f-7533c73c66b2 tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.009895 May 21 21:10:13.572185 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 37/91] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:13.574979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-31a9f043-c7a2-41a4-9f40-f545a83e1740 tempest-FlavorsAdminTestJSON-1337035739 tempest-FlavorsAdminTestJSON-1337035739-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:13.575600 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 55/92] 10.222.0.49 () {58 vars in 1142 bytes} [Sat May 21 21:10:13 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:13.597480 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-31a9f043-c7a2-41a4-9f40-f545a83e1740 tempest-FlavorsAdminTestJSON-1337035739 tempest-FlavorsAdminTestJSON-1337035739-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026116 May 21 21:10:13.598083 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 38/93] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:13.615105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-247cef5a-2e46-4cf5-ba91-4d00fe03b3d4 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:13.616091 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:13.616091 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:13.713209 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-247cef5a-2e46-4cf5-ba91-4d00fe03b3d4 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1671164660" status: 202 len: 0 microversion: 2.1 time: 0.103851 May 21 21:10:13.713806 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 56/94] 10.222.0.49 () {58 vars in 1160 bytes} [Sat May 21 21:10:13 2022] DELETE /compute/v2.1/flavors/1671164660 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:10:13.722729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-414c8674-50a1-4c6b-b0c6-30b0713f9ab6 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:13.747675 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-414c8674-50a1-4c6b-b0c6-30b0713f9ab6 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029237 May 21 21:10:13.772999 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2f3ac64f-a98b-4ff2-b14a-12d721f7b63e tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1767523350", "id": 203325688, "os-flavor-access:is_public": "True"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:13.774911 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:13.774911 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:13.787937 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 39/95] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:13.865850 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2f3ac64f-a98b-4ff2-b14a-12d721f7b63e tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.103432 May 21 21:10:13.872747 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 57/96] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:13 2022] POST /compute/v2.1/flavors => generated 411 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:13.880150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dd392e36-2325-480f-8506-22e14d27d37b tempest-FlavorsAdminTestJSON-1337035739 tempest-FlavorsAdminTestJSON-1337035739-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:13.923870 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dd392e36-2325-480f-8506-22e14d27d37b tempest-FlavorsAdminTestJSON-1337035739 tempest-FlavorsAdminTestJSON-1337035739-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.048402 May 21 21:10:13.950905 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 58/97] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:13 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:13.970466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f47a42f9-de33-452e-bcf6-25c343883408 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:14.083321 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f47a42f9-de33-452e-bcf6-25c343883408 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/203325688" status: 202 len: 0 microversion: 2.1 time: 0.136930 May 21 21:10:14.084388 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 59/98] 10.222.0.49 () {58 vars in 1157 bytes} [Sat May 21 21:10:13 2022] DELETE /compute/v2.1/flavors/203325688 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:10:14.094161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a19b3b18-8e12-49a7-8721-862ea58eea89 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:14.132997 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a19b3b18-8e12-49a7-8721-862ea58eea89 tempest-FlavorsAdminTestJSON-323610475 tempest-FlavorsAdminTestJSON-323610475-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040553 May 21 21:10:14.144079 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 60/99] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:14.386696 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-2146491514", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "availability_zone": "tempest-test_az-397334092"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:14.415724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:14.416464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:14.419057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:14.421510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:15.938571 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] validate_networks() for None {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:10:16.718249 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:10:16.718682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:10:16.719596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:10:16.720174 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:10:16.720958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:10:16.745593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:16.746682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:16.747498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:16.748435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:16.811250 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Getting quotas for project 83797d59cecf40fb97b5f8543a6476d0. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:10:16.828722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Getting quotas for user 222d5f38e7964046befd68eae1123ec0 and project 83797d59cecf40fb97b5f8543a6476d0. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:10:16.842755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:10:16.846597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:10:17.038146 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.193774 May 21 21:10:17.039787 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 40/100] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:10:17.053184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-937cfc7d-8b50-4814-95c3-912f4d378179 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:17.054271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-937cfc7d-8b50-4814-95c3-912f4d378179 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:18.809125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-937cfc7d-8b50-4814-95c3-912f4d378179 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222d5f38e7964046befd68eae1123ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83797d59cecf40fb97b5f8543a6476d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:18.831054 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-937cfc7d-8b50-4814-95c3-912f4d378179 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1242 microversion: 2.1 time: 1.784951 May 21 21:10:18.833262 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 61/101] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:17 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1242 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:19.467612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:19.469274 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-17504a9b-9683-4044-811c-a0fc9659c5f3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002085 May 21 21:10:19.477283 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 41/102] 10.222.0.49 () {56 vars in 885 bytes} [Sat May 21 21:10:19 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 21 21:10:19.852575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-15bb91f0-de24-4068-b190-753b95d0593d tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:19.853208 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-15bb91f0-de24-4068-b190-753b95d0593d tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:19.891951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-15bb91f0-de24-4068-b190-753b95d0593d tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:19.893759 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-15bb91f0-de24-4068-b190-753b95d0593d tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:19.916518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-15bb91f0-de24-4068-b190-753b95d0593d tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:19.920452 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-15bb91f0-de24-4068-b190-753b95d0593d tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:20.316444 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-15bb91f0-de24-4068-b190-753b95d0593d tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222d5f38e7964046befd68eae1123ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83797d59cecf40fb97b5f8543a6476d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:20.351054 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-15bb91f0-de24-4068-b190-753b95d0593d tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1242 microversion: 2.1 time: 0.502366 May 21 21:10:20.365019 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 42/103] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:19 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1242 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:20.417197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7a269167-6b67-46f1-93ed-a51b11f317c1 tempest-FlavorsV255TestJSON-225683811 tempest-FlavorsV255TestJSON-225683811-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-2039531233", "id": 474587859, "os-flavor-access:is_public": "True"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:20.419090 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:20.419090 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:20.549972 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7a269167-6b67-46f1-93ed-a51b11f317c1 tempest-FlavorsV255TestJSON-225683811 tempest-FlavorsV255TestJSON-225683811-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.969259 May 21 21:10:20.551170 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 62/104] 10.222.0.49 () {62 vars in 1187 bytes} [Sat May 21 21:10:19 2022] POST /compute/v2.1/flavors => generated 446 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:21.008532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-626b551e-cf24-4e17-90d9-bcfe8a515b1b tempest-FlavorsV255TestJSON-164355001 tempest-FlavorsV255TestJSON-164355001-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:21.027869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9c051d28-727a-4c37-b433-a0d86c1c1f3f tempest-FlavorsAccessTestJSON-1134362962 tempest-FlavorsAccessTestJSON-1134362962-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-563895756", "id": 2128385986, "os-flavor-access:is_public": "False"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:21.046154 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-626b551e-cf24-4e17-90d9-bcfe8a515b1b tempest-FlavorsV255TestJSON-164355001 tempest-FlavorsV255TestJSON-164355001-project] 10.222.0.49 "GET /compute/v2.1/flavors/474587859" status: 200 len: 446 microversion: 2.55 time: 0.487252 May 21 21:10:21.047339 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 43/105] 10.222.0.49 () {60 vars in 1195 bytes} [Sat May 21 21:10:20 2022] GET /compute/v2.1/flavors/474587859 => generated 446 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:21.147364 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9c051d28-727a-4c37-b433-a0d86c1c1f3f tempest-FlavorsAccessTestJSON-1134362962 tempest-FlavorsAccessTestJSON-1134362962-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.506048 May 21 21:10:21.148421 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 63/106] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:20 2022] POST /compute/v2.1/flavors => generated 430 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:21.154932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3a33d09b-82b7-47e5-9336-4bf9c9b3740f tempest-FlavorsV255TestJSON-225683811 tempest-FlavorsV255TestJSON-225683811-project-admin] Action: 'update', calling method: .version_select at 0x7fc82a2d2af0>, body: {"flavor": {"description": "new"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:21.176706 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:21.176706 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:21.291816 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3a33d09b-82b7-47e5-9336-4bf9c9b3740f tempest-FlavorsV255TestJSON-225683811 tempest-FlavorsV255TestJSON-225683811-project-admin] 10.222.0.49 "PUT /compute/v2.1/flavors/474587859" status: 200 len: 447 microversion: 2.55 time: 0.139672 May 21 21:10:21.291816 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 64/107] 10.222.0.49 () {62 vars in 1215 bytes} [Sat May 21 21:10:21 2022] PUT /compute/v2.1/flavors/474587859 => generated 447 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:21.319988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a39c437b-90d7-4fc4-b648-25c7f7655984 tempest-FlavorsAccessTestJSON-1134362962 tempest-FlavorsAccessTestJSON-1134362962-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "cf770f8c2a3845db821a012f86bb2fb0"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:21.323058 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:21.323058 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:21.369916 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-804e8189-9d25-4a7f-8b05-cbfc3c62fb71 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:21.398778 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-804e8189-9d25-4a7f-8b05-cbfc3c62fb71 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.348392 May 21 21:10:21.400449 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 44/108] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:10:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:21.409657 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c059437b-1da1-4e2c-b051-bd7e5c1a8cc7 tempest-FlavorsV255TestJSON-164355001 tempest-FlavorsV255TestJSON-164355001-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:21.443096 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c059437b-1da1-4e2c-b051-bd7e5c1a8cc7 tempest-FlavorsV255TestJSON-164355001 tempest-FlavorsV255TestJSON-164355001-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.038189 May 21 21:10:21.443691 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 45/109] 10.222.0.49 () {60 vars in 1186 bytes} [Sat May 21 21:10:21 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:10:21.449231 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-be5764d8-01d2-471b-a4a3-b6d5a113ccf6 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:21.450044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-be5764d8-01d2-471b-a4a3-b6d5a113ccf6 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:21.456766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be5764d8-01d2-471b-a4a3-b6d5a113ccf6 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:21.457438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be5764d8-01d2-471b-a4a3-b6d5a113ccf6 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:21.459113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be5764d8-01d2-471b-a4a3-b6d5a113ccf6 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:21.459745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be5764d8-01d2-471b-a4a3-b6d5a113ccf6 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:21.577723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-be5764d8-01d2-471b-a4a3-b6d5a113ccf6 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222d5f38e7964046befd68eae1123ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83797d59cecf40fb97b5f8543a6476d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:21.584091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:21.590694 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-be5764d8-01d2-471b-a4a3-b6d5a113ccf6 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1298 microversion: 2.1 time: 0.145486 May 21 21:10:21.601044 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=34 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:21.601215 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 46/110] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:21 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1298 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:21.785484 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a39c437b-90d7-4fc4-b648-25c7f7655984 tempest-FlavorsAccessTestJSON-1134362962 tempest-FlavorsAccessTestJSON-1134362962-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/2128385986/action" status: 200 len: 97 microversion: 2.1 time: 0.491570 May 21 21:10:21.785484 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 65/111] 10.222.0.49 () {60 vars in 1199 bytes} [Sat May 21 21:10:21 2022] POST /compute/v2.1/flavors/2128385986/action => generated 97 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:10:21.792927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-60068f9a-a3ce-4f4b-9792-ddbb5bc733ac tempest-FlavorsV255TestJSON-164355001 tempest-FlavorsV255TestJSON-164355001-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:21.861437 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-60068f9a-a3ce-4f4b-9792-ddbb5bc733ac tempest-FlavorsV255TestJSON-164355001 tempest-FlavorsV255TestJSON-164355001-project] 10.222.0.49 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.068239 May 21 21:10:21.872160 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 66/112] 10.222.0.49 () {60 vars in 1165 bytes} [Sat May 21 21:10:21 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:10:22.199443 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a0b191bb-68ab-4805-8315-27aa5d44019b tempest-ServersWithSpecificFlavorTestJSON-977658033 tempest-ServersWithSpecificFlavorTestJSON-977658033-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-41560848", "id": 1862267103, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:22.201718 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:22.201718 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:22.288069 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-438d7bd3-2c4c-464d-854c-84e034fa3ff6 tempest-FlavorsAccessTestJSON-430142599 tempest-FlavorsAccessTestJSON-430142599-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:22.305439 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a0b191bb-68ab-4805-8315-27aa5d44019b tempest-ServersWithSpecificFlavorTestJSON-977658033 tempest-ServersWithSpecificFlavorTestJSON-977658033-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.704889 May 21 21:10:22.312979 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 47/113] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:21 2022] POST /compute/v2.1/flavors => generated 423 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:22.321348 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2b286745-abe3-4589-91f5-cf10c8358b50 tempest-FlavorsV255TestJSON-225683811 tempest-FlavorsV255TestJSON-225683811-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:22.323473 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:22.323473 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:22.325065 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-438d7bd3-2c4c-464d-854c-84e034fa3ff6 tempest-FlavorsAccessTestJSON-430142599 tempest-FlavorsAccessTestJSON-430142599-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 6239 microversion: 2.1 time: 0.451413 May 21 21:10:22.326194 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 67/114] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:21 2022] GET /compute/v2.1/flavors/detail => generated 6239 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:22.354119 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=10,nova_api:DELETE=8 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:22.439080 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2b286745-abe3-4589-91f5-cf10c8358b50 tempest-FlavorsV255TestJSON-225683811 tempest-FlavorsV255TestJSON-225683811-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/474587859" status: 202 len: 0 microversion: 2.55 time: 0.124753 May 21 21:10:22.440041 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 48/115] 10.222.0.49 () {60 vars in 1198 bytes} [Sat May 21 21:10:22 2022] DELETE /compute/v2.1/flavors/474587859 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 21 21:10:22.448137 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7d2a232c-e3c2-462b-9388-816716c34cb6 tempest-ServersWithSpecificFlavorTestJSON-977658033 tempest-ServersWithSpecificFlavorTestJSON-977658033-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:22.458686 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7d2a232c-e3c2-462b-9388-816716c34cb6 tempest-ServersWithSpecificFlavorTestJSON-977658033 tempest-ServersWithSpecificFlavorTestJSON-977658033-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017338 May 21 21:10:22.459519 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 49/116] 10.222.0.49 () {58 vars in 1181 bytes} [Sat May 21 21:10:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:10:22.466443 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4fca9624-4e4e-421e-80c2-370c31959fbc tempest-FlavorsAccessTestJSON-1134362962 tempest-FlavorsAccessTestJSON-1134362962-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "cf770f8c2a3845db821a012f86bb2fb0"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:22.468236 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:22.468236 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:22.837031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3e68407b-a5ae-4604-862c-4e7e328817a3 tempest-AZAdminNegativeTestJSON-115389217 tempest-AZAdminNegativeTestJSON-115389217-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:22.837828 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:22.837828 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:22.838701 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3e68407b-a5ae-4604-862c-4e7e328817a3 tempest-AZAdminNegativeTestJSON-115389217 tempest-AZAdminNegativeTestJSON-115389217-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '3dffdfcc54964427ab323849fdaa02c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9fee7a14234b84afbe098f7a1e3b56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:22.843355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3e68407b-a5ae-4604-862c-4e7e328817a3 tempest-AZAdminNegativeTestJSON-115389217 tempest-AZAdminNegativeTestJSON-115389217-project] Request method failure captured: May 21 21:10:22.843355 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 May 21 21:10:22.843355 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:22.843355 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:22.843355 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:22.843355 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:10:22.843355 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:22.843355 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:22.843355 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:22.843355 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:22.843355 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVU7Sbda-kGDiXfqsk-3p0T_Q7hXWJM3_f6qxlAWR3QnF9uZcbw4K4Yui3cdB8k9CDjEx2p8zwUUkgm_UxCu_da-fY2O2oSCypQa_jgIlQTuvA6ziv9kLEwKkw28JRUatgUgH7IzpSF50ef7bfTRWV0Wy1sBZKK6WHY7rMgX0YbzpLo May 21 21:10:22.843355 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:22.843355 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:22.843355 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:22.843355 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:22.843355 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:22.843355 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:22.843355 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 3c9fee7a14234b84afbe098f7a1e3b56 May 21 21:10:22.843355 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AZAdminNegativeTestJSON-115389217 May 21 21:10:22.843355 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:10:22.843355 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:10:22.844797 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c9fee7a14234b84afbe098f7a1e3b56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c9fee7a14234b84afbe098f7a1e3b56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c9fee7a14234b84afbe098f7a1e3b56", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c9fee7a14234b84afbe098f7a1e3b56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:22.844797 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AZAdminNegativeTestJSON-115389217 May 21 21:10:22.844797 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 3c9fee7a14234b84afbe098f7a1e3b56 May 21 21:10:22.844797 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-115389217 May 21 21:10:22.844797 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AZAdminNegativeTestJSON-115389217-project May 21 21:10:22.844797 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:22.844797 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:22.844797 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 3dffdfcc54964427ab323849fdaa02c1 May 21 21:10:22.844797 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AZAdminNegativeTestJSON-115389217-project May 21 21:10:22.844797 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:10:22.844797 ncdv-master-1 devstack@n-api.service[131277]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 21 21:10:22.844797 ncdv-master-1 devstack@n-api.service[131277]: action_args: {} May 21 21:10:22.845602 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:22.845602 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:22.845602 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:22.845602 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:22.845602 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:22.845602 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:22.845602 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:22.845602 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:22.845602 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail May 21 21:10:22.845602 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) May 21 21:10:22.845602 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:10:22.845602 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:10:22.845602 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:10:22.845602 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:10:22.845602 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:22.845602 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:22.845602 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:22.845602 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:22.845602 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:10:22.846783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:10:22.846783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:10:22.846783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:10:22.846783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:10:22.846783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:10:22.846783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 21 21:10:22.846783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:22.846783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:22.846783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:22.846783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:22.846783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:22.846783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:22.846783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:10:22.846783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:10:22.846783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 21 21:10:22.846783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:22.849018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3e68407b-a5ae-4604-862c-4e7e328817a3 tempest-AZAdminNegativeTestJSON-115389217 tempest-AZAdminNegativeTestJSON-115389217-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:22.851057 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3e68407b-a5ae-4604-862c-4e7e328817a3 tempest-AZAdminNegativeTestJSON-115389217 tempest-AZAdminNegativeTestJSON-115389217-project] 10.222.0.49 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.523662 May 21 21:10:22.860457 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 68/117] 10.222.0.49 () {58 vars in 1184 bytes} [Sat May 21 21:10:22 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 533 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:22.876618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dcc6c6ae-8165-4b93-a97b-ab060d103e80 tempest-FlavorsV255TestJSON-225683811 tempest-FlavorsV255TestJSON-225683811-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:22.921076 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dcc6c6ae-8165-4b93-a97b-ab060d103e80 tempest-FlavorsV255TestJSON-225683811 tempest-FlavorsV255TestJSON-225683811-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5719 microversion: 2.55 time: 0.059422 May 21 21:10:22.921695 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 69/118] 10.222.0.49 () {60 vars in 1186 bytes} [Sat May 21 21:10:22 2022] GET /compute/v2.1/flavors/detail => generated 5719 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:10:22.943864 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-30cc6a24-3b86-4f02-9400-7924a7f1f0e3 tempest-ServersWithSpecificFlavorTestJSON-977658033 tempest-ServersWithSpecificFlavorTestJSON-977658033-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1172781991", "id": 1337621487, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:23.045054 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-30cc6a24-3b86-4f02-9400-7924a7f1f0e3 tempest-ServersWithSpecificFlavorTestJSON-977658033 tempest-ServersWithSpecificFlavorTestJSON-977658033-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.108646 May 21 21:10:23.046232 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 70/119] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:22 2022] POST /compute/v2.1/flavors => generated 425 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:23.059060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-23306701-bb51-4726-b6f9-bc5d0d02fd6c tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:23.071371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-23306701-bb51-4726-b6f9-bc5d0d02fd6c tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:23.097456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23306701-bb51-4726-b6f9-bc5d0d02fd6c tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:23.100060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23306701-bb51-4726-b6f9-bc5d0d02fd6c tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:23.102573 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23306701-bb51-4726-b6f9-bc5d0d02fd6c tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:23.116214 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23306701-bb51-4726-b6f9-bc5d0d02fd6c tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:23.222691 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4fca9624-4e4e-421e-80c2-370c31959fbc tempest-FlavorsAccessTestJSON-1134362962 tempest-FlavorsAccessTestJSON-1134362962-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/2128385986/action" status: 200 len: 21 microversion: 2.1 time: 0.761168 May 21 21:10:23.223233 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 50/120] 10.222.0.49 () {60 vars in 1199 bytes} [Sat May 21 21:10:22 2022] POST /compute/v2.1/flavors/2128385986/action => generated 21 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:10:23.229388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-739a9e70-a1e6-47ef-abce-5c1d6e619dd5 tempest-ServersWithSpecificFlavorTestJSON-977658033 tempest-ServersWithSpecificFlavorTestJSON-977658033-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:23.265945 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-739a9e70-a1e6-47ef-abce-5c1d6e619dd5 tempest-ServersWithSpecificFlavorTestJSON-977658033 tempest-ServersWithSpecificFlavorTestJSON-977658033-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.036605 May 21 21:10:23.267050 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 51/121] 10.222.0.49 () {58 vars in 1181 bytes} [Sat May 21 21:10:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:10:23.276233 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3fd33107-97ad-40cf-a23c-635585c0f9e5 tempest-FlavorsAccessTestJSON-430142599 tempest-FlavorsAccessTestJSON-430142599-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:23.331001 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3fd33107-97ad-40cf-a23c-635585c0f9e5 tempest-FlavorsAccessTestJSON-430142599 tempest-FlavorsAccessTestJSON-430142599-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.060085 May 21 21:10:23.348033 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 52/122] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:23 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:23.363475 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2272ae7c-9249-45d2-b97e-c5a696788fe5 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Action: 'create', calling method: .version_select at 0x7fc8284084c0>, body: {"keypair": {"name": "tempest-keypair-1123155506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESRYjljhmc7qpQD7o7aX8UPMfIMKGxRznSccgAwKQKmC1vqE6N/GLtFQeLmIoRzElEztX94anXqGleddzGT3JOI/F+aUZV92IgR1ApncoA+I2T1C/1zhSeMfR8A+hGtEg=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:23.440479 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-2272ae7c-9249-45d2-b97e-c5a696788fe5 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Getting quotas for project fd7555e458ef4971822c6265ce3fd07b. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:10:23.453583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-2272ae7c-9249-45d2-b97e-c5a696788fe5 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Getting quotas for user 0ef64531c9da4be5939447edd0d5b78d and project fd7555e458ef4971822c6265ce3fd07b. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:10:23.629703 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2272ae7c-9249-45d2-b97e-c5a696788fe5 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.279626 May 21 21:10:23.631332 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 53/123] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:10:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:23.636722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e5ddde43-a1a0-443f-a1c9-11c1b359dfc3 tempest-FlavorsAccessTestJSON-1134362962 tempest-FlavorsAccessTestJSON-1134362962-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:23.799898 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e5ddde43-a1a0-443f-a1c9-11c1b359dfc3 tempest-FlavorsAccessTestJSON-1134362962 tempest-FlavorsAccessTestJSON-1134362962-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/2128385986" status: 202 len: 0 microversion: 2.1 time: 0.167169 May 21 21:10:23.800763 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 54/124] 10.222.0.49 () {58 vars in 1160 bytes} [Sat May 21 21:10:23 2022] DELETE /compute/v2.1/flavors/2128385986 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:10:23.809507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4619de62-9096-4cd3-9676-99557395acf2 tempest-FlavorsAccessTestJSON-1134362962 tempest-FlavorsAccessTestJSON-1134362962-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:23.861490 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4619de62-9096-4cd3-9676-99557395acf2 tempest-FlavorsAccessTestJSON-1134362962 tempest-FlavorsAccessTestJSON-1134362962-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.055761 May 21 21:10:23.881664 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 55/125] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:23 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:23.890351 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c3a46433-b285-4170-b238-430d46c6f51e tempest-FlavorsAccessTestJSON-1134362962 tempest-FlavorsAccessTestJSON-1134362962-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1214833820", "id": 421788892, "os-flavor-access:is_public": "False"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:24.039951 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c3a46433-b285-4170-b238-430d46c6f51e tempest-FlavorsAccessTestJSON-1134362962 tempest-FlavorsAccessTestJSON-1134362962-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.137971 May 21 21:10:24.039951 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 56/126] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:23 2022] POST /compute/v2.1/flavors => generated 428 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:10:24.061690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0309ad97-fbec-45c0-97d2-fa1f5c995884 tempest-FlavorsAccessTestJSON-1134362962 tempest-FlavorsAccessTestJSON-1134362962-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:24.062624 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:24.062624 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:24.086148 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-23306701-bb51-4726-b6f9-bc5d0d02fd6c tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222d5f38e7964046befd68eae1123ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83797d59cecf40fb97b5f8543a6476d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:24.097947 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0309ad97-fbec-45c0-97d2-fa1f5c995884 tempest-FlavorsAccessTestJSON-1134362962 tempest-FlavorsAccessTestJSON-1134362962-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/421788892/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.043766 May 21 21:10:24.105107 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 57/127] 10.222.0.49 () {58 vars in 1205 bytes} [Sat May 21 21:10:24 2022] GET /compute/v2.1/flavors/421788892/os-flavor-access => generated 21 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:10:24.211171 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-426c4898-368c-4f4e-9a53-f7acecb2d0f3 tempest-FlavorsAccessTestJSON-1134362962 tempest-FlavorsAccessTestJSON-1134362962-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:24.211621 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-23306701-bb51-4726-b6f9-bc5d0d02fd6c tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1338 microversion: 2.1 time: 1.071891 May 21 21:10:24.211621 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 71/128] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:23 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1338 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:24.407161 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-426c4898-368c-4f4e-9a53-f7acecb2d0f3 tempest-FlavorsAccessTestJSON-1134362962 tempest-FlavorsAccessTestJSON-1134362962-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/421788892" status: 202 len: 0 microversion: 2.1 time: 0.283545 May 21 21:10:24.407161 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 58/129] 10.222.0.49 () {58 vars in 1157 bytes} [Sat May 21 21:10:24 2022] DELETE /compute/v2.1/flavors/421788892 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:10:24.415341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-63cb8e7e-2221-42de-a18c-2523cd7d2cfc tempest-FlavorsAccessTestJSON-1134362962 tempest-FlavorsAccessTestJSON-1134362962-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:24.517934 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-63cb8e7e-2221-42de-a18c-2523cd7d2cfc tempest-FlavorsAccessTestJSON-1134362962 tempest-FlavorsAccessTestJSON-1134362962-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.056220 May 21 21:10:24.517934 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 72/130] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:24 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:25.143411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-998d5dd3-15a3-4b86-ac51-825432c5c0ef tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:25.144060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-998d5dd3-15a3-4b86-ac51-825432c5c0ef tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:25.166201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-998d5dd3-15a3-4b86-ac51-825432c5c0ef tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:25.169012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-998d5dd3-15a3-4b86-ac51-825432c5c0ef tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:25.169976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-998d5dd3-15a3-4b86-ac51-825432c5c0ef tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:25.170409 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-998d5dd3-15a3-4b86-ac51-825432c5c0ef tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:26.288921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-998d5dd3-15a3-4b86-ac51-825432c5c0ef tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222d5f38e7964046befd68eae1123ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83797d59cecf40fb97b5f8543a6476d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:26.298372 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-998d5dd3-15a3-4b86-ac51-825432c5c0ef tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1338 microversion: 2.1 time: 1.159225 May 21 21:10:26.306367 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 59/131] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:25 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1338 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:26.439511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c3da6039-631f-46da-8959-aaface10e445 tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-105718289", "ram": 512, "vcpus": 1, "disk": 10, "id": 1100309759, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:26.439511 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:26.439511 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:26.525262 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c3da6039-631f-46da-8959-aaface10e445 tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.862051 May 21 21:10:26.525892 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 73/132] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:25 2022] POST /compute/v2.1/flavors => generated 415 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:26.554580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ab3c0e89-2767-4434-b399-2d206a4f55f1 tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:26.556711 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:26.556711 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:26.696572 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ab3c0e89-2767-4434-b399-2d206a4f55f1 tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1100309759/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.149991 May 21 21:10:26.697421 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 60/133] 10.222.0.49 () {60 vars in 1223 bytes} [Sat May 21 21:10:26 2022] POST /compute/v2.1/flavors/1100309759/os-extra_specs => generated 66 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:10:27.321563 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-249b52f1-0b23-4fae-bf88-9828c26b86a4 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:27.322280 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-249b52f1-0b23-4fae-bf88-9828c26b86a4 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:27.325497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=8 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:27.348430 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-249b52f1-0b23-4fae-bf88-9828c26b86a4 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:27.349738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-249b52f1-0b23-4fae-bf88-9828c26b86a4 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:27.353328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-249b52f1-0b23-4fae-bf88-9828c26b86a4 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:27.359601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-249b52f1-0b23-4fae-bf88-9828c26b86a4 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:27.455359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b5712a8c-c606-49ab-b859-96d21963886d tempest-FlavorsExtraSpecsTestJSON-654189192 tempest-FlavorsExtraSpecsTestJSON-654189192-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:27.517618 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b5712a8c-c606-49ab-b859-96d21963886d tempest-FlavorsExtraSpecsTestJSON-654189192 tempest-FlavorsExtraSpecsTestJSON-654189192-project] 10.222.0.49 "GET /compute/v2.1/flavors/1100309759/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.811832 May 21 21:10:27.520033 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 74/134] 10.222.0.49 () {58 vars in 1202 bytes} [Sat May 21 21:10:26 2022] GET /compute/v2.1/flavors/1100309759/os-extra_specs => generated 66 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:10:27.538279 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a44827b0-bb6f-4700-ac52-eba9d325c480 tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:27.540154 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:27.540154 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:27.612500 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a44827b0-bb6f-4700-ac52-eba9d325c480 tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1100309759/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.075855 May 21 21:10:27.612500 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 75/135] 10.222.0.49 () {60 vars in 1223 bytes} [Sat May 21 21:10:27 2022] POST /compute/v2.1/flavors/1100309759/os-extra_specs => generated 66 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:10:27.619476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-592cb141-105d-4424-9d9e-88f486ce6136 tempest-FlavorsExtraSpecsTestJSON-654189192 tempest-FlavorsExtraSpecsTestJSON-654189192-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:27.647475 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-592cb141-105d-4424-9d9e-88f486ce6136 tempest-FlavorsExtraSpecsTestJSON-654189192 tempest-FlavorsExtraSpecsTestJSON-654189192-project] 10.222.0.49 "GET /compute/v2.1/flavors/1100309759/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.031804 May 21 21:10:27.652551 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 76/136] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:10:27 2022] GET /compute/v2.1/flavors/1100309759/os-extra_specs/hw:numa_nodes => generated 22 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:10:27.665275 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-773762c0-f5dc-4fc0-a2f1-72fe1465716a tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:27.724530 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-773762c0-f5dc-4fc0-a2f1-72fe1465716a tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1100309759/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.058571 May 21 21:10:27.724876 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 77/137] 10.222.0.49 () {60 vars in 1223 bytes} [Sat May 21 21:10:27 2022] POST /compute/v2.1/flavors/1100309759/os-extra_specs => generated 66 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 21 21:10:27.729888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-67533a0f-d1d7-424b-9ae0-007df07cd73e tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:27.752576 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-67533a0f-d1d7-424b-9ae0-007df07cd73e tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/1100309759/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.023909 May 21 21:10:27.754139 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 78/138] 10.222.0.49 () {58 vars in 1202 bytes} [Sat May 21 21:10:27 2022] GET /compute/v2.1/flavors/1100309759/os-extra_specs => generated 66 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:10:27.766928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f092b0a8-b5f2-479b-ae93-fcd3fc25079d tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:27.769102 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:27.769102 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:27.796990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:DELETE=8,nova_api:SELECT=76,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:SAVEPOINT=5,nova_api:RELEASE=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:27.897333 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f092b0a8-b5f2-479b-ae93-fcd3fc25079d tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] 10.222.0.49 "PUT /compute/v2.1/flavors/1100309759/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.137051 May 21 21:10:27.898353 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 79/139] 10.222.0.49 () {60 vars in 1264 bytes} [Sat May 21 21:10:27 2022] PUT /compute/v2.1/flavors/1100309759/os-extra_specs/hw:numa_nodes => generated 22 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 21 21:10:27.915550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fb616110-f85a-4a36-9e89-38d9a85a1a02 tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:27.947088 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fb616110-f85a-4a36-9e89-38d9a85a1a02 tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/1100309759/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037647 May 21 21:10:27.963650 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 80/140] 10.222.0.49 () {58 vars in 1202 bytes} [Sat May 21 21:10:27 2022] GET /compute/v2.1/flavors/1100309759/os-extra_specs => generated 66 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:10:27.973954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a8b6dff8-70cc-4366-bbc2-867023a512c6 tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:27.976371 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:27.976371 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:28.152056 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a8b6dff8-70cc-4366-bbc2-867023a512c6 tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1100309759/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.186758 May 21 21:10:28.156917 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 81/141] 10.222.0.49 () {58 vars in 1247 bytes} [Sat May 21 21:10:27 2022] DELETE /compute/v2.1/flavors/1100309759/os-extra_specs/hw:numa_nodes => generated 0 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 21 21:10:28.173894 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-811c27a3-fa84-4c7e-a7ac-a5a1b6c97f21 tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:28.211829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-249b52f1-0b23-4fae-bf88-9828c26b86a4 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222d5f38e7964046befd68eae1123ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83797d59cecf40fb97b5f8543a6476d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:28.223162 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-249b52f1-0b23-4fae-bf88-9828c26b86a4 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1338 microversion: 2.1 time: 0.905393 May 21 21:10:28.227619 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 61/142] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:27 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1338 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:10:28.272538 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-811c27a3-fa84-4c7e-a7ac-a5a1b6c97f21 tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1100309759/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.114006 May 21 21:10:28.277483 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 82/143] 10.222.0.49 () {58 vars in 1247 bytes} [Sat May 21 21:10:28 2022] DELETE /compute/v2.1/flavors/1100309759/os-extra_specs/hw:cpu_policy => generated 0 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 21 21:10:28.293073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7e49f777-d9ff-4f6c-bd82-486bad4df956 tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:28.337440 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7e49f777-d9ff-4f6c-bd82-486bad4df956 tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/1100309759/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.058245 May 21 21:10:28.343374 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 83/144] 10.222.0.49 () {58 vars in 1202 bytes} [Sat May 21 21:10:28 2022] GET /compute/v2.1/flavors/1100309759/os-extra_specs => generated 19 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:10:28.356872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-47f21aeb-892d-4e5d-97e8-5fb2da8a401f tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:28.358121 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:28.358121 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:28.527276 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-47f21aeb-892d-4e5d-97e8-5fb2da8a401f tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1100309759" status: 202 len: 0 microversion: 2.1 time: 0.177478 May 21 21:10:28.529071 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 84/145] 10.222.0.49 () {58 vars in 1160 bytes} [Sat May 21 21:10:28 2022] DELETE /compute/v2.1/flavors/1100309759 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:10:28.538396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-453c7eea-1ebc-417b-b1bb-08ffd2bf6692 tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:28.575753 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-453c7eea-1ebc-417b-b1bb-08ffd2bf6692 tempest-FlavorsExtraSpecsTestJSON-1904590120 tempest-FlavorsExtraSpecsTestJSON-1904590120-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.041407 May 21 21:10:28.580916 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 85/146] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:28 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:28.755486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-4874cb66-83e5-4ba5-8b12-f9411236651a req-b632d094-84f8-4f09-a8a6-d4532f197c2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab48e8e-24d9-4608-ba16-fbe26f0a89b0", "tag": "85844a0a-8069-455a-83e1-74b104aee4d8"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:28.782925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4874cb66-83e5-4ba5-8b12-f9411236651a req-b632d094-84f8-4f09-a8a6-d4532f197c2d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:28.782925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4874cb66-83e5-4ba5-8b12-f9411236651a req-b632d094-84f8-4f09-a8a6-d4532f197c2d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:28.845261 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-4874cb66-83e5-4ba5-8b12-f9411236651a req-b632d094-84f8-4f09-a8a6-d4532f197c2d service nova] Creating event network-changed:85844a0a-8069-455a-83e1-74b104aee4d8 for instance fab48e8e-24d9-4608-ba16-fbe26f0a89b0 on nch2-master-1 May 21 21:10:28.847637 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4874cb66-83e5-4ba5-8b12-f9411236651a req-b632d094-84f8-4f09-a8a6-d4532f197c2d service nova] Acquired lock "compute-rpcapi-router" {{(pid=131278) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 21 21:10:28.851601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f8e47a8c-5e53-45ba-84b9-6142172c86d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:28.852812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f8e47a8c-5e53-45ba-84b9-6142172c86d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:28.855003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f8e47a8c-5e53-45ba-84b9-6142172c86d4 None None] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:28.855767 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f8e47a8c-5e53-45ba-84b9-6142172c86d4 None None] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:28.869827 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.compute.rpcapi [None req-f8e47a8c-5e53-45ba-84b9-6142172c86d4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 21 21:10:28.870936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f8e47a8c-5e53-45ba-84b9-6142172c86d4 None None] Releasing lock "compute-rpcapi-router" {{(pid=131278) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 21 21:10:28.893485 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f8e47a8c-5e53-45ba-84b9-6142172c86d4 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.663267 May 21 21:10:28.897011 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 62/147] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:29.247224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f1486ee5-c443-405f-be77-0a6a3f77a252 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:29.247890 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f1486ee5-c443-405f-be77-0a6a3f77a252 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:29.250083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:29.273461 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1486ee5-c443-405f-be77-0a6a3f77a252 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:29.274159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1486ee5-c443-405f-be77-0a6a3f77a252 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:29.275540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1486ee5-c443-405f-be77-0a6a3f77a252 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:29.280196 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1486ee5-c443-405f-be77-0a6a3f77a252 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:29.735542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f1486ee5-c443-405f-be77-0a6a3f77a252 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222d5f38e7964046befd68eae1123ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83797d59cecf40fb97b5f8543a6476d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:29.766464 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f1486ee5-c443-405f-be77-0a6a3f77a252 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1338 microversion: 2.1 time: 0.527181 May 21 21:10:29.784682 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 86/148] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:29 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1338 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:30.787713 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-44550bbf-86d6-4e25-b1ba-bc2e0807b9ab tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:30.789173 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-44550bbf-86d6-4e25-b1ba-bc2e0807b9ab tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:30.796432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d228d3d5-68aa-495b-b79f-536eea3f441c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1424915939", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "1337621487", "adminPass": "***", "networks": [{"uuid": "00bd4d2b-0921-4196-8f17-7fbf59b93533"}], "security_groups": [{"name": "tempest-securitygroup--1275885517"}], "key_name": "tempest-keypair-1123155506", "user_data": "}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:30.799070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44550bbf-86d6-4e25-b1ba-bc2e0807b9ab tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:30.799789 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44550bbf-86d6-4e25-b1ba-bc2e0807b9ab tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:30.800856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44550bbf-86d6-4e25-b1ba-bc2e0807b9ab tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:30.801600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44550bbf-86d6-4e25-b1ba-bc2e0807b9ab tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:31.218854 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-44550bbf-86d6-4e25-b1ba-bc2e0807b9ab tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222d5f38e7964046befd68eae1123ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83797d59cecf40fb97b5f8543a6476d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:31.227573 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-44550bbf-86d6-4e25-b1ba-bc2e0807b9ab tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1338 microversion: 2.1 time: 0.446572 May 21 21:10:31.233639 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 63/149] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:30 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1338 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:31.359449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-d228d3d5-68aa-495b-b79f-536eea3f441c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] validate_networks() for [('00bd4d2b-0921-4196-8f17-7fbf59b93533', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:10:32.197613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b4c52865-abf9-4f76-88b0-989b489c6593 tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] Calling method '.version_select at 0x7fc82823d9d0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:32.197613 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:32.197613 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:32.197613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b4c52865-abf9-4f76-88b0-989b489c6593 tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '1d45a6cf9f2a4360a37862a7d4a7acd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d576b3b40444b4abe828a59a35a59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:32.197613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b4c52865-abf9-4f76-88b0-989b489c6593 tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] Request method failure captured: May 21 21:10:32.197613 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 May 21 21:10:32.197613 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:32.197613 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:32.197613 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:32.197613 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:10:32.199030 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:32.199030 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:32.199030 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:32.199030 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:32.199030 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVEPAFl4-VTuL3B94YB0uMNfiP4TfLBlxZXlxP_490HRbLRiJxmJN8u-8dMWAr_o2Wtk5eyvq0NLOP5duHYSW9TrFrVDorelQUm1m2HDfnHqZtFxp076bIpfpAMJYzFctc1eAzmVYO__oS07uo8kn522FvosvZNto5rcv789bzMFwc May 21 21:10:32.199030 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:32.199030 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:32.199030 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:32.199030 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:32.199030 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:32.199030 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:32.199030 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 1d576b3b40444b4abe828a59a35a59ea May 21 21:10:32.199030 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1127738428 May 21 21:10:32.199030 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:10:32.199030 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:10:32.199030 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1d576b3b40444b4abe828a59a35a59ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d576b3b40444b4abe828a59a35a59ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1d576b3b40444b4abe828a59a35a59ea", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d576b3b40444b4abe828a59a35a59ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:32.199030 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1127738428 May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 1d576b3b40444b4abe828a59a35a59ea May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1127738428 May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-HypervisorAdminNegativeTestJSON-1127738428-project May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1d45a6cf9f2a4360a37862a7d4a7acd1 May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1127738428-project May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: action_args: {} May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._detail(req) May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail May 21 21:10:32.200300 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) May 21 21:10:32.202187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:10:32.202187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:10:32.202187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:10:32.202187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:10:32.202187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:32.202187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:32.202187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:32.202187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:32.202187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:10:32.202187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:10:32.202187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:10:32.202187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:10:32.202187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:10:32.202187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:10:32.202187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 21 21:10:32.202187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:32.202187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:32.202187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:32.202187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:32.202187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:32.203642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:32.203642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:10:32.203642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:10:32.203642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 21 21:10:32.203642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:32.203642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b4c52865-abf9-4f76-88b0-989b489c6593 tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:32.203642 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b4c52865-abf9-4f76-88b0-989b489c6593 tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.719810 May 21 21:10:32.203642 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 64/150] 10.222.0.49 () {58 vars in 1166 bytes} [Sat May 21 21:10:31 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 724 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 21 21:10:32.203642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5d57d31d-aa8b-4fd6-8210-c740289193e6 tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] Calling method '.version_select at 0x7fc8281bb670>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:32.204323 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:32.204323 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:32.204323 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5d57d31d-aa8b-4fd6-8210-c740289193e6 tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '1d45a6cf9f2a4360a37862a7d4a7acd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d576b3b40444b4abe828a59a35a59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:32.204323 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5d57d31d-aa8b-4fd6-8210-c740289193e6 tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] Request method failure captured: May 21 21:10:32.204323 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 May 21 21:10:32.204323 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:32.204323 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:32.204323 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:32.204323 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:10:32.204323 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:32.204323 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:32.204323 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:32.204323 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:32.204323 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVEPAFl4-VTuL3B94YB0uMNfiP4TfLBlxZXlxP_490HRbLRiJxmJN8u-8dMWAr_o2Wtk5eyvq0NLOP5duHYSW9TrFrVDorelQUm1m2HDfnHqZtFxp076bIpfpAMJYzFctc1eAzmVYO__oS07uo8kn522FvosvZNto5rcv789bzMFwc May 21 21:10:32.204323 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:32.204323 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:32.204323 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:32.204323 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:32.204323 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:32.205669 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:32.205669 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 1d576b3b40444b4abe828a59a35a59ea May 21 21:10:32.205669 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1127738428 May 21 21:10:32.205669 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:10:32.205669 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:10:32.205669 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1d576b3b40444b4abe828a59a35a59ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d576b3b40444b4abe828a59a35a59ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1d576b3b40444b4abe828a59a35a59ea", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d576b3b40444b4abe828a59a35a59ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:32.205669 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1127738428 May 21 21:10:32.205669 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 1d576b3b40444b4abe828a59a35a59ea May 21 21:10:32.205669 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1127738428 May 21 21:10:32.205669 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-HypervisorAdminNegativeTestJSON-1127738428-project May 21 21:10:32.205669 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:32.205669 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:32.205669 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1d45a6cf9f2a4360a37862a7d4a7acd1 May 21 21:10:32.205669 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1127738428-project May 21 21:10:32.205669 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:10:32.206657 ncdv-master-1 devstack@n-api.service[131278]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 21 21:10:32.206657 ncdv-master-1 devstack@n-api.service[131278]: action_args: {} May 21 21:10:32.206657 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:32.206657 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:32.206657 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:32.206657 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:32.206657 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:32.206657 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:32.206657 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:10:32.206657 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:10:32.206657 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:32.206657 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:32.206657 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index May 21 21:10:32.206657 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._index(req) May 21 21:10:32.206657 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index May 21 21:10:32.206657 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) May 21 21:10:32.206657 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:10:32.206657 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:10:32.206657 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:10:32.206657 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:10:32.208105 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:32.208105 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:32.208105 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:32.208105 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:32.208105 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:10:32.208105 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:10:32.208105 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:10:32.208105 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:10:32.208105 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:10:32.208105 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:10:32.208105 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 21 21:10:32.208105 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:32.208105 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:32.208105 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:32.208105 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:32.208105 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:32.208105 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:32.208105 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:10:32.208105 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:10:32.208105 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 21 21:10:32.209425 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:32.209425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5d57d31d-aa8b-4fd6-8210-c740289193e6 tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:32.209425 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5d57d31d-aa8b-4fd6-8210-c740289193e6 tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.008645 May 21 21:10:32.209425 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 65/151] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:32 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 21 21:10:32.209425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7df7d25c-9b57-461a-919b-e52c318addea tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] Calling method '.version_select at 0x7fc8281bb1f0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:32.209425 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:32.209425 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7df7d25c-9b57-461a-919b-e52c318addea tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '1d45a6cf9f2a4360a37862a7d4a7acd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d576b3b40444b4abe828a59a35a59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7df7d25c-9b57-461a-919b-e52c318addea tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] Request method failure captured: May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVEPAFl4-VTuL3B94YB0uMNfiP4TfLBlxZXlxP_490HRbLRiJxmJN8u-8dMWAr_o2Wtk5eyvq0NLOP5duHYSW9TrFrVDorelQUm1m2HDfnHqZtFxp076bIpfpAMJYzFctc1eAzmVYO__oS07uo8kn522FvosvZNto5rcv789bzMFwc May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 1d576b3b40444b4abe828a59a35a59ea May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1127738428 May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:10:32.209930 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:10:32.212193 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1d576b3b40444b4abe828a59a35a59ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d576b3b40444b4abe828a59a35a59ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1d576b3b40444b4abe828a59a35a59ea", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d576b3b40444b4abe828a59a35a59ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:32.212193 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1127738428 May 21 21:10:32.212193 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 1d576b3b40444b4abe828a59a35a59ea May 21 21:10:32.212193 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1127738428 May 21 21:10:32.212193 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-HypervisorAdminNegativeTestJSON-1127738428-project May 21 21:10:32.212193 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:32.212193 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:32.212193 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1d45a6cf9f2a4360a37862a7d4a7acd1 May 21 21:10:32.212193 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1127738428-project May 21 21:10:32.212193 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:10:32.212193 ncdv-master-1 devstack@n-api.service[131278]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 21 21:10:32.212193 ncdv-master-1 devstack@n-api.service[131278]: action_args: {} May 21 21:10:32.212193 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:32.220929 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:32.220929 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:32.220929 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:32.220929 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:32.220929 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:32.220929 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:10:32.220929 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:10:32.220929 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:32.220929 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:32.220929 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics May 21 21:10:32.220929 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) May 21 21:10:32.220929 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:10:32.220929 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:10:32.220929 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:10:32.220929 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:10:32.220929 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:32.220929 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:32.220929 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:32.220929 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:32.222008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:10:32.222008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:10:32.222008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:10:32.222008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:10:32.222008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:10:32.222008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:10:32.222008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 21 21:10:32.222008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:32.222008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:32.222008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:32.222008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:32.222008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:32.222008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:32.222008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:10:32.222008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:10:32.222008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 21 21:10:32.222008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:32.222887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7df7d25c-9b57-461a-919b-e52c318addea tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:32.222887 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7df7d25c-9b57-461a-919b-e52c318addea tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.008851 May 21 21:10:32.222887 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 66/152] 10.222.0.49 () {58 vars in 1178 bytes} [Sat May 21 21:10:32 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:32.554658 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a2a11597-01b6-4e01-9bf8-e9d0b84896f2 tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] Calling method '.version_select at 0x7fc8284b9b80>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:32.562227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a2a11597-01b6-4e01-9bf8-e9d0b84896f2 tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4f046ce9-ac6c-44d8-b1fb-b7063eef06e7(cell1) {{(pid=131278) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 21 21:10:32.563116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2a11597-01b6-4e01-9bf8-e9d0b84896f2 tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:32.566361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2a11597-01b6-4e01-9bf8-e9d0b84896f2 tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:32.588745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2a11597-01b6-4e01-9bf8-e9d0b84896f2 tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:32.589442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2a11597-01b6-4e01-9bf8-e9d0b84896f2 tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:32.606501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2a11597-01b6-4e01-9bf8-e9d0b84896f2 tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:32.606954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2a11597-01b6-4e01-9bf8-e9d0b84896f2 tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:32.624383 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a2a11597-01b6-4e01-9bf8-e9d0b84896f2 tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.395006 May 21 21:10:32.624889 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 67/153] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:32 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:32.635350 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7c77393f-2204-487d-906d-d3685a98fef7 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:32.636414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7c77393f-2204-487d-906d-d3685a98fef7 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:32.643212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c77393f-2204-487d-906d-d3685a98fef7 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:32.643753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c77393f-2204-487d-906d-d3685a98fef7 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:32.651836 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c77393f-2204-487d-906d-d3685a98fef7 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:32.652399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c77393f-2204-487d-906d-d3685a98fef7 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:33.002145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-d228d3d5-68aa-495b-b79f-536eea3f441c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:10:33.003181 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-d228d3d5-68aa-495b-b79f-536eea3f441c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:10:33.003726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-d228d3d5-68aa-495b-b79f-536eea3f441c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:10:33.004332 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-d228d3d5-68aa-495b-b79f-536eea3f441c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:10:33.005307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-d228d3d5-68aa-495b-b79f-536eea3f441c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:10:33.041191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d228d3d5-68aa-495b-b79f-536eea3f441c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:33.041650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d228d3d5-68aa-495b-b79f-536eea3f441c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:33.042652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d228d3d5-68aa-495b-b79f-536eea3f441c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:33.043179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d228d3d5-68aa-495b-b79f-536eea3f441c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:33.078535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7c77393f-2204-487d-906d-d3685a98fef7 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222d5f38e7964046befd68eae1123ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83797d59cecf40fb97b5f8543a6476d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:33.081786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-d228d3d5-68aa-495b-b79f-536eea3f441c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Getting quotas for project fd7555e458ef4971822c6265ce3fd07b. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:10:33.087324 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7c77393f-2204-487d-906d-d3685a98fef7 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1338 microversion: 2.1 time: 0.461148 May 21 21:10:33.088574 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 68/154] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:32 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1338 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:33.093662 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ea2a930c-19da-44dc-a4a0-d0440b0bb4ab tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] Calling method '.version_select at 0x7fc8282483a0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:33.096400 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:33.096400 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:33.096567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-d228d3d5-68aa-495b-b79f-536eea3f441c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Getting quotas for user 0ef64531c9da4be5939447edd0d5b78d and project fd7555e458ef4971822c6265ce3fd07b. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:10:33.096653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ea2a930c-19da-44dc-a4a0-d0440b0bb4ab tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '1d45a6cf9f2a4360a37862a7d4a7acd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d576b3b40444b4abe828a59a35a59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:33.099479 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ea2a930c-19da-44dc-a4a0-d0440b0bb4ab tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] Request method failure captured: May 21 21:10:33.099479 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 May 21 21:10:33.099479 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:33.099479 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:33.099479 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:33.099479 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:10:33.099479 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:33.099479 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:33.099479 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:33.099479 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:33.099479 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVEPAFl4-VTuL3B94YB0uMNfiP4TfLBlxZXlxP_490HRbLRiJxmJN8u-8dMWAr_o2Wtk5eyvq0NLOP5duHYSW9TrFrVDorelQUm1m2HDfnHqZtFxp076bIpfpAMJYzFctc1eAzmVYO__oS07uo8kn522FvosvZNto5rcv789bzMFwc May 21 21:10:33.099479 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:33.099479 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:33.099479 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:33.099479 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:33.099479 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:33.099479 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:33.099479 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 1d576b3b40444b4abe828a59a35a59ea May 21 21:10:33.099479 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1127738428 May 21 21:10:33.099479 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:10:33.099479 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:10:33.100700 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1d576b3b40444b4abe828a59a35a59ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d576b3b40444b4abe828a59a35a59ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1d576b3b40444b4abe828a59a35a59ea", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d576b3b40444b4abe828a59a35a59ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:33.100700 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1127738428 May 21 21:10:33.100700 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 1d576b3b40444b4abe828a59a35a59ea May 21 21:10:33.100700 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1127738428 May 21 21:10:33.100700 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-HypervisorAdminNegativeTestJSON-1127738428-project May 21 21:10:33.100700 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:33.100700 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:33.100700 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1d45a6cf9f2a4360a37862a7d4a7acd1 May 21 21:10:33.100700 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1127738428-project May 21 21:10:33.100700 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:10:33.100700 ncdv-master-1 devstack@n-api.service[131278]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 21 21:10:33.100700 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '1'} May 21 21:10:33.100700 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:33.101467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:33.101467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:33.101467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:33.101467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:33.101467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:33.101467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:10:33.101467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:10:33.101467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:33.101467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:33.101467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime May 21 21:10:33.101467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) May 21 21:10:33.101467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:10:33.101467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:10:33.101467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:10:33.101467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:10:33.101467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:33.101467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:33.101467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:33.101467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:33.102450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:10:33.102450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:10:33.102450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:10:33.102450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:10:33.102450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:10:33.102450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:10:33.102450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 21 21:10:33.102450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.102450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:33.102450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.102450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:33.102450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:33.102450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:33.102450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:10:33.102450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:10:33.102450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 21 21:10:33.102450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.103854 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ea2a930c-19da-44dc-a4a0-d0440b0bb4ab tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:33.103854 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ea2a930c-19da-44dc-a4a0-d0440b0bb4ab tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.011436 May 21 21:10:33.107049 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 69/155] 10.222.0.49 () {58 vars in 1172 bytes} [Sat May 21 21:10:33 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:33.111717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c7b0a728-798e-4d8d-a5bb-d2eee7a896dc tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] Calling method '.version_select at 0x7fc82823dca0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:33.113602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d228d3d5-68aa-495b-b79f-536eea3f441c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:10:33.115034 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-c7b0a728-798e-4d8d-a5bb-d2eee7a896dc tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] HTTP exception thrown: Hypervisor with ID '5cefc68f-7009-42be-9964-6701fcbfd499' could not be found. May 21 21:10:33.119333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d228d3d5-68aa-495b-b79f-536eea3f441c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:10:33.131718 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c7b0a728-798e-4d8d-a5bb-d2eee7a896dc tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] Request method failure captured: May 21 21:10:33.131718 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-hypervisors/5cefc68f-7009-42be-9964-6701fcbfd499/uptime HTTP/1.1 May 21 21:10:33.131718 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:33.131718 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:33.131718 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:33.131718 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:10:33.131718 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:33.131718 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:33.131718 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:33.131718 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:33.131718 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVHBVHyfsUN2-aPilm2dH0FIg70Fm1ciB9oOx2uAmwGp39vGIoleCs2ghKMjbTnsnKCsE2m2RpHDoSH6qFo_X0EaL5D28PayuyNI7D35LSMMrwADbxeudx8ga3MjKnNXS8oD7dVMKaRt6j-oF81X6d51oDSEmyFt8Wu4_xa-lIDCo8 May 21 21:10:33.131718 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:33.131718 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:33.131718 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:33.131718 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:33.131718 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:33.131718 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:33.131718 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 56643dc150054bb2b656a28b6caf6fb1 May 21 21:10:33.131718 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-476321965 May 21 21:10:33.131718 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,admin,member May 21 21:10:33.131718 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,admin,member May 21 21:10:33.133289 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/56643dc150054bb2b656a28b6caf6fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/56643dc150054bb2b656a28b6caf6fb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_56643dc150054bb2b656a28b6caf6fb1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/56643dc150054bb2b656a28b6caf6fb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:33.133289 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-476321965 May 21 21:10:33.133289 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 56643dc150054bb2b656a28b6caf6fb1 May 21 21:10:33.133289 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-476321965 May 21 21:10:33.133289 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin May 21 21:10:33.133289 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:33.133289 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:33.133289 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 04731b00432e415b819820b4a039b770 May 21 21:10:33.133289 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin May 21 21:10:33.133289 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:10:33.133289 ncdv-master-1 devstack@n-api.service[131278]: exception: Hypervisor with ID '5cefc68f-7009-42be-9964-6701fcbfd499' could not be found. May 21 21:10:33.133289 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '5cefc68f-7009-42be-9964-6701fcbfd499'} May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi value = int(str(value)) May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '5cefc68f-7009-42be-9964-6701fcbfd499' May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise ValueError(msg) May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer May 21 21:10:33.134151 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) May 21 21:10:33.135629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer May 21 21:10:33.135629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.135629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:33.135629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.135629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:33.135629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:33.135629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:33.135629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:33.135629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:33.135629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:10:33.135629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:10:33.135629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:33.135629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:33.135629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime May 21 21:10:33.135629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) May 21 21:10:33.135629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id May 21 21:10:33.135629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 21 21:10:33.135629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '5cefc68f-7009-42be-9964-6701fcbfd499' could not be found. May 21 21:10:33.135629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.135629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:33.135629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.137000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:33.137000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:33.137000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:33.137000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:33.137000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:33.137000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '5cefc68f-7009-42be-9964-6701fcbfd499' could not be found. May 21 21:10:33.137000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.137471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c7b0a728-798e-4d8d-a5bb-d2eee7a896dc tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] Returning 404 to user: Hypervisor with ID '5cefc68f-7009-42be-9964-6701fcbfd499' could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:33.138254 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c7b0a728-798e-4d8d-a5bb-d2eee7a896dc tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/5cefc68f-7009-42be-9964-6701fcbfd499/uptime" status: 404 len: 123 microversion: 2.1 time: 0.030171 May 21 21:10:33.138824 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 70/156] 10.222.0.49 () {58 vars in 1277 bytes} [Sat May 21 21:10:33 2022] GET /compute/v2.1/os-hypervisors/5cefc68f-7009-42be-9964-6701fcbfd499/uptime => generated 123 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:33.149638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7c608833-a474-42ed-b1f5-70d5bb040d93 tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] Calling method '.version_select at 0x7fc82825b550>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:33.150078 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:33.150078 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:33.162398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c608833-a474-42ed-b1f5-70d5bb040d93 tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:33.163079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c608833-a474-42ed-b1f5-70d5bb040d93 tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:33.191011 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c608833-a474-42ed-b1f5-70d5bb040d93 tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:33.191289 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c608833-a474-42ed-b1f5-70d5bb040d93 tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:33.216753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c608833-a474-42ed-b1f5-70d5bb040d93 tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:33.217378 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c608833-a474-42ed-b1f5-70d5bb040d93 tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:33.225643 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7c608833-a474-42ed-b1f5-70d5bb040d93 tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.080744 May 21 21:10:33.226567 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 71/157] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:33 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:10:33.237237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6e4345b5-0cf8-4377-a97f-54223f63e709 tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] Calling method '.version_select at 0x7fc82831bd30>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:33.238414 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:33.238414 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:33.240377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6e4345b5-0cf8-4377-a97f-54223f63e709 tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '1d45a6cf9f2a4360a37862a7d4a7acd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d576b3b40444b4abe828a59a35a59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:33.243178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6e4345b5-0cf8-4377-a97f-54223f63e709 tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] Request method failure captured: May 21 21:10:33.243178 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 May 21 21:10:33.243178 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:33.243178 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:33.243178 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:33.243178 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:10:33.243178 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:33.243178 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:33.243178 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:33.243178 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:33.243178 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVEPAFl4-VTuL3B94YB0uMNfiP4TfLBlxZXlxP_490HRbLRiJxmJN8u-8dMWAr_o2Wtk5eyvq0NLOP5duHYSW9TrFrVDorelQUm1m2HDfnHqZtFxp076bIpfpAMJYzFctc1eAzmVYO__oS07uo8kn522FvosvZNto5rcv789bzMFwc May 21 21:10:33.243178 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:33.243178 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:33.243178 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:33.243178 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:33.243178 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:33.243178 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:33.243178 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 1d576b3b40444b4abe828a59a35a59ea May 21 21:10:33.243178 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1127738428 May 21 21:10:33.243178 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:10:33.243178 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:10:33.244681 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1d576b3b40444b4abe828a59a35a59ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d576b3b40444b4abe828a59a35a59ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1d576b3b40444b4abe828a59a35a59ea", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d576b3b40444b4abe828a59a35a59ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:33.244681 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1127738428 May 21 21:10:33.244681 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 1d576b3b40444b4abe828a59a35a59ea May 21 21:10:33.244681 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1127738428 May 21 21:10:33.244681 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-HypervisorAdminNegativeTestJSON-1127738428-project May 21 21:10:33.244681 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:33.244681 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:33.244681 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1d45a6cf9f2a4360a37862a7d4a7acd1 May 21 21:10:33.244681 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1127738428-project May 21 21:10:33.244681 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:10:33.244681 ncdv-master-1 devstack@n-api.service[131278]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 21 21:10:33.244681 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '1'} May 21 21:10:33.244681 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:33.245559 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:33.245559 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:33.245559 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:33.245559 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:33.245559 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:33.245559 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:10:33.245559 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:10:33.245559 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:33.245559 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:33.245559 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show May 21 21:10:33.245559 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 21 21:10:33.245559 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show May 21 21:10:33.245559 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) May 21 21:10:33.245559 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:10:33.245559 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:10:33.245559 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:10:33.245559 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:10:33.245559 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:33.245559 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:33.246836 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:33.246836 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:33.246836 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:10:33.246836 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:10:33.246836 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:10:33.246836 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:10:33.246836 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:10:33.246836 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:10:33.246836 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 21 21:10:33.246836 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.246836 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:33.246836 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.246836 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:33.246836 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:33.246836 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:33.246836 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:10:33.246836 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:10:33.246836 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 21 21:10:33.246836 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.248002 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6e4345b5-0cf8-4377-a97f-54223f63e709 tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:33.248002 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6e4345b5-0cf8-4377-a97f-54223f63e709 tempest-HypervisorAdminNegativeTestJSON-1127738428 tempest-HypervisorAdminNegativeTestJSON-1127738428-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.012721 May 21 21:10:33.248002 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 72/158] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:10:33 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:33.273558 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d228d3d5-68aa-495b-b79f-536eea3f441c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.484657 May 21 21:10:33.274795 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 87/159] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 2487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:10:33.289451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5577b95f-4407-4ce9-a439-39333b483a9d tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] Calling method '.version_select at 0x7fc82823d8b0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:33.293314 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-5577b95f-4407-4ce9-a439-39333b483a9d tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] HTTP exception thrown: Hypervisor with ID '077bcb19-c3d6-426c-bd9c-178810538016' could not be found. May 21 21:10:33.296461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5577b95f-4407-4ce9-a439-39333b483a9d tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] Request method failure captured: May 21 21:10:33.296461 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-hypervisors/077bcb19-c3d6-426c-bd9c-178810538016 HTTP/1.1 May 21 21:10:33.296461 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:33.296461 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:33.296461 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:33.296461 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:10:33.296461 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:33.296461 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:33.296461 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:33.296461 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:33.296461 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVHBVHyfsUN2-aPilm2dH0FIg70Fm1ciB9oOx2uAmwGp39vGIoleCs2ghKMjbTnsnKCsE2m2RpHDoSH6qFo_X0EaL5D28PayuyNI7D35LSMMrwADbxeudx8ga3MjKnNXS8oD7dVMKaRt6j-oF81X6d51oDSEmyFt8Wu4_xa-lIDCo8 May 21 21:10:33.296461 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:33.296461 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:33.296461 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:33.296461 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:33.296461 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:33.296461 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:33.296461 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 56643dc150054bb2b656a28b6caf6fb1 May 21 21:10:33.296461 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-476321965 May 21 21:10:33.296461 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,admin,member May 21 21:10:33.296461 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,admin,member May 21 21:10:33.297824 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/56643dc150054bb2b656a28b6caf6fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/56643dc150054bb2b656a28b6caf6fb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_56643dc150054bb2b656a28b6caf6fb1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/56643dc150054bb2b656a28b6caf6fb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:33.297824 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-476321965 May 21 21:10:33.297824 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 56643dc150054bb2b656a28b6caf6fb1 May 21 21:10:33.297824 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-476321965 May 21 21:10:33.297824 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin May 21 21:10:33.297824 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:33.297824 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:33.297824 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 04731b00432e415b819820b4a039b770 May 21 21:10:33.297824 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin May 21 21:10:33.297824 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:10:33.297824 ncdv-master-1 devstack@n-api.service[131278]: exception: Hypervisor with ID '077bcb19-c3d6-426c-bd9c-178810538016' could not be found. May 21 21:10:33.297824 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '077bcb19-c3d6-426c-bd9c-178810538016'} May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi value = int(str(value)) May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '077bcb19-c3d6-426c-bd9c-178810538016' May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise ValueError(msg) May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer May 21 21:10:33.298803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) May 21 21:10:33.305220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer May 21 21:10:33.305220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.305220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:33.305220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.305220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:33.305220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:33.305220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:33.305220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:33.305220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:33.305220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:10:33.305220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:10:33.305220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:33.305220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:33.305220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show May 21 21:10:33.305220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 21 21:10:33.305220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show May 21 21:10:33.305220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) May 21 21:10:33.305220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id May 21 21:10:33.305220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 21 21:10:33.305220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '077bcb19-c3d6-426c-bd9c-178810538016' could not be found. May 21 21:10:33.307351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.307351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:33.307351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.307351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:33.307351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:33.307351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:33.307351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:33.307351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:33.307351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '077bcb19-c3d6-426c-bd9c-178810538016' could not be found. May 21 21:10:33.307351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:33.307985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0c21e44f-4c3a-48bf-a9f9-8e860580c40c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:33.308073 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5577b95f-4407-4ce9-a439-39333b483a9d tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] Returning 404 to user: Hypervisor with ID '077bcb19-c3d6-426c-bd9c-178810538016' could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:33.308150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0c21e44f-4c3a-48bf-a9f9-8e860580c40c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:33.308226 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5577b95f-4407-4ce9-a439-39333b483a9d tempest-HypervisorAdminNegativeTestJSON-476321965 tempest-HypervisorAdminNegativeTestJSON-476321965-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/077bcb19-c3d6-426c-bd9c-178810538016" status: 404 len: 123 microversion: 2.1 time: 0.036489 May 21 21:10:33.308226 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 73/160] 10.222.0.49 () {58 vars in 1256 bytes} [Sat May 21 21:10:33 2022] GET /compute/v2.1/os-hypervisors/077bcb19-c3d6-426c-bd9c-178810538016 => generated 123 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:33.377024 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0c21e44f-4c3a-48bf-a9f9-8e860580c40c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:33.397321 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0c21e44f-4c3a-48bf-a9f9-8e860580c40c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 200 len: 1265 microversion: 2.1 time: 0.097698 May 21 21:10:33.397321 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 88/161] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:33 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 1265 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:34.102646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=10 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:34.107214 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-943bce06-6191-4a0b-8ba0-98b6dd6607b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:34.107841 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-943bce06-6191-4a0b-8ba0-98b6dd6607b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:34.120771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-943bce06-6191-4a0b-8ba0-98b6dd6607b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:34.121492 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-943bce06-6191-4a0b-8ba0-98b6dd6607b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:34.122568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-943bce06-6191-4a0b-8ba0-98b6dd6607b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:34.123167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-943bce06-6191-4a0b-8ba0-98b6dd6607b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:34.363932 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-943bce06-6191-4a0b-8ba0-98b6dd6607b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222d5f38e7964046befd68eae1123ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83797d59cecf40fb97b5f8543a6476d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:34.374966 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-943bce06-6191-4a0b-8ba0-98b6dd6607b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1338 microversion: 2.1 time: 0.273028 May 21 21:10:34.376197 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 74/162] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:34 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1338 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:34.407163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-226f0cbc-23c9-4d2d-85e7-75cc38cd6438 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:34.407789 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-226f0cbc-23c9-4d2d-85e7-75cc38cd6438 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:34.469259 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-226f0cbc-23c9-4d2d-85e7-75cc38cd6438 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:34.477469 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-226f0cbc-23c9-4d2d-85e7-75cc38cd6438 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 200 len: 1265 microversion: 2.1 time: 0.076423 May 21 21:10:34.487128 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 89/163] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:34 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 1265 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:35.397235 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-71b2c829-6670-40a3-83e4-98dc9858a7ce tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:35.407165 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-71b2c829-6670-40a3-83e4-98dc9858a7ce tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:35.422111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71b2c829-6670-40a3-83e4-98dc9858a7ce tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:35.422111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71b2c829-6670-40a3-83e4-98dc9858a7ce tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:35.422111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71b2c829-6670-40a3-83e4-98dc9858a7ce tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:35.422111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71b2c829-6670-40a3-83e4-98dc9858a7ce tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:35.457010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=71 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:35.494735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4a552d23-63ed-44c5-8c84-373551ed6996 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:35.495348 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4a552d23-63ed-44c5-8c84-373551ed6996 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:35.502278 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a552d23-63ed-44c5-8c84-373551ed6996 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:35.503129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a552d23-63ed-44c5-8c84-373551ed6996 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:35.504216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a552d23-63ed-44c5-8c84-373551ed6996 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:35.505143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a552d23-63ed-44c5-8c84-373551ed6996 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:35.590103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4a552d23-63ed-44c5-8c84-373551ed6996 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:35.598770 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4a552d23-63ed-44c5-8c84-373551ed6996 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 200 len: 1269 microversion: 2.1 time: 0.107968 May 21 21:10:35.604856 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 90/164] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:35 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 1269 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:10:35.648807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-71b2c829-6670-40a3-83e4-98dc9858a7ce tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222d5f38e7964046befd68eae1123ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83797d59cecf40fb97b5f8543a6476d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:35.657789 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-71b2c829-6670-40a3-83e4-98dc9858a7ce tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1338 microversion: 2.1 time: 0.267556 May 21 21:10:35.658872 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 75/165] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:35 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1338 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:36.586329 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0ae54ed9-1b85-4160-a229-dbc791261afa tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] Action: 'create', calling method: .version_select at 0x7fc81bf2fe50>, body: {"keypair": {"name": "tempest-keypair-1738866167", "type": "ssh", "user_id": "acdc4718fb7d4f1095a9a097e1b30e8a", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVCh/zlDtpSRgdg6tQI5FUfF3PQITIivxWQhgdEgH4S30KdqVD5VTS3YcFz9sbjwKYthtHQUxSWiURiarGtGWVXIkRXi3vI3a/ZOQ/Ckh+xXwYhJlHPmejkQVXiXTCpEg=="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:36.607257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-0ae54ed9-1b85-4160-a229-dbc791261afa tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] Getting quotas for project 283d5229b524411fb88ffe5f1c8806cb. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:10:36.612609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-0ae54ed9-1b85-4160-a229-dbc791261afa tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] Getting quotas for user a4e50382ca3d4acf96f330cfcd567c74 and project 283d5229b524411fb88ffe5f1c8806cb. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:10:36.616137 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e547a8fa-bb79-4a3f-8eda-cfbd5b9c6c12 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:36.619865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e547a8fa-bb79-4a3f-8eda-cfbd5b9c6c12 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:36.626445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e547a8fa-bb79-4a3f-8eda-cfbd5b9c6c12 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:36.627504 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e547a8fa-bb79-4a3f-8eda-cfbd5b9c6c12 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:36.628552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e547a8fa-bb79-4a3f-8eda-cfbd5b9c6c12 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:36.629294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e547a8fa-bb79-4a3f-8eda-cfbd5b9c6c12 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:36.747799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e547a8fa-bb79-4a3f-8eda-cfbd5b9c6c12 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:36.760273 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e547a8fa-bb79-4a3f-8eda-cfbd5b9c6c12 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 200 len: 1335 microversion: 2.1 time: 0.148980 May 21 21:10:36.762181 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 76/166] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:36 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 1335 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:10:36.777473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-361b4391-1a38-4dff-b7a5-49d31af4ecf7 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:36.778089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-361b4391-1a38-4dff-b7a5-49d31af4ecf7 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:36.788880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-361b4391-1a38-4dff-b7a5-49d31af4ecf7 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:36.789578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-361b4391-1a38-4dff-b7a5-49d31af4ecf7 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:36.791212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-361b4391-1a38-4dff-b7a5-49d31af4ecf7 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:36.791942 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-361b4391-1a38-4dff-b7a5-49d31af4ecf7 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:36.793661 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0ae54ed9-1b85-4160-a229-dbc791261afa tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.500796 May 21 21:10:36.794488 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 91/167] 10.222.0.49 () {62 vars in 1199 bytes} [Sat May 21 21:10:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 502 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 21 21:10:36.819229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b09fd7b7-7db2-45ca-821e-d7ed8f517889 tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] Action: 'create', calling method: .version_select at 0x7fc8280ed280>, body: {"keypair": {"name": "tempest-keypair-2103666609", "type": "ssh", "user_id": "acdc4718fb7d4f1095a9a097e1b30e8a", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOGPYEzNQOVM7tV39BcgVSOMBe6zFH2IRKhhkwMdM1sAZcSzpigdo8KzHHUHo8T095Hshi1mgKQi8k5u/6Oo1cl+6K01nYFHPrtLXlCk5hCiNsSlG/9+t6AC+rqnnazWA=="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:36.859810 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-b09fd7b7-7db2-45ca-821e-d7ed8f517889 tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] Getting quotas for project 283d5229b524411fb88ffe5f1c8806cb. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:10:36.866632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-b09fd7b7-7db2-45ca-821e-d7ed8f517889 tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] Getting quotas for user a4e50382ca3d4acf96f330cfcd567c74 and project 283d5229b524411fb88ffe5f1c8806cb. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:10:36.998353 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b09fd7b7-7db2-45ca-821e-d7ed8f517889 tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.194681 May 21 21:10:36.999490 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 92/168] 10.222.0.49 () {62 vars in 1199 bytes} [Sat May 21 21:10:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 196 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 21 21:10:37.010306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-da3a0ede-9509-492e-b89b-4319cbf118fe tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] Calling method '.version_select at 0x7fc81beea550>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:37.024582 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-da3a0ede-9509-492e-b89b-4319cbf118fe tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] 10.222.0.49 "GET /compute/v2.1/os-keypairs/tempest-keypair-1738866167?user_id=acdc4718fb7d4f1095a9a097e1b30e8a" status: 200 len: 512 microversion: 2.10 time: 0.019235 May 21 21:10:37.029971 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 93/169] 10.222.0.49 () {60 vars in 1339 bytes} [Sat May 21 21:10:37 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1738866167?user_id=acdc4718fb7d4f1095a9a097e1b30e8a => generated 512 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:37.046923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d27f0698-4c1f-4ded-a11b-b1e682f2f9b9 tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] Action: 'create', calling method: .version_select at 0x7fc81beea280>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1138674712", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKesZDI8Yv4LrlGPAsebY1n7JZndqA8xsWOmIGHxc/QQScqcQ8j+LK4HYt3xXgtnmonUlF25uc27QJxuJFDzwGNNI3q8duL7Y8mR1Ia8Go/vT8bTuIhVnho1hQSJ4GVxuw=="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:37.072682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-d27f0698-4c1f-4ded-a11b-b1e682f2f9b9 tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] Getting quotas for project 283d5229b524411fb88ffe5f1c8806cb. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:10:37.079512 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-d27f0698-4c1f-4ded-a11b-b1e682f2f9b9 tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] Getting quotas for user a4e50382ca3d4acf96f330cfcd567c74 and project 283d5229b524411fb88ffe5f1c8806cb. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:10:37.102396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:RELEASE=3,nova_api:SAVEPOINT=2,nova_api:UPDATE=1,nova_api:SELECT=84,nova_api:DELETE=5,nova_api:INSERT=5 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:37.111398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-361b4391-1a38-4dff-b7a5-49d31af4ecf7 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222d5f38e7964046befd68eae1123ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83797d59cecf40fb97b5f8543a6476d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:37.127641 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-361b4391-1a38-4dff-b7a5-49d31af4ecf7 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1338 microversion: 2.1 time: 0.362303 May 21 21:10:37.128824 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 77/170] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:36 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1338 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:37.257425 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d27f0698-4c1f-4ded-a11b-b1e682f2f9b9 tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.214007 May 21 21:10:37.260757 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 94/171] 10.222.0.49 () {62 vars in 1199 bytes} [Sat May 21 21:10:37 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 218 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 21 21:10:37.271314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e4a0e46c-05f3-49ed-be06-58a9a6d6d797 tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] Calling method '.version_select at 0x7fc82a6940d0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:37.274022 ncdv-master-1 devstack@n-api.service[131278]: WARNING oslo_db.sqlalchemy.utils [None req-e4a0e46c-05f3-49ed-be06-58a9a6d6d797 tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. May 21 21:10:37.286593 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e4a0e46c-05f3-49ed-be06-58a9a6d6d797 tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] 10.222.0.49 "GET /compute/v2.1/os-keypairs?user_id=acdc4718fb7d4f1095a9a097e1b30e8a" status: 200 len: 726 microversion: 2.10 time: 0.019259 May 21 21:10:37.289237 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 78/172] 10.222.0.49 () {60 vars in 1258 bytes} [Sat May 21 21:10:37 2022] GET /compute/v2.1/os-keypairs?user_id=acdc4718fb7d4f1095a9a097e1b30e8a => generated 726 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:37.299731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-020ef71b-f63b-4f5c-ac15-f66b92440cba tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] Calling method '.version_select at 0x7fc81beeae50>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:37.411838 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-020ef71b-f63b-4f5c-ac15-f66b92440cba tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1138674712" status: 204 len: 0 microversion: 2.10 time: 0.110191 May 21 21:10:37.411838 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 95/173] 10.222.0.49 () {60 vars in 1324 bytes} [Sat May 21 21:10:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1138674712 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:10:37.417987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5d9da728-99e7-40fd-bf22-940a56c2cb19 tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] Calling method '.version_select at 0x7fc82a7c6dc0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:37.578118 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5d9da728-99e7-40fd-bf22-940a56c2cb19 tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2103666609?user_id=acdc4718fb7d4f1095a9a097e1b30e8a" status: 204 len: 0 microversion: 2.10 time: 0.164531 May 21 21:10:37.578820 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 79/174] 10.222.0.49 () {60 vars in 1342 bytes} [Sat May 21 21:10:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2103666609?user_id=acdc4718fb7d4f1095a9a097e1b30e8a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:10:37.590443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d81227ff-3e3b-48b9-acd2-ee9fd6d6bf35 tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] Calling method '.version_select at 0x7fc81bed5160>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:37.683775 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d81227ff-3e3b-48b9-acd2-ee9fd6d6bf35 tempest-KeyPairsV210TestJSON-450692906 tempest-KeyPairsV210TestJSON-450692906-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1738866167?user_id=acdc4718fb7d4f1095a9a097e1b30e8a" status: 204 len: 0 microversion: 2.10 time: 0.096856 May 21 21:10:37.686495 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 96/175] 10.222.0.49 () {60 vars in 1342 bytes} [Sat May 21 21:10:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1738866167?user_id=acdc4718fb7d4f1095a9a097e1b30e8a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:10:37.777988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1cd7e013-115b-4888-8a26-ba7684cbce2d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:37.778610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1cd7e013-115b-4888-8a26-ba7684cbce2d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:37.794972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1cd7e013-115b-4888-8a26-ba7684cbce2d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:37.794972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1cd7e013-115b-4888-8a26-ba7684cbce2d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:37.794972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1cd7e013-115b-4888-8a26-ba7684cbce2d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:37.795655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1cd7e013-115b-4888-8a26-ba7684cbce2d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:38.076068 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1cd7e013-115b-4888-8a26-ba7684cbce2d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:38.085390 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1cd7e013-115b-4888-8a26-ba7684cbce2d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 200 len: 1391 microversion: 2.1 time: 0.311554 May 21 21:10:38.089836 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 97/176] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:37 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 1391 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:38.149630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7c27f0a4-4983-496d-9b07-9e7fedea201b tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:38.150258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7c27f0a4-4983-496d-9b07-9e7fedea201b tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:38.167058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c27f0a4-4983-496d-9b07-9e7fedea201b tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:38.168263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c27f0a4-4983-496d-9b07-9e7fedea201b tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:38.169314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c27f0a4-4983-496d-9b07-9e7fedea201b tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:38.169902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c27f0a4-4983-496d-9b07-9e7fedea201b tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:38.177342 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d59e14ac-54d8-4591-86f0-a8db500a7a8e tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-264303082", "ram": 512, "vcpus": 1, "disk": 10, "id": 1618326156, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:38.179726 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:38.179726 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:38.311784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=9,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:38.327988 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d59e14ac-54d8-4591-86f0-a8db500a7a8e tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.646447 May 21 21:10:38.337086 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 80/177] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:37 2022] POST /compute/v2.1/flavors => generated 415 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:38.418347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7c27f0a4-4983-496d-9b07-9e7fedea201b tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222d5f38e7964046befd68eae1123ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83797d59cecf40fb97b5f8543a6476d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:38.433475 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7c27f0a4-4983-496d-9b07-9e7fedea201b tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1338 microversion: 2.1 time: 0.288636 May 21 21:10:38.434056 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 98/178] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:38 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1338 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:38.792450 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f7bee510-92da-4339-a506-6aae3ac0f8e5 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:38.804133 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-f7bee510-92da-4339-a506-6aae3ac0f8e5 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project] HTTP exception thrown: Flavor 1618326156 has no extra specs with key hw:cpu_thread_policy. May 21 21:10:38.805848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f7bee510-92da-4339-a506-6aae3ac0f8e5 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project] Request method failure captured: May 21 21:10:38.805848 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/flavors/1618326156/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 May 21 21:10:38.805848 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:38.805848 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:38.805848 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:38.805848 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:10:38.805848 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:38.805848 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:38.805848 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:38.805848 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:38.805848 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVLWbeQZHyAO4f7UJ0vSKFACdhin3IsS_OlWg-veeTcDhLKWTnQgua4KLghpNY6zJy3BuOxDmOKMHXudq4UexXNWicMP-t5LWzCfqqqP4CfbbJW_7_zZSoYEkwlTKenNgWQPz3W63PTUjtfkeU8n9gphRHoxokAeX3XuJwFlB9qZkY May 21 21:10:38.805848 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:38.805848 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:38.805848 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:38.805848 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:38.805848 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:38.805848 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:38.805848 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: bc3db127e2324209a64d97aea7882dbe May 21 21:10:38.805848 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 May 21 21:10:38.805848 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:10:38.805848 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:10:38.813714 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bc3db127e2324209a64d97aea7882dbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bc3db127e2324209a64d97aea7882dbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bc3db127e2324209a64d97aea7882dbe", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bc3db127e2324209a64d97aea7882dbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:38.813714 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 May 21 21:10:38.813714 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: bc3db127e2324209a64d97aea7882dbe May 21 21:10:38.813714 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 May 21 21:10:38.813714 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project May 21 21:10:38.813714 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:38.813714 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:38.813714 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 987add3457a64cf9aef0d3da453c7966 May 21 21:10:38.813714 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project May 21 21:10:38.813714 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:10:38.813714 ncdv-master-1 devstack@n-api.service[131278]: exception: Flavor 1618326156 has no extra specs with key hw:cpu_thread_policy. May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'flavor_id': '1618326156', 'id': 'hw:cpu_thread_policy'} May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1618326156 has no extra specs with key hw:cpu_thread_policy. May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:38.814441 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:38.815825 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:38.815825 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:38.815825 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:38.815825 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:38.815825 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:38.815825 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1618326156 has no extra specs with key hw:cpu_thread_policy. May 21 21:10:38.815825 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:38.815825 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f7bee510-92da-4339-a506-6aae3ac0f8e5 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project] Returning 404 to user: Flavor 1618326156 has no extra specs with key hw:cpu_thread_policy. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:38.815825 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f7bee510-92da-4339-a506-6aae3ac0f8e5 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project] 10.222.0.49 "GET /compute/v2.1/flavors/1618326156/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.469064 May 21 21:10:38.815825 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 81/179] 10.222.0.49 () {58 vars in 1265 bytes} [Sat May 21 21:10:38 2022] GET /compute/v2.1/flavors/1618326156/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 470 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:38.821732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bcc7daa5-7933-4b84-a0ad-7cd2e6407261 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:38.823375 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:38.823375 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:38.824410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bcc7daa5-7933-4b84-a0ad-7cd2e6407261 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '987add3457a64cf9aef0d3da453c7966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3db127e2324209a64d97aea7882dbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:38.826539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bcc7daa5-7933-4b84-a0ad-7cd2e6407261 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project] Request method failure captured: May 21 21:10:38.826539 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/flavors/1618326156/os-extra_specs HTTP/1.1 May 21 21:10:38.826539 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:38.826539 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:38.826539 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:38.826539 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 66 May 21 21:10:38.826539 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:38.826539 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:38.826539 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:38.826539 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:38.826539 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVVLWbeQZHyAO4f7UJ0vSKFACdhin3IsS_OlWg-veeTcDhLKWTnQgua4KLghpNY6zJy3BuOxDmOKMHXudq4UexXNWicMP-t5LWzCfqqqP4CfbbJW_7_zZSoYEkwlTKenNgWQPz3W63PTUjtfkeU8n9gphRHoxokAeX3XuJwFlB9qZkY May 21 21:10:38.826539 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:38.826539 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:38.826539 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:38.826539 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:38.826539 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:38.826539 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:38.826539 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: bc3db127e2324209a64d97aea7882dbe May 21 21:10:38.826539 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 May 21 21:10:38.826539 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:10:38.826539 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:10:38.829400 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bc3db127e2324209a64d97aea7882dbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bc3db127e2324209a64d97aea7882dbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bc3db127e2324209a64d97aea7882dbe", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bc3db127e2324209a64d97aea7882dbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:38.829400 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 May 21 21:10:38.829400 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: bc3db127e2324209a64d97aea7882dbe May 21 21:10:38.829400 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 May 21 21:10:38.829400 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project May 21 21:10:38.829400 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:38.829400 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:38.829400 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 987add3457a64cf9aef0d3da453c7966 May 21 21:10:38.829400 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project May 21 21:10:38.829400 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:10:38.829400 ncdv-master-1 devstack@n-api.service[131277]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} May 21 21:10:38.829400 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:10:38.830524 ncdv-master-1 devstack@n-api.service[131277]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 21 21:10:38.830524 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'flavor_id': '1618326156', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} May 21 21:10:38.830524 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:38.830524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:38.830524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:38.830524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:38.830524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:38.830524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:38.830524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:38.830524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:38.830524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:10:38.830524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:10:38.830524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create May 21 21:10:38.830524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) May 21 21:10:38.830524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:10:38.830524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:10:38.830524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:10:38.830524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:10:38.830524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:38.834349 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:38.834349 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:38.834349 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:38.834349 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:10:38.834349 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:10:38.834349 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:10:38.834349 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:10:38.834349 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:10:38.834349 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:10:38.834349 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 21 21:10:38.834349 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:38.834349 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:38.834349 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:38.834349 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:38.834349 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:38.834349 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:38.834349 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:10:38.834349 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:10:38.834349 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 21 21:10:38.834349 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:38.836021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bcc7daa5-7933-4b84-a0ad-7cd2e6407261 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:38.836021 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bcc7daa5-7933-4b84-a0ad-7cd2e6407261 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project] 10.222.0.49 "POST /compute/v2.1/flavors/1618326156/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.010690 May 21 21:10:38.836021 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 99/180] 10.222.0.49 () {60 vars in 1223 bytes} [Sat May 21 21:10:38 2022] POST /compute/v2.1/flavors/1618326156/os-extra_specs => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:38.841760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4f089b1e-1b59-40b3-8eaa-849a6ec35d1e tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:38.842804 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:38.842804 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:38.874458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:38.958534 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4f089b1e-1b59-40b3-8eaa-849a6ec35d1e tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1618326156/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.121416 May 21 21:10:38.959803 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 82/181] 10.222.0.49 () {60 vars in 1223 bytes} [Sat May 21 21:10:38 2022] POST /compute/v2.1/flavors/1618326156/os-extra_specs => generated 66 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:10:38.980568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-62af2986-9cb6-40ab-8ec2-98ed64e68837 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:38.982000 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:38.982000 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:38.983297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-62af2986-9cb6-40ab-8ec2-98ed64e68837 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '987add3457a64cf9aef0d3da453c7966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3db127e2324209a64d97aea7882dbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:38.986596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-62af2986-9cb6-40ab-8ec2-98ed64e68837 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project] Request method failure captured: May 21 21:10:38.986596 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/flavors/1618326156/os-extra_specs/hw:numa_nodes HTTP/1.1 May 21 21:10:38.986596 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:38.986596 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:38.986596 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:38.986596 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:10:38.986596 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:38.986596 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:38.986596 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:38.986596 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:38.986596 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVLWbeQZHyAO4f7UJ0vSKFACdhin3IsS_OlWg-veeTcDhLKWTnQgua4KLghpNY6zJy3BuOxDmOKMHXudq4UexXNWicMP-t5LWzCfqqqP4CfbbJW_7_zZSoYEkwlTKenNgWQPz3W63PTUjtfkeU8n9gphRHoxokAeX3XuJwFlB9qZkY May 21 21:10:38.986596 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:38.986596 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:38.986596 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:38.986596 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:38.986596 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:38.986596 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:38.986596 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: bc3db127e2324209a64d97aea7882dbe May 21 21:10:38.986596 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 May 21 21:10:38.986596 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:10:38.986596 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:10:38.987751 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bc3db127e2324209a64d97aea7882dbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bc3db127e2324209a64d97aea7882dbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bc3db127e2324209a64d97aea7882dbe", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bc3db127e2324209a64d97aea7882dbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:38.987751 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 May 21 21:10:38.987751 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: bc3db127e2324209a64d97aea7882dbe May 21 21:10:38.987751 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 May 21 21:10:38.987751 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project May 21 21:10:38.987751 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:38.987751 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:38.987751 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 987add3457a64cf9aef0d3da453c7966 May 21 21:10:38.987751 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project May 21 21:10:38.987751 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:10:38.987751 ncdv-master-1 devstack@n-api.service[131278]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 21 21:10:38.988613 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'flavor_id': '1618326156', 'id': 'hw:numa_nodes'} May 21 21:10:38.988613 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:38.988613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:38.988613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:38.988613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:38.988613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:38.988613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:38.988613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:38.988613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:38.988613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete May 21 21:10:38.988613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) May 21 21:10:38.988613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:10:38.988613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:10:38.988613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:10:38.988613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:10:38.988613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:38.988613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:38.988613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:38.988613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:38.988613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:10:38.989741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:10:38.989741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:10:38.989741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:10:38.989741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:10:38.989741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:10:38.989741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 21 21:10:38.989741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:38.989741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:38.989741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:38.989741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:38.989741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:38.989741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:38.989741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:10:38.989741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:10:38.989741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 21 21:10:38.989741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:38.991885 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-62af2986-9cb6-40ab-8ec2-98ed64e68837 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:38.993297 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-62af2986-9cb6-40ab-8ec2-98ed64e68837 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project] 10.222.0.49 "DELETE /compute/v2.1/flavors/1618326156/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.020952 May 21 21:10:38.994639 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 83/182] 10.222.0.49 () {58 vars in 1247 bytes} [Sat May 21 21:10:38 2022] DELETE /compute/v2.1/flavors/1618326156/os-extra_specs/hw:numa_nodes => generated 124 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:39.008772 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e3a2e3a6-c5b2-4b3b-b5a2-98b55944b300 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:39.040311 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e3a2e3a6-c5b2-4b3b-b5a2-98b55944b300 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1618326156/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036895 May 21 21:10:39.041188 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 84/183] 10.222.0.49 () {60 vars in 1223 bytes} [Sat May 21 21:10:39 2022] POST /compute/v2.1/flavors/1618326156/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:10:39.054187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fd30af81-6da0-4cfb-973e-760ba56ad24b tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:39.055808 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:39.055808 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:39.057199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fd30af81-6da0-4cfb-973e-760ba56ad24b tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '987add3457a64cf9aef0d3da453c7966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3db127e2324209a64d97aea7882dbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:39.058725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fd30af81-6da0-4cfb-973e-760ba56ad24b tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project] Request method failure captured: May 21 21:10:39.058725 ncdv-master-1 devstack@n-api.service[131278]: request: PUT /compute/v2.1/flavors/1618326156/os-extra_specs/hw:numa_nodes HTTP/1.1 May 21 21:10:39.058725 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:39.058725 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:39.058725 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:39.058725 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 22 May 21 21:10:39.058725 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:39.058725 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:39.058725 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:39.058725 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:39.058725 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVLWbeQZHyAO4f7UJ0vSKFACdhin3IsS_OlWg-veeTcDhLKWTnQgua4KLghpNY6zJy3BuOxDmOKMHXudq4UexXNWicMP-t5LWzCfqqqP4CfbbJW_7_zZSoYEkwlTKenNgWQPz3W63PTUjtfkeU8n9gphRHoxokAeX3XuJwFlB9qZkY May 21 21:10:39.058725 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:39.058725 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:39.058725 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:39.058725 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:39.058725 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:39.058725 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:39.058725 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: bc3db127e2324209a64d97aea7882dbe May 21 21:10:39.058725 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 May 21 21:10:39.058725 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:10:39.058725 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:10:39.060137 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bc3db127e2324209a64d97aea7882dbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bc3db127e2324209a64d97aea7882dbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bc3db127e2324209a64d97aea7882dbe", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bc3db127e2324209a64d97aea7882dbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:39.060137 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 May 21 21:10:39.060137 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: bc3db127e2324209a64d97aea7882dbe May 21 21:10:39.060137 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 May 21 21:10:39.060137 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project May 21 21:10:39.060137 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:39.060137 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:39.060137 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 987add3457a64cf9aef0d3da453c7966 May 21 21:10:39.060137 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project May 21 21:10:39.060137 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:10:39.060137 ncdv-master-1 devstack@n-api.service[131278]: {"hw:numa_nodes": "1"} May 21 21:10:39.060137 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:10:39.060137 ncdv-master-1 devstack@n-api.service[131278]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 21 21:10:39.061476 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'flavor_id': '1618326156', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} May 21 21:10:39.061476 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:39.061476 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:39.061476 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:39.061476 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:39.061476 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:39.061476 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:39.061476 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:39.061476 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:39.061476 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:10:39.061476 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:10:39.061476 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update May 21 21:10:39.061476 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) May 21 21:10:39.061476 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:10:39.061476 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:10:39.061476 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:10:39.061476 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:10:39.061476 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:39.061476 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:39.062597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:39.062597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:39.062597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:10:39.062597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:10:39.062597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:10:39.062597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:10:39.062597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:10:39.062597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:10:39.062597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 21 21:10:39.062597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:39.062597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:39.062597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:39.062597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:39.062597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:39.062597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:39.062597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:10:39.062597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:10:39.062597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 21 21:10:39.062597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:39.063593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fd30af81-6da0-4cfb-973e-760ba56ad24b tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:39.063593 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fd30af81-6da0-4cfb-973e-760ba56ad24b tempest-FlavorsExtraSpecsNegativeTestJSON-128860291 tempest-FlavorsExtraSpecsNegativeTestJSON-128860291-project] 10.222.0.49 "PUT /compute/v2.1/flavors/1618326156/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.012929 May 21 21:10:39.063593 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 85/184] 10.222.0.49 () {60 vars in 1264 bytes} [Sat May 21 21:10:39 2022] PUT /compute/v2.1/flavors/1618326156/os-extra_specs/hw:numa_nodes => generated 124 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:39.071711 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5c0dc544-efb0-47fc-a0dc-c1930c620835 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:39.087179 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-5c0dc544-efb0-47fc-a0dc-c1930c620835 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] HTTP exception thrown: Flavor 1618326156 has no extra specs with key hw:cpu_thread_policy. May 21 21:10:39.088758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5c0dc544-efb0-47fc-a0dc-c1930c620835 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] Request method failure captured: May 21 21:10:39.088758 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/flavors/1618326156/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 May 21 21:10:39.088758 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:39.088758 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:39.088758 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:39.088758 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:10:39.088758 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:39.088758 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:39.088758 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:39.088758 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:39.088758 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVN9WUIw9r2Wc9RetOPdWYMvkv-LffRksDmWCG2KaiaNPdA4-on6WcMnbKDcclwIwENhVK43kTim8GMtQ7HLT4d8LGxya27vY3ZO_sojXJrREUT4196Q9E62LdQuxB_TWwxQL4R_WAydPHJZYiO15S1jkI7_cAzEK76YjCK2xTVFek May 21 21:10:39.088758 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:39.088758 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:39.088758 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:39.088758 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:39.088758 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:39.088758 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:39.088758 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 6968a392aab34903966d2ea286c71222 May 21 21:10:39.088758 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 May 21 21:10:39.088758 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,admin,member May 21 21:10:39.088758 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,admin,member May 21 21:10:39.090249 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6968a392aab34903966d2ea286c71222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6968a392aab34903966d2ea286c71222"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6968a392aab34903966d2ea286c71222", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6968a392aab34903966d2ea286c71222"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:39.090249 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 May 21 21:10:39.090249 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 6968a392aab34903966d2ea286c71222 May 21 21:10:39.090249 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 May 21 21:10:39.090249 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin May 21 21:10:39.090249 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:39.090249 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:39.090249 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 4eea48c0885044569523fc0e3639815a May 21 21:10:39.090249 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin May 21 21:10:39.090249 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:10:39.090249 ncdv-master-1 devstack@n-api.service[131278]: exception: Flavor 1618326156 has no extra specs with key hw:cpu_thread_policy. May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'flavor_id': '1618326156', 'id': 'hw:cpu_thread_policy'} May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1618326156 has no extra specs with key hw:cpu_thread_policy. May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:39.090985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:39.092257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:39.092257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:39.092257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:39.092257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:39.092257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:39.092257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1618326156 has no extra specs with key hw:cpu_thread_policy. May 21 21:10:39.092257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:39.093835 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5c0dc544-efb0-47fc-a0dc-c1930c620835 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] Returning 404 to user: Flavor 1618326156 has no extra specs with key hw:cpu_thread_policy. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:39.094859 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5c0dc544-efb0-47fc-a0dc-c1930c620835 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1618326156/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.028724 May 21 21:10:39.095731 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 86/185] 10.222.0.49 () {58 vars in 1268 bytes} [Sat May 21 21:10:39 2022] DELETE /compute/v2.1/flavors/1618326156/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:39.109304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7f70d911-9cdc-4a7e-a3af-d0bfbaec31c4 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:39.109991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7f70d911-9cdc-4a7e-a3af-d0bfbaec31c4 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:39.117624 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f70d911-9cdc-4a7e-a3af-d0bfbaec31c4 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:39.118079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f70d911-9cdc-4a7e-a3af-d0bfbaec31c4 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:39.118878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f70d911-9cdc-4a7e-a3af-d0bfbaec31c4 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:39.119326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f70d911-9cdc-4a7e-a3af-d0bfbaec31c4 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:39.387423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7f70d911-9cdc-4a7e-a3af-d0bfbaec31c4 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:39.402350 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7f70d911-9cdc-4a7e-a3af-d0bfbaec31c4 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 200 len: 1391 microversion: 2.1 time: 0.297520 May 21 21:10:39.412341 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 87/186] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:39 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 1391 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:39.412341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7870d2ef-fcdb-4be2-a44c-a20055448c96 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:39.412341 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:39.412341 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:39.413427 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-7870d2ef-fcdb-4be2-a44c-a20055448c96 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] HTTP exception thrown: Request body and URI mismatch May 21 21:10:39.419259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7870d2ef-fcdb-4be2-a44c-a20055448c96 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] Request method failure captured: May 21 21:10:39.419259 ncdv-master-1 devstack@n-api.service[131278]: request: PUT /compute/v2.1/flavors/1618326156/os-extra_specs/hw:numa_nodes HTTP/1.1 May 21 21:10:39.419259 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:39.419259 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:39.419259 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:39.419259 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 27 May 21 21:10:39.419259 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:39.419259 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:39.419259 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:39.419259 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:39.419259 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVN9WUIw9r2Wc9RetOPdWYMvkv-LffRksDmWCG2KaiaNPdA4-on6WcMnbKDcclwIwENhVK43kTim8GMtQ7HLT4d8LGxya27vY3ZO_sojXJrREUT4196Q9E62LdQuxB_TWwxQL4R_WAydPHJZYiO15S1jkI7_cAzEK76YjCK2xTVFek May 21 21:10:39.419259 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:39.419259 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:39.419259 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:39.419259 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:39.419259 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:39.419259 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:39.419259 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 6968a392aab34903966d2ea286c71222 May 21 21:10:39.419259 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 May 21 21:10:39.419259 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,admin,member May 21 21:10:39.419259 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,admin,member May 21 21:10:39.420560 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6968a392aab34903966d2ea286c71222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6968a392aab34903966d2ea286c71222"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6968a392aab34903966d2ea286c71222", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6968a392aab34903966d2ea286c71222"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:39.420560 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 May 21 21:10:39.420560 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 6968a392aab34903966d2ea286c71222 May 21 21:10:39.420560 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 May 21 21:10:39.420560 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin May 21 21:10:39.420560 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:39.420560 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:39.420560 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 4eea48c0885044569523fc0e3639815a May 21 21:10:39.420560 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin May 21 21:10:39.420560 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:10:39.420560 ncdv-master-1 devstack@n-api.service[131278]: {"hw:cpu_policy": "shared"} May 21 21:10:39.420560 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:10:39.420560 ncdv-master-1 devstack@n-api.service[131278]: exception: Request body and URI mismatch May 21 21:10:39.421257 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'flavor_id': '1618326156', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} May 21 21:10:39.421257 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:39.421257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:39.421257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:39.421257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:39.421257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:39.421257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:39.421257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:39.421257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:39.421257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:10:39.421257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:10:39.421257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update May 21 21:10:39.421257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) May 21 21:10:39.421257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch May 21 21:10:39.421257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:39.421257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:39.421257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:39.421257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:39.421257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:39.421257 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:39.422888 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:39.422888 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:39.422888 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch May 21 21:10:39.422888 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:39.422888 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7870d2ef-fcdb-4be2-a44c-a20055448c96 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:39.422888 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7870d2ef-fcdb-4be2-a44c-a20055448c96 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] 10.222.0.49 "PUT /compute/v2.1/flavors/1618326156/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.016803 May 21 21:10:39.422888 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 88/187] 10.222.0.49 () {60 vars in 1264 bytes} [Sat May 21 21:10:39 2022] PUT /compute/v2.1/flavors/1618326156/os-extra_specs/hw:numa_nodes => generated 73 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 21 21:10:39.433129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0629a5ba-bb7b-4a22-abf8-de9030a9a348 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:39.438625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0629a5ba-bb7b-4a22-abf8-de9030a9a348 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] Request method failure captured: May 21 21:10:39.438625 ncdv-master-1 devstack@n-api.service[131278]: request: PUT /compute/v2.1/flavors/1618326156/os-extra_specs/hw:numa_nodes HTTP/1.1 May 21 21:10:39.438625 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:39.438625 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:39.438625 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:39.438625 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 49 May 21 21:10:39.438625 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:39.438625 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:39.438625 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:39.438625 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:39.438625 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVN9WUIw9r2Wc9RetOPdWYMvkv-LffRksDmWCG2KaiaNPdA4-on6WcMnbKDcclwIwENhVK43kTim8GMtQ7HLT4d8LGxya27vY3ZO_sojXJrREUT4196Q9E62LdQuxB_TWwxQL4R_WAydPHJZYiO15S1jkI7_cAzEK76YjCK2xTVFek May 21 21:10:39.438625 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:39.438625 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:39.438625 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:39.438625 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:39.438625 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:39.438625 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:39.438625 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 6968a392aab34903966d2ea286c71222 May 21 21:10:39.438625 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 May 21 21:10:39.438625 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,admin,member May 21 21:10:39.438625 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,admin,member May 21 21:10:39.444691 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6968a392aab34903966d2ea286c71222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6968a392aab34903966d2ea286c71222"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6968a392aab34903966d2ea286c71222", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6968a392aab34903966d2ea286c71222"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:39.444691 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 May 21 21:10:39.444691 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 6968a392aab34903966d2ea286c71222 May 21 21:10:39.444691 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 May 21 21:10:39.444691 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin May 21 21:10:39.444691 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:39.444691 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:39.444691 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 4eea48c0885044569523fc0e3639815a May 21 21:10:39.444691 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin May 21 21:10:39.444691 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:10:39.444691 ncdv-master-1 devstack@n-api.service[131278]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} May 21 21:10:39.444691 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'flavor_id': '1618326156', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise error May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'minProperties': 1, May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'type': ['string', May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'number']}}, May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi On instance: May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} May 21 21:10:39.445453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:39.446625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:39.446625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:39.446625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:39.446625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:39.446625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:39.446625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:39.446625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:39.446625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:39.446625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:39.446625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:10:39.446625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:10:39.446625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:10:39.446625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:10:39.446625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:10:39.446625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:10:39.446625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 21 21:10:39.446625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:39.446625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:39.446625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:39.446625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:39.447679 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:39.447679 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:39.447679 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:10:39.447679 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:10:39.447679 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 21 21:10:39.447679 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:39.447679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0629a5ba-bb7b-4a22-abf8-de9030a9a348 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:39.447679 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0629a5ba-bb7b-4a22-abf8-de9030a9a348 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] 10.222.0.49 "PUT /compute/v2.1/flavors/1618326156/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.016448 May 21 21:10:39.447679 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 89/188] 10.222.0.49 () {60 vars in 1264 bytes} [Sat May 21 21:10:39 2022] PUT /compute/v2.1/flavors/1618326156/os-extra_specs/hw:numa_nodes => generated 117 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:10:39.455921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cfca1d50-0869-4466-a13d-91b9f5969b41 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:39.456664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cfca1d50-0869-4466-a13d-91b9f5969b41 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:39.475798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cfca1d50-0869-4466-a13d-91b9f5969b41 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:39.476264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cfca1d50-0869-4466-a13d-91b9f5969b41 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:39.477095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cfca1d50-0869-4466-a13d-91b9f5969b41 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:39.477544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cfca1d50-0869-4466-a13d-91b9f5969b41 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:39.484902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-12afaa14-d508-49dc-b4c3-a9ec6a329806 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1134285219", "id": 1675335548, "os-flavor-access:is_public": "False"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:39.486654 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:39.486654 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:39.632871 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-12afaa14-d508-49dc-b4c3-a9ec6a329806 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.666614 May 21 21:10:39.633819 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 100/189] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:38 2022] POST /compute/v2.1/flavors => generated 439 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:39.639317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-21445453-16f5-4895-b67d-1d51a53d2717 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:39.640117 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:39.640117 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:39.685915 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cfca1d50-0869-4466-a13d-91b9f5969b41 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222d5f38e7964046befd68eae1123ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83797d59cecf40fb97b5f8543a6476d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:39.695930 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cfca1d50-0869-4466-a13d-91b9f5969b41 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1338 microversion: 2.1 time: 0.248472 May 21 21:10:39.705141 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 90/190] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:39 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1338 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:39.711418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9668d7f3-6d27-4ae6-9f75-8b02be5a45ab tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1405fa53339145618679372c0dc936e3"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:39.712580 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:39.712580 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:39.760787 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-21445453-16f5-4895-b67d-1d51a53d2717 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1618326156" status: 202 len: 0 microversion: 2.1 time: 0.124057 May 21 21:10:39.761389 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 101/191] 10.222.0.49 () {58 vars in 1160 bytes} [Sat May 21 21:10:39 2022] DELETE /compute/v2.1/flavors/1618326156 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:10:39.775519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8750bbf2-611e-45c2-949d-bb8505b64aec tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:39.811627 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8750bbf2-611e-45c2-949d-bb8505b64aec tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991 tempest-FlavorsExtraSpecsNegativeTestJSON-2065653991-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.039887 May 21 21:10:39.812741 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 102/192] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:39 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:40.422951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-03286485-34a5-4b74-81e2-e12230b9bff8 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:40.424271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-03286485-34a5-4b74-81e2-e12230b9bff8 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:40.437735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-03286485-34a5-4b74-81e2-e12230b9bff8 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:40.438597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-03286485-34a5-4b74-81e2-e12230b9bff8 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:40.439620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-03286485-34a5-4b74-81e2-e12230b9bff8 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:40.440737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-03286485-34a5-4b74-81e2-e12230b9bff8 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:40.633337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-03286485-34a5-4b74-81e2-e12230b9bff8 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:40.641732 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-03286485-34a5-4b74-81e2-e12230b9bff8 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 200 len: 1391 microversion: 2.1 time: 0.226018 May 21 21:10:40.643478 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 103/193] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:40 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 1391 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:40.716683 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-49368adf-8a5a-4f50-a10b-b67a9f0592f1 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:40.717227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-49368adf-8a5a-4f50-a10b-b67a9f0592f1 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:40.723719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49368adf-8a5a-4f50-a10b-b67a9f0592f1 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:40.724170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49368adf-8a5a-4f50-a10b-b67a9f0592f1 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:40.725177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49368adf-8a5a-4f50-a10b-b67a9f0592f1 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:40.725661 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49368adf-8a5a-4f50-a10b-b67a9f0592f1 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:40.759719 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9668d7f3-6d27-4ae6-9f75-8b02be5a45ab tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1675335548/action" status: 200 len: 97 microversion: 2.1 time: 1.052905 May 21 21:10:40.764397 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 91/194] 10.222.0.49 () {60 vars in 1199 bytes} [Sat May 21 21:10:39 2022] POST /compute/v2.1/flavors/1675335548/action => generated 97 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:10:40.777599 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d1fdff8b-7d86-4005-803c-2dac366e6767 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1405fa53339145618679372c0dc936e3"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:40.905610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-49368adf-8a5a-4f50-a10b-b67a9f0592f1 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222d5f38e7964046befd68eae1123ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83797d59cecf40fb97b5f8543a6476d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:40.914358 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-49368adf-8a5a-4f50-a10b-b67a9f0592f1 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1338 microversion: 2.1 time: 0.202316 May 21 21:10:40.923969 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 104/195] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:40 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1338 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:41.147830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-beabfab0-3052-49f5-8024-88b016a07bde tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Calling method '.version_select at 0x7fc81be8f040>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:41.149301 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:41.149301 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:41.151017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-beabfab0-3052-49f5-8024-88b016a07bde tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:41.151682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-beabfab0-3052-49f5-8024-88b016a07bde tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:41.152621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-beabfab0-3052-49f5-8024-88b016a07bde tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:41.153103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-beabfab0-3052-49f5-8024-88b016a07bde tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:41.194298 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-beabfab0-3052-49f5-8024-88b016a07bde tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts" status: 200 len: 400 microversion: 2.1 time: 0.268879 May 21 21:10:41.197027 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 105/196] 10.222.0.49 () {58 vars in 1127 bytes} [Sat May 21 21:10:40 2022] GET /compute/v2.1/os-hosts => generated 400 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:41.211084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-82c06bdb-6003-4042-83c0-f38604cbd511 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Calling method '.version_select at 0x7fc81beea310>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:41.212695 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:41.212695 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:41.213873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82c06bdb-6003-4042-83c0-f38604cbd511 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:41.214526 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82c06bdb-6003-4042-83c0-f38604cbd511 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:41.215351 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82c06bdb-6003-4042-83c0-f38604cbd511 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:41.215794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82c06bdb-6003-4042-83c0-f38604cbd511 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:41.252415 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-82c06bdb-6003-4042-83c0-f38604cbd511 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 400 microversion: 2.1 time: 0.049936 May 21 21:10:41.253630 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 106/197] 10.222.0.49 () {58 vars in 1138 bytes} [Sat May 21 21:10:41 2022] GET /compute/v2.1/os-hosts?zone= => generated 400 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:10:41.265427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7c4b9439-3b2f-4ece-92b9-2c88bf257bb0 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Calling method '.version_select at 0x7fc81beb2af0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:41.267159 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:41.267159 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:41.269278 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c4b9439-3b2f-4ece-92b9-2c88bf257bb0 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:41.270230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c4b9439-3b2f-4ece-92b9-2c88bf257bb0 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:41.271576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c4b9439-3b2f-4ece-92b9-2c88bf257bb0 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:41.272193 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c4b9439-3b2f-4ece-92b9-2c88bf257bb0 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:41.304606 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7c4b9439-3b2f-4ece-92b9-2c88bf257bb0 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.040336 May 21 21:10:41.307409 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 107/198] 10.222.0.49 () {58 vars in 1144 bytes} [Sat May 21 21:10:41 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:10:41.433184 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-d1fdff8b-7d86-4005-803c-2dac366e6767 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] HTTP exception thrown: Flavor access already exists for flavor 35 and project 1405fa53339145618679372c0dc936e3 combination. May 21 21:10:41.450073 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d1fdff8b-7d86-4005-803c-2dac366e6767 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Request method failure captured: May 21 21:10:41.450073 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/flavors/1675335548/action HTTP/1.1 May 21 21:10:41.450073 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:41.450073 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:41.450073 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:41.450073 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 67 May 21 21:10:41.450073 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:41.450073 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:41.450073 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:41.450073 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:41.450073 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVM_Ack5rC18Ko7vjSje4A4FQ-uVn9_uSkIlWqBTi7tMcSBV72ObJJ7lUH9fv0w28Y5Ce1744OkNSmUKbl9B6ovIcYj8M1Zqg7mNiWpGl1xWVHJ9tJykWk3VS7XoBH7yBnwEbHEa0bebKpgptHUg45HkWmwTFQoBNs0yJRrRLmp9UU May 21 21:10:41.450073 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:41.450073 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:41.450073 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:41.450073 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:41.450073 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:41.450073 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:41.450073 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 6d20c082edfe46c08079959d2b717054 May 21 21:10:41.450073 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-68179218 May 21 21:10:41.450073 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,admin,member May 21 21:10:41.450073 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,admin,member May 21 21:10:41.451666 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6d20c082edfe46c08079959d2b717054"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6d20c082edfe46c08079959d2b717054"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6d20c082edfe46c08079959d2b717054", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6d20c082edfe46c08079959d2b717054"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:41.451666 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-68179218 May 21 21:10:41.451666 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 6d20c082edfe46c08079959d2b717054 May 21 21:10:41.451666 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-68179218 May 21 21:10:41.451666 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin May 21 21:10:41.451666 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:41.451666 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:41.451666 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 3b85a8cba7e84b2dbd44d98da1c0f902 May 21 21:10:41.451666 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin May 21 21:10:41.451666 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:10:41.451666 ncdv-master-1 devstack@n-api.service[131278]: {"addTenantAccess": {"tenant": "1405fa53339145618679372c0dc936e3"}} May 21 21:10:41.451666 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:10:41.453033 ncdv-master-1 devstack@n-api.service[131278]: exception: Flavor access already exists for flavor 35 and project 1405fa53339145618679372c0dc936e3 combination. May 21 21:10:41.453033 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '1675335548', 'body': {'addTenantAccess': {'tenant': '1405fa53339145618679372c0dc936e3'}}} May 21 21:10:41.453033 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:41.453033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:41.453033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 21 21:10:41.453033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 21 21:10:41.453033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 21 21:10:41.453033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 21 21:10:41.453033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 21 21:10:41.453033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = self._query(query) May 21 21:10:41.453033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 21 21:10:41.453033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi conn.query(q) May 21 21:10:41.453033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 21 21:10:41.453033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 21 21:10:41.453033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 21 21:10:41.453033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result.read() May 21 21:10:41.453033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 21 21:10:41.453033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 21 21:10:41.454291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 21 21:10:41.454291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 21 21:10:41.454291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 21 21:10:41.454291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 21 21:10:41.454291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 21 21:10:41.454291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 21 21:10:41.454291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '35-1405fa53339145618679372c0dc936e3' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") May 21 21:10:41.454291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:41.454291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 21 21:10:41.454291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:41.454291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:41.454291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project May 21 21:10:41.454291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi project.save(context.session) May 21 21:10:41.454291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 21 21:10:41.454291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi session.flush() May 21 21:10:41.454291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 21 21:10:41.454291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._flush(objects) May 21 21:10:41.454291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 21 21:10:41.454291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 21 21:10:41.455741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 21 21:10:41.455741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi compat.raise_( May 21 21:10:41.455741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 21 21:10:41.455741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception May 21 21:10:41.455741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 21 21:10:41.455741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi flush_context.execute() May 21 21:10:41.455741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 21 21:10:41.455741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi rec.execute(self) May 21 21:10:41.455741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 21 21:10:41.455741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 21 21:10:41.455741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 21 21:10:41.455741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 21 21:10:41.455741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 21 21:10:41.455741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 21 21:10:41.455741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 21 21:10:41.455741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 21 21:10:41.455741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 21 21:10:41.455741 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 21 21:10:41.456894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 21 21:10:41.456894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 21 21:10:41.456894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 21 21:10:41.456894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 21 21:10:41.456894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 21 21:10:41.456894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 21 21:10:41.456894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 21 21:10:41.456894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception May 21 21:10:41.456894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 21 21:10:41.456894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 21 21:10:41.456894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 21 21:10:41.456894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 21 21:10:41.456894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 21 21:10:41.456894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = self._query(query) May 21 21:10:41.456894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 21 21:10:41.456894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi conn.query(q) May 21 21:10:41.456894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 21 21:10:41.456894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 21 21:10:41.458651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 21 21:10:41.458651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result.read() May 21 21:10:41.458651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 21 21:10:41.458651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 21 21:10:41.458651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 21 21:10:41.458651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 21 21:10:41.458651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 21 21:10:41.458651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 21 21:10:41.458651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 21 21:10:41.458651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 21 21:10:41.458651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '35-1405fa53339145618679372c0dc936e3' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") May 21 21:10:41.458651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] May 21 21:10:41.458651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 21, 21, 10, 41, 374061), 'updated_at': None, 'flavor_id': 35, 'project_id': '1405fa53339145618679372c0dc936e3'}] May 21 21:10:41.458651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 21 21:10:41.458651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:41.458651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:41.458651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:41.459701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:41.459701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access May 21 21:10:41.459701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) May 21 21:10:41.459701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 21 21:10:41.459701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 21 21:10:41.459701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access May 21 21:10:41.459701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._add_access(project_id) May 21 21:10:41.459701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access May 21 21:10:41.459701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) May 21 21:10:41.459701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project May 21 21:10:41.459701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) May 21 21:10:41.459701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:10:41.459701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:10:41.459701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project May 21 21:10:41.459701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, May 21 21:10:41.459701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 35 and project 1405fa53339145618679372c0dc936e3 combination. May 21 21:10:41.459701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:41.459701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:41.459701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:41.464806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:41.464806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:41.464806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:41.464806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:41.464806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:41.464806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:41.464806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:41.464806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:10:41.464806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:10:41.464806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access May 21 21:10:41.464806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) May 21 21:10:41.464806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 35 and project 1405fa53339145618679372c0dc936e3 combination. May 21 21:10:41.464806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:41.464806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:41.464806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:41.464806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:41.464806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:41.464806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:41.464806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:41.464806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:41.466962 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 35 and project 1405fa53339145618679372c0dc936e3 combination. May 21 21:10:41.466962 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:41.466962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d1fdff8b-7d86-4005-803c-2dac366e6767 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Returning 409 to user: Flavor access already exists for flavor 35 and project 1405fa53339145618679372c0dc936e3 combination. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:41.466962 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d1fdff8b-7d86-4005-803c-2dac366e6767 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1675335548/action" status: 409 len: 152 microversion: 2.1 time: 0.688728 May 21 21:10:41.466962 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 92/199] 10.222.0.49 () {60 vars in 1199 bytes} [Sat May 21 21:10:40 2022] POST /compute/v2.1/flavors/1675335548/action => generated 152 bytes in 690 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 21 21:10:41.473048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e3d3bf1e-2aee-4b8a-b18b-fa912fc1c29b tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1405fa53339145618679372c0dc936e3"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:41.481103 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:41.481103 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:41.799570 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e3d3bf1e-2aee-4b8a-b18b-fa912fc1c29b tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1675335548/action" status: 200 len: 21 microversion: 2.1 time: 0.330715 May 21 21:10:41.800181 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 108/200] 10.222.0.49 () {60 vars in 1199 bytes} [Sat May 21 21:10:41 2022] POST /compute/v2.1/flavors/1675335548/action => generated 21 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:10:41.805385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2622b85c-f567-4f93-a5a9-f942c747349e tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:41.806003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2622b85c-f567-4f93-a5a9-f942c747349e tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:41.812824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2622b85c-f567-4f93-a5a9-f942c747349e tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:41.813345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2622b85c-f567-4f93-a5a9-f942c747349e tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:41.825213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2622b85c-f567-4f93-a5a9-f942c747349e tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:41.825213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2622b85c-f567-4f93-a5a9-f942c747349e tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:41.974219 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2622b85c-f567-4f93-a5a9-f942c747349e tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:41.983423 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2622b85c-f567-4f93-a5a9-f942c747349e tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 200 len: 1391 microversion: 2.1 time: 0.182164 May 21 21:10:41.984009 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 109/201] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:41 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:41.988708 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-389e5580-25b0-4255-9a36-7ec83d19489b tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:41.989621 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:41.989621 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:42.041691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-6dd54523-829a-4648-bc2f-dc704218f7a8 req-9fa4613b-dca7-4f10-8ac3-528f4d313368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab48e8e-24d9-4608-ba16-fbe26f0a89b0", "name": "network-vif-plugged", "status": "completed", "tag": "85844a0a-8069-455a-83e1-74b104aee4d8"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:42.057100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6dd54523-829a-4648-bc2f-dc704218f7a8 req-9fa4613b-dca7-4f10-8ac3-528f4d313368 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:42.057734 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6dd54523-829a-4648-bc2f-dc704218f7a8 req-9fa4613b-dca7-4f10-8ac3-528f4d313368 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:42.069107 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-6dd54523-829a-4648-bc2f-dc704218f7a8 req-9fa4613b-dca7-4f10-8ac3-528f4d313368 service nova] Creating event network-vif-plugged:85844a0a-8069-455a-83e1-74b104aee4d8 for instance fab48e8e-24d9-4608-ba16-fbe26f0a89b0 on nch2-master-1 May 21 21:10:42.074627 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-6dd54523-829a-4648-bc2f-dc704218f7a8 req-9fa4613b-dca7-4f10-8ac3-528f4d313368 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.469093 May 21 21:10:42.075989 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 93/202] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:42.078177 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-389e5580-25b0-4255-9a36-7ec83d19489b tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1675335548" status: 202 len: 0 microversion: 2.1 time: 0.092446 May 21 21:10:42.079111 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 110/203] 10.222.0.49 () {58 vars in 1160 bytes} [Sat May 21 21:10:41 2022] DELETE /compute/v2.1/flavors/1675335548 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:10:42.088757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-250ba3ea-db70-40cd-a4e6-36e33a20a53d tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:42.101070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-54b6303c-7048-4752-8a1f-2c7ad86fc403 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:42.101815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-54b6303c-7048-4752-8a1f-2c7ad86fc403 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:42.110550 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54b6303c-7048-4752-8a1f-2c7ad86fc403 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:42.111243 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54b6303c-7048-4752-8a1f-2c7ad86fc403 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:42.112303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54b6303c-7048-4752-8a1f-2c7ad86fc403 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:42.114633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54b6303c-7048-4752-8a1f-2c7ad86fc403 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:42.125404 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-250ba3ea-db70-40cd-a4e6-36e33a20a53d tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.042112 May 21 21:10:42.127061 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 111/204] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:42 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:42.147590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-90638d0a-17ec-46e4-b70d-dd8241b3e93f tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1620734844", "id": 134132504, "os-flavor-access:is_public": "True"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:42.149459 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:42.149459 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:42.214124 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-90638d0a-17ec-46e4-b70d-dd8241b3e93f tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.071714 May 21 21:10:42.214743 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 112/205] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:42 2022] POST /compute/v2.1/flavors => generated 435 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:10:42.224818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-309e64aa-cee2-4d40-9b50-1745e03fba3d tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:42.225577 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:42.225577 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:42.233573 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-309e64aa-cee2-4d40-9b50-1745e03fba3d tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] HTTP exception thrown: Access list not available for public flavors. May 21 21:10:42.233840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-309e64aa-cee2-4d40-9b50-1745e03fba3d tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Request method failure captured: May 21 21:10:42.233840 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/flavors/134132504/os-flavor-access HTTP/1.1 May 21 21:10:42.233840 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:42.233840 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:42.233840 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:42.233840 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:10:42.233840 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:42.233840 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:42.233840 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:42.233840 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:42.233840 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVVM_Ack5rC18Ko7vjSje4A4FQ-uVn9_uSkIlWqBTi7tMcSBV72ObJJ7lUH9fv0w28Y5Ce1744OkNSmUKbl9B6ovIcYj8M1Zqg7mNiWpGl1xWVHJ9tJykWk3VS7XoBH7yBnwEbHEa0bebKpgptHUg45HkWmwTFQoBNs0yJRrRLmp9UU May 21 21:10:42.233840 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:42.233840 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:42.233840 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:42.233840 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:42.233840 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:42.233840 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:42.233840 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 6d20c082edfe46c08079959d2b717054 May 21 21:10:42.233840 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-68179218 May 21 21:10:42.233840 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:10:42.233840 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:10:42.235067 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6d20c082edfe46c08079959d2b717054"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6d20c082edfe46c08079959d2b717054"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6d20c082edfe46c08079959d2b717054", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6d20c082edfe46c08079959d2b717054"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:42.235067 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-68179218 May 21 21:10:42.235067 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 6d20c082edfe46c08079959d2b717054 May 21 21:10:42.235067 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-68179218 May 21 21:10:42.235067 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin May 21 21:10:42.235067 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:42.235067 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:42.235067 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 3b85a8cba7e84b2dbd44d98da1c0f902 May 21 21:10:42.235067 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin May 21 21:10:42.235067 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:10:42.235067 ncdv-master-1 devstack@n-api.service[131277]: exception: Access list not available for public flavors. May 21 21:10:42.235067 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'flavor_id': '134132504'} May 21 21:10:42.235807 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:42.235807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:42.235807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:42.235807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:42.235807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:42.235807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:42.235807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:42.235807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:42.235807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index May 21 21:10:42.235807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 21 21:10:42.235807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. May 21 21:10:42.235807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:42.235807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:42.235807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:42.235807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:42.235807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:42.235807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:42.235807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:42.235807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:42.235807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. May 21 21:10:42.235807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:42.237243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-309e64aa-cee2-4d40-9b50-1745e03fba3d tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:42.237243 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-309e64aa-cee2-4d40-9b50-1745e03fba3d tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/134132504/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.013964 May 21 21:10:42.239286 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 113/206] 10.222.0.49 () {58 vars in 1205 bytes} [Sat May 21 21:10:42 2022] GET /compute/v2.1/flavors/134132504/os-flavor-access => generated 91 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 21 21:10:42.244072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7b1e64a7-10f2-4117-afbd-ee1b62c8ec33 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:42.316462 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7b1e64a7-10f2-4117-afbd-ee1b62c8ec33 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/134132504" status: 202 len: 0 microversion: 2.1 time: 0.075697 May 21 21:10:42.318543 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 114/207] 10.222.0.49 () {58 vars in 1157 bytes} [Sat May 21 21:10:42 2022] DELETE /compute/v2.1/flavors/134132504 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:10:42.327188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7ea34ef8-6f84-459a-a1ea-65392484a739 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:42.348791 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7ea34ef8-6f84-459a-a1ea-65392484a739 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.025856 May 21 21:10:42.350690 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 115/208] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:42 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:42.369757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-57172f22-cc74-4671-bad3-8dd4a23a5b15 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-153485693", "id": 2108652566, "os-flavor-access:is_public": "False"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:42.404241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-54b6303c-7048-4752-8a1f-2c7ad86fc403 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222d5f38e7964046befd68eae1123ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83797d59cecf40fb97b5f8543a6476d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:42.412561 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-54b6303c-7048-4752-8a1f-2c7ad86fc403 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1338 microversion: 2.1 time: 0.335134 May 21 21:10:42.413623 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 94/209] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:42 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1338 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:42.470298 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-57172f22-cc74-4671-bad3-8dd4a23a5b15 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.105680 May 21 21:10:42.470892 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 116/210] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:42 2022] POST /compute/v2.1/flavors => generated 438 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:42.891031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bd9ea716-c33d-4e58-bd4b-c29305c4222a tempest-FlavorsAccessNegativeTestJSON-1070009877 tempest-FlavorsAccessNegativeTestJSON-1070009877-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1405fa53339145618679372c0dc936e3"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:42.892427 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:42.892427 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:42.893531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bd9ea716-c33d-4e58-bd4b-c29305c4222a tempest-FlavorsAccessNegativeTestJSON-1070009877 tempest-FlavorsAccessNegativeTestJSON-1070009877-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '3ff60a865e4c494488b1b6972bb5a2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1405fa53339145618679372c0dc936e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:42.895574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bd9ea716-c33d-4e58-bd4b-c29305c4222a tempest-FlavorsAccessNegativeTestJSON-1070009877 tempest-FlavorsAccessNegativeTestJSON-1070009877-project] Request method failure captured: May 21 21:10:42.895574 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/flavors/2108652566/action HTTP/1.1 May 21 21:10:42.895574 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:42.895574 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:42.895574 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:42.895574 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 67 May 21 21:10:42.895574 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:42.895574 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:42.895574 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:42.895574 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:42.895574 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVKpgn10pYr9TIbzt5oDBwfV6Q4bwrVa3_J4rvKu1G81W6eSvCIcirb6CbRUURRsf8N9v7edR9UbGcKK3qUAULW8FoGsMd2rLstWWkXZwOihw9YU_Wwh8Y3VBBorkcG7_D9bcQ_cs9EDGXKqGwBtqVgNHiGYlzk3U6nySXz2ox1KJw May 21 21:10:42.895574 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:42.895574 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:42.895574 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:42.895574 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:42.895574 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:42.895574 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:42.895574 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 1405fa53339145618679372c0dc936e3 May 21 21:10:42.895574 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1070009877 May 21 21:10:42.895574 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:10:42.895574 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:10:42.896822 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1405fa53339145618679372c0dc936e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1405fa53339145618679372c0dc936e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1405fa53339145618679372c0dc936e3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1405fa53339145618679372c0dc936e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:42.896822 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1070009877 May 21 21:10:42.896822 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 1405fa53339145618679372c0dc936e3 May 21 21:10:42.896822 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1070009877 May 21 21:10:42.896822 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-FlavorsAccessNegativeTestJSON-1070009877-project May 21 21:10:42.896822 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:42.896822 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:42.896822 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 3ff60a865e4c494488b1b6972bb5a2de May 21 21:10:42.896822 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1070009877-project May 21 21:10:42.896822 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:10:42.896822 ncdv-master-1 devstack@n-api.service[131278]: {"addTenantAccess": {"tenant": "1405fa53339145618679372c0dc936e3"}} May 21 21:10:42.896822 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:10:42.897485 ncdv-master-1 devstack@n-api.service[131278]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 21 21:10:42.897485 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '2108652566', 'body': {'addTenantAccess': {'tenant': '1405fa53339145618679372c0dc936e3'}}} May 21 21:10:42.897485 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:42.897485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:42.897485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:42.897485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:42.897485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:42.897485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:42.897485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:42.897485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:42.897485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:10:42.897485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:10:42.897485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access May 21 21:10:42.897485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) May 21 21:10:42.897485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:10:42.897485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:10:42.897485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:10:42.897485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:10:42.897485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:42.900654 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:42.900654 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:42.900654 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:42.900654 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:10:42.900654 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:10:42.900654 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:10:42.900654 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:10:42.900654 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:10:42.900654 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:10:42.900654 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 21 21:10:42.900654 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:42.900654 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:42.900654 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:42.900654 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:42.900654 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:42.900654 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:42.900654 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:10:42.900654 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:10:42.900654 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 21 21:10:42.900654 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:42.903240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bd9ea716-c33d-4e58-bd4b-c29305c4222a tempest-FlavorsAccessNegativeTestJSON-1070009877 tempest-FlavorsAccessNegativeTestJSON-1070009877-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:42.903240 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bd9ea716-c33d-4e58-bd4b-c29305c4222a tempest-FlavorsAccessNegativeTestJSON-1070009877 tempest-FlavorsAccessNegativeTestJSON-1070009877-project] 10.222.0.49 "POST /compute/v2.1/flavors/2108652566/action" status: 403 len: 130 microversion: 2.1 time: 0.417622 May 21 21:10:42.903240 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 95/211] 10.222.0.49 () {60 vars in 1199 bytes} [Sat May 21 21:10:42 2022] POST /compute/v2.1/flavors/2108652566/action => generated 130 bytes in 422 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:42.905806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8e774666-58d4-48cc-8ed1-ac4ae524e58f tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:43.000882 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9fba3b5c-cc0a-4b48-9eb4-b0647aed6c4f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:43.001537 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9fba3b5c-cc0a-4b48-9eb4-b0647aed6c4f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:43.012604 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8e774666-58d4-48cc-8ed1-ac4ae524e58f tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/2108652566" status: 202 len: 0 microversion: 2.1 time: 0.110273 May 21 21:10:43.013757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9fba3b5c-cc0a-4b48-9eb4-b0647aed6c4f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:43.014126 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 117/212] 10.222.0.49 () {58 vars in 1160 bytes} [Sat May 21 21:10:42 2022] DELETE /compute/v2.1/flavors/2108652566 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 21 21:10:43.015815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9fba3b5c-cc0a-4b48-9eb4-b0647aed6c4f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:43.015815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9fba3b5c-cc0a-4b48-9eb4-b0647aed6c4f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:43.020625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9fba3b5c-cc0a-4b48-9eb4-b0647aed6c4f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:43.028607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-21896175-f08c-4063-9b51-dde828ecdf42 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:43.086750 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-21896175-f08c-4063-9b51-dde828ecdf42 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.067384 May 21 21:10:43.087942 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 118/213] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:43 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:10:43.113286 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0c29a5e1-864d-4ae3-b050-e3ebfc44496e tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-457346110", "id": 1538285208, "os-flavor-access:is_public": "False"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:43.251771 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0c29a5e1-864d-4ae3-b050-e3ebfc44496e tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.146379 May 21 21:10:43.252598 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 119/214] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:43 2022] POST /compute/v2.1/flavors => generated 438 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:10:43.264426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9c9316e2-9b67-4018-b857-d33ef352e96a tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1405fa53339145618679372c0dc936e3"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:43.265946 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:43.265946 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:43.511563 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9fba3b5c-cc0a-4b48-9eb4-b0647aed6c4f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:43.521059 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9fba3b5c-cc0a-4b48-9eb4-b0647aed6c4f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 200 len: 1391 microversion: 2.1 time: 0.523594 May 21 21:10:43.530978 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 96/215] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:42 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 1391 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:10:43.537564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3cafd80e-baac-49ad-9a36-76fde3d29d29 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:43.538339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3cafd80e-baac-49ad-9a36-76fde3d29d29 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:43.546021 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cafd80e-baac-49ad-9a36-76fde3d29d29 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:43.546937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cafd80e-baac-49ad-9a36-76fde3d29d29 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:43.547729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cafd80e-baac-49ad-9a36-76fde3d29d29 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:43.548352 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cafd80e-baac-49ad-9a36-76fde3d29d29 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:43.737346 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9c9316e2-9b67-4018-b857-d33ef352e96a tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1538285208/action" status: 200 len: 97 microversion: 2.1 time: 0.477525 May 21 21:10:43.740030 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 120/216] 10.222.0.49 () {60 vars in 1199 bytes} [Sat May 21 21:10:43 2022] POST /compute/v2.1/flavors/1538285208/action => generated 97 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:10:43.757488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3cafd80e-baac-49ad-9a36-76fde3d29d29 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222d5f38e7964046befd68eae1123ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83797d59cecf40fb97b5f8543a6476d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:43.767343 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3cafd80e-baac-49ad-9a36-76fde3d29d29 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1338 microversion: 2.1 time: 0.234369 May 21 21:10:43.768626 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 97/217] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:43 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1338 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:43.774337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-68fae089-b90c-41b2-8c40-cb3dc29b0bed tempest-FlavorsAccessNegativeTestJSON-1070009877 tempest-FlavorsAccessNegativeTestJSON-1070009877-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1405fa53339145618679372c0dc936e3"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:43.775906 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:43.775906 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:43.777191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-68fae089-b90c-41b2-8c40-cb3dc29b0bed tempest-FlavorsAccessNegativeTestJSON-1070009877 tempest-FlavorsAccessNegativeTestJSON-1070009877-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '3ff60a865e4c494488b1b6972bb5a2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1405fa53339145618679372c0dc936e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:43.779369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-68fae089-b90c-41b2-8c40-cb3dc29b0bed tempest-FlavorsAccessNegativeTestJSON-1070009877 tempest-FlavorsAccessNegativeTestJSON-1070009877-project] Request method failure captured: May 21 21:10:43.779369 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/flavors/1538285208/action HTTP/1.1 May 21 21:10:43.779369 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:43.779369 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:43.779369 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:43.779369 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 70 May 21 21:10:43.779369 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:43.779369 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:43.779369 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:43.779369 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:43.779369 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVKpgn10pYr9TIbzt5oDBwfV6Q4bwrVa3_J4rvKu1G81W6eSvCIcirb6CbRUURRsf8N9v7edR9UbGcKK3qUAULW8FoGsMd2rLstWWkXZwOihw9YU_Wwh8Y3VBBorkcG7_D9bcQ_cs9EDGXKqGwBtqVgNHiGYlzk3U6nySXz2ox1KJw May 21 21:10:43.779369 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:43.779369 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:43.779369 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:43.779369 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:43.779369 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:43.779369 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:43.779369 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 1405fa53339145618679372c0dc936e3 May 21 21:10:43.779369 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1070009877 May 21 21:10:43.779369 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:10:43.779369 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:10:43.780898 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1405fa53339145618679372c0dc936e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1405fa53339145618679372c0dc936e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1405fa53339145618679372c0dc936e3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1405fa53339145618679372c0dc936e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:43.780898 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1070009877 May 21 21:10:43.780898 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 1405fa53339145618679372c0dc936e3 May 21 21:10:43.780898 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1070009877 May 21 21:10:43.780898 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-FlavorsAccessNegativeTestJSON-1070009877-project May 21 21:10:43.780898 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:43.780898 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:43.780898 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 3ff60a865e4c494488b1b6972bb5a2de May 21 21:10:43.780898 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1070009877-project May 21 21:10:43.780898 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:10:43.780898 ncdv-master-1 devstack@n-api.service[131278]: {"removeTenantAccess": {"tenant": "1405fa53339145618679372c0dc936e3"}} May 21 21:10:43.780898 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:10:43.781968 ncdv-master-1 devstack@n-api.service[131278]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 21 21:10:43.781968 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '1538285208', 'body': {'removeTenantAccess': {'tenant': '1405fa53339145618679372c0dc936e3'}}} May 21 21:10:43.781968 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:43.781968 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:43.781968 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:43.781968 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:43.781968 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:43.781968 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:43.781968 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:43.781968 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:43.781968 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:10:43.781968 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:10:43.781968 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access May 21 21:10:43.781968 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi context.can( May 21 21:10:43.781968 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:10:43.781968 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:10:43.781968 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:10:43.781968 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:10:43.781968 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:43.781968 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:43.783268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:43.783268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:43.783268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:10:43.783268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:10:43.783268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:10:43.783268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:10:43.783268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:10:43.783268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:10:43.783268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 21 21:10:43.783268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:43.783268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:43.783268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:43.783268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:43.783268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:43.783268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:43.783268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:10:43.783268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:10:43.783268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 21 21:10:43.783268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:43.785438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-68fae089-b90c-41b2-8c40-cb3dc29b0bed tempest-FlavorsAccessNegativeTestJSON-1070009877 tempest-FlavorsAccessNegativeTestJSON-1070009877-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:43.786599 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-68fae089-b90c-41b2-8c40-cb3dc29b0bed tempest-FlavorsAccessNegativeTestJSON-1070009877 tempest-FlavorsAccessNegativeTestJSON-1070009877-project] 10.222.0.49 "POST /compute/v2.1/flavors/1538285208/action" status: 403 len: 133 microversion: 2.1 time: 0.016566 May 21 21:10:43.788064 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 98/218] 10.222.0.49 () {60 vars in 1199 bytes} [Sat May 21 21:10:43 2022] POST /compute/v2.1/flavors/1538285208/action => generated 133 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:43.802582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-66788fb9-2dcb-432d-b3e0-de49d02b4811 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1405fa53339145618679372c0dc936e3"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:44.110677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0ed31657-f775-4ad3-8c94-9ba0f1250cd9 tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] Action: 'update', calling method: .version_select at 0x7fc82a740040>, body: {"quota_set": {"ram": "5120"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:44.413388 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-66788fb9-2dcb-432d-b3e0-de49d02b4811 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1538285208/action" status: 200 len: 21 microversion: 2.1 time: 0.615620 May 21 21:10:44.415811 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 99/219] 10.222.0.49 () {60 vars in 1199 bytes} [Sat May 21 21:10:43 2022] POST /compute/v2.1/flavors/1538285208/action => generated 21 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:10:44.426947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b0b56989-a14d-40bc-af2e-dbd8d16173e0 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:44.427728 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:44.427728 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:44.489389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6,nova_api:DELETE=15 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:44.517702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ed31657-f775-4ad3-8c94-9ba0f1250cd9 tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:44.518460 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ed31657-f775-4ad3-8c94-9ba0f1250cd9 tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:44.519551 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ed31657-f775-4ad3-8c94-9ba0f1250cd9 tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:44.521182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ed31657-f775-4ad3-8c94-9ba0f1250cd9 tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:44.545060 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b0b56989-a14d-40bc-af2e-dbd8d16173e0 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1538285208" status: 202 len: 0 microversion: 2.1 time: 0.122112 May 21 21:10:44.546844 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 100/220] 10.222.0.49 () {58 vars in 1160 bytes} [Sat May 21 21:10:44 2022] DELETE /compute/v2.1/flavors/1538285208 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:10:44.563458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7875fc50-074f-4838-8fbb-8a0742123f63 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:44.564228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7875fc50-074f-4838-8fbb-8a0742123f63 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:44.575268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7875fc50-074f-4838-8fbb-8a0742123f63 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:44.575953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7875fc50-074f-4838-8fbb-8a0742123f63 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:44.578008 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7875fc50-074f-4838-8fbb-8a0742123f63 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:44.579634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7875fc50-074f-4838-8fbb-8a0742123f63 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:44.659421 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0ed31657-f775-4ad3-8c94-9ba0f1250cd9 tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/61a9c843eec3400fb9bd56175311bbf1" status: 200 len: 240 microversion: 2.36 time: 0.919548 May 21 21:10:44.660692 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 121/221] 10.222.0.49 () {62 vars in 1302 bytes} [Sat May 21 21:10:43 2022] PUT /compute/v2.1/os-quota-sets/61a9c843eec3400fb9bd56175311bbf1 => generated 240 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:44.671959 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-24dee3c1-a928-43b3-9287-724269d0ebbe tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:44.703133 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-24dee3c1-a928-43b3-9287-724269d0ebbe tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.041217 May 21 21:10:44.703854 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 122/222] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:44 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:44.795109 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7875fc50-074f-4838-8fbb-8a0742123f63 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:44.804153 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7875fc50-074f-4838-8fbb-8a0742123f63 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 200 len: 1391 microversion: 2.1 time: 0.256067 May 21 21:10:44.806441 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 101/223] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:44 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 1391 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:44.811836 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8f688f95-0732-4ea4-952d-14f067c9d75b tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] Calling method '.version_select at 0x7fc81bf2aa60>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:44.863973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-a5ebe4e1-5f23-43d4-a08c-4c053df7c4c8 req-7605749c-107c-4e4d-a97b-14a29c927051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c22ee7-e0f1-4d96-bedb-559c91cd2f00", "tag": "2558a946-51d6-4f04-bcc7-302329aa7086"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:44.892689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a5ebe4e1-5f23-43d4-a08c-4c053df7c4c8 req-7605749c-107c-4e4d-a97b-14a29c927051 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:44.893132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a5ebe4e1-5f23-43d4-a08c-4c053df7c4c8 req-7605749c-107c-4e4d-a97b-14a29c927051 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:44.920172 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a5ebe4e1-5f23-43d4-a08c-4c053df7c4c8 req-7605749c-107c-4e4d-a97b-14a29c927051 service nova] Creating event network-changed:2558a946-51d6-4f04-bcc7-302329aa7086 for instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 on nch1-master-1 May 21 21:10:44.931506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a5ebe4e1-5f23-43d4-a08c-4c053df7c4c8 req-7605749c-107c-4e4d-a97b-14a29c927051 service nova] Acquired lock "compute-rpcapi-router" {{(pid=131277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 21 21:10:44.931506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-205b2e47-7ede-437a-977c-7902a6b17c05 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:44.931506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-205b2e47-7ede-437a-977c-7902a6b17c05 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:44.931506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-205b2e47-7ede-437a-977c-7902a6b17c05 None None] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:44.931506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-205b2e47-7ede-437a-977c-7902a6b17c05 None None] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:44.933252 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.compute.rpcapi [None req-205b2e47-7ede-437a-977c-7902a6b17c05 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 21 21:10:44.934127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-205b2e47-7ede-437a-977c-7902a6b17c05 None None] Releasing lock "compute-rpcapi-router" {{(pid=131277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 21 21:10:44.949198 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-205b2e47-7ede-437a-977c-7902a6b17c05 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.243731 May 21 21:10:44.949806 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 123/224] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:44.955158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-48c9c56b-4673-45f4-b96a-7816e1b70cee tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1901065550", "id": 874186216, "os-flavor-access:is_public": "False"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:44.956834 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:44.956834 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:45.087136 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-48c9c56b-4673-45f4-b96a-7816e1b70cee tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.135822 May 21 21:10:45.088223 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 124/225] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:10:44 2022] POST /compute/v2.1/flavors => generated 436 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:45.094648 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2b60a4d4-6308-4752-9e38-f3d64e9653b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:45.095601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2b60a4d4-6308-4752-9e38-f3d64e9653b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:45.108128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b60a4d4-6308-4752-9e38-f3d64e9653b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:45.108440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b60a4d4-6308-4752-9e38-f3d64e9653b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:45.109333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b60a4d4-6308-4752-9e38-f3d64e9653b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:45.110112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b60a4d4-6308-4752-9e38-f3d64e9653b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:45.123544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f688f95-0732-4ea4-952d-14f067c9d75b tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:45.124265 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f688f95-0732-4ea4-952d-14f067c9d75b tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:45.125420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f688f95-0732-4ea4-952d-14f067c9d75b tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:45.126042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f688f95-0732-4ea4-952d-14f067c9d75b tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:45.150947 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8f688f95-0732-4ea4-952d-14f067c9d75b tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/61a9c843eec3400fb9bd56175311bbf1/detail" status: 200 len: 672 microversion: 2.36 time: 0.343156 May 21 21:10:45.151805 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 102/226] 10.222.0.49 () {60 vars in 1303 bytes} [Sat May 21 21:10:44 2022] GET /compute/v2.1/os-quota-sets/61a9c843eec3400fb9bd56175311bbf1/detail => generated 672 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:45.222239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f29d52d3-c302-4efb-b2c8-dbd0f25af0e9 tempest-NetworksTest-2011197174 tempest-NetworksTest-2011197174-project-admin] Calling method '.version_select at 0x7fc82823d310>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:45.305935 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2b60a4d4-6308-4752-9e38-f3d64e9653b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222d5f38e7964046befd68eae1123ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83797d59cecf40fb97b5f8543a6476d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:45.314331 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2b60a4d4-6308-4752-9e38-f3d64e9653b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1487 microversion: 2.1 time: 0.224948 May 21 21:10:45.315132 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 125/227] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:45 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1487 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:45.331329 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-96417329-aa27-460a-8e79-c2e203b7ae64 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "da7ff97bc45743c9aaca609335082bad"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:45.333400 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:45.333400 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:45.479894 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f29d52d3-c302-4efb-b2c8-dbd0f25af0e9 tempest-NetworksTest-2011197174 tempest-NetworksTest-2011197174-project-admin] 10.222.0.49 "GET /compute/v2.1/os-networks" status: 200 len: 3328 microversion: 2.1 time: 0.325724 May 21 21:10:45.482529 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 103/228] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:10:45 2022] GET /compute/v2.1/os-networks => generated 3328 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:45.492457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-921232a2-ea3c-44ad-b758-292ec4aab95a tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:45.493298 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-921232a2-ea3c-44ad-b758-292ec4aab95a tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:45.500326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-921232a2-ea3c-44ad-b758-292ec4aab95a tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:45.500920 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-921232a2-ea3c-44ad-b758-292ec4aab95a tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:45.501765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-921232a2-ea3c-44ad-b758-292ec4aab95a tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:45.502437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-921232a2-ea3c-44ad-b758-292ec4aab95a tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:45.621266 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-96417329-aa27-460a-8e79-c2e203b7ae64 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] HTTP exception thrown: Flavor access not found for 39 / da7ff97bc45743c9aaca609335082bad combination. May 21 21:10:45.624654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-96417329-aa27-460a-8e79-c2e203b7ae64 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Request method failure captured: May 21 21:10:45.624654 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/flavors/874186216/action HTTP/1.1 May 21 21:10:45.624654 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:45.624654 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:45.624654 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:45.624654 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 70 May 21 21:10:45.624654 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:45.624654 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:45.624654 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:45.624654 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:45.624654 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVVM_Ack5rC18Ko7vjSje4A4FQ-uVn9_uSkIlWqBTi7tMcSBV72ObJJ7lUH9fv0w28Y5Ce1744OkNSmUKbl9B6ovIcYj8M1Zqg7mNiWpGl1xWVHJ9tJykWk3VS7XoBH7yBnwEbHEa0bebKpgptHUg45HkWmwTFQoBNs0yJRrRLmp9UU May 21 21:10:45.624654 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:45.624654 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:45.624654 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:45.624654 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:45.624654 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:45.624654 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:45.624654 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 6d20c082edfe46c08079959d2b717054 May 21 21:10:45.624654 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-68179218 May 21 21:10:45.624654 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:10:45.624654 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:10:45.626079 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6d20c082edfe46c08079959d2b717054"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6d20c082edfe46c08079959d2b717054"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6d20c082edfe46c08079959d2b717054", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6d20c082edfe46c08079959d2b717054"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:45.626079 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-68179218 May 21 21:10:45.626079 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 6d20c082edfe46c08079959d2b717054 May 21 21:10:45.626079 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-68179218 May 21 21:10:45.626079 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin May 21 21:10:45.626079 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:45.626079 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:45.626079 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 3b85a8cba7e84b2dbd44d98da1c0f902 May 21 21:10:45.626079 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin May 21 21:10:45.626079 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:10:45.626079 ncdv-master-1 devstack@n-api.service[131277]: {"removeTenantAccess": {"tenant": "da7ff97bc45743c9aaca609335082bad"}} May 21 21:10:45.626079 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:10:45.626899 ncdv-master-1 devstack@n-api.service[131277]: exception: Flavor access not found for 39 / da7ff97bc45743c9aaca609335082bad combination. May 21 21:10:45.626899 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '874186216', 'body': {'removeTenantAccess': {'tenant': 'da7ff97bc45743c9aaca609335082bad'}}} May 21 21:10:45.626899 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:45.626899 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:45.626899 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access May 21 21:10:45.626899 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) May 21 21:10:45.626899 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 21 21:10:45.626899 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 21 21:10:45.626899 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access May 21 21:10:45.626899 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) May 21 21:10:45.626899 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access May 21 21:10:45.626899 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) May 21 21:10:45.626899 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project May 21 21:10:45.626899 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) May 21 21:10:45.626899 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:10:45.626899 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:10:45.626899 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project May 21 21:10:45.626899 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, May 21 21:10:45.628054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 39 / da7ff97bc45743c9aaca609335082bad combination. May 21 21:10:45.628054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:45.628054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:45.628054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:45.628054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:45.628054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:45.628054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:45.628054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:45.628054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:45.628054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:45.628054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:45.628054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:10:45.628054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:10:45.628054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access May 21 21:10:45.628054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:10:45.628054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 39 / da7ff97bc45743c9aaca609335082bad combination. May 21 21:10:45.628054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:45.628054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:45.628054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:45.628054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:45.630235 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:45.630235 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:45.630235 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:45.630235 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:45.630235 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 39 / da7ff97bc45743c9aaca609335082bad combination. May 21 21:10:45.630235 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:45.630235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-96417329-aa27-460a-8e79-c2e203b7ae64 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Returning 404 to user: Flavor access not found for 39 / da7ff97bc45743c9aaca609335082bad combination. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:45.630710 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-96417329-aa27-460a-8e79-c2e203b7ae64 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/874186216/action" status: 404 len: 124 microversion: 2.1 time: 0.303475 May 21 21:10:45.631086 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 126/229] 10.222.0.49 () {60 vars in 1196 bytes} [Sat May 21 21:10:45 2022] POST /compute/v2.1/flavors/874186216/action => generated 124 bytes in 305 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:45.638090 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c73ef38c-453b-4b61-8641-164af119a298 tempest-NetworksTest-2011197174 tempest-NetworksTest-2011197174-project-admin] Calling method '.version_select at 0x7fc81be5b280>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:45.761444 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c73ef38c-453b-4b61-8641-164af119a298 tempest-NetworksTest-2011197174 tempest-NetworksTest-2011197174-project-admin] 10.222.0.49 "GET /compute/v2.1/os-networks/06983291-49ee-40b0-862a-5c233ae403c5" status: 200 len: 652 microversion: 2.1 time: 0.129287 May 21 21:10:45.762032 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 127/230] 10.222.0.49 () {58 vars in 1247 bytes} [Sat May 21 21:10:45 2022] GET /compute/v2.1/os-networks/06983291-49ee-40b0-862a-5c233ae403c5 => generated 652 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:45.766571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8f85c439-de78-4edc-9654-75947190dfb0 tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] Action: 'update', calling method: .version_select at 0x7fc81be15040>, body: {"quota_set": {"ram": "2048"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:45.830619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f85c439-de78-4edc-9654-75947190dfb0 tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:45.831069 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f85c439-de78-4edc-9654-75947190dfb0 tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:45.831866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f85c439-de78-4edc-9654-75947190dfb0 tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:45.833021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f85c439-de78-4edc-9654-75947190dfb0 tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:45.870834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f85c439-de78-4edc-9654-75947190dfb0 tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:45.871296 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f85c439-de78-4edc-9654-75947190dfb0 tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:45.872205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f85c439-de78-4edc-9654-75947190dfb0 tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:45.872679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f85c439-de78-4edc-9654-75947190dfb0 tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:45.908328 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-921232a2-ea3c-44ad-b758-292ec4aab95a tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1638 microversion: 2.1 time: 0.421978 May 21 21:10:45.909419 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 104/231] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:45 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1638 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:45.916578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a9735eea-1e12-401d-9af2-6309e4eeaed1 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:45.917344 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:45.917344 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:45.998963 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a9735eea-1e12-401d-9af2-6309e4eeaed1 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/874186216" status: 202 len: 0 microversion: 2.1 time: 0.088359 May 21 21:10:46.000067 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 105/232] 10.222.0.49 () {58 vars in 1157 bytes} [Sat May 21 21:10:45 2022] DELETE /compute/v2.1/flavors/874186216 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:10:46.005358 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-daa12941-45fa-4b2d-8be0-f7f8ed31324b tempest-NetworksTest-2011197174 tempest-NetworksTest-2011197174-project-admin] Calling method '.version_select at 0x7fc82a3ad820>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:46.018269 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8f85c439-de78-4edc-9654-75947190dfb0 tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/61a9c843eec3400fb9bd56175311bbf1?user_id=0c18849f4573481a9fd7f379342d825f" status: 200 len: 240 microversion: 2.36 time: 0.255177 May 21 21:10:46.019031 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 128/233] 10.222.0.49 () {62 vars in 1383 bytes} [Sat May 21 21:10:45 2022] PUT /compute/v2.1/os-quota-sets/61a9c843eec3400fb9bd56175311bbf1?user_id=0c18849f4573481a9fd7f379342d825f => generated 240 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:46.023883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4075d490-ff67-4617-b235-ac73a382e20d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:46.024691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4075d490-ff67-4617-b235-ac73a382e20d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:46.030543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4075d490-ff67-4617-b235-ac73a382e20d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:46.031039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4075d490-ff67-4617-b235-ac73a382e20d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:46.032063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4075d490-ff67-4617-b235-ac73a382e20d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:46.032524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4075d490-ff67-4617-b235-ac73a382e20d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:46.149476 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-daa12941-45fa-4b2d-8be0-f7f8ed31324b tempest-NetworksTest-2011197174 tempest-NetworksTest-2011197174-project-admin] 10.222.0.49 "GET /compute/v2.1/os-networks" status: 200 len: 3328 microversion: 2.1 time: 0.148573 May 21 21:10:46.150358 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 106/234] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:10:45 2022] GET /compute/v2.1/os-networks => generated 3328 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:46.163653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-87aa251e-7a46-4abc-a73d-e50a97722bae tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:46.163653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-87aa251e-7a46-4abc-a73d-e50a97722bae tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:46.177615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87aa251e-7a46-4abc-a73d-e50a97722bae tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:46.178121 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87aa251e-7a46-4abc-a73d-e50a97722bae tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:46.180063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87aa251e-7a46-4abc-a73d-e50a97722bae tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:46.180847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87aa251e-7a46-4abc-a73d-e50a97722bae tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:46.193869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4075d490-ff67-4617-b235-ac73a382e20d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:46.201557 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4075d490-ff67-4617-b235-ac73a382e20d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 200 len: 1391 microversion: 2.1 time: 0.181457 May 21 21:10:46.202701 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 129/235] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:46 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:46.206400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c6453800-71c1-4f6a-8b13-501027c2b111 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:46.213826 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-87aa251e-7a46-4abc-a73d-e50a97722bae tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:10:46.226706 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c6453800-71c1-4f6a-8b13-501027c2b111 tempest-FlavorsAccessNegativeTestJSON-68179218 tempest-FlavorsAccessNegativeTestJSON-68179218-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.023523 May 21 21:10:46.236159 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 130/236] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:46 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:46.236159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0e8aa6b1-ec30-4f75-b9ff-78d881bed587 tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] Calling method '.version_select at 0x7fc81be15af0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:46.589654 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-87aa251e-7a46-4abc-a73d-e50a97722bae tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 204 len: 0 microversion: 2.1 time: 0.437786 May 21 21:10:46.594435 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 107/237] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:10:46 2022] DELETE /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:10:46.600317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eea830c6-b73a-49d1-b721-03b70ce41b60 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:46.601141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-eea830c6-b73a-49d1-b721-03b70ce41b60 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:46.608645 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eea830c6-b73a-49d1-b721-03b70ce41b60 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:46.609103 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eea830c6-b73a-49d1-b721-03b70ce41b60 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:46.610748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eea830c6-b73a-49d1-b721-03b70ce41b60 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:46.611200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eea830c6-b73a-49d1-b721-03b70ce41b60 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:46.796153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-eea830c6-b73a-49d1-b721-03b70ce41b60 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222d5f38e7964046befd68eae1123ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83797d59cecf40fb97b5f8543a6476d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:46.806375 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-eea830c6-b73a-49d1-b721-03b70ce41b60 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1493 microversion: 2.1 time: 0.210611 May 21 21:10:46.807210 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 108/238] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:46 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1493 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:46.952233 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0e8aa6b1-ec30-4f75-b9ff-78d881bed587 tempest-QuotasAdminTestV236-699770121 tempest-QuotasAdminTestV236-699770121-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/61a9c843eec3400fb9bd56175311bbf1?user_id=0c18849f4573481a9fd7f379342d825f" status: 200 len: 282 microversion: 2.36 time: 0.723883 May 21 21:10:46.955941 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 131/239] 10.222.0.49 () {60 vars in 1363 bytes} [Sat May 21 21:10:46 2022] GET /compute/v2.1/os-quota-sets/61a9c843eec3400fb9bd56175311bbf1?user_id=0c18849f4573481a9fd7f379342d825f => generated 282 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:47.223241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f36c7e89-79d4-4b09-888c-89bd77ab7eac tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:47.223241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f36c7e89-79d4-4b09-888c-89bd77ab7eac tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:47.234685 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f36c7e89-79d4-4b09-888c-89bd77ab7eac tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:47.235158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f36c7e89-79d4-4b09-888c-89bd77ab7eac tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:47.238764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f36c7e89-79d4-4b09-888c-89bd77ab7eac tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:47.239194 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f36c7e89-79d4-4b09-888c-89bd77ab7eac tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:47.367959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c802c09e-9ec9-448b-b33a-4da3ed2f97b2 tempest-HypervisorAdminV228Test-95912747 tempest-HypervisorAdminV228Test-95912747-project-admin] Calling method '.version_select at 0x7fc81bf1edc0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:47.368888 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:47.368888 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:47.370032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c802c09e-9ec9-448b-b33a-4da3ed2f97b2 tempest-HypervisorAdminV228Test-95912747 tempest-HypervisorAdminV228Test-95912747-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:47.370478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c802c09e-9ec9-448b-b33a-4da3ed2f97b2 tempest-HypervisorAdminV228Test-95912747 tempest-HypervisorAdminV228Test-95912747-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:47.385422 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c802c09e-9ec9-448b-b33a-4da3ed2f97b2 tempest-HypervisorAdminV228Test-95912747 tempest-HypervisorAdminV228Test-95912747-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:47.385871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c802c09e-9ec9-448b-b33a-4da3ed2f97b2 tempest-HypervisorAdminV228Test-95912747 tempest-HypervisorAdminV228Test-95912747-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:47.398319 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c802c09e-9ec9-448b-b33a-4da3ed2f97b2 tempest-HypervisorAdminV228Test-95912747 tempest-HypervisorAdminV228Test-95912747-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:47.398767 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c802c09e-9ec9-448b-b33a-4da3ed2f97b2 tempest-HypervisorAdminV228Test-95912747 tempest-HypervisorAdminV228Test-95912747-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:47.419176 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c802c09e-9ec9-448b-b33a-4da3ed2f97b2 tempest-HypervisorAdminV228Test-95912747 tempest-HypervisorAdminV228Test-95912747-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.282241 May 21 21:10:47.424785 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 109/240] 10.222.0.49 () {60 vars in 1186 bytes} [Sat May 21 21:10:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:47.432219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-05b2aa4d-125f-4a87-892e-ae7a157584bb tempest-HypervisorAdminV228Test-95912747 tempest-HypervisorAdminV228Test-95912747-project-admin] Calling method '.version_select at 0x7fc81bf1ed30>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:47.433234 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:47.433234 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:47.434790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05b2aa4d-125f-4a87-892e-ae7a157584bb tempest-HypervisorAdminV228Test-95912747 tempest-HypervisorAdminV228Test-95912747-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:47.435322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05b2aa4d-125f-4a87-892e-ae7a157584bb tempest-HypervisorAdminV228Test-95912747 tempest-HypervisorAdminV228Test-95912747-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:47.453545 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05b2aa4d-125f-4a87-892e-ae7a157584bb tempest-HypervisorAdminV228Test-95912747 tempest-HypervisorAdminV228Test-95912747-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:47.454745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05b2aa4d-125f-4a87-892e-ae7a157584bb tempest-HypervisorAdminV228Test-95912747 tempest-HypervisorAdminV228Test-95912747-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:47.463291 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-05b2aa4d-125f-4a87-892e-ae7a157584bb tempest-HypervisorAdminV228Test-95912747 tempest-HypervisorAdminV228Test-95912747-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.037038 May 21 21:10:47.464743 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 110/241] 10.222.0.49 () {60 vars in 1192 bytes} [Sat May 21 21:10:47 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:47.524459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f36c7e89-79d4-4b09-888c-89bd77ab7eac tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:47.532662 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f36c7e89-79d4-4b09-888c-89bd77ab7eac tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 200 len: 1391 microversion: 2.1 time: 0.316891 May 21 21:10:47.536397 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 132/242] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:47 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 1391 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:47.824315 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d3535412-f5b6-4f49-aedf-06e8c638ef1b tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:47.825104 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d3535412-f5b6-4f49-aedf-06e8c638ef1b tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:47.831705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3535412-f5b6-4f49-aedf-06e8c638ef1b tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:47.833824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3535412-f5b6-4f49-aedf-06e8c638ef1b tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:47.834141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3535412-f5b6-4f49-aedf-06e8c638ef1b tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:47.834669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3535412-f5b6-4f49-aedf-06e8c638ef1b tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:48.048021 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d3535412-f5b6-4f49-aedf-06e8c638ef1b tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222d5f38e7964046befd68eae1123ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83797d59cecf40fb97b5f8543a6476d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:48.050423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:48.063254 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d3535412-f5b6-4f49-aedf-06e8c638ef1b tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1493 microversion: 2.1 time: 0.243056 May 21 21:10:48.063842 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 111/243] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:47 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1493 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:48.550212 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8df48279-bbc2-4099-af14-5e1eed498b66 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:48.551064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8df48279-bbc2-4099-af14-5e1eed498b66 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:48.559646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8df48279-bbc2-4099-af14-5e1eed498b66 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:48.560110 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8df48279-bbc2-4099-af14-5e1eed498b66 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:48.560947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8df48279-bbc2-4099-af14-5e1eed498b66 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:48.563061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8df48279-bbc2-4099-af14-5e1eed498b66 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:48.783577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8df48279-bbc2-4099-af14-5e1eed498b66 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:48.793551 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8df48279-bbc2-4099-af14-5e1eed498b66 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 200 len: 1391 microversion: 2.1 time: 0.247118 May 21 21:10:48.794466 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 133/244] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:48 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 1391 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:48.898779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-cdc0be13-dffb-4eba-b665-ecbdba6e156c req-ce34d695-8f44-4f6a-8b94-19ab1b7c9181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab48e8e-24d9-4608-ba16-fbe26f0a89b0", "name": "network-vif-deleted", "tag": "85844a0a-8069-455a-83e1-74b104aee4d8"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:48.916577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-cdc0be13-dffb-4eba-b665-ecbdba6e156c req-ce34d695-8f44-4f6a-8b94-19ab1b7c9181 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:48.917724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-cdc0be13-dffb-4eba-b665-ecbdba6e156c req-ce34d695-8f44-4f6a-8b94-19ab1b7c9181 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:48.969225 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-cdc0be13-dffb-4eba-b665-ecbdba6e156c req-ce34d695-8f44-4f6a-8b94-19ab1b7c9181 service nova] Creating event network-vif-deleted:85844a0a-8069-455a-83e1-74b104aee4d8 for instance fab48e8e-24d9-4608-ba16-fbe26f0a89b0 on nch2-master-1 May 21 21:10:48.976952 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-cdc0be13-dffb-4eba-b665-ecbdba6e156c req-ce34d695-8f44-4f6a-8b94-19ab1b7c9181 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084625 May 21 21:10:48.978205 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 112/245] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:49.079414 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e45221c1-db34-4d91-9cb9-9bf833817af8 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:49.080046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e45221c1-db34-4d91-9cb9-9bf833817af8 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:49.087322 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e45221c1-db34-4d91-9cb9-9bf833817af8 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:49.088004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e45221c1-db34-4d91-9cb9-9bf833817af8 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:49.088817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e45221c1-db34-4d91-9cb9-9bf833817af8 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:49.089261 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e45221c1-db34-4d91-9cb9-9bf833817af8 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:49.275943 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e45221c1-db34-4d91-9cb9-9bf833817af8 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222d5f38e7964046befd68eae1123ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83797d59cecf40fb97b5f8543a6476d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:49.295150 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e45221c1-db34-4d91-9cb9-9bf833817af8 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 200 len: 1323 microversion: 2.1 time: 0.217043 May 21 21:10:49.295789 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 134/246] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:49 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 1323 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:49.811443 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6007b98e-d468-4b1b-bd8e-04f736061d4c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:49.812135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6007b98e-d468-4b1b-bd8e-04f736061d4c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:49.815633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=80,nova_api:SAVEPOINT=4,nova_api:INSERT=4,nova_api:RELEASE=4,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:49.821981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6007b98e-d468-4b1b-bd8e-04f736061d4c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:49.824784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6007b98e-d468-4b1b-bd8e-04f736061d4c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:49.824784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6007b98e-d468-4b1b-bd8e-04f736061d4c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:49.824784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6007b98e-d468-4b1b-bd8e-04f736061d4c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:49.997789 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6007b98e-d468-4b1b-bd8e-04f736061d4c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:50.017269 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6007b98e-d468-4b1b-bd8e-04f736061d4c tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 200 len: 1391 microversion: 2.1 time: 0.209882 May 21 21:10:50.019325 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 113/247] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:49 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 1391 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:50.312434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fc879cf2-2db5-4918-b9e1-7048bb62114d tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:50.313082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fc879cf2-2db5-4918-b9e1-7048bb62114d tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:50.323809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc879cf2-2db5-4918-b9e1-7048bb62114d tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:50.323809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc879cf2-2db5-4918-b9e1-7048bb62114d tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:50.323809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc879cf2-2db5-4918-b9e1-7048bb62114d tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:50.323809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc879cf2-2db5-4918-b9e1-7048bb62114d tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:50.337886 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-fc879cf2-2db5-4918-b9e1-7048bb62114d tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] HTTP exception thrown: Instance fab48e8e-24d9-4608-ba16-fbe26f0a89b0 could not be found. May 21 21:10:50.345778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fc879cf2-2db5-4918-b9e1-7048bb62114d tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Request method failure captured: May 21 21:10:50.345778 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 HTTP/1.1 May 21 21:10:50.345778 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:50.345778 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:50.345778 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:50.345778 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:10:50.345778 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:50.345778 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:50.345778 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:50.345778 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:50.345778 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVUp4H1M5k513ZVCzTK2OIXpee4qMWEaThAGIA2sj5KC3gQ9dgOxeY_2k9pphkD2m9b2MdVI1kIHja94Q82uuRA7q7YfCC5owpNUfRlpSn_o1myUiUOJvPpSTSbe6CfxuQE5kOqtcSzuqI5hNeKK7kPV7gNWrishlG-jsqFtUKf7PKQ May 21 21:10:50.345778 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:50.345778 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:50.345778 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:50.345778 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:50.345778 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:50.345778 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:50.345778 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 83797d59cecf40fb97b5f8543a6476d0 May 21 21:10:50.345778 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AggregatesAdminTestJSON-1528215393 May 21 21:10:50.345778 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:10:50.345778 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:10:50.347232 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/83797d59cecf40fb97b5f8543a6476d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/83797d59cecf40fb97b5f8543a6476d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_83797d59cecf40fb97b5f8543a6476d0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/83797d59cecf40fb97b5f8543a6476d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:50.347232 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AggregatesAdminTestJSON-1528215393 May 21 21:10:50.347232 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 83797d59cecf40fb97b5f8543a6476d0 May 21 21:10:50.347232 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1528215393 May 21 21:10:50.347232 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AggregatesAdminTestJSON-1528215393-project May 21 21:10:50.347232 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:50.347232 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:50.347232 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 222d5f38e7964046befd68eae1123ec0 May 21 21:10:50.347232 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AggregatesAdminTestJSON-1528215393-project May 21 21:10:50.347232 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:10:50.347232 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance fab48e8e-24d9-4608-ba16-fbe26f0a89b0 could not be found. May 21 21:10:50.347232 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'fab48e8e-24d9-4608-ba16-fbe26f0a89b0'} May 21 21:10:50.359285 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:50.359285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:50.359285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:10:50.359285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:10:50.359285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:10:50.359285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:10:50.359285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:10:50.359285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:10:50.359285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:10:50.359285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:10:50.359285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fab48e8e-24d9-4608-ba16-fbe26f0a89b0 could not be found. May 21 21:10:50.359285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:50.359285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:50.359285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:50.359285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:50.359285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:50.359285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:50.359285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:50.359285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:50.359285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:50.360989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:50.360989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:10:50.360989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:10:50.360989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:10:50.360989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:10:50.360989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:10:50.360989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:10:50.360989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fab48e8e-24d9-4608-ba16-fbe26f0a89b0 could not be found. May 21 21:10:50.360989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:50.360989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:50.360989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:50.360989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:50.360989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:50.360989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:50.360989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:50.360989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:50.360989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fab48e8e-24d9-4608-ba16-fbe26f0a89b0 could not be found. May 21 21:10:50.360989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:50.362167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fc879cf2-2db5-4918-b9e1-7048bb62114d tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Returning 404 to user: Instance fab48e8e-24d9-4608-ba16-fbe26f0a89b0 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:50.362167 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fc879cf2-2db5-4918-b9e1-7048bb62114d tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 404 len: 111 microversion: 2.1 time: 0.042109 May 21 21:10:50.362167 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 135/248] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:50 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:50.368684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-02ef9c1b-b008-4ccf-9d26-0ac3280ad9f2 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:50.370015 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:50.370015 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:50.383187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02ef9c1b-b008-4ccf-9d26-0ac3280ad9f2 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:50.383872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02ef9c1b-b008-4ccf-9d26-0ac3280ad9f2 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:50.717133 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-02ef9c1b-b008-4ccf-9d26-0ac3280ad9f2 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 297 microversion: 2.1 time: 0.352417 May 21 21:10:50.717757 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 114/249] 10.222.0.49 () {60 vars in 1190 bytes} [Sat May 21 21:10:50 2022] POST /compute/v2.1/os-aggregates/4/action => generated 297 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:50.727982 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dc55099d-033c-4b51-840c-13211b2dfc07 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:50.728802 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:50.728802 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:50.868925 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dc55099d-033c-4b51-840c-13211b2dfc07 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.144541 May 21 21:10:50.869984 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 136/250] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:10:50 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 21 21:10:50.884329 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5ca8b634-d3e4-4f3e-817b-26934165aae8 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-250283284"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:50.885760 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:50.885760 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:50.886694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.aggregate [None req-5ca8b634-d3e4-4f3e-817b-26934165aae8 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Generated uuid 52745ca0-3816-4d96-b718-9c831ed85235 for aggregate {{(pid=131278) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 21 21:10:50.981467 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5ca8b634-d3e4-4f3e-817b-26934165aae8 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.101867 May 21 21:10:50.983193 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 115/251] 10.222.0.49 () {60 vars in 1163 bytes} [Sat May 21 21:10:50 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:50.993466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6d7f6556-3f56-4d65-bb5e-18a995302bbb tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:50.996472 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:50.996472 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:51.006997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d7f6556-3f56-4d65-bb5e-18a995302bbb tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:51.007631 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d7f6556-3f56-4d65-bb5e-18a995302bbb tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:51.014310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:51.037652 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e3755d6c-9e6a-4074-91a6-f6721cbb3788 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:51.038280 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e3755d6c-9e6a-4074-91a6-f6721cbb3788 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:51.044395 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3755d6c-9e6a-4074-91a6-f6721cbb3788 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:51.045468 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3755d6c-9e6a-4074-91a6-f6721cbb3788 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:51.046284 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3755d6c-9e6a-4074-91a6-f6721cbb3788 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:51.046716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3755d6c-9e6a-4074-91a6-f6721cbb3788 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:51.243211 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e3755d6c-9e6a-4074-91a6-f6721cbb3788 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:51.252863 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e3755d6c-9e6a-4074-91a6-f6721cbb3788 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 200 len: 1391 microversion: 2.1 time: 0.219900 May 21 21:10:51.253882 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 116/252] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:51 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 1391 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:10:51.343602 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6d7f6556-3f56-4d65-bb5e-18a995302bbb tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.353449 May 21 21:10:51.346366 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 137/253] 10.222.0.49 () {60 vars in 1190 bytes} [Sat May 21 21:10:50 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:51.356812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bc52bb77-b74a-4c9f-99fe-f5a914c45adb tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:51.357609 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:51.357609 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:51.365793 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bc52bb77-b74a-4c9f-99fe-f5a914c45adb tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.012969 May 21 21:10:51.366370 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 117/254] 10.222.0.49 () {58 vars in 1148 bytes} [Sat May 21 21:10:51 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:51.377019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5e43a1bf-ab85-40b9-b722-8a84119daede tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:51.378258 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:51.378258 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:51.387567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5e43a1bf-ab85-40b9-b722-8a84119daede tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:51.388379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5e43a1bf-ab85-40b9-b722-8a84119daede tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:51.434971 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-f8000c89-2239-4762-afa4-61149fbc395c req-fb7e4a44-de91-46b8-9763-b39a7000f6bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c22ee7-e0f1-4d96-bedb-559c91cd2f00", "name": "network-vif-plugged", "status": "completed", "tag": "2558a946-51d6-4f04-bcc7-302329aa7086"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:51.449901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f8000c89-2239-4762-afa4-61149fbc395c req-fb7e4a44-de91-46b8-9763-b39a7000f6bb service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:51.450362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f8000c89-2239-4762-afa4-61149fbc395c req-fb7e4a44-de91-46b8-9763-b39a7000f6bb service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:51.474677 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-f8000c89-2239-4762-afa4-61149fbc395c req-fb7e4a44-de91-46b8-9763-b39a7000f6bb service nova] Creating event network-vif-plugged:2558a946-51d6-4f04-bcc7-302329aa7086 for instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 on nch1-master-1 May 21 21:10:51.484125 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-f8000c89-2239-4762-afa4-61149fbc395c req-fb7e4a44-de91-46b8-9763-b39a7000f6bb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056784 May 21 21:10:51.485432 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 118/255] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:51.736397 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5e43a1bf-ab85-40b9-b722-8a84119daede tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.363065 May 21 21:10:51.736985 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 138/256] 10.222.0.49 () {60 vars in 1190 bytes} [Sat May 21 21:10:51 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:51.748648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d8f0732d-d9e7-4d1f-8ad2-f5cbf9419318 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:51.749732 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:51.749732 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:51.845404 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d8f0732d-d9e7-4d1f-8ad2-f5cbf9419318 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.101185 May 21 21:10:51.850045 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 119/257] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:10:51 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 21 21:10:51.865395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e1a0e16d-66fc-4818-9fc0-f395abbe0866 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-680875606"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:51.866785 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:51.866785 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:51.867660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.aggregate [None req-e1a0e16d-66fc-4818-9fc0-f395abbe0866 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Generated uuid c59f7284-f7ba-46be-b795-38425b17a63f for aggregate {{(pid=131277) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 21 21:10:51.966169 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e1a0e16d-66fc-4818-9fc0-f395abbe0866 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.110152 May 21 21:10:51.966959 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 139/258] 10.222.0.49 () {60 vars in 1163 bytes} [Sat May 21 21:10:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:51.980866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c5f9a49d-1077-4cd7-ad68-d271da4288a3 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:51.982122 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:51.982122 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:51.996429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5f9a49d-1077-4cd7-ad68-d271da4288a3 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:51.997027 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5f9a49d-1077-4cd7-ad68-d271da4288a3 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:52.276909 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5bf5efce-0a54-43e7-95ea-dd790abe9d33 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:52.277607 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c5f9a49d-1077-4cd7-ad68-d271da4288a3 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.300546 May 21 21:10:52.278311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5bf5efce-0a54-43e7-95ea-dd790abe9d33 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:52.278674 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 120/259] 10.222.0.49 () {60 vars in 1193 bytes} [Sat May 21 21:10:51 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:52.286903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5bf5efce-0a54-43e7-95ea-dd790abe9d33 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:52.287608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5bf5efce-0a54-43e7-95ea-dd790abe9d33 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:52.288416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5bf5efce-0a54-43e7-95ea-dd790abe9d33 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:52.288853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5bf5efce-0a54-43e7-95ea-dd790abe9d33 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:52.290714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-74d074d8-7367-4dfd-a8a4-ff29bbc2a3a5 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:52.291732 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:52.291732 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:52.299459 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-74d074d8-7367-4dfd-a8a4-ff29bbc2a3a5 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.014160 May 21 21:10:52.300103 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 121/260] 10.222.0.49 () {58 vars in 1142 bytes} [Sat May 21 21:10:52 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:10:52.310788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1ef77e87-186a-4bff-b5fd-98d7e6256889 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:52.312133 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:52.312133 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:52.322054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ef77e87-186a-4bff-b5fd-98d7e6256889 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:52.322509 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ef77e87-186a-4bff-b5fd-98d7e6256889 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:52.465273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5bf5efce-0a54-43e7-95ea-dd790abe9d33 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:52.473025 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5bf5efce-0a54-43e7-95ea-dd790abe9d33 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 200 len: 1391 microversion: 2.1 time: 0.200348 May 21 21:10:52.473600 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 140/261] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:52 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 1391 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:52.573637 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1ef77e87-186a-4bff-b5fd-98d7e6256889 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.266375 May 21 21:10:52.574266 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 122/262] 10.222.0.49 () {60 vars in 1193 bytes} [Sat May 21 21:10:52 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:52.585216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-01a3ee49-81c6-499c-bc40-2329add89805 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:52.586008 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:52.586008 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:52.701805 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-01a3ee49-81c6-499c-bc40-2329add89805 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.121222 May 21 21:10:52.702391 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 141/263] 10.222.0.49 () {58 vars in 1154 bytes} [Sat May 21 21:10:52 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 21 21:10:52.713103 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-40a91723-6a42-4941-b882-08141f7da7a3 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-338118478"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:52.714388 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:52.714388 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:52.717655 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.aggregate [None req-40a91723-6a42-4941-b882-08141f7da7a3 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Generated uuid 56124b9e-ca3f-4281-91f1-136eb94ad95f for aggregate {{(pid=131278) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 21 21:10:52.787080 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-40a91723-6a42-4941-b882-08141f7da7a3 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.077675 May 21 21:10:52.787994 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 123/264] 10.222.0.49 () {60 vars in 1163 bytes} [Sat May 21 21:10:52 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:52.798928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e47e6473-2ab6-4d48-8afc-7aab0189d1c2 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:52.801566 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:52.801566 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:52.806023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:52.811936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e47e6473-2ab6-4d48-8afc-7aab0189d1c2 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:52.812420 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e47e6473-2ab6-4d48-8afc-7aab0189d1c2 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:53.087301 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e47e6473-2ab6-4d48-8afc-7aab0189d1c2 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.293216 May 21 21:10:53.089180 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 142/265] 10.222.0.49 () {60 vars in 1193 bytes} [Sat May 21 21:10:52 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:53.107618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b9af31aa-6d56-46cc-beff-5605d1e4eee2 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:53.107618 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:53.107618 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:53.119529 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9af31aa-6d56-46cc-beff-5605d1e4eee2 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:53.120063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9af31aa-6d56-46cc-beff-5605d1e4eee2 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:53.492202 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-af212abb-4c3d-47cd-b846-08e9136d6579 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:53.494058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-af212abb-4c3d-47cd-b846-08e9136d6579 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:53.497014 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b9af31aa-6d56-46cc-beff-5605d1e4eee2 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.401954 May 21 21:10:53.497939 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 124/266] 10.222.0.49 () {60 vars in 1193 bytes} [Sat May 21 21:10:53 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:53.502577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af212abb-4c3d-47cd-b846-08e9136d6579 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:53.503386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af212abb-4c3d-47cd-b846-08e9136d6579 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:53.504557 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af212abb-4c3d-47cd-b846-08e9136d6579 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:53.505270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af212abb-4c3d-47cd-b846-08e9136d6579 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:53.510076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e282aa37-2fd2-48af-8374-0995c9a54949 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:53.511011 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:53.511011 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:53.586487 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e282aa37-2fd2-48af-8374-0995c9a54949 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.082183 May 21 21:10:53.587124 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 125/267] 10.222.0.49 () {58 vars in 1154 bytes} [Sat May 21 21:10:53 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 21 21:10:53.597701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c3d412a3-e94b-4031-9f10-9280bf66097d tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1015694319"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:53.599610 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:53.599610 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:53.600380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.aggregate [None req-c3d412a3-e94b-4031-9f10-9280bf66097d tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Generated uuid b20bb267-8caa-4cad-ad25-1985ea7262f4 for aggregate {{(pid=131278) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 21 21:10:53.686203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-af212abb-4c3d-47cd-b846-08e9136d6579 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:53.694873 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-af212abb-4c3d-47cd-b846-08e9136d6579 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 200 len: 1391 microversion: 2.1 time: 0.207976 May 21 21:10:53.705385 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c3d412a3-e94b-4031-9f10-9280bf66097d tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.103547 May 21 21:10:53.705385 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 126/268] 10.222.0.49 () {60 vars in 1163 bytes} [Sat May 21 21:10:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:53.705385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-039bdf66-f49d-4c9f-bfe2-9e5de69a4097 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1301391734"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:53.707950 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 143/269] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:53 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 1391 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:53.708856 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:53.708856 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:53.711475 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.aggregate [None req-039bdf66-f49d-4c9f-bfe2-9e5de69a4097 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Generated uuid d1f96b2f-7d84-4ba8-86eb-72203e642882 for aggregate {{(pid=131278) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 21 21:10:53.730602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d82bbe8d-25e6-431c-a471-d33780a3da75 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:53.734553 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:53.734553 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:53.829197 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-039bdf66-f49d-4c9f-bfe2-9e5de69a4097 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.129046 May 21 21:10:53.830141 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 127/270] 10.222.0.49 () {60 vars in 1163 bytes} [Sat May 21 21:10:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:53.839950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-71ff22d1-9ac2-48e9-a5c0-a9f24945828d tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:53.841209 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:53.841209 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:53.850054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71ff22d1-9ac2-48e9-a5c0-a9f24945828d tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:53.850512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71ff22d1-9ac2-48e9-a5c0-a9f24945828d tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:53.861345 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d82bbe8d-25e6-431c-a471-d33780a3da75 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.147087 May 21 21:10:53.862581 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 144/271] 10.222.0.49 () {58 vars in 1154 bytes} [Sat May 21 21:10:53 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 21 21:10:53.871494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-61b1d6cb-cc1c-458b-af37-850f0f687bb0 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:53.872497 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:53.872497 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:53.878895 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-61b1d6cb-cc1c-458b-af37-850f0f687bb0 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] HTTP exception thrown: Aggregate 12 could not be found. May 21 21:10:53.880759 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-61b1d6cb-cc1c-458b-af37-850f0f687bb0 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Request method failure captured: May 21 21:10:53.880759 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 May 21 21:10:53.880759 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:53.880759 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:53.880759 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:53.880759 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:10:53.880759 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:53.880759 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:53.880759 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:53.880759 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:53.880759 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVUt5msxNa1F8EM7c_zaifmZzWkZGKeD8-JgQDTHw6-Et6BRBWVovQMYZ2u7r_hBMZG_lPwPeu3vXTdUnOSbv_W7fypfdQwIO0LJ1ZxDMkXYYUISpXGSTqEd_FF_2-ENLKgX3IYbNPuBJ_BpLCQ86ay8POBeXAQPduP8TwRwxmBD7lE May 21 21:10:53.880759 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:53.880759 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:53.880759 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:53.880759 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:53.880759 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:53.880759 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:53.880759 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 19c062cb358f469287fd2926d5b63f00 May 21 21:10:53.880759 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AggregatesAdminTestJSON-1717385471 May 21 21:10:53.880759 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:10:53.880759 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:10:53.882338 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/19c062cb358f469287fd2926d5b63f00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19c062cb358f469287fd2926d5b63f00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_19c062cb358f469287fd2926d5b63f00", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19c062cb358f469287fd2926d5b63f00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:53.882338 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AggregatesAdminTestJSON-1717385471 May 21 21:10:53.882338 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 19c062cb358f469287fd2926d5b63f00 May 21 21:10:53.882338 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1717385471 May 21 21:10:53.882338 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AggregatesAdminTestJSON-1717385471-project-admin May 21 21:10:53.882338 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:53.882338 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:53.882338 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a02615d8cc104224a3bdb1557948ce1d May 21 21:10:53.882338 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AggregatesAdminTestJSON-1717385471-project-admin May 21 21:10:53.882338 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:10:53.882338 ncdv-master-1 devstack@n-api.service[131277]: exception: Aggregate 12 could not be found. May 21 21:10:53.882338 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '12'} May 21 21:10:53.882338 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:53.883262 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:53.883262 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 21 21:10:53.883262 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 21 21:10:53.883262 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate May 21 21:10:53.883262 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 21 21:10:53.883262 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:10:53.883262 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:10:53.883262 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 21 21:10:53.883262 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 21 21:10:53.883262 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:10:53.883262 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:10:53.883262 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 21 21:10:53.883262 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 21 21:10:53.883262 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. May 21 21:10:53.883262 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:53.883262 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:53.883262 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:53.883262 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:53.883262 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:53.884473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:53.884473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:53.884473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:53.884473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:53.884473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:53.884473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 21 21:10:53.884473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:10:53.884473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. May 21 21:10:53.884473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:53.884473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:53.884473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:53.884473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:53.884473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:53.884473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:53.884473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:53.884473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:53.884473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. May 21 21:10:53.884473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:53.887727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-61b1d6cb-cc1c-458b-af37-850f0f687bb0 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:53.887727 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-61b1d6cb-cc1c-458b-af37-850f0f687bb0 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.014705 May 21 21:10:53.887727 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 145/272] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:10:53 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:10:53.890340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aa5c5d10-08a3-4d8e-b183-d3780c052e03 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:53.891077 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:53.891077 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:53.902448 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-aa5c5d10-08a3-4d8e-b183-d3780c052e03 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] HTTP exception thrown: Aggregate 12 could not be found. May 21 21:10:53.904086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aa5c5d10-08a3-4d8e-b183-d3780c052e03 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Request method failure captured: May 21 21:10:53.904086 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 May 21 21:10:53.904086 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:53.904086 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:53.904086 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:53.904086 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:10:53.904086 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:53.904086 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:53.904086 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:53.904086 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:53.904086 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVUt5msxNa1F8EM7c_zaifmZzWkZGKeD8-JgQDTHw6-Et6BRBWVovQMYZ2u7r_hBMZG_lPwPeu3vXTdUnOSbv_W7fypfdQwIO0LJ1ZxDMkXYYUISpXGSTqEd_FF_2-ENLKgX3IYbNPuBJ_BpLCQ86ay8POBeXAQPduP8TwRwxmBD7lE May 21 21:10:53.904086 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:53.904086 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:53.904086 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:53.904086 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:53.904086 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:53.904086 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:53.904086 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 19c062cb358f469287fd2926d5b63f00 May 21 21:10:53.904086 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AggregatesAdminTestJSON-1717385471 May 21 21:10:53.904086 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:10:53.904086 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:10:53.905545 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/19c062cb358f469287fd2926d5b63f00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19c062cb358f469287fd2926d5b63f00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_19c062cb358f469287fd2926d5b63f00", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19c062cb358f469287fd2926d5b63f00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:53.905545 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AggregatesAdminTestJSON-1717385471 May 21 21:10:53.905545 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 19c062cb358f469287fd2926d5b63f00 May 21 21:10:53.905545 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1717385471 May 21 21:10:53.905545 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AggregatesAdminTestJSON-1717385471-project-admin May 21 21:10:53.905545 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:53.905545 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:53.905545 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a02615d8cc104224a3bdb1557948ce1d May 21 21:10:53.905545 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AggregatesAdminTestJSON-1717385471-project-admin May 21 21:10:53.905545 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:10:53.905545 ncdv-master-1 devstack@n-api.service[131277]: exception: Aggregate 12 could not be found. May 21 21:10:53.905545 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '12'} May 21 21:10:53.905545 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:53.906406 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:53.906406 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 21 21:10:53.906406 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 21 21:10:53.906406 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 21 21:10:53.906406 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 21 21:10:53.906406 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:53.906406 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:53.906406 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:53.906406 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:53.906406 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 21 21:10:53.906406 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 21 21:10:53.906406 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate May 21 21:10:53.906406 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 21 21:10:53.906406 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:10:53.906406 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:10:53.906406 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 21 21:10:53.906406 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 21 21:10:53.906406 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:10:53.906406 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:10:53.907773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 21 21:10:53.907773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 21 21:10:53.907773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. May 21 21:10:53.907773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:53.907773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:53.907773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:53.907773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:53.907773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:53.907773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:53.907773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:53.907773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:53.907773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:53.907773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:53.907773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 21 21:10:53.907773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:10:53.907773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. May 21 21:10:53.907773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:53.907773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:53.907773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:53.907773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:53.907773 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:53.909505 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:53.909505 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:53.909505 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:53.909505 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. May 21 21:10:53.909505 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:53.911051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aa5c5d10-08a3-4d8e-b183-d3780c052e03 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:53.911884 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aa5c5d10-08a3-4d8e-b183-d3780c052e03 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.024983 May 21 21:10:53.912634 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 146/273] 10.222.0.49 () {58 vars in 1154 bytes} [Sat May 21 21:10:53 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:10:53.921293 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-98294e8e-5469-4c1e-af8f-62aab3b7f3fe tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-754671340", "name": "tempest-test_aggregate-750931286"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:53.939458 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:53.939458 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:53.940548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.aggregate [None req-98294e8e-5469-4c1e-af8f-62aab3b7f3fe tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Generated uuid 9db823cd-045e-4a9e-84e7-350b3d6e8ebd for aggregate {{(pid=131277) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 21 21:10:54.081026 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-98294e8e-5469-4c1e-af8f-62aab3b7f3fe tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.163167 May 21 21:10:54.085935 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 147/274] 10.222.0.49 () {60 vars in 1164 bytes} [Sat May 21 21:10:53 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:54.169101 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-71ff22d1-9ac2-48e9-a5c0-a9f24945828d tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.332853 May 21 21:10:54.172681 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 128/275] 10.222.0.49 () {60 vars in 1193 bytes} [Sat May 21 21:10:53 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:10:54.174054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-89884f01-0c46-461a-b373-f25ae01a3769 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:54.174800 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:54.174800 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:54.306620 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-89884f01-0c46-461a-b373-f25ae01a3769 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.135831 May 21 21:10:54.307301 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 129/276] 10.222.0.49 () {58 vars in 1154 bytes} [Sat May 21 21:10:54 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 21 21:10:54.314095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cd95069d-eb02-441f-bea8-5ca9944c012f tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:54.315460 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:54.315460 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:54.316507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cd95069d-eb02-441f-bea8-5ca9944c012f tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'dc272ac8b07342829bcb11cfeb0646cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2926f5876ac4d439fb39c6d8baa1c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:54.319130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cd95069d-eb02-441f-bea8-5ca9944c012f tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Request method failure captured: May 21 21:10:54.319130 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 May 21 21:10:54.319130 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:54.319130 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:54.319130 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:54.319130 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 42 May 21 21:10:54.319130 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:54.319130 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:54.319130 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:54.319130 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:54.319130 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVUpvM8fezsHPo8FJ3g5sqfBFVfMmZv4yYLruMAfgdWJq7eufXBlWOrl9L_njcGFxgGrXtGG9z1QoUD9yIUsYQkiq0c7gSHaV1Ge_DLwc5RSKLDXZy0JmpCiJQyqZIdu5GrDxFyPjn1xUNjk5BUhoVQs5SbR6SgRw1Ix9YyRLPgFSag May 21 21:10:54.319130 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:54.319130 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:54.319130 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:54.319130 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:54.319130 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:54.319130 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:54.319130 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: e2926f5876ac4d439fb39c6d8baa1c8a May 21 21:10:54.319130 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1205282029 May 21 21:10:54.319130 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:10:54.319130 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:10:54.320479 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e2926f5876ac4d439fb39c6d8baa1c8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2926f5876ac4d439fb39c6d8baa1c8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e2926f5876ac4d439fb39c6d8baa1c8a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2926f5876ac4d439fb39c6d8baa1c8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:54.320479 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1205282029 May 21 21:10:54.320479 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: e2926f5876ac4d439fb39c6d8baa1c8a May 21 21:10:54.320479 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1205282029 May 21 21:10:54.320479 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-AggregatesAdminNegativeTestJSON-1205282029-project May 21 21:10:54.320479 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:54.320479 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:54.320479 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: dc272ac8b07342829bcb11cfeb0646cc May 21 21:10:54.320479 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1205282029-project May 21 21:10:54.320479 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:10:54.320479 ncdv-master-1 devstack@n-api.service[131278]: {"remove_host": {"host": "nch2-master-1"}} May 21 21:10:54.320479 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:10:54.320479 ncdv-master-1 devstack@n-api.service[131278]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 21 21:10:54.321348 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'nch2-master-1'}}} May 21 21:10:54.321348 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:54.321348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:54.321348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:54.321348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:54.321348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:54.321348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:54.321348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:54.321348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:54.321348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:10:54.321348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:10:54.321348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host May 21 21:10:54.321348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) May 21 21:10:54.321348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:10:54.321348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:10:54.321348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:10:54.321348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:10:54.321348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:54.321348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:54.322474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:54.322474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:54.322474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:10:54.322474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:10:54.322474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:10:54.322474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:10:54.322474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:10:54.322474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:10:54.322474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 21 21:10:54.322474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:54.322474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:54.322474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:54.322474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:54.322474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:54.322474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:54.322474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:10:54.322474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:10:54.322474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 21 21:10:54.322474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:54.323485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cd95069d-eb02-441f-bea8-5ca9944c012f tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:54.323485 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cd95069d-eb02-441f-bea8-5ca9944c012f tempest-AggregatesAdminNegativeTestJSON-1205282029 tempest-AggregatesAdminNegativeTestJSON-1205282029-project] 10.222.0.49 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.012615 May 21 21:10:54.323485 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 130/277] 10.222.0.49 () {60 vars in 1193 bytes} [Sat May 21 21:10:54 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:54.330581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9a831de3-86c4-4aa9-bf6f-84e4be545074 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:54.331330 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:54.331330 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:54.338312 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-9a831de3-86c4-4aa9-bf6f-84e4be545074 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] HTTP exception thrown: Aggregate 14 could not be found. May 21 21:10:54.342342 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9a831de3-86c4-4aa9-bf6f-84e4be545074 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Request method failure captured: May 21 21:10:54.342342 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 May 21 21:10:54.342342 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:54.342342 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:54.342342 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:54.342342 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:10:54.342342 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:54.342342 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:54.342342 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:54.342342 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:54.342342 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVUt5msxNa1F8EM7c_zaifmZzWkZGKeD8-JgQDTHw6-Et6BRBWVovQMYZ2u7r_hBMZG_lPwPeu3vXTdUnOSbv_W7fypfdQwIO0LJ1ZxDMkXYYUISpXGSTqEd_FF_2-ENLKgX3IYbNPuBJ_BpLCQ86ay8POBeXAQPduP8TwRwxmBD7lE May 21 21:10:54.342342 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:54.342342 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:54.342342 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:54.342342 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:54.342342 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:54.342342 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:54.342342 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 19c062cb358f469287fd2926d5b63f00 May 21 21:10:54.342342 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-AggregatesAdminTestJSON-1717385471 May 21 21:10:54.342342 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,admin,member May 21 21:10:54.342342 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,admin,member May 21 21:10:54.343798 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/19c062cb358f469287fd2926d5b63f00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19c062cb358f469287fd2926d5b63f00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_19c062cb358f469287fd2926d5b63f00", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19c062cb358f469287fd2926d5b63f00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:54.343798 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-AggregatesAdminTestJSON-1717385471 May 21 21:10:54.343798 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 19c062cb358f469287fd2926d5b63f00 May 21 21:10:54.343798 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1717385471 May 21 21:10:54.343798 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-AggregatesAdminTestJSON-1717385471-project-admin May 21 21:10:54.343798 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:54.343798 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:54.343798 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: a02615d8cc104224a3bdb1557948ce1d May 21 21:10:54.343798 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-AggregatesAdminTestJSON-1717385471-project-admin May 21 21:10:54.343798 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:10:54.343798 ncdv-master-1 devstack@n-api.service[131278]: exception: Aggregate 14 could not be found. May 21 21:10:54.343798 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '14'} May 21 21:10:54.343798 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:54.344820 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:54.344820 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 21 21:10:54.344820 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 21 21:10:54.344820 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate May 21 21:10:54.344820 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 21 21:10:54.344820 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:10:54.344820 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:10:54.344820 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 21 21:10:54.344820 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 21 21:10:54.344820 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:10:54.344820 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:10:54.344820 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 21 21:10:54.344820 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 21 21:10:54.344820 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. May 21 21:10:54.344820 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:54.344820 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:54.344820 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:54.344820 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:54.344820 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:54.345895 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:54.345895 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:54.345895 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:54.345895 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:54.345895 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:54.345895 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 21 21:10:54.345895 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:10:54.345895 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. May 21 21:10:54.345895 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:54.345895 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:54.345895 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:54.345895 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:54.345895 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:54.345895 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:54.345895 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:54.345895 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:54.345895 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. May 21 21:10:54.345895 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:54.346889 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9a831de3-86c4-4aa9-bf6f-84e4be545074 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:54.346889 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9a831de3-86c4-4aa9-bf6f-84e4be545074 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.022322 May 21 21:10:54.346889 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 131/278] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:10:54 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:10:54.350562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5756aed3-d0aa-4d93-8ef2-a09d81cc9346 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:54.359816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5756aed3-d0aa-4d93-8ef2-a09d81cc9346 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:54.360266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5756aed3-d0aa-4d93-8ef2-a09d81cc9346 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:54.440883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ce6db6a5-2c9a-4447-807c-8bacec4382f4 tempest-SecurityGroupsTestAdminJSON-553561558 tempest-SecurityGroupsTestAdminJSON-553561558-project] Action: 'create', calling method: .version_select at 0x7fc81bdf1b80>, body: {"security_group": {"name": "tempest-securitygroup-470233243", "description": "tempest-description-234020152"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:54.716024 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5756aed3-d0aa-4d93-8ef2-a09d81cc9346 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.369035 May 21 21:10:54.717221 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 132/279] 10.222.0.49 () {60 vars in 1193 bytes} [Sat May 21 21:10:54 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:54.722099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6840b3d3-a8c4-4eeb-b41d-3968fcc27293 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:54.724464 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:54.724464 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:54.745268 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-6840b3d3-a8c4-4eeb-b41d-3968fcc27293 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] HTTP exception thrown: Aggregate 14 could not be found. May 21 21:10:54.747975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6840b3d3-a8c4-4eeb-b41d-3968fcc27293 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Request method failure captured: May 21 21:10:54.747975 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 May 21 21:10:54.747975 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:54.747975 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:54.747975 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:54.747975 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:10:54.747975 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:54.747975 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:54.747975 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:54.747975 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:54.747975 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVUt5msxNa1F8EM7c_zaifmZzWkZGKeD8-JgQDTHw6-Et6BRBWVovQMYZ2u7r_hBMZG_lPwPeu3vXTdUnOSbv_W7fypfdQwIO0LJ1ZxDMkXYYUISpXGSTqEd_FF_2-ENLKgX3IYbNPuBJ_BpLCQ86ay8POBeXAQPduP8TwRwxmBD7lE May 21 21:10:54.747975 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:54.747975 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:54.747975 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:54.747975 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:54.747975 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:54.747975 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:54.747975 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 19c062cb358f469287fd2926d5b63f00 May 21 21:10:54.747975 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-AggregatesAdminTestJSON-1717385471 May 21 21:10:54.747975 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,admin,member May 21 21:10:54.747975 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,admin,member May 21 21:10:54.749305 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/19c062cb358f469287fd2926d5b63f00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19c062cb358f469287fd2926d5b63f00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_19c062cb358f469287fd2926d5b63f00", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19c062cb358f469287fd2926d5b63f00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:54.749305 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-AggregatesAdminTestJSON-1717385471 May 21 21:10:54.749305 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 19c062cb358f469287fd2926d5b63f00 May 21 21:10:54.749305 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1717385471 May 21 21:10:54.749305 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-AggregatesAdminTestJSON-1717385471-project-admin May 21 21:10:54.749305 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:54.749305 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:54.749305 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: a02615d8cc104224a3bdb1557948ce1d May 21 21:10:54.749305 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-AggregatesAdminTestJSON-1717385471-project-admin May 21 21:10:54.749305 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:10:54.749305 ncdv-master-1 devstack@n-api.service[131278]: exception: Aggregate 14 could not be found. May 21 21:10:54.749305 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '14'} May 21 21:10:54.749305 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:54.750018 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:54.750018 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 21 21:10:54.750018 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 21 21:10:54.750018 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 21 21:10:54.750018 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 21 21:10:54.750018 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:54.750018 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:54.750018 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:54.750018 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:54.750018 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 21 21:10:54.750018 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 21 21:10:54.750018 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate May 21 21:10:54.750018 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 21 21:10:54.750018 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:10:54.750018 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:10:54.750018 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 21 21:10:54.750018 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 21 21:10:54.750018 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:10:54.750018 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:10:54.751055 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 21 21:10:54.751055 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 21 21:10:54.751055 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. May 21 21:10:54.751055 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:54.751055 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:54.751055 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:54.751055 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:54.751055 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:54.751055 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:54.751055 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:54.751055 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:54.751055 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:54.751055 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:54.751055 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 21 21:10:54.751055 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:10:54.751055 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. May 21 21:10:54.751055 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:54.751055 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:54.751055 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:54.751055 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:54.751055 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:54.753613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:54.753613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:54.753613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:54.753613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. May 21 21:10:54.753613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:54.756385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6840b3d3-a8c4-4eeb-b41d-3968fcc27293 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:54.757674 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6840b3d3-a8c4-4eeb-b41d-3968fcc27293 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.039200 May 21 21:10:54.758801 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 133/280] 10.222.0.49 () {58 vars in 1154 bytes} [Sat May 21 21:10:54 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:10:54.770393 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1178f71a-455b-4b08-9243-259118f69872 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:54.770393 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1178f71a-455b-4b08-9243-259118f69872 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:54.775765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1178f71a-455b-4b08-9243-259118f69872 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:54.776224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1178f71a-455b-4b08-9243-259118f69872 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:54.777477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1178f71a-455b-4b08-9243-259118f69872 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:54.778058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1178f71a-455b-4b08-9243-259118f69872 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.086348 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1178f71a-455b-4b08-9243-259118f69872 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:55.094178 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1178f71a-455b-4b08-9243-259118f69872 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 200 len: 1591 microversion: 2.1 time: 0.334084 May 21 21:10:55.094757 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 134/281] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:54 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 1591 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:55.099179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9441e35f-e92f-4d03-a65e-7a49fb714169 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:55.099938 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:55.099938 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:55.120351 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:55.139428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:55.231061 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9441e35f-e92f-4d03-a65e-7a49fb714169 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.135222 May 21 21:10:55.231287 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ce6db6a5-2c9a-4447-807c-8bacec4382f4 tempest-SecurityGroupsTestAdminJSON-553561558 tempest-SecurityGroupsTestAdminJSON-553561558-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.148309 May 21 21:10:55.231758 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 135/282] 10.222.0.49 () {58 vars in 1154 bytes} [Sat May 21 21:10:55 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 21 21:10:55.232930 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 148/283] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:10:54 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:55.236267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ea4e3e8f-cc61-4b47-962a-df3310b8d3e9 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-317879190"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:55.237759 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:55.237759 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:55.239432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.aggregate [None req-ea4e3e8f-cc61-4b47-962a-df3310b8d3e9 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Generated uuid 1afe8911-f609-4ae5-9163-fad223690b4a for aggregate {{(pid=131278) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 21 21:10:55.245101 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=12,nova_api:INSERT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:55.339789 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ea4e3e8f-cc61-4b47-962a-df3310b8d3e9 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.107109 May 21 21:10:55.341037 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 136/284] 10.222.0.49 () {60 vars in 1163 bytes} [Sat May 21 21:10:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:55.353913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-be0c5fe0-ad4c-43b9-ad1f-8b0f4f4fe5fc tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Calling method '.version_select at 0x7fc81bdf1040>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:55.360493 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:55.360493 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:55.361809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be0c5fe0-ad4c-43b9-ad1f-8b0f4f4fe5fc tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:55.364075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be0c5fe0-ad4c-43b9-ad1f-8b0f4f4fe5fc tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.381189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be0c5fe0-ad4c-43b9-ad1f-8b0f4f4fe5fc tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:55.381925 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be0c5fe0-ad4c-43b9-ad1f-8b0f4f4fe5fc tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.406707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be0c5fe0-ad4c-43b9-ad1f-8b0f4f4fe5fc tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:55.407429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be0c5fe0-ad4c-43b9-ad1f-8b0f4f4fe5fc tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.408839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-60481a2d-d805-41dd-8387-47c4a83edaf8 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Calling method '.version_select at 0x7fc81be0e670>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:55.409815 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:55.409815 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:55.411590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-60481a2d-d805-41dd-8387-47c4a83edaf8 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:55.412066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-60481a2d-d805-41dd-8387-47c4a83edaf8 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.418682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be0c5fe0-ad4c-43b9-ad1f-8b0f4f4fe5fc tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:55.419134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be0c5fe0-ad4c-43b9-ad1f-8b0f4f4fe5fc tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.427616 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-60481a2d-d805-41dd-8387-47c4a83edaf8 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:55.428074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-60481a2d-d805-41dd-8387-47c4a83edaf8 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.438487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-60481a2d-d805-41dd-8387-47c4a83edaf8 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:55.438941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-60481a2d-d805-41dd-8387-47c4a83edaf8 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.440885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be0c5fe0-ad4c-43b9-ad1f-8b0f4f4fe5fc tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:55.441929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be0c5fe0-ad4c-43b9-ad1f-8b0f4f4fe5fc tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.445845 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-60481a2d-d805-41dd-8387-47c4a83edaf8 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.103262 May 21 21:10:55.451428 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 137/285] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:55 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:55.451565 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-be0c5fe0-ad4c-43b9-ad1f-8b0f4f4fe5fc tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1664 microversion: 2.53 time: 0.214202 May 21 21:10:55.451565 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 149/286] 10.222.0.49 () {60 vars in 1242 bytes} [Sat May 21 21:10:55 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1664 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:10:55.451705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-075bcac4-6872-4134-805d-aae794f5db44 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:55.452058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-075bcac4-6872-4134-805d-aae794f5db44 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:55.458997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-075bcac4-6872-4134-805d-aae794f5db44 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:55.459445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-075bcac4-6872-4134-805d-aae794f5db44 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.460224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-075bcac4-6872-4134-805d-aae794f5db44 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:55.460695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-075bcac4-6872-4134-805d-aae794f5db44 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.469494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f887973f-c77d-4e9f-8718-af34c51e1382 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1844693576"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:55.470934 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:55.470934 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:55.471834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.aggregate [None req-f887973f-c77d-4e9f-8718-af34c51e1382 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Generated uuid 2abda461-381d-46ab-a1e3-285b6cde4716 for aggregate {{(pid=131277) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 21 21:10:55.548832 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-075bcac4-6872-4134-805d-aae794f5db44 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100938 May 21 21:10:55.549445 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 138/287] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 21:10:55 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:55.554603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-82bfbeeb-425b-4565-987e-e31535938e5a tempest-SecurityGroupsTestAdminJSON-553561558 tempest-SecurityGroupsTestAdminJSON-553561558-project] Action: 'create', calling method: .version_select at 0x7fc81bd7d3a0>, body: {"security_group": {"name": "tempest-securitygroup-1180211685", "description": "tempest-description-1400142952"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:55.596972 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f887973f-c77d-4e9f-8718-af34c51e1382 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.146725 May 21 21:10:55.597614 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 150/288] 10.222.0.49 () {60 vars in 1163 bytes} [Sat May 21 21:10:55 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:55.606787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9bc6ee68-d1b3-4cad-921b-f4abadf8b48a tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Calling method '.version_select at 0x7fc81be5b700>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:55.607973 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:55.607973 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:55.609184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9bc6ee68-d1b3-4cad-921b-f4abadf8b48a tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:55.609632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9bc6ee68-d1b3-4cad-921b-f4abadf8b48a tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.610445 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9bc6ee68-d1b3-4cad-921b-f4abadf8b48a tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:55.610880 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9bc6ee68-d1b3-4cad-921b-f4abadf8b48a tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.635848 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9bc6ee68-d1b3-4cad-921b-f4abadf8b48a tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.037098 May 21 21:10:55.636572 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 151/289] 10.222.0.49 () {58 vars in 1127 bytes} [Sat May 21 21:10:55 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:55.641593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-63fc3da9-a682-4a7c-acab-2eb4b604824f tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:55.642371 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:55.642371 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:55.650393 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-63fc3da9-a682-4a7c-acab-2eb4b604824f tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 227 microversion: 2.1 time: 0.012754 May 21 21:10:55.650969 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 152/290] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:10:55 2022] GET /compute/v2.1/os-aggregates/15 => generated 227 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:55.757927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-029b3eac-6c9b-4a6b-9dbf-dc399fda2467 tempest-HypervisorAdminNegativeUnderV252Test-2140486129 tempest-HypervisorAdminNegativeUnderV252Test-2140486129-project] Calling method '.version_select at 0x7fc81bdf1b80>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:55.758820 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:55.758820 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:55.759944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-029b3eac-6c9b-4a6b-9dbf-dc399fda2467 tempest-HypervisorAdminNegativeUnderV252Test-2140486129 tempest-HypervisorAdminNegativeUnderV252Test-2140486129-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '4d4c4b27f5124363a63ab11476e85770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33309142b34423d9bfd24c435954d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:55.762635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-029b3eac-6c9b-4a6b-9dbf-dc399fda2467 tempest-HypervisorAdminNegativeUnderV252Test-2140486129 tempest-HypervisorAdminNegativeUnderV252Test-2140486129-project] Request method failure captured: May 21 21:10:55.762635 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/os-hypervisors/nch2-master-1/search HTTP/1.1 May 21 21:10:55.762635 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:55.762635 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:55.762635 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:55.762635 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:10:55.762635 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:55.762635 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:55.762635 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:55.762635 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:55.762635 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVVdyXyRZf6yUVDbEs77SPljaS9_RbBW65DhDtQttU7gdQQDvbz34wpAurkb25MdCiEyH-MLvKOqEMpGYmYK6TwlJ-rZ9CLvgD4UU9FAdMwv8jTccTkLrlVb-r2KwbCKQh-yGKpmfPt0sFvjuQ-Z8itR2-GODINK_a6Oix80_UxVmQ4 May 21 21:10:55.762635 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:55.762635 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:55.762635 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:55.762635 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:55.762635 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:55.762635 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:55.762635 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: d33309142b34423d9bfd24c435954d75 May 21 21:10:55.762635 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2140486129 May 21 21:10:55.762635 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:10:55.762635 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:10:55.763856 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d33309142b34423d9bfd24c435954d75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d33309142b34423d9bfd24c435954d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d33309142b34423d9bfd24c435954d75", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d33309142b34423d9bfd24c435954d75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:55.763856 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2140486129 May 21 21:10:55.763856 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: d33309142b34423d9bfd24c435954d75 May 21 21:10:55.763856 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2140486129 May 21 21:10:55.763856 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2140486129-project May 21 21:10:55.763856 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:55.763856 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:55.763856 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 4d4c4b27f5124363a63ab11476e85770 May 21 21:10:55.763856 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2140486129-project May 21 21:10:55.763856 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:10:55.763856 ncdv-master-1 devstack@n-api.service[131277]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 21 21:10:55.763856 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'nch2-master-1'} May 21 21:10:55.764576 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:55.764576 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:55.764576 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:55.764576 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:55.764576 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:55.764576 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:55.764576 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:10:55.764576 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:10:55.764576 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:55.764576 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:55.764576 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search May 21 21:10:55.764576 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) May 21 21:10:55.764576 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:10:55.764576 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:10:55.764576 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:10:55.764576 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:10:55.764576 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:55.764576 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:55.764576 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:55.766064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:55.766064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:10:55.766064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:10:55.766064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:10:55.766064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:10:55.766064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:10:55.766064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:10:55.766064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 21 21:10:55.766064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:55.766064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:55.766064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:55.766064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:55.766064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:55.766064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:55.766064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:10:55.766064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:10:55.766064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 21 21:10:55.766064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:55.767697 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-029b3eac-6c9b-4a6b-9dbf-dc399fda2467 tempest-HypervisorAdminNegativeUnderV252Test-2140486129 tempest-HypervisorAdminNegativeUnderV252Test-2140486129-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:55.767697 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-029b3eac-6c9b-4a6b-9dbf-dc399fda2467 tempest-HypervisorAdminNegativeUnderV252Test-2140486129 tempest-HypervisorAdminNegativeUnderV252Test-2140486129-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.112155 May 21 21:10:55.767697 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 153/291] 10.222.0.49 () {58 vars in 1208 bytes} [Sat May 21 21:10:55 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 117 bytes in 113 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:55.772157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5b544bcc-cc35-4f9a-a90b-79b8e2e78fc6 tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Calling method '.version_select at 0x7fc81bda9ee0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:55.774705 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:55.774705 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:55.776430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b544bcc-cc35-4f9a-a90b-79b8e2e78fc6 tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:55.776894 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b544bcc-cc35-4f9a-a90b-79b8e2e78fc6 tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.792626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b544bcc-cc35-4f9a-a90b-79b8e2e78fc6 tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:55.793211 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b544bcc-cc35-4f9a-a90b-79b8e2e78fc6 tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.807151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b544bcc-cc35-4f9a-a90b-79b8e2e78fc6 tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:55.807601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b544bcc-cc35-4f9a-a90b-79b8e2e78fc6 tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.822897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b544bcc-cc35-4f9a-a90b-79b8e2e78fc6 tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:55.823347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b544bcc-cc35-4f9a-a90b-79b8e2e78fc6 tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.847847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b544bcc-cc35-4f9a-a90b-79b8e2e78fc6 tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:55.848612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b544bcc-cc35-4f9a-a90b-79b8e2e78fc6 tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.856975 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5b544bcc-cc35-4f9a-a90b-79b8e2e78fc6 tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 357 microversion: 2.53 time: 0.090286 May 21 21:10:55.862439 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 154/292] 10.222.0.49 () {60 vars in 1221 bytes} [Sat May 21 21:10:55 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 357 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:55.868762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6cc20a2c-b3f6-4137-bb77-353b58a0cdc4 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:55.870033 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:55.870033 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:55.879864 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6cc20a2c-b3f6-4137-bb77-353b58a0cdc4 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:55.880547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6cc20a2c-b3f6-4137-bb77-353b58a0cdc4 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.886091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6cc20a2c-b3f6-4137-bb77-353b58a0cdc4 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:55.886754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6cc20a2c-b3f6-4137-bb77-353b58a0cdc4 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.894055 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.compute.aggregates [None req-6cc20a2c-b3f6-4137-bb77-353b58a0cdc4 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. May 21 21:10:55.894989 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-6cc20a2c-b3f6-4137-bb77-353b58a0cdc4 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 May 21 21:10:55.897266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6cc20a2c-b3f6-4137-bb77-353b58a0cdc4 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Request method failure captured: May 21 21:10:55.897266 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 May 21 21:10:55.897266 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:55.897266 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:55.897266 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:55.897266 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 42 May 21 21:10:55.897266 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:55.897266 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:55.897266 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:55.897266 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:55.897266 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVUtXoSJ6VszP1U-oSZcLfMM7HYXvJXhpF39QKode8HEZSIad3dvZNMVnM7NipekWfPeDS9X_y3nSjfA8qN7aKQpw7-9HSQWUXK9vEl3R8enRfwRO-p9lsbngVLl9EqL39DiWOhS9LQQ2lhmdaY4N0lVaBWLUuunh7nFRPyKyzFxNy0 May 21 21:10:55.897266 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:55.897266 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:55.897266 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:55.897266 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:55.897266 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:55.897266 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:55.897266 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 194a569eab164ba1b3752b2830e8f92e May 21 21:10:55.897266 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:55.897266 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:10:55.897266 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:10:55.898596 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_194a569eab164ba1b3752b2830e8f92e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/194a569eab164ba1b3752b2830e8f92e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:55.898596 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:55.898596 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 194a569eab164ba1b3752b2830e8f92e May 21 21:10:55.898596 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-591146729 May 21 21:10:55.898596 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin May 21 21:10:55.898596 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:55.898596 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:55.898596 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 1004a63485ce499499be9b3a3f2c1380 May 21 21:10:55.898596 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin May 21 21:10:55.898596 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:10:55.898596 ncdv-master-1 devstack@n-api.service[131277]: {"remove_host": {"host": "nonexist_host"}} May 21 21:10:55.898596 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:10:55.898596 ncdv-master-1 devstack@n-api.service[131277]: exception: Cannot remove host nonexist_host in aggregate 16 May 21 21:10:55.899307 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} May 21 21:10:55.899307 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:55.899307 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:55.899307 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host May 21 21:10:55.899307 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 21 21:10:55.899307 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:10:55.899307 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:10:55.899307 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 21 21:10:55.899307 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 21 21:10:55.899307 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:10:55.899307 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:10:55.899307 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 21 21:10:55.899307 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 21 21:10:55.899307 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell May 21 21:10:55.899307 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:55.899307 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:55.899307 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:55.899307 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:55.899307 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host May 21 21:10:55.899307 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) May 21 21:10:55.905072 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 21 21:10:55.905072 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 21 21:10:55.905072 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 21 21:10:55.905072 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:55.905072 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:55.905072 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:55.905072 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:55.905072 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host May 21 21:10:55.905072 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) May 21 21:10:55.905072 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 21 21:10:55.905072 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 21 21:10:55.905072 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:55.905072 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:55.905072 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:55.905072 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:55.905072 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 21 21:10:55.905072 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 21 21:10:55.905072 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate May 21 21:10:55.905072 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) May 21 21:10:55.905072 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host May 21 21:10:55.907867 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) May 21 21:10:55.907867 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. May 21 21:10:55.907867 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:55.907867 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:55.907867 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:55.907867 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:55.907867 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:55.907867 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:55.907867 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:55.907867 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:55.907867 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:55.907867 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:55.907867 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:10:55.907867 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:10:55.907867 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host May 21 21:10:55.907867 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 21 21:10:55.907867 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 May 21 21:10:55.907867 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:55.907867 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:55.907867 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:55.907867 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:55.910857 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:55.910857 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:55.910857 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:55.910857 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:55.910857 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 May 21 21:10:55.910857 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:55.910857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6cc20a2c-b3f6-4137-bb77-353b58a0cdc4 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:55.910857 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6cc20a2c-b3f6-4137-bb77-353b58a0cdc4 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.036551 May 21 21:10:55.910857 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 155/293] 10.222.0.49 () {60 vars in 1193 bytes} [Sat May 21 21:10:55 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:10:55.910857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-964e620d-682b-4370-a391-9bb7ddf6315b tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Calling method '.version_select at 0x7fc81bda9280>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:55.912386 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:55.912386 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:55.912386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-964e620d-682b-4370-a391-9bb7ddf6315b tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:55.912386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-964e620d-682b-4370-a391-9bb7ddf6315b tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.912386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-964e620d-682b-4370-a391-9bb7ddf6315b tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:55.913158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-964e620d-682b-4370-a391-9bb7ddf6315b tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:55.935888 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-964e620d-682b-4370-a391-9bb7ddf6315b tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.034153 May 21 21:10:55.936528 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 156/294] 10.222.0.49 () {58 vars in 1154 bytes} [Sat May 21 21:10:55 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:55.941095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3a937ed7-2c92-4f7d-a768-38a972431c4d tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:55.943428 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:55.943428 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:56.029460 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3a937ed7-2c92-4f7d-a768-38a972431c4d tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 265 microversion: 2.1 time: 0.091624 May 21 21:10:56.030592 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 157/295] 10.222.0.49 () {60 vars in 1193 bytes} [Sat May 21 21:10:55 2022] POST /compute/v2.1/os-aggregates/15/action => generated 265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:56.037250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3d279b34-36fe-44eb-8c77-93c01d0c8207 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Calling method '.version_select at 0x7fc81bdcc9d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:56.038085 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:56.038085 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:56.039245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d279b34-36fe-44eb-8c77-93c01d0c8207 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:56.039721 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d279b34-36fe-44eb-8c77-93c01d0c8207 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:56.053284 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-3d279b34-36fe-44eb-8c77-93c01d0c8207 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 21 21:10:56.056865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3d279b34-36fe-44eb-8c77-93c01d0c8207 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Request method failure captured: May 21 21:10:56.056865 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 May 21 21:10:56.056865 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:56.056865 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:56.056865 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:56.056865 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:10:56.056865 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:56.056865 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:56.056865 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:56.056865 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:56.056865 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVVeyXMDDhBx7ErkHOmU_nruTvc16AlpFMHJus47EJCg0XTL_cWMbSSt7RT97ktfVgMmsQMVRbVlW8zjRZmOMNtUYDGsT77XVcyTWxGDTgEF83sV16thKeA0lPkLV01WTTy1IY9nNC13jECm3scCbYilsMybYW92eRsdyrCtnL1gRqs May 21 21:10:56.056865 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:56.056865 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:56.056865 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:56.056865 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:56.056865 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:56.056865 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:56.056865 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: d818237b515c4baba0f1cbdbf5dbeb99 May 21 21:10:56.056865 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1065137831 May 21 21:10:56.056865 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:10:56.056865 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:10:56.059194 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d818237b515c4baba0f1cbdbf5dbeb99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d818237b515c4baba0f1cbdbf5dbeb99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d818237b515c4baba0f1cbdbf5dbeb99", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d818237b515c4baba0f1cbdbf5dbeb99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:56.059194 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1065137831 May 21 21:10:56.059194 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: d818237b515c4baba0f1cbdbf5dbeb99 May 21 21:10:56.059194 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1065137831 May 21 21:10:56.059194 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin May 21 21:10:56.059194 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:56.059194 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:56.059194 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a074391daf9b47cd8920000563a3cba0 May 21 21:10:56.059194 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin May 21 21:10:56.059194 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:10:56.059194 ncdv-master-1 devstack@n-api.service[131277]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 21 21:10:56.059194 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'nonexistent_hypervisor_name'} May 21 21:10:56.060022 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:56.060022 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:56.060022 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:56.060022 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:56.060022 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:56.060022 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:56.060022 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:10:56.060022 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:10:56.060022 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:56.060022 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:56.060022 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search May 21 21:10:56.060022 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) May 21 21:10:56.060022 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern May 21 21:10:56.060022 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 21 21:10:56.060022 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 21 21:10:56.060022 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:56.060022 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:56.060022 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:56.060022 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:56.060022 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:56.061371 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:56.061371 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:56.061371 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:56.061371 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 21 21:10:56.061371 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:56.061371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3d279b34-36fe-44eb-8c77-93c01d0c8207 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:56.063463 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3d279b34-36fe-44eb-8c77-93c01d0c8207 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.027216 May 21 21:10:56.064464 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 158/296] 10.222.0.49 () {58 vars in 1250 bytes} [Sat May 21 21:10:56 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:56.072799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5b6636f5-1db0-4478-9c49-fbcbca3a3039 tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Calling method '.version_select at 0x7fc8280ed280>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:56.073756 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:56.073756 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:56.077548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b6636f5-1db0-4478-9c49-fbcbca3a3039 tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:56.077548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b6636f5-1db0-4478-9c49-fbcbca3a3039 tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:56.093182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b6636f5-1db0-4478-9c49-fbcbca3a3039 tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:56.093638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b6636f5-1db0-4478-9c49-fbcbca3a3039 tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:56.107344 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5b6636f5-1db0-4478-9c49-fbcbca3a3039 tempest-HypervisorAdminV253TestBase-675221793 tempest-HypervisorAdminV253TestBase-675221793-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/78494baf-98dc-4e74-bb7b-20dec173c142" status: 200 len: 791 microversion: 2.53 time: 0.039570 May 21 21:10:56.108310 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 159/297] 10.222.0.49 () {60 vars in 1297 bytes} [Sat May 21 21:10:56 2022] GET /compute/v2.1/os-hypervisors/78494baf-98dc-4e74-bb7b-20dec173c142 => generated 791 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:10:56.130920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-eb73fb09-601f-45f0-ba77-a6014cb7d6e4 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:56.133328 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:56.133328 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:56.303436 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-eb73fb09-601f-45f0-ba77-a6014cb7d6e4 tempest-AggregatesAdminNegativeTestJSON-591146729 tempest-AggregatesAdminNegativeTestJSON-591146729-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.192435 May 21 21:10:56.305079 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 160/298] 10.222.0.49 () {58 vars in 1154 bytes} [Sat May 21 21:10:56 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 21 21:10:56.330060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9dd00f84-33a0-42cf-874b-17435399620d tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Calling method '.version_select at 0x7fc81bddaee0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:56.334441 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:56.334441 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:56.336182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9dd00f84-33a0-42cf-874b-17435399620d tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:56.336823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9dd00f84-33a0-42cf-874b-17435399620d tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:56.338103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9dd00f84-33a0-42cf-874b-17435399620d tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:56.338545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9dd00f84-33a0-42cf-874b-17435399620d tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:56.371204 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9dd00f84-33a0-42cf-874b-17435399620d tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.064240 May 21 21:10:56.372147 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 161/299] 10.222.0.49 () {58 vars in 1127 bytes} [Sat May 21 21:10:56 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:56.377560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0c7832b2-6b9e-4d71-ac71-648dd4ecf8d1 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:56.378634 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:56.378634 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:56.391954 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0c7832b2-6b9e-4d71-ac71-648dd4ecf8d1 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 241 microversion: 2.1 time: 0.017822 May 21 21:10:56.395935 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 162/300] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:10:56 2022] GET /compute/v2.1/os-aggregates/15 => generated 241 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:56.404050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-48b86ace-b554-4348-8fd1-cece2dd02a8c tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Calling method '.version_select at 0x7fc81bd72040>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:56.404928 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:56.404928 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:56.406813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48b86ace-b554-4348-8fd1-cece2dd02a8c tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:56.407532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48b86ace-b554-4348-8fd1-cece2dd02a8c tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:56.426416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48b86ace-b554-4348-8fd1-cece2dd02a8c tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:56.427178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48b86ace-b554-4348-8fd1-cece2dd02a8c tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:56.439556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48b86ace-b554-4348-8fd1-cece2dd02a8c tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:56.440149 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48b86ace-b554-4348-8fd1-cece2dd02a8c tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:56.447582 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-48b86ace-b554-4348-8fd1-cece2dd02a8c tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.050491 May 21 21:10:56.453215 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 163/301] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:10:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:56.453215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8ee78517-1787-4fe1-bb4d-84e40776a9f8 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Calling method '.version_select at 0x7fc81bda9550>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:56.454180 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:56.454180 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:56.462134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ee78517-1787-4fe1-bb4d-84e40776a9f8 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:56.462793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ee78517-1787-4fe1-bb4d-84e40776a9f8 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:56.477342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ee78517-1787-4fe1-bb4d-84e40776a9f8 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:56.477794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ee78517-1787-4fe1-bb4d-84e40776a9f8 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:56.486545 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8ee78517-1787-4fe1-bb4d-84e40776a9f8 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 332 microversion: 2.1 time: 0.036967 May 21 21:10:56.487225 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 164/302] 10.222.0.49 () {58 vars in 1169 bytes} [Sat May 21 21:10:56 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 332 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:56.495865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-80956c73-d447-4751-b225-30e800492401 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:56.496649 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:56.496649 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:56.624525 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-80956c73-d447-4751-b225-30e800492401 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.131938 May 21 21:10:56.625270 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 165/303] 10.222.0.49 () {58 vars in 1154 bytes} [Sat May 21 21:10:56 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 21 21:10:56.635773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a4b02e38-77cf-4c59-8447-6b3ba14ed9ce tempest-HypervisorAdminNegativeUnderV252Test-2140486129 tempest-HypervisorAdminNegativeUnderV252Test-2140486129-project] Calling method '.version_select at 0x7fc81bd729d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:56.636833 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:56.636833 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:56.638095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a4b02e38-77cf-4c59-8447-6b3ba14ed9ce tempest-HypervisorAdminNegativeUnderV252Test-2140486129 tempest-HypervisorAdminNegativeUnderV252Test-2140486129-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '4d4c4b27f5124363a63ab11476e85770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33309142b34423d9bfd24c435954d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:56.639996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a4b02e38-77cf-4c59-8447-6b3ba14ed9ce tempest-HypervisorAdminNegativeUnderV252Test-2140486129 tempest-HypervisorAdminNegativeUnderV252Test-2140486129-project] Request method failure captured: May 21 21:10:56.639996 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 May 21 21:10:56.639996 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:56.639996 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:56.639996 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:56.639996 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:10:56.639996 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:56.639996 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:56.639996 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:56.639996 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:56.639996 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVVdyXyRZf6yUVDbEs77SPljaS9_RbBW65DhDtQttU7gdQQDvbz34wpAurkb25MdCiEyH-MLvKOqEMpGYmYK6TwlJ-rZ9CLvgD4UU9FAdMwv8jTccTkLrlVb-r2KwbCKQh-yGKpmfPt0sFvjuQ-Z8itR2-GODINK_a6Oix80_UxVmQ4 May 21 21:10:56.639996 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:56.639996 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:56.639996 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:56.639996 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:56.639996 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:56.639996 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:56.639996 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: d33309142b34423d9bfd24c435954d75 May 21 21:10:56.639996 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2140486129 May 21 21:10:56.639996 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:10:56.639996 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:10:56.641303 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d33309142b34423d9bfd24c435954d75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d33309142b34423d9bfd24c435954d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d33309142b34423d9bfd24c435954d75", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d33309142b34423d9bfd24c435954d75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:56.641303 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2140486129 May 21 21:10:56.641303 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: d33309142b34423d9bfd24c435954d75 May 21 21:10:56.641303 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2140486129 May 21 21:10:56.641303 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2140486129-project May 21 21:10:56.641303 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:56.641303 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:56.641303 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 4d4c4b27f5124363a63ab11476e85770 May 21 21:10:56.641303 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2140486129-project May 21 21:10:56.641303 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:10:56.641303 ncdv-master-1 devstack@n-api.service[131277]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 21 21:10:56.641303 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '1'} May 21 21:10:56.641959 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:56.641959 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:56.641959 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:56.641959 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:56.641959 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:56.641959 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:56.641959 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:10:56.641959 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:10:56.641959 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:56.641959 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:56.641959 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers May 21 21:10:56.641959 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) May 21 21:10:56.641959 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:10:56.641959 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:10:56.641959 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:10:56.641959 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:10:56.641959 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:10:56.641959 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:10:56.641959 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:10:56.642974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:10:56.642974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:10:56.642974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:10:56.642974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:10:56.642974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:10:56.642974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:10:56.642974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:10:56.642974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 21 21:10:56.642974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:56.642974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:56.642974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:56.642974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:56.642974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:56.642974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:56.642974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:10:56.642974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:10:56.642974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 21 21:10:56.642974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:56.647260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a4b02e38-77cf-4c59-8447-6b3ba14ed9ce tempest-HypervisorAdminNegativeUnderV252Test-2140486129 tempest-HypervisorAdminNegativeUnderV252Test-2140486129-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:56.648109 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a4b02e38-77cf-4c59-8447-6b3ba14ed9ce tempest-HypervisorAdminNegativeUnderV252Test-2140486129 tempest-HypervisorAdminNegativeUnderV252Test-2140486129-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.016280 May 21 21:10:56.654698 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 166/304] 10.222.0.49 () {58 vars in 1175 bytes} [Sat May 21 21:10:56 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:56.654698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-425ef4e5-2304-458d-aeab-76172d5ec0b6 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Calling method '.version_select at 0x7fc81bd0aa60>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:56.655410 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:56.655410 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:56.672871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-425ef4e5-2304-458d-aeab-76172d5ec0b6 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:56.673350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-425ef4e5-2304-458d-aeab-76172d5ec0b6 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:56.728113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-425ef4e5-2304-458d-aeab-76172d5ec0b6 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:56.728624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-425ef4e5-2304-458d-aeab-76172d5ec0b6 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:56.762601 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-425ef4e5-2304-458d-aeab-76172d5ec0b6 tempest-HostsAdminTestJSON-1706979349 tempest-HostsAdminTestJSON-1706979349-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.112701 May 21 21:10:56.765652 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-82bfbeeb-425b-4565-987e-e31535938e5a tempest-SecurityGroupsTestAdminJSON-553561558 tempest-SecurityGroupsTestAdminJSON-553561558-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.215095 May 21 21:10:56.767010 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 139/305] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:10:55 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:56.773005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9277cb53-07bd-4771-b15e-51e9e55bb6a1 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1516946276", "availability_zone": "tempest-test_az-397619059"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:56.774764 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:56.774764 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:56.778567 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.aggregate [None req-9277cb53-07bd-4771-b15e-51e9e55bb6a1 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Generated uuid 87a3c01a-ec24-435f-a03f-af3830135e3c for aggregate {{(pid=131278) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 21 21:10:56.780737 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 167/306] 10.222.0.49 () {58 vars in 1169 bytes} [Sat May 21 21:10:56 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 467 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:56.792147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2b671f22-8fd9-422b-810f-fbed56adf373 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Calling method '.version_select at 0x7fc81bd721f0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:56.795694 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:56.795694 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:10:56.800058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b671f22-8fd9-422b-810f-fbed56adf373 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:56.801334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b671f22-8fd9-422b-810f-fbed56adf373 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:56.812222 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-2b671f22-8fd9-422b-810f-fbed56adf373 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] HTTP exception thrown: No hypervisor matching '7a161339-db25-458a-8c0f-7d89221fddac' could be found. May 21 21:10:56.813611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2b671f22-8fd9-422b-810f-fbed56adf373 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Request method failure captured: May 21 21:10:56.813611 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/os-hypervisors/7a161339-db25-458a-8c0f-7d89221fddac/servers HTTP/1.1 May 21 21:10:56.813611 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:10:56.813611 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:10:56.813611 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:10:56.813611 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:10:56.813611 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:10:56.813611 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:10:56.813611 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:10:56.813611 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:10:56.813611 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVVeyXMDDhBx7ErkHOmU_nruTvc16AlpFMHJus47EJCg0XTL_cWMbSSt7RT97ktfVgMmsQMVRbVlW8zjRZmOMNtUYDGsT77XVcyTWxGDTgEF83sV16thKeA0lPkLV01WTTy1IY9nNC13jECm3scCbYilsMybYW92eRsdyrCtnL1gRqs May 21 21:10:56.813611 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:10:56.813611 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:10:56.813611 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:10:56.813611 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:10:56.813611 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:10:56.813611 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:10:56.813611 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: d818237b515c4baba0f1cbdbf5dbeb99 May 21 21:10:56.813611 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1065137831 May 21 21:10:56.813611 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:10:56.813611 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:10:56.815164 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d818237b515c4baba0f1cbdbf5dbeb99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d818237b515c4baba0f1cbdbf5dbeb99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d818237b515c4baba0f1cbdbf5dbeb99", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d818237b515c4baba0f1cbdbf5dbeb99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:56.815164 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1065137831 May 21 21:10:56.815164 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: d818237b515c4baba0f1cbdbf5dbeb99 May 21 21:10:56.815164 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1065137831 May 21 21:10:56.815164 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin May 21 21:10:56.815164 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:10:56.815164 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:10:56.815164 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a074391daf9b47cd8920000563a3cba0 May 21 21:10:56.815164 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin May 21 21:10:56.815164 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:10:56.815164 ncdv-master-1 devstack@n-api.service[131277]: exception: No hypervisor matching '7a161339-db25-458a-8c0f-7d89221fddac' could be found. May 21 21:10:56.815164 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '7a161339-db25-458a-8c0f-7d89221fddac'} May 21 21:10:56.815891 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:56.815891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:56.815891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:56.815891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:56.815891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:56.815891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:56.815891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:10:56.815891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:10:56.815891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:56.815891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:56.815891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers May 21 21:10:56.815891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) May 21 21:10:56.815891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern May 21 21:10:56.815891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 21 21:10:56.815891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '7a161339-db25-458a-8c0f-7d89221fddac' could be found. May 21 21:10:56.815891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:56.815891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:56.815891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:56.815891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:56.817166 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:56.817166 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:56.817166 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:56.817166 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:56.817166 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '7a161339-db25-458a-8c0f-7d89221fddac' could be found. May 21 21:10:56.817166 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:10:56.817166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2b671f22-8fd9-422b-810f-fbed56adf373 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] Returning 404 to user: No hypervisor matching '7a161339-db25-458a-8c0f-7d89221fddac' could be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:56.817166 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2b671f22-8fd9-422b-810f-fbed56adf373 tempest-HypervisorAdminNegativeUnderV252Test-1065137831 tempest-HypervisorAdminNegativeUnderV252Test-1065137831-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/7a161339-db25-458a-8c0f-7d89221fddac/servers" status: 404 len: 123 microversion: 2.1 time: 0.033944 May 21 21:10:56.817166 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 168/307] 10.222.0.49 () {58 vars in 1280 bytes} [Sat May 21 21:10:56 2022] GET /compute/v2.1/os-hypervisors/7a161339-db25-458a-8c0f-7d89221fddac/servers => generated 123 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:56.931217 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9277cb53-07bd-4771-b15e-51e9e55bb6a1 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.162970 May 21 21:10:56.933497 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 140/308] 10.222.0.49 () {60 vars in 1164 bytes} [Sat May 21 21:10:56 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:56.946114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-97dc7520-08e8-4d98-a8ef-8cc0dbf3b379 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1516946276_new", "availability_zone": "tempest-test_az-397619059_new"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:56.946841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=46 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:56.952798 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:56.952798 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:57.107415 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-97dc7520-08e8-4d98-a8ef-8cc0dbf3b379 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:57.108300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-97dc7520-08e8-4d98-a8ef-8cc0dbf3b379 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:57.209672 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-97dc7520-08e8-4d98-a8ef-8cc0dbf3b379 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 335 microversion: 2.1 time: 0.270215 May 21 21:10:57.210897 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 141/309] 10.222.0.49 () {60 vars in 1172 bytes} [Sat May 21 21:10:56 2022] PUT /compute/v2.1/os-aggregates/17 => generated 335 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:57.222146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fe012567-c8aa-49c8-9fea-bbcb1202fb8b tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:57.225179 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:57.225179 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:57.236862 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fe012567-c8aa-49c8-9fea-bbcb1202fb8b tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.019304 May 21 21:10:57.242492 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 142/310] 10.222.0.49 () {58 vars in 1142 bytes} [Sat May 21 21:10:57 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:57.258601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c8b57b44-c17b-418d-b38f-29b6d5ad60b2 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:57.259561 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:57.259561 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:57.360839 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c8b57b44-c17b-418d-b38f-29b6d5ad60b2 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.107439 May 21 21:10:57.368757 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 143/311] 10.222.0.49 () {58 vars in 1154 bytes} [Sat May 21 21:10:57 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 21 21:10:57.375846 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6f4d510f-bde9-4809-8b50-4cdfff4d834a tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1592245263"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:57.377720 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:57.377720 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:57.378940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.aggregate [None req-6f4d510f-bde9-4809-8b50-4cdfff4d834a tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Generated uuid d07d0b86-5b7d-4c80-b7c7-e20dc1ab3787 for aggregate {{(pid=131278) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 21 21:10:57.516841 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6f4d510f-bde9-4809-8b50-4cdfff4d834a tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.145240 May 21 21:10:57.518049 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 144/312] 10.222.0.49 () {60 vars in 1163 bytes} [Sat May 21 21:10:57 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:10:57.529118 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-96523cd0-dbd4-49d9-9ff1-ce9420874e59 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:57.531377 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:57.531377 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:57.541144 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-96523cd0-dbd4-49d9-9ff1-ce9420874e59 tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.016426 May 21 21:10:57.542086 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 145/313] 10.222.0.49 () {58 vars in 1142 bytes} [Sat May 21 21:10:57 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:10:57.558746 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a0c6ebb3-1204-4568-a140-13dcfa1a101a tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:57.559662 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:10:57.559662 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:10:57.665650 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a0c6ebb3-1204-4568-a140-13dcfa1a101a tempest-AggregatesAdminTestJSON-1717385471 tempest-AggregatesAdminTestJSON-1717385471-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.111526 May 21 21:10:57.682459 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 146/314] 10.222.0.49 () {58 vars in 1154 bytes} [Sat May 21 21:10:57 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 21 21:10:57.698076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-09ad3585-329e-46af-b97a-b0425bd6e496 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:57.700745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-09ad3585-329e-46af-b97a-b0425bd6e496 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:57.713236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-09ad3585-329e-46af-b97a-b0425bd6e496 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:57.713772 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-09ad3585-329e-46af-b97a-b0425bd6e496 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:57.714486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-09ad3585-329e-46af-b97a-b0425bd6e496 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:57.714926 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-09ad3585-329e-46af-b97a-b0425bd6e496 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:57.746456 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-09ad3585-329e-46af-b97a-b0425bd6e496 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] HTTP exception thrown: Instance fab48e8e-24d9-4608-ba16-fbe26f0a89b0 could not be found. May 21 21:10:57.749001 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-09ad3585-329e-46af-b97a-b0425bd6e496 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Request method failure captured: May 21 21:10:57.749001 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 HTTP/1.1 May 21 21:10:57.749001 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:57.749001 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:57.749001 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:57.749001 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:10:57.749001 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:57.749001 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:57.749001 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:57.749001 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:57.749001 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVUp4H1M5k513ZVCzTK2OIXpee4qMWEaThAGIA2sj5KC3gQ9dgOxeY_2k9pphkD2m9b2MdVI1kIHja94Q82uuRA7q7YfCC5owpNUfRlpSn_o1myUiUOJvPpSTSbe6CfxuQE5kOqtcSzuqI5hNeKK7kPV7gNWrishlG-jsqFtUKf7PKQ May 21 21:10:57.749001 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:57.749001 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:57.749001 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:57.749001 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:57.749001 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:57.749001 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:57.749001 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 83797d59cecf40fb97b5f8543a6476d0 May 21 21:10:57.749001 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-AggregatesAdminTestJSON-1528215393 May 21 21:10:57.749001 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:10:57.749001 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:10:57.753151 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/83797d59cecf40fb97b5f8543a6476d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/83797d59cecf40fb97b5f8543a6476d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_83797d59cecf40fb97b5f8543a6476d0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/83797d59cecf40fb97b5f8543a6476d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:57.753151 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-AggregatesAdminTestJSON-1528215393 May 21 21:10:57.753151 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 83797d59cecf40fb97b5f8543a6476d0 May 21 21:10:57.753151 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1528215393 May 21 21:10:57.753151 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-AggregatesAdminTestJSON-1528215393-project May 21 21:10:57.753151 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:57.753151 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:57.753151 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 222d5f38e7964046befd68eae1123ec0 May 21 21:10:57.753151 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-AggregatesAdminTestJSON-1528215393-project May 21 21:10:57.753151 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:10:57.753151 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance fab48e8e-24d9-4608-ba16-fbe26f0a89b0 could not be found. May 21 21:10:57.753151 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'fab48e8e-24d9-4608-ba16-fbe26f0a89b0'} May 21 21:10:57.754572 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:57.754572 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:57.754572 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:10:57.754572 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:10:57.754572 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:10:57.754572 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:10:57.754572 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:10:57.754572 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:10:57.754572 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:10:57.754572 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:10:57.754572 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fab48e8e-24d9-4608-ba16-fbe26f0a89b0 could not be found. May 21 21:10:57.754572 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:57.754572 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:57.754572 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:57.754572 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:57.754572 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:57.754572 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:57.754572 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:57.754572 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:57.754572 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:57.755772 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:57.755772 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:10:57.755772 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:10:57.755772 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:10:57.755772 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:10:57.755772 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:10:57.755772 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:10:57.755772 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:10:57.755772 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:10:57.755772 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fab48e8e-24d9-4608-ba16-fbe26f0a89b0 could not be found. May 21 21:10:57.755772 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:57.755772 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:57.755772 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:57.755772 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:57.755772 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:57.755772 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:57.755772 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:57.755772 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:57.755772 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fab48e8e-24d9-4608-ba16-fbe26f0a89b0 could not be found. May 21 21:10:57.755772 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:57.757468 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-09ad3585-329e-46af-b97a-b0425bd6e496 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Returning 404 to user: Instance fab48e8e-24d9-4608-ba16-fbe26f0a89b0 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:57.757468 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-09ad3585-329e-46af-b97a-b0425bd6e496 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 404 len: 111 microversion: 2.1 time: 0.063306 May 21 21:10:57.761621 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 147/315] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:10:57 2022] DELETE /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:57.768441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-62f8ece7-576b-4894-8989-20dfe12b54b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:57.769874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-62f8ece7-576b-4894-8989-20dfe12b54b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] [instance: fab48e8e-24d9-4608-ba16-fbe26f0a89b0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:57.777083 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62f8ece7-576b-4894-8989-20dfe12b54b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:57.778405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62f8ece7-576b-4894-8989-20dfe12b54b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:57.779402 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62f8ece7-576b-4894-8989-20dfe12b54b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:57.780035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62f8ece7-576b-4894-8989-20dfe12b54b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:57.814316 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-62f8ece7-576b-4894-8989-20dfe12b54b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] HTTP exception thrown: Instance fab48e8e-24d9-4608-ba16-fbe26f0a89b0 could not be found. May 21 21:10:57.823728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-62f8ece7-576b-4894-8989-20dfe12b54b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Request method failure captured: May 21 21:10:57.823728 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 HTTP/1.1 May 21 21:10:57.823728 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:10:57.823728 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:10:57.823728 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:10:57.823728 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:10:57.823728 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:10:57.823728 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:10:57.823728 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:10:57.823728 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:10:57.823728 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVUp4H1M5k513ZVCzTK2OIXpee4qMWEaThAGIA2sj5KC3gQ9dgOxeY_2k9pphkD2m9b2MdVI1kIHja94Q82uuRA7q7YfCC5owpNUfRlpSn_o1myUiUOJvPpSTSbe6CfxuQE5kOqtcSzuqI5hNeKK7kPV7gNWrishlG-jsqFtUKf7PKQ May 21 21:10:57.823728 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:10:57.823728 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:10:57.823728 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:10:57.823728 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:10:57.823728 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:10:57.823728 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:10:57.823728 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 83797d59cecf40fb97b5f8543a6476d0 May 21 21:10:57.823728 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-AggregatesAdminTestJSON-1528215393 May 21 21:10:57.823728 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:10:57.823728 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:10:57.824934 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/83797d59cecf40fb97b5f8543a6476d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/83797d59cecf40fb97b5f8543a6476d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_83797d59cecf40fb97b5f8543a6476d0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/83797d59cecf40fb97b5f8543a6476d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:10:57.824934 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-AggregatesAdminTestJSON-1528215393 May 21 21:10:57.824934 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 83797d59cecf40fb97b5f8543a6476d0 May 21 21:10:57.824934 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1528215393 May 21 21:10:57.824934 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-AggregatesAdminTestJSON-1528215393-project May 21 21:10:57.824934 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:10:57.824934 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:10:57.824934 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 222d5f38e7964046befd68eae1123ec0 May 21 21:10:57.824934 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-AggregatesAdminTestJSON-1528215393-project May 21 21:10:57.824934 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:10:57.824934 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance fab48e8e-24d9-4608-ba16-fbe26f0a89b0 could not be found. May 21 21:10:57.824934 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'fab48e8e-24d9-4608-ba16-fbe26f0a89b0'} May 21 21:10:57.825593 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:10:57.825593 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:57.825593 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:10:57.825593 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:10:57.825593 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:10:57.825593 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:10:57.825593 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:10:57.825593 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:10:57.825593 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:10:57.825593 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:10:57.825593 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fab48e8e-24d9-4608-ba16-fbe26f0a89b0 could not be found. May 21 21:10:57.825593 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:57.825593 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:57.825593 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:57.825593 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:57.825593 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:57.825593 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:57.825593 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:10:57.825593 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:10:57.825593 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:10:57.826648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:10:57.826648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:10:57.826648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:10:57.826648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:10:57.826648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:10:57.826648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:10:57.826648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:10:57.826648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fab48e8e-24d9-4608-ba16-fbe26f0a89b0 could not be found. May 21 21:10:57.826648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:57.826648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:10:57.826648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:57.826648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:10:57.826648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:10:57.826648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:10:57.826648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:10:57.826648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:10:57.826648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fab48e8e-24d9-4608-ba16-fbe26f0a89b0 could not be found. May 21 21:10:57.826648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:10:57.827634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-62f8ece7-576b-4894-8989-20dfe12b54b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] Returning 404 to user: Instance fab48e8e-24d9-4608-ba16-fbe26f0a89b0 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:10:57.827634 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-62f8ece7-576b-4894-8989-20dfe12b54b3 tempest-AggregatesAdminTestJSON-1528215393 tempest-AggregatesAdminTestJSON-1528215393-project] 10.222.0.49 "GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0" status: 404 len: 111 microversion: 2.1 time: 0.058467 May 21 21:10:57.835661 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 148/316] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:57 2022] GET /compute/v2.1/servers/fab48e8e-24d9-4608-ba16-fbe26f0a89b0 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:10:57.880582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b132211f-5a27-486a-85d4-037d48e6af0d tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] Action: 'create', calling method: .version_select at 0x7fc81bd724c0>, body: {"security_group": {"name": "tempest-securitygroup-1097706433", "description": "tempest-description-244509930"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:57.890250 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e652519a-e0f9-48c0-9243-6bb53f318679 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:10:57.891643 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e652519a-e0f9-48c0-9243-6bb53f318679 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:10:57.909889 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e652519a-e0f9-48c0-9243-6bb53f318679 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:57.914438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e652519a-e0f9-48c0-9243-6bb53f318679 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:57.915964 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e652519a-e0f9-48c0-9243-6bb53f318679 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:57.916669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e652519a-e0f9-48c0-9243-6bb53f318679 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:58.339364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e652519a-e0f9-48c0-9243-6bb53f318679 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:10:58.349047 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e652519a-e0f9-48c0-9243-6bb53f318679 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 200 len: 1591 microversion: 2.1 time: 0.462549 May 21 21:10:58.350957 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 149/317] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:10:57 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 1591 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:10:58.356045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-186bd07e-ba21-4645-a586-60dbe1120ac7 req-a0b36f6a-9651-49e6-81e3-21eeb366d136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c22ee7-e0f1-4d96-bedb-559c91cd2f00", "tag": "2558a946-51d6-4f04-bcc7-302329aa7086"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:10:58.367683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-186bd07e-ba21-4645-a586-60dbe1120ac7 req-a0b36f6a-9651-49e6-81e3-21eeb366d136 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:10:58.368714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-186bd07e-ba21-4645-a586-60dbe1120ac7 req-a0b36f6a-9651-49e6-81e3-21eeb366d136 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:10:58.390425 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-186bd07e-ba21-4645-a586-60dbe1120ac7 req-a0b36f6a-9651-49e6-81e3-21eeb366d136 service nova] Creating event network-changed:2558a946-51d6-4f04-bcc7-302329aa7086 for instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 on nch1-master-1 May 21 21:10:58.399800 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-186bd07e-ba21-4645-a586-60dbe1120ac7 req-a0b36f6a-9651-49e6-81e3-21eeb366d136 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046341 May 21 21:10:58.404907 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 150/318] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:00.059294 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b132211f-5a27-486a-85d4-037d48e6af0d tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 3.240233 May 21 21:11:00.059294 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 169/319] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:10:56 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 3241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:00.073107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fe96e5ac-e55a-435a-86c9-120405a16ef0 tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] Action: 'create', calling method: .version_select at 0x7fc81be0e3a0>, body: {"security_group": {"name": "tempest-securitygroup-1018162475", "description": "tempest-description-1544200909"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:00.731336 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fe96e5ac-e55a-435a-86c9-120405a16ef0 tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.663190 May 21 21:11:00.740184 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 151/320] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:11:00 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:00.746237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a363f602-f00f-4d6f-95b5-dd7ae88261d5 tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] Calling method '.version_select at 0x7fc81bd72c10>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:03.177768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG neutronclient.v2_0.client [None req-a363f602-f00f-4d6f-95b5-dd7ae88261d5 tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 98b76ece-b142-47ab-8aa3-cb0d64c663a7 does not exist", "detail": ""}} {{(pid=131277) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:11:03.179637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.security_group_api [None req-a363f602-f00f-4d6f-95b5-dd7ae88261d5 tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] Neutron security group 98b76ece-b142-47ab-8aa3-cb0d64c663a7 not found {{(pid=131277) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 21 21:11:03.180093 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.compute.security_groups [None req-a363f602-f00f-4d6f-95b5-dd7ae88261d5 tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] Security Group ID 98b76ece-b142-47ab-8aa3-cb0d64c663a7 does not exist {{(pid=131277) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} May 21 21:11:03.289882 ncdv-master-1 devstack@n-api.service[131277]: DEBUG neutronclient.v2_0.client [None req-a363f602-f00f-4d6f-95b5-dd7ae88261d5 tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 98b76ece-b142-47ab-8aa3-cb0d64c663a7 does not exist", "detail": ""}} {{(pid=131277) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:11:03.292186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.security_group_api [None req-a363f602-f00f-4d6f-95b5-dd7ae88261d5 tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] Neutron security group 98b76ece-b142-47ab-8aa3-cb0d64c663a7 not found {{(pid=131277) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 21 21:11:03.294704 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.compute.security_groups [None req-a363f602-f00f-4d6f-95b5-dd7ae88261d5 tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] Security Group ID 98b76ece-b142-47ab-8aa3-cb0d64c663a7 does not exist {{(pid=131277) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} May 21 21:11:03.982772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG neutronclient.v2_0.client [None req-a363f602-f00f-4d6f-95b5-dd7ae88261d5 tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d0733130-e944-482c-a6cf-7b98d157dd8d does not exist", "detail": ""}} {{(pid=131277) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:11:03.983425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.security_group_api [None req-a363f602-f00f-4d6f-95b5-dd7ae88261d5 tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] Neutron security group d0733130-e944-482c-a6cf-7b98d157dd8d not found {{(pid=131277) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 21 21:11:03.983871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.compute.security_groups [None req-a363f602-f00f-4d6f-95b5-dd7ae88261d5 tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] Security Group ID d0733130-e944-482c-a6cf-7b98d157dd8d does not exist {{(pid=131277) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} May 21 21:11:04.007682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG neutronclient.v2_0.client [None req-a363f602-f00f-4d6f-95b5-dd7ae88261d5 tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d0733130-e944-482c-a6cf-7b98d157dd8d does not exist", "detail": ""}} {{(pid=131277) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:11:04.008321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.security_group_api [None req-a363f602-f00f-4d6f-95b5-dd7ae88261d5 tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] Neutron security group d0733130-e944-482c-a6cf-7b98d157dd8d not found {{(pid=131277) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 21 21:11:04.009180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.compute.security_groups [None req-a363f602-f00f-4d6f-95b5-dd7ae88261d5 tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] Security Group ID d0733130-e944-482c-a6cf-7b98d157dd8d does not exist {{(pid=131277) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} May 21 21:11:04.010393 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a363f602-f00f-4d6f-95b5-dd7ae88261d5 tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] 10.222.0.49 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 7279 microversion: 2.1 time: 3.269238 May 21 21:11:04.010986 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 170/321] 10.222.0.49 () {58 vars in 1190 bytes} [Sat May 21 21:11:00 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 7279 bytes in 3271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:04.026493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-271fd9a0-4fe0-4e18-ad38-83857d35fd36 tempest-SecurityGroupsTestAdminJSON-553561558 tempest-SecurityGroupsTestAdminJSON-553561558-project] Calling method '.version_select at 0x7fc81bd0e0d0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:04.248578 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-271fd9a0-4fe0-4e18-ad38-83857d35fd36 tempest-SecurityGroupsTestAdminJSON-553561558 tempest-SecurityGroupsTestAdminJSON-553561558-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.225736 May 21 21:11:04.249365 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 152/322] 10.222.0.49 () {58 vars in 1190 bytes} [Sat May 21 21:11:04 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:04.261170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1fca0b24-6b58-4d4a-99c9-de1fce5f3e4f tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] Calling method '.version_select at 0x7fc81bdcc9d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:04.694629 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1fca0b24-6b58-4d4a-99c9-de1fce5f3e4f tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/ff1d812a-ebf4-4f3c-afc0-eb5d8301a664" status: 202 len: 0 microversion: 2.1 time: 0.437103 May 21 21:11:04.695202 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 171/323] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:11:04 2022] DELETE /compute/v2.1/os-security-groups/ff1d812a-ebf4-4f3c-afc0-eb5d8301a664 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:11:04.708951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4c78867b-5d76-4956-88b8-10ad2559061e tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] Calling method '.version_select at 0x7fc81bd7d1f0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:05.120091 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4c78867b-5d76-4956-88b8-10ad2559061e tempest-SecurityGroupsTestAdminJSON-903351932 tempest-SecurityGroupsTestAdminJSON-903351932-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/6675d2b6-6357-47ff-8468-7311e4e9af37" status: 202 len: 0 microversion: 2.1 time: 0.420202 May 21 21:11:05.122347 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 153/324] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:11:04 2022] DELETE /compute/v2.1/os-security-groups/6675d2b6-6357-47ff-8468-7311e4e9af37 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:11:05.133012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6083818c-dd5a-4318-99db-8db94e09b82a tempest-SecurityGroupsTestAdminJSON-553561558 tempest-SecurityGroupsTestAdminJSON-553561558-project] Calling method '.version_select at 0x7fc81bd723a0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:05.466013 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6083818c-dd5a-4318-99db-8db94e09b82a tempest-SecurityGroupsTestAdminJSON-553561558 tempest-SecurityGroupsTestAdminJSON-553561558-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/8b59c857-b671-4129-bd3e-4b85d4553b7b" status: 202 len: 0 microversion: 2.1 time: 0.337687 May 21 21:11:05.466013 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 172/325] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:11:05 2022] DELETE /compute/v2.1/os-security-groups/8b59c857-b671-4129-bd3e-4b85d4553b7b => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:11:05.474689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9083809e-1286-4576-a132-4c082d5ec9fb tempest-SecurityGroupsTestAdminJSON-553561558 tempest-SecurityGroupsTestAdminJSON-553561558-project] Calling method '.version_select at 0x7fc81bccf1f0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:05.862335 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9083809e-1286-4576-a132-4c082d5ec9fb tempest-SecurityGroupsTestAdminJSON-553561558 tempest-SecurityGroupsTestAdminJSON-553561558-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/7f70b5dc-080c-4da5-aa12-6633a334885d" status: 202 len: 0 microversion: 2.1 time: 0.392654 May 21 21:11:05.864334 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 154/326] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:11:05 2022] DELETE /compute/v2.1/os-security-groups/7f70b5dc-080c-4da5-aa12-6633a334885d => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 21 21:11:06.087256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a4734918-d63b-424a-b642-2e81a0d91054 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-849958167", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "99d05c9f-92b6-430b-8f33-3ae9f1f2ec0c"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:06.175035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-a4734918-d63b-424a-b642-2e81a0d91054 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] validate_networks() for [('99d05c9f-92b6-430b-8f33-3ae9f1f2ec0c', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:11:06.353023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=25 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:06.728253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-a4734918-d63b-424a-b642-2e81a0d91054 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:11:06.728253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-a4734918-d63b-424a-b642-2e81a0d91054 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:11:06.729042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-a4734918-d63b-424a-b642-2e81a0d91054 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:11:06.729795 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-a4734918-d63b-424a-b642-2e81a0d91054 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:11:06.730470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-a4734918-d63b-424a-b642-2e81a0d91054 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:11:06.753128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a4734918-d63b-424a-b642-2e81a0d91054 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:06.754544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a4734918-d63b-424a-b642-2e81a0d91054 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:06.755499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a4734918-d63b-424a-b642-2e81a0d91054 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:06.756064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a4734918-d63b-424a-b642-2e81a0d91054 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:06.790898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-a4734918-d63b-424a-b642-2e81a0d91054 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Getting quotas for project 4c99e1f900034d42bbb1a786b225a230. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:11:06.793965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:06.796988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-a4734918-d63b-424a-b642-2e81a0d91054 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Getting quotas for user 74f296ea42634e18ad82ee175408c641 and project 4c99e1f900034d42bbb1a786b225a230. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:11:06.811200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a4734918-d63b-424a-b642-2e81a0d91054 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:11:06.813995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a4734918-d63b-424a-b642-2e81a0d91054 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:11:06.986891 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a4734918-d63b-424a-b642-2e81a0d91054 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.407676 May 21 21:11:06.993105 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 173/327] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:11:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:11:06.999042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e02153a6-b407-449d-99cc-43ff30951e43 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:06.999883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e02153a6-b407-449d-99cc-43ff30951e43 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:07.101027 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e02153a6-b407-449d-99cc-43ff30951e43 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:07.114506 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e02153a6-b407-449d-99cc-43ff30951e43 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3" status: 200 len: 1223 microversion: 2.1 time: 0.120207 May 21 21:11:07.115702 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 155/328] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:06 2022] GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3 => generated 1223 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:08.132478 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1cdc2ccf-0e28-42db-af28-7d707c612053 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:08.133078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1cdc2ccf-0e28-42db-af28-7d707c612053 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:08.299081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1cdc2ccf-0e28-42db-af28-7d707c612053 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:08.306609 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1cdc2ccf-0e28-42db-af28-7d707c612053 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3" status: 200 len: 1223 microversion: 2.1 time: 0.179335 May 21 21:11:08.307200 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 174/329] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:08 2022] GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3 => generated 1223 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:08.915844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=71 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:09.326566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2fcf773d-324f-4f6e-b98a-f1a51cf27d60 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:09.327938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2fcf773d-324f-4f6e-b98a-f1a51cf27d60 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:09.336518 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fcf773d-324f-4f6e-b98a-f1a51cf27d60 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:09.337199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fcf773d-324f-4f6e-b98a-f1a51cf27d60 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:09.338180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fcf773d-324f-4f6e-b98a-f1a51cf27d60 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:09.338958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fcf773d-324f-4f6e-b98a-f1a51cf27d60 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:09.416167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2fcf773d-324f-4f6e-b98a-f1a51cf27d60 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:09.423778 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2fcf773d-324f-4f6e-b98a-f1a51cf27d60 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3" status: 200 len: 1275 microversion: 2.1 time: 0.102907 May 21 21:11:09.424514 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 175/330] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:09 2022] GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3 => generated 1275 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:11:09.557165 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-18e07722-3e66-4bef-8c15-956bc47a8bf1 tempest-InstanceUsageAuditLogNegativeTestJSON-1549840332 tempest-InstanceUsageAuditLogNegativeTestJSON-1549840332-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:09.558269 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:11:09.558269 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:11:09.560842 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-18e07722-3e66-4bef-8c15-956bc47a8bf1 tempest-InstanceUsageAuditLogNegativeTestJSON-1549840332 tempest-InstanceUsageAuditLogNegativeTestJSON-1549840332-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time May 21 21:11:09.575610 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-18e07722-3e66-4bef-8c15-956bc47a8bf1 tempest-InstanceUsageAuditLogNegativeTestJSON-1549840332 tempest-InstanceUsageAuditLogNegativeTestJSON-1549840332-project-admin] Request method failure captured: May 21 21:11:09.575610 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 May 21 21:11:09.575610 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:11:09.575610 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:11:09.575610 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:11:09.575610 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:11:09.575610 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:11:09.575610 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:11:09.575610 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:11:09.575610 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:11:09.575610 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVsvOgjngoftOYPgDl9-htNzSEUyrBse2Jr3_qnx4oUbj8w0l7sMGF-36cVcYbCDv54hrfkeN31M4SEUk8d6yW0Bgrc8tanbU9jb-IzxDPsbVpF-1UY3SgBzYuqmq9S0uu-JDwxa_8rzYv-OjDh5L2vBB8TyMv3aUpZGBxZ2hraHpU May 21 21:11:09.575610 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:11:09.575610 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:11:09.575610 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:11:09.575610 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:11:09.575610 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:11:09.575610 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:11:09.575610 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: e708a107097746459825d8b5cccdda61 May 21 21:11:09.575610 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1549840332 May 21 21:11:09.575610 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,admin,member May 21 21:11:09.575610 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,admin,member May 21 21:11:09.577144 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e708a107097746459825d8b5cccdda61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e708a107097746459825d8b5cccdda61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e708a107097746459825d8b5cccdda61", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e708a107097746459825d8b5cccdda61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:11:09.577144 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1549840332 May 21 21:11:09.577144 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: e708a107097746459825d8b5cccdda61 May 21 21:11:09.577144 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1549840332 May 21 21:11:09.577144 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1549840332-project-admin May 21 21:11:09.577144 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:11:09.577144 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:11:09.577144 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 7902737b28e64165aba5fbd72e6be6ce May 21 21:11:09.577144 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1549840332-project-admin May 21 21:11:09.577144 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:11:09.577144 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid timestamp for date invalid_time May 21 21:11:09.577861 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'invalid_time'} May 21 21:11:09.577861 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:11:09.577861 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:11:09.577861 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show May 21 21:11:09.577861 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), May 21 21:11:09.577861 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime May 21 21:11:09.577861 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) May 21 21:11:09.577861 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime May 21 21:11:09.577861 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % May 21 21:11:09.577861 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' May 21 21:11:09.577861 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:11:09.577861 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:11:09.577861 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:11:09.577861 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:11:09.577861 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:11:09.577861 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:11:09.577861 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:11:09.577861 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:11:09.577861 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:11:09.577861 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:11:09.579092 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show May 21 21:11:09.579092 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) May 21 21:11:09.579092 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time May 21 21:11:09.579092 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:11:09.579092 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:11:09.579092 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:11:09.579092 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:11:09.579092 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:11:09.579092 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:11:09.579092 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:11:09.579092 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:11:09.579092 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time May 21 21:11:09.579092 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:11:09.579092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-18e07722-3e66-4bef-8c15-956bc47a8bf1 tempest-InstanceUsageAuditLogNegativeTestJSON-1549840332 tempest-InstanceUsageAuditLogNegativeTestJSON-1549840332-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:11:09.579092 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-18e07722-3e66-4bef-8c15-956bc47a8bf1 tempest-InstanceUsageAuditLogNegativeTestJSON-1549840332 tempest-InstanceUsageAuditLogNegativeTestJSON-1549840332-project-admin] 10.222.0.49 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.668015 May 21 21:11:09.579992 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 156/331] 10.222.0.49 () {58 vars in 1223 bytes} [Sat May 21 21:11:08 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 669 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 21 21:11:10.231828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-469425be-a305-4c2e-84e5-013ba3c6b9b1 tempest-InstanceUsageAuditLogNegativeTestJSON-176206949 tempest-InstanceUsageAuditLogNegativeTestJSON-176206949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:10.232641 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:11:10.232641 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:11:10.234568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-469425be-a305-4c2e-84e5-013ba3c6b9b1 tempest-InstanceUsageAuditLogNegativeTestJSON-176206949 tempest-InstanceUsageAuditLogNegativeTestJSON-176206949-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'a123227836b04ca58423fe923c67dccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c25623511949bfbce5490bd4dd6569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:10.236871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-469425be-a305-4c2e-84e5-013ba3c6b9b1 tempest-InstanceUsageAuditLogNegativeTestJSON-176206949 tempest-InstanceUsageAuditLogNegativeTestJSON-176206949-project] Request method failure captured: May 21 21:11:10.236871 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 May 21 21:11:10.236871 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:11:10.236871 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:11:10.236871 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:11:10.236871 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:11:10.236871 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:11:10.236871 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:11:10.236871 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:11:10.236871 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:11:10.236871 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVVpNWleUgPiqH5HZPGF98SBxD63LD0owNoTM583R_N_oJibI2znZZRe9NPgGch3WBldVj7xHZyLc-vI9mSED7I3xBCbvIepusaci4DUXNXpZ2-Ie6pPYpwQIFDWxunvQmrPU7yfMTKtW9-2HYrFbRcTlDK_G_1mIV-xfAyssOi0tfI May 21 21:11:10.236871 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:11:10.236871 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:11:10.236871 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:11:10.236871 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:11:10.236871 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:11:10.236871 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:11:10.236871 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 66c25623511949bfbce5490bd4dd6569 May 21 21:11:10.236871 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-176206949 May 21 21:11:10.236871 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:11:10.236871 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:11:10.239122 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/66c25623511949bfbce5490bd4dd6569"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/66c25623511949bfbce5490bd4dd6569"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_66c25623511949bfbce5490bd4dd6569", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/66c25623511949bfbce5490bd4dd6569"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:11:10.239122 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-176206949 May 21 21:11:10.239122 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 66c25623511949bfbce5490bd4dd6569 May 21 21:11:10.239122 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-176206949 May 21 21:11:10.239122 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-176206949-project May 21 21:11:10.239122 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:11:10.239122 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:11:10.239122 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a123227836b04ca58423fe923c67dccc May 21 21:11:10.239122 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-176206949-project May 21 21:11:10.239122 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:11:10.239122 ncdv-master-1 devstack@n-api.service[131277]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 21 21:11:10.239874 ncdv-master-1 devstack@n-api.service[131277]: action_args: {} May 21 21:11:10.239874 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:11:10.239874 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:11:10.239874 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:11:10.239874 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:11:10.239874 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:11:10.239874 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:11:10.239874 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:11:10.239874 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:11:10.239874 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index May 21 21:11:10.239874 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) May 21 21:11:10.239874 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:11:10.239874 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:11:10.239874 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:11:10.239874 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:11:10.239874 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:11:10.239874 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:11:10.239874 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:11:10.239874 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:11:10.239874 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:11:10.246481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:11:10.246481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:11:10.246481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:11:10.246481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:11:10.246481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:11:10.246481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 21 21:11:10.246481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:11:10.246481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:11:10.246481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:11:10.246481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:11:10.246481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:11:10.246481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:11:10.246481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:11:10.246481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:11:10.246481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 21 21:11:10.246481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:11:10.246481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-469425be-a305-4c2e-84e5-013ba3c6b9b1 tempest-InstanceUsageAuditLogNegativeTestJSON-176206949 tempest-InstanceUsageAuditLogNegativeTestJSON-176206949-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:11:10.248038 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-469425be-a305-4c2e-84e5-013ba3c6b9b1 tempest-InstanceUsageAuditLogNegativeTestJSON-176206949 tempest-InstanceUsageAuditLogNegativeTestJSON-176206949-project] 10.222.0.49 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.656447 May 21 21:11:10.248038 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 176/332] 10.222.0.49 () {58 vars in 1184 bytes} [Sat May 21 21:11:09 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 658 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:11:10.248822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0766ea10-9a2b-4a47-84d0-51953e9a49e2 tempest-InstanceUsageAuditLogNegativeTestJSON-176206949 tempest-InstanceUsageAuditLogNegativeTestJSON-176206949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:10.249634 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:11:10.249634 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:11:10.251039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0766ea10-9a2b-4a47-84d0-51953e9a49e2 tempest-InstanceUsageAuditLogNegativeTestJSON-176206949 tempest-InstanceUsageAuditLogNegativeTestJSON-176206949-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'a123227836b04ca58423fe923c67dccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c25623511949bfbce5490bd4dd6569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:10.255832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a5ec50b7-f048-478a-b92e-ee34a32a5c78 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-440666227", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": "none"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:10.260251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0766ea10-9a2b-4a47-84d0-51953e9a49e2 tempest-InstanceUsageAuditLogNegativeTestJSON-176206949 tempest-InstanceUsageAuditLogNegativeTestJSON-176206949-project] Request method failure captured: May 21 21:11:10.260251 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-05-21%2021:11:10 HTTP/1.1 May 21 21:11:10.260251 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:11:10.260251 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:11:10.260251 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:11:10.260251 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:11:10.260251 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:11:10.260251 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:11:10.260251 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:11:10.260251 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:11:10.260251 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVVpNWleUgPiqH5HZPGF98SBxD63LD0owNoTM583R_N_oJibI2znZZRe9NPgGch3WBldVj7xHZyLc-vI9mSED7I3xBCbvIepusaci4DUXNXpZ2-Ie6pPYpwQIFDWxunvQmrPU7yfMTKtW9-2HYrFbRcTlDK_G_1mIV-xfAyssOi0tfI May 21 21:11:10.260251 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:11:10.260251 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:11:10.260251 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:11:10.260251 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:11:10.260251 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:11:10.260251 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:11:10.260251 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 66c25623511949bfbce5490bd4dd6569 May 21 21:11:10.260251 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-176206949 May 21 21:11:10.260251 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:11:10.260251 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:11:10.262044 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/66c25623511949bfbce5490bd4dd6569"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/66c25623511949bfbce5490bd4dd6569"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_66c25623511949bfbce5490bd4dd6569", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/66c25623511949bfbce5490bd4dd6569"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:11:10.262044 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-176206949 May 21 21:11:10.262044 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 66c25623511949bfbce5490bd4dd6569 May 21 21:11:10.262044 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-176206949 May 21 21:11:10.262044 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-176206949-project May 21 21:11:10.262044 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:11:10.262044 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:11:10.262044 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a123227836b04ca58423fe923c67dccc May 21 21:11:10.262044 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-176206949-project May 21 21:11:10.262044 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:11:10.262044 ncdv-master-1 devstack@n-api.service[131277]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 21 21:11:10.266672 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '2022-05-21 21:11:10'} May 21 21:11:10.266672 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:11:10.266672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:11:10.266672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:11:10.266672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:11:10.266672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:11:10.266672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:11:10.266672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:11:10.266672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:11:10.266672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show May 21 21:11:10.266672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) May 21 21:11:10.266672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:11:10.266672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:11:10.266672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:11:10.266672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:11:10.266672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:11:10.266672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:11:10.266672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:11:10.266672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:11:10.266672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:11:10.273597 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:11:10.273597 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:11:10.273597 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:11:10.273597 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:11:10.273597 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:11:10.273597 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 21 21:11:10.273597 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:11:10.273597 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:11:10.273597 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:11:10.273597 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:11:10.273597 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:11:10.273597 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:11:10.273597 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:11:10.273597 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:11:10.273597 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 21 21:11:10.273597 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:11:10.273597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0766ea10-9a2b-4a47-84d0-51953e9a49e2 tempest-InstanceUsageAuditLogNegativeTestJSON-176206949 tempest-InstanceUsageAuditLogNegativeTestJSON-176206949-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:11:10.274703 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0766ea10-9a2b-4a47-84d0-51953e9a49e2 tempest-InstanceUsageAuditLogNegativeTestJSON-176206949 tempest-InstanceUsageAuditLogNegativeTestJSON-176206949-project] 10.222.0.49 "GET /compute/v2.1/os-instance_usage_audit_log/2022-05-21 21:11:10" status: 403 len: 128 microversion: 2.1 time: 0.016976 May 21 21:11:10.274703 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 177/333] 10.222.0.49 () {58 vars in 1250 bytes} [Sat May 21 21:11:10 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-05-21%2021%3A11%3A10 => generated 128 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 21 21:11:10.327691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-a5ec50b7-f048-478a-b92e-ee34a32a5c78 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:11:10.328419 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-a5ec50b7-f048-478a-b92e-ee34a32a5c78 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:11:10.329050 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-a5ec50b7-f048-478a-b92e-ee34a32a5c78 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:11:10.329634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-a5ec50b7-f048-478a-b92e-ee34a32a5c78 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:11:10.330210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-a5ec50b7-f048-478a-b92e-ee34a32a5c78 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:11:10.341651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5ec50b7-f048-478a-b92e-ee34a32a5c78 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:10.342146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5ec50b7-f048-478a-b92e-ee34a32a5c78 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:10.342963 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5ec50b7-f048-478a-b92e-ee34a32a5c78 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:10.343477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5ec50b7-f048-478a-b92e-ee34a32a5c78 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:10.367435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-a5ec50b7-f048-478a-b92e-ee34a32a5c78 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Getting quotas for project fe62f43f8ce2482887ec6ef306b112bd. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:11:10.373839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-a5ec50b7-f048-478a-b92e-ee34a32a5c78 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Getting quotas for user e83fbe80ab154846842f13c5cdfb5ff5 and project fe62f43f8ce2482887ec6ef306b112bd. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:11:10.391719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a5ec50b7-f048-478a-b92e-ee34a32a5c78 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:11:10.394172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a5ec50b7-f048-478a-b92e-ee34a32a5c78 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:11:10.442768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c11adcb7-bd82-4be7-9d53-c6a1db026798 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:10.444549 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c11adcb7-bd82-4be7-9d53-c6a1db026798 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:10.451496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c11adcb7-bd82-4be7-9d53-c6a1db026798 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:10.451942 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c11adcb7-bd82-4be7-9d53-c6a1db026798 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:10.452936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c11adcb7-bd82-4be7-9d53-c6a1db026798 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:10.453364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c11adcb7-bd82-4be7-9d53-c6a1db026798 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:10.535135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c11adcb7-bd82-4be7-9d53-c6a1db026798 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:10.543267 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a5ec50b7-f048-478a-b92e-ee34a32a5c78 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.908708 May 21 21:11:10.544829 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 157/334] 10.222.0.49 () {62 vars in 1187 bytes} [Sat May 21 21:11:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 21 21:11:10.558708 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c11adcb7-bd82-4be7-9d53-c6a1db026798 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3" status: 200 len: 1281 microversion: 2.1 time: 0.121050 May 21 21:11:10.559365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-967ed675-e56b-4634-894a-05aeb4030da3 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:10.560856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-967ed675-e56b-4634-894a-05aeb4030da3 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:10.567013 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 178/335] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:10 2022] GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3 => generated 1281 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:11:10.721889 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-967ed675-e56b-4634-894a-05aeb4030da3 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:10.735342 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-967ed675-e56b-4634-894a-05aeb4030da3 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:10.736922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-967ed675-e56b-4634-894a-05aeb4030da3 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:10.745181 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-967ed675-e56b-4634-894a-05aeb4030da3 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "PUT /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1358 microversion: 2.75 time: 0.191497 May 21 21:11:10.763256 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 158/336] 10.222.0.49 () {62 vars in 1296 bytes} [Sat May 21 21:11:10 2022] PUT /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:10.765410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7c273b36-7e0f-4f70-af04-c7b80b67a040 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:10.766123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7c273b36-7e0f-4f70-af04-c7b80b67a040 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:10.851361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7c273b36-7e0f-4f70-af04-c7b80b67a040 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:10.858595 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7c273b36-7e0f-4f70-af04-c7b80b67a040 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:10.860759 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7c273b36-7e0f-4f70-af04-c7b80b67a040 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:10.867815 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7c273b36-7e0f-4f70-af04-c7b80b67a040 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1358 microversion: 2.75 time: 0.107140 May 21 21:11:10.868411 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 159/337] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:10 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1358 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:11:11.163549 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-52a004bc-1ed1-408a-a091-639b058212e2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1958951764", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:11.231970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-52a004bc-1ed1-408a-a091-639b058212e2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] validate_networks() for None {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:11:11.464480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b3ac959b-d702-412e-8534-2d00303e6ba7 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Calling method '.version_select at 0x7fc81bccfa60>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:11.466728 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:11:11.466728 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:11:11.469754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3ac959b-d702-412e-8534-2d00303e6ba7 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:11.470686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3ac959b-d702-412e-8534-2d00303e6ba7 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:11.503373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3ac959b-d702-412e-8534-2d00303e6ba7 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:11.504751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3ac959b-d702-412e-8534-2d00303e6ba7 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:11.543712 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3ac959b-d702-412e-8534-2d00303e6ba7 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:11.543712 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3ac959b-d702-412e-8534-2d00303e6ba7 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:11.554555 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b3ac959b-d702-412e-8534-2d00303e6ba7 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.577559 May 21 21:11:11.555594 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 160/338] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:11:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:11:11.576945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-20ed347d-ff6f-45e1-be3e-cc9a0350321d tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Calling method '.version_select at 0x7fc81be0e670>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:11.581033 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:11:11.581033 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:11:11.581033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20ed347d-ff6f-45e1-be3e-cc9a0350321d tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:11.581033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20ed347d-ff6f-45e1-be3e-cc9a0350321d tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:11.607855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20ed347d-ff6f-45e1-be3e-cc9a0350321d tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:11.610325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20ed347d-ff6f-45e1-be3e-cc9a0350321d tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:11.620769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-52a004bc-1ed1-408a-a091-639b058212e2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:11:11.621195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-52a004bc-1ed1-408a-a091-639b058212e2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:11:11.622154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-52a004bc-1ed1-408a-a091-639b058212e2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:11:11.622890 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-52a004bc-1ed1-408a-a091-639b058212e2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:11:11.623627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-52a004bc-1ed1-408a-a091-639b058212e2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:11:11.630339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:UPDATE=2,nova_api:DELETE=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:11.634509 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20ed347d-ff6f-45e1-be3e-cc9a0350321d tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:11.635209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20ed347d-ff6f-45e1-be3e-cc9a0350321d tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:11.644444 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-20ed347d-ff6f-45e1-be3e-cc9a0350321d tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.082048 May 21 21:11:11.644596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-52a004bc-1ed1-408a-a091-639b058212e2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:11.644969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-52a004bc-1ed1-408a-a091-639b058212e2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:11.645824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-52a004bc-1ed1-408a-a091-639b058212e2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:11.646263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-52a004bc-1ed1-408a-a091-639b058212e2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:11.647511 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 161/339] 10.222.0.49 () {58 vars in 1166 bytes} [Sat May 21 21:11:11 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:11.653626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e0ba4052-ce82-42f1-a941-22742e76e6c2 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:11.654898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e0ba4052-ce82-42f1-a941-22742e76e6c2 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:11.670059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0ba4052-ce82-42f1-a941-22742e76e6c2 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:11.670781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0ba4052-ce82-42f1-a941-22742e76e6c2 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:11.672238 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0ba4052-ce82-42f1-a941-22742e76e6c2 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:11.672834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0ba4052-ce82-42f1-a941-22742e76e6c2 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:11.695277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-52a004bc-1ed1-408a-a091-639b058212e2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Getting quotas for project 3cdfab8428a54520a01fdde7222835be. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:11:11.699418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-52a004bc-1ed1-408a-a091-639b058212e2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Getting quotas for user c3d9543f794d40be9c24715bf530add3 and project 3cdfab8428a54520a01fdde7222835be. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:11:11.711873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-52a004bc-1ed1-408a-a091-639b058212e2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:11:11.714244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-52a004bc-1ed1-408a-a091-639b058212e2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:11:11.900610 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-52a004bc-1ed1-408a-a091-639b058212e2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.178914 May 21 21:11:11.901456 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 179/340] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:11:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:11:11.906082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-755f6fcf-5a02-40dc-ae2e-0a92194db981 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Calling method '.version_select at 0x7fc81bd0a4c0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:11.906881 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:11:11.906881 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:11:11.908380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-755f6fcf-5a02-40dc-ae2e-0a92194db981 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:11.908833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-755f6fcf-5a02-40dc-ae2e-0a92194db981 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:11.958215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-755f6fcf-5a02-40dc-ae2e-0a92194db981 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:11.958687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-755f6fcf-5a02-40dc-ae2e-0a92194db981 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:11.971448 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e0ba4052-ce82-42f1-a941-22742e76e6c2 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:11.981542 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e0ba4052-ce82-42f1-a941-22742e76e6c2 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3" status: 200 len: 1323 microversion: 2.1 time: 0.332807 May 21 21:11:11.985139 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 162/341] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:11 2022] GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3 => generated 1323 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:11.985848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-755f6fcf-5a02-40dc-ae2e-0a92194db981 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:11.986324 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-755f6fcf-5a02-40dc-ae2e-0a92194db981 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:11.992833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8253613f-d797-4ccc-ada6-61350fc1d1fd tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:11.993671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8253613f-d797-4ccc-ada6-61350fc1d1fd tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:11.993788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:11.997578 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-755f6fcf-5a02-40dc-ae2e-0a92194db981 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.095139 May 21 21:11:11.998180 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 180/342] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:11:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:12.017790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8253613f-d797-4ccc-ada6-61350fc1d1fd tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:12.017790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8253613f-d797-4ccc-ada6-61350fc1d1fd tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:12.017790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8253613f-d797-4ccc-ada6-61350fc1d1fd tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:12.018633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8253613f-d797-4ccc-ada6-61350fc1d1fd tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:12.027046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7f16aecc-ef09-4a55-92ac-f41845938184 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:12.027672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7f16aecc-ef09-4a55-92ac-f41845938184 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:12.117723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7f16aecc-ef09-4a55-92ac-f41845938184 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:12.126945 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7f16aecc-ef09-4a55-92ac-f41845938184 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1213 microversion: 2.1 time: 0.114034 May 21 21:11:12.127524 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 181/343] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:11 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1213 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:12.135513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a761dfcd-f2b1-4965-8680-92b97e0c201b tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Calling method '.version_select at 0x7fc81bd72700>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:12.136363 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:11:12.136363 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:11:12.141313 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a761dfcd-f2b1-4965-8680-92b97e0c201b tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:12.142079 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a761dfcd-f2b1-4965-8680-92b97e0c201b tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:12.165821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a761dfcd-f2b1-4965-8680-92b97e0c201b tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:12.166271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a761dfcd-f2b1-4965-8680-92b97e0c201b tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:12.189857 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a761dfcd-f2b1-4965-8680-92b97e0c201b tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.049891 May 21 21:11:12.192832 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 182/344] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:11:12 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:12.205467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-add4fb72-c97a-476e-984e-83bad58a72dc tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Calling method '.version_select at 0x7fc81bd0aca0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:12.206286 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:11:12.206286 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:11:12.208462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-add4fb72-c97a-476e-984e-83bad58a72dc tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:12.208920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-add4fb72-c97a-476e-984e-83bad58a72dc tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:12.231427 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-add4fb72-c97a-476e-984e-83bad58a72dc tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.029626 May 21 21:11:12.232045 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 183/345] 10.222.0.49 () {58 vars in 1178 bytes} [Sat May 21 21:11:12 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:12.245331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d5d6f7ab-dbf1-46ed-af83-df7c0d7d5a22 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Calling method '.version_select at 0x7fc81bd0a550>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:12.246616 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:11:12.246616 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:11:12.248265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5d6f7ab-dbf1-46ed-af83-df7c0d7d5a22 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:12.249123 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5d6f7ab-dbf1-46ed-af83-df7c0d7d5a22 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:12.264968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5d6f7ab-dbf1-46ed-af83-df7c0d7d5a22 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:12.265706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5d6f7ab-dbf1-46ed-af83-df7c0d7d5a22 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:12.286712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5d6f7ab-dbf1-46ed-af83-df7c0d7d5a22 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:12.290497 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5d6f7ab-dbf1-46ed-af83-df7c0d7d5a22 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:12.300808 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d5d6f7ab-dbf1-46ed-af83-df7c0d7d5a22 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.059983 May 21 21:11:12.301887 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 184/346] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:11:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:12.311137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9c61d8d6-bc8d-4df0-adeb-82db8f9907e3 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Calling method '.version_select at 0x7fc81bd0a790>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:12.311871 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:11:12.311871 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:11:12.313106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c61d8d6-bc8d-4df0-adeb-82db8f9907e3 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:12.314906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c61d8d6-bc8d-4df0-adeb-82db8f9907e3 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:12.325551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8253613f-d797-4ccc-ada6-61350fc1d1fd tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:12.341392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8253613f-d797-4ccc-ada6-61350fc1d1fd tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:12.342685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8253613f-d797-4ccc-ada6-61350fc1d1fd tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:12.356894 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8253613f-d797-4ccc-ada6-61350fc1d1fd tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1362 microversion: 2.75 time: 0.369069 May 21 21:11:12.357289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c61d8d6-bc8d-4df0-adeb-82db8f9907e3 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:12.357904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c61d8d6-bc8d-4df0-adeb-82db8f9907e3 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:12.358686 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 163/347] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:11 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1362 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:12.376183 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9c61d8d6-bc8d-4df0-adeb-82db8f9907e3 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.068907 May 21 21:11:12.376853 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 185/348] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:11:12 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:11:12.389634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c1f3e93c-bd3b-469b-9148-063483bc7ac0 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Calling method '.version_select at 0x7fc81bccfe50>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:12.390693 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:11:12.390693 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:11:12.392811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1f3e93c-bd3b-469b-9148-063483bc7ac0 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:12.393510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1f3e93c-bd3b-469b-9148-063483bc7ac0 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:12.411723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1f3e93c-bd3b-469b-9148-063483bc7ac0 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:12.412527 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1f3e93c-bd3b-469b-9148-063483bc7ac0 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:12.423874 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c1f3e93c-bd3b-469b-9148-063483bc7ac0 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.038256 May 21 21:11:12.433633 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 164/349] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:11:12 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:12.438147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-839f4114-24a6-41e5-bdb1-2f1057d70392 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Calling method '.version_select at 0x7fc81bd0a160>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:12.439022 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:11:12.439022 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:11:12.443277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-839f4114-24a6-41e5-bdb1-2f1057d70392 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:12.443930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-839f4114-24a6-41e5-bdb1-2f1057d70392 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:12.467047 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-839f4114-24a6-41e5-bdb1-2f1057d70392 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:12.467511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-839f4114-24a6-41e5-bdb1-2f1057d70392 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:12.488680 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-839f4114-24a6-41e5-bdb1-2f1057d70392 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:12.489324 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-839f4114-24a6-41e5-bdb1-2f1057d70392 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:12.533800 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-839f4114-24a6-41e5-bdb1-2f1057d70392 tempest-HypervisorAdminTestJSON-389450554 tempest-HypervisorAdminTestJSON-389450554-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.098971 May 21 21:11:12.535539 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 186/350] 10.222.0.49 () {58 vars in 1172 bytes} [Sat May 21 21:11:12 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:12.802252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-f4722ed2-d169-4ba1-8bec-69c56a136a8c req-b19678e2-4c86-47d7-a575-ae5ee074be7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3935c27-84ef-41ff-adbf-9e4b29eea5d3", "tag": "a3199f1f-7536-444f-ab94-2847aeee7a78"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:12.813727 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f4722ed2-d169-4ba1-8bec-69c56a136a8c req-b19678e2-4c86-47d7-a575-ae5ee074be7f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:12.814484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f4722ed2-d169-4ba1-8bec-69c56a136a8c req-b19678e2-4c86-47d7-a575-ae5ee074be7f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:12.885133 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-f4722ed2-d169-4ba1-8bec-69c56a136a8c req-b19678e2-4c86-47d7-a575-ae5ee074be7f service nova] Creating event network-changed:a3199f1f-7536-444f-ab94-2847aeee7a78 for instance c3935c27-84ef-41ff-adbf-9e4b29eea5d3 on nch2-master-1 May 21 21:11:12.896002 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-f4722ed2-d169-4ba1-8bec-69c56a136a8c req-b19678e2-4c86-47d7-a575-ae5ee074be7f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098310 May 21 21:11:12.901178 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 165/351] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:13.005915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f59935f1-7963-4f95-8950-8ab5448b5bc3 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:13.007846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f59935f1-7963-4f95-8950-8ab5448b5bc3 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:13.028961 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f59935f1-7963-4f95-8950-8ab5448b5bc3 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:13.033067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f59935f1-7963-4f95-8950-8ab5448b5bc3 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:13.035135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f59935f1-7963-4f95-8950-8ab5448b5bc3 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:13.036341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f59935f1-7963-4f95-8950-8ab5448b5bc3 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:13.145869 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8eacf31b-3167-450d-87f1-a3d226913711 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:13.147553 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8eacf31b-3167-450d-87f1-a3d226913711 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:13.403202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8eacf31b-3167-450d-87f1-a3d226913711 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:13.414244 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8eacf31b-3167-450d-87f1-a3d226913711 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1213 microversion: 2.1 time: 0.273410 May 21 21:11:13.425120 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 166/352] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:13 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1213 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:13.433566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f59935f1-7963-4f95-8950-8ab5448b5bc3 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:13.433758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-441137e4-2572-4394-bb37-64e38f262d0a tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:13.433758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-441137e4-2572-4394-bb37-64e38f262d0a tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:13.441292 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-441137e4-2572-4394-bb37-64e38f262d0a tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:13.442229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-441137e4-2572-4394-bb37-64e38f262d0a tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:13.443344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-441137e4-2572-4394-bb37-64e38f262d0a tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:13.443978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-441137e4-2572-4394-bb37-64e38f262d0a tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:13.444230 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f59935f1-7963-4f95-8950-8ab5448b5bc3 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3" status: 200 len: 1323 microversion: 2.1 time: 0.443816 May 21 21:11:13.445386 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 187/353] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:12 2022] GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3 => generated 1323 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:13.906698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-441137e4-2572-4394-bb37-64e38f262d0a tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:13.916511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-441137e4-2572-4394-bb37-64e38f262d0a tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:13.927081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-441137e4-2572-4394-bb37-64e38f262d0a tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:13.933871 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-441137e4-2572-4394-bb37-64e38f262d0a tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1418 microversion: 2.75 time: 0.507284 May 21 21:11:13.934519 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 167/354] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:13 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1418 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:14.434767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b2543ff7-6606-457e-83fa-a1bf289851fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:14.435365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b2543ff7-6606-457e-83fa-a1bf289851fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:14.443182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2543ff7-6606-457e-83fa-a1bf289851fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:14.443643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2543ff7-6606-457e-83fa-a1bf289851fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:14.444483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2543ff7-6606-457e-83fa-a1bf289851fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:14.444928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2543ff7-6606-457e-83fa-a1bf289851fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:14.461830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-059305b5-e9aa-422d-8be9-5c505140da88 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:14.462459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-059305b5-e9aa-422d-8be9-5c505140da88 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:14.473927 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-059305b5-e9aa-422d-8be9-5c505140da88 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:14.474391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-059305b5-e9aa-422d-8be9-5c505140da88 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:14.475203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-059305b5-e9aa-422d-8be9-5c505140da88 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:14.475702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-059305b5-e9aa-422d-8be9-5c505140da88 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:14.588758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b2543ff7-6606-457e-83fa-a1bf289851fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:14.600549 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b2543ff7-6606-457e-83fa-a1bf289851fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1265 microversion: 2.1 time: 0.169584 May 21 21:11:14.601684 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 188/355] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:14 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:14.670551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-059305b5-e9aa-422d-8be9-5c505140da88 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:14.678305 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-059305b5-e9aa-422d-8be9-5c505140da88 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3" status: 200 len: 1323 microversion: 2.1 time: 0.220543 May 21 21:11:14.688031 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 168/356] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:14 2022] GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3 => generated 1323 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:11:14.955754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-825a2b87-8020-4bfb-b613-80eef61b39b9 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:14.955754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-825a2b87-8020-4bfb-b613-80eef61b39b9 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:14.964848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-825a2b87-8020-4bfb-b613-80eef61b39b9 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:14.969877 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-825a2b87-8020-4bfb-b613-80eef61b39b9 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:14.970789 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-825a2b87-8020-4bfb-b613-80eef61b39b9 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:14.971836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-825a2b87-8020-4bfb-b613-80eef61b39b9 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:15.116430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-825a2b87-8020-4bfb-b613-80eef61b39b9 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:15.127490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-825a2b87-8020-4bfb-b613-80eef61b39b9 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:15.129948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-825a2b87-8020-4bfb-b613-80eef61b39b9 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:15.138639 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-825a2b87-8020-4bfb-b613-80eef61b39b9 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1416 microversion: 2.75 time: 0.187961 May 21 21:11:15.148092 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 189/357] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:14 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1416 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:15.623181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c792d055-ed2b-4773-9f6e-91e00fc88098 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:15.623803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c792d055-ed2b-4773-9f6e-91e00fc88098 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:15.634131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c792d055-ed2b-4773-9f6e-91e00fc88098 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:15.634587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c792d055-ed2b-4773-9f6e-91e00fc88098 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:15.635376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c792d055-ed2b-4773-9f6e-91e00fc88098 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:15.635824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c792d055-ed2b-4773-9f6e-91e00fc88098 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:15.696161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e2c42c17-607e-4bef-a38a-ed7ebe42d17a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:15.697376 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e2c42c17-607e-4bef-a38a-ed7ebe42d17a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:15.704068 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e2c42c17-607e-4bef-a38a-ed7ebe42d17a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:15.710275 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e2c42c17-607e-4bef-a38a-ed7ebe42d17a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:15.710275 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e2c42c17-607e-4bef-a38a-ed7ebe42d17a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:15.710275 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e2c42c17-607e-4bef-a38a-ed7ebe42d17a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:15.771184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c792d055-ed2b-4773-9f6e-91e00fc88098 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:15.780077 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c792d055-ed2b-4773-9f6e-91e00fc88098 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1265 microversion: 2.1 time: 0.160932 May 21 21:11:15.789777 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 169/358] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:15 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:16.004757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e2c42c17-607e-4bef-a38a-ed7ebe42d17a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:16.013719 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e2c42c17-607e-4bef-a38a-ed7ebe42d17a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3" status: 200 len: 1323 microversion: 2.1 time: 0.321828 May 21 21:11:16.017081 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 190/359] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:15 2022] GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3 => generated 1323 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:16.162391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0d42e116-f0d8-4a57-9757-c0fe7340aef9 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:16.163016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0d42e116-f0d8-4a57-9757-c0fe7340aef9 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:16.172524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d42e116-f0d8-4a57-9757-c0fe7340aef9 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:16.183830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d42e116-f0d8-4a57-9757-c0fe7340aef9 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:16.184913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d42e116-f0d8-4a57-9757-c0fe7340aef9 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:16.185418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d42e116-f0d8-4a57-9757-c0fe7340aef9 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:16.352225 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0d42e116-f0d8-4a57-9757-c0fe7340aef9 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:16.361098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0d42e116-f0d8-4a57-9757-c0fe7340aef9 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:16.379135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0d42e116-f0d8-4a57-9757-c0fe7340aef9 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:16.385677 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0d42e116-f0d8-4a57-9757-c0fe7340aef9 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1437 microversion: 2.75 time: 0.230507 May 21 21:11:16.400738 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 170/360] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:16 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1437 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:16.415824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7c344a71-3953-43af-8d08-b1c4a216365b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:16.417384 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7c344a71-3953-43af-8d08-b1c4a216365b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:16.424319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c344a71-3953-43af-8d08-b1c4a216365b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:16.425807 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c344a71-3953-43af-8d08-b1c4a216365b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:16.427177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c344a71-3953-43af-8d08-b1c4a216365b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:16.427623 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c344a71-3953-43af-8d08-b1c4a216365b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:16.536443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-7c344a71-3953-43af-8d08-b1c4a216365b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:11:16.537185 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-7c344a71-3953-43af-8d08-b1c4a216365b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:11:16.537989 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-7c344a71-3953-43af-8d08-b1c4a216365b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:11:16.538579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-7c344a71-3953-43af-8d08-b1c4a216365b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:11:16.539172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-7c344a71-3953-43af-8d08-b1c4a216365b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:11:16.811412 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9841c177-6a95-47ab-b694-11032141f18a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:16.813025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9841c177-6a95-47ab-b694-11032141f18a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:16.829287 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9841c177-6a95-47ab-b694-11032141f18a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:16.833943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9841c177-6a95-47ab-b694-11032141f18a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:16.835056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9841c177-6a95-47ab-b694-11032141f18a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:16.838121 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9841c177-6a95-47ab-b694-11032141f18a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:16.890141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7c344a71-3953-43af-8d08-b1c4a216365b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:16.910998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c344a71-3953-43af-8d08-b1c4a216365b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:16.911784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c344a71-3953-43af-8d08-b1c4a216365b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:16.916067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c344a71-3953-43af-8d08-b1c4a216365b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:16.920217 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c344a71-3953-43af-8d08-b1c4a216365b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:17.106911 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9841c177-6a95-47ab-b694-11032141f18a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:17.111303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7c344a71-3953-43af-8d08-b1c4a216365b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:17.119025 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9841c177-6a95-47ab-b694-11032141f18a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1271 microversion: 2.1 time: 0.317091 May 21 21:11:17.128971 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 171/361] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:16 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1271 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:11:17.136682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b40edeca-22c5-4bf9-b387-a6c5eb8ada31 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:17.139766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b40edeca-22c5-4bf9-b387-a6c5eb8ada31 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:17.155224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b40edeca-22c5-4bf9-b387-a6c5eb8ada31 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:17.155741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b40edeca-22c5-4bf9-b387-a6c5eb8ada31 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:17.163362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b40edeca-22c5-4bf9-b387-a6c5eb8ada31 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:17.163809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7c344a71-3953-43af-8d08-b1c4a216365b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:17.163955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b40edeca-22c5-4bf9-b387-a6c5eb8ada31 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:17.167830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7c344a71-3953-43af-8d08-b1c4a216365b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:17.177874 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7c344a71-3953-43af-8d08-b1c4a216365b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "POST /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a/action" status: 202 len: 1494 microversion: 2.75 time: 0.765474 May 21 21:11:17.178640 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 191/362] 10.222.0.49 () {62 vars in 1318 bytes} [Sat May 21 21:11:16 2022] POST /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a/action => generated 1494 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 21 21:11:17.200101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f5daf65b-b30b-4d32-b5fb-6b7e71d2b582 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:17.200835 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f5daf65b-b30b-4d32-b5fb-6b7e71d2b582 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:17.215617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5daf65b-b30b-4d32-b5fb-6b7e71d2b582 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:17.216632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5daf65b-b30b-4d32-b5fb-6b7e71d2b582 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:17.225142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5daf65b-b30b-4d32-b5fb-6b7e71d2b582 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:17.226080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5daf65b-b30b-4d32-b5fb-6b7e71d2b582 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:17.356749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f5daf65b-b30b-4d32-b5fb-6b7e71d2b582 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:17.384976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f5daf65b-b30b-4d32-b5fb-6b7e71d2b582 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:17.387204 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f5daf65b-b30b-4d32-b5fb-6b7e71d2b582 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:17.396087 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f5daf65b-b30b-4d32-b5fb-6b7e71d2b582 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1446 microversion: 2.75 time: 0.201311 May 21 21:11:17.402499 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 192/363] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:17 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1446 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:17.573897 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b40edeca-22c5-4bf9-b387-a6c5eb8ada31 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:17.585926 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b40edeca-22c5-4bf9-b387-a6c5eb8ada31 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3" status: 200 len: 1323 microversion: 2.1 time: 0.454112 May 21 21:11:17.594022 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 172/364] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:17 2022] GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3 => generated 1323 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:18.140930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-21bea5e4-5f8f-46bd-bc29-2ee78897c8fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:18.142214 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-21bea5e4-5f8f-46bd-bc29-2ee78897c8fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:18.151076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21bea5e4-5f8f-46bd-bc29-2ee78897c8fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:18.151933 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21bea5e4-5f8f-46bd-bc29-2ee78897c8fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:18.153678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21bea5e4-5f8f-46bd-bc29-2ee78897c8fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:18.155953 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21bea5e4-5f8f-46bd-bc29-2ee78897c8fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:18.345327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-21bea5e4-5f8f-46bd-bc29-2ee78897c8fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:18.358049 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-21bea5e4-5f8f-46bd-bc29-2ee78897c8fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1271 microversion: 2.1 time: 0.220866 May 21 21:11:18.359441 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 193/365] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:18 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1271 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:18.417907 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a46e845e-5d56-4501-a67a-addda598ccaf tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:18.419240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a46e845e-5d56-4501-a67a-addda598ccaf tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:18.426351 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a46e845e-5d56-4501-a67a-addda598ccaf tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:18.427098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a46e845e-5d56-4501-a67a-addda598ccaf tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:18.428616 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a46e845e-5d56-4501-a67a-addda598ccaf tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:18.429284 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a46e845e-5d56-4501-a67a-addda598ccaf tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:18.601035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-71683b61-c73d-4c4f-b7c7-7b881b222b3a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:18.601674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-71683b61-c73d-4c4f-b7c7-7b881b222b3a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:18.609863 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-71683b61-c73d-4c4f-b7c7-7b881b222b3a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:18.610325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-71683b61-c73d-4c4f-b7c7-7b881b222b3a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:18.611125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-71683b61-c73d-4c4f-b7c7-7b881b222b3a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:18.611571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-71683b61-c73d-4c4f-b7c7-7b881b222b3a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:18.793438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a46e845e-5d56-4501-a67a-addda598ccaf tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:18.803874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a46e845e-5d56-4501-a67a-addda598ccaf tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:18.806828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a46e845e-5d56-4501-a67a-addda598ccaf tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:18.814867 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a46e845e-5d56-4501-a67a-addda598ccaf tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1446 microversion: 2.75 time: 0.401278 May 21 21:11:18.825397 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 173/366] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:18 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1446 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:19.092381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-71683b61-c73d-4c4f-b7c7-7b881b222b3a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:19.116354 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-71683b61-c73d-4c4f-b7c7-7b881b222b3a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3" status: 200 len: 1323 microversion: 2.1 time: 0.519219 May 21 21:11:19.121325 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 194/367] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:18 2022] GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3 => generated 1323 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:11:19.375139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fef8af13-c3c7-404c-9377-b47b2ade90a3 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:19.375776 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fef8af13-c3c7-404c-9377-b47b2ade90a3 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:19.385295 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fef8af13-c3c7-404c-9377-b47b2ade90a3 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:19.397417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fef8af13-c3c7-404c-9377-b47b2ade90a3 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:19.398286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fef8af13-c3c7-404c-9377-b47b2ade90a3 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:19.398737 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fef8af13-c3c7-404c-9377-b47b2ade90a3 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:19.624224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-cf3cbfec-324f-42b5-84c0-64f7319deace req-f900114d-89a0-4b44-937c-d84b6749170e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3935c27-84ef-41ff-adbf-9e4b29eea5d3", "name": "network-vif-plugged", "status": "completed", "tag": "a3199f1f-7536-444f-ab94-2847aeee7a78"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:19.645072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cf3cbfec-324f-42b5-84c0-64f7319deace req-f900114d-89a0-4b44-937c-d84b6749170e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:19.645520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cf3cbfec-324f-42b5-84c0-64f7319deace req-f900114d-89a0-4b44-937c-d84b6749170e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:19.662758 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-cf3cbfec-324f-42b5-84c0-64f7319deace req-f900114d-89a0-4b44-937c-d84b6749170e service nova] Creating event network-vif-plugged:a3199f1f-7536-444f-ab94-2847aeee7a78 for instance c3935c27-84ef-41ff-adbf-9e4b29eea5d3 on nch2-master-1 May 21 21:11:19.671347 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-cf3cbfec-324f-42b5-84c0-64f7319deace req-f900114d-89a0-4b44-937c-d84b6749170e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049912 May 21 21:11:19.679656 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 195/368] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:19.839699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9535f114-bf9f-4d23-bf30-2ee84d92b2cf tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:19.840432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9535f114-bf9f-4d23-bf30-2ee84d92b2cf tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:19.858555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9535f114-bf9f-4d23-bf30-2ee84d92b2cf tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:19.859017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9535f114-bf9f-4d23-bf30-2ee84d92b2cf tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:19.859821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9535f114-bf9f-4d23-bf30-2ee84d92b2cf tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:19.860306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9535f114-bf9f-4d23-bf30-2ee84d92b2cf tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:20.039043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9535f114-bf9f-4d23-bf30-2ee84d92b2cf tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:20.055357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9535f114-bf9f-4d23-bf30-2ee84d92b2cf tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:20.058924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9535f114-bf9f-4d23-bf30-2ee84d92b2cf tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:20.080122 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9535f114-bf9f-4d23-bf30-2ee84d92b2cf tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1446 microversion: 2.75 time: 0.244599 May 21 21:11:20.080814 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 196/369] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:19 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1446 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:11:20.139231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b56d35c4-182a-4d98-a960-f765a3e77f14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:20.139761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b56d35c4-182a-4d98-a960-f765a3e77f14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:20.147058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b56d35c4-182a-4d98-a960-f765a3e77f14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:20.151124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b56d35c4-182a-4d98-a960-f765a3e77f14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:20.152146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b56d35c4-182a-4d98-a960-f765a3e77f14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:20.154122 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b56d35c4-182a-4d98-a960-f765a3e77f14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:20.231685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fef8af13-c3c7-404c-9377-b47b2ade90a3 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:20.239724 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fef8af13-c3c7-404c-9377-b47b2ade90a3 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1313 microversion: 2.1 time: 0.868434 May 21 21:11:20.257886 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 174/370] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:19 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1313 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:20.847215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b56d35c4-182a-4d98-a960-f765a3e77f14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:20.859493 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b56d35c4-182a-4d98-a960-f765a3e77f14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3" status: 200 len: 1323 microversion: 2.1 time: 0.724897 May 21 21:11:20.863664 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 197/371] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:20 2022] GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3 => generated 1323 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:21.100047 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-418b1383-456c-4683-ad14-dab3cfb7038e tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:21.100982 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-418b1383-456c-4683-ad14-dab3cfb7038e tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:21.103358 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:21.119812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-418b1383-456c-4683-ad14-dab3cfb7038e tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:21.120274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-418b1383-456c-4683-ad14-dab3cfb7038e tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:21.121129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-418b1383-456c-4683-ad14-dab3cfb7038e tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:21.121662 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-418b1383-456c-4683-ad14-dab3cfb7038e tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:21.212579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-418b1383-456c-4683-ad14-dab3cfb7038e tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:21.225196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-418b1383-456c-4683-ad14-dab3cfb7038e tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:21.230198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-418b1383-456c-4683-ad14-dab3cfb7038e tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:21.245986 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-418b1383-456c-4683-ad14-dab3cfb7038e tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1446 microversion: 2.75 time: 0.150767 May 21 21:11:21.246673 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 175/372] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:21 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1446 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:21.266390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-38938774-76de-4e92-a80c-271a60f496f0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:21.267348 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-38938774-76de-4e92-a80c-271a60f496f0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:21.276870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38938774-76de-4e92-a80c-271a60f496f0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:21.277609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38938774-76de-4e92-a80c-271a60f496f0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:21.278741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38938774-76de-4e92-a80c-271a60f496f0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:21.280580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38938774-76de-4e92-a80c-271a60f496f0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:21.286291 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:21.638731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-abc3e3fb-ee9f-4ea8-9b1b-ff555c118113 req-8b437a88-7a82-4c3d-9d43-ae0823c6230a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d5f184-08de-44c5-bd8c-051f64fe06fa", "tag": "15fa1734-3d96-43ae-a8b4-3a89b9859f45"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:21.663698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-abc3e3fb-ee9f-4ea8-9b1b-ff555c118113 req-8b437a88-7a82-4c3d-9d43-ae0823c6230a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:21.664162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-abc3e3fb-ee9f-4ea8-9b1b-ff555c118113 req-8b437a88-7a82-4c3d-9d43-ae0823c6230a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:21.676720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:21.708654 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-abc3e3fb-ee9f-4ea8-9b1b-ff555c118113 req-8b437a88-7a82-4c3d-9d43-ae0823c6230a service nova] Creating event network-changed:15fa1734-3d96-43ae-a8b4-3a89b9859f45 for instance 06d5f184-08de-44c5-bd8c-051f64fe06fa on nch1-master-1 May 21 21:11:21.735491 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-abc3e3fb-ee9f-4ea8-9b1b-ff555c118113 req-8b437a88-7a82-4c3d-9d43-ae0823c6230a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105829 May 21 21:11:21.738492 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 176/373] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:21.856531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-38938774-76de-4e92-a80c-271a60f496f0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:21.884825 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-38938774-76de-4e92-a80c-271a60f496f0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1313 microversion: 2.1 time: 0.623408 May 21 21:11:21.888095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d10b4f40-1424-44b6-ad56-2d97da0617fa tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:21.889151 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d10b4f40-1424-44b6-ad56-2d97da0617fa tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:21.899622 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 198/374] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:21 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1313 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:21.930799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d10b4f40-1424-44b6-ad56-2d97da0617fa tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:21.934008 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d10b4f40-1424-44b6-ad56-2d97da0617fa tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:21.952572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d10b4f40-1424-44b6-ad56-2d97da0617fa tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:21.953122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d10b4f40-1424-44b6-ad56-2d97da0617fa tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:22.265302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f00cfae3-41a3-47f6-9e6f-d0b90ad3fd34 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:22.266626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f00cfae3-41a3-47f6-9e6f-d0b90ad3fd34 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:22.271933 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=16 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:22.286441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f00cfae3-41a3-47f6-9e6f-d0b90ad3fd34 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:22.287077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f00cfae3-41a3-47f6-9e6f-d0b90ad3fd34 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:22.288973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f00cfae3-41a3-47f6-9e6f-d0b90ad3fd34 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:22.290503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f00cfae3-41a3-47f6-9e6f-d0b90ad3fd34 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:22.477199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d10b4f40-1424-44b6-ad56-2d97da0617fa tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:22.489750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f00cfae3-41a3-47f6-9e6f-d0b90ad3fd34 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:22.492025 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d10b4f40-1424-44b6-ad56-2d97da0617fa tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3" status: 200 len: 1520 microversion: 2.1 time: 0.615499 May 21 21:11:22.502078 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 177/375] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:21 2022] GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3 => generated 1520 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:22.508650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f00cfae3-41a3-47f6-9e6f-d0b90ad3fd34 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:22.512619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dd993eaf-46cb-465e-86ee-3bdc366a9ab2 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Action: 'create', calling method: .version_select at 0x7fc81bcb6820>, body: {"pool": null} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:22.514337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f00cfae3-41a3-47f6-9e6f-d0b90ad3fd34 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:22.526182 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f00cfae3-41a3-47f6-9e6f-d0b90ad3fd34 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1446 microversion: 2.75 time: 0.260934 May 21 21:11:22.533510 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 199/376] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:22 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1446 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:22.929240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1044368f-ace8-47d5-befe-aa89f9cc97a7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:22.930043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1044368f-ace8-47d5-befe-aa89f9cc97a7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:22.948026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1044368f-ace8-47d5-befe-aa89f9cc97a7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:22.951448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1044368f-ace8-47d5-befe-aa89f9cc97a7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:22.955720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1044368f-ace8-47d5-befe-aa89f9cc97a7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:22.957586 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1044368f-ace8-47d5-befe-aa89f9cc97a7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:23.226423 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1044368f-ace8-47d5-befe-aa89f9cc97a7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:23.237868 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1044368f-ace8-47d5-befe-aa89f9cc97a7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1313 microversion: 2.1 time: 0.332485 May 21 21:11:23.260864 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 200/377] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:22 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:23.408064 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=14 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:23.560495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8c1d6a4a-3faf-4141-b525-01b70c0b0e0b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:23.563441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8c1d6a4a-3faf-4141-b525-01b70c0b0e0b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:23.574848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c1d6a4a-3faf-4141-b525-01b70c0b0e0b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:23.575602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c1d6a4a-3faf-4141-b525-01b70c0b0e0b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:23.576680 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c1d6a4a-3faf-4141-b525-01b70c0b0e0b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:23.580776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c1d6a4a-3faf-4141-b525-01b70c0b0e0b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:23.730057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8c1d6a4a-3faf-4141-b525-01b70c0b0e0b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:23.738898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8c1d6a4a-3faf-4141-b525-01b70c0b0e0b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:23.740712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8c1d6a4a-3faf-4141-b525-01b70c0b0e0b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:23.752688 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8c1d6a4a-3faf-4141-b525-01b70c0b0e0b tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1446 microversion: 2.75 time: 0.196944 May 21 21:11:23.755233 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 201/378] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:23 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1446 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:11:24.269159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9a5bf38e-adf4-458f-9627-da53990cd17d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:24.269955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9a5bf38e-adf4-458f-9627-da53990cd17d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:24.277940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:24.279491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a5bf38e-adf4-458f-9627-da53990cd17d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:24.279960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a5bf38e-adf4-458f-9627-da53990cd17d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:24.280768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a5bf38e-adf4-458f-9627-da53990cd17d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:24.284891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a5bf38e-adf4-458f-9627-da53990cd17d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:24.603593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9a5bf38e-adf4-458f-9627-da53990cd17d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:24.616073 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9a5bf38e-adf4-458f-9627-da53990cd17d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1313 microversion: 2.1 time: 0.348852 May 21 21:11:24.617488 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 202/379] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:24 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:24.776653 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a9a319be-5ff4-4bb9-a1d5-4e923d91cc27 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:24.777347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a9a319be-5ff4-4bb9-a1d5-4e923d91cc27 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:24.793237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9a319be-5ff4-4bb9-a1d5-4e923d91cc27 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:24.796030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9a319be-5ff4-4bb9-a1d5-4e923d91cc27 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:24.805937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9a319be-5ff4-4bb9-a1d5-4e923d91cc27 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:24.806410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9a319be-5ff4-4bb9-a1d5-4e923d91cc27 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:24.989066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a9a319be-5ff4-4bb9-a1d5-4e923d91cc27 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:25.001394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a9a319be-5ff4-4bb9-a1d5-4e923d91cc27 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:25.008682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a9a319be-5ff4-4bb9-a1d5-4e923d91cc27 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:25.024962 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a9a319be-5ff4-4bb9-a1d5-4e923d91cc27 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1446 microversion: 2.75 time: 0.253770 May 21 21:11:25.025563 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 203/380] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:24 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1446 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:25.635083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e1f49fbe-ef1a-4d95-85e3-1caab52eb107 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:25.636898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e1f49fbe-ef1a-4d95-85e3-1caab52eb107 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:25.648158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1f49fbe-ef1a-4d95-85e3-1caab52eb107 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:25.649261 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1f49fbe-ef1a-4d95-85e3-1caab52eb107 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:25.650070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1f49fbe-ef1a-4d95-85e3-1caab52eb107 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:25.650698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1f49fbe-ef1a-4d95-85e3-1caab52eb107 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:26.149799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e1f49fbe-ef1a-4d95-85e3-1caab52eb107 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:26.163606 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e1f49fbe-ef1a-4d95-85e3-1caab52eb107 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1313 microversion: 2.1 time: 0.530853 May 21 21:11:26.164744 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 204/381] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:25 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:11:26.317240 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dd993eaf-46cb-465e-86ee-3bdc366a9ab2 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.806873 May 21 21:11:26.330126 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 178/382] 10.222.0.49 () {60 vars in 1169 bytes} [Sat May 21 21:11:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:11:26.333109 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-836b67f5-ebfb-46d7-99dd-18a87e61787c tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:26.335884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-836b67f5-ebfb-46d7-99dd-18a87e61787c tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:26.346214 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-836b67f5-ebfb-46d7-99dd-18a87e61787c tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:26.346702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-836b67f5-ebfb-46d7-99dd-18a87e61787c tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:26.347970 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-836b67f5-ebfb-46d7-99dd-18a87e61787c tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:26.349759 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-836b67f5-ebfb-46d7-99dd-18a87e61787c tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:26.444937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6dbbe3c0-674f-4258-b0a9-21e156bf9b0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1814178312", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:26.457979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-836b67f5-ebfb-46d7-99dd-18a87e61787c tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:26.462105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:26.474676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-836b67f5-ebfb-46d7-99dd-18a87e61787c tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:26.481647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-836b67f5-ebfb-46d7-99dd-18a87e61787c tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:26.497201 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-836b67f5-ebfb-46d7-99dd-18a87e61787c tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1446 microversion: 2.75 time: 0.173687 May 21 21:11:26.501049 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 179/383] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:26 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1446 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:26.565035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-6dbbe3c0-674f-4258-b0a9-21e156bf9b0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] validate_networks() for None {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:11:26.627865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-393a2e8a-41ff-47ff-a6c8-9deefc45f5cf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-936105239", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "4418fa8f-36c6-43c9-9df7-37213ff858a6"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:26.709077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-393a2e8a-41ff-47ff-a6c8-9deefc45f5cf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] validate_networks() for [('4418fa8f-36c6-43c9-9df7-37213ff858a6', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:11:26.863190 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6dbbe3c0-674f-4258-b0a9-21e156bf9b0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:11:26.864549 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6dbbe3c0-674f-4258-b0a9-21e156bf9b0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:11:26.865115 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6dbbe3c0-674f-4258-b0a9-21e156bf9b0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:11:26.865603 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6dbbe3c0-674f-4258-b0a9-21e156bf9b0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:11:26.866093 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6dbbe3c0-674f-4258-b0a9-21e156bf9b0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:11:26.895551 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6dbbe3c0-674f-4258-b0a9-21e156bf9b0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:26.895551 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6dbbe3c0-674f-4258-b0a9-21e156bf9b0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:26.895551 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6dbbe3c0-674f-4258-b0a9-21e156bf9b0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:26.895551 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6dbbe3c0-674f-4258-b0a9-21e156bf9b0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:26.915502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-6dbbe3c0-674f-4258-b0a9-21e156bf9b0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Getting quotas for project a16dae1aa89c4a86ad50273a1b3b08d8. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:11:26.920151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-6dbbe3c0-674f-4258-b0a9-21e156bf9b0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Getting quotas for user 4e7423d4ddfc46e390db2fc5fadac7f9 and project a16dae1aa89c4a86ad50273a1b3b08d8. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:11:26.933269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6dbbe3c0-674f-4258-b0a9-21e156bf9b0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:11:26.935762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6dbbe3c0-674f-4258-b0a9-21e156bf9b0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:11:27.042399 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6dbbe3c0-674f-4258-b0a9-21e156bf9b0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.875863 May 21 21:11:27.070784 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 205/384] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:11:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:11:27.202031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-00c58f1b-b116-4bf7-a34b-c954e1118396 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1441193545", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "d047b92d-2da6-44d2-8e31-01dbad6dd130"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:27.319832 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-00c58f1b-b116-4bf7-a34b-c954e1118396 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] validate_networks() for [('d047b92d-2da6-44d2-8e31-01dbad6dd130', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:11:27.669451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-393a2e8a-41ff-47ff-a6c8-9deefc45f5cf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:11:27.670455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-393a2e8a-41ff-47ff-a6c8-9deefc45f5cf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:11:27.671116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-393a2e8a-41ff-47ff-a6c8-9deefc45f5cf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:11:27.671808 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-393a2e8a-41ff-47ff-a6c8-9deefc45f5cf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:11:27.672553 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-393a2e8a-41ff-47ff-a6c8-9deefc45f5cf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:11:27.697988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-393a2e8a-41ff-47ff-a6c8-9deefc45f5cf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:27.699199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-393a2e8a-41ff-47ff-a6c8-9deefc45f5cf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:27.705882 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-393a2e8a-41ff-47ff-a6c8-9deefc45f5cf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:27.705882 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-393a2e8a-41ff-47ff-a6c8-9deefc45f5cf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:27.749504 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-393a2e8a-41ff-47ff-a6c8-9deefc45f5cf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Getting quotas for project 220204ccbcf443c98a64994f29700ef0. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:11:27.754048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-393a2e8a-41ff-47ff-a6c8-9deefc45f5cf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Getting quotas for user b7199de1e6f04147b197c086ac6cc6fc and project 220204ccbcf443c98a64994f29700ef0. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:11:27.766846 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-393a2e8a-41ff-47ff-a6c8-9deefc45f5cf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:11:27.770309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-393a2e8a-41ff-47ff-a6c8-9deefc45f5cf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:11:27.841221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-00c58f1b-b116-4bf7-a34b-c954e1118396 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:11:27.841645 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-00c58f1b-b116-4bf7-a34b-c954e1118396 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:11:27.842320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-00c58f1b-b116-4bf7-a34b-c954e1118396 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:11:27.842784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-00c58f1b-b116-4bf7-a34b-c954e1118396 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:11:27.843205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-00c58f1b-b116-4bf7-a34b-c954e1118396 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:11:27.855165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00c58f1b-b116-4bf7-a34b-c954e1118396 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:27.855624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00c58f1b-b116-4bf7-a34b-c954e1118396 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:27.856467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00c58f1b-b116-4bf7-a34b-c954e1118396 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:27.857687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00c58f1b-b116-4bf7-a34b-c954e1118396 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:27.877684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-00c58f1b-b116-4bf7-a34b-c954e1118396 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Getting quotas for project 5284da653ac24d73a21e8442609889c9. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:11:27.881801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-00c58f1b-b116-4bf7-a34b-c954e1118396 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Getting quotas for user 34c22f04c3114d46b6b1b1168aa064f5 and project 5284da653ac24d73a21e8442609889c9. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:11:27.893318 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-00c58f1b-b116-4bf7-a34b-c954e1118396 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:11:27.895948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-00c58f1b-b116-4bf7-a34b-c954e1118396 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:11:27.946788 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-393a2e8a-41ff-47ff-a6c8-9deefc45f5cf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.443837 May 21 21:11:27.953073 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 180/385] 10.222.0.49 () {62 vars in 1187 bytes} [Sat May 21 21:11:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1451 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 21 21:11:27.962744 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6f5d9c20-fc8b-4e4a-bc70-25f91b7d2e14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1238739730", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "99d05c9f-92b6-430b-8f33-3ae9f1f2ec0c"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:28.031025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-6f5d9c20-fc8b-4e4a-bc70-25f91b7d2e14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] validate_networks() for [('99d05c9f-92b6-430b-8f33-3ae9f1f2ec0c', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:11:28.143924 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-00c58f1b-b116-4bf7-a34b-c954e1118396 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.064370 May 21 21:11:28.143924 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 206/386] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:11:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:11:28.209634 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cfcd5156-0778-42d8-a930-d18f6e1d93d7 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:28.213479 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cfcd5156-0778-42d8-a930-d18f6e1d93d7 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:28.296231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cfcd5156-0778-42d8-a930-d18f6e1d93d7 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:28.305309 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cfcd5156-0778-42d8-a930-d18f6e1d93d7 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1219 microversion: 2.1 time: 0.163096 May 21 21:11:28.317258 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 207/387] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:28 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1219 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:28.322923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0529753a-4067-4b5c-9a56-0ee38c795c3a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:28.323738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0529753a-4067-4b5c-9a56-0ee38c795c3a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:28.333779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0529753a-4067-4b5c-9a56-0ee38c795c3a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:28.334292 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0529753a-4067-4b5c-9a56-0ee38c795c3a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:28.335094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0529753a-4067-4b5c-9a56-0ee38c795c3a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:28.335528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0529753a-4067-4b5c-9a56-0ee38c795c3a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:28.569043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0529753a-4067-4b5c-9a56-0ee38c795c3a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:28.583138 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0529753a-4067-4b5c-9a56-0ee38c795c3a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1313 microversion: 2.1 time: 0.261201 May 21 21:11:28.589085 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 208/388] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:28 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:28.599808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-624b36de-22d8-4001-8ada-ca48840ebd65 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:28.603460 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-624b36de-22d8-4001-8ada-ca48840ebd65 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:28.622297 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-624b36de-22d8-4001-8ada-ca48840ebd65 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:28.623188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-624b36de-22d8-4001-8ada-ca48840ebd65 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:28.625668 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-624b36de-22d8-4001-8ada-ca48840ebd65 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:28.626957 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-624b36de-22d8-4001-8ada-ca48840ebd65 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:28.730579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-624b36de-22d8-4001-8ada-ca48840ebd65 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:28.750511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-624b36de-22d8-4001-8ada-ca48840ebd65 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:28.756738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-624b36de-22d8-4001-8ada-ca48840ebd65 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:28.776554 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-624b36de-22d8-4001-8ada-ca48840ebd65 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1446 microversion: 2.75 time: 0.185714 May 21 21:11:28.777910 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 209/389] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:28 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1446 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:28.793790 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-65ae033c-beca-47ee-a6d7-ac202bcf8bc2 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:28.794309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-65ae033c-beca-47ee-a6d7-ac202bcf8bc2 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:28.803615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65ae033c-beca-47ee-a6d7-ac202bcf8bc2 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:28.804417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65ae033c-beca-47ee-a6d7-ac202bcf8bc2 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:28.809870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65ae033c-beca-47ee-a6d7-ac202bcf8bc2 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:28.809870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65ae033c-beca-47ee-a6d7-ac202bcf8bc2 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:28.870035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-65ae033c-beca-47ee-a6d7-ac202bcf8bc2 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:11:29.352017 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-65ae033c-beca-47ee-a6d7-ac202bcf8bc2 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "DELETE /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 204 len: 0 microversion: 2.1 time: 0.570093 May 21 21:11:29.352716 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 210/390] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:11:28 2022] DELETE /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:11:29.363345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-20717d4a-babb-4234-9f85-3d3d3a286742 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:29.363606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-20717d4a-babb-4234-9f85-3d3d3a286742 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:29.464651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-20717d4a-babb-4234-9f85-3d3d3a286742 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:29.478912 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-20717d4a-babb-4234-9f85-3d3d3a286742 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:29.480531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-20717d4a-babb-4234-9f85-3d3d3a286742 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:29.482280 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-20717d4a-babb-4234-9f85-3d3d3a286742 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1261 microversion: 2.25 time: 0.126301 May 21 21:11:29.486459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-6f5d9c20-fc8b-4e4a-bc70-25f91b7d2e14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:11:29.487517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-6f5d9c20-fc8b-4e4a-bc70-25f91b7d2e14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:11:29.487973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-6f5d9c20-fc8b-4e4a-bc70-25f91b7d2e14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:11:29.488109 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 211/391] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:29 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1261 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:29.493331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-6f5d9c20-fc8b-4e4a-bc70-25f91b7d2e14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:11:29.493331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-6f5d9c20-fc8b-4e4a-bc70-25f91b7d2e14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:11:29.499754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-15590cb5-4d59-4d19-b7a1-0670fa0bf31f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:29.502658 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-15590cb5-4d59-4d19-b7a1-0670fa0bf31f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:29.503303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f5d9c20-fc8b-4e4a-bc70-25f91b7d2e14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:29.503768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f5d9c20-fc8b-4e4a-bc70-25f91b7d2e14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:29.506051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f5d9c20-fc8b-4e4a-bc70-25f91b7d2e14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:29.506544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f5d9c20-fc8b-4e4a-bc70-25f91b7d2e14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:29.550657 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-6f5d9c20-fc8b-4e4a-bc70-25f91b7d2e14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Getting quotas for project 4c99e1f900034d42bbb1a786b225a230. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:11:29.560952 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-6f5d9c20-fc8b-4e4a-bc70-25f91b7d2e14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Getting quotas for user 74f296ea42634e18ad82ee175408c641 and project 4c99e1f900034d42bbb1a786b225a230. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:11:29.583131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6f5d9c20-fc8b-4e4a-bc70-25f91b7d2e14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:11:29.587765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6f5d9c20-fc8b-4e4a-bc70-25f91b7d2e14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:11:29.624251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-15590cb5-4d59-4d19-b7a1-0670fa0bf31f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:29.632999 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-15590cb5-4d59-4d19-b7a1-0670fa0bf31f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1211 microversion: 2.1 time: 0.143642 May 21 21:11:29.633590 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 212/392] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:29 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1211 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:29.639868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4f67167e-528b-47e0-8aca-b7508bb7dbc3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:29.641784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4f67167e-528b-47e0-8aca-b7508bb7dbc3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:29.650755 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f67167e-528b-47e0-8aca-b7508bb7dbc3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:29.651203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f67167e-528b-47e0-8aca-b7508bb7dbc3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:29.651966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f67167e-528b-47e0-8aca-b7508bb7dbc3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:29.652444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f67167e-528b-47e0-8aca-b7508bb7dbc3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:29.747637 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6f5d9c20-fc8b-4e4a-bc70-25f91b7d2e14 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.789121 May 21 21:11:29.748716 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 181/393] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:11:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:11:29.754337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4f67167e-528b-47e0-8aca-b7508bb7dbc3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:29.763572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d4266a77-c6af-4d60-bb6c-9dca584da25f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-566081804", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "1862267103", "adminPass": "***", "networks": [{"uuid": "00bd4d2b-0921-4196-8f17-7fbf59b93533"}], "security_groups": [{"name": "tempest-securitygroup--1275885517"}], "key_name": "tempest-keypair-1123155506", "user_data": "}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:29.766680 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4f67167e-528b-47e0-8aca-b7508bb7dbc3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1271 microversion: 2.1 time: 0.131756 May 21 21:11:29.772408 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 213/394] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:29 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1271 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:29.794172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-efcdf492-5b6d-4349-9e7e-9f4d1a19865f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:29.795706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-efcdf492-5b6d-4349-9e7e-9f4d1a19865f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:29.806955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efcdf492-5b6d-4349-9e7e-9f4d1a19865f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:29.807603 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efcdf492-5b6d-4349-9e7e-9f4d1a19865f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:29.808985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efcdf492-5b6d-4349-9e7e-9f4d1a19865f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:29.811053 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efcdf492-5b6d-4349-9e7e-9f4d1a19865f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:30.248766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-efcdf492-5b6d-4349-9e7e-9f4d1a19865f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:30.282081 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-efcdf492-5b6d-4349-9e7e-9f4d1a19865f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1313 microversion: 2.1 time: 0.499324 May 21 21:11:30.285274 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 214/395] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:29 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1313 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:30.305636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fc30914c-8e34-4746-ac43-04bbc1716021 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:30.307139 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fc30914c-8e34-4746-ac43-04bbc1716021 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:30.312846 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-d4266a77-c6af-4d60-bb6c-9dca584da25f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] validate_networks() for [('00bd4d2b-0921-4196-8f17-7fbf59b93533', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:11:30.425022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fc30914c-8e34-4746-ac43-04bbc1716021 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:30.436168 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fc30914c-8e34-4746-ac43-04bbc1716021 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1224 microversion: 2.1 time: 0.145759 May 21 21:11:30.437396 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 215/396] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:30 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1224 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:30.448529 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-462ff256-70f5-42b2-8441-519c19064fe1 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:30.449401 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-462ff256-70f5-42b2-8441-519c19064fe1 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:30.458105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-462ff256-70f5-42b2-8441-519c19064fe1 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:30.458828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-462ff256-70f5-42b2-8441-519c19064fe1 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:30.459879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-462ff256-70f5-42b2-8441-519c19064fe1 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:30.460666 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-462ff256-70f5-42b2-8441-519c19064fe1 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:30.550796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-462ff256-70f5-42b2-8441-519c19064fe1 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:30.559317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-462ff256-70f5-42b2-8441-519c19064fe1 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:30.560886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-462ff256-70f5-42b2-8441-519c19064fe1 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:30.566370 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-462ff256-70f5-42b2-8441-519c19064fe1 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1446 microversion: 2.75 time: 0.127462 May 21 21:11:30.566949 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 216/397] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:30 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1446 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:30.571617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f3d5a524-639b-41ba-bdf1-24212709bcba tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:30.572471 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f3d5a524-639b-41ba-bdf1-24212709bcba tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:30.579892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3d5a524-639b-41ba-bdf1-24212709bcba tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:30.580380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3d5a524-639b-41ba-bdf1-24212709bcba tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:30.581468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3d5a524-639b-41ba-bdf1-24212709bcba tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:30.581916 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3d5a524-639b-41ba-bdf1-24212709bcba tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:30.685401 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f3d5a524-639b-41ba-bdf1-24212709bcba tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:30.696383 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f3d5a524-639b-41ba-bdf1-24212709bcba tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:30.697941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f3d5a524-639b-41ba-bdf1-24212709bcba tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:30.699126 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f3d5a524-639b-41ba-bdf1-24212709bcba tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1313 microversion: 2.25 time: 0.131195 May 21 21:11:30.699693 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 217/398] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:30 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1313 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:30.706982 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4ef0a55d-5cb8-4ea8-bf00-90a830cfa1f3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:30.707830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4ef0a55d-5cb8-4ea8-bf00-90a830cfa1f3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:30.715533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ef0a55d-5cb8-4ea8-bf00-90a830cfa1f3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:30.716773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ef0a55d-5cb8-4ea8-bf00-90a830cfa1f3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:30.717881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ef0a55d-5cb8-4ea8-bf00-90a830cfa1f3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:30.718471 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ef0a55d-5cb8-4ea8-bf00-90a830cfa1f3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:30.736684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:30.807790 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4ef0a55d-5cb8-4ea8-bf00-90a830cfa1f3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:30.823151 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4ef0a55d-5cb8-4ea8-bf00-90a830cfa1f3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1207 microversion: 2.1 time: 0.122089 May 21 21:11:30.823650 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 218/399] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:30 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1207 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:30.832400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-edd53615-a3ae-4393-9a6c-c1a4b5968768 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:30.833242 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-edd53615-a3ae-4393-9a6c-c1a4b5968768 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:30.853477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-edd53615-a3ae-4393-9a6c-c1a4b5968768 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:30.853937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-edd53615-a3ae-4393-9a6c-c1a4b5968768 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:30.854738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-edd53615-a3ae-4393-9a6c-c1a4b5968768 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:30.855183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-edd53615-a3ae-4393-9a6c-c1a4b5968768 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:31.043040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-edd53615-a3ae-4393-9a6c-c1a4b5968768 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:31.053998 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-edd53615-a3ae-4393-9a6c-c1a4b5968768 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1277 microversion: 2.1 time: 0.229232 May 21 21:11:31.055209 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 219/400] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:30 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1277 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:31.305498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6ffbd31e-2212-4fe8-b8ac-971212a8316a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:31.307718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6ffbd31e-2212-4fe8-b8ac-971212a8316a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:31.318712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ffbd31e-2212-4fe8-b8ac-971212a8316a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:31.319604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ffbd31e-2212-4fe8-b8ac-971212a8316a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:31.325153 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ffbd31e-2212-4fe8-b8ac-971212a8316a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:31.326126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ffbd31e-2212-4fe8-b8ac-971212a8316a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:32.007665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6ffbd31e-2212-4fe8-b8ac-971212a8316a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:32.020634 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6ffbd31e-2212-4fe8-b8ac-971212a8316a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1313 microversion: 2.1 time: 0.722019 May 21 21:11:32.022077 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 220/401] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:31 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1313 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:32.027489 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bb1f9103-d6de-4a25-b93f-fb5468bb9613 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:32.028269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bb1f9103-d6de-4a25-b93f-fb5468bb9613 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:32.036687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d4266a77-c6af-4d60-bb6c-9dca584da25f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:11:32.037662 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d4266a77-c6af-4d60-bb6c-9dca584da25f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:11:32.038323 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d4266a77-c6af-4d60-bb6c-9dca584da25f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:11:32.039056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d4266a77-c6af-4d60-bb6c-9dca584da25f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:11:32.039623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d4266a77-c6af-4d60-bb6c-9dca584da25f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:11:32.047808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb1f9103-d6de-4a25-b93f-fb5468bb9613 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:32.048245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb1f9103-d6de-4a25-b93f-fb5468bb9613 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:32.050801 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d4266a77-c6af-4d60-bb6c-9dca584da25f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:32.051435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d4266a77-c6af-4d60-bb6c-9dca584da25f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:32.052809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d4266a77-c6af-4d60-bb6c-9dca584da25f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:32.053436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d4266a77-c6af-4d60-bb6c-9dca584da25f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:32.053797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb1f9103-d6de-4a25-b93f-fb5468bb9613 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:32.056035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb1f9103-d6de-4a25-b93f-fb5468bb9613 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:32.078709 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-d4266a77-c6af-4d60-bb6c-9dca584da25f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Getting quotas for project fd7555e458ef4971822c6265ce3fd07b. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:11:32.084024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-d4266a77-c6af-4d60-bb6c-9dca584da25f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Getting quotas for user 0ef64531c9da4be5939447edd0d5b78d and project fd7555e458ef4971822c6265ce3fd07b. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:11:32.098873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d4266a77-c6af-4d60-bb6c-9dca584da25f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:11:32.101642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d4266a77-c6af-4d60-bb6c-9dca584da25f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:11:32.286216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bb1f9103-d6de-4a25-b93f-fb5468bb9613 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:32.296269 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d4266a77-c6af-4d60-bb6c-9dca584da25f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.543636 May 21 21:11:32.311561 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 182/402] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:11:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 2549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:11:32.311792 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bb1f9103-d6de-4a25-b93f-fb5468bb9613 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1276 microversion: 2.1 time: 0.275716 May 21 21:11:32.311792 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 221/403] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:32 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1276 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:32.317189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a9176c27-5bdb-4efe-9e02-30052f5eca5d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:32.317830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a9176c27-5bdb-4efe-9e02-30052f5eca5d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:32.320728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-49e0f47e-a4cb-4b97-b65d-853deb590abe tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:32.326089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-49e0f47e-a4cb-4b97-b65d-853deb590abe tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:32.326216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9176c27-5bdb-4efe-9e02-30052f5eca5d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:32.326336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9176c27-5bdb-4efe-9e02-30052f5eca5d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:32.328616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9176c27-5bdb-4efe-9e02-30052f5eca5d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:32.329077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9176c27-5bdb-4efe-9e02-30052f5eca5d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:32.336116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:32.340660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-49e0f47e-a4cb-4b97-b65d-853deb590abe tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:32.341307 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-49e0f47e-a4cb-4b97-b65d-853deb590abe tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:32.342170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-49e0f47e-a4cb-4b97-b65d-853deb590abe tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:32.342625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-49e0f47e-a4cb-4b97-b65d-853deb590abe tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:32.533411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a9176c27-5bdb-4efe-9e02-30052f5eca5d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:32.545209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a9176c27-5bdb-4efe-9e02-30052f5eca5d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:32.552517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a9176c27-5bdb-4efe-9e02-30052f5eca5d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:32.552517 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a9176c27-5bdb-4efe-9e02-30052f5eca5d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1319 microversion: 2.25 time: 0.247986 May 21 21:11:32.552517 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 222/404] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:32 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:32.581920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0fedded3-0ef8-44f6-b3ee-bba33ae597e7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:32.582913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0fedded3-0ef8-44f6-b3ee-bba33ae597e7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:32.590063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0fedded3-0ef8-44f6-b3ee-bba33ae597e7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:32.590780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0fedded3-0ef8-44f6-b3ee-bba33ae597e7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:32.591800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0fedded3-0ef8-44f6-b3ee-bba33ae597e7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:32.593075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0fedded3-0ef8-44f6-b3ee-bba33ae597e7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:32.688999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-49e0f47e-a4cb-4b97-b65d-853deb590abe tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:32.699503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-49e0f47e-a4cb-4b97-b65d-853deb590abe tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:32.701260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-49e0f47e-a4cb-4b97-b65d-853deb590abe tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:32.719891 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-49e0f47e-a4cb-4b97-b65d-853deb590abe tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1446 microversion: 2.75 time: 0.415512 May 21 21:11:32.722488 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 183/405] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:32 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1446 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:32.728132 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-87890471-2de7-4c88-870d-87287cda2144 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:32.729123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-87890471-2de7-4c88-870d-87287cda2144 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:32.735925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87890471-2de7-4c88-870d-87287cda2144 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:32.737377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87890471-2de7-4c88-870d-87287cda2144 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:32.741080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87890471-2de7-4c88-870d-87287cda2144 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:32.741080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87890471-2de7-4c88-870d-87287cda2144 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:32.758170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0fedded3-0ef8-44f6-b3ee-bba33ae597e7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:32.765626 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0fedded3-0ef8-44f6-b3ee-bba33ae597e7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1269 microversion: 2.1 time: 0.189388 May 21 21:11:32.775792 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 223/406] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:32 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1269 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:32.780547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-877f2fb7-3d9c-4242-b52d-8e37ab570b17 req-86ac4ee4-ecc2-4f49-b25c-87736935aa09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d5f184-08de-44c5-bd8c-051f64fe06fa", "name": "network-vif-plugged", "status": "completed", "tag": "15fa1734-3d96-43ae-a8b4-3a89b9859f45"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:32.789480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-877f2fb7-3d9c-4242-b52d-8e37ab570b17 req-86ac4ee4-ecc2-4f49-b25c-87736935aa09 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:32.789922 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-877f2fb7-3d9c-4242-b52d-8e37ab570b17 req-86ac4ee4-ecc2-4f49-b25c-87736935aa09 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:32.802043 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-877f2fb7-3d9c-4242-b52d-8e37ab570b17 req-86ac4ee4-ecc2-4f49-b25c-87736935aa09 service nova] Creating event network-vif-plugged:15fa1734-3d96-43ae-a8b4-3a89b9859f45 for instance 06d5f184-08de-44c5-bd8c-051f64fe06fa on nch1-master-1 May 21 21:11:32.807087 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-877f2fb7-3d9c-4242-b52d-8e37ab570b17 req-86ac4ee4-ecc2-4f49-b25c-87736935aa09 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030035 May 21 21:11:32.807942 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 224/407] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:32.812701 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-db5c433a-dd11-4cdb-8a9c-f250cb09ef2e tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:32.813493 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-db5c433a-dd11-4cdb-8a9c-f250cb09ef2e tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:32.973130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-87890471-2de7-4c88-870d-87287cda2144 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:32.983830 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-87890471-2de7-4c88-870d-87287cda2144 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1277 microversion: 2.1 time: 0.259992 May 21 21:11:32.988411 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 184/408] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:32 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1277 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:33.029632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-db5c433a-dd11-4cdb-8a9c-f250cb09ef2e tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:33.038833 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-db5c433a-dd11-4cdb-8a9c-f250cb09ef2e tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 200 len: 1264 microversion: 2.1 time: 0.229858 May 21 21:11:33.039222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-40d1f26d-8c00-498f-a29b-6cea32ea1ec4 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:33.039858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-40d1f26d-8c00-498f-a29b-6cea32ea1ec4 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:33.050541 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 225/409] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:32 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 1264 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:33.054045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40d1f26d-8c00-498f-a29b-6cea32ea1ec4 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:33.054509 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40d1f26d-8c00-498f-a29b-6cea32ea1ec4 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:33.055308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40d1f26d-8c00-498f-a29b-6cea32ea1ec4 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:33.055764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40d1f26d-8c00-498f-a29b-6cea32ea1ec4 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:33.319888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3fb27fe2-70b7-4790-b657-f575ce783363 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:33.321178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3fb27fe2-70b7-4790-b657-f575ce783363 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:33.329280 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3fb27fe2-70b7-4790-b657-f575ce783363 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:33.329996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3fb27fe2-70b7-4790-b657-f575ce783363 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:33.331473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3fb27fe2-70b7-4790-b657-f575ce783363 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:33.332393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3fb27fe2-70b7-4790-b657-f575ce783363 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:33.474934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-40d1f26d-8c00-498f-a29b-6cea32ea1ec4 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:33.484827 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-40d1f26d-8c00-498f-a29b-6cea32ea1ec4 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1313 microversion: 2.1 time: 0.449486 May 21 21:11:33.495294 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 185/410] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:33 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1313 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:33.519996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3fb27fe2-70b7-4790-b657-f575ce783363 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:33.530182 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3fb27fe2-70b7-4790-b657-f575ce783363 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1282 microversion: 2.1 time: 0.214917 May 21 21:11:33.537787 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 226/411] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:33 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1282 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:11:33.576997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2fbc2a02-6240-4a0a-b261-7ba4a7e9196c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:33.578696 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2fbc2a02-6240-4a0a-b261-7ba4a7e9196c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:33.586959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2fbc2a02-6240-4a0a-b261-7ba4a7e9196c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:33.588518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2fbc2a02-6240-4a0a-b261-7ba4a7e9196c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:33.589877 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2fbc2a02-6240-4a0a-b261-7ba4a7e9196c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:33.590627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2fbc2a02-6240-4a0a-b261-7ba4a7e9196c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:33.741381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-47410d67-5b0d-4797-8b6e-a5ab0801d0ed tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:33.742010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-47410d67-5b0d-4797-8b6e-a5ab0801d0ed tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:33.747540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:33.757373 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47410d67-5b0d-4797-8b6e-a5ab0801d0ed tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:33.757834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47410d67-5b0d-4797-8b6e-a5ab0801d0ed tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:33.758641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47410d67-5b0d-4797-8b6e-a5ab0801d0ed tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:33.759087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47410d67-5b0d-4797-8b6e-a5ab0801d0ed tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:33.844353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2fbc2a02-6240-4a0a-b261-7ba4a7e9196c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:33.858016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2fbc2a02-6240-4a0a-b261-7ba4a7e9196c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:33.864261 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2fbc2a02-6240-4a0a-b261-7ba4a7e9196c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:33.869197 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2fbc2a02-6240-4a0a-b261-7ba4a7e9196c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1319 microversion: 2.25 time: 0.301237 May 21 21:11:33.869941 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 186/412] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:33 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:33.882616 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4dec4b32-5566-4514-ad07-3406e2fe0ee5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:33.885387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4dec4b32-5566-4514-ad07-3406e2fe0ee5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:33.899756 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4dec4b32-5566-4514-ad07-3406e2fe0ee5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:33.902486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4dec4b32-5566-4514-ad07-3406e2fe0ee5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:33.905119 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4dec4b32-5566-4514-ad07-3406e2fe0ee5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:33.905948 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4dec4b32-5566-4514-ad07-3406e2fe0ee5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:34.412575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4dec4b32-5566-4514-ad07-3406e2fe0ee5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:34.431051 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4dec4b32-5566-4514-ad07-3406e2fe0ee5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1311 microversion: 2.1 time: 0.559891 May 21 21:11:34.432346 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 187/413] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:33 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1311 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:34.437389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2896280a-bb83-450a-8ec6-f6df9fa837ea tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:34.440801 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2896280a-bb83-450a-8ec6-f6df9fa837ea tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:34.458674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2896280a-bb83-450a-8ec6-f6df9fa837ea tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:34.459349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2896280a-bb83-450a-8ec6-f6df9fa837ea tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:34.460369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2896280a-bb83-450a-8ec6-f6df9fa837ea tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:34.460993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2896280a-bb83-450a-8ec6-f6df9fa837ea tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:34.551082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-47410d67-5b0d-4797-8b6e-a5ab0801d0ed tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:34.564005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-47410d67-5b0d-4797-8b6e-a5ab0801d0ed tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:34.569550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-47410d67-5b0d-4797-8b6e-a5ab0801d0ed tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:34.588169 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-47410d67-5b0d-4797-8b6e-a5ab0801d0ed tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1446 microversion: 2.75 time: 0.850577 May 21 21:11:34.589255 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 227/414] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:33 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1446 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:11:34.599247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-23d4c73a-b665-4264-87d5-e012eb50cf1a tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:34.599247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-23d4c73a-b665-4264-87d5-e012eb50cf1a tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:34.607681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23d4c73a-b665-4264-87d5-e012eb50cf1a tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:34.610421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23d4c73a-b665-4264-87d5-e012eb50cf1a tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:34.613693 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23d4c73a-b665-4264-87d5-e012eb50cf1a tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:34.613693 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23d4c73a-b665-4264-87d5-e012eb50cf1a tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:34.932435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-23d4c73a-b665-4264-87d5-e012eb50cf1a tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:34.932435 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-23d4c73a-b665-4264-87d5-e012eb50cf1a tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 200 len: 1260 microversion: 2.1 time: 0.319289 May 21 21:11:34.932435 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 228/415] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:34 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 1260 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:34.932435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-844cd9dd-a734-4a49-bdbd-c4909ef02185 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:34.932881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-844cd9dd-a734-4a49-bdbd-c4909ef02185 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:34.932881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-844cd9dd-a734-4a49-bdbd-c4909ef02185 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:34.932881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-844cd9dd-a734-4a49-bdbd-c4909ef02185 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:34.937813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-844cd9dd-a734-4a49-bdbd-c4909ef02185 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:34.938385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-844cd9dd-a734-4a49-bdbd-c4909ef02185 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:34.942609 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2896280a-bb83-450a-8ec6-f6df9fa837ea tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:34.987579 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2896280a-bb83-450a-8ec6-f6df9fa837ea tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1319 microversion: 2.1 time: 0.530028 May 21 21:11:34.987579 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 188/416] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:34 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1319 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:34.987579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9f28151a-4628-4d33-90d6-bce705f6d998 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:34.987579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9f28151a-4628-4d33-90d6-bce705f6d998 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:34.993262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f28151a-4628-4d33-90d6-bce705f6d998 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:34.995141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f28151a-4628-4d33-90d6-bce705f6d998 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:34.997494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f28151a-4628-4d33-90d6-bce705f6d998 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:34.997946 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f28151a-4628-4d33-90d6-bce705f6d998 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:35.198663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9f28151a-4628-4d33-90d6-bce705f6d998 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:35.211436 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9f28151a-4628-4d33-90d6-bce705f6d998 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1282 microversion: 2.1 time: 0.245105 May 21 21:11:35.212033 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 189/417] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:34 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1282 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:35.238899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-66e7a13f-4b55-4da2-b95e-2c8fd4a623b5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:35.241541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-66e7a13f-4b55-4da2-b95e-2c8fd4a623b5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:35.264865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66e7a13f-4b55-4da2-b95e-2c8fd4a623b5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:35.265930 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66e7a13f-4b55-4da2-b95e-2c8fd4a623b5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:35.267487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66e7a13f-4b55-4da2-b95e-2c8fd4a623b5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:35.268474 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66e7a13f-4b55-4da2-b95e-2c8fd4a623b5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:35.747905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-66e7a13f-4b55-4da2-b95e-2c8fd4a623b5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:35.751867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-844cd9dd-a734-4a49-bdbd-c4909ef02185 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:35.758429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-66e7a13f-4b55-4da2-b95e-2c8fd4a623b5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:35.776608 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-844cd9dd-a734-4a49-bdbd-c4909ef02185 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1313 microversion: 2.1 time: 0.863980 May 21 21:11:35.779922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-66e7a13f-4b55-4da2-b95e-2c8fd4a623b5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:35.781355 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-66e7a13f-4b55-4da2-b95e-2c8fd4a623b5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1361 microversion: 2.25 time: 0.568348 May 21 21:11:35.793608 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 229/418] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:34 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1313 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:35.801958 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 190/419] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:35 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1361 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:35.809410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-62a9062d-22d5-4266-9cff-cd64da4fc238 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:35.811971 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8a027995-ce0b-49fb-80f7-99fef4351c70 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:35.812108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-62a9062d-22d5-4266-9cff-cd64da4fc238 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:35.812669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8a027995-ce0b-49fb-80f7-99fef4351c70 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:35.841829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8a027995-ce0b-49fb-80f7-99fef4351c70 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:35.842389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8a027995-ce0b-49fb-80f7-99fef4351c70 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:35.843313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8a027995-ce0b-49fb-80f7-99fef4351c70 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:35.845400 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8a027995-ce0b-49fb-80f7-99fef4351c70 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:35.848412 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-62a9062d-22d5-4266-9cff-cd64da4fc238 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:35.850514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-62a9062d-22d5-4266-9cff-cd64da4fc238 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:35.852225 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-62a9062d-22d5-4266-9cff-cd64da4fc238 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:35.862593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-62a9062d-22d5-4266-9cff-cd64da4fc238 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:36.073059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8a027995-ce0b-49fb-80f7-99fef4351c70 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:36.132952 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8a027995-ce0b-49fb-80f7-99fef4351c70 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:36.141600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8a027995-ce0b-49fb-80f7-99fef4351c70 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:36.150839 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8a027995-ce0b-49fb-80f7-99fef4351c70 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1446 microversion: 2.75 time: 0.347434 May 21 21:11:36.156753 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 191/420] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:35 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1446 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:36.161304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a9a3b35e-c579-4fb1-a402-fb47bbcfa9f5 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:36.162121 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a9a3b35e-c579-4fb1-a402-fb47bbcfa9f5 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:36.179016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a9a3b35e-c579-4fb1-a402-fb47bbcfa9f5 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:36.179805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a9a3b35e-c579-4fb1-a402-fb47bbcfa9f5 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:36.185519 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a9a3b35e-c579-4fb1-a402-fb47bbcfa9f5 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:36.185519 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a9a3b35e-c579-4fb1-a402-fb47bbcfa9f5 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:36.942097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a9a3b35e-c579-4fb1-a402-fb47bbcfa9f5 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:36.959466 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a9a3b35e-c579-4fb1-a402-fb47bbcfa9f5 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 200 len: 1324 microversion: 2.1 time: 0.801968 May 21 21:11:36.963446 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 192/421] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:36 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 1324 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:36.976824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-62a9062d-22d5-4266-9cff-cd64da4fc238 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:36.978647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1ae72399-eef8-4e1e-a44e-cc505a292cc2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:36.997698 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-62a9062d-22d5-4266-9cff-cd64da4fc238 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1311 microversion: 2.1 time: 1.202601 May 21 21:11:37.002489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1ae72399-eef8-4e1e-a44e-cc505a292cc2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:37.005620 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 230/422] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:35 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1311 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:37.021884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ae72399-eef8-4e1e-a44e-cc505a292cc2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:37.024121 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ae72399-eef8-4e1e-a44e-cc505a292cc2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:37.025366 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ae72399-eef8-4e1e-a44e-cc505a292cc2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:37.025598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ae72399-eef8-4e1e-a44e-cc505a292cc2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:37.026521 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-29373985-93d0-430b-b910-4e49b71058b8 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:37.027326 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-29373985-93d0-430b-b910-4e49b71058b8 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:37.054791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29373985-93d0-430b-b910-4e49b71058b8 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:37.057838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29373985-93d0-430b-b910-4e49b71058b8 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:37.057838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29373985-93d0-430b-b910-4e49b71058b8 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:37.058288 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29373985-93d0-430b-b910-4e49b71058b8 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:37.303868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-29373985-93d0-430b-b910-4e49b71058b8 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:37.318308 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-29373985-93d0-430b-b910-4e49b71058b8 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1282 microversion: 2.1 time: 0.310475 May 21 21:11:37.327575 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 231/423] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:37 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1282 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:37.327575 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-43d17c39-3a54-4cb4-be77-d2f5c900e7e0 req-de2730b1-72f9-4a8e-b7f2-ac85bc7f694c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c22ee7-e0f1-4d96-bedb-559c91cd2f00", "name": "network-vif-deleted", "tag": "2558a946-51d6-4f04-bcc7-302329aa7086"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:37.344561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-43d17c39-3a54-4cb4-be77-d2f5c900e7e0 req-de2730b1-72f9-4a8e-b7f2-ac85bc7f694c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:37.345015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-43d17c39-3a54-4cb4-be77-d2f5c900e7e0 req-de2730b1-72f9-4a8e-b7f2-ac85bc7f694c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:37.374901 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-43d17c39-3a54-4cb4-be77-d2f5c900e7e0 req-de2730b1-72f9-4a8e-b7f2-ac85bc7f694c service nova] Creating event network-vif-deleted:2558a946-51d6-4f04-bcc7-302329aa7086 for instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 on nch1-master-1 May 21 21:11:37.390313 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-43d17c39-3a54-4cb4-be77-d2f5c900e7e0 req-de2730b1-72f9-4a8e-b7f2-ac85bc7f694c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069515 May 21 21:11:37.391540 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 232/424] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:37.405627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-effd851b-9473-4b84-8876-1ba458b6cd73 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:37.406337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-effd851b-9473-4b84-8876-1ba458b6cd73 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:37.416194 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-effd851b-9473-4b84-8876-1ba458b6cd73 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:37.418562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-effd851b-9473-4b84-8876-1ba458b6cd73 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:37.418562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-effd851b-9473-4b84-8876-1ba458b6cd73 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:37.418562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-effd851b-9473-4b84-8876-1ba458b6cd73 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:37.428786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1ae72399-eef8-4e1e-a44e-cc505a292cc2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:37.447018 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1ae72399-eef8-4e1e-a44e-cc505a292cc2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1319 microversion: 2.1 time: 0.482312 May 21 21:11:37.448104 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 193/425] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:36 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1319 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:37.467904 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c1f58abf-701c-449d-9b6d-6ba5bb96c309 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:37.468725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c1f58abf-701c-449d-9b6d-6ba5bb96c309 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:37.484125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1f58abf-701c-449d-9b6d-6ba5bb96c309 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:37.484751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1f58abf-701c-449d-9b6d-6ba5bb96c309 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:37.485596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1f58abf-701c-449d-9b6d-6ba5bb96c309 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:37.486036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1f58abf-701c-449d-9b6d-6ba5bb96c309 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:37.869185 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:37.896688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c1f58abf-701c-449d-9b6d-6ba5bb96c309 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:37.912430 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c1f58abf-701c-449d-9b6d-6ba5bb96c309 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1462 microversion: 2.1 time: 0.460573 May 21 21:11:37.914595 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 194/426] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:37 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1462 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:37.931201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d6d4988d-6f5d-496f-8a2b-dcf3e290f076 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:37.932973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d6d4988d-6f5d-496f-8a2b-dcf3e290f076 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:37.951988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d6d4988d-6f5d-496f-8a2b-dcf3e290f076 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:37.953235 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d6d4988d-6f5d-496f-8a2b-dcf3e290f076 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:37.954333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d6d4988d-6f5d-496f-8a2b-dcf3e290f076 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:37.957090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d6d4988d-6f5d-496f-8a2b-dcf3e290f076 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:38.265862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d6d4988d-6f5d-496f-8a2b-dcf3e290f076 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:38.276908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d6d4988d-6f5d-496f-8a2b-dcf3e290f076 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:38.284179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d6d4988d-6f5d-496f-8a2b-dcf3e290f076 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:38.303092 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d6d4988d-6f5d-496f-8a2b-dcf3e290f076 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1446 microversion: 2.75 time: 0.387350 May 21 21:11:38.303697 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 195/427] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:37 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1446 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:38.314598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-c55d1d61-bd0a-4808-9eed-cae208e92183 req-2dff2559-e2f8-4421-9b23-4ad8c838c6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6b5633e-336c-45cc-927e-8bc71bd6e52f", "tag": "dc7021f0-e141-4045-80b4-042a54a3e380"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:38.342429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c55d1d61-bd0a-4808-9eed-cae208e92183 req-2dff2559-e2f8-4421-9b23-4ad8c838c6f9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:38.342886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c55d1d61-bd0a-4808-9eed-cae208e92183 req-2dff2559-e2f8-4421-9b23-4ad8c838c6f9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:38.358050 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-c55d1d61-bd0a-4808-9eed-cae208e92183 req-2dff2559-e2f8-4421-9b23-4ad8c838c6f9 service nova] Creating event network-changed:dc7021f0-e141-4045-80b4-042a54a3e380 for instance a6b5633e-336c-45cc-927e-8bc71bd6e52f on nch2-master-1 May 21 21:11:38.366349 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-c55d1d61-bd0a-4808-9eed-cae208e92183 req-2dff2559-e2f8-4421-9b23-4ad8c838c6f9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061320 May 21 21:11:38.367554 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 196/428] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:38.504380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bb7b6dbb-d730-4490-a190-220e93e97d14 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:38.505054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bb7b6dbb-d730-4490-a190-220e93e97d14 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:38.511739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb7b6dbb-d730-4490-a190-220e93e97d14 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:38.512201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb7b6dbb-d730-4490-a190-220e93e97d14 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:38.513023 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb7b6dbb-d730-4490-a190-220e93e97d14 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:38.513645 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb7b6dbb-d730-4490-a190-220e93e97d14 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:38.758137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-effd851b-9473-4b84-8876-1ba458b6cd73 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:38.763553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-effd851b-9473-4b84-8876-1ba458b6cd73 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:38.767745 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-effd851b-9473-4b84-8876-1ba458b6cd73 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:38.771813 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-effd851b-9473-4b84-8876-1ba458b6cd73 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1361 microversion: 2.25 time: 1.378071 May 21 21:11:38.773274 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 233/429] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:37 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1361 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:38.787054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e1ba56c7-2f9e-4219-a2a8-a7e84cff2cf8 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:38.788056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e1ba56c7-2f9e-4219-a2a8-a7e84cff2cf8 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:38.800744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1ba56c7-2f9e-4219-a2a8-a7e84cff2cf8 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:38.806273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1ba56c7-2f9e-4219-a2a8-a7e84cff2cf8 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:38.806273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1ba56c7-2f9e-4219-a2a8-a7e84cff2cf8 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:38.806273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1ba56c7-2f9e-4219-a2a8-a7e84cff2cf8 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:38.910880 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e1ba56c7-2f9e-4219-a2a8-a7e84cff2cf8 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:38.922191 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e1ba56c7-2f9e-4219-a2a8-a7e84cff2cf8 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 200 len: 1322 microversion: 2.1 time: 0.147008 May 21 21:11:38.923094 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 234/430] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:38 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:38.933681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e73e3f9a-6750-42fb-a6c0-dae1a63c5b23 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:38.936673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e73e3f9a-6750-42fb-a6c0-dae1a63c5b23 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:38.942083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e73e3f9a-6750-42fb-a6c0-dae1a63c5b23 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:38.942817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e73e3f9a-6750-42fb-a6c0-dae1a63c5b23 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:38.943830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e73e3f9a-6750-42fb-a6c0-dae1a63c5b23 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:38.944575 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e73e3f9a-6750-42fb-a6c0-dae1a63c5b23 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:39.312082 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bb7b6dbb-d730-4490-a190-220e93e97d14 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1613 microversion: 2.1 time: 0.939229 May 21 21:11:39.312082 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 197/431] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:38 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1613 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:39.316329 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9f6752e9-17c2-4958-ab49-598bfb763242 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:39.317198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9f6752e9-17c2-4958-ab49-598bfb763242 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:39.324629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f6752e9-17c2-4958-ab49-598bfb763242 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:39.325164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f6752e9-17c2-4958-ab49-598bfb763242 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:39.326089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f6752e9-17c2-4958-ab49-598bfb763242 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:39.326550 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f6752e9-17c2-4958-ab49-598bfb763242 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:39.563945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9f6752e9-17c2-4958-ab49-598bfb763242 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:39.576411 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9f6752e9-17c2-4958-ab49-598bfb763242 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1324 microversion: 2.1 time: 0.261582 May 21 21:11:39.576411 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 198/432] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:39 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1324 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:39.578130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-87ea8cba-9572-4beb-b3e6-0a4fe8a37ef3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:39.578739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-87ea8cba-9572-4beb-b3e6-0a4fe8a37ef3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:39.584628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87ea8cba-9572-4beb-b3e6-0a4fe8a37ef3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:39.585293 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87ea8cba-9572-4beb-b3e6-0a4fe8a37ef3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:39.586066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87ea8cba-9572-4beb-b3e6-0a4fe8a37ef3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:39.586502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87ea8cba-9572-4beb-b3e6-0a4fe8a37ef3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:39.590883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:39.616695 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e73e3f9a-6750-42fb-a6c0-dae1a63c5b23 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:39.630756 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e73e3f9a-6750-42fb-a6c0-dae1a63c5b23 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1311 microversion: 2.1 time: 0.706136 May 21 21:11:39.632043 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 235/433] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:38 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1311 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:39.638214 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-24cae7ba-487f-48f4-9e45-5e72b9bd152c tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:39.639084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-24cae7ba-487f-48f4-9e45-5e72b9bd152c tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:39.647771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24cae7ba-487f-48f4-9e45-5e72b9bd152c tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:39.649740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24cae7ba-487f-48f4-9e45-5e72b9bd152c tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:39.650850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24cae7ba-487f-48f4-9e45-5e72b9bd152c tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:39.653402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24cae7ba-487f-48f4-9e45-5e72b9bd152c tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:39.787089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-87ea8cba-9572-4beb-b3e6-0a4fe8a37ef3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:39.796082 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-87ea8cba-9572-4beb-b3e6-0a4fe8a37ef3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1319 microversion: 2.1 time: 0.221365 May 21 21:11:39.799944 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 199/434] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:39 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:39.802504 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6a768858-ea31-477e-a049-3972ae70b289 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:39.803108 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6a768858-ea31-477e-a049-3972ae70b289 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:39.810906 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6a768858-ea31-477e-a049-3972ae70b289 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:39.811349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6a768858-ea31-477e-a049-3972ae70b289 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:39.812118 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6a768858-ea31-477e-a049-3972ae70b289 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:39.812592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6a768858-ea31-477e-a049-3972ae70b289 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:39.821078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-24cae7ba-487f-48f4-9e45-5e72b9bd152c tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'debdf601e2af4bfa8399af03d4c7960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1dd623262494c9187474cbd860b52c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:39.821770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-24cae7ba-487f-48f4-9e45-5e72b9bd152c tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] flavor_id is None. Assuming migration. {{(pid=131277) resize /opt/stack/nova/nova/compute/api.py:4142}} May 21 21:11:39.822364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-24cae7ba-487f-48f4-9e45-5e72b9bd152c tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131277) resize /opt/stack/nova/nova/compute/api.py:4166}} May 21 21:11:39.894518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6a768858-ea31-477e-a049-3972ae70b289 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:39.904862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6a768858-ea31-477e-a049-3972ae70b289 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:39.909333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6a768858-ea31-477e-a049-3972ae70b289 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:39.913898 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6a768858-ea31-477e-a049-3972ae70b289 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1446 microversion: 2.75 time: 0.116012 May 21 21:11:39.914678 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 200/435] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:39 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1446 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:39.919638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-adb4251d-419f-4279-8fe1-737c582637f8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:39.920947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-adb4251d-419f-4279-8fe1-737c582637f8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:39.927212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-adb4251d-419f-4279-8fe1-737c582637f8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:39.927635 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-adb4251d-419f-4279-8fe1-737c582637f8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:39.928474 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-adb4251d-419f-4279-8fe1-737c582637f8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:39.928921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-adb4251d-419f-4279-8fe1-737c582637f8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:40.090380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-adb4251d-419f-4279-8fe1-737c582637f8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:40.099925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-adb4251d-419f-4279-8fe1-737c582637f8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:40.102899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-adb4251d-419f-4279-8fe1-737c582637f8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:40.104405 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-adb4251d-419f-4279-8fe1-737c582637f8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1361 microversion: 2.25 time: 0.188725 May 21 21:11:40.108405 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 201/436] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:39 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:40.109653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-63e4d78c-076b-45b7-86c5-fcba61e3eda6 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:40.110267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-63e4d78c-076b-45b7-86c5-fcba61e3eda6 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:40.117105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63e4d78c-076b-45b7-86c5-fcba61e3eda6 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:40.117677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63e4d78c-076b-45b7-86c5-fcba61e3eda6 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:40.118326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63e4d78c-076b-45b7-86c5-fcba61e3eda6 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:40.118910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63e4d78c-076b-45b7-86c5-fcba61e3eda6 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:40.172167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:40.197161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-63e4d78c-076b-45b7-86c5-fcba61e3eda6 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:40.208526 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-63e4d78c-076b-45b7-86c5-fcba61e3eda6 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 200 len: 1322 microversion: 2.1 time: 0.102569 May 21 21:11:40.209469 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 202/437] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:40 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 1322 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:40.418019 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-24cae7ba-487f-48f4-9e45-5e72b9bd152c tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa/action" status: 202 len: 0 microversion: 2.1 time: 0.784251 May 21 21:11:40.418654 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 236/438] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:11:39 2022] POST /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa/action => generated 0 bytes in 786 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:11:40.427829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e70a6931-cb1c-482c-852f-2a8a8a887b07 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:40.428559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e70a6931-cb1c-482c-852f-2a8a8a887b07 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:40.435655 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e70a6931-cb1c-482c-852f-2a8a8a887b07 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:40.436220 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e70a6931-cb1c-482c-852f-2a8a8a887b07 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:40.437308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e70a6931-cb1c-482c-852f-2a8a8a887b07 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:40.437961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e70a6931-cb1c-482c-852f-2a8a8a887b07 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:40.444081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-c3378316-060a-4c1b-869d-3fd030084b5c req-edaf6dda-58d7-43f6-9834-d169aa728cee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23d169f8-72b8-4928-b109-7d948fe70b9a", "tag": "9c5044e3-c8fa-45e3-b917-7a13d3004a8e"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:40.454262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c3378316-060a-4c1b-869d-3fd030084b5c req-edaf6dda-58d7-43f6-9834-d169aa728cee service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:40.454593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c3378316-060a-4c1b-869d-3fd030084b5c req-edaf6dda-58d7-43f6-9834-d169aa728cee service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:40.468623 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-c3378316-060a-4c1b-869d-3fd030084b5c req-edaf6dda-58d7-43f6-9834-d169aa728cee service nova] Creating event network-changed:9c5044e3-c8fa-45e3-b917-7a13d3004a8e for instance 23d169f8-72b8-4928-b109-7d948fe70b9a on nch2-master-1 May 21 21:11:40.476374 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-c3378316-060a-4c1b-869d-3fd030084b5c req-edaf6dda-58d7-43f6-9834-d169aa728cee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035849 May 21 21:11:40.477317 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 237/439] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:40.594025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5bdcf27e-e1fe-497d-834a-9e186265f89c tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:40.594951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5bdcf27e-e1fe-497d-834a-9e186265f89c tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:40.606106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5bdcf27e-e1fe-497d-834a-9e186265f89c tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:40.611052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5bdcf27e-e1fe-497d-834a-9e186265f89c tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:40.612103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5bdcf27e-e1fe-497d-834a-9e186265f89c tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:40.612774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5bdcf27e-e1fe-497d-834a-9e186265f89c tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:40.658128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e70a6931-cb1c-482c-852f-2a8a8a887b07 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:40.670385 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e70a6931-cb1c-482c-852f-2a8a8a887b07 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1471 microversion: 2.1 time: 0.247186 May 21 21:11:40.671618 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 203/440] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:40 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1471 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:11:40.677016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b0ba7a39-1e9b-4e17-b5d3-07260e9f6dd8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:40.677937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b0ba7a39-1e9b-4e17-b5d3-07260e9f6dd8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:40.692859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b0ba7a39-1e9b-4e17-b5d3-07260e9f6dd8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:40.693558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b0ba7a39-1e9b-4e17-b5d3-07260e9f6dd8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:40.694565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b0ba7a39-1e9b-4e17-b5d3-07260e9f6dd8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:40.695269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b0ba7a39-1e9b-4e17-b5d3-07260e9f6dd8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:40.938939 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b0ba7a39-1e9b-4e17-b5d3-07260e9f6dd8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:40.949236 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b0ba7a39-1e9b-4e17-b5d3-07260e9f6dd8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1311 microversion: 2.1 time: 0.275491 May 21 21:11:40.959308 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 204/441] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:40 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1311 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:40.959524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2f9aa0be-3a43-41ef-a800-cc866010cddd tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:40.960709 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2f9aa0be-3a43-41ef-a800-cc866010cddd tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:40.967925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f9aa0be-3a43-41ef-a800-cc866010cddd tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:40.968413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f9aa0be-3a43-41ef-a800-cc866010cddd tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:40.969215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f9aa0be-3a43-41ef-a800-cc866010cddd tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:40.969631 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f9aa0be-3a43-41ef-a800-cc866010cddd tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:41.171500 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2f9aa0be-3a43-41ef-a800-cc866010cddd tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:41.195438 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2f9aa0be-3a43-41ef-a800-cc866010cddd tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1319 microversion: 2.1 time: 0.235486 May 21 21:11:41.200127 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 205/442] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:40 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:41.207298 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a301940b-2ff3-482e-96ec-f7c82296d0be tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:41.208178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a301940b-2ff3-482e-96ec-f7c82296d0be tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:41.221007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a301940b-2ff3-482e-96ec-f7c82296d0be tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:41.222147 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a301940b-2ff3-482e-96ec-f7c82296d0be tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:41.223375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a301940b-2ff3-482e-96ec-f7c82296d0be tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:41.223649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a301940b-2ff3-482e-96ec-f7c82296d0be tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:41.306248 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a301940b-2ff3-482e-96ec-f7c82296d0be tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:41.315627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a301940b-2ff3-482e-96ec-f7c82296d0be tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:41.317205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a301940b-2ff3-482e-96ec-f7c82296d0be tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:41.322587 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a301940b-2ff3-482e-96ec-f7c82296d0be tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1446 microversion: 2.75 time: 0.120739 May 21 21:11:41.323110 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 206/443] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:41 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1446 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:41.327335 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f87307fc-8ced-4b10-80c4-3924fe477527 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:41.327952 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f87307fc-8ced-4b10-80c4-3924fe477527 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:41.334685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f87307fc-8ced-4b10-80c4-3924fe477527 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:41.335145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f87307fc-8ced-4b10-80c4-3924fe477527 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:41.336103 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f87307fc-8ced-4b10-80c4-3924fe477527 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:41.336406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f87307fc-8ced-4b10-80c4-3924fe477527 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:41.550635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5bdcf27e-e1fe-497d-834a-9e186265f89c tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:41.563839 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5bdcf27e-e1fe-497d-834a-9e186265f89c tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1324 microversion: 2.1 time: 0.975881 May 21 21:11:41.566406 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 238/444] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:40 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1324 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:11:41.582730 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5e7055ab-5683-46c1-8c76-604d24340c42 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:41.583425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5e7055ab-5683-46c1-8c76-604d24340c42 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:41.592626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5e7055ab-5683-46c1-8c76-604d24340c42 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:41.598236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5e7055ab-5683-46c1-8c76-604d24340c42 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:41.598236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5e7055ab-5683-46c1-8c76-604d24340c42 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:41.598236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5e7055ab-5683-46c1-8c76-604d24340c42 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:41.646397 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f87307fc-8ced-4b10-80c4-3924fe477527 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:41.662617 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f87307fc-8ced-4b10-80c4-3924fe477527 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:41.664170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f87307fc-8ced-4b10-80c4-3924fe477527 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:41.665337 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f87307fc-8ced-4b10-80c4-3924fe477527 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1361 microversion: 2.25 time: 0.341546 May 21 21:11:41.666343 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 207/445] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:41 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1361 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:41.689672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-b32fd4f5-f0e2-49fe-a97d-fa20618f5e9e req-2948c39a-3a65-40dc-9e98-7b05c6585b3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d32d33-c3d7-4c41-a4cf-f804fac41120", "tag": "2e166c5d-4aab-4618-98ae-7042d9891722"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:41.698044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b32fd4f5-f0e2-49fe-a97d-fa20618f5e9e req-2948c39a-3a65-40dc-9e98-7b05c6585b3c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:41.698703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b32fd4f5-f0e2-49fe-a97d-fa20618f5e9e req-2948c39a-3a65-40dc-9e98-7b05c6585b3c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:41.711006 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-b32fd4f5-f0e2-49fe-a97d-fa20618f5e9e req-2948c39a-3a65-40dc-9e98-7b05c6585b3c service nova] Creating event network-changed:2e166c5d-4aab-4618-98ae-7042d9891722 for instance 99d32d33-c3d7-4c41-a4cf-f804fac41120 on nch2-master-1 May 21 21:11:41.715888 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-b32fd4f5-f0e2-49fe-a97d-fa20618f5e9e req-2948c39a-3a65-40dc-9e98-7b05c6585b3c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031075 May 21 21:11:41.717056 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 208/446] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:41.722470 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cf8a9e3f-d3d0-44d2-bd17-893ad9f312a7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:41.723259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cf8a9e3f-d3d0-44d2-bd17-893ad9f312a7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:41.730014 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf8a9e3f-d3d0-44d2-bd17-893ad9f312a7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:41.730580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf8a9e3f-d3d0-44d2-bd17-893ad9f312a7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:41.731725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf8a9e3f-d3d0-44d2-bd17-893ad9f312a7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:41.732260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf8a9e3f-d3d0-44d2-bd17-893ad9f312a7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:42.068476 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:42.094118 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=18 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:42.218216 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cf8a9e3f-d3d0-44d2-bd17-893ad9f312a7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:42.229917 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cf8a9e3f-d3d0-44d2-bd17-893ad9f312a7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1471 microversion: 2.1 time: 0.511583 May 21 21:11:42.232642 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 209/447] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:41 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1471 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:42.239705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ec607296-898f-42dd-98c6-856f3e150351 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:42.242042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ec607296-898f-42dd-98c6-856f3e150351 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:42.251022 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ec607296-898f-42dd-98c6-856f3e150351 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:42.251676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ec607296-898f-42dd-98c6-856f3e150351 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:42.253503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ec607296-898f-42dd-98c6-856f3e150351 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:42.254098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ec607296-898f-42dd-98c6-856f3e150351 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:42.319790 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5e7055ab-5683-46c1-8c76-604d24340c42 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:42.329537 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5e7055ab-5683-46c1-8c76-604d24340c42 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 200 len: 1390 microversion: 2.1 time: 0.762570 May 21 21:11:42.333146 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 239/448] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:41 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 1390 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:42.340309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c28cf250-e01d-4191-9e3b-600a5add5b22 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:42.341131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c28cf250-e01d-4191-9e3b-600a5add5b22 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:42.348959 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c28cf250-e01d-4191-9e3b-600a5add5b22 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:42.350240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c28cf250-e01d-4191-9e3b-600a5add5b22 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:42.351212 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c28cf250-e01d-4191-9e3b-600a5add5b22 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:42.351744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c28cf250-e01d-4191-9e3b-600a5add5b22 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:42.974637 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ec607296-898f-42dd-98c6-856f3e150351 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:42.988743 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ec607296-898f-42dd-98c6-856f3e150351 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1311 microversion: 2.1 time: 0.754781 May 21 21:11:42.989521 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 210/449] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:42 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1311 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:42.999534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0419b926-3e75-466c-8123-976af46d49ef tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:43.000725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0419b926-3e75-466c-8123-976af46d49ef tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:43.018612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0419b926-3e75-466c-8123-976af46d49ef tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:43.018612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0419b926-3e75-466c-8123-976af46d49ef tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:43.019100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0419b926-3e75-466c-8123-976af46d49ef tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:43.019548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0419b926-3e75-466c-8123-976af46d49ef tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:43.035900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=22 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:43.127824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c28cf250-e01d-4191-9e3b-600a5add5b22 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:43.127977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0419b926-3e75-466c-8123-976af46d49ef tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:43.136517 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c28cf250-e01d-4191-9e3b-600a5add5b22 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1319 microversion: 2.1 time: 0.801819 May 21 21:11:43.139878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0419b926-3e75-466c-8123-976af46d49ef tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:43.141755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0419b926-3e75-466c-8123-976af46d49ef tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:43.148019 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 240/450] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:42 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1319 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:43.150221 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0419b926-3e75-466c-8123-976af46d49ef tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1446 microversion: 2.75 time: 0.159469 May 21 21:11:43.152546 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 211/451] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:42 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1446 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:43.164469 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-17ac082d-6447-40f9-b689-982a2e5d771d tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:43.164469 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-17ac082d-6447-40f9-b689-982a2e5d771d tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:43.164469 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-17ac082d-6447-40f9-b689-982a2e5d771d tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:43.164469 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-17ac082d-6447-40f9-b689-982a2e5d771d tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:43.164988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-17ac082d-6447-40f9-b689-982a2e5d771d tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:43.164988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-17ac082d-6447-40f9-b689-982a2e5d771d tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:43.181026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bb4aaf1f-5b47-4c9f-ba65-0a43758f9c88 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:43.181941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bb4aaf1f-5b47-4c9f-ba65-0a43758f9c88 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:43.189784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb4aaf1f-5b47-4c9f-ba65-0a43758f9c88 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:43.190682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb4aaf1f-5b47-4c9f-ba65-0a43758f9c88 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:43.192375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb4aaf1f-5b47-4c9f-ba65-0a43758f9c88 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:43.193029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb4aaf1f-5b47-4c9f-ba65-0a43758f9c88 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:43.521856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bb4aaf1f-5b47-4c9f-ba65-0a43758f9c88 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:43.536829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bb4aaf1f-5b47-4c9f-ba65-0a43758f9c88 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:43.540252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bb4aaf1f-5b47-4c9f-ba65-0a43758f9c88 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:43.541737 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bb4aaf1f-5b47-4c9f-ba65-0a43758f9c88 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1361 microversion: 2.25 time: 0.388071 May 21 21:11:43.542802 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 212/452] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:43 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1361 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:43.559482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-71fb7045-026e-4335-a17a-92ef34255e50 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:43.560401 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-71fb7045-026e-4335-a17a-92ef34255e50 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:43.567399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71fb7045-026e-4335-a17a-92ef34255e50 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:43.568744 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71fb7045-026e-4335-a17a-92ef34255e50 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:43.569726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71fb7045-026e-4335-a17a-92ef34255e50 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:43.570336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71fb7045-026e-4335-a17a-92ef34255e50 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:43.734243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-17ac082d-6447-40f9-b689-982a2e5d771d tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:43.754936 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-17ac082d-6447-40f9-b689-982a2e5d771d tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1324 microversion: 2.1 time: 0.604652 May 21 21:11:43.764330 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 241/453] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:43 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1324 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:43.771805 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c93fdf66-22c7-42b7-a2e5-54f3db19726d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:43.772961 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c93fdf66-22c7-42b7-a2e5-54f3db19726d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:43.783043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c93fdf66-22c7-42b7-a2e5-54f3db19726d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:43.783819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c93fdf66-22c7-42b7-a2e5-54f3db19726d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:43.785062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c93fdf66-22c7-42b7-a2e5-54f3db19726d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:43.785667 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c93fdf66-22c7-42b7-a2e5-54f3db19726d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:43.888235 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-71fb7045-026e-4335-a17a-92ef34255e50 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:43.902349 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-71fb7045-026e-4335-a17a-92ef34255e50 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1471 microversion: 2.1 time: 0.356910 May 21 21:11:43.903235 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 213/454] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:43 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1471 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:44.012485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ae797f0e-3411-4c79-90b9-bb675007d17d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:44.013327 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ae797f0e-3411-4c79-90b9-bb675007d17d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:44.020507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ae797f0e-3411-4c79-90b9-bb675007d17d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:44.021204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ae797f0e-3411-4c79-90b9-bb675007d17d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:44.022162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ae797f0e-3411-4c79-90b9-bb675007d17d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:44.022769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ae797f0e-3411-4c79-90b9-bb675007d17d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:44.303497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ae797f0e-3411-4c79-90b9-bb675007d17d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:44.334077 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ae797f0e-3411-4c79-90b9-bb675007d17d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1311 microversion: 2.1 time: 0.325141 May 21 21:11:44.335158 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 214/455] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:44 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1311 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:44.342143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-710b6c8d-8392-4200-b7c4-ccde24f4b266 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:44.342967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-710b6c8d-8392-4200-b7c4-ccde24f4b266 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:44.366522 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-710b6c8d-8392-4200-b7c4-ccde24f4b266 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:44.367378 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-710b6c8d-8392-4200-b7c4-ccde24f4b266 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:44.368575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-710b6c8d-8392-4200-b7c4-ccde24f4b266 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:44.369342 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-710b6c8d-8392-4200-b7c4-ccde24f4b266 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:44.592680 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-710b6c8d-8392-4200-b7c4-ccde24f4b266 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:44.602613 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-710b6c8d-8392-4200-b7c4-ccde24f4b266 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1319 microversion: 2.1 time: 0.264280 May 21 21:11:44.604224 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 215/456] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:44 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:44.609792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-02ce1d3c-3581-4c51-8e0e-a2f7d5f33ee3 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:44.610573 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-02ce1d3c-3581-4c51-8e0e-a2f7d5f33ee3 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:44.620111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02ce1d3c-3581-4c51-8e0e-a2f7d5f33ee3 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:44.620874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02ce1d3c-3581-4c51-8e0e-a2f7d5f33ee3 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:44.621979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02ce1d3c-3581-4c51-8e0e-a2f7d5f33ee3 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:44.622644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02ce1d3c-3581-4c51-8e0e-a2f7d5f33ee3 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:44.654502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:44.734165 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-02ce1d3c-3581-4c51-8e0e-a2f7d5f33ee3 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:44.751831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-02ce1d3c-3581-4c51-8e0e-a2f7d5f33ee3 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:44.755805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-02ce1d3c-3581-4c51-8e0e-a2f7d5f33ee3 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:44.774471 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-02ce1d3c-3581-4c51-8e0e-a2f7d5f33ee3 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1452 microversion: 2.75 time: 0.168175 May 21 21:11:44.786207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c93fdf66-22c7-42b7-a2e5-54f3db19726d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:44.790758 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 216/457] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:44 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1452 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:44.801734 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f1ff3437-c096-4568-81fc-3cfaf117abc9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:44.802508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f1ff3437-c096-4568-81fc-3cfaf117abc9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:44.813453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1ff3437-c096-4568-81fc-3cfaf117abc9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:44.814035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1ff3437-c096-4568-81fc-3cfaf117abc9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:44.821401 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1ff3437-c096-4568-81fc-3cfaf117abc9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:44.823258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1ff3437-c096-4568-81fc-3cfaf117abc9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:44.842272 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c93fdf66-22c7-42b7-a2e5-54f3db19726d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 200 len: 1390 microversion: 2.1 time: 1.076812 May 21 21:11:44.851725 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 242/458] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:43 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 1390 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:44.869406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-82a87a8c-4780-4968-93c0-2e742872c098 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:44.872521 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-82a87a8c-4780-4968-93c0-2e742872c098 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:44.899040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82a87a8c-4780-4968-93c0-2e742872c098 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:44.899594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82a87a8c-4780-4968-93c0-2e742872c098 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:44.905501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82a87a8c-4780-4968-93c0-2e742872c098 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:44.905962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82a87a8c-4780-4968-93c0-2e742872c098 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:45.076582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f1ff3437-c096-4568-81fc-3cfaf117abc9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:45.088249 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f1ff3437-c096-4568-81fc-3cfaf117abc9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:45.089883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f1ff3437-c096-4568-81fc-3cfaf117abc9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:45.091033 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f1ff3437-c096-4568-81fc-3cfaf117abc9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1361 microversion: 2.25 time: 0.298459 May 21 21:11:45.098848 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 217/459] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:44 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1361 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:45.114540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-bdbce75d-e84e-40fe-9500-be4fee9f0abc req-d40516f3-e8c3-41ba-8c0e-8b4fd0831ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c92463-f5f1-4c2a-bcf0-573711f0c4f1", "tag": "d19d3553-91b7-47ed-96ea-0384ea855a46"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:45.124614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-bdbce75d-e84e-40fe-9500-be4fee9f0abc req-d40516f3-e8c3-41ba-8c0e-8b4fd0831ca6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:45.125276 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-bdbce75d-e84e-40fe-9500-be4fee9f0abc req-d40516f3-e8c3-41ba-8c0e-8b4fd0831ca6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:45.157949 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-bdbce75d-e84e-40fe-9500-be4fee9f0abc req-d40516f3-e8c3-41ba-8c0e-8b4fd0831ca6 service nova] Creating event network-changed:d19d3553-91b7-47ed-96ea-0384ea855a46 for instance 11c92463-f5f1-4c2a-bcf0-573711f0c4f1 on nch2-master-1 May 21 21:11:45.169250 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-bdbce75d-e84e-40fe-9500-be4fee9f0abc req-d40516f3-e8c3-41ba-8c0e-8b4fd0831ca6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058780 May 21 21:11:45.181091 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 218/460] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:45.181091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-71d00987-484f-4f3b-9f3c-2ebf36d4c261 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:45.181091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-71d00987-484f-4f3b-9f3c-2ebf36d4c261 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:45.191766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71d00987-484f-4f3b-9f3c-2ebf36d4c261 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:45.196459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71d00987-484f-4f3b-9f3c-2ebf36d4c261 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:45.197772 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71d00987-484f-4f3b-9f3c-2ebf36d4c261 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:45.199109 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71d00987-484f-4f3b-9f3c-2ebf36d4c261 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:45.553339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-71d00987-484f-4f3b-9f3c-2ebf36d4c261 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:45.562823 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-71d00987-484f-4f3b-9f3c-2ebf36d4c261 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1471 microversion: 2.1 time: 0.389498 May 21 21:11:45.564253 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 219/461] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:45 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1471 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:45.584420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f37cc07c-eca4-4e86-b068-b8d83cf3644e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:45.590624 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f37cc07c-eca4-4e86-b068-b8d83cf3644e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:45.602068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f37cc07c-eca4-4e86-b068-b8d83cf3644e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:45.602699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f37cc07c-eca4-4e86-b068-b8d83cf3644e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:45.603802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f37cc07c-eca4-4e86-b068-b8d83cf3644e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:45.605121 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f37cc07c-eca4-4e86-b068-b8d83cf3644e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:45.730704 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-82a87a8c-4780-4968-93c0-2e742872c098 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:45.743406 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-82a87a8c-4780-4968-93c0-2e742872c098 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1324 microversion: 2.1 time: 0.899298 May 21 21:11:45.760455 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 243/462] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:44 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1324 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:45.765795 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9d4dd34f-bf38-4cd3-8f5f-d1d3285e6312 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:45.766491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9d4dd34f-bf38-4cd3-8f5f-d1d3285e6312 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:45.775593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d4dd34f-bf38-4cd3-8f5f-d1d3285e6312 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:45.776427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d4dd34f-bf38-4cd3-8f5f-d1d3285e6312 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:45.777426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d4dd34f-bf38-4cd3-8f5f-d1d3285e6312 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:45.778134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d4dd34f-bf38-4cd3-8f5f-d1d3285e6312 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:45.870222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f37cc07c-eca4-4e86-b068-b8d83cf3644e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:45.883778 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f37cc07c-eca4-4e86-b068-b8d83cf3644e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1311 microversion: 2.1 time: 0.316765 May 21 21:11:45.898672 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 220/463] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:45 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1311 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:45.904693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0f70e67f-9559-4d6e-9535-b8eb99bb7acc tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:45.905538 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0f70e67f-9559-4d6e-9535-b8eb99bb7acc tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:45.915043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f70e67f-9559-4d6e-9535-b8eb99bb7acc tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:45.915794 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f70e67f-9559-4d6e-9535-b8eb99bb7acc tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:45.917239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f70e67f-9559-4d6e-9535-b8eb99bb7acc tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:45.917877 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f70e67f-9559-4d6e-9535-b8eb99bb7acc tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:46.026138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0f70e67f-9559-4d6e-9535-b8eb99bb7acc tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:46.038453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0f70e67f-9559-4d6e-9535-b8eb99bb7acc tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:46.040256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0f70e67f-9559-4d6e-9535-b8eb99bb7acc tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:46.048407 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0f70e67f-9559-4d6e-9535-b8eb99bb7acc tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1452 microversion: 2.75 time: 0.148207 May 21 21:11:46.051972 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 221/464] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:45 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:46.059397 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3e5b2034-6fdd-4cb3-84c4-18ac79d6d1fa tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:46.061174 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3e5b2034-6fdd-4cb3-84c4-18ac79d6d1fa tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:46.069909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e5b2034-6fdd-4cb3-84c4-18ac79d6d1fa tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:46.075273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e5b2034-6fdd-4cb3-84c4-18ac79d6d1fa tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:46.076948 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e5b2034-6fdd-4cb3-84c4-18ac79d6d1fa tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:46.077548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e5b2034-6fdd-4cb3-84c4-18ac79d6d1fa tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:46.235247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9d4dd34f-bf38-4cd3-8f5f-d1d3285e6312 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:46.250417 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9d4dd34f-bf38-4cd3-8f5f-d1d3285e6312 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1319 microversion: 2.1 time: 0.482592 May 21 21:11:46.251654 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 244/465] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:45 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1319 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:46.295639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a3b8492e-baf1-4d2a-8a59-e0dd32617c36 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:46.296267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a3b8492e-baf1-4d2a-8a59-e0dd32617c36 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:46.304152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a3b8492e-baf1-4d2a-8a59-e0dd32617c36 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:46.304935 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a3b8492e-baf1-4d2a-8a59-e0dd32617c36 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:46.305930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a3b8492e-baf1-4d2a-8a59-e0dd32617c36 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:46.308447 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a3b8492e-baf1-4d2a-8a59-e0dd32617c36 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:46.369294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3e5b2034-6fdd-4cb3-84c4-18ac79d6d1fa tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:46.381277 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3e5b2034-6fdd-4cb3-84c4-18ac79d6d1fa tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 200 len: 1390 microversion: 2.1 time: 0.326850 May 21 21:11:46.382324 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 222/466] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:46 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 1390 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:46.590854 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-89fee396-a604-40dd-8f0d-da529c2f6c09 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:46.592026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-89fee396-a604-40dd-8f0d-da529c2f6c09 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:46.604712 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-89fee396-a604-40dd-8f0d-da529c2f6c09 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:46.607132 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-89fee396-a604-40dd-8f0d-da529c2f6c09 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:46.612731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-89fee396-a604-40dd-8f0d-da529c2f6c09 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:46.613525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-89fee396-a604-40dd-8f0d-da529c2f6c09 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:46.923015 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-89fee396-a604-40dd-8f0d-da529c2f6c09 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:46.948467 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-89fee396-a604-40dd-8f0d-da529c2f6c09 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1471 microversion: 2.1 time: 0.362746 May 21 21:11:46.962191 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 223/467] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:46 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1471 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:11:46.968807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-81dce70a-d150-4bb9-9111-59b6a1486d40 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:46.970076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-81dce70a-d150-4bb9-9111-59b6a1486d40 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:46.983053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81dce70a-d150-4bb9-9111-59b6a1486d40 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:46.983845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81dce70a-d150-4bb9-9111-59b6a1486d40 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:46.985076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81dce70a-d150-4bb9-9111-59b6a1486d40 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:46.985862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81dce70a-d150-4bb9-9111-59b6a1486d40 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:47.017252 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a3b8492e-baf1-4d2a-8a59-e0dd32617c36 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:47.026589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a3b8492e-baf1-4d2a-8a59-e0dd32617c36 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:47.029015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a3b8492e-baf1-4d2a-8a59-e0dd32617c36 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:47.029552 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a3b8492e-baf1-4d2a-8a59-e0dd32617c36 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1361 microversion: 2.25 time: 0.776061 May 21 21:11:47.029823 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 245/468] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:46 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1361 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:47.043677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2cb32741-c01f-4bed-8c41-283799d5dd9b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:47.044339 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2cb32741-c01f-4bed-8c41-283799d5dd9b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:47.057331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2cb32741-c01f-4bed-8c41-283799d5dd9b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:47.057933 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2cb32741-c01f-4bed-8c41-283799d5dd9b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:47.058788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2cb32741-c01f-4bed-8c41-283799d5dd9b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:47.059564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2cb32741-c01f-4bed-8c41-283799d5dd9b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:47.234574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-81dce70a-d150-4bb9-9111-59b6a1486d40 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:47.246473 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-81dce70a-d150-4bb9-9111-59b6a1486d40 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1324 microversion: 2.1 time: 0.281856 May 21 21:11:47.253312 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 224/469] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:46 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1324 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:47.278637 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6ed002cf-cdf1-44dc-8706-075fdbbee6da tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:47.279664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6ed002cf-cdf1-44dc-8706-075fdbbee6da tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:47.289795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:47.291487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6ed002cf-cdf1-44dc-8706-075fdbbee6da tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:47.291947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6ed002cf-cdf1-44dc-8706-075fdbbee6da tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:47.292830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6ed002cf-cdf1-44dc-8706-075fdbbee6da tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:47.293427 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6ed002cf-cdf1-44dc-8706-075fdbbee6da tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:47.401761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6ed002cf-cdf1-44dc-8706-075fdbbee6da tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:47.437785 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6ed002cf-cdf1-44dc-8706-075fdbbee6da tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:47.437785 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6ed002cf-cdf1-44dc-8706-075fdbbee6da tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:47.438208 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6ed002cf-cdf1-44dc-8706-075fdbbee6da tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1437 microversion: 2.75 time: 0.183558 May 21 21:11:47.454956 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 225/470] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:47 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1437 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:47.463199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-df35d283-7c6f-4ee5-a766-59212d793c2f tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:47.463871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-df35d283-7c6f-4ee5-a766-59212d793c2f tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:47.471455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df35d283-7c6f-4ee5-a766-59212d793c2f tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:47.472008 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df35d283-7c6f-4ee5-a766-59212d793c2f tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:47.473132 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df35d283-7c6f-4ee5-a766-59212d793c2f tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:47.473446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df35d283-7c6f-4ee5-a766-59212d793c2f tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:47.672076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2cb32741-c01f-4bed-8c41-283799d5dd9b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:47.682495 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2cb32741-c01f-4bed-8c41-283799d5dd9b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1311 microversion: 2.1 time: 0.651601 May 21 21:11:47.697653 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 246/471] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:47 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1311 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:47.707507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-254f3c16-dd2e-43d7-a98b-77ffadf7d2ff req-4aadf47a-12a1-4d15-9425-6dbeaeadb2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a046a9e9-4485-4d77-9f5c-62410cf739f5", "tag": "7dab2225-b424-4882-a428-97b3ef334ec1"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:47.746547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-254f3c16-dd2e-43d7-a98b-77ffadf7d2ff req-4aadf47a-12a1-4d15-9425-6dbeaeadb2a4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:47.750178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-254f3c16-dd2e-43d7-a98b-77ffadf7d2ff req-4aadf47a-12a1-4d15-9425-6dbeaeadb2a4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:47.768710 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-df35d283-7c6f-4ee5-a766-59212d793c2f tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:47.777109 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-df35d283-7c6f-4ee5-a766-59212d793c2f tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1319 microversion: 2.1 time: 0.320104 May 21 21:11:47.782755 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 226/472] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:47 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:47.787163 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c904a714-d20d-49db-9b79-06b7a4b1b1bf tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:47.787794 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c904a714-d20d-49db-9b79-06b7a4b1b1bf tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:47.793808 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-254f3c16-dd2e-43d7-a98b-77ffadf7d2ff req-4aadf47a-12a1-4d15-9425-6dbeaeadb2a4 service nova] Creating event network-changed:7dab2225-b424-4882-a428-97b3ef334ec1 for instance a046a9e9-4485-4d77-9f5c-62410cf739f5 on nch1-master-1 May 21 21:11:47.795876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c904a714-d20d-49db-9b79-06b7a4b1b1bf tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:47.796374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c904a714-d20d-49db-9b79-06b7a4b1b1bf tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:47.797184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c904a714-d20d-49db-9b79-06b7a4b1b1bf tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:47.797626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c904a714-d20d-49db-9b79-06b7a4b1b1bf tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:47.808517 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-254f3c16-dd2e-43d7-a98b-77ffadf7d2ff req-4aadf47a-12a1-4d15-9425-6dbeaeadb2a4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109137 May 21 21:11:47.811175 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 247/473] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:47.989768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c904a714-d20d-49db-9b79-06b7a4b1b1bf tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:48.000481 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c904a714-d20d-49db-9b79-06b7a4b1b1bf tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 200 len: 1390 microversion: 2.1 time: 0.217255 May 21 21:11:48.001432 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 227/474] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:47 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 1390 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:48.006752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cb5e023d-a641-4752-b875-40efe882b0e8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:48.007797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cb5e023d-a641-4752-b875-40efe882b0e8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:48.014539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb5e023d-a641-4752-b875-40efe882b0e8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:48.015151 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb5e023d-a641-4752-b875-40efe882b0e8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:48.017900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb5e023d-a641-4752-b875-40efe882b0e8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:48.017900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb5e023d-a641-4752-b875-40efe882b0e8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:48.091297 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6cbeedc9-f647-4411-bef5-8f1e83976313 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:48.109832 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6cbeedc9-f647-4411-bef5-8f1e83976313 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:48.120166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6cbeedc9-f647-4411-bef5-8f1e83976313 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:48.124989 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6cbeedc9-f647-4411-bef5-8f1e83976313 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:48.131285 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6cbeedc9-f647-4411-bef5-8f1e83976313 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:48.131285 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6cbeedc9-f647-4411-bef5-8f1e83976313 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:48.249367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cb5e023d-a641-4752-b875-40efe882b0e8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:48.277028 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cb5e023d-a641-4752-b875-40efe882b0e8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1476 microversion: 2.1 time: 0.269694 May 21 21:11:48.281299 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 228/475] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:48 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1476 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:48.289162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-21892bb1-6f75-472a-a86b-7b84362a8079 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:48.292051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-21892bb1-6f75-472a-a86b-7b84362a8079 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:48.303883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21892bb1-6f75-472a-a86b-7b84362a8079 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:48.310875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21892bb1-6f75-472a-a86b-7b84362a8079 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:48.310875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21892bb1-6f75-472a-a86b-7b84362a8079 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:48.310875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21892bb1-6f75-472a-a86b-7b84362a8079 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:48.342400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6cbeedc9-f647-4411-bef5-8f1e83976313 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:11:48.342970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6cbeedc9-f647-4411-bef5-8f1e83976313 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:11:48.343499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6cbeedc9-f647-4411-bef5-8f1e83976313 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:11:48.343990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6cbeedc9-f647-4411-bef5-8f1e83976313 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:11:48.344701 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6cbeedc9-f647-4411-bef5-8f1e83976313 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:11:48.608532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-21892bb1-6f75-472a-a86b-7b84362a8079 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:48.619935 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-21892bb1-6f75-472a-a86b-7b84362a8079 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:48.622742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-21892bb1-6f75-472a-a86b-7b84362a8079 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:48.624070 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-21892bb1-6f75-472a-a86b-7b84362a8079 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1361 microversion: 2.25 time: 0.341084 May 21 21:11:48.636591 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 229/476] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:48 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1361 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:48.642014 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6fe3c6b2-0555-4395-b9e8-e1b8666aa14c tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:48.643364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6fe3c6b2-0555-4395-b9e8-e1b8666aa14c tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:48.653064 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6fe3c6b2-0555-4395-b9e8-e1b8666aa14c tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:48.653522 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6fe3c6b2-0555-4395-b9e8-e1b8666aa14c tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:48.654422 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6fe3c6b2-0555-4395-b9e8-e1b8666aa14c tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:48.654975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6fe3c6b2-0555-4395-b9e8-e1b8666aa14c tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:48.686786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6cbeedc9-f647-4411-bef5-8f1e83976313 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:48.701811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6cbeedc9-f647-4411-bef5-8f1e83976313 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:48.701811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6cbeedc9-f647-4411-bef5-8f1e83976313 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:48.704222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6cbeedc9-f647-4411-bef5-8f1e83976313 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:48.704712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6cbeedc9-f647-4411-bef5-8f1e83976313 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:48.884596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6fe3c6b2-0555-4395-b9e8-e1b8666aa14c tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:48.895125 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6fe3c6b2-0555-4395-b9e8-e1b8666aa14c tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1324 microversion: 2.1 time: 0.257094 May 21 21:11:48.904659 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 230/477] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:48 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1324 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:48.904659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-bfd6e000-2bb1-4dfd-b698-629d46553a2b req-f43a2a10-3390-4b32-91ea-0aad2934531a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b5633e-336c-45cc-927e-8bc71bd6e52f", "name": "network-vif-plugged", "status": "completed", "tag": "dc7021f0-e141-4045-80b4-042a54a3e380"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:48.922516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-6cbeedc9-f647-4411-bef5-8f1e83976313 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:11:48.925379 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-bfd6e000-2bb1-4dfd-b698-629d46553a2b req-f43a2a10-3390-4b32-91ea-0aad2934531a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:48.925765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-bfd6e000-2bb1-4dfd-b698-629d46553a2b req-f43a2a10-3390-4b32-91ea-0aad2934531a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:48.953426 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-bfd6e000-2bb1-4dfd-b698-629d46553a2b req-f43a2a10-3390-4b32-91ea-0aad2934531a service nova] Creating event network-vif-plugged:dc7021f0-e141-4045-80b4-042a54a3e380 for instance a6b5633e-336c-45cc-927e-8bc71bd6e52f on nch2-master-1 May 21 21:11:48.983489 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-bfd6e000-2bb1-4dfd-b698-629d46553a2b req-f43a2a10-3390-4b32-91ea-0aad2934531a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085837 May 21 21:11:48.985370 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 231/478] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:48.998625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7c1e048f-3a0d-4260-9329-a5e7e7110420 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:48.998933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7c1e048f-3a0d-4260-9329-a5e7e7110420 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:49.017178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c1e048f-3a0d-4260-9329-a5e7e7110420 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:49.020361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c1e048f-3a0d-4260-9329-a5e7e7110420 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:49.021284 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c1e048f-3a0d-4260-9329-a5e7e7110420 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:49.023737 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c1e048f-3a0d-4260-9329-a5e7e7110420 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:49.079421 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6cbeedc9-f647-4411-bef5-8f1e83976313 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a/action" status: 202 len: 1940 microversion: 2.75 time: 1.266607 May 21 21:11:49.100316 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 248/479] 10.222.0.49 () {62 vars in 1318 bytes} [Sat May 21 21:11:47 2022] POST /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a/action => generated 1940 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 21 21:11:49.111226 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-128af568-153f-4c77-96b4-b96ed64eca37 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:49.112865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-128af568-153f-4c77-96b4-b96ed64eca37 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:49.147310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-128af568-153f-4c77-96b4-b96ed64eca37 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:49.147817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-128af568-153f-4c77-96b4-b96ed64eca37 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:49.151298 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-128af568-153f-4c77-96b4-b96ed64eca37 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:49.151766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-128af568-153f-4c77-96b4-b96ed64eca37 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:49.318287 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7c1e048f-3a0d-4260-9329-a5e7e7110420 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:49.329455 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7c1e048f-3a0d-4260-9329-a5e7e7110420 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1311 microversion: 2.1 time: 0.336840 May 21 21:11:49.330714 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 232/480] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:48 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1311 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:49.337424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0647d73c-c503-4ead-ba71-be8cea449249 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:49.338295 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0647d73c-c503-4ead-ba71-be8cea449249 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:49.346688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0647d73c-c503-4ead-ba71-be8cea449249 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:49.347388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0647d73c-c503-4ead-ba71-be8cea449249 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:49.348441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0647d73c-c503-4ead-ba71-be8cea449249 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:49.349046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0647d73c-c503-4ead-ba71-be8cea449249 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:49.678658 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0647d73c-c503-4ead-ba71-be8cea449249 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:49.700617 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0647d73c-c503-4ead-ba71-be8cea449249 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 200 len: 1390 microversion: 2.1 time: 0.367669 May 21 21:11:49.712404 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 233/481] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:49 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 1390 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:49.718987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8651b66d-9b1c-4508-b83e-e8d5376f9627 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:49.719618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8651b66d-9b1c-4508-b83e-e8d5376f9627 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:49.728134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8651b66d-9b1c-4508-b83e-e8d5376f9627 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:49.728677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8651b66d-9b1c-4508-b83e-e8d5376f9627 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:49.729475 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8651b66d-9b1c-4508-b83e-e8d5376f9627 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:49.730085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8651b66d-9b1c-4508-b83e-e8d5376f9627 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:49.827229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:49.924118 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-8651b66d-9b1c-4508-b83e-e8d5376f9627 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:11:50.133142 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8651b66d-9b1c-4508-b83e-e8d5376f9627 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1927 microversion: 2.75 time: 0.419260 May 21 21:11:50.146170 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 234/482] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:49 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1927 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:50.151474 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0a591fbb-b363-41c6-8a2a-78920941bc7f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:50.152206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0a591fbb-b363-41c6-8a2a-78920941bc7f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:50.162038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a591fbb-b363-41c6-8a2a-78920941bc7f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:50.162632 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a591fbb-b363-41c6-8a2a-78920941bc7f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:50.165126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a591fbb-b363-41c6-8a2a-78920941bc7f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:50.168031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a591fbb-b363-41c6-8a2a-78920941bc7f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:50.365405 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-128af568-153f-4c77-96b4-b96ed64eca37 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:50.373428 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-128af568-153f-4c77-96b4-b96ed64eca37 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1319 microversion: 2.1 time: 1.279065 May 21 21:11:50.388303 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 249/483] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:49 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1319 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:50.393077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-20890f9e-9bbc-4dba-8540-238e4dbad437 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:50.396929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-20890f9e-9bbc-4dba-8540-238e4dbad437 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:50.406370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20890f9e-9bbc-4dba-8540-238e4dbad437 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:50.407094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20890f9e-9bbc-4dba-8540-238e4dbad437 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:50.408526 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20890f9e-9bbc-4dba-8540-238e4dbad437 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:50.409158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20890f9e-9bbc-4dba-8540-238e4dbad437 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:50.479337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0a591fbb-b363-41c6-8a2a-78920941bc7f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:50.490481 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0a591fbb-b363-41c6-8a2a-78920941bc7f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1476 microversion: 2.1 time: 0.342958 May 21 21:11:50.491482 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 235/484] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:50 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1476 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:50.497468 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2ed91cbb-ea3b-4e33-b42f-e15f3925e15f tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:50.498093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2ed91cbb-ea3b-4e33-b42f-e15f3925e15f tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:50.511832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2ed91cbb-ea3b-4e33-b42f-e15f3925e15f tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:50.512498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2ed91cbb-ea3b-4e33-b42f-e15f3925e15f tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:50.516956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2ed91cbb-ea3b-4e33-b42f-e15f3925e15f tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:50.518325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2ed91cbb-ea3b-4e33-b42f-e15f3925e15f tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:50.763143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2ed91cbb-ea3b-4e33-b42f-e15f3925e15f tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:50.773178 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2ed91cbb-ea3b-4e33-b42f-e15f3925e15f tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1324 microversion: 2.1 time: 0.279629 May 21 21:11:50.781040 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 236/485] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:50 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1324 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:50.789736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4dd4cbab-abc3-4963-a9da-e43eba7ac077 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:50.790361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4dd4cbab-abc3-4963-a9da-e43eba7ac077 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:50.797294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4dd4cbab-abc3-4963-a9da-e43eba7ac077 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:50.802098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4dd4cbab-abc3-4963-a9da-e43eba7ac077 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:50.802098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4dd4cbab-abc3-4963-a9da-e43eba7ac077 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:50.802098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4dd4cbab-abc3-4963-a9da-e43eba7ac077 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:50.909584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-20890f9e-9bbc-4dba-8540-238e4dbad437 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:50.918189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-20890f9e-9bbc-4dba-8540-238e4dbad437 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:50.920056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-20890f9e-9bbc-4dba-8540-238e4dbad437 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:50.921418 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-20890f9e-9bbc-4dba-8540-238e4dbad437 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1361 microversion: 2.25 time: 0.537279 May 21 21:11:50.936927 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 250/486] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:50 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1361 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:50.942116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e98efc19-1459-4e96-bfe9-e87924cbdd9d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:50.946660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e98efc19-1459-4e96-bfe9-e87924cbdd9d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:50.962134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e98efc19-1459-4e96-bfe9-e87924cbdd9d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:50.962873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e98efc19-1459-4e96-bfe9-e87924cbdd9d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:50.963828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e98efc19-1459-4e96-bfe9-e87924cbdd9d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:50.964458 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e98efc19-1459-4e96-bfe9-e87924cbdd9d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:50.969315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:51.098476 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4dd4cbab-abc3-4963-a9da-e43eba7ac077 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:51.110806 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4dd4cbab-abc3-4963-a9da-e43eba7ac077 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1311 microversion: 2.1 time: 0.328471 May 21 21:11:51.123554 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 237/487] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:50 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1311 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:51.154017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ade63b29-c9db-49b4-9fbc-00d9ad33dd13 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:51.154733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ade63b29-c9db-49b4-9fbc-00d9ad33dd13 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:51.164940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ade63b29-c9db-49b4-9fbc-00d9ad33dd13 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:51.165438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ade63b29-c9db-49b4-9fbc-00d9ad33dd13 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:51.170575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ade63b29-c9db-49b4-9fbc-00d9ad33dd13 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:51.170575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ade63b29-c9db-49b4-9fbc-00d9ad33dd13 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:51.273262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-ade63b29-c9db-49b4-9fbc-00d9ad33dd13 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:11:51.293509 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ade63b29-c9db-49b4-9fbc-00d9ad33dd13 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1927 microversion: 2.75 time: 0.143713 May 21 21:11:51.294106 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 238/488] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:51 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1927 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:11:51.299647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-166e0168-ab54-474e-93e8-b851d905ca38 req-cc8c42a4-64d0-4356-88ae-9cf68d885a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d169f8-72b8-4928-b109-7d948fe70b9a", "name": "network-vif-plugged", "status": "completed", "tag": "9c5044e3-c8fa-45e3-b917-7a13d3004a8e"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:51.308591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-166e0168-ab54-474e-93e8-b851d905ca38 req-cc8c42a4-64d0-4356-88ae-9cf68d885a81 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:51.309044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-166e0168-ab54-474e-93e8-b851d905ca38 req-cc8c42a4-64d0-4356-88ae-9cf68d885a81 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:51.321729 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-166e0168-ab54-474e-93e8-b851d905ca38 req-cc8c42a4-64d0-4356-88ae-9cf68d885a81 service nova] Creating event network-vif-plugged:9c5044e3-c8fa-45e3-b917-7a13d3004a8e for instance 23d169f8-72b8-4928-b109-7d948fe70b9a on nch2-master-1 May 21 21:11:51.327522 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-166e0168-ab54-474e-93e8-b851d905ca38 req-cc8c42a4-64d0-4356-88ae-9cf68d885a81 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031536 May 21 21:11:51.328348 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 239/489] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:51.401666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c1b6ada5-d36c-4bc4-9357-cebfac27e64a tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:51.403009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c1b6ada5-d36c-4bc4-9357-cebfac27e64a tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:51.414395 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1b6ada5-d36c-4bc4-9357-cebfac27e64a tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:51.415300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1b6ada5-d36c-4bc4-9357-cebfac27e64a tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:51.419486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1b6ada5-d36c-4bc4-9357-cebfac27e64a tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:51.420131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1b6ada5-d36c-4bc4-9357-cebfac27e64a tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:51.567114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e98efc19-1459-4e96-bfe9-e87924cbdd9d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:51.595047 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e98efc19-1459-4e96-bfe9-e87924cbdd9d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 200 len: 1390 microversion: 2.1 time: 0.653288 May 21 21:11:51.598609 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 251/490] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:50 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 1390 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:51.618128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c5d256b0-bb00-48b4-8986-91cf69a41a7a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:51.621793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c5d256b0-bb00-48b4-8986-91cf69a41a7a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:51.645823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c5d256b0-bb00-48b4-8986-91cf69a41a7a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:51.649232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c5d256b0-bb00-48b4-8986-91cf69a41a7a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:51.650365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c5d256b0-bb00-48b4-8986-91cf69a41a7a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:51.654682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c5d256b0-bb00-48b4-8986-91cf69a41a7a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:51.768714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c1b6ada5-d36c-4bc4-9357-cebfac27e64a tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:51.778135 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c1b6ada5-d36c-4bc4-9357-cebfac27e64a tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1319 microversion: 2.1 time: 0.381110 May 21 21:11:51.785638 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 240/491] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:51 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:11:51.796933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2894cc85-a571-4ba1-9bd7-bc32936d56d4 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:51.805275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2894cc85-a571-4ba1-9bd7-bc32936d56d4 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:51.815958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2894cc85-a571-4ba1-9bd7-bc32936d56d4 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:51.816670 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2894cc85-a571-4ba1-9bd7-bc32936d56d4 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:51.817472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2894cc85-a571-4ba1-9bd7-bc32936d56d4 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:51.817922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2894cc85-a571-4ba1-9bd7-bc32936d56d4 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:52.011095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2894cc85-a571-4ba1-9bd7-bc32936d56d4 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:52.014114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c5d256b0-bb00-48b4-8986-91cf69a41a7a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:52.022467 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2894cc85-a571-4ba1-9bd7-bc32936d56d4 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1324 microversion: 2.1 time: 0.229369 May 21 21:11:52.024976 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c5d256b0-bb00-48b4-8986-91cf69a41a7a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1476 microversion: 2.1 time: 0.424780 May 21 21:11:52.026023 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 252/492] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:51 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1476 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:52.029357 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 241/493] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:51 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1324 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:52.032425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ff5935d0-5d87-407c-a4d2-10af147b27b3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:52.033863 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ff5935d0-5d87-407c-a4d2-10af147b27b3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:52.041735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff5935d0-5d87-407c-a4d2-10af147b27b3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:52.042375 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff5935d0-5d87-407c-a4d2-10af147b27b3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:52.043541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff5935d0-5d87-407c-a4d2-10af147b27b3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:52.044157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff5935d0-5d87-407c-a4d2-10af147b27b3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:52.136321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1f2f9fe5-7dc1-440a-8b66-8396b8dad53e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:52.137157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1f2f9fe5-7dc1-440a-8b66-8396b8dad53e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:52.150478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f2f9fe5-7dc1-440a-8b66-8396b8dad53e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:52.150999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f2f9fe5-7dc1-440a-8b66-8396b8dad53e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:52.151945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f2f9fe5-7dc1-440a-8b66-8396b8dad53e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:52.154148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f2f9fe5-7dc1-440a-8b66-8396b8dad53e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:52.231223 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ff5935d0-5d87-407c-a4d2-10af147b27b3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:52.245376 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ff5935d0-5d87-407c-a4d2-10af147b27b3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:52.247823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ff5935d0-5d87-407c-a4d2-10af147b27b3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:52.252765 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ff5935d0-5d87-407c-a4d2-10af147b27b3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1361 microversion: 2.25 time: 0.224284 May 21 21:11:52.254710 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 253/494] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:52 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:52.323178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9637c96d-4071-4275-8b85-19a44b80d2cf tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:52.324479 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9637c96d-4071-4275-8b85-19a44b80d2cf tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:52.333119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9637c96d-4071-4275-8b85-19a44b80d2cf tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:52.333945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9637c96d-4071-4275-8b85-19a44b80d2cf tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:52.335040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9637c96d-4071-4275-8b85-19a44b80d2cf tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:52.335821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9637c96d-4071-4275-8b85-19a44b80d2cf tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:52.388947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1f2f9fe5-7dc1-440a-8b66-8396b8dad53e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:52.400909 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1f2f9fe5-7dc1-440a-8b66-8396b8dad53e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1494 microversion: 2.1 time: 0.269534 May 21 21:11:52.402054 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 242/495] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:52 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1494 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:52.455383 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-9637c96d-4071-4275-8b85-19a44b80d2cf tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:11:52.494323 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9637c96d-4071-4275-8b85-19a44b80d2cf tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1927 microversion: 2.75 time: 0.175801 May 21 21:11:52.495225 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 254/496] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:52 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1927 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:52.525215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6b5fe3e8-a8d5-45e4-b7f7-99d59876bfa4 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:52.525938 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6b5fe3e8-a8d5-45e4-b7f7-99d59876bfa4 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:52.532174 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b5fe3e8-a8d5-45e4-b7f7-99d59876bfa4 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:52.533552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b5fe3e8-a8d5-45e4-b7f7-99d59876bfa4 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:52.534405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b5fe3e8-a8d5-45e4-b7f7-99d59876bfa4 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:52.535053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b5fe3e8-a8d5-45e4-b7f7-99d59876bfa4 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:52.614477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c303c4a1-1540-4215-ba38-0e4ddbfd85a3 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:52.615794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c303c4a1-1540-4215-ba38-0e4ddbfd85a3 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:52.624346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c303c4a1-1540-4215-ba38-0e4ddbfd85a3 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:52.626592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c303c4a1-1540-4215-ba38-0e4ddbfd85a3 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:52.627970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c303c4a1-1540-4215-ba38-0e4ddbfd85a3 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:52.628642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c303c4a1-1540-4215-ba38-0e4ddbfd85a3 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:52.707423 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6b5fe3e8-a8d5-45e4-b7f7-99d59876bfa4 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1645 microversion: 2.1 time: 0.287745 May 21 21:11:52.716183 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 243/497] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:52 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1645 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:52.728561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-38f35afe-cde3-430f-aba9-9ee12beff639 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:52.730853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-38f35afe-cde3-430f-aba9-9ee12beff639 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:52.739120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38f35afe-cde3-430f-aba9-9ee12beff639 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:52.740457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38f35afe-cde3-430f-aba9-9ee12beff639 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:52.741620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38f35afe-cde3-430f-aba9-9ee12beff639 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:52.742227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38f35afe-cde3-430f-aba9-9ee12beff639 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:52.828479 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c303c4a1-1540-4215-ba38-0e4ddbfd85a3 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:52.838942 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c303c4a1-1540-4215-ba38-0e4ddbfd85a3 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 200 len: 1390 microversion: 2.1 time: 0.228890 May 21 21:11:52.848836 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 255/498] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:52 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 1390 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:11:52.857537 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ff4af068-11e6-48eb-93ba-8369e621ee5e tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:52.858818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ff4af068-11e6-48eb-93ba-8369e621ee5e tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:52.866604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff4af068-11e6-48eb-93ba-8369e621ee5e tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:52.867279 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff4af068-11e6-48eb-93ba-8369e621ee5e tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:52.868320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff4af068-11e6-48eb-93ba-8369e621ee5e tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:52.869226 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff4af068-11e6-48eb-93ba-8369e621ee5e tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:52.940673 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-38f35afe-cde3-430f-aba9-9ee12beff639 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1645 microversion: 2.1 time: 0.214798 May 21 21:11:52.941658 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 244/499] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:52 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1645 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:52.965405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-93a69cfd-e535-4217-89ea-20ac87dd3c12 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:52.967558 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:11:52.967558 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:11:52.971847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-93a69cfd-e535-4217-89ea-20ac87dd3c12 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:52.974421 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-93a69cfd-e535-4217-89ea-20ac87dd3c12 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:52.975434 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-93a69cfd-e535-4217-89ea-20ac87dd3c12 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:52.975977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-93a69cfd-e535-4217-89ea-20ac87dd3c12 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:53.023194 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-93a69cfd-e535-4217-89ea-20ac87dd3c12 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.065977 May 21 21:11:53.029146 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 245/500] 10.222.0.49 () {58 vars in 1175 bytes} [Sat May 21 21:11:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:53.041343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eccd06b8-2b4c-48e9-bb95-ee2bcdcca929 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:53.042739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-eccd06b8-2b4c-48e9-bb95-ee2bcdcca929 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:53.050162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eccd06b8-2b4c-48e9-bb95-ee2bcdcca929 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:53.050839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eccd06b8-2b4c-48e9-bb95-ee2bcdcca929 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:53.051777 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eccd06b8-2b4c-48e9-bb95-ee2bcdcca929 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:53.052401 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eccd06b8-2b4c-48e9-bb95-ee2bcdcca929 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:53.143740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-eccd06b8-2b4c-48e9-bb95-ee2bcdcca929 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lazy-loading 'flavor' on Instance uuid a6b5633e-336c-45cc-927e-8bc71bd6e52f {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:11:53.185438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ff4af068-11e6-48eb-93ba-8369e621ee5e tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:53.194025 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ff4af068-11e6-48eb-93ba-8369e621ee5e tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1319 microversion: 2.1 time: 0.343886 May 21 21:11:53.194652 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 256/501] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:52 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:53.199218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-72751cdc-de62-4c64-8074-990d83b09c6f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:53.201769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-72751cdc-de62-4c64-8074-990d83b09c6f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:53.216230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72751cdc-de62-4c64-8074-990d83b09c6f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:53.216230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72751cdc-de62-4c64-8074-990d83b09c6f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:53.216230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72751cdc-de62-4c64-8074-990d83b09c6f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:53.216230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72751cdc-de62-4c64-8074-990d83b09c6f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:53.217507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-eccd06b8-2b4c-48e9-bb95-ee2bcdcca929 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Going to try to live migrate instance to nch1-master-1 {{(pid=131278) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 21 21:11:53.384797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-72751cdc-de62-4c64-8074-990d83b09c6f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:53.392857 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-72751cdc-de62-4c64-8074-990d83b09c6f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1476 microversion: 2.1 time: 0.196919 May 21 21:11:53.401567 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 257/502] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:53 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1476 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:53.401567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ffe6ad7e-0422-4c52-adf8-77fa8fc92728 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:53.401567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ffe6ad7e-0422-4c52-adf8-77fa8fc92728 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:53.406418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffe6ad7e-0422-4c52-adf8-77fa8fc92728 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:53.406862 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffe6ad7e-0422-4c52-adf8-77fa8fc92728 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:53.410342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffe6ad7e-0422-4c52-adf8-77fa8fc92728 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:53.410342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffe6ad7e-0422-4c52-adf8-77fa8fc92728 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:53.575614 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ffe6ad7e-0422-4c52-adf8-77fa8fc92728 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:53.588386 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ffe6ad7e-0422-4c52-adf8-77fa8fc92728 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1324 microversion: 2.1 time: 0.192903 May 21 21:11:53.603788 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 258/503] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:53 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1324 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:53.631894 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9cce38d5-7b9f-459d-b5dd-2133578a8cc6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:53.632717 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9cce38d5-7b9f-459d-b5dd-2133578a8cc6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:53.641449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cce38d5-7b9f-459d-b5dd-2133578a8cc6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:53.642340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cce38d5-7b9f-459d-b5dd-2133578a8cc6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:53.643538 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cce38d5-7b9f-459d-b5dd-2133578a8cc6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:53.644250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cce38d5-7b9f-459d-b5dd-2133578a8cc6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:53.840865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9cce38d5-7b9f-459d-b5dd-2133578a8cc6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:53.850791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9cce38d5-7b9f-459d-b5dd-2133578a8cc6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:53.853033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9cce38d5-7b9f-459d-b5dd-2133578a8cc6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:53.854300 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9cce38d5-7b9f-459d-b5dd-2133578a8cc6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1361 microversion: 2.25 time: 0.230342 May 21 21:11:53.855040 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 259/504] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:53 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1361 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:53.869566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-a9a27bfc-61dc-46f3-aa11-dd9d33715f4d req-3a62a392-4c75-46f8-95d0-cd6cbeea9ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d32d33-c3d7-4c41-a4cf-f804fac41120", "name": "network-vif-plugged", "status": "completed", "tag": "2e166c5d-4aab-4618-98ae-7042d9891722"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:53.880048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a9a27bfc-61dc-46f3-aa11-dd9d33715f4d req-3a62a392-4c75-46f8-95d0-cd6cbeea9ce1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:53.880611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a9a27bfc-61dc-46f3-aa11-dd9d33715f4d req-3a62a392-4c75-46f8-95d0-cd6cbeea9ce1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:53.903160 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a9a27bfc-61dc-46f3-aa11-dd9d33715f4d req-3a62a392-4c75-46f8-95d0-cd6cbeea9ce1 service nova] Creating event network-vif-plugged:2e166c5d-4aab-4618-98ae-7042d9891722 for instance 99d32d33-c3d7-4c41-a4cf-f804fac41120 on nch2-master-1 May 21 21:11:53.911107 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-a9a27bfc-61dc-46f3-aa11-dd9d33715f4d req-3a62a392-4c75-46f8-95d0-cd6cbeea9ce1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045412 May 21 21:11:53.912205 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 260/505] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:53.919339 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ffea185e-27c1-4f8d-93ab-de443ed459b1 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:53.920049 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ffea185e-27c1-4f8d-93ab-de443ed459b1 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:53.927650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffea185e-27c1-4f8d-93ab-de443ed459b1 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:53.928106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffea185e-27c1-4f8d-93ab-de443ed459b1 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:53.928978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffea185e-27c1-4f8d-93ab-de443ed459b1 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:53.929849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffea185e-27c1-4f8d-93ab-de443ed459b1 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:54.050801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-ffea185e-27c1-4f8d-93ab-de443ed459b1 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:11:54.086966 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ffea185e-27c1-4f8d-93ab-de443ed459b1 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1927 microversion: 2.75 time: 0.173452 May 21 21:11:54.108147 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 261/506] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:53 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1927 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:54.115352 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aecd0070-39ef-49a0-9927-6c1c00714d45 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:54.116264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aecd0070-39ef-49a0-9927-6c1c00714d45 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:54.127449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aecd0070-39ef-49a0-9927-6c1c00714d45 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:54.128124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aecd0070-39ef-49a0-9927-6c1c00714d45 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:54.129109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aecd0070-39ef-49a0-9927-6c1c00714d45 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:54.130529 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aecd0070-39ef-49a0-9927-6c1c00714d45 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:54.354817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aecd0070-39ef-49a0-9927-6c1c00714d45 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:54.363991 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aecd0070-39ef-49a0-9927-6c1c00714d45 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 200 len: 1390 microversion: 2.1 time: 0.275096 May 21 21:11:54.364697 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 262/507] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:54 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 1390 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:54.379832 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4bd3522c-fb4d-4653-a9d4-da8d12aa1eb9 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:54.386708 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4bd3522c-fb4d-4653-a9d4-da8d12aa1eb9 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:54.393700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4bd3522c-fb4d-4653-a9d4-da8d12aa1eb9 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:54.394224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4bd3522c-fb4d-4653-a9d4-da8d12aa1eb9 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:54.395102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4bd3522c-fb4d-4653-a9d4-da8d12aa1eb9 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:54.395608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4bd3522c-fb4d-4653-a9d4-da8d12aa1eb9 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:54.546116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4bd3522c-fb4d-4653-a9d4-da8d12aa1eb9 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:54.555704 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4bd3522c-fb4d-4653-a9d4-da8d12aa1eb9 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1468 microversion: 2.1 time: 0.189861 May 21 21:11:54.556317 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 263/508] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:54 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1468 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:54.560844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2f527efb-ad1a-4741-8f7f-fd9409b42562 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:54.561700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2f527efb-ad1a-4741-8f7f-fd9409b42562 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:54.568403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f527efb-ad1a-4741-8f7f-fd9409b42562 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:54.568862 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f527efb-ad1a-4741-8f7f-fd9409b42562 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:54.569644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f527efb-ad1a-4741-8f7f-fd9409b42562 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:54.570083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f527efb-ad1a-4741-8f7f-fd9409b42562 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:54.732620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2f527efb-ad1a-4741-8f7f-fd9409b42562 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:54.741986 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2f527efb-ad1a-4741-8f7f-fd9409b42562 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1476 microversion: 2.1 time: 0.184632 May 21 21:11:54.744075 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 264/509] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:54 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1476 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:54.805838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-efa34aa1-81d0-48b3-8921-0699c01c3321 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-340959485", "block_migration": true, "disk_over_commit": false}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:54.807029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-efa34aa1-81d0-48b3-8921-0699c01c3321 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:54.813279 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efa34aa1-81d0-48b3-8921-0699c01c3321 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:54.813729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efa34aa1-81d0-48b3-8921-0699c01c3321 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:54.815121 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efa34aa1-81d0-48b3-8921-0699c01c3321 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:54.815654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efa34aa1-81d0-48b3-8921-0699c01c3321 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:54.887620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-efa34aa1-81d0-48b3-8921-0699c01c3321 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lazy-loading 'flavor' on Instance uuid 23d169f8-72b8-4928-b109-7d948fe70b9a {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:11:54.960184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-efa34aa1-81d0-48b3-8921-0699c01c3321 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Going to try to live migrate instance to tempest-host-340959485 {{(pid=131277) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 21 21:11:54.968782 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-efa34aa1-81d0-48b3-8921-0699c01c3321 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] HTTP exception thrown: Compute host tempest-host-340959485 could not be found. May 21 21:11:54.987116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-efa34aa1-81d0-48b3-8921-0699c01c3321 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Request method failure captured: May 21 21:11:54.987116 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a/action HTTP/1.1 May 21 21:11:54.987116 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:11:54.987116 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:11:54.987116 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:11:54.987116 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 106 May 21 21:11:54.987116 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:11:54.987116 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:11:54.987116 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:11:54.987116 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:11:54.987116 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVV96LNZ9mBuXz6RRIKr3ItwNEsqpnDJkYxzM98aKlnKgHiKb8Z5vNs3UhI-IC9qZBG7KdkzreuPqta5tEvcZqiETF_1mIBViD-VFCFAoeQa6iTbtlA-cFSWIi0ckSsTFsw4lmlyohC_rDZaRJVQxKs6Gty5GdhL9WJOTThyjvmBMoY May 21 21:11:54.987116 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:11:54.987116 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:11:54.987116 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:11:54.987116 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:11:54.987116 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:11:54.987116 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:11:54.987116 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 979278445a524a83ac4c9f9074432721 May 21 21:11:54.987116 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-LiveMigrationNegativeTest-348843391 May 21 21:11:54.987116 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:11:54.987116 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:11:54.988816 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/979278445a524a83ac4c9f9074432721"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/979278445a524a83ac4c9f9074432721"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_979278445a524a83ac4c9f9074432721", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/979278445a524a83ac4c9f9074432721"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:11:54.988816 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-LiveMigrationNegativeTest-348843391 May 21 21:11:54.988816 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 979278445a524a83ac4c9f9074432721 May 21 21:11:54.988816 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-348843391 May 21 21:11:54.988816 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-LiveMigrationNegativeTest-348843391-project-admin May 21 21:11:54.988816 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:11:54.988816 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:11:54.988816 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 3e446128ecf740ce89d8355ef358a655 May 21 21:11:54.988816 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-LiveMigrationNegativeTest-348843391-project-admin May 21 21:11:54.988816 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:11:54.988816 ncdv-master-1 devstack@n-api.service[131277]: {"os-migrateLive": {"host": "tempest-host-340959485", "block_migration": true, "disk_over_commit": false}} May 21 21:11:54.988816 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:11:54.989789 ncdv-master-1 devstack@n-api.service[131277]: exception: Compute host tempest-host-340959485 could not be found. May 21 21:11:54.989789 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '23d169f8-72b8-4928-b109-7d948fe70b9a', 'body': {'os-migrateLive': {'host': 'tempest-host-340959485', 'block_migration': True, 'disk_over_commit': False}}} May 21 21:11:54.989789 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:11:54.989789 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:11:54.989789 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live May 21 21:11:54.989789 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, May 21 21:11:54.989789 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 21 21:11:54.989789 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:11:54.989789 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 21 21:11:54.989789 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 21 21:11:54.989789 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 21 21:11:54.989789 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 21:11:54.989789 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 21 21:11:54.989789 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 21 21:11:54.989789 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 21 21:11:54.989789 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 21:11:54.989789 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 21 21:11:54.989789 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 21:11:54.989789 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 21 21:11:54.991237 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:11:54.991237 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 21 21:11:54.991237 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 21:11:54.991237 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate May 21 21:11:54.991237 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) May 21 21:11:54.991237 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:11:54.991237 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:11:54.991237 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host May 21 21:11:54.991237 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, May 21 21:11:54.991237 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper May 21 21:11:54.991237 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:11:54.991237 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host May 21 21:11:54.991237 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) May 21 21:11:54.991237 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper May 21 21:11:54.991237 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) May 21 21:11:54.991237 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host May 21 21:11:54.991237 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) May 21 21:11:54.991237 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-340959485 could not be found. May 21 21:11:54.991237 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:11:54.992748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:11:54.992748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:11:54.992748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:11:54.992748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:11:54.992748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:11:54.992748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:11:54.992748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:11:54.992748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:11:54.992748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:11:54.992748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:11:54.992748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:11:54.992748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:11:54.992748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:11:54.992748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:11:54.992748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:11:54.992748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 21 21:11:54.992748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live May 21 21:11:54.992748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 21 21:11:54.992748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-340959485 could not be found. May 21 21:11:54.992748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:11:54.994234 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:11:54.994234 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:11:54.994234 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:11:54.994234 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:11:54.994234 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:11:54.994234 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:11:54.994234 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:11:54.994234 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-340959485 could not be found. May 21 21:11:54.994234 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:11:54.994234 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-efa34aa1-81d0-48b3-8921-0699c01c3321 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Returning 400 to user: Compute host tempest-host-340959485 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:11:54.995932 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-efa34aa1-81d0-48b3-8921-0699c01c3321 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a/action" status: 400 len: 99 microversion: 2.1 time: 0.252265 May 21 21:11:54.999836 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 265/510] 10.222.0.49 () {60 vars in 1278 bytes} [Sat May 21 21:11:54 2022] POST /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a/action => generated 99 bytes in 253 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 21 21:11:55.004334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-165b9926-9cb4-4125-a1b0-8e17b43b59b2 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:55.015970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-165b9926-9cb4-4125-a1b0-8e17b43b59b2 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:55.023117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-165b9926-9cb4-4125-a1b0-8e17b43b59b2 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:55.023646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-165b9926-9cb4-4125-a1b0-8e17b43b59b2 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:55.024582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-165b9926-9cb4-4125-a1b0-8e17b43b59b2 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:55.025088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-165b9926-9cb4-4125-a1b0-8e17b43b59b2 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:55.204470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-165b9926-9cb4-4125-a1b0-8e17b43b59b2 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:55.213559 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-165b9926-9cb4-4125-a1b0-8e17b43b59b2 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1324 microversion: 2.1 time: 0.215575 May 21 21:11:55.214483 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 266/511] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:54 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1324 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:55.218960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-14cde688-cd9e-4460-8c7f-66c599c34d0f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:55.223784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-14cde688-cd9e-4460-8c7f-66c599c34d0f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:55.227897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14cde688-cd9e-4460-8c7f-66c599c34d0f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:55.228536 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14cde688-cd9e-4460-8c7f-66c599c34d0f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:55.229472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14cde688-cd9e-4460-8c7f-66c599c34d0f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:55.229885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14cde688-cd9e-4460-8c7f-66c599c34d0f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:55.259846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:55.408835 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-14cde688-cd9e-4460-8c7f-66c599c34d0f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:55.426142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-14cde688-cd9e-4460-8c7f-66c599c34d0f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:55.427663 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-14cde688-cd9e-4460-8c7f-66c599c34d0f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:55.429256 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-14cde688-cd9e-4460-8c7f-66c599c34d0f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1361 microversion: 2.25 time: 0.214009 May 21 21:11:55.441434 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 267/512] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:55 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:55.447570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ebda2f19-1cd7-4427-a23a-6e37b9fa1dc1 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:55.448257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ebda2f19-1cd7-4427-a23a-6e37b9fa1dc1 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:55.454935 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebda2f19-1cd7-4427-a23a-6e37b9fa1dc1 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:55.455610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebda2f19-1cd7-4427-a23a-6e37b9fa1dc1 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:55.456492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebda2f19-1cd7-4427-a23a-6e37b9fa1dc1 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:55.456934 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebda2f19-1cd7-4427-a23a-6e37b9fa1dc1 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:55.628317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ebda2f19-1cd7-4427-a23a-6e37b9fa1dc1 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:55.641115 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ebda2f19-1cd7-4427-a23a-6e37b9fa1dc1 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1468 microversion: 2.1 time: 0.198273 May 21 21:11:55.645793 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 268/513] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:55 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1468 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:55.652102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f90d2ecd-e27d-4934-937d-1ab086137ea8 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:55.653187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f90d2ecd-e27d-4934-937d-1ab086137ea8 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:55.669577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f90d2ecd-e27d-4934-937d-1ab086137ea8 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:55.670413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f90d2ecd-e27d-4934-937d-1ab086137ea8 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:55.671268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f90d2ecd-e27d-4934-937d-1ab086137ea8 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:55.671792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f90d2ecd-e27d-4934-937d-1ab086137ea8 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:55.773026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-f90d2ecd-e27d-4934-937d-1ab086137ea8 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:11:55.788732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:55.792968 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f90d2ecd-e27d-4934-937d-1ab086137ea8 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1927 microversion: 2.75 time: 0.145774 May 21 21:11:55.793560 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 269/514] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:55 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1927 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:55.806047 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7a910255-a7dc-4708-b3e9-0d4ee110556e tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:55.806047 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7a910255-a7dc-4708-b3e9-0d4ee110556e tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:55.811022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a910255-a7dc-4708-b3e9-0d4ee110556e tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:55.811481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a910255-a7dc-4708-b3e9-0d4ee110556e tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:55.812262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a910255-a7dc-4708-b3e9-0d4ee110556e tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:55.812857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a910255-a7dc-4708-b3e9-0d4ee110556e tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:55.998647 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7a910255-a7dc-4708-b3e9-0d4ee110556e tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:56.021745 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7a910255-a7dc-4708-b3e9-0d4ee110556e tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 200 len: 1390 microversion: 2.1 time: 0.227019 May 21 21:11:56.030331 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 270/515] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:55 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 1390 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:56.035681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4d530989-5660-4506-8e50-f52f03e91fa3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1097726175", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:56.099540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-4d530989-5660-4506-8e50-f52f03e91fa3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] validate_networks() for None {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:11:56.405472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-4d530989-5660-4506-8e50-f52f03e91fa3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:11:56.406200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-4d530989-5660-4506-8e50-f52f03e91fa3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:11:56.406848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-4d530989-5660-4506-8e50-f52f03e91fa3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:11:56.409729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-4d530989-5660-4506-8e50-f52f03e91fa3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:11:56.410162 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-4d530989-5660-4506-8e50-f52f03e91fa3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:11:56.421783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d530989-5660-4506-8e50-f52f03e91fa3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:56.422397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d530989-5660-4506-8e50-f52f03e91fa3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:56.423207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d530989-5660-4506-8e50-f52f03e91fa3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:56.424612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d530989-5660-4506-8e50-f52f03e91fa3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:56.448680 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-4d530989-5660-4506-8e50-f52f03e91fa3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Getting quotas for project a16dae1aa89c4a86ad50273a1b3b08d8. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:11:56.453696 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-4d530989-5660-4506-8e50-f52f03e91fa3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Getting quotas for user 4e7423d4ddfc46e390db2fc5fadac7f9 and project a16dae1aa89c4a86ad50273a1b3b08d8. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:11:56.466878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4d530989-5660-4506-8e50-f52f03e91fa3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:11:56.469241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4d530989-5660-4506-8e50-f52f03e91fa3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:11:56.598529 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-eccd06b8-2b4c-48e9-bb95-ee2bcdcca929 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f/action" status: 202 len: 0 microversion: 2.1 time: 3.562095 May 21 21:11:56.601884 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 246/516] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:11:53 2022] POST /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f/action => generated 0 bytes in 3566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:11:56.610116 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4d530989-5660-4506-8e50-f52f03e91fa3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578645 May 21 21:11:56.616682 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 271/517] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:11:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:11:56.617401 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-6b21eb28-77c7-469a-8d0c-a2de6120a098 req-f86a7a63-34a4-4d7b-a582-cefc6e880146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a046a9e9-4485-4d77-9f5c-62410cf739f5", "name": "network-vif-plugged", "status": "completed", "tag": "7dab2225-b424-4882-a428-97b3ef334ec1"}, {"server_uuid": "11c92463-f5f1-4c2a-bcf0-573711f0c4f1", "name": "network-vif-plugged", "status": "completed", "tag": "d19d3553-91b7-47ed-96ea-0384ea855a46"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:56.618873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0b735c25-dbf2-41d9-a3fa-279287884ce0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:56.619726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0b735c25-dbf2-41d9-a3fa-279287884ce0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:56.628737 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b735c25-dbf2-41d9-a3fa-279287884ce0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:56.629831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b735c25-dbf2-41d9-a3fa-279287884ce0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:56.631825 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b735c25-dbf2-41d9-a3fa-279287884ce0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:56.632550 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b735c25-dbf2-41d9-a3fa-279287884ce0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:56.652065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6b21eb28-77c7-469a-8d0c-a2de6120a098 req-f86a7a63-34a4-4d7b-a582-cefc6e880146 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:56.652910 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6b21eb28-77c7-469a-8d0c-a2de6120a098 req-f86a7a63-34a4-4d7b-a582-cefc6e880146 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:56.674658 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-6b21eb28-77c7-469a-8d0c-a2de6120a098 req-f86a7a63-34a4-4d7b-a582-cefc6e880146 service nova] Creating event network-vif-plugged:7dab2225-b424-4882-a428-97b3ef334ec1 for instance a046a9e9-4485-4d77-9f5c-62410cf739f5 on nch1-master-1 May 21 21:11:56.675279 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-6b21eb28-77c7-469a-8d0c-a2de6120a098 req-f86a7a63-34a4-4d7b-a582-cefc6e880146 service nova] Creating event network-vif-plugged:d19d3553-91b7-47ed-96ea-0384ea855a46 for instance 11c92463-f5f1-4c2a-bcf0-573711f0c4f1 on nch2-master-1 May 21 21:11:56.713070 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-6b21eb28-77c7-469a-8d0c-a2de6120a098 req-f86a7a63-34a4-4d7b-a582-cefc6e880146 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.094025 May 21 21:11:56.714545 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 272/518] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:11:56.728731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3f9f4412-8ef7-44ae-8241-5f9aece0e6f6 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:56.732677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3f9f4412-8ef7-44ae-8241-5f9aece0e6f6 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:56.755573 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f9f4412-8ef7-44ae-8241-5f9aece0e6f6 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:56.757840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f9f4412-8ef7-44ae-8241-5f9aece0e6f6 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:56.758648 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f9f4412-8ef7-44ae-8241-5f9aece0e6f6 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:56.759112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f9f4412-8ef7-44ae-8241-5f9aece0e6f6 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:56.965112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0b735c25-dbf2-41d9-a3fa-279287884ce0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:56.975073 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0b735c25-dbf2-41d9-a3fa-279287884ce0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1476 microversion: 2.1 time: 0.371016 May 21 21:11:56.990244 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 247/519] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:56 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1476 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:56.998390 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-750cbd15-2991-4cda-998d-b9594cf443ce tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:56.999285 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-750cbd15-2991-4cda-998d-b9594cf443ce tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:57.008771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-750cbd15-2991-4cda-998d-b9594cf443ce tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:57.009520 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-750cbd15-2991-4cda-998d-b9594cf443ce tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:57.010638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-750cbd15-2991-4cda-998d-b9594cf443ce tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:57.011234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-750cbd15-2991-4cda-998d-b9594cf443ce tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:57.220810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-750cbd15-2991-4cda-998d-b9594cf443ce tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:57.230472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-750cbd15-2991-4cda-998d-b9594cf443ce tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:57.232419 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-750cbd15-2991-4cda-998d-b9594cf443ce tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:57.233672 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-750cbd15-2991-4cda-998d-b9594cf443ce tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1556 microversion: 2.25 time: 0.241560 May 21 21:11:57.237955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3f9f4412-8ef7-44ae-8241-5f9aece0e6f6 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:57.242748 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 248/520] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:56 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1556 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:57.260981 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3f9f4412-8ef7-44ae-8241-5f9aece0e6f6 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1324 microversion: 2.1 time: 0.530156 May 21 21:11:57.260981 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 273/521] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:56 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1324 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:57.261347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8bb17518-2285-48b4-8629-e91596327ae3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:57.261347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8bb17518-2285-48b4-8629-e91596327ae3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:57.261517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-570dcf4a-8ff8-4144-9268-47b9a68270b4 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:57.261517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-570dcf4a-8ff8-4144-9268-47b9a68270b4 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:57.261663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8bb17518-2285-48b4-8629-e91596327ae3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:57.261663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8bb17518-2285-48b4-8629-e91596327ae3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:57.266114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8bb17518-2285-48b4-8629-e91596327ae3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:57.266114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8bb17518-2285-48b4-8629-e91596327ae3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:57.344775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-570dcf4a-8ff8-4144-9268-47b9a68270b4 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:57.358001 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-570dcf4a-8ff8-4144-9268-47b9a68270b4 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 200 len: 1219 microversion: 2.1 time: 0.108793 May 21 21:11:57.360439 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 274/522] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:57 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:57.364762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-755ea938-8a93-4f6c-8488-5b8fba81ca65 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:57.365371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-755ea938-8a93-4f6c-8488-5b8fba81ca65 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:57.386508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-755ea938-8a93-4f6c-8488-5b8fba81ca65 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:57.387061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-755ea938-8a93-4f6c-8488-5b8fba81ca65 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:57.398358 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-755ea938-8a93-4f6c-8488-5b8fba81ca65 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:57.399224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-755ea938-8a93-4f6c-8488-5b8fba81ca65 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:57.485590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8bb17518-2285-48b4-8629-e91596327ae3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:57.490464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:57.497554 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8bb17518-2285-48b4-8629-e91596327ae3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1504 microversion: 2.1 time: 0.252658 May 21 21:11:57.498481 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 249/523] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:57 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:57.511579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-755ea938-8a93-4f6c-8488-5b8fba81ca65 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:11:57.517902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2df311b8-4883-4d0f-a0a4-d0eaddfaf868 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:57.518833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2df311b8-4883-4d0f-a0a4-d0eaddfaf868 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:57.527216 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2df311b8-4883-4d0f-a0a4-d0eaddfaf868 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:57.527969 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2df311b8-4883-4d0f-a0a4-d0eaddfaf868 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:57.538469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2df311b8-4883-4d0f-a0a4-d0eaddfaf868 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:57.539372 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2df311b8-4883-4d0f-a0a4-d0eaddfaf868 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:57.547809 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-755ea938-8a93-4f6c-8488-5b8fba81ca65 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1927 microversion: 2.75 time: 0.188112 May 21 21:11:57.553216 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 275/524] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:57 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1927 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:57.629001 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a909e682-6ecc-4f59-9dd0-39c9cf810dad tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:57.630012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a909e682-6ecc-4f59-9dd0-39c9cf810dad tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:57.637748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a909e682-6ecc-4f59-9dd0-39c9cf810dad tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:57.638490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a909e682-6ecc-4f59-9dd0-39c9cf810dad tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:57.639523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a909e682-6ecc-4f59-9dd0-39c9cf810dad tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:57.640182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a909e682-6ecc-4f59-9dd0-39c9cf810dad tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:57.786369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2df311b8-4883-4d0f-a0a4-d0eaddfaf868 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:57.795008 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2df311b8-4883-4d0f-a0a4-d0eaddfaf868 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 200 len: 1390 microversion: 2.1 time: 0.289165 May 21 21:11:57.795862 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 250/525] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:57 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 1390 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:57.853413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-a909e682-6ecc-4f59-9dd0-39c9cf810dad tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lazy-loading 'services' on Instance uuid 99d32d33-c3d7-4c41-a4cf-f804fac41120 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:11:57.868487 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a909e682-6ecc-4f59-9dd0-39c9cf810dad tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 2048 microversion: 2.25 time: 0.318064 May 21 21:11:57.869247 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 276/526] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:57 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 2048 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:57.886785 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6e57b500-7409-494f-b9a4-ceda4d2b5cac tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:57.887409 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6e57b500-7409-494f-b9a4-ceda4d2b5cac tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:57.894432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e57b500-7409-494f-b9a4-ceda4d2b5cac tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:57.894830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e57b500-7409-494f-b9a4-ceda4d2b5cac tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:57.895631 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e57b500-7409-494f-b9a4-ceda4d2b5cac tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:57.896075 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e57b500-7409-494f-b9a4-ceda4d2b5cac tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:58.004171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0ee4b817-6027-4b2c-ad03-f5102b56a609 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:58.004171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0ee4b817-6027-4b2c-ad03-f5102b56a609 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:58.012732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ee4b817-6027-4b2c-ad03-f5102b56a609 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:58.012732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ee4b817-6027-4b2c-ad03-f5102b56a609 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:58.012732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ee4b817-6027-4b2c-ad03-f5102b56a609 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:58.012732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ee4b817-6027-4b2c-ad03-f5102b56a609 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:58.057903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-6e57b500-7409-494f-b9a4-ceda4d2b5cac tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lazy-loading 'services' on Instance uuid 99d32d33-c3d7-4c41-a4cf-f804fac41120 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:11:58.073331 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6e57b500-7409-494f-b9a4-ceda4d2b5cac tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 2048 microversion: 2.25 time: 0.190756 May 21 21:11:58.073926 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 251/527] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:57 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 2048 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:58.090551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f1e65c47-cb63-4a9e-ba87-9212f27ff633 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:58.092006 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:11:58.092006 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:11:58.098508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1e65c47-cb63-4a9e-ba87-9212f27ff633 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:58.098508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1e65c47-cb63-4a9e-ba87-9212f27ff633 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:58.098508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1e65c47-cb63-4a9e-ba87-9212f27ff633 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:58.098770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1e65c47-cb63-4a9e-ba87-9212f27ff633 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:58.133975 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f1e65c47-cb63-4a9e-ba87-9212f27ff633 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.047006 May 21 21:11:58.138532 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 252/528] 10.222.0.49 () {60 vars in 1216 bytes} [Sat May 21 21:11:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 21 21:11:58.146548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5d9b07bf-6c85-487a-8608-37a81704dca7 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:11:58.148117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5d9b07bf-6c85-487a-8608-37a81704dca7 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:58.154755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d9b07bf-6c85-487a-8608-37a81704dca7 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:58.155218 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d9b07bf-6c85-487a-8608-37a81704dca7 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:58.156064 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d9b07bf-6c85-487a-8608-37a81704dca7 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:58.156543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d9b07bf-6c85-487a-8608-37a81704dca7 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:58.196504 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-5d9b07bf-6c85-487a-8608-37a81704dca7 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lazy-loading 'flavor' on Instance uuid 99d32d33-c3d7-4c41-a4cf-f804fac41120 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:11:58.215310 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5d9b07bf-6c85-487a-8608-37a81704dca7 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Going to try to live migrate instance to nch1-master-1 {{(pid=131278) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 21 21:11:58.278027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0ee4b817-6027-4b2c-ad03-f5102b56a609 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:58.286636 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0ee4b817-6027-4b2c-ad03-f5102b56a609 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1476 microversion: 2.1 time: 0.290492 May 21 21:11:58.292458 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 277/529] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:57 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1476 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:58.297025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f940c4b2-f1e3-4169-a7af-909b3814ff17 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:58.297726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f940c4b2-f1e3-4169-a7af-909b3814ff17 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:58.304994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f940c4b2-f1e3-4169-a7af-909b3814ff17 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:58.305444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f940c4b2-f1e3-4169-a7af-909b3814ff17 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:58.306228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f940c4b2-f1e3-4169-a7af-909b3814ff17 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:58.306856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f940c4b2-f1e3-4169-a7af-909b3814ff17 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:58.567610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f940c4b2-f1e3-4169-a7af-909b3814ff17 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:58.581814 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f940c4b2-f1e3-4169-a7af-909b3814ff17 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1324 microversion: 2.1 time: 0.293327 May 21 21:11:58.591545 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 278/530] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:58 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1324 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:58.599065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7b37b906-2464-4163-9693-4e15d3c6c02d tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:58.599847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7b37b906-2464-4163-9693-4e15d3c6c02d tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:58.606114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7b37b906-2464-4163-9693-4e15d3c6c02d tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:58.606653 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7b37b906-2464-4163-9693-4e15d3c6c02d tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:58.607446 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7b37b906-2464-4163-9693-4e15d3c6c02d tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:58.607874 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7b37b906-2464-4163-9693-4e15d3c6c02d tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:58.723945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7b37b906-2464-4163-9693-4e15d3c6c02d tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:58.732688 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7b37b906-2464-4163-9693-4e15d3c6c02d tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 200 len: 1215 microversion: 2.1 time: 0.139588 May 21 21:11:58.733518 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 279/531] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:58 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 1215 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:58.743661 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7f902387-6990-4ebd-a921-18f75ffac994 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:58.744771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7f902387-6990-4ebd-a921-18f75ffac994 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:58.750816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f902387-6990-4ebd-a921-18f75ffac994 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:58.755074 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f902387-6990-4ebd-a921-18f75ffac994 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:58.755074 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f902387-6990-4ebd-a921-18f75ffac994 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:58.755074 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f902387-6990-4ebd-a921-18f75ffac994 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:58.924870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7f902387-6990-4ebd-a921-18f75ffac994 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:58.934593 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7f902387-6990-4ebd-a921-18f75ffac994 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1504 microversion: 2.1 time: 0.194600 May 21 21:11:58.935544 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 280/532] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:58 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:58.944039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-327836b0-2484-4a68-aaf5-1e9c87cbd89f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:58.944039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-327836b0-2484-4a68-aaf5-1e9c87cbd89f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:58.948598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-327836b0-2484-4a68-aaf5-1e9c87cbd89f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:58.949052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-327836b0-2484-4a68-aaf5-1e9c87cbd89f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:58.950133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-327836b0-2484-4a68-aaf5-1e9c87cbd89f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:58.950578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-327836b0-2484-4a68-aaf5-1e9c87cbd89f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:59.147482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-327836b0-2484-4a68-aaf5-1e9c87cbd89f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:11:59.172474 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-327836b0-2484-4a68-aaf5-1e9c87cbd89f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1927 microversion: 2.75 time: 0.235192 May 21 21:11:59.186377 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 281/533] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:11:58 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1927 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:11:59.193683 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-99d6cf57-7bdd-42fb-ac89-ed342c6e108a tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:59.199327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-99d6cf57-7bdd-42fb-ac89-ed342c6e108a tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:59.202758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-99d6cf57-7bdd-42fb-ac89-ed342c6e108a tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:59.203217 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-99d6cf57-7bdd-42fb-ac89-ed342c6e108a tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:59.204010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-99d6cf57-7bdd-42fb-ac89-ed342c6e108a tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:59.204490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-99d6cf57-7bdd-42fb-ac89-ed342c6e108a tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:59.457210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-99d6cf57-7bdd-42fb-ac89-ed342c6e108a tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:59.470218 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-99d6cf57-7bdd-42fb-ac89-ed342c6e108a tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 200 len: 1590 microversion: 2.1 time: 0.282144 May 21 21:11:59.481261 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 282/534] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:59 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 1590 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:59.487277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4a70bba0-3d69-469a-80f8-2a4a2e36149c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:59.487897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4a70bba0-3d69-469a-80f8-2a4a2e36149c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:59.497176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a70bba0-3d69-469a-80f8-2a4a2e36149c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:59.497616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a70bba0-3d69-469a-80f8-2a4a2e36149c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:59.498393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a70bba0-3d69-469a-80f8-2a4a2e36149c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:59.498830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a70bba0-3d69-469a-80f8-2a4a2e36149c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:59.909921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4a70bba0-3d69-469a-80f8-2a4a2e36149c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:11:59.929710 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4a70bba0-3d69-469a-80f8-2a4a2e36149c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1476 microversion: 2.1 time: 0.447274 May 21 21:11:59.943515 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 283/535] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:11:59 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1476 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:11:59.950411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fcd09848-95fd-4ca1-aca7-06be8d9c7777 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:11:59.952366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fcd09848-95fd-4ca1-aca7-06be8d9c7777 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:11:59.964691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fcd09848-95fd-4ca1-aca7-06be8d9c7777 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:59.965855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fcd09848-95fd-4ca1-aca7-06be8d9c7777 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:11:59.979085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fcd09848-95fd-4ca1-aca7-06be8d9c7777 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:11:59.980413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fcd09848-95fd-4ca1-aca7-06be8d9c7777 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:00.516430 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fcd09848-95fd-4ca1-aca7-06be8d9c7777 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.571569 May 21 21:12:00.517889 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 284/536] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 21:11:59 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5/os-interface => generated 285 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:00.522683 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-95225d1f-c793-4ccf-add2-d89e56c9937b tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:00.523498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-95225d1f-c793-4ccf-add2-d89e56c9937b tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:00.540443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-95225d1f-c793-4ccf-add2-d89e56c9937b tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:00.540944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-95225d1f-c793-4ccf-add2-d89e56c9937b tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:00.541742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-95225d1f-c793-4ccf-add2-d89e56c9937b tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:00.542179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-95225d1f-c793-4ccf-add2-d89e56c9937b tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:00.566308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:01.135932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-95225d1f-c793-4ccf-add2-d89e56c9937b tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:01.143242 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5d9b07bf-6c85-487a-8608-37a81704dca7 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120/action" status: 202 len: 0 microversion: 2.25 time: 2.999962 May 21 21:12:01.145005 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-95225d1f-c793-4ccf-add2-d89e56c9937b tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1521 microversion: 2.1 time: 0.625852 May 21 21:12:01.152552 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 253/537] 10.222.0.49 () {62 vars in 1318 bytes} [Sat May 21 21:11:58 2022] POST /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120/action => generated 0 bytes in 3009 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 21 21:12:01.157045 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 285/538] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:00 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1521 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:01.159285 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6621887e-577e-4a0d-a555-5c06e5957472 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:01.160177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6621887e-577e-4a0d-a555-5c06e5957472 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:01.163002 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cbde7ab5-0816-42f3-8162-2f1a178515cc tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:01.163625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cbde7ab5-0816-42f3-8162-2f1a178515cc tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:01.179531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6621887e-577e-4a0d-a555-5c06e5957472 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:01.180399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6621887e-577e-4a0d-a555-5c06e5957472 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:01.181496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cbde7ab5-0816-42f3-8162-2f1a178515cc tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:01.182081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6621887e-577e-4a0d-a555-5c06e5957472 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:01.182258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cbde7ab5-0816-42f3-8162-2f1a178515cc tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:01.183210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cbde7ab5-0816-42f3-8162-2f1a178515cc tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:01.183330 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6621887e-577e-4a0d-a555-5c06e5957472 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:01.184420 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cbde7ab5-0816-42f3-8162-2f1a178515cc tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:01.277828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6621887e-577e-4a0d-a555-5c06e5957472 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:01.289906 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6621887e-577e-4a0d-a555-5c06e5957472 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 200 len: 1277 microversion: 2.1 time: 0.137817 May 21 21:12:01.290493 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 254/539] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:01 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 1277 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:01.295863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e1746f3e-c629-4434-8567-1c230fa70652 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:01.296816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e1746f3e-c629-4434-8567-1c230fa70652 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:01.308608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1746f3e-c629-4434-8567-1c230fa70652 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:01.309451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1746f3e-c629-4434-8567-1c230fa70652 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:01.310469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1746f3e-c629-4434-8567-1c230fa70652 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:01.311052 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1746f3e-c629-4434-8567-1c230fa70652 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:01.403205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-e1746f3e-c629-4434-8567-1c230fa70652 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:01.434734 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e1746f3e-c629-4434-8567-1c230fa70652 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1927 microversion: 2.75 time: 0.142926 May 21 21:12:01.435492 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 255/540] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:01 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1927 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:01.447555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-0189a3dc-16e6-41b0-8442-df9af54b5106 req-4c6e9e91-11cb-41c2-a27a-53d209c6fe01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b5633e-336c-45cc-927e-8bc71bd6e52f", "name": "network-vif-unplugged", "status": "completed", "tag": "dc7021f0-e141-4045-80b4-042a54a3e380"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:01.453752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0189a3dc-16e6-41b0-8442-df9af54b5106 req-4c6e9e91-11cb-41c2-a27a-53d209c6fe01 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:01.454221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0189a3dc-16e6-41b0-8442-df9af54b5106 req-4c6e9e91-11cb-41c2-a27a-53d209c6fe01 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:01.468449 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-0189a3dc-16e6-41b0-8442-df9af54b5106 req-4c6e9e91-11cb-41c2-a27a-53d209c6fe01 service nova] Creating event network-vif-unplugged:dc7021f0-e141-4045-80b4-042a54a3e380 for instance a6b5633e-336c-45cc-927e-8bc71bd6e52f on nch2-master-1 May 21 21:12:01.474138 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-0189a3dc-16e6-41b0-8442-df9af54b5106 req-4c6e9e91-11cb-41c2-a27a-53d209c6fe01 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037060 May 21 21:12:01.475611 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 256/541] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:01.482485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-45f12743-4522-4732-9593-d12b29d83133 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:01.483463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-45f12743-4522-4732-9593-d12b29d83133 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:01.495192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-45f12743-4522-4732-9593-d12b29d83133 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:01.496070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-45f12743-4522-4732-9593-d12b29d83133 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:01.497139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-45f12743-4522-4732-9593-d12b29d83133 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:01.497965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-45f12743-4522-4732-9593-d12b29d83133 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:01.709573 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-45f12743-4522-4732-9593-d12b29d83133 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:01.721518 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-45f12743-4522-4732-9593-d12b29d83133 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1476 microversion: 2.1 time: 0.241589 May 21 21:12:01.722911 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 257/542] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:01 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1476 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:01.729548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e60f1856-e7bb-4ee7-a5fa-f0c03bfce3a8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:01.735438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e60f1856-e7bb-4ee7-a5fa-f0c03bfce3a8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:01.740812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e60f1856-e7bb-4ee7-a5fa-f0c03bfce3a8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:01.742228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e60f1856-e7bb-4ee7-a5fa-f0c03bfce3a8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:01.743359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e60f1856-e7bb-4ee7-a5fa-f0c03bfce3a8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:01.743814 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e60f1856-e7bb-4ee7-a5fa-f0c03bfce3a8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:01.875186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cbde7ab5-0816-42f3-8162-2f1a178515cc tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:01.919318 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cbde7ab5-0816-42f3-8162-2f1a178515cc tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1504 microversion: 2.1 time: 0.758096 May 21 21:12:01.922801 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 286/543] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:01 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1504 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:01.930263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aa564ebe-af7b-4737-8ba3-e5c753dbc5c0 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Action: 'action', calling method: .version_select at 0x7fc82a2d25e0>, body: {"addFloatingIp": {"address": "172.35.0.186"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:01.931930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aa564ebe-af7b-4737-8ba3-e5c753dbc5c0 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:01.948475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa564ebe-af7b-4737-8ba3-e5c753dbc5c0 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:01.948475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa564ebe-af7b-4737-8ba3-e5c753dbc5c0 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:01.948475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa564ebe-af7b-4737-8ba3-e5c753dbc5c0 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:01.948475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa564ebe-af7b-4737-8ba3-e5c753dbc5c0 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:01.979481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e60f1856-e7bb-4ee7-a5fa-f0c03bfce3a8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:01.993463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e60f1856-e7bb-4ee7-a5fa-f0c03bfce3a8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:01.997680 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e60f1856-e7bb-4ee7-a5fa-f0c03bfce3a8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:01.999004 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e60f1856-e7bb-4ee7-a5fa-f0c03bfce3a8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.275022 May 21 21:12:02.000148 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 258/544] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:01 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:02.070983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa564ebe-af7b-4737-8ba3-e5c753dbc5c0 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Acquired lock "refresh_cache-c3935c27-84ef-41ff-adbf-9e4b29eea5d3" {{(pid=131277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 21 21:12:02.313536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d5f93841-da02-486a-a4a4-10a9cfb2d2e3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:02.315638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d5f93841-da02-486a-a4a4-10a9cfb2d2e3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:02.334955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5f93841-da02-486a-a4a4-10a9cfb2d2e3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:02.335786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5f93841-da02-486a-a4a4-10a9cfb2d2e3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:02.336528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5f93841-da02-486a-a4a4-10a9cfb2d2e3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:02.336969 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5f93841-da02-486a-a4a4-10a9cfb2d2e3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:02.446906 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d5f93841-da02-486a-a4a4-10a9cfb2d2e3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:02.465932 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d5f93841-da02-486a-a4a4-10a9cfb2d2e3 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 200 len: 1277 microversion: 2.1 time: 0.157725 May 21 21:12:02.476318 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 259/545] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:02 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:02.484056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dce59747-11f4-4501-8464-dc4c0f4cbe55 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:02.484056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dce59747-11f4-4501-8464-dc4c0f4cbe55 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:02.494288 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dce59747-11f4-4501-8464-dc4c0f4cbe55 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:02.495209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dce59747-11f4-4501-8464-dc4c0f4cbe55 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:02.496063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dce59747-11f4-4501-8464-dc4c0f4cbe55 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:02.496685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dce59747-11f4-4501-8464-dc4c0f4cbe55 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:02.600007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-dce59747-11f4-4501-8464-dc4c0f4cbe55 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:02.612637 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dce59747-11f4-4501-8464-dc4c0f4cbe55 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1927 microversion: 2.75 time: 0.144024 May 21 21:12:02.613241 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 260/546] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:02 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1927 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:02.759463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-06336459-76f1-431b-b8dd-7cdded36e55e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:02.761399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-06336459-76f1-431b-b8dd-7cdded36e55e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:02.772515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06336459-76f1-431b-b8dd-7cdded36e55e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:02.773347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06336459-76f1-431b-b8dd-7cdded36e55e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:02.774269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06336459-76f1-431b-b8dd-7cdded36e55e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:02.774823 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06336459-76f1-431b-b8dd-7cdded36e55e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:02.927711 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-06336459-76f1-431b-b8dd-7cdded36e55e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:02.936265 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-06336459-76f1-431b-b8dd-7cdded36e55e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1476 microversion: 2.1 time: 0.182218 May 21 21:12:02.937328 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 261/547] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:02 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1476 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:12:02.943364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-38836b15-a889-4622-b1fd-18baca6b9827 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:02.944007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-38836b15-a889-4622-b1fd-18baca6b9827 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:02.950166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38836b15-a889-4622-b1fd-18baca6b9827 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:02.950617 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38836b15-a889-4622-b1fd-18baca6b9827 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:02.951398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38836b15-a889-4622-b1fd-18baca6b9827 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:02.951834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38836b15-a889-4622-b1fd-18baca6b9827 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:03.138326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-38836b15-a889-4622-b1fd-18baca6b9827 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:03.162069 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-38836b15-a889-4622-b1fd-18baca6b9827 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1504 microversion: 2.1 time: 0.212871 May 21 21:12:03.162069 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 262/548] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:02 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:03.178001 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f6152306-4cea-4c94-9e33-e7f4e6facdfd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:03.178639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f6152306-4cea-4c94-9e33-e7f4e6facdfd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:03.186181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6152306-4cea-4c94-9e33-e7f4e6facdfd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:03.186793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6152306-4cea-4c94-9e33-e7f4e6facdfd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:03.187829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6152306-4cea-4c94-9e33-e7f4e6facdfd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:03.188262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6152306-4cea-4c94-9e33-e7f4e6facdfd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:03.405387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f6152306-4cea-4c94-9e33-e7f4e6facdfd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:03.419318 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f6152306-4cea-4c94-9e33-e7f4e6facdfd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:03.421326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f6152306-4cea-4c94-9e33-e7f4e6facdfd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:03.422111 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f6152306-4cea-4c94-9e33-e7f4e6facdfd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.268513 May 21 21:12:03.422882 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 263/549] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:03 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:03.484587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-720f7482-241e-47a8-9fb9-512dceec199b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:03.485127 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-720f7482-241e-47a8-9fb9-512dceec199b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:03.495164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-720f7482-241e-47a8-9fb9-512dceec199b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:03.495842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-720f7482-241e-47a8-9fb9-512dceec199b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:03.497596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-720f7482-241e-47a8-9fb9-512dceec199b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:03.498045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-720f7482-241e-47a8-9fb9-512dceec199b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:03.722618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-720f7482-241e-47a8-9fb9-512dceec199b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:03.727215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:03.731662 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-720f7482-241e-47a8-9fb9-512dceec199b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 200 len: 1319 microversion: 2.1 time: 0.251189 May 21 21:12:03.732528 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 264/550] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:03 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:03.744739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-f6d16966-8bf9-46b8-8058-6758f37d39c2 req-2ca50c01-7cc4-46c5-9ebc-4e627ce64d99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6b5633e-336c-45cc-927e-8bc71bd6e52f", "tag": "dc7021f0-e141-4045-80b4-042a54a3e380"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:03.759187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f6d16966-8bf9-46b8-8058-6758f37d39c2 req-2ca50c01-7cc4-46c5-9ebc-4e627ce64d99 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:03.759782 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f6d16966-8bf9-46b8-8058-6758f37d39c2 req-2ca50c01-7cc4-46c5-9ebc-4e627ce64d99 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:03.774868 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-f6d16966-8bf9-46b8-8058-6758f37d39c2 req-2ca50c01-7cc4-46c5-9ebc-4e627ce64d99 service nova] Creating event network-changed:dc7021f0-e141-4045-80b4-042a54a3e380 for instance a6b5633e-336c-45cc-927e-8bc71bd6e52f on nch2-master-1 May 21 21:12:03.780854 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-f6d16966-8bf9-46b8-8058-6758f37d39c2 req-2ca50c01-7cc4-46c5-9ebc-4e627ce64d99 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047058 May 21 21:12:03.782317 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 265/551] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:03.788180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0a7a7f8a-7bed-4040-b128-9a325dad09f7 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:03.788939 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0a7a7f8a-7bed-4040-b128-9a325dad09f7 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:03.794293 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:03.800162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a7a7f8a-7bed-4040-b128-9a325dad09f7 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:03.800651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a7a7f8a-7bed-4040-b128-9a325dad09f7 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:03.802003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a7a7f8a-7bed-4040-b128-9a325dad09f7 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:03.802003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a7a7f8a-7bed-4040-b128-9a325dad09f7 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:03.896841 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-0a7a7f8a-7bed-4040-b128-9a325dad09f7 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:03.922017 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0a7a7f8a-7bed-4040-b128-9a325dad09f7 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1927 microversion: 2.75 time: 0.138049 May 21 21:12:03.922693 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 266/552] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:03 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1927 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:03.956578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8fe417c7-fb0c-426f-ac94-d5751c96520b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:03.956578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8fe417c7-fb0c-426f-ac94-d5751c96520b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:03.966161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8fe417c7-fb0c-426f-ac94-d5751c96520b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:03.966588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8fe417c7-fb0c-426f-ac94-d5751c96520b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:03.975024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8fe417c7-fb0c-426f-ac94-d5751c96520b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:03.975024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8fe417c7-fb0c-426f-ac94-d5751c96520b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:04.195296 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8fe417c7-fb0c-426f-ac94-d5751c96520b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:04.222256 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8fe417c7-fb0c-426f-ac94-d5751c96520b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1476 microversion: 2.1 time: 0.272167 May 21 21:12:04.236658 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 267/553] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:03 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1476 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:04.249130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-28d71f03-26bc-4a29-8d7a-7ae1abd31c16 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:04.252382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-28d71f03-26bc-4a29-8d7a-7ae1abd31c16 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:04.269893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28d71f03-26bc-4a29-8d7a-7ae1abd31c16 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:04.272739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28d71f03-26bc-4a29-8d7a-7ae1abd31c16 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:04.277452 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28d71f03-26bc-4a29-8d7a-7ae1abd31c16 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:04.281777 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28d71f03-26bc-4a29-8d7a-7ae1abd31c16 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:04.646928 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-28d71f03-26bc-4a29-8d7a-7ae1abd31c16 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:04.666432 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-28d71f03-26bc-4a29-8d7a-7ae1abd31c16 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1504 microversion: 2.1 time: 0.428123 May 21 21:12:04.677100 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 268/554] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:04 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1504 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:04.681013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b0700b6b-64df-4609-be26-121273ef53ae tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:04.681700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b0700b6b-64df-4609-be26-121273ef53ae tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:04.698603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b0700b6b-64df-4609-be26-121273ef53ae tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:04.699071 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b0700b6b-64df-4609-be26-121273ef53ae tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:04.699853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b0700b6b-64df-4609-be26-121273ef53ae tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:04.700315 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b0700b6b-64df-4609-be26-121273ef53ae tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:04.884861 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b0700b6b-64df-4609-be26-121273ef53ae tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:04.897629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b0700b6b-64df-4609-be26-121273ef53ae tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:04.899297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b0700b6b-64df-4609-be26-121273ef53ae tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:04.900599 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b0700b6b-64df-4609-be26-121273ef53ae tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.225677 May 21 21:12:04.901310 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 269/555] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:04 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:04.906053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9ecd6583-cd99-4ba5-90e6-e1897a0c0cfc tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:04.906732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9ecd6583-cd99-4ba5-90e6-e1897a0c0cfc tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:04.914247 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ecd6583-cd99-4ba5-90e6-e1897a0c0cfc tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:04.914907 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ecd6583-cd99-4ba5-90e6-e1897a0c0cfc tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:04.915690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ecd6583-cd99-4ba5-90e6-e1897a0c0cfc tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:04.916136 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ecd6583-cd99-4ba5-90e6-e1897a0c0cfc tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:05.085552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9ecd6583-cd99-4ba5-90e6-e1897a0c0cfc tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:05.095667 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9ecd6583-cd99-4ba5-90e6-e1897a0c0cfc tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 200 len: 1590 microversion: 2.1 time: 0.192722 May 21 21:12:05.097193 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 270/556] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:04 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 1590 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:05.102194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7fcbcfe5-ec9e-457b-9ec2-cbefca39a8f2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:05.102950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7fcbcfe5-ec9e-457b-9ec2-cbefca39a8f2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:05.110254 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7fcbcfe5-ec9e-457b-9ec2-cbefca39a8f2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:05.111312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7fcbcfe5-ec9e-457b-9ec2-cbefca39a8f2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:05.112120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7fcbcfe5-ec9e-457b-9ec2-cbefca39a8f2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:05.112738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7fcbcfe5-ec9e-457b-9ec2-cbefca39a8f2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:05.295224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7fcbcfe5-ec9e-457b-9ec2-cbefca39a8f2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:05.312048 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7fcbcfe5-ec9e-457b-9ec2-cbefca39a8f2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 200 len: 1319 microversion: 2.1 time: 0.213875 May 21 21:12:05.327555 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 271/557] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:05 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:05.332732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bb50ca13-6501-4efa-bb35-85d177c4689d tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:05.335086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bb50ca13-6501-4efa-bb35-85d177c4689d tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:05.343009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb50ca13-6501-4efa-bb35-85d177c4689d tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:05.343690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb50ca13-6501-4efa-bb35-85d177c4689d tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:05.344688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb50ca13-6501-4efa-bb35-85d177c4689d tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:05.345824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb50ca13-6501-4efa-bb35-85d177c4689d tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:05.469286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-bb50ca13-6501-4efa-bb35-85d177c4689d tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:05.499962 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bb50ca13-6501-4efa-bb35-85d177c4689d tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1927 microversion: 2.75 time: 0.170766 May 21 21:12:05.505223 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 272/558] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:05 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1927 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:05.506993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7c05735b-7f02-43de-8e45-205d8e1aa785 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:05.508374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7c05735b-7f02-43de-8e45-205d8e1aa785 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:05.518751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c05735b-7f02-43de-8e45-205d8e1aa785 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:05.519500 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c05735b-7f02-43de-8e45-205d8e1aa785 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:05.520553 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c05735b-7f02-43de-8e45-205d8e1aa785 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:05.521156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c05735b-7f02-43de-8e45-205d8e1aa785 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:05.862286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7c05735b-7f02-43de-8e45-205d8e1aa785 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:05.879370 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7c05735b-7f02-43de-8e45-205d8e1aa785 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1476 microversion: 2.1 time: 0.377080 May 21 21:12:05.879989 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 273/559] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:05 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1476 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:05.887143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1bb9b0fb-69fb-4840-8ea5-1d7ef1f599d6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:05.891383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1bb9b0fb-69fb-4840-8ea5-1d7ef1f599d6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:05.906100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1bb9b0fb-69fb-4840-8ea5-1d7ef1f599d6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:05.906569 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1bb9b0fb-69fb-4840-8ea5-1d7ef1f599d6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:05.907371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1bb9b0fb-69fb-4840-8ea5-1d7ef1f599d6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:05.911653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1bb9b0fb-69fb-4840-8ea5-1d7ef1f599d6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:06.121214 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1bb9b0fb-69fb-4840-8ea5-1d7ef1f599d6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:06.138687 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1bb9b0fb-69fb-4840-8ea5-1d7ef1f599d6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1504 microversion: 2.1 time: 0.257569 May 21 21:12:06.139484 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 274/560] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:05 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1504 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:06.152099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1d46200f-5772-442e-a75d-7501870ee6c2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:06.152864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1d46200f-5772-442e-a75d-7501870ee6c2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:06.169546 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d46200f-5772-442e-a75d-7501870ee6c2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:06.171042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d46200f-5772-442e-a75d-7501870ee6c2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:06.171042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d46200f-5772-442e-a75d-7501870ee6c2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:06.171236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d46200f-5772-442e-a75d-7501870ee6c2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:06.375356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1d46200f-5772-442e-a75d-7501870ee6c2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:06.386478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1d46200f-5772-442e-a75d-7501870ee6c2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:06.388167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1d46200f-5772-442e-a75d-7501870ee6c2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:06.389736 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1d46200f-5772-442e-a75d-7501870ee6c2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.249459 May 21 21:12:06.390710 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 275/561] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:06 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:06.396691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-d36eaa26-7b32-4431-a10d-bc73d074715c req-dd95d129-1bf8-4318-bf78-a61ce72c404e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a046a9e9-4485-4d77-9f5c-62410cf739f5", "tag": "7dab2225-b424-4882-a428-97b3ef334ec1"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:06.405818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-d36eaa26-7b32-4431-a10d-bc73d074715c req-dd95d129-1bf8-4318-bf78-a61ce72c404e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:06.405818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-d36eaa26-7b32-4431-a10d-bc73d074715c req-dd95d129-1bf8-4318-bf78-a61ce72c404e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:06.419573 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-d36eaa26-7b32-4431-a10d-bc73d074715c req-dd95d129-1bf8-4318-bf78-a61ce72c404e service nova] Creating event network-changed:7dab2225-b424-4882-a428-97b3ef334ec1 for instance a046a9e9-4485-4d77-9f5c-62410cf739f5 on nch1-master-1 May 21 21:12:06.428019 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-d36eaa26-7b32-4431-a10d-bc73d074715c req-dd95d129-1bf8-4318-bf78-a61ce72c404e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035974 May 21 21:12:06.429750 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 276/562] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:06.437712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:06.452811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5ae04cc5-4210-4a35-be0b-946e13f75d0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:06.453829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5ae04cc5-4210-4a35-be0b-946e13f75d0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:06.462211 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ae04cc5-4210-4a35-be0b-946e13f75d0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:06.462817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ae04cc5-4210-4a35-be0b-946e13f75d0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:06.463704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ae04cc5-4210-4a35-be0b-946e13f75d0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:06.464244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ae04cc5-4210-4a35-be0b-946e13f75d0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:06.687051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5ae04cc5-4210-4a35-be0b-946e13f75d0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:06.697718 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5ae04cc5-4210-4a35-be0b-946e13f75d0b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 200 len: 1319 microversion: 2.1 time: 0.265195 May 21 21:12:06.698473 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 277/563] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:06 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:06.703747 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-21ac2668-09e0-4bb1-ae6a-5226ea1c7c65 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:06.704459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-21ac2668-09e0-4bb1-ae6a-5226ea1c7c65 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:06.713367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21ac2668-09e0-4bb1-ae6a-5226ea1c7c65 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:06.714294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21ac2668-09e0-4bb1-ae6a-5226ea1c7c65 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:06.715424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21ac2668-09e0-4bb1-ae6a-5226ea1c7c65 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:06.715424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21ac2668-09e0-4bb1-ae6a-5226ea1c7c65 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:06.819079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-21ac2668-09e0-4bb1-ae6a-5226ea1c7c65 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:06.840030 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-21ac2668-09e0-4bb1-ae6a-5226ea1c7c65 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1927 microversion: 2.75 time: 0.140060 May 21 21:12:06.840695 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 278/564] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:06 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1927 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:06.897451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3db68cc8-2a27-434b-9ce6-da794af47f3d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:06.898175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3db68cc8-2a27-434b-9ce6-da794af47f3d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:06.915998 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3db68cc8-2a27-434b-9ce6-da794af47f3d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:06.916651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3db68cc8-2a27-434b-9ce6-da794af47f3d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:06.917598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3db68cc8-2a27-434b-9ce6-da794af47f3d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:06.918111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3db68cc8-2a27-434b-9ce6-da794af47f3d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:07.202662 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-aa564ebe-af7b-4737-8ba3-e5c753dbc5c0 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Building network info cache for instance {{(pid=131277) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 21 21:12:07.247634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3db68cc8-2a27-434b-9ce6-da794af47f3d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:07.260731 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3db68cc8-2a27-434b-9ce6-da794af47f3d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1475 microversion: 2.1 time: 0.364800 May 21 21:12:07.272700 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 279/565] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:06 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1475 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:12:07.272700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ba80f0ca-8bdf-4a8c-ba42-57c1ea80648f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:07.275518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ba80f0ca-8bdf-4a8c-ba42-57c1ea80648f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:07.287317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba80f0ca-8bdf-4a8c-ba42-57c1ea80648f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:07.287765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba80f0ca-8bdf-4a8c-ba42-57c1ea80648f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:07.292799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba80f0ca-8bdf-4a8c-ba42-57c1ea80648f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:07.293201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba80f0ca-8bdf-4a8c-ba42-57c1ea80648f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:07.357979 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=8 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:07.471863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ba80f0ca-8bdf-4a8c-ba42-57c1ea80648f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:07.481338 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ba80f0ca-8bdf-4a8c-ba42-57c1ea80648f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1504 microversion: 2.1 time: 0.216665 May 21 21:12:07.491447 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 280/566] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:07 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:07.491447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1a0d84b0-8e44-4bf1-ae77-d37bc0df68fc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:07.491447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1a0d84b0-8e44-4bf1-ae77-d37bc0df68fc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:07.495239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a0d84b0-8e44-4bf1-ae77-d37bc0df68fc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:07.495689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a0d84b0-8e44-4bf1-ae77-d37bc0df68fc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:07.504713 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a0d84b0-8e44-4bf1-ae77-d37bc0df68fc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:07.504713 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a0d84b0-8e44-4bf1-ae77-d37bc0df68fc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:07.880374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1a0d84b0-8e44-4bf1-ae77-d37bc0df68fc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:07.884543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:07.891598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1a0d84b0-8e44-4bf1-ae77-d37bc0df68fc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:07.894186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1a0d84b0-8e44-4bf1-ae77-d37bc0df68fc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:07.895793 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1a0d84b0-8e44-4bf1-ae77-d37bc0df68fc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.412499 May 21 21:12:07.896587 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 281/567] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:07 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:07.923874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b2d39d61-5d17-4125-a722-e7412b84e255 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:07.925141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b2d39d61-5d17-4125-a722-e7412b84e255 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:07.932860 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2d39d61-5d17-4125-a722-e7412b84e255 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:07.933122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2d39d61-5d17-4125-a722-e7412b84e255 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:07.934007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2d39d61-5d17-4125-a722-e7412b84e255 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:07.934561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2d39d61-5d17-4125-a722-e7412b84e255 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:08.098181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b2d39d61-5d17-4125-a722-e7412b84e255 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:08.113843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:08.120555 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b2d39d61-5d17-4125-a722-e7412b84e255 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 200 len: 1319 microversion: 2.1 time: 0.211032 May 21 21:12:08.121374 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 282/568] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:07 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:08.133298 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-30207db4-b956-427f-bb29-7de36dd4cf43 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:08.133962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-30207db4-b956-427f-bb29-7de36dd4cf43 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:08.142808 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30207db4-b956-427f-bb29-7de36dd4cf43 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:08.143250 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30207db4-b956-427f-bb29-7de36dd4cf43 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:08.144047 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30207db4-b956-427f-bb29-7de36dd4cf43 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:08.144527 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30207db4-b956-427f-bb29-7de36dd4cf43 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:08.234201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-30207db4-b956-427f-bb29-7de36dd4cf43 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:08.256660 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-30207db4-b956-427f-bb29-7de36dd4cf43 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1927 microversion: 2.75 time: 0.127033 May 21 21:12:08.264249 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 283/569] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:08 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1927 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:08.281338 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2deaba89-5f4a-4cf7-a31f-c4efe55d7e30 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:08.281974 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2deaba89-5f4a-4cf7-a31f-c4efe55d7e30 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:08.289799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2deaba89-5f4a-4cf7-a31f-c4efe55d7e30 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:08.290113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2deaba89-5f4a-4cf7-a31f-c4efe55d7e30 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:08.291560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2deaba89-5f4a-4cf7-a31f-c4efe55d7e30 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:08.291686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2deaba89-5f4a-4cf7-a31f-c4efe55d7e30 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:08.497947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2deaba89-5f4a-4cf7-a31f-c4efe55d7e30 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:08.507768 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2deaba89-5f4a-4cf7-a31f-c4efe55d7e30 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1475 microversion: 2.1 time: 0.230810 May 21 21:12:08.518360 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 284/570] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:08 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1475 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:12:08.518360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-d6182790-4997-485b-a557-c6ad3f6b1756 req-45749c4c-692e-4df8-a73a-ce8f61347ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3935c27-84ef-41ff-adbf-9e4b29eea5d3", "tag": "a3199f1f-7536-444f-ab94-2847aeee7a78"}, {"server_uuid": "06d5f184-08de-44c5-bd8c-051f64fe06fa", "name": "network-vif-unplugged", "status": "completed", "tag": "15fa1734-3d96-43ae-a8b4-3a89b9859f45"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:08.524731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-d6182790-4997-485b-a557-c6ad3f6b1756 req-45749c4c-692e-4df8-a73a-ce8f61347ff2 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:08.525318 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-d6182790-4997-485b-a557-c6ad3f6b1756 req-45749c4c-692e-4df8-a73a-ce8f61347ff2 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:08.546875 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-d6182790-4997-485b-a557-c6ad3f6b1756 req-45749c4c-692e-4df8-a73a-ce8f61347ff2 service nova] Creating event network-changed:a3199f1f-7536-444f-ab94-2847aeee7a78 for instance c3935c27-84ef-41ff-adbf-9e4b29eea5d3 on nch2-master-1 May 21 21:12:08.546875 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-d6182790-4997-485b-a557-c6ad3f6b1756 req-45749c4c-692e-4df8-a73a-ce8f61347ff2 service nova] Creating event network-vif-unplugged:15fa1734-3d96-43ae-a8b4-3a89b9859f45 for instance 06d5f184-08de-44c5-bd8c-051f64fe06fa on nch2-master-1 May 21 21:12:08.561355 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [req-d6182790-4997-485b-a557-c6ad3f6b1756 req-45749c4c-692e-4df8-a73a-ce8f61347ff2 service nova] Instance 06d5f184-08de-44c5-bd8c-051f64fe06fa is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 21:12:08.575481 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-d6182790-4997-485b-a557-c6ad3f6b1756 req-45749c4c-692e-4df8-a73a-ce8f61347ff2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.065798 May 21 21:12:08.576327 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 285/571] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:08.582068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d82af5b0-a7a6-4ece-ae6a-dac0f1b4fa93 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:08.582922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d82af5b0-a7a6-4ece-ae6a-dac0f1b4fa93 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:08.590410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d82af5b0-a7a6-4ece-ae6a-dac0f1b4fa93 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:08.591250 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d82af5b0-a7a6-4ece-ae6a-dac0f1b4fa93 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:08.592210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d82af5b0-a7a6-4ece-ae6a-dac0f1b4fa93 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:08.592937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d82af5b0-a7a6-4ece-ae6a-dac0f1b4fa93 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:08.849049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d82af5b0-a7a6-4ece-ae6a-dac0f1b4fa93 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:08.857701 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d82af5b0-a7a6-4ece-ae6a-dac0f1b4fa93 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1504 microversion: 2.1 time: 0.280056 May 21 21:12:08.872735 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 286/572] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:08 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1504 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:08.916613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-00e88ae6-ae6f-4c25-a81b-ea2fd6f7398d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:08.917845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-00e88ae6-ae6f-4c25-a81b-ea2fd6f7398d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:08.928762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00e88ae6-ae6f-4c25-a81b-ea2fd6f7398d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:08.935780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00e88ae6-ae6f-4c25-a81b-ea2fd6f7398d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:08.935780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00e88ae6-ae6f-4c25-a81b-ea2fd6f7398d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:08.935780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00e88ae6-ae6f-4c25-a81b-ea2fd6f7398d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:09.244544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-00e88ae6-ae6f-4c25-a81b-ea2fd6f7398d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:09.250756 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-00e88ae6-ae6f-4c25-a81b-ea2fd6f7398d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:09.255679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-00e88ae6-ae6f-4c25-a81b-ea2fd6f7398d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:09.260980 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-00e88ae6-ae6f-4c25-a81b-ea2fd6f7398d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.345895 May 21 21:12:09.262496 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 287/573] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:08 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:12:09.277453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3e1f7152-4ccc-412d-9d31-edb95972d5df tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:09.279658 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3e1f7152-4ccc-412d-9d31-edb95972d5df tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:09.306312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e1f7152-4ccc-412d-9d31-edb95972d5df tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:09.307198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e1f7152-4ccc-412d-9d31-edb95972d5df tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:09.309684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e1f7152-4ccc-412d-9d31-edb95972d5df tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:09.311646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e1f7152-4ccc-412d-9d31-edb95972d5df tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:09.834859 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-aa564ebe-af7b-4737-8ba3-e5c753dbc5c0 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Updating instance_info_cache with network_info: [{"id": "a3199f1f-7536-444f-ab94-2847aeee7a78", "address": "fa:16:3e:5f:80:d1", "network": {"id": "99d05c9f-92b6-430b-8f33-3ae9f1f2ec0c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1022125987-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4c99e1f900034d42bbb1a786b225a230", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa3199f1f-75", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131277) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 21 21:12:09.957336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa564ebe-af7b-4737-8ba3-e5c753dbc5c0 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Releasing lock "refresh_cache-c3935c27-84ef-41ff-adbf-9e4b29eea5d3" {{(pid=131277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 21 21:12:09.958226 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aa564ebe-af7b-4737-8ba3-e5c753dbc5c0 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "POST /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3/action" status: 202 len: 0 microversion: 2.1 time: 8.033802 May 21 21:12:09.961963 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 287/574] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:12:01 2022] POST /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3/action => generated 0 bytes in 8035 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 21 21:12:09.964031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-341a2e72-813b-4320-8927-d1a0bd962575 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:09.964994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-341a2e72-813b-4320-8927-d1a0bd962575 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:09.977753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-341a2e72-813b-4320-8927-d1a0bd962575 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:09.978492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-341a2e72-813b-4320-8927-d1a0bd962575 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:09.979445 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-341a2e72-813b-4320-8927-d1a0bd962575 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:09.980189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-341a2e72-813b-4320-8927-d1a0bd962575 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:10.096483 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3e1f7152-4ccc-412d-9d31-edb95972d5df tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:10.105900 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3e1f7152-4ccc-412d-9d31-edb95972d5df tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 200 len: 1319 microversion: 2.1 time: 0.842042 May 21 21:12:10.106762 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 288/575] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:09 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 1319 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:10.121441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-30c4d4c0-a7ab-4333-a5ac-77670ba64483 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:10.122275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-30c4d4c0-a7ab-4333-a5ac-77670ba64483 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:10.125606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-341a2e72-813b-4320-8927-d1a0bd962575 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:10.129024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30c4d4c0-a7ab-4333-a5ac-77670ba64483 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:10.129688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30c4d4c0-a7ab-4333-a5ac-77670ba64483 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:10.131384 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30c4d4c0-a7ab-4333-a5ac-77670ba64483 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:10.131985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30c4d4c0-a7ab-4333-a5ac-77670ba64483 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:10.163967 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-341a2e72-813b-4320-8927-d1a0bd962575 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1927 microversion: 2.75 time: 0.203705 May 21 21:12:10.169601 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 288/576] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:09 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1927 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:10.174776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ec53c788-649f-41ec-9b3f-b6824ee25642 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:10.175817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ec53c788-649f-41ec-9b3f-b6824ee25642 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:10.182343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ec53c788-649f-41ec-9b3f-b6824ee25642 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:10.183031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ec53c788-649f-41ec-9b3f-b6824ee25642 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:10.183988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ec53c788-649f-41ec-9b3f-b6824ee25642 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:10.184612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ec53c788-649f-41ec-9b3f-b6824ee25642 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:10.363796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-30c4d4c0-a7ab-4333-a5ac-77670ba64483 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:10.379503 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-30c4d4c0-a7ab-4333-a5ac-77670ba64483 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1475 microversion: 2.1 time: 0.258599 May 21 21:12:10.380352 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 289/577] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:10 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1475 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:10.397004 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ef7954c1-8cd3-4940-b12c-3f5f37098eca tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Action: 'action', calling method: .version_select at 0x7fc82a2d15e0>, body: {"addFloatingIp": {"address": "172.35.0.186"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:10.398458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ef7954c1-8cd3-4940-b12c-3f5f37098eca tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:10.405411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef7954c1-8cd3-4940-b12c-3f5f37098eca tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:10.406242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef7954c1-8cd3-4940-b12c-3f5f37098eca tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:10.408038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef7954c1-8cd3-4940-b12c-3f5f37098eca tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:10.408760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef7954c1-8cd3-4940-b12c-3f5f37098eca tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:10.488020 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef7954c1-8cd3-4940-b12c-3f5f37098eca tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Acquired lock "refresh_cache-11c92463-f5f1-4c2a-bcf0-573711f0c4f1" {{(pid=131278) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 21 21:12:11.043593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ec53c788-649f-41ec-9b3f-b6824ee25642 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:11.078465 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ec53c788-649f-41ec-9b3f-b6824ee25642 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1504 microversion: 2.1 time: 0.904603 May 21 21:12:11.083428 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 289/578] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:10 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1504 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:11.101337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cdb0203e-3fb1-4562-af18-52e2ba2c393c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:11.105756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cdb0203e-3fb1-4562-af18-52e2ba2c393c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:11.122459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdb0203e-3fb1-4562-af18-52e2ba2c393c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:11.124469 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdb0203e-3fb1-4562-af18-52e2ba2c393c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:11.126713 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdb0203e-3fb1-4562-af18-52e2ba2c393c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:11.127560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdb0203e-3fb1-4562-af18-52e2ba2c393c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:11.477354 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cdb0203e-3fb1-4562-af18-52e2ba2c393c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:11.490542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cdb0203e-3fb1-4562-af18-52e2ba2c393c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:11.492634 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cdb0203e-3fb1-4562-af18-52e2ba2c393c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:11.494004 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cdb0203e-3fb1-4562-af18-52e2ba2c393c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.404208 May 21 21:12:11.495329 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 290/579] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:11 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:11.502320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-b73ad292-cdd5-4298-9370-152ce9c0ec82 req-57720ab1-bc55-4237-b637-365325bfed70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1886820b-3b3f-4ae7-94ea-4204d7cf8a60", "tag": "9819927c-6523-4e99-b41c-43d458e3b568"}, {"name": "network-changed", "server_uuid": "06d5f184-08de-44c5-bd8c-051f64fe06fa", "tag": "15fa1734-3d96-43ae-a8b4-3a89b9859f45"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:11.513318 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b73ad292-cdd5-4298-9370-152ce9c0ec82 req-57720ab1-bc55-4237-b637-365325bfed70 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:11.514016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b73ad292-cdd5-4298-9370-152ce9c0ec82 req-57720ab1-bc55-4237-b637-365325bfed70 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:11.532224 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-b73ad292-cdd5-4298-9370-152ce9c0ec82 req-57720ab1-bc55-4237-b637-365325bfed70 service nova] Creating event network-changed:9819927c-6523-4e99-b41c-43d458e3b568 for instance 1886820b-3b3f-4ae7-94ea-4204d7cf8a60 on nch1-master-1 May 21 21:12:11.533784 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-b73ad292-cdd5-4298-9370-152ce9c0ec82 req-57720ab1-bc55-4237-b637-365325bfed70 service nova] Creating event network-changed:15fa1734-3d96-43ae-a8b4-3a89b9859f45 for instance 06d5f184-08de-44c5-bd8c-051f64fe06fa on nch2-master-1 May 21 21:12:11.551121 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [req-b73ad292-cdd5-4298-9370-152ce9c0ec82 req-57720ab1-bc55-4237-b637-365325bfed70 service nova] Instance 06d5f184-08de-44c5-bd8c-051f64fe06fa is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 21:12:11.574669 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-b73ad292-cdd5-4298-9370-152ce9c0ec82 req-57720ab1-bc55-4237-b637-365325bfed70 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.075184 May 21 21:12:11.576075 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 291/580] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:11.585399 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f324b458-66e7-45b8-8529-12afa33b0721 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:11.586476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f324b458-66e7-45b8-8529-12afa33b0721 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:11.593505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f324b458-66e7-45b8-8529-12afa33b0721 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:11.594359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f324b458-66e7-45b8-8529-12afa33b0721 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:11.595470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f324b458-66e7-45b8-8529-12afa33b0721 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:11.596250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f324b458-66e7-45b8-8529-12afa33b0721 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:11.885877 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f324b458-66e7-45b8-8529-12afa33b0721 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:11.908173 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f324b458-66e7-45b8-8529-12afa33b0721 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 200 len: 1319 microversion: 2.1 time: 0.329121 May 21 21:12:11.925396 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 292/581] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:11 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:11.934053 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e8685aba-b8d7-4ce0-94a7-d9e8d6295c90 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:11.934783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e8685aba-b8d7-4ce0-94a7-d9e8d6295c90 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:11.941812 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8685aba-b8d7-4ce0-94a7-d9e8d6295c90 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:11.942273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8685aba-b8d7-4ce0-94a7-d9e8d6295c90 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:11.943305 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8685aba-b8d7-4ce0-94a7-d9e8d6295c90 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:11.943858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8685aba-b8d7-4ce0-94a7-d9e8d6295c90 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:12.036015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-e8685aba-b8d7-4ce0-94a7-d9e8d6295c90 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:12.058323 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e8685aba-b8d7-4ce0-94a7-d9e8d6295c90 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1927 microversion: 2.75 time: 0.130768 May 21 21:12:12.059245 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 293/582] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:11 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1927 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:12.064316 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d98051d0-c716-4d3f-b855-281b0454b223 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:12.065235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d98051d0-c716-4d3f-b855-281b0454b223 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:12.109517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d98051d0-c716-4d3f-b855-281b0454b223 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:12.110277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d98051d0-c716-4d3f-b855-281b0454b223 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:12.112874 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d98051d0-c716-4d3f-b855-281b0454b223 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:12.114474 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d98051d0-c716-4d3f-b855-281b0454b223 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:12.768399 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d98051d0-c716-4d3f-b855-281b0454b223 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:12.776633 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d98051d0-c716-4d3f-b855-281b0454b223 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1475 microversion: 2.1 time: 0.713761 May 21 21:12:12.776633 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 294/583] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:12 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1475 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:12.790962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4a7d4652-45c2-4cb1-953f-23dc5730d290 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:12.791545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4a7d4652-45c2-4cb1-953f-23dc5730d290 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:12.798757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a7d4652-45c2-4cb1-953f-23dc5730d290 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:12.799673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a7d4652-45c2-4cb1-953f-23dc5730d290 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:12.800565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a7d4652-45c2-4cb1-953f-23dc5730d290 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:12.801019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a7d4652-45c2-4cb1-953f-23dc5730d290 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:13.306118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4a7d4652-45c2-4cb1-953f-23dc5730d290 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:13.322106 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4a7d4652-45c2-4cb1-953f-23dc5730d290 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1504 microversion: 2.1 time: 0.545460 May 21 21:12:13.324677 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 295/584] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:12 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1504 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:13.336445 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cdcac267-2400-4d85-a747-937e18acd915 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:13.337317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cdcac267-2400-4d85-a747-937e18acd915 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:13.337542 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.network.neutron [None req-ef7954c1-8cd3-4940-b12c-3f5f37098eca tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] re-assign floating IP 172.35.0.186 from instance c3935c27-84ef-41ff-adbf-9e4b29eea5d3 May 21 21:12:13.348823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdcac267-2400-4d85-a747-937e18acd915 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:13.349325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdcac267-2400-4d85-a747-937e18acd915 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:13.350849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdcac267-2400-4d85-a747-937e18acd915 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:13.351303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdcac267-2400-4d85-a747-937e18acd915 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:13.387354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-ef7954c1-8cd3-4940-b12c-3f5f37098eca tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Building network info cache for instance {{(pid=131278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 21 21:12:13.777531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cdcac267-2400-4d85-a747-937e18acd915 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:13.793748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cdcac267-2400-4d85-a747-937e18acd915 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:13.795277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cdcac267-2400-4d85-a747-937e18acd915 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:13.796604 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cdcac267-2400-4d85-a747-937e18acd915 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.466432 May 21 21:12:13.797470 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 296/585] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:13 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:13.802172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-12e72a23-cad5-4095-8730-285121c3ed4a tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:13.802846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-12e72a23-cad5-4095-8730-285121c3ed4a tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:13.826213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-12e72a23-cad5-4095-8730-285121c3ed4a tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:13.826714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-12e72a23-cad5-4095-8730-285121c3ed4a tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:13.827472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-12e72a23-cad5-4095-8730-285121c3ed4a tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:13.827920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-12e72a23-cad5-4095-8730-285121c3ed4a tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:14.278187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-ef7954c1-8cd3-4940-b12c-3f5f37098eca tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Updating instance_info_cache with network_info: [{"id": "a3199f1f-7536-444f-ab94-2847aeee7a78", "address": "fa:16:3e:5f:80:d1", "network": {"id": "99d05c9f-92b6-430b-8f33-3ae9f1f2ec0c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1022125987-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4c99e1f900034d42bbb1a786b225a230", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa3199f1f-75", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 21 21:12:14.374161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-ef7954c1-8cd3-4940-b12c-3f5f37098eca tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Building network info cache for instance {{(pid=131278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 21 21:12:14.595185 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-12e72a23-cad5-4095-8730-285121c3ed4a tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:14.605501 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-12e72a23-cad5-4095-8730-285121c3ed4a tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 200 len: 1319 microversion: 2.1 time: 0.806863 May 21 21:12:14.608445 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 297/586] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:13 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 1319 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:14.615872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bba4efa7-7626-4e95-809c-af3c4b728533 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:14.616950 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bba4efa7-7626-4e95-809c-af3c4b728533 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:14.623444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bba4efa7-7626-4e95-809c-af3c4b728533 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:14.623939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bba4efa7-7626-4e95-809c-af3c4b728533 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:14.636333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bba4efa7-7626-4e95-809c-af3c4b728533 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:14.637143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bba4efa7-7626-4e95-809c-af3c4b728533 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:14.947677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-bba4efa7-7626-4e95-809c-af3c4b728533 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:14.975345 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bba4efa7-7626-4e95-809c-af3c4b728533 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1927 microversion: 2.75 time: 0.365466 May 21 21:12:14.976484 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 298/587] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:14 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1927 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:14.981500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-5ea41891-8e14-4386-b5a7-290d9fbc7b72 req-ddfdb2fe-d8df-4b08-a70d-fe50505fcb29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3935c27-84ef-41ff-adbf-9e4b29eea5d3", "tag": "a3199f1f-7536-444f-ab94-2847aeee7a78"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:14.991254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5ea41891-8e14-4386-b5a7-290d9fbc7b72 req-ddfdb2fe-d8df-4b08-a70d-fe50505fcb29 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:14.992031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5ea41891-8e14-4386-b5a7-290d9fbc7b72 req-ddfdb2fe-d8df-4b08-a70d-fe50505fcb29 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:15.007781 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-5ea41891-8e14-4386-b5a7-290d9fbc7b72 req-ddfdb2fe-d8df-4b08-a70d-fe50505fcb29 service nova] Creating event network-changed:a3199f1f-7536-444f-ab94-2847aeee7a78 for instance c3935c27-84ef-41ff-adbf-9e4b29eea5d3 on nch2-master-1 May 21 21:12:15.013129 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-5ea41891-8e14-4386-b5a7-290d9fbc7b72 req-ddfdb2fe-d8df-4b08-a70d-fe50505fcb29 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035349 May 21 21:12:15.014288 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 299/588] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:15.031810 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-32bd4503-f534-4ce8-b49d-1030e15bd3d8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:15.034682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-32bd4503-f534-4ce8-b49d-1030e15bd3d8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:15.057352 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32bd4503-f534-4ce8-b49d-1030e15bd3d8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:15.058162 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32bd4503-f534-4ce8-b49d-1030e15bd3d8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:15.059171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32bd4503-f534-4ce8-b49d-1030e15bd3d8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:15.059762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32bd4503-f534-4ce8-b49d-1030e15bd3d8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:15.774572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-ef7954c1-8cd3-4940-b12c-3f5f37098eca tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Updating instance_info_cache with network_info: [{"id": "d19d3553-91b7-47ed-96ea-0384ea855a46", "address": "fa:16:3e:46:c1:29", "network": {"id": "99d05c9f-92b6-430b-8f33-3ae9f1f2ec0c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1022125987-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4c99e1f900034d42bbb1a786b225a230", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd19d3553-91", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 21 21:12:15.801403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-32bd4503-f534-4ce8-b49d-1030e15bd3d8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:15.813404 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-32bd4503-f534-4ce8-b49d-1030e15bd3d8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1470 microversion: 2.1 time: 0.796425 May 21 21:12:15.814218 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 300/589] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:15 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1470 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:15.835553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b38bc88d-4f99-47e8-8c97-59b81cb0c10f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:15.839960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b38bc88d-4f99-47e8-8c97-59b81cb0c10f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:15.854313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef7954c1-8cd3-4940-b12c-3f5f37098eca tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Releasing lock "refresh_cache-11c92463-f5f1-4c2a-bcf0-573711f0c4f1" {{(pid=131278) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 21 21:12:15.859364 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ef7954c1-8cd3-4940-b12c-3f5f37098eca tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "POST /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1/action" status: 202 len: 0 microversion: 2.1 time: 5.462913 May 21 21:12:15.859484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b38bc88d-4f99-47e8-8c97-59b81cb0c10f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:15.859484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b38bc88d-4f99-47e8-8c97-59b81cb0c10f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:15.860006 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 290/590] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:12:10 2022] POST /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1/action => generated 0 bytes in 5479 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 21 21:12:15.861703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b38bc88d-4f99-47e8-8c97-59b81cb0c10f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:15.862329 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b38bc88d-4f99-47e8-8c97-59b81cb0c10f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:15.865536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f68448b4-507f-4d95-8346-8f1bd25eb6a4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:15.866171 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f68448b4-507f-4d95-8346-8f1bd25eb6a4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:15.878743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f68448b4-507f-4d95-8346-8f1bd25eb6a4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:15.879197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f68448b4-507f-4d95-8346-8f1bd25eb6a4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:15.879987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f68448b4-507f-4d95-8346-8f1bd25eb6a4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:15.885266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f68448b4-507f-4d95-8346-8f1bd25eb6a4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:15.902952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:16.105450 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f68448b4-507f-4d95-8346-8f1bd25eb6a4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:16.115491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f68448b4-507f-4d95-8346-8f1bd25eb6a4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:16.124010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f68448b4-507f-4d95-8346-8f1bd25eb6a4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:16.125743 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f68448b4-507f-4d95-8346-8f1bd25eb6a4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.264495 May 21 21:12:16.127116 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 291/591] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:15 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:16.259766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bd989eb2-b19b-4c9d-b761-9e932897c508 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Action: 'create', calling method: .version_select at 0x7fc81b9a5b80>, body: {"keypair": {"name": "tempest-keypair-1661763655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9TmKSZwHuaC7dgYrfZoseKJfuWq8IW6o5mCK2Mvqn03fxo/K4R9C/STPzeWGgX5+Nm5xpWghwbuCyLakNV/UBHbxRJxYqd43rgXMsNOOJViQvIKi0sqvMvtK8iWI1gLw=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:16.276258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-bd989eb2-b19b-4c9d-b761-9e932897c508 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Getting quotas for project ec45624cf8a940fd952008d56b0d2465. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:12:16.294044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-bd989eb2-b19b-4c9d-b761-9e932897c508 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Getting quotas for user 331fe55d374249f6bbd9291adf78d5a9 and project ec45624cf8a940fd952008d56b0d2465. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:12:16.300846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b38bc88d-4f99-47e8-8c97-59b81cb0c10f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:16.308814 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b38bc88d-4f99-47e8-8c97-59b81cb0c10f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1494 microversion: 2.1 time: 0.482345 May 21 21:12:16.309958 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 301/592] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:15 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1494 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:16.315938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e6cb1b4b-40d9-461b-8d7f-a00fe9b8c355 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:16.320631 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e6cb1b4b-40d9-461b-8d7f-a00fe9b8c355 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:16.323823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6cb1b4b-40d9-461b-8d7f-a00fe9b8c355 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:16.324493 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6cb1b4b-40d9-461b-8d7f-a00fe9b8c355 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:16.325464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6cb1b4b-40d9-461b-8d7f-a00fe9b8c355 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:16.326060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6cb1b4b-40d9-461b-8d7f-a00fe9b8c355 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:16.419441 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bd989eb2-b19b-4c9d-b761-9e932897c508 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.291035 May 21 21:12:16.422177 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 292/593] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:12:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:16.431228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f3f2f036-4681-4c3a-a43c-7ca8dd65a994 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:16.431775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f3f2f036-4681-4c3a-a43c-7ca8dd65a994 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:16.442570 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3f2f036-4681-4c3a-a43c-7ca8dd65a994 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:16.443012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3f2f036-4681-4c3a-a43c-7ca8dd65a994 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:16.443988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3f2f036-4681-4c3a-a43c-7ca8dd65a994 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:16.444601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3f2f036-4681-4c3a-a43c-7ca8dd65a994 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:16.690859 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e6cb1b4b-40d9-461b-8d7f-a00fe9b8c355 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:16.699481 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e6cb1b4b-40d9-461b-8d7f-a00fe9b8c355 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 200 len: 1319 microversion: 2.1 time: 0.387980 May 21 21:12:16.700227 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 302/594] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:16 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:16.705712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3c35b8f7-6f1a-45bc-9339-c3e8fba965ac tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Action: 'action', calling method: .version_select at 0x7fc82a0c2b80>, body: {"removeFloatingIp": {"address": "172.35.0.186"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:16.736018 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f3f2f036-4681-4c3a-a43c-7ca8dd65a994 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "POST /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa/action" status: 204 len: 0 microversion: 2.1 time: 0.307293 May 21 21:12:16.736018 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 293/595] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:12:16 2022] POST /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa/action => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:12:16.740595 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4e416e6a-3bef-40bd-9bac-19734409e09f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:16.741887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4e416e6a-3bef-40bd-9bac-19734409e09f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:16.771170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e416e6a-3bef-40bd-9bac-19734409e09f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:16.772052 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e416e6a-3bef-40bd-9bac-19734409e09f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:16.772778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e416e6a-3bef-40bd-9bac-19734409e09f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:16.773232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e416e6a-3bef-40bd-9bac-19734409e09f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:16.888153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-4e416e6a-3bef-40bd-9bac-19734409e09f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:16.915124 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4e416e6a-3bef-40bd-9bac-19734409e09f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1927 microversion: 2.75 time: 0.181344 May 21 21:12:16.917574 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 294/596] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:16 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1927 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:16.922560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-69bd7a82-c33f-4c88-874e-93036fc9466e req-bc8d36ba-57d7-428c-a1a5-69d04a15cbb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1886820b-3b3f-4ae7-94ea-4204d7cf8a60", "name": "network-vif-plugged", "status": "completed", "tag": "9819927c-6523-4e99-b41c-43d458e3b568"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:16.939202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-69bd7a82-c33f-4c88-874e-93036fc9466e req-bc8d36ba-57d7-428c-a1a5-69d04a15cbb9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:16.939821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-69bd7a82-c33f-4c88-874e-93036fc9466e req-bc8d36ba-57d7-428c-a1a5-69d04a15cbb9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:16.955394 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-69bd7a82-c33f-4c88-874e-93036fc9466e req-bc8d36ba-57d7-428c-a1a5-69d04a15cbb9 service nova] Creating event network-vif-plugged:9819927c-6523-4e99-b41c-43d458e3b568 for instance 1886820b-3b3f-4ae7-94ea-4204d7cf8a60 on nch1-master-1 May 21 21:12:16.965625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3c35b8f7-6f1a-45bc-9339-c3e8fba965ac tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:16.971410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c35b8f7-6f1a-45bc-9339-c3e8fba965ac tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:16.972483 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-69bd7a82-c33f-4c88-874e-93036fc9466e req-bc8d36ba-57d7-428c-a1a5-69d04a15cbb9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053306 May 21 21:12:16.972956 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c35b8f7-6f1a-45bc-9339-c3e8fba965ac tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:16.973521 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 295/597] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:16.973781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c35b8f7-6f1a-45bc-9339-c3e8fba965ac tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:16.974229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c35b8f7-6f1a-45bc-9339-c3e8fba965ac tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:16.981407 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-12917385-330f-40ac-9d43-12a0330ad833 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '.version_select at 0x7fc81ba144c0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:16.984804 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-12917385-330f-40ac-9d43-12a0330ad833 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:16.991982 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-12917385-330f-40ac-9d43-12a0330ad833 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:16.999964 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-12917385-330f-40ac-9d43-12a0330ad833 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 1173 microversion: 2.1 time: 0.024745 May 21 21:12:17.001605 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 296/598] 10.222.0.49 () {58 vars in 1142 bytes} [Sat May 21 21:12:16 2022] GET /compute/v2.1/os-migrations => generated 1173 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:17.006605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3b951460-43b1-42be-88c2-bfa67640ec5f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:17.007353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3b951460-43b1-42be-88c2-bfa67640ec5f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:17.014003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b951460-43b1-42be-88c2-bfa67640ec5f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:17.014688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b951460-43b1-42be-88c2-bfa67640ec5f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:17.015630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b951460-43b1-42be-88c2-bfa67640ec5f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:17.016226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b951460-43b1-42be-88c2-bfa67640ec5f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:17.021279 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:17.211606 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3b951460-43b1-42be-88c2-bfa67640ec5f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:17.219288 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3b951460-43b1-42be-88c2-bfa67640ec5f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1470 microversion: 2.1 time: 0.216493 May 21 21:12:17.220462 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 297/599] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:17 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1470 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:17.233375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-44aef871-e21f-4e75-abaa-78b28eb5d92b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:17.233375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-44aef871-e21f-4e75-abaa-78b28eb5d92b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:17.233375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44aef871-e21f-4e75-abaa-78b28eb5d92b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:17.239856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44aef871-e21f-4e75-abaa-78b28eb5d92b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:17.240911 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44aef871-e21f-4e75-abaa-78b28eb5d92b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:17.241376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44aef871-e21f-4e75-abaa-78b28eb5d92b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:17.418649 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-44aef871-e21f-4e75-abaa-78b28eb5d92b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1645 microversion: 2.1 time: 0.197114 May 21 21:12:17.422594 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 298/600] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:17 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1645 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:17.447007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-dc9642a7-f162-4e25-9af6-d958854b774a req-e25a5b07-7c5c-4631-9fb6-f6454d6db040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c92463-f5f1-4c2a-bcf0-573711f0c4f1", "tag": "d19d3553-91b7-47ed-96ea-0384ea855a46"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:17.456691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-dc9642a7-f162-4e25-9af6-d958854b774a req-e25a5b07-7c5c-4631-9fb6-f6454d6db040 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:17.457169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-dc9642a7-f162-4e25-9af6-d958854b774a req-e25a5b07-7c5c-4631-9fb6-f6454d6db040 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:17.470437 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-dc9642a7-f162-4e25-9af6-d958854b774a req-e25a5b07-7c5c-4631-9fb6-f6454d6db040 service nova] Creating event network-changed:d19d3553-91b7-47ed-96ea-0384ea855a46 for instance 11c92463-f5f1-4c2a-bcf0-573711f0c4f1 on nch2-master-1 May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-3c35b8f7-6f1a-45bc-9339-c3e8fba965ac tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] HTTP exception thrown: Floating IP 172.35.0.186 is not associated with instance c3935c27-84ef-41ff-adbf-9e4b29eea5d3. May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3c35b8f7-6f1a-45bc-9339-c3e8fba965ac tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Request method failure captured: May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3/action HTTP/1.1 May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 49 May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVVpDBkS9K5pHFyv1XlqioW0P9eZZk_9X-B4sgaichiXR51l8haUp4vJjn70cKE_2K_VfbPPZsJsGr1xAY3eh4HDE-hFYM3re9EaunzR52vH2hltxndJ5h9YgnrzeA7ccnIdugc39yImBWPo33UJW0svJK37zeFXDOCybMyKPxcajjA May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 4c99e1f900034d42bbb1a786b225a230 May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1972717349 May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:12:17.475625 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:12:17.477250 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4c99e1f900034d42bbb1a786b225a230"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c99e1f900034d42bbb1a786b225a230"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4c99e1f900034d42bbb1a786b225a230", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c99e1f900034d42bbb1a786b225a230"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:12:17.477250 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1972717349 May 21 21:12:17.477250 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 4c99e1f900034d42bbb1a786b225a230 May 21 21:12:17.477250 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1972717349 May 21 21:12:17.477250 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-FloatingIPsAssociationTestJSON-1972717349-project May 21 21:12:17.477250 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:12:17.477250 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:12:17.477250 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 74f296ea42634e18ad82ee175408c641 May 21 21:12:17.477250 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1972717349-project May 21 21:12:17.477250 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:12:17.477250 ncdv-master-1 devstack@n-api.service[131277]: {"removeFloatingIp": {"address": "172.35.0.186"}} May 21 21:12:17.477250 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:12:17.477250 ncdv-master-1 devstack@n-api.service[131277]: exception: Floating IP 172.35.0.186 is not associated with instance c3935c27-84ef-41ff-adbf-9e4b29eea5d3. May 21 21:12:17.478180 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'c3935c27-84ef-41ff-adbf-9e4b29eea5d3', 'body': {'removeFloatingIp': {'address': '172.35.0.186'}}} May 21 21:12:17.478180 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:12:17.478180 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:17.478180 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:17.478180 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:17.478180 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:12:17.478180 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:12:17.478180 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:12:17.478180 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:12:17.478180 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:12:17.478180 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:12:17.478180 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:12:17.478180 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:12:17.478180 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip May 21 21:12:17.478180 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 21 21:12:17.478180 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.0.186 is not associated with instance c3935c27-84ef-41ff-adbf-9e4b29eea5d3. May 21 21:12:17.478180 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:12:17.478180 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:17.478180 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:12:17.478180 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:17.479566 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:17.479566 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:17.479566 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:12:17.479566 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:12:17.479566 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.0.186 is not associated with instance c3935c27-84ef-41ff-adbf-9e4b29eea5d3. May 21 21:12:17.479566 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:12:17.479566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3c35b8f7-6f1a-45bc-9339-c3e8fba965ac tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Returning 409 to user: Floating IP 172.35.0.186 is not associated with instance c3935c27-84ef-41ff-adbf-9e4b29eea5d3. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:12:17.480082 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-dc9642a7-f162-4e25-9af6-d958854b774a req-e25a5b07-7c5c-4631-9fb6-f6454d6db040 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041346 May 21 21:12:17.480082 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 299/601] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:17.480239 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3c35b8f7-6f1a-45bc-9339-c3e8fba965ac tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "POST /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3/action" status: 409 len: 146 microversion: 2.1 time: 0.776986 May 21 21:12:17.481178 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 303/602] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:12:16 2022] POST /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3/action => generated 146 bytes in 780 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 21 21:12:17.491804 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6fa55f97-3c80-4613-a1ec-994f2dcb8ef3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:17.491995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dd076a9e-39e4-46b2-90c5-f3c38dd8260b tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.0.186"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:17.492797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6fa55f97-3c80-4613-a1ec-994f2dcb8ef3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:17.504338 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6fa55f97-3c80-4613-a1ec-994f2dcb8ef3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:17.504801 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6fa55f97-3c80-4613-a1ec-994f2dcb8ef3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:17.505589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6fa55f97-3c80-4613-a1ec-994f2dcb8ef3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:17.506029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6fa55f97-3c80-4613-a1ec-994f2dcb8ef3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:17.711758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6fa55f97-3c80-4613-a1ec-994f2dcb8ef3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:17.720995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6fa55f97-3c80-4613-a1ec-994f2dcb8ef3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:17.723846 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6fa55f97-3c80-4613-a1ec-994f2dcb8ef3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:17.725988 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6fa55f97-3c80-4613-a1ec-994f2dcb8ef3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.247617 May 21 21:12:17.727094 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 300/603] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:17 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:17.735034 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8cd2f370-03ae-4455-a71e-aff9c80522f6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1376005786", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "d047b92d-2da6-44d2-8e31-01dbad6dd130"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:17.790023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dd076a9e-39e4-46b2-90c5-f3c38dd8260b tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:17.795580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd076a9e-39e4-46b2-90c5-f3c38dd8260b tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:17.798283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd076a9e-39e4-46b2-90c5-f3c38dd8260b tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:17.799572 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd076a9e-39e4-46b2-90c5-f3c38dd8260b tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:17.801094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd076a9e-39e4-46b2-90c5-f3c38dd8260b tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:17.806516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-8cd2f370-03ae-4455-a71e-aff9c80522f6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] validate_networks() for [('d047b92d-2da6-44d2-8e31-01dbad6dd130', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:12:18.478285 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-8cd2f370-03ae-4455-a71e-aff9c80522f6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:12:18.478863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-8cd2f370-03ae-4455-a71e-aff9c80522f6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:12:18.479511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-8cd2f370-03ae-4455-a71e-aff9c80522f6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:12:18.479985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-8cd2f370-03ae-4455-a71e-aff9c80522f6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:12:18.480543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-8cd2f370-03ae-4455-a71e-aff9c80522f6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:12:18.491551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8cd2f370-03ae-4455-a71e-aff9c80522f6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:18.492366 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8cd2f370-03ae-4455-a71e-aff9c80522f6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:18.493377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8cd2f370-03ae-4455-a71e-aff9c80522f6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:18.494204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8cd2f370-03ae-4455-a71e-aff9c80522f6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:18.527062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-8cd2f370-03ae-4455-a71e-aff9c80522f6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Getting quotas for project 5284da653ac24d73a21e8442609889c9. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:12:18.533946 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-8cd2f370-03ae-4455-a71e-aff9c80522f6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Getting quotas for user 34c22f04c3114d46b6b1b1168aa064f5 and project 5284da653ac24d73a21e8442609889c9. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:12:18.552528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8cd2f370-03ae-4455-a71e-aff9c80522f6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:12:18.555082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8cd2f370-03ae-4455-a71e-aff9c80522f6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:12:18.567538 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:18.651378 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd076a9e-39e4-46b2-90c5-f3c38dd8260b tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Acquired lock "refresh_cache-11c92463-f5f1-4c2a-bcf0-573711f0c4f1" {{(pid=131277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 21 21:12:18.686279 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8cd2f370-03ae-4455-a71e-aff9c80522f6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.957627 May 21 21:12:18.692769 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 301/604] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:12:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:12:18.692769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c7ebf637-264a-4dcf-a64d-16054ef0da0c tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:18.693423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c7ebf637-264a-4dcf-a64d-16054ef0da0c tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:18.700078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c7ebf637-264a-4dcf-a64d-16054ef0da0c tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:18.700561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c7ebf637-264a-4dcf-a64d-16054ef0da0c tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:18.701959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c7ebf637-264a-4dcf-a64d-16054ef0da0c tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:18.703516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c7ebf637-264a-4dcf-a64d-16054ef0da0c tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:18.983579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c7ebf637-264a-4dcf-a64d-16054ef0da0c tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:18.993765 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c7ebf637-264a-4dcf-a64d-16054ef0da0c tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 200 len: 1319 microversion: 2.1 time: 0.305630 May 21 21:12:18.994351 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 302/605] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:18 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:18.999226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8ba22ca8-6366-4008-8c42-6ee67adc0947 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:18.999830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8ba22ca8-6366-4008-8c42-6ee67adc0947 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:19.006664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8ba22ca8-6366-4008-8c42-6ee67adc0947 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:19.007115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8ba22ca8-6366-4008-8c42-6ee67adc0947 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:19.007884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8ba22ca8-6366-4008-8c42-6ee67adc0947 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:19.008344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8ba22ca8-6366-4008-8c42-6ee67adc0947 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:19.090723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-8ba22ca8-6366-4008-8c42-6ee67adc0947 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:19.115094 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8ba22ca8-6366-4008-8c42-6ee67adc0947 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1927 microversion: 2.75 time: 0.119402 May 21 21:12:19.116194 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 303/606] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:18 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1927 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:19.127153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6711dd89-8d05-471e-8ab0-2791dd89fbd3 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:19.128207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6711dd89-8d05-471e-8ab0-2791dd89fbd3 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:19.134990 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6711dd89-8d05-471e-8ab0-2791dd89fbd3 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:19.135951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6711dd89-8d05-471e-8ab0-2791dd89fbd3 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:19.136232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6711dd89-8d05-471e-8ab0-2791dd89fbd3 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:19.136920 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6711dd89-8d05-471e-8ab0-2791dd89fbd3 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:19.389585 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6711dd89-8d05-471e-8ab0-2791dd89fbd3 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:19.398706 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6711dd89-8d05-471e-8ab0-2791dd89fbd3 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1470 microversion: 2.1 time: 0.281370 May 21 21:12:19.399523 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 304/607] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:19 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1470 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:19.404316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0bfa8355-753a-48ae-bd57-2238541de38e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:19.405154 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0bfa8355-753a-48ae-bd57-2238541de38e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:19.487743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0bfa8355-753a-48ae-bd57-2238541de38e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:19.495863 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0bfa8355-753a-48ae-bd57-2238541de38e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1211 microversion: 2.1 time: 0.095148 May 21 21:12:19.496751 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 305/608] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:19 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:19.511226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0f9db2f3-4eff-4851-9bdd-7486f6c461b4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:19.511839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0f9db2f3-4eff-4851-9bdd-7486f6c461b4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:19.519420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f9db2f3-4eff-4851-9bdd-7486f6c461b4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:19.519871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f9db2f3-4eff-4851-9bdd-7486f6c461b4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:19.520679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f9db2f3-4eff-4851-9bdd-7486f6c461b4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:19.521115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f9db2f3-4eff-4851-9bdd-7486f6c461b4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:19.714300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0f9db2f3-4eff-4851-9bdd-7486f6c461b4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:19.723251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0f9db2f3-4eff-4851-9bdd-7486f6c461b4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:19.724804 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0f9db2f3-4eff-4851-9bdd-7486f6c461b4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:19.726057 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0f9db2f3-4eff-4851-9bdd-7486f6c461b4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.218618 May 21 21:12:19.726734 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 306/609] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:19 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:19.731619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-36ca2aaf-2f3d-42ab-896a-253d0e575b22 req-4ea75fb6-7375-4e4c-8337-e266ddb046ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d5f184-08de-44c5-bd8c-051f64fe06fa", "name": "network-vif-plugged", "status": "completed", "tag": "15fa1734-3d96-43ae-a8b4-3a89b9859f45"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:19.741212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-36ca2aaf-2f3d-42ab-896a-253d0e575b22 req-4ea75fb6-7375-4e4c-8337-e266ddb046ab service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:19.741665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-36ca2aaf-2f3d-42ab-896a-253d0e575b22 req-4ea75fb6-7375-4e4c-8337-e266ddb046ab service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:19.756112 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-36ca2aaf-2f3d-42ab-896a-253d0e575b22 req-4ea75fb6-7375-4e4c-8337-e266ddb046ab service nova] Creating event network-vif-plugged:15fa1734-3d96-43ae-a8b4-3a89b9859f45 for instance 06d5f184-08de-44c5-bd8c-051f64fe06fa on nch2-master-1 May 21 21:12:19.768445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [req-36ca2aaf-2f3d-42ab-896a-253d0e575b22 req-4ea75fb6-7375-4e4c-8337-e266ddb046ab service nova] Instance 06d5f184-08de-44c5-bd8c-051f64fe06fa is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 21:12:19.774113 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-36ca2aaf-2f3d-42ab-896a-253d0e575b22 req-4ea75fb6-7375-4e4c-8337-e266ddb046ab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046195 May 21 21:12:19.774703 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 307/610] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:19.815138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0432782b-e02b-4a29-83cd-933c2a22d8fd tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-2009846742", "imageRef": "83a7d9b3-5133-4665-8db9-df64839688fc", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f8f6badb-0484-4ec9-b0f5-caadd06fb512"}], "security_groups": [{"name": "tempest-securitygroup--466323921"}], "key_name": "tempest-keypair-1661763655", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:19.939432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-0432782b-e02b-4a29-83cd-933c2a22d8fd tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] validate_networks() for [('f8f6badb-0484-4ec9-b0f5-caadd06fb512', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:12:20.410917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0432782b-e02b-4a29-83cd-933c2a22d8fd tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:12:20.411472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0432782b-e02b-4a29-83cd-933c2a22d8fd tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:12:20.412033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0432782b-e02b-4a29-83cd-933c2a22d8fd tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:12:20.412481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0432782b-e02b-4a29-83cd-933c2a22d8fd tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:12:20.412894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0432782b-e02b-4a29-83cd-933c2a22d8fd tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:12:20.424138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0432782b-e02b-4a29-83cd-933c2a22d8fd tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:20.424627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0432782b-e02b-4a29-83cd-933c2a22d8fd tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:20.425439 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0432782b-e02b-4a29-83cd-933c2a22d8fd tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:20.425876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0432782b-e02b-4a29-83cd-933c2a22d8fd tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:20.444441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-0432782b-e02b-4a29-83cd-933c2a22d8fd tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Getting quotas for project ec45624cf8a940fd952008d56b0d2465. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:12:20.448661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-0432782b-e02b-4a29-83cd-933c2a22d8fd tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Getting quotas for user 331fe55d374249f6bbd9291adf78d5a9 and project ec45624cf8a940fd952008d56b0d2465. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:12:20.461275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0432782b-e02b-4a29-83cd-933c2a22d8fd tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:12:20.463671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0432782b-e02b-4a29-83cd-933c2a22d8fd tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='83a7d9b3-5133-4665-8db9-df64839688fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:12:20.591196 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0432782b-e02b-4a29-83cd-933c2a22d8fd tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.780254 May 21 21:12:20.597101 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 308/611] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:12:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:12:20.601863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5eb993a0-ede9-4276-aa20-cc8e5d4cfa4b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:20.602497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5eb993a0-ede9-4276-aa20-cc8e5d4cfa4b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:20.609167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5eb993a0-ede9-4276-aa20-cc8e5d4cfa4b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:20.610511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5eb993a0-ede9-4276-aa20-cc8e5d4cfa4b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:20.610913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5eb993a0-ede9-4276-aa20-cc8e5d4cfa4b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:20.611456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5eb993a0-ede9-4276-aa20-cc8e5d4cfa4b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:20.671719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-dd076a9e-39e4-46b2-90c5-f3c38dd8260b tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Building network info cache for instance {{(pid=131277) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 21 21:12:20.849649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5eb993a0-ede9-4276-aa20-cc8e5d4cfa4b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:20.872698 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5eb993a0-ede9-4276-aa20-cc8e5d4cfa4b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 200 len: 1469 microversion: 2.1 time: 0.273258 May 21 21:12:20.874452 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 309/612] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:20 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 1469 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:20.883891 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2f7623aa-d63f-4f39-bfc3-dbf0973cb324 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:20.885393 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2f7623aa-d63f-4f39-bfc3-dbf0973cb324 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:20.893846 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f7623aa-d63f-4f39-bfc3-dbf0973cb324 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:20.897830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f7623aa-d63f-4f39-bfc3-dbf0973cb324 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:20.897830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f7623aa-d63f-4f39-bfc3-dbf0973cb324 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:20.897830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f7623aa-d63f-4f39-bfc3-dbf0973cb324 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:20.976884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-2f7623aa-d63f-4f39-bfc3-dbf0973cb324 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:20.996240 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2f7623aa-d63f-4f39-bfc3-dbf0973cb324 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1927 microversion: 2.75 time: 0.121211 May 21 21:12:20.997225 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 310/613] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:20 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1927 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:21.002696 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-981d19cc-0f8a-4f8b-95c6-a75256927cde tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:21.003778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-981d19cc-0f8a-4f8b-95c6-a75256927cde tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:21.014950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-981d19cc-0f8a-4f8b-95c6-a75256927cde tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:21.015659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-981d19cc-0f8a-4f8b-95c6-a75256927cde tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:21.017369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-981d19cc-0f8a-4f8b-95c6-a75256927cde tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:21.017850 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-981d19cc-0f8a-4f8b-95c6-a75256927cde tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:21.191053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-981d19cc-0f8a-4f8b-95c6-a75256927cde tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:21.209665 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-981d19cc-0f8a-4f8b-95c6-a75256927cde tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1470 microversion: 2.1 time: 0.211173 May 21 21:12:21.222014 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 311/614] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:20 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1470 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:21.222014 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bad98f48-53db-4841-b50d-edf09d923282 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:21.222014 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bad98f48-53db-4841-b50d-edf09d923282 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:21.222014 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bad98f48-53db-4841-b50d-edf09d923282 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:21.223091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bad98f48-53db-4841-b50d-edf09d923282 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:21.224119 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bad98f48-53db-4841-b50d-edf09d923282 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:21.224736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bad98f48-53db-4841-b50d-edf09d923282 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:21.327847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bad98f48-53db-4841-b50d-edf09d923282 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:21.336860 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bad98f48-53db-4841-b50d-edf09d923282 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1271 microversion: 2.1 time: 0.125367 May 21 21:12:21.337900 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 312/615] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:21 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1271 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:21.342793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bf86a5b9-8887-4b70-80ea-153ff3ac6c84 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:21.343284 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bf86a5b9-8887-4b70-80ea-153ff3ac6c84 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:21.410909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bf86a5b9-8887-4b70-80ea-153ff3ac6c84 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:21.419402 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bf86a5b9-8887-4b70-80ea-153ff3ac6c84 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1246 microversion: 2.1 time: 0.080181 May 21 21:12:21.420111 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 313/616] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:21 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1246 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:21.425679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-d4a44c14-e96c-4ba5-b4da-1e408695dbcb req-74954997-2ad1-4c55-b1c1-d7f7fdf1a62a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c92463-f5f1-4c2a-bcf0-573711f0c4f1", "tag": "d19d3553-91b7-47ed-96ea-0384ea855a46"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:21.435612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-d4a44c14-e96c-4ba5-b4da-1e408695dbcb req-74954997-2ad1-4c55-b1c1-d7f7fdf1a62a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:21.436189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-d4a44c14-e96c-4ba5-b4da-1e408695dbcb req-74954997-2ad1-4c55-b1c1-d7f7fdf1a62a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:21.447915 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-d4a44c14-e96c-4ba5-b4da-1e408695dbcb req-74954997-2ad1-4c55-b1c1-d7f7fdf1a62a service nova] Creating event network-changed:d19d3553-91b7-47ed-96ea-0384ea855a46 for instance 11c92463-f5f1-4c2a-bcf0-573711f0c4f1 on nch2-master-1 May 21 21:12:21.453457 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-d4a44c14-e96c-4ba5-b4da-1e408695dbcb req-74954997-2ad1-4c55-b1c1-d7f7fdf1a62a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032213 May 21 21:12:21.454504 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 314/617] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:21.459440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-78b68a09-29db-4434-b806-5140b086389e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:21.461091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-78b68a09-29db-4434-b806-5140b086389e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:21.467529 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78b68a09-29db-4434-b806-5140b086389e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:21.468085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78b68a09-29db-4434-b806-5140b086389e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:21.468986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78b68a09-29db-4434-b806-5140b086389e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:21.469552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78b68a09-29db-4434-b806-5140b086389e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:21.637406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-78b68a09-29db-4434-b806-5140b086389e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:21.647729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-78b68a09-29db-4434-b806-5140b086389e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:21.650276 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-78b68a09-29db-4434-b806-5140b086389e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:21.651420 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-78b68a09-29db-4434-b806-5140b086389e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.195984 May 21 21:12:21.652536 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 315/618] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:21 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:21.659787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ac5eddbe-77a5-461e-b048-81fc27eef17d tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:21.661682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ac5eddbe-77a5-461e-b048-81fc27eef17d tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:21.671020 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ac5eddbe-77a5-461e-b048-81fc27eef17d tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:21.671481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ac5eddbe-77a5-461e-b048-81fc27eef17d tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:21.672365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ac5eddbe-77a5-461e-b048-81fc27eef17d tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:21.673990 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ac5eddbe-77a5-461e-b048-81fc27eef17d tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:21.708646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-ac5eddbe-77a5-461e-b048-81fc27eef17d tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lazy-loading 'flavor' on Instance uuid 1886820b-3b3f-4ae7-94ea-4204d7cf8a60 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:21.715921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-dd076a9e-39e4-46b2-90c5-f3c38dd8260b tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Updating instance_info_cache with network_info: [{"id": "d19d3553-91b7-47ed-96ea-0384ea855a46", "address": "fa:16:3e:46:c1:29", "network": {"id": "99d05c9f-92b6-430b-8f33-3ae9f1f2ec0c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1022125987-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4c99e1f900034d42bbb1a786b225a230", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd19d3553-91", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131277) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 21 21:12:21.809204 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd076a9e-39e4-46b2-90c5-f3c38dd8260b tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Releasing lock "refresh_cache-11c92463-f5f1-4c2a-bcf0-573711f0c4f1" {{(pid=131277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 21 21:12:21.810299 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dd076a9e-39e4-46b2-90c5-f3c38dd8260b tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "POST /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1/action" status: 202 len: 0 microversion: 2.1 time: 4.323433 May 21 21:12:21.813997 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 304/619] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:12:17 2022] POST /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1/action => generated 0 bytes in 4325 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 21 21:12:21.819419 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-85f254ad-3123-4615-b3a4-28122e1a73d6 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:21.819926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-85f254ad-3123-4615-b3a4-28122e1a73d6 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:21.827255 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85f254ad-3123-4615-b3a4-28122e1a73d6 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:21.827723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85f254ad-3123-4615-b3a4-28122e1a73d6 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:21.828661 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85f254ad-3123-4615-b3a4-28122e1a73d6 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:21.829269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85f254ad-3123-4615-b3a4-28122e1a73d6 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:21.868823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-85f254ad-3123-4615-b3a4-28122e1a73d6 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:12:21.896417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:22.119151 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ac5eddbe-77a5-461e-b048-81fc27eef17d tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60/action" status: 202 len: 0 microversion: 2.1 time: 0.464612 May 21 21:12:22.122650 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 316/620] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:12:21 2022] POST /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:12:22.132880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c104f092-6113-4274-a0e9-1d1aaf47543f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:22.137760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c104f092-6113-4274-a0e9-1d1aaf47543f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:22.167030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:22.172638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c104f092-6113-4274-a0e9-1d1aaf47543f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:22.173009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c104f092-6113-4274-a0e9-1d1aaf47543f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:22.176901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c104f092-6113-4274-a0e9-1d1aaf47543f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:22.177436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c104f092-6113-4274-a0e9-1d1aaf47543f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:22.271863 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-85f254ad-3123-4615-b3a4-28122e1a73d6 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "DELETE /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 204 len: 0 microversion: 2.1 time: 0.456176 May 21 21:12:22.273458 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 305/621] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:12:21 2022] DELETE /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 21:12:22.286908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4e1b9e9b-fb89-4edb-9b15-31b9508ab956 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:22.289642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4e1b9e9b-fb89-4edb-9b15-31b9508ab956 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:22.313802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e1b9e9b-fb89-4edb-9b15-31b9508ab956 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:22.314263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e1b9e9b-fb89-4edb-9b15-31b9508ab956 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:22.315249 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e1b9e9b-fb89-4edb-9b15-31b9508ab956 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:22.315854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e1b9e9b-fb89-4edb-9b15-31b9508ab956 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:22.322289 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-c104f092-6113-4274-a0e9-1d1aaf47543f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:22.343542 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c104f092-6113-4274-a0e9-1d1aaf47543f tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1945 microversion: 2.75 time: 0.221845 May 21 21:12:22.345359 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 317/622] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:22 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1945 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:22.350371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0a010cf3-9d3c-4892-8df2-7a814cca5445 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:22.351222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0a010cf3-9d3c-4892-8df2-7a814cca5445 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:22.359666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a010cf3-9d3c-4892-8df2-7a814cca5445 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:22.361823 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a010cf3-9d3c-4892-8df2-7a814cca5445 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:22.361823 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a010cf3-9d3c-4892-8df2-7a814cca5445 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:22.361823 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a010cf3-9d3c-4892-8df2-7a814cca5445 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:22.526255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0a010cf3-9d3c-4892-8df2-7a814cca5445 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:22.541927 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0a010cf3-9d3c-4892-8df2-7a814cca5445 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1462 microversion: 2.1 time: 0.195328 May 21 21:12:22.547514 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 318/623] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:22 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1462 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:22.549325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7d99aaf0-18d1-4e8a-87ec-d2444f47261a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.186"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:22.550562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7d99aaf0-18d1-4e8a-87ec-d2444f47261a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:22.558224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7d99aaf0-18d1-4e8a-87ec-d2444f47261a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:22.559598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7d99aaf0-18d1-4e8a-87ec-d2444f47261a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:22.559857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7d99aaf0-18d1-4e8a-87ec-d2444f47261a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:22.560414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7d99aaf0-18d1-4e8a-87ec-d2444f47261a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:22.589006 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7d99aaf0-18d1-4e8a-87ec-d2444f47261a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Acquired lock "refresh_cache-c3935c27-84ef-41ff-adbf-9e4b29eea5d3" {{(pid=131278) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 21 21:12:22.804550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4e1b9e9b-fb89-4edb-9b15-31b9508ab956 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:22.812721 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4e1b9e9b-fb89-4edb-9b15-31b9508ab956 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 200 len: 1477 microversion: 2.1 time: 0.537857 May 21 21:12:22.815746 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 306/624] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:22 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 1477 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:22.820899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1e0c0ee5-0be1-4530-8251-4b9f8c2319ff tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:22.821777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1e0c0ee5-0be1-4530-8251-4b9f8c2319ff tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:22.828397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1e0c0ee5-0be1-4530-8251-4b9f8c2319ff tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:22.830644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1e0c0ee5-0be1-4530-8251-4b9f8c2319ff tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:22.831892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1e0c0ee5-0be1-4530-8251-4b9f8c2319ff tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:22.832601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1e0c0ee5-0be1-4530-8251-4b9f8c2319ff tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:22.910459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1e0c0ee5-0be1-4530-8251-4b9f8c2319ff tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:22.918022 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1e0c0ee5-0be1-4530-8251-4b9f8c2319ff tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1269 microversion: 2.1 time: 0.100995 May 21 21:12:22.918599 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 307/625] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:22 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1269 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:22.923654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d7a6ffa2-4b68-4cca-82bd-ef9b631ae2c5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:22.924323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d7a6ffa2-4b68-4cca-82bd-ef9b631ae2c5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:22.930360 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7a6ffa2-4b68-4cca-82bd-ef9b631ae2c5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:22.932151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7a6ffa2-4b68-4cca-82bd-ef9b631ae2c5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:22.932151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7a6ffa2-4b68-4cca-82bd-ef9b631ae2c5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:22.932151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7a6ffa2-4b68-4cca-82bd-ef9b631ae2c5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:23.004239 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d7a6ffa2-4b68-4cca-82bd-ef9b631ae2c5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:23.012757 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d7a6ffa2-4b68-4cca-82bd-ef9b631ae2c5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1242 microversion: 2.1 time: 0.093093 May 21 21:12:23.023048 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 308/626] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:22 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:23.023048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a8f4ce7c-7b91-4e56-b5ce-c6e6991156e6 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:23.023048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a8f4ce7c-7b91-4e56-b5ce-c6e6991156e6 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:23.028724 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8f4ce7c-7b91-4e56-b5ce-c6e6991156e6 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:23.029349 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8f4ce7c-7b91-4e56-b5ce-c6e6991156e6 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:23.030340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8f4ce7c-7b91-4e56-b5ce-c6e6991156e6 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:23.030839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8f4ce7c-7b91-4e56-b5ce-c6e6991156e6 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:23.394921 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a8f4ce7c-7b91-4e56-b5ce-c6e6991156e6 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1613 microversion: 2.1 time: 0.379929 May 21 21:12:23.395767 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 309/627] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:23 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1613 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:23.403073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f8b8c66e-eefa-4da1-bbe9-a3a0a0dd6d68 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:23.406162 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f8b8c66e-eefa-4da1-bbe9-a3a0a0dd6d68 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:23.421336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f8b8c66e-eefa-4da1-bbe9-a3a0a0dd6d68 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:23.421766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f8b8c66e-eefa-4da1-bbe9-a3a0a0dd6d68 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:23.423995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f8b8c66e-eefa-4da1-bbe9-a3a0a0dd6d68 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:23.424475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f8b8c66e-eefa-4da1-bbe9-a3a0a0dd6d68 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:23.988260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f8b8c66e-eefa-4da1-bbe9-a3a0a0dd6d68 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:23.992172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f8b8c66e-eefa-4da1-bbe9-a3a0a0dd6d68 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:23.994575 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f8b8c66e-eefa-4da1-bbe9-a3a0a0dd6d68 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:23.996136 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f8b8c66e-eefa-4da1-bbe9-a3a0a0dd6d68 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.599244 May 21 21:12:23.997005 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 310/628] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:23 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:24.025433 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-16708278-9025-4772-8e0a-3144ca0f34d2 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:24.026457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-16708278-9025-4772-8e0a-3144ca0f34d2 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:24.033630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-16708278-9025-4772-8e0a-3144ca0f34d2 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:24.034439 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-16708278-9025-4772-8e0a-3144ca0f34d2 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:24.035468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-16708278-9025-4772-8e0a-3144ca0f34d2 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:24.036129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-16708278-9025-4772-8e0a-3144ca0f34d2 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:24.219313 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-16708278-9025-4772-8e0a-3144ca0f34d2 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:24.253228 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-16708278-9025-4772-8e0a-3144ca0f34d2 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1933 microversion: 2.75 time: 0.254049 May 21 21:12:24.254596 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 311/629] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:23 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1933 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:24.265913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7ebf9cba-a193-4d76-9c29-c00da1b2df6d tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Calling method '.version_select at 0x7fc81b7505e0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:24.270306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ebf9cba-a193-4d76-9c29-c00da1b2df6d tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:24.271133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ebf9cba-a193-4d76-9c29-c00da1b2df6d tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:24.291826 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7ebf9cba-a193-4d76-9c29-c00da1b2df6d tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 1177 microversion: 2.1 time: 0.035617 May 21 21:12:24.293779 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 312/630] 10.222.0.49 () {58 vars in 1142 bytes} [Sat May 21 21:12:24 2022] GET /compute/v2.1/os-migrations => generated 1177 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:24.300009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-bc27198d-f547-4b3a-8b94-9cc7e8edf509 req-7700e3ce-875c-4ced-9697-a0dded7fc00b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d32d33-c3d7-4c41-a4cf-f804fac41120", "name": "network-vif-unplugged", "status": "completed", "tag": "2e166c5d-4aab-4618-98ae-7042d9891722"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:24.314400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-bc27198d-f547-4b3a-8b94-9cc7e8edf509 req-7700e3ce-875c-4ced-9697-a0dded7fc00b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:24.314844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-bc27198d-f547-4b3a-8b94-9cc7e8edf509 req-7700e3ce-875c-4ced-9697-a0dded7fc00b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:24.358043 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-bc27198d-f547-4b3a-8b94-9cc7e8edf509 req-7700e3ce-875c-4ced-9697-a0dded7fc00b service nova] Creating event network-vif-unplugged:2e166c5d-4aab-4618-98ae-7042d9891722 for instance 99d32d33-c3d7-4c41-a4cf-f804fac41120 on nch2-master-1 May 21 21:12:24.365006 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-bc27198d-f547-4b3a-8b94-9cc7e8edf509 req-7700e3ce-875c-4ced-9697-a0dded7fc00b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069625 May 21 21:12:24.366092 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 313/631] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:24.372732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-44a2d28e-67c8-4633-853e-28fa5faa3c42 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:24.373448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-44a2d28e-67c8-4633-853e-28fa5faa3c42 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:24.382154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44a2d28e-67c8-4633-853e-28fa5faa3c42 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:24.382609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44a2d28e-67c8-4633-853e-28fa5faa3c42 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:24.383392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44a2d28e-67c8-4633-853e-28fa5faa3c42 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:24.384036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44a2d28e-67c8-4633-853e-28fa5faa3c42 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:24.618456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-44a2d28e-67c8-4633-853e-28fa5faa3c42 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:24.622659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-7d99aaf0-18d1-4e8a-87ec-d2444f47261a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Building network info cache for instance {{(pid=131278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 21 21:12:24.629895 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-44a2d28e-67c8-4633-853e-28fa5faa3c42 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 200 len: 1460 microversion: 2.1 time: 0.261920 May 21 21:12:24.635313 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 314/632] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:24 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 1460 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:24.641983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6b4764d1-7563-4e72-9f34-6da7d92baf6f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:24.643349 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6b4764d1-7563-4e72-9f34-6da7d92baf6f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:24.649546 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6b4764d1-7563-4e72-9f34-6da7d92baf6f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:24.650002 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6b4764d1-7563-4e72-9f34-6da7d92baf6f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:24.650972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6b4764d1-7563-4e72-9f34-6da7d92baf6f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:24.651414 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6b4764d1-7563-4e72-9f34-6da7d92baf6f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:25.045568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6b4764d1-7563-4e72-9f34-6da7d92baf6f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:25.053464 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6b4764d1-7563-4e72-9f34-6da7d92baf6f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1311 microversion: 2.1 time: 0.421854 May 21 21:12:25.062978 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 315/633] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:24 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1311 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:25.069184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ba2ba77e-0920-4123-95c0-a4ce60bcbb7d tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:25.069808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ba2ba77e-0920-4123-95c0-a4ce60bcbb7d tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:25.076026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba2ba77e-0920-4123-95c0-a4ce60bcbb7d tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:25.076527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba2ba77e-0920-4123-95c0-a4ce60bcbb7d tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:25.077319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba2ba77e-0920-4123-95c0-a4ce60bcbb7d tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:25.079237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba2ba77e-0920-4123-95c0-a4ce60bcbb7d tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:25.206410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ba2ba77e-0920-4123-95c0-a4ce60bcbb7d tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:25.213237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:25.220221 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ba2ba77e-0920-4123-95c0-a4ce60bcbb7d tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1316 microversion: 2.1 time: 0.152376 May 21 21:12:25.220221 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 316/634] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:25 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:25.225965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4c998f61-1096-4a19-b7c1-7aa4140c3a77 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1533423654", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:25.325154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-4c998f61-1096-4a19-b7c1-7aa4140c3a77 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] validate_networks() for None {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:12:25.705329 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-7d99aaf0-18d1-4e8a-87ec-d2444f47261a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Updating instance_info_cache with network_info: [{"id": "a3199f1f-7536-444f-ab94-2847aeee7a78", "address": "fa:16:3e:5f:80:d1", "network": {"id": "99d05c9f-92b6-430b-8f33-3ae9f1f2ec0c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1022125987-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4c99e1f900034d42bbb1a786b225a230", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa3199f1f-75", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 21 21:12:25.817322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7d99aaf0-18d1-4e8a-87ec-d2444f47261a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Releasing lock "refresh_cache-c3935c27-84ef-41ff-adbf-9e4b29eea5d3" {{(pid=131278) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 21 21:12:25.831507 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7d99aaf0-18d1-4e8a-87ec-d2444f47261a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "POST /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3/action" status: 202 len: 0 microversion: 2.1 time: 3.284782 May 21 21:12:25.835508 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 319/635] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:12:22 2022] POST /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3/action => generated 0 bytes in 3290 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 21 21:12:25.870336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-f5bb36f6-b7ad-461d-b761-a9ff900cc285 req-996379c7-cdd3-4dcb-a408-d97210a89aae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3935c27-84ef-41ff-adbf-9e4b29eea5d3", "tag": "a3199f1f-7536-444f-ab94-2847aeee7a78"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:25.896066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f5bb36f6-b7ad-461d-b761-a9ff900cc285 req-996379c7-cdd3-4dcb-a408-d97210a89aae service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:25.902667 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f5bb36f6-b7ad-461d-b761-a9ff900cc285 req-996379c7-cdd3-4dcb-a408-d97210a89aae service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:25.933200 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-f5bb36f6-b7ad-461d-b761-a9ff900cc285 req-996379c7-cdd3-4dcb-a408-d97210a89aae service nova] Creating event network-changed:a3199f1f-7536-444f-ab94-2847aeee7a78 for instance c3935c27-84ef-41ff-adbf-9e4b29eea5d3 on nch2-master-1 May 21 21:12:25.950164 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-f5bb36f6-b7ad-461d-b761-a9ff900cc285 req-996379c7-cdd3-4dcb-a408-d97210a89aae service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112201 May 21 21:12:25.950739 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 320/636] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:25.959523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cb9b49a1-ac7a-4cc3-91e3-1991ee212017 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:25.969391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cb9b49a1-ac7a-4cc3-91e3-1991ee212017 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:25.976140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb9b49a1-ac7a-4cc3-91e3-1991ee212017 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:25.980880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb9b49a1-ac7a-4cc3-91e3-1991ee212017 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:25.981921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb9b49a1-ac7a-4cc3-91e3-1991ee212017 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:25.982541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb9b49a1-ac7a-4cc3-91e3-1991ee212017 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:26.091152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-4c998f61-1096-4a19-b7c1-7aa4140c3a77 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:12:26.092192 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-4c998f61-1096-4a19-b7c1-7aa4140c3a77 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:12:26.092866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-4c998f61-1096-4a19-b7c1-7aa4140c3a77 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:12:26.093486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-4c998f61-1096-4a19-b7c1-7aa4140c3a77 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:12:26.094083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-4c998f61-1096-4a19-b7c1-7aa4140c3a77 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:12:26.115273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4c998f61-1096-4a19-b7c1-7aa4140c3a77 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:26.116062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4c998f61-1096-4a19-b7c1-7aa4140c3a77 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:26.117152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4c998f61-1096-4a19-b7c1-7aa4140c3a77 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:26.117781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4c998f61-1096-4a19-b7c1-7aa4140c3a77 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:26.173152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-4c998f61-1096-4a19-b7c1-7aa4140c3a77 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Getting quotas for project 3cdfab8428a54520a01fdde7222835be. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:12:26.184223 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-4c998f61-1096-4a19-b7c1-7aa4140c3a77 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Getting quotas for user c3d9543f794d40be9c24715bf530add3 and project 3cdfab8428a54520a01fdde7222835be. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:12:26.207059 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4c998f61-1096-4a19-b7c1-7aa4140c3a77 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:12:26.221798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4c998f61-1096-4a19-b7c1-7aa4140c3a77 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:12:26.459659 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4c998f61-1096-4a19-b7c1-7aa4140c3a77 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.238006 May 21 21:12:26.464299 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 317/637] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:12:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:12:26.477788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c9968cc3-a2a1-4374-a8ec-671c9a21a321 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:26.479342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c9968cc3-a2a1-4374-a8ec-671c9a21a321 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:26.496511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c9968cc3-a2a1-4374-a8ec-671c9a21a321 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:26.497268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c9968cc3-a2a1-4374-a8ec-671c9a21a321 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:26.499303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c9968cc3-a2a1-4374-a8ec-671c9a21a321 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:26.500124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c9968cc3-a2a1-4374-a8ec-671c9a21a321 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:26.898465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c9968cc3-a2a1-4374-a8ec-671c9a21a321 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:26.904537 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c9968cc3-a2a1-4374-a8ec-671c9a21a321 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:26.906054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c9968cc3-a2a1-4374-a8ec-671c9a21a321 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:26.907274 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c9968cc3-a2a1-4374-a8ec-671c9a21a321 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.444911 May 21 21:12:26.920882 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 318/638] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:26 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:26.929812 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6bae3329-506f-46f5-bdb3-f750fab98cc1 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:26.932137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6bae3329-506f-46f5-bdb3-f750fab98cc1 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:26.933865 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cb9b49a1-ac7a-4cc3-91e3-1991ee212017 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 200 len: 1611 microversion: 2.1 time: 0.981613 May 21 21:12:26.945461 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 321/639] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:25 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 1611 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:26.948274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6bae3329-506f-46f5-bdb3-f750fab98cc1 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:26.955694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6bae3329-506f-46f5-bdb3-f750fab98cc1 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:26.955694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6bae3329-506f-46f5-bdb3-f750fab98cc1 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:26.961836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6bae3329-506f-46f5-bdb3-f750fab98cc1 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:26.964961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4f306f05-c11d-45e2-9026-02667a51a9c2 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '.version_select at 0x7fc81b883c10>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:27.101715 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-6bae3329-506f-46f5-bdb3-f750fab98cc1 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] Lazy-loading 'services' on Instance uuid bee17f35-3db6-4dbd-99d8-f5f87788e35a {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:27.147827 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6bae3329-506f-46f5-bdb3-f750fab98cc1 tempest-ServersAdmin275Test-1123777510 tempest-ServersAdmin275Test-1123777510-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1918 microversion: 2.75 time: 0.225189 May 21 21:12:27.167172 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 319/640] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:26 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1918 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:27.181674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-90342928-f690-4933-b133-ad6f4de040d1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:27.182601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-90342928-f690-4933-b133-ad6f4de040d1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:27.196169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90342928-f690-4933-b133-ad6f4de040d1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:27.197246 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90342928-f690-4933-b133-ad6f4de040d1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:27.198585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90342928-f690-4933-b133-ad6f4de040d1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:27.199540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90342928-f690-4933-b133-ad6f4de040d1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:27.339162 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4f306f05-c11d-45e2-9026-02667a51a9c2 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips/de4d9298-b7b4-401b-9695-1a73f582ae1e" status: 200 len: 185 microversion: 2.1 time: 0.392190 May 21 21:12:27.339766 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 322/641] 10.222.0.49 () {58 vars in 1259 bytes} [Sat May 21 21:12:26 2022] GET /compute/v2.1/os-floating-ips/de4d9298-b7b4-401b-9695-1a73f582ae1e => generated 185 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:27.346189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6b064049-8349-4a95-ae06-24b49f1dee2d tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:27.348511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6b064049-8349-4a95-ae06-24b49f1dee2d tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:27.354555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b064049-8349-4a95-ae06-24b49f1dee2d tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:27.355152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b064049-8349-4a95-ae06-24b49f1dee2d tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:27.356109 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b064049-8349-4a95-ae06-24b49f1dee2d tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:27.356566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b064049-8349-4a95-ae06-24b49f1dee2d tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:27.482300 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-90342928-f690-4933-b133-ad6f4de040d1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:27.502255 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-90342928-f690-4933-b133-ad6f4de040d1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1311 microversion: 2.1 time: 0.333491 May 21 21:12:27.503567 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 320/642] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:27 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1311 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:27.508530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3e84510d-8ba6-4c05-aec3-23dce6803483 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:27.509480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3e84510d-8ba6-4c05-aec3-23dce6803483 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:27.607805 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3e84510d-8ba6-4c05-aec3-23dce6803483 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:27.616400 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3e84510d-8ba6-4c05-aec3-23dce6803483 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1213 microversion: 2.1 time: 0.111595 May 21 21:12:27.617001 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6b064049-8349-4a95-ae06-24b49f1dee2d tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:27.618411 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 321/643] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:27 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1213 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:27.627625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-3d8cf83f-8a6f-4ea7-b46f-3fc2a677a887 req-5e353759-d637-449e-ab42-59e7b5a0103d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d32d33-c3d7-4c41-a4cf-f804fac41120", "tag": "2e166c5d-4aab-4618-98ae-7042d9891722"}, {"name": "network-changed", "server_uuid": "d1861c5f-d59a-4d75-9849-ecd40aeb32fe", "tag": "f0278179-1509-4b53-9291-18dd7c351135"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:27.630177 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6b064049-8349-4a95-ae06-24b49f1dee2d tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1371 microversion: 2.1 time: 0.289263 May 21 21:12:27.636968 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 323/644] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:27 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1371 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:27.646601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a2724c5b-1ee1-4bed-9c75-b058f73f5392 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:27.648019 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:12:27.648019 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:12:27.649642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-3d8cf83f-8a6f-4ea7-b46f-3fc2a677a887 req-5e353759-d637-449e-ab42-59e7b5a0103d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:27.650167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-3d8cf83f-8a6f-4ea7-b46f-3fc2a677a887 req-5e353759-d637-449e-ab42-59e7b5a0103d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:27.661069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2724c5b-1ee1-4bed-9c75-b058f73f5392 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:27.674518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2724c5b-1ee1-4bed-9c75-b058f73f5392 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:27.674518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2724c5b-1ee1-4bed-9c75-b058f73f5392 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:27.674518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2724c5b-1ee1-4bed-9c75-b058f73f5392 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:27.678053 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-3d8cf83f-8a6f-4ea7-b46f-3fc2a677a887 req-5e353759-d637-449e-ab42-59e7b5a0103d service nova] Creating event network-changed:2e166c5d-4aab-4618-98ae-7042d9891722 for instance 99d32d33-c3d7-4c41-a4cf-f804fac41120 on nch2-master-1 May 21 21:12:27.678568 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-3d8cf83f-8a6f-4ea7-b46f-3fc2a677a887 req-5e353759-d637-449e-ab42-59e7b5a0103d service nova] Creating event network-changed:f0278179-1509-4b53-9291-18dd7c351135 for instance d1861c5f-d59a-4d75-9849-ecd40aeb32fe on nch2-master-1 May 21 21:12:27.693954 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-3d8cf83f-8a6f-4ea7-b46f-3fc2a677a887 req-5e353759-d637-449e-ab42-59e7b5a0103d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.070159 May 21 21:12:27.696632 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 322/645] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:27.704412 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a2724c5b-1ee1-4bed-9c75-b058f73f5392 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.066136 May 21 21:12:27.706803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d7588284-1ecc-4573-96b4-7b9b5104397c tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:27.708246 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d7588284-1ecc-4573-96b4-7b9b5104397c tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:27.708835 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 324/646] 10.222.0.49 () {58 vars in 1175 bytes} [Sat May 21 21:12:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:27.716750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3bcf2f55-334f-4493-b21c-cde3cdb76263 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Action: 'action', calling method: .version_select at 0x7fc82a0c2b80>, body: {"removeFloatingIp": {"address": "172.35.0.186"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:27.741019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7588284-1ecc-4573-96b4-7b9b5104397c tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:27.742000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7588284-1ecc-4573-96b4-7b9b5104397c tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:27.745303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7588284-1ecc-4573-96b4-7b9b5104397c tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:27.747173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7588284-1ecc-4573-96b4-7b9b5104397c tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:27.795471 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d7588284-1ecc-4573-96b4-7b9b5104397c tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:12:27.988079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3bcf2f55-334f-4493-b21c-cde3cdb76263 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:27.996161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3bcf2f55-334f-4493-b21c-cde3cdb76263 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:27.996960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3bcf2f55-334f-4493-b21c-cde3cdb76263 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:27.997914 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3bcf2f55-334f-4493-b21c-cde3cdb76263 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:28.004693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3bcf2f55-334f-4493-b21c-cde3cdb76263 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:28.121132 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d7588284-1ecc-4573-96b4-7b9b5104397c tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 204 len: 0 microversion: 2.75 time: 0.421079 May 21 21:12:28.125368 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 323/647] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:12:27 2022] DELETE /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:12:28.132736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8177beea-d10c-4f5f-a7eb-17d072149fe9 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:28.135531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8177beea-d10c-4f5f-a7eb-17d072149fe9 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:28.150827 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8177beea-d10c-4f5f-a7eb-17d072149fe9 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:28.153389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8177beea-d10c-4f5f-a7eb-17d072149fe9 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:28.158653 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8177beea-d10c-4f5f-a7eb-17d072149fe9 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:28.163937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8177beea-d10c-4f5f-a7eb-17d072149fe9 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:28.223809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-8177beea-d10c-4f5f-a7eb-17d072149fe9 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Lazy-loading 'flavor' on Instance uuid 1886820b-3b3f-4ae7-94ea-4204d7cf8a60 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:28.237382 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-8177beea-d10c-4f5f-a7eb-17d072149fe9 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 1886820b-3b3f-4ae7-94ea-4204d7cf8a60 while it is in vm_state suspended May 21 21:12:28.239235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8177beea-d10c-4f5f-a7eb-17d072149fe9 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Request method failure captured: May 21 21:12:28.239235 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60/action HTTP/1.1 May 21 21:12:28.239235 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:12:28.239235 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:12:28.239235 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:12:28.239235 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 97 May 21 21:12:28.239235 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:12:28.239235 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:12:28.239235 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:12:28.239235 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:12:28.239235 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVV96LNZ9mBuXz6RRIKr3ItwNEsqpnDJkYxzM98aKlnKgHiKb8Z5vNs3UhI-IC9qZBG7KdkzreuPqta5tEvcZqiETF_1mIBViD-VFCFAoeQa6iTbtlA-cFSWIi0ckSsTFsw4lmlyohC_rDZaRJVQxKs6Gty5GdhL9WJOTThyjvmBMoY May 21 21:12:28.239235 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:12:28.239235 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:12:28.239235 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:12:28.239235 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:12:28.239235 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:12:28.239235 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:12:28.239235 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 979278445a524a83ac4c9f9074432721 May 21 21:12:28.239235 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-LiveMigrationNegativeTest-348843391 May 21 21:12:28.239235 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:12:28.239235 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:12:28.241238 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/979278445a524a83ac4c9f9074432721"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/979278445a524a83ac4c9f9074432721"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_979278445a524a83ac4c9f9074432721", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/979278445a524a83ac4c9f9074432721"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:12:28.241238 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-LiveMigrationNegativeTest-348843391 May 21 21:12:28.241238 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 979278445a524a83ac4c9f9074432721 May 21 21:12:28.241238 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-348843391 May 21 21:12:28.241238 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-LiveMigrationNegativeTest-348843391-project-admin May 21 21:12:28.241238 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:12:28.241238 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:12:28.241238 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 3e446128ecf740ce89d8355ef358a655 May 21 21:12:28.241238 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-LiveMigrationNegativeTest-348843391-project-admin May 21 21:12:28.241238 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:12:28.241238 ncdv-master-1 devstack@n-api.service[131277]: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} May 21 21:12:28.241238 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:12:28.242205 ncdv-master-1 devstack@n-api.service[131277]: exception: Cannot 'os-migrateLive' instance 1886820b-3b3f-4ae7-94ea-4204d7cf8a60 while it is in vm_state suspended May 21 21:12:28.242205 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '1886820b-3b3f-4ae7-94ea-4204d7cf8a60', 'body': {'os-migrateLive': {'host': 'nch2-master-1', 'block_migration': True, 'disk_over_commit': False}}} May 21 21:12:28.242205 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:12:28.242205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:28.242205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live May 21 21:12:28.242205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, May 21 21:12:28.242205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 21 21:12:28.242205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:12:28.242205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 21 21:12:28.242205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 21 21:12:28.242205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 21 21:12:28.242205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 21:12:28.242205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 21 21:12:28.242205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 21 21:12:28.242205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 21 21:12:28.242205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 21:12:28.242205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 21 21:12:28.242205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 21:12:28.243484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 21 21:12:28.243484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:12:28.243484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 21 21:12:28.243484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 21 21:12:28.243484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1886820b-3b3f-4ae7-94ea-4204d7cf8a60 in vm_state suspended. Cannot live_migrate while the instance is in this state. May 21 21:12:28.243484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:12:28.243484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:28.243484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:12:28.243484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:28.243484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:28.243484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:28.243484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:12:28.243484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:12:28.243484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:12:28.243484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:12:28.243484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:12:28.243484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:12:28.243484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:12:28.243484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:12:28.243484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:12:28.246087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:12:28.246087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 21 21:12:28.246087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live May 21 21:12:28.246087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 21 21:12:28.246087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 21 21:12:28.246087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 21 21:12:28.246087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 1886820b-3b3f-4ae7-94ea-4204d7cf8a60 while it is in vm_state suspended May 21 21:12:28.246087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:12:28.246087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:28.246087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:12:28.246087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:28.246087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:28.246087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:28.246087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:12:28.246087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:12:28.246087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 1886820b-3b3f-4ae7-94ea-4204d7cf8a60 while it is in vm_state suspended May 21 21:12:28.246087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:12:28.247240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8177beea-d10c-4f5f-a7eb-17d072149fe9 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 1886820b-3b3f-4ae7-94ea-4204d7cf8a60 while it is in vm_state suspended {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:12:28.247240 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8177beea-d10c-4f5f-a7eb-17d072149fe9 tempest-LiveMigrationNegativeTest-348843391 tempest-LiveMigrationNegativeTest-348843391-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60/action" status: 409 len: 155 microversion: 2.1 time: 0.112564 May 21 21:12:28.263656 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 324/648] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:12:28 2022] POST /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60/action => generated 155 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 21 21:12:28.263656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-989a4b7c-328c-4cf7-9dc5-fa79edbeb468 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:28.263656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-989a4b7c-328c-4cf7-9dc5-fa79edbeb468 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:28.280685 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-989a4b7c-328c-4cf7-9dc5-fa79edbeb468 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:28.282474 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-989a4b7c-328c-4cf7-9dc5-fa79edbeb468 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:28.284415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-989a4b7c-328c-4cf7-9dc5-fa79edbeb468 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:28.287894 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-989a4b7c-328c-4cf7-9dc5-fa79edbeb468 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:28.403984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3bcf2f55-334f-4493-b21c-cde3cdb76263 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Acquired lock "refresh_cache-c3935c27-84ef-41ff-adbf-9e4b29eea5d3" {{(pid=131278) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 21 21:12:28.532518 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-989a4b7c-328c-4cf7-9dc5-fa79edbeb468 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:28.541128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-989a4b7c-328c-4cf7-9dc5-fa79edbeb468 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:28.542634 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-989a4b7c-328c-4cf7-9dc5-fa79edbeb468 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:28.543802 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-989a4b7c-328c-4cf7-9dc5-fa79edbeb468 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.287190 May 21 21:12:28.544384 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 325/649] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:28 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:28.552181 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-d7b56836-2c08-41ad-a757-82dc68d76385 req-337b3c27-a874-469d-ae92-aba6e141aed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c92463-f5f1-4c2a-bcf0-573711f0c4f1", "name": "network-vif-deleted", "tag": "d19d3553-91b7-47ed-96ea-0384ea855a46"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:28.560390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d7b56836-2c08-41ad-a757-82dc68d76385 req-337b3c27-a874-469d-ae92-aba6e141aed5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:28.560842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d7b56836-2c08-41ad-a757-82dc68d76385 req-337b3c27-a874-469d-ae92-aba6e141aed5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:28.573114 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-d7b56836-2c08-41ad-a757-82dc68d76385 req-337b3c27-a874-469d-ae92-aba6e141aed5 service nova] Creating event network-vif-deleted:d19d3553-91b7-47ed-96ea-0384ea855a46 for instance 11c92463-f5f1-4c2a-bcf0-573711f0c4f1 on nch2-master-1 May 21 21:12:28.578464 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-d7b56836-2c08-41ad-a757-82dc68d76385 req-337b3c27-a874-469d-ae92-aba6e141aed5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032625 May 21 21:12:28.579742 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 326/650] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:28.584941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-393a6dac-58ff-4603-870d-9a2fc545fd5a tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:28.585638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-393a6dac-58ff-4603-870d-9a2fc545fd5a tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:28.591772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-393a6dac-58ff-4603-870d-9a2fc545fd5a tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:28.592227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-393a6dac-58ff-4603-870d-9a2fc545fd5a tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:28.593074 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-393a6dac-58ff-4603-870d-9a2fc545fd5a tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:28.593515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-393a6dac-58ff-4603-870d-9a2fc545fd5a tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:28.667880 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-393a6dac-58ff-4603-870d-9a2fc545fd5a tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:28.677276 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-393a6dac-58ff-4603-870d-9a2fc545fd5a tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:28.679149 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-393a6dac-58ff-4603-870d-9a2fc545fd5a tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:28.685564 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-393a6dac-58ff-4603-870d-9a2fc545fd5a tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1443 microversion: 2.75 time: 0.104673 May 21 21:12:28.686141 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 327/651] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:28 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1443 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:28.693340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f288629a-ec40-4f3c-b6c8-3b4cc1d6d338 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:28.694261 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f288629a-ec40-4f3c-b6c8-3b4cc1d6d338 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:28.708325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f288629a-ec40-4f3c-b6c8-3b4cc1d6d338 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:28.711425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f288629a-ec40-4f3c-b6c8-3b4cc1d6d338 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:28.711425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f288629a-ec40-4f3c-b6c8-3b4cc1d6d338 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:28.712209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f288629a-ec40-4f3c-b6c8-3b4cc1d6d338 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:28.762533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f288629a-ec40-4f3c-b6c8-3b4cc1d6d338 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:12:29.051881 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f288629a-ec40-4f3c-b6c8-3b4cc1d6d338 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 204 len: 0 microversion: 2.1 time: 0.364383 May 21 21:12:29.052426 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 328/652] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:12:28 2022] DELETE /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:12:29.057608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-19f0969d-828a-4dee-894b-481b2f344117 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:29.058313 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-19f0969d-828a-4dee-894b-481b2f344117 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:29.065097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19f0969d-828a-4dee-894b-481b2f344117 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:29.065555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19f0969d-828a-4dee-894b-481b2f344117 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:29.066333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19f0969d-828a-4dee-894b-481b2f344117 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:29.066774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19f0969d-828a-4dee-894b-481b2f344117 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:29.238596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-19f0969d-828a-4dee-894b-481b2f344117 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:29.246612 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-19f0969d-828a-4dee-894b-481b2f344117 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1311 microversion: 2.1 time: 0.192996 May 21 21:12:29.247536 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 329/653] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:29 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1311 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:29.253120 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cbf83338-d467-4c96-a40a-e3c6bff0f89b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:29.253730 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cbf83338-d467-4c96-a40a-e3c6bff0f89b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:29.261614 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cbf83338-d467-4c96-a40a-e3c6bff0f89b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:29.262203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cbf83338-d467-4c96-a40a-e3c6bff0f89b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:29.263095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cbf83338-d467-4c96-a40a-e3c6bff0f89b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:29.263543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cbf83338-d467-4c96-a40a-e3c6bff0f89b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:29.352701 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cbf83338-d467-4c96-a40a-e3c6bff0f89b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:29.354082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-3bcf2f55-334f-4493-b21c-cde3cdb76263 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Building network info cache for instance {{(pid=131278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 21 21:12:29.362886 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cbf83338-d467-4c96-a40a-e3c6bff0f89b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1217 microversion: 2.1 time: 0.114476 May 21 21:12:29.372731 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 330/654] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:29 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1217 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:29.390400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0149e7cc-5b9d-4cde-907e-318cc9c83960 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:29.391614 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0149e7cc-5b9d-4cde-907e-318cc9c83960 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:29.401378 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0149e7cc-5b9d-4cde-907e-318cc9c83960 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:29.401826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0149e7cc-5b9d-4cde-907e-318cc9c83960 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:29.402748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0149e7cc-5b9d-4cde-907e-318cc9c83960 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:29.403180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0149e7cc-5b9d-4cde-907e-318cc9c83960 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:29.577232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0149e7cc-5b9d-4cde-907e-318cc9c83960 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:29.587823 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0149e7cc-5b9d-4cde-907e-318cc9c83960 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1371 microversion: 2.1 time: 0.213825 May 21 21:12:29.589170 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 331/655] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:29 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:29.595161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-245562c8-5d46-4e31-90ee-5a5b8f437f05 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:29.596172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-245562c8-5d46-4e31-90ee-5a5b8f437f05 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:29.603156 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-245562c8-5d46-4e31-90ee-5a5b8f437f05 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:29.603608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-245562c8-5d46-4e31-90ee-5a5b8f437f05 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:29.604435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-245562c8-5d46-4e31-90ee-5a5b8f437f05 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:29.604879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-245562c8-5d46-4e31-90ee-5a5b8f437f05 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:29.771266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-245562c8-5d46-4e31-90ee-5a5b8f437f05 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:29.777816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:29.780644 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-245562c8-5d46-4e31-90ee-5a5b8f437f05 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 200 len: 1466 microversion: 2.1 time: 0.190319 May 21 21:12:29.783517 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 332/656] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:29 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 1466 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:29.788447 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-da6cc81b-e328-4e51-84e6-bff693e4e12c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:29.789023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-da6cc81b-e328-4e51-84e6-bff693e4e12c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:29.796654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da6cc81b-e328-4e51-84e6-bff693e4e12c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:29.797129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da6cc81b-e328-4e51-84e6-bff693e4e12c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:29.798148 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da6cc81b-e328-4e51-84e6-bff693e4e12c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:29.798702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da6cc81b-e328-4e51-84e6-bff693e4e12c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:30.081983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-da6cc81b-e328-4e51-84e6-bff693e4e12c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:30.086416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-3bcf2f55-334f-4493-b21c-cde3cdb76263 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Updating instance_info_cache with network_info: [{"id": "a3199f1f-7536-444f-ab94-2847aeee7a78", "address": "fa:16:3e:5f:80:d1", "network": {"id": "99d05c9f-92b6-430b-8f33-3ae9f1f2ec0c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1022125987-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4c99e1f900034d42bbb1a786b225a230", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa3199f1f-75", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 21 21:12:30.106080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-da6cc81b-e328-4e51-84e6-bff693e4e12c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:30.109216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-da6cc81b-e328-4e51-84e6-bff693e4e12c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:30.122890 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-da6cc81b-e328-4e51-84e6-bff693e4e12c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.326051 May 21 21:12:30.122890 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 333/657] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:29 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:30.128517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fb041bba-d084-496f-97fe-60a8ed093cb7 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:30.129075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fb041bba-d084-496f-97fe-60a8ed093cb7 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:30.135502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb041bba-d084-496f-97fe-60a8ed093cb7 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:30.135960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb041bba-d084-496f-97fe-60a8ed093cb7 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:30.136772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb041bba-d084-496f-97fe-60a8ed093cb7 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:30.137220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb041bba-d084-496f-97fe-60a8ed093cb7 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:30.191414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3bcf2f55-334f-4493-b21c-cde3cdb76263 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Releasing lock "refresh_cache-c3935c27-84ef-41ff-adbf-9e4b29eea5d3" {{(pid=131278) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 21 21:12:30.192322 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3bcf2f55-334f-4493-b21c-cde3cdb76263 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "POST /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3/action" status: 202 len: 0 microversion: 2.1 time: 2.482293 May 21 21:12:30.192955 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 325/658] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:12:27 2022] POST /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3/action => generated 0 bytes in 2484 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 21 21:12:30.206037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-876c5d75-c238-4e51-8b17-2bf8fe318e91 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:30.207579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-876c5d75-c238-4e51-8b17-2bf8fe318e91 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:30.216814 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-876c5d75-c238-4e51-8b17-2bf8fe318e91 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:30.217631 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-876c5d75-c238-4e51-8b17-2bf8fe318e91 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:30.218726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-876c5d75-c238-4e51-8b17-2bf8fe318e91 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:30.219924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-876c5d75-c238-4e51-8b17-2bf8fe318e91 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:30.235550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fb041bba-d084-496f-97fe-60a8ed093cb7 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:30.248782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fb041bba-d084-496f-97fe-60a8ed093cb7 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:30.250464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fb041bba-d084-496f-97fe-60a8ed093cb7 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:30.253330 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-876c5d75-c238-4e51-8b17-2bf8fe318e91 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:12:30.273488 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fb041bba-d084-496f-97fe-60a8ed093cb7 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1443 microversion: 2.75 time: 0.161214 May 21 21:12:30.286037 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 334/659] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:30 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1443 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:30.291261 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7b252061-28f8-41eb-a612-03da7b0560a0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:30.291902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7b252061-28f8-41eb-a612-03da7b0560a0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:30.299110 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7b252061-28f8-41eb-a612-03da7b0560a0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:30.299579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7b252061-28f8-41eb-a612-03da7b0560a0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:30.300407 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7b252061-28f8-41eb-a612-03da7b0560a0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:30.300854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7b252061-28f8-41eb-a612-03da7b0560a0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:30.481365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7b252061-28f8-41eb-a612-03da7b0560a0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:30.505232 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7b252061-28f8-41eb-a612-03da7b0560a0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1311 microversion: 2.1 time: 0.218145 May 21 21:12:30.506134 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 335/660] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:30 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1311 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:30.517046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6df0f2af-07be-4583-8296-5c0b4ccf3555 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:30.518014 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6df0f2af-07be-4583-8296-5c0b4ccf3555 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:30.521200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:30.522069 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-876c5d75-c238-4e51-8b17-2bf8fe318e91 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "DELETE /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 204 len: 0 microversion: 2.1 time: 0.321653 May 21 21:12:30.523622 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 326/661] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:12:30 2022] DELETE /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:12:30.528482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6df0f2af-07be-4583-8296-5c0b4ccf3555 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:30.529306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6df0f2af-07be-4583-8296-5c0b4ccf3555 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:30.530548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6df0f2af-07be-4583-8296-5c0b4ccf3555 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:30.531111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6df0f2af-07be-4583-8296-5c0b4ccf3555 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:30.557275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dd490201-a872-41ae-b161-3586915180e8 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:30.558319 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dd490201-a872-41ae-b161-3586915180e8 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:30.565698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd490201-a872-41ae-b161-3586915180e8 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:30.566391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd490201-a872-41ae-b161-3586915180e8 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:30.567433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd490201-a872-41ae-b161-3586915180e8 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:30.568039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd490201-a872-41ae-b161-3586915180e8 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:30.606903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd490201-a872-41ae-b161-3586915180e8 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:30.607618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd490201-a872-41ae-b161-3586915180e8 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:30.608242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-dd490201-a872-41ae-b161-3586915180e8 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lazy-loading 'fault' on Instance uuid 11c92463-f5f1-4c2a-bcf0-573711f0c4f1 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:30.655388 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6df0f2af-07be-4583-8296-5c0b4ccf3555 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:30.662950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dd490201-a872-41ae-b161-3586915180e8 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:30.671129 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dd490201-a872-41ae-b161-3586915180e8 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1320 microversion: 2.1 time: 0.136435 May 21 21:12:30.681201 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 327/662] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:30 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1320 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:30.681350 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6df0f2af-07be-4583-8296-5c0b4ccf3555 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1217 microversion: 2.1 time: 0.165709 May 21 21:12:30.681451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-cce883e0-66ff-4d75-a67d-1bae58b77600 req-2498ccb9-e792-4572-9286-a9bbfd4c364d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3935c27-84ef-41ff-adbf-9e4b29eea5d3", "tag": "a3199f1f-7536-444f-ab94-2847aeee7a78"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:30.690211 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 336/663] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:30 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1217 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:30.698362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-cce883e0-66ff-4d75-a67d-1bae58b77600 req-2498ccb9-e792-4572-9286-a9bbfd4c364d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:30.698899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-cce883e0-66ff-4d75-a67d-1bae58b77600 req-2498ccb9-e792-4572-9286-a9bbfd4c364d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:30.700221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f4355735-eb78-4895-9bc4-0d537f5d6cc3 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:30.701340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f4355735-eb78-4895-9bc4-0d537f5d6cc3 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:30.718109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4355735-eb78-4895-9bc4-0d537f5d6cc3 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:30.718670 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4355735-eb78-4895-9bc4-0d537f5d6cc3 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:30.719638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4355735-eb78-4895-9bc4-0d537f5d6cc3 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:30.733213 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-cce883e0-66ff-4d75-a67d-1bae58b77600 req-2498ccb9-e792-4572-9286-a9bbfd4c364d service nova] Creating event network-changed:a3199f1f-7536-444f-ab94-2847aeee7a78 for instance c3935c27-84ef-41ff-adbf-9e4b29eea5d3 on nch2-master-1 May 21 21:12:30.744447 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4355735-eb78-4895-9bc4-0d537f5d6cc3 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:30.747419 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-cce883e0-66ff-4d75-a67d-1bae58b77600 req-2498ccb9-e792-4572-9286-a9bbfd4c364d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074165 May 21 21:12:30.748043 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 328/664] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:30.801401 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8143ab2b-734c-4893-94b5-24e43a8b5c49 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:30.803662 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8143ab2b-734c-4893-94b5-24e43a8b5c49 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:30.812536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8143ab2b-734c-4893-94b5-24e43a8b5c49 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:30.814762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8143ab2b-734c-4893-94b5-24e43a8b5c49 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:30.816119 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8143ab2b-734c-4893-94b5-24e43a8b5c49 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:30.817009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8143ab2b-734c-4893-94b5-24e43a8b5c49 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:30.933006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f4355735-eb78-4895-9bc4-0d537f5d6cc3 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:30.943623 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f4355735-eb78-4895-9bc4-0d537f5d6cc3 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1371 microversion: 2.1 time: 0.249124 May 21 21:12:30.949069 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 337/665] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:30 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:31.020998 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8143ab2b-734c-4893-94b5-24e43a8b5c49 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:31.040891 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8143ab2b-734c-4893-94b5-24e43a8b5c49 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 200 len: 1466 microversion: 2.1 time: 0.245971 May 21 21:12:31.041487 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 329/666] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:30 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 1466 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:12:31.130787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-29aeae49-6e0c-49e5-9baf-0749cb76343f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:31.131393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-29aeae49-6e0c-49e5-9baf-0749cb76343f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:31.137625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29aeae49-6e0c-49e5-9baf-0749cb76343f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:31.138071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29aeae49-6e0c-49e5-9baf-0749cb76343f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:31.138837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29aeae49-6e0c-49e5-9baf-0749cb76343f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:31.139271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29aeae49-6e0c-49e5-9baf-0749cb76343f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:31.293458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6cbfec5a-4caf-476b-9807-0cc320e7d905 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:31.296228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6cbfec5a-4caf-476b-9807-0cc320e7d905 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:31.301148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6cbfec5a-4caf-476b-9807-0cc320e7d905 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:31.301605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6cbfec5a-4caf-476b-9807-0cc320e7d905 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:31.302391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6cbfec5a-4caf-476b-9807-0cc320e7d905 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:31.302832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6cbfec5a-4caf-476b-9807-0cc320e7d905 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:31.317691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-29aeae49-6e0c-49e5-9baf-0749cb76343f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:31.326924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-29aeae49-6e0c-49e5-9baf-0749cb76343f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:31.336873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-29aeae49-6e0c-49e5-9baf-0749cb76343f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:31.338284 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-29aeae49-6e0c-49e5-9baf-0749cb76343f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.211431 May 21 21:12:31.347190 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 338/667] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:31 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:31.412039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6cbfec5a-4caf-476b-9807-0cc320e7d905 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:31.419072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=20 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:31.422416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6cbfec5a-4caf-476b-9807-0cc320e7d905 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:31.424189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6cbfec5a-4caf-476b-9807-0cc320e7d905 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e83fbe80ab154846842f13c5cdfb5ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62f43f8ce2482887ec6ef306b112bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:31.430558 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6cbfec5a-4caf-476b-9807-0cc320e7d905 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 200 len: 1443 microversion: 2.75 time: 0.140913 May 21 21:12:31.431707 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 330/668] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:31 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 1443 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:12:31.524465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-457ccc13-1587-450b-ace2-464cef529cc7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:31.525065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-457ccc13-1587-450b-ace2-464cef529cc7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:31.531314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-457ccc13-1587-450b-ace2-464cef529cc7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:31.533177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-457ccc13-1587-450b-ace2-464cef529cc7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:31.534114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-457ccc13-1587-450b-ace2-464cef529cc7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:31.534622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-457ccc13-1587-450b-ace2-464cef529cc7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:31.693489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2929454e-ffc6-4aee-8e1d-ce1a00707765 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:31.694803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2929454e-ffc6-4aee-8e1d-ce1a00707765 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:31.704901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2929454e-ffc6-4aee-8e1d-ce1a00707765 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:31.705635 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2929454e-ffc6-4aee-8e1d-ce1a00707765 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:31.706605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2929454e-ffc6-4aee-8e1d-ce1a00707765 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:31.708879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2929454e-ffc6-4aee-8e1d-ce1a00707765 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:31.748048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2929454e-ffc6-4aee-8e1d-ce1a00707765 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:31.748807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2929454e-ffc6-4aee-8e1d-ce1a00707765 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:31.749428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-2929454e-ffc6-4aee-8e1d-ce1a00707765 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lazy-loading 'fault' on Instance uuid 11c92463-f5f1-4c2a-bcf0-573711f0c4f1 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:31.808577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2929454e-ffc6-4aee-8e1d-ce1a00707765 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:31.811806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:31.816758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-457ccc13-1587-450b-ace2-464cef529cc7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:31.820636 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2929454e-ffc6-4aee-8e1d-ce1a00707765 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1320 microversion: 2.1 time: 0.131382 May 21 21:12:31.821180 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 331/669] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:31 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1320 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:31.825855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-65682911-acd1-474e-868f-56459837a5c0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:31.826838 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-65682911-acd1-474e-868f-56459837a5c0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:31.828630 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-457ccc13-1587-450b-ace2-464cef529cc7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1311 microversion: 2.1 time: 0.309119 May 21 21:12:31.829421 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:31.830611 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 339/670] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:31 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1311 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:31.841162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65682911-acd1-474e-868f-56459837a5c0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:31.843836 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65682911-acd1-474e-868f-56459837a5c0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:31.843836 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65682911-acd1-474e-868f-56459837a5c0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:31.843836 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65682911-acd1-474e-868f-56459837a5c0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:31.927336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-65682911-acd1-474e-868f-56459837a5c0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:31.942340 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-65682911-acd1-474e-868f-56459837a5c0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1217 microversion: 2.1 time: 0.120064 May 21 21:12:31.943307 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 332/671] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:31 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1217 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:31.959910 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3e3b1e85-01cd-445d-a933-f0b8feebcbf0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:31.960841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3e3b1e85-01cd-445d-a933-f0b8feebcbf0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:31.967184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e3b1e85-01cd-445d-a933-f0b8feebcbf0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:31.968273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e3b1e85-01cd-445d-a933-f0b8feebcbf0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:31.968568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e3b1e85-01cd-445d-a933-f0b8feebcbf0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:31.969307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e3b1e85-01cd-445d-a933-f0b8feebcbf0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:32.059915 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3bd71f53-6259-44e1-bcab-45f40d1a3655 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:32.060568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3bd71f53-6259-44e1-bcab-45f40d1a3655 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:32.068206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3bd71f53-6259-44e1-bcab-45f40d1a3655 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:32.068700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3bd71f53-6259-44e1-bcab-45f40d1a3655 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:32.069490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3bd71f53-6259-44e1-bcab-45f40d1a3655 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:32.069936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3bd71f53-6259-44e1-bcab-45f40d1a3655 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:32.204806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3e3b1e85-01cd-445d-a933-f0b8feebcbf0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:32.216739 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3e3b1e85-01cd-445d-a933-f0b8feebcbf0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1371 microversion: 2.1 time: 0.260497 May 21 21:12:32.221826 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 340/672] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:31 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:32.242421 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3bd71f53-6259-44e1-bcab-45f40d1a3655 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:32.262461 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3bd71f53-6259-44e1-bcab-45f40d1a3655 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 200 len: 1466 microversion: 2.1 time: 0.197901 May 21 21:12:32.262461 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 333/673] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:32 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 1466 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:12:32.357163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2985c5a3-52f1-4c0e-ae77-fbe5988331a6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:32.357823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2985c5a3-52f1-4c0e-ae77-fbe5988331a6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:32.364761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2985c5a3-52f1-4c0e-ae77-fbe5988331a6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:32.365227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2985c5a3-52f1-4c0e-ae77-fbe5988331a6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:32.366052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2985c5a3-52f1-4c0e-ae77-fbe5988331a6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:32.366493 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2985c5a3-52f1-4c0e-ae77-fbe5988331a6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:32.456534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3c1e87df-b42e-4fc7-9ac9-3bf5ce0d0001 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:32.457175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3c1e87df-b42e-4fc7-9ac9-3bf5ce0d0001 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] [instance: bee17f35-3db6-4dbd-99d8-f5f87788e35a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:32.463671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3c1e87df-b42e-4fc7-9ac9-3bf5ce0d0001 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:32.464444 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3c1e87df-b42e-4fc7-9ac9-3bf5ce0d0001 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:32.465403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3c1e87df-b42e-4fc7-9ac9-3bf5ce0d0001 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:32.466017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3c1e87df-b42e-4fc7-9ac9-3bf5ce0d0001 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:32.496084 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-3c1e87df-b42e-4fc7-9ac9-3bf5ce0d0001 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] HTTP exception thrown: Instance bee17f35-3db6-4dbd-99d8-f5f87788e35a could not be found. May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3c1e87df-b42e-4fc7-9ac9-3bf5ce0d0001 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Request method failure captured: May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a HTTP/1.1 May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVpXcEd2zpt7uHkryEww7Og2BvYSt9g5VOsm1jiM_PYA3qDB7ZcA5v0kbPqVrU4pQ97D6-u52fjKO_HRGz6D3a5RSSCFXaS_Cj6-HajFztQBvud2ZTCywKsqfyZZ7OrdN5TZdtV5to7ijccjTpTV63xFGTvDcTX9IlYIKvkl993_hg May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: X-Openstack-Nova-Api-Version: 2.75 May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: fe62f43f8ce2482887ec6ef306b112bd May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersAdmin275Test-1860742155 May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:12:32.498585 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:12:32.500029 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fe62f43f8ce2482887ec6ef306b112bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fe62f43f8ce2482887ec6ef306b112bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fe62f43f8ce2482887ec6ef306b112bd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fe62f43f8ce2482887ec6ef306b112bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:12:32.500029 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersAdmin275Test-1860742155 May 21 21:12:32.500029 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: fe62f43f8ce2482887ec6ef306b112bd May 21 21:12:32.500029 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersAdmin275Test-1860742155 May 21 21:12:32.500029 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersAdmin275Test-1860742155-project May 21 21:12:32.500029 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:12:32.500029 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:12:32.500029 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: e83fbe80ab154846842f13c5cdfb5ff5 May 21 21:12:32.500029 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersAdmin275Test-1860742155-project May 21 21:12:32.500029 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:12:32.500029 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance bee17f35-3db6-4dbd-99d8-f5f87788e35a could not be found. May 21 21:12:32.500029 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'bee17f35-3db6-4dbd-99d8-f5f87788e35a'} May 21 21:12:32.500952 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:12:32.500952 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:32.500952 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:12:32.500952 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:12:32.500952 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:12:32.500952 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:12:32.500952 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:12:32.500952 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:12:32.500952 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:12:32.500952 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:12:32.500952 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bee17f35-3db6-4dbd-99d8-f5f87788e35a could not be found. May 21 21:12:32.500952 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:32.500952 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:32.500952 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:32.500952 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:32.500952 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:32.500952 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:32.500952 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:12:32.500952 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:12:32.500952 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:12:32.502190 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:12:32.502190 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:12:32.502190 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:12:32.502190 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:12:32.502190 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:12:32.502190 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:12:32.502190 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:12:32.502190 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bee17f35-3db6-4dbd-99d8-f5f87788e35a could not be found. May 21 21:12:32.502190 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:32.502190 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:32.502190 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:32.502190 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:32.502190 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:32.502190 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:32.502190 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:12:32.502190 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:12:32.502190 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bee17f35-3db6-4dbd-99d8-f5f87788e35a could not be found. May 21 21:12:32.502190 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:32.503490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3c1e87df-b42e-4fc7-9ac9-3bf5ce0d0001 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] Returning 404 to user: Instance bee17f35-3db6-4dbd-99d8-f5f87788e35a could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:12:32.503490 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3c1e87df-b42e-4fc7-9ac9-3bf5ce0d0001 tempest-ServersAdmin275Test-1860742155 tempest-ServersAdmin275Test-1860742155-project] 10.222.0.49 "GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a" status: 404 len: 111 microversion: 2.75 time: 0.052690 May 21 21:12:32.505312 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 334/674] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:32 2022] GET /compute/v2.1/servers/bee17f35-3db6-4dbd-99d8-f5f87788e35a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:12:32.681506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-ed45c59d-51d4-494b-9f41-33ec6dc9760a req-c5f8ab4f-baf9-4338-b952-2997300c9207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1886820b-3b3f-4ae7-94ea-4204d7cf8a60", "name": "network-vif-deleted", "tag": "9819927c-6523-4e99-b41c-43d458e3b568"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:32.712482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ed45c59d-51d4-494b-9f41-33ec6dc9760a req-c5f8ab4f-baf9-4338-b952-2997300c9207 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:32.713168 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ed45c59d-51d4-494b-9f41-33ec6dc9760a req-c5f8ab4f-baf9-4338-b952-2997300c9207 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:32.764440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2985c5a3-52f1-4c0e-ae77-fbe5988331a6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:32.775229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2985c5a3-52f1-4c0e-ae77-fbe5988331a6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:32.783803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2985c5a3-52f1-4c0e-ae77-fbe5988331a6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:32.786713 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-ed45c59d-51d4-494b-9f41-33ec6dc9760a req-c5f8ab4f-baf9-4338-b952-2997300c9207 service nova] Creating event network-vif-deleted:9819927c-6523-4e99-b41c-43d458e3b568 for instance 1886820b-3b3f-4ae7-94ea-4204d7cf8a60 on nch1-master-1 May 21 21:12:32.787668 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2985c5a3-52f1-4c0e-ae77-fbe5988331a6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.434430 May 21 21:12:32.796756 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-ed45c59d-51d4-494b-9f41-33ec6dc9760a req-c5f8ab4f-baf9-4338-b952-2997300c9207 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124303 May 21 21:12:32.800000 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 335/675] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:32.804519 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 341/676] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:32 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:32.840605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-184b8a15-0890-49f4-966d-5bcc70983131 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:32.841404 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-184b8a15-0890-49f4-966d-5bcc70983131 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:32.848408 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-50856912-922d-4285-90c4-0edbccdc8e06 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:32.849428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-50856912-922d-4285-90c4-0edbccdc8e06 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:32.853356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-184b8a15-0890-49f4-966d-5bcc70983131 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:32.853828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-184b8a15-0890-49f4-966d-5bcc70983131 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:32.855298 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-184b8a15-0890-49f4-966d-5bcc70983131 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:32.855298 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-184b8a15-0890-49f4-966d-5bcc70983131 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:32.855927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50856912-922d-4285-90c4-0edbccdc8e06 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:32.856582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50856912-922d-4285-90c4-0edbccdc8e06 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:32.857703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50856912-922d-4285-90c4-0edbccdc8e06 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:32.858304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50856912-922d-4285-90c4-0edbccdc8e06 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:32.905726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-184b8a15-0890-49f4-966d-5bcc70983131 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:32.906195 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-184b8a15-0890-49f4-966d-5bcc70983131 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:32.907209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-184b8a15-0890-49f4-966d-5bcc70983131 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lazy-loading 'fault' on Instance uuid 11c92463-f5f1-4c2a-bcf0-573711f0c4f1 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:32.982095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-184b8a15-0890-49f4-966d-5bcc70983131 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:32.991920 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-184b8a15-0890-49f4-966d-5bcc70983131 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1320 microversion: 2.1 time: 0.156887 May 21 21:12:32.992526 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 336/677] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:32 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1320 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:32.997172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b24a17c6-c95b-466a-b31d-8ebadb79350f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:32.997983 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b24a17c6-c95b-466a-b31d-8ebadb79350f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:33.005812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b24a17c6-c95b-466a-b31d-8ebadb79350f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:33.006574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b24a17c6-c95b-466a-b31d-8ebadb79350f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:33.007927 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b24a17c6-c95b-466a-b31d-8ebadb79350f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:33.008788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b24a17c6-c95b-466a-b31d-8ebadb79350f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:33.097230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b24a17c6-c95b-466a-b31d-8ebadb79350f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:33.108186 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b24a17c6-c95b-466a-b31d-8ebadb79350f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1217 microversion: 2.1 time: 0.114318 May 21 21:12:33.110297 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 337/678] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:32 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1217 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:33.139831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-50856912-922d-4285-90c4-0edbccdc8e06 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:33.148419 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-50856912-922d-4285-90c4-0edbccdc8e06 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1311 microversion: 2.1 time: 0.305231 May 21 21:12:33.149097 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 342/679] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:32 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1311 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:33.239573 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-06bff165-e7e2-4114-ab98-16a5dfb3837b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:33.240612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-06bff165-e7e2-4114-ab98-16a5dfb3837b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:33.248345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06bff165-e7e2-4114-ab98-16a5dfb3837b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:33.248804 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06bff165-e7e2-4114-ab98-16a5dfb3837b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:33.249878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06bff165-e7e2-4114-ab98-16a5dfb3837b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:33.250237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06bff165-e7e2-4114-ab98-16a5dfb3837b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:33.270389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-22cc97f0-a616-4b6c-99b4-3c591d9437fe tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:33.271014 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-22cc97f0-a616-4b6c-99b4-3c591d9437fe tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:33.280699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-22cc97f0-a616-4b6c-99b4-3c591d9437fe tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:33.281159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-22cc97f0-a616-4b6c-99b4-3c591d9437fe tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:33.282533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-22cc97f0-a616-4b6c-99b4-3c591d9437fe tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:33.283422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-22cc97f0-a616-4b6c-99b4-3c591d9437fe tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:33.342948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-22cc97f0-a616-4b6c-99b4-3c591d9437fe tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:33.343955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-22cc97f0-a616-4b6c-99b4-3c591d9437fe tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:33.345203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-22cc97f0-a616-4b6c-99b4-3c591d9437fe tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lazy-loading 'fault' on Instance uuid 1886820b-3b3f-4ae7-94ea-4204d7cf8a60 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:33.409339 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-22cc97f0-a616-4b6c-99b4-3c591d9437fe tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:33.423408 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-22cc97f0-a616-4b6c-99b4-3c591d9437fe tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 200 len: 1309 microversion: 2.1 time: 0.153880 May 21 21:12:33.428448 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 343/680] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:33 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 1309 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:33.507165 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-06bff165-e7e2-4114-ab98-16a5dfb3837b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:33.515280 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-06bff165-e7e2-4114-ab98-16a5dfb3837b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1371 microversion: 2.1 time: 0.279598 May 21 21:12:33.516078 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 338/681] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:33 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1371 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:33.810071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dfe2e6fc-4d01-4fce-8ed6-a0e488e17e1e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:33.810709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dfe2e6fc-4d01-4fce-8ed6-a0e488e17e1e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:33.818036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dfe2e6fc-4d01-4fce-8ed6-a0e488e17e1e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:33.818494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dfe2e6fc-4d01-4fce-8ed6-a0e488e17e1e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:33.819306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dfe2e6fc-4d01-4fce-8ed6-a0e488e17e1e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:33.819749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dfe2e6fc-4d01-4fce-8ed6-a0e488e17e1e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:34.008384 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-efc23bbb-d623-4033-8244-646c5e86c290 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:34.009089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-efc23bbb-d623-4033-8244-646c5e86c290 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:34.009924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-dfe2e6fc-4d01-4fce-8ed6-a0e488e17e1e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:34.017192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efc23bbb-d623-4033-8244-646c5e86c290 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:34.020758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efc23bbb-d623-4033-8244-646c5e86c290 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:34.020758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efc23bbb-d623-4033-8244-646c5e86c290 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:34.020758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efc23bbb-d623-4033-8244-646c5e86c290 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:34.021054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-dfe2e6fc-4d01-4fce-8ed6-a0e488e17e1e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:34.021250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-dfe2e6fc-4d01-4fce-8ed6-a0e488e17e1e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:34.022479 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dfe2e6fc-4d01-4fce-8ed6-a0e488e17e1e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.216456 May 21 21:12:34.023054 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 344/682] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:33 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:34.055509 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efc23bbb-d623-4033-8244-646c5e86c290 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:34.055963 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efc23bbb-d623-4033-8244-646c5e86c290 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:34.056458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-efc23bbb-d623-4033-8244-646c5e86c290 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lazy-loading 'fault' on Instance uuid 11c92463-f5f1-4c2a-bcf0-573711f0c4f1 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:34.103105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-efc23bbb-d623-4033-8244-646c5e86c290 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:34.111328 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-efc23bbb-d623-4033-8244-646c5e86c290 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1320 microversion: 2.1 time: 0.106822 May 21 21:12:34.112214 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 339/683] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:34 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1320 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:12:34.128798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c3995656-ef3d-4f80-9eeb-965f750442bd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:34.129547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c3995656-ef3d-4f80-9eeb-965f750442bd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:34.138012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c3995656-ef3d-4f80-9eeb-965f750442bd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:34.142494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c3995656-ef3d-4f80-9eeb-965f750442bd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:34.142494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c3995656-ef3d-4f80-9eeb-965f750442bd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:34.142494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c3995656-ef3d-4f80-9eeb-965f750442bd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:34.165675 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cbef77af-f3ef-4b54-8780-3908702f54dd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:34.166215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cbef77af-f3ef-4b54-8780-3908702f54dd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:34.173685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbef77af-f3ef-4b54-8780-3908702f54dd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:34.180707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbef77af-f3ef-4b54-8780-3908702f54dd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:34.181561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbef77af-f3ef-4b54-8780-3908702f54dd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:34.182059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbef77af-f3ef-4b54-8780-3908702f54dd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:34.237082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c3995656-ef3d-4f80-9eeb-965f750442bd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:34.245492 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c3995656-ef3d-4f80-9eeb-965f750442bd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1217 microversion: 2.1 time: 0.122062 May 21 21:12:34.246291 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 345/684] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:34 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1217 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:34.348068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cbef77af-f3ef-4b54-8780-3908702f54dd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:34.356467 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cbef77af-f3ef-4b54-8780-3908702f54dd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1311 microversion: 2.1 time: 0.194585 May 21 21:12:34.357130 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 340/685] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:34 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1311 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:12:34.438444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2cc41845-fa3a-40b8-ad35-c000fe0d306b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:34.439006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2cc41845-fa3a-40b8-ad35-c000fe0d306b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 1886820b-3b3f-4ae7-94ea-4204d7cf8a60] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:34.445268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2cc41845-fa3a-40b8-ad35-c000fe0d306b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:34.445723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2cc41845-fa3a-40b8-ad35-c000fe0d306b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:34.446532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2cc41845-fa3a-40b8-ad35-c000fe0d306b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:34.446988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2cc41845-fa3a-40b8-ad35-c000fe0d306b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:34.461673 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-2cc41845-fa3a-40b8-ad35-c000fe0d306b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] HTTP exception thrown: Instance 1886820b-3b3f-4ae7-94ea-4204d7cf8a60 could not be found. May 21 21:12:34.463267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2cc41845-fa3a-40b8-ad35-c000fe0d306b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Request method failure captured: May 21 21:12:34.463267 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 HTTP/1.1 May 21 21:12:34.463267 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:12:34.463267 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:12:34.463267 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:12:34.463267 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:12:34.463267 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:12:34.463267 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:12:34.463267 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:12:34.463267 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:12:34.463267 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVV8dsE2RQF6hiBN_tkwzE0k_ChXgfIpRji6E88QHXKJWiZU9rrouLTBLW5aUXaH1A5zkH4ULEmEtQpbFpseUjF4w_vX62Q5XwBBUxwi1cmzMe9GEeGz-oztF9VT1j7ehjYWPUymKeKSocubM3UxzTUaOCDvJ_DdcoEY4zocr2Zc43A May 21 21:12:34.463267 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:12:34.463267 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:12:34.463267 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:12:34.463267 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:12:34.463267 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:12:34.463267 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:12:34.463267 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: a16dae1aa89c4a86ad50273a1b3b08d8 May 21 21:12:34.463267 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-LiveMigrationNegativeTest-791937 May 21 21:12:34.463267 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:12:34.463267 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:12:34.464825 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a16dae1aa89c4a86ad50273a1b3b08d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a16dae1aa89c4a86ad50273a1b3b08d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a16dae1aa89c4a86ad50273a1b3b08d8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a16dae1aa89c4a86ad50273a1b3b08d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:12:34.464825 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-LiveMigrationNegativeTest-791937 May 21 21:12:34.464825 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: a16dae1aa89c4a86ad50273a1b3b08d8 May 21 21:12:34.464825 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-791937 May 21 21:12:34.464825 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-LiveMigrationNegativeTest-791937-project May 21 21:12:34.464825 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:12:34.464825 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:12:34.464825 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 4e7423d4ddfc46e390db2fc5fadac7f9 May 21 21:12:34.464825 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-LiveMigrationNegativeTest-791937-project May 21 21:12:34.464825 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:12:34.464825 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 1886820b-3b3f-4ae7-94ea-4204d7cf8a60 could not be found. May 21 21:12:34.464825 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '1886820b-3b3f-4ae7-94ea-4204d7cf8a60'} May 21 21:12:34.465763 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:12:34.465763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:34.465763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:12:34.465763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:12:34.465763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:12:34.465763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:12:34.465763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:12:34.465763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:12:34.465763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:12:34.465763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:12:34.465763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1886820b-3b3f-4ae7-94ea-4204d7cf8a60 could not be found. May 21 21:12:34.465763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:12:34.465763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:34.465763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:12:34.465763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:34.465763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:34.465763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:34.465763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:12:34.465763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:12:34.465763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:12:34.467144 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:12:34.467144 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:12:34.467144 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:12:34.467144 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:12:34.467144 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:12:34.467144 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:12:34.467144 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:12:34.467144 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1886820b-3b3f-4ae7-94ea-4204d7cf8a60 could not be found. May 21 21:12:34.467144 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:12:34.467144 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:34.467144 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:12:34.467144 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:34.467144 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:34.467144 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:34.467144 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:12:34.467144 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:12:34.467144 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1886820b-3b3f-4ae7-94ea-4204d7cf8a60 could not be found. May 21 21:12:34.467144 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:12:34.468412 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2cc41845-fa3a-40b8-ad35-c000fe0d306b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Returning 404 to user: Instance 1886820b-3b3f-4ae7-94ea-4204d7cf8a60 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:12:34.468412 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2cc41845-fa3a-40b8-ad35-c000fe0d306b tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60" status: 404 len: 111 microversion: 2.1 time: 0.030938 May 21 21:12:34.468412 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 346/686] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:34 2022] GET /compute/v2.1/servers/1886820b-3b3f-4ae7-94ea-4204d7cf8a60 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:12:34.474000 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6606e7a1-5c75-452d-b458-dd6ffc71134c tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:34.474517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6606e7a1-5c75-452d-b458-dd6ffc71134c tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:34.480765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6606e7a1-5c75-452d-b458-dd6ffc71134c tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:34.481221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6606e7a1-5c75-452d-b458-dd6ffc71134c tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:34.481995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6606e7a1-5c75-452d-b458-dd6ffc71134c tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:34.482437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6606e7a1-5c75-452d-b458-dd6ffc71134c tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:34.509852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6606e7a1-5c75-452d-b458-dd6ffc71134c tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:12:34.535684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c875c05f-ce37-43dd-9daa-6a509511040e tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:34.536698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c875c05f-ce37-43dd-9daa-6a509511040e tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:34.546263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c875c05f-ce37-43dd-9daa-6a509511040e tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:34.546736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c875c05f-ce37-43dd-9daa-6a509511040e tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:34.548436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c875c05f-ce37-43dd-9daa-6a509511040e tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:34.548879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c875c05f-ce37-43dd-9daa-6a509511040e tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:34.799351 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c875c05f-ce37-43dd-9daa-6a509511040e tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:34.807519 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c875c05f-ce37-43dd-9daa-6a509511040e tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1371 microversion: 2.1 time: 0.278383 May 21 21:12:34.808395 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 347/687] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:34 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:12:35.043075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8886030d-8ef7-4448-abcb-588fb60f5a37 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:35.043806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8886030d-8ef7-4448-abcb-588fb60f5a37 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:35.050687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8886030d-8ef7-4448-abcb-588fb60f5a37 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:35.051164 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8886030d-8ef7-4448-abcb-588fb60f5a37 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:35.051990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8886030d-8ef7-4448-abcb-588fb60f5a37 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:35.052593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8886030d-8ef7-4448-abcb-588fb60f5a37 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:35.105071 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6606e7a1-5c75-452d-b458-dd6ffc71134c tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "DELETE /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 204 len: 0 microversion: 2.1 time: 0.634023 May 21 21:12:35.106377 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 341/688] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:12:34 2022] DELETE /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 0 bytes in 637 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:12:35.116521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6a74d41a-0eb7-4a60-8f11-88fcae464e29 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:35.117895 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6a74d41a-0eb7-4a60-8f11-88fcae464e29 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:35.127929 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6a74d41a-0eb7-4a60-8f11-88fcae464e29 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:35.128405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6a74d41a-0eb7-4a60-8f11-88fcae464e29 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:35.129185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6a74d41a-0eb7-4a60-8f11-88fcae464e29 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:35.133026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6a74d41a-0eb7-4a60-8f11-88fcae464e29 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:35.301130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8886030d-8ef7-4448-abcb-588fb60f5a37 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:35.309952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8886030d-8ef7-4448-abcb-588fb60f5a37 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:35.311486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8886030d-8ef7-4448-abcb-588fb60f5a37 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:35.313533 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8886030d-8ef7-4448-abcb-588fb60f5a37 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.274620 May 21 21:12:35.314320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6a74d41a-0eb7-4a60-8f11-88fcae464e29 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:35.314566 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 348/689] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:35 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:12:35.319981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fcec8a9f-9101-4b82-8abb-19db95556c10 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:35.321062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fcec8a9f-9101-4b82-8abb-19db95556c10 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:35.322728 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6a74d41a-0eb7-4a60-8f11-88fcae464e29 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1474 microversion: 2.1 time: 0.210971 May 21 21:12:35.326565 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 342/690] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:35 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1474 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:35.326998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fcec8a9f-9101-4b82-8abb-19db95556c10 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:35.327464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fcec8a9f-9101-4b82-8abb-19db95556c10 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:35.328338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fcec8a9f-9101-4b82-8abb-19db95556c10 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:35.328791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fcec8a9f-9101-4b82-8abb-19db95556c10 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:35.346349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b6d80cee-3897-4db7-8b7c-7d4f127d249e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:35.347953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b6d80cee-3897-4db7-8b7c-7d4f127d249e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:35.355185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6d80cee-3897-4db7-8b7c-7d4f127d249e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:35.357984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6d80cee-3897-4db7-8b7c-7d4f127d249e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:35.357984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6d80cee-3897-4db7-8b7c-7d4f127d249e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:35.357984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6d80cee-3897-4db7-8b7c-7d4f127d249e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:35.379169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fcec8a9f-9101-4b82-8abb-19db95556c10 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:35.380039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fcec8a9f-9101-4b82-8abb-19db95556c10 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:35.380746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-fcec8a9f-9101-4b82-8abb-19db95556c10 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lazy-loading 'fault' on Instance uuid 11c92463-f5f1-4c2a-bcf0-573711f0c4f1 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:35.384468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:35.431699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fcec8a9f-9101-4b82-8abb-19db95556c10 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:35.448522 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fcec8a9f-9101-4b82-8abb-19db95556c10 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1320 microversion: 2.1 time: 0.132811 May 21 21:12:35.449159 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 349/691] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:35 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1320 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:35.449663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b6d80cee-3897-4db7-8b7c-7d4f127d249e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:35.454209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2334d0ca-bc34-4ce9-974f-23eccb2ecc36 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:35.456465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2334d0ca-bc34-4ce9-974f-23eccb2ecc36 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:35.459045 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b6d80cee-3897-4db7-8b7c-7d4f127d249e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1217 microversion: 2.1 time: 0.133113 May 21 21:12:35.460101 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 343/692] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:35 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1217 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:35.461920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2334d0ca-bc34-4ce9-974f-23eccb2ecc36 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:35.470137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2334d0ca-bc34-4ce9-974f-23eccb2ecc36 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:35.470137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2334d0ca-bc34-4ce9-974f-23eccb2ecc36 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:35.470137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2334d0ca-bc34-4ce9-974f-23eccb2ecc36 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:35.672092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2334d0ca-bc34-4ce9-974f-23eccb2ecc36 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:35.683118 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2334d0ca-bc34-4ce9-974f-23eccb2ecc36 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1311 microversion: 2.1 time: 0.232901 May 21 21:12:35.685118 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 350/693] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:35 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1311 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:35.829275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-328020a5-af3b-4cf3-80e1-abf4ff86ca90 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:35.832185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-328020a5-af3b-4cf3-80e1-abf4ff86ca90 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:35.845493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-328020a5-af3b-4cf3-80e1-abf4ff86ca90 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:35.847146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-328020a5-af3b-4cf3-80e1-abf4ff86ca90 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:35.849034 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-328020a5-af3b-4cf3-80e1-abf4ff86ca90 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:35.850062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-328020a5-af3b-4cf3-80e1-abf4ff86ca90 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:36.029868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-328020a5-af3b-4cf3-80e1-abf4ff86ca90 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:36.037786 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-328020a5-af3b-4cf3-80e1-abf4ff86ca90 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1371 microversion: 2.1 time: 0.216810 May 21 21:12:36.038357 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 344/694] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:35 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:36.331335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dd38fa01-65c8-494b-950d-89effe79dde6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:36.332022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dd38fa01-65c8-494b-950d-89effe79dde6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:36.334422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:36.339691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd38fa01-65c8-494b-950d-89effe79dde6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:36.340150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd38fa01-65c8-494b-950d-89effe79dde6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:36.340970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd38fa01-65c8-494b-950d-89effe79dde6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:36.341421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd38fa01-65c8-494b-950d-89effe79dde6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:36.341829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e55a9c68-c8dd-4f77-ba45-a87943a86682 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:36.342462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e55a9c68-c8dd-4f77-ba45-a87943a86682 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:36.349014 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e55a9c68-c8dd-4f77-ba45-a87943a86682 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:36.349473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e55a9c68-c8dd-4f77-ba45-a87943a86682 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:36.350251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e55a9c68-c8dd-4f77-ba45-a87943a86682 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:36.350694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e55a9c68-c8dd-4f77-ba45-a87943a86682 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:36.501156 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-dd38fa01-65c8-494b-950d-89effe79dde6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:36.510709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-dd38fa01-65c8-494b-950d-89effe79dde6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:36.511970 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e55a9c68-c8dd-4f77-ba45-a87943a86682 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:36.512229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-dd38fa01-65c8-494b-950d-89effe79dde6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:36.513482 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dd38fa01-65c8-494b-950d-89effe79dde6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.186293 May 21 21:12:36.514253 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 351/695] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:36 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:36.524849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-94b666a9-ce4f-436d-930a-0816f9131681 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:36.525476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-94b666a9-ce4f-436d-930a-0816f9131681 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:36.527723 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e55a9c68-c8dd-4f77-ba45-a87943a86682 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1474 microversion: 2.1 time: 0.190326 May 21 21:12:36.528345 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 345/696] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:36 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1474 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:12:36.533741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-df1f7b59-1504-4d65-9ab8-442190f86fbb tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:36.534999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-df1f7b59-1504-4d65-9ab8-442190f86fbb tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:36.536946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94b666a9-ce4f-436d-930a-0816f9131681 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:36.537467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94b666a9-ce4f-436d-930a-0816f9131681 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:36.538318 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94b666a9-ce4f-436d-930a-0816f9131681 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:36.538823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94b666a9-ce4f-436d-930a-0816f9131681 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:36.544089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df1f7b59-1504-4d65-9ab8-442190f86fbb tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:36.544089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df1f7b59-1504-4d65-9ab8-442190f86fbb tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:36.544089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df1f7b59-1504-4d65-9ab8-442190f86fbb tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:36.544089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df1f7b59-1504-4d65-9ab8-442190f86fbb tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:36.571698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94b666a9-ce4f-436d-930a-0816f9131681 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:36.572154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94b666a9-ce4f-436d-930a-0816f9131681 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:36.572635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-94b666a9-ce4f-436d-930a-0816f9131681 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lazy-loading 'fault' on Instance uuid 11c92463-f5f1-4c2a-bcf0-573711f0c4f1 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:36.614420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-df1f7b59-1504-4d65-9ab8-442190f86fbb tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:36.620662 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-94b666a9-ce4f-436d-930a-0816f9131681 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:36.623120 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-df1f7b59-1504-4d65-9ab8-442190f86fbb tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1217 microversion: 2.1 time: 0.093620 May 21 21:12:36.628020 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 346/697] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:36 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:36.631433 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-94b666a9-ce4f-436d-930a-0816f9131681 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1320 microversion: 2.1 time: 0.116327 May 21 21:12:36.638211 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 352/698] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:36 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1320 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:36.701799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c2497bc2-63a5-412d-b01d-647b27d622fb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:36.702497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c2497bc2-63a5-412d-b01d-647b27d622fb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:36.710966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2497bc2-63a5-412d-b01d-647b27d622fb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:36.711634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2497bc2-63a5-412d-b01d-647b27d622fb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:36.713264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2497bc2-63a5-412d-b01d-647b27d622fb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:36.714045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2497bc2-63a5-412d-b01d-647b27d622fb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:36.735234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:36.881677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c2497bc2-63a5-412d-b01d-647b27d622fb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:36.891604 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c2497bc2-63a5-412d-b01d-647b27d622fb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1311 microversion: 2.1 time: 0.193940 May 21 21:12:36.892946 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 347/699] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:36 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1311 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:37.055459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7f60a27b-3654-4e84-94b3-2de81f32e5d5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:37.058576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7f60a27b-3654-4e84-94b3-2de81f32e5d5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:37.063786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f60a27b-3654-4e84-94b3-2de81f32e5d5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:37.064270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f60a27b-3654-4e84-94b3-2de81f32e5d5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:37.065086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f60a27b-3654-4e84-94b3-2de81f32e5d5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:37.065593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f60a27b-3654-4e84-94b3-2de81f32e5d5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:37.271626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7f60a27b-3654-4e84-94b3-2de81f32e5d5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:37.280325 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7f60a27b-3654-4e84-94b3-2de81f32e5d5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1371 microversion: 2.1 time: 0.230075 May 21 21:12:37.292971 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 353/700] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:37 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:37.535374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3fe207be-2860-4373-a7a3-cefd69d0ca61 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:37.536188 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3fe207be-2860-4373-a7a3-cefd69d0ca61 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:37.545026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3fe207be-2860-4373-a7a3-cefd69d0ca61 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:37.546740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-20453452-fc8b-4083-ad8d-8d6bac606322 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:37.547202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3fe207be-2860-4373-a7a3-cefd69d0ca61 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:37.547202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3fe207be-2860-4373-a7a3-cefd69d0ca61 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:37.547390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-20453452-fc8b-4083-ad8d-8d6bac606322 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:37.547482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3fe207be-2860-4373-a7a3-cefd69d0ca61 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:37.553292 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20453452-fc8b-4083-ad8d-8d6bac606322 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:37.553748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20453452-fc8b-4083-ad8d-8d6bac606322 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:37.554529 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20453452-fc8b-4083-ad8d-8d6bac606322 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:37.554965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20453452-fc8b-4083-ad8d-8d6bac606322 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:37.613532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=8 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:37.682151 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:37.721932 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3fe207be-2860-4373-a7a3-cefd69d0ca61 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:37.725593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-20453452-fc8b-4083-ad8d-8d6bac606322 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:37.730335 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3fe207be-2860-4373-a7a3-cefd69d0ca61 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:37.731868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3fe207be-2860-4373-a7a3-cefd69d0ca61 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:37.733101 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3fe207be-2860-4373-a7a3-cefd69d0ca61 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.203754 May 21 21:12:37.733799 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 348/701] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:37 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:37.736637 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-20453452-fc8b-4083-ad8d-8d6bac606322 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1474 microversion: 2.1 time: 0.195149 May 21 21:12:37.745866 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 354/702] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:37 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1474 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:37.750309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7e000299-d7c8-4adc-adc2-0cc9bcef2e70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:37.750939 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7e000299-d7c8-4adc-adc2-0cc9bcef2e70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:37.751204 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e7185374-ffa5-410e-8710-a15d6145610a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:37.751866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e7185374-ffa5-410e-8710-a15d6145610a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:37.757618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e000299-d7c8-4adc-adc2-0cc9bcef2e70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:37.758037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7185374-ffa5-410e-8710-a15d6145610a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:37.758411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e000299-d7c8-4adc-adc2-0cc9bcef2e70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:37.758561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7185374-ffa5-410e-8710-a15d6145610a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:37.759244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7185374-ffa5-410e-8710-a15d6145610a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:37.759420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e000299-d7c8-4adc-adc2-0cc9bcef2e70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:37.759781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7185374-ffa5-410e-8710-a15d6145610a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:37.759987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e000299-d7c8-4adc-adc2-0cc9bcef2e70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:37.800406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7185374-ffa5-410e-8710-a15d6145610a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:37.801216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7185374-ffa5-410e-8710-a15d6145610a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:37.801963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-e7185374-ffa5-410e-8710-a15d6145610a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lazy-loading 'fault' on Instance uuid 11c92463-f5f1-4c2a-bcf0-573711f0c4f1 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:37.842745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7e000299-d7c8-4adc-adc2-0cc9bcef2e70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:37.853108 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7e000299-d7c8-4adc-adc2-0cc9bcef2e70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1217 microversion: 2.1 time: 0.107615 May 21 21:12:37.856035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e7185374-ffa5-410e-8710-a15d6145610a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:37.863545 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 349/703] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:37 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1217 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:37.874197 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e7185374-ffa5-410e-8710-a15d6145610a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1320 microversion: 2.1 time: 0.127102 May 21 21:12:37.874784 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 355/704] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:37 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1320 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:37.910705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-caa80b89-1afe-407f-baf5-cb9e9b99537e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:37.911347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-caa80b89-1afe-407f-baf5-cb9e9b99537e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:37.917450 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-caa80b89-1afe-407f-baf5-cb9e9b99537e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:37.917902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-caa80b89-1afe-407f-baf5-cb9e9b99537e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:37.918788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-caa80b89-1afe-407f-baf5-cb9e9b99537e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:37.919224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-caa80b89-1afe-407f-baf5-cb9e9b99537e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:38.087724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-caa80b89-1afe-407f-baf5-cb9e9b99537e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:38.095882 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-caa80b89-1afe-407f-baf5-cb9e9b99537e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1311 microversion: 2.1 time: 0.190645 May 21 21:12:38.096471 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 350/705] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:37 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1311 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:38.300783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2114f4af-aaa6-419f-a270-4d154f618b9f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:38.301406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2114f4af-aaa6-419f-a270-4d154f618b9f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:38.307568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2114f4af-aaa6-419f-a270-4d154f618b9f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:38.308007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2114f4af-aaa6-419f-a270-4d154f618b9f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:38.308955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2114f4af-aaa6-419f-a270-4d154f618b9f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:38.309343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2114f4af-aaa6-419f-a270-4d154f618b9f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:38.459449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2114f4af-aaa6-419f-a270-4d154f618b9f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:38.467653 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2114f4af-aaa6-419f-a270-4d154f618b9f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1371 microversion: 2.1 time: 0.171251 May 21 21:12:38.468252 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 356/706] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:38 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:38.753725 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9cad045d-95c8-46e1-b416-17a74b34c39f tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:38.754498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9cad045d-95c8-46e1-b416-17a74b34c39f tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:38.756246 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-630c48f7-f029-47c4-a4a1-93d59e758b39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:38.758276 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-630c48f7-f029-47c4-a4a1-93d59e758b39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:38.770725 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cad045d-95c8-46e1-b416-17a74b34c39f tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:38.772807 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cad045d-95c8-46e1-b416-17a74b34c39f tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:38.775091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cad045d-95c8-46e1-b416-17a74b34c39f tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:38.775888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cad045d-95c8-46e1-b416-17a74b34c39f tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:38.789962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-630c48f7-f029-47c4-a4a1-93d59e758b39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:38.791685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-630c48f7-f029-47c4-a4a1-93d59e758b39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:38.791685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-630c48f7-f029-47c4-a4a1-93d59e758b39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:38.792329 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-630c48f7-f029-47c4-a4a1-93d59e758b39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:39.083233 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-630c48f7-f029-47c4-a4a1-93d59e758b39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:39.096866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-630c48f7-f029-47c4-a4a1-93d59e758b39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:39.098733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-630c48f7-f029-47c4-a4a1-93d59e758b39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:39.100711 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-630c48f7-f029-47c4-a4a1-93d59e758b39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.351290 May 21 21:12:39.103567 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 351/707] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:38 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:39.111743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cff16111-63ff-481d-b17a-28f43c6fa5d8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:39.112690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cff16111-63ff-481d-b17a-28f43c6fa5d8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:39.119600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cff16111-63ff-481d-b17a-28f43c6fa5d8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:39.120056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cff16111-63ff-481d-b17a-28f43c6fa5d8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:39.120944 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cff16111-63ff-481d-b17a-28f43c6fa5d8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:39.121587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cff16111-63ff-481d-b17a-28f43c6fa5d8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:39.134213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9cad045d-95c8-46e1-b416-17a74b34c39f tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:39.144375 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9cad045d-95c8-46e1-b416-17a74b34c39f tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1474 microversion: 2.1 time: 0.394924 May 21 21:12:39.144969 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 357/708] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:38 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1474 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:39.149909 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4e364e12-fd41-49f5-8094-30892b296f44 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:39.150706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4e364e12-fd41-49f5-8094-30892b296f44 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:39.163736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e364e12-fd41-49f5-8094-30892b296f44 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:39.163736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e364e12-fd41-49f5-8094-30892b296f44 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:39.163736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e364e12-fd41-49f5-8094-30892b296f44 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:39.163736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e364e12-fd41-49f5-8094-30892b296f44 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:39.192883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e364e12-fd41-49f5-8094-30892b296f44 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:39.193336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e364e12-fd41-49f5-8094-30892b296f44 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:39.193803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-4e364e12-fd41-49f5-8094-30892b296f44 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lazy-loading 'fault' on Instance uuid 11c92463-f5f1-4c2a-bcf0-573711f0c4f1 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:39.226027 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cff16111-63ff-481d-b17a-28f43c6fa5d8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:39.234950 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cff16111-63ff-481d-b17a-28f43c6fa5d8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1209 microversion: 2.1 time: 0.131233 May 21 21:12:39.244841 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 352/709] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:39 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1209 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:39.248738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a3399c82-ed85-48ba-964b-920d0b672be3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:39.249358 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a3399c82-ed85-48ba-964b-920d0b672be3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:39.252133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4e364e12-fd41-49f5-8094-30892b296f44 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:39.256965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3399c82-ed85-48ba-964b-920d0b672be3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:39.257883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3399c82-ed85-48ba-964b-920d0b672be3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:39.258827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3399c82-ed85-48ba-964b-920d0b672be3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:39.259435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3399c82-ed85-48ba-964b-920d0b672be3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:39.261717 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4e364e12-fd41-49f5-8094-30892b296f44 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 200 len: 1320 microversion: 2.1 time: 0.115463 May 21 21:12:39.262297 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 358/710] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:39 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 1320 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:39.487061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ca1146c6-7525-4ead-a2fd-3e5be121d604 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:39.487784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ca1146c6-7525-4ead-a2fd-3e5be121d604 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:39.496773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca1146c6-7525-4ead-a2fd-3e5be121d604 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:39.497995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca1146c6-7525-4ead-a2fd-3e5be121d604 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:39.498656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca1146c6-7525-4ead-a2fd-3e5be121d604 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:39.499217 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca1146c6-7525-4ead-a2fd-3e5be121d604 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:39.507699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a3399c82-ed85-48ba-964b-920d0b672be3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:39.516683 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a3399c82-ed85-48ba-964b-920d0b672be3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1311 microversion: 2.1 time: 0.279052 May 21 21:12:39.517280 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 353/711] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:39 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1311 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:39.751020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ca1146c6-7525-4ead-a2fd-3e5be121d604 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:39.758906 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ca1146c6-7525-4ead-a2fd-3e5be121d604 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1371 microversion: 2.1 time: 0.278085 May 21 21:12:39.759819 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 359/712] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:39 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:12:39.961501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-1e6a7678-c13d-4268-b0e9-4d48aa74b655 req-5daae26a-bfe1-480a-a791-a99937dd2cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "201a83df-62c1-4804-b9d2-1cee0b7a7013", "tag": "30c8503a-ba5d-4891-802d-ebdb59c1d865"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:39.980035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-1e6a7678-c13d-4268-b0e9-4d48aa74b655 req-5daae26a-bfe1-480a-a791-a99937dd2cb6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:39.980647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-1e6a7678-c13d-4268-b0e9-4d48aa74b655 req-5daae26a-bfe1-480a-a791-a99937dd2cb6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:40.027153 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-1e6a7678-c13d-4268-b0e9-4d48aa74b655 req-5daae26a-bfe1-480a-a791-a99937dd2cb6 service nova] Creating event network-changed:30c8503a-ba5d-4891-802d-ebdb59c1d865 for instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 on nch2-master-1 May 21 21:12:40.038068 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-1e6a7678-c13d-4268-b0e9-4d48aa74b655 req-5daae26a-bfe1-480a-a791-a99937dd2cb6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079648 May 21 21:12:40.039262 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 354/713] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:40.119301 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7ca785f5-fc3e-47a7-8f96-94e118a5c9c6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:40.124439 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7ca785f5-fc3e-47a7-8f96-94e118a5c9c6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:40.133456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ca785f5-fc3e-47a7-8f96-94e118a5c9c6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:40.143030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ca785f5-fc3e-47a7-8f96-94e118a5c9c6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:40.159128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ca785f5-fc3e-47a7-8f96-94e118a5c9c6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:40.159128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ca785f5-fc3e-47a7-8f96-94e118a5c9c6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:40.164191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-511b92aa-b716-4013-875c-9229170ca048 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:40.164985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-511b92aa-b716-4013-875c-9229170ca048 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:40.179865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-511b92aa-b716-4013-875c-9229170ca048 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:40.180345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-511b92aa-b716-4013-875c-9229170ca048 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:40.185183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-511b92aa-b716-4013-875c-9229170ca048 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:40.185634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-511b92aa-b716-4013-875c-9229170ca048 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:40.814527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7ca785f5-fc3e-47a7-8f96-94e118a5c9c6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:40.823333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7ca785f5-fc3e-47a7-8f96-94e118a5c9c6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:40.824970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7ca785f5-fc3e-47a7-8f96-94e118a5c9c6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:40.826182 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7ca785f5-fc3e-47a7-8f96-94e118a5c9c6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.711170 May 21 21:12:40.826946 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 360/714] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:40 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:40.833489 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-effe2552-230b-4c6f-a101-dfa94e2e5570 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:40.834306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-effe2552-230b-4c6f-a101-dfa94e2e5570 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:40.842656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-effe2552-230b-4c6f-a101-dfa94e2e5570 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:40.844955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-effe2552-230b-4c6f-a101-dfa94e2e5570 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:40.844955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-effe2552-230b-4c6f-a101-dfa94e2e5570 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:40.849519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-effe2552-230b-4c6f-a101-dfa94e2e5570 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:40.979522 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-511b92aa-b716-4013-875c-9229170ca048 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:40.993651 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-511b92aa-b716-4013-875c-9229170ca048 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1474 microversion: 2.1 time: 0.834645 May 21 21:12:41.003588 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 355/715] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:40 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1474 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:12:41.003588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e1c0ae8a-75c4-4eca-a0db-40e9ff3f360d tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:41.003588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e1c0ae8a-75c4-4eca-a0db-40e9ff3f360d tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: 11c92463-f5f1-4c2a-bcf0-573711f0c4f1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:41.007289 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1c0ae8a-75c4-4eca-a0db-40e9ff3f360d tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:41.017692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1c0ae8a-75c4-4eca-a0db-40e9ff3f360d tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:41.017692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1c0ae8a-75c4-4eca-a0db-40e9ff3f360d tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:41.017692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1c0ae8a-75c4-4eca-a0db-40e9ff3f360d tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:41.024814 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-e1c0ae8a-75c4-4eca-a0db-40e9ff3f360d tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] HTTP exception thrown: Instance 11c92463-f5f1-4c2a-bcf0-573711f0c4f1 could not be found. May 21 21:12:41.026469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e1c0ae8a-75c4-4eca-a0db-40e9ff3f360d tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Request method failure captured: May 21 21:12:41.026469 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 HTTP/1.1 May 21 21:12:41.026469 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:12:41.026469 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:12:41.026469 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:12:41.026469 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:12:41.026469 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:12:41.026469 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:12:41.026469 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:12:41.026469 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:12:41.026469 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVpDBkS9K5pHFyv1XlqioW0P9eZZk_9X-B4sgaichiXR51l8haUp4vJjn70cKE_2K_VfbPPZsJsGr1xAY3eh4HDE-hFYM3re9EaunzR52vH2hltxndJ5h9YgnrzeA7ccnIdugc39yImBWPo33UJW0svJK37zeFXDOCybMyKPxcajjA May 21 21:12:41.026469 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:12:41.026469 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:12:41.026469 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:12:41.026469 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:12:41.026469 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:12:41.026469 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:12:41.026469 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 4c99e1f900034d42bbb1a786b225a230 May 21 21:12:41.026469 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1972717349 May 21 21:12:41.026469 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:12:41.026469 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:12:41.027925 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4c99e1f900034d42bbb1a786b225a230"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c99e1f900034d42bbb1a786b225a230"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4c99e1f900034d42bbb1a786b225a230", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c99e1f900034d42bbb1a786b225a230"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:12:41.027925 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1972717349 May 21 21:12:41.027925 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 4c99e1f900034d42bbb1a786b225a230 May 21 21:12:41.027925 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1972717349 May 21 21:12:41.027925 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-FloatingIPsAssociationTestJSON-1972717349-project May 21 21:12:41.027925 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:12:41.027925 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:12:41.027925 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 74f296ea42634e18ad82ee175408c641 May 21 21:12:41.027925 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1972717349-project May 21 21:12:41.027925 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:12:41.027925 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 11c92463-f5f1-4c2a-bcf0-573711f0c4f1 could not be found. May 21 21:12:41.027925 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '11c92463-f5f1-4c2a-bcf0-573711f0c4f1'} May 21 21:12:41.028823 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:12:41.028823 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:41.028823 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:12:41.028823 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:12:41.028823 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:12:41.028823 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:12:41.028823 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:12:41.028823 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:12:41.028823 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:12:41.028823 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:12:41.028823 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11c92463-f5f1-4c2a-bcf0-573711f0c4f1 could not be found. May 21 21:12:41.028823 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:41.028823 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:41.028823 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:41.028823 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:41.028823 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:41.028823 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:41.028823 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:12:41.028823 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:12:41.028823 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:12:41.030996 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:12:41.030996 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:12:41.030996 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:12:41.030996 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:12:41.030996 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:12:41.030996 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:12:41.030996 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:12:41.030996 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11c92463-f5f1-4c2a-bcf0-573711f0c4f1 could not be found. May 21 21:12:41.030996 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:41.030996 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:41.030996 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:41.030996 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:41.030996 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:41.030996 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:41.030996 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:12:41.030996 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:12:41.030996 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11c92463-f5f1-4c2a-bcf0-573711f0c4f1 could not be found. May 21 21:12:41.030996 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:41.036622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e1c0ae8a-75c4-4eca-a0db-40e9ff3f360d tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Returning 404 to user: Instance 11c92463-f5f1-4c2a-bcf0-573711f0c4f1 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:12:41.036622 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e1c0ae8a-75c4-4eca-a0db-40e9ff3f360d tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1" status: 404 len: 111 microversion: 2.1 time: 0.032182 May 21 21:12:41.036622 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 356/716] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:40 2022] GET /compute/v2.1/servers/11c92463-f5f1-4c2a-bcf0-573711f0c4f1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:12:41.037480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4121f001-5c2b-421b-a42e-55543889349a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:41.041016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4121f001-5c2b-421b-a42e-55543889349a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:41.050091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4121f001-5c2b-421b-a42e-55543889349a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:41.050875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4121f001-5c2b-421b-a42e-55543889349a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:41.053039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4121f001-5c2b-421b-a42e-55543889349a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:41.053039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4121f001-5c2b-421b-a42e-55543889349a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:41.086350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-effe2552-230b-4c6f-a101-dfa94e2e5570 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:41.124035 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-effe2552-230b-4c6f-a101-dfa94e2e5570 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1265 microversion: 2.1 time: 0.289985 May 21 21:12:41.126649 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 361/717] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:40 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1265 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:41.132759 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c6e99963-0c3e-4863-a59c-e90a2fea3bf5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:41.133436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c6e99963-0c3e-4863-a59c-e90a2fea3bf5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:41.141840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6e99963-0c3e-4863-a59c-e90a2fea3bf5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:41.142304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6e99963-0c3e-4863-a59c-e90a2fea3bf5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:41.143682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6e99963-0c3e-4863-a59c-e90a2fea3bf5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:41.144149 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6e99963-0c3e-4863-a59c-e90a2fea3bf5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:42.074488 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c6e99963-0c3e-4863-a59c-e90a2fea3bf5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:42.103245 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c6e99963-0c3e-4863-a59c-e90a2fea3bf5 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1371 microversion: 2.1 time: 0.974266 May 21 21:12:42.104349 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 362/718] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:41 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1371 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:42.109515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-40a75e6c-66c7-4aba-aa81-39800093078f tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '.version_select at 0x7fc81be8f670>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:42.239726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4121f001-5c2b-421b-a42e-55543889349a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:42.252780 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4121f001-5c2b-421b-a42e-55543889349a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1311 microversion: 2.1 time: 1.214284 May 21 21:12:42.252780 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 357/719] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:41 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1311 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:42.271363 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-539c79da-2b71-4a37-b737-170f8ae86624 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:42.282696 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-539c79da-2b71-4a37-b737-170f8ae86624 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:42.288485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-539c79da-2b71-4a37-b737-170f8ae86624 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:42.289359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-539c79da-2b71-4a37-b737-170f8ae86624 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:42.290320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-539c79da-2b71-4a37-b737-170f8ae86624 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:42.291041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-539c79da-2b71-4a37-b737-170f8ae86624 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:42.336931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-539c79da-2b71-4a37-b737-170f8ae86624 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:12:42.792348 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-539c79da-2b71-4a37-b737-170f8ae86624 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 204 len: 0 microversion: 2.1 time: 0.529194 May 21 21:12:42.793814 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 358/720] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:12:42 2022] DELETE /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:12:42.803595 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7c2cb1ab-282a-468d-b538-d30d80822056 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:42.812032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7c2cb1ab-282a-468d-b538-d30d80822056 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:42.825256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c2cb1ab-282a-468d-b538-d30d80822056 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:42.826945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c2cb1ab-282a-468d-b538-d30d80822056 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:42.832371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c2cb1ab-282a-468d-b538-d30d80822056 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:42.833045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c2cb1ab-282a-468d-b538-d30d80822056 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:43.584762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7c2cb1ab-282a-468d-b538-d30d80822056 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:43.596430 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7c2cb1ab-282a-468d-b538-d30d80822056 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:43.598054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7c2cb1ab-282a-468d-b538-d30d80822056 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:43.599924 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7c2cb1ab-282a-468d-b538-d30d80822056 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.804923 May 21 21:12:43.603117 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 359/721] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:42 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:43.608427 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7daeb5b4-179f-4654-b1a7-0f40be4855e9 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:43.611764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7daeb5b4-179f-4654-b1a7-0f40be4855e9 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:43.619661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7daeb5b4-179f-4654-b1a7-0f40be4855e9 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:43.632185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7daeb5b4-179f-4654-b1a7-0f40be4855e9 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:43.637075 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7daeb5b4-179f-4654-b1a7-0f40be4855e9 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:43.639386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7daeb5b4-179f-4654-b1a7-0f40be4855e9 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:43.924779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7daeb5b4-179f-4654-b1a7-0f40be4855e9 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:43.934280 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7daeb5b4-179f-4654-b1a7-0f40be4855e9 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1432 microversion: 2.1 time: 0.329833 May 21 21:12:43.935231 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 360/722] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:43 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1432 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:43.948887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d5826beb-0dfc-401a-9a18-708b14d17c68 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:43.950827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d5826beb-0dfc-401a-9a18-708b14d17c68 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:43.980557 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5826beb-0dfc-401a-9a18-708b14d17c68 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:43.981410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5826beb-0dfc-401a-9a18-708b14d17c68 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:43.982425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5826beb-0dfc-401a-9a18-708b14d17c68 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:43.983025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5826beb-0dfc-401a-9a18-708b14d17c68 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:44.259947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d5826beb-0dfc-401a-9a18-708b14d17c68 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:44.270097 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d5826beb-0dfc-401a-9a18-708b14d17c68 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1313 microversion: 2.1 time: 0.333168 May 21 21:12:44.270680 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 361/723] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:43 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:44.275431 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-eeea7570-22ad-420c-a960-bc4834c0cc23 req-aa1fd50d-53ce-4e39-8cea-cf003e0ef210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d169f8-72b8-4928-b109-7d948fe70b9a", "name": "network-vif-unplugged", "status": "completed", "tag": "9c5044e3-c8fa-45e3-b917-7a13d3004a8e"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:44.285500 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-eeea7570-22ad-420c-a960-bc4834c0cc23 req-aa1fd50d-53ce-4e39-8cea-cf003e0ef210 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:44.286226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-eeea7570-22ad-420c-a960-bc4834c0cc23 req-aa1fd50d-53ce-4e39-8cea-cf003e0ef210 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:44.301749 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-eeea7570-22ad-420c-a960-bc4834c0cc23 req-aa1fd50d-53ce-4e39-8cea-cf003e0ef210 service nova] Creating event network-vif-unplugged:9c5044e3-c8fa-45e3-b917-7a13d3004a8e for instance 23d169f8-72b8-4928-b109-7d948fe70b9a on nch2-master-1 May 21 21:12:44.308061 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-eeea7570-22ad-420c-a960-bc4834c0cc23 req-aa1fd50d-53ce-4e39-8cea-cf003e0ef210 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036182 May 21 21:12:44.308943 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 362/724] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:44.317946 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c2a08ff8-50d6-41d0-acb7-dc8d397a8bb1 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:44.321905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c2a08ff8-50d6-41d0-acb7-dc8d397a8bb1 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:44.327079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2a08ff8-50d6-41d0-acb7-dc8d397a8bb1 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:44.327535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2a08ff8-50d6-41d0-acb7-dc8d397a8bb1 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:44.329119 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2a08ff8-50d6-41d0-acb7-dc8d397a8bb1 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:44.329594 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2a08ff8-50d6-41d0-acb7-dc8d397a8bb1 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:44.502221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c2a08ff8-50d6-41d0-acb7-dc8d397a8bb1 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:44.514055 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c2a08ff8-50d6-41d0-acb7-dc8d397a8bb1 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 200 len: 1714 microversion: 2.1 time: 0.203715 May 21 21:12:44.526455 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 363/725] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:44 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 1714 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:44.526455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4e820bd0-e1a4-4a76-ad1f-c29ca9479f6f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:44.526455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4e820bd0-e1a4-4a76-ad1f-c29ca9479f6f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:44.530078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e820bd0-e1a4-4a76-ad1f-c29ca9479f6f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:44.530545 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e820bd0-e1a4-4a76-ad1f-c29ca9479f6f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:44.532445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e820bd0-e1a4-4a76-ad1f-c29ca9479f6f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:44.532611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e820bd0-e1a4-4a76-ad1f-c29ca9479f6f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:44.554816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:44.945865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4e820bd0-e1a4-4a76-ad1f-c29ca9479f6f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:44.956169 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4e820bd0-e1a4-4a76-ad1f-c29ca9479f6f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1371 microversion: 2.1 time: 0.437180 May 21 21:12:44.964515 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 364/726] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:44 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1371 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:44.964515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-32b008d2-cd6b-4201-9624-e97d9390a24d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:44.964515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-32b008d2-cd6b-4201-9624-e97d9390a24d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:44.975152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32b008d2-cd6b-4201-9624-e97d9390a24d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:44.975664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32b008d2-cd6b-4201-9624-e97d9390a24d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:44.977787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32b008d2-cd6b-4201-9624-e97d9390a24d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:44.978248 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32b008d2-cd6b-4201-9624-e97d9390a24d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:44.981720 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-40a75e6c-66c7-4aba-aa81-39800093078f tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/de4d9298-b7b4-401b-9695-1a73f582ae1e" status: 202 len: 0 microversion: 2.1 time: 2.875209 May 21 21:12:44.986718 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 363/727] 10.222.0.49 () {58 vars in 1262 bytes} [Sat May 21 21:12:42 2022] DELETE /compute/v2.1/os-floating-ips/de4d9298-b7b4-401b-9695-1a73f582ae1e => generated 0 bytes in 2881 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:12:44.993542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-67112296-76ab-49df-8bf9-2d5e191bf457 req-e67522b7-6b86-4eab-aab9-b8d56509ad01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d169f8-72b8-4928-b109-7d948fe70b9a", "name": "network-vif-deleted", "tag": "9c5044e3-c8fa-45e3-b917-7a13d3004a8e"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:45.028030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-67112296-76ab-49df-8bf9-2d5e191bf457 req-e67522b7-6b86-4eab-aab9-b8d56509ad01 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:45.031127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-67112296-76ab-49df-8bf9-2d5e191bf457 req-e67522b7-6b86-4eab-aab9-b8d56509ad01 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:45.047778 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-67112296-76ab-49df-8bf9-2d5e191bf457 req-e67522b7-6b86-4eab-aab9-b8d56509ad01 service nova] Creating event network-vif-deleted:9c5044e3-c8fa-45e3-b917-7a13d3004a8e for instance 23d169f8-72b8-4928-b109-7d948fe70b9a on nch2-master-1 May 21 21:12:45.054882 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-67112296-76ab-49df-8bf9-2d5e191bf457 req-e67522b7-6b86-4eab-aab9-b8d56509ad01 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066302 May 21 21:12:45.055865 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 364/728] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:45.063141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4121b772-e814-4c62-8886-e17b7ea939ca tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:45.063861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4121b772-e814-4c62-8886-e17b7ea939ca tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:45.072678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4121b772-e814-4c62-8886-e17b7ea939ca tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:45.073136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4121b772-e814-4c62-8886-e17b7ea939ca tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:45.074039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4121b772-e814-4c62-8886-e17b7ea939ca tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:45.074484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4121b772-e814-4c62-8886-e17b7ea939ca tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:45.469255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-32b008d2-cd6b-4201-9624-e97d9390a24d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:45.478245 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-32b008d2-cd6b-4201-9624-e97d9390a24d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1311 microversion: 2.1 time: 0.520406 May 21 21:12:45.483314 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 365/729] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:44 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1311 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:45.486847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7faed79b-ef3c-4404-b77b-31b6e762cfb2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:45.487421 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7faed79b-ef3c-4404-b77b-31b6e762cfb2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:45.497126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7faed79b-ef3c-4404-b77b-31b6e762cfb2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:45.498216 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7faed79b-ef3c-4404-b77b-31b6e762cfb2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:45.499355 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7faed79b-ef3c-4404-b77b-31b6e762cfb2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:45.502119 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7faed79b-ef3c-4404-b77b-31b6e762cfb2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:45.580627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7faed79b-ef3c-4404-b77b-31b6e762cfb2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:45.582648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7faed79b-ef3c-4404-b77b-31b6e762cfb2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:45.584870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-7faed79b-ef3c-4404-b77b-31b6e762cfb2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lazy-loading 'fault' on Instance uuid 23d169f8-72b8-4928-b109-7d948fe70b9a {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:45.613501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4121b772-e814-4c62-8886-e17b7ea939ca tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:45.628502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4121b772-e814-4c62-8886-e17b7ea939ca tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:45.631005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4121b772-e814-4c62-8886-e17b7ea939ca tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:45.633222 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4121b772-e814-4c62-8886-e17b7ea939ca tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.576138 May 21 21:12:45.638622 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 365/730] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:45 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:45.641076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e7c94b4e-1373-4d77-9ffe-419322bc1d54 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:45.641924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e7c94b4e-1373-4d77-9ffe-419322bc1d54 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:45.650586 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7c94b4e-1373-4d77-9ffe-419322bc1d54 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:45.651032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7c94b4e-1373-4d77-9ffe-419322bc1d54 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:45.651973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7c94b4e-1373-4d77-9ffe-419322bc1d54 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:45.652906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7c94b4e-1373-4d77-9ffe-419322bc1d54 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:45.686124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e7c94b4e-1373-4d77-9ffe-419322bc1d54 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:12:45.697619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:45.727514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7faed79b-ef3c-4404-b77b-31b6e762cfb2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7423d4ddfc46e390db2fc5fadac7f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16dae1aa89c4a86ad50273a1b3b08d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:45.738676 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7faed79b-ef3c-4404-b77b-31b6e762cfb2 tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 200 len: 1309 microversion: 2.1 time: 0.257964 May 21 21:12:45.740324 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 366/731] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:45 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 1309 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:45.746486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-958bc570-cef8-459e-97a1-ce8bd96c366a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:45.746690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-958bc570-cef8-459e-97a1-ce8bd96c366a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:45.755299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-958bc570-cef8-459e-97a1-ce8bd96c366a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:45.755859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-958bc570-cef8-459e-97a1-ce8bd96c366a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:45.756914 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-958bc570-cef8-459e-97a1-ce8bd96c366a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:45.757301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-958bc570-cef8-459e-97a1-ce8bd96c366a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:46.064370 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e7c94b4e-1373-4d77-9ffe-419322bc1d54 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3" status: 204 len: 0 microversion: 2.1 time: 0.428432 May 21 21:12:46.068571 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 366/732] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:12:45 2022] DELETE /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:12:46.073965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-34e77228-54f0-4ed7-8636-893c96e9affd tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:46.074801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-34e77228-54f0-4ed7-8636-893c96e9affd tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:46.082310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34e77228-54f0-4ed7-8636-893c96e9affd tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:46.082310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34e77228-54f0-4ed7-8636-893c96e9affd tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:46.083534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34e77228-54f0-4ed7-8636-893c96e9affd tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:46.084058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34e77228-54f0-4ed7-8636-893c96e9affd tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:46.108321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-958bc570-cef8-459e-97a1-ce8bd96c366a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:46.115974 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-958bc570-cef8-459e-97a1-ce8bd96c366a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1313 microversion: 2.1 time: 0.374412 May 21 21:12:46.117424 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 367/733] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:45 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:46.122156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4bf7c139-5113-45d6-adda-8da7aa694158 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:46.122945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4bf7c139-5113-45d6-adda-8da7aa694158 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:46.131765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bf7c139-5113-45d6-adda-8da7aa694158 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:46.132232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bf7c139-5113-45d6-adda-8da7aa694158 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:46.133049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bf7c139-5113-45d6-adda-8da7aa694158 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:46.133494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bf7c139-5113-45d6-adda-8da7aa694158 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:46.422702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4bf7c139-5113-45d6-adda-8da7aa694158 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:46.431752 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4bf7c139-5113-45d6-adda-8da7aa694158 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1371 microversion: 2.1 time: 0.312911 May 21 21:12:46.436482 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 368/734] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:46 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1371 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:46.444766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d8c86d91-1547-4ddc-b4e8-8767ab8c27a7 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:46.445527 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d8c86d91-1547-4ddc-b4e8-8767ab8c27a7 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:46.454286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8c86d91-1547-4ddc-b4e8-8767ab8c27a7 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:46.454286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8c86d91-1547-4ddc-b4e8-8767ab8c27a7 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:46.454286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8c86d91-1547-4ddc-b4e8-8767ab8c27a7 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:46.455020 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8c86d91-1547-4ddc-b4e8-8767ab8c27a7 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:46.654831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-34e77228-54f0-4ed7-8636-893c96e9affd tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:46.671504 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-34e77228-54f0-4ed7-8636-893c96e9affd tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 200 len: 1714 microversion: 2.1 time: 0.604676 May 21 21:12:46.672547 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 367/735] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:46 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 1714 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:46.687790 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bff2b7be-adb8-46e5-8df9-90dbd45ac152 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:46.688751 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bff2b7be-adb8-46e5-8df9-90dbd45ac152 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:46.702371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bff2b7be-adb8-46e5-8df9-90dbd45ac152 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:46.706455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bff2b7be-adb8-46e5-8df9-90dbd45ac152 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:46.707701 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bff2b7be-adb8-46e5-8df9-90dbd45ac152 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:46.708327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bff2b7be-adb8-46e5-8df9-90dbd45ac152 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:46.725326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d8c86d91-1547-4ddc-b4e8-8767ab8c27a7 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:46.733335 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d8c86d91-1547-4ddc-b4e8-8767ab8c27a7 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3" status: 200 len: 1526 microversion: 2.1 time: 0.299798 May 21 21:12:46.735110 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 369/736] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:46 2022] GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3 => generated 1526 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:46.751908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a81ec0a0-5174-42f4-b72d-2abfaadf348d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:46.754187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a81ec0a0-5174-42f4-b72d-2abfaadf348d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:46.768898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a81ec0a0-5174-42f4-b72d-2abfaadf348d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:46.769621 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a81ec0a0-5174-42f4-b72d-2abfaadf348d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:46.770589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a81ec0a0-5174-42f4-b72d-2abfaadf348d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:46.771191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a81ec0a0-5174-42f4-b72d-2abfaadf348d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:46.978286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a81ec0a0-5174-42f4-b72d-2abfaadf348d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:46.989645 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a81ec0a0-5174-42f4-b72d-2abfaadf348d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:46.991470 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a81ec0a0-5174-42f4-b72d-2abfaadf348d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:46.993235 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a81ec0a0-5174-42f4-b72d-2abfaadf348d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1566 microversion: 2.25 time: 0.256536 May 21 21:12:46.995243 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 370/737] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:46 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1566 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:47.002186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a3610f85-a2d0-4480-9e21-763eb45b885d tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:47.003292 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a3610f85-a2d0-4480-9e21-763eb45b885d tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] [instance: 23d169f8-72b8-4928-b109-7d948fe70b9a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:47.020751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3610f85-a2d0-4480-9e21-763eb45b885d tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:47.021126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3610f85-a2d0-4480-9e21-763eb45b885d tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:47.022103 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3610f85-a2d0-4480-9e21-763eb45b885d tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:47.022710 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3610f85-a2d0-4480-9e21-763eb45b885d tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:47.040565 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-a3610f85-a2d0-4480-9e21-763eb45b885d tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] HTTP exception thrown: Instance 23d169f8-72b8-4928-b109-7d948fe70b9a could not be found. May 21 21:12:47.049695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a3610f85-a2d0-4480-9e21-763eb45b885d tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Request method failure captured: May 21 21:12:47.049695 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a HTTP/1.1 May 21 21:12:47.049695 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:12:47.049695 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:12:47.049695 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:12:47.049695 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:12:47.049695 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:12:47.049695 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:12:47.049695 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:12:47.049695 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:12:47.049695 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVV8dsE2RQF6hiBN_tkwzE0k_ChXgfIpRji6E88QHXKJWiZU9rrouLTBLW5aUXaH1A5zkH4ULEmEtQpbFpseUjF4w_vX62Q5XwBBUxwi1cmzMe9GEeGz-oztF9VT1j7ehjYWPUymKeKSocubM3UxzTUaOCDvJ_DdcoEY4zocr2Zc43A May 21 21:12:47.049695 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:12:47.049695 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:12:47.049695 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:12:47.049695 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:12:47.049695 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:12:47.049695 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:12:47.049695 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: a16dae1aa89c4a86ad50273a1b3b08d8 May 21 21:12:47.049695 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-LiveMigrationNegativeTest-791937 May 21 21:12:47.049695 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:12:47.049695 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:12:47.053760 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a16dae1aa89c4a86ad50273a1b3b08d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a16dae1aa89c4a86ad50273a1b3b08d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a16dae1aa89c4a86ad50273a1b3b08d8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a16dae1aa89c4a86ad50273a1b3b08d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:12:47.053760 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-LiveMigrationNegativeTest-791937 May 21 21:12:47.053760 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: a16dae1aa89c4a86ad50273a1b3b08d8 May 21 21:12:47.053760 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-791937 May 21 21:12:47.053760 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-LiveMigrationNegativeTest-791937-project May 21 21:12:47.053760 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:12:47.053760 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:12:47.053760 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 4e7423d4ddfc46e390db2fc5fadac7f9 May 21 21:12:47.053760 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-LiveMigrationNegativeTest-791937-project May 21 21:12:47.053760 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:12:47.053760 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 23d169f8-72b8-4928-b109-7d948fe70b9a could not be found. May 21 21:12:47.053760 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '23d169f8-72b8-4928-b109-7d948fe70b9a'} May 21 21:12:47.056246 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:12:47.056246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:47.056246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:12:47.056246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:12:47.056246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:12:47.056246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:12:47.056246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:12:47.056246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:12:47.056246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:12:47.056246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:12:47.056246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23d169f8-72b8-4928-b109-7d948fe70b9a could not be found. May 21 21:12:47.056246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:47.056246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:47.056246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:47.056246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:47.056246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:47.056246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:47.056246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:12:47.056246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:12:47.056246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:12:47.058027 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:12:47.058027 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:12:47.058027 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:12:47.058027 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:12:47.058027 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:12:47.058027 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:12:47.058027 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:12:47.058027 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23d169f8-72b8-4928-b109-7d948fe70b9a could not be found. May 21 21:12:47.058027 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:47.058027 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:47.058027 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:47.058027 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:47.058027 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:47.058027 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:47.058027 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:12:47.058027 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:12:47.058027 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23d169f8-72b8-4928-b109-7d948fe70b9a could not be found. May 21 21:12:47.058027 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:47.060056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a3610f85-a2d0-4480-9e21-763eb45b885d tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] Returning 404 to user: Instance 23d169f8-72b8-4928-b109-7d948fe70b9a could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:12:47.060056 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a3610f85-a2d0-4480-9e21-763eb45b885d tempest-LiveMigrationNegativeTest-791937 tempest-LiveMigrationNegativeTest-791937-project] 10.222.0.49 "GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a" status: 404 len: 111 microversion: 2.1 time: 0.054768 May 21 21:12:47.060056 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 371/738] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:46 2022] GET /compute/v2.1/servers/23d169f8-72b8-4928-b109-7d948fe70b9a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:12:47.065844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-b87edae4-a06e-46bc-b3a6-092d96c39718 req-3f5998d5-1561-4cea-af7f-c59c8f93f497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1861c5f-d59a-4d75-9849-ecd40aeb32fe", "name": "network-vif-plugged", "status": "completed", "tag": "f0278179-1509-4b53-9291-18dd7c351135"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:47.071636 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b87edae4-a06e-46bc-b3a6-092d96c39718 req-3f5998d5-1561-4cea-af7f-c59c8f93f497 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:47.072014 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b87edae4-a06e-46bc-b3a6-092d96c39718 req-3f5998d5-1561-4cea-af7f-c59c8f93f497 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:47.090094 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-b87edae4-a06e-46bc-b3a6-092d96c39718 req-3f5998d5-1561-4cea-af7f-c59c8f93f497 service nova] Creating event network-vif-plugged:f0278179-1509-4b53-9291-18dd7c351135 for instance d1861c5f-d59a-4d75-9849-ecd40aeb32fe on nch2-master-1 May 21 21:12:47.096346 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-b87edae4-a06e-46bc-b3a6-092d96c39718 req-3f5998d5-1561-4cea-af7f-c59c8f93f497 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038682 May 21 21:12:47.097366 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 372/739] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:47.105482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-3e39f3a1-4f42-42be-80d5-09016aa371b8 req-22e504af-6d94-49ee-a4bb-9d936c2df997 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a995b92-640c-4b35-96a4-abd23d9995e6", "tag": "5dcfbf23-d7d5-46ab-8767-b5c1c927ce65"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:47.109752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:47.117314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bff2b7be-adb8-46e5-8df9-90dbd45ac152 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:47.117872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3e39f3a1-4f42-42be-80d5-09016aa371b8 req-22e504af-6d94-49ee-a4bb-9d936c2df997 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:47.118327 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3e39f3a1-4f42-42be-80d5-09016aa371b8 req-22e504af-6d94-49ee-a4bb-9d936c2df997 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:47.128832 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bff2b7be-adb8-46e5-8df9-90dbd45ac152 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1311 microversion: 2.1 time: 0.455115 May 21 21:12:47.133001 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 368/740] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:46 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1311 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:47.143563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-087b3adf-88d7-44ac-b066-f2bfb631a964 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:47.144449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-087b3adf-88d7-44ac-b066-f2bfb631a964 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:47.144954 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-3e39f3a1-4f42-42be-80d5-09016aa371b8 req-22e504af-6d94-49ee-a4bb-9d936c2df997 service nova] Creating event network-changed:5dcfbf23-d7d5-46ab-8767-b5c1c927ce65 for instance 5a995b92-640c-4b35-96a4-abd23d9995e6 on nch2-master-1 May 21 21:12:47.151613 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-3e39f3a1-4f42-42be-80d5-09016aa371b8 req-22e504af-6d94-49ee-a4bb-9d936c2df997 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052235 May 21 21:12:47.152636 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 373/741] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:47.162216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-087b3adf-88d7-44ac-b066-f2bfb631a964 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:47.163012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-087b3adf-88d7-44ac-b066-f2bfb631a964 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:47.164137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-087b3adf-88d7-44ac-b066-f2bfb631a964 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:47.164819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-087b3adf-88d7-44ac-b066-f2bfb631a964 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:47.451786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3df7bf52-0c3d-4060-bf7b-828505062ad6 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:47.453342 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3df7bf52-0c3d-4060-bf7b-828505062ad6 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:47.470045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3df7bf52-0c3d-4060-bf7b-828505062ad6 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:47.471588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3df7bf52-0c3d-4060-bf7b-828505062ad6 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:47.473964 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3df7bf52-0c3d-4060-bf7b-828505062ad6 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:47.474749 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3df7bf52-0c3d-4060-bf7b-828505062ad6 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:48.034164 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-087b3adf-88d7-44ac-b066-f2bfb631a964 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:48.042181 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-087b3adf-88d7-44ac-b066-f2bfb631a964 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1313 microversion: 2.1 time: 0.907858 May 21 21:12:48.042802 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 369/742] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:47 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1313 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:48.047424 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-999b2fc9-4c58-4054-9486-c20528f5808d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:48.048196 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-999b2fc9-4c58-4054-9486-c20528f5808d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:48.054797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-999b2fc9-4c58-4054-9486-c20528f5808d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:48.055256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-999b2fc9-4c58-4054-9486-c20528f5808d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:48.056053 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-999b2fc9-4c58-4054-9486-c20528f5808d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:48.056532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-999b2fc9-4c58-4054-9486-c20528f5808d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:48.185529 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-999b2fc9-4c58-4054-9486-c20528f5808d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:48.201175 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-999b2fc9-4c58-4054-9486-c20528f5808d tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 200 len: 1646 microversion: 2.1 time: 0.157187 May 21 21:12:48.210578 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 370/743] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:48 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 1646 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:48.211096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4b86df39-8aa1-479f-9c92-2731e2115e99 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:48.212061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4b86df39-8aa1-479f-9c92-2731e2115e99 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:48.220364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4b86df39-8aa1-479f-9c92-2731e2115e99 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:48.221127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4b86df39-8aa1-479f-9c92-2731e2115e99 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:48.224070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4b86df39-8aa1-479f-9c92-2731e2115e99 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:48.224611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4b86df39-8aa1-479f-9c92-2731e2115e99 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:48.413733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3df7bf52-0c3d-4060-bf7b-828505062ad6 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:48.428492 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3df7bf52-0c3d-4060-bf7b-828505062ad6 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1371 microversion: 2.1 time: 0.981714 May 21 21:12:48.444684 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 374/744] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:47 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1371 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:12:48.467951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e9054869-4c05-4723-9758-f5dba1ddcacf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:48.469311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e9054869-4c05-4723-9758-f5dba1ddcacf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:48.477894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9054869-4c05-4723-9758-f5dba1ddcacf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:48.478656 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9054869-4c05-4723-9758-f5dba1ddcacf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:48.479915 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9054869-4c05-4723-9758-f5dba1ddcacf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:48.480630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9054869-4c05-4723-9758-f5dba1ddcacf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:48.658720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4b86df39-8aa1-479f-9c92-2731e2115e99 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:48.678618 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4b86df39-8aa1-479f-9c92-2731e2115e99 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3" status: 200 len: 1526 microversion: 2.1 time: 0.468573 May 21 21:12:48.679846 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 371/745] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:48 2022] GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3 => generated 1526 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:48.694236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-53b7f41e-2222-4842-8b55-b693fd1bae57 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:48.695117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-53b7f41e-2222-4842-8b55-b693fd1bae57 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:48.713226 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53b7f41e-2222-4842-8b55-b693fd1bae57 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:48.721343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53b7f41e-2222-4842-8b55-b693fd1bae57 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:48.721343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53b7f41e-2222-4842-8b55-b693fd1bae57 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:48.721343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53b7f41e-2222-4842-8b55-b693fd1bae57 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:48.974813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-53b7f41e-2222-4842-8b55-b693fd1bae57 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:48.985288 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-53b7f41e-2222-4842-8b55-b693fd1bae57 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1311 microversion: 2.1 time: 0.302886 May 21 21:12:48.989922 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 372/746] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:48 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1311 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:48.991273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-63860b70-8ce9-4c38-9006-c4b1c6af2a4c req-c20daf0d-7db9-4fb9-9793-410723761d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a046a9e9-4485-4d77-9f5c-62410cf739f5", "name": "network-vif-deleted", "tag": "7dab2225-b424-4882-a428-97b3ef334ec1"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:49.001712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-63860b70-8ce9-4c38-9006-c4b1c6af2a4c req-c20daf0d-7db9-4fb9-9793-410723761d8b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:49.002401 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-63860b70-8ce9-4c38-9006-c4b1c6af2a4c req-c20daf0d-7db9-4fb9-9793-410723761d8b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:49.018651 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-63860b70-8ce9-4c38-9006-c4b1c6af2a4c req-c20daf0d-7db9-4fb9-9793-410723761d8b service nova] Creating event network-vif-deleted:7dab2225-b424-4882-a428-97b3ef334ec1 for instance a046a9e9-4485-4d77-9f5c-62410cf739f5 on nch1-master-1 May 21 21:12:49.026017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e9054869-4c05-4723-9758-f5dba1ddcacf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:49.047018 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-63860b70-8ce9-4c38-9006-c4b1c6af2a4c req-c20daf0d-7db9-4fb9-9793-410723761d8b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050357 May 21 21:12:49.048212 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 373/747] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:49.048434 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e9054869-4c05-4723-9758-f5dba1ddcacf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:49.050600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e9054869-4c05-4723-9758-f5dba1ddcacf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:49.082880 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e9054869-4c05-4723-9758-f5dba1ddcacf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1556 microversion: 2.25 time: 0.630463 May 21 21:12:49.087674 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 375/748] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:48 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1556 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:49.095617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ca590274-532c-4078-9c3f-1185bbc67fd5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:49.096719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ca590274-532c-4078-9c3f-1185bbc67fd5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:49.112633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9ed2a24c-a02e-44ae-bdcb-e898e38467d6 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '.version_select at 0x7fc81b808c10>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:49.121899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ed2a24c-a02e-44ae-bdcb-e898e38467d6 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:49.125915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca590274-532c-4078-9c3f-1185bbc67fd5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:49.127843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ed2a24c-a02e-44ae-bdcb-e898e38467d6 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:49.136749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca590274-532c-4078-9c3f-1185bbc67fd5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:49.139138 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca590274-532c-4078-9c3f-1185bbc67fd5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:49.141434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca590274-532c-4078-9c3f-1185bbc67fd5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:49.165639 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9ed2a24c-a02e-44ae-bdcb-e898e38467d6 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 1524 microversion: 2.25 time: 0.064147 May 21 21:12:49.172940 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 376/749] 10.222.0.49 () {60 vars in 1183 bytes} [Sat May 21 21:12:49 2022] GET /compute/v2.1/os-migrations => generated 1524 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:12:49.179986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-16625733-2218-4704-bc5c-b68c7e9a3cc1 req-f51cf52c-db6d-4440-b2e6-7c97b45a3a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201a83df-62c1-4804-b9d2-1cee0b7a7013", "name": "network-vif-plugged", "status": "completed", "tag": "30c8503a-ba5d-4891-802d-ebdb59c1d865"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:49.189850 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-16625733-2218-4704-bc5c-b68c7e9a3cc1 req-f51cf52c-db6d-4440-b2e6-7c97b45a3a7e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:49.190588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-16625733-2218-4704-bc5c-b68c7e9a3cc1 req-f51cf52c-db6d-4440-b2e6-7c97b45a3a7e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:49.237851 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-16625733-2218-4704-bc5c-b68c7e9a3cc1 req-f51cf52c-db6d-4440-b2e6-7c97b45a3a7e service nova] Creating event network-vif-plugged:30c8503a-ba5d-4891-802d-ebdb59c1d865 for instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 on nch2-master-1 May 21 21:12:49.258400 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-16625733-2218-4704-bc5c-b68c7e9a3cc1 req-f51cf52c-db6d-4440-b2e6-7c97b45a3a7e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083951 May 21 21:12:49.259650 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 377/750] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:49.266496 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ffae973f-b563-41ed-a255-bdc7b56e5a5b tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:49.268463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ffae973f-b563-41ed-a255-bdc7b56e5a5b tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:49.281963 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffae973f-b563-41ed-a255-bdc7b56e5a5b tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:49.284912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffae973f-b563-41ed-a255-bdc7b56e5a5b tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:49.285909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffae973f-b563-41ed-a255-bdc7b56e5a5b tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:49.286772 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffae973f-b563-41ed-a255-bdc7b56e5a5b tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:49.577563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ca590274-532c-4078-9c3f-1185bbc67fd5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:49.591545 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ca590274-532c-4078-9c3f-1185bbc67fd5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1313 microversion: 2.1 time: 0.524456 May 21 21:12:49.604251 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 374/751] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:49 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1313 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:49.613163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d3414948-8c04-4e9a-9ef2-c4d45d58c52f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:49.613795 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d3414948-8c04-4e9a-9ef2-c4d45d58c52f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:49.620096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3414948-8c04-4e9a-9ef2-c4d45d58c52f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:49.621487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3414948-8c04-4e9a-9ef2-c4d45d58c52f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:49.622318 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3414948-8c04-4e9a-9ef2-c4d45d58c52f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:49.622763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3414948-8c04-4e9a-9ef2-c4d45d58c52f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:49.661259 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3414948-8c04-4e9a-9ef2-c4d45d58c52f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:49.661719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3414948-8c04-4e9a-9ef2-c4d45d58c52f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:49.662442 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-d3414948-8c04-4e9a-9ef2-c4d45d58c52f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lazy-loading 'fault' on Instance uuid a046a9e9-4485-4d77-9f5c-62410cf739f5 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:49.740489 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d3414948-8c04-4e9a-9ef2-c4d45d58c52f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef64531c9da4be5939447edd0d5b78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7555e458ef4971822c6265ce3fd07b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:49.772631 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d3414948-8c04-4e9a-9ef2-c4d45d58c52f tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 200 len: 1354 microversion: 2.1 time: 0.163080 May 21 21:12:49.774629 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 375/752] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:49 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 1354 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:49.789146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-be88a4f0-b3a3-4222-8044-0cb56aa0d15e tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:49.796820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-be88a4f0-b3a3-4222-8044-0cb56aa0d15e tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:49.818671 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be88a4f0-b3a3-4222-8044-0cb56aa0d15e tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:49.821858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be88a4f0-b3a3-4222-8044-0cb56aa0d15e tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:49.823838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be88a4f0-b3a3-4222-8044-0cb56aa0d15e tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:49.824755 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be88a4f0-b3a3-4222-8044-0cb56aa0d15e tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:50.065438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-ffae973f-b563-41ed-a255-bdc7b56e5a5b tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lazy-loading 'services' on Instance uuid 99d32d33-c3d7-4c41-a4cf-f804fac41120 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:50.088196 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ffae973f-b563-41ed-a255-bdc7b56e5a5b tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 2048 microversion: 2.25 time: 0.826900 May 21 21:12:50.089662 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 378/753] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:49 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 2048 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:50.097166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-81fbdafa-73b6-4d23-ada5-ac2c56683687 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:50.098085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-81fbdafa-73b6-4d23-ada5-ac2c56683687 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:50.119586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81fbdafa-73b6-4d23-ada5-ac2c56683687 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:50.120144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81fbdafa-73b6-4d23-ada5-ac2c56683687 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:50.137557 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81fbdafa-73b6-4d23-ada5-ac2c56683687 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:50.145512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81fbdafa-73b6-4d23-ada5-ac2c56683687 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:50.189299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-be88a4f0-b3a3-4222-8044-0cb56aa0d15e tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:50.202013 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-be88a4f0-b3a3-4222-8044-0cb56aa0d15e tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1371 microversion: 2.1 time: 0.420265 May 21 21:12:50.203266 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 376/754] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:49 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1371 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:50.210251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-81f71e80-5a05-41a6-af32-545e3b3e24de tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:50.216087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-81f71e80-5a05-41a6-af32-545e3b3e24de tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:50.236559 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81f71e80-5a05-41a6-af32-545e3b3e24de tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:50.240930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81f71e80-5a05-41a6-af32-545e3b3e24de tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:50.242417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81f71e80-5a05-41a6-af32-545e3b3e24de tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:50.245316 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81f71e80-5a05-41a6-af32-545e3b3e24de tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:50.639352 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-81fbdafa-73b6-4d23-ada5-ac2c56683687 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:50.647930 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-81fbdafa-73b6-4d23-ada5-ac2c56683687 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3" status: 200 len: 1484 microversion: 2.1 time: 0.555115 May 21 21:12:50.659957 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 379/755] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:50 2022] GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3 => generated 1484 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:50.666208 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-e7b71dfd-b662-40e4-ab02-50ee91c8dfe3 req-6e409ab6-96d3-4f23-ac78-d9639f1cae07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3935c27-84ef-41ff-adbf-9e4b29eea5d3", "name": "network-vif-deleted", "tag": "a3199f1f-7536-444f-ab94-2847aeee7a78"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:50.711257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-81f71e80-5a05-41a6-af32-545e3b3e24de tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:50.717011 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e7b71dfd-b662-40e4-ab02-50ee91c8dfe3 req-6e409ab6-96d3-4f23-ac78-d9639f1cae07 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:50.718324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e7b71dfd-b662-40e4-ab02-50ee91c8dfe3 req-6e409ab6-96d3-4f23-ac78-d9639f1cae07 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:50.731193 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-81f71e80-5a05-41a6-af32-545e3b3e24de tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1495 microversion: 2.1 time: 0.525687 May 21 21:12:50.732781 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 377/756] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:50 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1495 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:50.736968 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-e7b71dfd-b662-40e4-ab02-50ee91c8dfe3 req-6e409ab6-96d3-4f23-ac78-d9639f1cae07 service nova] Creating event network-vif-deleted:a3199f1f-7536-444f-ab94-2847aeee7a78 for instance c3935c27-84ef-41ff-adbf-9e4b29eea5d3 on nch2-master-1 May 21 21:12:50.742678 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-e7b71dfd-b662-40e4-ab02-50ee91c8dfe3 req-6e409ab6-96d3-4f23-ac78-d9639f1cae07 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080792 May 21 21:12:50.744609 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 380/757] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:50.752587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0ca0c379-9819-4acc-8674-d52115663513 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:50.752690 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dd687c19-5485-41a6-91a6-57d50b4cab81 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-289233989", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "4418fa8f-36c6-43c9-9df7-37213ff858a6"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:50.752797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0ca0c379-9819-4acc-8674-d52115663513 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:50.763191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ca0c379-9819-4acc-8674-d52115663513 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:50.763671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ca0c379-9819-4acc-8674-d52115663513 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:50.764596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ca0c379-9819-4acc-8674-d52115663513 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:50.765649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ca0c379-9819-4acc-8674-d52115663513 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:50.773563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:50.825432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-dd687c19-5485-41a6-91a6-57d50b4cab81 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] validate_networks() for [('4418fa8f-36c6-43c9-9df7-37213ff858a6', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:12:50.956014 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0ca0c379-9819-4acc-8674-d52115663513 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:50.964758 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0ca0c379-9819-4acc-8674-d52115663513 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1313 microversion: 2.1 time: 0.218673 May 21 21:12:50.965585 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 381/758] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:50 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:50.971140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b80abf9c-a5d0-4078-96d6-4b5be3ad6c6a tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:50.975560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b80abf9c-a5d0-4078-96d6-4b5be3ad6c6a tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:50.978684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b80abf9c-a5d0-4078-96d6-4b5be3ad6c6a tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:50.979147 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b80abf9c-a5d0-4078-96d6-4b5be3ad6c6a tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:50.979938 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b80abf9c-a5d0-4078-96d6-4b5be3ad6c6a tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:50.980580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b80abf9c-a5d0-4078-96d6-4b5be3ad6c6a tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:51.348721 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b80abf9c-a5d0-4078-96d6-4b5be3ad6c6a tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1646 microversion: 2.1 time: 0.381325 May 21 21:12:51.361956 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 382/759] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:50 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1646 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:51.368458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-da0d3e0b-1313-4a59-b482-4ab94b1cdc52 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:51.369265 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-da0d3e0b-1313-4a59-b482-4ab94b1cdc52 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:51.376042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da0d3e0b-1313-4a59-b482-4ab94b1cdc52 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:51.376754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da0d3e0b-1313-4a59-b482-4ab94b1cdc52 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:51.377550 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da0d3e0b-1313-4a59-b482-4ab94b1cdc52 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:51.377998 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da0d3e0b-1313-4a59-b482-4ab94b1cdc52 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:51.395051 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-da0d3e0b-1313-4a59-b482-4ab94b1cdc52 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] HTTP exception thrown: Instance a046a9e9-4485-4d77-9f5c-62410cf739f5 could not be found. May 21 21:12:51.397201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-da0d3e0b-1313-4a59-b482-4ab94b1cdc52 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Request method failure captured: May 21 21:12:51.397201 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 HTTP/1.1 May 21 21:12:51.397201 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:12:51.397201 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:12:51.397201 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:12:51.397201 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:12:51.397201 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:12:51.397201 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:12:51.397201 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:12:51.397201 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:12:51.397201 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVUwiPSy3Qc0sPwh_F0fXwkyAVDau_Yw9s7_QI5u6OYJ3x_XNNWkVgVvafZTt95_0QoEmvlp_lpCfQa-Mz8DaQreziG6QsgKg4Y34zTZ_mCkW3uxLNL1RH_WvyPiNvM_bBRQaiH8ACCxcxcXh2N3HjC2qk6TqqKJLzFTCcd-V55SrfI May 21 21:12:51.397201 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:12:51.397201 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:12:51.397201 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:12:51.397201 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:12:51.397201 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:12:51.397201 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:12:51.397201 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: fd7555e458ef4971822c6265ce3fd07b May 21 21:12:51.397201 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1907068961 May 21 21:12:51.397201 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:12:51.397201 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:12:51.398863 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd7555e458ef4971822c6265ce3fd07b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd7555e458ef4971822c6265ce3fd07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd7555e458ef4971822c6265ce3fd07b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd7555e458ef4971822c6265ce3fd07b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:12:51.398863 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1907068961 May 21 21:12:51.398863 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: fd7555e458ef4971822c6265ce3fd07b May 21 21:12:51.398863 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1907068961 May 21 21:12:51.398863 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1907068961-project May 21 21:12:51.398863 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:12:51.398863 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:12:51.398863 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 0ef64531c9da4be5939447edd0d5b78d May 21 21:12:51.398863 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1907068961-project May 21 21:12:51.398863 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:12:51.398863 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance a046a9e9-4485-4d77-9f5c-62410cf739f5 could not be found. May 21 21:12:51.398863 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'a046a9e9-4485-4d77-9f5c-62410cf739f5'} May 21 21:12:51.399787 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:12:51.399787 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:51.399787 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:12:51.399787 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:12:51.399787 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:12:51.399787 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:12:51.399787 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:12:51.399787 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:12:51.399787 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:12:51.399787 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:12:51.399787 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a046a9e9-4485-4d77-9f5c-62410cf739f5 could not be found. May 21 21:12:51.399787 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:51.399787 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:51.399787 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:51.399787 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:51.399787 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:51.399787 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:51.399787 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:12:51.399787 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:12:51.399787 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:12:51.401291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:12:51.401291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:12:51.401291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:12:51.401291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:12:51.401291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:12:51.401291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:12:51.401291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:12:51.401291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a046a9e9-4485-4d77-9f5c-62410cf739f5 could not be found. May 21 21:12:51.401291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:51.401291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:51.401291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:51.401291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:51.401291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:51.401291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:51.401291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:12:51.401291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:12:51.401291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a046a9e9-4485-4d77-9f5c-62410cf739f5 could not be found. May 21 21:12:51.401291 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:51.404722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-da0d3e0b-1313-4a59-b482-4ab94b1cdc52 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Returning 404 to user: Instance a046a9e9-4485-4d77-9f5c-62410cf739f5 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:12:51.405907 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-da0d3e0b-1313-4a59-b482-4ab94b1cdc52 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 404 len: 111 microversion: 2.1 time: 0.042556 May 21 21:12:51.410347 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 383/760] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:51 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:12:51.417300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-44ec4217-c5fd-4e9b-b2d7-df45fb31d4ac tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:51.418188 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-44ec4217-c5fd-4e9b-b2d7-df45fb31d4ac tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:51.427919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44ec4217-c5fd-4e9b-b2d7-df45fb31d4ac tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:51.428672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44ec4217-c5fd-4e9b-b2d7-df45fb31d4ac tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:51.429485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44ec4217-c5fd-4e9b-b2d7-df45fb31d4ac tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:51.429921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44ec4217-c5fd-4e9b-b2d7-df45fb31d4ac tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:51.628386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-44ec4217-c5fd-4e9b-b2d7-df45fb31d4ac tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:51.637908 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-44ec4217-c5fd-4e9b-b2d7-df45fb31d4ac tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1371 microversion: 2.1 time: 0.226204 May 21 21:12:51.647704 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 384/761] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:51 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:51.652685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-309c6028-3d71-4cb2-80ae-c6e3474def5e tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:51.653313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-309c6028-3d71-4cb2-80ae-c6e3474def5e tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:51.661200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-309c6028-3d71-4cb2-80ae-c6e3474def5e tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:51.661666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-309c6028-3d71-4cb2-80ae-c6e3474def5e tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:51.662473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-309c6028-3d71-4cb2-80ae-c6e3474def5e tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:51.662917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-309c6028-3d71-4cb2-80ae-c6e3474def5e tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:51.667978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:51.819239 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-309c6028-3d71-4cb2-80ae-c6e3474def5e tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1646 microversion: 2.1 time: 0.170180 May 21 21:12:51.820128 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 385/762] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:51 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1646 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:51.831048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-242d0e7d-0c07-4c3e-912a-4b4b52b7d314 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:51.831048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-242d0e7d-0c07-4c3e-912a-4b4b52b7d314 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:51.832797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-dd687c19-5485-41a6-91a6-57d50b4cab81 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:12:51.833261 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-dd687c19-5485-41a6-91a6-57d50b4cab81 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:12:51.833853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-dd687c19-5485-41a6-91a6-57d50b4cab81 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:12:51.834270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-dd687c19-5485-41a6-91a6-57d50b4cab81 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:12:51.834683 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-dd687c19-5485-41a6-91a6-57d50b4cab81 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:12:51.835058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-242d0e7d-0c07-4c3e-912a-4b4b52b7d314 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:51.835548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-242d0e7d-0c07-4c3e-912a-4b4b52b7d314 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:51.836434 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-242d0e7d-0c07-4c3e-912a-4b4b52b7d314 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:51.837002 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-242d0e7d-0c07-4c3e-912a-4b4b52b7d314 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:51.847319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd687c19-5485-41a6-91a6-57d50b4cab81 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:51.847679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd687c19-5485-41a6-91a6-57d50b4cab81 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:51.848616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd687c19-5485-41a6-91a6-57d50b4cab81 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:51.849009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd687c19-5485-41a6-91a6-57d50b4cab81 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:51.856731 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-242d0e7d-0c07-4c3e-912a-4b4b52b7d314 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] HTTP exception thrown: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. May 21 21:12:51.858955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-242d0e7d-0c07-4c3e-912a-4b4b52b7d314 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Request method failure captured: May 21 21:12:51.858955 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 HTTP/1.1 May 21 21:12:51.858955 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:12:51.858955 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:12:51.858955 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:12:51.858955 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:12:51.858955 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:12:51.858955 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:12:51.858955 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:12:51.858955 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:12:51.858955 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVUwiPSy3Qc0sPwh_F0fXwkyAVDau_Yw9s7_QI5u6OYJ3x_XNNWkVgVvafZTt95_0QoEmvlp_lpCfQa-Mz8DaQreziG6QsgKg4Y34zTZ_mCkW3uxLNL1RH_WvyPiNvM_bBRQaiH8ACCxcxcXh2N3HjC2qk6TqqKJLzFTCcd-V55SrfI May 21 21:12:51.858955 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:12:51.858955 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:12:51.858955 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:12:51.858955 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:12:51.858955 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:12:51.858955 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:12:51.858955 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: fd7555e458ef4971822c6265ce3fd07b May 21 21:12:51.858955 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1907068961 May 21 21:12:51.858955 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:12:51.858955 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:12:51.860313 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd7555e458ef4971822c6265ce3fd07b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd7555e458ef4971822c6265ce3fd07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd7555e458ef4971822c6265ce3fd07b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd7555e458ef4971822c6265ce3fd07b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:12:51.860313 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1907068961 May 21 21:12:51.860313 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: fd7555e458ef4971822c6265ce3fd07b May 21 21:12:51.860313 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1907068961 May 21 21:12:51.860313 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1907068961-project May 21 21:12:51.860313 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:12:51.860313 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:12:51.860313 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 0ef64531c9da4be5939447edd0d5b78d May 21 21:12:51.860313 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1907068961-project May 21 21:12:51.860313 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:12:51.860313 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. May 21 21:12:51.860313 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '78c22ee7-e0f1-4d96-bedb-559c91cd2f00'} May 21 21:12:51.861064 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:12:51.861064 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:51.861064 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:12:51.861064 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:12:51.861064 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:12:51.861064 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:12:51.861064 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:12:51.861064 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:12:51.861064 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:12:51.861064 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:12:51.861064 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. May 21 21:12:51.861064 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:51.861064 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:51.861064 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:51.861064 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:51.861064 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:51.861064 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:51.861064 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:12:51.861064 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:12:51.861064 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:12:51.862220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:12:51.862220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:12:51.862220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:12:51.862220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:12:51.862220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:12:51.862220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:12:51.862220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:12:51.862220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:12:51.862220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:12:51.862220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. May 21 21:12:51.862220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:51.862220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:51.862220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:51.862220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:51.862220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:51.862220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:51.862220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:12:51.862220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:12:51.862220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. May 21 21:12:51.862220 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:51.864752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-242d0e7d-0c07-4c3e-912a-4b4b52b7d314 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Returning 404 to user: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:12:51.865983 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-242d0e7d-0c07-4c3e-912a-4b4b52b7d314 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "DELETE /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 404 len: 111 microversion: 2.1 time: 0.044290 May 21 21:12:51.876968 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 386/763] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:12:51 2022] DELETE /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:12:51.885544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-dd687c19-5485-41a6-91a6-57d50b4cab81 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Getting quotas for project 220204ccbcf443c98a64994f29700ef0. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:12:51.886252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-382a405a-ed50-4e24-bfb1-0c3c57068510 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:51.887263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-382a405a-ed50-4e24-bfb1-0c3c57068510 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:51.894316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-382a405a-ed50-4e24-bfb1-0c3c57068510 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:51.895033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-382a405a-ed50-4e24-bfb1-0c3c57068510 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:51.896053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-382a405a-ed50-4e24-bfb1-0c3c57068510 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:51.896738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-382a405a-ed50-4e24-bfb1-0c3c57068510 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:51.898103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-dd687c19-5485-41a6-91a6-57d50b4cab81 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Getting quotas for user b7199de1e6f04147b197c086ac6cc6fc and project 220204ccbcf443c98a64994f29700ef0. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:12:51.921318 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dd687c19-5485-41a6-91a6-57d50b4cab81 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:12:51.924929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dd687c19-5485-41a6-91a6-57d50b4cab81 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:12:51.939015 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-382a405a-ed50-4e24-bfb1-0c3c57068510 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:51.939482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-382a405a-ed50-4e24-bfb1-0c3c57068510 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:51.940132 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-382a405a-ed50-4e24-bfb1-0c3c57068510 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lazy-loading 'fault' on Instance uuid c3935c27-84ef-41ff-adbf-9e4b29eea5d3 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:52.033116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-382a405a-ed50-4e24-bfb1-0c3c57068510 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74f296ea42634e18ad82ee175408c641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c99e1f900034d42bbb1a786b225a230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:52.050444 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-382a405a-ed50-4e24-bfb1-0c3c57068510 tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3" status: 200 len: 1313 microversion: 2.1 time: 0.169264 May 21 21:12:52.062228 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 387/764] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:51 2022] GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:52.068432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-00e1ba91-ca0f-4778-8839-177671cf0fff tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:52.069957 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:12:52.069957 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:12:52.072393 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00e1ba91-ca0f-4778-8839-177671cf0fff tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:52.072927 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00e1ba91-ca0f-4778-8839-177671cf0fff tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:52.073969 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00e1ba91-ca0f-4778-8839-177671cf0fff tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:52.074487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00e1ba91-ca0f-4778-8839-177671cf0fff tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:52.104482 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-00e1ba91-ca0f-4778-8839-177671cf0fff tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040009 May 21 21:12:52.105667 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 388/765] 10.222.0.49 () {58 vars in 1175 bytes} [Sat May 21 21:12:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:52.116038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eea747c3-ef72-4ea0-bccd-74100c0c74a1 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:52.116688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-eea747c3-ef72-4ea0-bccd-74100c0c74a1 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:52.123817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eea747c3-ef72-4ea0-bccd-74100c0c74a1 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:52.124316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eea747c3-ef72-4ea0-bccd-74100c0c74a1 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:52.125195 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eea747c3-ef72-4ea0-bccd-74100c0c74a1 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:52.125629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eea747c3-ef72-4ea0-bccd-74100c0c74a1 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:52.135743 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dd687c19-5485-41a6-91a6-57d50b4cab81 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.401764 May 21 21:12:52.136694 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 378/766] 10.222.0.49 () {62 vars in 1187 bytes} [Sat May 21 21:12:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1403 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 21 21:12:52.144953 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-efe6cb93-3034-48cd-8603-ed08c821f926 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:52.150026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-efe6cb93-3034-48cd-8603-ed08c821f926 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:52.162633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efe6cb93-3034-48cd-8603-ed08c821f926 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:52.163101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efe6cb93-3034-48cd-8603-ed08c821f926 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:52.163907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efe6cb93-3034-48cd-8603-ed08c821f926 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:52.164376 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efe6cb93-3034-48cd-8603-ed08c821f926 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:52.166969 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-eea747c3-ef72-4ea0-bccd-74100c0c74a1 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] HTTP exception thrown: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. May 21 21:12:52.175321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eea747c3-ef72-4ea0-bccd-74100c0c74a1 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Request method failure captured: May 21 21:12:52.175321 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 HTTP/1.1 May 21 21:12:52.175321 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:12:52.175321 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:12:52.175321 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:12:52.175321 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:12:52.175321 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:12:52.175321 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:12:52.175321 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:12:52.175321 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:12:52.175321 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVUwiPSy3Qc0sPwh_F0fXwkyAVDau_Yw9s7_QI5u6OYJ3x_XNNWkVgVvafZTt95_0QoEmvlp_lpCfQa-Mz8DaQreziG6QsgKg4Y34zTZ_mCkW3uxLNL1RH_WvyPiNvM_bBRQaiH8ACCxcxcXh2N3HjC2qk6TqqKJLzFTCcd-V55SrfI May 21 21:12:52.175321 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:12:52.175321 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:12:52.175321 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:12:52.175321 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:12:52.175321 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:12:52.175321 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:12:52.175321 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: fd7555e458ef4971822c6265ce3fd07b May 21 21:12:52.175321 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1907068961 May 21 21:12:52.175321 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:12:52.175321 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:12:52.176760 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd7555e458ef4971822c6265ce3fd07b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd7555e458ef4971822c6265ce3fd07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd7555e458ef4971822c6265ce3fd07b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd7555e458ef4971822c6265ce3fd07b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:12:52.176760 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1907068961 May 21 21:12:52.176760 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: fd7555e458ef4971822c6265ce3fd07b May 21 21:12:52.176760 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1907068961 May 21 21:12:52.176760 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1907068961-project May 21 21:12:52.176760 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:12:52.176760 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:12:52.176760 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 0ef64531c9da4be5939447edd0d5b78d May 21 21:12:52.176760 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1907068961-project May 21 21:12:52.176760 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:12:52.176760 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. May 21 21:12:52.176760 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '78c22ee7-e0f1-4d96-bedb-559c91cd2f00'} May 21 21:12:52.177503 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:12:52.177503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:52.177503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:12:52.177503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:12:52.177503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:12:52.177503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:12:52.177503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:12:52.177503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:12:52.177503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:12:52.177503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:12:52.177503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. May 21 21:12:52.177503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:52.177503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:52.177503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:52.177503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:52.177503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:52.177503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:52.177503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:12:52.177503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:12:52.177503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:12:52.179033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:12:52.179033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:12:52.179033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:12:52.179033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:12:52.179033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:12:52.179033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:12:52.179033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:12:52.179033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. May 21 21:12:52.179033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:52.179033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:52.179033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:52.179033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:52.179033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:52.179033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:52.179033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:12:52.179033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:12:52.179033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. May 21 21:12:52.179033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:52.180217 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eea747c3-ef72-4ea0-bccd-74100c0c74a1 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Returning 404 to user: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:12:52.181513 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-eea747c3-ef72-4ea0-bccd-74100c0c74a1 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 404 len: 111 microversion: 2.1 time: 0.074659 May 21 21:12:52.182110 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 389/767] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:52 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:12:52.198423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fdffb902-d5d3-4051-adb5-01dffa2c0e77 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:52.198423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fdffb902-d5d3-4051-adb5-01dffa2c0e77 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:52.228837 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fdffb902-d5d3-4051-adb5-01dffa2c0e77 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:52.230230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fdffb902-d5d3-4051-adb5-01dffa2c0e77 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:52.231097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fdffb902-d5d3-4051-adb5-01dffa2c0e77 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:52.231547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fdffb902-d5d3-4051-adb5-01dffa2c0e77 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:52.534315 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fdffb902-d5d3-4051-adb5-01dffa2c0e77 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe/action" status: 202 len: 0 microversion: 2.1 time: 0.350844 May 21 21:12:52.535427 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 390/768] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:12:52 2022] POST /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:12:52.541845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ee849f2f-5ef6-4509-a856-281f6ac8e4d4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:52.542566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ee849f2f-5ef6-4509-a856-281f6ac8e4d4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:52.633057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ee849f2f-5ef6-4509-a856-281f6ac8e4d4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:52.643708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ee849f2f-5ef6-4509-a856-281f6ac8e4d4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:52.646379 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ee849f2f-5ef6-4509-a856-281f6ac8e4d4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:52.650938 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ee849f2f-5ef6-4509-a856-281f6ac8e4d4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1261 microversion: 2.25 time: 0.111498 May 21 21:12:52.650938 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 391/769] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:52 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1261 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:52.655441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e796a6dc-c201-4258-a534-4c66a5dae5ae tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '.version_select at 0x7fc81b8b0ca0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:52.776166 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e796a6dc-c201-4258-a534-4c66a5dae5ae tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1123155506" status: 202 len: 0 microversion: 2.1 time: 0.125517 May 21 21:12:52.777508 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 392/770] 10.222.0.49 () {58 vars in 1220 bytes} [Sat May 21 21:12:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1123155506 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:12:52.784858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3c56cb69-abbc-40eb-894f-4868cd3f9d6b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:52.785845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3c56cb69-abbc-40eb-894f-4868cd3f9d6b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:52.796024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3c56cb69-abbc-40eb-894f-4868cd3f9d6b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:52.797432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3c56cb69-abbc-40eb-894f-4868cd3f9d6b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:52.798628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3c56cb69-abbc-40eb-894f-4868cd3f9d6b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:52.799210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3c56cb69-abbc-40eb-894f-4868cd3f9d6b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:52.936936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-efe6cb93-3034-48cd-8603-ed08c821f926 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:52.951961 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-efe6cb93-3034-48cd-8603-ed08c821f926 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1313 microversion: 2.1 time: 0.813912 May 21 21:12:52.953206 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 379/771] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:52 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1313 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:52.965691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-41f25dd4-0c92-4ca0-b940-94cc4c38f179 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:52.970021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-41f25dd4-0c92-4ca0-b940-94cc4c38f179 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:52.998264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-41f25dd4-0c92-4ca0-b940-94cc4c38f179 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:53.000254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-41f25dd4-0c92-4ca0-b940-94cc4c38f179 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:53.001579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-41f25dd4-0c92-4ca0-b940-94cc4c38f179 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:53.005934 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-41f25dd4-0c92-4ca0-b940-94cc4c38f179 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:53.201582 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3c56cb69-abbc-40eb-894f-4868cd3f9d6b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1651 microversion: 2.1 time: 0.422562 May 21 21:12:53.204736 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 393/772] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:52 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1651 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:53.211578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-85217c93-ec42-4373-bccc-5dadce2f6b3a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:53.212198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-85217c93-ec42-4373-bccc-5dadce2f6b3a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] [instance: c3935c27-84ef-41ff-adbf-9e4b29eea5d3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:53.229786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-85217c93-ec42-4373-bccc-5dadce2f6b3a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:53.231438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-85217c93-ec42-4373-bccc-5dadce2f6b3a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:53.232480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-85217c93-ec42-4373-bccc-5dadce2f6b3a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:53.233125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-85217c93-ec42-4373-bccc-5dadce2f6b3a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:53.253814 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-85217c93-ec42-4373-bccc-5dadce2f6b3a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] HTTP exception thrown: Instance c3935c27-84ef-41ff-adbf-9e4b29eea5d3 could not be found. May 21 21:12:53.256178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-85217c93-ec42-4373-bccc-5dadce2f6b3a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Request method failure captured: May 21 21:12:53.256178 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3 HTTP/1.1 May 21 21:12:53.256178 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:12:53.256178 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:12:53.256178 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:12:53.256178 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:12:53.256178 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:12:53.256178 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:12:53.256178 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:12:53.256178 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:12:53.256178 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVpDBkS9K5pHFyv1XlqioW0P9eZZk_9X-B4sgaichiXR51l8haUp4vJjn70cKE_2K_VfbPPZsJsGr1xAY3eh4HDE-hFYM3re9EaunzR52vH2hltxndJ5h9YgnrzeA7ccnIdugc39yImBWPo33UJW0svJK37zeFXDOCybMyKPxcajjA May 21 21:12:53.256178 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:12:53.256178 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:12:53.256178 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:12:53.256178 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:12:53.256178 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:12:53.256178 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:12:53.256178 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 4c99e1f900034d42bbb1a786b225a230 May 21 21:12:53.256178 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1972717349 May 21 21:12:53.256178 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:12:53.256178 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:12:53.262191 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4c99e1f900034d42bbb1a786b225a230"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c99e1f900034d42bbb1a786b225a230"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4c99e1f900034d42bbb1a786b225a230", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c99e1f900034d42bbb1a786b225a230"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:12:53.262191 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1972717349 May 21 21:12:53.262191 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 4c99e1f900034d42bbb1a786b225a230 May 21 21:12:53.262191 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1972717349 May 21 21:12:53.262191 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-FloatingIPsAssociationTestJSON-1972717349-project May 21 21:12:53.262191 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:12:53.262191 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:12:53.262191 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 74f296ea42634e18ad82ee175408c641 May 21 21:12:53.262191 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1972717349-project May 21 21:12:53.262191 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:12:53.262191 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance c3935c27-84ef-41ff-adbf-9e4b29eea5d3 could not be found. May 21 21:12:53.262191 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'c3935c27-84ef-41ff-adbf-9e4b29eea5d3'} May 21 21:12:53.263050 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:12:53.263050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:53.263050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:12:53.263050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:12:53.263050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:12:53.263050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:12:53.263050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:12:53.263050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:12:53.263050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:12:53.263050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:12:53.263050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3935c27-84ef-41ff-adbf-9e4b29eea5d3 could not be found. May 21 21:12:53.263050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:53.263050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:53.263050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:53.263050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:53.263050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:53.263050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:53.263050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:12:53.263050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:12:53.263050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:12:53.264234 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:12:53.264234 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:12:53.264234 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:12:53.264234 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:12:53.264234 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:12:53.264234 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:12:53.264234 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:12:53.264234 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3935c27-84ef-41ff-adbf-9e4b29eea5d3 could not be found. May 21 21:12:53.264234 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:53.264234 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:53.264234 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:53.264234 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:53.264234 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:53.264234 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:53.264234 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:12:53.264234 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:12:53.264234 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3935c27-84ef-41ff-adbf-9e4b29eea5d3 could not be found. May 21 21:12:53.264234 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:53.267325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-85217c93-ec42-4373-bccc-5dadce2f6b3a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] Returning 404 to user: Instance c3935c27-84ef-41ff-adbf-9e4b29eea5d3 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:12:53.267325 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-85217c93-ec42-4373-bccc-5dadce2f6b3a tempest-FloatingIPsAssociationTestJSON-1972717349 tempest-FloatingIPsAssociationTestJSON-1972717349-project] 10.222.0.49 "GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3" status: 404 len: 111 microversion: 2.1 time: 0.052265 May 21 21:12:53.267325 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 394/773] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:53 2022] GET /compute/v2.1/servers/c3935c27-84ef-41ff-adbf-9e4b29eea5d3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:12:53.511083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-41f25dd4-0c92-4ca0-b940-94cc4c38f179 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:53.533347 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-41f25dd4-0c92-4ca0-b940-94cc4c38f179 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1557 microversion: 2.1 time: 0.565798 May 21 21:12:53.536766 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 380/774] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:52 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1557 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:53.555468 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0b3b36e1-7f2f-4b23-a397-dc97cc3473c8 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:53.556037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0b3b36e1-7f2f-4b23-a397-dc97cc3473c8 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:53.565466 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b3b36e1-7f2f-4b23-a397-dc97cc3473c8 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:53.565751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b3b36e1-7f2f-4b23-a397-dc97cc3473c8 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:53.570422 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b3b36e1-7f2f-4b23-a397-dc97cc3473c8 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:53.570422 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b3b36e1-7f2f-4b23-a397-dc97cc3473c8 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:53.672483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7e452658-9a87-41f0-b48d-1d04ffe6c728 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:53.673755 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7e452658-9a87-41f0-b48d-1d04ffe6c728 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:53.680887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e452658-9a87-41f0-b48d-1d04ffe6c728 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:53.681702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e452658-9a87-41f0-b48d-1d04ffe6c728 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:53.682724 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e452658-9a87-41f0-b48d-1d04ffe6c728 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:53.683997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e452658-9a87-41f0-b48d-1d04ffe6c728 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:53.828176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7e452658-9a87-41f0-b48d-1d04ffe6c728 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:53.831152 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0b3b36e1-7f2f-4b23-a397-dc97cc3473c8 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.281793 May 21 21:12:53.832234 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 395/775] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 21:12:53 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013/os-interface => generated 284 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:53.837405 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7e452658-9a87-41f0-b48d-1d04ffe6c728 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:53.845799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7e452658-9a87-41f0-b48d-1d04ffe6c728 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:53.845799 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7e452658-9a87-41f0-b48d-1d04ffe6c728 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1265 microversion: 2.25 time: 0.173329 May 21 21:12:53.845799 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 381/776] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:53 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:12:53.969875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-608baffa-28ea-4bbf-9c4c-60f25286c5b5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:53.970501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-608baffa-28ea-4bbf-9c4c-60f25286c5b5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:53.994235 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-608baffa-28ea-4bbf-9c4c-60f25286c5b5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:53.994707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-608baffa-28ea-4bbf-9c4c-60f25286c5b5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:53.997263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-608baffa-28ea-4bbf-9c4c-60f25286c5b5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:53.997263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-608baffa-28ea-4bbf-9c4c-60f25286c5b5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:54.219806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f2e8a001-9d24-43df-ab97-d5dc4843ce29 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:54.221706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f2e8a001-9d24-43df-ab97-d5dc4843ce29 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:54.242544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2e8a001-9d24-43df-ab97-d5dc4843ce29 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:54.243333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2e8a001-9d24-43df-ab97-d5dc4843ce29 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:54.256379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2e8a001-9d24-43df-ab97-d5dc4843ce29 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:54.257119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2e8a001-9d24-43df-ab97-d5dc4843ce29 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:54.687957 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:54.696567 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f2e8a001-9d24-43df-ab97-d5dc4843ce29 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1631 microversion: 2.1 time: 0.480325 May 21 21:12:54.708535 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 382/777] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:54 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1631 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:54.874192 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c23c9a2f-20be-4a75-ba94-b0fa2d16d73e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-2058011606", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "04b78a92-706b-4bf5-ae65-d20c8d1ef8cb"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:54.972046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-c23c9a2f-20be-4a75-ba94-b0fa2d16d73e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] validate_networks() for [('04b78a92-706b-4bf5-ae65-d20c8d1ef8cb', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:12:55.289592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-608baffa-28ea-4bbf-9c4c-60f25286c5b5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:55.303504 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-608baffa-28ea-4bbf-9c4c-60f25286c5b5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1313 microversion: 2.1 time: 1.337962 May 21 21:12:55.308453 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 396/778] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:53 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1313 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:55.462796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3664432e-a76e-4959-baa9-e83b57b06045 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-818898053", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:55.527178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-3664432e-a76e-4959-baa9-e83b57b06045 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] validate_networks() for None {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:12:55.861074 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c23c9a2f-20be-4a75-ba94-b0fa2d16d73e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:12:55.862154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c23c9a2f-20be-4a75-ba94-b0fa2d16d73e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:12:55.873646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c23c9a2f-20be-4a75-ba94-b0fa2d16d73e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:12:55.874232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c23c9a2f-20be-4a75-ba94-b0fa2d16d73e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:12:55.874792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c23c9a2f-20be-4a75-ba94-b0fa2d16d73e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:12:55.889194 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c23c9a2f-20be-4a75-ba94-b0fa2d16d73e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:55.893548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c23c9a2f-20be-4a75-ba94-b0fa2d16d73e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:55.894728 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c23c9a2f-20be-4a75-ba94-b0fa2d16d73e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:55.895233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c23c9a2f-20be-4a75-ba94-b0fa2d16d73e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:55.945534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-c23c9a2f-20be-4a75-ba94-b0fa2d16d73e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Getting quotas for project 5ae6bac4c6b146d8af30881b58e4138f. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:12:55.950128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-c23c9a2f-20be-4a75-ba94-b0fa2d16d73e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Getting quotas for user 95ddad8359564852b7116efb8d9b21fb and project 5ae6bac4c6b146d8af30881b58e4138f. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:12:55.968727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c23c9a2f-20be-4a75-ba94-b0fa2d16d73e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:12:55.970818 ncdv-master-1 devstack@n-api.service[131277]: WARNING nova.utils [None req-c23c9a2f-20be-4a75-ba94-b0fa2d16d73e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-2058011606 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-205801160 May 21 21:12:55.984812 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c23c9a2f-20be-4a75-ba94-b0fa2d16d73e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:12:56.103638 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c23c9a2f-20be-4a75-ba94-b0fa2d16d73e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.404504 May 21 21:12:56.110901 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 383/779] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:12:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:12:56.116560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-400c854d-a723-4bc2-9442-7e091dc8c449 tempest-ServersWithSpecificFlavorTestJSON-977658033 tempest-ServersWithSpecificFlavorTestJSON-977658033-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:56.117643 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:12:56.117643 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:12:56.240646 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-400c854d-a723-4bc2-9442-7e091dc8c449 tempest-ServersWithSpecificFlavorTestJSON-977658033 tempest-ServersWithSpecificFlavorTestJSON-977658033-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1337621487" status: 202 len: 0 microversion: 2.1 time: 0.127903 May 21 21:12:56.241385 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 384/780] 10.222.0.49 () {58 vars in 1160 bytes} [Sat May 21 21:12:56 2022] DELETE /compute/v2.1/flavors/1337621487 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:12:56.251739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a41aa8f0-9b8c-4ee8-a6ee-52a497936d9b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:56.253280 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a41aa8f0-9b8c-4ee8-a6ee-52a497936d9b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:56.288458 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a41aa8f0-9b8c-4ee8-a6ee-52a497936d9b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:56.288917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a41aa8f0-9b8c-4ee8-a6ee-52a497936d9b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:56.293670 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a41aa8f0-9b8c-4ee8-a6ee-52a497936d9b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:56.294128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a41aa8f0-9b8c-4ee8-a6ee-52a497936d9b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:56.368742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-a41aa8f0-9b8c-4ee8-a6ee-52a497936d9b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lazy-loading 'flavor' on Instance uuid d1861c5f-d59a-4d75-9849-ecd40aeb32fe {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:12:56.402160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-3664432e-a76e-4959-baa9-e83b57b06045 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:12:56.402651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a41aa8f0-9b8c-4ee8-a6ee-52a497936d9b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Going to try to live migrate instance to nch1-master-1 {{(pid=131277) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 21 21:12:56.402741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-3664432e-a76e-4959-baa9-e83b57b06045 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:12:56.403070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-3664432e-a76e-4959-baa9-e83b57b06045 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:12:56.403484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-3664432e-a76e-4959-baa9-e83b57b06045 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:12:56.403904 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-3664432e-a76e-4959-baa9-e83b57b06045 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:12:56.426241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3664432e-a76e-4959-baa9-e83b57b06045 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:56.426707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3664432e-a76e-4959-baa9-e83b57b06045 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:56.427523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3664432e-a76e-4959-baa9-e83b57b06045 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:56.427965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3664432e-a76e-4959-baa9-e83b57b06045 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:56.477107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-3664432e-a76e-4959-baa9-e83b57b06045 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Getting quotas for project 40b391d62af746e1918a37a9813444f4. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:12:56.486934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-3664432e-a76e-4959-baa9-e83b57b06045 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Getting quotas for user e29ca91cfd3d49cb87a18a1eeb968c42 and project 40b391d62af746e1918a37a9813444f4. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:12:56.517402 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3664432e-a76e-4959-baa9-e83b57b06045 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:12:56.519811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3664432e-a76e-4959-baa9-e83b57b06045 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 8895a6f1-f3e3-455c-90f8-6eeca064c26e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:12:56.779003 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3664432e-a76e-4959-baa9-e83b57b06045 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.469087 May 21 21:12:56.781788 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 397/781] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:12:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:12:56.798250 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4c68d22b-e53f-4641-8b2b-ee183fee20c2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:56.798878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4c68d22b-e53f-4641-8b2b-ee183fee20c2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:56.824060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4c68d22b-e53f-4641-8b2b-ee183fee20c2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:56.824870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4c68d22b-e53f-4641-8b2b-ee183fee20c2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:56.825879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4c68d22b-e53f-4641-8b2b-ee183fee20c2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:56.826494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4c68d22b-e53f-4641-8b2b-ee183fee20c2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:57.255962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4c68d22b-e53f-4641-8b2b-ee183fee20c2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:57.270418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4c68d22b-e53f-4641-8b2b-ee183fee20c2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:57.276517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4c68d22b-e53f-4641-8b2b-ee183fee20c2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:57.281115 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4c68d22b-e53f-4641-8b2b-ee183fee20c2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1361 microversion: 2.25 time: 0.491533 May 21 21:12:57.282498 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 398/782] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:56 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1361 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:57.309480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ab2d716a-fb2e-4fba-96fd-335ca1333982 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:57.310120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ab2d716a-fb2e-4fba-96fd-335ca1333982 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:57.496866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ab2d716a-fb2e-4fba-96fd-335ca1333982 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ddad8359564852b7116efb8d9b21fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae6bac4c6b146d8af30881b58e4138f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:57.510233 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ab2d716a-fb2e-4fba-96fd-335ca1333982 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122" status: 200 len: 1232 microversion: 2.1 time: 0.224690 May 21 21:12:57.523248 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 399/783] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:57 2022] GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122 => generated 1232 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:57.542133 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b4fd59c9-9786-4655-8fe6-3c048d9a939d tempest-ServersWithSpecificFlavorTestJSON-977658033 tempest-ServersWithSpecificFlavorTestJSON-977658033-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:57.603835 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b4fd59c9-9786-4655-8fe6-3c048d9a939d tempest-ServersWithSpecificFlavorTestJSON-977658033 tempest-ServersWithSpecificFlavorTestJSON-977658033-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5404 microversion: 2.1 time: 0.075004 May 21 21:12:57.609567 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 400/784] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:12:57 2022] GET /compute/v2.1/flavors/detail => generated 5404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:57.614704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ff914932-d43a-4c7c-9920-fbc89e470828 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:57.619639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ff914932-d43a-4c7c-9920-fbc89e470828 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:57.641314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff914932-d43a-4c7c-9920-fbc89e470828 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:57.643626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff914932-d43a-4c7c-9920-fbc89e470828 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:57.644750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff914932-d43a-4c7c-9920-fbc89e470828 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:57.646537 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff914932-d43a-4c7c-9920-fbc89e470828 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:58.117165 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ff914932-d43a-4c7c-9920-fbc89e470828 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:58.128157 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ff914932-d43a-4c7c-9920-fbc89e470828 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1313 microversion: 2.1 time: 0.519799 May 21 21:12:58.138392 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 401/785] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:57 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1313 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:58.145081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-2551b90d-5a43-44de-b1b2-9f17a9ab9bef req-6e0b27ac-00a9-4daf-bc04-6939397a9327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "201a83df-62c1-4804-b9d2-1cee0b7a7013", "tag": "30c8503a-ba5d-4891-802d-ebdb59c1d865"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:58.170490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2551b90d-5a43-44de-b1b2-9f17a9ab9bef req-6e0b27ac-00a9-4daf-bc04-6939397a9327 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:58.171809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2551b90d-5a43-44de-b1b2-9f17a9ab9bef req-6e0b27ac-00a9-4daf-bc04-6939397a9327 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:58.210860 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-2551b90d-5a43-44de-b1b2-9f17a9ab9bef req-6e0b27ac-00a9-4daf-bc04-6939397a9327 service nova] Creating event network-changed:30c8503a-ba5d-4891-802d-ebdb59c1d865 for instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 on nch2-master-1 May 21 21:12:58.222968 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-2551b90d-5a43-44de-b1b2-9f17a9ab9bef req-6e0b27ac-00a9-4daf-bc04-6939397a9327 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082700 May 21 21:12:58.225729 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 402/786] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:58.231811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d63e7a69-596c-4543-a4b5-7da7491b924f tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:58.232686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d63e7a69-596c-4543-a4b5-7da7491b924f tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 8895a6f1-f3e3-455c-90f8-6eeca064c26e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:58.398024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d63e7a69-596c-4543-a4b5-7da7491b924f tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:58.406936 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d63e7a69-596c-4543-a4b5-7da7491b924f tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e" status: 200 len: 1221 microversion: 2.1 time: 0.179928 May 21 21:12:58.408333 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 403/787] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:58 2022] GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e => generated 1221 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:58.459800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-725e50fd-3b63-4cee-b8e1-87a0bd777acc tempest-ServersWithSpecificFlavorTestJSON-977658033 tempest-ServersWithSpecificFlavorTestJSON-977658033-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:58.461998 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:12:58.461998 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:12:58.658717 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-725e50fd-3b63-4cee-b8e1-87a0bd777acc tempest-ServersWithSpecificFlavorTestJSON-977658033 tempest-ServersWithSpecificFlavorTestJSON-977658033-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1862267103" status: 202 len: 0 microversion: 2.1 time: 0.248798 May 21 21:12:58.659622 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 404/788] 10.222.0.49 () {58 vars in 1160 bytes} [Sat May 21 21:12:58 2022] DELETE /compute/v2.1/flavors/1862267103 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:12:58.665046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-cbb3e78b-ee2d-46a5-a888-67063974fd0a req-22d248a7-84b6-4980-8e97-5232e3289121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a995b92-640c-4b35-96a4-abd23d9995e6", "name": "network-vif-plugged", "status": "completed", "tag": "5dcfbf23-d7d5-46ab-8767-b5c1c927ce65"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:58.689200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-cbb3e78b-ee2d-46a5-a888-67063974fd0a req-22d248a7-84b6-4980-8e97-5232e3289121 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:58.689866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-cbb3e78b-ee2d-46a5-a888-67063974fd0a req-22d248a7-84b6-4980-8e97-5232e3289121 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:58.712665 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-cbb3e78b-ee2d-46a5-a888-67063974fd0a req-22d248a7-84b6-4980-8e97-5232e3289121 service nova] Creating event network-vif-plugged:5dcfbf23-d7d5-46ab-8767-b5c1c927ce65 for instance 5a995b92-640c-4b35-96a4-abd23d9995e6 on nch2-master-1 May 21 21:12:58.726962 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-cbb3e78b-ee2d-46a5-a888-67063974fd0a req-22d248a7-84b6-4980-8e97-5232e3289121 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065418 May 21 21:12:58.727665 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 405/789] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:58.732848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-756ba67a-1f9f-44d8-b628-bbb24994508d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:58.734581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-756ba67a-1f9f-44d8-b628-bbb24994508d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:58.747271 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-756ba67a-1f9f-44d8-b628-bbb24994508d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:58.747955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-756ba67a-1f9f-44d8-b628-bbb24994508d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:58.761488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-756ba67a-1f9f-44d8-b628-bbb24994508d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:58.762199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-756ba67a-1f9f-44d8-b628-bbb24994508d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:59.286082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-756ba67a-1f9f-44d8-b628-bbb24994508d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:59.309417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-756ba67a-1f9f-44d8-b628-bbb24994508d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:59.318820 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-756ba67a-1f9f-44d8-b628-bbb24994508d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:59.320046 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-756ba67a-1f9f-44d8-b628-bbb24994508d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1361 microversion: 2.25 time: 0.591247 May 21 21:12:59.321043 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 406/790] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:12:58 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1361 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:12:59.333418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-84dd5270-e2f7-4b47-905e-963333157dcb req-2ff9af93-a9a6-4f58-b666-fda2d12cf5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "604b986c-b195-4646-879b-a74b61a9b786", "tag": "113f7a42-78cc-499f-8f86-1ff9d0dcd6e5"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:12:59.350272 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-84dd5270-e2f7-4b47-905e-963333157dcb req-2ff9af93-a9a6-4f58-b666-fda2d12cf5b9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:59.354967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-84dd5270-e2f7-4b47-905e-963333157dcb req-2ff9af93-a9a6-4f58-b666-fda2d12cf5b9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:59.388233 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-84dd5270-e2f7-4b47-905e-963333157dcb req-2ff9af93-a9a6-4f58-b666-fda2d12cf5b9 service nova] Creating event network-changed:113f7a42-78cc-499f-8f86-1ff9d0dcd6e5 for instance 604b986c-b195-4646-879b-a74b61a9b786 on nch1-master-1 May 21 21:12:59.394716 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-84dd5270-e2f7-4b47-905e-963333157dcb req-2ff9af93-a9a6-4f58-b666-fda2d12cf5b9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071624 May 21 21:12:59.396192 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 407/791] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:12:59.402032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-762ac92a-2089-42b7-a693-36e8ac54e72e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:59.403185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-762ac92a-2089-42b7-a693-36e8ac54e72e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:59.411596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:59.415748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-762ac92a-2089-42b7-a693-36e8ac54e72e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:59.416737 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-762ac92a-2089-42b7-a693-36e8ac54e72e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:59.417949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-762ac92a-2089-42b7-a693-36e8ac54e72e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:59.418614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-762ac92a-2089-42b7-a693-36e8ac54e72e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:59.529431 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-762ac92a-2089-42b7-a693-36e8ac54e72e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ddad8359564852b7116efb8d9b21fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae6bac4c6b146d8af30881b58e4138f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:59.541380 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-762ac92a-2089-42b7-a693-36e8ac54e72e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122" status: 200 len: 1284 microversion: 2.1 time: 0.143663 May 21 21:12:59.542291 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 408/792] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:59 2022] GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122 => generated 1284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:59.550376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9db288d7-b017-4da7-8451-0999512d0334 tempest-ServersWithSpecificFlavorTestJSON-977658033 tempest-ServersWithSpecificFlavorTestJSON-977658033-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:59.581387 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9db288d7-b017-4da7-8451-0999512d0334 tempest-ServersWithSpecificFlavorTestJSON-977658033 tempest-ServersWithSpecificFlavorTestJSON-977658033-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037590 May 21 21:12:59.582823 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 409/793] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:12:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:59.594924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8c4605d4-6984-492c-b409-f4911dc9add1 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:59.595936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8c4605d4-6984-492c-b409-f4911dc9add1 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:59.615166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c4605d4-6984-492c-b409-f4911dc9add1 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:59.615738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c4605d4-6984-492c-b409-f4911dc9add1 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:59.617003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c4605d4-6984-492c-b409-f4911dc9add1 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:59.617533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c4605d4-6984-492c-b409-f4911dc9add1 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:59.783751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8c4605d4-6984-492c-b409-f4911dc9add1 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:59.791385 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8c4605d4-6984-492c-b409-f4911dc9add1 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1313 microversion: 2.1 time: 0.207308 May 21 21:12:59.791966 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 410/794] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:59 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:59.797736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7f5d53b3-9843-4daa-8107-55eaab012e57 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:59.798364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7f5d53b3-9843-4daa-8107-55eaab012e57 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 8895a6f1-f3e3-455c-90f8-6eeca064c26e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:59.804432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f5d53b3-9843-4daa-8107-55eaab012e57 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:59.804884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f5d53b3-9843-4daa-8107-55eaab012e57 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:59.805919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f5d53b3-9843-4daa-8107-55eaab012e57 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:59.806418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f5d53b3-9843-4daa-8107-55eaab012e57 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:59.878679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7f5d53b3-9843-4daa-8107-55eaab012e57 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:12:59.887749 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7f5d53b3-9843-4daa-8107-55eaab012e57 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e" status: 200 len: 1273 microversion: 2.1 time: 0.094026 May 21 21:12:59.888883 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 411/795] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:59 2022] GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:12:59.896387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b142984c-cd22-48e8-a2b5-257573acb586 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:59.898090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b142984c-cd22-48e8-a2b5-257573acb586 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:59.909770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b142984c-cd22-48e8-a2b5-257573acb586 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:59.910236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b142984c-cd22-48e8-a2b5-257573acb586 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:59.911089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b142984c-cd22-48e8-a2b5-257573acb586 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:59.911681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b142984c-cd22-48e8-a2b5-257573acb586 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:59.931236 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-b142984c-cd22-48e8-a2b5-257573acb586 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] HTTP exception thrown: Instance a046a9e9-4485-4d77-9f5c-62410cf739f5 could not be found. May 21 21:12:59.933795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b142984c-cd22-48e8-a2b5-257573acb586 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Request method failure captured: May 21 21:12:59.933795 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 HTTP/1.1 May 21 21:12:59.933795 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:12:59.933795 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:12:59.933795 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:12:59.933795 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:12:59.933795 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:12:59.933795 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:12:59.933795 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:12:59.933795 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:12:59.933795 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVUwiPSy3Qc0sPwh_F0fXwkyAVDau_Yw9s7_QI5u6OYJ3x_XNNWkVgVvafZTt95_0QoEmvlp_lpCfQa-Mz8DaQreziG6QsgKg4Y34zTZ_mCkW3uxLNL1RH_WvyPiNvM_bBRQaiH8ACCxcxcXh2N3HjC2qk6TqqKJLzFTCcd-V55SrfI May 21 21:12:59.933795 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:12:59.933795 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:12:59.933795 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:12:59.933795 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:12:59.933795 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:12:59.933795 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:12:59.933795 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: fd7555e458ef4971822c6265ce3fd07b May 21 21:12:59.933795 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1907068961 May 21 21:12:59.933795 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:12:59.933795 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:12:59.935486 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd7555e458ef4971822c6265ce3fd07b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd7555e458ef4971822c6265ce3fd07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd7555e458ef4971822c6265ce3fd07b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd7555e458ef4971822c6265ce3fd07b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:12:59.935486 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1907068961 May 21 21:12:59.935486 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: fd7555e458ef4971822c6265ce3fd07b May 21 21:12:59.935486 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1907068961 May 21 21:12:59.935486 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1907068961-project May 21 21:12:59.935486 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:12:59.935486 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:12:59.935486 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 0ef64531c9da4be5939447edd0d5b78d May 21 21:12:59.935486 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1907068961-project May 21 21:12:59.935486 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:12:59.935486 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance a046a9e9-4485-4d77-9f5c-62410cf739f5 could not be found. May 21 21:12:59.935486 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'a046a9e9-4485-4d77-9f5c-62410cf739f5'} May 21 21:12:59.937252 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:12:59.937252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:59.937252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:12:59.937252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:12:59.937252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:12:59.937252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:12:59.937252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:12:59.937252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:12:59.937252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:12:59.937252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:12:59.937252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a046a9e9-4485-4d77-9f5c-62410cf739f5 could not be found. May 21 21:12:59.937252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:59.937252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:59.937252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:59.937252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:59.937252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:59.937252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:59.937252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:12:59.937252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:12:59.937252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:12:59.938925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:12:59.938925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:12:59.938925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:12:59.938925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:12:59.938925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:12:59.938925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:12:59.938925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:12:59.938925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:12:59.938925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:12:59.938925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a046a9e9-4485-4d77-9f5c-62410cf739f5 could not be found. May 21 21:12:59.938925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:59.938925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:59.938925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:59.938925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:59.938925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:59.938925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:59.938925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:12:59.938925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:12:59.938925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a046a9e9-4485-4d77-9f5c-62410cf739f5 could not be found. May 21 21:12:59.938925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:59.940537 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b142984c-cd22-48e8-a2b5-257573acb586 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Returning 404 to user: Instance a046a9e9-4485-4d77-9f5c-62410cf739f5 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:12:59.940537 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b142984c-cd22-48e8-a2b5-257573acb586 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 404 len: 111 microversion: 2.1 time: 0.045618 May 21 21:12:59.940537 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 412/796] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:12:59 2022] DELETE /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:12:59.946620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dc94f30c-e7b9-4d01-9878-a22be54989d7 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:59.947259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dc94f30c-e7b9-4d01-9878-a22be54989d7 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: a046a9e9-4485-4d77-9f5c-62410cf739f5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:12:59.956747 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc94f30c-e7b9-4d01-9878-a22be54989d7 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:59.957291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc94f30c-e7b9-4d01-9878-a22be54989d7 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:59.958091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc94f30c-e7b9-4d01-9878-a22be54989d7 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:12:59.958655 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc94f30c-e7b9-4d01-9878-a22be54989d7 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:12:59.977733 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-dc94f30c-e7b9-4d01-9878-a22be54989d7 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] HTTP exception thrown: Instance a046a9e9-4485-4d77-9f5c-62410cf739f5 could not be found. May 21 21:12:59.979487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dc94f30c-e7b9-4d01-9878-a22be54989d7 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Request method failure captured: May 21 21:12:59.979487 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 HTTP/1.1 May 21 21:12:59.979487 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:12:59.979487 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:12:59.979487 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:12:59.979487 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:12:59.979487 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:12:59.979487 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:12:59.979487 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:12:59.979487 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:12:59.979487 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVUwiPSy3Qc0sPwh_F0fXwkyAVDau_Yw9s7_QI5u6OYJ3x_XNNWkVgVvafZTt95_0QoEmvlp_lpCfQa-Mz8DaQreziG6QsgKg4Y34zTZ_mCkW3uxLNL1RH_WvyPiNvM_bBRQaiH8ACCxcxcXh2N3HjC2qk6TqqKJLzFTCcd-V55SrfI May 21 21:12:59.979487 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:12:59.979487 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:12:59.979487 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:12:59.979487 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:12:59.979487 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:12:59.979487 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:12:59.979487 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: fd7555e458ef4971822c6265ce3fd07b May 21 21:12:59.979487 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1907068961 May 21 21:12:59.979487 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:12:59.979487 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:12:59.980820 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd7555e458ef4971822c6265ce3fd07b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd7555e458ef4971822c6265ce3fd07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd7555e458ef4971822c6265ce3fd07b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd7555e458ef4971822c6265ce3fd07b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:12:59.980820 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1907068961 May 21 21:12:59.980820 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: fd7555e458ef4971822c6265ce3fd07b May 21 21:12:59.980820 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1907068961 May 21 21:12:59.980820 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1907068961-project May 21 21:12:59.980820 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:12:59.980820 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:12:59.980820 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 0ef64531c9da4be5939447edd0d5b78d May 21 21:12:59.980820 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1907068961-project May 21 21:12:59.980820 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:12:59.980820 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance a046a9e9-4485-4d77-9f5c-62410cf739f5 could not be found. May 21 21:12:59.980820 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'a046a9e9-4485-4d77-9f5c-62410cf739f5'} May 21 21:12:59.981537 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:12:59.981537 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:59.981537 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:12:59.981537 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:12:59.981537 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:12:59.981537 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:12:59.981537 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:12:59.981537 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:12:59.981537 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:12:59.981537 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:12:59.981537 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a046a9e9-4485-4d77-9f5c-62410cf739f5 could not be found. May 21 21:12:59.981537 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:59.981537 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:59.981537 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:59.981537 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:59.981537 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:59.981537 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:59.981537 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:12:59.981537 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:12:59.981537 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:12:59.983255 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:12:59.983255 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:12:59.983255 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:12:59.983255 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:12:59.983255 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:12:59.983255 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:12:59.983255 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:12:59.983255 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a046a9e9-4485-4d77-9f5c-62410cf739f5 could not be found. May 21 21:12:59.983255 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:59.983255 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:12:59.983255 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:59.983255 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:12:59.983255 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:12:59.983255 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:12:59.983255 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:12:59.983255 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:12:59.983255 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a046a9e9-4485-4d77-9f5c-62410cf739f5 could not be found. May 21 21:12:59.983255 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:12:59.984960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dc94f30c-e7b9-4d01-9878-a22be54989d7 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Returning 404 to user: Instance a046a9e9-4485-4d77-9f5c-62410cf739f5 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:12:59.984960 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dc94f30c-e7b9-4d01-9878-a22be54989d7 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5" status: 404 len: 111 microversion: 2.1 time: 0.039767 May 21 21:12:59.985806 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 413/797] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:12:59 2022] GET /compute/v2.1/servers/a046a9e9-4485-4d77-9f5c-62410cf739f5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:12:59.990981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-531b9ef9-82be-4e15-bcd7-c8a3b50c0660 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:12:59.991493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-531b9ef9-82be-4e15-bcd7-c8a3b50c0660 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:00.000739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-531b9ef9-82be-4e15-bcd7-c8a3b50c0660 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:00.000866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-531b9ef9-82be-4e15-bcd7-c8a3b50c0660 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:00.001834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-531b9ef9-82be-4e15-bcd7-c8a3b50c0660 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:00.002898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-531b9ef9-82be-4e15-bcd7-c8a3b50c0660 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:00.021444 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-531b9ef9-82be-4e15-bcd7-c8a3b50c0660 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] HTTP exception thrown: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. May 21 21:13:00.023578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-531b9ef9-82be-4e15-bcd7-c8a3b50c0660 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Request method failure captured: May 21 21:13:00.023578 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 HTTP/1.1 May 21 21:13:00.023578 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:13:00.023578 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:13:00.023578 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:13:00.023578 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:13:00.023578 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:13:00.023578 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:13:00.023578 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:13:00.023578 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:13:00.023578 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVUwiPSy3Qc0sPwh_F0fXwkyAVDau_Yw9s7_QI5u6OYJ3x_XNNWkVgVvafZTt95_0QoEmvlp_lpCfQa-Mz8DaQreziG6QsgKg4Y34zTZ_mCkW3uxLNL1RH_WvyPiNvM_bBRQaiH8ACCxcxcXh2N3HjC2qk6TqqKJLzFTCcd-V55SrfI May 21 21:13:00.023578 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:13:00.023578 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:13:00.023578 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:13:00.023578 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:13:00.023578 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:13:00.023578 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:13:00.023578 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: fd7555e458ef4971822c6265ce3fd07b May 21 21:13:00.023578 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1907068961 May 21 21:13:00.023578 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:13:00.023578 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:13:00.024868 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd7555e458ef4971822c6265ce3fd07b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd7555e458ef4971822c6265ce3fd07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd7555e458ef4971822c6265ce3fd07b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd7555e458ef4971822c6265ce3fd07b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:13:00.024868 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1907068961 May 21 21:13:00.024868 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: fd7555e458ef4971822c6265ce3fd07b May 21 21:13:00.024868 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1907068961 May 21 21:13:00.024868 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1907068961-project May 21 21:13:00.024868 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:13:00.024868 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:13:00.024868 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 0ef64531c9da4be5939447edd0d5b78d May 21 21:13:00.024868 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1907068961-project May 21 21:13:00.024868 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:13:00.024868 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. May 21 21:13:00.024868 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '78c22ee7-e0f1-4d96-bedb-559c91cd2f00'} May 21 21:13:00.025597 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:13:00.025597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:00.025597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:13:00.025597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:13:00.025597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:13:00.025597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:13:00.025597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:13:00.025597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:13:00.025597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:13:00.025597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:13:00.025597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. May 21 21:13:00.025597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:00.025597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:00.025597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:00.025597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:00.025597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:00.025597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:00.025597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:13:00.025597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:13:00.025597 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:13:00.027366 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:13:00.027366 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:13:00.027366 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:13:00.027366 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:13:00.027366 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:13:00.027366 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:13:00.027366 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:13:00.027366 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:13:00.027366 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:13:00.027366 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. May 21 21:13:00.027366 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:00.027366 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:00.027366 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:00.027366 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:00.027366 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:00.027366 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:00.027366 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:13:00.027366 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:13:00.027366 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. May 21 21:13:00.027366 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:00.029235 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-531b9ef9-82be-4e15-bcd7-c8a3b50c0660 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Returning 404 to user: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:13:00.029235 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-531b9ef9-82be-4e15-bcd7-c8a3b50c0660 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "DELETE /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 404 len: 111 microversion: 2.1 time: 0.038280 May 21 21:13:00.030072 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 414/798] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:12:59 2022] DELETE /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:13:00.042057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7dfcb84e-3e15-4e94-b7b7-d287d65d5c12 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:00.042057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7dfcb84e-3e15-4e94-b7b7-d287d65d5c12 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] [instance: 78c22ee7-e0f1-4d96-bedb-559c91cd2f00] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:00.046392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7dfcb84e-3e15-4e94-b7b7-d287d65d5c12 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:00.046853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7dfcb84e-3e15-4e94-b7b7-d287d65d5c12 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:00.047652 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7dfcb84e-3e15-4e94-b7b7-d287d65d5c12 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:00.048093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7dfcb84e-3e15-4e94-b7b7-d287d65d5c12 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:00.053709 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:00.065096 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-7dfcb84e-3e15-4e94-b7b7-d287d65d5c12 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] HTTP exception thrown: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. May 21 21:13:00.066710 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7dfcb84e-3e15-4e94-b7b7-d287d65d5c12 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Request method failure captured: May 21 21:13:00.066710 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 HTTP/1.1 May 21 21:13:00.066710 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:13:00.066710 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:13:00.066710 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:13:00.066710 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:13:00.066710 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:13:00.066710 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:13:00.066710 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:13:00.066710 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:13:00.066710 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVUwiPSy3Qc0sPwh_F0fXwkyAVDau_Yw9s7_QI5u6OYJ3x_XNNWkVgVvafZTt95_0QoEmvlp_lpCfQa-Mz8DaQreziG6QsgKg4Y34zTZ_mCkW3uxLNL1RH_WvyPiNvM_bBRQaiH8ACCxcxcXh2N3HjC2qk6TqqKJLzFTCcd-V55SrfI May 21 21:13:00.066710 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:13:00.066710 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:13:00.066710 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:13:00.066710 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:13:00.066710 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:13:00.066710 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:13:00.066710 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: fd7555e458ef4971822c6265ce3fd07b May 21 21:13:00.066710 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1907068961 May 21 21:13:00.066710 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:13:00.066710 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:13:00.068009 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fd7555e458ef4971822c6265ce3fd07b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd7555e458ef4971822c6265ce3fd07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fd7555e458ef4971822c6265ce3fd07b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fd7555e458ef4971822c6265ce3fd07b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:13:00.068009 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1907068961 May 21 21:13:00.068009 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: fd7555e458ef4971822c6265ce3fd07b May 21 21:13:00.068009 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1907068961 May 21 21:13:00.068009 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1907068961-project May 21 21:13:00.068009 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:13:00.068009 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:13:00.068009 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 0ef64531c9da4be5939447edd0d5b78d May 21 21:13:00.068009 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1907068961-project May 21 21:13:00.068009 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:13:00.068009 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. May 21 21:13:00.068009 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '78c22ee7-e0f1-4d96-bedb-559c91cd2f00'} May 21 21:13:00.068897 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:13:00.068897 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:00.068897 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:13:00.068897 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:13:00.068897 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:13:00.068897 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:13:00.068897 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:13:00.068897 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:13:00.068897 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:13:00.068897 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:13:00.068897 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. May 21 21:13:00.068897 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:00.068897 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:00.068897 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:00.068897 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:00.068897 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:00.068897 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:00.068897 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:13:00.068897 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:13:00.068897 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:13:00.070336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:13:00.070336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:13:00.070336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:13:00.070336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:13:00.070336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:13:00.070336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:13:00.070336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:13:00.070336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. May 21 21:13:00.070336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:00.070336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:00.070336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:00.070336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:00.070336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:00.070336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:00.070336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:13:00.070336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:13:00.070336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. May 21 21:13:00.070336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:00.071585 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7dfcb84e-3e15-4e94-b7b7-d287d65d5c12 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] Returning 404 to user: Instance 78c22ee7-e0f1-4d96-bedb-559c91cd2f00 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:13:00.071585 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7dfcb84e-3e15-4e94-b7b7-d287d65d5c12 tempest-ServersWithSpecificFlavorTestJSON-1907068961 tempest-ServersWithSpecificFlavorTestJSON-1907068961-project] 10.222.0.49 "GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00" status: 404 len: 111 microversion: 2.1 time: 0.036260 May 21 21:13:00.072402 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 415/799] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:00 2022] GET /compute/v2.1/servers/78c22ee7-e0f1-4d96-bedb-559c91cd2f00 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:13:00.340706 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3cec595d-0527-47a8-a8d0-213cb3613b9e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:00.341468 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3cec595d-0527-47a8-a8d0-213cb3613b9e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:00.348846 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cec595d-0527-47a8-a8d0-213cb3613b9e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:00.349304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cec595d-0527-47a8-a8d0-213cb3613b9e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:00.350098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cec595d-0527-47a8-a8d0-213cb3613b9e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:00.350548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cec595d-0527-47a8-a8d0-213cb3613b9e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:00.554613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3cec595d-0527-47a8-a8d0-213cb3613b9e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:00.563649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3cec595d-0527-47a8-a8d0-213cb3613b9e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:00.565353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3cec595d-0527-47a8-a8d0-213cb3613b9e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:00.567714 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3cec595d-0527-47a8-a8d0-213cb3613b9e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1361 microversion: 2.25 time: 0.231640 May 21 21:13:00.568628 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 416/800] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:00 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1361 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:00.574322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4b4885e5-f27f-4666-9a33-f8cb0865a7d6 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:00.575056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4b4885e5-f27f-4666-9a33-f8cb0865a7d6 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:00.581687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b4885e5-f27f-4666-9a33-f8cb0865a7d6 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:00.584328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b4885e5-f27f-4666-9a33-f8cb0865a7d6 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:00.584328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b4885e5-f27f-4666-9a33-f8cb0865a7d6 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:00.584328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b4885e5-f27f-4666-9a33-f8cb0865a7d6 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:00.665805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4b4885e5-f27f-4666-9a33-f8cb0865a7d6 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ddad8359564852b7116efb8d9b21fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae6bac4c6b146d8af30881b58e4138f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:00.674982 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4b4885e5-f27f-4666-9a33-f8cb0865a7d6 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122" status: 200 len: 1292 microversion: 2.1 time: 0.104993 May 21 21:13:00.676555 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 417/801] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:00 2022] GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122 => generated 1292 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:00.808792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1fdc7473-bee5-4138-97a8-49ac912cbf4a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:00.809404 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1fdc7473-bee5-4138-97a8-49ac912cbf4a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:00.817531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1fdc7473-bee5-4138-97a8-49ac912cbf4a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:00.821921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1fdc7473-bee5-4138-97a8-49ac912cbf4a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:00.821921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1fdc7473-bee5-4138-97a8-49ac912cbf4a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:00.821921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1fdc7473-bee5-4138-97a8-49ac912cbf4a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:01.423047 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1fdc7473-bee5-4138-97a8-49ac912cbf4a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:01.431829 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1fdc7473-bee5-4138-97a8-49ac912cbf4a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1462 microversion: 2.1 time: 0.626900 May 21 21:13:01.446485 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 418/802] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:00 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1462 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:13:01.454987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-654c5364-357c-4dc6-8452-3f21369e7e47 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:01.455942 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-654c5364-357c-4dc6-8452-3f21369e7e47 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 8895a6f1-f3e3-455c-90f8-6eeca064c26e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:01.464272 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-654c5364-357c-4dc6-8452-3f21369e7e47 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:01.465124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-654c5364-357c-4dc6-8452-3f21369e7e47 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:01.468822 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-654c5364-357c-4dc6-8452-3f21369e7e47 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:01.469512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-654c5364-357c-4dc6-8452-3f21369e7e47 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:01.650800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-654c5364-357c-4dc6-8452-3f21369e7e47 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:01.660220 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-654c5364-357c-4dc6-8452-3f21369e7e47 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e" status: 200 len: 1279 microversion: 2.1 time: 0.210006 May 21 21:13:01.661282 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 419/803] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:01 2022] GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e => generated 1279 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:01.673452 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d0adbdd4-63ba-4155-81a9-8562406c8c06 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:01.674772 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d0adbdd4-63ba-4155-81a9-8562406c8c06 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:01.686042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0adbdd4-63ba-4155-81a9-8562406c8c06 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:01.690374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0adbdd4-63ba-4155-81a9-8562406c8c06 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:01.690374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0adbdd4-63ba-4155-81a9-8562406c8c06 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:01.690374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0adbdd4-63ba-4155-81a9-8562406c8c06 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:01.790874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d0adbdd4-63ba-4155-81a9-8562406c8c06 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:01.805599 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d0adbdd4-63ba-4155-81a9-8562406c8c06 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Old instance type m1.heat2, new instance type m1.heat {{(pid=131278) resize /opt/stack/nova/nova/compute/api.py:4166}} May 21 21:13:01.813231 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d0adbdd4-63ba-4155-81a9-8562406c8c06 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:13:01.819647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d0adbdd4-63ba-4155-81a9-8562406c8c06 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:13:01.819647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d0adbdd4-63ba-4155-81a9-8562406c8c06 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:13:01.819647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d0adbdd4-63ba-4155-81a9-8562406c8c06 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:13:01.819647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d0adbdd4-63ba-4155-81a9-8562406c8c06 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:13:02.144890 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d0adbdd4-63ba-4155-81a9-8562406c8c06 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "POST /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6/action" status: 202 len: 0 microversion: 2.1 time: 0.481286 May 21 21:13:02.148676 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 420/804] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:13:01 2022] POST /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:13:02.162668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f684a1f1-d415-4f91-8ef6-fa9d87146296 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:02.169893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f684a1f1-d415-4f91-8ef6-fa9d87146296 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:02.187045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f684a1f1-d415-4f91-8ef6-fa9d87146296 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:02.188395 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f684a1f1-d415-4f91-8ef6-fa9d87146296 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:02.191399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f684a1f1-d415-4f91-8ef6-fa9d87146296 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:02.193789 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f684a1f1-d415-4f91-8ef6-fa9d87146296 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:02.647653 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a41aa8f0-9b8c-4ee8-a6ee-52a497936d9b tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe/action" status: 202 len: 0 microversion: 2.1 time: 6.404964 May 21 21:13:02.651682 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 385/805] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:12:56 2022] POST /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe/action => generated 0 bytes in 6410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:13:02.659110 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f6f69758-97dd-49d7-ab4d-855c299df7a3 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:02.660179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f6f69758-97dd-49d7-ab4d-855c299df7a3 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:02.675977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6f69758-97dd-49d7-ab4d-855c299df7a3 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:02.676799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6f69758-97dd-49d7-ab4d-855c299df7a3 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:02.678589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6f69758-97dd-49d7-ab4d-855c299df7a3 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:02.678589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6f69758-97dd-49d7-ab4d-855c299df7a3 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:02.848416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f6f69758-97dd-49d7-ab4d-855c299df7a3 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ddad8359564852b7116efb8d9b21fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae6bac4c6b146d8af30881b58e4138f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:02.879894 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f6f69758-97dd-49d7-ab4d-855c299df7a3 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122" status: 200 len: 1290 microversion: 2.1 time: 0.226996 May 21 21:13:02.886845 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 386/806] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:02 2022] GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122 => generated 1290 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:02.900000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6d6577f0-efe3-4873-abe1-107a37ffe1e6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:02.901308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6d6577f0-efe3-4873-abe1-107a37ffe1e6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:02.904750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f684a1f1-d415-4f91-8ef6-fa9d87146296 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:02.910440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d6577f0-efe3-4873-abe1-107a37ffe1e6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:02.911080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d6577f0-efe3-4873-abe1-107a37ffe1e6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:02.912169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d6577f0-efe3-4873-abe1-107a37ffe1e6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:02.912791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d6577f0-efe3-4873-abe1-107a37ffe1e6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:02.916933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f684a1f1-d415-4f91-8ef6-fa9d87146296 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:02.920590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f684a1f1-d415-4f91-8ef6-fa9d87146296 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:02.924988 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f684a1f1-d415-4f91-8ef6-fa9d87146296 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1361 microversion: 2.25 time: 0.773532 May 21 21:13:02.925822 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 421/807] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:02 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1361 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:02.937414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d8702a94-0031-40ad-b6aa-2ab8a2c043be tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:02.941482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d8702a94-0031-40ad-b6aa-2ab8a2c043be tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:02.964239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8702a94-0031-40ad-b6aa-2ab8a2c043be tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:02.964752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8702a94-0031-40ad-b6aa-2ab8a2c043be tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:02.965578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8702a94-0031-40ad-b6aa-2ab8a2c043be tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:02.966011 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8702a94-0031-40ad-b6aa-2ab8a2c043be tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:03.486256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d8702a94-0031-40ad-b6aa-2ab8a2c043be tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:03.497773 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d8702a94-0031-40ad-b6aa-2ab8a2c043be tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1505 microversion: 2.1 time: 0.568974 May 21 21:13:03.499285 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 422/808] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:02 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1505 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:03.520539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d2bfed0e-00cc-4127-8efb-0031dc8b191f tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:03.525954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d2bfed0e-00cc-4127-8efb-0031dc8b191f tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 8895a6f1-f3e3-455c-90f8-6eeca064c26e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:03.535320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2bfed0e-00cc-4127-8efb-0031dc8b191f tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:03.535677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2bfed0e-00cc-4127-8efb-0031dc8b191f tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:03.536521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2bfed0e-00cc-4127-8efb-0031dc8b191f tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:03.536969 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2bfed0e-00cc-4127-8efb-0031dc8b191f tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:03.679660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d2bfed0e-00cc-4127-8efb-0031dc8b191f tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:03.691659 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d2bfed0e-00cc-4127-8efb-0031dc8b191f tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e" status: 200 len: 1279 microversion: 2.1 time: 0.180862 May 21 21:13:03.702140 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 423/809] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:03 2022] GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e => generated 1279 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:03.822993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6d6577f0-efe3-4873-abe1-107a37ffe1e6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:03.842439 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6d6577f0-efe3-4873-abe1-107a37ffe1e6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1471 microversion: 2.1 time: 0.957952 May 21 21:13:03.844200 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 387/810] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:02 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1471 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:03.903376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6f7247bc-dba5-4428-bb43-cd593ebf5558 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:03.907249 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6f7247bc-dba5-4428-bb43-cd593ebf5558 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:03.929198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f7247bc-dba5-4428-bb43-cd593ebf5558 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:03.929720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f7247bc-dba5-4428-bb43-cd593ebf5558 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:03.930589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f7247bc-dba5-4428-bb43-cd593ebf5558 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:03.932979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f7247bc-dba5-4428-bb43-cd593ebf5558 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:03.946963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-33c0f930-341f-4271-8a4b-d9c79224df42 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:03.947839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-33c0f930-341f-4271-8a4b-d9c79224df42 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:03.960555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33c0f930-341f-4271-8a4b-d9c79224df42 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:03.962153 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33c0f930-341f-4271-8a4b-d9c79224df42 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:03.963664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33c0f930-341f-4271-8a4b-d9c79224df42 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:03.965890 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33c0f930-341f-4271-8a4b-d9c79224df42 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:04.597211 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6f7247bc-dba5-4428-bb43-cd593ebf5558 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ddad8359564852b7116efb8d9b21fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae6bac4c6b146d8af30881b58e4138f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:04.609050 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6f7247bc-dba5-4428-bb43-cd593ebf5558 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122" status: 200 len: 1332 microversion: 2.1 time: 0.710848 May 21 21:13:04.610758 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 424/811] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:03 2022] GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122 => generated 1332 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:04.618019 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1332bf47-f0bb-4d21-afc4-c77827da198c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:04.622275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1332bf47-f0bb-4d21-afc4-c77827da198c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:04.627179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1332bf47-f0bb-4d21-afc4-c77827da198c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:04.627846 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1332bf47-f0bb-4d21-afc4-c77827da198c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:04.628942 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1332bf47-f0bb-4d21-afc4-c77827da198c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:04.629551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1332bf47-f0bb-4d21-afc4-c77827da198c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:04.731142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-33c0f930-341f-4271-8a4b-d9c79224df42 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:04.752237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-33c0f930-341f-4271-8a4b-d9c79224df42 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:04.763396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-33c0f930-341f-4271-8a4b-d9c79224df42 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:04.765680 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-33c0f930-341f-4271-8a4b-d9c79224df42 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1361 microversion: 2.25 time: 0.826442 May 21 21:13:04.776399 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 388/812] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:03 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1361 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:13:04.781613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-314eadb2-04a3-405f-acc7-f98ca74a7df9 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:04.782241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-314eadb2-04a3-405f-acc7-f98ca74a7df9 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 8895a6f1-f3e3-455c-90f8-6eeca064c26e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:04.818891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-314eadb2-04a3-405f-acc7-f98ca74a7df9 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:04.821803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-314eadb2-04a3-405f-acc7-f98ca74a7df9 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:04.837771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-314eadb2-04a3-405f-acc7-f98ca74a7df9 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:04.838979 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-314eadb2-04a3-405f-acc7-f98ca74a7df9 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:05.009349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1332bf47-f0bb-4d21-afc4-c77827da198c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:05.021174 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1332bf47-f0bb-4d21-afc4-c77827da198c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1505 microversion: 2.1 time: 0.408353 May 21 21:13:05.021996 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 425/813] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:04 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1505 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:05.037875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-67515920-73c4-4f4c-a45b-565b1a0d5960 req-12218a68-df21-4310-acad-6f40254b3df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "604b986c-b195-4646-879b-a74b61a9b786", "name": "network-vif-plugged", "status": "completed", "tag": "113f7a42-78cc-499f-8f86-1ff9d0dcd6e5"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:05.063621 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-67515920-73c4-4f4c-a45b-565b1a0d5960 req-12218a68-df21-4310-acad-6f40254b3df7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:05.064374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-67515920-73c4-4f4c-a45b-565b1a0d5960 req-12218a68-df21-4310-acad-6f40254b3df7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:05.076880 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-67515920-73c4-4f4c-a45b-565b1a0d5960 req-12218a68-df21-4310-acad-6f40254b3df7 service nova] Creating event network-vif-plugged:113f7a42-78cc-499f-8f86-1ff9d0dcd6e5 for instance 604b986c-b195-4646-879b-a74b61a9b786 on nch1-master-1 May 21 21:13:05.081839 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-67515920-73c4-4f4c-a45b-565b1a0d5960 req-12218a68-df21-4310-acad-6f40254b3df7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047699 May 21 21:13:05.085502 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 426/814] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:05.090936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b4663763-065e-40bb-8dc0-93c19020406e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:05.097907 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b4663763-065e-40bb-8dc0-93c19020406e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:05.100571 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b4663763-065e-40bb-8dc0-93c19020406e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:05.101115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b4663763-065e-40bb-8dc0-93c19020406e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:05.101979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b4663763-065e-40bb-8dc0-93c19020406e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:05.102524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b4663763-065e-40bb-8dc0-93c19020406e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:05.467051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b4663763-065e-40bb-8dc0-93c19020406e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:05.479113 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b4663763-065e-40bb-8dc0-93c19020406e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1471 microversion: 2.1 time: 0.392342 May 21 21:13:05.479701 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 427/815] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:05 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1471 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:05.594147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-314eadb2-04a3-405f-acc7-f98ca74a7df9 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:05.610955 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-314eadb2-04a3-405f-acc7-f98ca74a7df9 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e" status: 200 len: 1321 microversion: 2.1 time: 0.835084 May 21 21:13:05.611933 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 389/816] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:04 2022] GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e => generated 1321 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:05.628215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cc172a4d-43d0-4ef6-b5b0-eca3fca41710 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:05.628934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cc172a4d-43d0-4ef6-b5b0-eca3fca41710 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:05.638245 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cc172a4d-43d0-4ef6-b5b0-eca3fca41710 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:05.640052 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cc172a4d-43d0-4ef6-b5b0-eca3fca41710 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:05.641111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cc172a4d-43d0-4ef6-b5b0-eca3fca41710 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:05.642964 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cc172a4d-43d0-4ef6-b5b0-eca3fca41710 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:05.786012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-45d2d5b1-1ad0-4576-822a-8c0ea49ea330 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:05.786936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-45d2d5b1-1ad0-4576-822a-8c0ea49ea330 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:05.798283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-45d2d5b1-1ad0-4576-822a-8c0ea49ea330 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:05.799009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-45d2d5b1-1ad0-4576-822a-8c0ea49ea330 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:05.800893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-45d2d5b1-1ad0-4576-822a-8c0ea49ea330 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:05.801502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-45d2d5b1-1ad0-4576-822a-8c0ea49ea330 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:05.915902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:05.961775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=12 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:06.077696 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cc172a4d-43d0-4ef6-b5b0-eca3fca41710 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ddad8359564852b7116efb8d9b21fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae6bac4c6b146d8af30881b58e4138f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:06.089645 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cc172a4d-43d0-4ef6-b5b0-eca3fca41710 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122" status: 200 len: 1332 microversion: 2.1 time: 0.466302 May 21 21:13:06.091085 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 428/817] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:05 2022] GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122 => generated 1332 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:06.105968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-df96954f-885e-4e99-940f-d0276331957c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:06.112598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-df96954f-885e-4e99-940f-d0276331957c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:06.114542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df96954f-885e-4e99-940f-d0276331957c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:06.116022 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df96954f-885e-4e99-940f-d0276331957c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:06.117589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df96954f-885e-4e99-940f-d0276331957c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:06.118521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df96954f-885e-4e99-940f-d0276331957c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:06.312035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-45d2d5b1-1ad0-4576-822a-8c0ea49ea330 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:06.322172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-45d2d5b1-1ad0-4576-822a-8c0ea49ea330 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:06.325104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-45d2d5b1-1ad0-4576-822a-8c0ea49ea330 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:06.327163 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-45d2d5b1-1ad0-4576-822a-8c0ea49ea330 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1361 microversion: 2.25 time: 0.544767 May 21 21:13:06.342840 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 390/818] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:05 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1361 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:13:06.446186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-df96954f-885e-4e99-940f-d0276331957c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:06.458574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:06.467104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-85718d01-be7a-4fd3-9e45-41121cc13ddb req-b3b9b36d-78f2-43ca-92c5-3462f696703d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8895a6f1-f3e3-455c-90f8-6eeca064c26e", "tag": "230eabe2-8c30-4490-8ccb-ece7718fc64c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:06.467302 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-df96954f-885e-4e99-940f-d0276331957c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1505 microversion: 2.1 time: 0.374746 May 21 21:13:06.470359 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 429/819] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:06 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:06.489322 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-85718d01-be7a-4fd3-9e45-41121cc13ddb req-b3b9b36d-78f2-43ca-92c5-3462f696703d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:06.489764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-85718d01-be7a-4fd3-9e45-41121cc13ddb req-b3b9b36d-78f2-43ca-92c5-3462f696703d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:06.497880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7be92c5b-61cd-42c9-8a49-8619d1e65f83 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:06.499100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7be92c5b-61cd-42c9-8a49-8619d1e65f83 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:06.512171 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7be92c5b-61cd-42c9-8a49-8619d1e65f83 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:06.512978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7be92c5b-61cd-42c9-8a49-8619d1e65f83 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:06.516679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7be92c5b-61cd-42c9-8a49-8619d1e65f83 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:06.516679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7be92c5b-61cd-42c9-8a49-8619d1e65f83 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:06.517160 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-85718d01-be7a-4fd3-9e45-41121cc13ddb req-b3b9b36d-78f2-43ca-92c5-3462f696703d service nova] Creating event network-changed:230eabe2-8c30-4490-8ccb-ece7718fc64c for instance 8895a6f1-f3e3-455c-90f8-6eeca064c26e on nch1-master-1 May 21 21:13:06.526114 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-85718d01-be7a-4fd3-9e45-41121cc13ddb req-b3b9b36d-78f2-43ca-92c5-3462f696703d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064933 May 21 21:13:06.529481 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 391/820] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:06.631063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-99d1d6f4-1310-4ec1-9588-303dbe58fc6e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:06.631806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-99d1d6f4-1310-4ec1-9588-303dbe58fc6e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 8895a6f1-f3e3-455c-90f8-6eeca064c26e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:06.651231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-99d1d6f4-1310-4ec1-9588-303dbe58fc6e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:06.651689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-99d1d6f4-1310-4ec1-9588-303dbe58fc6e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:06.652515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-99d1d6f4-1310-4ec1-9588-303dbe58fc6e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:06.652957 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-99d1d6f4-1310-4ec1-9588-303dbe58fc6e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:07.705761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-99d1d6f4-1310-4ec1-9588-303dbe58fc6e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:07.714274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7be92c5b-61cd-42c9-8a49-8619d1e65f83 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:07.733910 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7be92c5b-61cd-42c9-8a49-8619d1e65f83 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1471 microversion: 2.1 time: 1.235621 May 21 21:13:07.735564 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-99d1d6f4-1310-4ec1-9588-303dbe58fc6e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e" status: 200 len: 1321 microversion: 2.1 time: 1.109902 May 21 21:13:07.736037 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 430/821] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:06 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1471 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:13:07.751434 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 392/822] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:06 2022] GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e => generated 1321 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:13:07.752232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2cd210b1-22dd-4bc4-ab40-4028fcaad626 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:07.752888 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2cd210b1-22dd-4bc4-ab40-4028fcaad626 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:07.757247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0370de95-15ed-484a-996c-d4f4742d91e2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:07.758561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0370de95-15ed-484a-996c-d4f4742d91e2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:07.759555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2cd210b1-22dd-4bc4-ab40-4028fcaad626 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:07.760012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2cd210b1-22dd-4bc4-ab40-4028fcaad626 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:07.760842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2cd210b1-22dd-4bc4-ab40-4028fcaad626 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:07.761524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2cd210b1-22dd-4bc4-ab40-4028fcaad626 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:07.771116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0370de95-15ed-484a-996c-d4f4742d91e2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:07.772350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0370de95-15ed-484a-996c-d4f4742d91e2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:07.772985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0370de95-15ed-484a-996c-d4f4742d91e2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:07.773584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0370de95-15ed-484a-996c-d4f4742d91e2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:08.110058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2cd210b1-22dd-4bc4-ab40-4028fcaad626 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ddad8359564852b7116efb8d9b21fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae6bac4c6b146d8af30881b58e4138f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:08.112738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:08.118810 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2cd210b1-22dd-4bc4-ab40-4028fcaad626 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122" status: 200 len: 1332 microversion: 2.1 time: 0.381688 May 21 21:13:08.119402 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 431/823] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:07 2022] GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122 => generated 1332 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:08.133081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-43047a92-299b-4aea-9ce4-eee97a28433d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:08.133728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-43047a92-299b-4aea-9ce4-eee97a28433d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:08.142551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-43047a92-299b-4aea-9ce4-eee97a28433d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:08.142551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-43047a92-299b-4aea-9ce4-eee97a28433d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:08.142551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-43047a92-299b-4aea-9ce4-eee97a28433d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:08.142551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-43047a92-299b-4aea-9ce4-eee97a28433d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:08.359898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0370de95-15ed-484a-996c-d4f4742d91e2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:08.372616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0370de95-15ed-484a-996c-d4f4742d91e2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:08.377658 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0370de95-15ed-484a-996c-d4f4742d91e2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:08.379218 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0370de95-15ed-484a-996c-d4f4742d91e2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1557 microversion: 2.25 time: 0.626571 May 21 21:13:08.380482 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 393/824] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:07 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1557 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:08.388228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-d218b288-50e7-400e-bb20-552cbc1d5f3d req-decced24-f101-4939-bbcf-4681361b8e6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c088d68-a287-4c8a-9984-9fd1de948122", "tag": "1bea7c12-5a29-43c3-a208-bd1092d37fcd"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:08.398345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d218b288-50e7-400e-bb20-552cbc1d5f3d req-decced24-f101-4939-bbcf-4681361b8e6a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:08.399100 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d218b288-50e7-400e-bb20-552cbc1d5f3d req-decced24-f101-4939-bbcf-4681361b8e6a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:08.403116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=12 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:08.414857 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-d218b288-50e7-400e-bb20-552cbc1d5f3d req-decced24-f101-4939-bbcf-4681361b8e6a service nova] Creating event network-changed:1bea7c12-5a29-43c3-a208-bd1092d37fcd for instance 5c088d68-a287-4c8a-9984-9fd1de948122 on nch1-master-1 May 21 21:13:08.420884 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-d218b288-50e7-400e-bb20-552cbc1d5f3d req-decced24-f101-4939-bbcf-4681361b8e6a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038682 May 21 21:13:08.421795 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 394/825] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:08.430256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bb51fc19-8275-4736-b84a-bf9077ac4f4b tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:08.430953 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bb51fc19-8275-4736-b84a-bf9077ac4f4b tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:08.442079 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb51fc19-8275-4736-b84a-bf9077ac4f4b tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:08.442894 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb51fc19-8275-4736-b84a-bf9077ac4f4b tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:08.449305 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb51fc19-8275-4736-b84a-bf9077ac4f4b tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:08.450143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb51fc19-8275-4736-b84a-bf9077ac4f4b tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:08.493706 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-43047a92-299b-4aea-9ce4-eee97a28433d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:08.504975 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-43047a92-299b-4aea-9ce4-eee97a28433d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1505 microversion: 2.1 time: 0.375493 May 21 21:13:08.505573 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 432/826] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:08 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:08.753017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8114f7f8-7f2f-4f5e-99dd-77fd0082da40 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:08.753643 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8114f7f8-7f2f-4f5e-99dd-77fd0082da40 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 8895a6f1-f3e3-455c-90f8-6eeca064c26e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:08.761963 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8114f7f8-7f2f-4f5e-99dd-77fd0082da40 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:08.762374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8114f7f8-7f2f-4f5e-99dd-77fd0082da40 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:08.763179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8114f7f8-7f2f-4f5e-99dd-77fd0082da40 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:08.764934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8114f7f8-7f2f-4f5e-99dd-77fd0082da40 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:08.925630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8114f7f8-7f2f-4f5e-99dd-77fd0082da40 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:08.933113 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8114f7f8-7f2f-4f5e-99dd-77fd0082da40 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e" status: 200 len: 1321 microversion: 2.1 time: 0.184780 May 21 21:13:08.933752 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 433/827] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:08 2022] GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:13:08.938991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a82812f3-7456-4561-a013-2271fc21e26f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:08.939892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a82812f3-7456-4561-a013-2271fc21e26f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:08.954049 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-bb51fc19-8275-4736-b84a-bf9077ac4f4b tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lazy-loading 'services' on Instance uuid 604b986c-b195-4646-879b-a74b61a9b786 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:13:08.962926 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a82812f3-7456-4561-a013-2271fc21e26f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:08.963681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a82812f3-7456-4561-a013-2271fc21e26f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:08.964674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a82812f3-7456-4561-a013-2271fc21e26f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:08.965549 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a82812f3-7456-4561-a013-2271fc21e26f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:08.968868 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bb51fc19-8275-4736-b84a-bf9077ac4f4b tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 2049 microversion: 2.25 time: 0.544289 May 21 21:13:08.973301 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 395/828] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:08 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 2049 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:08.986591 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2c463216-15eb-453c-91e4-54530edb719c tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:08.987513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2c463216-15eb-453c-91e4-54530edb719c tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:08.993909 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c463216-15eb-453c-91e4-54530edb719c tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:08.994562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c463216-15eb-453c-91e4-54530edb719c tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:08.996314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c463216-15eb-453c-91e4-54530edb719c tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:08.996314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c463216-15eb-453c-91e4-54530edb719c tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:09.121328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a82812f3-7456-4561-a013-2271fc21e26f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:09.129308 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a82812f3-7456-4561-a013-2271fc21e26f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1476 microversion: 2.1 time: 0.194635 May 21 21:13:09.130213 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 434/829] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:08 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1476 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:09.135086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a6a93381-df70-480d-8752-f341754b4354 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:09.135922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a6a93381-df70-480d-8752-f341754b4354 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:09.142708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a6a93381-df70-480d-8752-f341754b4354 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:09.143160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a6a93381-df70-480d-8752-f341754b4354 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:09.143940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a6a93381-df70-480d-8752-f341754b4354 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:09.144583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a6a93381-df70-480d-8752-f341754b4354 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:09.295816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a6a93381-df70-480d-8752-f341754b4354 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ddad8359564852b7116efb8d9b21fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae6bac4c6b146d8af30881b58e4138f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:09.303758 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a6a93381-df70-480d-8752-f341754b4354 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122" status: 200 len: 1332 microversion: 2.1 time: 0.172370 May 21 21:13:09.304412 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 435/830] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:09 2022] GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122 => generated 1332 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:09.325714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-2c463216-15eb-453c-91e4-54530edb719c tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lazy-loading 'services' on Instance uuid 604b986c-b195-4646-879b-a74b61a9b786 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:13:09.341008 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2c463216-15eb-453c-91e4-54530edb719c tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 2049 microversion: 2.25 time: 0.358717 May 21 21:13:09.341676 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 396/831] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:08 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 2049 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:13:09.359481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6d1e31ad-7236-4752-a14b-cb704ac7ed76 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:09.361798 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:13:09.361798 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:13:09.363015 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d1e31ad-7236-4752-a14b-cb704ac7ed76 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:09.363469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d1e31ad-7236-4752-a14b-cb704ac7ed76 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:09.364329 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d1e31ad-7236-4752-a14b-cb704ac7ed76 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:09.364797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d1e31ad-7236-4752-a14b-cb704ac7ed76 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:09.388533 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6d1e31ad-7236-4752-a14b-cb704ac7ed76 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.032847 May 21 21:13:09.389816 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 436/832] 10.222.0.49 () {60 vars in 1216 bytes} [Sat May 21 21:13:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:13:09.400817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d0fe7b6d-4632-47f4-85b5-f412e565ef9c tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:09.401364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d0fe7b6d-4632-47f4-85b5-f412e565ef9c tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:09.408727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d0fe7b6d-4632-47f4-85b5-f412e565ef9c tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:09.409209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d0fe7b6d-4632-47f4-85b5-f412e565ef9c tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:09.409998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d0fe7b6d-4632-47f4-85b5-f412e565ef9c tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:09.410414 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d0fe7b6d-4632-47f4-85b5-f412e565ef9c tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:09.524948 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3d0bfadb-e605-4bec-a7a2-cab0c5d40ba7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:09.525579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3d0bfadb-e605-4bec-a7a2-cab0c5d40ba7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:09.532737 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d0bfadb-e605-4bec-a7a2-cab0c5d40ba7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:09.533460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d0bfadb-e605-4bec-a7a2-cab0c5d40ba7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:09.534235 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d0bfadb-e605-4bec-a7a2-cab0c5d40ba7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:09.534679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d0bfadb-e605-4bec-a7a2-cab0c5d40ba7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:09.645581 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d0fe7b6d-4632-47f4-85b5-f412e565ef9c tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786/action" status: 202 len: 0 microversion: 2.25 time: 0.248221 May 21 21:13:09.649515 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 397/833] 10.222.0.49 () {62 vars in 1318 bytes} [Sat May 21 21:13:09 2022] POST /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 21 21:13:09.665996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e616c627-0a34-4142-9942-f7b966096aac tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:09.667004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e616c627-0a34-4142-9942-f7b966096aac tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:09.675095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e616c627-0a34-4142-9942-f7b966096aac tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:09.675549 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e616c627-0a34-4142-9942-f7b966096aac tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:09.677232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e616c627-0a34-4142-9942-f7b966096aac tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:09.677929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e616c627-0a34-4142-9942-f7b966096aac tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:09.716270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3d0bfadb-e605-4bec-a7a2-cab0c5d40ba7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:09.718366 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3d0bfadb-e605-4bec-a7a2-cab0c5d40ba7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1505 microversion: 2.1 time: 0.196622 May 21 21:13:09.719196 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 437/834] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:09 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:09.968814 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3485f3e4-81c0-4b3e-8104-871bcb5a251e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:09.975063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3485f3e4-81c0-4b3e-8104-871bcb5a251e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 8895a6f1-f3e3-455c-90f8-6eeca064c26e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:10.009535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3485f3e4-81c0-4b3e-8104-871bcb5a251e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:10.010803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3485f3e4-81c0-4b3e-8104-871bcb5a251e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:10.013476 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3485f3e4-81c0-4b3e-8104-871bcb5a251e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:10.013929 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3485f3e4-81c0-4b3e-8104-871bcb5a251e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:10.181304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:10.185518 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-e616c627-0a34-4142-9942-f7b966096aac tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lazy-loading 'services' on Instance uuid 604b986c-b195-4646-879b-a74b61a9b786 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:13:10.203875 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e616c627-0a34-4142-9942-f7b966096aac tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 2054 microversion: 2.25 time: 0.553049 May 21 21:13:10.205102 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 398/835] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:09 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 2054 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:10.213320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3d644146-2a57-4774-80be-340000960ef9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:10.214159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3d644146-2a57-4774-80be-340000960ef9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:10.227627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d644146-2a57-4774-80be-340000960ef9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:10.228254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d644146-2a57-4774-80be-340000960ef9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:10.229250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d644146-2a57-4774-80be-340000960ef9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:10.229842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d644146-2a57-4774-80be-340000960ef9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:10.442734 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3485f3e4-81c0-4b3e-8104-871bcb5a251e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:10.451258 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3485f3e4-81c0-4b3e-8104-871bcb5a251e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e" status: 200 len: 1321 microversion: 2.1 time: 0.503242 May 21 21:13:10.452858 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 438/836] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:09 2022] GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e => generated 1321 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:10.459507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-45524632-a922-4412-b084-160d0adedf1f tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:10.460557 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-45524632-a922-4412-b084-160d0adedf1f tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:10.467783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-45524632-a922-4412-b084-160d0adedf1f tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:10.468461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-45524632-a922-4412-b084-160d0adedf1f tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:10.469264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-45524632-a922-4412-b084-160d0adedf1f tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:10.469748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-45524632-a922-4412-b084-160d0adedf1f tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:10.479801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3d644146-2a57-4774-80be-340000960ef9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:10.488367 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3d644146-2a57-4774-80be-340000960ef9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1476 microversion: 2.1 time: 0.281993 May 21 21:13:10.488948 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 399/837] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:10 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1476 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:10.496425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-42a42f89-fe98-4c22-ad57-6c87c6e00a30 req-8eb6986d-8f31-425c-9559-0d5c4cfd9475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1861c5f-d59a-4d75-9849-ecd40aeb32fe", "name": "network-vif-unplugged", "status": "completed", "tag": "f0278179-1509-4b53-9291-18dd7c351135"}, {"name": "network-changed", "server_uuid": "d1861c5f-d59a-4d75-9849-ecd40aeb32fe", "tag": "f0278179-1509-4b53-9291-18dd7c351135"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:10.507832 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-42a42f89-fe98-4c22-ad57-6c87c6e00a30 req-8eb6986d-8f31-425c-9559-0d5c4cfd9475 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:10.508995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-42a42f89-fe98-4c22-ad57-6c87c6e00a30 req-8eb6986d-8f31-425c-9559-0d5c4cfd9475 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:10.522035 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-42a42f89-fe98-4c22-ad57-6c87c6e00a30 req-8eb6986d-8f31-425c-9559-0d5c4cfd9475 service nova] Creating event network-vif-unplugged:f0278179-1509-4b53-9291-18dd7c351135 for instance d1861c5f-d59a-4d75-9849-ecd40aeb32fe on nch2-master-1 May 21 21:13:10.522644 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-42a42f89-fe98-4c22-ad57-6c87c6e00a30 req-8eb6986d-8f31-425c-9559-0d5c4cfd9475 service nova] Creating event network-changed:f0278179-1509-4b53-9291-18dd7c351135 for instance d1861c5f-d59a-4d75-9849-ecd40aeb32fe on nch2-master-1 May 21 21:13:10.527943 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-42a42f89-fe98-4c22-ad57-6c87c6e00a30 req-8eb6986d-8f31-425c-9559-0d5c4cfd9475 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.037850 May 21 21:13:10.529083 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 400/838] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:10.737906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e5494d85-c170-405f-98e0-a4b8d6f5fef5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:10.738561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e5494d85-c170-405f-98e0-a4b8d6f5fef5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:10.745954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5494d85-c170-405f-98e0-a4b8d6f5fef5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:10.746413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5494d85-c170-405f-98e0-a4b8d6f5fef5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:10.747197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5494d85-c170-405f-98e0-a4b8d6f5fef5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:10.747638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5494d85-c170-405f-98e0-a4b8d6f5fef5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:10.866548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-45524632-a922-4412-b084-160d0adedf1f tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ddad8359564852b7116efb8d9b21fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae6bac4c6b146d8af30881b58e4138f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:10.882771 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-45524632-a922-4412-b084-160d0adedf1f tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122" status: 200 len: 1332 microversion: 2.1 time: 0.428510 May 21 21:13:10.883424 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 439/839] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:10 2022] GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122 => generated 1332 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:10.899421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e5494d85-c170-405f-98e0-a4b8d6f5fef5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:10.906783 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e5494d85-c170-405f-98e0-a4b8d6f5fef5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1505 microversion: 2.1 time: 0.173921 May 21 21:13:10.916561 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 401/840] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:10 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:13:11.223524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cffb09b6-27f1-4628-8ed8-f8c4bfc8a717 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:11.224134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cffb09b6-27f1-4628-8ed8-f8c4bfc8a717 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:11.231674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cffb09b6-27f1-4628-8ed8-f8c4bfc8a717 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:11.232049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cffb09b6-27f1-4628-8ed8-f8c4bfc8a717 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:11.232981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cffb09b6-27f1-4628-8ed8-f8c4bfc8a717 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:11.234118 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cffb09b6-27f1-4628-8ed8-f8c4bfc8a717 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:11.470272 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-27d233c1-0042-4370-91b3-040098e4af67 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:11.471042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-27d233c1-0042-4370-91b3-040098e4af67 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 8895a6f1-f3e3-455c-90f8-6eeca064c26e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:11.480164 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27d233c1-0042-4370-91b3-040098e4af67 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:11.486238 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27d233c1-0042-4370-91b3-040098e4af67 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:11.487116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27d233c1-0042-4370-91b3-040098e4af67 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:11.487798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27d233c1-0042-4370-91b3-040098e4af67 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:11.654574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-cffb09b6-27f1-4628-8ed8-f8c4bfc8a717 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lazy-loading 'services' on Instance uuid 604b986c-b195-4646-879b-a74b61a9b786 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:13:11.697176 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cffb09b6-27f1-4628-8ed8-f8c4bfc8a717 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 2034 microversion: 2.25 time: 0.476639 May 21 21:13:11.700763 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 440/841] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:11 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 2034 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:11.707951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4f70b56a-d3fb-405b-818b-b05b6a835120 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:11.713715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4f70b56a-d3fb-405b-818b-b05b6a835120 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:11.728144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f70b56a-d3fb-405b-818b-b05b6a835120 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:11.730017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f70b56a-d3fb-405b-818b-b05b6a835120 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:11.732778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f70b56a-d3fb-405b-818b-b05b6a835120 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:11.733528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f70b56a-d3fb-405b-818b-b05b6a835120 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:12.022389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-27d233c1-0042-4370-91b3-040098e4af67 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:12.032751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4f70b56a-d3fb-405b-818b-b05b6a835120 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:12.034252 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-27d233c1-0042-4370-91b3-040098e4af67 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e" status: 200 len: 1321 microversion: 2.1 time: 0.567965 May 21 21:13:12.035683 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 402/842] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:11 2022] GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e => generated 1321 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:12.041549 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2313debe-7af7-4808-aed4-d47c3d8dba89 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:12.043754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2313debe-7af7-4808-aed4-d47c3d8dba89 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:12.047495 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4f70b56a-d3fb-405b-818b-b05b6a835120 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1476 microversion: 2.1 time: 0.344302 May 21 21:13:12.048328 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 441/843] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:11 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1476 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:12.052771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2313debe-7af7-4808-aed4-d47c3d8dba89 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:12.052950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5da1d97a-90e0-424f-b16e-fb070ad5197e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:12.053443 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5da1d97a-90e0-424f-b16e-fb070ad5197e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:12.054091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2313debe-7af7-4808-aed4-d47c3d8dba89 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:12.055678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2313debe-7af7-4808-aed4-d47c3d8dba89 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:12.056416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2313debe-7af7-4808-aed4-d47c3d8dba89 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:12.072111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5da1d97a-90e0-424f-b16e-fb070ad5197e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:12.072593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5da1d97a-90e0-424f-b16e-fb070ad5197e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:12.073382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5da1d97a-90e0-424f-b16e-fb070ad5197e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:12.073823 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5da1d97a-90e0-424f-b16e-fb070ad5197e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:12.093709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-2313debe-7af7-4808-aed4-d47c3d8dba89 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lazy-loading 'flavor' on Instance uuid 604b986c-b195-4646-879b-a74b61a9b786 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:13:12.113051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2313debe-7af7-4808-aed4-d47c3d8dba89 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Going to try to live migrate instance to nch2-master-1 {{(pid=131277) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 21 21:13:12.347560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5da1d97a-90e0-424f-b16e-fb070ad5197e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ddad8359564852b7116efb8d9b21fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae6bac4c6b146d8af30881b58e4138f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:12.356521 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5da1d97a-90e0-424f-b16e-fb070ad5197e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122" status: 200 len: 1332 microversion: 2.1 time: 0.307102 May 21 21:13:12.364736 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 442/844] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:12 2022] GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122 => generated 1332 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:12.369897 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c5944998-10c9-4a6b-a7df-0c8c2730b761 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:12.371536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c5944998-10c9-4a6b-a7df-0c8c2730b761 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:12.378218 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5944998-10c9-4a6b-a7df-0c8c2730b761 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:12.378678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5944998-10c9-4a6b-a7df-0c8c2730b761 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:12.379485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5944998-10c9-4a6b-a7df-0c8c2730b761 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:12.379932 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5944998-10c9-4a6b-a7df-0c8c2730b761 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:12.700735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c5944998-10c9-4a6b-a7df-0c8c2730b761 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:12.709052 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c5944998-10c9-4a6b-a7df-0c8c2730b761 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1505 microversion: 2.1 time: 0.342695 May 21 21:13:12.709497 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 443/845] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:12 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:13.052161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5bbd99dc-c0dd-4abc-b162-fad162fa0ddc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:13.052819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5bbd99dc-c0dd-4abc-b162-fad162fa0ddc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 8895a6f1-f3e3-455c-90f8-6eeca064c26e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:13.059657 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5bbd99dc-c0dd-4abc-b162-fad162fa0ddc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:13.060110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5bbd99dc-c0dd-4abc-b162-fad162fa0ddc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:13.061368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5bbd99dc-c0dd-4abc-b162-fad162fa0ddc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:13.061996 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5bbd99dc-c0dd-4abc-b162-fad162fa0ddc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:13.425549 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5bbd99dc-c0dd-4abc-b162-fad162fa0ddc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:13.437739 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5bbd99dc-c0dd-4abc-b162-fad162fa0ddc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e" status: 200 len: 1321 microversion: 2.1 time: 0.389446 May 21 21:13:13.448032 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 444/846] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:13 2022] GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e => generated 1321 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:13:13.453748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c52e25e4-bee5-41a4-bff4-65cd7c2d7274 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:13.455149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c52e25e4-bee5-41a4-bff4-65cd7c2d7274 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:13.463287 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c52e25e4-bee5-41a4-bff4-65cd7c2d7274 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:13.464070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c52e25e4-bee5-41a4-bff4-65cd7c2d7274 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:13.465237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c52e25e4-bee5-41a4-bff4-65cd7c2d7274 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:13.466180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c52e25e4-bee5-41a4-bff4-65cd7c2d7274 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:13.773192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c52e25e4-bee5-41a4-bff4-65cd7c2d7274 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:13.782257 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c52e25e4-bee5-41a4-bff4-65cd7c2d7274 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1476 microversion: 2.1 time: 0.332579 May 21 21:13:13.782964 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 445/847] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:13 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1476 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:13.787737 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2b39dab6-80c6-4b75-94cf-abc0c06a0e25 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:13.788456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2b39dab6-80c6-4b75-94cf-abc0c06a0e25 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:13.794427 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b39dab6-80c6-4b75-94cf-abc0c06a0e25 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:13.795007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b39dab6-80c6-4b75-94cf-abc0c06a0e25 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:13.795988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b39dab6-80c6-4b75-94cf-abc0c06a0e25 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:13.796457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b39dab6-80c6-4b75-94cf-abc0c06a0e25 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:14.444274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2b39dab6-80c6-4b75-94cf-abc0c06a0e25 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ddad8359564852b7116efb8d9b21fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae6bac4c6b146d8af30881b58e4138f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:14.454118 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2b39dab6-80c6-4b75-94cf-abc0c06a0e25 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122" status: 200 len: 1332 microversion: 2.1 time: 0.669757 May 21 21:13:14.463507 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 446/848] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:13 2022] GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122 => generated 1332 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:14.473800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6d0ad9dc-fd93-416b-add0-407d9d1bdd0a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:14.474802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6d0ad9dc-fd93-416b-add0-407d9d1bdd0a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:14.487552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d0ad9dc-fd93-416b-add0-407d9d1bdd0a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:14.500959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d0ad9dc-fd93-416b-add0-407d9d1bdd0a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:14.509844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d0ad9dc-fd93-416b-add0-407d9d1bdd0a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:14.510760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d0ad9dc-fd93-416b-add0-407d9d1bdd0a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:15.042133 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6d0ad9dc-fd93-416b-add0-407d9d1bdd0a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:15.064854 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6d0ad9dc-fd93-416b-add0-407d9d1bdd0a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1505 microversion: 2.1 time: 0.608722 May 21 21:13:15.065707 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 447/849] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:14 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1505 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:15.071010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-25f7a7e4-6f8b-4be6-84a5-fb2ad0942ed2 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:15.071824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-25f7a7e4-6f8b-4be6-84a5-fb2ad0942ed2 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 8895a6f1-f3e3-455c-90f8-6eeca064c26e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:15.080330 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25f7a7e4-6f8b-4be6-84a5-fb2ad0942ed2 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:15.080962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25f7a7e4-6f8b-4be6-84a5-fb2ad0942ed2 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:15.081908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25f7a7e4-6f8b-4be6-84a5-fb2ad0942ed2 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:15.082502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25f7a7e4-6f8b-4be6-84a5-fb2ad0942ed2 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:15.445357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-25f7a7e4-6f8b-4be6-84a5-fb2ad0942ed2 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:15.448257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:15.462833 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-25f7a7e4-6f8b-4be6-84a5-fb2ad0942ed2 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e" status: 200 len: 1321 microversion: 2.1 time: 0.395362 May 21 21:13:15.473739 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 448/850] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:15 2022] GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:15.477666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-accbebad-b1c8-434d-952b-f2425cca03db tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:15.478499 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-accbebad-b1c8-434d-952b-f2425cca03db tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:15.496085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-accbebad-b1c8-434d-952b-f2425cca03db tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:15.496572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-accbebad-b1c8-434d-952b-f2425cca03db tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:15.497371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-accbebad-b1c8-434d-952b-f2425cca03db tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:15.497813 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-accbebad-b1c8-434d-952b-f2425cca03db tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:15.795992 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2313debe-7af7-4808-aed4-d47c3d8dba89 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786/action" status: 202 len: 0 microversion: 2.25 time: 3.758710 May 21 21:13:15.797688 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 403/851] 10.222.0.49 () {62 vars in 1318 bytes} [Sat May 21 21:13:12 2022] POST /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786/action => generated 0 bytes in 3761 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 21 21:13:15.805548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-8931bf9e-c927-4bd5-8f4b-7b0825b77e05 req-15255c9c-ea85-439e-9602-e5cb63942e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8895a6f1-f3e3-455c-90f8-6eeca064c26e", "name": "network-vif-plugged", "status": "completed", "tag": "230eabe2-8c30-4490-8ccb-ece7718fc64c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:15.818425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8931bf9e-c927-4bd5-8f4b-7b0825b77e05 req-15255c9c-ea85-439e-9602-e5cb63942e16 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:15.819214 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8931bf9e-c927-4bd5-8f4b-7b0825b77e05 req-15255c9c-ea85-439e-9602-e5cb63942e16 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:15.819596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-accbebad-b1c8-434d-952b-f2425cca03db tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:15.847026 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-accbebad-b1c8-434d-952b-f2425cca03db tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1476 microversion: 2.1 time: 0.381788 May 21 21:13:15.847912 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 449/852] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:15 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1476 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:15.862596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b98611f4-8cf1-4a18-9223-0dd10ecedd38 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:15.868781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b98611f4-8cf1-4a18-9223-0dd10ecedd38 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:15.869740 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-8931bf9e-c927-4bd5-8f4b-7b0825b77e05 req-15255c9c-ea85-439e-9602-e5cb63942e16 service nova] Creating event network-vif-plugged:230eabe2-8c30-4490-8ccb-ece7718fc64c for instance 8895a6f1-f3e3-455c-90f8-6eeca064c26e on nch1-master-1 May 21 21:13:15.877858 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-8931bf9e-c927-4bd5-8f4b-7b0825b77e05 req-15255c9c-ea85-439e-9602-e5cb63942e16 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078404 May 21 21:13:15.878657 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 404/853] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:15.884635 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b98611f4-8cf1-4a18-9223-0dd10ecedd38 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:15.885108 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b98611f4-8cf1-4a18-9223-0dd10ecedd38 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:15.896626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b98611f4-8cf1-4a18-9223-0dd10ecedd38 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:15.897375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b98611f4-8cf1-4a18-9223-0dd10ecedd38 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:15.902634 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9f3e972f-c723-4839-b3a5-b29232110666 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:15.904208 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9f3e972f-c723-4839-b3a5-b29232110666 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:15.958507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f3e972f-c723-4839-b3a5-b29232110666 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:15.960014 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f3e972f-c723-4839-b3a5-b29232110666 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:15.962539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f3e972f-c723-4839-b3a5-b29232110666 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:15.968977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f3e972f-c723-4839-b3a5-b29232110666 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:16.325983 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b98611f4-8cf1-4a18-9223-0dd10ecedd38 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ddad8359564852b7116efb8d9b21fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae6bac4c6b146d8af30881b58e4138f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:16.326266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9f3e972f-c723-4839-b3a5-b29232110666 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:16.334749 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b98611f4-8cf1-4a18-9223-0dd10ecedd38 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122" status: 200 len: 1332 microversion: 2.1 time: 0.476663 May 21 21:13:16.343552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9f3e972f-c723-4839-b3a5-b29232110666 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:16.343984 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9f3e972f-c723-4839-b3a5-b29232110666 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:16.344886 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9f3e972f-c723-4839-b3a5-b29232110666 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1567 microversion: 2.25 time: 0.464369 May 21 21:13:16.345366 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 450/854] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:15 2022] GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122 => generated 1332 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:16.348419 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 405/855] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:15 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1567 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:16.353041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b05b88ec-3a73-4fe8-b3e6-51cbd5cf8142 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:16.353780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b05b88ec-3a73-4fe8-b3e6-51cbd5cf8142 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:16.371206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b05b88ec-3a73-4fe8-b3e6-51cbd5cf8142 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:16.379321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b05b88ec-3a73-4fe8-b3e6-51cbd5cf8142 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:16.379321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b05b88ec-3a73-4fe8-b3e6-51cbd5cf8142 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:16.379321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b05b88ec-3a73-4fe8-b3e6-51cbd5cf8142 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:16.485903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-84930d42-2671-427b-adc0-48f678b9f3cc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:16.486521 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-84930d42-2671-427b-adc0-48f678b9f3cc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 8895a6f1-f3e3-455c-90f8-6eeca064c26e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:16.493109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84930d42-2671-427b-adc0-48f678b9f3cc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:16.493768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84930d42-2671-427b-adc0-48f678b9f3cc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:16.494829 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84930d42-2671-427b-adc0-48f678b9f3cc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:16.495431 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84930d42-2671-427b-adc0-48f678b9f3cc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:16.763509 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b05b88ec-3a73-4fe8-b3e6-51cbd5cf8142 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:16.773853 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b05b88ec-3a73-4fe8-b3e6-51cbd5cf8142 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1505 microversion: 2.1 time: 0.424254 May 21 21:13:16.784879 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 451/856] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:16 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:16.865597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-40400c2d-f4fa-4da2-adf2-e544a214f860 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:16.866189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-40400c2d-f4fa-4da2-adf2-e544a214f860 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:16.873037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40400c2d-f4fa-4da2-adf2-e544a214f860 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:16.873823 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40400c2d-f4fa-4da2-adf2-e544a214f860 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:16.874863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40400c2d-f4fa-4da2-adf2-e544a214f860 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:16.875465 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40400c2d-f4fa-4da2-adf2-e544a214f860 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:16.936497 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-84930d42-2671-427b-adc0-48f678b9f3cc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:16.945766 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-84930d42-2671-427b-adc0-48f678b9f3cc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e" status: 200 len: 1321 microversion: 2.1 time: 0.463812 May 21 21:13:16.946697 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 406/857] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:16 2022] GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e => generated 1321 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:13:17.327306 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-40400c2d-f4fa-4da2-adf2-e544a214f860 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:17.343448 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-40400c2d-f4fa-4da2-adf2-e544a214f860 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1476 microversion: 2.1 time: 0.481180 May 21 21:13:17.345111 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 452/858] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:16 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1476 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:13:17.362013 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b0d94b3b-09de-423f-9d6f-18ad95287d6a tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:17.363000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b0d94b3b-09de-423f-9d6f-18ad95287d6a tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:17.372796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bdfe7eb8-a205-4c49-868d-fb12fca18aba tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:17.374498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bdfe7eb8-a205-4c49-868d-fb12fca18aba tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:17.380107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0d94b3b-09de-423f-9d6f-18ad95287d6a tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:17.380597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0d94b3b-09de-423f-9d6f-18ad95287d6a tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:17.381415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0d94b3b-09de-423f-9d6f-18ad95287d6a tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:17.381851 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0d94b3b-09de-423f-9d6f-18ad95287d6a tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:17.384213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bdfe7eb8-a205-4c49-868d-fb12fca18aba tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:17.385061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bdfe7eb8-a205-4c49-868d-fb12fca18aba tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:17.386103 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bdfe7eb8-a205-4c49-868d-fb12fca18aba tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:17.386763 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bdfe7eb8-a205-4c49-868d-fb12fca18aba tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:17.660637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b0d94b3b-09de-423f-9d6f-18ad95287d6a tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ddad8359564852b7116efb8d9b21fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae6bac4c6b146d8af30881b58e4138f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:17.673311 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b0d94b3b-09de-423f-9d6f-18ad95287d6a tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122" status: 200 len: 1332 microversion: 2.1 time: 0.315804 May 21 21:13:17.685013 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 407/859] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:17 2022] GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122 => generated 1332 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:17.791342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-34dbf8e8-e86f-400c-88e3-a9d26de0ca6b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:17.792335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-34dbf8e8-e86f-400c-88e3-a9d26de0ca6b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:17.812893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34dbf8e8-e86f-400c-88e3-a9d26de0ca6b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:17.813682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34dbf8e8-e86f-400c-88e3-a9d26de0ca6b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:17.814713 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34dbf8e8-e86f-400c-88e3-a9d26de0ca6b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:17.815354 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34dbf8e8-e86f-400c-88e3-a9d26de0ca6b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:18.226372 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bdfe7eb8-a205-4c49-868d-fb12fca18aba tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:18.237551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bdfe7eb8-a205-4c49-868d-fb12fca18aba tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:18.239383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bdfe7eb8-a205-4c49-868d-fb12fca18aba tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:18.240902 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bdfe7eb8-a205-4c49-868d-fb12fca18aba tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1567 microversion: 2.25 time: 0.872950 May 21 21:13:18.262734 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 453/860] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:17 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1567 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:18.270399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-87a9af6a-5f0a-4bb0-8304-5defda7090d6 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:18.271279 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-87a9af6a-5f0a-4bb0-8304-5defda7090d6 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 8895a6f1-f3e3-455c-90f8-6eeca064c26e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:18.282858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87a9af6a-5f0a-4bb0-8304-5defda7090d6 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:18.283906 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87a9af6a-5f0a-4bb0-8304-5defda7090d6 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:18.285020 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87a9af6a-5f0a-4bb0-8304-5defda7090d6 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:18.297336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87a9af6a-5f0a-4bb0-8304-5defda7090d6 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:18.598119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-34dbf8e8-e86f-400c-88e3-a9d26de0ca6b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:18.620451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-87a9af6a-5f0a-4bb0-8304-5defda7090d6 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:18.647197 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-87a9af6a-5f0a-4bb0-8304-5defda7090d6 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e" status: 200 len: 1471 microversion: 2.1 time: 0.382942 May 21 21:13:18.648464 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 454/861] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:18 2022] GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e => generated 1471 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:18.653332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-62f318b9-22d3-48fb-99f6-30ce2bd1e31e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:18.654212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-62f318b9-22d3-48fb-99f6-30ce2bd1e31e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:18.667040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:18.669077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62f318b9-22d3-48fb-99f6-30ce2bd1e31e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:18.669740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62f318b9-22d3-48fb-99f6-30ce2bd1e31e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:18.670920 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62f318b9-22d3-48fb-99f6-30ce2bd1e31e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:18.671588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62f318b9-22d3-48fb-99f6-30ce2bd1e31e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:18.688564 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-34dbf8e8-e86f-400c-88e3-a9d26de0ca6b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1505 microversion: 2.1 time: 0.889277 May 21 21:13:18.699049 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 408/862] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:17 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1505 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:13:18.702246 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-1211464a-6c67-4376-83d7-de797fdb6879 req-0cd9acb2-3b74-4eac-958e-33ea13365b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c088d68-a287-4c8a-9984-9fd1de948122", "name": "network-vif-plugged", "status": "completed", "tag": "1bea7c12-5a29-43c3-a208-bd1092d37fcd"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:18.724404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:18.729525 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-1211464a-6c67-4376-83d7-de797fdb6879 req-0cd9acb2-3b74-4eac-958e-33ea13365b57 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:18.730207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-1211464a-6c67-4376-83d7-de797fdb6879 req-0cd9acb2-3b74-4eac-958e-33ea13365b57 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:18.748012 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-1211464a-6c67-4376-83d7-de797fdb6879 req-0cd9acb2-3b74-4eac-958e-33ea13365b57 service nova] Creating event network-vif-plugged:1bea7c12-5a29-43c3-a208-bd1092d37fcd for instance 5c088d68-a287-4c8a-9984-9fd1de948122 on nch1-master-1 May 21 21:13:18.767106 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-1211464a-6c67-4376-83d7-de797fdb6879 req-0cd9acb2-3b74-4eac-958e-33ea13365b57 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073587 May 21 21:13:18.768588 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 409/863] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:19.051961 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-eddf977f-e01e-4917-b339-c66b599580a9 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:19.052881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-eddf977f-e01e-4917-b339-c66b599580a9 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] [instance: 21e54116-bcff-4220-af7e-f8467601aa74] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:19.062014 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-eddf977f-e01e-4917-b339-c66b599580a9 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] HTTP exception thrown: Instance 21e54116-bcff-4220-af7e-f8467601aa74 could not be found. May 21 21:13:19.063938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-eddf977f-e01e-4917-b339-c66b599580a9 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Request method failure captured: May 21 21:13:19.063938 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/21e54116-bcff-4220-af7e-f8467601aa74/action HTTP/1.1 May 21 21:13:19.063938 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:13:19.063938 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:13:19.063938 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:13:19.063938 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 15 May 21 21:13:19.063938 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:13:19.063938 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:13:19.063938 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:13:19.063938 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:13:19.063938 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVXWg6j6XX760Sm1xQbTyi9jXvrBEF3qG-7J5pjnR1OtauOvu9h-gQOyvYybKg-E7VzODSkVOisoliO-TNtutLkLmKkFDCqBB33BGbFmr8AqJAiE4NctioNNLzaJqzF9_jRSGCvWqTrDoXnMvhpOGnBwgKztEY-J9Lt1a-3l7GJ3rHM May 21 21:13:19.063938 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:13:19.063938 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:13:19.063938 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:13:19.063938 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:13:19.063938 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:13:19.063938 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:13:19.063938 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 4b8f067dbf24408dba40b7a17c168a27 May 21 21:13:19.063938 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2074060390 May 21 21:13:19.063938 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:13:19.063938 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:13:19.065292 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4b8f067dbf24408dba40b7a17c168a27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b8f067dbf24408dba40b7a17c168a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4b8f067dbf24408dba40b7a17c168a27", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b8f067dbf24408dba40b7a17c168a27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:13:19.065292 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2074060390 May 21 21:13:19.065292 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 4b8f067dbf24408dba40b7a17c168a27 May 21 21:13:19.065292 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2074060390 May 21 21:13:19.065292 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersAdminNegativeTestJSON-2074060390-project-admin May 21 21:13:19.065292 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:13:19.065292 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:13:19.065292 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: d16caacafb054b3094e71cf500b44c16 May 21 21:13:19.065292 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2074060390-project-admin May 21 21:13:19.065292 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:13:19.065292 ncdv-master-1 devstack@n-api.service[131277]: {"migrate": {}} May 21 21:13:19.065292 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:13:19.065292 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 21e54116-bcff-4220-af7e-f8467601aa74 could not be found. May 21 21:13:19.067165 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '21e54116-bcff-4220-af7e-f8467601aa74', 'body': {'migrate': {}}} May 21 21:13:19.067165 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:13:19.067165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:19.067165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:13:19.067165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:13:19.067165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:13:19.067165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:13:19.067165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 21:13:19.067165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:13:19.067165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21e54116-bcff-4220-af7e-f8467601aa74 could not be found. May 21 21:13:19.067165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:19.067165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:19.067165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:19.067165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:19.067165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:19.067165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:19.067165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:13:19.067165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:13:19.067165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:13:19.067165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:13:19.068885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:13:19.068885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:13:19.068885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate May 21 21:13:19.068885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, May 21 21:13:19.068885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:13:19.068885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:13:19.068885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21e54116-bcff-4220-af7e-f8467601aa74 could not be found. May 21 21:13:19.068885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:19.068885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:19.068885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:19.068885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:19.068885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:19.068885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:19.068885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:13:19.068885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:13:19.068885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21e54116-bcff-4220-af7e-f8467601aa74 could not be found. May 21 21:13:19.068885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:19.070658 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-eddf977f-e01e-4917-b339-c66b599580a9 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Returning 404 to user: Instance 21e54116-bcff-4220-af7e-f8467601aa74 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:13:19.070658 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-eddf977f-e01e-4917-b339-c66b599580a9 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/21e54116-bcff-4220-af7e-f8467601aa74/action" status: 404 len: 111 microversion: 2.1 time: 0.295453 May 21 21:13:19.070658 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 410/864] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:13:18 2022] POST /compute/v2.1/servers/21e54116-bcff-4220-af7e-f8467601aa74/action => generated 111 bytes in 297 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:13:19.072698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e8a62043-83c2-4b6d-af15-2a5f95cb0eb4 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:19.073316 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e8a62043-83c2-4b6d-af15-2a5f95cb0eb4 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:19.089411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8a62043-83c2-4b6d-af15-2a5f95cb0eb4 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:19.092911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8a62043-83c2-4b6d-af15-2a5f95cb0eb4 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:19.093826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8a62043-83c2-4b6d-af15-2a5f95cb0eb4 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:19.094272 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8a62043-83c2-4b6d-af15-2a5f95cb0eb4 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:19.370468 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:19.609595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e8a62043-83c2-4b6d-af15-2a5f95cb0eb4 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ddad8359564852b7116efb8d9b21fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae6bac4c6b146d8af30881b58e4138f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:19.619563 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e8a62043-83c2-4b6d-af15-2a5f95cb0eb4 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122" status: 200 len: 1332 microversion: 2.1 time: 0.552536 May 21 21:13:19.642928 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 411/865] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:19 2022] GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122 => generated 1332 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:19.654124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-62f318b9-22d3-48fb-99f6-30ce2bd1e31e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:19.663290 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f58ce62a-d41a-4002-a943-c4e30365f152 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-399859036", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:19.669105 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-62f318b9-22d3-48fb-99f6-30ce2bd1e31e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1476 microversion: 2.1 time: 1.019381 May 21 21:13:19.674011 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 455/866] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:18 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1476 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:19.694410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0f5b9560-563d-4176-90b1-fb57517a106b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:19.694410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0f5b9560-563d-4176-90b1-fb57517a106b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:19.694410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f5b9560-563d-4176-90b1-fb57517a106b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:19.694410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f5b9560-563d-4176-90b1-fb57517a106b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:19.694803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f5b9560-563d-4176-90b1-fb57517a106b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:19.695341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f5b9560-563d-4176-90b1-fb57517a106b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:19.749255 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-f58ce62a-d41a-4002-a943-c4e30365f152 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] validate_networks() for None {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:13:20.097672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-f58ce62a-d41a-4002-a943-c4e30365f152 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:13:20.098620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-f58ce62a-d41a-4002-a943-c4e30365f152 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:13:20.099150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-f58ce62a-d41a-4002-a943-c4e30365f152 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:13:20.103677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-f58ce62a-d41a-4002-a943-c4e30365f152 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:13:20.103677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-f58ce62a-d41a-4002-a943-c4e30365f152 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:13:20.110634 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f58ce62a-d41a-4002-a943-c4e30365f152 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:20.111095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f58ce62a-d41a-4002-a943-c4e30365f152 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:20.111906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f58ce62a-d41a-4002-a943-c4e30365f152 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:20.112393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f58ce62a-d41a-4002-a943-c4e30365f152 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:20.134337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-f58ce62a-d41a-4002-a943-c4e30365f152 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Getting quotas for project 40b391d62af746e1918a37a9813444f4. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:13:20.137553 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0f5b9560-563d-4176-90b1-fb57517a106b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:20.139688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-f58ce62a-d41a-4002-a943-c4e30365f152 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Getting quotas for user e29ca91cfd3d49cb87a18a1eeb968c42 and project 40b391d62af746e1918a37a9813444f4. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:13:20.146716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0f5b9560-563d-4176-90b1-fb57517a106b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:20.153002 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0f5b9560-563d-4176-90b1-fb57517a106b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:20.154252 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0f5b9560-563d-4176-90b1-fb57517a106b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1567 microversion: 2.25 time: 0.479001 May 21 21:13:20.155860 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f58ce62a-d41a-4002-a943-c4e30365f152 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:13:20.159153 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f58ce62a-d41a-4002-a943-c4e30365f152 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:13:20.180461 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 456/867] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:19 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1567 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:20.186232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-17d5b4a2-ffae-441d-8907-24de10230b8f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:20.187460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-17d5b4a2-ffae-441d-8907-24de10230b8f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:20.194865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17d5b4a2-ffae-441d-8907-24de10230b8f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:20.195559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17d5b4a2-ffae-441d-8907-24de10230b8f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:20.196578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17d5b4a2-ffae-441d-8907-24de10230b8f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:20.197171 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17d5b4a2-ffae-441d-8907-24de10230b8f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:20.368255 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f58ce62a-d41a-4002-a943-c4e30365f152 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723733 May 21 21:13:20.385950 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 412/868] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:13:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:13:20.510939 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-17d5b4a2-ffae-441d-8907-24de10230b8f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:20.518447 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aefd2c7a-dadd-4e20-855f-97f036708cfd tempest-FloatingIPsNegativeTestJSON-1084413089 tempest-FloatingIPsNegativeTestJSON-1084413089-project] Calling method '.version_select at 0x7fc81b7fe310>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:20.534626 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-17d5b4a2-ffae-441d-8907-24de10230b8f tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1505 microversion: 2.1 time: 0.352793 May 21 21:13:20.536025 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 457/869] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:20 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:20.562871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8dc0db27-4337-4ef3-9a4a-8c67ed5275cc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:20.563680 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8dc0db27-4337-4ef3-9a4a-8c67ed5275cc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:20.677198 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aefd2c7a-dadd-4e20-855f-97f036708cfd tempest-FloatingIPsNegativeTestJSON-1084413089 tempest-FloatingIPsNegativeTestJSON-1084413089-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.288614 May 21 21:13:20.678931 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 413/870] 10.222.0.49 () {58 vars in 1148 bytes} [Sat May 21 21:13:20 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:13:20.686741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-69e1f7de-6f72-4f80-96c9-5c17f2a5f38f req-b088126a-c8f9-4277-92d5-051ef38ad168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "604b986c-b195-4646-879b-a74b61a9b786", "name": "network-vif-unplugged", "status": "completed", "tag": "113f7a42-78cc-499f-8f86-1ff9d0dcd6e5"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:20.699733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8dc0db27-4337-4ef3-9a4a-8c67ed5275cc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:20.717712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-69e1f7de-6f72-4f80-96c9-5c17f2a5f38f req-b088126a-c8f9-4277-92d5-051ef38ad168 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:20.718093 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-69e1f7de-6f72-4f80-96c9-5c17f2a5f38f req-b088126a-c8f9-4277-92d5-051ef38ad168 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:20.732251 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8dc0db27-4337-4ef3-9a4a-8c67ed5275cc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad" status: 200 len: 1221 microversion: 2.1 time: 0.194769 May 21 21:13:20.734579 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 458/871] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:20 2022] GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad => generated 1221 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:20.734977 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-69e1f7de-6f72-4f80-96c9-5c17f2a5f38f req-b088126a-c8f9-4277-92d5-051ef38ad168 service nova] Creating event network-vif-unplugged:113f7a42-78cc-499f-8f86-1ff9d0dcd6e5 for instance 604b986c-b195-4646-879b-a74b61a9b786 on nch1-master-1 May 21 21:13:20.745695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f38d4d9c-5ee0-4082-8ab4-b7286cb1f4cb tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:20.745695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f38d4d9c-5ee0-4082-8ab4-b7286cb1f4cb tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:20.752388 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-69e1f7de-6f72-4f80-96c9-5c17f2a5f38f req-b088126a-c8f9-4277-92d5-051ef38ad168 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068279 May 21 21:13:20.753434 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 414/872] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:20.755755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f38d4d9c-5ee0-4082-8ab4-b7286cb1f4cb tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:20.756838 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f38d4d9c-5ee0-4082-8ab4-b7286cb1f4cb tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:20.758457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f38d4d9c-5ee0-4082-8ab4-b7286cb1f4cb tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:20.759855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f38d4d9c-5ee0-4082-8ab4-b7286cb1f4cb tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:20.759974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0e02af9a-66ab-4ce4-8016-23be86bf884b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:20.760674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0e02af9a-66ab-4ce4-8016-23be86bf884b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:20.774147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e02af9a-66ab-4ce4-8016-23be86bf884b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:20.774885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e02af9a-66ab-4ce4-8016-23be86bf884b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:20.776020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e02af9a-66ab-4ce4-8016-23be86bf884b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:20.776703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e02af9a-66ab-4ce4-8016-23be86bf884b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:21.086940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f38d4d9c-5ee0-4082-8ab4-b7286cb1f4cb tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ddad8359564852b7116efb8d9b21fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae6bac4c6b146d8af30881b58e4138f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:21.095643 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f38d4d9c-5ee0-4082-8ab4-b7286cb1f4cb tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122" status: 200 len: 1536 microversion: 2.1 time: 0.359915 May 21 21:13:21.096545 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 459/873] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:20 2022] GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122 => generated 1536 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:21.101681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3611d127-b7a3-4d05-a297-540ca82bf04c tempest-FloatingIPsNegativeTestJSON-1084413089 tempest-FloatingIPsNegativeTestJSON-1084413089-project] Action: 'create', calling method: .version_select at 0x7fc81bcb6a60>, body: {"pool": "non_exist_pool"} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:21.135181 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0e02af9a-66ab-4ce4-8016-23be86bf884b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:21.140953 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-3611d127-b7a3-4d05-a297-540ca82bf04c tempest-FloatingIPsNegativeTestJSON-1084413089 tempest-FloatingIPsNegativeTestJSON-1084413089-project] HTTP exception thrown: Floating IP pool not found. May 21 21:13:21.144156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3611d127-b7a3-4d05-a297-540ca82bf04c tempest-FloatingIPsNegativeTestJSON-1084413089 tempest-FloatingIPsNegativeTestJSON-1084413089-project] Request method failure captured: May 21 21:13:21.144156 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 May 21 21:13:21.144156 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:13:21.144156 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:13:21.144156 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:13:21.144156 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 26 May 21 21:13:21.144156 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:13:21.144156 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:13:21.144156 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:13:21.144156 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:13:21.144156 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVXvj1G5HuF8ENBtUNVrzdAZMkrTp_GmmYsIcfSr-jMXh9BiyLMsLRLLmqRxlwB_V5YkYH2uHTJWQlJpoblaMn0rWJoVtrO7D8sPmfwUGblqpQBmkODPiVrCffRs_CWQBIOAo1DrhKT9YzdB62A4t84g0RoaspT-sHadIzPDJL2vSkg May 21 21:13:21.144156 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:13:21.144156 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:13:21.144156 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:13:21.144156 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:13:21.144156 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:13:21.144156 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:13:21.144156 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: daddb4f56cbe43cd88b9e9387eabce91 May 21 21:13:21.144156 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1084413089 May 21 21:13:21.144156 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:13:21.144156 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:13:21.145621 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/daddb4f56cbe43cd88b9e9387eabce91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/daddb4f56cbe43cd88b9e9387eabce91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_daddb4f56cbe43cd88b9e9387eabce91", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/daddb4f56cbe43cd88b9e9387eabce91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:13:21.145621 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1084413089 May 21 21:13:21.145621 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: daddb4f56cbe43cd88b9e9387eabce91 May 21 21:13:21.145621 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1084413089 May 21 21:13:21.145621 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-FloatingIPsNegativeTestJSON-1084413089-project May 21 21:13:21.145621 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:13:21.145621 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:13:21.145621 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: d99338b815994b149342e5f42bfdf305 May 21 21:13:21.145621 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1084413089-project May 21 21:13:21.145621 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:13:21.145621 ncdv-master-1 devstack@n-api.service[131278]: {"pool": "non_exist_pool"} May 21 21:13:21.145621 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:13:21.145621 ncdv-master-1 devstack@n-api.service[131278]: exception: Floating IP pool not found. May 21 21:13:21.145621 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'pool': 'non_exist_pool'}} May 21 21:13:21.145621 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:13:21.146525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:21.146525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create May 21 21:13:21.146525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) May 21 21:13:21.146525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2958, in allocate_floating_ip May 21 21:13:21.146525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) May 21 21:13:21.146525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2948, in _get_floating_ip_pool_id_by_name_or_id May 21 21:13:21.146525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() May 21 21:13:21.146525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. May 21 21:13:21.146525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:21.146525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:21.146525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:21.146525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:21.146525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:21.146525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:21.146525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:13:21.146525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:13:21.146525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:13:21.146525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:13:21.146525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:13:21.146525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:13:21.147751 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create May 21 21:13:21.147751 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:13:21.147751 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. May 21 21:13:21.147751 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:21.147751 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:21.147751 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:21.147751 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:21.147751 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:21.147751 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:21.147751 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:13:21.147751 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:13:21.147751 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. May 21 21:13:21.147751 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:21.148549 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0e02af9a-66ab-4ce4-8016-23be86bf884b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1476 microversion: 2.1 time: 0.392410 May 21 21:13:21.148549 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 415/874] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:20 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1476 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:21.150487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3611d127-b7a3-4d05-a297-540ca82bf04c tempest-FloatingIPsNegativeTestJSON-1084413089 tempest-FloatingIPsNegativeTestJSON-1084413089-project] Returning 404 to user: Floating IP pool not found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:13:21.151576 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3611d127-b7a3-4d05-a297-540ca82bf04c tempest-FloatingIPsNegativeTestJSON-1084413089 tempest-FloatingIPsNegativeTestJSON-1084413089-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.053686 May 21 21:13:21.152544 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 460/875] 10.222.0.49 () {60 vars in 1169 bytes} [Sat May 21 21:13:21 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:13:21.163345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-88b4f0d7-de54-4c0a-8663-e5233e273c63 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Action: 'create', calling method: .version_select at 0x7fc81b6511f0>, body: {"pool": "06983291-49ee-40b0-862a-5c233ae403c5"} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:21.167818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e35303f0-df60-4191-b1fe-a82a8a0b1289 tempest-FloatingIPsNegativeTestJSON-1084413089 tempest-FloatingIPsNegativeTestJSON-1084413089-project] Calling method '.version_select at 0x7fc81b74a940>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:21.228465 ncdv-master-1 devstack@n-api.service[131278]: DEBUG neutronclient.v2_0.client [None req-e35303f0-df60-4191-b1fe-a82a8a0b1289 tempest-FloatingIPsNegativeTestJSON-1084413089 tempest-FloatingIPsNegativeTestJSON-1084413089-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP fc629f77-73f0-4cfa-b099-99883b5ff5b1 could not be found", "detail": ""}} {{(pid=131278) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:13:21.228688 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-e35303f0-df60-4191-b1fe-a82a8a0b1289 tempest-FloatingIPsNegativeTestJSON-1084413089 tempest-FloatingIPsNegativeTestJSON-1084413089-project] HTTP exception thrown: Floating IP not found for ID fc629f77-73f0-4cfa-b099-99883b5ff5b1 May 21 21:13:21.245898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e35303f0-df60-4191-b1fe-a82a8a0b1289 tempest-FloatingIPsNegativeTestJSON-1084413089 tempest-FloatingIPsNegativeTestJSON-1084413089-project] Request method failure captured: May 21 21:13:21.245898 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/os-floating-ips/fc629f77-73f0-4cfa-b099-99883b5ff5b1 HTTP/1.1 May 21 21:13:21.245898 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:13:21.245898 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:13:21.245898 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:13:21.245898 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:13:21.245898 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:13:21.245898 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:13:21.245898 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:13:21.245898 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:13:21.245898 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVXvj1G5HuF8ENBtUNVrzdAZMkrTp_GmmYsIcfSr-jMXh9BiyLMsLRLLmqRxlwB_V5YkYH2uHTJWQlJpoblaMn0rWJoVtrO7D8sPmfwUGblqpQBmkODPiVrCffRs_CWQBIOAo1DrhKT9YzdB62A4t84g0RoaspT-sHadIzPDJL2vSkg May 21 21:13:21.245898 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:13:21.245898 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:13:21.245898 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:13:21.245898 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:13:21.245898 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:13:21.245898 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:13:21.245898 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: daddb4f56cbe43cd88b9e9387eabce91 May 21 21:13:21.245898 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1084413089 May 21 21:13:21.245898 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:13:21.245898 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:13:21.247672 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/daddb4f56cbe43cd88b9e9387eabce91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/daddb4f56cbe43cd88b9e9387eabce91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_daddb4f56cbe43cd88b9e9387eabce91", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/daddb4f56cbe43cd88b9e9387eabce91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:13:21.247672 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1084413089 May 21 21:13:21.247672 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: daddb4f56cbe43cd88b9e9387eabce91 May 21 21:13:21.247672 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1084413089 May 21 21:13:21.247672 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-FloatingIPsNegativeTestJSON-1084413089-project May 21 21:13:21.247672 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:13:21.247672 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:13:21.247672 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: d99338b815994b149342e5f42bfdf305 May 21 21:13:21.247672 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1084413089-project May 21 21:13:21.247672 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:13:21.247672 ncdv-master-1 devstack@n-api.service[131278]: exception: Floating IP not found for ID fc629f77-73f0-4cfa-b099-99883b5ff5b1 May 21 21:13:21.247672 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'fc629f77-73f0-4cfa-b099-99883b5ff5b1'} May 21 21:13:21.247672 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:13:21.251231 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:21.251231 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip May 21 21:13:21.251231 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 21 21:13:21.251231 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:13:21.251231 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:13:21.251231 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 21 21:13:21.251231 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 21 21:13:21.251231 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:13:21.251231 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:13:21.251231 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 21 21:13:21.251231 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 21 21:13:21.251231 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:13:21.251231 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:13:21.251231 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:13:21.251231 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:13:21.251231 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:13:21.251231 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:13:21.251231 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:13:21.251231 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:13:21.253492 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:13:21.253492 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:13:21.253492 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:13:21.253492 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:13:21.253492 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:13:21.253492 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:13:21.253492 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP fc629f77-73f0-4cfa-b099-99883b5ff5b1 could not be found May 21 21:13:21.253492 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36417406-4047-47d4-9d78-da15e986f859'] May 21 21:13:21.253492 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:21.253492 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:21.253492 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:21.253492 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:21.253492 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete May 21 21:13:21.253492 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 21 21:13:21.253492 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip May 21 21:13:21.253492 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 21 21:13:21.253492 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID fc629f77-73f0-4cfa-b099-99883b5ff5b1. May 21 21:13:21.253492 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:21.253492 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:21.253492 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:21.255249 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:21.255249 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:21.255249 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:21.255249 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:13:21.255249 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:13:21.255249 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:13:21.255249 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:13:21.255249 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:13:21.255249 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:13:21.255249 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete May 21 21:13:21.255249 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 21 21:13:21.255249 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID fc629f77-73f0-4cfa-b099-99883b5ff5b1 May 21 21:13:21.255249 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:21.255249 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:21.255249 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:21.255249 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:21.255249 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:21.255249 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:21.255249 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:13:21.255249 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:13:21.262940 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID fc629f77-73f0-4cfa-b099-99883b5ff5b1 May 21 21:13:21.262940 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:21.262940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e35303f0-df60-4191-b1fe-a82a8a0b1289 tempest-FloatingIPsNegativeTestJSON-1084413089 tempest-FloatingIPsNegativeTestJSON-1084413089-project] Returning 404 to user: Floating IP not found for ID fc629f77-73f0-4cfa-b099-99883b5ff5b1 {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:13:21.262940 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e35303f0-df60-4191-b1fe-a82a8a0b1289 tempest-FloatingIPsNegativeTestJSON-1084413089 tempest-FloatingIPsNegativeTestJSON-1084413089-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/fc629f77-73f0-4cfa-b099-99883b5ff5b1" status: 404 len: 111 microversion: 2.1 time: 0.102325 May 21 21:13:21.262940 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 461/876] 10.222.0.49 () {58 vars in 1262 bytes} [Sat May 21 21:13:21 2022] DELETE /compute/v2.1/os-floating-ips/fc629f77-73f0-4cfa-b099-99883b5ff5b1 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:13:21.270297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5b87d5ae-ec83-4715-9d9d-8b191b066008 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:21.272704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5b87d5ae-ec83-4715-9d9d-8b191b066008 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:21.294872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5b87d5ae-ec83-4715-9d9d-8b191b066008 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:21.295488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5b87d5ae-ec83-4715-9d9d-8b191b066008 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:21.296815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5b87d5ae-ec83-4715-9d9d-8b191b066008 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:21.297266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5b87d5ae-ec83-4715-9d9d-8b191b066008 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:21.665452 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5b87d5ae-ec83-4715-9d9d-8b191b066008 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:21.684788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5b87d5ae-ec83-4715-9d9d-8b191b066008 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:21.694257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5b87d5ae-ec83-4715-9d9d-8b191b066008 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:21.694257 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5b87d5ae-ec83-4715-9d9d-8b191b066008 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1567 microversion: 2.25 time: 0.428768 May 21 21:13:21.699473 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 462/877] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:21 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1567 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:21.707560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-38651ba9-76da-46ed-8531-436c49bceb6c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:21.709177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-38651ba9-76da-46ed-8531-436c49bceb6c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:21.723459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38651ba9-76da-46ed-8531-436c49bceb6c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:21.724451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38651ba9-76da-46ed-8531-436c49bceb6c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:21.725568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38651ba9-76da-46ed-8531-436c49bceb6c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:21.726229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38651ba9-76da-46ed-8531-436c49bceb6c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:22.024879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-38651ba9-76da-46ed-8531-436c49bceb6c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:22.038345 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-38651ba9-76da-46ed-8531-436c49bceb6c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1480 microversion: 2.1 time: 0.337064 May 21 21:13:22.039684 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 463/878] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:21 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1480 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:22.044660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a004268e-1cdb-47db-8158-7bd5f9afef4d tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:22.051238 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a004268e-1cdb-47db-8158-7bd5f9afef4d tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:22.074517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a004268e-1cdb-47db-8158-7bd5f9afef4d tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:22.074976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a004268e-1cdb-47db-8158-7bd5f9afef4d tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:22.075778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a004268e-1cdb-47db-8158-7bd5f9afef4d tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:22.076304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a004268e-1cdb-47db-8158-7bd5f9afef4d tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:22.177185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a004268e-1cdb-47db-8158-7bd5f9afef4d tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:22.186060 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a004268e-1cdb-47db-8158-7bd5f9afef4d tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad" status: 200 len: 1225 microversion: 2.1 time: 0.144753 May 21 21:13:22.187413 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 464/879] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:22 2022] GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad => generated 1225 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:22.200849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6af63bb9-a596-41fb-b86e-187099b40b52 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '.version_select at 0x7fc81b852550>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:22.204848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6af63bb9-a596-41fb-b86e-187099b40b52 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:22.205544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6af63bb9-a596-41fb-b86e-187099b40b52 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:22.218018 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6af63bb9-a596-41fb-b86e-187099b40b52 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 2334 microversion: 2.1 time: 0.029192 May 21 21:13:22.220437 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 465/880] 10.222.0.49 () {58 vars in 1142 bytes} [Sat May 21 21:13:22 2022] GET /compute/v2.1/os-migrations => generated 2334 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:22.227441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2b93ced2-7b2a-4577-a513-0aaa0b614755 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:22.228573 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2b93ced2-7b2a-4577-a513-0aaa0b614755 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:22.237668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b93ced2-7b2a-4577-a513-0aaa0b614755 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:22.237668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b93ced2-7b2a-4577-a513-0aaa0b614755 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:22.238704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b93ced2-7b2a-4577-a513-0aaa0b614755 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:22.239335 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b93ced2-7b2a-4577-a513-0aaa0b614755 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:22.608117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2b93ced2-7b2a-4577-a513-0aaa0b614755 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:22.616052 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2b93ced2-7b2a-4577-a513-0aaa0b614755 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1476 microversion: 2.1 time: 0.394374 May 21 21:13:22.620632 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 466/881] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:22 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1476 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:22.635884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e3205b5e-c502-4f5e-ac1e-20155c299ed0 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:22.636545 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e3205b5e-c502-4f5e-ac1e-20155c299ed0 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:22.651750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3205b5e-c502-4f5e-ac1e-20155c299ed0 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:22.657162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3205b5e-c502-4f5e-ac1e-20155c299ed0 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:22.658317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3205b5e-c502-4f5e-ac1e-20155c299ed0 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:22.661702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3205b5e-c502-4f5e-ac1e-20155c299ed0 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:22.896868 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e3205b5e-c502-4f5e-ac1e-20155c299ed0 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1631 microversion: 2.1 time: 0.274793 May 21 21:13:22.908477 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 467/882] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:22 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1631 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:22.908477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fe6b9eb9-c9a9-46e8-9751-d3e35a2356cb tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:22.908477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fe6b9eb9-c9a9-46e8-9751-d3e35a2356cb tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:22.925707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fe6b9eb9-c9a9-46e8-9751-d3e35a2356cb tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:22.925707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fe6b9eb9-c9a9-46e8-9751-d3e35a2356cb tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:22.925707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fe6b9eb9-c9a9-46e8-9751-d3e35a2356cb tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:22.925707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fe6b9eb9-c9a9-46e8-9751-d3e35a2356cb tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:23.143722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fe6b9eb9-c9a9-46e8-9751-d3e35a2356cb tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:23.152950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fe6b9eb9-c9a9-46e8-9751-d3e35a2356cb tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:23.155269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fe6b9eb9-c9a9-46e8-9751-d3e35a2356cb tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:23.156567 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fe6b9eb9-c9a9-46e8-9751-d3e35a2356cb tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1567 microversion: 2.25 time: 0.257758 May 21 21:13:23.157380 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 468/883] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:22 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:23.164341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-6f306318-1ec3-4be8-a7c0-a35cbb6e7383 req-0222f19a-8530-45a4-8b60-ead3db326716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "604b986c-b195-4646-879b-a74b61a9b786", "tag": "113f7a42-78cc-499f-8f86-1ff9d0dcd6e5"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:23.174333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6f306318-1ec3-4be8-a7c0-a35cbb6e7383 req-0222f19a-8530-45a4-8b60-ead3db326716 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:23.174792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6f306318-1ec3-4be8-a7c0-a35cbb6e7383 req-0222f19a-8530-45a4-8b60-ead3db326716 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:23.177878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:23.190370 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-6f306318-1ec3-4be8-a7c0-a35cbb6e7383 req-0222f19a-8530-45a4-8b60-ead3db326716 service nova] Creating event network-changed:113f7a42-78cc-499f-8f86-1ff9d0dcd6e5 for instance 604b986c-b195-4646-879b-a74b61a9b786 on nch1-master-1 May 21 21:13:23.196858 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-6f306318-1ec3-4be8-a7c0-a35cbb6e7383 req-0222f19a-8530-45a4-8b60-ead3db326716 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038456 May 21 21:13:23.202233 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 469/884] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:23.208053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1d2024ef-63df-4696-ae8d-e820e6df85e8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1053903542", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "d047b92d-2da6-44d2-8e31-01dbad6dd130"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:23.271793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-1d2024ef-63df-4696-ae8d-e820e6df85e8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] validate_networks() for [('d047b92d-2da6-44d2-8e31-01dbad6dd130', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:13:23.990736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-1d2024ef-63df-4696-ae8d-e820e6df85e8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:13:23.991357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-1d2024ef-63df-4696-ae8d-e820e6df85e8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:13:23.992919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-1d2024ef-63df-4696-ae8d-e820e6df85e8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:13:23.993544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-1d2024ef-63df-4696-ae8d-e820e6df85e8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:13:23.994145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-1d2024ef-63df-4696-ae8d-e820e6df85e8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:13:24.010640 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d2024ef-63df-4696-ae8d-e820e6df85e8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:24.011382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d2024ef-63df-4696-ae8d-e820e6df85e8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:24.012562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d2024ef-63df-4696-ae8d-e820e6df85e8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:24.013471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d2024ef-63df-4696-ae8d-e820e6df85e8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:24.043400 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-1d2024ef-63df-4696-ae8d-e820e6df85e8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Getting quotas for project 5284da653ac24d73a21e8442609889c9. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:13:24.052315 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-1d2024ef-63df-4696-ae8d-e820e6df85e8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Getting quotas for user 34c22f04c3114d46b6b1b1168aa064f5 and project 5284da653ac24d73a21e8442609889c9. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:13:24.073244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1d2024ef-63df-4696-ae8d-e820e6df85e8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:13:24.080999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1d2024ef-63df-4696-ae8d-e820e6df85e8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:13:24.273751 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1d2024ef-63df-4696-ae8d-e820e6df85e8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.069895 May 21 21:13:24.275154 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 470/885] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:13:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:13:24.280275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-03553493-9953-42bf-8887-f777030b2b9d tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:24.281003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-03553493-9953-42bf-8887-f777030b2b9d tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:24.288549 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03553493-9953-42bf-8887-f777030b2b9d tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:24.289001 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03553493-9953-42bf-8887-f777030b2b9d tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:24.290989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03553493-9953-42bf-8887-f777030b2b9d tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:24.290989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03553493-9953-42bf-8887-f777030b2b9d tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:24.412180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-03553493-9953-42bf-8887-f777030b2b9d tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:24.423821 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-03553493-9953-42bf-8887-f777030b2b9d tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad" status: 200 len: 1279 microversion: 2.1 time: 0.148354 May 21 21:13:24.428087 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 471/886] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:24 2022] GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad => generated 1279 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:24.438739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-07684edf-d9aa-45f4-bdcd-07cbfab89985 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:24.439664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-07684edf-d9aa-45f4-bdcd-07cbfab89985 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:24.455609 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-07684edf-d9aa-45f4-bdcd-07cbfab89985 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:24.456252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-07684edf-d9aa-45f4-bdcd-07cbfab89985 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:24.457242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-07684edf-d9aa-45f4-bdcd-07cbfab89985 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:24.457837 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-07684edf-d9aa-45f4-bdcd-07cbfab89985 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:25.203715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-07684edf-d9aa-45f4-bdcd-07cbfab89985 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:25.216762 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-07684edf-d9aa-45f4-bdcd-07cbfab89985 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1476 microversion: 2.1 time: 0.785893 May 21 21:13:25.217408 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 472/887] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:24 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1476 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:25.233205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-94bd1798-e994-429e-a79a-c2be090657bd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:25.234152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-94bd1798-e994-429e-a79a-c2be090657bd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:25.245635 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94bd1798-e994-429e-a79a-c2be090657bd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:25.246396 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94bd1798-e994-429e-a79a-c2be090657bd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:25.248037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94bd1798-e994-429e-a79a-c2be090657bd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:25.248713 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94bd1798-e994-429e-a79a-c2be090657bd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:25.470043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-94bd1798-e994-429e-a79a-c2be090657bd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:25.479037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-94bd1798-e994-429e-a79a-c2be090657bd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:25.481041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-94bd1798-e994-429e-a79a-c2be090657bd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:25.482272 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-94bd1798-e994-429e-a79a-c2be090657bd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1567 microversion: 2.25 time: 0.262811 May 21 21:13:25.483471 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 473/888] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:25 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1567 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:25.489339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eaf219ef-14c6-444a-8df6-044d56145f30 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:25.490325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-eaf219ef-14c6-444a-8df6-044d56145f30 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:25.577025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-eaf219ef-14c6-444a-8df6-044d56145f30 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:25.577025 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-eaf219ef-14c6-444a-8df6-044d56145f30 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1211 microversion: 2.1 time: 0.090863 May 21 21:13:25.577588 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 474/889] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:25 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:25.582603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-28f09dc0-6a18-4484-9146-621c0b8400e7 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:25.583626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-28f09dc0-6a18-4484-9146-621c0b8400e7 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:25.590002 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28f09dc0-6a18-4484-9146-621c0b8400e7 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:25.590873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28f09dc0-6a18-4484-9146-621c0b8400e7 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:25.591710 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28f09dc0-6a18-4484-9146-621c0b8400e7 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:25.594676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28f09dc0-6a18-4484-9146-621c0b8400e7 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:25.878644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-28f09dc0-6a18-4484-9146-621c0b8400e7 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:25.905181 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-28f09dc0-6a18-4484-9146-621c0b8400e7 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad" status: 200 len: 1321 microversion: 2.1 time: 0.325370 May 21 21:13:25.915809 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 475/890] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:25 2022] GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad => generated 1321 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:26.180480 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-88b4f0d7-de54-4c0a-8663-e5233e273c63 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.030818 May 21 21:13:26.181467 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 416/891] 10.222.0.49 () {60 vars in 1169 bytes} [Sat May 21 21:13:21 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:26.201432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9bd7639e-72c4-4bed-b18d-9a1b46fc7796 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.29"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:26.202600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9bd7639e-72c4-4bed-b18d-9a1b46fc7796 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:26.211946 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9bd7639e-72c4-4bed-b18d-9a1b46fc7796 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:26.212708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9bd7639e-72c4-4bed-b18d-9a1b46fc7796 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:26.213953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9bd7639e-72c4-4bed-b18d-9a1b46fc7796 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:26.214752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9bd7639e-72c4-4bed-b18d-9a1b46fc7796 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:26.237141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8ffd0a68-e6da-4e1e-b6d2-a719f2798d33 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:26.238283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8ffd0a68-e6da-4e1e-b6d2-a719f2798d33 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:26.264542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ffd0a68-e6da-4e1e-b6d2-a719f2798d33 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:26.265180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ffd0a68-e6da-4e1e-b6d2-a719f2798d33 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:26.267218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ffd0a68-e6da-4e1e-b6d2-a719f2798d33 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:26.269291 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ffd0a68-e6da-4e1e-b6d2-a719f2798d33 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:26.339827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9bd7639e-72c4-4bed-b18d-9a1b46fc7796 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Acquired lock "refresh_cache-5c088d68-a287-4c8a-9984-9fd1de948122" {{(pid=131278) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 21 21:13:26.774287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8ffd0a68-e6da-4e1e-b6d2-a719f2798d33 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:26.787503 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8ffd0a68-e6da-4e1e-b6d2-a719f2798d33 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1476 microversion: 2.1 time: 0.556813 May 21 21:13:26.788363 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 417/892] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:26 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1476 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:26.808391 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-14a8a041-d1ab-44c0-bf95-4b03578f803c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:26.809901 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-14a8a041-d1ab-44c0-bf95-4b03578f803c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:26.817423 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14a8a041-d1ab-44c0-bf95-4b03578f803c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:26.822099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14a8a041-d1ab-44c0-bf95-4b03578f803c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:26.828168 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14a8a041-d1ab-44c0-bf95-4b03578f803c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:26.829842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14a8a041-d1ab-44c0-bf95-4b03578f803c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:27.406881 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 21:13:27.407500 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 21:13:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 (ip 10.222.0.49) !!! May 21 21:13:27.694178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-14a8a041-d1ab-44c0-bf95-4b03578f803c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:27.725662 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-14a8a041-d1ab-44c0-bf95-4b03578f803c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:27.729061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-14a8a041-d1ab-44c0-bf95-4b03578f803c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:27.733869 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-14a8a041-d1ab-44c0-bf95-4b03578f803c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1567 microversion: 2.25 time: 0.939497 May 21 21:13:27.734523 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 418/893] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:26 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1567 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:27.747651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-49b08b73-2997-4a60-9211-e32556abe480 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:27.749393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-49b08b73-2997-4a60-9211-e32556abe480 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:27.761758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49b08b73-2997-4a60-9211-e32556abe480 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:27.762225 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49b08b73-2997-4a60-9211-e32556abe480 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:27.763057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49b08b73-2997-4a60-9211-e32556abe480 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:27.765282 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49b08b73-2997-4a60-9211-e32556abe480 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:27.790092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:27.923342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-49b08b73-2997-4a60-9211-e32556abe480 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:27.934766 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-49b08b73-2997-4a60-9211-e32556abe480 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1281 microversion: 2.1 time: 0.199139 May 21 21:13:27.937249 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 419/894] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:27 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1281 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:27.943124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ed977508-a8f4-4f64-8005-7c90ef91d636 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:27.944049 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ed977508-a8f4-4f64-8005-7c90ef91d636 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:27.953314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed977508-a8f4-4f64-8005-7c90ef91d636 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:27.954155 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed977508-a8f4-4f64-8005-7c90ef91d636 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:27.971389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed977508-a8f4-4f64-8005-7c90ef91d636 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:27.972463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed977508-a8f4-4f64-8005-7c90ef91d636 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:28.239722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ed977508-a8f4-4f64-8005-7c90ef91d636 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:28.247616 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ed977508-a8f4-4f64-8005-7c90ef91d636 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad" status: 200 len: 1321 microversion: 2.1 time: 0.309023 May 21 21:13:28.261765 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 420/895] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:27 2022] GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:28.264448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b1f1004a-2712-46f8-9fdc-784883a534b6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:28.265334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b1f1004a-2712-46f8-9fdc-784883a534b6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:28.273742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1f1004a-2712-46f8-9fdc-784883a534b6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:28.284019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1f1004a-2712-46f8-9fdc-784883a534b6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:28.284019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1f1004a-2712-46f8-9fdc-784883a534b6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:28.284019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1f1004a-2712-46f8-9fdc-784883a534b6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:28.526490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b1f1004a-2712-46f8-9fdc-784883a534b6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:28.542969 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b1f1004a-2712-46f8-9fdc-784883a534b6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1476 microversion: 2.1 time: 0.290622 May 21 21:13:28.544006 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 421/896] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:28 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1476 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:28.564247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-a7ca73ff-b6ec-41e0-bfe5-3fa738eaf1dd req-182a27f7-38a1-4f15-b07a-0ae68c7184b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30cee6ae-d43b-458a-9f0d-4ff396297bad", "tag": "dc214c8f-7695-4d7f-842f-e90a3b0b5e6a"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:28.581195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a7ca73ff-b6ec-41e0-bfe5-3fa738eaf1dd req-182a27f7-38a1-4f15-b07a-0ae68c7184b3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:28.581655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a7ca73ff-b6ec-41e0-bfe5-3fa738eaf1dd req-182a27f7-38a1-4f15-b07a-0ae68c7184b3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:28.598190 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a7ca73ff-b6ec-41e0-bfe5-3fa738eaf1dd req-182a27f7-38a1-4f15-b07a-0ae68c7184b3 service nova] Creating event network-changed:dc214c8f-7695-4d7f-842f-e90a3b0b5e6a for instance 30cee6ae-d43b-458a-9f0d-4ff396297bad on nch2-master-1 May 21 21:13:28.604839 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-a7ca73ff-b6ec-41e0-bfe5-3fa738eaf1dd req-182a27f7-38a1-4f15-b07a-0ae68c7184b3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057823 May 21 21:13:28.605758 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 422/897] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:28.760402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9287f2f2-20c9-4371-acfc-ffc9cafe4f00 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:28.760402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9287f2f2-20c9-4371-acfc-ffc9cafe4f00 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:28.775756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9287f2f2-20c9-4371-acfc-ffc9cafe4f00 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:28.776246 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9287f2f2-20c9-4371-acfc-ffc9cafe4f00 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:28.777306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9287f2f2-20c9-4371-acfc-ffc9cafe4f00 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:28.777725 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9287f2f2-20c9-4371-acfc-ffc9cafe4f00 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:29.030790 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9287f2f2-20c9-4371-acfc-ffc9cafe4f00 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:29.040046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9287f2f2-20c9-4371-acfc-ffc9cafe4f00 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:29.041843 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9287f2f2-20c9-4371-acfc-ffc9cafe4f00 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:29.050025 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9287f2f2-20c9-4371-acfc-ffc9cafe4f00 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1567 microversion: 2.25 time: 0.299487 May 21 21:13:29.053815 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 423/898] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:28 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1567 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:29.057209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ce319ab3-3dc5-4afd-a040-620de890c66b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:29.058007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ce319ab3-3dc5-4afd-a040-620de890c66b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:29.066041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce319ab3-3dc5-4afd-a040-620de890c66b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:29.066750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce319ab3-3dc5-4afd-a040-620de890c66b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:29.067730 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce319ab3-3dc5-4afd-a040-620de890c66b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:29.068376 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce319ab3-3dc5-4afd-a040-620de890c66b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:29.180395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ce319ab3-3dc5-4afd-a040-620de890c66b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:29.195137 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ce319ab3-3dc5-4afd-a040-620de890c66b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1269 microversion: 2.1 time: 0.142769 May 21 21:13:29.208451 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 424/899] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:29 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:29.270672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6d8a8876-4855-4ed5-a5c2-950919d932d6 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:29.271475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6d8a8876-4855-4ed5-a5c2-950919d932d6 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:29.278704 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d8a8876-4855-4ed5-a5c2-950919d932d6 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:29.279004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d8a8876-4855-4ed5-a5c2-950919d932d6 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:29.280018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d8a8876-4855-4ed5-a5c2-950919d932d6 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:29.280514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d8a8876-4855-4ed5-a5c2-950919d932d6 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:29.447752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6d8a8876-4855-4ed5-a5c2-950919d932d6 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:29.462080 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6d8a8876-4855-4ed5-a5c2-950919d932d6 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad" status: 200 len: 1321 microversion: 2.1 time: 0.195492 May 21 21:13:29.463585 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 425/900] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:29 2022] GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:13:29.561538 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1c3f12c3-ace7-4610-b631-11f825a65e2d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:29.563022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1c3f12c3-ace7-4610-b631-11f825a65e2d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:29.571810 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1c3f12c3-ace7-4610-b631-11f825a65e2d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:29.572733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1c3f12c3-ace7-4610-b631-11f825a65e2d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:29.574714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1c3f12c3-ace7-4610-b631-11f825a65e2d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:29.575342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1c3f12c3-ace7-4610-b631-11f825a65e2d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:29.988847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1c3f12c3-ace7-4610-b631-11f825a65e2d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:30.006973 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1c3f12c3-ace7-4610-b631-11f825a65e2d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1476 microversion: 2.1 time: 0.439907 May 21 21:13:30.006973 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 426/901] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:29 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1476 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:30.121485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:30.148667 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:30.212993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-24b37681-711d-43c5-97d3-8c37c0731330 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1091519284", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:30.297542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-24b37681-711d-43c5-97d3-8c37c0731330 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] validate_networks() for None {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:13:30.589565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-9bd7639e-72c4-4bed-b18d-9a1b46fc7796 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Building network info cache for instance {{(pid=131278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 21 21:13:30.758587 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-24b37681-711d-43c5-97d3-8c37c0731330 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:13:30.759059 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-24b37681-711d-43c5-97d3-8c37c0731330 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:13:30.759472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-24b37681-711d-43c5-97d3-8c37c0731330 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:13:30.760077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-24b37681-711d-43c5-97d3-8c37c0731330 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:13:30.760738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-24b37681-711d-43c5-97d3-8c37c0731330 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:13:30.778058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24b37681-711d-43c5-97d3-8c37c0731330 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:30.778058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24b37681-711d-43c5-97d3-8c37c0731330 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:30.779648 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24b37681-711d-43c5-97d3-8c37c0731330 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:30.780352 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24b37681-711d-43c5-97d3-8c37c0731330 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:30.799944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-24b37681-711d-43c5-97d3-8c37c0731330 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Getting quotas for project dd80101aef664387bbad8effdf280090. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:13:30.804976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-24b37681-711d-43c5-97d3-8c37c0731330 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Getting quotas for user a5007c2462df46d385ca2f883b061a54 and project dd80101aef664387bbad8effdf280090. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:13:30.819392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-24b37681-711d-43c5-97d3-8c37c0731330 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:13:30.822607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-24b37681-711d-43c5-97d3-8c37c0731330 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:13:30.978208 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-24b37681-711d-43c5-97d3-8c37c0731330 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.978649 May 21 21:13:30.978903 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 427/902] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:13:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:13:30.991031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2fb53bad-3de1-476f-b871-6e0edf2bd6e8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:30.991031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2fb53bad-3de1-476f-b871-6e0edf2bd6e8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:30.996543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fb53bad-3de1-476f-b871-6e0edf2bd6e8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:30.997502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fb53bad-3de1-476f-b871-6e0edf2bd6e8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:30.999366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fb53bad-3de1-476f-b871-6e0edf2bd6e8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:31.000769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fb53bad-3de1-476f-b871-6e0edf2bd6e8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:31.268185 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2fb53bad-3de1-476f-b871-6e0edf2bd6e8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:31.277716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2fb53bad-3de1-476f-b871-6e0edf2bd6e8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:31.279436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2fb53bad-3de1-476f-b871-6e0edf2bd6e8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:31.281497 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2fb53bad-3de1-476f-b871-6e0edf2bd6e8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1567 microversion: 2.25 time: 0.301618 May 21 21:13:31.292463 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 428/903] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:30 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1567 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:31.292463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f6dd33c9-c2f4-4edd-94ed-0a3d45e61cae tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:31.292463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f6dd33c9-c2f4-4edd-94ed-0a3d45e61cae tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:31.303737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6dd33c9-c2f4-4edd-94ed-0a3d45e61cae tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:31.304803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6dd33c9-c2f4-4edd-94ed-0a3d45e61cae tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:31.306157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6dd33c9-c2f4-4edd-94ed-0a3d45e61cae tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:31.308063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6dd33c9-c2f4-4edd-94ed-0a3d45e61cae tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:31.509061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f6dd33c9-c2f4-4edd-94ed-0a3d45e61cae tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:31.517897 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f6dd33c9-c2f4-4edd-94ed-0a3d45e61cae tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1311 microversion: 2.1 time: 0.234748 May 21 21:13:31.519099 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 429/904] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:31 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1311 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:31.545126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-43ecab98-7b21-49b1-bcc4-b960be40c673 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:31.550702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-43ecab98-7b21-49b1-bcc4-b960be40c673 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:31.554842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43ecab98-7b21-49b1-bcc4-b960be40c673 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:31.555024 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43ecab98-7b21-49b1-bcc4-b960be40c673 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:31.556012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43ecab98-7b21-49b1-bcc4-b960be40c673 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:31.556799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43ecab98-7b21-49b1-bcc4-b960be40c673 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:31.869118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-43ecab98-7b21-49b1-bcc4-b960be40c673 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:31.879245 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-43ecab98-7b21-49b1-bcc4-b960be40c673 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad" status: 200 len: 1321 microversion: 2.1 time: 0.358674 May 21 21:13:31.883595 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 430/905] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:31 2022] GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:31.892938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-38c8da28-97a9-420a-a031-272d08ab6678 req-3d1952ca-e7d9-42c9-9ff5-512cdca89791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c088d68-a287-4c8a-9984-9fd1de948122", "tag": "1bea7c12-5a29-43c3-a208-bd1092d37fcd"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:31.911393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-38c8da28-97a9-420a-a031-272d08ab6678 req-3d1952ca-e7d9-42c9-9ff5-512cdca89791 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:31.911968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-38c8da28-97a9-420a-a031-272d08ab6678 req-3d1952ca-e7d9-42c9-9ff5-512cdca89791 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:31.936764 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-38c8da28-97a9-420a-a031-272d08ab6678 req-3d1952ca-e7d9-42c9-9ff5-512cdca89791 service nova] Creating event network-changed:1bea7c12-5a29-43c3-a208-bd1092d37fcd for instance 5c088d68-a287-4c8a-9984-9fd1de948122 on nch1-master-1 May 21 21:13:31.948001 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-38c8da28-97a9-420a-a031-272d08ab6678 req-3d1952ca-e7d9-42c9-9ff5-512cdca89791 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063137 May 21 21:13:31.954017 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 431/906] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:31.960430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4a336ca4-01c6-415d-ad72-8033f1a383c4 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:31.961849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4a336ca4-01c6-415d-ad72-8033f1a383c4 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:32.063691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4a336ca4-01c6-415d-ad72-8033f1a383c4 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:32.072887 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4a336ca4-01c6-415d-ad72-8033f1a383c4 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219" status: 200 len: 1220 microversion: 2.1 time: 0.116958 May 21 21:13:32.077253 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 432/907] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:31 2022] GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 => generated 1220 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:32.085091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-26b592d0-94c2-40b6-aa83-677cbab72672 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:32.086310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-26b592d0-94c2-40b6-aa83-677cbab72672 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:32.097474 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-26b592d0-94c2-40b6-aa83-677cbab72672 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:32.098274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-26b592d0-94c2-40b6-aa83-677cbab72672 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:32.099235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-26b592d0-94c2-40b6-aa83-677cbab72672 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:32.099806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-26b592d0-94c2-40b6-aa83-677cbab72672 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:32.468639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-9bd7639e-72c4-4bed-b18d-9a1b46fc7796 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Updating instance_info_cache with network_info: [{"id": "1bea7c12-5a29-43c3-a208-bd1092d37fcd", "address": "fa:16:3e:74:a8:3b", "network": {"id": "04b78a92-706b-4bf5-ae65-d20c8d1ef8cb", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-873642298-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5ae6bac4c6b146d8af30881b58e4138f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1bea7c12-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 21 21:13:32.537443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-26b592d0-94c2-40b6-aa83-677cbab72672 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:32.545785 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-26b592d0-94c2-40b6-aa83-677cbab72672 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1476 microversion: 2.1 time: 0.466589 May 21 21:13:32.546286 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 433/908] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:32 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1476 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:32.551124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-96c2d409-a9d8-4144-8ab4-a34f30df7144 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:32.551885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-96c2d409-a9d8-4144-8ab4-a34f30df7144 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:32.558174 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96c2d409-a9d8-4144-8ab4-a34f30df7144 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:32.558630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96c2d409-a9d8-4144-8ab4-a34f30df7144 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:32.559400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96c2d409-a9d8-4144-8ab4-a34f30df7144 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:32.559837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96c2d409-a9d8-4144-8ab4-a34f30df7144 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:32.608057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9bd7639e-72c4-4bed-b18d-9a1b46fc7796 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Releasing lock "refresh_cache-5c088d68-a287-4c8a-9984-9fd1de948122" {{(pid=131278) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 21 21:13:32.609021 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9bd7639e-72c4-4bed-b18d-9a1b46fc7796 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "POST /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122/action" status: 202 len: 0 microversion: 2.1 time: 6.418121 May 21 21:13:32.612611 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 476/909] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:13:26 2022] POST /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122/action => generated 0 bytes in 6421 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) May 21 21:13:32.621513 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-361b9b80-231c-4967-95c4-8d0187a90768 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:32.622340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-361b9b80-231c-4967-95c4-8d0187a90768 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:32.633126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-361b9b80-231c-4967-95c4-8d0187a90768 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:32.633586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-361b9b80-231c-4967-95c4-8d0187a90768 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:32.634381 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-361b9b80-231c-4967-95c4-8d0187a90768 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:32.634821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-361b9b80-231c-4967-95c4-8d0187a90768 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:32.826324 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-96c2d409-a9d8-4144-8ab4-a34f30df7144 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:32.835669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-96c2d409-a9d8-4144-8ab4-a34f30df7144 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:32.838233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-96c2d409-a9d8-4144-8ab4-a34f30df7144 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:32.839676 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-96c2d409-a9d8-4144-8ab4-a34f30df7144 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1542 microversion: 2.25 time: 0.292259 May 21 21:13:32.840470 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 434/910] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:32 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1542 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:32.862057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7810a7d5-b95a-45c1-8d4f-c2b5b6165d0e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Action: 'create', calling method: .version_select at 0x7fc81b660790>, body: {"pool": "06983291-49ee-40b0-862a-5c233ae403c5"} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:33.067955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-361b9b80-231c-4967-95c4-8d0187a90768 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:33.111233 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-361b9b80-231c-4967-95c4-8d0187a90768 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1311 microversion: 2.1 time: 0.491630 May 21 21:13:33.129102 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 477/911] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:32 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1311 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:33.139786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2356bb3c-9a0a-43cf-aee2-d78620ee03d7 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '.version_select at 0x7fc81bd4dca0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:33.148304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2356bb3c-9a0a-43cf-aee2-d78620ee03d7 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:33.151091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2356bb3c-9a0a-43cf-aee2-d78620ee03d7 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:33.166096 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2356bb3c-9a0a-43cf-aee2-d78620ee03d7 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 2785 microversion: 2.25 time: 0.034830 May 21 21:13:33.167418 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 478/912] 10.222.0.49 () {60 vars in 1183 bytes} [Sat May 21 21:13:33 2022] GET /compute/v2.1/os-migrations => generated 2785 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:33.183985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-983c7eb9-3b91-4063-833e-c278e25a4cb5 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:33.184839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-983c7eb9-3b91-4063-833e-c278e25a4cb5 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:33.196656 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-983c7eb9-3b91-4063-833e-c278e25a4cb5 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:33.196656 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-983c7eb9-3b91-4063-833e-c278e25a4cb5 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:33.196656 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-983c7eb9-3b91-4063-833e-c278e25a4cb5 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:33.196656 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-983c7eb9-3b91-4063-833e-c278e25a4cb5 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:33.539992 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-983c7eb9-3b91-4063-833e-c278e25a4cb5 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:33.550622 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-983c7eb9-3b91-4063-833e-c278e25a4cb5 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad" status: 200 len: 1321 microversion: 2.1 time: 0.380923 May 21 21:13:33.556940 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 479/913] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:33 2022] GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad => generated 1321 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:33.563781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4cba0f47-1c9e-442f-b63f-43ad89e572d7 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:33.564554 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4cba0f47-1c9e-442f-b63f-43ad89e572d7 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:33.572097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cba0f47-1c9e-442f-b63f-43ad89e572d7 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:33.577478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cba0f47-1c9e-442f-b63f-43ad89e572d7 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:33.577478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cba0f47-1c9e-442f-b63f-43ad89e572d7 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:33.577478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cba0f47-1c9e-442f-b63f-43ad89e572d7 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:33.677449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4cba0f47-1c9e-442f-b63f-43ad89e572d7 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:33.687088 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4cba0f47-1c9e-442f-b63f-43ad89e572d7 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219" status: 200 len: 1272 microversion: 2.1 time: 0.133944 May 21 21:13:33.690510 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 480/914] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:33 2022] GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 => generated 1272 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:33.696247 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-00bb0119-0fd8-401d-aeb2-fcae9ee063c2 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:33.697874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-00bb0119-0fd8-401d-aeb2-fcae9ee063c2 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:33.703955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00bb0119-0fd8-401d-aeb2-fcae9ee063c2 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:33.704577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00bb0119-0fd8-401d-aeb2-fcae9ee063c2 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:33.705498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00bb0119-0fd8-401d-aeb2-fcae9ee063c2 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:33.706311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00bb0119-0fd8-401d-aeb2-fcae9ee063c2 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:33.981093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-00bb0119-0fd8-401d-aeb2-fcae9ee063c2 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lazy-loading 'services' on Instance uuid 604b986c-b195-4646-879b-a74b61a9b786 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:13:34.003418 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-00bb0119-0fd8-401d-aeb2-fcae9ee063c2 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 2034 microversion: 2.25 time: 0.311338 May 21 21:13:34.036538 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 481/915] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:33 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 2034 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:34.050568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-68209917-d5ae-4e02-ab09-be307c2ca64b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8a19dad-a211-4b3c-948b-1c4f05f69948"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:34.052013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-68209917-d5ae-4e02-ab09-be307c2ca64b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:34.061413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:34.063566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-68209917-d5ae-4e02-ab09-be307c2ca64b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:34.064026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-68209917-d5ae-4e02-ab09-be307c2ca64b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:34.064851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-68209917-d5ae-4e02-ab09-be307c2ca64b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:34.065290 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-68209917-d5ae-4e02-ab09-be307c2ca64b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:35.572934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=10 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:35.637325 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7810a7d5-b95a-45c1-8d4f-c2b5b6165d0e tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.781568 May 21 21:13:35.638761 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 435/916] 10.222.0.49 () {60 vars in 1169 bytes} [Sat May 21 21:13:32 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:35.643725 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-13f98a2f-0d0b-4982-b09b-c5a19b7a4830 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:35.644979 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-13f98a2f-0d0b-4982-b09b-c5a19b7a4830 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:35.653240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-13f98a2f-0d0b-4982-b09b-c5a19b7a4830 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:35.654222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-13f98a2f-0d0b-4982-b09b-c5a19b7a4830 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:35.655412 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-13f98a2f-0d0b-4982-b09b-c5a19b7a4830 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:35.656076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-13f98a2f-0d0b-4982-b09b-c5a19b7a4830 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:35.865714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-13f98a2f-0d0b-4982-b09b-c5a19b7a4830 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:35.874544 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-13f98a2f-0d0b-4982-b09b-c5a19b7a4830 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1476 microversion: 2.1 time: 0.234547 May 21 21:13:35.876089 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 436/917] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:35 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1476 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:35.880562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-16245e78-f3fb-4958-97dd-23f1aa090606 req-090a04aa-5036-4620-acab-b2bec581aa97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afc6789c-29a3-4a84-8045-36b96ce9e9fe", "tag": "5f73169d-eef2-4b97-bed3-b8b63c509864"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:35.890575 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-16245e78-f3fb-4958-97dd-23f1aa090606 req-090a04aa-5036-4620-acab-b2bec581aa97 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:35.891705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-16245e78-f3fb-4958-97dd-23f1aa090606 req-090a04aa-5036-4620-acab-b2bec581aa97 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:35.914289 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-16245e78-f3fb-4958-97dd-23f1aa090606 req-090a04aa-5036-4620-acab-b2bec581aa97 service nova] Creating event network-changed:5f73169d-eef2-4b97-bed3-b8b63c509864 for instance afc6789c-29a3-4a84-8045-36b96ce9e9fe on nch2-master-1 May 21 21:13:35.946864 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-16245e78-f3fb-4958-97dd-23f1aa090606 req-090a04aa-5036-4620-acab-b2bec581aa97 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046751 May 21 21:13:35.949796 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 437/918] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:35.959058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fdff4ab2-d0dc-4739-9922-cfee087995eb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:35.960323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fdff4ab2-d0dc-4739-9922-cfee087995eb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:35.970401 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fdff4ab2-d0dc-4739-9922-cfee087995eb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:35.970856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fdff4ab2-d0dc-4739-9922-cfee087995eb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:35.972245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fdff4ab2-d0dc-4739-9922-cfee087995eb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:35.974078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fdff4ab2-d0dc-4739-9922-cfee087995eb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:36.074825 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-68209917-d5ae-4e02-ab09-be307c2ca64b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "POST /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.035777 May 21 21:13:36.076743 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 482/919] 10.222.0.49 () {60 vars in 1322 bytes} [Sat May 21 21:13:34 2022] POST /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013/os-volume_attachments => generated 194 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:36.085740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d38d21df-fe01-420f-949a-3369a8a00d39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1279544886", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "4418fa8f-36c6-43c9-9df7-37213ff858a6"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:36.167866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-d38d21df-fe01-420f-949a-3369a8a00d39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] validate_networks() for [('4418fa8f-36c6-43c9-9df7-37213ff858a6', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:13:36.309108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fdff4ab2-d0dc-4739-9922-cfee087995eb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:36.315458 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fdff4ab2-d0dc-4739-9922-cfee087995eb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1311 microversion: 2.1 time: 0.362346 May 21 21:13:36.325368 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 438/920] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:35 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1311 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:36.325368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5c4cdbe1-301c-4628-a6a9-965af75e6370 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:36.325368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5c4cdbe1-301c-4628-a6a9-965af75e6370 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:36.336036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c4cdbe1-301c-4628-a6a9-965af75e6370 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:36.338841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c4cdbe1-301c-4628-a6a9-965af75e6370 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:36.338841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c4cdbe1-301c-4628-a6a9-965af75e6370 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:36.338841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c4cdbe1-301c-4628-a6a9-965af75e6370 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:36.605058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5c4cdbe1-301c-4628-a6a9-965af75e6370 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:36.616631 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5c4cdbe1-301c-4628-a6a9-965af75e6370 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad" status: 200 len: 1321 microversion: 2.1 time: 0.298575 May 21 21:13:36.619107 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 439/921] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:36 2022] GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:36.625155 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6b0f6559-f0e3-442c-9879-3d5782a770f7 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:36.625909 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6b0f6559-f0e3-442c-9879-3d5782a770f7 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:36.632616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6b0f6559-f0e3-442c-9879-3d5782a770f7 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:36.633221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6b0f6559-f0e3-442c-9879-3d5782a770f7 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:36.634752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6b0f6559-f0e3-442c-9879-3d5782a770f7 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:36.635996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6b0f6559-f0e3-442c-9879-3d5782a770f7 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:36.727860 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6b0f6559-f0e3-442c-9879-3d5782a770f7 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:36.729408 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:36.737739 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6b0f6559-f0e3-442c-9879-3d5782a770f7 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219" status: 200 len: 1278 microversion: 2.1 time: 0.117422 May 21 21:13:36.738913 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 440/922] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:36 2022] GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 => generated 1278 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:36.751524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b62dbfcc-efa7-4079-9235-d6a08183cbfd tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.42"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:36.753030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b62dbfcc-efa7-4079-9235-d6a08183cbfd tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:36.762967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b62dbfcc-efa7-4079-9235-d6a08183cbfd tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:36.763513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b62dbfcc-efa7-4079-9235-d6a08183cbfd tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:36.764567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b62dbfcc-efa7-4079-9235-d6a08183cbfd tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:36.765036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b62dbfcc-efa7-4079-9235-d6a08183cbfd tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:36.868092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b62dbfcc-efa7-4079-9235-d6a08183cbfd tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Acquired lock "refresh_cache-5c088d68-a287-4c8a-9984-9fd1de948122" {{(pid=131277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 21 21:13:37.920453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d38d21df-fe01-420f-949a-3369a8a00d39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:13:37.924668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d38d21df-fe01-420f-949a-3369a8a00d39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:13:37.927166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d38d21df-fe01-420f-949a-3369a8a00d39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:13:37.929052 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d38d21df-fe01-420f-949a-3369a8a00d39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:13:37.929783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d38d21df-fe01-420f-949a-3369a8a00d39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:13:37.966115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d38d21df-fe01-420f-949a-3369a8a00d39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:37.980942 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d38d21df-fe01-420f-949a-3369a8a00d39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:37.982690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d38d21df-fe01-420f-949a-3369a8a00d39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:37.983472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d38d21df-fe01-420f-949a-3369a8a00d39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:38.011428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-d38d21df-fe01-420f-949a-3369a8a00d39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Getting quotas for project 220204ccbcf443c98a64994f29700ef0. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:13:38.016724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-d38d21df-fe01-420f-949a-3369a8a00d39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Getting quotas for user b7199de1e6f04147b197c086ac6cc6fc and project 220204ccbcf443c98a64994f29700ef0. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:13:38.029362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d38d21df-fe01-420f-949a-3369a8a00d39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:13:38.031843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d38d21df-fe01-420f-949a-3369a8a00d39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:13:38.049727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG neutronclient.v2_0.client [None req-b62dbfcc-efa7-4079-9235-d6a08183cbfd tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.0.42 (4b7d3070-b75b-420a-9059-7bbf78ace5fb) with port 1bea7c12-5a29-43c3-a208-bd1092d37fcd using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 06983291-49ee-40b0-862a-5c233ae403c5.", "detail": ""}} {{(pid=131277) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:13:38.051925 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b62dbfcc-efa7-4079-9235-d6a08183cbfd tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Releasing lock "refresh_cache-5c088d68-a287-4c8a-9984-9fd1de948122" {{(pid=131277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 21 21:13:38.054394 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-b62dbfcc-efa7-4079-9235-d6a08183cbfd tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] HTTP exception thrown: Cannot associate floating IP 172.35.0.42 (4b7d3070-b75b-420a-9059-7bbf78ace5fb) with port 1bea7c12-5a29-43c3-a208-bd1092d37fcd using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 06983291-49ee-40b0-862a-5c233ae403c5. May 21 21:13:38.054394 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-40cfb000-7697-47de-be67-156a41d1c2ba'] May 21 21:13:38.059065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b62dbfcc-efa7-4079-9235-d6a08183cbfd tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Request method failure captured: May 21 21:13:38.059065 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122/action HTTP/1.1 May 21 21:13:38.059065 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:13:38.059065 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:13:38.059065 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:13:38.059065 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 45 May 21 21:13:38.059065 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:13:38.059065 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:13:38.059065 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:13:38.059065 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:13:38.059065 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVXVJJzhF_ivczZOcdrnjDceuT90XVoI2ncGqyWraxrL26EGVtGdTl8E3BjrljOPGzG7IE__NrS0aOqGs-mFcT5UYxyaM_ayigVJqmSPi8DQPj-La_aXM6HQj38kDFxpK8lnMdkqupcxwcrkoNaPl7NLNe4cuQvTnfHm5vHpY79oSjw May 21 21:13:38.059065 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:13:38.059065 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:13:38.059065 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:13:38.059065 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:13:38.059065 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:13:38.059065 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:13:38.059065 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 5ae6bac4c6b146d8af30881b58e4138f May 21 21:13:38.059065 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 May 21 21:13:38.059065 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:13:38.059065 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:13:38.061137 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5ae6bac4c6b146d8af30881b58e4138f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5ae6bac4c6b146d8af30881b58e4138f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5ae6bac4c6b146d8af30881b58e4138f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5ae6bac4c6b146d8af30881b58e4138f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:13:38.061137 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 May 21 21:13:38.061137 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 5ae6bac4c6b146d8af30881b58e4138f May 21 21:13:38.061137 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 May 21 21:13:38.061137 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project May 21 21:13:38.061137 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:13:38.061137 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:13:38.061137 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 95ddad8359564852b7116efb8d9b21fb May 21 21:13:38.061137 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project May 21 21:13:38.061137 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:13:38.061137 ncdv-master-1 devstack@n-api.service[131277]: {"addFloatingIp": {"address": "172.35.0.42"}} May 21 21:13:38.061137 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:13:38.062046 ncdv-master-1 devstack@n-api.service[131277]: exception: Cannot associate floating IP 172.35.0.42 (4b7d3070-b75b-420a-9059-7bbf78ace5fb) with port 1bea7c12-5a29-43c3-a208-bd1092d37fcd using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 06983291-49ee-40b0-862a-5c233ae403c5. May 21 21:13:38.062046 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-40cfb000-7697-47de-be67-156a41d1c2ba'] May 21 21:13:38.062046 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '5c088d68-a287-4c8a-9984-9fd1de948122', 'body': {'addFloatingIp': {'address': '172.35.0.42'}}} May 21 21:13:38.062046 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:13:38.062046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:38.062046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2689, in associate_floating_ip May 21 21:13:38.062046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) May 21 21:13:38.062046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:13:38.062046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:13:38.062046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip May 21 21:13:38.062046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), May 21 21:13:38.062046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:13:38.062046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:13:38.062046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource May 21 21:13:38.062046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) May 21 21:13:38.062046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:13:38.062046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:13:38.063381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put May 21 21:13:38.063381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, May 21 21:13:38.063381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:13:38.063381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:13:38.063381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:13:38.063381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:13:38.063381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:13:38.063381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:13:38.063381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:13:38.063381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:13:38.063381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:13:38.063381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:13:38.063381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:13:38.063381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:13:38.063381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:13:38.063381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:13:38.064511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.0.42 (4b7d3070-b75b-420a-9059-7bbf78ace5fb) with port 1bea7c12-5a29-43c3-a208-bd1092d37fcd using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 06983291-49ee-40b0-862a-5c233ae403c5. May 21 21:13:38.064511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40cfb000-7697-47de-be67-156a41d1c2ba'] May 21 21:13:38.064511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:38.064511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:38.064511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:38.064511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:38.064511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip May 21 21:13:38.064511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, May 21 21:13:38.064511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper May 21 21:13:38.064511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) May 21 21:13:38.064511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2691, in associate_floating_ip May 21 21:13:38.064511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) May 21 21:13:38.064511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.0.42 (4b7d3070-b75b-420a-9059-7bbf78ace5fb) with port 1bea7c12-5a29-43c3-a208-bd1092d37fcd using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 06983291-49ee-40b0-862a-5c233ae403c5. May 21 21:13:38.064511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40cfb000-7697-47de-be67-156a41d1c2ba'] May 21 21:13:38.064511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:38.064511 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:38.066287 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:38.066287 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:38.066287 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:38.066287 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:38.066287 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:13:38.066287 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:13:38.066287 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:13:38.066287 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:13:38.066287 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:13:38.066287 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:13:38.066287 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:13:38.066287 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:13:38.066287 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip May 21 21:13:38.066287 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) May 21 21:13:38.066287 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.0.42 (4b7d3070-b75b-420a-9059-7bbf78ace5fb) with port 1bea7c12-5a29-43c3-a208-bd1092d37fcd using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 06983291-49ee-40b0-862a-5c233ae403c5. May 21 21:13:38.066287 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40cfb000-7697-47de-be67-156a41d1c2ba'] May 21 21:13:38.066287 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:38.066287 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:38.067854 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:38.067854 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:38.067854 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:38.067854 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:38.067854 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:13:38.067854 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:13:38.067854 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.0.42 (4b7d3070-b75b-420a-9059-7bbf78ace5fb) with port 1bea7c12-5a29-43c3-a208-bd1092d37fcd using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 06983291-49ee-40b0-862a-5c233ae403c5. May 21 21:13:38.067854 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40cfb000-7697-47de-be67-156a41d1c2ba'] May 21 21:13:38.067854 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:38.069509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b62dbfcc-efa7-4079-9235-d6a08183cbfd tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Returning 400 to user: Cannot associate floating IP 172.35.0.42 (4b7d3070-b75b-420a-9059-7bbf78ace5fb) with port 1bea7c12-5a29-43c3-a208-bd1092d37fcd using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 06983291-49ee-40b0-862a-5c233ae403c5. May 21 21:13:38.069509 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-40cfb000-7697-47de-be67-156a41d1c2ba'] {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:13:38.070446 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b62dbfcc-efa7-4079-9235-d6a08183cbfd tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "POST /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122/action" status: 400 len: 381 microversion: 2.1 time: 1.330294 May 21 21:13:38.071217 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 441/923] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:13:36 2022] POST /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122/action => generated 381 bytes in 1332 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:13:38.076656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c3363cb9-e273-467c-87c7-0300407e0e08 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:38.087847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c3363cb9-e273-467c-87c7-0300407e0e08 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:38.087847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c3363cb9-e273-467c-87c7-0300407e0e08 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:38.087847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c3363cb9-e273-467c-87c7-0300407e0e08 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:38.087847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c3363cb9-e273-467c-87c7-0300407e0e08 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:38.088237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c3363cb9-e273-467c-87c7-0300407e0e08 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:38.241261 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d38d21df-fe01-420f-949a-3369a8a00d39 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.161370 May 21 21:13:38.242543 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 483/924] 10.222.0.49 () {62 vars in 1187 bytes} [Sat May 21 21:13:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2165 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 21 21:13:38.250192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b1a4ffca-b09e-4bec-a04d-f87d1ea39bd1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:38.251061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b1a4ffca-b09e-4bec-a04d-f87d1ea39bd1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:38.260908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b1a4ffca-b09e-4bec-a04d-f87d1ea39bd1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:38.267884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b1a4ffca-b09e-4bec-a04d-f87d1ea39bd1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:38.267884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b1a4ffca-b09e-4bec-a04d-f87d1ea39bd1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:38.267884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b1a4ffca-b09e-4bec-a04d-f87d1ea39bd1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:38.336766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c3363cb9-e273-467c-87c7-0300407e0e08 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:38.353227 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c3363cb9-e273-467c-87c7-0300407e0e08 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1476 microversion: 2.1 time: 0.280689 May 21 21:13:38.358334 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 442/925] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:38 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1476 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:38.372974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-570f7a8d-bee5-4771-b6a2-42ae440c0ef4 req-5a379ab5-b77e-437d-9fae-f98c04c89b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30cee6ae-d43b-458a-9f0d-4ff396297bad", "name": "network-vif-plugged", "status": "completed", "tag": "dc214c8f-7695-4d7f-842f-e90a3b0b5e6a"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:38.399800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-570f7a8d-bee5-4771-b6a2-42ae440c0ef4 req-5a379ab5-b77e-437d-9fae-f98c04c89b0f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:38.422828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-570f7a8d-bee5-4771-b6a2-42ae440c0ef4 req-5a379ab5-b77e-437d-9fae-f98c04c89b0f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:38.443334 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-570f7a8d-bee5-4771-b6a2-42ae440c0ef4 req-5a379ab5-b77e-437d-9fae-f98c04c89b0f service nova] Creating event network-vif-plugged:dc214c8f-7695-4d7f-842f-e90a3b0b5e6a for instance 30cee6ae-d43b-458a-9f0d-4ff396297bad on nch2-master-1 May 21 21:13:38.457047 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-570f7a8d-bee5-4771-b6a2-42ae440c0ef4 req-5a379ab5-b77e-437d-9fae-f98c04c89b0f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097120 May 21 21:13:38.459768 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 443/926] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:38.471241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3c9ba8cd-fc32-4ff4-a2d7-b05f75ff44ad tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:38.472305 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3c9ba8cd-fc32-4ff4-a2d7-b05f75ff44ad tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:38.480555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c9ba8cd-fc32-4ff4-a2d7-b05f75ff44ad tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:38.485061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c9ba8cd-fc32-4ff4-a2d7-b05f75ff44ad tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:38.485061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c9ba8cd-fc32-4ff4-a2d7-b05f75ff44ad tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:38.485061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c9ba8cd-fc32-4ff4-a2d7-b05f75ff44ad tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:38.715237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b1a4ffca-b09e-4bec-a04d-f87d1ea39bd1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:38.728380 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b1a4ffca-b09e-4bec-a04d-f87d1ea39bd1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1311 microversion: 2.1 time: 0.482150 May 21 21:13:38.729728 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 484/927] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:38 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1311 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:38.755601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-991204d4-577f-4d9c-adb2-8008448b871b tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:38.762385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-991204d4-577f-4d9c-adb2-8008448b871b tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:38.781084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-991204d4-577f-4d9c-adb2-8008448b871b tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:38.781547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-991204d4-577f-4d9c-adb2-8008448b871b tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:38.784518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-991204d4-577f-4d9c-adb2-8008448b871b tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:38.784988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-991204d4-577f-4d9c-adb2-8008448b871b tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:38.938496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3c9ba8cd-fc32-4ff4-a2d7-b05f75ff44ad tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:38.950130 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3c9ba8cd-fc32-4ff4-a2d7-b05f75ff44ad tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad" status: 200 len: 1321 microversion: 2.1 time: 0.488055 May 21 21:13:38.962277 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 444/928] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:38 2022] GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad => generated 1321 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:38.969617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-119fd3b6-0259-480b-a54b-f8075fe052e0 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Calling method '.version_select at 0x7fc81b638040>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:39.134020 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-991204d4-577f-4d9c-adb2-8008448b871b tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:39.149375 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-991204d4-577f-4d9c-adb2-8008448b871b tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219" status: 200 len: 1320 microversion: 2.1 time: 0.417346 May 21 21:13:39.150921 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 485/929] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:38 2022] GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 => generated 1320 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:39.161105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-31402920-785d-42a5-bf72-393f3e8b80dc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:39.162167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-31402920-785d-42a5-bf72-393f3e8b80dc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:39.240785 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-31402920-785d-42a5-bf72-393f3e8b80dc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:39.253352 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-31402920-785d-42a5-bf72-393f3e8b80dc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:39.254669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-31402920-785d-42a5-bf72-393f3e8b80dc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:39.256271 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-31402920-785d-42a5-bf72-393f3e8b80dc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1262 microversion: 2.25 time: 0.103615 May 21 21:13:39.281080 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 486/930] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:39 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1262 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:39.377575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dd493cff-9f38-40ab-acdf-425dd49c4435 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:39.378579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dd493cff-9f38-40ab-acdf-425dd49c4435 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:39.387473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd493cff-9f38-40ab-acdf-425dd49c4435 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:39.388910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd493cff-9f38-40ab-acdf-425dd49c4435 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:39.389977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd493cff-9f38-40ab-acdf-425dd49c4435 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:39.390637 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd493cff-9f38-40ab-acdf-425dd49c4435 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:39.818503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dd493cff-9f38-40ab-acdf-425dd49c4435 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:39.826297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:39.833461 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dd493cff-9f38-40ab-acdf-425dd49c4435 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1476 microversion: 2.1 time: 0.460410 May 21 21:13:39.834621 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 487/931] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:39 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1476 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:39.840243 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-0606b85b-749e-4b15-b928-e2bc3df2dc02 req-17b14a1f-55a9-49fe-952f-e9c800eb4347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d7caaad-109e-4e52-9ecb-180ab87d1219", "tag": "3a693139-22a5-4d00-8f4d-05185cc581ca"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:39.851337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0606b85b-749e-4b15-b928-e2bc3df2dc02 req-17b14a1f-55a9-49fe-952f-e9c800eb4347 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:39.852104 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0606b85b-749e-4b15-b928-e2bc3df2dc02 req-17b14a1f-55a9-49fe-952f-e9c800eb4347 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:39.868005 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-0606b85b-749e-4b15-b928-e2bc3df2dc02 req-17b14a1f-55a9-49fe-952f-e9c800eb4347 service nova] Creating event network-changed:3a693139-22a5-4d00-8f4d-05185cc581ca for instance 0d7caaad-109e-4e52-9ecb-180ab87d1219 on nch1-master-1 May 21 21:13:39.874233 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-0606b85b-749e-4b15-b928-e2bc3df2dc02 req-17b14a1f-55a9-49fe-952f-e9c800eb4347 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038158 May 21 21:13:39.875772 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 488/932] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:39.891849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-72217b7b-030c-4457-b061-a7dd66a07f9a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:39.893257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-72217b7b-030c-4457-b061-a7dd66a07f9a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:39.901584 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72217b7b-030c-4457-b061-a7dd66a07f9a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:39.902374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72217b7b-030c-4457-b061-a7dd66a07f9a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:39.903275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72217b7b-030c-4457-b061-a7dd66a07f9a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:39.904563 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72217b7b-030c-4457-b061-a7dd66a07f9a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:40.623122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-72217b7b-030c-4457-b061-a7dd66a07f9a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:40.633813 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-72217b7b-030c-4457-b061-a7dd66a07f9a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1311 microversion: 2.1 time: 0.756379 May 21 21:13:40.635580 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 489/933] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:39 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1311 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:40.658475 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c7d2d4ac-dc14-40c7-a021-13ca235b3588 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:40.660839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c7d2d4ac-dc14-40c7-a021-13ca235b3588 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:40.672579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c7d2d4ac-dc14-40c7-a021-13ca235b3588 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:40.673796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c7d2d4ac-dc14-40c7-a021-13ca235b3588 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:40.674781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c7d2d4ac-dc14-40c7-a021-13ca235b3588 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:40.675677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c7d2d4ac-dc14-40c7-a021-13ca235b3588 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:40.695282 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-119fd3b6-0259-480b-a54b-f8075fe052e0 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/4b7d3070-b75b-420a-9059-7bbf78ace5fb" status: 202 len: 0 microversion: 2.1 time: 1.731700 May 21 21:13:40.695951 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 445/934] 10.222.0.49 () {58 vars in 1262 bytes} [Sat May 21 21:13:38 2022] DELETE /compute/v2.1/os-floating-ips/4b7d3070-b75b-420a-9059-7bbf78ace5fb => generated 0 bytes in 1733 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:13:40.701039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-611e4344-0a40-4c3e-ac2c-1e11346a6637 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:40.701669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-611e4344-0a40-4c3e-ac2c-1e11346a6637 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:40.708695 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-611e4344-0a40-4c3e-ac2c-1e11346a6637 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:40.710740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-611e4344-0a40-4c3e-ac2c-1e11346a6637 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:40.710740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-611e4344-0a40-4c3e-ac2c-1e11346a6637 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:40.710740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-611e4344-0a40-4c3e-ac2c-1e11346a6637 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:40.790122 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:40.876016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-611e4344-0a40-4c3e-ac2c-1e11346a6637 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:40.885601 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-611e4344-0a40-4c3e-ac2c-1e11346a6637 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219" status: 200 len: 1320 microversion: 2.1 time: 0.188452 May 21 21:13:40.886188 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 446/935] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:40 2022] GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 => generated 1320 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:40.892105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-180d2f07-4fa8-414a-aecf-fe368c6c4821 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:40.893376 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-180d2f07-4fa8-414a-aecf-fe368c6c4821 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:40.901812 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-180d2f07-4fa8-414a-aecf-fe368c6c4821 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:40.902265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-180d2f07-4fa8-414a-aecf-fe368c6c4821 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:40.903051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-180d2f07-4fa8-414a-aecf-fe368c6c4821 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:40.903524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-180d2f07-4fa8-414a-aecf-fe368c6c4821 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:40.931520 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c7d2d4ac-dc14-40c7-a021-13ca235b3588 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:40.942860 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c7d2d4ac-dc14-40c7-a021-13ca235b3588 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad" status: 200 len: 1321 microversion: 2.1 time: 0.305897 May 21 21:13:40.943451 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 490/936] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:40 2022] GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:40.948175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-44b92e44-a300-4a51-9143-69676a30b09a req-810f3045-ffa9-4074-83a6-52bc6d5e3c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc6789c-29a3-4a84-8045-36b96ce9e9fe", "name": "network-vif-plugged", "status": "completed", "tag": "5f73169d-eef2-4b97-bed3-b8b63c509864"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:40.957935 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-44b92e44-a300-4a51-9143-69676a30b09a req-810f3045-ffa9-4074-83a6-52bc6d5e3c55 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:40.958411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-44b92e44-a300-4a51-9143-69676a30b09a req-810f3045-ffa9-4074-83a6-52bc6d5e3c55 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:40.971112 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-44b92e44-a300-4a51-9143-69676a30b09a req-810f3045-ffa9-4074-83a6-52bc6d5e3c55 service nova] Creating event network-vif-plugged:5f73169d-eef2-4b97-bed3-b8b63c509864 for instance afc6789c-29a3-4a84-8045-36b96ce9e9fe on nch2-master-1 May 21 21:13:40.976147 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-44b92e44-a300-4a51-9143-69676a30b09a req-810f3045-ffa9-4074-83a6-52bc6d5e3c55 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031579 May 21 21:13:40.976940 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 491/937] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:40.983438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-03a5531f-861e-4acb-bd94-7f7cf4f44890 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.0.29"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:41.005987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-180d2f07-4fa8-414a-aecf-fe368c6c4821 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:41.014817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-180d2f07-4fa8-414a-aecf-fe368c6c4821 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:41.016482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-180d2f07-4fa8-414a-aecf-fe368c6c4821 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:41.017767 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-180d2f07-4fa8-414a-aecf-fe368c6c4821 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1322 microversion: 2.25 time: 0.130300 May 21 21:13:41.018330 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 447/938] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:40 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1322 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:41.022851 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c7403f99-3ae7-4636-9f0d-931fead1a68e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:41.023623 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c7403f99-3ae7-4636-9f0d-931fead1a68e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:41.030925 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:41.032375 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7403f99-3ae7-4636-9f0d-931fead1a68e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:41.033021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7403f99-3ae7-4636-9f0d-931fead1a68e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:41.034201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7403f99-3ae7-4636-9f0d-931fead1a68e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:41.034639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7403f99-3ae7-4636-9f0d-931fead1a68e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:41.206743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-03a5531f-861e-4acb-bd94-7f7cf4f44890 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:41.217290 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:41.222162 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c7403f99-3ae7-4636-9f0d-931fead1a68e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:41.227725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03a5531f-861e-4acb-bd94-7f7cf4f44890 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:41.229713 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03a5531f-861e-4acb-bd94-7f7cf4f44890 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:41.230699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03a5531f-861e-4acb-bd94-7f7cf4f44890 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:41.231883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03a5531f-861e-4acb-bd94-7f7cf4f44890 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:41.237232 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c7403f99-3ae7-4636-9f0d-931fead1a68e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1476 microversion: 2.1 time: 0.217681 May 21 21:13:41.239853 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 448/939] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:41 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1476 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:41.651514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-061aede9-1933-4283-b9c0-9f33e10b855c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:41.652664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-061aede9-1933-4283-b9c0-9f33e10b855c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:41.662399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03a5531f-861e-4acb-bd94-7f7cf4f44890 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Acquired lock "refresh_cache-5c088d68-a287-4c8a-9984-9fd1de948122" {{(pid=131278) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 21 21:13:41.668820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-061aede9-1933-4283-b9c0-9f33e10b855c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:41.670544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-061aede9-1933-4283-b9c0-9f33e10b855c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:41.671393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-061aede9-1933-4283-b9c0-9f33e10b855c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:41.672820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-061aede9-1933-4283-b9c0-9f33e10b855c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:41.982105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-061aede9-1933-4283-b9c0-9f33e10b855c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:41.996386 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-061aede9-1933-4283-b9c0-9f33e10b855c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1311 microversion: 2.1 time: 0.348910 May 21 21:13:42.000038 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 449/940] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:41 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1311 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:42.032970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-971ce464-7699-447f-a113-04d54fef6f13 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:42.035985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-971ce464-7699-447f-a113-04d54fef6f13 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:42.049175 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-971ce464-7699-447f-a113-04d54fef6f13 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:42.050405 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-971ce464-7699-447f-a113-04d54fef6f13 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:42.051879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-971ce464-7699-447f-a113-04d54fef6f13 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:42.052545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-971ce464-7699-447f-a113-04d54fef6f13 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:42.075490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=8 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:42.404239 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-971ce464-7699-447f-a113-04d54fef6f13 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:42.415020 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-971ce464-7699-447f-a113-04d54fef6f13 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219" status: 200 len: 1320 microversion: 2.1 time: 0.412397 May 21 21:13:42.415949 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 450/941] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:42 2022] GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 => generated 1320 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:42.429122 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3b3f9d85-8c5f-4175-803c-71dcda49696c tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:42.429795 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3b3f9d85-8c5f-4175-803c-71dcda49696c tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:42.443595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b3f9d85-8c5f-4175-803c-71dcda49696c tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:42.444505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b3f9d85-8c5f-4175-803c-71dcda49696c tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:42.446237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b3f9d85-8c5f-4175-803c-71dcda49696c tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:42.446869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b3f9d85-8c5f-4175-803c-71dcda49696c tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:43.247032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3b3f9d85-8c5f-4175-803c-71dcda49696c tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:43.251243 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-03a5531f-861e-4acb-bd94-7f7cf4f44890 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Building network info cache for instance {{(pid=131278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 21 21:13:43.260233 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3b3f9d85-8c5f-4175-803c-71dcda49696c tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad" status: 200 len: 1321 microversion: 2.1 time: 0.833853 May 21 21:13:43.283101 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 451/942] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:42 2022] GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad => generated 1321 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:43.288789 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7defce44-4fbb-4d61-8ac3-d9dac12386d3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:43.301727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7defce44-4fbb-4d61-8ac3-d9dac12386d3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:43.314712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7defce44-4fbb-4d61-8ac3-d9dac12386d3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:43.315168 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7defce44-4fbb-4d61-8ac3-d9dac12386d3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:43.316072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7defce44-4fbb-4d61-8ac3-d9dac12386d3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:43.316546 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7defce44-4fbb-4d61-8ac3-d9dac12386d3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:43.532173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7defce44-4fbb-4d61-8ac3-d9dac12386d3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:43.554483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7defce44-4fbb-4d61-8ac3-d9dac12386d3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:43.556401 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7defce44-4fbb-4d61-8ac3-d9dac12386d3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:43.565803 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7defce44-4fbb-4d61-8ac3-d9dac12386d3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1320 microversion: 2.25 time: 0.281097 May 21 21:13:43.567750 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 452/943] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:43 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1320 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:43.572580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3a8fe0c0-9267-4304-ad8a-e209b4a95232 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:43.593164 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3a8fe0c0-9267-4304-ad8a-e209b4a95232 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:43.600684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a8fe0c0-9267-4304-ad8a-e209b4a95232 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:43.607448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a8fe0c0-9267-4304-ad8a-e209b4a95232 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:43.608879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a8fe0c0-9267-4304-ad8a-e209b4a95232 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:43.609533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a8fe0c0-9267-4304-ad8a-e209b4a95232 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:44.069036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3a8fe0c0-9267-4304-ad8a-e209b4a95232 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:44.082603 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3a8fe0c0-9267-4304-ad8a-e209b4a95232 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1475 microversion: 2.1 time: 0.513544 May 21 21:13:44.084120 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 453/944] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:43 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1475 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:44.089696 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bd5c34d2-63c4-49ab-9fd4-031b7fa037b2 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:44.090615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bd5c34d2-63c4-49ab-9fd4-031b7fa037b2 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:44.102599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd5c34d2-63c4-49ab-9fd4-031b7fa037b2 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:44.102599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd5c34d2-63c4-49ab-9fd4-031b7fa037b2 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:44.102599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd5c34d2-63c4-49ab-9fd4-031b7fa037b2 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:44.102599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd5c34d2-63c4-49ab-9fd4-031b7fa037b2 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:44.567087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bd5c34d2-63c4-49ab-9fd4-031b7fa037b2 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:44.581532 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bd5c34d2-63c4-49ab-9fd4-031b7fa037b2 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1311 microversion: 2.1 time: 0.495999 May 21 21:13:44.588205 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 454/945] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:44 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1311 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:44.595382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-bce3c312-1627-4200-9bae-04c66ac632c4 req-fc4e7a19-e8ad-492d-9b13-41114ca1d80e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c088d68-a287-4c8a-9984-9fd1de948122", "tag": "1bea7c12-5a29-43c3-a208-bd1092d37fcd"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:44.619655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-bce3c312-1627-4200-9bae-04c66ac632c4 req-fc4e7a19-e8ad-492d-9b13-41114ca1d80e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:44.621536 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-bce3c312-1627-4200-9bae-04c66ac632c4 req-fc4e7a19-e8ad-492d-9b13-41114ca1d80e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:44.677131 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-bce3c312-1627-4200-9bae-04c66ac632c4 req-fc4e7a19-e8ad-492d-9b13-41114ca1d80e service nova] Creating event network-changed:1bea7c12-5a29-43c3-a208-bd1092d37fcd for instance 5c088d68-a287-4c8a-9984-9fd1de948122 on nch1-master-1 May 21 21:13:44.694945 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-bce3c312-1627-4200-9bae-04c66ac632c4 req-fc4e7a19-e8ad-492d-9b13-41114ca1d80e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105071 May 21 21:13:44.699802 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 455/946] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:44.715259 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-db603c6e-4f8b-48a4-b99c-1fbd2a2bb4be tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:44.718041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-db603c6e-4f8b-48a4-b99c-1fbd2a2bb4be tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:44.737962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db603c6e-4f8b-48a4-b99c-1fbd2a2bb4be tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:44.738815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db603c6e-4f8b-48a4-b99c-1fbd2a2bb4be tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:44.739913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db603c6e-4f8b-48a4-b99c-1fbd2a2bb4be tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:44.740676 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db603c6e-4f8b-48a4-b99c-1fbd2a2bb4be tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:45.555632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-db603c6e-4f8b-48a4-b99c-1fbd2a2bb4be tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:45.586795 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-db603c6e-4f8b-48a4-b99c-1fbd2a2bb4be tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219" status: 200 len: 1320 microversion: 2.1 time: 0.881232 May 21 21:13:45.602730 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 456/947] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:44 2022] GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 => generated 1320 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:45.623300 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-081ca07a-9605-4951-b758-a6f5ebbb63f0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:45.627727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-081ca07a-9605-4951-b758-a6f5ebbb63f0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:45.642978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-081ca07a-9605-4951-b758-a6f5ebbb63f0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:45.643710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-081ca07a-9605-4951-b758-a6f5ebbb63f0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:45.649456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-081ca07a-9605-4951-b758-a6f5ebbb63f0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:45.649456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-081ca07a-9605-4951-b758-a6f5ebbb63f0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:45.717013 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-081ca07a-9605-4951-b758-a6f5ebbb63f0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110640 May 21 21:13:45.718695 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 457/948] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:13:45 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:45.738117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3fee4006-11c3-4eb9-89d9-393f4c9d106f tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:45.739421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3fee4006-11c3-4eb9-89d9-393f4c9d106f tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:45.750123 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3fee4006-11c3-4eb9-89d9-393f4c9d106f tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:45.750914 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3fee4006-11c3-4eb9-89d9-393f4c9d106f tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:45.752555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3fee4006-11c3-4eb9-89d9-393f4c9d106f tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:45.753186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3fee4006-11c3-4eb9-89d9-393f4c9d106f tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:45.928565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-03a5531f-861e-4acb-bd94-7f7cf4f44890 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Updating instance_info_cache with network_info: [{"id": "1bea7c12-5a29-43c3-a208-bd1092d37fcd", "address": "fa:16:3e:74:a8:3b", "network": {"id": "04b78a92-706b-4bf5-ae65-d20c8d1ef8cb", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-873642298-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5ae6bac4c6b146d8af30881b58e4138f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1bea7c12-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 21 21:13:46.038465 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03a5531f-861e-4acb-bd94-7f7cf4f44890 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Releasing lock "refresh_cache-5c088d68-a287-4c8a-9984-9fd1de948122" {{(pid=131278) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 21 21:13:46.039236 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-03a5531f-861e-4acb-bd94-7f7cf4f44890 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "POST /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122/action" status: 202 len: 0 microversion: 2.1 time: 5.061020 May 21 21:13:46.040045 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 492/949] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:13:40 2022] POST /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122/action => generated 0 bytes in 5062 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 21 21:13:46.051964 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-380a1608-0efc-4a48-a687-c7c193506125 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:46.054744 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-380a1608-0efc-4a48-a687-c7c193506125 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:46.070670 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-380a1608-0efc-4a48-a687-c7c193506125 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:46.071126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-380a1608-0efc-4a48-a687-c7c193506125 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:46.072274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-380a1608-0efc-4a48-a687-c7c193506125 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:46.072886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-380a1608-0efc-4a48-a687-c7c193506125 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:46.196613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3fee4006-11c3-4eb9-89d9-393f4c9d106f tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:46.209554 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3fee4006-11c3-4eb9-89d9-393f4c9d106f tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad" status: 200 len: 1470 microversion: 2.1 time: 0.485222 May 21 21:13:46.212580 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 458/950] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:45 2022] GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad => generated 1470 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:46.220539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-5540f468-d119-4dce-9a05-5af1f523ea3d req-db6653e3-5f58-48f7-93bd-98484ed7a559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a995b92-640c-4b35-96a4-abd23d9995e6", "name": "network-vif-unplugged", "status": "completed", "tag": "5dcfbf23-d7d5-46ab-8767-b5c1c927ce65"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:46.230369 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5540f468-d119-4dce-9a05-5af1f523ea3d req-db6653e3-5f58-48f7-93bd-98484ed7a559 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:46.231847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5540f468-d119-4dce-9a05-5af1f523ea3d req-db6653e3-5f58-48f7-93bd-98484ed7a559 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:46.247180 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-5540f468-d119-4dce-9a05-5af1f523ea3d req-db6653e3-5f58-48f7-93bd-98484ed7a559 service nova] Creating event network-vif-unplugged:5dcfbf23-d7d5-46ab-8767-b5c1c927ce65 for instance 5a995b92-640c-4b35-96a4-abd23d9995e6 on nch2-master-1 May 21 21:13:46.253683 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [req-5540f468-d119-4dce-9a05-5af1f523ea3d req-db6653e3-5f58-48f7-93bd-98484ed7a559 service nova] Instance 5a995b92-640c-4b35-96a4-abd23d9995e6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=131277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 21:13:46.264998 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-5540f468-d119-4dce-9a05-5af1f523ea3d req-db6653e3-5f58-48f7-93bd-98484ed7a559 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050251 May 21 21:13:46.266359 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 459/951] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:46.272028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ccc753f0-f670-48bd-a0cb-5f3ed4a68e03 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:46.272952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ccc753f0-f670-48bd-a0cb-5f3ed4a68e03 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:46.280578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ccc753f0-f670-48bd-a0cb-5f3ed4a68e03 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:46.281036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ccc753f0-f670-48bd-a0cb-5f3ed4a68e03 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:46.281824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ccc753f0-f670-48bd-a0cb-5f3ed4a68e03 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:46.282262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ccc753f0-f670-48bd-a0cb-5f3ed4a68e03 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:46.300788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:46.587942 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ccc753f0-f670-48bd-a0cb-5f3ed4a68e03 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:46.599897 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ccc753f0-f670-48bd-a0cb-5f3ed4a68e03 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1475 microversion: 2.1 time: 0.332049 May 21 21:13:46.600537 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 460/952] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:46 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1475 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:46.609043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-acb75f66-c502-4656-9d35-81217f1c50a3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:46.609677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-acb75f66-c502-4656-9d35-81217f1c50a3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:46.627288 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-acb75f66-c502-4656-9d35-81217f1c50a3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:46.627747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-acb75f66-c502-4656-9d35-81217f1c50a3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:46.628573 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-acb75f66-c502-4656-9d35-81217f1c50a3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:46.629022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-acb75f66-c502-4656-9d35-81217f1c50a3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:46.834757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-380a1608-0efc-4a48-a687-c7c193506125 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:46.843939 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-380a1608-0efc-4a48-a687-c7c193506125 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:46.845825 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-380a1608-0efc-4a48-a687-c7c193506125 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:46.847381 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-380a1608-0efc-4a48-a687-c7c193506125 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1362 microversion: 2.25 time: 0.805872 May 21 21:13:46.848181 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 493/953] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:46 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1362 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:46.867779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-acb75f66-c502-4656-9d35-81217f1c50a3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:46.869278 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8c925f0b-9977-4c1c-9f2d-4b6de652a32a tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:46.870263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8c925f0b-9977-4c1c-9f2d-4b6de652a32a tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:46.881676 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-acb75f66-c502-4656-9d35-81217f1c50a3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1495 microversion: 2.1 time: 0.277672 May 21 21:13:46.883868 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 461/954] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:46 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1495 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:46.887757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c925f0b-9977-4c1c-9f2d-4b6de652a32a tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:46.890495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f0a6b353-fe52-4816-b2bf-64a010f105b8 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Calling method '.version_select at 0x7fc81b55a4c0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:46.893647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c925f0b-9977-4c1c-9f2d-4b6de652a32a tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:46.894916 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c925f0b-9977-4c1c-9f2d-4b6de652a32a tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:46.895383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c925f0b-9977-4c1c-9f2d-4b6de652a32a tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:47.107738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-8c925f0b-9977-4c1c-9f2d-4b6de652a32a tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lazy-loading 'services' on Instance uuid 201a83df-62c1-4804-b9d2-1cee0b7a7013 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:13:47.457395 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8c925f0b-9977-4c1c-9f2d-4b6de652a32a tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "DELETE /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013/os-volume_attachments/a8a19dad-a211-4b3c-948b-1c4f05f69948" status: 202 len: 0 microversion: 2.1 time: 0.607560 May 21 21:13:47.458099 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 494/955] 10.222.0.49 () {58 vars in 1415 bytes} [Sat May 21 21:13:46 2022] DELETE /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013/os-volume_attachments/a8a19dad-a211-4b3c-948b-1c4f05f69948 => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:13:47.469096 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3413272d-24a8-442f-9671-c66fb8f3d517 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:47.469787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3413272d-24a8-442f-9671-c66fb8f3d517 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:47.503883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3413272d-24a8-442f-9671-c66fb8f3d517 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:47.504924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3413272d-24a8-442f-9671-c66fb8f3d517 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:47.509413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3413272d-24a8-442f-9671-c66fb8f3d517 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:47.510064 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3413272d-24a8-442f-9671-c66fb8f3d517 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:47.565002 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-3413272d-24a8-442f-9671-c66fb8f3d517 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Lazy-loading 'flavor' on Instance uuid 30cee6ae-d43b-458a-9f0d-4ff396297bad {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:13:47.812761 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3413272d-24a8-442f-9671-c66fb8f3d517 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad/action" status: 202 len: 0 microversion: 2.1 time: 0.353113 May 21 21:13:47.813834 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 495/956] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:13:47 2022] POST /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:13:47.819790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-afeab61c-5b41-4767-a863-45576c13274e tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:47.820578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-afeab61c-5b41-4767-a863-45576c13274e tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:47.827502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-afeab61c-5b41-4767-a863-45576c13274e tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:47.827968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-afeab61c-5b41-4767-a863-45576c13274e tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:47.828796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-afeab61c-5b41-4767-a863-45576c13274e tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:47.829240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-afeab61c-5b41-4767-a863-45576c13274e tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:47.988943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-afeab61c-5b41-4767-a863-45576c13274e tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:48.001597 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-afeab61c-5b41-4767-a863-45576c13274e tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219" status: 200 len: 1320 microversion: 2.1 time: 0.186177 May 21 21:13:48.003174 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 496/957] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:47 2022] GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 => generated 1320 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:48.007831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-70627e92-3b84-49ff-8f15-212f8d710539 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:48.008687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-70627e92-3b84-49ff-8f15-212f8d710539 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:48.015192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:48.017108 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-70627e92-3b84-49ff-8f15-212f8d710539 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:48.017730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-70627e92-3b84-49ff-8f15-212f8d710539 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:48.018627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-70627e92-3b84-49ff-8f15-212f8d710539 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:48.019221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-70627e92-3b84-49ff-8f15-212f8d710539 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:48.179446 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-70627e92-3b84-49ff-8f15-212f8d710539 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1646 microversion: 2.1 time: 0.174943 May 21 21:13:48.180257 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 497/958] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:48 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1646 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:48.185607 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-faef2fd5-e9b3-4c4f-ba88-25bed9bde97f req-856c8ceb-b91f-46ce-8289-8306fdb4daf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13739e66-c933-4b7b-b4a9-365b8b4c65cb", "tag": "c87e240a-00db-4d2f-b98a-859d7a88abad"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:48.194262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-faef2fd5-e9b3-4c4f-ba88-25bed9bde97f req-856c8ceb-b91f-46ce-8289-8306fdb4daf1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:48.194818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-faef2fd5-e9b3-4c4f-ba88-25bed9bde97f req-856c8ceb-b91f-46ce-8289-8306fdb4daf1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:48.207345 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-faef2fd5-e9b3-4c4f-ba88-25bed9bde97f req-856c8ceb-b91f-46ce-8289-8306fdb4daf1 service nova] Creating event network-changed:c87e240a-00db-4d2f-b98a-859d7a88abad for instance 13739e66-c933-4b7b-b4a9-365b8b4c65cb on nch1-master-1 May 21 21:13:48.212732 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-faef2fd5-e9b3-4c4f-ba88-25bed9bde97f req-856c8ceb-b91f-46ce-8289-8306fdb4daf1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030914 May 21 21:13:48.213438 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 498/959] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:48.349072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-403ccbbb-2ebe-480e-8771-3cdb97a46c78 tempest-FloatingIPDetailsNegativeTestJSON-972474336 tempest-FloatingIPDetailsNegativeTestJSON-972474336-project] Calling method '.version_select at 0x7fc81b6e6160>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:48.404691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG neutronclient.v2_0.client [None req-403ccbbb-2ebe-480e-8771-3cdb97a46c78 tempest-FloatingIPDetailsNegativeTestJSON-972474336 tempest-FloatingIPDetailsNegativeTestJSON-972474336-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 63477645-250e-473d-848e-306fd306a9b2 could not be found", "detail": ""}} {{(pid=131278) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:13:48.405435 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-403ccbbb-2ebe-480e-8771-3cdb97a46c78 tempest-FloatingIPDetailsNegativeTestJSON-972474336 tempest-FloatingIPDetailsNegativeTestJSON-972474336-project] HTTP exception thrown: Floating IP not found for ID 63477645-250e-473d-848e-306fd306a9b2 May 21 21:13:48.407398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-403ccbbb-2ebe-480e-8771-3cdb97a46c78 tempest-FloatingIPDetailsNegativeTestJSON-972474336 tempest-FloatingIPDetailsNegativeTestJSON-972474336-project] Request method failure captured: May 21 21:13:48.407398 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-floating-ips/63477645-250e-473d-848e-306fd306a9b2 HTTP/1.1 May 21 21:13:48.407398 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:13:48.407398 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:13:48.407398 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:13:48.407398 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:13:48.407398 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:13:48.407398 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:13:48.407398 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:13:48.407398 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:13:48.407398 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVYLTQwIAdSu8XTEefeOtmiNG-8j8LeQRdVyIgMFgd3s1TCumVkE0RZCx2wm8BDW7tEV0NOy7jRqGU2nl5g66NY1yVcSNlzj53igJ-IenO12VQ5ztpYQ0nZk0GHmo6kN27CX_tMYVNVhRWcVGSHd81ZycivUAs2CSeduLkBKEzAj0m0 May 21 21:13:48.407398 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:13:48.407398 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:13:48.407398 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:13:48.407398 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:13:48.407398 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:13:48.407398 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:13:48.407398 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: ad21fe9991e746d087cdba8ba869ad47 May 21 21:13:48.407398 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-972474336 May 21 21:13:48.407398 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:13:48.407398 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:13:48.409283 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ad21fe9991e746d087cdba8ba869ad47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ad21fe9991e746d087cdba8ba869ad47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ad21fe9991e746d087cdba8ba869ad47", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ad21fe9991e746d087cdba8ba869ad47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:13:48.409283 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-972474336 May 21 21:13:48.409283 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: ad21fe9991e746d087cdba8ba869ad47 May 21 21:13:48.409283 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-972474336 May 21 21:13:48.409283 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-972474336-project May 21 21:13:48.409283 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:13:48.409283 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:13:48.409283 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 5a74af7bba88490bacd360b2a12edb88 May 21 21:13:48.409283 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-972474336-project May 21 21:13:48.409283 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:13:48.409283 ncdv-master-1 devstack@n-api.service[131278]: exception: Floating IP not found for ID 63477645-250e-473d-848e-306fd306a9b2 May 21 21:13:48.409283 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '63477645-250e-473d-848e-306fd306a9b2'} May 21 21:13:48.410116 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:13:48.410116 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:48.410116 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip May 21 21:13:48.410116 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 21 21:13:48.410116 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:13:48.410116 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:13:48.410116 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 21 21:13:48.410116 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 21 21:13:48.410116 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:13:48.410116 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:13:48.410116 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 21 21:13:48.410116 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 21 21:13:48.410116 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:13:48.410116 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:13:48.410116 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:13:48.410116 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:13:48.410116 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:13:48.410116 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:13:48.410116 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:13:48.411302 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:13:48.411302 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:13:48.411302 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:13:48.411302 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:13:48.411302 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:13:48.411302 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:13:48.411302 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:13:48.411302 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 63477645-250e-473d-848e-306fd306a9b2 could not be found May 21 21:13:48.411302 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1feb2bab-3cdb-45f6-bc7a-541390b318b6'] May 21 21:13:48.411302 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:48.411302 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:48.411302 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:48.411302 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:48.411302 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show May 21 21:13:48.411302 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 21 21:13:48.411302 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip May 21 21:13:48.411302 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 21 21:13:48.411302 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 63477645-250e-473d-848e-306fd306a9b2. May 21 21:13:48.411302 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:48.412471 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:48.412471 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:48.412471 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:48.412471 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:48.412471 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:48.412471 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:13:48.412471 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:13:48.412471 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:13:48.412471 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:13:48.412471 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:13:48.412471 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:13:48.412471 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show May 21 21:13:48.412471 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 21 21:13:48.412471 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 63477645-250e-473d-848e-306fd306a9b2 May 21 21:13:48.412471 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:48.412471 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:48.412471 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:48.412471 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:48.412471 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:48.412471 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:48.412471 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:13:48.413797 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:13:48.413797 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 63477645-250e-473d-848e-306fd306a9b2 May 21 21:13:48.413797 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:48.413797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-403ccbbb-2ebe-480e-8771-3cdb97a46c78 tempest-FloatingIPDetailsNegativeTestJSON-972474336 tempest-FloatingIPDetailsNegativeTestJSON-972474336-project] Returning 404 to user: Floating IP not found for ID 63477645-250e-473d-848e-306fd306a9b2 {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:13:48.413797 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-403ccbbb-2ebe-480e-8771-3cdb97a46c78 tempest-FloatingIPDetailsNegativeTestJSON-972474336 tempest-FloatingIPDetailsNegativeTestJSON-972474336-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips/63477645-250e-473d-848e-306fd306a9b2" status: 404 len: 111 microversion: 2.1 time: 0.194315 May 21 21:13:48.413797 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 499/960] 10.222.0.49 () {58 vars in 1259 bytes} [Sat May 21 21:13:48 2022] GET /compute/v2.1/os-floating-ips/63477645-250e-473d-848e-306fd306a9b2 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:13:48.414273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4b59def8-8270-4997-8665-997e1d194bb6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:48.415009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4b59def8-8270-4997-8665-997e1d194bb6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:48.422845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b59def8-8270-4997-8665-997e1d194bb6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:48.423306 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b59def8-8270-4997-8665-997e1d194bb6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:48.424126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b59def8-8270-4997-8665-997e1d194bb6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:48.428869 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b59def8-8270-4997-8665-997e1d194bb6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:48.638721 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4b59def8-8270-4997-8665-997e1d194bb6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:48.646969 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4b59def8-8270-4997-8665-997e1d194bb6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1473 microversion: 2.1 time: 0.236246 May 21 21:13:48.647561 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 500/961] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:48 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1473 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:48.673964 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7842a8c3-49c8-4846-b3fe-41e55b31990f tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:48.674900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7842a8c3-49c8-4846-b3fe-41e55b31990f tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:48.693901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7842a8c3-49c8-4846-b3fe-41e55b31990f tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:48.694365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7842a8c3-49c8-4846-b3fe-41e55b31990f tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:48.695188 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7842a8c3-49c8-4846-b3fe-41e55b31990f tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:48.695705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7842a8c3-49c8-4846-b3fe-41e55b31990f tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:48.712078 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f0a6b353-fe52-4816-b2bf-64a010f105b8 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/e3d2905f-6f36-4a8b-918e-4532d6db0e2b" status: 202 len: 0 microversion: 2.1 time: 1.826902 May 21 21:13:48.713019 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 462/962] 10.222.0.49 () {58 vars in 1262 bytes} [Sat May 21 21:13:46 2022] DELETE /compute/v2.1/os-floating-ips/e3d2905f-6f36-4a8b-918e-4532d6db0e2b => generated 0 bytes in 1828 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:13:48.718490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0adb0236-dc28-4505-9e2c-8821fefc2be3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:48.719454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0adb0236-dc28-4505-9e2c-8821fefc2be3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:48.750695 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0adb0236-dc28-4505-9e2c-8821fefc2be3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:48.753873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0adb0236-dc28-4505-9e2c-8821fefc2be3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:48.758578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0adb0236-dc28-4505-9e2c-8821fefc2be3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:48.759502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0adb0236-dc28-4505-9e2c-8821fefc2be3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:49.121338 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7842a8c3-49c8-4846-b3fe-41e55b31990f tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad" status: 200 len: 1629 microversion: 2.1 time: 0.456709 May 21 21:13:49.132402 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 501/963] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:48 2022] GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad => generated 1629 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:49.140377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4534d9ae-0dc2-4a90-a39e-2a59e99774ee tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:49.143262 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:13:49.143262 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:13:49.145427 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4534d9ae-0dc2-4a90-a39e-2a59e99774ee tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:49.148950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4534d9ae-0dc2-4a90-a39e-2a59e99774ee tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:49.148950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4534d9ae-0dc2-4a90-a39e-2a59e99774ee tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:49.148950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4534d9ae-0dc2-4a90-a39e-2a59e99774ee tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:49.171574 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0adb0236-dc28-4505-9e2c-8821fefc2be3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:49.182892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0adb0236-dc28-4505-9e2c-8821fefc2be3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:49.186945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0adb0236-dc28-4505-9e2c-8821fefc2be3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:49.188129 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0adb0236-dc28-4505-9e2c-8821fefc2be3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1362 microversion: 2.25 time: 0.474154 May 21 21:13:49.194290 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 463/964] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:48 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1362 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:49.199611 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4534d9ae-0dc2-4a90-a39e-2a59e99774ee tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.065483 May 21 21:13:49.202606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-29b1a9eb-1665-4960-94ca-50df4e69c881 req-6c983e4b-b509-4b52-b634-8e3137436f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d7caaad-109e-4e52-9ecb-180ab87d1219", "name": "network-vif-plugged", "status": "completed", "tag": "3a693139-22a5-4d00-8f4d-05185cc581ca"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:49.203422 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 502/965] 10.222.0.49 () {58 vars in 1175 bytes} [Sat May 21 21:13:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:49.215082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-53d86e18-9621-42ae-9356-df0b7390fe20 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:49.224242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-53d86e18-9621-42ae-9356-df0b7390fe20 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Request method failure captured: May 21 21:13:49.224242 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122/action HTTP/1.1 May 21 21:13:49.224242 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:13:49.224242 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:13:49.224242 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:13:49.224242 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 34 May 21 21:13:49.224242 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:13:49.224242 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:13:49.224242 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:13:49.224242 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:13:49.224242 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVXVJJzhF_ivczZOcdrnjDceuT90XVoI2ncGqyWraxrL26EGVtGdTl8E3BjrljOPGzG7IE__NrS0aOqGs-mFcT5UYxyaM_ayigVJqmSPi8DQPj-La_aXM6HQj38kDFxpK8lnMdkqupcxwcrkoNaPl7NLNe4cuQvTnfHm5vHpY79oSjw May 21 21:13:49.224242 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:13:49.224242 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:13:49.224242 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:13:49.224242 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:13:49.224242 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:13:49.224242 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:13:49.224242 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 5ae6bac4c6b146d8af30881b58e4138f May 21 21:13:49.224242 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 May 21 21:13:49.224242 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:13:49.224242 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:13:49.225779 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5ae6bac4c6b146d8af30881b58e4138f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5ae6bac4c6b146d8af30881b58e4138f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5ae6bac4c6b146d8af30881b58e4138f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5ae6bac4c6b146d8af30881b58e4138f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:13:49.225779 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 May 21 21:13:49.225779 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 5ae6bac4c6b146d8af30881b58e4138f May 21 21:13:49.225779 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 May 21 21:13:49.225779 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project May 21 21:13:49.225779 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:13:49.225779 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:13:49.225779 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 95ddad8359564852b7116efb8d9b21fb May 21 21:13:49.225779 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project May 21 21:13:49.225779 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:13:49.225779 ncdv-master-1 devstack@n-api.service[131278]: {"addFloatingIp": {"address": ""}} May 21 21:13:49.225779 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:13:49.225779 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '5c088d68-a287-4c8a-9984-9fd1de948122', 'body': {'addFloatingIp': {'address': ''}}} May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise error May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi '' May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:13:49.226749 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:13:49.228433 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:13:49.228433 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:13:49.228433 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:13:49.228433 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:13:49.228433 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:13:49.228433 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:13:49.228433 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:13:49.228433 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:13:49.228433 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:13:49.228433 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:13:49.228433 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 21 21:13:49.228433 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:49.228433 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:49.228433 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:49.228433 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:49.228433 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:49.228433 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:49.228433 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:13:49.228433 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:13:49.229868 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 21 21:13:49.229868 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:49.229868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-53d86e18-9621-42ae-9356-df0b7390fe20 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:13:49.229868 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-53d86e18-9621-42ae-9356-df0b7390fe20 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "POST /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122/action" status: 400 len: 142 microversion: 2.1 time: 0.016778 May 21 21:13:49.232302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-29b1a9eb-1665-4960-94ca-50df4e69c881 req-6c983e4b-b509-4b52-b634-8e3137436f60 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:49.233249 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-29b1a9eb-1665-4960-94ca-50df4e69c881 req-6c983e4b-b509-4b52-b634-8e3137436f60 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:49.235545 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 503/966] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:13:49 2022] POST /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122/action => generated 142 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:13:49.243204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-894f0333-60d0-4fb1-9756-6c424ad61e50 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:49.248243 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-29b1a9eb-1665-4960-94ca-50df4e69c881 req-6c983e4b-b509-4b52-b634-8e3137436f60 service nova] Creating event network-vif-plugged:3a693139-22a5-4d00-8f4d-05185cc581ca for instance 0d7caaad-109e-4e52-9ecb-180ab87d1219 on nch1-master-1 May 21 21:13:49.253252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-894f0333-60d0-4fb1-9756-6c424ad61e50 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:49.255088 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-29b1a9eb-1665-4960-94ca-50df4e69c881 req-6c983e4b-b509-4b52-b634-8e3137436f60 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059209 May 21 21:13:49.256165 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 464/967] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:49.264456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d3f043a1-fde1-4cb3-afb8-de1292af815d tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:49.266239 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d3f043a1-fde1-4cb3-afb8-de1292af815d tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:49.276846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3f043a1-fde1-4cb3-afb8-de1292af815d tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:49.277561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3f043a1-fde1-4cb3-afb8-de1292af815d tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:49.283653 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3f043a1-fde1-4cb3-afb8-de1292af815d tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:49.283653 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3f043a1-fde1-4cb3-afb8-de1292af815d tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:49.285024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=8 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:49.286821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-894f0333-60d0-4fb1-9756-6c424ad61e50 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:49.287287 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-894f0333-60d0-4fb1-9756-6c424ad61e50 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:49.300476 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-894f0333-60d0-4fb1-9756-6c424ad61e50 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:49.300930 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-894f0333-60d0-4fb1-9756-6c424ad61e50 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:49.330548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3f043a1-fde1-4cb3-afb8-de1292af815d tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Acquired lock "refresh_cache-5c088d68-a287-4c8a-9984-9fd1de948122" {{(pid=131277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 21 21:13:49.663721 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-894f0333-60d0-4fb1-9756-6c424ad61e50 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:49.689448 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-894f0333-60d0-4fb1-9756-6c424ad61e50 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219" status: 200 len: 1320 microversion: 2.1 time: 0.452726 May 21 21:13:49.709469 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 504/968] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:49 2022] GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 => generated 1320 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:49.732232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-50fd22ca-4dd9-4df8-91ae-4bedd535b022 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:49.735973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-50fd22ca-4dd9-4df8-91ae-4bedd535b022 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:49.747731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50fd22ca-4dd9-4df8-91ae-4bedd535b022 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:49.752829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50fd22ca-4dd9-4df8-91ae-4bedd535b022 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:49.752829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50fd22ca-4dd9-4df8-91ae-4bedd535b022 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:49.752829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50fd22ca-4dd9-4df8-91ae-4bedd535b022 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:50.178067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3f043a1-fde1-4cb3-afb8-de1292af815d tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Releasing lock "refresh_cache-5c088d68-a287-4c8a-9984-9fd1de948122" {{(pid=131277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 21 21:13:50.179711 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-d3f043a1-fde1-4cb3-afb8-de1292af815d tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] HTTP exception thrown: floating IP not found May 21 21:13:50.182817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d3f043a1-fde1-4cb3-afb8-de1292af815d tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Request method failure captured: May 21 21:13:50.182817 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122/action HTTP/1.1 May 21 21:13:50.182817 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:13:50.182817 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:13:50.182817 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:13:50.182817 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 41 May 21 21:13:50.182817 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:13:50.182817 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:13:50.182817 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:13:50.182817 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:13:50.182817 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVXVJJzhF_ivczZOcdrnjDceuT90XVoI2ncGqyWraxrL26EGVtGdTl8E3BjrljOPGzG7IE__NrS0aOqGs-mFcT5UYxyaM_ayigVJqmSPi8DQPj-La_aXM6HQj38kDFxpK8lnMdkqupcxwcrkoNaPl7NLNe4cuQvTnfHm5vHpY79oSjw May 21 21:13:50.182817 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:13:50.182817 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:13:50.182817 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:13:50.182817 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:13:50.182817 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:13:50.182817 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:13:50.182817 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 5ae6bac4c6b146d8af30881b58e4138f May 21 21:13:50.182817 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 May 21 21:13:50.182817 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:13:50.182817 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:13:50.185076 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5ae6bac4c6b146d8af30881b58e4138f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5ae6bac4c6b146d8af30881b58e4138f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5ae6bac4c6b146d8af30881b58e4138f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5ae6bac4c6b146d8af30881b58e4138f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:13:50.185076 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 May 21 21:13:50.185076 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 5ae6bac4c6b146d8af30881b58e4138f May 21 21:13:50.185076 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 May 21 21:13:50.185076 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project May 21 21:13:50.185076 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:13:50.185076 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:13:50.185076 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 95ddad8359564852b7116efb8d9b21fb May 21 21:13:50.185076 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project May 21 21:13:50.185076 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:13:50.185076 ncdv-master-1 devstack@n-api.service[131277]: {"addFloatingIp": {"address": "0.0.0.0"}} May 21 21:13:50.185076 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:13:50.185076 ncdv-master-1 devstack@n-api.service[131277]: exception: floating IP not found May 21 21:13:50.186298 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '5c088d68-a287-4c8a-9984-9fd1de948122', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} May 21 21:13:50.186298 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:13:50.186298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:50.186298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip May 21 21:13:50.186298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, May 21 21:13:50.186298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper May 21 21:13:50.186298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) May 21 21:13:50.186298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2685, in associate_floating_ip May 21 21:13:50.186298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) May 21 21:13:50.186298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2997, in _get_floating_ip_by_address May 21 21:13:50.186298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) May 21 21:13:50.186298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. May 21 21:13:50.186298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:50.186298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:50.186298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:50.186298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:50.186298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:50.186298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:50.186298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:13:50.187841 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:13:50.187841 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:13:50.187841 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:13:50.187841 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:13:50.187841 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:13:50.187841 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:13:50.187841 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:13:50.187841 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip May 21 21:13:50.187841 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 21 21:13:50.187841 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found May 21 21:13:50.187841 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:50.187841 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:50.187841 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:50.187841 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:50.187841 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:50.187841 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:50.187841 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:13:50.187841 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:13:50.187841 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found May 21 21:13:50.187841 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:50.190089 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d3f043a1-fde1-4cb3-afb8-de1292af815d tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Returning 404 to user: floating IP not found {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:13:50.191118 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d3f043a1-fde1-4cb3-afb8-de1292af815d tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "POST /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122/action" status: 404 len: 67 microversion: 2.1 time: 0.933657 May 21 21:13:50.192034 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 465/969] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:13:49 2022] POST /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122/action => generated 67 bytes in 935 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:13:50.201491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a3ecdc67-a59b-4972-8e88-e7e88a233f6e tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:50.207217 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a3ecdc67-a59b-4972-8e88-e7e88a233f6e tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:50.220369 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a3ecdc67-a59b-4972-8e88-e7e88a233f6e tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:50.221302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a3ecdc67-a59b-4972-8e88-e7e88a233f6e tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:50.222525 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a3ecdc67-a59b-4972-8e88-e7e88a233f6e tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:50.227232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a3ecdc67-a59b-4972-8e88-e7e88a233f6e tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:50.609291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-50fd22ca-4dd9-4df8-91ae-4bedd535b022 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:50.619524 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-50fd22ca-4dd9-4df8-91ae-4bedd535b022 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1470 microversion: 2.1 time: 0.898054 May 21 21:13:50.620930 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 505/970] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:49 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1470 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:50.629829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9f228c05-d8bb-4d81-b889-5ab02e31be22 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:50.630831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9f228c05-d8bb-4d81-b889-5ab02e31be22 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:50.639379 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f228c05-d8bb-4d81-b889-5ab02e31be22 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:50.640134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f228c05-d8bb-4d81-b889-5ab02e31be22 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:50.640979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f228c05-d8bb-4d81-b889-5ab02e31be22 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:50.641423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f228c05-d8bb-4d81-b889-5ab02e31be22 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:50.646425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:50.718145 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a3ecdc67-a59b-4972-8e88-e7e88a233f6e tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad" status: 200 len: 1612 microversion: 2.1 time: 0.521109 May 21 21:13:50.733530 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 466/971] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:50 2022] GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad => generated 1612 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:50.740067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e7e81549-7043-4352-9959-e1d7b6c27bae tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:50.816912 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-e7e81549-7043-4352-9959-e1d7b6c27bae tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. May 21 21:13:50.821447 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e7e81549-7043-4352-9959-e1d7b6c27bae tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Request method failure captured: May 21 21:13:50.821447 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122/action HTTP/1.1 May 21 21:13:50.821447 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:13:50.821447 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:13:50.821447 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:13:50.821447 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 44 May 21 21:13:50.821447 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:13:50.821447 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:13:50.821447 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:13:50.821447 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:13:50.821447 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVXVJJzhF_ivczZOcdrnjDceuT90XVoI2ncGqyWraxrL26EGVtGdTl8E3BjrljOPGzG7IE__NrS0aOqGs-mFcT5UYxyaM_ayigVJqmSPi8DQPj-La_aXM6HQj38kDFxpK8lnMdkqupcxwcrkoNaPl7NLNe4cuQvTnfHm5vHpY79oSjw May 21 21:13:50.821447 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:13:50.821447 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:13:50.821447 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:13:50.821447 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:13:50.821447 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:13:50.821447 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:13:50.821447 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 5ae6bac4c6b146d8af30881b58e4138f May 21 21:13:50.821447 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 May 21 21:13:50.821447 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:13:50.821447 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:13:50.823022 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5ae6bac4c6b146d8af30881b58e4138f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5ae6bac4c6b146d8af30881b58e4138f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5ae6bac4c6b146d8af30881b58e4138f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5ae6bac4c6b146d8af30881b58e4138f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:13:50.823022 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 May 21 21:13:50.823022 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 5ae6bac4c6b146d8af30881b58e4138f May 21 21:13:50.823022 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 May 21 21:13:50.823022 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project May 21 21:13:50.823022 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:13:50.823022 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:13:50.823022 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 95ddad8359564852b7116efb8d9b21fb May 21 21:13:50.823022 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project May 21 21:13:50.823022 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:13:50.823022 ncdv-master-1 devstack@n-api.service[131277]: {"removeFloatingIp": {"address": "0.0.0.0"}} May 21 21:13:50.823022 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:13:50.823022 ncdv-master-1 devstack@n-api.service[131277]: exception: Floating IP not found for address 0.0.0.0. May 21 21:13:50.824076 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '5c088d68-a287-4c8a-9984-9fd1de948122', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} May 21 21:13:50.824076 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:13:50.824076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:50.824076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr May 21 21:13:50.824076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( May 21 21:13:50.824076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2913, in get_instance_id_by_floating_address May 21 21:13:50.824076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) May 21 21:13:50.824076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2997, in _get_floating_ip_by_address May 21 21:13:50.824076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) May 21 21:13:50.824076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. May 21 21:13:50.824076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:50.824076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:50.824076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:50.824076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:50.824076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:50.824076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:50.824076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:13:50.824076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:13:50.824076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:13:50.828523 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:13:50.828523 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:13:50.828523 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:13:50.828523 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:13:50.828523 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:13:50.828523 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip May 21 21:13:50.828523 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) May 21 21:13:50.828523 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr May 21 21:13:50.828523 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) May 21 21:13:50.828523 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. May 21 21:13:50.828523 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:50.828523 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:50.828523 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:50.828523 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:50.828523 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:50.828523 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:50.828523 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:13:50.828523 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:13:50.828523 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. May 21 21:13:50.828523 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:50.830061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e7e81549-7043-4352-9959-e1d7b6c27bae tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:13:50.830061 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e7e81549-7043-4352-9959-e1d7b6c27bae tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "POST /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122/action" status: 404 len: 88 microversion: 2.1 time: 0.088619 May 21 21:13:50.830061 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 467/972] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:13:50 2022] POST /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122/action => generated 88 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:13:50.835584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4453b148-5464-44df-841e-0a13f6fca680 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:50.836387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4453b148-5464-44df-841e-0a13f6fca680 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:50.846199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4453b148-5464-44df-841e-0a13f6fca680 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:50.846804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4453b148-5464-44df-841e-0a13f6fca680 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:50.847618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4453b148-5464-44df-841e-0a13f6fca680 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:50.848184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4453b148-5464-44df-841e-0a13f6fca680 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:50.870260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9f228c05-d8bb-4d81-b889-5ab02e31be22 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:50.880670 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9f228c05-d8bb-4d81-b889-5ab02e31be22 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:50.885703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9f228c05-d8bb-4d81-b889-5ab02e31be22 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:50.894141 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9f228c05-d8bb-4d81-b889-5ab02e31be22 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1362 microversion: 2.25 time: 0.271715 May 21 21:13:50.895053 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 506/973] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:50 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:50.901188 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b3529d75-3a36-4f7f-a1bf-1a759853c165 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:50.909214 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b3529d75-3a36-4f7f-a1bf-1a759853c165 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:50.919766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3529d75-3a36-4f7f-a1bf-1a759853c165 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:50.919766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3529d75-3a36-4f7f-a1bf-1a759853c165 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:50.919766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3529d75-3a36-4f7f-a1bf-1a759853c165 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:50.919766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3529d75-3a36-4f7f-a1bf-1a759853c165 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:51.130473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b3529d75-3a36-4f7f-a1bf-1a759853c165 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:51.142608 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b3529d75-3a36-4f7f-a1bf-1a759853c165 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219" status: 200 len: 1320 microversion: 2.1 time: 0.245366 May 21 21:13:51.144414 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 507/974] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:50 2022] GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 => generated 1320 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:51.150545 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d78adea3-c074-4ab1-afb9-d3c382979ae7 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:51.151126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d78adea3-c074-4ab1-afb9-d3c382979ae7 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:51.155429 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4453b148-5464-44df-841e-0a13f6fca680 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "POST /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6/action" status: 204 len: 0 microversion: 2.1 time: 0.324016 May 21 21:13:51.156940 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 468/975] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:13:50 2022] POST /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6/action => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:13:51.161164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d78adea3-c074-4ab1-afb9-d3c382979ae7 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:51.162172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d78adea3-c074-4ab1-afb9-d3c382979ae7 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:51.163002 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d78adea3-c074-4ab1-afb9-d3c382979ae7 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:51.163938 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d78adea3-c074-4ab1-afb9-d3c382979ae7 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:51.166321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b5e2fbad-f80f-4e1e-b159-2f32473d98c1 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:51.170443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b5e2fbad-f80f-4e1e-b159-2f32473d98c1 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:51.177332 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b5e2fbad-f80f-4e1e-b159-2f32473d98c1 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:51.178181 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b5e2fbad-f80f-4e1e-b159-2f32473d98c1 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:51.179657 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b5e2fbad-f80f-4e1e-b159-2f32473d98c1 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:51.180370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b5e2fbad-f80f-4e1e-b159-2f32473d98c1 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:51.211670 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b5e2fbad-f80f-4e1e-b159-2f32473d98c1 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:13:51.265800 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-d78adea3-c074-4ab1-afb9-d3c382979ae7 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] HTTP exception thrown: Cannot 'migrate' instance 30cee6ae-d43b-458a-9f0d-4ff396297bad while it is in vm_state suspended May 21 21:13:51.268184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d78adea3-c074-4ab1-afb9-d3c382979ae7 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Request method failure captured: May 21 21:13:51.268184 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad/action HTTP/1.1 May 21 21:13:51.268184 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:13:51.268184 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:13:51.268184 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:13:51.268184 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 15 May 21 21:13:51.268184 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:13:51.268184 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:13:51.268184 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:13:51.268184 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:13:51.268184 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVXWg6j6XX760Sm1xQbTyi9jXvrBEF3qG-7J5pjnR1OtauOvu9h-gQOyvYybKg-E7VzODSkVOisoliO-TNtutLkLmKkFDCqBB33BGbFmr8AqJAiE4NctioNNLzaJqzF9_jRSGCvWqTrDoXnMvhpOGnBwgKztEY-J9Lt1a-3l7GJ3rHM May 21 21:13:51.268184 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:13:51.268184 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:13:51.268184 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:13:51.268184 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:13:51.268184 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:13:51.268184 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:13:51.268184 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 4b8f067dbf24408dba40b7a17c168a27 May 21 21:13:51.268184 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2074060390 May 21 21:13:51.268184 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,admin,member May 21 21:13:51.268184 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,admin,member May 21 21:13:51.269703 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4b8f067dbf24408dba40b7a17c168a27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b8f067dbf24408dba40b7a17c168a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4b8f067dbf24408dba40b7a17c168a27", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b8f067dbf24408dba40b7a17c168a27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:13:51.269703 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2074060390 May 21 21:13:51.269703 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 4b8f067dbf24408dba40b7a17c168a27 May 21 21:13:51.269703 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2074060390 May 21 21:13:51.269703 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersAdminNegativeTestJSON-2074060390-project-admin May 21 21:13:51.269703 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:13:51.269703 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:13:51.269703 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: d16caacafb054b3094e71cf500b44c16 May 21 21:13:51.269703 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2074060390-project-admin May 21 21:13:51.269703 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:13:51.269703 ncdv-master-1 devstack@n-api.service[131278]: {"migrate": {}} May 21 21:13:51.269703 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:13:51.269703 ncdv-master-1 devstack@n-api.service[131278]: exception: Cannot 'migrate' instance 30cee6ae-d43b-458a-9f0d-4ff396297bad while it is in vm_state suspended May 21 21:13:51.270489 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '30cee6ae-d43b-458a-9f0d-4ff396297bad', 'body': {'migrate': {}}} May 21 21:13:51.270489 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:13:51.270489 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:51.270489 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate May 21 21:13:51.270489 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, May 21 21:13:51.270489 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 21 21:13:51.270489 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:13:51.270489 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 21 21:13:51.270489 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 21 21:13:51.270489 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 21 21:13:51.270489 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 21:13:51.270489 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 21 21:13:51.270489 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 21 21:13:51.270489 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 21 21:13:51.270489 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:13:51.270489 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 21 21:13:51.270489 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 21 21:13:51.270489 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 30cee6ae-d43b-458a-9f0d-4ff396297bad in vm_state suspended. Cannot resize while the instance is in this state. May 21 21:13:51.270489 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:51.271650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:51.271650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:51.271650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:51.271650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:51.271650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:51.271650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:13:51.271650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:13:51.271650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:13:51.271650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:13:51.271650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:13:51.271650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:13:51.271650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate May 21 21:13:51.271650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 21 21:13:51.271650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 21 21:13:51.271650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 21 21:13:51.271650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 30cee6ae-d43b-458a-9f0d-4ff396297bad while it is in vm_state suspended May 21 21:13:51.271650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:51.271650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:51.271650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:51.271650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:51.274161 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:51.274161 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:51.274161 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:13:51.274161 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:13:51.274161 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 30cee6ae-d43b-458a-9f0d-4ff396297bad while it is in vm_state suspended May 21 21:13:51.274161 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:51.275353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d78adea3-c074-4ab1-afb9-d3c382979ae7 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Returning 409 to user: Cannot 'migrate' instance 30cee6ae-d43b-458a-9f0d-4ff396297bad while it is in vm_state suspended {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:13:51.276479 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d78adea3-c074-4ab1-afb9-d3c382979ae7 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad/action" status: 409 len: 148 microversion: 2.1 time: 0.130661 May 21 21:13:51.277586 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 508/976] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:13:51 2022] POST /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad/action => generated 148 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 21 21:13:51.284017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-599509de-424f-47a0-a26d-0a1626592aa9 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:51.285363 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-599509de-424f-47a0-a26d-0a1626592aa9 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:51.302762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-599509de-424f-47a0-a26d-0a1626592aa9 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:51.302762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-599509de-424f-47a0-a26d-0a1626592aa9 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:51.302762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-599509de-424f-47a0-a26d-0a1626592aa9 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:51.302762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-599509de-424f-47a0-a26d-0a1626592aa9 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:51.338351 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-599509de-424f-47a0-a26d-0a1626592aa9 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059208 May 21 21:13:51.339671 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 509/977] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:13:51 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:13:51.349292 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e7d61f22-0f10-42c4-9059-aaf040319bab tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:51.350681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e7d61f22-0f10-42c4-9059-aaf040319bab tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:51.359874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7d61f22-0f10-42c4-9059-aaf040319bab tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:51.360376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7d61f22-0f10-42c4-9059-aaf040319bab tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:51.362120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7d61f22-0f10-42c4-9059-aaf040319bab tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:51.362764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7d61f22-0f10-42c4-9059-aaf040319bab tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:51.570347 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b5e2fbad-f80f-4e1e-b159-2f32473d98c1 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122" status: 204 len: 0 microversion: 2.1 time: 0.411604 May 21 21:13:51.572540 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 469/978] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:13:51 2022] DELETE /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:13:51.583933 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-03a0492c-1ed9-4d7c-8e27-6886258c2e75 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:51.588151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-03a0492c-1ed9-4d7c-8e27-6886258c2e75 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Request method failure captured: May 21 21:13:51.588151 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e/action HTTP/1.1 May 21 21:13:51.588151 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:13:51.588151 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:13:51.588151 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:13:51.588151 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 39 May 21 21:13:51.588151 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:13:51.588151 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:13:51.588151 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:13:51.588151 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:13:51.588151 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVXWg6j6XX760Sm1xQbTyi9jXvrBEF3qG-7J5pjnR1OtauOvu9h-gQOyvYybKg-E7VzODSkVOisoliO-TNtutLkLmKkFDCqBB33BGbFmr8AqJAiE4NctioNNLzaJqzF9_jRSGCvWqTrDoXnMvhpOGnBwgKztEY-J9Lt1a-3l7GJ3rHM May 21 21:13:51.588151 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:13:51.588151 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:13:51.588151 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:13:51.588151 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:13:51.588151 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:13:51.588151 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:13:51.588151 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 4b8f067dbf24408dba40b7a17c168a27 May 21 21:13:51.588151 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2074060390 May 21 21:13:51.588151 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:13:51.588151 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:13:51.589715 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4b8f067dbf24408dba40b7a17c168a27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b8f067dbf24408dba40b7a17c168a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4b8f067dbf24408dba40b7a17c168a27", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b8f067dbf24408dba40b7a17c168a27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:13:51.589715 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2074060390 May 21 21:13:51.589715 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 4b8f067dbf24408dba40b7a17c168a27 May 21 21:13:51.589715 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2074060390 May 21 21:13:51.589715 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersAdminNegativeTestJSON-2074060390-project-admin May 21 21:13:51.589715 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:13:51.589715 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:13:51.589715 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: d16caacafb054b3094e71cf500b44c16 May 21 21:13:51.589715 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2074060390-project-admin May 21 21:13:51.589715 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:13:51.589715 ncdv-master-1 devstack@n-api.service[131277]: {"os-resetState": {"state": "invalid"}} May 21 21:13:51.589715 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '8895a6f1-f3e3-455c-90f8-6eeca064c26e', 'body': {'os-resetState': {'state': 'invalid'}}} May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise error May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'invalid' May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:51.593904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:13:51.596205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:13:51.596205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:13:51.596205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:13:51.596205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:13:51.596205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:13:51.596205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:13:51.596205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:13:51.596205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:13:51.596205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:13:51.596205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 21 21:13:51.596205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:51.596205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:51.596205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:51.596205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:51.596205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:51.596205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:51.596205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:13:51.596205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:13:51.596205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 21 21:13:51.601375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:51.601375 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-03a0492c-1ed9-4d7c-8e27-6886258c2e75 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:13:51.601375 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-03a0492c-1ed9-4d7c-8e27-6886258c2e75 tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e/action" status: 400 len: 144 microversion: 2.1 time: 0.014644 May 21 21:13:51.601375 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 470/979] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:13:51 2022] POST /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e/action => generated 144 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:13:51.603896 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-3201bb78-55f9-4fd5-beaa-7984d93e7276 req-e431466b-ba00-4f1a-9ee3-d3cff0fb3de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a995b92-640c-4b35-96a4-abd23d9995e6", "name": "network-vif-plugged", "status": "completed", "tag": "5dcfbf23-d7d5-46ab-8767-b5c1c927ce65"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:51.616674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-3201bb78-55f9-4fd5-beaa-7984d93e7276 req-e431466b-ba00-4f1a-9ee3-d3cff0fb3de7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:51.617129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-3201bb78-55f9-4fd5-beaa-7984d93e7276 req-e431466b-ba00-4f1a-9ee3-d3cff0fb3de7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:51.633871 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-3201bb78-55f9-4fd5-beaa-7984d93e7276 req-e431466b-ba00-4f1a-9ee3-d3cff0fb3de7 service nova] Creating event network-vif-plugged:5dcfbf23-d7d5-46ab-8767-b5c1c927ce65 for instance 5a995b92-640c-4b35-96a4-abd23d9995e6 on nch2-master-1 May 21 21:13:51.640357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [req-3201bb78-55f9-4fd5-beaa-7984d93e7276 req-e431466b-ba00-4f1a-9ee3-d3cff0fb3de7 service nova] Instance 5a995b92-640c-4b35-96a4-abd23d9995e6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=131277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 21:13:51.647986 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-3201bb78-55f9-4fd5-beaa-7984d93e7276 req-e431466b-ba00-4f1a-9ee3-d3cff0fb3de7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055647 May 21 21:13:51.649877 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 471/980] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:51.669185 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1d3a14f8-5822-43af-91fd-1d7167088f70 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:51.670305 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1d3a14f8-5822-43af-91fd-1d7167088f70 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:51.693914 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d3a14f8-5822-43af-91fd-1d7167088f70 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:51.693914 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d3a14f8-5822-43af-91fd-1d7167088f70 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:51.693914 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d3a14f8-5822-43af-91fd-1d7167088f70 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:51.693914 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d3a14f8-5822-43af-91fd-1d7167088f70 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:51.737908 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1d3a14f8-5822-43af-91fd-1d7167088f70 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086730 May 21 21:13:51.739061 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 472/981] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:13:51 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:13:51.746464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dce98c5b-d6e9-4e20-a93b-6c3554bd2a3a tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:51.755737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dce98c5b-d6e9-4e20-a93b-6c3554bd2a3a tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:51.756980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e7d61f22-0f10-42c4-9059-aaf040319bab tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:51.769679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dce98c5b-d6e9-4e20-a93b-6c3554bd2a3a tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:51.771119 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e7d61f22-0f10-42c4-9059-aaf040319bab tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1470 microversion: 2.1 time: 0.429859 May 21 21:13:51.771708 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 510/982] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:51 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1470 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:51.771978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dce98c5b-d6e9-4e20-a93b-6c3554bd2a3a tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:51.788366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dce98c5b-d6e9-4e20-a93b-6c3554bd2a3a tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:51.788889 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dce98c5b-d6e9-4e20-a93b-6c3554bd2a3a tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:51.799949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5a299188-d697-422b-9fea-406c38e2acba tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:51.802261 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5a299188-d697-422b-9fea-406c38e2acba tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Request method failure captured: May 21 21:13:51.802261 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e/action HTTP/1.1 May 21 21:13:51.802261 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:13:51.802261 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:13:51.802261 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:13:51.802261 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 31 May 21 21:13:51.802261 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:13:51.802261 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:13:51.802261 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:13:51.802261 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:13:51.802261 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVXWg6j6XX760Sm1xQbTyi9jXvrBEF3qG-7J5pjnR1OtauOvu9h-gQOyvYybKg-E7VzODSkVOisoliO-TNtutLkLmKkFDCqBB33BGbFmr8AqJAiE4NctioNNLzaJqzF9_jRSGCvWqTrDoXnMvhpOGnBwgKztEY-J9Lt1a-3l7GJ3rHM May 21 21:13:51.802261 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:13:51.802261 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:13:51.802261 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:13:51.802261 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:13:51.802261 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:13:51.802261 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:13:51.802261 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 4b8f067dbf24408dba40b7a17c168a27 May 21 21:13:51.802261 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2074060390 May 21 21:13:51.802261 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,admin,member May 21 21:13:51.802261 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,admin,member May 21 21:13:51.803862 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4b8f067dbf24408dba40b7a17c168a27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b8f067dbf24408dba40b7a17c168a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4b8f067dbf24408dba40b7a17c168a27", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b8f067dbf24408dba40b7a17c168a27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:13:51.803862 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2074060390 May 21 21:13:51.803862 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 4b8f067dbf24408dba40b7a17c168a27 May 21 21:13:51.803862 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2074060390 May 21 21:13:51.803862 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersAdminNegativeTestJSON-2074060390-project-admin May 21 21:13:51.803862 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:13:51.803862 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:13:51.803862 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: d16caacafb054b3094e71cf500b44c16 May 21 21:13:51.803862 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2074060390-project-admin May 21 21:13:51.803862 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:13:51.803862 ncdv-master-1 devstack@n-api.service[131278]: {"os-resetState": {"state": 1}} May 21 21:13:51.803862 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:13:51.803862 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '8895a6f1-f3e3-455c-90f8-6eeca064c26e', 'body': {'os-resetState': {'state': 1}}} May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise error May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 1 May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:13:51.804931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:13:51.806558 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:13:51.806558 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:13:51.806558 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:13:51.806558 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:13:51.806558 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:13:51.806558 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:13:51.806558 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:13:51.806558 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:13:51.806558 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 21 21:13:51.806558 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:51.806558 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:51.806558 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:51.806558 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:51.806558 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:51.806558 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:51.806558 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:13:51.806558 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:13:51.806558 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 21 21:13:51.806558 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:51.811222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5a299188-d697-422b-9fea-406c38e2acba tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:13:51.812143 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5a299188-d697-422b-9fea-406c38e2acba tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e/action" status: 400 len: 120 microversion: 2.1 time: 0.038500 May 21 21:13:51.818435 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 511/983] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:13:51 2022] POST /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e/action => generated 120 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:13:51.823910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-072f80bb-d5c0-4ba7-b065-c75af3f21b0f tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:51.830766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-072f80bb-d5c0-4ba7-b065-c75af3f21b0f tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Failed to fetch instance by id 999 {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2926}} May 21 21:13:51.831395 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-072f80bb-d5c0-4ba7-b065-c75af3f21b0f tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] HTTP exception thrown: Instance 999 could not be found. May 21 21:13:51.844130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-072f80bb-d5c0-4ba7-b065-c75af3f21b0f tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Request method failure captured: May 21 21:13:51.844130 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 May 21 21:13:51.844130 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:13:51.844130 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:13:51.844130 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:13:51.844130 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 37 May 21 21:13:51.844130 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:13:51.844130 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:13:51.844130 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:13:51.844130 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:13:51.844130 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVXWg6j6XX760Sm1xQbTyi9jXvrBEF3qG-7J5pjnR1OtauOvu9h-gQOyvYybKg-E7VzODSkVOisoliO-TNtutLkLmKkFDCqBB33BGbFmr8AqJAiE4NctioNNLzaJqzF9_jRSGCvWqTrDoXnMvhpOGnBwgKztEY-J9Lt1a-3l7GJ3rHM May 21 21:13:51.844130 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:13:51.844130 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:13:51.844130 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:13:51.844130 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:13:51.844130 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:13:51.844130 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:13:51.844130 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 4b8f067dbf24408dba40b7a17c168a27 May 21 21:13:51.844130 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2074060390 May 21 21:13:51.844130 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,admin,member May 21 21:13:51.844130 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,admin,member May 21 21:13:51.845544 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4b8f067dbf24408dba40b7a17c168a27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b8f067dbf24408dba40b7a17c168a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4b8f067dbf24408dba40b7a17c168a27", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b8f067dbf24408dba40b7a17c168a27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:13:51.845544 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2074060390 May 21 21:13:51.845544 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 4b8f067dbf24408dba40b7a17c168a27 May 21 21:13:51.845544 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2074060390 May 21 21:13:51.845544 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersAdminNegativeTestJSON-2074060390-project-admin May 21 21:13:51.845544 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:13:51.845544 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:13:51.845544 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: d16caacafb054b3094e71cf500b44c16 May 21 21:13:51.845544 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2074060390-project-admin May 21 21:13:51.845544 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:13:51.845544 ncdv-master-1 devstack@n-api.service[131278]: {"os-resetState": {"state": "error"}} May 21 21:13:51.845544 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:13:51.845544 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 999 could not be found. May 21 21:13:51.846335 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} May 21 21:13:51.846335 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:13:51.846335 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:51.846335 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:13:51.846335 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:13:51.846335 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 21 21:13:51.846335 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 21 21:13:51.846335 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. May 21 21:13:51.846335 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:51.846335 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:51.846335 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:51.846335 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:51.846335 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:51.846335 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:51.846335 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:13:51.846335 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:13:51.846335 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:13:51.846335 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:13:51.846335 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:13:51.846335 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:13:51.846335 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state May 21 21:13:51.847617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 21 21:13:51.847617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:13:51.847617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:13:51.847617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. May 21 21:13:51.847617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:51.847617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:51.847617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:51.847617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:51.847617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:51.847617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:51.847617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:13:51.847617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:13:51.847617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. May 21 21:13:51.847617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:51.847617 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-072f80bb-d5c0-4ba7-b065-c75af3f21b0f tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:13:51.847617 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-072f80bb-d5c0-4ba7-b065-c75af3f21b0f tempest-ServersAdminNegativeTestJSON-2074060390 tempest-ServersAdminNegativeTestJSON-2074060390-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.025878 May 21 21:13:51.849103 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 512/984] 10.222.0.49 () {60 vars in 1178 bytes} [Sat May 21 21:13:51 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:13:51.858023 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6b5ed5aa-65f2-4a13-9c4b-5731e0201786 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:51.858548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6b5ed5aa-65f2-4a13-9c4b-5731e0201786 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:51.884694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b5ed5aa-65f2-4a13-9c4b-5731e0201786 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:51.885522 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b5ed5aa-65f2-4a13-9c4b-5731e0201786 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:51.890492 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b5ed5aa-65f2-4a13-9c4b-5731e0201786 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:51.890492 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b5ed5aa-65f2-4a13-9c4b-5731e0201786 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:51.925289 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6b5ed5aa-65f2-4a13-9c4b-5731e0201786 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:13:52.179701 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6b5ed5aa-65f2-4a13-9c4b-5731e0201786 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "DELETE /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 204 len: 0 microversion: 2.1 time: 0.331490 May 21 21:13:52.180315 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 513/985] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:13:51 2022] DELETE /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:13:52.187512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2bb9bd47-a756-4c55-bbf2-9501ff96d0a9 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:52.188157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2bb9bd47-a756-4c55-bbf2-9501ff96d0a9 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:52.194385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2bb9bd47-a756-4c55-bbf2-9501ff96d0a9 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:52.194842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2bb9bd47-a756-4c55-bbf2-9501ff96d0a9 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:52.195613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2bb9bd47-a756-4c55-bbf2-9501ff96d0a9 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:52.196051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2bb9bd47-a756-4c55-bbf2-9501ff96d0a9 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:52.230731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-dce98c5b-d6e9-4e20-a93b-6c3554bd2a3a tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ddad8359564852b7116efb8d9b21fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae6bac4c6b146d8af30881b58e4138f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:52.231291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2bb9bd47-a756-4c55-bbf2-9501ff96d0a9 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:13:52.243592 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dce98c5b-d6e9-4e20-a93b-6c3554bd2a3a tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122" status: 200 len: 1542 microversion: 2.1 time: 0.502413 May 21 21:13:52.244936 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 473/986] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:51 2022] GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122 => generated 1542 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:52.252162 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f6086572-44cc-4351-bef8-0cbbfa0b9801 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:52.252922 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f6086572-44cc-4351-bef8-0cbbfa0b9801 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:52.260428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6086572-44cc-4351-bef8-0cbbfa0b9801 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:52.263959 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6086572-44cc-4351-bef8-0cbbfa0b9801 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:52.263959 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6086572-44cc-4351-bef8-0cbbfa0b9801 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:52.265435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6086572-44cc-4351-bef8-0cbbfa0b9801 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:52.490099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f6086572-44cc-4351-bef8-0cbbfa0b9801 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:52.498334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f6086572-44cc-4351-bef8-0cbbfa0b9801 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:52.499813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f6086572-44cc-4351-bef8-0cbbfa0b9801 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:52.500941 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f6086572-44cc-4351-bef8-0cbbfa0b9801 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1362 microversion: 2.25 time: 0.254649 May 21 21:13:52.501497 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 474/987] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:52 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:52.505859 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c46c77db-ce06-40f7-ace6-0df05db780b0 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:52.506457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c46c77db-ce06-40f7-ace6-0df05db780b0 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:52.512245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c46c77db-ce06-40f7-ace6-0df05db780b0 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:52.516150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c46c77db-ce06-40f7-ace6-0df05db780b0 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:52.516150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c46c77db-ce06-40f7-ace6-0df05db780b0 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:52.516150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c46c77db-ce06-40f7-ace6-0df05db780b0 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:52.557977 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2bb9bd47-a756-4c55-bbf2-9501ff96d0a9 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "DELETE /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad" status: 204 len: 0 microversion: 2.1 time: 0.375997 May 21 21:13:52.558560 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 514/988] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:13:52 2022] DELETE /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:13:52.563969 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b563fa1d-2ab3-461f-a15a-997750c97be0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:52.564692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b563fa1d-2ab3-461f-a15a-997750c97be0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:52.570716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b563fa1d-2ab3-461f-a15a-997750c97be0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:52.571165 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b563fa1d-2ab3-461f-a15a-997750c97be0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:52.571938 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b563fa1d-2ab3-461f-a15a-997750c97be0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:52.572403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b563fa1d-2ab3-461f-a15a-997750c97be0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:52.745874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b563fa1d-2ab3-461f-a15a-997750c97be0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:52.754960 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b563fa1d-2ab3-461f-a15a-997750c97be0 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1681 microversion: 2.1 time: 0.195083 May 21 21:13:52.755824 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 515/989] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:52 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1681 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:52.771911 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-75570629-17cf-47fe-81b2-4870cb0fb345 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "733be916-b25a-45e6-a958-0a250da2a456", "device": "/dev/xvdb"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:52.773616 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-75570629-17cf-47fe-81b2-4870cb0fb345 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:52.781390 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-75570629-17cf-47fe-81b2-4870cb0fb345 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:52.782109 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-75570629-17cf-47fe-81b2-4870cb0fb345 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:52.782475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c46c77db-ce06-40f7-ace6-0df05db780b0 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:52.785026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-75570629-17cf-47fe-81b2-4870cb0fb345 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:52.785807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-75570629-17cf-47fe-81b2-4870cb0fb345 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:52.797067 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c46c77db-ce06-40f7-ace6-0df05db780b0 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219" status: 200 len: 1320 microversion: 2.1 time: 0.294497 May 21 21:13:52.807428 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 475/990] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:52 2022] GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 => generated 1320 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:52.812817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e73095a0-08a4-4ef4-993a-10060281c3d7 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:52.813742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e73095a0-08a4-4ef4-993a-10060281c3d7 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:52.824191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e73095a0-08a4-4ef4-993a-10060281c3d7 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:52.824191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e73095a0-08a4-4ef4-993a-10060281c3d7 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:52.824191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e73095a0-08a4-4ef4-993a-10060281c3d7 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:52.824191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e73095a0-08a4-4ef4-993a-10060281c3d7 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:53.015486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e73095a0-08a4-4ef4-993a-10060281c3d7 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:53.023991 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e73095a0-08a4-4ef4-993a-10060281c3d7 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad" status: 200 len: 1467 microversion: 2.1 time: 0.215154 May 21 21:13:53.024823 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 476/991] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:52 2022] GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad => generated 1467 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:53.029604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3cbdd03a-4dfa-4fc7-9e40-efbd9e2243ea tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:53.030411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3cbdd03a-4dfa-4fc7-9e40-efbd9e2243ea tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:53.037050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3cbdd03a-4dfa-4fc7-9e40-efbd9e2243ea tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:53.037633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3cbdd03a-4dfa-4fc7-9e40-efbd9e2243ea tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:53.038498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3cbdd03a-4dfa-4fc7-9e40-efbd9e2243ea tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:53.039031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3cbdd03a-4dfa-4fc7-9e40-efbd9e2243ea tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:53.347706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3cbdd03a-4dfa-4fc7-9e40-efbd9e2243ea tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:53.381523 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3cbdd03a-4dfa-4fc7-9e40-efbd9e2243ea tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1470 microversion: 2.1 time: 0.355463 May 21 21:13:53.382775 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 477/992] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:53 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1470 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:53.389724 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b6c44636-4c75-488f-abcc-294e2cd18c23 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:53.390785 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b6c44636-4c75-488f-abcc-294e2cd18c23 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:53.400127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6c44636-4c75-488f-abcc-294e2cd18c23 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:53.400990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6c44636-4c75-488f-abcc-294e2cd18c23 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:53.402936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6c44636-4c75-488f-abcc-294e2cd18c23 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:53.403840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6c44636-4c75-488f-abcc-294e2cd18c23 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:53.429606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:53.746916 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b6c44636-4c75-488f-abcc-294e2cd18c23 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ddad8359564852b7116efb8d9b21fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae6bac4c6b146d8af30881b58e4138f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:53.757053 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b6c44636-4c75-488f-abcc-294e2cd18c23 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122" status: 200 len: 1542 microversion: 2.1 time: 0.369250 May 21 21:13:53.767023 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 478/993] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:53 2022] GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122 => generated 1542 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:53.767023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ea8c33ec-5614-498a-ac0e-727bafb0941c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:53.767023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ea8c33ec-5614-498a-ac0e-727bafb0941c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:53.776327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea8c33ec-5614-498a-ac0e-727bafb0941c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:53.785331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea8c33ec-5614-498a-ac0e-727bafb0941c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:53.785331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea8c33ec-5614-498a-ac0e-727bafb0941c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:53.785331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea8c33ec-5614-498a-ac0e-727bafb0941c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:54.015499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ea8c33ec-5614-498a-ac0e-727bafb0941c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:54.025389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ea8c33ec-5614-498a-ac0e-727bafb0941c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:54.026891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ea8c33ec-5614-498a-ac0e-727bafb0941c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:54.028617 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ea8c33ec-5614-498a-ac0e-727bafb0941c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1362 microversion: 2.25 time: 0.269548 May 21 21:13:54.029450 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 479/994] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:53 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:54.035827 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c0c77c22-aa6b-4fa8-b432-46f2372d719f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:54.036769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c0c77c22-aa6b-4fa8-b432-46f2372d719f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:54.044454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c0c77c22-aa6b-4fa8-b432-46f2372d719f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:54.045195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c0c77c22-aa6b-4fa8-b432-46f2372d719f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:54.046207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c0c77c22-aa6b-4fa8-b432-46f2372d719f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:54.057257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c0c77c22-aa6b-4fa8-b432-46f2372d719f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:54.204432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c0c77c22-aa6b-4fa8-b432-46f2372d719f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:54.212912 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c0c77c22-aa6b-4fa8-b432-46f2372d719f tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1681 microversion: 2.1 time: 0.181217 May 21 21:13:54.213382 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 480/995] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:54 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:54.218116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1c788168-1c0b-4abc-b69b-11ae28a6039a tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:54.218786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1c788168-1c0b-4abc-b69b-11ae28a6039a tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:54.226016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1c788168-1c0b-4abc-b69b-11ae28a6039a tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:54.226862 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1c788168-1c0b-4abc-b69b-11ae28a6039a tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:54.228237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1c788168-1c0b-4abc-b69b-11ae28a6039a tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:54.229330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1c788168-1c0b-4abc-b69b-11ae28a6039a tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:54.414764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1c788168-1c0b-4abc-b69b-11ae28a6039a tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:54.424607 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1c788168-1c0b-4abc-b69b-11ae28a6039a tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219" status: 200 len: 1469 microversion: 2.1 time: 0.210124 May 21 21:13:54.425811 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 481/996] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:54 2022] GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 => generated 1469 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:54.432078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0df5936d-d57d-45f8-93c6-f9c79d129757 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:54.433063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0df5936d-d57d-45f8-93c6-f9c79d129757 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:54.441083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0df5936d-d57d-45f8-93c6-f9c79d129757 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:54.441929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0df5936d-d57d-45f8-93c6-f9c79d129757 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:54.444815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0df5936d-d57d-45f8-93c6-f9c79d129757 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:54.445555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0df5936d-d57d-45f8-93c6-f9c79d129757 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:54.617783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0df5936d-d57d-45f8-93c6-f9c79d129757 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:54.626046 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0df5936d-d57d-45f8-93c6-f9c79d129757 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad" status: 200 len: 1467 microversion: 2.1 time: 0.198889 May 21 21:13:54.626916 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 482/997] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:54 2022] GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad => generated 1467 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:54.637219 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-00b3693a-d8aa-4b13-b592-ab733a526a15 req-fbf85496-de19-44cb-a706-2e07483ecd6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c088d68-a287-4c8a-9984-9fd1de948122", "name": "network-vif-deleted", "tag": "1bea7c12-5a29-43c3-a208-bd1092d37fcd"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:54.647600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-00b3693a-d8aa-4b13-b592-ab733a526a15 req-fbf85496-de19-44cb-a706-2e07483ecd6c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:54.648048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-00b3693a-d8aa-4b13-b592-ab733a526a15 req-fbf85496-de19-44cb-a706-2e07483ecd6c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:54.688358 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-00b3693a-d8aa-4b13-b592-ab733a526a15 req-fbf85496-de19-44cb-a706-2e07483ecd6c service nova] Creating event network-vif-deleted:1bea7c12-5a29-43c3-a208-bd1092d37fcd for instance 5c088d68-a287-4c8a-9984-9fd1de948122 on nch1-master-1 May 21 21:13:54.693840 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-00b3693a-d8aa-4b13-b592-ab733a526a15 req-fbf85496-de19-44cb-a706-2e07483ecd6c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065115 May 21 21:13:54.694448 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 483/998] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:54.699631 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a7962fd2-c03f-464b-9ae2-fbfc3ccab323 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:54.700446 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a7962fd2-c03f-464b-9ae2-fbfc3ccab323 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:54.707634 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7962fd2-c03f-464b-9ae2-fbfc3ccab323 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:54.708085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7962fd2-c03f-464b-9ae2-fbfc3ccab323 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:54.709299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7962fd2-c03f-464b-9ae2-fbfc3ccab323 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:54.709513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7962fd2-c03f-464b-9ae2-fbfc3ccab323 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:55.116205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a7962fd2-c03f-464b-9ae2-fbfc3ccab323 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:55.124949 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a7962fd2-c03f-464b-9ae2-fbfc3ccab323 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1470 microversion: 2.1 time: 0.429314 May 21 21:13:55.128593 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 484/999] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:54 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1470 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:55.429459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b2bcbdd9-e574-4651-8a9b-10d27dd48559 tempest-DeleteServersAdminTestJSON-194072967 tempest-DeleteServersAdminTestJSON-194072967-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:55.430930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b2bcbdd9-e574-4651-8a9b-10d27dd48559 tempest-DeleteServersAdminTestJSON-194072967 tempest-DeleteServersAdminTestJSON-194072967-project-admin] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:55.443058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2bcbdd9-e574-4651-8a9b-10d27dd48559 tempest-DeleteServersAdminTestJSON-194072967 tempest-DeleteServersAdminTestJSON-194072967-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:55.443993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2bcbdd9-e574-4651-8a9b-10d27dd48559 tempest-DeleteServersAdminTestJSON-194072967 tempest-DeleteServersAdminTestJSON-194072967-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:55.445600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2bcbdd9-e574-4651-8a9b-10d27dd48559 tempest-DeleteServersAdminTestJSON-194072967 tempest-DeleteServersAdminTestJSON-194072967-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:55.446245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2bcbdd9-e574-4651-8a9b-10d27dd48559 tempest-DeleteServersAdminTestJSON-194072967 tempest-DeleteServersAdminTestJSON-194072967-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:55.478549 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-75570629-17cf-47fe-81b2-4870cb0fb345 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "POST /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.711098 May 21 21:13:55.479777 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 516/1000] 10.222.0.49 () {60 vars in 1322 bytes} [Sat May 21 21:13:52 2022] POST /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe/os-volume_attachments => generated 194 bytes in 2724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:55.488907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b2bcbdd9-e574-4651-8a9b-10d27dd48559 tempest-DeleteServersAdminTestJSON-194072967 tempest-DeleteServersAdminTestJSON-194072967-project-admin] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:13:55.513667 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fc20da2a-b50a-46bd-aed4-24b5006b0b4b tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:55.514925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fc20da2a-b50a-46bd-aed4-24b5006b0b4b tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] [instance: 5c088d68-a287-4c8a-9984-9fd1de948122] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:55.531271 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc20da2a-b50a-46bd-aed4-24b5006b0b4b tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:55.531742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc20da2a-b50a-46bd-aed4-24b5006b0b4b tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:55.532611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc20da2a-b50a-46bd-aed4-24b5006b0b4b tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:55.540552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc20da2a-b50a-46bd-aed4-24b5006b0b4b tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:55.574281 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-fc20da2a-b50a-46bd-aed4-24b5006b0b4b tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] HTTP exception thrown: Instance 5c088d68-a287-4c8a-9984-9fd1de948122 could not be found. May 21 21:13:55.577336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fc20da2a-b50a-46bd-aed4-24b5006b0b4b tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Request method failure captured: May 21 21:13:55.577336 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122 HTTP/1.1 May 21 21:13:55.577336 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:13:55.577336 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:13:55.577336 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:13:55.577336 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:13:55.577336 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:13:55.577336 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:13:55.577336 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:13:55.577336 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:13:55.577336 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVXVJJzhF_ivczZOcdrnjDceuT90XVoI2ncGqyWraxrL26EGVtGdTl8E3BjrljOPGzG7IE__NrS0aOqGs-mFcT5UYxyaM_ayigVJqmSPi8DQPj-La_aXM6HQj38kDFxpK8lnMdkqupcxwcrkoNaPl7NLNe4cuQvTnfHm5vHpY79oSjw May 21 21:13:55.577336 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:13:55.577336 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:13:55.577336 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:13:55.577336 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:13:55.577336 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:13:55.577336 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:13:55.577336 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 5ae6bac4c6b146d8af30881b58e4138f May 21 21:13:55.577336 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 May 21 21:13:55.577336 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:13:55.577336 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:13:55.578814 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5ae6bac4c6b146d8af30881b58e4138f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5ae6bac4c6b146d8af30881b58e4138f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5ae6bac4c6b146d8af30881b58e4138f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5ae6bac4c6b146d8af30881b58e4138f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:13:55.578814 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 May 21 21:13:55.578814 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 5ae6bac4c6b146d8af30881b58e4138f May 21 21:13:55.578814 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 May 21 21:13:55.578814 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project May 21 21:13:55.578814 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:13:55.578814 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:13:55.578814 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 95ddad8359564852b7116efb8d9b21fb May 21 21:13:55.578814 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project May 21 21:13:55.578814 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:13:55.578814 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 5c088d68-a287-4c8a-9984-9fd1de948122 could not be found. May 21 21:13:55.578814 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '5c088d68-a287-4c8a-9984-9fd1de948122'} May 21 21:13:55.579773 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:13:55.579773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:55.579773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:13:55.579773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:13:55.579773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:13:55.579773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:13:55.579773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:13:55.579773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:13:55.579773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:13:55.579773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:13:55.579773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c088d68-a287-4c8a-9984-9fd1de948122 could not be found. May 21 21:13:55.579773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:55.579773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:55.579773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:55.579773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:55.579773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:55.579773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:55.579773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:13:55.579773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:13:55.579773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:13:55.581024 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:13:55.581024 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:13:55.581024 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:13:55.581024 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:13:55.581024 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:13:55.581024 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:13:55.581024 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:13:55.581024 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c088d68-a287-4c8a-9984-9fd1de948122 could not be found. May 21 21:13:55.581024 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:55.581024 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:55.581024 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:55.581024 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:55.581024 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:55.581024 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:55.581024 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:13:55.581024 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:13:55.581024 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c088d68-a287-4c8a-9984-9fd1de948122 could not be found. May 21 21:13:55.581024 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:13:55.583193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fc20da2a-b50a-46bd-aed4-24b5006b0b4b tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] Returning 404 to user: Instance 5c088d68-a287-4c8a-9984-9fd1de948122 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:13:55.587311 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fc20da2a-b50a-46bd-aed4-24b5006b0b4b tempest-FloatingIPsAssociationNegativeTestJSON-1877643410 tempest-FloatingIPsAssociationNegativeTestJSON-1877643410-project] 10.222.0.49 "GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122" status: 404 len: 111 microversion: 2.1 time: 0.103117 May 21 21:13:55.592737 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 517/1001] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:55 2022] GET /compute/v2.1/servers/5c088d68-a287-4c8a-9984-9fd1de948122 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:13:55.599483 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bcdfdecc-d8f5-4866-8602-aec3b3dd8b24 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:55.599483 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bcdfdecc-d8f5-4866-8602-aec3b3dd8b24 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:55.605894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bcdfdecc-d8f5-4866-8602-aec3b3dd8b24 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:55.607574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bcdfdecc-d8f5-4866-8602-aec3b3dd8b24 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:55.608629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bcdfdecc-d8f5-4866-8602-aec3b3dd8b24 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:55.609299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bcdfdecc-d8f5-4866-8602-aec3b3dd8b24 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:55.864675 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b2bcbdd9-e574-4651-8a9b-10d27dd48559 tempest-DeleteServersAdminTestJSON-194072967 tempest-DeleteServersAdminTestJSON-194072967-project-admin] 10.222.0.49 "DELETE /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219" status: 204 len: 0 microversion: 2.1 time: 0.734453 May 21 21:13:55.866220 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 485/1002] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:13:55 2022] DELETE /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:13:55.872914 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-574d14ec-cd60-440c-8e6c-653f9e2258e4 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:55.873625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-574d14ec-cd60-440c-8e6c-653f9e2258e4 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:55.892624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-574d14ec-cd60-440c-8e6c-653f9e2258e4 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:55.892982 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-574d14ec-cd60-440c-8e6c-653f9e2258e4 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:55.893845 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-574d14ec-cd60-440c-8e6c-653f9e2258e4 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:55.895901 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-574d14ec-cd60-440c-8e6c-653f9e2258e4 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:56.100851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bcdfdecc-d8f5-4866-8602-aec3b3dd8b24 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:56.117312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bcdfdecc-d8f5-4866-8602-aec3b3dd8b24 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:56.119179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bcdfdecc-d8f5-4866-8602-aec3b3dd8b24 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:56.121442 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bcdfdecc-d8f5-4866-8602-aec3b3dd8b24 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1362 microversion: 2.25 time: 0.527299 May 21 21:13:56.137867 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 518/1003] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:55 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1362 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:13:56.152620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-e2ab8fcc-f1c7-4aa9-9b06-4fcf65b8d158 req-64e94d3a-79d1-47dd-8d42-8f8443afe022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13739e66-c933-4b7b-b4a9-365b8b4c65cb", "name": "network-vif-plugged", "status": "completed", "tag": "c87e240a-00db-4d2f-b98a-859d7a88abad"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:56.163658 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e2ab8fcc-f1c7-4aa9-9b06-4fcf65b8d158 req-64e94d3a-79d1-47dd-8d42-8f8443afe022 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:56.164110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e2ab8fcc-f1c7-4aa9-9b06-4fcf65b8d158 req-64e94d3a-79d1-47dd-8d42-8f8443afe022 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:56.179238 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-e2ab8fcc-f1c7-4aa9-9b06-4fcf65b8d158 req-64e94d3a-79d1-47dd-8d42-8f8443afe022 service nova] Creating event network-vif-plugged:c87e240a-00db-4d2f-b98a-859d7a88abad for instance 13739e66-c933-4b7b-b4a9-365b8b4c65cb on nch1-master-1 May 21 21:13:56.191603 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-e2ab8fcc-f1c7-4aa9-9b06-4fcf65b8d158 req-64e94d3a-79d1-47dd-8d42-8f8443afe022 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046617 May 21 21:13:56.196297 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 519/1004] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:56.207229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cf5ab3b8-3c3d-470c-ba86-02cb7a76c957 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:56.209461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cf5ab3b8-3c3d-470c-ba86-02cb7a76c957 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:56.224568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf5ab3b8-3c3d-470c-ba86-02cb7a76c957 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:56.225382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf5ab3b8-3c3d-470c-ba86-02cb7a76c957 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:56.226430 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf5ab3b8-3c3d-470c-ba86-02cb7a76c957 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:56.227031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf5ab3b8-3c3d-470c-ba86-02cb7a76c957 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:56.240916 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-574d14ec-cd60-440c-8e6c-653f9e2258e4 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:56.251250 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-574d14ec-cd60-440c-8e6c-653f9e2258e4 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1681 microversion: 2.1 time: 0.383645 May 21 21:13:56.256420 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 486/1005] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:55 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1681 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:56.269604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-34d3b21d-c5a7-44ba-810e-40337115053a tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:56.272516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-34d3b21d-c5a7-44ba-810e-40337115053a tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:56.282507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34d3b21d-c5a7-44ba-810e-40337115053a tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:56.283018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34d3b21d-c5a7-44ba-810e-40337115053a tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:56.284245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34d3b21d-c5a7-44ba-810e-40337115053a tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:56.284965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34d3b21d-c5a7-44ba-810e-40337115053a tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:56.594154 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cf5ab3b8-3c3d-470c-ba86-02cb7a76c957 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:56.609669 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cf5ab3b8-3c3d-470c-ba86-02cb7a76c957 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad" status: 200 len: 1467 microversion: 2.1 time: 0.411874 May 21 21:13:56.610263 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 520/1006] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:56 2022] GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad => generated 1467 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:56.614699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f251adba-c403-43fd-bf73-f0985b31412f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:56.619878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f251adba-c403-43fd-bf73-f0985b31412f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:56.630950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f251adba-c403-43fd-bf73-f0985b31412f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:56.637036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f251adba-c403-43fd-bf73-f0985b31412f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:56.638576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f251adba-c403-43fd-bf73-f0985b31412f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:56.638922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f251adba-c403-43fd-bf73-f0985b31412f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:56.802474 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-34d3b21d-c5a7-44ba-810e-40337115053a tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:56.813147 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-34d3b21d-c5a7-44ba-810e-40337115053a tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219" status: 200 len: 1475 microversion: 2.1 time: 0.555293 May 21 21:13:56.813737 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 487/1007] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:56 2022] GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 => generated 1475 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:56.940244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f251adba-c403-43fd-bf73-f0985b31412f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:56.946387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:56.957680 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f251adba-c403-43fd-bf73-f0985b31412f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1462 microversion: 2.1 time: 0.346344 May 21 21:13:56.960556 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 521/1008] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:56 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1462 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:56.982753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ef121228-ab58-4a38-832e-c78649aedd53 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:56.983742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ef121228-ab58-4a38-832e-c78649aedd53 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:56.999612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef121228-ab58-4a38-832e-c78649aedd53 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:57.004121 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef121228-ab58-4a38-832e-c78649aedd53 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:57.006343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef121228-ab58-4a38-832e-c78649aedd53 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:57.010364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef121228-ab58-4a38-832e-c78649aedd53 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:57.153573 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b330e33f-d54f-44e3-8255-5df32db58025 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:57.154755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b330e33f-d54f-44e3-8255-5df32db58025 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:57.201919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b330e33f-d54f-44e3-8255-5df32db58025 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:57.203298 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b330e33f-d54f-44e3-8255-5df32db58025 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:57.206751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b330e33f-d54f-44e3-8255-5df32db58025 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:57.209229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b330e33f-d54f-44e3-8255-5df32db58025 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:57.855106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b330e33f-d54f-44e3-8255-5df32db58025 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:57.870970 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b330e33f-d54f-44e3-8255-5df32db58025 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:57.873505 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b330e33f-d54f-44e3-8255-5df32db58025 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:57.874647 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b330e33f-d54f-44e3-8255-5df32db58025 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1362 microversion: 2.25 time: 0.737230 May 21 21:13:57.875209 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 522/1009] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:57 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1362 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:13:57.886519 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0bb8ca6f-eb15-4f75-b567-2993e1723dd1 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:57.887780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0bb8ca6f-eb15-4f75-b567-2993e1723dd1 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:57.894691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bb8ca6f-eb15-4f75-b567-2993e1723dd1 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:57.895148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bb8ca6f-eb15-4f75-b567-2993e1723dd1 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:57.896121 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bb8ca6f-eb15-4f75-b567-2993e1723dd1 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:57.896750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bb8ca6f-eb15-4f75-b567-2993e1723dd1 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:57.955788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ef121228-ab58-4a38-832e-c78649aedd53 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:57.966222 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ef121228-ab58-4a38-832e-c78649aedd53 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1462 microversion: 2.1 time: 0.988848 May 21 21:13:57.972641 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 488/1010] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:56 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1462 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:57.983153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0bb8ca6f-eb15-4f75-b567-2993e1723dd1 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:57.990002 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-93378d85-bc14-47a1-8d12-9495ac671619 req-9d413eae-5b08-4f8e-8627-52eacccad198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30cee6ae-d43b-458a-9f0d-4ff396297bad", "name": "network-vif-deleted", "tag": "dc214c8f-7695-4d7f-842f-e90a3b0b5e6a"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:57.994492 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0bb8ca6f-eb15-4f75-b567-2993e1723dd1 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1614 microversion: 2.1 time: 0.112682 May 21 21:13:58.000385 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 523/1011] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:57 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1614 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:58.010713 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-93378d85-bc14-47a1-8d12-9495ac671619 req-9d413eae-5b08-4f8e-8627-52eacccad198 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:58.014970 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9474c777-90a7-43e0-9097-ca92b623566e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:58.015119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-93378d85-bc14-47a1-8d12-9495ac671619 req-9d413eae-5b08-4f8e-8627-52eacccad198 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:58.017428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9474c777-90a7-43e0-9097-ca92b623566e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:58.030024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9474c777-90a7-43e0-9097-ca92b623566e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:58.030775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9474c777-90a7-43e0-9097-ca92b623566e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:58.031794 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9474c777-90a7-43e0-9097-ca92b623566e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:58.032452 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9474c777-90a7-43e0-9097-ca92b623566e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:58.039362 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-93378d85-bc14-47a1-8d12-9495ac671619 req-9d413eae-5b08-4f8e-8627-52eacccad198 service nova] Creating event network-vif-deleted:dc214c8f-7695-4d7f-842f-e90a3b0b5e6a for instance 30cee6ae-d43b-458a-9f0d-4ff396297bad on nch2-master-1 May 21 21:13:58.051552 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-93378d85-bc14-47a1-8d12-9495ac671619 req-9d413eae-5b08-4f8e-8627-52eacccad198 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077033 May 21 21:13:58.052175 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 489/1012] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:58.062083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e05ffd0c-d8e6-467b-bd37-7aa2a8ca6ecc tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:58.065266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e05ffd0c-d8e6-467b-bd37-7aa2a8ca6ecc tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:58.080620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e05ffd0c-d8e6-467b-bd37-7aa2a8ca6ecc tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:58.081306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e05ffd0c-d8e6-467b-bd37-7aa2a8ca6ecc tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:58.082274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e05ffd0c-d8e6-467b-bd37-7aa2a8ca6ecc tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:58.090311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e05ffd0c-d8e6-467b-bd37-7aa2a8ca6ecc tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:58.110943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9474c777-90a7-43e0-9097-ca92b623566e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:58.111435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9474c777-90a7-43e0-9097-ca92b623566e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:58.111919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-9474c777-90a7-43e0-9097-ca92b623566e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lazy-loading 'fault' on Instance uuid 30cee6ae-d43b-458a-9f0d-4ff396297bad {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:13:58.206074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9474c777-90a7-43e0-9097-ca92b623566e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:58.216705 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9474c777-90a7-43e0-9097-ca92b623566e tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad" status: 200 len: 1311 microversion: 2.1 time: 0.214536 May 21 21:13:58.224169 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 524/1013] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:58 2022] GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad => generated 1311 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:58.230095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-04e63962-fe49-4d96-b9a4-6dc739c48130 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Calling method '.version_select at 0x7fc81b58a790>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:58.233346 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04e63962-fe49-4d96-b9a4-6dc739c48130 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:58.234004 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04e63962-fe49-4d96-b9a4-6dc739c48130 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:58.245067 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-04e63962-fe49-4d96-b9a4-6dc739c48130 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.019608 May 21 21:13:58.246234 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 525/1014] 10.222.0.49 () {58 vars in 1142 bytes} [Sat May 21 21:13:58 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:58.279623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-37c38e6d-c72f-4391-96bb-4fb83ee10f72 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:58.296574 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-37c38e6d-c72f-4391-96bb-4fb83ee10f72 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032956 May 21 21:13:58.315614 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 526/1015] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:13:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:58.328113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b26e60c7-a350-45cf-8f3b-d60b44472b7e tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1584798516", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:58.336582 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:13:58.336582 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:13:58.363816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e05ffd0c-d8e6-467b-bd37-7aa2a8ca6ecc tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:58.372782 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e05ffd0c-d8e6-467b-bd37-7aa2a8ca6ecc tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219" status: 200 len: 1475 microversion: 2.1 time: 0.319002 May 21 21:13:58.377769 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 490/1016] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:58 2022] GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 => generated 1475 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:58.473808 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b26e60c7-a350-45cf-8f3b-d60b44472b7e tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.156790 May 21 21:13:58.474393 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 527/1017] 10.222.0.49 () {60 vars in 1145 bytes} [Sat May 21 21:13:58 2022] POST /compute/v2.1/flavors => generated 499 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:13:58.484768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b4208f3c-cd0a-49c9-8c98-b3b4954dcc54 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:58.494055 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b4208f3c-cd0a-49c9-8c98-b3b4954dcc54 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013001 May 21 21:13:58.494708 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 491/1018] 10.222.0.49 () {58 vars in 1181 bytes} [Sat May 21 21:13:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:13:58.624661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6d8ed405-585f-4991-aaf5-47083b9dfe5c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-182570335", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "b9a3a7a4-330d-41f5-b501-7cbe6e4d1da7"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:13:58.712503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-6d8ed405-585f-4991-aaf5-47083b9dfe5c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] validate_networks() for None {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:13:58.894480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ff205e20-45be-465b-88c1-96ed31e5dea0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:58.895587 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ff205e20-45be-465b-88c1-96ed31e5dea0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:58.903215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff205e20-45be-465b-88c1-96ed31e5dea0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:58.908815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff205e20-45be-465b-88c1-96ed31e5dea0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:58.909816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff205e20-45be-465b-88c1-96ed31e5dea0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:58.910880 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff205e20-45be-465b-88c1-96ed31e5dea0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:59.158994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:59.363284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ff205e20-45be-465b-88c1-96ed31e5dea0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:59.364439 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-6d8ed405-585f-4991-aaf5-47083b9dfe5c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:13:59.367900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-6d8ed405-585f-4991-aaf5-47083b9dfe5c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:13:59.368545 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-6d8ed405-585f-4991-aaf5-47083b9dfe5c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:13:59.369069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-6d8ed405-585f-4991-aaf5-47083b9dfe5c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:13:59.369597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-6d8ed405-585f-4991-aaf5-47083b9dfe5c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:13:59.378690 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ff205e20-45be-465b-88c1-96ed31e5dea0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:59.390198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ff205e20-45be-465b-88c1-96ed31e5dea0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:59.394166 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ff205e20-45be-465b-88c1-96ed31e5dea0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1362 microversion: 2.25 time: 0.506063 May 21 21:13:59.395003 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 492/1019] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:13:58 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1362 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:13:59.405577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d8ed405-585f-4991-aaf5-47083b9dfe5c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:59.406738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d8ed405-585f-4991-aaf5-47083b9dfe5c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:59.412247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4cf5c5f1-7715-4898-a1fa-2f2da17f3c41 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:59.413482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d8ed405-585f-4991-aaf5-47083b9dfe5c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:59.414033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d8ed405-585f-4991-aaf5-47083b9dfe5c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:59.420754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4cf5c5f1-7715-4898-a1fa-2f2da17f3c41 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:59.432961 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cf5c5f1-7715-4898-a1fa-2f2da17f3c41 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:59.435217 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cf5c5f1-7715-4898-a1fa-2f2da17f3c41 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:59.436429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cf5c5f1-7715-4898-a1fa-2f2da17f3c41 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:59.440146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cf5c5f1-7715-4898-a1fa-2f2da17f3c41 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:59.461758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-6d8ed405-585f-4991-aaf5-47083b9dfe5c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Getting quotas for project 3cdfab8428a54520a01fdde7222835be. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:13:59.466253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-6d8ed405-585f-4991-aaf5-47083b9dfe5c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Getting quotas for user c3d9543f794d40be9c24715bf530add3 and project 3cdfab8428a54520a01fdde7222835be. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:13:59.482839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6d8ed405-585f-4991-aaf5-47083b9dfe5c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:13:59.485665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6d8ed405-585f-4991-aaf5-47083b9dfe5c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:13:59.518932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cf5c5f1-7715-4898-a1fa-2f2da17f3c41 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:59.519493 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cf5c5f1-7715-4898-a1fa-2f2da17f3c41 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:59.520200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-4cf5c5f1-7715-4898-a1fa-2f2da17f3c41 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lazy-loading 'fault' on Instance uuid 201a83df-62c1-4804-b9d2-1cee0b7a7013 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:13:59.580303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4cf5c5f1-7715-4898-a1fa-2f2da17f3c41 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331fe55d374249f6bbd9291adf78d5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec45624cf8a940fd952008d56b0d2465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:59.589644 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4cf5c5f1-7715-4898-a1fa-2f2da17f3c41 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 200 len: 1332 microversion: 2.1 time: 0.181477 May 21 21:13:59.591122 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 493/1020] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:59 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 1332 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:59.596002 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ff72c304-588f-4200-8e07-b5928f546c62 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:59.596944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ff72c304-588f-4200-8e07-b5928f546c62 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 30cee6ae-d43b-458a-9f0d-4ff396297bad] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:59.600202 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:59.603992 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff72c304-588f-4200-8e07-b5928f546c62 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:59.604724 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff72c304-588f-4200-8e07-b5928f546c62 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:59.606351 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff72c304-588f-4200-8e07-b5928f546c62 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:59.606802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff72c304-588f-4200-8e07-b5928f546c62 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:59.624815 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-ff72c304-588f-4200-8e07-b5928f546c62 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] HTTP exception thrown: Instance 30cee6ae-d43b-458a-9f0d-4ff396297bad could not be found. May 21 21:13:59.626260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ff72c304-588f-4200-8e07-b5928f546c62 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Request method failure captured: May 21 21:13:59.626260 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad HTTP/1.1 May 21 21:13:59.626260 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:13:59.626260 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:13:59.626260 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:13:59.626260 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:13:59.626260 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:13:59.626260 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:13:59.626260 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:13:59.626260 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:13:59.626260 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVXVl8ErKEqsoOETA6UCpKMj6i3kXpzaMqv3g6GrIuNxSZ51iM8nODptU9BVOsHuk8SKjoQ1rYnY74Cb1e9eXbw_-C3EwnCr-zYu43HNXZNgd1hVVEMdVWYQSmPZIRUxxz8ZAKctKi7TRUq506QAm2NNJ6ct8Xs7v-C8BV6x5wKwtEY May 21 21:13:59.626260 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:13:59.626260 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:13:59.626260 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:13:59.626260 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:13:59.626260 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:13:59.626260 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:13:59.626260 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 40b391d62af746e1918a37a9813444f4 May 21 21:13:59.626260 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-716040781 May 21 21:13:59.626260 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:13:59.626260 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:13:59.627963 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/40b391d62af746e1918a37a9813444f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/40b391d62af746e1918a37a9813444f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_40b391d62af746e1918a37a9813444f4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/40b391d62af746e1918a37a9813444f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:13:59.627963 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersAdminNegativeTestJSON-716040781 May 21 21:13:59.627963 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 40b391d62af746e1918a37a9813444f4 May 21 21:13:59.627963 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-716040781 May 21 21:13:59.627963 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersAdminNegativeTestJSON-716040781-project May 21 21:13:59.627963 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:13:59.627963 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:13:59.627963 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: e29ca91cfd3d49cb87a18a1eeb968c42 May 21 21:13:59.627963 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersAdminNegativeTestJSON-716040781-project May 21 21:13:59.627963 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:13:59.627963 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 30cee6ae-d43b-458a-9f0d-4ff396297bad could not be found. May 21 21:13:59.627963 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '30cee6ae-d43b-458a-9f0d-4ff396297bad'} May 21 21:13:59.628968 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:13:59.628968 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:59.628968 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:13:59.628968 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:13:59.628968 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:13:59.628968 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:13:59.628968 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:13:59.628968 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:13:59.628968 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:13:59.628968 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:13:59.628968 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30cee6ae-d43b-458a-9f0d-4ff396297bad could not be found. May 21 21:13:59.628968 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:59.628968 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:59.628968 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:59.628968 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:59.628968 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:59.628968 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:59.628968 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:13:59.628968 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:13:59.628968 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:13:59.630631 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:13:59.630631 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:13:59.630631 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:13:59.630631 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:13:59.630631 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:13:59.630631 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:13:59.630631 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:13:59.630631 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30cee6ae-d43b-458a-9f0d-4ff396297bad could not be found. May 21 21:13:59.630631 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:59.630631 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:13:59.630631 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:59.630631 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:13:59.630631 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:13:59.630631 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:13:59.630631 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:13:59.630631 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:13:59.630631 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30cee6ae-d43b-458a-9f0d-4ff396297bad could not be found. May 21 21:13:59.630631 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:13:59.632689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ff72c304-588f-4200-8e07-b5928f546c62 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Returning 404 to user: Instance 30cee6ae-d43b-458a-9f0d-4ff396297bad could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:13:59.633726 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ff72c304-588f-4200-8e07-b5928f546c62 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad" status: 404 len: 111 microversion: 2.1 time: 0.041399 May 21 21:13:59.634466 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 494/1021] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:59 2022] GET /compute/v2.1/servers/30cee6ae-d43b-458a-9f0d-4ff396297bad => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:13:59.635327 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6d8ed405-585f-4991-aaf5-47083b9dfe5c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.018516 May 21 21:13:59.636089 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 528/1022] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:13:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:13:59.646279 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8f1a2640-53c9-491a-8303-4a78f50c876b tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:59.646279 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8f1a2640-53c9-491a-8303-4a78f50c876b tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:59.648972 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4034e978-e808-4537-b5e8-65bb3ad9767a tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:59.649570 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4034e978-e808-4537-b5e8-65bb3ad9767a tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 8895a6f1-f3e3-455c-90f8-6eeca064c26e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:13:59.652907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f1a2640-53c9-491a-8303-4a78f50c876b tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:59.653589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f1a2640-53c9-491a-8303-4a78f50c876b tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:59.654645 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f1a2640-53c9-491a-8303-4a78f50c876b tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:59.655247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f1a2640-53c9-491a-8303-4a78f50c876b tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:59.657182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4034e978-e808-4537-b5e8-65bb3ad9767a tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:59.657636 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4034e978-e808-4537-b5e8-65bb3ad9767a tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:59.658809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4034e978-e808-4537-b5e8-65bb3ad9767a tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:59.659340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4034e978-e808-4537-b5e8-65bb3ad9767a tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:59.703040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4034e978-e808-4537-b5e8-65bb3ad9767a tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 8895a6f1-f3e3-455c-90f8-6eeca064c26e] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:13:59.773031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f1a2640-53c9-491a-8303-4a78f50c876b tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:13:59.773604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f1a2640-53c9-491a-8303-4a78f50c876b tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:13:59.773934 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-8f1a2640-53c9-491a-8303-4a78f50c876b tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lazy-loading 'fault' on Instance uuid 0d7caaad-109e-4e52-9ecb-180ab87d1219 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:13:59.865190 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8f1a2640-53c9-491a-8303-4a78f50c876b tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:13:59.876775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:59.884175 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8f1a2640-53c9-491a-8303-4a78f50c876b tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219" status: 200 len: 1310 microversion: 2.1 time: 0.248512 May 21 21:13:59.886608 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 495/1023] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:59 2022] GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 => generated 1310 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:13:59.892330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e770180a-3f27-4a82-a670-4bd56dd77f1f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:13:59.893241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e770180a-3f27-4a82-a670-4bd56dd77f1f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:00.017292 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e770180a-3f27-4a82-a670-4bd56dd77f1f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:00.030720 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e770180a-3f27-4a82-a670-4bd56dd77f1f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1278 microversion: 2.1 time: 0.142727 May 21 21:14:00.047299 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 496/1024] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:13:59 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:00.058209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:00.130193 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4034e978-e808-4537-b5e8-65bb3ad9767a tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e" status: 204 len: 0 microversion: 2.1 time: 0.486751 May 21 21:14:00.132610 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 529/1025] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:13:59 2022] DELETE /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:14:00.143824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6dde891a-b2a2-47ab-8371-ebb1a52d27bc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:00.144142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-ead07d85-23d3-4ca3-bdfb-f3f9849cafa1 req-27d0b13a-3254-4a10-9086-ff340ac3d7bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201a83df-62c1-4804-b9d2-1cee0b7a7013", "name": "network-vif-deleted", "tag": "30c8503a-ba5d-4891-802d-ebdb59c1d865"}, {"server_uuid": "0d7caaad-109e-4e52-9ecb-180ab87d1219", "name": "network-vif-deleted", "tag": "3a693139-22a5-4d00-8f4d-05185cc581ca"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:00.145896 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6dde891a-b2a2-47ab-8371-ebb1a52d27bc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 8895a6f1-f3e3-455c-90f8-6eeca064c26e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:00.161304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6dde891a-b2a2-47ab-8371-ebb1a52d27bc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:00.166502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6dde891a-b2a2-47ab-8371-ebb1a52d27bc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:00.170543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6dde891a-b2a2-47ab-8371-ebb1a52d27bc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:00.171511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6dde891a-b2a2-47ab-8371-ebb1a52d27bc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:00.197858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ead07d85-23d3-4ca3-bdfb-f3f9849cafa1 req-27d0b13a-3254-4a10-9086-ff340ac3d7bf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:00.198575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ead07d85-23d3-4ca3-bdfb-f3f9849cafa1 req-27d0b13a-3254-4a10-9086-ff340ac3d7bf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:00.234985 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-ead07d85-23d3-4ca3-bdfb-f3f9849cafa1 req-27d0b13a-3254-4a10-9086-ff340ac3d7bf service nova] Creating event network-vif-deleted:30c8503a-ba5d-4891-802d-ebdb59c1d865 for instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 on nch2-master-1 May 21 21:14:00.236880 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-ead07d85-23d3-4ca3-bdfb-f3f9849cafa1 req-27d0b13a-3254-4a10-9086-ff340ac3d7bf service nova] Creating event network-vif-deleted:3a693139-22a5-4d00-8f4d-05185cc581ca for instance 0d7caaad-109e-4e52-9ecb-180ab87d1219 on nch1-master-1 May 21 21:14:00.260369 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-ead07d85-23d3-4ca3-bdfb-f3f9849cafa1 req-27d0b13a-3254-4a10-9086-ff340ac3d7bf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.120723 May 21 21:14:00.261639 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 530/1026] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:00.287362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1a6fa70e-0658-470f-97be-619c654a3a39 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:00.287905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1a6fa70e-0658-470f-97be-619c654a3a39 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:00.304999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a6fa70e-0658-470f-97be-619c654a3a39 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:00.305852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a6fa70e-0658-470f-97be-619c654a3a39 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:00.306878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a6fa70e-0658-470f-97be-619c654a3a39 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:00.307634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a6fa70e-0658-470f-97be-619c654a3a39 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:00.392415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6dde891a-b2a2-47ab-8371-ebb1a52d27bc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:00.406988 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6dde891a-b2a2-47ab-8371-ebb1a52d27bc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e" status: 200 len: 1477 microversion: 2.1 time: 0.270003 May 21 21:14:00.420406 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 497/1027] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:00 2022] GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e => generated 1477 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:00.425464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6b0d176a-8052-47da-b6fe-0686f01a31c3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:00.426369 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6b0d176a-8052-47da-b6fe-0686f01a31c3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:00.433338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6b0d176a-8052-47da-b6fe-0686f01a31c3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:00.434624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6b0d176a-8052-47da-b6fe-0686f01a31c3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:00.436350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6b0d176a-8052-47da-b6fe-0686f01a31c3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:00.437020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6b0d176a-8052-47da-b6fe-0686f01a31c3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:00.629934 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1a6fa70e-0658-470f-97be-619c654a3a39 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1692 microversion: 2.1 time: 0.346817 May 21 21:14:00.631001 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 531/1028] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:00 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1692 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:14:00.636058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a673e12a-9584-481a-af2d-93bbb775dd1b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:00.636705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a673e12a-9584-481a-af2d-93bbb775dd1b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:00.643532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a673e12a-9584-481a-af2d-93bbb775dd1b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:00.643988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a673e12a-9584-481a-af2d-93bbb775dd1b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:00.645417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6b0d176a-8052-47da-b6fe-0686f01a31c3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:00.649492 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a673e12a-9584-481a-af2d-93bbb775dd1b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:00.650045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a673e12a-9584-481a-af2d-93bbb775dd1b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:00.660195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6b0d176a-8052-47da-b6fe-0686f01a31c3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:00.660195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6b0d176a-8052-47da-b6fe-0686f01a31c3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:00.661282 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6b0d176a-8052-47da-b6fe-0686f01a31c3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1557 microversion: 2.25 time: 0.239664 May 21 21:14:00.662314 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 498/1029] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:14:00 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1557 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:00.667176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-35991072-e9d7-4699-b5e3-38c8ea5dc018 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:00.669638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-35991072-e9d7-4699-b5e3-38c8ea5dc018 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:00.676966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35991072-e9d7-4699-b5e3-38c8ea5dc018 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:00.677617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35991072-e9d7-4699-b5e3-38c8ea5dc018 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:00.678643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35991072-e9d7-4699-b5e3-38c8ea5dc018 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:00.679528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35991072-e9d7-4699-b5e3-38c8ea5dc018 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:00.708166 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-a673e12a-9584-481a-af2d-93bbb775dd1b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] HTTP exception thrown: Instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 could not be found. May 21 21:14:00.713085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-35991072-e9d7-4699-b5e3-38c8ea5dc018 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lazy-loading 'flavor' on Instance uuid afc6789c-29a3-4a84-8045-36b96ce9e9fe {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:14:00.718681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a673e12a-9584-481a-af2d-93bbb775dd1b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Request method failure captured: May 21 21:14:00.718681 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 HTTP/1.1 May 21 21:14:00.718681 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:14:00.718681 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:14:00.718681 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:14:00.718681 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:14:00.718681 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:14:00.718681 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:14:00.718681 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:14:00.718681 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:14:00.718681 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVV7ciGpBI1VdQKKU-8dLBsgx6FFAZqCe5_UCA8J2q3rw9pcVOFlBABWg-HrAICWqIShMsBslsmPUiDFL3XUHDXXookgNEu825kN5MVutlCYGvJeVDQlv4YeNmimccREq8-TZVsib1Koj5owfkuIY1uB0uoc9EUctbq5I2UadM6tv84 May 21 21:14:00.718681 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:14:00.718681 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:14:00.718681 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:14:00.718681 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:14:00.718681 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:14:00.718681 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:14:00.718681 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: ec45624cf8a940fd952008d56b0d2465 May 21 21:14:00.718681 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-459177358 May 21 21:14:00.718681 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:14:00.718681 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:14:00.720451 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ec45624cf8a940fd952008d56b0d2465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ec45624cf8a940fd952008d56b0d2465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ec45624cf8a940fd952008d56b0d2465", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ec45624cf8a940fd952008d56b0d2465"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:00.720451 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-459177358 May 21 21:14:00.720451 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: ec45624cf8a940fd952008d56b0d2465 May 21 21:14:00.720451 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-459177358 May 21 21:14:00.720451 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-AttachSCSIVolumeTestJSON-459177358-project May 21 21:14:00.720451 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:14:00.720451 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:14:00.720451 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 331fe55d374249f6bbd9291adf78d5a9 May 21 21:14:00.720451 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-459177358-project May 21 21:14:00.720451 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:14:00.720451 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 could not be found. May 21 21:14:00.720451 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '201a83df-62c1-4804-b9d2-1cee0b7a7013'} May 21 21:14:00.721403 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:00.721403 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:00.721403 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:14:00.721403 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:14:00.721403 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:14:00.721403 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:14:00.721403 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:14:00.721403 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:14:00.721403 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:14:00.721403 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:14:00.721403 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 could not be found. May 21 21:14:00.721403 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:00.721403 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:00.721403 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:00.721403 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:00.721403 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:00.721403 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:00.721403 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:00.721403 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:00.721403 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:00.722891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:00.722891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:14:00.722891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:14:00.722891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:14:00.722891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:14:00.722891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:14:00.722891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:14:00.722891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 could not be found. May 21 21:14:00.722891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:00.722891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:00.722891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:00.722891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:00.722891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:00.722891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:00.722891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:00.722891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:00.722891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 could not be found. May 21 21:14:00.722891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:00.724215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a673e12a-9584-481a-af2d-93bbb775dd1b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Returning 404 to user: Instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:00.724215 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a673e12a-9584-481a-af2d-93bbb775dd1b tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 404 len: 111 microversion: 2.1 time: 0.088225 May 21 21:14:00.728086 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 532/1030] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:00 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:14:00.737012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-119dbc2e-f575-4404-836a-51dddf6755f3 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:00.739231 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-119dbc2e-f575-4404-836a-51dddf6755f3 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:00.744521 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-35991072-e9d7-4699-b5e3-38c8ea5dc018 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Going to try to live migrate instance to nch1-master-1 {{(pid=131277) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 21 21:14:00.756258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-119dbc2e-f575-4404-836a-51dddf6755f3 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:00.761254 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-119dbc2e-f575-4404-836a-51dddf6755f3 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:00.762373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-119dbc2e-f575-4404-836a-51dddf6755f3 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:00.763019 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-119dbc2e-f575-4404-836a-51dddf6755f3 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:01.038569 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-119dbc2e-f575-4404-836a-51dddf6755f3 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lazy-loading 'services' on Instance uuid 13739e66-c933-4b7b-b4a9-365b8b4c65cb {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:14:01.054749 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-119dbc2e-f575-4404-836a-51dddf6755f3 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 2050 microversion: 2.25 time: 0.325355 May 21 21:14:01.055549 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 533/1031] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:14:00 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 2050 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:01.061496 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-63c73432-6a60-4e2b-b16c-5d9cb1bc2814 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '.version_select at 0x7fc81b58a3a0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:01.160077 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-63c73432-6a60-4e2b-b16c-5d9cb1bc2814 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1661763655" status: 202 len: 0 microversion: 2.1 time: 0.103245 May 21 21:14:01.160721 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 534/1032] 10.222.0.49 () {58 vars in 1220 bytes} [Sat May 21 21:14:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1661763655 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:14:01.166079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-baadc849-1016-472d-a2b7-cd0cc00a1a92 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:01.166500 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-baadc849-1016-472d-a2b7-cd0cc00a1a92 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:01.178603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-baadc849-1016-472d-a2b7-cd0cc00a1a92 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:01.178941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-baadc849-1016-472d-a2b7-cd0cc00a1a92 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:01.179937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-baadc849-1016-472d-a2b7-cd0cc00a1a92 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:01.180399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-baadc849-1016-472d-a2b7-cd0cc00a1a92 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:01.215028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-baadc849-1016-472d-a2b7-cd0cc00a1a92 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:01.216154 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-baadc849-1016-472d-a2b7-cd0cc00a1a92 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:01.216796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-baadc849-1016-472d-a2b7-cd0cc00a1a92 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lazy-loading 'fault' on Instance uuid 0d7caaad-109e-4e52-9ecb-180ab87d1219 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:14:01.368507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-baadc849-1016-472d-a2b7-cd0cc00a1a92 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:01.379795 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-baadc849-1016-472d-a2b7-cd0cc00a1a92 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219" status: 200 len: 1310 microversion: 2.1 time: 0.215345 May 21 21:14:01.380451 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 535/1033] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:01 2022] GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 => generated 1310 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:01.396716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eda2ed1b-2404-409a-88a6-b801a60f9db1 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:01.396716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-eda2ed1b-2404-409a-88a6-b801a60f9db1 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:01.407012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eda2ed1b-2404-409a-88a6-b801a60f9db1 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:01.407474 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eda2ed1b-2404-409a-88a6-b801a60f9db1 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:01.408562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eda2ed1b-2404-409a-88a6-b801a60f9db1 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:01.409007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eda2ed1b-2404-409a-88a6-b801a60f9db1 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:01.637361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-eda2ed1b-2404-409a-88a6-b801a60f9db1 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:01.667351 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-eda2ed1b-2404-409a-88a6-b801a60f9db1 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1282 microversion: 2.1 time: 0.284450 May 21 21:14:01.667944 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 536/1034] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:01 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1282 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:01.682088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c32ca876-e064-414c-84da-bb3d8c4029f2 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:01.685346 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:01.685346 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:14:01.686789 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c32ca876-e064-414c-84da-bb3d8c4029f2 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:01.687196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c32ca876-e064-414c-84da-bb3d8c4029f2 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:01.690349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c32ca876-e064-414c-84da-bb3d8c4029f2 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:01.697228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c32ca876-e064-414c-84da-bb3d8c4029f2 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:01.724543 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c32ca876-e064-414c-84da-bb3d8c4029f2 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.049687 May 21 21:14:01.731876 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 537/1035] 10.222.0.49 () {60 vars in 1216 bytes} [Sat May 21 21:14:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:14:01.736748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1a308816-8df6-4970-a48e-eeeed282c240 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:01.737391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1a308816-8df6-4970-a48e-eeeed282c240 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 8895a6f1-f3e3-455c-90f8-6eeca064c26e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:01.747710 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a308816-8df6-4970-a48e-eeeed282c240 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:01.748353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a308816-8df6-4970-a48e-eeeed282c240 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:01.749231 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a308816-8df6-4970-a48e-eeeed282c240 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:01.753361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a308816-8df6-4970-a48e-eeeed282c240 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:02.249409 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1a308816-8df6-4970-a48e-eeeed282c240 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:02.260691 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1a308816-8df6-4970-a48e-eeeed282c240 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e" status: 200 len: 1477 microversion: 2.1 time: 0.527571 May 21 21:14:02.261643 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 538/1036] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:01 2022] GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e => generated 1477 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:02.398146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aff14e94-5d80-4c9b-9107-fc6d84ebf738 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:02.408479 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-aff14e94-5d80-4c9b-9107-fc6d84ebf738 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:02.423092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aff14e94-5d80-4c9b-9107-fc6d84ebf738 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:02.431982 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aff14e94-5d80-4c9b-9107-fc6d84ebf738 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:02.432976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aff14e94-5d80-4c9b-9107-fc6d84ebf738 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:02.433552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aff14e94-5d80-4c9b-9107-fc6d84ebf738 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:02.464892 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-aff14e94-5d80-4c9b-9107-fc6d84ebf738 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] HTTP exception thrown: Instance 0d7caaad-109e-4e52-9ecb-180ab87d1219 could not be found. May 21 21:14:02.467459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aff14e94-5d80-4c9b-9107-fc6d84ebf738 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Request method failure captured: May 21 21:14:02.467459 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 HTTP/1.1 May 21 21:14:02.467459 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:14:02.467459 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:14:02.467459 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:14:02.467459 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:14:02.467459 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:14:02.467459 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:14:02.467459 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:14:02.467459 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:14:02.467459 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVX4o0fD01EknQAf3EBdwsjuxRdxcuqX8J2LiAZgIjHmc2Mq9YR0YowRYLTvtjsSDrLXBPo2tf8lhoQ9OIkLAey6rzn--Xvvn-IDY--ohJX2vvnXk7FVt1hw8zRplSgj-O-SPbmtL3Q74iZzmd-Dy6SIvsyEgo79b6DCENtfFF-SdUQ May 21 21:14:02.467459 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:14:02.467459 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:14:02.467459 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:14:02.467459 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:14:02.467459 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:14:02.467459 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:14:02.467459 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: dd80101aef664387bbad8effdf280090 May 21 21:14:02.467459 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-DeleteServersAdminTestJSON-585429533 May 21 21:14:02.467459 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:14:02.467459 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:14:02.468968 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dd80101aef664387bbad8effdf280090"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd80101aef664387bbad8effdf280090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dd80101aef664387bbad8effdf280090", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd80101aef664387bbad8effdf280090"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:02.468968 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-DeleteServersAdminTestJSON-585429533 May 21 21:14:02.468968 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: dd80101aef664387bbad8effdf280090 May 21 21:14:02.468968 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-585429533 May 21 21:14:02.468968 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-DeleteServersAdminTestJSON-585429533-project May 21 21:14:02.468968 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:14:02.468968 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:14:02.468968 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: a5007c2462df46d385ca2f883b061a54 May 21 21:14:02.468968 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-DeleteServersAdminTestJSON-585429533-project May 21 21:14:02.468968 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:14:02.468968 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 0d7caaad-109e-4e52-9ecb-180ab87d1219 could not be found. May 21 21:14:02.468968 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '0d7caaad-109e-4e52-9ecb-180ab87d1219'} May 21 21:14:02.469791 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:02.469791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:02.469791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:14:02.469791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:14:02.469791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:14:02.469791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:14:02.469791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:14:02.469791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:14:02.469791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:14:02.469791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:14:02.469791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d7caaad-109e-4e52-9ecb-180ab87d1219 could not be found. May 21 21:14:02.469791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:02.469791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:02.469791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:02.469791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:02.469791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:02.469791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:02.469791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:02.469791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:02.469791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:02.471084 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:02.471084 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:14:02.471084 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:14:02.471084 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:14:02.471084 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:14:02.471084 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:14:02.471084 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:14:02.471084 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d7caaad-109e-4e52-9ecb-180ab87d1219 could not be found. May 21 21:14:02.471084 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:02.471084 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:02.471084 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:02.471084 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:02.471084 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:02.471084 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:02.471084 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:02.471084 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:02.471084 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d7caaad-109e-4e52-9ecb-180ab87d1219 could not be found. May 21 21:14:02.471084 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:02.472264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aff14e94-5d80-4c9b-9107-fc6d84ebf738 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Returning 404 to user: Instance 0d7caaad-109e-4e52-9ecb-180ab87d1219 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:02.472264 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-aff14e94-5d80-4c9b-9107-fc6d84ebf738 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219" status: 404 len: 111 microversion: 2.1 time: 0.075862 May 21 21:14:02.472264 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 539/1037] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:02 2022] GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:14:02.601960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9a7b8b2a-243f-4397-a000-eb1d60dae040 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-308907554", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:02.751192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-9a7b8b2a-243f-4397-a000-eb1d60dae040 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] validate_networks() for None {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:14:03.148455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-9a7b8b2a-243f-4397-a000-eb1d60dae040 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:14:03.148897 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-9a7b8b2a-243f-4397-a000-eb1d60dae040 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:14:03.149383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-9a7b8b2a-243f-4397-a000-eb1d60dae040 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:14:03.149806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-9a7b8b2a-243f-4397-a000-eb1d60dae040 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:14:03.150230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-9a7b8b2a-243f-4397-a000-eb1d60dae040 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:14:03.162701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a7b8b2a-243f-4397-a000-eb1d60dae040 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:03.163658 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a7b8b2a-243f-4397-a000-eb1d60dae040 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:03.164781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a7b8b2a-243f-4397-a000-eb1d60dae040 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:03.165523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a7b8b2a-243f-4397-a000-eb1d60dae040 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:03.196358 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-9a7b8b2a-243f-4397-a000-eb1d60dae040 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Getting quotas for project dd80101aef664387bbad8effdf280090. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:14:03.214456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-9a7b8b2a-243f-4397-a000-eb1d60dae040 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Getting quotas for user a5007c2462df46d385ca2f883b061a54 and project dd80101aef664387bbad8effdf280090. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:14:03.250896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9a7b8b2a-243f-4397-a000-eb1d60dae040 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:14:03.255568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9a7b8b2a-243f-4397-a000-eb1d60dae040 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:14:03.473951 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9a7b8b2a-243f-4397-a000-eb1d60dae040 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876274 May 21 21:14:03.479930 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 540/1038] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:14:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 21 21:14:03.489582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1325b727-cd24-42e5-b726-9d5cf73b064a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:03.490433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1325b727-cd24-42e5-b726-9d5cf73b064a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:03.514400 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1325b727-cd24-42e5-b726-9d5cf73b064a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:03.515167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1325b727-cd24-42e5-b726-9d5cf73b064a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:03.517475 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1325b727-cd24-42e5-b726-9d5cf73b064a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:03.518091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1325b727-cd24-42e5-b726-9d5cf73b064a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:03.674205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1325b727-cd24-42e5-b726-9d5cf73b064a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:03.683437 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1325b727-cd24-42e5-b726-9d5cf73b064a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1336 microversion: 2.1 time: 0.201610 May 21 21:14:03.704633 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 541/1039] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:03 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1336 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:03.722175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-cacb4df3-1f04-4bfc-b201-66cca7869d0a req-e36cca64-e0d1-4e5c-903d-b40e0627c8c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8895a6f1-f3e3-455c-90f8-6eeca064c26e", "name": "network-vif-deleted", "tag": "230eabe2-8c30-4490-8ccb-ece7718fc64c"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:03.732181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-cacb4df3-1f04-4bfc-b201-66cca7869d0a req-e36cca64-e0d1-4e5c-903d-b40e0627c8c2 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:03.732780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-cacb4df3-1f04-4bfc-b201-66cca7869d0a req-e36cca64-e0d1-4e5c-903d-b40e0627c8c2 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:03.750323 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-cacb4df3-1f04-4bfc-b201-66cca7869d0a req-e36cca64-e0d1-4e5c-903d-b40e0627c8c2 service nova] Creating event network-vif-deleted:230eabe2-8c30-4490-8ccb-ece7718fc64c for instance 8895a6f1-f3e3-455c-90f8-6eeca064c26e on nch1-master-1 May 21 21:14:03.758647 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-cacb4df3-1f04-4bfc-b201-66cca7869d0a req-e36cca64-e0d1-4e5c-903d-b40e0627c8c2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049866 May 21 21:14:03.759844 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 542/1040] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:03.769896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d8c4b0b6-299b-4d4e-ac9b-ce688527c838 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:03.771651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d8c4b0b6-299b-4d4e-ac9b-ce688527c838 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 8895a6f1-f3e3-455c-90f8-6eeca064c26e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:03.779904 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8c4b0b6-299b-4d4e-ac9b-ce688527c838 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:03.780405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8c4b0b6-299b-4d4e-ac9b-ce688527c838 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:03.781236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8c4b0b6-299b-4d4e-ac9b-ce688527c838 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:03.782074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8c4b0b6-299b-4d4e-ac9b-ce688527c838 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:03.818879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8c4b0b6-299b-4d4e-ac9b-ce688527c838 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:03.819656 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8c4b0b6-299b-4d4e-ac9b-ce688527c838 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:03.820402 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-d8c4b0b6-299b-4d4e-ac9b-ce688527c838 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lazy-loading 'fault' on Instance uuid 8895a6f1-f3e3-455c-90f8-6eeca064c26e {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:14:03.879527 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d8c4b0b6-299b-4d4e-ac9b-ce688527c838 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29ca91cfd3d49cb87a18a1eeb968c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b391d62af746e1918a37a9813444f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:03.882143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:03.890761 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d8c4b0b6-299b-4d4e-ac9b-ce688527c838 tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e" status: 200 len: 1311 microversion: 2.1 time: 0.129445 May 21 21:14:03.896369 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 543/1041] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:03 2022] GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e => generated 1311 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:03.906084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-63d7b195-e42b-4815-a96e-dacf3a7bd950 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:03.906719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-63d7b195-e42b-4815-a96e-dacf3a7bd950 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:04.013264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-63d7b195-e42b-4815-a96e-dacf3a7bd950 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:04.023440 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-63d7b195-e42b-4815-a96e-dacf3a7bd950 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255" status: 200 len: 1219 microversion: 2.1 time: 0.130399 May 21 21:14:04.024154 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 544/1042] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:03 2022] GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:04.405897 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-35991072-e9d7-4699-b5e3-38c8ea5dc018 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe/action" status: 202 len: 0 microversion: 2.1 time: 3.741905 May 21 21:14:04.413570 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 499/1043] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:14:00 2022] POST /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe/action => generated 0 bytes in 3750 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:14:04.429389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f7971778-1d15-455a-b627-763f035fde44 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:04.443448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f7971778-1d15-455a-b627-763f035fde44 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:04.471673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7971778-1d15-455a-b627-763f035fde44 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:04.472857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7971778-1d15-455a-b627-763f035fde44 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:04.474630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7971778-1d15-455a-b627-763f035fde44 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:04.475646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7971778-1d15-455a-b627-763f035fde44 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:04.705754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f45bddaa-a499-4b09-acdd-bde24cf457b0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-828816654", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "535b779e-2c0d-4051-93ac-b34fe98b76f4"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:04.802241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-f45bddaa-a499-4b09-acdd-bde24cf457b0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] validate_networks() for [('535b779e-2c0d-4051-93ac-b34fe98b76f4', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:14:04.952586 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f7971778-1d15-455a-b627-763f035fde44 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:04.964437 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f7971778-1d15-455a-b627-763f035fde44 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1551 microversion: 2.1 time: 0.548568 May 21 21:14:04.969032 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 500/1044] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:04 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1551 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:04.982124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-eb2728e6-06b3-4ea6-aee6-303507830d9f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:04.982124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-eb2728e6-06b3-4ea6-aee6-303507830d9f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:04.990715 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eb2728e6-06b3-4ea6-aee6-303507830d9f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:04.991186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eb2728e6-06b3-4ea6-aee6-303507830d9f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:04.991995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eb2728e6-06b3-4ea6-aee6-303507830d9f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:04.992653 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eb2728e6-06b3-4ea6-aee6-303507830d9f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:05.089180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-eb2728e6-06b3-4ea6-aee6-303507830d9f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:05.101619 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-eb2728e6-06b3-4ea6-aee6-303507830d9f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1336 microversion: 2.1 time: 0.131135 May 21 21:14:05.102654 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 501/1045] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:04 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1336 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:05.108082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-de970264-b65b-4db2-bc22-ce77b8f457fc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:05.109107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-de970264-b65b-4db2-bc22-ce77b8f457fc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] [instance: 8895a6f1-f3e3-455c-90f8-6eeca064c26e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:05.127837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-de970264-b65b-4db2-bc22-ce77b8f457fc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:05.128605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-de970264-b65b-4db2-bc22-ce77b8f457fc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:05.130425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-de970264-b65b-4db2-bc22-ce77b8f457fc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:05.131044 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-de970264-b65b-4db2-bc22-ce77b8f457fc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:05.155262 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-de970264-b65b-4db2-bc22-ce77b8f457fc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] HTTP exception thrown: Instance 8895a6f1-f3e3-455c-90f8-6eeca064c26e could not be found. May 21 21:14:05.158780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-de970264-b65b-4db2-bc22-ce77b8f457fc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Request method failure captured: May 21 21:14:05.158780 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e HTTP/1.1 May 21 21:14:05.158780 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:05.158780 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:05.158780 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:05.158780 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:14:05.158780 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:05.158780 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:05.158780 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:05.158780 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:05.158780 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVXVl8ErKEqsoOETA6UCpKMj6i3kXpzaMqv3g6GrIuNxSZ51iM8nODptU9BVOsHuk8SKjoQ1rYnY74Cb1e9eXbw_-C3EwnCr-zYu43HNXZNgd1hVVEMdVWYQSmPZIRUxxz8ZAKctKi7TRUq506QAm2NNJ6ct8Xs7v-C8BV6x5wKwtEY May 21 21:14:05.158780 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:05.158780 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:05.158780 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:05.158780 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:05.158780 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:05.158780 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:05.158780 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 40b391d62af746e1918a37a9813444f4 May 21 21:14:05.158780 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-716040781 May 21 21:14:05.158780 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:14:05.158780 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:14:05.160456 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/40b391d62af746e1918a37a9813444f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/40b391d62af746e1918a37a9813444f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_40b391d62af746e1918a37a9813444f4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/40b391d62af746e1918a37a9813444f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:05.160456 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersAdminNegativeTestJSON-716040781 May 21 21:14:05.160456 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 40b391d62af746e1918a37a9813444f4 May 21 21:14:05.160456 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-716040781 May 21 21:14:05.160456 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersAdminNegativeTestJSON-716040781-project May 21 21:14:05.160456 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:05.160456 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:05.160456 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: e29ca91cfd3d49cb87a18a1eeb968c42 May 21 21:14:05.160456 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersAdminNegativeTestJSON-716040781-project May 21 21:14:05.160456 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:14:05.160456 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 8895a6f1-f3e3-455c-90f8-6eeca064c26e could not be found. May 21 21:14:05.160456 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '8895a6f1-f3e3-455c-90f8-6eeca064c26e'} May 21 21:14:05.161460 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:05.161460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:05.161460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:14:05.161460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:14:05.161460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:14:05.161460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:14:05.161460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:14:05.161460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:14:05.161460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:14:05.161460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:14:05.161460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8895a6f1-f3e3-455c-90f8-6eeca064c26e could not be found. May 21 21:14:05.161460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:05.161460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:05.161460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:05.161460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:05.161460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:05.161460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:05.161460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:05.161460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:05.161460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:05.162955 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:05.162955 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:14:05.162955 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:14:05.162955 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:14:05.162955 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:14:05.162955 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:14:05.162955 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:14:05.162955 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8895a6f1-f3e3-455c-90f8-6eeca064c26e could not be found. May 21 21:14:05.162955 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:05.162955 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:05.162955 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:05.162955 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:05.162955 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:05.162955 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:05.162955 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:05.162955 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:05.162955 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8895a6f1-f3e3-455c-90f8-6eeca064c26e could not be found. May 21 21:14:05.162955 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:05.169071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-de970264-b65b-4db2-bc22-ce77b8f457fc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] Returning 404 to user: Instance 8895a6f1-f3e3-455c-90f8-6eeca064c26e could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:05.170202 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-de970264-b65b-4db2-bc22-ce77b8f457fc tempest-ServersAdminNegativeTestJSON-716040781 tempest-ServersAdminNegativeTestJSON-716040781-project] 10.222.0.49 "GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e" status: 404 len: 111 microversion: 2.1 time: 0.066350 May 21 21:14:05.171406 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 502/1046] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:05 2022] GET /compute/v2.1/servers/8895a6f1-f3e3-455c-90f8-6eeca064c26e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:14:05.234152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b1ec96bf-9378-4481-b273-d1a80db015e5 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:05.234986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b1ec96bf-9378-4481-b273-d1a80db015e5 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:05.242186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1ec96bf-9378-4481-b273-d1a80db015e5 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:05.247498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1ec96bf-9378-4481-b273-d1a80db015e5 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:05.248607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1ec96bf-9378-4481-b273-d1a80db015e5 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:05.249585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1ec96bf-9378-4481-b273-d1a80db015e5 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:05.470365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b1ec96bf-9378-4481-b273-d1a80db015e5 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:05.479160 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b1ec96bf-9378-4481-b273-d1a80db015e5 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255" status: 200 len: 1223 microversion: 2.1 time: 0.306473 May 21 21:14:05.490115 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 503/1047] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:05 2022] GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 => generated 1223 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:05.490115 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c343da4c-b40f-4818-9b38-bc92b1a05add tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43913e24-b1c1-4a82-9f77-46cfbc414199", "device": "/dev/xvdb"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:05.491035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c343da4c-b40f-4818-9b38-bc92b1a05add tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:05.501174 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c343da4c-b40f-4818-9b38-bc92b1a05add tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:05.501811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c343da4c-b40f-4818-9b38-bc92b1a05add tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:05.502831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c343da4c-b40f-4818-9b38-bc92b1a05add tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:05.503444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c343da4c-b40f-4818-9b38-bc92b1a05add tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:05.779853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f45bddaa-a499-4b09-acdd-bde24cf457b0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:14:05.780471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f45bddaa-a499-4b09-acdd-bde24cf457b0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:14:05.780943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f45bddaa-a499-4b09-acdd-bde24cf457b0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:14:05.781431 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f45bddaa-a499-4b09-acdd-bde24cf457b0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:14:05.781904 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f45bddaa-a499-4b09-acdd-bde24cf457b0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:14:05.798411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f45bddaa-a499-4b09-acdd-bde24cf457b0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:05.804741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f45bddaa-a499-4b09-acdd-bde24cf457b0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:05.806849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f45bddaa-a499-4b09-acdd-bde24cf457b0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:05.809317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f45bddaa-a499-4b09-acdd-bde24cf457b0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:05.844505 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-f45bddaa-a499-4b09-acdd-bde24cf457b0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Getting quotas for project 85f6ae1864ee43429c910eb27888608f. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:14:05.849255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-f45bddaa-a499-4b09-acdd-bde24cf457b0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Getting quotas for user 186310904c3943fdb63247b58725140e and project 85f6ae1864ee43429c910eb27888608f. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:14:05.864104 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f45bddaa-a499-4b09-acdd-bde24cf457b0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:14:05.867158 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f45bddaa-a499-4b09-acdd-bde24cf457b0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:14:06.037677 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f45bddaa-a499-4b09-acdd-bde24cf457b0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.761158 May 21 21:14:06.045533 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 545/1048] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:14:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:14:06.051633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-466fad94-752d-4a1f-8513-56bb200d832b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:06.054484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-466fad94-752d-4a1f-8513-56bb200d832b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:06.078286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-466fad94-752d-4a1f-8513-56bb200d832b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:06.079322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-466fad94-752d-4a1f-8513-56bb200d832b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:06.085282 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-466fad94-752d-4a1f-8513-56bb200d832b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:06.088524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-466fad94-752d-4a1f-8513-56bb200d832b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:06.390812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-466fad94-752d-4a1f-8513-56bb200d832b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:06.400461 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-466fad94-752d-4a1f-8513-56bb200d832b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1551 microversion: 2.1 time: 0.353483 May 21 21:14:06.411820 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 546/1049] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:06 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1551 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:06.417257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-066677ef-76b0-473e-b7e8-3c1e2fd4bbd8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:06.418674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-066677ef-76b0-473e-b7e8-3c1e2fd4bbd8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:06.482798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-066677ef-76b0-473e-b7e8-3c1e2fd4bbd8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:06.490435 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-066677ef-76b0-473e-b7e8-3c1e2fd4bbd8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1224 microversion: 2.1 time: 0.076947 May 21 21:14:06.491465 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 547/1050] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:06 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:06.502127 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3262fd7c-5c1d-4453-ac27-8639528c3aa4 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:06.503388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3262fd7c-5c1d-4453-ac27-8639528c3aa4 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:06.511230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3262fd7c-5c1d-4453-ac27-8639528c3aa4 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:06.512605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3262fd7c-5c1d-4453-ac27-8639528c3aa4 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:06.515845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3262fd7c-5c1d-4453-ac27-8639528c3aa4 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:06.516325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3262fd7c-5c1d-4453-ac27-8639528c3aa4 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:06.676461 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c343da4c-b40f-4818-9b38-bc92b1a05add tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "POST /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.191131 May 21 21:14:06.677471 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 504/1051] 10.222.0.49 () {62 vars in 1363 bytes} [Sat May 21 21:14:05 2022] POST /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb/os-volume_attachments => generated 194 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:14:06.709695 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-63304fd0-4a4d-412c-9da0-684b345f0b89 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:06.713106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-63304fd0-4a4d-412c-9da0-684b345f0b89 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:06.725921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-63304fd0-4a4d-412c-9da0-684b345f0b89 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:06.726392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-63304fd0-4a4d-412c-9da0-684b345f0b89 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:06.727553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-63304fd0-4a4d-412c-9da0-684b345f0b89 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:06.728236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-63304fd0-4a4d-412c-9da0-684b345f0b89 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:06.931285 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3262fd7c-5c1d-4453-ac27-8639528c3aa4 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:06.951801 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3262fd7c-5c1d-4453-ac27-8639528c3aa4 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1378 microversion: 2.1 time: 0.459219 May 21 21:14:06.956662 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 548/1052] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:06 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1378 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:07.001857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-63304fd0-4a4d-412c-9da0-684b345f0b89 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:07.005455 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-63304fd0-4a4d-412c-9da0-684b345f0b89 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255" status: 200 len: 1271 microversion: 2.1 time: 0.316519 May 21 21:14:07.006045 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 505/1053] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:06 2022] GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 => generated 1271 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:07.417819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ebb93913-648b-49ad-8abb-6d95fb3a37d4 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:07.418849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ebb93913-648b-49ad-8abb-6d95fb3a37d4 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:07.429465 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ebb93913-648b-49ad-8abb-6d95fb3a37d4 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:07.430333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ebb93913-648b-49ad-8abb-6d95fb3a37d4 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:07.431917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ebb93913-648b-49ad-8abb-6d95fb3a37d4 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:07.433415 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ebb93913-648b-49ad-8abb-6d95fb3a37d4 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:07.511115 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4dc223ca-9a07-4155-baaf-f657aa3cfb07 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:07.512386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4dc223ca-9a07-4155-baaf-f657aa3cfb07 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:07.794085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4dc223ca-9a07-4155-baaf-f657aa3cfb07 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:07.821614 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4dc223ca-9a07-4155-baaf-f657aa3cfb07 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1224 microversion: 2.1 time: 0.314500 May 21 21:14:07.823813 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 506/1054] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:07 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1224 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:14:07.968150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ebb93913-648b-49ad-8abb-6d95fb3a37d4 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:07.972638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7fabc43e-4071-4d2f-be9a-848af162c754 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:07.973450 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7fabc43e-4071-4d2f-be9a-848af162c754 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:07.977231 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ebb93913-648b-49ad-8abb-6d95fb3a37d4 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1551 microversion: 2.1 time: 0.563216 May 21 21:14:07.981814 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 549/1055] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:07 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1551 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:07.996317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fabc43e-4071-4d2f-be9a-848af162c754 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:07.997077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fabc43e-4071-4d2f-be9a-848af162c754 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:07.998065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fabc43e-4071-4d2f-be9a-848af162c754 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:07.998691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fabc43e-4071-4d2f-be9a-848af162c754 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:08.032687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-180c2943-5ab2-4a40-924c-e8d0edbfec68 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:08.034040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-180c2943-5ab2-4a40-924c-e8d0edbfec68 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:08.056101 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-180c2943-5ab2-4a40-924c-e8d0edbfec68 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:08.056589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-180c2943-5ab2-4a40-924c-e8d0edbfec68 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:08.057423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-180c2943-5ab2-4a40-924c-e8d0edbfec68 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:08.057872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-180c2943-5ab2-4a40-924c-e8d0edbfec68 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:08.279254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7fabc43e-4071-4d2f-be9a-848af162c754 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:08.282280 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7fabc43e-4071-4d2f-be9a-848af162c754 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1378 microversion: 2.1 time: 0.313360 May 21 21:14:08.283150 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 507/1056] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:07 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1378 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:14:08.331324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-180c2943-5ab2-4a40-924c-e8d0edbfec68 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:08.366231 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-180c2943-5ab2-4a40-924c-e8d0edbfec68 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255" status: 200 len: 1277 microversion: 2.1 time: 0.346744 May 21 21:14:08.367390 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 550/1057] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:08 2022] GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 => generated 1277 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:08.420022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-51b3c129-c267-47d3-ab96-44e835790675 req-625792a1-3260-4033-97ce-f5d0722b816d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4531a7ea-7be9-48b8-adac-fe968ff5d889", "tag": "d47da14c-0379-42b1-91a7-7b1098c8cded"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:08.441029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-51b3c129-c267-47d3-ab96-44e835790675 req-625792a1-3260-4033-97ce-f5d0722b816d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:08.441531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-51b3c129-c267-47d3-ab96-44e835790675 req-625792a1-3260-4033-97ce-f5d0722b816d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:08.473458 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-51b3c129-c267-47d3-ab96-44e835790675 req-625792a1-3260-4033-97ce-f5d0722b816d service nova] Creating event network-changed:d47da14c-0379-42b1-91a7-7b1098c8cded for instance 4531a7ea-7be9-48b8-adac-fe968ff5d889 on nch1-master-1 May 21 21:14:08.485013 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-51b3c129-c267-47d3-ab96-44e835790675 req-625792a1-3260-4033-97ce-f5d0722b816d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070583 May 21 21:14:08.505071 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 508/1058] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:08.840555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8f602641-7100-4768-a3d0-1baa7d387d6a tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:08.841585 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8f602641-7100-4768-a3d0-1baa7d387d6a tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:08.856302 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f602641-7100-4768-a3d0-1baa7d387d6a tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:08.857229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f602641-7100-4768-a3d0-1baa7d387d6a tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:08.858347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f602641-7100-4768-a3d0-1baa7d387d6a tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:08.859984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f602641-7100-4768-a3d0-1baa7d387d6a tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:08.997139 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dc6ac878-077a-47bd-97ae-dc2c67c61958 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:08.998806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dc6ac878-077a-47bd-97ae-dc2c67c61958 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:09.006452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dc6ac878-077a-47bd-97ae-dc2c67c61958 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:09.007050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dc6ac878-077a-47bd-97ae-dc2c67c61958 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:09.007948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dc6ac878-077a-47bd-97ae-dc2c67c61958 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:09.008643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dc6ac878-077a-47bd-97ae-dc2c67c61958 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:09.190889 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8f602641-7100-4768-a3d0-1baa7d387d6a tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:09.194332 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8f602641-7100-4768-a3d0-1baa7d387d6a tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1220 microversion: 2.1 time: 0.359395 May 21 21:14:09.197871 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 551/1059] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:08 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1220 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:09.241012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-dc6ac878-077a-47bd-97ae-dc2c67c61958 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:09.249769 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dc6ac878-077a-47bd-97ae-dc2c67c61958 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1551 microversion: 2.1 time: 0.258145 May 21 21:14:09.250511 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 509/1060] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:08 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1551 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:09.300673 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f813d967-3d87-486c-877f-cf143acc6e2d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:09.301294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f813d967-3d87-486c-877f-cf143acc6e2d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:09.307506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f813d967-3d87-486c-877f-cf143acc6e2d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:09.307959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f813d967-3d87-486c-877f-cf143acc6e2d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:09.308878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f813d967-3d87-486c-877f-cf143acc6e2d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:09.309537 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f813d967-3d87-486c-877f-cf143acc6e2d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:09.384236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e6f492d4-6548-4e8c-8201-35a902fbce01 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:09.384886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e6f492d4-6548-4e8c-8201-35a902fbce01 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:09.391779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6f492d4-6548-4e8c-8201-35a902fbce01 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:09.392527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6f492d4-6548-4e8c-8201-35a902fbce01 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:09.393326 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6f492d4-6548-4e8c-8201-35a902fbce01 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:09.393773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6f492d4-6548-4e8c-8201-35a902fbce01 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:09.609741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f813d967-3d87-486c-877f-cf143acc6e2d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:09.619770 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f813d967-3d87-486c-877f-cf143acc6e2d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1378 microversion: 2.1 time: 0.323602 May 21 21:14:09.620380 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 552/1061] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:09 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1378 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:09.718114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e6f492d4-6548-4e8c-8201-35a902fbce01 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:09.728258 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e6f492d4-6548-4e8c-8201-35a902fbce01 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255" status: 200 len: 1319 microversion: 2.1 time: 0.347819 May 21 21:14:09.731839 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 510/1062] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:09 2022] GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:14:10.220400 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e7258f40-5b22-48bc-84a8-e5e731558310 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:10.221038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e7258f40-5b22-48bc-84a8-e5e731558310 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:10.236344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7258f40-5b22-48bc-84a8-e5e731558310 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:10.236903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7258f40-5b22-48bc-84a8-e5e731558310 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:10.237747 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7258f40-5b22-48bc-84a8-e5e731558310 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:10.238194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7258f40-5b22-48bc-84a8-e5e731558310 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:10.267610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-534ac54e-4434-4dd1-8882-7b70e21587d0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:10.268884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-534ac54e-4434-4dd1-8882-7b70e21587d0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:10.278623 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-534ac54e-4434-4dd1-8882-7b70e21587d0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:10.279512 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-534ac54e-4434-4dd1-8882-7b70e21587d0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:10.280535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-534ac54e-4434-4dd1-8882-7b70e21587d0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:10.281241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-534ac54e-4434-4dd1-8882-7b70e21587d0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:10.337114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e7258f40-5b22-48bc-84a8-e5e731558310 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:10.358583 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e7258f40-5b22-48bc-84a8-e5e731558310 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1282 microversion: 2.1 time: 0.142008 May 21 21:14:10.359200 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 553/1063] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:10 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1282 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:14:10.483838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-534ac54e-4434-4dd1-8882-7b70e21587d0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:10.492503 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-534ac54e-4434-4dd1-8882-7b70e21587d0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1551 microversion: 2.1 time: 0.228711 May 21 21:14:10.493323 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 511/1064] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:10 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1551 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:14:10.640447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-858eadef-4a0d-4222-a2cb-9d34770cf78c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:10.641672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-858eadef-4a0d-4222-a2cb-9d34770cf78c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:10.650832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-858eadef-4a0d-4222-a2cb-9d34770cf78c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:10.651299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-858eadef-4a0d-4222-a2cb-9d34770cf78c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:10.656897 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-858eadef-4a0d-4222-a2cb-9d34770cf78c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:10.659675 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-858eadef-4a0d-4222-a2cb-9d34770cf78c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:10.747955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-50ec409f-cab7-4c3f-9593-8fcd0bba0d6f tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:10.748609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-50ec409f-cab7-4c3f-9593-8fcd0bba0d6f tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:10.758893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50ec409f-cab7-4c3f-9593-8fcd0bba0d6f tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:10.759615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50ec409f-cab7-4c3f-9593-8fcd0bba0d6f tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:10.764454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50ec409f-cab7-4c3f-9593-8fcd0bba0d6f tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:10.764454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50ec409f-cab7-4c3f-9593-8fcd0bba0d6f tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:10.791445 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:10.946325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-50ec409f-cab7-4c3f-9593-8fcd0bba0d6f tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:10.955348 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-50ec409f-cab7-4c3f-9593-8fcd0bba0d6f tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255" status: 200 len: 1319 microversion: 2.1 time: 0.212081 May 21 21:14:10.956206 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 512/1065] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:10 2022] GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:11.048962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-858eadef-4a0d-4222-a2cb-9d34770cf78c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:11.056975 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-858eadef-4a0d-4222-a2cb-9d34770cf78c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1378 microversion: 2.1 time: 0.422643 May 21 21:14:11.057726 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 554/1066] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:10 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1378 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:11.283021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-4293017e-3f16-4c6e-ba61-9abee29c6cdf req-fb9f1b80-8706-4d88-9990-319a79363934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24ac7c08-f2ba-42ce-9b70-c28101bab255", "tag": "f683da31-65ac-4fd9-a216-c46e5543ec92"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:11.294397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-4293017e-3f16-4c6e-ba61-9abee29c6cdf req-fb9f1b80-8706-4d88-9990-319a79363934 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:11.294996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-4293017e-3f16-4c6e-ba61-9abee29c6cdf req-fb9f1b80-8706-4d88-9990-319a79363934 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:11.309509 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-4293017e-3f16-4c6e-ba61-9abee29c6cdf req-fb9f1b80-8706-4d88-9990-319a79363934 service nova] Creating event network-changed:f683da31-65ac-4fd9-a216-c46e5543ec92 for instance 24ac7c08-f2ba-42ce-9b70-c28101bab255 on nch2-master-1 May 21 21:14:11.314317 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-4293017e-3f16-4c6e-ba61-9abee29c6cdf req-fb9f1b80-8706-4d88-9990-319a79363934 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035681 May 21 21:14:11.317083 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 513/1067] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:11.393093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d7181df1-6537-4dcb-8205-558cd57beede tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:11.393960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d7181df1-6537-4dcb-8205-558cd57beede tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:11.410537 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7181df1-6537-4dcb-8205-558cd57beede tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:11.414952 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7181df1-6537-4dcb-8205-558cd57beede tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:11.418115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7181df1-6537-4dcb-8205-558cd57beede tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:11.418572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7181df1-6537-4dcb-8205-558cd57beede tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:11.510713 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3972bf85-0732-472f-81b1-65fb45614411 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:11.512613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3972bf85-0732-472f-81b1-65fb45614411 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:11.520753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3972bf85-0732-472f-81b1-65fb45614411 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:11.521547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3972bf85-0732-472f-81b1-65fb45614411 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:11.522565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3972bf85-0732-472f-81b1-65fb45614411 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:11.524172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3972bf85-0732-472f-81b1-65fb45614411 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:11.794517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3972bf85-0732-472f-81b1-65fb45614411 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:11.825423 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3972bf85-0732-472f-81b1-65fb45614411 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1551 microversion: 2.1 time: 0.298930 May 21 21:14:11.825423 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 514/1068] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:11 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1551 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:14:11.867923 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d7181df1-6537-4dcb-8205-558cd57beede tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:11.876395 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d7181df1-6537-4dcb-8205-558cd57beede tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1324 microversion: 2.1 time: 0.502336 May 21 21:14:11.877837 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 555/1069] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:11 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1324 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:11.974600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-18318655-5dbc-4138-a84b-f53394f7383f tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:11.975531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-18318655-5dbc-4138-a84b-f53394f7383f tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:11.984576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-18318655-5dbc-4138-a84b-f53394f7383f tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:11.985673 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-18318655-5dbc-4138-a84b-f53394f7383f tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:11.986953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-18318655-5dbc-4138-a84b-f53394f7383f tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:11.988123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-18318655-5dbc-4138-a84b-f53394f7383f tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.054320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c51c8afb-e3bb-421b-a10c-aa716dd126f7 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Action: 'update', calling method: .version_select at 0x7fc81b474b80>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:12.056497 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:12.056497 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:14:12.060651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c51c8afb-e3bb-421b-a10c-aa716dd126f7 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.060651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c51c8afb-e3bb-421b-a10c-aa716dd126f7 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.067783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c51c8afb-e3bb-421b-a10c-aa716dd126f7 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.068227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c51c8afb-e3bb-421b-a10c-aa716dd126f7 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.077144 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-c51c8afb-e3bb-421b-a10c-aa716dd126f7 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] HTTP exception thrown: Service 40c2049c-77f7-4eff-9cae-7293149ff059 could not be found. May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c51c8afb-e3bb-421b-a10c-aa716dd126f7 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Request method failure captured: May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: request: PUT /compute/v2.1/os-services/40c2049c-77f7-4eff-9cae-7293149ff059 HTTP/1.1 May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 56 May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVYjiiInvB-XS0f1pHuIJUX5Gn5FFyCwye4oVeW1Bo9gQLNYNc5UgwDXIKyzoNIdW-0BIwJNRbkOya6A6onuvD4quOEhiKzreH12aLZNQW1bLTynRlqVRecDlsjyfD2_bPrc8A1X_YYMjj0K7WWlirYGkApd8Et5h4HP4bQjoQpsJ-U May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: X-Openstack-Nova-Api-Version: 2.53 May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 3001963e1031434483d066bba2e30803 May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-158622665 May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:14:12.079444 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:14:12.081014 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3001963e1031434483d066bba2e30803"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3001963e1031434483d066bba2e30803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3001963e1031434483d066bba2e30803", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3001963e1031434483d066bba2e30803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:12.081014 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-158622665 May 21 21:14:12.081014 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 3001963e1031434483d066bba2e30803 May 21 21:14:12.081014 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-158622665 May 21 21:14:12.081014 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin May 21 21:14:12.081014 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:12.081014 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:12.081014 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 6d83fa3c35764b8990ba15ec7de2eb1d May 21 21:14:12.081014 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin May 21 21:14:12.081014 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:14:12.081014 ncdv-master-1 devstack@n-api.service[131277]: {"status": "disabled", "disabled_reason": "maintenance"} May 21 21:14:12.081014 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:14:12.081014 ncdv-master-1 devstack@n-api.service[131277]: exception: Service 40c2049c-77f7-4eff-9cae-7293149ff059 could not be found. May 21 21:14:12.082007 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '40c2049c-77f7-4eff-9cae-7293149ff059', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} May 21 21:14:12.082007 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:12.082007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:12.082007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id May 21 21:14:12.082007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 21 21:14:12.082007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 21 21:14:12.082007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 21 21:14:12.082007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 21 21:14:12.082007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:12.082007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:12.082007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:12.082007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:12.082007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 21 21:14:12.082007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 21 21:14:12.082007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 21 21:14:12.082007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 21 21:14:12.082007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 40c2049c-77f7-4eff-9cae-7293149ff059 could not be found. May 21 21:14:12.082007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:12.082007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:12.082007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:12.082007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:12.083529 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:12.083529 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:12.083529 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:12.083529 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:12.083529 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:12.083529 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:12.083529 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:12.083529 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:12.083529 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:14:12.083529 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:14:12.083529 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 21 21:14:12.083529 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:14:12.083529 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 40c2049c-77f7-4eff-9cae-7293149ff059 could not be found. May 21 21:14:12.083529 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:12.083529 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:12.083529 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:12.083529 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:12.083529 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:12.083529 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:12.083529 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:12.085025 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:12.085025 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 40c2049c-77f7-4eff-9cae-7293149ff059 could not be found. May 21 21:14:12.085025 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:12.085905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c51c8afb-e3bb-421b-a10c-aa716dd126f7 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Returning 404 to user: Service 40c2049c-77f7-4eff-9cae-7293149ff059 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:12.086912 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c51c8afb-e3bb-421b-a10c-aa716dd126f7 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-services/40c2049c-77f7-4eff-9cae-7293149ff059" status: 404 len: 110 microversion: 2.53 time: 0.170969 May 21 21:14:12.088025 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 515/1070] 10.222.0.49 () {62 vars in 1308 bytes} [Sat May 21 21:14:11 2022] PUT /compute/v2.1/os-services/40c2049c-77f7-4eff-9cae-7293149ff059 => generated 110 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:14:12.097234 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a0d887d4-3732-43c4-8bbc-0de64506720e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:12.098161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a0d887d4-3732-43c4-8bbc-0de64506720e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:12.107154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a0d887d4-3732-43c4-8bbc-0de64506720e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.107742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a0d887d4-3732-43c4-8bbc-0de64506720e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.108546 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a0d887d4-3732-43c4-8bbc-0de64506720e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.109160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a0d887d4-3732-43c4-8bbc-0de64506720e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.263242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-18318655-5dbc-4138-a84b-f53394f7383f tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:12.270924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a0d887d4-3732-43c4-8bbc-0de64506720e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:12.273779 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-18318655-5dbc-4138-a84b-f53394f7383f tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255" status: 200 len: 1319 microversion: 2.1 time: 0.304357 May 21 21:14:12.274679 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 556/1071] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:11 2022] GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:14:12.280056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-31fffabd-ffd5-4464-aab6-362295dc6cc5 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Action: 'update', calling method: .version_select at 0x7fc81b65e280>, body: {"status": "disabled"} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:12.281322 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a0d887d4-3732-43c4-8bbc-0de64506720e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1378 microversion: 2.1 time: 0.192078 May 21 21:14:12.281550 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:12.281550 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:14:12.282226 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 516/1072] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:12 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1378 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:12.283559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-31fffabd-ffd5-4464-aab6-362295dc6cc5 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.284367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-31fffabd-ffd5-4464-aab6-362295dc6cc5 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.294159 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-31fffabd-ffd5-4464-aab6-362295dc6cc5 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.295019 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-31fffabd-ffd5-4464-aab6-362295dc6cc5 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.295522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9974845c-1853-4417-a4fd-83eb4f0fd943 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b457940>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:12.302344 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-31fffabd-ffd5-4464-aab6-362295dc6cc5 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] HTTP exception thrown: Service 40c2049c-77f7-4eff-9cae-7293149ff059 could not be found. May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-31fffabd-ffd5-4464-aab6-362295dc6cc5 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Request method failure captured: May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: request: PUT /compute/v2.1/os-services/40c2049c-77f7-4eff-9cae-7293149ff059 HTTP/1.1 May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 22 May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVYjiiInvB-XS0f1pHuIJUX5Gn5FFyCwye4oVeW1Bo9gQLNYNc5UgwDXIKyzoNIdW-0BIwJNRbkOya6A6onuvD4quOEhiKzreH12aLZNQW1bLTynRlqVRecDlsjyfD2_bPrc8A1X_YYMjj0K7WWlirYGkApd8Et5h4HP4bQjoQpsJ-U May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: X-Openstack-Nova-Api-Version: 2.53 May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 3001963e1031434483d066bba2e30803 May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-158622665 May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,admin,member May 21 21:14:12.304807 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,admin,member May 21 21:14:12.306276 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3001963e1031434483d066bba2e30803"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3001963e1031434483d066bba2e30803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3001963e1031434483d066bba2e30803", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3001963e1031434483d066bba2e30803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:12.306276 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-158622665 May 21 21:14:12.306276 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 3001963e1031434483d066bba2e30803 May 21 21:14:12.306276 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-158622665 May 21 21:14:12.306276 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin May 21 21:14:12.306276 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:14:12.306276 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:14:12.306276 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 6d83fa3c35764b8990ba15ec7de2eb1d May 21 21:14:12.306276 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin May 21 21:14:12.306276 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:14:12.306276 ncdv-master-1 devstack@n-api.service[131278]: {"status": "disabled"} May 21 21:14:12.306276 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:14:12.306276 ncdv-master-1 devstack@n-api.service[131278]: exception: Service 40c2049c-77f7-4eff-9cae-7293149ff059 could not be found. May 21 21:14:12.306276 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '40c2049c-77f7-4eff-9cae-7293149ff059', 'body': {'status': 'disabled'}} May 21 21:14:12.307272 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:12.307272 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:12.307272 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id May 21 21:14:12.307272 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 21 21:14:12.307272 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 21 21:14:12.307272 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 21 21:14:12.307272 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 21 21:14:12.307272 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:12.307272 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:12.307272 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:12.307272 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:12.307272 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 21 21:14:12.307272 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 21 21:14:12.307272 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 21 21:14:12.307272 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 21 21:14:12.307272 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 40c2049c-77f7-4eff-9cae-7293149ff059 could not be found. May 21 21:14:12.307272 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:12.307272 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:12.307272 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:12.307272 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:12.307272 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:12.317405 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:12.317405 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:12.317405 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:12.317405 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:12.317405 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:12.317405 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:12.317405 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:12.317405 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:14:12.317405 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:14:12.317405 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 21 21:14:12.317405 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:14:12.317405 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 40c2049c-77f7-4eff-9cae-7293149ff059 could not be found. May 21 21:14:12.317405 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:12.317405 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:12.317405 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:12.317405 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:12.317405 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:12.317405 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:12.317405 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:12.317405 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:12.319521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 40c2049c-77f7-4eff-9cae-7293149ff059 could not be found. May 21 21:14:12.319521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:12.319521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-31fffabd-ffd5-4464-aab6-362295dc6cc5 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Returning 404 to user: Service 40c2049c-77f7-4eff-9cae-7293149ff059 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:12.319521 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-31fffabd-ffd5-4464-aab6-362295dc6cc5 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-services/40c2049c-77f7-4eff-9cae-7293149ff059" status: 404 len: 110 microversion: 2.53 time: 0.035078 May 21 21:14:12.319521 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 557/1073] 10.222.0.49 () {62 vars in 1308 bytes} [Sat May 21 21:14:12 2022] PUT /compute/v2.1/os-services/40c2049c-77f7-4eff-9cae-7293149ff059 => generated 110 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:14:12.325819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8d4a651f-e691-4308-9dcd-734aa2a4a39e tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Action: 'update', calling method: .version_select at 0x7fc81b6fc8b0>, body: {"status": "enabled"} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:12.328233 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d4a651f-e691-4308-9dcd-734aa2a4a39e tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.328693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d4a651f-e691-4308-9dcd-734aa2a4a39e tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.334599 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d4a651f-e691-4308-9dcd-734aa2a4a39e tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.335250 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d4a651f-e691-4308-9dcd-734aa2a4a39e tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.342007 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-8d4a651f-e691-4308-9dcd-734aa2a4a39e tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] HTTP exception thrown: Service 40c2049c-77f7-4eff-9cae-7293149ff059 could not be found. May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8d4a651f-e691-4308-9dcd-734aa2a4a39e tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Request method failure captured: May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: request: PUT /compute/v2.1/os-services/40c2049c-77f7-4eff-9cae-7293149ff059 HTTP/1.1 May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 21 May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVYjiiInvB-XS0f1pHuIJUX5Gn5FFyCwye4oVeW1Bo9gQLNYNc5UgwDXIKyzoNIdW-0BIwJNRbkOya6A6onuvD4quOEhiKzreH12aLZNQW1bLTynRlqVRecDlsjyfD2_bPrc8A1X_YYMjj0K7WWlirYGkApd8Et5h4HP4bQjoQpsJ-U May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: X-Openstack-Nova-Api-Version: 2.53 May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 3001963e1031434483d066bba2e30803 May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-158622665 May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,admin,member May 21 21:14:12.344063 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,admin,member May 21 21:14:12.353399 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3001963e1031434483d066bba2e30803"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3001963e1031434483d066bba2e30803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3001963e1031434483d066bba2e30803", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3001963e1031434483d066bba2e30803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:12.353399 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-158622665 May 21 21:14:12.353399 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 3001963e1031434483d066bba2e30803 May 21 21:14:12.353399 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-158622665 May 21 21:14:12.353399 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin May 21 21:14:12.353399 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:14:12.353399 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:14:12.353399 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 6d83fa3c35764b8990ba15ec7de2eb1d May 21 21:14:12.353399 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin May 21 21:14:12.353399 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:14:12.353399 ncdv-master-1 devstack@n-api.service[131278]: {"status": "enabled"} May 21 21:14:12.353399 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:14:12.353399 ncdv-master-1 devstack@n-api.service[131278]: exception: Service 40c2049c-77f7-4eff-9cae-7293149ff059 could not be found. May 21 21:14:12.353399 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '40c2049c-77f7-4eff-9cae-7293149ff059', 'body': {'status': 'enabled'}} May 21 21:14:12.354246 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:12.354246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:12.354246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id May 21 21:14:12.354246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 21 21:14:12.354246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 21 21:14:12.354246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 21 21:14:12.354246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 21 21:14:12.354246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:12.354246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:12.354246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:12.354246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:12.354246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 21 21:14:12.354246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 21 21:14:12.354246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 21 21:14:12.354246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 21 21:14:12.354246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 40c2049c-77f7-4eff-9cae-7293149ff059 could not be found. May 21 21:14:12.354246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:12.354246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:12.354246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:12.354246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:12.354246 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:12.356351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:12.356351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:12.356351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:12.356351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:12.356351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:12.356351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:12.356351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:12.356351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:14:12.356351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:14:12.356351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 21 21:14:12.356351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:14:12.356351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 40c2049c-77f7-4eff-9cae-7293149ff059 could not be found. May 21 21:14:12.356351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:12.356351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:12.356351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:12.356351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:12.356351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:12.356351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:12.356351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:12.356351 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:12.358090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 40c2049c-77f7-4eff-9cae-7293149ff059 could not be found. May 21 21:14:12.358090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:12.358090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8d4a651f-e691-4308-9dcd-734aa2a4a39e tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Returning 404 to user: Service 40c2049c-77f7-4eff-9cae-7293149ff059 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:12.358090 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8d4a651f-e691-4308-9dcd-734aa2a4a39e tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-services/40c2049c-77f7-4eff-9cae-7293149ff059" status: 404 len: 110 microversion: 2.53 time: 0.026900 May 21 21:14:12.358090 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 558/1074] 10.222.0.49 () {62 vars in 1308 bytes} [Sat May 21 21:14:12 2022] PUT /compute/v2.1/os-services/40c2049c-77f7-4eff-9cae-7293149ff059 => generated 110 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:14:12.358823 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9974845c-1853-4417-a4fd-83eb4f0fd943 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/7f51617f-5c2a-4842-9e1b-89d7ddfa6acb" status: 200 len: 661 microversion: 2.1 time: 0.064686 May 21 21:14:12.358823 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 517/1075] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:14:12 2022] GET /compute/v2.1/images/7f51617f-5c2a-4842-9e1b-89d7ddfa6acb => generated 661 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:12.363888 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1445eb26-942d-4091-bf96-bccd8a638b82 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b5f9700>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:12.365065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9e1e4004-a95a-4946-8464-4bb97dcea6a4 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:12.366364 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:12.366364 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:14:12.367897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e1e4004-a95a-4946-8464-4bb97dcea6a4 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.368388 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e1e4004-a95a-4946-8464-4bb97dcea6a4 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.369209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e1e4004-a95a-4946-8464-4bb97dcea6a4 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.369932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e1e4004-a95a-4946-8464-4bb97dcea6a4 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.399762 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9e1e4004-a95a-4946-8464-4bb97dcea6a4 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.037876 May 21 21:14:12.404321 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 518/1076] 10.222.0.49 () {60 vars in 1177 bytes} [Sat May 21 21:14:12 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:12.412773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-39bb5185-abe2-446d-9f84-8c7141d45e11 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:12.414034 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:12.414034 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:14:12.415284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39bb5185-abe2-446d-9f84-8c7141d45e11 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.415962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39bb5185-abe2-446d-9f84-8c7141d45e11 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.416813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39bb5185-abe2-446d-9f84-8c7141d45e11 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.417258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39bb5185-abe2-446d-9f84-8c7141d45e11 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.419361 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1445eb26-942d-4091-bf96-bccd8a638b82 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/7f51617f-5c2a-4842-9e1b-89d7ddfa6acb" status: 200 len: 661 microversion: 2.1 time: 0.059295 May 21 21:14:12.419984 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 559/1077] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:14:12 2022] GET /compute/v2.1/images/7f51617f-5c2a-4842-9e1b-89d7ddfa6acb => generated 661 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:12.448247 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-39bb5185-abe2-446d-9f84-8c7141d45e11 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.039641 May 21 21:14:12.449417 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 519/1078] 10.222.0.49 () {60 vars in 1210 bytes} [Sat May 21 21:14:12 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:12.462278 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-89cc70a3-002b-413d-be3e-cc6e8c06cfc0 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:12.463582 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:12.463582 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:14:12.465590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-89cc70a3-002b-413d-be3e-cc6e8c06cfc0 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.466038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-89cc70a3-002b-413d-be3e-cc6e8c06cfc0 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.466865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-89cc70a3-002b-413d-be3e-cc6e8c06cfc0 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.467311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-89cc70a3-002b-413d-be3e-cc6e8c06cfc0 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.483804 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:12.492942 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-89cc70a3-002b-413d-be3e-cc6e8c06cfc0 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.035406 May 21 21:14:12.493618 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 560/1079] 10.222.0.49 () {60 vars in 1177 bytes} [Sat May 21 21:14:12 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:14:12.504744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b547795d-1a41-4872-b5ba-72eaa2123c44 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:12.506017 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:12.506017 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:14:12.507215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b547795d-1a41-4872-b5ba-72eaa2123c44 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.507664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b547795d-1a41-4872-b5ba-72eaa2123c44 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.508502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b547795d-1a41-4872-b5ba-72eaa2123c44 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.515527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b547795d-1a41-4872-b5ba-72eaa2123c44 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.535135 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b547795d-1a41-4872-b5ba-72eaa2123c44 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.033994 May 21 21:14:12.535749 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 520/1080] 10.222.0.49 () {60 vars in 1236 bytes} [Sat May 21 21:14:12 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:12.547003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-206dad29-80ce-437b-8d58-f68671294860 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:12.548245 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:12.548245 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:14:12.549556 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-206dad29-80ce-437b-8d58-f68671294860 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.550017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-206dad29-80ce-437b-8d58-f68671294860 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.550832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-206dad29-80ce-437b-8d58-f68671294860 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.551278 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-206dad29-80ce-437b-8d58-f68671294860 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.582774 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-206dad29-80ce-437b-8d58-f68671294860 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.039433 May 21 21:14:12.583329 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 561/1081] 10.222.0.49 () {60 vars in 1177 bytes} [Sat May 21 21:14:12 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:14:12.594133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9f120231-1f9b-4303-ae02-73fc3a4462d5 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:12.595412 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:12.595412 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:14:12.596645 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f120231-1f9b-4303-ae02-73fc3a4462d5 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.597101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f120231-1f9b-4303-ae02-73fc3a4462d5 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.597908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f120231-1f9b-4303-ae02-73fc3a4462d5 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.598346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f120231-1f9b-4303-ae02-73fc3a4462d5 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.621791 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9f120231-1f9b-4303-ae02-73fc3a4462d5 tempest-ServicesAdminNegativeV253TestJSON-158622665 tempest-ServicesAdminNegativeV253TestJSON-158622665-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.030731 May 21 21:14:12.622483 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 521/1082] 10.222.0.49 () {60 vars in 1238 bytes} [Sat May 21 21:14:12 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:14:12.742024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6e4306d0-d026-45d2-8921-e042162f1071 tempest-ServicesAdminNegativeV253TestJSON-1369299937 tempest-ServicesAdminNegativeV253TestJSON-1369299937-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:12.743244 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:12.743244 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:14:12.744459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6e4306d0-d026-45d2-8921-e042162f1071 tempest-ServicesAdminNegativeV253TestJSON-1369299937 tempest-ServicesAdminNegativeV253TestJSON-1369299937-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '575bd777aa2140d1a1a7ba4ec80c54be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64951c158b64ff096e84a781b918a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6e4306d0-d026-45d2-8921-e042162f1071 tempest-ServicesAdminNegativeV253TestJSON-1369299937 tempest-ServicesAdminNegativeV253TestJSON-1369299937-project] Request method failure captured: May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-services HTTP/1.1 May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVYiim-Max_4VJJOIx3PW0E2oywh8RTBohcszQVsoHU_ycYb6Yw4sy_QC4JmeZwhILKhVQPIarIrVI_Qvijtp63V5mBvh4vfkU2yX9MAnt8fvCnM9xA8fHeU0VxiO7R9IszRx6tb6UBwXTHBj-6r7k1bJX52JedO04ejbTGD9wWxNwU May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: X-Openstack-Nova-Api-Version: 2.53 May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: c64951c158b64ff096e84a781b918a37 May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1369299937 May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:14:12.750057 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:14:12.751582 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c64951c158b64ff096e84a781b918a37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c64951c158b64ff096e84a781b918a37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c64951c158b64ff096e84a781b918a37", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c64951c158b64ff096e84a781b918a37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:12.751582 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1369299937 May 21 21:14:12.751582 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: c64951c158b64ff096e84a781b918a37 May 21 21:14:12.751582 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1369299937 May 21 21:14:12.751582 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1369299937-project May 21 21:14:12.751582 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:14:12.751582 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:14:12.751582 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 575bd777aa2140d1a1a7ba4ec80c54be May 21 21:14:12.751582 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1369299937-project May 21 21:14:12.751582 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:14:12.751582 ncdv-master-1 devstack@n-api.service[131278]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. May 21 21:14:12.751582 ncdv-master-1 devstack@n-api.service[131278]: action_args: {} May 21 21:14:12.752499 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:12.752499 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:12.752499 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:12.752499 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:12.752499 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:12.752499 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:12.752499 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 21:14:12.752499 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:14:12.752499 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 21:14:12.752499 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:14:12.752499 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:12.752499 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:12.752499 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index May 21 21:14:12.752499 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) May 21 21:14:12.752499 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:14:12.752499 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:14:12.752499 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:14:12.752499 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:14:12.752499 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:14:12.753738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:14:12.753738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:14:12.753738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:14:12.753738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:14:12.753738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:14:12.753738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:14:12.753738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:14:12.753738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:14:12.753738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:14:12.753738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. May 21 21:14:12.753738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:12.753738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:12.753738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:12.753738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:12.753738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:12.753738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:12.753738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:14:12.753738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:14:12.753738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. May 21 21:14:12.753738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:12.755432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6e4306d0-d026-45d2-8921-e042162f1071 tempest-ServicesAdminNegativeV253TestJSON-1369299937 tempest-ServicesAdminNegativeV253TestJSON-1369299937-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:12.755432 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6e4306d0-d026-45d2-8921-e042162f1071 tempest-ServicesAdminNegativeV253TestJSON-1369299937 tempest-ServicesAdminNegativeV253TestJSON-1369299937-project] 10.222.0.49 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.118534 May 21 21:14:12.755432 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 562/1083] 10.222.0.49 () {60 vars in 1177 bytes} [Sat May 21 21:14:12 2022] GET /compute/v2.1/os-services => generated 112 bytes in 120 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) May 21 21:14:12.806974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b0653ef1-2635-434e-ba71-c528354418e8 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:12.807550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b0653ef1-2635-434e-ba71-c528354418e8 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:12.815332 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0653ef1-2635-434e-ba71-c528354418e8 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.818444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0653ef1-2635-434e-ba71-c528354418e8 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.818444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0653ef1-2635-434e-ba71-c528354418e8 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.818444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0653ef1-2635-434e-ba71-c528354418e8 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.831936 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-b0653ef1-2635-434e-ba71-c528354418e8 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] HTTP exception thrown: Instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 could not be found. May 21 21:14:12.833563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b0653ef1-2635-434e-ba71-c528354418e8 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Request method failure captured: May 21 21:14:12.833563 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 HTTP/1.1 May 21 21:14:12.833563 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:12.833563 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:12.833563 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:12.833563 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:14:12.833563 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:12.833563 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:12.833563 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:12.833563 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:12.833563 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVV7ciGpBI1VdQKKU-8dLBsgx6FFAZqCe5_UCA8J2q3rw9pcVOFlBABWg-HrAICWqIShMsBslsmPUiDFL3XUHDXXookgNEu825kN5MVutlCYGvJeVDQlv4YeNmimccREq8-TZVsib1Koj5owfkuIY1uB0uoc9EUctbq5I2UadM6tv84 May 21 21:14:12.833563 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:12.833563 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:12.833563 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:12.833563 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:12.833563 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:12.833563 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:12.833563 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: ec45624cf8a940fd952008d56b0d2465 May 21 21:14:12.833563 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-459177358 May 21 21:14:12.833563 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:14:12.833563 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:14:12.834927 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ec45624cf8a940fd952008d56b0d2465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ec45624cf8a940fd952008d56b0d2465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ec45624cf8a940fd952008d56b0d2465", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ec45624cf8a940fd952008d56b0d2465"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:12.834927 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-459177358 May 21 21:14:12.834927 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: ec45624cf8a940fd952008d56b0d2465 May 21 21:14:12.834927 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-459177358 May 21 21:14:12.834927 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AttachSCSIVolumeTestJSON-459177358-project May 21 21:14:12.834927 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:12.834927 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:12.834927 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 331fe55d374249f6bbd9291adf78d5a9 May 21 21:14:12.834927 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-459177358-project May 21 21:14:12.834927 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:14:12.834927 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 could not be found. May 21 21:14:12.834927 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '201a83df-62c1-4804-b9d2-1cee0b7a7013'} May 21 21:14:12.835677 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:12.835677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:12.835677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:14:12.835677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:14:12.835677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:14:12.835677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:14:12.835677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:14:12.835677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:14:12.835677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:14:12.835677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:14:12.835677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 could not be found. May 21 21:14:12.835677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:12.835677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:12.835677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:12.835677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:12.835677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:12.835677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:12.835677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:12.835677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:12.835677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:12.841748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:12.841748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:14:12.841748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:14:12.841748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:14:12.841748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:14:12.841748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:14:12.841748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:14:12.841748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:14:12.841748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:14:12.841748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 could not be found. May 21 21:14:12.841748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:12.841748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:12.841748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:12.841748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:12.841748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:12.841748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:12.841748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:12.841748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:12.841748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 could not be found. May 21 21:14:12.841748 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:12.843382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b0653ef1-2635-434e-ba71-c528354418e8 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Returning 404 to user: Instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:12.843382 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b0653ef1-2635-434e-ba71-c528354418e8 tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "DELETE /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 404 len: 111 microversion: 2.1 time: 0.032488 May 21 21:14:12.843382 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 522/1084] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:14:12 2022] DELETE /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:14:12.843608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4a82e941-4aa1-4dce-b1c2-38c4fa5c11e0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:12.843608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4a82e941-4aa1-4dce-b1c2-38c4fa5c11e0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:12.845560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-52ec827a-4d88-45db-b6dc-072b8a10b59c tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:12.846171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-52ec827a-4d88-45db-b6dc-072b8a10b59c tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] [instance: 201a83df-62c1-4804-b9d2-1cee0b7a7013] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:12.849286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4a82e941-4aa1-4dce-b1c2-38c4fa5c11e0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.850008 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4a82e941-4aa1-4dce-b1c2-38c4fa5c11e0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.850791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4a82e941-4aa1-4dce-b1c2-38c4fa5c11e0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.851228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4a82e941-4aa1-4dce-b1c2-38c4fa5c11e0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.852819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-52ec827a-4d88-45db-b6dc-072b8a10b59c tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.853260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-52ec827a-4d88-45db-b6dc-072b8a10b59c tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.854243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-52ec827a-4d88-45db-b6dc-072b8a10b59c tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.854943 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-52ec827a-4d88-45db-b6dc-072b8a10b59c tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.870170 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-52ec827a-4d88-45db-b6dc-072b8a10b59c tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] HTTP exception thrown: Instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 could not be found. May 21 21:14:12.873053 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-52ec827a-4d88-45db-b6dc-072b8a10b59c tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Request method failure captured: May 21 21:14:12.873053 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 HTTP/1.1 May 21 21:14:12.873053 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:12.873053 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:12.873053 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:12.873053 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:14:12.873053 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:12.873053 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:12.873053 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:12.873053 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:12.873053 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVV7ciGpBI1VdQKKU-8dLBsgx6FFAZqCe5_UCA8J2q3rw9pcVOFlBABWg-HrAICWqIShMsBslsmPUiDFL3XUHDXXookgNEu825kN5MVutlCYGvJeVDQlv4YeNmimccREq8-TZVsib1Koj5owfkuIY1uB0uoc9EUctbq5I2UadM6tv84 May 21 21:14:12.873053 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:12.873053 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:12.873053 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:12.873053 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:12.873053 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:12.873053 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:12.873053 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: ec45624cf8a940fd952008d56b0d2465 May 21 21:14:12.873053 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-459177358 May 21 21:14:12.873053 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:14:12.873053 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:14:12.874746 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ec45624cf8a940fd952008d56b0d2465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ec45624cf8a940fd952008d56b0d2465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ec45624cf8a940fd952008d56b0d2465", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ec45624cf8a940fd952008d56b0d2465"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:12.874746 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-459177358 May 21 21:14:12.874746 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: ec45624cf8a940fd952008d56b0d2465 May 21 21:14:12.874746 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-459177358 May 21 21:14:12.874746 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AttachSCSIVolumeTestJSON-459177358-project May 21 21:14:12.874746 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:12.874746 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:12.874746 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 331fe55d374249f6bbd9291adf78d5a9 May 21 21:14:12.874746 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-459177358-project May 21 21:14:12.874746 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:14:12.874746 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 could not be found. May 21 21:14:12.874746 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '201a83df-62c1-4804-b9d2-1cee0b7a7013'} May 21 21:14:12.875662 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:12.875662 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:12.875662 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:14:12.875662 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:14:12.875662 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:14:12.875662 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:14:12.875662 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:14:12.875662 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:14:12.875662 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:14:12.875662 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:14:12.875662 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 could not be found. May 21 21:14:12.875662 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:12.875662 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:12.875662 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:12.875662 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:12.875662 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:12.875662 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:12.875662 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:12.875662 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:12.875662 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:12.877149 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:12.877149 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:14:12.877149 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:14:12.877149 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:14:12.877149 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:14:12.877149 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:14:12.877149 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:14:12.877149 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 could not be found. May 21 21:14:12.877149 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:12.877149 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:12.877149 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:12.877149 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:12.877149 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:12.877149 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:12.877149 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:12.877149 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:12.877149 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 could not be found. May 21 21:14:12.877149 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:12.878732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-52ec827a-4d88-45db-b6dc-072b8a10b59c tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] Returning 404 to user: Instance 201a83df-62c1-4804-b9d2-1cee0b7a7013 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:12.878732 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-52ec827a-4d88-45db-b6dc-072b8a10b59c tempest-AttachSCSIVolumeTestJSON-459177358 tempest-AttachSCSIVolumeTestJSON-459177358-project] 10.222.0.49 "GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013" status: 404 len: 111 microversion: 2.1 time: 0.032913 May 21 21:14:12.878732 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 523/1085] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:12 2022] GET /compute/v2.1/servers/201a83df-62c1-4804-b9d2-1cee0b7a7013 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:14:12.894422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e8b79f13-cae3-46ae-a476-62b3f4bee914 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:12.894963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e8b79f13-cae3-46ae-a476-62b3f4bee914 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:12.901533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8b79f13-cae3-46ae-a476-62b3f4bee914 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.902314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8b79f13-cae3-46ae-a476-62b3f4bee914 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:12.903444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8b79f13-cae3-46ae-a476-62b3f4bee914 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:12.905243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8b79f13-cae3-46ae-a476-62b3f4bee914 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:13.064735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e8b79f13-cae3-46ae-a476-62b3f4bee914 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:13.071491 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e8b79f13-cae3-46ae-a476-62b3f4bee914 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1324 microversion: 2.1 time: 0.180878 May 21 21:14:13.072222 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 524/1086] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:12 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1324 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:13.201966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4a82e941-4aa1-4dce-b1c2-38c4fa5c11e0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:13.222233 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4a82e941-4aa1-4dce-b1c2-38c4fa5c11e0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1551 microversion: 2.1 time: 0.392353 May 21 21:14:13.222920 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 563/1087] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:12 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1551 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:14:13.291127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a9bd158c-9278-4e02-9900-6c8745555248 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:13.292066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a9bd158c-9278-4e02-9900-6c8745555248 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:13.300924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9bd158c-9278-4e02-9900-6c8745555248 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:13.301867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e73e341d-d695-41dc-9299-7026ab9e1ff7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:13.302583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9bd158c-9278-4e02-9900-6c8745555248 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:13.302871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e73e341d-d695-41dc-9299-7026ab9e1ff7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:13.303995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9bd158c-9278-4e02-9900-6c8745555248 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:13.305003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9bd158c-9278-4e02-9900-6c8745555248 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:13.316937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e73e341d-d695-41dc-9299-7026ab9e1ff7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:13.317704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e73e341d-d695-41dc-9299-7026ab9e1ff7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:13.319625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e73e341d-d695-41dc-9299-7026ab9e1ff7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:13.320442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e73e341d-d695-41dc-9299-7026ab9e1ff7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:13.507382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a9bd158c-9278-4e02-9900-6c8745555248 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:13.516582 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a9bd158c-9278-4e02-9900-6c8745555248 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255" status: 200 len: 1319 microversion: 2.1 time: 0.229269 May 21 21:14:13.517748 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 525/1088] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:13 2022] GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:13.714426 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e73e341d-d695-41dc-9299-7026ab9e1ff7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:13.756068 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e73e341d-d695-41dc-9299-7026ab9e1ff7 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1378 microversion: 2.1 time: 0.456739 May 21 21:14:13.759510 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 564/1089] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:13 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1378 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:14:13.879437 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e6d5931c-66b8-4ddb-8473-9bd6364e3a07 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:13.880508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e6d5931c-66b8-4ddb-8473-9bd6364e3a07 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:13.887441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6d5931c-66b8-4ddb-8473-9bd6364e3a07 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:13.888162 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6d5931c-66b8-4ddb-8473-9bd6364e3a07 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:13.889166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6d5931c-66b8-4ddb-8473-9bd6364e3a07 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:13.889617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6d5931c-66b8-4ddb-8473-9bd6364e3a07 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:14.091464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c483087e-0dc2-426d-bbee-47735da071c7 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:14.092304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c483087e-0dc2-426d-bbee-47735da071c7 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:14.101138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c483087e-0dc2-426d-bbee-47735da071c7 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:14.101698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c483087e-0dc2-426d-bbee-47735da071c7 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:14.102581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c483087e-0dc2-426d-bbee-47735da071c7 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:14.103182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c483087e-0dc2-426d-bbee-47735da071c7 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:14.114273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-e6d5931c-66b8-4ddb-8473-9bd6364e3a07 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lazy-loading 'services' on Instance uuid 13739e66-c933-4b7b-b4a9-365b8b4c65cb {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:14:14.130176 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e6d5931c-66b8-4ddb-8473-9bd6364e3a07 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 2128 microversion: 2.25 time: 0.254859 May 21 21:14:14.131104 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 526/1090] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:14:13 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 2128 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:14.149895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4b5b9260-e922-4417-9999-5cbadac25ef0 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:14.151097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4b5b9260-e922-4417-9999-5cbadac25ef0 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:14.159726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4b5b9260-e922-4417-9999-5cbadac25ef0 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:14.160813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4b5b9260-e922-4417-9999-5cbadac25ef0 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:14.160986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4b5b9260-e922-4417-9999-5cbadac25ef0 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:14.161621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4b5b9260-e922-4417-9999-5cbadac25ef0 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:14.188648 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-4b5b9260-e922-4417-9999-5cbadac25ef0 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lazy-loading 'flavor' on Instance uuid 13739e66-c933-4b7b-b4a9-365b8b4c65cb {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:14:14.203459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4b5b9260-e922-4417-9999-5cbadac25ef0 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Going to try to live migrate instance to nch2-master-1 {{(pid=131277) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 21 21:14:14.559923 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c483087e-0dc2-426d-bbee-47735da071c7 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:14.568480 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c483087e-0dc2-426d-bbee-47735da071c7 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1324 microversion: 2.1 time: 0.482851 May 21 21:14:14.569535 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 565/1091] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:14 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1324 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:14:14.575670 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ec168658-2928-4942-ae8a-8ded07eab282 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:14.576847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ec168658-2928-4942-ae8a-8ded07eab282 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:14.583575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ec168658-2928-4942-ae8a-8ded07eab282 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:14.584389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ec168658-2928-4942-ae8a-8ded07eab282 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:14.585183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ec168658-2928-4942-ae8a-8ded07eab282 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:14.585627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ec168658-2928-4942-ae8a-8ded07eab282 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:15.336506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ec168658-2928-4942-ae8a-8ded07eab282 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:15.363096 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ec168658-2928-4942-ae8a-8ded07eab282 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1551 microversion: 2.1 time: 0.792058 May 21 21:14:15.363971 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 566/1092] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:14 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1551 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:15.375366 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4afcac81-a271-468a-acba-91cec3926634 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:15.375991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4afcac81-a271-468a-acba-91cec3926634 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:15.382856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4afcac81-a271-468a-acba-91cec3926634 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:15.383313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4afcac81-a271-468a-acba-91cec3926634 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:15.384097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4afcac81-a271-468a-acba-91cec3926634 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:15.385186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4afcac81-a271-468a-acba-91cec3926634 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:15.833833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4afcac81-a271-468a-acba-91cec3926634 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:15.836598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:15.843868 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4afcac81-a271-468a-acba-91cec3926634 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255" status: 200 len: 1319 microversion: 2.1 time: 0.478578 May 21 21:14:15.844545 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 567/1093] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:15 2022] GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 => generated 1319 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:15.873394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-ba8fe312-9efd-41e8-add2-cd82d4a9f6ab req-2d27551d-c88a-4c96-b731-9ba51b424e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc6789c-29a3-4a84-8045-36b96ce9e9fe", "name": "network-vif-unplugged", "status": "completed", "tag": "5f73169d-eef2-4b97-bed3-b8b63c509864"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:15.899632 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ba8fe312-9efd-41e8-add2-cd82d4a9f6ab req-2d27551d-c88a-4c96-b731-9ba51b424e01 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:15.900482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ba8fe312-9efd-41e8-add2-cd82d4a9f6ab req-2d27551d-c88a-4c96-b731-9ba51b424e01 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:15.916313 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-ba8fe312-9efd-41e8-add2-cd82d4a9f6ab req-2d27551d-c88a-4c96-b731-9ba51b424e01 service nova] Creating event network-vif-unplugged:5f73169d-eef2-4b97-bed3-b8b63c509864 for instance afc6789c-29a3-4a84-8045-36b96ce9e9fe on nch2-master-1 May 21 21:14:15.921996 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-ba8fe312-9efd-41e8-add2-cd82d4a9f6ab req-2d27551d-c88a-4c96-b731-9ba51b424e01 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067250 May 21 21:14:15.925018 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 568/1094] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:15.931092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-63877027-69d7-45e1-851a-83afc96a6e32 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b5750d0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:15.984888 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-63877027-69d7-45e1-851a-83afc96a6e32 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/bf502d24-b9bd-4c44-a7b6-df60c68ed75f" status: 200 len: 662 microversion: 2.1 time: 0.058000 May 21 21:14:15.986386 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 569/1095] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:14:15 2022] GET /compute/v2.1/images/bf502d24-b9bd-4c44-a7b6-df60c68ed75f => generated 662 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:15.998775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f7ccf5ab-965c-4e21-99b6-f35b1959ec24 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:16.001857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f7ccf5ab-965c-4e21-99b6-f35b1959ec24 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:16.013185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f7ccf5ab-965c-4e21-99b6-f35b1959ec24 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:16.013681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f7ccf5ab-965c-4e21-99b6-f35b1959ec24 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:16.014707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f7ccf5ab-965c-4e21-99b6-f35b1959ec24 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:16.015646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f7ccf5ab-965c-4e21-99b6-f35b1959ec24 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:16.409546 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f7ccf5ab-965c-4e21-99b6-f35b1959ec24 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:16.420926 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f7ccf5ab-965c-4e21-99b6-f35b1959ec24 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1378 microversion: 2.1 time: 0.433131 May 21 21:14:16.421748 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 570/1096] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:15 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1378 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:16.427737 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3b12d9db-6aa0-4008-8bd5-8222f5325583 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:16.428700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3b12d9db-6aa0-4008-8bd5-8222f5325583 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:16.436699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b12d9db-6aa0-4008-8bd5-8222f5325583 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:16.437148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b12d9db-6aa0-4008-8bd5-8222f5325583 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:16.437923 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b12d9db-6aa0-4008-8bd5-8222f5325583 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:16.438361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b12d9db-6aa0-4008-8bd5-8222f5325583 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:16.487542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=22 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:16.749235 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3b12d9db-6aa0-4008-8bd5-8222f5325583 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:16.761137 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3b12d9db-6aa0-4008-8bd5-8222f5325583 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1324 microversion: 2.1 time: 0.338173 May 21 21:14:16.761961 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 571/1097] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:16 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1324 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:16.775774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-5b823126-7ec3-4269-8a22-c8be29a79c16 req-09342150-69e5-4ff4-a0af-b5df3d9774e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b58aadd3-11a8-41dc-9104-b6082e4eeb06", "tag": "45d0dcd8-6e01-48f0-a3c7-19f72707d0d7"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:16.792440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-5b823126-7ec3-4269-8a22-c8be29a79c16 req-09342150-69e5-4ff4-a0af-b5df3d9774e4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:16.792440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-5b823126-7ec3-4269-8a22-c8be29a79c16 req-09342150-69e5-4ff4-a0af-b5df3d9774e4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:16.804673 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-5b823126-7ec3-4269-8a22-c8be29a79c16 req-09342150-69e5-4ff4-a0af-b5df3d9774e4 service nova] Creating event network-changed:45d0dcd8-6e01-48f0-a3c7-19f72707d0d7 for instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 on nch1-master-1 May 21 21:14:16.810500 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-5b823126-7ec3-4269-8a22-c8be29a79c16 req-09342150-69e5-4ff4-a0af-b5df3d9774e4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037947 May 21 21:14:16.815485 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 572/1098] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:16.818123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6d883312-b412-4c05-952c-046cb6736b22 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b4cfd30>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:16.870447 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6d883312-b412-4c05-952c-046cb6736b22 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/bf502d24-b9bd-4c44-a7b6-df60c68ed75f" status: 200 len: 662 microversion: 2.1 time: 0.057305 May 21 21:14:16.872198 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 573/1099] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:14:16 2022] GET /compute/v2.1/images/bf502d24-b9bd-4c44-a7b6-df60c68ed75f => generated 662 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:16.878863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9ab67ada-1edb-47ce-8cde-e87903c84db1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:16.878863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9ab67ada-1edb-47ce-8cde-e87903c84db1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:16.886715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ab67ada-1edb-47ce-8cde-e87903c84db1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:16.888115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ab67ada-1edb-47ce-8cde-e87903c84db1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:16.889127 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ab67ada-1edb-47ce-8cde-e87903c84db1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:16.889575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ab67ada-1edb-47ce-8cde-e87903c84db1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:17.178817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9ab67ada-1edb-47ce-8cde-e87903c84db1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:17.187930 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9ab67ada-1edb-47ce-8cde-e87903c84db1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1551 microversion: 2.1 time: 0.314654 May 21 21:14:17.197320 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 574/1100] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:16 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1551 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:17.202425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-70d64232-80d9-48e7-bea9-2aceb914c913 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:17.203260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-70d64232-80d9-48e7-bea9-2aceb914c913 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:17.209836 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-70d64232-80d9-48e7-bea9-2aceb914c913 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:17.210529 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-70d64232-80d9-48e7-bea9-2aceb914c913 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:17.211461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-70d64232-80d9-48e7-bea9-2aceb914c913 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:17.212050 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-70d64232-80d9-48e7-bea9-2aceb914c913 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:17.523954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-70d64232-80d9-48e7-bea9-2aceb914c913 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:17.544757 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-70d64232-80d9-48e7-bea9-2aceb914c913 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255" status: 200 len: 1319 microversion: 2.1 time: 0.342836 May 21 21:14:17.546417 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 575/1101] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:17 2022] GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:17.552112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4274e24b-3239-4e70-ac10-40e325d81c32 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:17.553076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4274e24b-3239-4e70-ac10-40e325d81c32 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:17.562128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4274e24b-3239-4e70-ac10-40e325d81c32 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:17.562518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4274e24b-3239-4e70-ac10-40e325d81c32 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:17.563469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4274e24b-3239-4e70-ac10-40e325d81c32 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:17.564211 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4274e24b-3239-4e70-ac10-40e325d81c32 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:17.763636 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4274e24b-3239-4e70-ac10-40e325d81c32 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:17.775209 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4274e24b-3239-4e70-ac10-40e325d81c32 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1378 microversion: 2.1 time: 0.226876 May 21 21:14:17.777891 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 576/1102] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:17 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1378 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:17.786755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-b90e2ab7-7852-4efa-b3d1-e3058454dfe2 req-a1d0ef0a-bf94-48e9-8404-96c1f59a3687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ac7c08-f2ba-42ce-9b70-c28101bab255", "name": "network-vif-plugged", "status": "completed", "tag": "f683da31-65ac-4fd9-a216-c46e5543ec92"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:17.799760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b90e2ab7-7852-4efa-b3d1-e3058454dfe2 req-a1d0ef0a-bf94-48e9-8404-96c1f59a3687 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:17.800504 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b90e2ab7-7852-4efa-b3d1-e3058454dfe2 req-a1d0ef0a-bf94-48e9-8404-96c1f59a3687 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:17.810372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:17.816659 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-b90e2ab7-7852-4efa-b3d1-e3058454dfe2 req-a1d0ef0a-bf94-48e9-8404-96c1f59a3687 service nova] Creating event network-vif-plugged:f683da31-65ac-4fd9-a216-c46e5543ec92 for instance 24ac7c08-f2ba-42ce-9b70-c28101bab255 on nch2-master-1 May 21 21:14:17.822019 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-b90e2ab7-7852-4efa-b3d1-e3058454dfe2 req-a1d0ef0a-bf94-48e9-8404-96c1f59a3687 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039899 May 21 21:14:17.823200 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 577/1103] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:17.828225 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d7b6594d-c647-46f8-bb0e-ac212fe8f755 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:17.829105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d7b6594d-c647-46f8-bb0e-ac212fe8f755 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:17.836597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7b6594d-c647-46f8-bb0e-ac212fe8f755 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:17.837349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7b6594d-c647-46f8-bb0e-ac212fe8f755 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:17.838358 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7b6594d-c647-46f8-bb0e-ac212fe8f755 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:17.839015 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7b6594d-c647-46f8-bb0e-ac212fe8f755 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:17.841793 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4b5b9260-e922-4417-9999-5cbadac25ef0 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb/action" status: 202 len: 0 microversion: 2.25 time: 3.696377 May 21 21:14:17.843102 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 527/1104] 10.222.0.49 () {62 vars in 1318 bytes} [Sat May 21 21:14:14 2022] POST /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb/action => generated 0 bytes in 3698 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 21 21:14:17.852545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ebffb806-6b26-42a9-bc11-4404a5be85f4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:17.853233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ebffb806-6b26-42a9-bc11-4404a5be85f4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:17.876547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebffb806-6b26-42a9-bc11-4404a5be85f4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:17.877203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebffb806-6b26-42a9-bc11-4404a5be85f4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:17.878719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebffb806-6b26-42a9-bc11-4404a5be85f4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:17.879217 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebffb806-6b26-42a9-bc11-4404a5be85f4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:18.141944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ebffb806-6b26-42a9-bc11-4404a5be85f4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:18.151053 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ebffb806-6b26-42a9-bc11-4404a5be85f4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:18.153968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ebffb806-6b26-42a9-bc11-4404a5be85f4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:18.155426 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ebffb806-6b26-42a9-bc11-4404a5be85f4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1645 microversion: 2.25 time: 0.307995 May 21 21:14:18.168108 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 528/1105] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:14:17 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1645 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:18.190114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-0be5f3df-6a0e-4de6-84ca-4f36125bdd7c req-3e660794-097a-4404-bd7e-28cfe0c262ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afc6789c-29a3-4a84-8045-36b96ce9e9fe", "tag": "5f73169d-eef2-4b97-bed3-b8b63c509864"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:18.200672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-0be5f3df-6a0e-4de6-84ca-4f36125bdd7c req-3e660794-097a-4404-bd7e-28cfe0c262ce service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:18.202042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-0be5f3df-6a0e-4de6-84ca-4f36125bdd7c req-3e660794-097a-4404-bd7e-28cfe0c262ce service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:18.216071 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-0be5f3df-6a0e-4de6-84ca-4f36125bdd7c req-3e660794-097a-4404-bd7e-28cfe0c262ce service nova] Creating event network-changed:5f73169d-eef2-4b97-bed3-b8b63c509864 for instance afc6789c-29a3-4a84-8045-36b96ce9e9fe on nch2-master-1 May 21 21:14:18.220609 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d7b6594d-c647-46f8-bb0e-ac212fe8f755 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:18.222479 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-0be5f3df-6a0e-4de6-84ca-4f36125bdd7c req-3e660794-097a-4404-bd7e-28cfe0c262ce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050927 May 21 21:14:18.223808 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 529/1106] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:18.228943 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d7b6594d-c647-46f8-bb0e-ac212fe8f755 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1324 microversion: 2.1 time: 0.404612 May 21 21:14:18.231159 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 578/1107] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:17 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1324 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:18.239883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-15a852b9-f3de-4fad-906d-ac65448f66eb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:18.243732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-15a852b9-f3de-4fad-906d-ac65448f66eb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:18.255707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15a852b9-f3de-4fad-906d-ac65448f66eb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:18.256424 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15a852b9-f3de-4fad-906d-ac65448f66eb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:18.257368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15a852b9-f3de-4fad-906d-ac65448f66eb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:18.257963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15a852b9-f3de-4fad-906d-ac65448f66eb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:18.570213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-41979853-5f9b-4079-b446-4f5fef9af280 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:18.571418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-41979853-5f9b-4079-b446-4f5fef9af280 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:18.585852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41979853-5f9b-4079-b446-4f5fef9af280 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:18.586488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41979853-5f9b-4079-b446-4f5fef9af280 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:18.587300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41979853-5f9b-4079-b446-4f5fef9af280 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:18.587769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41979853-5f9b-4079-b446-4f5fef9af280 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:18.827718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-15a852b9-f3de-4fad-906d-ac65448f66eb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:18.837156 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-15a852b9-f3de-4fad-906d-ac65448f66eb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1551 microversion: 2.1 time: 0.611828 May 21 21:14:18.837858 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 530/1108] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:18 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1551 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:18.843186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-320c8b0a-7c11-49c2-ba7a-ee3f55577a50 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:18.843881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-320c8b0a-7c11-49c2-ba7a-ee3f55577a50 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:18.850655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-320c8b0a-7c11-49c2-ba7a-ee3f55577a50 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:18.851325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-320c8b0a-7c11-49c2-ba7a-ee3f55577a50 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:18.852167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-320c8b0a-7c11-49c2-ba7a-ee3f55577a50 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:18.852884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-320c8b0a-7c11-49c2-ba7a-ee3f55577a50 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:18.944330 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-41979853-5f9b-4079-b446-4f5fef9af280 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:18.955417 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-41979853-5f9b-4079-b446-4f5fef9af280 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255" status: 200 len: 1319 microversion: 2.1 time: 0.397810 May 21 21:14:18.956194 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 579/1109] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:18 2022] GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 => generated 1319 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:19.119359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9f7d65bb-117b-4808-9fe1-bcd5c072da58 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b4d3dc0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:19.170729 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9f7d65bb-117b-4808-9fe1-bcd5c072da58 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/b9f0dcc1-c61a-4326-a35c-23a5dcd833e3" status: 200 len: 661 microversion: 2.1 time: 0.055460 May 21 21:14:19.174402 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 580/1110] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:14:19 2022] GET /compute/v2.1/images/b9f0dcc1-c61a-4326-a35c-23a5dcd833e3 => generated 661 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:14:19.181071 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-98aa7c32-896c-4e27-8241-538d4a84dd74 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:19.181984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-98aa7c32-896c-4e27-8241-538d4a84dd74 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:19.190802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98aa7c32-896c-4e27-8241-538d4a84dd74 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:19.191359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98aa7c32-896c-4e27-8241-538d4a84dd74 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:19.192543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98aa7c32-896c-4e27-8241-538d4a84dd74 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:19.193933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98aa7c32-896c-4e27-8241-538d4a84dd74 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:19.229905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-320c8b0a-7c11-49c2-ba7a-ee3f55577a50 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:19.245102 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-320c8b0a-7c11-49c2-ba7a-ee3f55577a50 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1378 microversion: 2.1 time: 0.401359 May 21 21:14:19.247250 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 531/1111] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:18 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1378 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:19.254172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-55a16d60-0b4a-42f8-bb7f-b30649150725 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b435ee0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:19.314681 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-55a16d60-0b4a-42f8-bb7f-b30649150725 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/b9f0dcc1-c61a-4326-a35c-23a5dcd833e3" status: 200 len: 661 microversion: 2.1 time: 0.066047 May 21 21:14:19.315481 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 532/1112] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:14:19 2022] GET /compute/v2.1/images/b9f0dcc1-c61a-4326-a35c-23a5dcd833e3 => generated 661 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:19.320736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b6d409f2-03fe-424f-bd2f-50193ff9a11b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:19.321602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b6d409f2-03fe-424f-bd2f-50193ff9a11b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:19.329603 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6d409f2-03fe-424f-bd2f-50193ff9a11b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:19.330313 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6d409f2-03fe-424f-bd2f-50193ff9a11b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:19.332512 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6d409f2-03fe-424f-bd2f-50193ff9a11b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:19.333452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6d409f2-03fe-424f-bd2f-50193ff9a11b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:19.655287 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-98aa7c32-896c-4e27-8241-538d4a84dd74 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:19.664885 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-98aa7c32-896c-4e27-8241-538d4a84dd74 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:19.666677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-98aa7c32-896c-4e27-8241-538d4a84dd74 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:19.668219 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-98aa7c32-896c-4e27-8241-538d4a84dd74 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1645 microversion: 2.25 time: 0.494491 May 21 21:14:19.679086 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 581/1113] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:14:19 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1645 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:14:19.679086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ef463e13-b335-4aa1-80ff-648940ca6a8c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-846900661", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:19.745073 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-ef463e13-b335-4aa1-80ff-648940ca6a8c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] validate_networks() for None {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:14:19.830118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b6d409f2-03fe-424f-bd2f-50193ff9a11b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:19.844582 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b6d409f2-03fe-424f-bd2f-50193ff9a11b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1324 microversion: 2.1 time: 0.527208 May 21 21:14:19.845080 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 533/1114] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:19 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1324 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:19.849791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-17b0a8f2-25f5-4179-b985-be514c4d32d0 req-83610f41-a5bf-465c-b934-14f576ab1e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4531a7ea-7be9-48b8-adac-fe968ff5d889", "name": "network-vif-plugged", "status": "completed", "tag": "d47da14c-0379-42b1-91a7-7b1098c8cded"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:19.859848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-17b0a8f2-25f5-4179-b985-be514c4d32d0 req-83610f41-a5bf-465c-b934-14f576ab1e42 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:19.860441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-17b0a8f2-25f5-4179-b985-be514c4d32d0 req-83610f41-a5bf-465c-b934-14f576ab1e42 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:19.873887 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-17b0a8f2-25f5-4179-b985-be514c4d32d0 req-83610f41-a5bf-465c-b934-14f576ab1e42 service nova] Creating event network-vif-plugged:d47da14c-0379-42b1-91a7-7b1098c8cded for instance 4531a7ea-7be9-48b8-adac-fe968ff5d889 on nch1-master-1 May 21 21:14:19.879329 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-17b0a8f2-25f5-4179-b985-be514c4d32d0 req-83610f41-a5bf-465c-b934-14f576ab1e42 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032826 May 21 21:14:19.879968 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 534/1115] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:19.885382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2b8209c8-72be-4e93-9e58-d455789cf6f5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:19.886642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2b8209c8-72be-4e93-9e58-d455789cf6f5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:19.894709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b8209c8-72be-4e93-9e58-d455789cf6f5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:19.895523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b8209c8-72be-4e93-9e58-d455789cf6f5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:19.896352 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b8209c8-72be-4e93-9e58-d455789cf6f5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:19.896801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b8209c8-72be-4e93-9e58-d455789cf6f5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:19.921875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:20.136888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2b8209c8-72be-4e93-9e58-d455789cf6f5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:20.154802 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2b8209c8-72be-4e93-9e58-d455789cf6f5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1551 microversion: 2.1 time: 0.273048 May 21 21:14:20.156468 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 535/1116] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:19 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1551 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:20.163535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1348d448-1c29-4963-b089-fd2112e2aead tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:20.165288 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1348d448-1c29-4963-b089-fd2112e2aead tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:20.176980 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1348d448-1c29-4963-b089-fd2112e2aead tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:20.177583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1348d448-1c29-4963-b089-fd2112e2aead tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:20.178609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1348d448-1c29-4963-b089-fd2112e2aead tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:20.179210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1348d448-1c29-4963-b089-fd2112e2aead tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:20.442466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1348d448-1c29-4963-b089-fd2112e2aead tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:20.451911 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1348d448-1c29-4963-b089-fd2112e2aead tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255" status: 200 len: 1469 microversion: 2.1 time: 0.293411 May 21 21:14:20.452782 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 536/1117] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:20 2022] GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 => generated 1469 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:20.457793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7ca77ae9-c75d-4f99-878a-4659703f42f2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:20.464876 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7ca77ae9-c75d-4f99-878a-4659703f42f2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:20.471400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ca77ae9-c75d-4f99-878a-4659703f42f2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:20.472043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ca77ae9-c75d-4f99-878a-4659703f42f2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:20.473898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ca77ae9-c75d-4f99-878a-4659703f42f2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:20.473898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ca77ae9-c75d-4f99-878a-4659703f42f2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:20.744084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7ca77ae9-c75d-4f99-878a-4659703f42f2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:20.755260 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7ca77ae9-c75d-4f99-878a-4659703f42f2 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1378 microversion: 2.1 time: 0.301172 May 21 21:14:20.756451 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 537/1118] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:20 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1378 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:20.762824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a32569ab-9c4f-405d-972b-89098f12d654 tempest-DeleteServersAdminTestJSON-194072967 tempest-DeleteServersAdminTestJSON-194072967-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:20.764076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a32569ab-9c4f-405d-972b-89098f12d654 tempest-DeleteServersAdminTestJSON-194072967 tempest-DeleteServersAdminTestJSON-194072967-project-admin] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:20.770944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:20.773940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a32569ab-9c4f-405d-972b-89098f12d654 tempest-DeleteServersAdminTestJSON-194072967 tempest-DeleteServersAdminTestJSON-194072967-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:20.777221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a32569ab-9c4f-405d-972b-89098f12d654 tempest-DeleteServersAdminTestJSON-194072967 tempest-DeleteServersAdminTestJSON-194072967-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:20.777221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a32569ab-9c4f-405d-972b-89098f12d654 tempest-DeleteServersAdminTestJSON-194072967 tempest-DeleteServersAdminTestJSON-194072967-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:20.777221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a32569ab-9c4f-405d-972b-89098f12d654 tempest-DeleteServersAdminTestJSON-194072967 tempest-DeleteServersAdminTestJSON-194072967-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:21.018968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-ef463e13-b335-4aa1-80ff-648940ca6a8c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:14:21.021371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-ef463e13-b335-4aa1-80ff-648940ca6a8c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:14:21.022977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-ef463e13-b335-4aa1-80ff-648940ca6a8c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:14:21.023590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-ef463e13-b335-4aa1-80ff-648940ca6a8c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:14:21.024414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-ef463e13-b335-4aa1-80ff-648940ca6a8c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:14:21.052831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef463e13-b335-4aa1-80ff-648940ca6a8c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:21.055986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef463e13-b335-4aa1-80ff-648940ca6a8c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:21.059515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef463e13-b335-4aa1-80ff-648940ca6a8c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:21.062533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef463e13-b335-4aa1-80ff-648940ca6a8c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:21.104548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-ef463e13-b335-4aa1-80ff-648940ca6a8c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Getting quotas for project 0e8dbd3049724928a8db6771b70ad38b. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:14:21.111525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-ef463e13-b335-4aa1-80ff-648940ca6a8c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Getting quotas for user 8b5d5f69b7c04811b9dc36daaa17079a and project 0e8dbd3049724928a8db6771b70ad38b. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:14:21.128094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ef463e13-b335-4aa1-80ff-648940ca6a8c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:14:21.130959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ef463e13-b335-4aa1-80ff-648940ca6a8c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: 55818247-81af-4cf1-bff3-92aeb3f06bba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:14:21.275857 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a32569ab-9c4f-405d-972b-89098f12d654 tempest-DeleteServersAdminTestJSON-194072967 tempest-DeleteServersAdminTestJSON-194072967-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255/action" status: 202 len: 0 microversion: 2.1 time: 0.516738 May 21 21:14:21.281223 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 538/1119] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:14:20 2022] POST /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:14:21.287210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-770b9f77-d887-4403-9f4d-6bdf78de88f8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:21.288359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-770b9f77-d887-4403-9f4d-6bdf78de88f8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:21.319207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-770b9f77-d887-4403-9f4d-6bdf78de88f8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:21.319872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-770b9f77-d887-4403-9f4d-6bdf78de88f8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:21.320953 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-770b9f77-d887-4403-9f4d-6bdf78de88f8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:21.321784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-770b9f77-d887-4403-9f4d-6bdf78de88f8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:21.356430 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ef463e13-b335-4aa1-80ff-648940ca6a8c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.679439 May 21 21:14:21.357296 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 582/1120] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:14:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:14:21.384441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-93c8261e-22c5-414c-89d4-26ed4f990053 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:21.385080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-93c8261e-22c5-414c-89d4-26ed4f990053 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:21.404995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-93c8261e-22c5-414c-89d4-26ed4f990053 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:21.405465 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-93c8261e-22c5-414c-89d4-26ed4f990053 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:21.406613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-93c8261e-22c5-414c-89d4-26ed4f990053 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:21.410464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-93c8261e-22c5-414c-89d4-26ed4f990053 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:21.704759 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-770b9f77-d887-4403-9f4d-6bdf78de88f8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:21.719962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-770b9f77-d887-4403-9f4d-6bdf78de88f8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:21.722225 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-770b9f77-d887-4403-9f4d-6bdf78de88f8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:21.723488 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-770b9f77-d887-4403-9f4d-6bdf78de88f8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1645 microversion: 2.25 time: 0.441148 May 21 21:14:21.734923 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 539/1121] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:14:21 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1645 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:21.739478 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8318ff18-1b89-44f7-97b2-038169ce4784 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:21.741813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8318ff18-1b89-44f7-97b2-038169ce4784 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:21.753182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8318ff18-1b89-44f7-97b2-038169ce4784 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:21.753735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8318ff18-1b89-44f7-97b2-038169ce4784 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:21.754997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8318ff18-1b89-44f7-97b2-038169ce4784 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:21.755565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8318ff18-1b89-44f7-97b2-038169ce4784 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:21.823852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-93c8261e-22c5-414c-89d4-26ed4f990053 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:21.834366 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-93c8261e-22c5-414c-89d4-26ed4f990053 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1324 microversion: 2.1 time: 0.474497 May 21 21:14:21.835804 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 583/1122] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:21 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1324 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:21.842217 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6c623ff4-58bc-4e44-9082-744acd46c404 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:21.843194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6c623ff4-58bc-4e44-9082-744acd46c404 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:21.858089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c623ff4-58bc-4e44-9082-744acd46c404 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:21.858868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c623ff4-58bc-4e44-9082-744acd46c404 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:21.860099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c623ff4-58bc-4e44-9082-744acd46c404 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:21.860851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c623ff4-58bc-4e44-9082-744acd46c404 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:21.908831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c623ff4-58bc-4e44-9082-744acd46c404 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:21.909606 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c623ff4-58bc-4e44-9082-744acd46c404 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:21.910375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-6c623ff4-58bc-4e44-9082-744acd46c404 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lazy-loading 'fault' on Instance uuid 24ac7c08-f2ba-42ce-9b70-c28101bab255 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:14:22.082573 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8318ff18-1b89-44f7-97b2-038169ce4784 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:22.098741 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8318ff18-1b89-44f7-97b2-038169ce4784 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1551 microversion: 2.1 time: 0.370820 May 21 21:14:22.100125 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 540/1123] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:21 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1551 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:22.115122 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-83ae6f4c-1a86-455d-a85a-7ca9e9adaee2 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1515829338", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:22.215798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6c623ff4-58bc-4e44-9082-744acd46c404 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:22.231468 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6c623ff4-58bc-4e44-9082-744acd46c404 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255" status: 200 len: 1452 microversion: 2.1 time: 0.394085 May 21 21:14:22.232960 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 584/1124] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:21 2022] GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 => generated 1452 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:22.247625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9f654bb6-5654-4b16-8d32-37cc57bfe316 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:22.255484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9f654bb6-5654-4b16-8d32-37cc57bfe316 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:22.262839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f654bb6-5654-4b16-8d32-37cc57bfe316 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:22.263451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f654bb6-5654-4b16-8d32-37cc57bfe316 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:22.268145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f654bb6-5654-4b16-8d32-37cc57bfe316 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:22.268895 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f654bb6-5654-4b16-8d32-37cc57bfe316 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:22.275456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-83ae6f4c-1a86-455d-a85a-7ca9e9adaee2 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] validate_networks() for None {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:14:22.604273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=10 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:22.698966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-83ae6f4c-1a86-455d-a85a-7ca9e9adaee2 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:14:22.699393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-83ae6f4c-1a86-455d-a85a-7ca9e9adaee2 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:14:22.699989 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-83ae6f4c-1a86-455d-a85a-7ca9e9adaee2 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:14:22.700435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-83ae6f4c-1a86-455d-a85a-7ca9e9adaee2 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:14:22.700855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-83ae6f4c-1a86-455d-a85a-7ca9e9adaee2 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:14:22.711886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-83ae6f4c-1a86-455d-a85a-7ca9e9adaee2 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:22.712659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-83ae6f4c-1a86-455d-a85a-7ca9e9adaee2 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:22.713778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-83ae6f4c-1a86-455d-a85a-7ca9e9adaee2 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:22.714828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-83ae6f4c-1a86-455d-a85a-7ca9e9adaee2 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:22.746671 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-83ae6f4c-1a86-455d-a85a-7ca9e9adaee2 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Getting quotas for project 0e8dbd3049724928a8db6771b70ad38b. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:14:22.762747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-83ae6f4c-1a86-455d-a85a-7ca9e9adaee2 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Getting quotas for user 8b5d5f69b7c04811b9dc36daaa17079a and project 0e8dbd3049724928a8db6771b70ad38b. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:14:22.780656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-83ae6f4c-1a86-455d-a85a-7ca9e9adaee2 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:14:22.783547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-83ae6f4c-1a86-455d-a85a-7ca9e9adaee2 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:14:22.903057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9f654bb6-5654-4b16-8d32-37cc57bfe316 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:22.930512 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9f654bb6-5654-4b16-8d32-37cc57bfe316 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1378 microversion: 2.1 time: 0.694465 May 21 21:14:22.932699 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 585/1125] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:22 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1378 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:22.955642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-818378c9-5ce9-461f-b86b-72fa4b1cdd03 req-3c95b4f2-0251-41a4-931c-66dba6653a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b58aadd3-11a8-41dc-9104-b6082e4eeb06", "name": "network-vif-plugged", "status": "completed", "tag": "45d0dcd8-6e01-48f0-a3c7-19f72707d0d7"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:22.961683 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-83ae6f4c-1a86-455d-a85a-7ca9e9adaee2 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.859551 May 21 21:14:22.966002 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 541/1126] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:14:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:14:22.993037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7f32ea90-e0bb-4221-b080-e0c17e55c607 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:22.994473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7f32ea90-e0bb-4221-b080-e0c17e55c607 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:23.010684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-818378c9-5ce9-461f-b86b-72fa4b1cdd03 req-3c95b4f2-0251-41a4-931c-66dba6653a62 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:23.011187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-818378c9-5ce9-461f-b86b-72fa4b1cdd03 req-3c95b4f2-0251-41a4-931c-66dba6653a62 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:23.025326 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f32ea90-e0bb-4221-b080-e0c17e55c607 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:23.043943 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f32ea90-e0bb-4221-b080-e0c17e55c607 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:23.048454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f32ea90-e0bb-4221-b080-e0c17e55c607 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:23.051036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f32ea90-e0bb-4221-b080-e0c17e55c607 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:23.057370 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-818378c9-5ce9-461f-b86b-72fa4b1cdd03 req-3c95b4f2-0251-41a4-931c-66dba6653a62 service nova] Creating event network-vif-plugged:45d0dcd8-6e01-48f0-a3c7-19f72707d0d7 for instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 on nch1-master-1 May 21 21:14:23.070066 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-818378c9-5ce9-461f-b86b-72fa4b1cdd03 req-3c95b4f2-0251-41a4-931c-66dba6653a62 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135449 May 21 21:14:23.071528 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 586/1127] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:23.084909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6fbb6738-7fcd-44a4-a7c3-a10daded3056 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:23.087100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6fbb6738-7fcd-44a4-a7c3-a10daded3056 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:23.101966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6fbb6738-7fcd-44a4-a7c3-a10daded3056 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:23.106092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6fbb6738-7fcd-44a4-a7c3-a10daded3056 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:23.108104 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6fbb6738-7fcd-44a4-a7c3-a10daded3056 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:23.108746 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6fbb6738-7fcd-44a4-a7c3-a10daded3056 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:23.133220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7f32ea90-e0bb-4221-b080-e0c17e55c607 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:14:23.539572 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7f32ea90-e0bb-4221-b080-e0c17e55c607 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "DELETE /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255" status: 204 len: 0 microversion: 2.1 time: 0.558920 May 21 21:14:23.540086 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 542/1128] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:14:22 2022] DELETE /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:14:23.549077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ceb5551b-544d-4e1f-84fa-d03ac4bf2037 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:23.553735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ceb5551b-544d-4e1f-84fa-d03ac4bf2037 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:23.568361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ceb5551b-544d-4e1f-84fa-d03ac4bf2037 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:23.568828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ceb5551b-544d-4e1f-84fa-d03ac4bf2037 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:23.573289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ceb5551b-544d-4e1f-84fa-d03ac4bf2037 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:23.574568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ceb5551b-544d-4e1f-84fa-d03ac4bf2037 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:23.852779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6fbb6738-7fcd-44a4-a7c3-a10daded3056 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:23.857738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ceb5551b-544d-4e1f-84fa-d03ac4bf2037 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:23.866093 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ceb5551b-544d-4e1f-84fa-d03ac4bf2037 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1324 microversion: 2.1 time: 0.321464 May 21 21:14:23.870194 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 543/1129] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:23 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1324 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:23.874186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6fbb6738-7fcd-44a4-a7c3-a10daded3056 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:23.878642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6fbb6738-7fcd-44a4-a7c3-a10daded3056 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:23.882560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2ac8f833-8f4b-4d45-9cdd-4b6e82b81337 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:23.883186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2ac8f833-8f4b-4d45-9cdd-4b6e82b81337 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:23.883659 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6fbb6738-7fcd-44a4-a7c3-a10daded3056 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1645 microversion: 2.25 time: 0.809677 May 21 21:14:23.884368 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 587/1130] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:14:23 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1645 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:23.900198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-14b33702-48d2-4bf2-b5bf-3bfcdc9439cb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:23.901094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-14b33702-48d2-4bf2-b5bf-3bfcdc9439cb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:23.918106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14b33702-48d2-4bf2-b5bf-3bfcdc9439cb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:23.918695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14b33702-48d2-4bf2-b5bf-3bfcdc9439cb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:23.920988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14b33702-48d2-4bf2-b5bf-3bfcdc9439cb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:23.922698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14b33702-48d2-4bf2-b5bf-3bfcdc9439cb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:23.983144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2ac8f833-8f4b-4d45-9cdd-4b6e82b81337 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:23.990427 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2ac8f833-8f4b-4d45-9cdd-4b6e82b81337 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 1218 microversion: 2.1 time: 0.118639 May 21 21:14:23.991665 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 544/1131] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:23 2022] GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:24.004867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ce870d35-c165-4f7f-85af-715eb94305d9 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:24.005492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ce870d35-c165-4f7f-85af-715eb94305d9 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:24.015148 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce870d35-c165-4f7f-85af-715eb94305d9 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:24.015797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce870d35-c165-4f7f-85af-715eb94305d9 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:24.016750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce870d35-c165-4f7f-85af-715eb94305d9 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:24.017442 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce870d35-c165-4f7f-85af-715eb94305d9 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:24.065144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce870d35-c165-4f7f-85af-715eb94305d9 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:24.065731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce870d35-c165-4f7f-85af-715eb94305d9 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:24.066294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-ce870d35-c165-4f7f-85af-715eb94305d9 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lazy-loading 'fault' on Instance uuid 24ac7c08-f2ba-42ce-9b70-c28101bab255 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:14:24.220554 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-14b33702-48d2-4bf2-b5bf-3bfcdc9439cb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:24.229332 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-14b33702-48d2-4bf2-b5bf-3bfcdc9439cb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1551 microversion: 2.1 time: 0.343638 May 21 21:14:24.231089 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 588/1132] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:23 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1551 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:24.236523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0f24bb55-0eb0-4b4a-b700-c7e003a19677 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:24.237373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0f24bb55-0eb0-4b4a-b700-c7e003a19677 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:24.244674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f24bb55-0eb0-4b4a-b700-c7e003a19677 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:24.246650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f24bb55-0eb0-4b4a-b700-c7e003a19677 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:24.247002 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f24bb55-0eb0-4b4a-b700-c7e003a19677 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:24.247671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f24bb55-0eb0-4b4a-b700-c7e003a19677 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:24.336901 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ce870d35-c165-4f7f-85af-715eb94305d9 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:24.348755 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ce870d35-c165-4f7f-85af-715eb94305d9 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255" status: 200 len: 1458 microversion: 2.1 time: 0.355619 May 21 21:14:24.361349 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 545/1133] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:23 2022] GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 => generated 1458 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:24.712212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0f24bb55-0eb0-4b4a-b700-c7e003a19677 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:24.721127 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0f24bb55-0eb0-4b4a-b700-c7e003a19677 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1526 microversion: 2.1 time: 0.488798 May 21 21:14:24.725486 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 589/1134] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:24 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1526 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:24.746703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-292e1577-f9ba-40de-9f8e-b6b7d9214262 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:24.747323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-292e1577-f9ba-40de-9f8e-b6b7d9214262 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:24.758607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-292e1577-f9ba-40de-9f8e-b6b7d9214262 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:24.762266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-292e1577-f9ba-40de-9f8e-b6b7d9214262 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:24.762266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-292e1577-f9ba-40de-9f8e-b6b7d9214262 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:24.762782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-292e1577-f9ba-40de-9f8e-b6b7d9214262 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:24.889348 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1b895894-d499-4f59-8819-e70f1d533a87 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:24.891476 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1b895894-d499-4f59-8819-e70f1d533a87 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:24.918903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b895894-d499-4f59-8819-e70f1d533a87 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:24.920752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b895894-d499-4f59-8819-e70f1d533a87 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:24.922752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b895894-d499-4f59-8819-e70f1d533a87 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:24.924826 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b895894-d499-4f59-8819-e70f1d533a87 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:24.973758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:25.063705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-292e1577-f9ba-40de-9f8e-b6b7d9214262 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:25.077024 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-292e1577-f9ba-40de-9f8e-b6b7d9214262 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1526 microversion: 2.1 time: 0.331517 May 21 21:14:25.079324 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 546/1135] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:24 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1526 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:25.096163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5ba0a52a-a981-4afe-a78e-4fbcba1de0e0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:25.106913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5ba0a52a-a981-4afe-a78e-4fbcba1de0e0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:25.122977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ba0a52a-a981-4afe-a78e-4fbcba1de0e0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:25.123443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ba0a52a-a981-4afe-a78e-4fbcba1de0e0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:25.124734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ba0a52a-a981-4afe-a78e-4fbcba1de0e0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:25.125235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ba0a52a-a981-4afe-a78e-4fbcba1de0e0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:25.367384 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5ba0a52a-a981-4afe-a78e-4fbcba1de0e0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:25.388804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5ba0a52a-a981-4afe-a78e-4fbcba1de0e0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:25.390938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5ba0a52a-a981-4afe-a78e-4fbcba1de0e0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:25.395545 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5ba0a52a-a981-4afe-a78e-4fbcba1de0e0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1645 microversion: 2.25 time: 0.314669 May 21 21:14:25.396973 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 547/1136] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:14:25 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1645 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:25.409467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c45cea95-e354-41c6-b50e-ca0678ba76bf tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:25.415232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c45cea95-e354-41c6-b50e-ca0678ba76bf tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:25.426877 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c45cea95-e354-41c6-b50e-ca0678ba76bf tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:25.427716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c45cea95-e354-41c6-b50e-ca0678ba76bf tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:25.428753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c45cea95-e354-41c6-b50e-ca0678ba76bf tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:25.429411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c45cea95-e354-41c6-b50e-ca0678ba76bf tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:25.601631 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c45cea95-e354-41c6-b50e-ca0678ba76bf tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:25.614958 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c45cea95-e354-41c6-b50e-ca0678ba76bf tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 1270 microversion: 2.1 time: 0.216386 May 21 21:14:25.620660 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 548/1137] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:25 2022] GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 => generated 1270 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:25.639113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6eb4806a-7c12-4f89-a0ee-3419f5c99262 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:25.640080 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:25.640080 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:14:25.739026 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6eb4806a-7c12-4f89-a0ee-3419f5c99262 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/b9a3a7a4-330d-41f5-b501-7cbe6e4d1da7" status: 202 len: 0 microversion: 2.1 time: 0.117028 May 21 21:14:25.739910 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 549/1138] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:14:25 2022] DELETE /compute/v2.1/flavors/b9a3a7a4-330d-41f5-b501-7cbe6e4d1da7 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:14:25.748242 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-28aab3af-2a53-4d22-b813-013cca6badab tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:25.749327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-28aab3af-2a53-4d22-b813-013cca6badab tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:25.755596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-28aab3af-2a53-4d22-b813-013cca6badab tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:25.756201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-28aab3af-2a53-4d22-b813-013cca6badab tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:25.757087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-28aab3af-2a53-4d22-b813-013cca6badab tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:25.757631 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-28aab3af-2a53-4d22-b813-013cca6badab tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:25.867535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1b895894-d499-4f59-8819-e70f1d533a87 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:25.881496 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1b895894-d499-4f59-8819-e70f1d533a87 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1324 microversion: 2.1 time: 0.998487 May 21 21:14:25.882098 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 590/1139] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:24 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1324 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:14:25.918124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f301daaf-9ec3-4a9f-ba61-9294925b58b2 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:25.918900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f301daaf-9ec3-4a9f-ba61-9294925b58b2 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:25.934184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f301daaf-9ec3-4a9f-ba61-9294925b58b2 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:25.936943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f301daaf-9ec3-4a9f-ba61-9294925b58b2 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:25.938609 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f301daaf-9ec3-4a9f-ba61-9294925b58b2 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:25.939326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f301daaf-9ec3-4a9f-ba61-9294925b58b2 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:26.014482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f301daaf-9ec3-4a9f-ba61-9294925b58b2 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:26.015093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f301daaf-9ec3-4a9f-ba61-9294925b58b2 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:26.015666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-f301daaf-9ec3-4a9f-ba61-9294925b58b2 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lazy-loading 'fault' on Instance uuid 24ac7c08-f2ba-42ce-9b70-c28101bab255 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:14:26.082295 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-28aab3af-2a53-4d22-b813-013cca6badab tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:26.093120 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-28aab3af-2a53-4d22-b813-013cca6badab tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1551 microversion: 2.1 time: 0.349041 May 21 21:14:26.094086 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 550/1140] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:25 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1551 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:26.111763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c8fbbba9-cea6-4744-a43a-0391fc711a4e tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:26.149189 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c8fbbba9-cea6-4744-a43a-0391fc711a4e tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042153 May 21 21:14:26.160736 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 551/1141] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:14:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:26.167849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d42b7e7e-88c9-4be1-b08c-0d957756c58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:26.169027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d42b7e7e-88c9-4be1-b08c-0d957756c58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:26.175765 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d42b7e7e-88c9-4be1-b08c-0d957756c58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:26.176878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d42b7e7e-88c9-4be1-b08c-0d957756c58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:26.177665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d42b7e7e-88c9-4be1-b08c-0d957756c58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:26.178105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d42b7e7e-88c9-4be1-b08c-0d957756c58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:26.293473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:26.342207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d42b7e7e-88c9-4be1-b08c-0d957756c58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:26.351251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d42b7e7e-88c9-4be1-b08c-0d957756c58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Old instance type tempest-test_resize_flavor_-1584798516, new instance type m1.heat {{(pid=131277) resize /opt/stack/nova/nova/compute/api.py:4166}} May 21 21:14:26.371142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-d42b7e7e-88c9-4be1-b08c-0d957756c58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:14:26.371636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-d42b7e7e-88c9-4be1-b08c-0d957756c58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:14:26.372166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-d42b7e7e-88c9-4be1-b08c-0d957756c58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:14:26.372929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-d42b7e7e-88c9-4be1-b08c-0d957756c58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:14:26.374483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-d42b7e7e-88c9-4be1-b08c-0d957756c58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:14:26.829464 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d42b7e7e-88c9-4be1-b08c-0d957756c58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "POST /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889/action" status: 202 len: 0 microversion: 2.1 time: 0.667428 May 21 21:14:26.836386 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 552/1142] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:14:26 2022] POST /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889/action => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:14:26.847896 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4e95483d-a331-4f43-b028-d943fed7d1ac tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:26.848554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4e95483d-a331-4f43-b028-d943fed7d1ac tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:26.865397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e95483d-a331-4f43-b028-d943fed7d1ac tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:26.865911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e95483d-a331-4f43-b028-d943fed7d1ac tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:26.871113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e95483d-a331-4f43-b028-d943fed7d1ac tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:26.871628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e95483d-a331-4f43-b028-d943fed7d1ac tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:26.939883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f301daaf-9ec3-4a9f-ba61-9294925b58b2 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:26.950336 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f301daaf-9ec3-4a9f-ba61-9294925b58b2 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255" status: 200 len: 1458 microversion: 2.1 time: 1.045043 May 21 21:14:26.952149 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 591/1143] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:25 2022] GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 => generated 1458 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:26.958406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-66d1b38f-6980-46a0-85d4-a6193f298183 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:26.959387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-66d1b38f-6980-46a0-85d4-a6193f298183 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:26.970001 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66d1b38f-6980-46a0-85d4-a6193f298183 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:26.972687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66d1b38f-6980-46a0-85d4-a6193f298183 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:26.973757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66d1b38f-6980-46a0-85d4-a6193f298183 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:26.974461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66d1b38f-6980-46a0-85d4-a6193f298183 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:27.219103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4e95483d-a331-4f43-b028-d943fed7d1ac tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:27.230684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4e95483d-a331-4f43-b028-d943fed7d1ac tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:27.236954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4e95483d-a331-4f43-b028-d943fed7d1ac tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:27.236954 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4e95483d-a331-4f43-b028-d943fed7d1ac tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1645 microversion: 2.25 time: 0.392469 May 21 21:14:27.236954 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 553/1144] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:14:26 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1645 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:27.276333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ce5dba28-e946-4731-bd99-d77c6cdcd1f5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:27.276333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ce5dba28-e946-4731-bd99-d77c6cdcd1f5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:27.288610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce5dba28-e946-4731-bd99-d77c6cdcd1f5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:27.289326 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce5dba28-e946-4731-bd99-d77c6cdcd1f5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:27.299432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce5dba28-e946-4731-bd99-d77c6cdcd1f5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:27.299432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce5dba28-e946-4731-bd99-d77c6cdcd1f5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:27.454273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-66d1b38f-6980-46a0-85d4-a6193f298183 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:27.465024 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-66d1b38f-6980-46a0-85d4-a6193f298183 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 1278 microversion: 2.1 time: 0.511257 May 21 21:14:27.466173 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 592/1145] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:26 2022] GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 => generated 1278 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:27.473900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-db06ff90-83bf-4a95-b79d-1bfea2d472fc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:27.474919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-db06ff90-83bf-4a95-b79d-1bfea2d472fc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:27.483534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-db06ff90-83bf-4a95-b79d-1bfea2d472fc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:27.484737 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-db06ff90-83bf-4a95-b79d-1bfea2d472fc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:27.486362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-db06ff90-83bf-4a95-b79d-1bfea2d472fc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:27.487349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-db06ff90-83bf-4a95-b79d-1bfea2d472fc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:27.896181 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ce5dba28-e946-4731-bd99-d77c6cdcd1f5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:27.906261 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ce5dba28-e946-4731-bd99-d77c6cdcd1f5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1535 microversion: 2.1 time: 0.641705 May 21 21:14:27.906261 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 554/1146] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:27 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1535 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:27.919162 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aaa9a562-9022-4be0-8b47-58362890bbef tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:27.919786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aaa9a562-9022-4be0-8b47-58362890bbef tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:27.928581 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aaa9a562-9022-4be0-8b47-58362890bbef tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:27.929855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aaa9a562-9022-4be0-8b47-58362890bbef tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:27.931808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aaa9a562-9022-4be0-8b47-58362890bbef tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:27.932950 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aaa9a562-9022-4be0-8b47-58362890bbef tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:28.237957 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aaa9a562-9022-4be0-8b47-58362890bbef tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:28.250466 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aaa9a562-9022-4be0-8b47-58362890bbef tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1551 microversion: 2.1 time: 0.335754 May 21 21:14:28.256840 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 555/1147] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:27 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1551 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:28.264455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-20548de3-c3f8-46c2-8de9-121f1962bcfe tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:28.268184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-20548de3-c3f8-46c2-8de9-121f1962bcfe tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:28.278245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20548de3-c3f8-46c2-8de9-121f1962bcfe tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:28.278699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20548de3-c3f8-46c2-8de9-121f1962bcfe tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:28.279473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20548de3-c3f8-46c2-8de9-121f1962bcfe tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:28.282633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20548de3-c3f8-46c2-8de9-121f1962bcfe tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:28.345279 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20548de3-c3f8-46c2-8de9-121f1962bcfe tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:28.346702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20548de3-c3f8-46c2-8de9-121f1962bcfe tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:28.348435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-20548de3-c3f8-46c2-8de9-121f1962bcfe tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lazy-loading 'fault' on Instance uuid 24ac7c08-f2ba-42ce-9b70-c28101bab255 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:14:28.362247 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-db06ff90-83bf-4a95-b79d-1bfea2d472fc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:28.378282 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-db06ff90-83bf-4a95-b79d-1bfea2d472fc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1521 microversion: 2.1 time: 0.910191 May 21 21:14:28.392232 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 593/1148] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:27 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1521 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:28.392232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2b273825-37c1-4489-bd64-6519b34eef55 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:28.392232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2b273825-37c1-4489-bd64-6519b34eef55 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:28.414273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b273825-37c1-4489-bd64-6519b34eef55 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:28.414778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b273825-37c1-4489-bd64-6519b34eef55 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:28.415610 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b273825-37c1-4489-bd64-6519b34eef55 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:28.416062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b273825-37c1-4489-bd64-6519b34eef55 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:28.437985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-20548de3-c3f8-46c2-8de9-121f1962bcfe tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:28.437985 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-20548de3-c3f8-46c2-8de9-121f1962bcfe tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255" status: 200 len: 1416 microversion: 2.1 time: 0.181759 May 21 21:14:28.439383 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 556/1149] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:28 2022] GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 => generated 1416 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:28.446001 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f623e891-33aa-4a95-8e81-e3f21704a6a8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:28.451704 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f623e891-33aa-4a95-8e81-e3f21704a6a8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:28.466374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f623e891-33aa-4a95-8e81-e3f21704a6a8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:28.471307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f623e891-33aa-4a95-8e81-e3f21704a6a8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:28.472371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f623e891-33aa-4a95-8e81-e3f21704a6a8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:28.472951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f623e891-33aa-4a95-8e81-e3f21704a6a8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:28.808111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f623e891-33aa-4a95-8e81-e3f21704a6a8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:28.824205 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f623e891-33aa-4a95-8e81-e3f21704a6a8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1521 microversion: 2.1 time: 0.382272 May 21 21:14:28.835187 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 557/1150] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:28 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:28.835750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b1a29692-6863-403a-820f-c89f14918532 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:28.836512 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b1a29692-6863-403a-820f-c89f14918532 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:28.844738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1a29692-6863-403a-820f-c89f14918532 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:28.853439 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1a29692-6863-403a-820f-c89f14918532 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:28.856531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1a29692-6863-403a-820f-c89f14918532 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:28.857455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1a29692-6863-403a-820f-c89f14918532 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:28.989180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b1a29692-6863-403a-820f-c89f14918532 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:29.003710 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b1a29692-6863-403a-820f-c89f14918532 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 1276 microversion: 2.1 time: 0.171799 May 21 21:14:29.005112 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 558/1151] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:28 2022] GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 => generated 1276 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:29.014588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c78b0ce4-1bf5-4f58-b5c4-ac4d09b2491b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1512664781", "metadata": {"": ""}}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:29.019020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c78b0ce4-1bf5-4f58-b5c4-ac4d09b2491b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Request method failure captured: May 21 21:14:29.019020 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06/action HTTP/1.1 May 21 21:14:29.019020 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:29.019020 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:29.019020 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:29.019020 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 107 May 21 21:14:29.019020 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:29.019020 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:29.019020 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:29.019020 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:29.019020 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVYcSiyjAIR82oxkRB6GTuWAKVTX4xG5vMYtW_3BeBGCFxFQjKbNKPB4C0xhPGbN3kZTd0vkZOYFJP4MJ1kk_eZN0RsUqNmA1UP-b-s9HcyrYiVjgp1H1dIVPKi3UtrJ4Ob8-qkiVNLHvP2GMr_o_p2pBItaNXntU_KoEaP7ETd6R3M May 21 21:14:29.019020 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:29.019020 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:29.019020 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:29.019020 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:29.019020 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:29.019020 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:29.019020 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:14:29.019020 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:14:29.019020 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:14:29.019020 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:14:29.020680 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85f6ae1864ee43429c910eb27888608f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:29.020680 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:14:29.020680 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:14:29.020680 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:14:29.020680 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:14:29.020680 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:29.020680 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:29.020680 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 186310904c3943fdb63247b58725140e May 21 21:14:29.020680 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:14:29.020680 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:14:29.020680 ncdv-master-1 devstack@n-api.service[131277]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1512664781", "metadata": {"": ""}}} May 21 21:14:29.020680 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:14:29.021761 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:14:29.021761 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'b58aadd3-11a8-41dc-9104-b6082e4eeb06', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1512664781', 'metadata': {'': ''}}}} May 21 21:14:29.021761 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:29.021761 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:29.021761 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:14:29.021761 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:14:29.021761 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:14:29.021761 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise error May 21 21:14:29.021761 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:14:29.021761 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:29.021761 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: May 21 21:14:29.021761 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 21 21:14:29.021761 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 21 21:14:29.021761 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 21 21:14:29.021761 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 21 21:14:29.021761 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:29.021761 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 21 21:14:29.021761 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'': ''} May 21 21:14:29.021761 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:29.021761 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:29.021761 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:29.023379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:29.023379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:29.023379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:29.023379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:29.023379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:29.023379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:29.023379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:29.023379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:14:29.023379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:14:29.023379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:14:29.023379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:14:29.023379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:14:29.023379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:14:29.023379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:14:29.023379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:14:29.023379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:14:29.023379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:29.023379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:29.023379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:29.023379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:29.032542 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:29.032542 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:29.032542 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:14:29.032542 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:14:29.032542 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:14:29.032542 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:29.032542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c78b0ce4-1bf5-4f58-b5c4-ac4d09b2491b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:29.032542 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c78b0ce4-1bf5-4f58-b5c4-ac4d09b2491b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "POST /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06/action" status: 400 len: 170 microversion: 2.1 time: 0.016102 May 21 21:14:29.032542 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 559/1152] 10.222.0.49 () {60 vars in 1278 bytes} [Sat May 21 21:14:29 2022] POST /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06/action => generated 170 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:14:29.033762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-24414a00-7c05-48ae-b7a1-63e395882412 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:29.033762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-24414a00-7c05-48ae-b7a1-63e395882412 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:29.041763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24414a00-7c05-48ae-b7a1-63e395882412 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:29.042849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24414a00-7c05-48ae-b7a1-63e395882412 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:29.043750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24414a00-7c05-48ae-b7a1-63e395882412 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:29.044294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24414a00-7c05-48ae-b7a1-63e395882412 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:29.207100 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-24414a00-7c05-48ae-b7a1-63e395882412 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:29.217720 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-24414a00-7c05-48ae-b7a1-63e395882412 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1535 microversion: 2.1 time: 0.191398 May 21 21:14:29.227376 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 560/1153] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:29 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1535 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:29.383344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8e573738-439f-453d-a065-ecd6c5ade78e tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] Action: 'create', calling method: .version_select at 0x7fc81b2dfdc0>, body: {"pool": null} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:29.631682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2b273825-37c1-4489-bd64-6519b34eef55 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:29.653592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2b273825-37c1-4489-bd64-6519b34eef55 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:29.657957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2b273825-37c1-4489-bd64-6519b34eef55 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:29.660074 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2b273825-37c1-4489-bd64-6519b34eef55 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1645 microversion: 2.25 time: 1.277003 May 21 21:14:29.675952 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 594/1154] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:14:28 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1645 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:29.684850 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b6574515-7e65-4aee-9748-a45be97d647d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:29.685879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b6574515-7e65-4aee-9748-a45be97d647d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:29.705863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6574515-7e65-4aee-9748-a45be97d647d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:29.707156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6574515-7e65-4aee-9748-a45be97d647d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:29.708383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6574515-7e65-4aee-9748-a45be97d647d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:29.709123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6574515-7e65-4aee-9748-a45be97d647d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:30.090953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b6574515-7e65-4aee-9748-a45be97d647d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:30.107174 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b6574515-7e65-4aee-9748-a45be97d647d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1521 microversion: 2.1 time: 0.427138 May 21 21:14:30.119041 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 595/1155] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:29 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:30.124971 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-72a036ce-655e-4e82-a6ca-7c5b46732967 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:30.127708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-72a036ce-655e-4e82-a6ca-7c5b46732967 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:30.147391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72a036ce-655e-4e82-a6ca-7c5b46732967 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:30.152712 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72a036ce-655e-4e82-a6ca-7c5b46732967 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:30.153686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72a036ce-655e-4e82-a6ca-7c5b46732967 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:30.154242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72a036ce-655e-4e82-a6ca-7c5b46732967 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:30.539165 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-72a036ce-655e-4e82-a6ca-7c5b46732967 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:30.554659 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-72a036ce-655e-4e82-a6ca-7c5b46732967 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1551 microversion: 2.1 time: 0.445170 May 21 21:14:30.555895 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 596/1156] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:30 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1551 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:30.568343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-e87b2dd1-a74a-43ae-bb7a-2a862c675416 req-f613ed6c-c648-4178-b50b-48ed90780a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ac7c08-f2ba-42ce-9b70-c28101bab255", "name": "network-vif-deleted", "tag": "f683da31-65ac-4fd9-a216-c46e5543ec92"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:30.616062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e87b2dd1-a74a-43ae-bb7a-2a862c675416 req-f613ed6c-c648-4178-b50b-48ed90780a82 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:30.618920 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e87b2dd1-a74a-43ae-bb7a-2a862c675416 req-f613ed6c-c648-4178-b50b-48ed90780a82 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:30.653482 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-e87b2dd1-a74a-43ae-bb7a-2a862c675416 req-f613ed6c-c648-4178-b50b-48ed90780a82 service nova] Creating event network-vif-deleted:f683da31-65ac-4fd9-a216-c46e5543ec92 for instance 24ac7c08-f2ba-42ce-9b70-c28101bab255 on nch2-master-1 May 21 21:14:30.691291 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-e87b2dd1-a74a-43ae-bb7a-2a862c675416 req-f613ed6c-c648-4178-b50b-48ed90780a82 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118129 May 21 21:14:30.704347 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 597/1157] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:30.740902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-396c986e-cd91-4dd2-a27d-5d753620db75 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:30.755154 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-396c986e-cd91-4dd2-a27d-5d753620db75 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:30.779080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-396c986e-cd91-4dd2-a27d-5d753620db75 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:30.779843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-396c986e-cd91-4dd2-a27d-5d753620db75 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:30.780756 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-396c986e-cd91-4dd2-a27d-5d753620db75 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:30.781724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-396c986e-cd91-4dd2-a27d-5d753620db75 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:30.872728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-396c986e-cd91-4dd2-a27d-5d753620db75 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:30.874909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-396c986e-cd91-4dd2-a27d-5d753620db75 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:30.875512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-396c986e-cd91-4dd2-a27d-5d753620db75 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lazy-loading 'fault' on Instance uuid 24ac7c08-f2ba-42ce-9b70-c28101bab255 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:14:31.087933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=18 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:31.110512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-396c986e-cd91-4dd2-a27d-5d753620db75 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5007c2462df46d385ca2f883b061a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd80101aef664387bbad8effdf280090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:31.126167 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-396c986e-cd91-4dd2-a27d-5d753620db75 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255" status: 200 len: 1309 microversion: 2.1 time: 0.413398 May 21 21:14:31.128170 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 598/1158] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:30 2022] GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 => generated 1309 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:31.141435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-99a74c96-2e57-47f0-9308-692de98bb231 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:31.143886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-99a74c96-2e57-47f0-9308-692de98bb231 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:31.150638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:31.165115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99a74c96-2e57-47f0-9308-692de98bb231 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:31.165726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99a74c96-2e57-47f0-9308-692de98bb231 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:31.166587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99a74c96-2e57-47f0-9308-692de98bb231 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:31.170393 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99a74c96-2e57-47f0-9308-692de98bb231 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:31.447694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-99a74c96-2e57-47f0-9308-692de98bb231 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:31.457704 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-99a74c96-2e57-47f0-9308-692de98bb231 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 1276 microversion: 2.1 time: 0.327350 May 21 21:14:31.458297 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 599/1159] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:31 2022] GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 => generated 1276 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:31.463612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ad91addc-d911-4d33-9307-a1c2daac7ae1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:31.464795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ad91addc-d911-4d33-9307-a1c2daac7ae1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:31.490968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ad91addc-d911-4d33-9307-a1c2daac7ae1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:31.491444 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ad91addc-d911-4d33-9307-a1c2daac7ae1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:31.492241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ad91addc-d911-4d33-9307-a1c2daac7ae1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:31.492910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ad91addc-d911-4d33-9307-a1c2daac7ae1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:32.198549 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ad91addc-d911-4d33-9307-a1c2daac7ae1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:32.211619 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ad91addc-d911-4d33-9307-a1c2daac7ae1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1521 microversion: 2.1 time: 0.752066 May 21 21:14:32.212231 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 600/1160] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:31 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1521 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:32.229148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-235707ad-5f82-4658-a3bd-7eed1382c62e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:32.230299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-235707ad-5f82-4658-a3bd-7eed1382c62e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:32.247030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-235707ad-5f82-4658-a3bd-7eed1382c62e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:32.247791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-235707ad-5f82-4658-a3bd-7eed1382c62e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:32.248893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-235707ad-5f82-4658-a3bd-7eed1382c62e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:32.250706 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-235707ad-5f82-4658-a3bd-7eed1382c62e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:32.868228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-235707ad-5f82-4658-a3bd-7eed1382c62e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:32.882390 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-235707ad-5f82-4658-a3bd-7eed1382c62e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1535 microversion: 2.1 time: 0.668633 May 21 21:14:32.883017 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 601/1161] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:32 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1535 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:32.904067 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c6cd9a3f-ec39-4d12-b21d-c79a95182260 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:32.904067 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c6cd9a3f-ec39-4d12-b21d-c79a95182260 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:32.915094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c6cd9a3f-ec39-4d12-b21d-c79a95182260 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:32.916090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c6cd9a3f-ec39-4d12-b21d-c79a95182260 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:32.918000 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c6cd9a3f-ec39-4d12-b21d-c79a95182260 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:32.918689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c6cd9a3f-ec39-4d12-b21d-c79a95182260 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:33.149593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c6cd9a3f-ec39-4d12-b21d-c79a95182260 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:33.167430 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c6cd9a3f-ec39-4d12-b21d-c79a95182260 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:33.181276 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c6cd9a3f-ec39-4d12-b21d-c79a95182260 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:33.181276 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c6cd9a3f-ec39-4d12-b21d-c79a95182260 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1645 microversion: 2.25 time: 0.276688 May 21 21:14:33.187709 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 602/1162] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:14:32 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1645 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:33.193505 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-15e28672-0160-4e16-a1a0-606526da53b5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:33.194365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-15e28672-0160-4e16-a1a0-606526da53b5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:33.204881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:33.204881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-15e28672-0160-4e16-a1a0-606526da53b5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:33.204881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-15e28672-0160-4e16-a1a0-606526da53b5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:33.206478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-15e28672-0160-4e16-a1a0-606526da53b5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:33.207158 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-15e28672-0160-4e16-a1a0-606526da53b5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:33.258738 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8e573738-439f-453d-a065-ecd6c5ade78e tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.038929 May 21 21:14:33.261014 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 561/1163] 10.222.0.49 () {60 vars in 1169 bytes} [Sat May 21 21:14:29 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:33.266398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-94d157d1-1250-49bb-9151-50a0432eb1ff tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:33.267524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-94d157d1-1250-49bb-9151-50a0432eb1ff tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:33.276978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94d157d1-1250-49bb-9151-50a0432eb1ff tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:33.276978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94d157d1-1250-49bb-9151-50a0432eb1ff tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:33.278629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94d157d1-1250-49bb-9151-50a0432eb1ff tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:33.279244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94d157d1-1250-49bb-9151-50a0432eb1ff tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:33.304235 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-94d157d1-1250-49bb-9151-50a0432eb1ff tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] HTTP exception thrown: Instance 24ac7c08-f2ba-42ce-9b70-c28101bab255 could not be found. May 21 21:14:33.306218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-94d157d1-1250-49bb-9151-50a0432eb1ff tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Request method failure captured: May 21 21:14:33.306218 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 HTTP/1.1 May 21 21:14:33.306218 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:33.306218 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:33.306218 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:33.306218 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:14:33.306218 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:33.306218 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:33.306218 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:33.306218 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:33.306218 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVX4o0fD01EknQAf3EBdwsjuxRdxcuqX8J2LiAZgIjHmc2Mq9YR0YowRYLTvtjsSDrLXBPo2tf8lhoQ9OIkLAey6rzn--Xvvn-IDY--ohJX2vvnXk7FVt1hw8zRplSgj-O-SPbmtL3Q74iZzmd-Dy6SIvsyEgo79b6DCENtfFF-SdUQ May 21 21:14:33.306218 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:33.306218 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:33.306218 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:33.306218 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:33.306218 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:33.306218 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:33.306218 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: dd80101aef664387bbad8effdf280090 May 21 21:14:33.306218 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-DeleteServersAdminTestJSON-585429533 May 21 21:14:33.306218 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:14:33.306218 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:14:33.307924 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dd80101aef664387bbad8effdf280090"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd80101aef664387bbad8effdf280090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dd80101aef664387bbad8effdf280090", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd80101aef664387bbad8effdf280090"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:33.307924 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-DeleteServersAdminTestJSON-585429533 May 21 21:14:33.307924 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: dd80101aef664387bbad8effdf280090 May 21 21:14:33.307924 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-585429533 May 21 21:14:33.307924 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-DeleteServersAdminTestJSON-585429533-project May 21 21:14:33.307924 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:33.307924 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:33.307924 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a5007c2462df46d385ca2f883b061a54 May 21 21:14:33.307924 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-DeleteServersAdminTestJSON-585429533-project May 21 21:14:33.307924 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:14:33.307924 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 24ac7c08-f2ba-42ce-9b70-c28101bab255 could not be found. May 21 21:14:33.307924 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '24ac7c08-f2ba-42ce-9b70-c28101bab255'} May 21 21:14:33.322192 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:33.322192 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:33.322192 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:14:33.322192 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:14:33.322192 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:14:33.322192 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:14:33.322192 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:14:33.322192 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:14:33.322192 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:14:33.322192 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:14:33.322192 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24ac7c08-f2ba-42ce-9b70-c28101bab255 could not be found. May 21 21:14:33.322192 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:33.322192 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:33.322192 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:33.322192 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:33.322192 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:33.322192 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:33.322192 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:33.322192 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:33.322192 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:33.324370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:33.324370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:14:33.324370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:14:33.324370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:14:33.324370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:14:33.324370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:14:33.324370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:14:33.324370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24ac7c08-f2ba-42ce-9b70-c28101bab255 could not be found. May 21 21:14:33.324370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:33.324370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:33.324370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:33.324370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:33.324370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:33.324370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:33.324370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:33.324370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:33.324370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24ac7c08-f2ba-42ce-9b70-c28101bab255 could not be found. May 21 21:14:33.324370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:33.325777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-94d157d1-1250-49bb-9151-50a0432eb1ff tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Returning 404 to user: Instance 24ac7c08-f2ba-42ce-9b70-c28101bab255 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:33.325777 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-94d157d1-1250-49bb-9151-50a0432eb1ff tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255" status: 404 len: 111 microversion: 2.1 time: 0.047745 May 21 21:14:33.325777 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 562/1164] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:33 2022] GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:14:33.332208 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c8c44878-99bb-4375-9451-c08548147639 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1184241384", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:33.335608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c8c44878-99bb-4375-9451-c08548147639 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Request method failure captured: May 21 21:14:33.335608 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06/action HTTP/1.1 May 21 21:14:33.335608 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:33.335608 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:33.335608 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:33.335608 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 619 May 21 21:14:33.335608 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:33.335608 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:33.335608 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:33.335608 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:33.335608 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVYcSiyjAIR82oxkRB6GTuWAKVTX4xG5vMYtW_3BeBGCFxFQjKbNKPB4C0xhPGbN3kZTd0vkZOYFJP4MJ1kk_eZN0RsUqNmA1UP-b-s9HcyrYiVjgp1H1dIVPKi3UtrJ4Ob8-qkiVNLHvP2GMr_o_p2pBItaNXntU_KoEaP7ETd6R3M May 21 21:14:33.335608 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:33.335608 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:33.335608 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:33.335608 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:33.335608 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:33.335608 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:33.335608 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:14:33.335608 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:14:33.335608 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:14:33.335608 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:14:33.337154 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85f6ae1864ee43429c910eb27888608f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:33.337154 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:14:33.337154 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:14:33.337154 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:14:33.337154 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:14:33.337154 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:33.337154 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:33.337154 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 186310904c3943fdb63247b58725140e May 21 21:14:33.337154 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:14:33.337154 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:14:33.337797 ncdv-master-1 devstack@n-api.service[131277]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1184241384", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} May 21 21:14:33.337797 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:14:33.337797 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:14:33.338040 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'b58aadd3-11a8-41dc-9104-b6082e4eeb06', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1184241384', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} May 21 21:14:33.338040 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:33.338040 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:33.338040 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:14:33.338040 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:14:33.338040 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:14:33.338040 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise error May 21 21:14:33.338040 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:14:33.338040 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:33.338040 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: May 21 21:14:33.338040 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 21 21:14:33.339368 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 21 21:14:33.339368 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 21 21:14:33.339368 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 21 21:14:33.339368 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:33.339368 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 21 21:14:33.339368 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} May 21 21:14:33.339368 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:33.339368 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:33.339368 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:33.339368 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:33.339368 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:33.339368 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:33.339368 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:33.339368 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:33.339368 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:33.339368 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:33.339368 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:14:33.340501 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:14:33.340501 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:14:33.340501 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:14:33.340501 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:14:33.340501 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:14:33.340501 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:14:33.340501 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:14:33.340501 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:14:33.340501 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:33.340501 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:33.340501 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:33.340501 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:33.341279 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:33.341279 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:33.341279 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:14:33.341279 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:14:33.341279 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:14:33.341279 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:33.343114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c8c44878-99bb-4375-9451-c08548147639 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:33.344232 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c8c44878-99bb-4375-9451-c08548147639 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "POST /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06/action" status: 400 len: 938 microversion: 2.1 time: 0.016348 May 21 21:14:33.345356 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 563/1165] 10.222.0.49 () {60 vars in 1278 bytes} [Sat May 21 21:14:33 2022] POST /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06/action => generated 938 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:14:33.350524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-42d01fb0-f133-447a-882b-cf0373adf077 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:33.351396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-42d01fb0-f133-447a-882b-cf0373adf077 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:33.359760 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42d01fb0-f133-447a-882b-cf0373adf077 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:33.360532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42d01fb0-f133-447a-882b-cf0373adf077 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:33.361498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42d01fb0-f133-447a-882b-cf0373adf077 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:33.362174 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42d01fb0-f133-447a-882b-cf0373adf077 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:33.619373 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:33.741763 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-15e28672-0160-4e16-a1a0-606526da53b5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:33.754224 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-15e28672-0160-4e16-a1a0-606526da53b5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1541 microversion: 2.1 time: 0.564363 May 21 21:14:33.759017 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 603/1166] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:33 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1541 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:33.765079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-3b2865fb-5f8b-4dc9-ae4b-8247fa244c9f req-60346a07-c184-4f3e-bf1f-e0f0fe81c99d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13739e66-c933-4b7b-b4a9-365b8b4c65cb", "name": "network-vif-unplugged", "status": "completed", "tag": "c87e240a-00db-4d2f-b98a-859d7a88abad"}, {"name": "network-changed", "server_uuid": "13739e66-c933-4b7b-b4a9-365b8b4c65cb", "tag": "c87e240a-00db-4d2f-b98a-859d7a88abad"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:33.774597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3b2865fb-5f8b-4dc9-ae4b-8247fa244c9f req-60346a07-c184-4f3e-bf1f-e0f0fe81c99d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:33.775327 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3b2865fb-5f8b-4dc9-ae4b-8247fa244c9f req-60346a07-c184-4f3e-bf1f-e0f0fe81c99d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:33.788340 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-3b2865fb-5f8b-4dc9-ae4b-8247fa244c9f req-60346a07-c184-4f3e-bf1f-e0f0fe81c99d service nova] Creating event network-vif-unplugged:c87e240a-00db-4d2f-b98a-859d7a88abad for instance 13739e66-c933-4b7b-b4a9-365b8b4c65cb on nch1-master-1 May 21 21:14:33.789707 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-3b2865fb-5f8b-4dc9-ae4b-8247fa244c9f req-60346a07-c184-4f3e-bf1f-e0f0fe81c99d service nova] Creating event network-changed:c87e240a-00db-4d2f-b98a-859d7a88abad for instance 13739e66-c933-4b7b-b4a9-365b8b4c65cb on nch1-master-1 May 21 21:14:33.795733 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-3b2865fb-5f8b-4dc9-ae4b-8247fa244c9f req-60346a07-c184-4f3e-bf1f-e0f0fe81c99d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.035147 May 21 21:14:33.796916 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 604/1167] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:33.802881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-888aba57-4827-46d5-afb2-68ca15703702 tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] Calling method '.version_select at 0x7fc81b575040>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:33.988342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=8 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:34.168452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-42d01fb0-f133-447a-882b-cf0373adf077 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:34.204193 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-42d01fb0-f133-447a-882b-cf0373adf077 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 1318 microversion: 2.1 time: 0.856960 May 21 21:14:34.206044 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 564/1168] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:33 2022] GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 => generated 1318 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:34.213056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-da298bf1-ea76-4bea-8b1f-78f9a330a6e6 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:34.214759 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-da298bf1-ea76-4bea-8b1f-78f9a330a6e6 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:34.235840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da298bf1-ea76-4bea-8b1f-78f9a330a6e6 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:34.236496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da298bf1-ea76-4bea-8b1f-78f9a330a6e6 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:34.237642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da298bf1-ea76-4bea-8b1f-78f9a330a6e6 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:34.239302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da298bf1-ea76-4bea-8b1f-78f9a330a6e6 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:34.257230 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-da298bf1-ea76-4bea-8b1f-78f9a330a6e6 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] HTTP exception thrown: Instance 24ac7c08-f2ba-42ce-9b70-c28101bab255 could not be found. May 21 21:14:34.259140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-da298bf1-ea76-4bea-8b1f-78f9a330a6e6 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Request method failure captured: May 21 21:14:34.259140 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 HTTP/1.1 May 21 21:14:34.259140 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:34.259140 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:34.259140 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:34.259140 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:14:34.259140 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:34.259140 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:34.259140 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:34.259140 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:34.259140 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVX4o0fD01EknQAf3EBdwsjuxRdxcuqX8J2LiAZgIjHmc2Mq9YR0YowRYLTvtjsSDrLXBPo2tf8lhoQ9OIkLAey6rzn--Xvvn-IDY--ohJX2vvnXk7FVt1hw8zRplSgj-O-SPbmtL3Q74iZzmd-Dy6SIvsyEgo79b6DCENtfFF-SdUQ May 21 21:14:34.259140 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:34.259140 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:34.259140 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:34.259140 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:34.259140 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:34.259140 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:34.259140 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: dd80101aef664387bbad8effdf280090 May 21 21:14:34.259140 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-DeleteServersAdminTestJSON-585429533 May 21 21:14:34.259140 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:14:34.259140 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:14:34.261927 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dd80101aef664387bbad8effdf280090"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd80101aef664387bbad8effdf280090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dd80101aef664387bbad8effdf280090", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd80101aef664387bbad8effdf280090"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:34.261927 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-DeleteServersAdminTestJSON-585429533 May 21 21:14:34.261927 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: dd80101aef664387bbad8effdf280090 May 21 21:14:34.261927 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-585429533 May 21 21:14:34.261927 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-DeleteServersAdminTestJSON-585429533-project May 21 21:14:34.261927 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:34.261927 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:34.261927 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a5007c2462df46d385ca2f883b061a54 May 21 21:14:34.261927 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-DeleteServersAdminTestJSON-585429533-project May 21 21:14:34.261927 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:14:34.261927 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 24ac7c08-f2ba-42ce-9b70-c28101bab255 could not be found. May 21 21:14:34.261927 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '24ac7c08-f2ba-42ce-9b70-c28101bab255'} May 21 21:14:34.262794 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:34.262794 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:34.262794 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:14:34.262794 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:14:34.262794 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:14:34.262794 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:14:34.262794 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:14:34.262794 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:14:34.262794 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:14:34.262794 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:14:34.262794 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24ac7c08-f2ba-42ce-9b70-c28101bab255 could not be found. May 21 21:14:34.262794 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:34.262794 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:34.262794 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:34.262794 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:34.262794 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:34.262794 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:34.262794 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:34.262794 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:34.262794 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:34.264298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:34.264298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:14:34.264298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:14:34.264298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:14:34.264298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:14:34.264298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:14:34.264298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:14:34.264298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:14:34.264298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:14:34.264298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24ac7c08-f2ba-42ce-9b70-c28101bab255 could not be found. May 21 21:14:34.264298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:34.264298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:34.264298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:34.264298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:34.264298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:34.264298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:34.264298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:34.264298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:34.264298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24ac7c08-f2ba-42ce-9b70-c28101bab255 could not be found. May 21 21:14:34.264298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:34.265801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-da298bf1-ea76-4bea-8b1f-78f9a330a6e6 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Returning 404 to user: Instance 24ac7c08-f2ba-42ce-9b70-c28101bab255 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:34.266494 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-da298bf1-ea76-4bea-8b1f-78f9a330a6e6 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "DELETE /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255" status: 404 len: 111 microversion: 2.1 time: 0.058066 May 21 21:14:34.267501 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 565/1169] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:14:34 2022] DELETE /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:14:34.273608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1e3f758e-69e5-477d-aa7a-0fa4e68fdddf tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:34.274516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1e3f758e-69e5-477d-aa7a-0fa4e68fdddf tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:34.283049 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1e3f758e-69e5-477d-aa7a-0fa4e68fdddf tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:34.283906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1e3f758e-69e5-477d-aa7a-0fa4e68fdddf tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:34.284852 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1e3f758e-69e5-477d-aa7a-0fa4e68fdddf tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:34.285534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1e3f758e-69e5-477d-aa7a-0fa4e68fdddf tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:34.650635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1e3f758e-69e5-477d-aa7a-0fa4e68fdddf tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:34.695904 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-888aba57-4827-46d5-afb2-68ca15703702 tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips/40b3177b-2c2b-4c1c-aa4e-331d4b006f0b" status: 200 len: 141 microversion: 2.1 time: 0.897634 May 21 21:14:34.696594 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 605/1170] 10.222.0.49 () {58 vars in 1259 bytes} [Sat May 21 21:14:33 2022] GET /compute/v2.1/os-floating-ips/40b3177b-2c2b-4c1c-aa4e-331d4b006f0b => generated 141 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:34.701740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-148415ce-7ac9-430d-a3ed-eb70c09ca685 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '.version_select at 0x7fc81b493670>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:34.704472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-148415ce-7ac9-430d-a3ed-eb70c09ca685 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:34.707245 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1e3f758e-69e5-477d-aa7a-0fa4e68fdddf tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1521 microversion: 2.1 time: 0.432452 May 21 21:14:34.707916 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 566/1171] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:34 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1521 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:34.708270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-148415ce-7ac9-430d-a3ed-eb70c09ca685 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:34.717356 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5ed1c4a0-5cd4-42f0-94c2-778de771911a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:34.721050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5ed1c4a0-5cd4-42f0-94c2-778de771911a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:34.728588 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-148415ce-7ac9-430d-a3ed-eb70c09ca685 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 3497 microversion: 2.1 time: 0.030855 May 21 21:14:34.738223 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 606/1172] 10.222.0.49 () {58 vars in 1142 bytes} [Sat May 21 21:14:34 2022] GET /compute/v2.1/os-migrations => generated 3497 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:34.743369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e0b322d7-db6d-4209-8894-5e08bf6b9a7d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:34.744322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e0b322d7-db6d-4209-8894-5e08bf6b9a7d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:34.749503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ed1c4a0-5cd4-42f0-94c2-778de771911a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:34.749503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ed1c4a0-5cd4-42f0-94c2-778de771911a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:34.751786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0b322d7-db6d-4209-8894-5e08bf6b9a7d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:34.752357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ed1c4a0-5cd4-42f0-94c2-778de771911a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:34.752634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0b322d7-db6d-4209-8894-5e08bf6b9a7d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:34.753590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0b322d7-db6d-4209-8894-5e08bf6b9a7d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:34.753779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ed1c4a0-5cd4-42f0-94c2-778de771911a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:34.754356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0b322d7-db6d-4209-8894-5e08bf6b9a7d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:34.958400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5ed1c4a0-5cd4-42f0-94c2-778de771911a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:34.967423 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5ed1c4a0-5cd4-42f0-94c2-778de771911a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1535 microversion: 2.1 time: 0.256599 May 21 21:14:34.968005 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 567/1173] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:34 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1535 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:34.973979 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4835095e-e4f3-45d7-842c-f799be5a9ddb tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:34.974784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4835095e-e4f3-45d7-842c-f799be5a9ddb tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 24ac7c08-f2ba-42ce-9b70-c28101bab255] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:34.986761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4835095e-e4f3-45d7-842c-f799be5a9ddb tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:34.987217 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4835095e-e4f3-45d7-842c-f799be5a9ddb tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:34.993314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4835095e-e4f3-45d7-842c-f799be5a9ddb tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:34.993314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4835095e-e4f3-45d7-842c-f799be5a9ddb tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:35.005137 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-4835095e-e4f3-45d7-842c-f799be5a9ddb tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] HTTP exception thrown: Instance 24ac7c08-f2ba-42ce-9b70-c28101bab255 could not be found. May 21 21:14:35.006832 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4835095e-e4f3-45d7-842c-f799be5a9ddb tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Request method failure captured: May 21 21:14:35.006832 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 HTTP/1.1 May 21 21:14:35.006832 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:35.006832 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:35.006832 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:35.006832 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:14:35.006832 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:35.006832 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:35.006832 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:35.006832 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:35.006832 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVX4o0fD01EknQAf3EBdwsjuxRdxcuqX8J2LiAZgIjHmc2Mq9YR0YowRYLTvtjsSDrLXBPo2tf8lhoQ9OIkLAey6rzn--Xvvn-IDY--ohJX2vvnXk7FVt1hw8zRplSgj-O-SPbmtL3Q74iZzmd-Dy6SIvsyEgo79b6DCENtfFF-SdUQ May 21 21:14:35.006832 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:35.006832 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:35.006832 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:35.006832 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:35.006832 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:35.006832 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:35.006832 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: dd80101aef664387bbad8effdf280090 May 21 21:14:35.006832 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-DeleteServersAdminTestJSON-585429533 May 21 21:14:35.006832 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:14:35.006832 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:14:35.008195 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dd80101aef664387bbad8effdf280090"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd80101aef664387bbad8effdf280090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dd80101aef664387bbad8effdf280090", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd80101aef664387bbad8effdf280090"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:35.008195 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-DeleteServersAdminTestJSON-585429533 May 21 21:14:35.008195 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: dd80101aef664387bbad8effdf280090 May 21 21:14:35.008195 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-585429533 May 21 21:14:35.008195 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-DeleteServersAdminTestJSON-585429533-project May 21 21:14:35.008195 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:35.008195 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:35.008195 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a5007c2462df46d385ca2f883b061a54 May 21 21:14:35.008195 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-DeleteServersAdminTestJSON-585429533-project May 21 21:14:35.008195 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:14:35.008195 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 24ac7c08-f2ba-42ce-9b70-c28101bab255 could not be found. May 21 21:14:35.008195 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '24ac7c08-f2ba-42ce-9b70-c28101bab255'} May 21 21:14:35.008967 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:35.008967 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:35.008967 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:14:35.008967 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:14:35.008967 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:14:35.008967 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:14:35.008967 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:14:35.008967 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:14:35.008967 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:14:35.008967 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:14:35.008967 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24ac7c08-f2ba-42ce-9b70-c28101bab255 could not be found. May 21 21:14:35.008967 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:35.008967 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:35.008967 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:35.008967 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:35.008967 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:35.008967 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:35.008967 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:35.008967 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:35.008967 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:35.010973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:35.010973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:14:35.010973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:14:35.010973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:14:35.010973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:14:35.010973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:14:35.010973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:14:35.010973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24ac7c08-f2ba-42ce-9b70-c28101bab255 could not be found. May 21 21:14:35.010973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:35.010973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:35.010973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:35.010973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:35.010973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:35.010973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:35.010973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:35.010973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:35.010973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24ac7c08-f2ba-42ce-9b70-c28101bab255 could not be found. May 21 21:14:35.010973 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:35.012548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4835095e-e4f3-45d7-842c-f799be5a9ddb tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Returning 404 to user: Instance 24ac7c08-f2ba-42ce-9b70-c28101bab255 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:35.012548 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4835095e-e4f3-45d7-842c-f799be5a9ddb tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255" status: 404 len: 111 microversion: 2.1 time: 0.039124 May 21 21:14:35.012548 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 568/1174] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:34 2022] GET /compute/v2.1/servers/24ac7c08-f2ba-42ce-9b70-c28101bab255 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:14:35.016435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0cccef6b-1cb7-4fcb-bf53-e65af5c59a84 tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] Calling method '.version_select at 0x7fc81b2f3ee0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:35.328933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e0b322d7-db6d-4209-8894-5e08bf6b9a7d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:35.345420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e0b322d7-db6d-4209-8894-5e08bf6b9a7d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:35.347502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e0b322d7-db6d-4209-8894-5e08bf6b9a7d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:35.349739 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e0b322d7-db6d-4209-8894-5e08bf6b9a7d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1645 microversion: 2.25 time: 0.609705 May 21 21:14:35.351701 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 607/1175] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:14:34 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1645 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:35.358697 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5dbca298-a405-4d6a-b5f0-cf003d16745d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:35.359662 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5dbca298-a405-4d6a-b5f0-cf003d16745d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:35.373623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5dbca298-a405-4d6a-b5f0-cf003d16745d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:35.374733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5dbca298-a405-4d6a-b5f0-cf003d16745d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:35.375890 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5dbca298-a405-4d6a-b5f0-cf003d16745d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:35.376664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5dbca298-a405-4d6a-b5f0-cf003d16745d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:35.434140 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0cccef6b-1cb7-4fcb-bf53-e65af5c59a84 tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.423548 May 21 21:14:35.436811 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 569/1176] 10.222.0.49 () {58 vars in 1148 bytes} [Sat May 21 21:14:35 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:35.446433 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bc5bf299-b123-4fec-a436-1b8cc4ddcee8 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:35.450377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bc5bf299-b123-4fec-a436-1b8cc4ddcee8 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:35.461646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bc5bf299-b123-4fec-a436-1b8cc4ddcee8 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:35.462770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bc5bf299-b123-4fec-a436-1b8cc4ddcee8 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:35.464256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bc5bf299-b123-4fec-a436-1b8cc4ddcee8 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:35.464949 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bc5bf299-b123-4fec-a436-1b8cc4ddcee8 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:35.730250 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bc5bf299-b123-4fec-a436-1b8cc4ddcee8 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1692 microversion: 2.1 time: 0.290880 May 21 21:14:35.731663 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 570/1177] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:35 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1692 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:35.741776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ec39143c-0638-42ef-ab4d-50ce5f48d5a2 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:35.743109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ec39143c-0638-42ef-ab4d-50ce5f48d5a2 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:35.753474 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ec39143c-0638-42ef-ab4d-50ce5f48d5a2 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:35.753647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5dbca298-a405-4d6a-b5f0-cf003d16745d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:35.755144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ec39143c-0638-42ef-ab4d-50ce5f48d5a2 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:35.756988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ec39143c-0638-42ef-ab4d-50ce5f48d5a2 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:35.757726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ec39143c-0638-42ef-ab4d-50ce5f48d5a2 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:35.772397 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5dbca298-a405-4d6a-b5f0-cf003d16745d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1521 microversion: 2.1 time: 0.418640 May 21 21:14:35.774568 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 608/1178] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:35 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1521 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:35.781426 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-ec39143c-0638-42ef-ab4d-50ce5f48d5a2 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] HTTP exception thrown: Instance 0d7caaad-109e-4e52-9ecb-180ab87d1219 could not be found. May 21 21:14:35.788695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-61d8829b-0cca-410f-84e9-88bb7045eec1 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:35.788695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-61d8829b-0cca-410f-84e9-88bb7045eec1 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:35.789104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ec39143c-0638-42ef-ab4d-50ce5f48d5a2 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Request method failure captured: May 21 21:14:35.789104 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 HTTP/1.1 May 21 21:14:35.789104 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:35.789104 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:35.789104 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:35.789104 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:14:35.789104 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:35.789104 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:35.789104 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:35.789104 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:35.789104 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVX4o0fD01EknQAf3EBdwsjuxRdxcuqX8J2LiAZgIjHmc2Mq9YR0YowRYLTvtjsSDrLXBPo2tf8lhoQ9OIkLAey6rzn--Xvvn-IDY--ohJX2vvnXk7FVt1hw8zRplSgj-O-SPbmtL3Q74iZzmd-Dy6SIvsyEgo79b6DCENtfFF-SdUQ May 21 21:14:35.789104 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:35.789104 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:35.789104 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:35.789104 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:35.789104 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:35.789104 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:35.789104 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: dd80101aef664387bbad8effdf280090 May 21 21:14:35.789104 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-DeleteServersAdminTestJSON-585429533 May 21 21:14:35.789104 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:14:35.789104 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:14:35.791709 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dd80101aef664387bbad8effdf280090"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd80101aef664387bbad8effdf280090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dd80101aef664387bbad8effdf280090", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd80101aef664387bbad8effdf280090"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:35.791709 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-DeleteServersAdminTestJSON-585429533 May 21 21:14:35.791709 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: dd80101aef664387bbad8effdf280090 May 21 21:14:35.791709 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-585429533 May 21 21:14:35.791709 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-DeleteServersAdminTestJSON-585429533-project May 21 21:14:35.791709 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:35.791709 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:35.791709 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a5007c2462df46d385ca2f883b061a54 May 21 21:14:35.791709 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-DeleteServersAdminTestJSON-585429533-project May 21 21:14:35.791709 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:14:35.791709 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 0d7caaad-109e-4e52-9ecb-180ab87d1219 could not be found. May 21 21:14:35.791709 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '0d7caaad-109e-4e52-9ecb-180ab87d1219'} May 21 21:14:35.795693 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:35.795693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:35.795693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:14:35.795693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:14:35.795693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:14:35.795693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:14:35.795693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:14:35.795693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:14:35.795693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:14:35.795693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:14:35.795693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d7caaad-109e-4e52-9ecb-180ab87d1219 could not be found. May 21 21:14:35.795693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:35.795693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:35.795693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:35.795693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:35.795693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:35.795693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:35.795693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:35.795693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:35.795693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:35.798412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:35.798412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:14:35.798412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:14:35.798412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:14:35.798412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:14:35.798412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:14:35.798412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:14:35.798412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:14:35.798412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:14:35.798412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d7caaad-109e-4e52-9ecb-180ab87d1219 could not be found. May 21 21:14:35.798412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:35.798412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:35.798412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:35.798412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:35.798412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:35.798412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:35.798412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:35.798412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:35.798412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d7caaad-109e-4e52-9ecb-180ab87d1219 could not be found. May 21 21:14:35.798412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:35.802256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ec39143c-0638-42ef-ab4d-50ce5f48d5a2 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Returning 404 to user: Instance 0d7caaad-109e-4e52-9ecb-180ab87d1219 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:35.802256 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ec39143c-0638-42ef-ab4d-50ce5f48d5a2 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219" status: 404 len: 111 microversion: 2.1 time: 0.053299 May 21 21:14:35.802256 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 571/1179] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:14:35 2022] DELETE /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:14:35.804814 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61d8829b-0cca-410f-84e9-88bb7045eec1 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:35.804814 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61d8829b-0cca-410f-84e9-88bb7045eec1 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:35.804814 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61d8829b-0cca-410f-84e9-88bb7045eec1 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:35.804814 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61d8829b-0cca-410f-84e9-88bb7045eec1 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:35.814495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-249eaab9-3a47-430e-b5d1-7f216d1f7bdf tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] Calling method '.version_select at 0x7fc81b501040>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:35.823725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:36.326157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-61d8829b-0cca-410f-84e9-88bb7045eec1 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:36.355408 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-61d8829b-0cca-410f-84e9-88bb7045eec1 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 1318 microversion: 2.1 time: 0.569413 May 21 21:14:36.372016 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 609/1180] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:35 2022] GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 => generated 1318 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:36.384528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4670eddf-3c5f-476b-9ca4-c4192e8f3e93 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:36.390676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4670eddf-3c5f-476b-9ca4-c4192e8f3e93 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:36.404117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4670eddf-3c5f-476b-9ca4-c4192e8f3e93 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:36.408949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4670eddf-3c5f-476b-9ca4-c4192e8f3e93 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:36.410041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4670eddf-3c5f-476b-9ca4-c4192e8f3e93 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:36.411564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4670eddf-3c5f-476b-9ca4-c4192e8f3e93 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:36.763866 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4670eddf-3c5f-476b-9ca4-c4192e8f3e93 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1692 microversion: 2.1 time: 0.387563 May 21 21:14:36.769077 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 610/1181] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:36 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1692 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:36.773605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4a41fa9d-7b81-487a-b123-e8006f369e22 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:36.777935 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4a41fa9d-7b81-487a-b123-e8006f369e22 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Request method failure captured: May 21 21:14:36.777935 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06/action HTTP/1.1 May 21 21:14:36.777935 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:14:36.777935 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:14:36.777935 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:14:36.777935 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 285 May 21 21:14:36.777935 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:14:36.777935 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:14:36.777935 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:14:36.777935 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:14:36.777935 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVYcSiyjAIR82oxkRB6GTuWAKVTX4xG5vMYtW_3BeBGCFxFQjKbNKPB4C0xhPGbN3kZTd0vkZOYFJP4MJ1kk_eZN0RsUqNmA1UP-b-s9HcyrYiVjgp1H1dIVPKi3UtrJ4Ob8-qkiVNLHvP2GMr_o_p2pBItaNXntU_KoEaP7ETd6R3M May 21 21:14:36.777935 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:14:36.777935 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:14:36.777935 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:14:36.777935 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:14:36.777935 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:14:36.777935 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:14:36.777935 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:14:36.777935 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:14:36.777935 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:14:36.777935 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:14:36.779353 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85f6ae1864ee43429c910eb27888608f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:36.779353 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:14:36.779353 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:14:36.779353 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:14:36.779353 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:14:36.779353 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:14:36.779353 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:14:36.779353 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 186310904c3943fdb63247b58725140e May 21 21:14:36.779353 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:14:36.779353 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:14:36.779353 ncdv-master-1 devstack@n-api.service[131278]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 21 21:14:36.780058 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:14:36.780058 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 21 21:14:36.780058 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'b58aadd3-11a8-41dc-9104-b6082e4eeb06', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 21 21:14:36.780058 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:36.780058 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:36.780058 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:14:36.780058 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:14:36.780058 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:14:36.780058 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise error May 21 21:14:36.780058 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 21 21:14:36.780813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:36.780813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: May 21 21:14:36.780813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 21 21:14:36.780813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:36.780813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 21 21:14:36.780813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 21 21:14:36.780813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:36.780813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:36.780813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:36.780813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:36.780813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:36.780813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:36.780813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:36.780813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:36.780813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:36.780813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:36.780813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:14:36.780813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:14:36.780813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:14:36.780813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:14:36.782316 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:14:36.782316 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:14:36.782316 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:14:36.782316 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:14:36.782316 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 21 21:14:36.782316 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:36.782316 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:36.782316 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:36.782316 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:36.782316 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:36.782316 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:36.782316 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:14:36.782316 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:14:36.783625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 21 21:14:36.783625 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:36.784650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4a41fa9d-7b81-487a-b123-e8006f369e22 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:36.790020 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4a41fa9d-7b81-487a-b123-e8006f369e22 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "POST /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06/action" status: 400 len: 619 microversion: 2.1 time: 0.016044 May 21 21:14:36.790020 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 611/1182] 10.222.0.49 () {60 vars in 1278 bytes} [Sat May 21 21:14:36 2022] POST /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06/action => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:14:36.794375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e5af470b-050c-47bf-a54c-41cf91768919 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:36.795009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e5af470b-050c-47bf-a54c-41cf91768919 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] [instance: 0d7caaad-109e-4e52-9ecb-180ab87d1219] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:36.802497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e5af470b-050c-47bf-a54c-41cf91768919 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:36.803274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e5af470b-050c-47bf-a54c-41cf91768919 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:36.804360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e5af470b-050c-47bf-a54c-41cf91768919 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:36.805048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e5af470b-050c-47bf-a54c-41cf91768919 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:36.829318 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-e5af470b-050c-47bf-a54c-41cf91768919 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] HTTP exception thrown: Instance 0d7caaad-109e-4e52-9ecb-180ab87d1219 could not be found. May 21 21:14:36.831081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e5af470b-050c-47bf-a54c-41cf91768919 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Request method failure captured: May 21 21:14:36.831081 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 HTTP/1.1 May 21 21:14:36.831081 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:14:36.831081 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:14:36.831081 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:14:36.831081 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:14:36.831081 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:14:36.831081 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:14:36.831081 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:14:36.831081 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:14:36.831081 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVX4o0fD01EknQAf3EBdwsjuxRdxcuqX8J2LiAZgIjHmc2Mq9YR0YowRYLTvtjsSDrLXBPo2tf8lhoQ9OIkLAey6rzn--Xvvn-IDY--ohJX2vvnXk7FVt1hw8zRplSgj-O-SPbmtL3Q74iZzmd-Dy6SIvsyEgo79b6DCENtfFF-SdUQ May 21 21:14:36.831081 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:14:36.831081 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:14:36.831081 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:14:36.831081 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:14:36.831081 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:14:36.831081 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:14:36.831081 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: dd80101aef664387bbad8effdf280090 May 21 21:14:36.831081 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-DeleteServersAdminTestJSON-585429533 May 21 21:14:36.831081 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:14:36.831081 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:14:36.832719 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dd80101aef664387bbad8effdf280090"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd80101aef664387bbad8effdf280090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dd80101aef664387bbad8effdf280090", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd80101aef664387bbad8effdf280090"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:36.832719 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-DeleteServersAdminTestJSON-585429533 May 21 21:14:36.832719 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: dd80101aef664387bbad8effdf280090 May 21 21:14:36.832719 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-585429533 May 21 21:14:36.832719 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-DeleteServersAdminTestJSON-585429533-project May 21 21:14:36.832719 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:14:36.832719 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:14:36.832719 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: a5007c2462df46d385ca2f883b061a54 May 21 21:14:36.832719 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-DeleteServersAdminTestJSON-585429533-project May 21 21:14:36.832719 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:14:36.832719 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 0d7caaad-109e-4e52-9ecb-180ab87d1219 could not be found. May 21 21:14:36.832719 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '0d7caaad-109e-4e52-9ecb-180ab87d1219'} May 21 21:14:36.833634 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:36.833634 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:36.833634 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:14:36.833634 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:14:36.833634 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:14:36.833634 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:14:36.833634 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:14:36.833634 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:14:36.833634 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:14:36.833634 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:14:36.833634 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d7caaad-109e-4e52-9ecb-180ab87d1219 could not be found. May 21 21:14:36.833634 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:36.833634 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:36.833634 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:36.833634 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:36.833634 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:36.833634 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:36.833634 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:36.833634 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:36.833634 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:36.836104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:36.836104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:14:36.836104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:14:36.836104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:14:36.836104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:14:36.836104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:14:36.836104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:14:36.836104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d7caaad-109e-4e52-9ecb-180ab87d1219 could not be found. May 21 21:14:36.836104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:36.836104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:36.836104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:36.836104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:36.836104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:36.836104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:36.836104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:36.836104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:36.836104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d7caaad-109e-4e52-9ecb-180ab87d1219 could not be found. May 21 21:14:36.836104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:36.839043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e5af470b-050c-47bf-a54c-41cf91768919 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] Returning 404 to user: Instance 0d7caaad-109e-4e52-9ecb-180ab87d1219 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:36.840834 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e5af470b-050c-47bf-a54c-41cf91768919 tempest-DeleteServersAdminTestJSON-585429533 tempest-DeleteServersAdminTestJSON-585429533-project] 10.222.0.49 "GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219" status: 404 len: 111 microversion: 2.1 time: 0.053164 May 21 21:14:36.844884 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 612/1183] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:36 2022] GET /compute/v2.1/servers/0d7caaad-109e-4e52-9ecb-180ab87d1219 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:14:36.852547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-3568eb7f-2a9e-44cc-807d-76bac603f56c req-6041d0dc-e887-43a6-8ea9-51afa7f05264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55818247-81af-4cf1-bff3-92aeb3f06bba", "tag": "d78ce8f3-1b0e-4e09-b2ee-8d7b3fe8530e"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:36.864230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3568eb7f-2a9e-44cc-807d-76bac603f56c req-6041d0dc-e887-43a6-8ea9-51afa7f05264 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:36.865057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3568eb7f-2a9e-44cc-807d-76bac603f56c req-6041d0dc-e887-43a6-8ea9-51afa7f05264 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:36.879202 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-3568eb7f-2a9e-44cc-807d-76bac603f56c req-6041d0dc-e887-43a6-8ea9-51afa7f05264 service nova] Creating event network-changed:d78ce8f3-1b0e-4e09-b2ee-8d7b3fe8530e for instance 55818247-81af-4cf1-bff3-92aeb3f06bba on nch2-master-1 May 21 21:14:36.884626 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-3568eb7f-2a9e-44cc-807d-76bac603f56c req-6041d0dc-e887-43a6-8ea9-51afa7f05264 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038202 May 21 21:14:36.886935 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 613/1184] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:36.898885 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-558623a7-da6d-4ae0-a710-9e298b796683 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:36.898885 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-558623a7-da6d-4ae0-a710-9e298b796683 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:36.911072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-558623a7-da6d-4ae0-a710-9e298b796683 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:36.911799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-558623a7-da6d-4ae0-a710-9e298b796683 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:36.912851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-558623a7-da6d-4ae0-a710-9e298b796683 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:36.913446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-558623a7-da6d-4ae0-a710-9e298b796683 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:37.233628 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-249eaab9-3a47-430e-b5d1-7f216d1f7bdf tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/40b3177b-2c2b-4c1c-aa4e-331d4b006f0b" status: 202 len: 0 microversion: 2.1 time: 1.428798 May 21 21:14:37.234861 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 572/1185] 10.222.0.49 () {58 vars in 1262 bytes} [Sat May 21 21:14:35 2022] DELETE /compute/v2.1/os-floating-ips/40b3177b-2c2b-4c1c-aa4e-331d4b006f0b => generated 0 bytes in 1446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:14:37.239654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-01692a02-1343-4986-b3ce-6bb351672acb tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:37.240438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-01692a02-1343-4986-b3ce-6bb351672acb tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:37.248260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-01692a02-1343-4986-b3ce-6bb351672acb tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:37.248985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-01692a02-1343-4986-b3ce-6bb351672acb tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:37.249961 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-01692a02-1343-4986-b3ce-6bb351672acb tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:37.250554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-01692a02-1343-4986-b3ce-6bb351672acb tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:37.302026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-558623a7-da6d-4ae0-a710-9e298b796683 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:37.315910 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-558623a7-da6d-4ae0-a710-9e298b796683 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1540 microversion: 2.1 time: 0.426793 May 21 21:14:37.316878 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 614/1186] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:36 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1540 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:37.322335 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cdb8c190-4f5c-4c7a-ad3c-1715e5f069b8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:37.323476 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cdb8c190-4f5c-4c7a-ad3c-1715e5f069b8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:37.330620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cdb8c190-4f5c-4c7a-ad3c-1715e5f069b8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:37.331424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cdb8c190-4f5c-4c7a-ad3c-1715e5f069b8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:37.333285 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cdb8c190-4f5c-4c7a-ad3c-1715e5f069b8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:37.333975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cdb8c190-4f5c-4c7a-ad3c-1715e5f069b8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:37.459336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-01692a02-1343-4986-b3ce-6bb351672acb tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:37.469826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-01692a02-1343-4986-b3ce-6bb351672acb tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:37.471565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-01692a02-1343-4986-b3ce-6bb351672acb tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:37.472757 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-01692a02-1343-4986-b3ce-6bb351672acb tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1645 microversion: 2.25 time: 0.236833 May 21 21:14:37.473491 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 573/1187] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:14:37 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1645 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:37.479076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-08a2d552-caeb-4ed3-9a43-22fba66d1abe tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:37.480262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-08a2d552-caeb-4ed3-9a43-22fba66d1abe tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:37.486592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08a2d552-caeb-4ed3-9a43-22fba66d1abe tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:37.487039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08a2d552-caeb-4ed3-9a43-22fba66d1abe tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:37.488016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08a2d552-caeb-4ed3-9a43-22fba66d1abe tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:37.488490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08a2d552-caeb-4ed3-9a43-22fba66d1abe tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:37.541115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cdb8c190-4f5c-4c7a-ad3c-1715e5f069b8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:37.549530 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cdb8c190-4f5c-4c7a-ad3c-1715e5f069b8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1521 microversion: 2.1 time: 0.231414 May 21 21:14:37.550692 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 615/1188] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:37 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:37.555668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-01e42410-b28a-4ede-840b-b25d7e56f590 tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] Action: 'create', calling method: .version_select at 0x7fc81b5d20d0>, body: {"pool": null} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:37.638513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-08a2d552-caeb-4ed3-9a43-22fba66d1abe tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lazy-loading 'services' on Instance uuid afc6789c-29a3-4a84-8045-36b96ce9e9fe {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:14:37.693962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:37.944962 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-08a2d552-caeb-4ed3-9a43-22fba66d1abe tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "DELETE /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe/os-volume_attachments/733be916-b25a-45e6-a958-0a250da2a456" status: 202 len: 0 microversion: 2.1 time: 0.469721 May 21 21:14:37.946320 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 574/1189] 10.222.0.49 () {58 vars in 1415 bytes} [Sat May 21 21:14:37 2022] DELETE /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe/os-volume_attachments/733be916-b25a-45e6-a958-0a250da2a456 => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:14:37.952572 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-97ce8335-e76f-44d9-8052-0500f79ee192 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:37.953398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-97ce8335-e76f-44d9-8052-0500f79ee192 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:37.960154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-97ce8335-e76f-44d9-8052-0500f79ee192 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:37.960788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-97ce8335-e76f-44d9-8052-0500f79ee192 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:37.961587 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-97ce8335-e76f-44d9-8052-0500f79ee192 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:37.962122 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-97ce8335-e76f-44d9-8052-0500f79ee192 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:38.132117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-97ce8335-e76f-44d9-8052-0500f79ee192 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:38.147189 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-97ce8335-e76f-44d9-8052-0500f79ee192 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 1318 microversion: 2.1 time: 0.198811 May 21 21:14:38.155132 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 575/1190] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:37 2022] GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:38.162424 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-775c2090-ba5b-4a03-851b-5687dd6afec4 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:38.163314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-775c2090-ba5b-4a03-851b-5687dd6afec4 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:38.167167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:38.177703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-775c2090-ba5b-4a03-851b-5687dd6afec4 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:38.178294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-775c2090-ba5b-4a03-851b-5687dd6afec4 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:38.179448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-775c2090-ba5b-4a03-851b-5687dd6afec4 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:38.179965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-775c2090-ba5b-4a03-851b-5687dd6afec4 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:38.345850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-775c2090-ba5b-4a03-851b-5687dd6afec4 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:38.356720 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-775c2090-ba5b-4a03-851b-5687dd6afec4 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1521 microversion: 2.1 time: 0.199985 May 21 21:14:38.357490 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 576/1191] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:38 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:38.362981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9e8db0f1-e0a1-4b29-96e7-4d7c076b7cb9 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:38.364437 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9e8db0f1-e0a1-4b29-96e7-4d7c076b7cb9 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:38.376705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e8db0f1-e0a1-4b29-96e7-4d7c076b7cb9 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:38.377159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e8db0f1-e0a1-4b29-96e7-4d7c076b7cb9 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:38.378138 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e8db0f1-e0a1-4b29-96e7-4d7c076b7cb9 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:38.378580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e8db0f1-e0a1-4b29-96e7-4d7c076b7cb9 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:38.411311 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9e8db0f1-e0a1-4b29-96e7-4d7c076b7cb9 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052439 May 21 21:14:38.411901 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 577/1192] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:14:38 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:38.416555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7d8c8759-974c-4669-97b0-ec15f92ad56b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:38.417455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7d8c8759-974c-4669-97b0-ec15f92ad56b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:38.423338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7d8c8759-974c-4669-97b0-ec15f92ad56b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:38.423795 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7d8c8759-974c-4669-97b0-ec15f92ad56b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:38.424632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7d8c8759-974c-4669-97b0-ec15f92ad56b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:38.426046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7d8c8759-974c-4669-97b0-ec15f92ad56b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:38.619368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7d8c8759-974c-4669-97b0-ec15f92ad56b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:38.630305 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7d8c8759-974c-4669-97b0-ec15f92ad56b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1540 microversion: 2.1 time: 0.217354 May 21 21:14:38.631159 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 578/1193] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:38 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1540 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:38.648215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1de5b80f-a53a-4b36-bfec-eee6026cd401 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1057771045"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:38.649533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1de5b80f-a53a-4b36-bfec-eee6026cd401 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:38.657562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1de5b80f-a53a-4b36-bfec-eee6026cd401 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:38.658592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1de5b80f-a53a-4b36-bfec-eee6026cd401 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:38.659570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1de5b80f-a53a-4b36-bfec-eee6026cd401 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:38.660243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1de5b80f-a53a-4b36-bfec-eee6026cd401 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:39.358426 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1de5b80f-a53a-4b36-bfec-eee6026cd401 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "POST /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06/action" status: 202 len: 0 microversion: 2.1 time: 0.710934 May 21 21:14:39.358426 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 579/1194] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:14:38 2022] POST /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06/action => generated 0 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 21 21:14:39.364735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-95d66388-155d-4b1e-a2d4-b9106f415eb0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:39.366167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-95d66388-155d-4b1e-a2d4-b9106f415eb0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:39.379075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-95d66388-155d-4b1e-a2d4-b9106f415eb0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:39.379762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-95d66388-155d-4b1e-a2d4-b9106f415eb0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:39.380786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-95d66388-155d-4b1e-a2d4-b9106f415eb0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:39.381381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-95d66388-155d-4b1e-a2d4-b9106f415eb0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:39.692840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-95d66388-155d-4b1e-a2d4-b9106f415eb0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:39.705975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-95d66388-155d-4b1e-a2d4-b9106f415eb0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:39.707655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-95d66388-155d-4b1e-a2d4-b9106f415eb0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:39.711069 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-95d66388-155d-4b1e-a2d4-b9106f415eb0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1645 microversion: 2.25 time: 0.350623 May 21 21:14:39.713223 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 580/1195] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:14:39 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1645 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:39.733639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-d3901327-a614-499a-953b-a713075e35b2 req-184a3d70-f180-495f-806c-e64240737ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0525194-b3aa-482c-a355-c77c63bf4c88", "tag": "5eb403c4-fa1f-43de-83df-5b9059a1b1b1"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:39.744398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d3901327-a614-499a-953b-a713075e35b2 req-184a3d70-f180-495f-806c-e64240737ee0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:39.745948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d3901327-a614-499a-953b-a713075e35b2 req-184a3d70-f180-495f-806c-e64240737ee0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:39.760411 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-d3901327-a614-499a-953b-a713075e35b2 req-184a3d70-f180-495f-806c-e64240737ee0 service nova] Creating event network-changed:5eb403c4-fa1f-43de-83df-5b9059a1b1b1 for instance f0525194-b3aa-482c-a355-c77c63bf4c88 on nch2-master-1 May 21 21:14:39.766081 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-d3901327-a614-499a-953b-a713075e35b2 req-184a3d70-f180-495f-806c-e64240737ee0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050293 May 21 21:14:39.773565 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 581/1196] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:39.787131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5d4d2c00-c507-4799-a0d6-043f60f0371e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:39.787852 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5d4d2c00-c507-4799-a0d6-043f60f0371e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:39.803976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d4d2c00-c507-4799-a0d6-043f60f0371e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:39.808337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d4d2c00-c507-4799-a0d6-043f60f0371e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:39.813365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d4d2c00-c507-4799-a0d6-043f60f0371e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:39.813365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d4d2c00-c507-4799-a0d6-043f60f0371e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:40.021226 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5d4d2c00-c507-4799-a0d6-043f60f0371e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:40.043686 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5d4d2c00-c507-4799-a0d6-043f60f0371e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 1318 microversion: 2.1 time: 0.260643 May 21 21:14:40.043686 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 582/1197] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:39 2022] GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:40.053387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4fa83793-e135-42c2-9fbd-38c514378146 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1427730355"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:40.055246 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4fa83793-e135-42c2-9fbd-38c514378146 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:40.063775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4fa83793-e135-42c2-9fbd-38c514378146 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:40.064322 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4fa83793-e135-42c2-9fbd-38c514378146 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:40.065165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4fa83793-e135-42c2-9fbd-38c514378146 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:40.065478 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4fa83793-e135-42c2-9fbd-38c514378146 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:40.105426 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-4fa83793-e135-42c2-9fbd-38c514378146 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] HTTP exception thrown: Cannot 'createImage' instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 while it is in task_state image_snapshot May 21 21:14:40.107294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4fa83793-e135-42c2-9fbd-38c514378146 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Request method failure captured: May 21 21:14:40.107294 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06/action HTTP/1.1 May 21 21:14:40.107294 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:40.107294 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:40.107294 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:40.107294 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 85 May 21 21:14:40.107294 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:40.107294 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:40.107294 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:40.107294 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:40.107294 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVYcSiyjAIR82oxkRB6GTuWAKVTX4xG5vMYtW_3BeBGCFxFQjKbNKPB4C0xhPGbN3kZTd0vkZOYFJP4MJ1kk_eZN0RsUqNmA1UP-b-s9HcyrYiVjgp1H1dIVPKi3UtrJ4Ob8-qkiVNLHvP2GMr_o_p2pBItaNXntU_KoEaP7ETd6R3M May 21 21:14:40.107294 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:40.107294 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:40.107294 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:40.107294 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:40.107294 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:40.107294 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:40.107294 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:14:40.107294 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:14:40.107294 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:14:40.107294 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:14:40.108797 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85f6ae1864ee43429c910eb27888608f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:40.108797 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:14:40.108797 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:14:40.108797 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:14:40.108797 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:14:40.108797 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:40.108797 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:40.108797 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 186310904c3943fdb63247b58725140e May 21 21:14:40.108797 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:14:40.108797 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:14:40.108797 ncdv-master-1 devstack@n-api.service[131277]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1427730355"}} May 21 21:14:40.108797 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:14:40.109590 ncdv-master-1 devstack@n-api.service[131277]: exception: Cannot 'createImage' instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 while it is in task_state image_snapshot May 21 21:14:40.109590 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'b58aadd3-11a8-41dc-9104-b6082e4eeb06', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1427730355'}}} May 21 21:14:40.109590 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:40.109590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:40.109590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image May 21 21:14:40.109590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, May 21 21:14:40.109590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner May 21 21:14:40.109590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 21 21:14:40.109590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 in task_state image_snapshot. Cannot snapshot while the instance is in this state. May 21 21:14:40.109590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:40.109590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:40.109590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:40.109590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:40.109590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:40.109590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:40.109590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:40.109590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:40.109590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:40.109590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:40.110816 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:14:40.110816 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:14:40.110816 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:14:40.110816 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:14:40.110816 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image May 21 21:14:40.110816 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 21 21:14:40.110816 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 21 21:14:40.110816 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 21 21:14:40.110816 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 while it is in task_state image_snapshot May 21 21:14:40.110816 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:40.110816 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:40.110816 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:40.110816 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:40.110816 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:40.110816 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:40.110816 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:40.110816 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:40.110816 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 while it is in task_state image_snapshot May 21 21:14:40.110816 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:40.112902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4fa83793-e135-42c2-9fbd-38c514378146 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Returning 409 to user: Cannot 'createImage' instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 while it is in task_state image_snapshot {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:40.112902 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4fa83793-e135-42c2-9fbd-38c514378146 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "POST /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06/action" status: 409 len: 159 microversion: 2.1 time: 0.068509 May 21 21:14:40.112902 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 583/1198] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:14:40 2022] POST /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06/action => generated 159 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 21 21:14:40.117652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-983ad6e0-04ea-43a9-9cee-0f0e0994297d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:40.118585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-983ad6e0-04ea-43a9-9cee-0f0e0994297d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:40.124803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-983ad6e0-04ea-43a9-9cee-0f0e0994297d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:40.125255 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-983ad6e0-04ea-43a9-9cee-0f0e0994297d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:40.126160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-983ad6e0-04ea-43a9-9cee-0f0e0994297d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:40.126599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-983ad6e0-04ea-43a9-9cee-0f0e0994297d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:40.169072 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-983ad6e0-04ea-43a9-9cee-0f0e0994297d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053969 May 21 21:14:40.169072 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 584/1199] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:14:40 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:14:40.173439 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-349089e7-32ac-45c7-8f46-fcebb8a2b374 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:40.174358 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-349089e7-32ac-45c7-8f46-fcebb8a2b374 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:40.181865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-349089e7-32ac-45c7-8f46-fcebb8a2b374 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:40.182423 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-349089e7-32ac-45c7-8f46-fcebb8a2b374 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:40.183531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-349089e7-32ac-45c7-8f46-fcebb8a2b374 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:40.183970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-349089e7-32ac-45c7-8f46-fcebb8a2b374 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:40.358088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-349089e7-32ac-45c7-8f46-fcebb8a2b374 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:40.365837 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-349089e7-32ac-45c7-8f46-fcebb8a2b374 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1540 microversion: 2.1 time: 0.195950 May 21 21:14:40.366615 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 585/1200] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:40 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1540 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:40.372201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-40894051-b311-4790-9b8d-041381313d6a tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '.version_select at 0x7fc81b1c70d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:40.729841 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-40894051-b311-4790-9b8d-041381313d6a tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "DELETE /compute/v2.1/images/a1e797c9-08eb-43bc-ba9a-4e8195f6e076" status: 204 len: 0 microversion: 2.1 time: 0.358970 May 21 21:14:40.729841 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 586/1201] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:40 2022] DELETE /compute/v2.1/images/a1e797c9-08eb-43bc-ba9a-4e8195f6e076 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:14:40.732837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7302791a-1c2d-40c9-ba7f-4f1dc05c0014 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:40.733638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7302791a-1c2d-40c9-ba7f-4f1dc05c0014 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:40.744992 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7302791a-1c2d-40c9-ba7f-4f1dc05c0014 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:40.745635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7302791a-1c2d-40c9-ba7f-4f1dc05c0014 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:40.746591 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7302791a-1c2d-40c9-ba7f-4f1dc05c0014 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:40.753512 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7302791a-1c2d-40c9-ba7f-4f1dc05c0014 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:41.019553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7302791a-1c2d-40c9-ba7f-4f1dc05c0014 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:41.030776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7302791a-1c2d-40c9-ba7f-4f1dc05c0014 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:41.033906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7302791a-1c2d-40c9-ba7f-4f1dc05c0014 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:41.035877 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7302791a-1c2d-40c9-ba7f-4f1dc05c0014 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1645 microversion: 2.25 time: 0.306816 May 21 21:14:41.037202 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 587/1202] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:14:40 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1645 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:41.054766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ead4be36-1427-4667-9f51-b5270c556219 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:41.055561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ead4be36-1427-4667-9f51-b5270c556219 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:41.065672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ead4be36-1427-4667-9f51-b5270c556219 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:41.065921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ead4be36-1427-4667-9f51-b5270c556219 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:41.067064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ead4be36-1427-4667-9f51-b5270c556219 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:41.067512 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ead4be36-1427-4667-9f51-b5270c556219 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:41.196496 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-01e42410-b28a-4ede-840b-b25d7e56f590 tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.644150 May 21 21:14:41.210994 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 616/1203] 10.222.0.49 () {60 vars in 1169 bytes} [Sat May 21 21:14:37 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:41.214771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-40b8e888-fd81-453b-b7eb-d97109b39edd tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:41.215803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-40b8e888-fd81-453b-b7eb-d97109b39edd tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:41.223425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40b8e888-fd81-453b-b7eb-d97109b39edd tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:41.224240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40b8e888-fd81-453b-b7eb-d97109b39edd tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:41.227019 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40b8e888-fd81-453b-b7eb-d97109b39edd tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:41.227641 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40b8e888-fd81-453b-b7eb-d97109b39edd tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:41.327431 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ead4be36-1427-4667-9f51-b5270c556219 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:41.336920 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ead4be36-1427-4667-9f51-b5270c556219 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1533 microversion: 2.1 time: 0.298079 May 21 21:14:41.337337 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 588/1204] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:41 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1533 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:41.631953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-40b8e888-fd81-453b-b7eb-d97109b39edd tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:41.645047 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-40b8e888-fd81-453b-b7eb-d97109b39edd tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 1318 microversion: 2.1 time: 0.442506 May 21 21:14:41.646162 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 617/1205] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:41 2022] GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:41.652789 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b31adf9a-91aa-4626-b9f1-a75866cdebcc tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] Calling method '.version_select at 0x7fc81b571550>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:41.801277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-861b3d00-4fc4-4f28-98ae-29da75bcfec9 tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] Calling method '.version_select at 0x7fc81b3c6dc0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:41.839555 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-861b3d00-4fc4-4f28-98ae-29da75bcfec9 tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] HTTP exception thrown: Image not found. May 21 21:14:41.894059 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-861b3d00-4fc4-4f28-98ae-29da75bcfec9 tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] Request method failure captured: May 21 21:14:41.894059 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/images/514f96b4-7eaf-40e5-b315-71fc600de6b4/metadata/os_distro HTTP/1.1 May 21 21:14:41.894059 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:41.894059 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:41.894059 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:41.894059 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:14:41.894059 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:41.894059 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:41.894059 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:41.894059 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:41.894059 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZApBMAq4H62BrM2bNBGXwFRLxVa-hQ15XtjiT8vvTKgBz6AC-ccSH3gQms5fe-U0n7oHePEF9Gio_6-vItqzVEKMClxDxumvi0MIblM8ZiuLG6q05QxwHG0bd-CJRU6bXv7VU1e6xFPGjE-AVaWwyUzXO8ciTFR6hENXQTw0TaUFU May 21 21:14:41.894059 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:41.894059 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:41.894059 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:41.894059 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:41.894059 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:41.894059 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:41.894059 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 41cac259fef24da3989dbc7944b5c9e1 May 21 21:14:41.894059 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1305059096 May 21 21:14:41.894059 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:14:41.894059 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:14:41.900404 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/41cac259fef24da3989dbc7944b5c9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41cac259fef24da3989dbc7944b5c9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_41cac259fef24da3989dbc7944b5c9e1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41cac259fef24da3989dbc7944b5c9e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:41.900404 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1305059096 May 21 21:14:41.900404 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 41cac259fef24da3989dbc7944b5c9e1 May 21 21:14:41.900404 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1305059096 May 21 21:14:41.900404 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesMetadataNegativeTestJSON-1305059096-project May 21 21:14:41.900404 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:41.900404 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:41.900404 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 65ededecccee49929eae51096bb3349e May 21 21:14:41.900404 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1305059096-project May 21 21:14:41.900404 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:14:41.900404 ncdv-master-1 devstack@n-api.service[131277]: exception: Image not found. May 21 21:14:41.900404 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'image_id': '514f96b4-7eaf-40e5-b315-71fc600de6b4', 'id': 'os_distro'} May 21 21:14:41.900404 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:41.902404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:41.902404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 21 21:14:41.902404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 21 21:14:41.902404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:14:41.902404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:14:41.902404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 21 21:14:41.902404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 21 21:14:41.902404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:14:41.902404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:14:41.902404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 21 21:14:41.902404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 21 21:14:41.902404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 21 21:14:41.902404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 21 21:14:41.902404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:14:41.902404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:14:41.902404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:14:41.902404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:14:41.902404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 514f96b4-7eaf-40e5-b315-71fc600de6b4 May 21 21:14:41.904109 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:41.904109 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:41.904109 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:41.904109 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:41.904109 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 21 21:14:41.904109 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 21 21:14:41.904109 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 21 21:14:41.904109 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 21 21:14:41.904109 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 21 21:14:41.904109 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 21 21:14:41.904109 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 21 21:14:41.904109 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 21 21:14:41.904109 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 21 21:14:41.904109 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 21 21:14:41.904109 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:14:41.904109 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:14:41.904109 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 21 21:14:41.904109 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 21 21:14:41.904109 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:14:41.904109 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:14:41.905589 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 21 21:14:41.905589 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 21 21:14:41.905589 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 21 21:14:41.905589 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 21 21:14:41.905589 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:14:41.905589 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:14:41.905589 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:14:41.905589 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:14:41.905589 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 514f96b4-7eaf-40e5-b315-71fc600de6b4 could not be found. May 21 21:14:41.905589 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:41.905589 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:41.905589 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:41.905589 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:41.905589 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:41.905589 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:41.905589 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:41.905589 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:41.905589 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:41.905589 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:41.908190 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:41.908190 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:41.908190 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete May 21 21:14:41.908190 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 21 21:14:41.908190 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 21 21:14:41.908190 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 21 21:14:41.908190 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:14:41.908190 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:41.908190 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:41.908190 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:41.908190 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:41.908190 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:41.908190 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:41.908190 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:41.908190 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:41.908190 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:14:41.908190 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:41.908190 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-861b3d00-4fc4-4f28-98ae-29da75bcfec9 tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] Returning 404 to user: Image not found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:41.911450 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-861b3d00-4fc4-4f28-98ae-29da75bcfec9 tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] 10.222.0.49 "DELETE /compute/v2.1/images/514f96b4-7eaf-40e5-b315-71fc600de6b4/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.557699 May 21 21:14:41.911450 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 589/1206] 10.222.0.49 () {58 vars in 1292 bytes} [Sat May 21 21:14:41 2022] DELETE /compute/v2.1/images/514f96b4-7eaf-40e5-b315-71fc600de6b4/metadata/os_distro => generated 62 bytes in 559 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:14:41.912955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fd0da5d4-2202-4bee-9ac0-637ca5c55769 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:41.918623 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fd0da5d4-2202-4bee-9ac0-637ca5c55769 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:41.928404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd0da5d4-2202-4bee-9ac0-637ca5c55769 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:41.928952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd0da5d4-2202-4bee-9ac0-637ca5c55769 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:41.931052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd0da5d4-2202-4bee-9ac0-637ca5c55769 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:41.932482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd0da5d4-2202-4bee-9ac0-637ca5c55769 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:42.161237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fd0da5d4-2202-4bee-9ac0-637ca5c55769 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:42.183073 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fd0da5d4-2202-4bee-9ac0-637ca5c55769 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1540 microversion: 2.1 time: 0.283433 May 21 21:14:42.186681 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 590/1207] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:41 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1540 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:42.191701 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f0d93503-88ec-4440-af2b-fca6796c9e7a req-d22c1593-4439-4f40-b3bc-a5f0f62f9e4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55818247-81af-4cf1-bff3-92aeb3f06bba", "name": "network-vif-plugged", "status": "completed", "tag": "d78ce8f3-1b0e-4e09-b2ee-8d7b3fe8530e"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:42.201875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f0d93503-88ec-4440-af2b-fca6796c9e7a req-d22c1593-4439-4f40-b3bc-a5f0f62f9e4e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:42.202209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f0d93503-88ec-4440-af2b-fca6796c9e7a req-d22c1593-4439-4f40-b3bc-a5f0f62f9e4e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:42.216206 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f0d93503-88ec-4440-af2b-fca6796c9e7a req-d22c1593-4439-4f40-b3bc-a5f0f62f9e4e service nova] Creating event network-vif-plugged:d78ce8f3-1b0e-4e09-b2ee-8d7b3fe8530e for instance 55818247-81af-4cf1-bff3-92aeb3f06bba on nch2-master-1 May 21 21:14:42.221506 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f0d93503-88ec-4440-af2b-fca6796c9e7a req-d22c1593-4439-4f40-b3bc-a5f0f62f9e4e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033484 May 21 21:14:42.222110 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 591/1208] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:42.227295 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-eb02c107-973f-4036-b472-e076150fd4ce tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] Calling method '.version_select at 0x7fc81b3ca550>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:42.260003 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-eb02c107-973f-4036-b472-e076150fd4ce tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] HTTP exception thrown: Image not found. May 21 21:14:42.263171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-eb02c107-973f-4036-b472-e076150fd4ce tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] Request method failure captured: May 21 21:14:42.263171 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/images/ce0ee400-583c-4b9a-bf4e-f1ed7b910cc0/metadata/os_version HTTP/1.1 May 21 21:14:42.263171 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:42.263171 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:42.263171 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:42.263171 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:14:42.263171 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:42.263171 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:42.263171 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:42.263171 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:42.263171 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZApBMAq4H62BrM2bNBGXwFRLxVa-hQ15XtjiT8vvTKgBz6AC-ccSH3gQms5fe-U0n7oHePEF9Gio_6-vItqzVEKMClxDxumvi0MIblM8ZiuLG6q05QxwHG0bd-CJRU6bXv7VU1e6xFPGjE-AVaWwyUzXO8ciTFR6hENXQTw0TaUFU May 21 21:14:42.263171 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:42.263171 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:42.263171 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:42.263171 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:42.263171 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:42.263171 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:42.263171 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 41cac259fef24da3989dbc7944b5c9e1 May 21 21:14:42.263171 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1305059096 May 21 21:14:42.263171 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:14:42.263171 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:14:42.264651 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/41cac259fef24da3989dbc7944b5c9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41cac259fef24da3989dbc7944b5c9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_41cac259fef24da3989dbc7944b5c9e1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41cac259fef24da3989dbc7944b5c9e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:42.264651 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1305059096 May 21 21:14:42.264651 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 41cac259fef24da3989dbc7944b5c9e1 May 21 21:14:42.264651 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1305059096 May 21 21:14:42.264651 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesMetadataNegativeTestJSON-1305059096-project May 21 21:14:42.264651 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:42.264651 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:42.264651 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 65ededecccee49929eae51096bb3349e May 21 21:14:42.264651 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1305059096-project May 21 21:14:42.264651 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:14:42.264651 ncdv-master-1 devstack@n-api.service[131277]: exception: Image not found. May 21 21:14:42.264651 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'image_id': 'ce0ee400-583c-4b9a-bf4e-f1ed7b910cc0', 'id': 'os_version'} May 21 21:14:42.264651 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:42.265479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:42.265479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 21 21:14:42.265479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 21 21:14:42.265479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:14:42.265479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:14:42.265479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 21 21:14:42.265479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 21 21:14:42.265479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:14:42.265479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:14:42.265479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 21 21:14:42.265479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 21 21:14:42.265479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 21 21:14:42.265479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 21 21:14:42.265479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:14:42.265479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:14:42.265479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:14:42.265479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:14:42.265479 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ce0ee400-583c-4b9a-bf4e-f1ed7b910cc0 May 21 21:14:42.266572 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:42.266572 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:42.266572 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:42.266572 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:42.266572 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 21 21:14:42.266572 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 21 21:14:42.266572 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 21 21:14:42.266572 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 21 21:14:42.266572 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 21 21:14:42.266572 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 21 21:14:42.266572 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 21 21:14:42.266572 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 21 21:14:42.266572 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 21 21:14:42.266572 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 21 21:14:42.266572 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:14:42.266572 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:14:42.266572 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 21 21:14:42.266572 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 21 21:14:42.266572 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:14:42.266572 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:14:42.267813 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 21 21:14:42.267813 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 21 21:14:42.267813 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 21 21:14:42.267813 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 21 21:14:42.267813 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:14:42.267813 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:14:42.267813 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:14:42.267813 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:14:42.267813 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ce0ee400-583c-4b9a-bf4e-f1ed7b910cc0 could not be found. May 21 21:14:42.267813 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:42.267813 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:42.267813 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:42.267813 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:42.267813 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:42.267813 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:42.267813 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:42.267813 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:42.267813 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:42.267813 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:42.271639 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:42.271639 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:42.271639 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show May 21 21:14:42.271639 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] May 21 21:14:42.271639 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 21 21:14:42.271639 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 21 21:14:42.271639 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:14:42.271639 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:42.271639 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:42.271639 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:42.271639 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:42.271639 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:42.271639 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:42.271639 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:42.271639 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:42.271639 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:14:42.271639 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:42.271639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-eb02c107-973f-4036-b472-e076150fd4ce tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] Returning 404 to user: Image not found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:42.274469 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-eb02c107-973f-4036-b472-e076150fd4ce tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] 10.222.0.49 "GET /compute/v2.1/images/ce0ee400-583c-4b9a-bf4e-f1ed7b910cc0/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.041962 May 21 21:14:42.282820 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 592/1209] 10.222.0.49 () {58 vars in 1292 bytes} [Sat May 21 21:14:42 2022] GET /compute/v2.1/images/ce0ee400-583c-4b9a-bf4e-f1ed7b910cc0/metadata/os_version => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:14:42.296894 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aa940df9-e203-4621-b040-188fca6a8f45 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:42.299098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aa940df9-e203-4621-b040-188fca6a8f45 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:42.306135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa940df9-e203-4621-b040-188fca6a8f45 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:42.306652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa940df9-e203-4621-b040-188fca6a8f45 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:42.308348 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa940df9-e203-4621-b040-188fca6a8f45 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:42.309052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa940df9-e203-4621-b040-188fca6a8f45 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:42.578071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aa940df9-e203-4621-b040-188fca6a8f45 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:42.613963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aa940df9-e203-4621-b040-188fca6a8f45 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:42.622047 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aa940df9-e203-4621-b040-188fca6a8f45 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:42.628031 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aa940df9-e203-4621-b040-188fca6a8f45 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1645 microversion: 2.25 time: 0.340109 May 21 21:14:42.629000 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 593/1210] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:14:42 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1645 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:42.643891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d592e9a7-925a-4317-8b62-1fc505e1ac7c tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] Calling method '.version_select at 0x7fc81b1fc1f0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:42.687752 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-d592e9a7-925a-4317-8b62-1fc505e1ac7c tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] HTTP exception thrown: Image not found. May 21 21:14:42.690813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d592e9a7-925a-4317-8b62-1fc505e1ac7c tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] Request method failure captured: May 21 21:14:42.690813 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/images/519c41b2-e53c-4a53-a392-dcb947704af4/metadata HTTP/1.1 May 21 21:14:42.690813 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:42.690813 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:42.690813 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:42.690813 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:14:42.690813 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:42.690813 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:42.690813 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:42.690813 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:42.690813 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZApBMAq4H62BrM2bNBGXwFRLxVa-hQ15XtjiT8vvTKgBz6AC-ccSH3gQms5fe-U0n7oHePEF9Gio_6-vItqzVEKMClxDxumvi0MIblM8ZiuLG6q05QxwHG0bd-CJRU6bXv7VU1e6xFPGjE-AVaWwyUzXO8ciTFR6hENXQTw0TaUFU May 21 21:14:42.690813 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:42.690813 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:42.690813 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:42.690813 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:42.690813 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:42.690813 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:42.690813 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 41cac259fef24da3989dbc7944b5c9e1 May 21 21:14:42.690813 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1305059096 May 21 21:14:42.690813 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:14:42.690813 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:14:42.692205 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/41cac259fef24da3989dbc7944b5c9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41cac259fef24da3989dbc7944b5c9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_41cac259fef24da3989dbc7944b5c9e1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41cac259fef24da3989dbc7944b5c9e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:42.692205 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1305059096 May 21 21:14:42.692205 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 41cac259fef24da3989dbc7944b5c9e1 May 21 21:14:42.692205 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1305059096 May 21 21:14:42.692205 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesMetadataNegativeTestJSON-1305059096-project May 21 21:14:42.692205 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:42.692205 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:42.692205 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 65ededecccee49929eae51096bb3349e May 21 21:14:42.692205 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1305059096-project May 21 21:14:42.692205 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:14:42.692205 ncdv-master-1 devstack@n-api.service[131277]: exception: Image not found. May 21 21:14:42.692205 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'image_id': '519c41b2-e53c-4a53-a392-dcb947704af4'} May 21 21:14:42.692205 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:42.693268 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:42.693268 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 21 21:14:42.693268 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 21 21:14:42.693268 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:14:42.693268 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:14:42.693268 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 21 21:14:42.693268 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 21 21:14:42.693268 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:14:42.693268 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:14:42.693268 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 21 21:14:42.693268 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 21 21:14:42.693268 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 21 21:14:42.693268 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 21 21:14:42.693268 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:14:42.693268 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:14:42.693268 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:14:42.693268 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:14:42.693268 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 519c41b2-e53c-4a53-a392-dcb947704af4 May 21 21:14:42.695447 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:42.695447 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:42.695447 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:42.695447 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:42.695447 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 21 21:14:42.695447 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 21 21:14:42.695447 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 21 21:14:42.695447 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 21 21:14:42.695447 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 21 21:14:42.695447 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 21 21:14:42.695447 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 21 21:14:42.695447 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 21 21:14:42.695447 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 21 21:14:42.695447 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 21 21:14:42.695447 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:14:42.695447 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:14:42.695447 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 21 21:14:42.695447 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 21 21:14:42.695447 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:14:42.695447 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:14:42.698298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 21 21:14:42.698298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 21 21:14:42.698298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 21 21:14:42.698298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 21 21:14:42.698298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:14:42.698298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:14:42.698298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:14:42.698298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:14:42.698298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 519c41b2-e53c-4a53-a392-dcb947704af4 could not be found. May 21 21:14:42.698298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:42.698298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:42.698298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:42.698298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:42.698298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:42.698298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:42.698298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:42.698298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:42.698298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:42.698298 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:42.701010 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:42.701010 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:42.701010 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index May 21 21:14:42.701010 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] May 21 21:14:42.701010 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 21 21:14:42.701010 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 21 21:14:42.701010 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:14:42.701010 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:42.701010 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:42.701010 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:42.701010 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:42.701010 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:42.701010 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:42.701010 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:42.701010 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:42.701010 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:14:42.701010 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:42.701010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d592e9a7-925a-4317-8b62-1fc505e1ac7c tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] Returning 404 to user: Image not found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:42.703648 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d592e9a7-925a-4317-8b62-1fc505e1ac7c tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] 10.222.0.49 "GET /compute/v2.1/images/519c41b2-e53c-4a53-a392-dcb947704af4/metadata" status: 404 len: 62 microversion: 2.1 time: 0.061129 May 21 21:14:42.703648 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 594/1211] 10.222.0.49 () {58 vars in 1259 bytes} [Sat May 21 21:14:42 2022] GET /compute/v2.1/images/519c41b2-e53c-4a53-a392-dcb947704af4/metadata => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:14:42.712080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-038a6845-21cc-448e-af58-5cc71c7387ed tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:42.717033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-038a6845-21cc-448e-af58-5cc71c7387ed tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:42.745895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-038a6845-21cc-448e-af58-5cc71c7387ed tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:42.746993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-038a6845-21cc-448e-af58-5cc71c7387ed tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:42.747868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-038a6845-21cc-448e-af58-5cc71c7387ed tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:42.748356 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-038a6845-21cc-448e-af58-5cc71c7387ed tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:42.758746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:42.991287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-038a6845-21cc-448e-af58-5cc71c7387ed tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:43.000258 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-038a6845-21cc-448e-af58-5cc71c7387ed tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1539 microversion: 2.1 time: 0.297566 May 21 21:14:43.001126 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 595/1212] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:42 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1539 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:43.006522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4ee9daee-99d1-4a55-ae11-bd46a691ab6c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:43.007563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4ee9daee-99d1-4a55-ae11-bd46a691ab6c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:43.017463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ee9daee-99d1-4a55-ae11-bd46a691ab6c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:43.017463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ee9daee-99d1-4a55-ae11-bd46a691ab6c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:43.017463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ee9daee-99d1-4a55-ae11-bd46a691ab6c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:43.018520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ee9daee-99d1-4a55-ae11-bd46a691ab6c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:43.184914 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4ee9daee-99d1-4a55-ae11-bd46a691ab6c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:43.194142 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4ee9daee-99d1-4a55-ae11-bd46a691ab6c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 1318 microversion: 2.1 time: 0.191865 May 21 21:14:43.194885 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 596/1213] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:43 2022] GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:43.202067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a5fc6542-02cf-4aff-81d5-65e12e2a1608 tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] Action: 'update_all', calling method: .version_select at 0x7fc81b1501f0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:43.229707 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-a5fc6542-02cf-4aff-81d5-65e12e2a1608 tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] HTTP exception thrown: Image not found. May 21 21:14:43.233360 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a5fc6542-02cf-4aff-81d5-65e12e2a1608 tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] Request method failure captured: May 21 21:14:43.233360 ncdv-master-1 devstack@n-api.service[131277]: request: PUT /compute/v2.1/images/e93c6206-710c-4ddb-b6f8-798b56195604/metadata HTTP/1.1 May 21 21:14:43.233360 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:43.233360 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:43.233360 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:43.233360 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 57 May 21 21:14:43.233360 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:43.233360 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:43.233360 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:43.233360 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:43.233360 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZApBMAq4H62BrM2bNBGXwFRLxVa-hQ15XtjiT8vvTKgBz6AC-ccSH3gQms5fe-U0n7oHePEF9Gio_6-vItqzVEKMClxDxumvi0MIblM8ZiuLG6q05QxwHG0bd-CJRU6bXv7VU1e6xFPGjE-AVaWwyUzXO8ciTFR6hENXQTw0TaUFU May 21 21:14:43.233360 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:43.233360 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:43.233360 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:43.233360 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:43.233360 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:43.233360 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:43.233360 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 41cac259fef24da3989dbc7944b5c9e1 May 21 21:14:43.233360 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1305059096 May 21 21:14:43.233360 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:14:43.233360 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:14:43.235121 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/41cac259fef24da3989dbc7944b5c9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41cac259fef24da3989dbc7944b5c9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_41cac259fef24da3989dbc7944b5c9e1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41cac259fef24da3989dbc7944b5c9e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:43.235121 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1305059096 May 21 21:14:43.235121 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 41cac259fef24da3989dbc7944b5c9e1 May 21 21:14:43.235121 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1305059096 May 21 21:14:43.235121 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesMetadataNegativeTestJSON-1305059096-project May 21 21:14:43.235121 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:43.235121 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:43.235121 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 65ededecccee49929eae51096bb3349e May 21 21:14:43.235121 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1305059096-project May 21 21:14:43.235121 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:14:43.235121 ncdv-master-1 devstack@n-api.service[131277]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} May 21 21:14:43.235121 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:14:43.235121 ncdv-master-1 devstack@n-api.service[131277]: exception: Image not found. May 21 21:14:43.235121 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'image_id': 'e93c6206-710c-4ddb-b6f8-798b56195604', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} May 21 21:14:43.236187 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:43.236187 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:43.236187 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 21 21:14:43.236187 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 21 21:14:43.236187 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:14:43.236187 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:14:43.236187 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 21 21:14:43.236187 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 21 21:14:43.236187 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:14:43.236187 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:14:43.236187 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 21 21:14:43.236187 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 21 21:14:43.236187 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 21 21:14:43.236187 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 21 21:14:43.236187 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:14:43.236187 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:14:43.236187 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:14:43.236187 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:14:43.237563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e93c6206-710c-4ddb-b6f8-798b56195604 May 21 21:14:43.237563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:43.237563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:43.237563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:43.237563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:43.237563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 21 21:14:43.237563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 21 21:14:43.237563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 21 21:14:43.237563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 21 21:14:43.237563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 21 21:14:43.237563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 21 21:14:43.237563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 21 21:14:43.237563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 21 21:14:43.237563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 21 21:14:43.237563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 21 21:14:43.237563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:14:43.237563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:14:43.237563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 21 21:14:43.237563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 21 21:14:43.239153 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:14:43.239153 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:14:43.239153 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 21 21:14:43.239153 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 21 21:14:43.239153 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 21 21:14:43.239153 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 21 21:14:43.239153 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:14:43.239153 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:14:43.239153 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:14:43.239153 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:14:43.239153 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e93c6206-710c-4ddb-b6f8-798b56195604 could not be found. May 21 21:14:43.239153 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:43.239153 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:43.239153 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:43.239153 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:43.239153 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:43.239153 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:43.239153 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:43.239153 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:43.240632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:43.240632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:43.240632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:43.240632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:43.240632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:14:43.240632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:14:43.240632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all May 21 21:14:43.240632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 21 21:14:43.240632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 21 21:14:43.240632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 21 21:14:43.240632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:14:43.240632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:43.240632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:43.240632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:43.240632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:43.240632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:43.240632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:43.240632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:43.240632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:43.240632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:14:43.240632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:43.245977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a5fc6542-02cf-4aff-81d5-65e12e2a1608 tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] Returning 404 to user: Image not found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:43.245977 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a5fc6542-02cf-4aff-81d5-65e12e2a1608 tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] 10.222.0.49 "PUT /compute/v2.1/images/e93c6206-710c-4ddb-b6f8-798b56195604/metadata" status: 404 len: 62 microversion: 2.1 time: 0.046249 May 21 21:14:43.245977 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 597/1214] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:14:43 2022] PUT /compute/v2.1/images/e93c6206-710c-4ddb-b6f8-798b56195604/metadata => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:14:43.371153 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-72317a0a-0543-4dfd-af1d-b2f446afc811 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Calling method '.version_select at 0x7fc81b1fc940>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:43.372507 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:43.372507 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:14:43.374531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72317a0a-0543-4dfd-af1d-b2f446afc811 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:43.375187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72317a0a-0543-4dfd-af1d-b2f446afc811 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:43.376003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72317a0a-0543-4dfd-af1d-b2f446afc811 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:43.376470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72317a0a-0543-4dfd-af1d-b2f446afc811 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:43.405434 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-72317a0a-0543-4dfd-af1d-b2f446afc811 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.160958 May 21 21:14:43.406311 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 598/1215] 10.222.0.49 () {58 vars in 1127 bytes} [Sat May 21 21:14:43 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:43.411316 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-98d1f756-dc2e-4802-a1f2-a17a83dfe47a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:43.411973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-98d1f756-dc2e-4802-a1f2-a17a83dfe47a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:43.418216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98d1f756-dc2e-4802-a1f2-a17a83dfe47a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:43.418660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98d1f756-dc2e-4802-a1f2-a17a83dfe47a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:43.419428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98d1f756-dc2e-4802-a1f2-a17a83dfe47a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:43.419852 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98d1f756-dc2e-4802-a1f2-a17a83dfe47a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:43.478437 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b31adf9a-91aa-4626-b9f1-a75866cdebcc tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/2d52ba77-aafd-41de-8e06-bc696b1be581" status: 202 len: 0 microversion: 2.1 time: 1.831052 May 21 21:14:43.482284 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 618/1216] 10.222.0.49 () {58 vars in 1262 bytes} [Sat May 21 21:14:41 2022] DELETE /compute/v2.1/os-floating-ips/2d52ba77-aafd-41de-8e06-bc696b1be581 => generated 0 bytes in 1832 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:14:43.483902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f6a1168b-6def-4e3f-bef3-e8861c25b2a1 tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] Action: 'update', calling method: .version_select at 0x7fc81b4ad160>, body: {"meta": {"os_distro": "alt"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:43.507440 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-f6a1168b-6def-4e3f-bef3-e8861c25b2a1 tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] HTTP exception thrown: Image not found. May 21 21:14:43.511539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f6a1168b-6def-4e3f-bef3-e8861c25b2a1 tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] Request method failure captured: May 21 21:14:43.511539 ncdv-master-1 devstack@n-api.service[131278]: request: PUT /compute/v2.1/images/83c3387d-9d8f-4202-b009-f70c106c5c75/metadata/os_distro HTTP/1.1 May 21 21:14:43.511539 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:14:43.511539 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:14:43.511539 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:14:43.511539 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 30 May 21 21:14:43.511539 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:14:43.511539 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:14:43.511539 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:14:43.511539 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:14:43.511539 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZApBMAq4H62BrM2bNBGXwFRLxVa-hQ15XtjiT8vvTKgBz6AC-ccSH3gQms5fe-U0n7oHePEF9Gio_6-vItqzVEKMClxDxumvi0MIblM8ZiuLG6q05QxwHG0bd-CJRU6bXv7VU1e6xFPGjE-AVaWwyUzXO8ciTFR6hENXQTw0TaUFU May 21 21:14:43.511539 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:14:43.511539 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:14:43.511539 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:14:43.511539 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:14:43.511539 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:14:43.511539 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:14:43.511539 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 41cac259fef24da3989dbc7944b5c9e1 May 21 21:14:43.511539 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1305059096 May 21 21:14:43.511539 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:14:43.511539 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:14:43.513228 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/41cac259fef24da3989dbc7944b5c9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41cac259fef24da3989dbc7944b5c9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_41cac259fef24da3989dbc7944b5c9e1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41cac259fef24da3989dbc7944b5c9e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:43.513228 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1305059096 May 21 21:14:43.513228 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 41cac259fef24da3989dbc7944b5c9e1 May 21 21:14:43.513228 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1305059096 May 21 21:14:43.513228 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesMetadataNegativeTestJSON-1305059096-project May 21 21:14:43.513228 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:14:43.513228 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:14:43.513228 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 65ededecccee49929eae51096bb3349e May 21 21:14:43.513228 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1305059096-project May 21 21:14:43.513228 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:14:43.513228 ncdv-master-1 devstack@n-api.service[131278]: {"meta": {"os_distro": "alt"}} May 21 21:14:43.513228 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:14:43.513228 ncdv-master-1 devstack@n-api.service[131278]: exception: Image not found. May 21 21:14:43.513228 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'image_id': '83c3387d-9d8f-4202-b009-f70c106c5c75', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} May 21 21:14:43.516796 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:43.516796 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:43.516796 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 21 21:14:43.516796 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 21 21:14:43.516796 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:14:43.516796 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:14:43.516796 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 21 21:14:43.516796 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 21 21:14:43.516796 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:14:43.516796 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:14:43.516796 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 21 21:14:43.516796 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 21 21:14:43.516796 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 21 21:14:43.516796 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 21 21:14:43.516796 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:14:43.516796 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:14:43.516796 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:14:43.516796 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:14:43.518294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 83c3387d-9d8f-4202-b009-f70c106c5c75 May 21 21:14:43.518294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:43.518294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:43.518294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:43.518294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:43.518294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 21 21:14:43.518294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 21 21:14:43.518294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 21 21:14:43.518294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 21 21:14:43.518294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 21 21:14:43.518294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 21 21:14:43.518294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 21 21:14:43.518294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 21 21:14:43.518294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 21 21:14:43.518294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 21 21:14:43.518294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:14:43.518294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:14:43.518294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 21 21:14:43.518294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 21 21:14:43.519714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:14:43.519714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:14:43.519714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 21 21:14:43.519714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 21 21:14:43.519714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 21 21:14:43.519714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 21 21:14:43.519714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:14:43.519714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:14:43.519714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:14:43.519714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:14:43.519714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 83c3387d-9d8f-4202-b009-f70c106c5c75 could not be found. May 21 21:14:43.519714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:43.519714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:43.519714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:43.519714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:43.519714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:43.519714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:43.519714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:43.519714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:43.521482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:43.521482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:43.521482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:43.521482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:43.521482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:14:43.521482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:14:43.521482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update May 21 21:14:43.521482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 21 21:14:43.521482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 21 21:14:43.521482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 21 21:14:43.521482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:14:43.521482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:43.521482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:43.521482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:43.521482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:43.521482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:43.521482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:43.521482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:43.521482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:43.521482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:14:43.521482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:43.523095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f6a1168b-6def-4e3f-bef3-e8861c25b2a1 tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] Returning 404 to user: Image not found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:43.523095 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f6a1168b-6def-4e3f-bef3-e8861c25b2a1 tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] 10.222.0.49 "PUT /compute/v2.1/images/83c3387d-9d8f-4202-b009-f70c106c5c75/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.033002 May 21 21:14:43.523095 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 619/1217] 10.222.0.49 () {60 vars in 1309 bytes} [Sat May 21 21:14:43 2022] PUT /compute/v2.1/images/83c3387d-9d8f-4202-b009-f70c106c5c75/metadata/os_distro => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:14:43.693048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-98d1f756-dc2e-4802-a1f2-a17a83dfe47a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:43.703802 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-98d1f756-dc2e-4802-a1f2-a17a83dfe47a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1540 microversion: 2.1 time: 0.296220 May 21 21:14:43.705213 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 599/1218] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:43 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1540 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:43.718809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-953ad472-9699-45f2-aaf5-c75de2688e29 tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] Calling method '.version_select at 0x7fc81b2cd0d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:43.725647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8f7494f8-053d-47d7-86bb-319c4ac9def2 tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Calling method '.version_select at 0x7fc81b497a60>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:43.726985 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:43.726985 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:14:43.729963 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8f7494f8-053d-47d7-86bb-319c4ac9def2 tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '67ecde1a6ec544dc9081ff5cab085f27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f59b3530b453992cdf02f9418f054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:43.732168 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8f7494f8-053d-47d7-86bb-319c4ac9def2 tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Request method failure captured: May 21 21:14:43.732168 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-hosts HTTP/1.1 May 21 21:14:43.732168 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:14:43.732168 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:14:43.732168 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:14:43.732168 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:14:43.732168 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:14:43.732168 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:14:43.732168 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:14:43.732168 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:14:43.732168 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZBfq4_p1cJ3dwh9cyMpezwzptDANlK1izwvKw3RAzctprYspoVJjDW9SfMomkjfr_DSPypcjz-5e4PhwA6Ibl2AxCoJ_ZS6dpQks1oatB3WYU7b1ftM1LJCADy5LELq81l6P5qwoyqGPHMaVnuE_R9OKCjdDmmRKiJPvex7RC50Z0 May 21 21:14:43.732168 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:14:43.732168 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:14:43.732168 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:14:43.732168 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:14:43.732168 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:14:43.732168 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:14:43.732168 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 6f8f59b3530b453992cdf02f9418f054 May 21 21:14:43.732168 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-205626687 May 21 21:14:43.732168 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:14:43.732168 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:14:43.733571 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6f8f59b3530b453992cdf02f9418f054"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6f8f59b3530b453992cdf02f9418f054"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6f8f59b3530b453992cdf02f9418f054", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6f8f59b3530b453992cdf02f9418f054"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:43.733571 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-HostsAdminNegativeTestJSON-205626687 May 21 21:14:43.733571 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 6f8f59b3530b453992cdf02f9418f054 May 21 21:14:43.733571 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-205626687 May 21 21:14:43.733571 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-HostsAdminNegativeTestJSON-205626687-project May 21 21:14:43.733571 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:14:43.733571 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:14:43.733571 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 67ecde1a6ec544dc9081ff5cab085f27 May 21 21:14:43.733571 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-HostsAdminNegativeTestJSON-205626687-project May 21 21:14:43.733571 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:14:43.733571 ncdv-master-1 devstack@n-api.service[131278]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 21 21:14:43.733571 ncdv-master-1 devstack@n-api.service[131278]: action_args: {} May 21 21:14:43.733571 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:43.734419 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:43.734419 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:43.734419 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:43.734419 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:43.734419 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:43.734419 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:43.734419 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:43.734419 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 21:14:43.734419 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:14:43.734419 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:43.734419 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:43.734419 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index May 21 21:14:43.734419 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', May 21 21:14:43.734419 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:14:43.734419 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:14:43.734419 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:14:43.734419 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:14:43.734419 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:14:43.734419 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:14:43.735603 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:14:43.735603 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:14:43.735603 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:14:43.735603 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:14:43.735603 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:14:43.735603 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:14:43.735603 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:14:43.735603 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:14:43.735603 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 21 21:14:43.735603 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:43.735603 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:43.735603 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:43.735603 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:43.735603 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:43.735603 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:43.735603 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:14:43.735603 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:14:43.735603 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 21 21:14:43.735603 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:43.740312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8f7494f8-053d-47d7-86bb-319c4ac9def2 tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:43.743251 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8f7494f8-053d-47d7-86bb-319c4ac9def2 tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] 10.222.0.49 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.226673 May 21 21:14:43.745253 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 620/1219] 10.222.0.49 () {58 vars in 1127 bytes} [Sat May 21 21:14:43 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 229 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:14:43.764866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a9f4feda-929e-4bfb-9ec1-b74183c47c2d tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] Action: 'create', calling method: .version_select at 0x7fc81b4d3f70>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:43.791984 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-a9f4feda-929e-4bfb-9ec1-b74183c47c2d tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] HTTP exception thrown: Image not found. May 21 21:14:43.798701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a9f4feda-929e-4bfb-9ec1-b74183c47c2d tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] Request method failure captured: May 21 21:14:43.798701 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/images/0361b204-a30a-4cca-84dc-380375dc8a0b/metadata HTTP/1.1 May 21 21:14:43.798701 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:14:43.798701 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:14:43.798701 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:14:43.798701 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 57 May 21 21:14:43.798701 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:14:43.798701 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:14:43.798701 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:14:43.798701 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:14:43.798701 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZApBMAq4H62BrM2bNBGXwFRLxVa-hQ15XtjiT8vvTKgBz6AC-ccSH3gQms5fe-U0n7oHePEF9Gio_6-vItqzVEKMClxDxumvi0MIblM8ZiuLG6q05QxwHG0bd-CJRU6bXv7VU1e6xFPGjE-AVaWwyUzXO8ciTFR6hENXQTw0TaUFU May 21 21:14:43.798701 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:14:43.798701 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:14:43.798701 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:14:43.798701 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:14:43.798701 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:14:43.798701 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:14:43.798701 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 41cac259fef24da3989dbc7944b5c9e1 May 21 21:14:43.798701 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1305059096 May 21 21:14:43.798701 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:14:43.798701 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:14:43.800375 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/41cac259fef24da3989dbc7944b5c9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41cac259fef24da3989dbc7944b5c9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_41cac259fef24da3989dbc7944b5c9e1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41cac259fef24da3989dbc7944b5c9e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:43.800375 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1305059096 May 21 21:14:43.800375 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 41cac259fef24da3989dbc7944b5c9e1 May 21 21:14:43.800375 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1305059096 May 21 21:14:43.800375 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesMetadataNegativeTestJSON-1305059096-project May 21 21:14:43.800375 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:14:43.800375 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:14:43.800375 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 65ededecccee49929eae51096bb3349e May 21 21:14:43.800375 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1305059096-project May 21 21:14:43.800375 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:14:43.800375 ncdv-master-1 devstack@n-api.service[131278]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} May 21 21:14:43.800375 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:14:43.800375 ncdv-master-1 devstack@n-api.service[131278]: exception: Image not found. May 21 21:14:43.800375 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'image_id': '0361b204-a30a-4cca-84dc-380375dc8a0b', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} May 21 21:14:43.801958 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:43.801958 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:43.801958 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 21 21:14:43.801958 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 21 21:14:43.801958 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:14:43.801958 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:14:43.801958 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 21 21:14:43.801958 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 21 21:14:43.801958 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:14:43.801958 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:14:43.801958 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 21 21:14:43.801958 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 21 21:14:43.801958 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 21 21:14:43.801958 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 21 21:14:43.801958 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:14:43.801958 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:14:43.801958 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:14:43.801958 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:14:43.803443 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0361b204-a30a-4cca-84dc-380375dc8a0b May 21 21:14:43.803443 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:43.803443 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:43.803443 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:43.803443 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:43.803443 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 21 21:14:43.803443 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 21 21:14:43.803443 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 21 21:14:43.803443 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 21 21:14:43.803443 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 21 21:14:43.803443 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 21 21:14:43.803443 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 21 21:14:43.803443 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 21 21:14:43.803443 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 21 21:14:43.803443 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 21 21:14:43.803443 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:14:43.803443 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:14:43.803443 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 21 21:14:43.803443 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 21 21:14:43.807279 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:14:43.807279 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:14:43.807279 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 21 21:14:43.807279 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 21 21:14:43.807279 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 21 21:14:43.807279 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 21 21:14:43.807279 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:14:43.807279 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:14:43.807279 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:14:43.807279 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:14:43.807279 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0361b204-a30a-4cca-84dc-380375dc8a0b could not be found. May 21 21:14:43.807279 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:43.807279 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:43.807279 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:43.807279 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:43.807279 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:43.807279 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:43.807279 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:43.807279 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:43.808730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:43.808730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:43.808730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:43.808730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:43.808730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:14:43.808730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:14:43.808730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create May 21 21:14:43.808730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 21 21:14:43.808730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 21 21:14:43.808730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 21 21:14:43.808730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:14:43.808730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:43.808730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:43.808730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:43.808730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:43.808730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:43.808730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:43.808730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:43.808730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:43.808730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:14:43.808730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:43.811021 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a9f4feda-929e-4bfb-9ec1-b74183c47c2d tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] Returning 404 to user: Image not found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:43.811021 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a9f4feda-929e-4bfb-9ec1-b74183c47c2d tempest-ImagesMetadataNegativeTestJSON-1305059096 tempest-ImagesMetadataNegativeTestJSON-1305059096-project] 10.222.0.49 "POST /compute/v2.1/images/0361b204-a30a-4cca-84dc-380375dc8a0b/metadata" status: 404 len: 62 microversion: 2.1 time: 0.057115 May 21 21:14:43.811021 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 621/1220] 10.222.0.49 () {60 vars in 1280 bytes} [Sat May 21 21:14:43 2022] POST /compute/v2.1/images/0361b204-a30a-4cca-84dc-380375dc8a0b/metadata => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:14:43.813089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f63abdbd-4222-42b2-88be-c8a993c13886 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:43.813687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f63abdbd-4222-42b2-88be-c8a993c13886 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:43.845517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f63abdbd-4222-42b2-88be-c8a993c13886 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:43.846240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f63abdbd-4222-42b2-88be-c8a993c13886 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:43.847235 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f63abdbd-4222-42b2-88be-c8a993c13886 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:43.848492 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f63abdbd-4222-42b2-88be-c8a993c13886 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:43.899173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG neutronclient.v2_0.client [None req-953ad472-9699-45f2-aaf5-c75de2688e29 tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2d52ba77-aafd-41de-8e06-bc696b1be581 could not be found", "detail": ""}} {{(pid=131277) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:14:43.900092 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-953ad472-9699-45f2-aaf5-c75de2688e29 tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] HTTP exception thrown: Floating IP not found for ID 2d52ba77-aafd-41de-8e06-bc696b1be581 May 21 21:14:43.903911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-953ad472-9699-45f2-aaf5-c75de2688e29 tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] Request method failure captured: May 21 21:14:43.903911 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/os-floating-ips/2d52ba77-aafd-41de-8e06-bc696b1be581 HTTP/1.1 May 21 21:14:43.903911 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:43.903911 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:43.903911 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:43.903911 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:14:43.903911 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:43.903911 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:43.903911 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:43.903911 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:43.903911 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVY0OccbUPOst6VweKS4lSXhz4lJBreiUbDx0lWHMpNsWQ4t6q8dSiyvmtMY6LlgYnHWP_OUIxUpRHvO82UnyoXjDF8Pi5GxqirgLSHLNGhLIgV84uwq6NFkL-ZZ85hjy0Ix_dVT4L0kCdGLVAvtAiVOmyemuPCHTt7VFQx-8tCoG7o May 21 21:14:43.903911 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:43.903911 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:43.903911 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:43.903911 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:43.903911 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:43.903911 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:43.903911 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 8a4b0440c9bd489f811a331cd2d5732e May 21 21:14:43.903911 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-FloatingIPsTestJSON-1551424312 May 21 21:14:43.903911 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:14:43.903911 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:14:43.905725 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8a4b0440c9bd489f811a331cd2d5732e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8a4b0440c9bd489f811a331cd2d5732e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8a4b0440c9bd489f811a331cd2d5732e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8a4b0440c9bd489f811a331cd2d5732e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:43.905725 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-FloatingIPsTestJSON-1551424312 May 21 21:14:43.905725 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 8a4b0440c9bd489f811a331cd2d5732e May 21 21:14:43.905725 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1551424312 May 21 21:14:43.905725 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-FloatingIPsTestJSON-1551424312-project May 21 21:14:43.905725 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:43.905725 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:43.905725 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 49431d4a790545538bd793694f6ff840 May 21 21:14:43.905725 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-FloatingIPsTestJSON-1551424312-project May 21 21:14:43.905725 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:14:43.905725 ncdv-master-1 devstack@n-api.service[131277]: exception: Floating IP not found for ID 2d52ba77-aafd-41de-8e06-bc696b1be581 May 21 21:14:43.905725 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '2d52ba77-aafd-41de-8e06-bc696b1be581'} May 21 21:14:43.905725 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:43.906726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:43.906726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip May 21 21:14:43.906726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 21 21:14:43.906726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:14:43.906726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:14:43.906726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 21 21:14:43.906726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 21 21:14:43.906726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:14:43.906726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:14:43.906726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 21 21:14:43.906726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 21 21:14:43.906726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:14:43.906726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:14:43.906726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:14:43.906726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:14:43.906726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:14:43.906726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:14:43.906726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:14:43.906726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:14:43.908245 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:14:43.908245 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:14:43.908245 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:14:43.908245 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:14:43.908245 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:14:43.908245 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:14:43.908245 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2d52ba77-aafd-41de-8e06-bc696b1be581 could not be found May 21 21:14:43.908245 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5bce3a1c-d77a-48a9-ad7b-8f09e16b1fdb'] May 21 21:14:43.908245 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:43.908245 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:43.908245 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:43.908245 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:43.908245 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show May 21 21:14:43.908245 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 21 21:14:43.908245 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip May 21 21:14:43.908245 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 21 21:14:43.908245 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2d52ba77-aafd-41de-8e06-bc696b1be581. May 21 21:14:43.908245 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:43.908245 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:43.908245 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:43.910054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:43.910054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:43.910054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:43.910054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:43.910054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:43.910054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:43.910054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:43.910054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:43.910054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:43.910054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show May 21 21:14:43.910054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 21 21:14:43.910054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2d52ba77-aafd-41de-8e06-bc696b1be581 May 21 21:14:43.910054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:43.910054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:43.910054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:43.910054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:43.910054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:43.910054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:43.910054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:43.910054 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:43.911575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2d52ba77-aafd-41de-8e06-bc696b1be581 May 21 21:14:43.911575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:43.913053 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-953ad472-9699-45f2-aaf5-c75de2688e29 tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] Returning 404 to user: Floating IP not found for ID 2d52ba77-aafd-41de-8e06-bc696b1be581 {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:43.914123 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-953ad472-9699-45f2-aaf5-c75de2688e29 tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips/2d52ba77-aafd-41de-8e06-bc696b1be581" status: 404 len: 111 microversion: 2.1 time: 0.203432 May 21 21:14:43.915055 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 600/1221] 10.222.0.49 () {58 vars in 1259 bytes} [Sat May 21 21:14:43 2022] GET /compute/v2.1/os-floating-ips/2d52ba77-aafd-41de-8e06-bc696b1be581 => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:14:43.923232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-549137fa-3069-43cb-be89-15c9831f2135 tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Calling method '.version_select at 0x7fc81b2bcaf0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:43.924498 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:43.924498 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:14:43.926157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-549137fa-3069-43cb-be89-15c9831f2135 tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '67ecde1a6ec544dc9081ff5cab085f27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f59b3530b453992cdf02f9418f054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:43.928776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-549137fa-3069-43cb-be89-15c9831f2135 tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Request method failure captured: May 21 21:14:43.928776 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/reboot HTTP/1.1 May 21 21:14:43.928776 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:43.928776 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:43.928776 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:43.928776 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:14:43.928776 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:43.928776 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:43.928776 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:43.928776 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:43.928776 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZBfq4_p1cJ3dwh9cyMpezwzptDANlK1izwvKw3RAzctprYspoVJjDW9SfMomkjfr_DSPypcjz-5e4PhwA6Ibl2AxCoJ_ZS6dpQks1oatB3WYU7b1ftM1LJCADy5LELq81l6P5qwoyqGPHMaVnuE_R9OKCjdDmmRKiJPvex7RC50Z0 May 21 21:14:43.928776 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:43.928776 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:43.928776 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:43.928776 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:43.928776 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:43.928776 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:43.928776 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 6f8f59b3530b453992cdf02f9418f054 May 21 21:14:43.928776 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-205626687 May 21 21:14:43.928776 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:14:43.928776 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:14:43.933975 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6f8f59b3530b453992cdf02f9418f054"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6f8f59b3530b453992cdf02f9418f054"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6f8f59b3530b453992cdf02f9418f054", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6f8f59b3530b453992cdf02f9418f054"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:43.933975 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-HostsAdminNegativeTestJSON-205626687 May 21 21:14:43.933975 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 6f8f59b3530b453992cdf02f9418f054 May 21 21:14:43.933975 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-205626687 May 21 21:14:43.933975 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-HostsAdminNegativeTestJSON-205626687-project May 21 21:14:43.933975 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:43.933975 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:43.933975 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 67ecde1a6ec544dc9081ff5cab085f27 May 21 21:14:43.933975 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-HostsAdminNegativeTestJSON-205626687-project May 21 21:14:43.933975 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:14:43.933975 ncdv-master-1 devstack@n-api.service[131277]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 21 21:14:43.933975 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'ncdv-master-1'} May 21 21:14:43.933975 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:43.935711 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:43.935711 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:43.935711 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:43.935711 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:43.935711 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:43.935711 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:43.935711 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:43.935711 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:43.935711 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:43.935711 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot May 21 21:14:43.935711 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', May 21 21:14:43.935711 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:14:43.935711 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:14:43.935711 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:14:43.935711 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:14:43.935711 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:14:43.935711 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:14:43.935711 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:14:43.935711 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:14:43.936974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:14:43.936974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:14:43.936974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:14:43.936974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:14:43.936974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:14:43.936974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:14:43.936974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 21 21:14:43.936974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:43.936974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:43.936974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:43.936974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:43.936974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:43.936974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:43.936974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:14:43.936974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:14:43.936974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 21 21:14:43.936974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:43.938178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-549137fa-3069-43cb-be89-15c9831f2135 tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:43.938178 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-549137fa-3069-43cb-be89-15c9831f2135 tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] 10.222.0.49 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.012710 May 21 21:14:43.938178 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 601/1222] 10.222.0.49 () {58 vars in 1190 bytes} [Sat May 21 21:14:43 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:14:43.946424 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0fcae9fa-d975-4508-983a-4b8b6031cda8 tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] Calling method '.version_select at 0x7fc81b2bc160>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:44.042015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG neutronclient.v2_0.client [None req-0fcae9fa-d975-4508-983a-4b8b6031cda8 tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2d52ba77-aafd-41de-8e06-bc696b1be581 could not be found", "detail": ""}} {{(pid=131277) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:14:44.043059 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-0fcae9fa-d975-4508-983a-4b8b6031cda8 tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] HTTP exception thrown: Floating IP not found for ID 2d52ba77-aafd-41de-8e06-bc696b1be581 May 21 21:14:44.045090 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0fcae9fa-d975-4508-983a-4b8b6031cda8 tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] Request method failure captured: May 21 21:14:44.045090 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/os-floating-ips/2d52ba77-aafd-41de-8e06-bc696b1be581 HTTP/1.1 May 21 21:14:44.045090 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:44.045090 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:44.045090 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:44.045090 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:14:44.045090 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:44.045090 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:44.045090 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:44.045090 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:44.045090 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVY0OccbUPOst6VweKS4lSXhz4lJBreiUbDx0lWHMpNsWQ4t6q8dSiyvmtMY6LlgYnHWP_OUIxUpRHvO82UnyoXjDF8Pi5GxqirgLSHLNGhLIgV84uwq6NFkL-ZZ85hjy0Ix_dVT4L0kCdGLVAvtAiVOmyemuPCHTt7VFQx-8tCoG7o May 21 21:14:44.045090 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:44.045090 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:44.045090 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:44.045090 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:44.045090 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:44.045090 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:44.045090 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 8a4b0440c9bd489f811a331cd2d5732e May 21 21:14:44.045090 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-FloatingIPsTestJSON-1551424312 May 21 21:14:44.045090 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:14:44.045090 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:14:44.046595 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8a4b0440c9bd489f811a331cd2d5732e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8a4b0440c9bd489f811a331cd2d5732e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8a4b0440c9bd489f811a331cd2d5732e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8a4b0440c9bd489f811a331cd2d5732e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:44.046595 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-FloatingIPsTestJSON-1551424312 May 21 21:14:44.046595 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 8a4b0440c9bd489f811a331cd2d5732e May 21 21:14:44.046595 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1551424312 May 21 21:14:44.046595 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-FloatingIPsTestJSON-1551424312-project May 21 21:14:44.046595 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:44.046595 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:44.046595 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 49431d4a790545538bd793694f6ff840 May 21 21:14:44.046595 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-FloatingIPsTestJSON-1551424312-project May 21 21:14:44.046595 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:14:44.046595 ncdv-master-1 devstack@n-api.service[131277]: exception: Floating IP not found for ID 2d52ba77-aafd-41de-8e06-bc696b1be581 May 21 21:14:44.046595 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '2d52ba77-aafd-41de-8e06-bc696b1be581'} May 21 21:14:44.046595 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:44.047585 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:44.047585 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip May 21 21:14:44.047585 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 21 21:14:44.047585 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:14:44.047585 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:14:44.047585 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 21 21:14:44.047585 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 21 21:14:44.047585 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:14:44.047585 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:14:44.047585 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 21 21:14:44.047585 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 21 21:14:44.047585 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:14:44.047585 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:14:44.047585 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:14:44.047585 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:14:44.047585 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:14:44.047585 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:14:44.047585 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:14:44.047585 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:14:44.048865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:14:44.048865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:14:44.048865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:14:44.048865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:14:44.048865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:14:44.048865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:14:44.048865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2d52ba77-aafd-41de-8e06-bc696b1be581 could not be found May 21 21:14:44.048865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8f38bfa-672b-4042-8be0-bb945a672b75'] May 21 21:14:44.048865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:44.048865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:44.048865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:44.048865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:44.048865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete May 21 21:14:44.048865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 21 21:14:44.048865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip May 21 21:14:44.048865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 21 21:14:44.048865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2d52ba77-aafd-41de-8e06-bc696b1be581. May 21 21:14:44.048865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:44.048865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:44.048865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:44.050254 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:44.050254 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:44.050254 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:44.050254 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:44.050254 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:44.050254 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:44.050254 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:44.050254 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:44.050254 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:44.050254 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete May 21 21:14:44.050254 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 21 21:14:44.050254 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2d52ba77-aafd-41de-8e06-bc696b1be581 May 21 21:14:44.050254 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:44.050254 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:44.050254 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:44.050254 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:44.050254 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:44.050254 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:44.050254 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:44.050254 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:44.051474 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2d52ba77-aafd-41de-8e06-bc696b1be581 May 21 21:14:44.051474 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:44.053187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0fcae9fa-d975-4508-983a-4b8b6031cda8 tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] Returning 404 to user: Floating IP not found for ID 2d52ba77-aafd-41de-8e06-bc696b1be581 {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:44.054459 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0fcae9fa-d975-4508-983a-4b8b6031cda8 tempest-FloatingIPsTestJSON-1551424312 tempest-FloatingIPsTestJSON-1551424312-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/2d52ba77-aafd-41de-8e06-bc696b1be581" status: 404 len: 111 microversion: 2.1 time: 0.122336 May 21 21:14:44.055508 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 602/1223] 10.222.0.49 () {58 vars in 1262 bytes} [Sat May 21 21:14:43 2022] DELETE /compute/v2.1/os-floating-ips/2d52ba77-aafd-41de-8e06-bc696b1be581 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:14:44.062304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a304b436-3e9c-4b63-9589-f24ea7fbcf78 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Calling method '.version_select at 0x7fc81b2f3670>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:44.080148 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-a304b436-3e9c-4b63-9589-f24ea7fbcf78 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:44.082605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a304b436-3e9c-4b63-9589-f24ea7fbcf78 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Request method failure captured: May 21 21:14:44.082605 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 May 21 21:14:44.082605 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:44.082605 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:44.082605 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:44.082605 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:14:44.082605 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:44.082605 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:44.082605 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:44.082605 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:44.082605 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZCwWQ7tfHD4hyaeA8zoOb73Y_tG0QfV7-qInDcqET3Wwf9nt8jcm9he_tdB8TCfmkoS8DyF06w9Lz-sdLWexoNY3VA2G0hDqSP5DXX6EWtlNU7dpdMF_tm67cgZL5U1PSmgRXkuwyM_WeQSpAe8pjt8eFscboNtrEjLmDHDXtSUdg May 21 21:14:44.082605 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:44.082605 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:44.082605 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:44.082605 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:44.082605 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:44.082605 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:44.082605 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 1a1084c31b02401b9c974f61140f3a01 May 21 21:14:44.082605 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:44.082605 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:14:44.082605 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:14:44.084011 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1a1084c31b02401b9c974f61140f3a01", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:44.084011 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:44.084011 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 1a1084c31b02401b9c974f61140f3a01 May 21 21:14:44.084011 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:44.084011 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-HostsAdminNegativeTestJSON-1586594302-project-admin May 21 21:14:44.084011 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:44.084011 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:44.084011 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 434aa53e258744eb8851a1839c5e4e6f May 21 21:14:44.084011 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1586594302-project-admin May 21 21:14:44.084011 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:14:44.084011 ncdv-master-1 devstack@n-api.service[131277]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:44.084011 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'nonexistent_hostname'} May 21 21:14:44.084011 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:44.084863 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:44.084863 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 21 21:14:44.084863 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 21 21:14:44.084863 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 21 21:14:44.084863 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 21 21:14:44.084863 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:14:44.084863 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:14:44.084863 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:14:44.084863 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:14:44.084863 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 21 21:14:44.084863 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 21 21:14:44.084863 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 21 21:14:44.084863 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 21 21:14:44.084863 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:14:44.084863 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:14:44.084863 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 21 21:14:44.084863 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 21 21:14:44.084863 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:14:44.084863 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:14:44.089311 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 21 21:14:44.089311 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 21 21:14:44.089311 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:44.089311 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:44.089311 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:44.089311 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:44.089311 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:44.089311 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:44.089311 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:44.089311 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:44.089311 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:44.089311 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:44.089311 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:44.089311 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:44.089311 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:44.089311 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot May 21 21:14:44.089311 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") May 21 21:14:44.089311 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 21 21:14:44.089311 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:14:44.091495 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:44.091495 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:44.091495 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:44.091495 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:44.091495 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:44.091495 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:44.091495 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:44.091495 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:44.091495 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:44.091495 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:44.091495 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:44.099417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a304b436-3e9c-4b63-9589-f24ea7fbcf78 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:44.100323 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a304b436-3e9c-4b63-9589-f24ea7fbcf78 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.043484 May 21 21:14:44.100937 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 603/1224] 10.222.0.49 () {58 vars in 1211 bytes} [Sat May 21 21:14:44 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:14:44.138840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b2567751-fdaf-466b-9cf7-a41d0a56cfa8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:44.138840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b2567751-fdaf-466b-9cf7-a41d0a56cfa8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:44.138840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2567751-fdaf-466b-9cf7-a41d0a56cfa8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:44.138840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2567751-fdaf-466b-9cf7-a41d0a56cfa8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:44.139336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2567751-fdaf-466b-9cf7-a41d0a56cfa8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:44.139336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2567751-fdaf-466b-9cf7-a41d0a56cfa8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:44.452711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b2567751-fdaf-466b-9cf7-a41d0a56cfa8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:44.470068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f63abdbd-4222-42b2-88be-c8a993c13886 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:44.471774 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b2567751-fdaf-466b-9cf7-a41d0a56cfa8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1534 microversion: 2.1 time: 0.353947 May 21 21:14:44.472948 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 604/1225] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:44 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1534 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:44.477872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-802d3966-1fb2-421e-b32b-2d8a2f3c529d tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Calling method '.version_select at 0x7fc81b1c71f0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:44.479408 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:44.479408 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:14:44.479714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f63abdbd-4222-42b2-88be-c8a993c13886 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:44.480534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-802d3966-1fb2-421e-b32b-2d8a2f3c529d tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '67ecde1a6ec544dc9081ff5cab085f27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f59b3530b453992cdf02f9418f054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:44.481065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f63abdbd-4222-42b2-88be-c8a993c13886 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:44.482242 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f63abdbd-4222-42b2-88be-c8a993c13886 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1645 microversion: 2.25 time: 0.675762 May 21 21:14:44.482790 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 622/1226] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:14:43 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1645 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:44.483839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-802d3966-1fb2-421e-b32b-2d8a2f3c529d tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Request method failure captured: May 21 21:14:44.483839 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 May 21 21:14:44.483839 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:44.483839 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:44.483839 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:44.483839 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:14:44.483839 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:44.483839 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:44.483839 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:44.483839 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:44.483839 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZBfq4_p1cJ3dwh9cyMpezwzptDANlK1izwvKw3RAzctprYspoVJjDW9SfMomkjfr_DSPypcjz-5e4PhwA6Ibl2AxCoJ_ZS6dpQks1oatB3WYU7b1ftM1LJCADy5LELq81l6P5qwoyqGPHMaVnuE_R9OKCjdDmmRKiJPvex7RC50Z0 May 21 21:14:44.483839 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:44.483839 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:44.483839 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:44.483839 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:44.483839 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:44.483839 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:44.483839 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 6f8f59b3530b453992cdf02f9418f054 May 21 21:14:44.483839 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-205626687 May 21 21:14:44.483839 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:14:44.483839 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:14:44.485264 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6f8f59b3530b453992cdf02f9418f054"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6f8f59b3530b453992cdf02f9418f054"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6f8f59b3530b453992cdf02f9418f054", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6f8f59b3530b453992cdf02f9418f054"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:44.485264 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-HostsAdminNegativeTestJSON-205626687 May 21 21:14:44.485264 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 6f8f59b3530b453992cdf02f9418f054 May 21 21:14:44.485264 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-205626687 May 21 21:14:44.485264 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-HostsAdminNegativeTestJSON-205626687-project May 21 21:14:44.485264 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:44.485264 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:44.485264 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 67ecde1a6ec544dc9081ff5cab085f27 May 21 21:14:44.485264 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-HostsAdminNegativeTestJSON-205626687-project May 21 21:14:44.485264 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:14:44.485264 ncdv-master-1 devstack@n-api.service[131277]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 21 21:14:44.485264 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'ncdv-master-1'} May 21 21:14:44.485264 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:44.486152 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:44.486152 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:44.486152 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:44.486152 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:44.486152 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:44.486152 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:44.486152 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:44.486152 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:44.486152 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:44.486152 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show May 21 21:14:44.486152 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', May 21 21:14:44.486152 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:14:44.486152 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:14:44.486152 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:14:44.486152 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:14:44.486152 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:14:44.486152 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:14:44.486152 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:14:44.486152 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:14:44.487306 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:14:44.487306 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:14:44.487306 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:14:44.487306 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:14:44.487306 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:14:44.487306 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:14:44.487306 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 21 21:14:44.487306 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:44.487306 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:44.487306 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:44.487306 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:44.487306 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:44.487306 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:44.487306 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:14:44.487306 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:14:44.487306 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 21 21:14:44.487306 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:44.488458 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-802d3966-1fb2-421e-b32b-2d8a2f3c529d tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:44.491131 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-802d3966-1fb2-421e-b32b-2d8a2f3c529d tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] 10.222.0.49 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.011362 May 21 21:14:44.491812 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 605/1227] 10.222.0.49 () {58 vars in 1169 bytes} [Sat May 21 21:14:44 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:14:44.505464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-629f6ef0-2b42-4024-b3ba-596bb2ea899e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:44.506539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-629f6ef0-2b42-4024-b3ba-596bb2ea899e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:44.506866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-03a2c11d-b078-48c9-9685-285d55ad6cd9 req-07b093a4-436c-4b2f-8b85-46f5618a121a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b58aadd3-11a8-41dc-9104-b6082e4eeb06", "name": "network-vif-plugged", "status": "completed", "tag": "45d0dcd8-6e01-48f0-a3c7-19f72707d0d7"}, {"server_uuid": "f0525194-b3aa-482c-a355-c77c63bf4c88", "name": "network-vif-plugged", "status": "completed", "tag": "5eb403c4-fa1f-43de-83df-5b9059a1b1b1"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:44.526756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-629f6ef0-2b42-4024-b3ba-596bb2ea899e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:44.530131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-03a2c11d-b078-48c9-9685-285d55ad6cd9 req-07b093a4-436c-4b2f-8b85-46f5618a121a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:44.530827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-03a2c11d-b078-48c9-9685-285d55ad6cd9 req-07b093a4-436c-4b2f-8b85-46f5618a121a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:44.536651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-629f6ef0-2b42-4024-b3ba-596bb2ea899e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:44.538946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-629f6ef0-2b42-4024-b3ba-596bb2ea899e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:44.542825 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-629f6ef0-2b42-4024-b3ba-596bb2ea899e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:44.545896 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-03a2c11d-b078-48c9-9685-285d55ad6cd9 req-07b093a4-436c-4b2f-8b85-46f5618a121a service nova] Creating event network-vif-plugged:45d0dcd8-6e01-48f0-a3c7-19f72707d0d7 for instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 on nch1-master-1 May 21 21:14:44.548032 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-03a2c11d-b078-48c9-9685-285d55ad6cd9 req-07b093a4-436c-4b2f-8b85-46f5618a121a service nova] Creating event network-vif-plugged:5eb403c4-fa1f-43de-83df-5b9059a1b1b1 for instance f0525194-b3aa-482c-a355-c77c63bf4c88 on nch2-master-1 May 21 21:14:44.563841 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-03a2c11d-b078-48c9-9685-285d55ad6cd9 req-07b093a4-436c-4b2f-8b85-46f5618a121a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068311 May 21 21:14:44.565396 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 623/1228] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:44.575634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2f493466-28e2-4bb8-94e0-df6fc25d1b36 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Calling method '.version_select at 0x7fc81b3c0280>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:44.576783 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:44.576783 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:14:44.590841 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-2f493466-28e2-4bb8-94e0-df6fc25d1b36 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:44.595300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2f493466-28e2-4bb8-94e0-df6fc25d1b36 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Request method failure captured: May 21 21:14:44.595300 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 May 21 21:14:44.595300 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:14:44.595300 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:14:44.595300 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:14:44.595300 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:14:44.595300 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:14:44.595300 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:14:44.595300 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:14:44.595300 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:14:44.595300 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZCwWQ7tfHD4hyaeA8zoOb73Y_tG0QfV7-qInDcqET3Wwf9nt8jcm9he_tdB8TCfmkoS8DyF06w9Lz-sdLWexoNY3VA2G0hDqSP5DXX6EWtlNU7dpdMF_tm67cgZL5U1PSmgRXkuwyM_WeQSpAe8pjt8eFscboNtrEjLmDHDXtSUdg May 21 21:14:44.595300 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:14:44.595300 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:14:44.595300 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:14:44.595300 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:14:44.595300 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:14:44.595300 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:14:44.595300 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 1a1084c31b02401b9c974f61140f3a01 May 21 21:14:44.595300 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:44.595300 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,admin,member May 21 21:14:44.595300 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,admin,member May 21 21:14:44.596803 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1a1084c31b02401b9c974f61140f3a01", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:44.596803 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:44.596803 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 1a1084c31b02401b9c974f61140f3a01 May 21 21:14:44.596803 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:44.596803 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-HostsAdminNegativeTestJSON-1586594302-project-admin May 21 21:14:44.596803 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:14:44.596803 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:14:44.596803 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 434aa53e258744eb8851a1839c5e4e6f May 21 21:14:44.596803 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1586594302-project-admin May 21 21:14:44.596803 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:14:44.596803 ncdv-master-1 devstack@n-api.service[131278]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:44.596803 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'nonexistent_hostname'} May 21 21:14:44.596803 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:44.597601 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:44.597601 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show May 21 21:14:44.597601 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 21 21:14:44.597601 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:14:44.597601 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:14:44.597601 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 21 21:14:44.597601 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 21 21:14:44.597601 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:14:44.597601 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:14:44.597601 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 21 21:14:44.597601 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 21 21:14:44.597601 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:44.597601 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:44.597601 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:44.597601 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:44.597601 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:44.597601 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:44.597601 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:44.597601 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:44.598766 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:44.598766 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:44.598766 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:44.598766 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:44.598766 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:44.598766 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show May 21 21:14:44.598766 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:14:44.598766 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:44.598766 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:44.598766 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:44.598766 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:44.598766 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:44.598766 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:44.598766 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:44.598766 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:44.598766 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:44.598766 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:44.598766 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:44.605639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2f493466-28e2-4bb8-94e0-df6fc25d1b36 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:44.605639 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2f493466-28e2-4bb8-94e0-df6fc25d1b36 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.036325 May 21 21:14:44.605639 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 624/1229] 10.222.0.49 () {58 vars in 1190 bytes} [Sat May 21 21:14:44 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:14:44.625130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-47851a55-c65e-4d1c-adc6-8effc4ceab6b tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Calling method '.version_select at 0x7fc81b4d3f70>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:44.628469 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:44.628469 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:14:44.630002 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-47851a55-c65e-4d1c-adc6-8effc4ceab6b tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '67ecde1a6ec544dc9081ff5cab085f27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f59b3530b453992cdf02f9418f054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:44.633993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-47851a55-c65e-4d1c-adc6-8effc4ceab6b tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Request method failure captured: May 21 21:14:44.633993 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown HTTP/1.1 May 21 21:14:44.633993 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:14:44.633993 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:14:44.633993 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:14:44.633993 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:14:44.633993 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:14:44.633993 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:14:44.633993 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:14:44.633993 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:14:44.633993 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZBfq4_p1cJ3dwh9cyMpezwzptDANlK1izwvKw3RAzctprYspoVJjDW9SfMomkjfr_DSPypcjz-5e4PhwA6Ibl2AxCoJ_ZS6dpQks1oatB3WYU7b1ftM1LJCADy5LELq81l6P5qwoyqGPHMaVnuE_R9OKCjdDmmRKiJPvex7RC50Z0 May 21 21:14:44.633993 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:14:44.633993 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:14:44.633993 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:14:44.633993 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:14:44.633993 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:14:44.633993 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:14:44.633993 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 6f8f59b3530b453992cdf02f9418f054 May 21 21:14:44.633993 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-205626687 May 21 21:14:44.633993 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:14:44.633993 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:14:44.642213 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6f8f59b3530b453992cdf02f9418f054"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6f8f59b3530b453992cdf02f9418f054"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6f8f59b3530b453992cdf02f9418f054", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6f8f59b3530b453992cdf02f9418f054"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:44.642213 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-HostsAdminNegativeTestJSON-205626687 May 21 21:14:44.642213 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 6f8f59b3530b453992cdf02f9418f054 May 21 21:14:44.642213 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-205626687 May 21 21:14:44.642213 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-HostsAdminNegativeTestJSON-205626687-project May 21 21:14:44.642213 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:14:44.642213 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:14:44.642213 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 67ecde1a6ec544dc9081ff5cab085f27 May 21 21:14:44.642213 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-HostsAdminNegativeTestJSON-205626687-project May 21 21:14:44.642213 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:14:44.642213 ncdv-master-1 devstack@n-api.service[131278]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 21 21:14:44.642213 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'ncdv-master-1'} May 21 21:14:44.642213 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:44.643074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:44.643074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:44.643074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:44.643074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:44.643074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:44.643074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:44.643074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:44.643074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:44.643074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:44.643074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown May 21 21:14:44.643074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', May 21 21:14:44.643074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:14:44.643074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:14:44.643074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:14:44.643074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:14:44.643074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:14:44.643074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:14:44.643074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:14:44.643074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:14:44.644493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:14:44.644493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:14:44.644493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:14:44.644493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:14:44.644493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:14:44.644493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:14:44.644493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 21 21:14:44.644493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:44.644493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:44.644493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:44.644493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:44.644493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:44.644493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:44.644493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:14:44.644493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:14:44.644493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 21 21:14:44.644493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:44.645821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-47851a55-c65e-4d1c-adc6-8effc4ceab6b tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:44.645821 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-47851a55-c65e-4d1c-adc6-8effc4ceab6b tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] 10.222.0.49 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.023749 May 21 21:14:44.645821 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 625/1230] 10.222.0.49 () {58 vars in 1196 bytes} [Sat May 21 21:14:44 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:14:44.661175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aaef1684-75a2-4422-b171-563b5823b0a6 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Calling method '.version_select at 0x7fc81b44ee50>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:44.678721 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-aaef1684-75a2-4422-b171-563b5823b0a6 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:44.680945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aaef1684-75a2-4422-b171-563b5823b0a6 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Request method failure captured: May 21 21:14:44.680945 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 May 21 21:14:44.680945 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:14:44.680945 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:14:44.680945 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:14:44.680945 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:14:44.680945 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:14:44.680945 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:14:44.680945 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:14:44.680945 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:14:44.680945 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZCwWQ7tfHD4hyaeA8zoOb73Y_tG0QfV7-qInDcqET3Wwf9nt8jcm9he_tdB8TCfmkoS8DyF06w9Lz-sdLWexoNY3VA2G0hDqSP5DXX6EWtlNU7dpdMF_tm67cgZL5U1PSmgRXkuwyM_WeQSpAe8pjt8eFscboNtrEjLmDHDXtSUdg May 21 21:14:44.680945 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:14:44.680945 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:14:44.680945 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:14:44.680945 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:14:44.680945 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:14:44.680945 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:14:44.680945 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 1a1084c31b02401b9c974f61140f3a01 May 21 21:14:44.680945 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:44.680945 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,admin,member May 21 21:14:44.680945 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,admin,member May 21 21:14:44.682552 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1a1084c31b02401b9c974f61140f3a01", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:44.682552 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:44.682552 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 1a1084c31b02401b9c974f61140f3a01 May 21 21:14:44.682552 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:44.682552 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-HostsAdminNegativeTestJSON-1586594302-project-admin May 21 21:14:44.682552 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:14:44.682552 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:14:44.682552 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 434aa53e258744eb8851a1839c5e4e6f May 21 21:14:44.682552 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1586594302-project-admin May 21 21:14:44.682552 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:14:44.682552 ncdv-master-1 devstack@n-api.service[131278]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:44.682552 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'nonexistent_hostname'} May 21 21:14:44.682552 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:44.683422 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:44.683422 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 21 21:14:44.683422 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 21 21:14:44.683422 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 21 21:14:44.683422 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 21 21:14:44.683422 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:14:44.683422 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:14:44.683422 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:14:44.683422 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:14:44.683422 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 21 21:14:44.683422 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 21 21:14:44.683422 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 21 21:14:44.683422 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 21 21:14:44.683422 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:14:44.683422 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:14:44.683422 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 21 21:14:44.683422 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 21 21:14:44.683422 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:14:44.683422 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:14:44.685314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 21 21:14:44.685314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 21 21:14:44.685314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:44.685314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:44.685314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:44.685314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:44.685314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:44.685314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:44.685314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:44.685314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:44.685314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:44.685314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:44.685314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:44.685314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:44.685314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:44.685314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown May 21 21:14:44.685314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") May 21 21:14:44.685314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 21 21:14:44.685314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:14:44.687518 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:44.687518 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:44.687518 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:44.687518 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:44.687518 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:44.687518 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:44.687518 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:44.687518 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:44.687518 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:44.687518 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:44.687518 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:44.694762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aaef1684-75a2-4422-b171-563b5823b0a6 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:44.697056 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-aaef1684-75a2-4422-b171-563b5823b0a6 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.051507 May 21 21:14:44.698557 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 626/1231] 10.222.0.49 () {58 vars in 1217 bytes} [Sat May 21 21:14:44 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:14:44.708738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6ca6384d-755f-4aa7-951d-d865ab0d3baf tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Calling method '.version_select at 0x7fc81b3c04c0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:44.710451 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:44.710451 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:14:44.712629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6ca6384d-755f-4aa7-951d-d865ab0d3baf tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '67ecde1a6ec544dc9081ff5cab085f27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f59b3530b453992cdf02f9418f054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:44.717207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6ca6384d-755f-4aa7-951d-d865ab0d3baf tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Request method failure captured: May 21 21:14:44.717207 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/startup HTTP/1.1 May 21 21:14:44.717207 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:14:44.717207 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:14:44.717207 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:14:44.717207 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:14:44.717207 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:14:44.717207 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:14:44.717207 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:14:44.717207 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:14:44.717207 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZBfq4_p1cJ3dwh9cyMpezwzptDANlK1izwvKw3RAzctprYspoVJjDW9SfMomkjfr_DSPypcjz-5e4PhwA6Ibl2AxCoJ_ZS6dpQks1oatB3WYU7b1ftM1LJCADy5LELq81l6P5qwoyqGPHMaVnuE_R9OKCjdDmmRKiJPvex7RC50Z0 May 21 21:14:44.717207 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:14:44.717207 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:14:44.717207 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:14:44.717207 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:14:44.717207 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:14:44.717207 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:14:44.717207 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 6f8f59b3530b453992cdf02f9418f054 May 21 21:14:44.717207 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-205626687 May 21 21:14:44.717207 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:14:44.717207 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:14:44.718896 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6f8f59b3530b453992cdf02f9418f054"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6f8f59b3530b453992cdf02f9418f054"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6f8f59b3530b453992cdf02f9418f054", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6f8f59b3530b453992cdf02f9418f054"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:44.718896 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-HostsAdminNegativeTestJSON-205626687 May 21 21:14:44.718896 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 6f8f59b3530b453992cdf02f9418f054 May 21 21:14:44.718896 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-205626687 May 21 21:14:44.718896 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-HostsAdminNegativeTestJSON-205626687-project May 21 21:14:44.718896 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:14:44.718896 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:14:44.718896 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 67ecde1a6ec544dc9081ff5cab085f27 May 21 21:14:44.718896 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-HostsAdminNegativeTestJSON-205626687-project May 21 21:14:44.718896 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:14:44.718896 ncdv-master-1 devstack@n-api.service[131278]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 21 21:14:44.718896 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'ncdv-master-1'} May 21 21:14:44.718896 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:44.719919 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:44.719919 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:44.719919 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:44.719919 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:44.719919 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:44.719919 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:44.719919 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:44.719919 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:44.719919 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:44.719919 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup May 21 21:14:44.719919 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', May 21 21:14:44.719919 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:14:44.719919 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:14:44.719919 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:14:44.719919 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:14:44.719919 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:14:44.719919 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:14:44.719919 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:14:44.719919 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:14:44.724256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:14:44.724256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:14:44.724256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:14:44.724256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:14:44.724256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:14:44.724256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:14:44.724256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 21 21:14:44.724256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:44.724256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:44.724256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:44.724256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:44.724256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:44.724256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:44.724256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:14:44.724256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:14:44.724256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 21 21:14:44.724256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:14:44.725467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6ca6384d-755f-4aa7-951d-d865ab0d3baf tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:44.725467 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6ca6384d-755f-4aa7-951d-d865ab0d3baf tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] 10.222.0.49 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.018116 May 21 21:14:44.725467 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 627/1232] 10.222.0.49 () {58 vars in 1193 bytes} [Sat May 21 21:14:44 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 21 21:14:44.731701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ce648e08-1086-4404-8ac4-d330852c5571 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:44.733387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ce648e08-1086-4404-8ac4-d330852c5571 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:44.742778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ce648e08-1086-4404-8ac4-d330852c5571 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:44.746394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ce648e08-1086-4404-8ac4-d330852c5571 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:44.746394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ce648e08-1086-4404-8ac4-d330852c5571 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:44.746394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ce648e08-1086-4404-8ac4-d330852c5571 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:44.974260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-629f6ef0-2b42-4024-b3ba-596bb2ea899e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:44.998339 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-629f6ef0-2b42-4024-b3ba-596bb2ea899e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 1318 microversion: 2.1 time: 0.505061 May 21 21:14:45.000048 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 606/1233] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:44 2022] GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:45.010328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f5b9f5cc-8407-4661-b3d7-4d594a39ecf8 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Calling method '.version_select at 0x7fc81b2bc670>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:45.013561 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:45.013561 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:14:45.033763 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-f5b9f5cc-8407-4661-b3d7-4d594a39ecf8 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:45.036035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f5b9f5cc-8407-4661-b3d7-4d594a39ecf8 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Request method failure captured: May 21 21:14:45.036035 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 May 21 21:14:45.036035 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:45.036035 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:45.036035 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:45.036035 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:14:45.036035 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:45.036035 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:45.036035 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:45.036035 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:45.036035 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZCwWQ7tfHD4hyaeA8zoOb73Y_tG0QfV7-qInDcqET3Wwf9nt8jcm9he_tdB8TCfmkoS8DyF06w9Lz-sdLWexoNY3VA2G0hDqSP5DXX6EWtlNU7dpdMF_tm67cgZL5U1PSmgRXkuwyM_WeQSpAe8pjt8eFscboNtrEjLmDHDXtSUdg May 21 21:14:45.036035 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:45.036035 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:45.036035 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:45.036035 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:45.036035 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:45.036035 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:45.036035 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 1a1084c31b02401b9c974f61140f3a01 May 21 21:14:45.036035 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:45.036035 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:14:45.036035 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:14:45.044783 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1a1084c31b02401b9c974f61140f3a01", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:45.044783 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:45.044783 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 1a1084c31b02401b9c974f61140f3a01 May 21 21:14:45.044783 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:45.044783 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-HostsAdminNegativeTestJSON-1586594302-project-admin May 21 21:14:45.044783 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:45.044783 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:45.044783 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 434aa53e258744eb8851a1839c5e4e6f May 21 21:14:45.044783 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1586594302-project-admin May 21 21:14:45.044783 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:14:45.044783 ncdv-master-1 devstack@n-api.service[131277]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:45.044783 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'nonexistent_hostname'} May 21 21:14:45.044783 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:45.045617 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:45.045617 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 21 21:14:45.045617 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 21 21:14:45.045617 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 21 21:14:45.045617 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 21 21:14:45.045617 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:14:45.045617 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:14:45.045617 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:14:45.045617 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:14:45.045617 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 21 21:14:45.045617 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 21 21:14:45.045617 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 21 21:14:45.045617 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 21 21:14:45.045617 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:14:45.045617 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:14:45.045617 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 21 21:14:45.045617 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 21 21:14:45.045617 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:14:45.045617 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:14:45.046846 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 21 21:14:45.046846 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 21 21:14:45.046846 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:45.046846 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.046846 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:45.046846 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.046846 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:45.046846 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:45.046846 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:45.046846 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:45.046846 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:45.046846 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:45.046846 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:45.046846 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:45.046846 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:45.046846 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup May 21 21:14:45.046846 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") May 21 21:14:45.046846 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 21 21:14:45.046846 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:14:45.048104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:45.048104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.048104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:45.048104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.048104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:45.048104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:45.048104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:45.048104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:45.048104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:45.048104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:45.048104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.048104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f5b9f5cc-8407-4661-b3d7-4d594a39ecf8 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:45.048104 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f5b9f5cc-8407-4661-b3d7-4d594a39ecf8 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.036407 May 21 21:14:45.048104 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 607/1234] 10.222.0.49 () {58 vars in 1214 bytes} [Sat May 21 21:14:45 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:14:45.059998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4d3e59e3-5d64-4310-a9d7-3f3e55f3d469 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Action: 'update', calling method: .version_select at 0x7fc81b1724c0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:45.067158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4d3e59e3-5d64-4310-a9d7-3f3e55f3d469 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Request method failure captured: May 21 21:14:45.067158 ncdv-master-1 devstack@n-api.service[131277]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 May 21 21:14:45.067158 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:45.067158 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:45.067158 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:45.067158 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 51 May 21 21:14:45.067158 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:45.067158 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:45.067158 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:45.067158 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:45.067158 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZCwWQ7tfHD4hyaeA8zoOb73Y_tG0QfV7-qInDcqET3Wwf9nt8jcm9he_tdB8TCfmkoS8DyF06w9Lz-sdLWexoNY3VA2G0hDqSP5DXX6EWtlNU7dpdMF_tm67cgZL5U1PSmgRXkuwyM_WeQSpAe8pjt8eFscboNtrEjLmDHDXtSUdg May 21 21:14:45.067158 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:45.067158 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:45.067158 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:45.067158 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:45.067158 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:45.067158 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:45.067158 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 1a1084c31b02401b9c974f61140f3a01 May 21 21:14:45.067158 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:45.067158 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:14:45.067158 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:14:45.068696 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1a1084c31b02401b9c974f61140f3a01", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:45.068696 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:45.068696 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 1a1084c31b02401b9c974f61140f3a01 May 21 21:14:45.068696 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:45.068696 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-HostsAdminNegativeTestJSON-1586594302-project-admin May 21 21:14:45.068696 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:45.068696 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:45.068696 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 434aa53e258744eb8851a1839c5e4e6f May 21 21:14:45.068696 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1586594302-project-admin May 21 21:14:45.068696 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:14:45.068696 ncdv-master-1 devstack@n-api.service[131277]: {"status": "enable", "maintenance_mode": "invalid"} May 21 21:14:45.068696 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:14:45.068696 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise error May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'disable', May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'Enable', May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'Disable', May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'ENABLE', May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi On instance: May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'invalid' May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:45.070151 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:45.072000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:45.072000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:45.072000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:45.072000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:45.072000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:45.072000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:45.072000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:45.072000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:14:45.072000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:14:45.072000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:14:45.072000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:14:45.072000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:14:45.072000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:14:45.072000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 21 21:14:45.072000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.072000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:45.072000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.072000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:45.072000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:45.083920 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:45.083920 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:14:45.083920 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:14:45.083920 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 21 21:14:45.083920 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.083920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4d3e59e3-5d64-4310-a9d7-3f3e55f3d469 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:45.083920 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4d3e59e3-5d64-4310-a9d7-3f3e55f3d469 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.024708 May 21 21:14:45.083920 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 608/1235] 10.222.0.49 () {60 vars in 1189 bytes} [Sat May 21 21:14:45 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:14:45.085033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dd60e119-ad5d-42d4-b2b6-02582be79fe4 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Action: 'update', calling method: .version_select at 0x7fc81b3caca0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:45.086387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dd60e119-ad5d-42d4-b2b6-02582be79fe4 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Request method failure captured: May 21 21:14:45.086387 ncdv-master-1 devstack@n-api.service[131277]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 May 21 21:14:45.086387 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:45.086387 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:45.086387 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:45.086387 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 51 May 21 21:14:45.086387 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:45.086387 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:45.086387 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:45.086387 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:45.086387 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZCwWQ7tfHD4hyaeA8zoOb73Y_tG0QfV7-qInDcqET3Wwf9nt8jcm9he_tdB8TCfmkoS8DyF06w9Lz-sdLWexoNY3VA2G0hDqSP5DXX6EWtlNU7dpdMF_tm67cgZL5U1PSmgRXkuwyM_WeQSpAe8pjt8eFscboNtrEjLmDHDXtSUdg May 21 21:14:45.086387 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:45.086387 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:45.086387 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:45.086387 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:45.086387 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:45.086387 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:45.086387 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 1a1084c31b02401b9c974f61140f3a01 May 21 21:14:45.086387 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:45.086387 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:14:45.086387 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:14:45.087827 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1a1084c31b02401b9c974f61140f3a01", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:45.087827 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:45.087827 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 1a1084c31b02401b9c974f61140f3a01 May 21 21:14:45.087827 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:45.087827 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-HostsAdminNegativeTestJSON-1586594302-project-admin May 21 21:14:45.087827 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:45.087827 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:45.087827 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 434aa53e258744eb8851a1839c5e4e6f May 21 21:14:45.087827 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1586594302-project-admin May 21 21:14:45.087827 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:14:45.087827 ncdv-master-1 devstack@n-api.service[131277]: {"status": "invalid", "maintenance_mode": "enable"} May 21 21:14:45.087827 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:14:45.087827 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise error May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'disable', May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'Enable', May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'Disable', May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'ENABLE', May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi On instance: May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'invalid' May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:45.091385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:45.094577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:45.094577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:45.094577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:45.094577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:45.094577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:45.094577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:45.094577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:45.094577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:14:45.094577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:14:45.094577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:14:45.094577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:14:45.094577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:14:45.094577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:14:45.094577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 21 21:14:45.094577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.094577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:45.094577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.094577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:45.094577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:45.098398 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:45.098398 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:14:45.098398 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:14:45.098398 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 21 21:14:45.098398 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.098398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dd60e119-ad5d-42d4-b2b6-02582be79fe4 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:45.098398 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dd60e119-ad5d-42d4-b2b6-02582be79fe4 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.010401 May 21 21:14:45.098398 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 609/1236] 10.222.0.49 () {60 vars in 1189 bytes} [Sat May 21 21:14:45 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:14:45.104460 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d47498e0-8a58-45e4-8e25-bcfdca96be1d tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Action: 'update', calling method: .version_select at 0x7fc81b172430>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:45.108348 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:45.108348 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:14:45.110057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d47498e0-8a58-45e4-8e25-bcfdca96be1d tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '67ecde1a6ec544dc9081ff5cab085f27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f59b3530b453992cdf02f9418f054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:45.111979 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d47498e0-8a58-45e4-8e25-bcfdca96be1d tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Request method failure captured: May 21 21:14:45.111979 ncdv-master-1 devstack@n-api.service[131277]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 May 21 21:14:45.111979 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:45.111979 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:45.111979 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:45.111979 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 50 May 21 21:14:45.111979 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:45.111979 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:45.111979 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:45.111979 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:45.111979 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZBfq4_p1cJ3dwh9cyMpezwzptDANlK1izwvKw3RAzctprYspoVJjDW9SfMomkjfr_DSPypcjz-5e4PhwA6Ibl2AxCoJ_ZS6dpQks1oatB3WYU7b1ftM1LJCADy5LELq81l6P5qwoyqGPHMaVnuE_R9OKCjdDmmRKiJPvex7RC50Z0 May 21 21:14:45.111979 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:45.111979 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:45.111979 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:45.111979 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:45.111979 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:45.111979 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:45.111979 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 6f8f59b3530b453992cdf02f9418f054 May 21 21:14:45.111979 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-205626687 May 21 21:14:45.111979 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:14:45.111979 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:14:45.116710 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6f8f59b3530b453992cdf02f9418f054"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6f8f59b3530b453992cdf02f9418f054"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6f8f59b3530b453992cdf02f9418f054", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6f8f59b3530b453992cdf02f9418f054"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:45.116710 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-HostsAdminNegativeTestJSON-205626687 May 21 21:14:45.116710 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 6f8f59b3530b453992cdf02f9418f054 May 21 21:14:45.116710 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-205626687 May 21 21:14:45.116710 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-HostsAdminNegativeTestJSON-205626687-project May 21 21:14:45.116710 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:45.116710 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:45.116710 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 67ecde1a6ec544dc9081ff5cab085f27 May 21 21:14:45.116710 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-HostsAdminNegativeTestJSON-205626687-project May 21 21:14:45.116710 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:14:45.116710 ncdv-master-1 devstack@n-api.service[131277]: {"status": "enable", "maintenance_mode": "enable"} May 21 21:14:45.116710 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:14:45.116710 ncdv-master-1 devstack@n-api.service[131277]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 21 21:14:45.116710 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} May 21 21:14:45.117619 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:45.117619 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:45.117619 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:45.117619 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:45.117619 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:45.117619 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:45.117619 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:45.117619 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:45.117619 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:45.117619 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:45.117619 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:14:45.117619 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:14:45.117619 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update May 21 21:14:45.117619 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', May 21 21:14:45.117619 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:14:45.117619 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:14:45.117619 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:14:45.117619 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:14:45.117619 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:14:45.117619 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:14:45.118878 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:14:45.118878 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:14:45.118878 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:14:45.118878 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:14:45.118878 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:14:45.118878 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:14:45.118878 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:14:45.118878 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:14:45.118878 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 21 21:14:45.118878 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.118878 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:45.118878 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.118878 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:45.118878 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:45.118878 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:45.118878 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:14:45.118878 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:14:45.118878 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 21 21:14:45.118878 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.121559 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d47498e0-8a58-45e4-8e25-bcfdca96be1d tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:45.121559 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d47498e0-8a58-45e4-8e25-bcfdca96be1d tempest-HostsAdminNegativeTestJSON-205626687 tempest-HostsAdminNegativeTestJSON-205626687-project] 10.222.0.49 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.018007 May 21 21:14:45.121559 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 610/1237] 10.222.0.49 () {60 vars in 1189 bytes} [Sat May 21 21:14:45 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:14:45.134718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bebbf31f-5d93-4b38-ad3f-8b454dbc7584 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Action: 'update', calling method: .version_select at 0x7fc81b16e820>, body: {"status": null, "maintenance_mode": null} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:45.146742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bebbf31f-5d93-4b38-ad3f-8b454dbc7584 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Request method failure captured: May 21 21:14:45.146742 ncdv-master-1 devstack@n-api.service[131277]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 May 21 21:14:45.146742 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:45.146742 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:45.146742 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:45.146742 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 42 May 21 21:14:45.146742 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:45.146742 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:45.146742 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:45.146742 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:45.146742 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZCwWQ7tfHD4hyaeA8zoOb73Y_tG0QfV7-qInDcqET3Wwf9nt8jcm9he_tdB8TCfmkoS8DyF06w9Lz-sdLWexoNY3VA2G0hDqSP5DXX6EWtlNU7dpdMF_tm67cgZL5U1PSmgRXkuwyM_WeQSpAe8pjt8eFscboNtrEjLmDHDXtSUdg May 21 21:14:45.146742 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:45.146742 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:45.146742 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:45.146742 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:45.146742 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:45.146742 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:45.146742 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 1a1084c31b02401b9c974f61140f3a01 May 21 21:14:45.146742 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:45.146742 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:14:45.146742 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:14:45.155676 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1a1084c31b02401b9c974f61140f3a01", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:45.155676 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:45.155676 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 1a1084c31b02401b9c974f61140f3a01 May 21 21:14:45.155676 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:45.155676 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-HostsAdminNegativeTestJSON-1586594302-project-admin May 21 21:14:45.155676 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:45.155676 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:45.155676 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 434aa53e258744eb8851a1839c5e4e6f May 21 21:14:45.155676 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1586594302-project-admin May 21 21:14:45.155676 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:14:45.155676 ncdv-master-1 devstack@n-api.service[131277]: {"status": null, "maintenance_mode": null} May 21 21:14:45.155676 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:14:45.155676 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 21 21:14:45.155676 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'ncdv-master-1', 'body': {'status': None, 'maintenance_mode': None}} May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise error May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'disable', May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'Enable', May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'Disable', May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'ENABLE', May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi On instance: May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi None May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:45.156625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:45.158172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:45.158172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:45.158172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:45.158172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:45.158172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:45.158172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:45.158172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:14:45.158172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:14:45.158172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:14:45.158172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:14:45.158172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:14:45.158172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:14:45.158172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 21 21:14:45.158172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.158172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:45.158172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.158172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:45.158172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:45.158172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:45.159603 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:14:45.159603 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:14:45.159603 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 21 21:14:45.159603 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.159603 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bebbf31f-5d93-4b38-ad3f-8b454dbc7584 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:45.159603 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bebbf31f-5d93-4b38-ad3f-8b454dbc7584 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.027119 May 21 21:14:45.159603 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 611/1238] 10.222.0.49 () {60 vars in 1189 bytes} [Sat May 21 21:14:45 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:14:45.165813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f7790a24-c5b0-4ccd-ba8d-2425404cc278 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Action: 'update', calling method: .version_select at 0x7fc81b172ca0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:45.168373 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.hosts [None req-f7790a24-c5b0-4ccd-ba8d-2425404cc278 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Enabling host nonexistent_hostname. May 21 21:14:45.176673 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-f7790a24-c5b0-4ccd-ba8d-2425404cc278 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:45.178422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f7790a24-c5b0-4ccd-ba8d-2425404cc278 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Request method failure captured: May 21 21:14:45.178422 ncdv-master-1 devstack@n-api.service[131277]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 May 21 21:14:45.178422 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:45.178422 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:45.178422 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:45.178422 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 50 May 21 21:14:45.178422 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:45.178422 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:45.178422 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:45.178422 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:45.178422 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZCwWQ7tfHD4hyaeA8zoOb73Y_tG0QfV7-qInDcqET3Wwf9nt8jcm9he_tdB8TCfmkoS8DyF06w9Lz-sdLWexoNY3VA2G0hDqSP5DXX6EWtlNU7dpdMF_tm67cgZL5U1PSmgRXkuwyM_WeQSpAe8pjt8eFscboNtrEjLmDHDXtSUdg May 21 21:14:45.178422 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:45.178422 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:45.178422 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:45.178422 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:45.178422 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:45.178422 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:45.178422 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 1a1084c31b02401b9c974f61140f3a01 May 21 21:14:45.178422 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:45.178422 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:14:45.178422 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:14:45.182615 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1a1084c31b02401b9c974f61140f3a01", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a1084c31b02401b9c974f61140f3a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:45.182615 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:45.182615 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 1a1084c31b02401b9c974f61140f3a01 May 21 21:14:45.182615 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1586594302 May 21 21:14:45.182615 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-HostsAdminNegativeTestJSON-1586594302-project-admin May 21 21:14:45.182615 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:45.182615 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:45.182615 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 434aa53e258744eb8851a1839c5e4e6f May 21 21:14:45.182615 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1586594302-project-admin May 21 21:14:45.182615 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:14:45.182615 ncdv-master-1 devstack@n-api.service[131277]: {"status": "enable", "maintenance_mode": "enable"} May 21 21:14:45.182615 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:14:45.182615 ncdv-master-1 devstack@n-api.service[131277]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:45.182615 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} May 21 21:14:45.183484 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:45.183484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:45.183484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status May 21 21:14:45.183484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) May 21 21:14:45.183484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 21 21:14:45.183484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 21 21:14:45.183484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:14:45.183484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:14:45.183484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:14:45.183484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:14:45.183484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 21 21:14:45.183484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 21 21:14:45.183484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 21 21:14:45.183484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 21 21:14:45.183484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:14:45.183484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:14:45.183484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 21 21:14:45.183484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 21 21:14:45.184663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:14:45.184663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:14:45.184663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 21 21:14:45.184663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 21 21:14:45.184663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:45.184663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.184663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:45.184663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.184663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:45.184663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:45.184663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:45.184663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:45.184663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:45.184663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:14:45.184663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:14:45.184663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:45.184663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:45.184663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:14:45.184663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:14:45.184663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update May 21 21:14:45.186007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) May 21 21:14:45.186007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status May 21 21:14:45.186007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:14:45.186007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:45.186007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.186007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:45.186007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.186007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:45.186007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:45.186007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:45.186007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:45.186007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:45.186007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 21 21:14:45.186007 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:45.186007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f7790a24-c5b0-4ccd-ba8d-2425404cc278 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:45.186929 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f7790a24-c5b0-4ccd-ba8d-2425404cc278 tempest-HostsAdminNegativeTestJSON-1586594302 tempest-HostsAdminNegativeTestJSON-1586594302-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.017742 May 21 21:14:45.186929 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 612/1239] 10.222.0.49 () {60 vars in 1210 bytes} [Sat May 21 21:14:45 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:14:45.498182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6da673a5-46f1-4397-a8f9-fc1ba424699b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:45.499440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6da673a5-46f1-4397-a8f9-fc1ba424699b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:45.515937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6da673a5-46f1-4397-a8f9-fc1ba424699b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:45.518965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6da673a5-46f1-4397-a8f9-fc1ba424699b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:45.520515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6da673a5-46f1-4397-a8f9-fc1ba424699b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:45.522562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6da673a5-46f1-4397-a8f9-fc1ba424699b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:45.561780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ce648e08-1086-4404-8ac4-d330852c5571 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:45.572224 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ce648e08-1086-4404-8ac4-d330852c5571 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1540 microversion: 2.1 time: 0.845034 May 21 21:14:45.581792 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 628/1240] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:44 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1540 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:45.581792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1626ab0e-ec40-4587-8a87-210e1405fc65 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:45.581792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1626ab0e-ec40-4587-8a87-210e1405fc65 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:45.592057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1626ab0e-ec40-4587-8a87-210e1405fc65 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:45.592483 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1626ab0e-ec40-4587-8a87-210e1405fc65 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:45.593274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1626ab0e-ec40-4587-8a87-210e1405fc65 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:45.593714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1626ab0e-ec40-4587-8a87-210e1405fc65 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:45.883784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1626ab0e-ec40-4587-8a87-210e1405fc65 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:45.887613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6da673a5-46f1-4397-a8f9-fc1ba424699b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:45.897162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1626ab0e-ec40-4587-8a87-210e1405fc65 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:45.898512 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6da673a5-46f1-4397-a8f9-fc1ba424699b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1521 microversion: 2.1 time: 0.411789 May 21 21:14:45.903890 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1626ab0e-ec40-4587-8a87-210e1405fc65 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:45.907159 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1626ab0e-ec40-4587-8a87-210e1405fc65 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1645 microversion: 2.25 time: 0.332920 May 21 21:14:45.910714 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 629/1242] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:14:45 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1645 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:45.910893 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 613/1242] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:45 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:45.927170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f81dc19c-4261-450f-bdaf-7490a1bc3ca0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:45.928239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f81dc19c-4261-450f-bdaf-7490a1bc3ca0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:45.945240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f81dc19c-4261-450f-bdaf-7490a1bc3ca0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:45.945964 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f81dc19c-4261-450f-bdaf-7490a1bc3ca0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:45.947292 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f81dc19c-4261-450f-bdaf-7490a1bc3ca0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:45.953537 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f81dc19c-4261-450f-bdaf-7490a1bc3ca0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:45.999705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f81dc19c-4261-450f-bdaf-7490a1bc3ca0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:14:46.022523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8c2f8809-d593-48e9-bdd0-d9d439e05c87 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:46.023574 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8c2f8809-d593-48e9-bdd0-d9d439e05c87 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:46.045707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c2f8809-d593-48e9-bdd0-d9d439e05c87 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:46.055211 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c2f8809-d593-48e9-bdd0-d9d439e05c87 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:46.056055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c2f8809-d593-48e9-bdd0-d9d439e05c87 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:46.056640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c2f8809-d593-48e9-bdd0-d9d439e05c87 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:46.437602 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f81dc19c-4261-450f-bdaf-7490a1bc3ca0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 204 len: 0 microversion: 2.1 time: 0.522045 May 21 21:14:46.438482 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 630/1243] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:14:45 2022] DELETE /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 21:14:46.459922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b5dff57d-74d8-482d-930e-5505f6aa1986 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:46.460675 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b5dff57d-74d8-482d-930e-5505f6aa1986 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:46.475319 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5dff57d-74d8-482d-930e-5505f6aa1986 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:46.477960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5dff57d-74d8-482d-930e-5505f6aa1986 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:46.480528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5dff57d-74d8-482d-930e-5505f6aa1986 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:46.482290 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5dff57d-74d8-482d-930e-5505f6aa1986 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:46.839735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b5dff57d-74d8-482d-930e-5505f6aa1986 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:46.848806 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b5dff57d-74d8-482d-930e-5505f6aa1986 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1527 microversion: 2.1 time: 0.394815 May 21 21:14:46.852631 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 631/1244] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:46 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1527 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:46.874006 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e1e15b98-a445-4720-b0bd-e36571929f3a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:46.876102 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e1e15b98-a445-4720-b0bd-e36571929f3a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:46.898850 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1e15b98-a445-4720-b0bd-e36571929f3a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:46.899329 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1e15b98-a445-4720-b0bd-e36571929f3a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:46.900176 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1e15b98-a445-4720-b0bd-e36571929f3a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:46.903133 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1e15b98-a445-4720-b0bd-e36571929f3a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:47.143845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e1e15b98-a445-4720-b0bd-e36571929f3a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:47.153221 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e1e15b98-a445-4720-b0bd-e36571929f3a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1540 microversion: 2.1 time: 0.300552 May 21 21:14:47.154765 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 632/1245] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:46 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1540 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:47.162973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f4d44635-96ef-4cbe-8683-851d6e3a3c24 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:47.164084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f4d44635-96ef-4cbe-8683-851d6e3a3c24 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:47.172791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f4d44635-96ef-4cbe-8683-851d6e3a3c24 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:47.173346 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f4d44635-96ef-4cbe-8683-851d6e3a3c24 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:47.174828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f4d44635-96ef-4cbe-8683-851d6e3a3c24 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:47.175606 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f4d44635-96ef-4cbe-8683-851d6e3a3c24 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:47.190256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8c2f8809-d593-48e9-bdd0-d9d439e05c87 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:47.203670 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8c2f8809-d593-48e9-bdd0-d9d439e05c87 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 1318 microversion: 2.1 time: 1.185070 May 21 21:14:47.213946 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 614/1246] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:46 2022] GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 => generated 1318 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:47.392342 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f4d44635-96ef-4cbe-8683-851d6e3a3c24 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:47.403029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f4d44635-96ef-4cbe-8683-851d6e3a3c24 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:47.404848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f4d44635-96ef-4cbe-8683-851d6e3a3c24 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:47.406264 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f4d44635-96ef-4cbe-8683-851d6e3a3c24 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1635 microversion: 2.25 time: 0.249784 May 21 21:14:47.406996 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 633/1247] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:14:47 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1635 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:47.432907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9561f04e-0e60-4373-9c9c-0f4775d1900a tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '.version_select at 0x7fc81b16e280>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:47.434151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9561f04e-0e60-4373-9c9c-0f4775d1900a tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:47.434845 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9561f04e-0e60-4373-9c9c-0f4775d1900a tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:47.448488 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9561f04e-0e60-4373-9c9c-0f4775d1900a tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 4046 microversion: 2.25 time: 0.027750 May 21 21:14:47.449515 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 615/1248] 10.222.0.49 () {60 vars in 1183 bytes} [Sat May 21 21:14:47 2022] GET /compute/v2.1/os-migrations => generated 4046 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:14:47.469030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-752e6c6f-921b-4681-8077-3d4b2b83cbd3 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:47.469030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-752e6c6f-921b-4681-8077-3d4b2b83cbd3 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:47.471569 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-752e6c6f-921b-4681-8077-3d4b2b83cbd3 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:47.472029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-752e6c6f-921b-4681-8077-3d4b2b83cbd3 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:47.472845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-752e6c6f-921b-4681-8077-3d4b2b83cbd3 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:47.473478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-752e6c6f-921b-4681-8077-3d4b2b83cbd3 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:47.742160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-752e6c6f-921b-4681-8077-3d4b2b83cbd3 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lazy-loading 'services' on Instance uuid 13739e66-c933-4b7b-b4a9-365b8b4c65cb {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:14:47.767499 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-752e6c6f-921b-4681-8077-3d4b2b83cbd3 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 2128 microversion: 2.25 time: 0.308273 May 21 21:14:47.768252 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 634/1249] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:14:47 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 2128 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:47.785746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c4cc6308-eaec-458f-82e4-62fe382cb5f8 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:47.786360 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c4cc6308-eaec-458f-82e4-62fe382cb5f8 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:47.797806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4cc6308-eaec-458f-82e4-62fe382cb5f8 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:47.798651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4cc6308-eaec-458f-82e4-62fe382cb5f8 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:47.799820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4cc6308-eaec-458f-82e4-62fe382cb5f8 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:47.800373 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4cc6308-eaec-458f-82e4-62fe382cb5f8 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:47.851549 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-998992b2-ec34-4fef-9e01-1b85a0a1204f req-b4aa5ed4-f1d8-40be-b525-518220bcf32a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b58aadd3-11a8-41dc-9104-b6082e4eeb06", "name": "network-vif-unplugged", "status": "completed", "tag": "45d0dcd8-6e01-48f0-a3c7-19f72707d0d7"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:47.884332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-998992b2-ec34-4fef-9e01-1b85a0a1204f req-b4aa5ed4-f1d8-40be-b525-518220bcf32a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:47.884959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-998992b2-ec34-4fef-9e01-1b85a0a1204f req-b4aa5ed4-f1d8-40be-b525-518220bcf32a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:47.911834 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-998992b2-ec34-4fef-9e01-1b85a0a1204f req-b4aa5ed4-f1d8-40be-b525-518220bcf32a service nova] Creating event network-vif-unplugged:45d0dcd8-6e01-48f0-a3c7-19f72707d0d7 for instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 on nch1-master-1 May 21 21:14:47.921506 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-998992b2-ec34-4fef-9e01-1b85a0a1204f req-b4aa5ed4-f1d8-40be-b525-518220bcf32a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080613 May 21 21:14:47.922107 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 635/1250] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:14:47.938187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-baac92ea-0ac2-487c-89ef-9e1cbfcae6bb tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:47.943611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-baac92ea-0ac2-487c-89ef-9e1cbfcae6bb tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:47.957410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-baac92ea-0ac2-487c-89ef-9e1cbfcae6bb tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:47.957877 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-baac92ea-0ac2-487c-89ef-9e1cbfcae6bb tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:47.961031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-baac92ea-0ac2-487c-89ef-9e1cbfcae6bb tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:47.961912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-baac92ea-0ac2-487c-89ef-9e1cbfcae6bb tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:48.196678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-c4cc6308-eaec-458f-82e4-62fe382cb5f8 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lazy-loading 'services' on Instance uuid 13739e66-c933-4b7b-b4a9-365b8b4c65cb {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:14:48.213015 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c4cc6308-eaec-458f-82e4-62fe382cb5f8 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 2128 microversion: 2.25 time: 0.431267 May 21 21:14:48.217417 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 616/1251] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:14:47 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 2128 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:14:48.222267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-507c28e9-e6ac-43c5-837a-5fca3ee99418 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:48.223137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-507c28e9-e6ac-43c5-837a-5fca3ee99418 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:48.247809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-507c28e9-e6ac-43c5-837a-5fca3ee99418 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:48.248269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-507c28e9-e6ac-43c5-837a-5fca3ee99418 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:48.249090 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-507c28e9-e6ac-43c5-837a-5fca3ee99418 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:48.249722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-507c28e9-e6ac-43c5-837a-5fca3ee99418 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:48.296755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-baac92ea-0ac2-487c-89ef-9e1cbfcae6bb tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:48.312551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:48.316477 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-baac92ea-0ac2-487c-89ef-9e1cbfcae6bb tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1527 microversion: 2.1 time: 0.390124 May 21 21:14:48.318588 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 636/1252] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:47 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1527 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:48.324613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-696575dc-5b53-49ad-9054-c1b86c254749 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:48.325677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-696575dc-5b53-49ad-9054-c1b86c254749 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:48.347081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-696575dc-5b53-49ad-9054-c1b86c254749 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:48.350385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-696575dc-5b53-49ad-9054-c1b86c254749 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:48.352222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-696575dc-5b53-49ad-9054-c1b86c254749 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:48.354334 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-696575dc-5b53-49ad-9054-c1b86c254749 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:48.707095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-507c28e9-e6ac-43c5-837a-5fca3ee99418 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:48.724892 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-507c28e9-e6ac-43c5-837a-5fca3ee99418 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1540 microversion: 2.1 time: 0.509997 May 21 21:14:48.725481 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 617/1253] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:48 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1540 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:48.756155 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-41c191ff-263c-4bf4-bb1c-ed83b3498cae tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:48.757006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-41c191ff-263c-4bf4-bb1c-ed83b3498cae tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:48.764655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-41c191ff-263c-4bf4-bb1c-ed83b3498cae tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:48.765467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-41c191ff-263c-4bf4-bb1c-ed83b3498cae tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:48.767201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-41c191ff-263c-4bf4-bb1c-ed83b3498cae tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:48.767890 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-41c191ff-263c-4bf4-bb1c-ed83b3498cae tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:48.946777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-41c191ff-263c-4bf4-bb1c-ed83b3498cae tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lazy-loading 'services' on Instance uuid 13739e66-c933-4b7b-b4a9-365b8b4c65cb {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:14:49.139499 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-696575dc-5b53-49ad-9054-c1b86c254749 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:49.151356 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-696575dc-5b53-49ad-9054-c1b86c254749 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 1468 microversion: 2.1 time: 0.829038 May 21 21:14:49.152759 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 637/1254] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:48 2022] GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 => generated 1468 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:49.174846 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a4aa9d7d-e8cb-4ea4-afbf-49dd427fb74e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:49.175150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a4aa9d7d-e8cb-4ea4-afbf-49dd427fb74e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: 55818247-81af-4cf1-bff3-92aeb3f06bba] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:49.185362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4aa9d7d-e8cb-4ea4-afbf-49dd427fb74e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:49.189150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4aa9d7d-e8cb-4ea4-afbf-49dd427fb74e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:49.189150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4aa9d7d-e8cb-4ea4-afbf-49dd427fb74e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:49.189150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4aa9d7d-e8cb-4ea4-afbf-49dd427fb74e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:49.241420 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-41c191ff-263c-4bf4-bb1c-ed83b3498cae tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "DELETE /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb/os-volume_attachments/43913e24-b1c1-4a82-9f77-46cfbc414199" status: 202 len: 0 microversion: 2.25 time: 0.503364 May 21 21:14:49.242609 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 618/1255] 10.222.0.49 () {60 vars in 1456 bytes} [Sat May 21 21:14:48 2022] DELETE /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb/os-volume_attachments/43913e24-b1c1-4a82-9f77-46cfbc414199 => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 21 21:14:49.251657 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-efa62477-1311-4de3-b998-e065e834464c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:49.252868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-efa62477-1311-4de3-b998-e065e834464c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:49.259619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efa62477-1311-4de3-b998-e065e834464c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:49.261119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efa62477-1311-4de3-b998-e065e834464c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:49.262107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efa62477-1311-4de3-b998-e065e834464c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:49.262659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efa62477-1311-4de3-b998-e065e834464c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:49.318110 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-efa62477-1311-4de3-b998-e065e834464c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.070624 May 21 21:14:49.322314 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 619/1256] 10.222.0.49 () {60 vars in 1342 bytes} [Sat May 21 21:14:49 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:14:49.336847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4048b7b3-370d-4df9-bee0-10e2acddb7d6 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:49.347948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4048b7b3-370d-4df9-bee0-10e2acddb7d6 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:49.383134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4048b7b3-370d-4df9-bee0-10e2acddb7d6 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:49.383666 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4048b7b3-370d-4df9-bee0-10e2acddb7d6 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:49.389661 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4048b7b3-370d-4df9-bee0-10e2acddb7d6 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:49.399909 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4048b7b3-370d-4df9-bee0-10e2acddb7d6 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:49.625042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a4aa9d7d-e8cb-4ea4-afbf-49dd427fb74e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:49.633283 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a4aa9d7d-e8cb-4ea4-afbf-49dd427fb74e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba" status: 200 len: 1465 microversion: 2.1 time: 0.468255 May 21 21:14:49.644901 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 638/1257] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:49 2022] GET /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba => generated 1465 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:14:49.660824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6fcb83a9-23e9-4dd4-b07f-260091f1ccaa tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2081311852"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:49.662312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6fcb83a9-23e9-4dd4-b07f-260091f1ccaa tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: 55818247-81af-4cf1-bff3-92aeb3f06bba] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:49.677316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6fcb83a9-23e9-4dd4-b07f-260091f1ccaa tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:49.678101 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6fcb83a9-23e9-4dd4-b07f-260091f1ccaa tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:49.678941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6fcb83a9-23e9-4dd4-b07f-260091f1ccaa tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:49.679535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6fcb83a9-23e9-4dd4-b07f-260091f1ccaa tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:49.709009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4048b7b3-370d-4df9-bee0-10e2acddb7d6 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:49.729881 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4048b7b3-370d-4df9-bee0-10e2acddb7d6 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1485 microversion: 2.1 time: 0.398283 May 21 21:14:49.744204 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 620/1258] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:49 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1485 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:49.752142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-2ac27075-fbdd-491a-8c0e-cf55164c8cd2 req-29b6dd1e-c5c1-4bf0-830b-f1b5e8be6edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b58aadd3-11a8-41dc-9104-b6082e4eeb06", "name": "network-vif-deleted", "tag": "45d0dcd8-6e01-48f0-a3c7-19f72707d0d7"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:49.771844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2ac27075-fbdd-491a-8c0e-cf55164c8cd2 req-29b6dd1e-c5c1-4bf0-830b-f1b5e8be6edf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:49.772632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2ac27075-fbdd-491a-8c0e-cf55164c8cd2 req-29b6dd1e-c5c1-4bf0-830b-f1b5e8be6edf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:49.789532 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-2ac27075-fbdd-491a-8c0e-cf55164c8cd2 req-29b6dd1e-c5c1-4bf0-830b-f1b5e8be6edf service nova] Creating event network-vif-deleted:45d0dcd8-6e01-48f0-a3c7-19f72707d0d7 for instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 on nch1-master-1 May 21 21:14:49.795994 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-2ac27075-fbdd-491a-8c0e-cf55164c8cd2 req-29b6dd1e-c5c1-4bf0-830b-f1b5e8be6edf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063996 May 21 21:14:49.797294 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 621/1259] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:49.827166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b7403709-5235-4077-8277-2b48de47f1bd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:49.827793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b7403709-5235-4077-8277-2b48de47f1bd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:49.845209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7403709-5235-4077-8277-2b48de47f1bd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:49.846889 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7403709-5235-4077-8277-2b48de47f1bd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:49.849790 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7403709-5235-4077-8277-2b48de47f1bd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:49.850767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7403709-5235-4077-8277-2b48de47f1bd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:50.159895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b7403709-5235-4077-8277-2b48de47f1bd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:50.180455 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b7403709-5235-4077-8277-2b48de47f1bd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1540 microversion: 2.1 time: 0.380860 May 21 21:14:50.183344 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 622/1260] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:49 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1540 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:50.335234 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-96f08795-f634-4047-b2a1-d2f77bd3589d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:50.337940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-96f08795-f634-4047-b2a1-d2f77bd3589d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:50.345272 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96f08795-f634-4047-b2a1-d2f77bd3589d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:50.346006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96f08795-f634-4047-b2a1-d2f77bd3589d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:50.363828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96f08795-f634-4047-b2a1-d2f77bd3589d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:50.363828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96f08795-f634-4047-b2a1-d2f77bd3589d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:50.418008 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-96f08795-f634-4047-b2a1-d2f77bd3589d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.087477 May 21 21:14:50.418805 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 623/1261] 10.222.0.49 () {60 vars in 1342 bytes} [Sat May 21 21:14:50 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 21 21:14:50.440895 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6fcb83a9-23e9-4dd4-b07f-260091f1ccaa tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "POST /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba/action" status: 202 len: 0 microversion: 2.1 time: 0.783667 May 21 21:14:50.447116 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 639/1262] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:14:49 2022] POST /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba/action => generated 0 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 21 21:14:50.453090 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4e35b489-e1ce-4c7b-b03f-42d539d8f618 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b1fc4c0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:50.523297 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4e35b489-e1ce-4c7b-b03f-42d539d8f618 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e" status: 200 len: 1453 microversion: 2.1 time: 0.075783 May 21 21:14:50.524944 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 624/1263] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:14:50 2022] GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e => generated 1453 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:14:50.762769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c586eeb3-c4fd-4328-a6ff-d1cdb293e86b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:50.763765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c586eeb3-c4fd-4328-a6ff-d1cdb293e86b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:50.771223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c586eeb3-c4fd-4328-a6ff-d1cdb293e86b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:50.772128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c586eeb3-c4fd-4328-a6ff-d1cdb293e86b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:50.773364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c586eeb3-c4fd-4328-a6ff-d1cdb293e86b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:50.774054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c586eeb3-c4fd-4328-a6ff-d1cdb293e86b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:50.819847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c586eeb3-c4fd-4328-a6ff-d1cdb293e86b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:50.820311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c586eeb3-c4fd-4328-a6ff-d1cdb293e86b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:50.820770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-c586eeb3-c4fd-4328-a6ff-d1cdb293e86b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lazy-loading 'fault' on Instance uuid b58aadd3-11a8-41dc-9104-b6082e4eeb06 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:14:50.953796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c586eeb3-c4fd-4328-a6ff-d1cdb293e86b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:50.967159 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c586eeb3-c4fd-4328-a6ff-d1cdb293e86b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 200 len: 1314 microversion: 2.1 time: 0.213142 May 21 21:14:50.968924 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 640/1264] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:50 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:51.202784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9cc8d301-6e8a-49ee-8ec7-a59fad04b9da tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:51.203426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9cc8d301-6e8a-49ee-8ec7-a59fad04b9da tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:51.213256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cc8d301-6e8a-49ee-8ec7-a59fad04b9da tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:51.217694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cc8d301-6e8a-49ee-8ec7-a59fad04b9da tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:51.217694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cc8d301-6e8a-49ee-8ec7-a59fad04b9da tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:51.217694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cc8d301-6e8a-49ee-8ec7-a59fad04b9da tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:51.433197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dbc73ffb-22bd-49b9-91c6-40ea39fd54db tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:51.434843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dbc73ffb-22bd-49b9-91c6-40ea39fd54db tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:51.445582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbc73ffb-22bd-49b9-91c6-40ea39fd54db tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:51.452169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbc73ffb-22bd-49b9-91c6-40ea39fd54db tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:51.452169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbc73ffb-22bd-49b9-91c6-40ea39fd54db tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:51.452169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbc73ffb-22bd-49b9-91c6-40ea39fd54db tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:51.467931 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9cc8d301-6e8a-49ee-8ec7-a59fad04b9da tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:51.470362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:51.480979 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9cc8d301-6e8a-49ee-8ec7-a59fad04b9da tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1540 microversion: 2.1 time: 0.284725 May 21 21:14:51.487560 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 625/1265] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:51 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1540 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:51.517335 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dbc73ffb-22bd-49b9-91c6-40ea39fd54db tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.090448 May 21 21:14:51.518989 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 641/1266] 10.222.0.49 () {60 vars in 1342 bytes} [Sat May 21 21:14:51 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:14:51.539816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8faa060b-0d77-4649-8999-156b9bd966a4 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b1fc1f0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:51.616343 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8faa060b-0d77-4649-8999-156b9bd966a4 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e" status: 200 len: 1453 microversion: 2.1 time: 0.080197 May 21 21:14:51.616343 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 626/1267] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:14:51 2022] GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e => generated 1453 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:51.985903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-94b71e4f-7571-4422-90bd-067b3d9bee5b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:51.986533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-94b71e4f-7571-4422-90bd-067b3d9bee5b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:51.999472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94b71e4f-7571-4422-90bd-067b3d9bee5b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:51.999937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94b71e4f-7571-4422-90bd-067b3d9bee5b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:52.003568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94b71e4f-7571-4422-90bd-067b3d9bee5b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:52.007948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94b71e4f-7571-4422-90bd-067b3d9bee5b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:52.046315 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-94b71e4f-7571-4422-90bd-067b3d9bee5b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] HTTP exception thrown: Instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 could not be found. May 21 21:14:52.051716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-94b71e4f-7571-4422-90bd-067b3d9bee5b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Request method failure captured: May 21 21:14:52.051716 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 HTTP/1.1 May 21 21:14:52.051716 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:14:52.051716 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:14:52.051716 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:14:52.051716 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:14:52.051716 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:14:52.051716 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:14:52.051716 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:14:52.051716 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:14:52.051716 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVYcSiyjAIR82oxkRB6GTuWAKVTX4xG5vMYtW_3BeBGCFxFQjKbNKPB4C0xhPGbN3kZTd0vkZOYFJP4MJ1kk_eZN0RsUqNmA1UP-b-s9HcyrYiVjgp1H1dIVPKi3UtrJ4Ob8-qkiVNLHvP2GMr_o_p2pBItaNXntU_KoEaP7ETd6R3M May 21 21:14:52.051716 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:14:52.051716 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:14:52.051716 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:14:52.051716 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:14:52.051716 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:14:52.051716 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:14:52.051716 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:14:52.051716 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:14:52.051716 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:14:52.051716 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:14:52.058814 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85f6ae1864ee43429c910eb27888608f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:14:52.058814 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:14:52.058814 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:14:52.058814 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:14:52.058814 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:14:52.058814 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:14:52.058814 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:14:52.058814 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 186310904c3943fdb63247b58725140e May 21 21:14:52.058814 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:14:52.058814 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:14:52.058814 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 could not be found. May 21 21:14:52.058814 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'b58aadd3-11a8-41dc-9104-b6082e4eeb06'} May 21 21:14:52.059891 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:14:52.059891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:52.059891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:14:52.059891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:14:52.059891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:14:52.059891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:14:52.059891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:14:52.059891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:14:52.059891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:14:52.059891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:14:52.059891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 could not be found. May 21 21:14:52.059891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:52.059891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:52.059891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:52.059891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:52.059891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:52.059891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:52.059891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:14:52.059891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:14:52.059891 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:14:52.061477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:14:52.061477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:14:52.061477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:14:52.061477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:14:52.061477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:14:52.061477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:14:52.061477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:14:52.061477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 could not be found. May 21 21:14:52.061477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:52.061477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:14:52.061477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:52.061477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:14:52.061477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:14:52.061477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:14:52.061477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:14:52.061477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:14:52.061477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 could not be found. May 21 21:14:52.061477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:14:52.063858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-94b71e4f-7571-4422-90bd-067b3d9bee5b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Returning 404 to user: Instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:14:52.063858 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-94b71e4f-7571-4422-90bd-067b3d9bee5b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 404 len: 111 microversion: 2.1 time: 0.075217 May 21 21:14:52.076018 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 627/1268] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:51 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:14:52.096479 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-68e7ed7f-4b4a-49a5-9ca3-45a07645ee4c tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Action: 'create', calling method: .version_select at 0x7fc81b2f30d0>, body: {"keypair": {"name": "tempest-keypair-901848935", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE569dlcwWpVR8JfZv1m/rhIQOQJGVSb/d5/LFmB8319TK2XuOOemxgLp2N+zrw2U6nt2mTZ3VjZqYfdaY4TwcmhnZra5EV86YptVHtv2nxsjuKTF5n3kBYDB+htO9cAfw=="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:52.150745 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-68e7ed7f-4b4a-49a5-9ca3-45a07645ee4c tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Getting quotas for project 85f6ae1864ee43429c910eb27888608f. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:14:52.164325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-68e7ed7f-4b4a-49a5-9ca3-45a07645ee4c tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Getting quotas for user 186310904c3943fdb63247b58725140e and project 85f6ae1864ee43429c910eb27888608f. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:14:52.322767 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0e9c1d2b-196e-465e-a35b-d6b4e1783dfa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1026377499", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "c5f18057-839a-44a2-aa7d-5be2d01e71c9"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:52.330381 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-68e7ed7f-4b4a-49a5-9ca3-45a07645ee4c tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.252216 May 21 21:14:52.331659 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 628/1269] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:14:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:52.389750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-0e9c1d2b-196e-465e-a35b-d6b4e1783dfa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] validate_networks() for [('c5f18057-839a-44a2-aa7d-5be2d01e71c9', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:14:52.604987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cea7627f-5341-46a7-841f-d6c5d7e5dfaa tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Calling method '.version_select at 0x7fc81b39ea60>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:52.609224 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:52.609224 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:14:52.609224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cea7627f-5341-46a7-841f-d6c5d7e5dfaa tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:52.609224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cea7627f-5341-46a7-841f-d6c5d7e5dfaa tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:52.633767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cea7627f-5341-46a7-841f-d6c5d7e5dfaa tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:52.634516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cea7627f-5341-46a7-841f-d6c5d7e5dfaa tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:52.650098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cea7627f-5341-46a7-841f-d6c5d7e5dfaa tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:52.651339 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cea7627f-5341-46a7-841f-d6c5d7e5dfaa tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:52.659894 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cea7627f-5341-46a7-841f-d6c5d7e5dfaa tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.305548 May 21 21:14:52.661444 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 629/1270] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:14:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:52.672557 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-59e938ee-96d8-4000-af58-afba1ec6b54a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:52.673377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-59e938ee-96d8-4000-af58-afba1ec6b54a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:52.683072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-59e938ee-96d8-4000-af58-afba1ec6b54a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:52.684268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-59e938ee-96d8-4000-af58-afba1ec6b54a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:52.685627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-59e938ee-96d8-4000-af58-afba1ec6b54a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:52.685936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-59e938ee-96d8-4000-af58-afba1ec6b54a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:52.871551 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-59e938ee-96d8-4000-af58-afba1ec6b54a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:52.880442 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-59e938ee-96d8-4000-af58-afba1ec6b54a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1540 microversion: 2.1 time: 0.217424 May 21 21:14:52.881279 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 630/1271] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:52 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1540 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:52.887722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f7e679fe-9f61-4038-8bbe-16e605d957be tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b22ff70>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:52.951057 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f7e679fe-9f61-4038-8bbe-16e605d957be tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e" status: 200 len: 1453 microversion: 2.1 time: 0.068312 May 21 21:14:52.952193 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 631/1272] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:14:52 2022] GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e => generated 1453 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:52.957375 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-618689dc-8903-4364-ad8a-b9621e2d110d tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Calling method '.version_select at 0x7fc81b1fcb80>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:52.958686 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:52.958686 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:14:52.960104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-618689dc-8903-4364-ad8a-b9621e2d110d tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:52.960768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-618689dc-8903-4364-ad8a-b9621e2d110d tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:52.976681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-618689dc-8903-4364-ad8a-b9621e2d110d tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:52.977200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-618689dc-8903-4364-ad8a-b9621e2d110d tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:53.028589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-618689dc-8903-4364-ad8a-b9621e2d110d tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:53.029241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-618689dc-8903-4364-ad8a-b9621e2d110d tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:53.038796 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-618689dc-8903-4364-ad8a-b9621e2d110d tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/nch2-master-1/servers" status: 200 len: 591 microversion: 2.1 time: 0.085210 May 21 21:14:53.039364 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 632/1273] 10.222.0.49 () {58 vars in 1211 bytes} [Sat May 21 21:14:52 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/servers => generated 591 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:53.061538 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b515c479-df76-4fc9-9679-b9d5b4905c43 tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Calling method '.version_select at 0x7fc81b16e0d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:53.061538 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:53.061538 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:14:53.061538 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b515c479-df76-4fc9-9679-b9d5b4905c43 tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:53.061538 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b515c479-df76-4fc9-9679-b9d5b4905c43 tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:53.072096 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0e9c1d2b-196e-465e-a35b-d6b4e1783dfa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:14:53.073338 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0e9c1d2b-196e-465e-a35b-d6b4e1783dfa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:14:53.074063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0e9c1d2b-196e-465e-a35b-d6b4e1783dfa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:14:53.074790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0e9c1d2b-196e-465e-a35b-d6b4e1783dfa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:14:53.075547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0e9c1d2b-196e-465e-a35b-d6b4e1783dfa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:14:53.075974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b515c479-df76-4fc9-9679-b9d5b4905c43 tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:53.076485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b515c479-df76-4fc9-9679-b9d5b4905c43 tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:53.092079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e9c1d2b-196e-465e-a35b-d6b4e1783dfa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:53.092079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e9c1d2b-196e-465e-a35b-d6b4e1783dfa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:53.092079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e9c1d2b-196e-465e-a35b-d6b4e1783dfa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:53.092079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e9c1d2b-196e-465e-a35b-d6b4e1783dfa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:53.092778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b515c479-df76-4fc9-9679-b9d5b4905c43 tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:53.092778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b515c479-df76-4fc9-9679-b9d5b4905c43 tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:53.100712 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b515c479-df76-4fc9-9679-b9d5b4905c43 tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.051176 May 21 21:14:53.103238 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 633/1274] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:14:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:14:53.113778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fada8e67-b3de-4b3f-a163-20212af5c8db tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Calling method '.version_select at 0x7fc81b16e9d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:53.115057 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:14:53.115057 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:14:53.116572 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fada8e67-b3de-4b3f-a163-20212af5c8db tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:53.117245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fada8e67-b3de-4b3f-a163-20212af5c8db tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:53.120869 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-0e9c1d2b-196e-465e-a35b-d6b4e1783dfa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Getting quotas for project 89256ac3448643b6892e74f55bfb31d3. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:14:53.124638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-0e9c1d2b-196e-465e-a35b-d6b4e1783dfa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Getting quotas for user 16686b6509f54c4abfe9d519acfb4a73 and project 89256ac3448643b6892e74f55bfb31d3. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:14:53.129392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:53.133152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fada8e67-b3de-4b3f-a163-20212af5c8db tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:53.133686 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fada8e67-b3de-4b3f-a163-20212af5c8db tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:53.144055 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fada8e67-b3de-4b3f-a163-20212af5c8db tempest-HypervisorAdminUnderV252Test-195279948 tempest-HypervisorAdminUnderV252Test-195279948-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.031159 May 21 21:14:53.144055 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 634/1275] 10.222.0.49 () {58 vars in 1208 bytes} [Sat May 21 21:14:53 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 104 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:14:53.144330 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0e9c1d2b-196e-465e-a35b-d6b4e1783dfa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:14:53.146070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0e9c1d2b-196e-465e-a35b-d6b4e1783dfa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 2efd4657-7152-42ae-92d6-9249939767ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:14:53.295969 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0e9c1d2b-196e-465e-a35b-d6b4e1783dfa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.616117 May 21 21:14:53.303353 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 642/1276] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:14:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:14:53.307887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-00156447-fe44-48be-8e47-7d5ff5620622 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:53.308538 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-00156447-fe44-48be-8e47-7d5ff5620622 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 2efd4657-7152-42ae-92d6-9249939767ed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:53.387919 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-00156447-fe44-48be-8e47-7d5ff5620622 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:53.389079 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:53.397298 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-00156447-fe44-48be-8e47-7d5ff5620622 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed" status: 200 len: 1208 microversion: 2.1 time: 0.093583 May 21 21:14:53.398368 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 635/1277] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:53 2022] GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed => generated 1208 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:14:53.899755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0b6c135f-e2c7-4fb5-9cfa-111c90388991 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:53.900933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0b6c135f-e2c7-4fb5-9cfa-111c90388991 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:53.918733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b6c135f-e2c7-4fb5-9cfa-111c90388991 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:53.919186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b6c135f-e2c7-4fb5-9cfa-111c90388991 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:53.919965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b6c135f-e2c7-4fb5-9cfa-111c90388991 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:53.920601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b6c135f-e2c7-4fb5-9cfa-111c90388991 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:53.969843 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-eed4b6c9-6a72-4dbc-ab77-c8418d1e19d2 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b39e430>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:54.088459 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-eed4b6c9-6a72-4dbc-ab77-c8418d1e19d2 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e" status: 200 len: 1453 microversion: 2.1 time: 0.121838 May 21 21:14:54.088459 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 636/1278] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:14:53 2022] GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e => generated 1453 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:54.207402 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0b6c135f-e2c7-4fb5-9cfa-111c90388991 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:54.216145 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0b6c135f-e2c7-4fb5-9cfa-111c90388991 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1540 microversion: 2.1 time: 0.321074 May 21 21:14:54.217896 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 643/1279] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:53 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1540 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:54.417630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5d9196dd-2367-4cdc-b4c1-e35b2ec9e981 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:54.418528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5d9196dd-2367-4cdc-b4c1-e35b2ec9e981 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 2efd4657-7152-42ae-92d6-9249939767ed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:54.637769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5d9196dd-2367-4cdc-b4c1-e35b2ec9e981 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:54.659734 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5d9196dd-2367-4cdc-b4c1-e35b2ec9e981 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed" status: 200 len: 1208 microversion: 2.1 time: 0.245586 May 21 21:14:54.662369 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 637/1280] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:54 2022] GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed => generated 1208 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:55.099804 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9c339a1f-c8e1-4d0f-af92-f9d65a987f80 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b3c0790>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:55.235266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c8649441-93be-42b6-bdd5-9d1541fbf608 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:55.236145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c8649441-93be-42b6-bdd5-9d1541fbf608 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:55.242868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c8649441-93be-42b6-bdd5-9d1541fbf608 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:55.246055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c8649441-93be-42b6-bdd5-9d1541fbf608 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:55.247004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c8649441-93be-42b6-bdd5-9d1541fbf608 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:55.247716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c8649441-93be-42b6-bdd5-9d1541fbf608 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:55.516898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c8649441-93be-42b6-bdd5-9d1541fbf608 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:55.526117 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c8649441-93be-42b6-bdd5-9d1541fbf608 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1540 microversion: 2.1 time: 0.294387 May 21 21:14:55.526785 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 638/1281] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:55 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1540 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:55.679973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d6191898-d0f5-4987-a870-c4c20e8ac53a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:55.680784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d6191898-d0f5-4987-a870-c4c20e8ac53a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 2efd4657-7152-42ae-92d6-9249939767ed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:55.700303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6191898-d0f5-4987-a870-c4c20e8ac53a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:55.701964 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6191898-d0f5-4987-a870-c4c20e8ac53a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:55.704218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6191898-d0f5-4987-a870-c4c20e8ac53a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:55.706256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6191898-d0f5-4987-a870-c4c20e8ac53a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:55.895427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d6191898-d0f5-4987-a870-c4c20e8ac53a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:55.904692 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d6191898-d0f5-4987-a870-c4c20e8ac53a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed" status: 200 len: 1204 microversion: 2.1 time: 0.229341 May 21 21:14:55.905355 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 639/1282] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:55 2022] GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed => generated 1204 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:55.922314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-67249ae0-9e79-4ee9-8e3a-c3ac83038af2 req-31bd07ca-a710-46e3-bfec-512bc2d67026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55818247-81af-4cf1-bff3-92aeb3f06bba", "name": "network-vif-plugged", "status": "completed", "tag": "d78ce8f3-1b0e-4e09-b2ee-8d7b3fe8530e"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:14:55.937758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-67249ae0-9e79-4ee9-8e3a-c3ac83038af2 req-31bd07ca-a710-46e3-bfec-512bc2d67026 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:55.938407 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-67249ae0-9e79-4ee9-8e3a-c3ac83038af2 req-31bd07ca-a710-46e3-bfec-512bc2d67026 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:55.983986 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-67249ae0-9e79-4ee9-8e3a-c3ac83038af2 req-31bd07ca-a710-46e3-bfec-512bc2d67026 service nova] Creating event network-vif-plugged:d78ce8f3-1b0e-4e09-b2ee-8d7b3fe8530e for instance 55818247-81af-4cf1-bff3-92aeb3f06bba on nch2-master-1 May 21 21:14:55.996759 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-67249ae0-9e79-4ee9-8e3a-c3ac83038af2 req-31bd07ca-a710-46e3-bfec-512bc2d67026 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086796 May 21 21:14:55.997738 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 640/1283] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:14:56.546598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-839e996b-5190-4af8-b8d5-d15e8a822442 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:14:56.547315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-839e996b-5190-4af8-b8d5-d15e8a822442 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:14:56.563395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-839e996b-5190-4af8-b8d5-d15e8a822442 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:56.564254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-839e996b-5190-4af8-b8d5-d15e8a822442 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:56.565013 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-839e996b-5190-4af8-b8d5-d15e8a822442 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:14:56.565735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-839e996b-5190-4af8-b8d5-d15e8a822442 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:14:56.880954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-839e996b-5190-4af8-b8d5-d15e8a822442 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:14:56.893158 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-839e996b-5190-4af8-b8d5-d15e8a822442 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1540 microversion: 2.1 time: 0.352448 May 21 21:14:56.894525 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 641/1284] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:14:56 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1540 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:14:56.920123 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9e3ab9af-1c1e-4f1b-8410-376b057e34ee tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-792283234", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:02.632008 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9c339a1f-c8e1-4d0f-af92-f9d65a987f80 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e" status: 200 len: 1453 microversion: 2.1 time: 7.536695 May 21 21:15:02.641673 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 644/1285] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:14:55 2022] GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e => generated 1453 bytes in 7539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:15:02.641673 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-245a582f-a9f8-4903-b2c8-c3140ecf7aa7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:02.646562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-245a582f-a9f8-4903-b2c8-c3140ecf7aa7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 2efd4657-7152-42ae-92d6-9249939767ed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:02.653682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-9e3ab9af-1c1e-4f1b-8410-376b057e34ee tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] validate_networks() for [('535b779e-2c0d-4051-93ac-b34fe98b76f4', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:15:02.659275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-245a582f-a9f8-4903-b2c8-c3140ecf7aa7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:02.660091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-245a582f-a9f8-4903-b2c8-c3140ecf7aa7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:02.678703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-245a582f-a9f8-4903-b2c8-c3140ecf7aa7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:02.680429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-245a582f-a9f8-4903-b2c8-c3140ecf7aa7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:02.993960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-245a582f-a9f8-4903-b2c8-c3140ecf7aa7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:03.004752 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-245a582f-a9f8-4903-b2c8-c3140ecf7aa7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed" status: 200 len: 1308 microversion: 2.1 time: 0.369825 May 21 21:15:03.018988 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 645/1286] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:02 2022] GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed => generated 1308 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:03.032949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1345817f-3964-467e-b284-c98fa510f18b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:03.034188 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1345817f-3964-467e-b284-c98fa510f18b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:03.050566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1345817f-3964-467e-b284-c98fa510f18b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:03.052424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1345817f-3964-467e-b284-c98fa510f18b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:03.058355 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1345817f-3964-467e-b284-c98fa510f18b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:03.058355 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1345817f-3964-467e-b284-c98fa510f18b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:03.121692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:03.137059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:03.339026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1345817f-3964-467e-b284-c98fa510f18b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:03.347703 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1345817f-3964-467e-b284-c98fa510f18b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1468 microversion: 2.1 time: 0.326158 May 21 21:15:03.348585 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 646/1287] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:03 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1468 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:03.812599 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7349bc7c-d76e-4951-b85a-5a0628401505 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Action: 'create', calling method: .version_select at 0x7fc81b493160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1392405057", "description": "tempest-description-31205368"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:04.168341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-9e3ab9af-1c1e-4f1b-8410-376b057e34ee tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:15:04.169470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-9e3ab9af-1c1e-4f1b-8410-376b057e34ee tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:15:04.170101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-9e3ab9af-1c1e-4f1b-8410-376b057e34ee tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:15:04.170680 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-9e3ab9af-1c1e-4f1b-8410-376b057e34ee tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:15:04.171328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-9e3ab9af-1c1e-4f1b-8410-376b057e34ee tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:15:04.192811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e3ab9af-1c1e-4f1b-8410-376b057e34ee tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:04.193490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e3ab9af-1c1e-4f1b-8410-376b057e34ee tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:04.194784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e3ab9af-1c1e-4f1b-8410-376b057e34ee tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:04.197757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e3ab9af-1c1e-4f1b-8410-376b057e34ee tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:04.228943 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-9e3ab9af-1c1e-4f1b-8410-376b057e34ee tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Getting quotas for project 85f6ae1864ee43429c910eb27888608f. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:15:04.235622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-9e3ab9af-1c1e-4f1b-8410-376b057e34ee tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Getting quotas for user 186310904c3943fdb63247b58725140e and project 85f6ae1864ee43429c910eb27888608f. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:15:04.252219 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9e3ab9af-1c1e-4f1b-8410-376b057e34ee tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:15:04.255360 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9e3ab9af-1c1e-4f1b-8410-376b057e34ee tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:15:04.362682 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7349bc7c-d76e-4951-b85a-5a0628401505 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.012673 May 21 21:15:04.363636 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 647/1288] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:15:03 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:04.369013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-e6143b54-9fbc-47d1-98db-c9119390676f req-df550f11-44fb-4d01-95cb-112a08552a2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4531a7ea-7be9-48b8-adac-fe968ff5d889", "name": "network-vif-unplugged", "status": "completed", "tag": "d47da14c-0379-42b1-91a7-7b1098c8cded"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:04.386782 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e6143b54-9fbc-47d1-98db-c9119390676f req-df550f11-44fb-4d01-95cb-112a08552a2c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:04.387576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e6143b54-9fbc-47d1-98db-c9119390676f req-df550f11-44fb-4d01-95cb-112a08552a2c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:04.418562 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-e6143b54-9fbc-47d1-98db-c9119390676f req-df550f11-44fb-4d01-95cb-112a08552a2c service nova] Creating event network-vif-unplugged:d47da14c-0379-42b1-91a7-7b1098c8cded for instance 4531a7ea-7be9-48b8-adac-fe968ff5d889 on nch1-master-1 May 21 21:15:04.422613 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9e3ab9af-1c1e-4f1b-8410-376b057e34ee tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.509786 May 21 21:15:04.423511 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 642/1289] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:14:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 7511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 21 21:15:04.435224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [req-e6143b54-9fbc-47d1-98db-c9119390676f req-df550f11-44fb-4d01-95cb-112a08552a2c service nova] Instance 4531a7ea-7be9-48b8-adac-fe968ff5d889 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=131278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 21:15:04.442931 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-e6143b54-9fbc-47d1-98db-c9119390676f req-df550f11-44fb-4d01-95cb-112a08552a2c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077664 May 21 21:15:04.443745 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 648/1290] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:04.453553 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-28ad13f3-af54-4cb9-94b5-f4180361bccb req-95172fcf-4c7c-4003-a8ab-cbc5b620e600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2efd4657-7152-42ae-92d6-9249939767ed", "tag": "500741bf-90f2-4eed-9a27-ca517aaff42a"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:04.465276 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-28ad13f3-af54-4cb9-94b5-f4180361bccb req-95172fcf-4c7c-4003-a8ab-cbc5b620e600 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:04.469257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-28ad13f3-af54-4cb9-94b5-f4180361bccb req-95172fcf-4c7c-4003-a8ab-cbc5b620e600 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:04.482782 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-28ad13f3-af54-4cb9-94b5-f4180361bccb req-95172fcf-4c7c-4003-a8ab-cbc5b620e600 service nova] Creating event network-changed:500741bf-90f2-4eed-9a27-ca517aaff42a for instance 2efd4657-7152-42ae-92d6-9249939767ed on nch1-master-1 May 21 21:15:04.488462 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-28ad13f3-af54-4cb9-94b5-f4180361bccb req-95172fcf-4c7c-4003-a8ab-cbc5b620e600 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039065 May 21 21:15:04.489470 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 649/1291] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:04.497562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8cbf8ad4-cd4c-418b-bf08-9585f1fce686 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:04.498207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8cbf8ad4-cd4c-418b-bf08-9585f1fce686 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:04.513416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8cbf8ad4-cd4c-418b-bf08-9585f1fce686 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:04.514099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8cbf8ad4-cd4c-418b-bf08-9585f1fce686 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:04.515054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8cbf8ad4-cd4c-418b-bf08-9585f1fce686 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:04.517658 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8cbf8ad4-cd4c-418b-bf08-9585f1fce686 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:04.537129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-500338fa-f9b6-4e38-a293-a8e35f730dc1 tempest-InstanceUsageAuditLogTestJSON-134665932 tempest-InstanceUsageAuditLogTestJSON-134665932-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:04.538104 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:15:04.538104 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:15:04.588805 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-500338fa-f9b6-4e38-a293-a8e35f730dc1 tempest-InstanceUsageAuditLogTestJSON-134665932 tempest-InstanceUsageAuditLogTestJSON-134665932-project-admin] 10.222.0.49 "GET /compute/v2.1/os-instance_usage_audit_log/2022-05-21 21:15:00" status: 200 len: 318 microversion: 2.1 time: 0.163248 May 21 21:15:04.591709 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 643/1292] 10.222.0.49 () {58 vars in 1250 bytes} [Sat May 21 21:15:04 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-05-21%2021%3A15%3A00 => generated 318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:04.614533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6290de0c-1ce4-46e3-9182-f99ea9c3c072 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b3c6af0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:04.618981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8cbf8ad4-cd4c-418b-bf08-9585f1fce686 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:04.619899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8cbf8ad4-cd4c-418b-bf08-9585f1fce686 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:04.620944 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8cbf8ad4-cd4c-418b-bf08-9585f1fce686 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:04.621940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8cbf8ad4-cd4c-418b-bf08-9585f1fce686 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:04.691864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-8cbf8ad4-cd4c-418b-bf08-9585f1fce686 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Getting quotas for project 3cdfab8428a54520a01fdde7222835be. Resources: {'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:15:04.694848 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6290de0c-1ce4-46e3-9182-f99ea9c3c072 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e" status: 200 len: 1453 microversion: 2.1 time: 0.099262 May 21 21:15:04.699788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-8cbf8ad4-cd4c-418b-bf08-9585f1fce686 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Getting quotas for user c3d9543f794d40be9c24715bf530add3 and project 3cdfab8428a54520a01fdde7222835be. Resources: {'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:15:04.701183 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 644/1293] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:04 2022] GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e => generated 1453 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:04.703218 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:04.718911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3855e5ae-304a-4b7f-8d2a-5db2a8331ef6 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:04.719677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3855e5ae-304a-4b7f-8d2a-5db2a8331ef6 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 2efd4657-7152-42ae-92d6-9249939767ed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:04.738757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3855e5ae-304a-4b7f-8d2a-5db2a8331ef6 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:04.739220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3855e5ae-304a-4b7f-8d2a-5db2a8331ef6 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:04.740022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3855e5ae-304a-4b7f-8d2a-5db2a8331ef6 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:04.748342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3855e5ae-304a-4b7f-8d2a-5db2a8331ef6 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:04.949969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3855e5ae-304a-4b7f-8d2a-5db2a8331ef6 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:04.961702 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3855e5ae-304a-4b7f-8d2a-5db2a8331ef6 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed" status: 200 len: 1308 microversion: 2.1 time: 0.259088 May 21 21:15:04.965023 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 645/1294] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:04 2022] GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed => generated 1308 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:04.970567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-11a14611-2c20-4b5d-a693-a5249b7d651a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Action: 'create', calling method: .version_select at 0x7fc81b2f3c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-804847213", "description": "tempest-description-1763321472"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:05.273402 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8cbf8ad4-cd4c-418b-bf08-9585f1fce686 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "POST /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889/action" status: 202 len: 0 microversion: 2.1 time: 0.781701 May 21 21:15:05.278332 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 650/1295] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:15:04 2022] POST /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889/action => generated 0 bytes in 787 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:15:05.285719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a86a5dc1-6edb-44b3-98a7-bb31e99145bd tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:05.290674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a86a5dc1-6edb-44b3-98a7-bb31e99145bd tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:05.385368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a86a5dc1-6edb-44b3-98a7-bb31e99145bd tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:05.394788 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a86a5dc1-6edb-44b3-98a7-bb31e99145bd tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1224 microversion: 2.1 time: 0.114842 May 21 21:15:05.408090 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 651/1296] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:05 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1224 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:05.416597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-16105380-5551-4086-bb88-4efa5780ac47 tempest-InstanceUsageAuditLogTestJSON-134665932 tempest-InstanceUsageAuditLogTestJSON-134665932-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:05.421448 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:15:05.421448 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:15:05.469836 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-16105380-5551-4086-bb88-4efa5780ac47 tempest-InstanceUsageAuditLogTestJSON-134665932 tempest-InstanceUsageAuditLogTestJSON-134665932-project-admin] 10.222.0.49 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.059474 May 21 21:15:05.472014 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 652/1297] 10.222.0.49 () {58 vars in 1184 bytes} [Sat May 21 21:15:05 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:05.494819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-32692ad9-3a8d-4237-86c7-a710b6cc8210 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:05.495399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-32692ad9-3a8d-4237-86c7-a710b6cc8210 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:05.508490 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-11a14611-2c20-4b5d-a693-a5249b7d651a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.541634 May 21 21:15:05.508864 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 646/1298] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:15:04 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:05.530355 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32692ad9-3a8d-4237-86c7-a710b6cc8210 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:05.538362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32692ad9-3a8d-4237-86c7-a710b6cc8210 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:05.538921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32692ad9-3a8d-4237-86c7-a710b6cc8210 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:05.539385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32692ad9-3a8d-4237-86c7-a710b6cc8210 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:05.597905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a9d08aad-3cfc-4b81-be0a-f029e3fe125c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1768663560", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "3aca5486-8d2f-4873-a368-534e03eca6d4"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:05.716833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-a9d08aad-3cfc-4b81-be0a-f029e3fe125c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] validate_networks() for [('3aca5486-8d2f-4873-a368-534e03eca6d4', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:15:06.052105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-32692ad9-3a8d-4237-86c7-a710b6cc8210 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:06.063423 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-32692ad9-3a8d-4237-86c7-a710b6cc8210 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1467 microversion: 2.1 time: 0.589957 May 21 21:15:06.070903 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 653/1299] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:05 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1467 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:06.089558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fd9660d8-ef94-44fa-b4bc-1358c677872b tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b3fc670>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:06.177734 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fd9660d8-ef94-44fa-b4bc-1358c677872b tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e" status: 200 len: 1453 microversion: 2.1 time: 0.102166 May 21 21:15:06.184729 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 654/1300] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:06 2022] GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:06.194475 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-efa69723-0018-4dd2-a9da-18e1d5a3115e tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:06.202266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-efa69723-0018-4dd2-a9da-18e1d5a3115e tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 2efd4657-7152-42ae-92d6-9249939767ed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:06.224144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efa69723-0018-4dd2-a9da-18e1d5a3115e tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:06.236655 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efa69723-0018-4dd2-a9da-18e1d5a3115e tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:06.241694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efa69723-0018-4dd2-a9da-18e1d5a3115e tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:06.241694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efa69723-0018-4dd2-a9da-18e1d5a3115e tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:06.274455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:06.878394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-efa69723-0018-4dd2-a9da-18e1d5a3115e tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:06.889655 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-efa69723-0018-4dd2-a9da-18e1d5a3115e tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed" status: 200 len: 1308 microversion: 2.1 time: 0.709572 May 21 21:15:06.893911 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 655/1301] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:06 2022] GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed => generated 1308 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:06.916317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a712c3b7-3402-43fb-9467-8a9bcf25f379 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:06.924551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a712c3b7-3402-43fb-9467-8a9bcf25f379 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:06.947111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a712c3b7-3402-43fb-9467-8a9bcf25f379 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:06.947479 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a712c3b7-3402-43fb-9467-8a9bcf25f379 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:06.951139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a712c3b7-3402-43fb-9467-8a9bcf25f379 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:06.951807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a712c3b7-3402-43fb-9467-8a9bcf25f379 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:07.127366 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a712c3b7-3402-43fb-9467-8a9bcf25f379 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:07.155987 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a712c3b7-3402-43fb-9467-8a9bcf25f379 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1276 microversion: 2.1 time: 0.259117 May 21 21:15:07.157856 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 656/1302] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:06 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1276 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:07.171749 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-be4eaf12-be7f-47dc-ae8d-87477e4aaa90 req-8eec2177-cc24-4937-b089-3eaf6f41e546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4531a7ea-7be9-48b8-adac-fe968ff5d889", "name": "network-vif-plugged", "status": "completed", "tag": "d47da14c-0379-42b1-91a7-7b1098c8cded"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:07.192919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-be4eaf12-be7f-47dc-ae8d-87477e4aaa90 req-8eec2177-cc24-4937-b089-3eaf6f41e546 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:07.193667 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-be4eaf12-be7f-47dc-ae8d-87477e4aaa90 req-8eec2177-cc24-4937-b089-3eaf6f41e546 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:07.226087 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-be4eaf12-be7f-47dc-ae8d-87477e4aaa90 req-8eec2177-cc24-4937-b089-3eaf6f41e546 service nova] Creating event network-vif-plugged:d47da14c-0379-42b1-91a7-7b1098c8cded for instance 4531a7ea-7be9-48b8-adac-fe968ff5d889 on nch1-master-1 May 21 21:15:07.233764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-a9d08aad-3cfc-4b81-be0a-f029e3fe125c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:15:07.234802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-a9d08aad-3cfc-4b81-be0a-f029e3fe125c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:15:07.235459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-a9d08aad-3cfc-4b81-be0a-f029e3fe125c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:15:07.236044 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-a9d08aad-3cfc-4b81-be0a-f029e3fe125c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:15:07.236675 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-a9d08aad-3cfc-4b81-be0a-f029e3fe125c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:15:07.237209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [req-be4eaf12-be7f-47dc-ae8d-87477e4aaa90 req-8eec2177-cc24-4937-b089-3eaf6f41e546 service nova] Instance 4531a7ea-7be9-48b8-adac-fe968ff5d889 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=131278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 21:15:07.251852 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9d08aad-3cfc-4b81-be0a-f029e3fe125c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:07.253202 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-be4eaf12-be7f-47dc-ae8d-87477e4aaa90 req-8eec2177-cc24-4937-b089-3eaf6f41e546 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093647 May 21 21:15:07.253922 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9d08aad-3cfc-4b81-be0a-f029e3fe125c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:07.254960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9d08aad-3cfc-4b81-be0a-f029e3fe125c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:07.256012 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 657/1303] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:07.256695 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9d08aad-3cfc-4b81-be0a-f029e3fe125c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:07.271657 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aad1ea94-a6b5-4796-9dad-afb931f0e3eb tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:07.273274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-aad1ea94-a6b5-4796-9dad-afb931f0e3eb tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:07.302597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-a9d08aad-3cfc-4b81-be0a-f029e3fe125c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Getting quotas for project 53774c838bd64b319776f9afa0821b79. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:15:07.310702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-a9d08aad-3cfc-4b81-be0a-f029e3fe125c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Getting quotas for user 5e82c479130c4377a9a27dd7c8bbe611 and project 53774c838bd64b319776f9afa0821b79. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:15:07.316998 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aad1ea94-a6b5-4796-9dad-afb931f0e3eb tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:07.318662 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aad1ea94-a6b5-4796-9dad-afb931f0e3eb tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:07.321340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aad1ea94-a6b5-4796-9dad-afb931f0e3eb tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:07.323806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aad1ea94-a6b5-4796-9dad-afb931f0e3eb tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:07.326123 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a9d08aad-3cfc-4b81-be0a-f029e3fe125c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:15:07.330071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a9d08aad-3cfc-4b81-be0a-f029e3fe125c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:15:07.473318 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a9d08aad-3cfc-4b81-be0a-f029e3fe125c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.879541 May 21 21:15:07.474930 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 647/1304] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:15:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 21 21:15:07.485727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c0af786d-fb1b-4297-918e-3dccdc6d636a tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b22f670>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:07.575126 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c0af786d-fb1b-4297-918e-3dccdc6d636a tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e" status: 200 len: 1453 microversion: 2.1 time: 0.098712 May 21 21:15:07.580894 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 648/1305] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:07 2022] GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:07.590040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5c779390-07ee-486e-9495-f412e298b204 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:07.590591 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5c779390-07ee-486e-9495-f412e298b204 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:07.719929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5c779390-07ee-486e-9495-f412e298b204 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:07.754671 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5c779390-07ee-486e-9495-f412e298b204 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f" status: 200 len: 1216 microversion: 2.1 time: 0.160322 May 21 21:15:07.755643 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 649/1306] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:07 2022] GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f => generated 1216 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:07.912309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0650d1da-a81e-4f70-8541-0a82e74b6b83 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:07.912972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0650d1da-a81e-4f70-8541-0a82e74b6b83 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 2efd4657-7152-42ae-92d6-9249939767ed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:07.927944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0650d1da-a81e-4f70-8541-0a82e74b6b83 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:07.929834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0650d1da-a81e-4f70-8541-0a82e74b6b83 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:07.931721 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0650d1da-a81e-4f70-8541-0a82e74b6b83 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:07.932812 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0650d1da-a81e-4f70-8541-0a82e74b6b83 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:07.994669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-aad1ea94-a6b5-4796-9dad-afb931f0e3eb tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:08.030122 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-aad1ea94-a6b5-4796-9dad-afb931f0e3eb tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1467 microversion: 2.1 time: 0.772654 May 21 21:15:08.030652 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 658/1307] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:07 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1467 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:08.175348 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a8a9212f-7968-4f92-8406-de0e5442a073 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:08.175958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a8a9212f-7968-4f92-8406-de0e5442a073 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:08.190639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a8a9212f-7968-4f92-8406-de0e5442a073 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:08.191170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a8a9212f-7968-4f92-8406-de0e5442a073 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:08.192377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a8a9212f-7968-4f92-8406-de0e5442a073 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:08.193088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a8a9212f-7968-4f92-8406-de0e5442a073 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:08.241707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0650d1da-a81e-4f70-8541-0a82e74b6b83 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:08.255121 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0650d1da-a81e-4f70-8541-0a82e74b6b83 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed" status: 200 len: 1308 microversion: 2.1 time: 0.346914 May 21 21:15:08.256678 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 650/1308] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:07 2022] GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed => generated 1308 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:15:08.425842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a8a9212f-7968-4f92-8406-de0e5442a073 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:08.446324 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a8a9212f-7968-4f92-8406-de0e5442a073 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1282 microversion: 2.1 time: 0.270761 May 21 21:15:08.467103 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 659/1309] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:08 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1282 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:08.589425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d03f5883-cc33-4cb7-8a55-84277911f50a tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b3c6e50>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:08.675809 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d03f5883-cc33-4cb7-8a55-84277911f50a tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e" status: 200 len: 1453 microversion: 2.1 time: 0.091727 May 21 21:15:08.676571 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 651/1310] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:08 2022] GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:08.773540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-012e68e7-3b8c-4e06-b532-f67818a1f7d5 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:08.774428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-012e68e7-3b8c-4e06-b532-f67818a1f7d5 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:09.009306 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-012e68e7-3b8c-4e06-b532-f67818a1f7d5 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:09.038720 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-012e68e7-3b8c-4e06-b532-f67818a1f7d5 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f" status: 200 len: 1216 microversion: 2.1 time: 0.269904 May 21 21:15:09.040005 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 660/1311] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:08 2022] GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f => generated 1216 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:09.056959 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-04bf36ec-2d6f-4afc-8364-a740fe16221e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:09.057927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-04bf36ec-2d6f-4afc-8364-a740fe16221e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:09.065531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-04bf36ec-2d6f-4afc-8364-a740fe16221e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:09.066293 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-04bf36ec-2d6f-4afc-8364-a740fe16221e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:09.067385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-04bf36ec-2d6f-4afc-8364-a740fe16221e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:09.068104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-04bf36ec-2d6f-4afc-8364-a740fe16221e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:09.279420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ab7e3042-d94c-44d7-b65c-d8f0fa109164 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:09.280180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ab7e3042-d94c-44d7-b65c-d8f0fa109164 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 2efd4657-7152-42ae-92d6-9249939767ed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:09.286461 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-04bf36ec-2d6f-4afc-8364-a740fe16221e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:09.291620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab7e3042-d94c-44d7-b65c-d8f0fa109164 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:09.292186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab7e3042-d94c-44d7-b65c-d8f0fa109164 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:09.293093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab7e3042-d94c-44d7-b65c-d8f0fa109164 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:09.293586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab7e3042-d94c-44d7-b65c-d8f0fa109164 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:09.300247 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-04bf36ec-2d6f-4afc-8364-a740fe16221e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1467 microversion: 2.1 time: 0.248152 May 21 21:15:09.312311 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 652/1312] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:09 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1467 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:09.327890 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f20b318f-e40e-4481-b736-ee2f9f97fe83 req-17e59fe5-af2b-489b-af21-8ea638c095ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2efd4657-7152-42ae-92d6-9249939767ed", "name": "network-vif-plugged", "status": "completed", "tag": "500741bf-90f2-4eed-9a27-ca517aaff42a"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:09.350860 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f20b318f-e40e-4481-b736-ee2f9f97fe83 req-17e59fe5-af2b-489b-af21-8ea638c095ff service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:09.351319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f20b318f-e40e-4481-b736-ee2f9f97fe83 req-17e59fe5-af2b-489b-af21-8ea638c095ff service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:09.382737 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f20b318f-e40e-4481-b736-ee2f9f97fe83 req-17e59fe5-af2b-489b-af21-8ea638c095ff service nova] Creating event network-vif-plugged:500741bf-90f2-4eed-9a27-ca517aaff42a for instance 2efd4657-7152-42ae-92d6-9249939767ed on nch1-master-1 May 21 21:15:09.389395 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f20b318f-e40e-4481-b736-ee2f9f97fe83 req-17e59fe5-af2b-489b-af21-8ea638c095ff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081489 May 21 21:15:09.392767 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 653/1313] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:09.471253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-18436200-eed9-43ce-9e6b-b6044b8f12f3 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:09.472310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-18436200-eed9-43ce-9e6b-b6044b8f12f3 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:09.487317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-18436200-eed9-43ce-9e6b-b6044b8f12f3 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:09.489669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-18436200-eed9-43ce-9e6b-b6044b8f12f3 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:09.496016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-18436200-eed9-43ce-9e6b-b6044b8f12f3 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:09.496016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-18436200-eed9-43ce-9e6b-b6044b8f12f3 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:09.619091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-18436200-eed9-43ce-9e6b-b6044b8f12f3 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:09.630418 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-18436200-eed9-43ce-9e6b-b6044b8f12f3 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1282 microversion: 2.1 time: 0.164334 May 21 21:15:09.642208 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 654/1314] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:09 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1282 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:15:09.655256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ab7e3042-d94c-44d7-b65c-d8f0fa109164 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:09.664823 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ab7e3042-d94c-44d7-b65c-d8f0fa109164 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed" status: 200 len: 1308 microversion: 2.1 time: 0.390606 May 21 21:15:09.675495 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 661/1315] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:09 2022] GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed => generated 1308 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:09.690182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-49fee45b-ea46-42ab-b586-e5aee0041233 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b3d15e0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:09.962793 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-49fee45b-ea46-42ab-b586-e5aee0041233 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e" status: 200 len: 1453 microversion: 2.1 time: 0.123513 May 21 21:15:09.962793 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 655/1316] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:09 2022] GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e => generated 1453 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:10.059236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aec4b1ac-9ba4-4d98-a910-27755978d482 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:10.060017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-aec4b1ac-9ba4-4d98-a910-27755978d482 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:10.078506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aec4b1ac-9ba4-4d98-a910-27755978d482 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:10.080322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aec4b1ac-9ba4-4d98-a910-27755978d482 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:10.084236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aec4b1ac-9ba4-4d98-a910-27755978d482 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:10.084943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aec4b1ac-9ba4-4d98-a910-27755978d482 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:10.222189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-aec4b1ac-9ba4-4d98-a910-27755978d482 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:10.240756 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-aec4b1ac-9ba4-4d98-a910-27755978d482 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f" status: 200 len: 1220 microversion: 2.1 time: 0.186857 May 21 21:15:10.251461 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 662/1317] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:10 2022] GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f => generated 1220 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:10.320629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c15b8a2f-8779-493e-afc3-20a8e323be71 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:10.321871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c15b8a2f-8779-493e-afc3-20a8e323be71 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:10.372431 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c15b8a2f-8779-493e-afc3-20a8e323be71 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:10.377039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c15b8a2f-8779-493e-afc3-20a8e323be71 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:10.379083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c15b8a2f-8779-493e-afc3-20a8e323be71 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:10.383873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c15b8a2f-8779-493e-afc3-20a8e323be71 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:10.648185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1ea5bcc0-f29b-4bcb-a1a4-6992a7e29864 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:10.648742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1ea5bcc0-f29b-4bcb-a1a4-6992a7e29864 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:10.676635 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ea5bcc0-f29b-4bcb-a1a4-6992a7e29864 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:10.685633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ea5bcc0-f29b-4bcb-a1a4-6992a7e29864 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:10.686489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ea5bcc0-f29b-4bcb-a1a4-6992a7e29864 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:10.686932 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ea5bcc0-f29b-4bcb-a1a4-6992a7e29864 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:10.830977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c15b8a2f-8779-493e-afc3-20a8e323be71 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:10.856544 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c15b8a2f-8779-493e-afc3-20a8e323be71 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1467 microversion: 2.1 time: 0.541252 May 21 21:15:10.857138 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 656/1318] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:10 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1467 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:10.861699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4ac20b0a-5c68-4644-95da-cb0825a16beb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:10.862312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4ac20b0a-5c68-4644-95da-cb0825a16beb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 2efd4657-7152-42ae-92d6-9249939767ed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:10.878147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ac20b0a-5c68-4644-95da-cb0825a16beb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:10.878600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ac20b0a-5c68-4644-95da-cb0825a16beb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:10.889388 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ac20b0a-5c68-4644-95da-cb0825a16beb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:10.890089 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ac20b0a-5c68-4644-95da-cb0825a16beb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:11.003199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1ea5bcc0-f29b-4bcb-a1a4-6992a7e29864 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:11.019667 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1ea5bcc0-f29b-4bcb-a1a4-6992a7e29864 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1324 microversion: 2.1 time: 0.375190 May 21 21:15:11.020952 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 663/1319] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:10 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1324 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:15:11.030588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-162a48b9-994d-4b3c-8064-a37ad4e15263 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b3a80d0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:11.116948 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-162a48b9-994d-4b3c-8064-a37ad4e15263 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e" status: 200 len: 1453 microversion: 2.1 time: 0.094664 May 21 21:15:11.117532 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 664/1320] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:11 2022] GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:11.127404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4ac20b0a-5c68-4644-95da-cb0825a16beb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:11.136562 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4ac20b0a-5c68-4644-95da-cb0825a16beb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed" status: 200 len: 1308 microversion: 2.1 time: 0.278378 May 21 21:15:11.149741 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 657/1321] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:10 2022] GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed => generated 1308 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:11.259151 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-875bd3d5-9ac3-456e-9c5e-da7b9c9d8c1d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:11.263623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-875bd3d5-9ac3-456e-9c5e-da7b9c9d8c1d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:11.268029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-875bd3d5-9ac3-456e-9c5e-da7b9c9d8c1d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:11.269193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-875bd3d5-9ac3-456e-9c5e-da7b9c9d8c1d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:11.270244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-875bd3d5-9ac3-456e-9c5e-da7b9c9d8c1d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:11.270884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-875bd3d5-9ac3-456e-9c5e-da7b9c9d8c1d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:11.395598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-875bd3d5-9ac3-456e-9c5e-da7b9c9d8c1d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:11.404022 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-875bd3d5-9ac3-456e-9c5e-da7b9c9d8c1d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f" status: 200 len: 1268 microversion: 2.1 time: 0.149318 May 21 21:15:11.404905 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 665/1322] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:11 2022] GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:11.875819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-31619d5d-f4cc-4455-97ab-a71ac3296821 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:11.876884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-31619d5d-f4cc-4455-97ab-a71ac3296821 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:11.891466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31619d5d-f4cc-4455-97ab-a71ac3296821 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:11.892245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31619d5d-f4cc-4455-97ab-a71ac3296821 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:11.895737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31619d5d-f4cc-4455-97ab-a71ac3296821 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:11.895737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31619d5d-f4cc-4455-97ab-a71ac3296821 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:12.038009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f9f1bacb-6fe6-4da0-80c5-55eb00ede6b2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:12.039290 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f9f1bacb-6fe6-4da0-80c5-55eb00ede6b2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:12.059302 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f9f1bacb-6fe6-4da0-80c5-55eb00ede6b2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:12.059775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f9f1bacb-6fe6-4da0-80c5-55eb00ede6b2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:12.060622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f9f1bacb-6fe6-4da0-80c5-55eb00ede6b2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:12.061076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f9f1bacb-6fe6-4da0-80c5-55eb00ede6b2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:12.156181 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-31619d5d-f4cc-4455-97ab-a71ac3296821 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:12.159531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:12.166638 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-31619d5d-f4cc-4455-97ab-a71ac3296821 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1467 microversion: 2.1 time: 0.295380 May 21 21:15:12.167594 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 658/1323] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:11 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1467 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:12.172368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-36a4e59e-9453-4954-be62-3e587aa87e5c req-c97052cf-907f-4198-96f0-7d2cb10842f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd05f19-07e5-4ed2-846c-250e839345f6", "tag": "525aa738-49ca-4abe-aa07-8919b01951c3"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:12.181397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-36a4e59e-9453-4954-be62-3e587aa87e5c req-c97052cf-907f-4198-96f0-7d2cb10842f5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:12.181848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-36a4e59e-9453-4954-be62-3e587aa87e5c req-c97052cf-907f-4198-96f0-7d2cb10842f5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:12.193759 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-36a4e59e-9453-4954-be62-3e587aa87e5c req-c97052cf-907f-4198-96f0-7d2cb10842f5 service nova] Creating event network-changed:525aa738-49ca-4abe-aa07-8919b01951c3 for instance 6dd05f19-07e5-4ed2-846c-250e839345f6 on nch2-master-1 May 21 21:15:12.199554 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-36a4e59e-9453-4954-be62-3e587aa87e5c req-c97052cf-907f-4198-96f0-7d2cb10842f5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030713 May 21 21:15:12.200170 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 659/1324] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:12.206216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0c666379-226c-43b4-ad8f-8186211a9341 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b2dfee0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:12.263614 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0c666379-226c-43b4-ad8f-8186211a9341 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e" status: 200 len: 1462 microversion: 2.1 time: 0.061883 May 21 21:15:12.264704 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 660/1325] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:12 2022] GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e => generated 1462 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:12.270040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7290d294-2b24-4963-a8e2-a8d99030bdee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:12.272031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7290d294-2b24-4963-a8e2-a8d99030bdee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 2efd4657-7152-42ae-92d6-9249939767ed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:12.286514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7290d294-2b24-4963-a8e2-a8d99030bdee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:12.286514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7290d294-2b24-4963-a8e2-a8d99030bdee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:12.286514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7290d294-2b24-4963-a8e2-a8d99030bdee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:12.286514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7290d294-2b24-4963-a8e2-a8d99030bdee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:12.562824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7290d294-2b24-4963-a8e2-a8d99030bdee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:12.579838 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7290d294-2b24-4963-a8e2-a8d99030bdee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed" status: 200 len: 1489 microversion: 2.1 time: 0.313642 May 21 21:15:12.582015 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 661/1326] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:12 2022] GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed => generated 1489 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:12.593171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5638129f-1118-4322-bf23-57e6c6e7bd2e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b1dfd30>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:12.663548 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5638129f-1118-4322-bf23-57e6c6e7bd2e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e" status: 200 len: 1462 microversion: 2.1 time: 0.079267 May 21 21:15:12.664823 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 662/1327] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:12 2022] GET /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e => generated 1462 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:12.684817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f9f1bacb-6fe6-4da0-80c5-55eb00ede6b2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:12.737094 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f9f1bacb-6fe6-4da0-80c5-55eb00ede6b2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1324 microversion: 2.1 time: 0.699608 May 21 21:15:12.737952 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 666/1328] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:12 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1324 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:12.739196 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bd68366e-652a-48c2-8372-eeb59ac8e8ca tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:12.745068 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bd68366e-652a-48c2-8372-eeb59ac8e8ca tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:12.752929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd68366e-652a-48c2-8372-eeb59ac8e8ca tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:12.753473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd68366e-652a-48c2-8372-eeb59ac8e8ca tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:12.759744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd68366e-652a-48c2-8372-eeb59ac8e8ca tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:12.759874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-826829df-94dd-4780-8d51-1de516fed0fa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:12.759966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd68366e-652a-48c2-8372-eeb59ac8e8ca tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:12.760453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-826829df-94dd-4780-8d51-1de516fed0fa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 2efd4657-7152-42ae-92d6-9249939767ed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:12.773227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-826829df-94dd-4780-8d51-1de516fed0fa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:12.773684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-826829df-94dd-4780-8d51-1de516fed0fa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:12.775142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-826829df-94dd-4780-8d51-1de516fed0fa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:12.775587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-826829df-94dd-4780-8d51-1de516fed0fa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:12.875055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bd68366e-652a-48c2-8372-eeb59ac8e8ca tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:12.888711 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bd68366e-652a-48c2-8372-eeb59ac8e8ca tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f" status: 200 len: 1286 microversion: 2.1 time: 0.211672 May 21 21:15:12.889451 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 663/1329] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:12 2022] GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f => generated 1286 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:12.909395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a5e17aa6-f3c9-46b5-8706-551cd90f2144 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:12.910031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a5e17aa6-f3c9-46b5-8706-551cd90f2144 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: 55818247-81af-4cf1-bff3-92aeb3f06bba] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:12.916260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5e17aa6-f3c9-46b5-8706-551cd90f2144 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:12.916983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5e17aa6-f3c9-46b5-8706-551cd90f2144 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:12.917929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5e17aa6-f3c9-46b5-8706-551cd90f2144 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:12.918520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5e17aa6-f3c9-46b5-8706-551cd90f2144 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:13.068184 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-826829df-94dd-4780-8d51-1de516fed0fa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "POST /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed/action" status: 202 len: 0 microversion: 2.1 time: 0.328450 May 21 21:15:13.069720 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 667/1330] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:15:12 2022] POST /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:15:13.084504 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a86a5a0e-3b29-441d-b20a-81ac82c51ff4 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:13.088961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a86a5a0e-3b29-441d-b20a-81ac82c51ff4 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 2efd4657-7152-42ae-92d6-9249939767ed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:13.100963 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a86a5a0e-3b29-441d-b20a-81ac82c51ff4 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:13.102092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a86a5a0e-3b29-441d-b20a-81ac82c51ff4 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:13.104723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a86a5a0e-3b29-441d-b20a-81ac82c51ff4 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:13.105867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a86a5a0e-3b29-441d-b20a-81ac82c51ff4 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:13.219287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a5e17aa6-f3c9-46b5-8706-551cd90f2144 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:13.233201 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a5e17aa6-f3c9-46b5-8706-551cd90f2144 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba" status: 200 len: 1465 microversion: 2.1 time: 0.327182 May 21 21:15:13.239194 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 664/1331] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:12 2022] GET /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba => generated 1465 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:13.250167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-07477045-c7f2-4631-acec-f08fc7b2a41a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:13.253281 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-07477045-c7f2-4631-acec-f08fc7b2a41a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:13.262807 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07477045-c7f2-4631-acec-f08fc7b2a41a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:13.265025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07477045-c7f2-4631-acec-f08fc7b2a41a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:13.265025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07477045-c7f2-4631-acec-f08fc7b2a41a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:13.265025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07477045-c7f2-4631-acec-f08fc7b2a41a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:13.526626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a86a5a0e-3b29-441d-b20a-81ac82c51ff4 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:13.537704 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a86a5a0e-3b29-441d-b20a-81ac82c51ff4 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed" status: 200 len: 1494 microversion: 2.1 time: 0.462494 May 21 21:15:13.538966 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 668/1332] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:13 2022] GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed => generated 1494 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:13.554367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d69d5e53-676a-40e7-9c27-169eeb8f70be tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1317216846"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:13.561548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d69d5e53-676a-40e7-9c27-169eeb8f70be tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:13.584020 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d69d5e53-676a-40e7-9c27-169eeb8f70be tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:13.591004 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d69d5e53-676a-40e7-9c27-169eeb8f70be tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:13.591985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d69d5e53-676a-40e7-9c27-169eeb8f70be tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:13.596951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d69d5e53-676a-40e7-9c27-169eeb8f70be tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:13.753319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-07477045-c7f2-4631-acec-f08fc7b2a41a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:13.774568 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-07477045-c7f2-4631-acec-f08fc7b2a41a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1533 microversion: 2.1 time: 0.530936 May 21 21:15:13.782860 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 665/1333] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:13 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1533 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:13.795960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cc1d76fe-4afb-49dd-abed-cdb6cb131c69 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:13.799006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cc1d76fe-4afb-49dd-abed-cdb6cb131c69 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:13.814085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cc1d76fe-4afb-49dd-abed-cdb6cb131c69 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:13.817208 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cc1d76fe-4afb-49dd-abed-cdb6cb131c69 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:13.818249 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cc1d76fe-4afb-49dd-abed-cdb6cb131c69 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:13.818872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cc1d76fe-4afb-49dd-abed-cdb6cb131c69 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:14.187224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cc1d76fe-4afb-49dd-abed-cdb6cb131c69 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:14.198409 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cc1d76fe-4afb-49dd-abed-cdb6cb131c69 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1324 microversion: 2.1 time: 0.413649 May 21 21:15:14.202185 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 666/1334] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:13 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1324 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:14.209548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2fde2004-3ebe-433f-82bc-7b962655ead5 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:14.210711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2fde2004-3ebe-433f-82bc-7b962655ead5 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:14.218884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fde2004-3ebe-433f-82bc-7b962655ead5 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:14.219343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fde2004-3ebe-433f-82bc-7b962655ead5 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:14.220527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fde2004-3ebe-433f-82bc-7b962655ead5 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:14.221278 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fde2004-3ebe-433f-82bc-7b962655ead5 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:14.452331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2fde2004-3ebe-433f-82bc-7b962655ead5 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:14.460119 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2fde2004-3ebe-433f-82bc-7b962655ead5 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f" status: 200 len: 1316 microversion: 2.1 time: 0.256160 May 21 21:15:14.460761 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 667/1335] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:14 2022] GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:14.466131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-ca7e5b27-26d5-4e8f-a781-4881ffb05144 req-c5e1b1b1-8378-41b6-b287-363777c7c416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4531a7ea-7be9-48b8-adac-fe968ff5d889", "name": "network-vif-unplugged", "status": "completed", "tag": "d47da14c-0379-42b1-91a7-7b1098c8cded"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:14.474278 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ca7e5b27-26d5-4e8f-a781-4881ffb05144 req-c5e1b1b1-8378-41b6-b287-363777c7c416 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:14.474727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ca7e5b27-26d5-4e8f-a781-4881ffb05144 req-c5e1b1b1-8378-41b6-b287-363777c7c416 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:14.492675 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-ca7e5b27-26d5-4e8f-a781-4881ffb05144 req-c5e1b1b1-8378-41b6-b287-363777c7c416 service nova] Creating event network-vif-unplugged:d47da14c-0379-42b1-91a7-7b1098c8cded for instance 4531a7ea-7be9-48b8-adac-fe968ff5d889 on nch1-master-1 May 21 21:15:14.499411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [req-ca7e5b27-26d5-4e8f-a781-4881ffb05144 req-c5e1b1b1-8378-41b6-b287-363777c7c416 service nova] Instance 4531a7ea-7be9-48b8-adac-fe968ff5d889 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=131277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 21:15:14.506327 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-ca7e5b27-26d5-4e8f-a781-4881ffb05144 req-c5e1b1b1-8378-41b6-b287-363777c7c416 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044178 May 21 21:15:14.511785 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 668/1336] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:14.644407 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:14.661957 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b6c2a1e8-708b-4857-b600-6fc86d75206c tempest-QuotaClassesAdmin257Test-306548279 tempest-QuotaClassesAdmin257Test-306548279-project-admin] Calling method '.version_select at 0x7fc81b2df940>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:14.663208 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:15:14.663208 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:15:14.677703 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b6c2a1e8-708b-4857-b600-6fc86d75206c tempest-QuotaClassesAdmin257Test-306548279 tempest-QuotaClassesAdmin257Test-306548279-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.164289 May 21 21:15:14.683498 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 669/1337] 10.222.0.49 () {60 vars in 1225 bytes} [Sat May 21 21:15:14 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:15:14.693102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-398b580a-39d4-4602-aea2-0f9e86c970fe tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:14.693858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-398b580a-39d4-4602-aea2-0f9e86c970fe tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 2efd4657-7152-42ae-92d6-9249939767ed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:14.702179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-398b580a-39d4-4602-aea2-0f9e86c970fe tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:14.702632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-398b580a-39d4-4602-aea2-0f9e86c970fe tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:14.703634 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-398b580a-39d4-4602-aea2-0f9e86c970fe tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:14.704086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-398b580a-39d4-4602-aea2-0f9e86c970fe tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:14.866032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-398b580a-39d4-4602-aea2-0f9e86c970fe tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:14.875005 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-398b580a-39d4-4602-aea2-0f9e86c970fe tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed" status: 200 len: 1474 microversion: 2.1 time: 0.195277 May 21 21:15:14.887735 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 670/1338] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:14 2022] GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed => generated 1474 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:14.887735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e0a3efd8-1e97-4043-b180-046fd5ceef66 tempest-QuotaClassesAdmin257Test-306548279 tempest-QuotaClassesAdmin257Test-306548279-project-admin] Action: 'update', calling method: .version_select at 0x7fc81b22f280>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:14.887735 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:15:14.887735 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:15:14.892923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=29 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:15.791291 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d69d5e53-676a-40e7-9c27-169eeb8f70be tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "POST /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88/action" status: 202 len: 0 microversion: 2.1 time: 2.250456 May 21 21:15:15.806648 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 669/1339] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:15:13 2022] POST /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88/action => generated 0 bytes in 2267 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 21 21:15:15.813763 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9b65d7ec-02ea-4736-b412-1c4190c4ad28 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:15.814729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9b65d7ec-02ea-4736-b412-1c4190c4ad28 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:15.823820 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9b65d7ec-02ea-4736-b412-1c4190c4ad28 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:15.840227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9b65d7ec-02ea-4736-b412-1c4190c4ad28 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:15.845710 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9b65d7ec-02ea-4736-b412-1c4190c4ad28 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:15.846158 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9b65d7ec-02ea-4736-b412-1c4190c4ad28 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:15.906024 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:UPDATE=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:16.334904 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9b65d7ec-02ea-4736-b412-1c4190c4ad28 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:16.343382 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9b65d7ec-02ea-4736-b412-1c4190c4ad28 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1533 microversion: 2.1 time: 0.535067 May 21 21:15:16.348032 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 670/1340] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:15 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1533 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:16.350504 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bcd4da18-5b91-499f-b936-004981f2a243 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1504192970"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:16.351842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bcd4da18-5b91-499f-b936-004981f2a243 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 2efd4657-7152-42ae-92d6-9249939767ed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:16.359627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bcd4da18-5b91-499f-b936-004981f2a243 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:16.360087 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bcd4da18-5b91-499f-b936-004981f2a243 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:16.360928 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bcd4da18-5b91-499f-b936-004981f2a243 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:16.361378 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bcd4da18-5b91-499f-b936-004981f2a243 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:16.581291 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e0a3efd8-1e97-4043-b180-046fd5ceef66 tempest-QuotaClassesAdmin257Test-306548279 tempest-QuotaClassesAdmin257Test-306548279-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 1.704182 May 21 21:15:16.589428 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 671/1341] 10.222.0.49 () {62 vars in 1246 bytes} [Sat May 21 21:15:14 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:15:16.595692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f7b322e0-cf07-4d60-9325-db88ee57d5c0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:16.596533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f7b322e0-cf07-4d60-9325-db88ee57d5c0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:16.603758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7b322e0-cf07-4d60-9325-db88ee57d5c0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:16.604325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7b322e0-cf07-4d60-9325-db88ee57d5c0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:16.606568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7b322e0-cf07-4d60-9325-db88ee57d5c0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:16.607081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7b322e0-cf07-4d60-9325-db88ee57d5c0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:16.800732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:16.810282 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f7b322e0-cf07-4d60-9325-db88ee57d5c0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:16.820260 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f7b322e0-cf07-4d60-9325-db88ee57d5c0 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1324 microversion: 2.1 time: 0.229137 May 21 21:15:16.820663 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 672/1342] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:16 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1324 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:16.826133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-698d7a16-ea9d-4c4b-abc8-ebac277d3316 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:16.826751 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-698d7a16-ea9d-4c4b-abc8-ebac277d3316 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:16.834308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-698d7a16-ea9d-4c4b-abc8-ebac277d3316 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:16.834741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-698d7a16-ea9d-4c4b-abc8-ebac277d3316 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:16.835503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-698d7a16-ea9d-4c4b-abc8-ebac277d3316 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:16.835937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-698d7a16-ea9d-4c4b-abc8-ebac277d3316 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:16.993632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-698d7a16-ea9d-4c4b-abc8-ebac277d3316 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:17.001542 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-698d7a16-ea9d-4c4b-abc8-ebac277d3316 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f" status: 200 len: 1316 microversion: 2.1 time: 0.178957 May 21 21:15:17.007015 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 673/1343] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:16 2022] GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f => generated 1316 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:17.013048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-46c30890-8140-4d19-941e-df794facafec tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b408430>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:17.058443 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-46c30890-8140-4d19-941e-df794facafec tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/2f5eec8a-f8ee-48fa-a9cf-d9572da37393" status: 200 len: 1453 microversion: 2.1 time: 0.050202 May 21 21:15:17.059119 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 674/1344] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:17 2022] GET /compute/v2.1/images/2f5eec8a-f8ee-48fa-a9cf-d9572da37393 => generated 1453 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:17.063765 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-47357f84-eb39-47aa-8480-9dcc90dbff50 req-ec0981d8-ad51-4df4-bacd-9088e8fb471b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55818247-81af-4cf1-bff3-92aeb3f06bba", "name": "network-vif-unplugged", "status": "completed", "tag": "d78ce8f3-1b0e-4e09-b2ee-8d7b3fe8530e"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:17.072406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-47357f84-eb39-47aa-8480-9dcc90dbff50 req-ec0981d8-ad51-4df4-bacd-9088e8fb471b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:17.075796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-47357f84-eb39-47aa-8480-9dcc90dbff50 req-ec0981d8-ad51-4df4-bacd-9088e8fb471b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:17.087236 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-47357f84-eb39-47aa-8480-9dcc90dbff50 req-ec0981d8-ad51-4df4-bacd-9088e8fb471b service nova] Creating event network-vif-unplugged:d78ce8f3-1b0e-4e09-b2ee-8d7b3fe8530e for instance 55818247-81af-4cf1-bff3-92aeb3f06bba on nch2-master-1 May 21 21:15:17.092488 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-47357f84-eb39-47aa-8480-9dcc90dbff50 req-ec0981d8-ad51-4df4-bacd-9088e8fb471b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032050 May 21 21:15:17.093072 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 675/1345] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:17.098779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-57afbd3c-2ad8-46f3-82b1-9b1c261217f1 tempest-QuotaClassesAdmin257Test-306548279 tempest-QuotaClassesAdmin257Test-306548279-project-admin] Calling method '.version_select at 0x7fc81b408550>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:17.100353 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:15:17.100353 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:15:17.105592 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bcd4da18-5b91-499f-b936-004981f2a243 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "POST /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed/action" status: 202 len: 0 microversion: 2.1 time: 0.760128 May 21 21:15:17.106428 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 671/1346] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:15:16 2022] POST /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed/action => generated 0 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 21 21:15:17.116000 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-57afbd3c-2ad8-46f3-82b1-9b1c261217f1 tempest-QuotaClassesAdmin257Test-306548279 tempest-QuotaClassesAdmin257Test-306548279-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.021523 May 21 21:15:17.116628 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 676/1347] 10.222.0.49 () {60 vars in 1225 bytes} [Sat May 21 21:15:17 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:15:17.120055 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-0b901b60-2669-43f4-aa0f-0565b9a747b1 req-33a4b937-ae2c-4d12-b6e0-d8e0ce3be535 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6300bf23-6e6c-4959-b913-81a4b850397f", "tag": "460cd6f3-8f7e-413a-9811-cf5158ce5e95"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:17.121483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-96ae2f32-6902-4f4e-ba3b-210a63f525c3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b408f70>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:17.137754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0b901b60-2669-43f4-aa0f-0565b9a747b1 req-33a4b937-ae2c-4d12-b6e0-d8e0ce3be535 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:17.138202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0b901b60-2669-43f4-aa0f-0565b9a747b1 req-33a4b937-ae2c-4d12-b6e0-d8e0ce3be535 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:17.149955 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-0b901b60-2669-43f4-aa0f-0565b9a747b1 req-33a4b937-ae2c-4d12-b6e0-d8e0ce3be535 service nova] Creating event network-changed:460cd6f3-8f7e-413a-9811-cf5158ce5e95 for instance 6300bf23-6e6c-4959-b913-81a4b850397f on nch1-master-1 May 21 21:15:17.155190 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-0b901b60-2669-43f4-aa0f-0565b9a747b1 req-33a4b937-ae2c-4d12-b6e0-d8e0ce3be535 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047175 May 21 21:15:17.155788 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 672/1348] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:17.161181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4162915a-7fd0-4724-bbbb-1ce91570c4aa tempest-QuotaClassesAdmin257Test-306548279 tempest-QuotaClassesAdmin257Test-306548279-project-admin] Action: 'update', calling method: .version_select at 0x7fc81b3cf700>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:17.162706 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:15:17.162706 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:15:17.181709 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-96ae2f32-6902-4f4e-ba3b-210a63f525c3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/a01ea977-6a34-4461-99fd-b508fcead394" status: 200 len: 1412 microversion: 2.1 time: 0.064025 May 21 21:15:17.182461 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 677/1349] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:17 2022] GET /compute/v2.1/images/a01ea977-6a34-4461-99fd-b508fcead394 => generated 1412 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:17.358337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:17.363433 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c1d922a9-e6f6-427d-81f4-92e61ca74269 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:17.364177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c1d922a9-e6f6-427d-81f4-92e61ca74269 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:17.372526 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1d922a9-e6f6-427d-81f4-92e61ca74269 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:17.373215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1d922a9-e6f6-427d-81f4-92e61ca74269 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:17.374214 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1d922a9-e6f6-427d-81f4-92e61ca74269 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:17.374826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1d922a9-e6f6-427d-81f4-92e61ca74269 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:17.538826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c1d922a9-e6f6-427d-81f4-92e61ca74269 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:17.549106 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c1d922a9-e6f6-427d-81f4-92e61ca74269 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1526 microversion: 2.1 time: 0.191716 May 21 21:15:17.549695 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 678/1350] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:17 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1526 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:17.566168 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0a821477-e0fa-432e-aaca-85e92dd68114 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:17.571575 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0a821477-e0fa-432e-aaca-85e92dd68114 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:17.573981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a821477-e0fa-432e-aaca-85e92dd68114 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:17.574434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a821477-e0fa-432e-aaca-85e92dd68114 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:17.575286 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a821477-e0fa-432e-aaca-85e92dd68114 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:17.575727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a821477-e0fa-432e-aaca-85e92dd68114 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:17.729535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0a821477-e0fa-432e-aaca-85e92dd68114 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:17.737572 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0a821477-e0fa-432e-aaca-85e92dd68114 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1526 microversion: 2.1 time: 0.175766 May 21 21:15:17.738239 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 679/1351] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:17 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1526 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:15:17.754903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fc6cfe68-d029-4870-9783-5e7df1f8fa7e tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:17.755712 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:15:17.755712 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:15:17.762242 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-fc6cfe68-d029-4870-9783-5e7df1f8fa7e tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] HTTP exception thrown: Flavor b9a3a7a4-330d-41f5-b501-7cbe6e4d1da7 could not be found. May 21 21:15:17.764149 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fc6cfe68-d029-4870-9783-5e7df1f8fa7e tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Request method failure captured: May 21 21:15:17.764149 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/flavors/b9a3a7a4-330d-41f5-b501-7cbe6e4d1da7 HTTP/1.1 May 21 21:15:17.764149 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:15:17.764149 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:15:17.764149 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:15:17.764149 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:15:17.764149 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:15:17.764149 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:15:17.764149 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:15:17.764149 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:15:17.764149 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVVuzAiBT36t_CWYaJvvgTDRmz8nRJzxPzZC1IOe_wjAjMd33vpsdICNpqDCK_HCvcj_RaPLkgshzM26-o-fbkBAp40CaDM3rH4x9PABGofkbL_d5uk9Tb45C4CBZnIVsdyQxHp3wicYBFbeCwWY6U_gqGpNwwdmJ-AUWpJShFDL3Tw May 21 21:15:17.764149 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:15:17.764149 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:15:17.764149 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:15:17.764149 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:15:17.764149 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:15:17.764149 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:15:17.764149 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: c1dd623262494c9187474cbd860b52c2 May 21 21:15:17.764149 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-MigrationsAdminTest-554610794 May 21 21:15:17.764149 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:15:17.764149 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:15:17.765871 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c1dd623262494c9187474cbd860b52c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c1dd623262494c9187474cbd860b52c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c1dd623262494c9187474cbd860b52c2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c1dd623262494c9187474cbd860b52c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:15:17.765871 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-MigrationsAdminTest-554610794 May 21 21:15:17.765871 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: c1dd623262494c9187474cbd860b52c2 May 21 21:15:17.765871 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-MigrationsAdminTest-554610794 May 21 21:15:17.765871 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-MigrationsAdminTest-554610794-project-admin May 21 21:15:17.765871 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:15:17.765871 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:15:17.765871 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: debdf601e2af4bfa8399af03d4c7960d May 21 21:15:17.765871 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-MigrationsAdminTest-554610794-project-admin May 21 21:15:17.765871 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:15:17.765871 ncdv-master-1 devstack@n-api.service[131277]: exception: Flavor b9a3a7a4-330d-41f5-b501-7cbe6e4d1da7 could not be found. May 21 21:15:17.765871 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'b9a3a7a4-330d-41f5-b501-7cbe6e4d1da7'} May 21 21:15:17.766710 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:15:17.766710 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:17.766710 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete May 21 21:15:17.766710 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi flavor.destroy() May 21 21:15:17.766710 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 21 21:15:17.766710 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 21 21:15:17.766710 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy May 21 21:15:17.766710 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, May 21 21:15:17.766710 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy May 21 21:15:17.766710 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) May 21 21:15:17.766710 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:15:17.766710 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:15:17.766710 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy May 21 21:15:17.766710 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) May 21 21:15:17.766710 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor b9a3a7a4-330d-41f5-b501-7cbe6e4d1da7 could not be found. May 21 21:15:17.766710 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:17.766710 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:15:17.766710 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:17.766710 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:17.766710 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:15:17.768172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:15:17.768172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:15:17.768172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:15:17.768172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:15:17.768172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:15:17.768172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete May 21 21:15:17.768172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:15:17.768172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor b9a3a7a4-330d-41f5-b501-7cbe6e4d1da7 could not be found. May 21 21:15:17.768172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:17.768172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:15:17.768172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:17.768172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:17.768172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:15:17.768172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:15:17.768172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:15:17.768172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:15:17.768172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor b9a3a7a4-330d-41f5-b501-7cbe6e4d1da7 could not be found. May 21 21:15:17.768172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:17.778303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fc6cfe68-d029-4870-9783-5e7df1f8fa7e tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Returning 404 to user: Flavor b9a3a7a4-330d-41f5-b501-7cbe6e4d1da7 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:15:17.778303 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fc6cfe68-d029-4870-9783-5e7df1f8fa7e tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/b9a3a7a4-330d-41f5-b501-7cbe6e4d1da7" status: 404 len: 109 microversion: 2.1 time: 0.014583 May 21 21:15:17.778303 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 680/1352] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:15:17 2022] DELETE /compute/v2.1/flavors/b9a3a7a4-330d-41f5-b501-7cbe6e4d1da7 => generated 109 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:15:17.834838 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4162915a-7fd0-4724-bbbb-1ce91570c4aa tempest-QuotaClassesAdmin257Test-306548279 tempest-QuotaClassesAdmin257Test-306548279-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.677553 May 21 21:15:17.835904 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 673/1353] 10.222.0.49 () {62 vars in 1246 bytes} [Sat May 21 21:15:17 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:15:17.868998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c336c6f7-78e4-47fa-8956-06cb6370c45b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:17.873816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c336c6f7-78e4-47fa-8956-06cb6370c45b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:17.885646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e46bd7cc-6ec2-4dd5-8ba7-05cbfd8b767d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-578868108", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:17.890383 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c336c6f7-78e4-47fa-8956-06cb6370c45b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:17.890383 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c336c6f7-78e4-47fa-8956-06cb6370c45b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:17.890383 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c336c6f7-78e4-47fa-8956-06cb6370c45b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:17.890714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c336c6f7-78e4-47fa-8956-06cb6370c45b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:17.970595 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-e46bd7cc-6ec2-4dd5-8ba7-05cbfd8b767d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] validate_networks() for None {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:15:18.089782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c336c6f7-78e4-47fa-8956-06cb6370c45b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:18.099088 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c336c6f7-78e4-47fa-8956-06cb6370c45b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1324 microversion: 2.1 time: 0.245004 May 21 21:15:18.099869 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 681/1354] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:17 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1324 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:18.108627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e101b606-7857-4e5a-ad62-c19209b54a3e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:18.109504 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e101b606-7857-4e5a-ad62-c19209b54a3e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:18.116944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e101b606-7857-4e5a-ad62-c19209b54a3e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:18.117410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e101b606-7857-4e5a-ad62-c19209b54a3e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:18.119267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e101b606-7857-4e5a-ad62-c19209b54a3e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:18.119731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e101b606-7857-4e5a-ad62-c19209b54a3e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:18.295869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e101b606-7857-4e5a-ad62-c19209b54a3e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:18.296408 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-e46bd7cc-6ec2-4dd5-8ba7-05cbfd8b767d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:15:18.297216 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-e46bd7cc-6ec2-4dd5-8ba7-05cbfd8b767d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:15:18.297950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-e46bd7cc-6ec2-4dd5-8ba7-05cbfd8b767d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:15:18.298717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-e46bd7cc-6ec2-4dd5-8ba7-05cbfd8b767d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:15:18.299465 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-e46bd7cc-6ec2-4dd5-8ba7-05cbfd8b767d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:15:18.310302 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e101b606-7857-4e5a-ad62-c19209b54a3e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f" status: 200 len: 1316 microversion: 2.1 time: 0.208719 May 21 21:15:18.318691 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 682/1355] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:18 2022] GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f => generated 1316 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:18.318988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e46bd7cc-6ec2-4dd5-8ba7-05cbfd8b767d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:18.318988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e46bd7cc-6ec2-4dd5-8ba7-05cbfd8b767d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:18.318988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e46bd7cc-6ec2-4dd5-8ba7-05cbfd8b767d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:18.318988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e46bd7cc-6ec2-4dd5-8ba7-05cbfd8b767d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:18.319361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b162855e-298e-4a85-82d4-251b415a4976 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b408d30>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:18.343725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-e46bd7cc-6ec2-4dd5-8ba7-05cbfd8b767d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Getting quotas for project 3cdfab8428a54520a01fdde7222835be. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:15:18.349074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-e46bd7cc-6ec2-4dd5-8ba7-05cbfd8b767d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Getting quotas for user c3d9543f794d40be9c24715bf530add3 and project 3cdfab8428a54520a01fdde7222835be. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:15:18.364579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e46bd7cc-6ec2-4dd5-8ba7-05cbfd8b767d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:15:18.367512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e46bd7cc-6ec2-4dd5-8ba7-05cbfd8b767d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:15:18.387266 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b162855e-298e-4a85-82d4-251b415a4976 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/2f5eec8a-f8ee-48fa-a9cf-d9572da37393" status: 200 len: 1453 microversion: 2.1 time: 0.070451 May 21 21:15:18.387266 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 683/1356] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:18 2022] GET /compute/v2.1/images/2f5eec8a-f8ee-48fa-a9cf-d9572da37393 => generated 1453 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:18.389808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-59d766d1-448b-46c6-a97b-116ba3c2a906 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b22f280>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:18.436844 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-59d766d1-448b-46c6-a97b-116ba3c2a906 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/a01ea977-6a34-4461-99fd-b508fcead394" status: 200 len: 1412 microversion: 2.1 time: 0.050756 May 21 21:15:18.437497 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 684/1357] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:18 2022] GET /compute/v2.1/images/a01ea977-6a34-4461-99fd-b508fcead394 => generated 1412 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:18.573627 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e46bd7cc-6ec2-4dd5-8ba7-05cbfd8b767d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.692407 May 21 21:15:18.574655 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 674/1358] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:15:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:15:18.585422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d4743f73-8caa-46ea-8cfd-c08ee2093c3c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:18.587456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d4743f73-8caa-46ea-8cfd-c08ee2093c3c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:18.670148 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d4743f73-8caa-46ea-8cfd-c08ee2093c3c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:18.681776 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d4743f73-8caa-46ea-8cfd-c08ee2093c3c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1212 microversion: 2.1 time: 0.101350 May 21 21:15:18.698161 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 685/1359] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:18 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1212 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:15:19.108372 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-8d9b3cae-4c97-49ca-9d47-69752b5b0435 req-c2fe487d-276a-4387-a660-067cdda175c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd05f19-07e5-4ed2-846c-250e839345f6", "name": "network-vif-plugged", "status": "completed", "tag": "525aa738-49ca-4abe-aa07-8919b01951c3"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:19.116947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f074c5ca-dda1-4c68-9165-a3974c762778 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:19.118548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f074c5ca-dda1-4c68-9165-a3974c762778 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:19.119355 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-8d9b3cae-4c97-49ca-9d47-69752b5b0435 req-c2fe487d-276a-4387-a660-067cdda175c1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:19.119809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-8d9b3cae-4c97-49ca-9d47-69752b5b0435 req-c2fe487d-276a-4387-a660-067cdda175c1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:19.124620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f074c5ca-dda1-4c68-9165-a3974c762778 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:19.125116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f074c5ca-dda1-4c68-9165-a3974c762778 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:19.126076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f074c5ca-dda1-4c68-9165-a3974c762778 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:19.126683 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f074c5ca-dda1-4c68-9165-a3974c762778 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:19.134371 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-8d9b3cae-4c97-49ca-9d47-69752b5b0435 req-c2fe487d-276a-4387-a660-067cdda175c1 service nova] Creating event network-vif-plugged:525aa738-49ca-4abe-aa07-8919b01951c3 for instance 6dd05f19-07e5-4ed2-846c-250e839345f6 on nch2-master-1 May 21 21:15:19.141159 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-8d9b3cae-4c97-49ca-9d47-69752b5b0435 req-c2fe487d-276a-4387-a660-067cdda175c1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037510 May 21 21:15:19.142136 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 675/1360] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:19.328261 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c4a6cce9-6003-4a2c-927e-4f9c8ed1a48c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:19.329280 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c4a6cce9-6003-4a2c-927e-4f9c8ed1a48c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:19.337455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4a6cce9-6003-4a2c-927e-4f9c8ed1a48c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:19.338201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4a6cce9-6003-4a2c-927e-4f9c8ed1a48c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:19.339152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4a6cce9-6003-4a2c-927e-4f9c8ed1a48c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:19.339760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4a6cce9-6003-4a2c-927e-4f9c8ed1a48c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:19.453965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f074c5ca-dda1-4c68-9165-a3974c762778 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:19.466838 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f074c5ca-dda1-4c68-9165-a3974c762778 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1324 microversion: 2.1 time: 0.353677 May 21 21:15:19.476350 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 686/1361] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:19 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1324 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:15:19.476350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-59e8f2dd-d32a-4b44-aa92-34cba6445a75 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b3c6ca0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:19.530081 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-59e8f2dd-d32a-4b44-aa92-34cba6445a75 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/2f5eec8a-f8ee-48fa-a9cf-d9572da37393" status: 200 len: 1453 microversion: 2.1 time: 0.060922 May 21 21:15:19.531086 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 687/1362] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:19 2022] GET /compute/v2.1/images/2f5eec8a-f8ee-48fa-a9cf-d9572da37393 => generated 1453 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:19.536092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ad57150b-9795-4f53-9978-eec373e3c928 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b4579d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:19.582175 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ad57150b-9795-4f53-9978-eec373e3c928 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/a01ea977-6a34-4461-99fd-b508fcead394" status: 200 len: 1412 microversion: 2.1 time: 0.049888 May 21 21:15:19.582840 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 688/1363] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:19 2022] GET /compute/v2.1/images/a01ea977-6a34-4461-99fd-b508fcead394 => generated 1412 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:19.700739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b3c83ec9-9603-44e5-91b3-4bad356c8a32 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:19.701691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b3c83ec9-9603-44e5-91b3-4bad356c8a32 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:19.777342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b3c83ec9-9603-44e5-91b3-4bad356c8a32 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:19.785990 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b3c83ec9-9603-44e5-91b3-4bad356c8a32 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1212 microversion: 2.1 time: 0.090704 May 21 21:15:19.787163 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 689/1364] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:19 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1212 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:19.992263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c4a6cce9-6003-4a2c-927e-4f9c8ed1a48c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:20.007346 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c4a6cce9-6003-4a2c-927e-4f9c8ed1a48c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f" status: 200 len: 1316 microversion: 2.1 time: 0.679111 May 21 21:15:20.019719 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 676/1365] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:19 2022] GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f => generated 1316 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:20.484677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6bbc87d9-af3d-44ed-92b2-24c8d73bf090 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:20.485245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6bbc87d9-af3d-44ed-92b2-24c8d73bf090 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:20.491924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6bbc87d9-af3d-44ed-92b2-24c8d73bf090 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:20.492403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6bbc87d9-af3d-44ed-92b2-24c8d73bf090 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:20.493802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6bbc87d9-af3d-44ed-92b2-24c8d73bf090 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:20.494238 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6bbc87d9-af3d-44ed-92b2-24c8d73bf090 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:20.544213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8a9d5cba-6843-449a-8df4-514bccddbdee tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b3b3310>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:20.592194 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8a9d5cba-6843-449a-8df4-514bccddbdee tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/2f5eec8a-f8ee-48fa-a9cf-d9572da37393" status: 200 len: 1453 microversion: 2.1 time: 0.053048 May 21 21:15:20.598088 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 677/1366] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:20 2022] GET /compute/v2.1/images/2f5eec8a-f8ee-48fa-a9cf-d9572da37393 => generated 1453 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:15:20.604145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b6a6e387-6024-4696-8f5f-7c8f65aebe62 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b65e3a0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:20.649596 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b6a6e387-6024-4696-8f5f-7c8f65aebe62 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/a01ea977-6a34-4461-99fd-b508fcead394" status: 200 len: 1412 microversion: 2.1 time: 0.050215 May 21 21:15:20.650166 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 678/1367] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:20 2022] GET /compute/v2.1/images/a01ea977-6a34-4461-99fd-b508fcead394 => generated 1412 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:20.655299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6bbc87d9-af3d-44ed-92b2-24c8d73bf090 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:20.663240 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6bbc87d9-af3d-44ed-92b2-24c8d73bf090 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1324 microversion: 2.1 time: 0.182547 May 21 21:15:20.663811 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 690/1368] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:20 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1324 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:20.804462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3dd02bde-5847-4bc7-a697-8233ee997d54 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:20.805659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3dd02bde-5847-4bc7-a697-8233ee997d54 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:20.812001 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3dd02bde-5847-4bc7-a697-8233ee997d54 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:20.812486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3dd02bde-5847-4bc7-a697-8233ee997d54 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:20.813263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3dd02bde-5847-4bc7-a697-8233ee997d54 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:20.813698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3dd02bde-5847-4bc7-a697-8233ee997d54 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:20.881185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3dd02bde-5847-4bc7-a697-8233ee997d54 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:20.891170 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3dd02bde-5847-4bc7-a697-8233ee997d54 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1216 microversion: 2.1 time: 0.090479 May 21 21:15:20.892076 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 679/1369] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:20 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1216 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:21.025140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-23ce0588-25c5-41ed-b1a9-c92fab74307b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:21.025807 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-23ce0588-25c5-41ed-b1a9-c92fab74307b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:21.032661 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23ce0588-25c5-41ed-b1a9-c92fab74307b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:21.033112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23ce0588-25c5-41ed-b1a9-c92fab74307b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:21.034147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23ce0588-25c5-41ed-b1a9-c92fab74307b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:21.034584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23ce0588-25c5-41ed-b1a9-c92fab74307b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:21.037201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:21.157678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-2daa89fe-73a9-481c-8ae5-c486a643bffe req-79cae863-f7b5-4be9-a1a8-f2a0e7dadc89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4531a7ea-7be9-48b8-adac-fe968ff5d889", "name": "network-vif-plugged", "status": "completed", "tag": "d47da14c-0379-42b1-91a7-7b1098c8cded"}, {"server_uuid": "f0525194-b3aa-482c-a355-c77c63bf4c88", "name": "network-vif-plugged", "status": "completed", "tag": "5eb403c4-fa1f-43de-83df-5b9059a1b1b1"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:21.174419 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2daa89fe-73a9-481c-8ae5-c486a643bffe req-79cae863-f7b5-4be9-a1a8-f2a0e7dadc89 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:21.174958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2daa89fe-73a9-481c-8ae5-c486a643bffe req-79cae863-f7b5-4be9-a1a8-f2a0e7dadc89 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:21.189270 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-2daa89fe-73a9-481c-8ae5-c486a643bffe req-79cae863-f7b5-4be9-a1a8-f2a0e7dadc89 service nova] Creating event network-vif-plugged:d47da14c-0379-42b1-91a7-7b1098c8cded for instance 4531a7ea-7be9-48b8-adac-fe968ff5d889 on nch1-master-1 May 21 21:15:21.189677 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-2daa89fe-73a9-481c-8ae5-c486a643bffe req-79cae863-f7b5-4be9-a1a8-f2a0e7dadc89 service nova] Creating event network-vif-plugged:5eb403c4-fa1f-43de-83df-5b9059a1b1b1 for instance f0525194-b3aa-482c-a355-c77c63bf4c88 on nch2-master-1 May 21 21:15:21.191857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-23ce0588-25c5-41ed-b1a9-c92fab74307b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:21.200769 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-2daa89fe-73a9-481c-8ae5-c486a643bffe req-79cae863-f7b5-4be9-a1a8-f2a0e7dadc89 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046902 May 21 21:15:21.201391 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 680/1370] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:21.203913 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-23ce0588-25c5-41ed-b1a9-c92fab74307b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f" status: 200 len: 1316 microversion: 2.1 time: 0.182600 May 21 21:15:21.204648 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 691/1371] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:21 2022] GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:21.607092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-34b03b7a-bcb5-4e98-9ccc-5710100624a1 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b3b3b80>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:21.650801 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-34b03b7a-bcb5-4e98-9ccc-5710100624a1 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/2f5eec8a-f8ee-48fa-a9cf-d9572da37393" status: 200 len: 1453 microversion: 2.1 time: 0.048782 May 21 21:15:21.651362 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 681/1372] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:21 2022] GET /compute/v2.1/images/2f5eec8a-f8ee-48fa-a9cf-d9572da37393 => generated 1453 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:21.662768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ce58e598-e1b1-4817-8a83-edfd35cd4c9b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b4b1af0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:21.683339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-94d7cc00-0eb2-4814-aed8-9b0b17d65ca6 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:21.684113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-94d7cc00-0eb2-4814-aed8-9b0b17d65ca6 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:21.693774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94d7cc00-0eb2-4814-aed8-9b0b17d65ca6 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:21.694250 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94d7cc00-0eb2-4814-aed8-9b0b17d65ca6 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:21.695190 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94d7cc00-0eb2-4814-aed8-9b0b17d65ca6 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:21.698243 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94d7cc00-0eb2-4814-aed8-9b0b17d65ca6 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:21.709471 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ce58e598-e1b1-4817-8a83-edfd35cd4c9b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/a01ea977-6a34-4461-99fd-b508fcead394" status: 200 len: 1412 microversion: 2.1 time: 0.050927 May 21 21:15:21.710287 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 692/1373] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:21 2022] GET /compute/v2.1/images/a01ea977-6a34-4461-99fd-b508fcead394 => generated 1412 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:21.851783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-94d7cc00-0eb2-4814-aed8-9b0b17d65ca6 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:21.859942 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-94d7cc00-0eb2-4814-aed8-9b0b17d65ca6 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1324 microversion: 2.1 time: 0.182700 May 21 21:15:21.860551 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 682/1374] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:21 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1324 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:15:21.909881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2917decf-b1cd-4452-bfb1-557f97aea58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:21.910498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2917decf-b1cd-4452-bfb1-557f97aea58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:21.917729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2917decf-b1cd-4452-bfb1-557f97aea58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:21.918179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2917decf-b1cd-4452-bfb1-557f97aea58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:21.918952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2917decf-b1cd-4452-bfb1-557f97aea58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:21.919414 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2917decf-b1cd-4452-bfb1-557f97aea58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:22.032793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2917decf-b1cd-4452-bfb1-557f97aea58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:22.042155 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2917decf-b1cd-4452-bfb1-557f97aea58c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1216 microversion: 2.1 time: 0.136666 May 21 21:15:22.042795 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 693/1375] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:21 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1216 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:22.222664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-41447120-f6dc-4f1c-83b6-53da9b3bbc6c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:22.228395 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-41447120-f6dc-4f1c-83b6-53da9b3bbc6c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:22.234403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41447120-f6dc-4f1c-83b6-53da9b3bbc6c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:22.235381 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41447120-f6dc-4f1c-83b6-53da9b3bbc6c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:22.237515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41447120-f6dc-4f1c-83b6-53da9b3bbc6c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:22.238190 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41447120-f6dc-4f1c-83b6-53da9b3bbc6c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:22.524061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-41447120-f6dc-4f1c-83b6-53da9b3bbc6c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:22.531846 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-41447120-f6dc-4f1c-83b6-53da9b3bbc6c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f" status: 200 len: 1316 microversion: 2.1 time: 0.313226 May 21 21:15:22.532613 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 683/1376] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:22 2022] GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f => generated 1316 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:22.671160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-08c3eb08-1c5c-4120-b127-a3b65b5033e2 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b4088b0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:22.723618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2b7d6940-044c-40a4-87e4-2703eafccf1c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc82d19b790>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:28.329873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:28.357647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=16 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:29.782556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:UPDATE=7,nova_cell0:SELECT=28 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:31.914659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:UPDATE=5,nova_api:SELECT=50,nova_api:INSERT=5 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:32.228670 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=8,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:32.528822 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:33.127997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=11 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:38.449009 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2b7d6940-044c-40a4-87e4-2703eafccf1c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/a01ea977-6a34-4461-99fd-b508fcead394" status: 200 len: 1421 microversion: 2.1 time: 15.729542 May 21 21:15:38.460419 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 684/1377] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:22 2022] GET /compute/v2.1/images/a01ea977-6a34-4461-99fd-b508fcead394 => generated 1421 bytes in 15732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:15:38.460662 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-08c3eb08-1c5c-4120-b127-a3b65b5033e2 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/2f5eec8a-f8ee-48fa-a9cf-d9572da37393" status: 200 len: 1453 microversion: 2.1 time: 15.790219 May 21 21:15:38.461333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c761f728-56ad-4a67-baaa-72d84b6ce07b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:38.461333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c761f728-56ad-4a67-baaa-72d84b6ce07b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:38.463377 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 694/1378] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:22 2022] GET /compute/v2.1/images/2f5eec8a-f8ee-48fa-a9cf-d9572da37393 => generated 1453 bytes in 15797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:38.464536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c761f728-56ad-4a67-baaa-72d84b6ce07b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:38.467740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c761f728-56ad-4a67-baaa-72d84b6ce07b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:38.467918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-591e1f58-e0b1-4fe6-9936-b8c69dc28d9c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:38.467918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-591e1f58-e0b1-4fe6-9936-b8c69dc28d9c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:38.468156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c761f728-56ad-4a67-baaa-72d84b6ce07b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:38.468156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c761f728-56ad-4a67-baaa-72d84b6ce07b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:38.474375 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-591e1f58-e0b1-4fe6-9936-b8c69dc28d9c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:38.474840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-591e1f58-e0b1-4fe6-9936-b8c69dc28d9c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:38.475879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-591e1f58-e0b1-4fe6-9936-b8c69dc28d9c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:38.476576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-591e1f58-e0b1-4fe6-9936-b8c69dc28d9c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:38.626965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c761f728-56ad-4a67-baaa-72d84b6ce07b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:38.636698 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c761f728-56ad-4a67-baaa-72d84b6ce07b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1521 microversion: 2.1 time: 0.184755 May 21 21:15:38.638134 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 685/1379] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:38 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:38.643103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-591e1f58-e0b1-4fe6-9936-b8c69dc28d9c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:38.643919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-93239054-28e8-49a7-bb3d-8fbd6c435d3a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:38.644428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-93239054-28e8-49a7-bb3d-8fbd6c435d3a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:38.654712 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-591e1f58-e0b1-4fe6-9936-b8c69dc28d9c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1312 microversion: 2.1 time: 0.193899 May 21 21:15:38.654941 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 695/1380] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:38 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1312 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:38.660311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f05093ea-0d76-42f6-bfd1-89fd3c5399e9 req-5d44cf57-c2e7-4167-9c79-bce31b8ed004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6300bf23-6e6c-4959-b913-81a4b850397f", "name": "network-vif-plugged", "status": "completed", "tag": "460cd6f3-8f7e-413a-9811-cf5158ce5e95"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:38.671711 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-93239054-28e8-49a7-bb3d-8fbd6c435d3a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:38.674943 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f05093ea-0d76-42f6-bfd1-89fd3c5399e9 req-5d44cf57-c2e7-4167-9c79-bce31b8ed004 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:38.675271 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-93239054-28e8-49a7-bb3d-8fbd6c435d3a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:38.675387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f05093ea-0d76-42f6-bfd1-89fd3c5399e9 req-5d44cf57-c2e7-4167-9c79-bce31b8ed004 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:38.675494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-93239054-28e8-49a7-bb3d-8fbd6c435d3a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:38.675494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-93239054-28e8-49a7-bb3d-8fbd6c435d3a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:38.693457 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f05093ea-0d76-42f6-bfd1-89fd3c5399e9 req-5d44cf57-c2e7-4167-9c79-bce31b8ed004 service nova] Creating event network-vif-plugged:460cd6f3-8f7e-413a-9811-cf5158ce5e95 for instance 6300bf23-6e6c-4959-b913-81a4b850397f on nch1-master-1 May 21 21:15:38.695545 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f05093ea-0d76-42f6-bfd1-89fd3c5399e9 req-5d44cf57-c2e7-4167-9c79-bce31b8ed004 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039171 May 21 21:15:38.699006 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 696/1381] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:38.850798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-93239054-28e8-49a7-bb3d-8fbd6c435d3a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:38.856734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5f0ad88c-7861-471c-ac24-46cbdaa3fdc4 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Calling method '.version_select at 0x7fc81b44d8b0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:38.860422 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-93239054-28e8-49a7-bb3d-8fbd6c435d3a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f" status: 200 len: 1316 microversion: 2.1 time: 0.219200 May 21 21:15:38.861115 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 686/1382] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:38 2022] GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f => generated 1316 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:38.935636 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-a48896df-8f8f-485b-ad9f-37c80f590f94 req-28100bb7-e7d0-4839-9c5c-996045dabcd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add2b490-a27b-434c-9ff5-aa58ee869b78", "tag": "6bd26e7a-5e3e-4a20-8012-db2830ba8f9e"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:38.941678 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5f0ad88c-7861-471c-ac24-46cbdaa3fdc4 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/8f92240c957b4dc189fb8322a993d52b" status: 200 len: 371 microversion: 2.1 time: 0.241346 May 21 21:15:38.948212 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 697/1383] 10.222.0.49 () {58 vars in 1241 bytes} [Sat May 21 21:15:38 2022] GET /compute/v2.1/os-quota-sets/8f92240c957b4dc189fb8322a993d52b => generated 371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:38.949999 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c9f22cd7-f419-45f4-86d2-51c225a9858a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b2df1f0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:38.953026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a48896df-8f8f-485b-ad9f-37c80f590f94 req-28100bb7-e7d0-4839-9c5c-996045dabcd6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:38.953211 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a48896df-8f8f-485b-ad9f-37c80f590f94 req-28100bb7-e7d0-4839-9c5c-996045dabcd6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:38.966986 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-a48896df-8f8f-485b-ad9f-37c80f590f94 req-28100bb7-e7d0-4839-9c5c-996045dabcd6 service nova] Creating event network-changed:6bd26e7a-5e3e-4a20-8012-db2830ba8f9e for instance add2b490-a27b-434c-9ff5-aa58ee869b78 on nch2-master-1 May 21 21:15:38.978444 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-a48896df-8f8f-485b-ad9f-37c80f590f94 req-28100bb7-e7d0-4839-9c5c-996045dabcd6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115778 May 21 21:15:38.979146 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 687/1384] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:38.986253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f0b53fe5-e857-429e-bae9-fb05134adfea tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:38.987042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f0b53fe5-e857-429e-bae9-fb05134adfea tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:38.997819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0b53fe5-e857-429e-bae9-fb05134adfea tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:38.998276 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0b53fe5-e857-429e-bae9-fb05134adfea tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:38.999131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0b53fe5-e857-429e-bae9-fb05134adfea tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:38.999580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0b53fe5-e857-429e-bae9-fb05134adfea tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:39.004470 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c9f22cd7-f419-45f4-86d2-51c225a9858a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/a01ea977-6a34-4461-99fd-b508fcead394" status: 200 len: 1421 microversion: 2.1 time: 0.060310 May 21 21:15:39.005053 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 698/1385] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:38 2022] GET /compute/v2.1/images/a01ea977-6a34-4461-99fd-b508fcead394 => generated 1421 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:39.010624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c7ad9400-a508-4ba9-92e9-27d079a3ff39 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Action: 'update', calling method: .version_select at 0x7fc81b3ca0d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:39.077627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7ad9400-a508-4ba9-92e9-27d079a3ff39 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:39.078081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7ad9400-a508-4ba9-92e9-27d079a3ff39 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:39.079377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7ad9400-a508-4ba9-92e9-27d079a3ff39 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:39.079825 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7ad9400-a508-4ba9-92e9-27d079a3ff39 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:39.209451 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c7ad9400-a508-4ba9-92e9-27d079a3ff39 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/8f92240c957b4dc189fb8322a993d52b" status: 200 len: 328 microversion: 2.1 time: 0.203031 May 21 21:15:39.210020 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 699/1386] 10.222.0.49 () {60 vars in 1261 bytes} [Sat May 21 21:15:39 2022] PUT /compute/v2.1/os-quota-sets/8f92240c957b4dc189fb8322a993d52b => generated 328 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:39.214853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8b6906e3-c51b-4aa9-b70b-103ef86b0ed8 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b3d1dc0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:39.269532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f0b53fe5-e857-429e-bae9-fb05134adfea tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:39.278198 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f0b53fe5-e857-429e-bae9-fb05134adfea tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1521 microversion: 2.1 time: 0.297722 May 21 21:15:39.278865 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 688/1387] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:38 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:39.283106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-03365702-7bb6-4b63-b3b6-4da2a117f917 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:39.393091 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-03365702-7bb6-4b63-b3b6-4da2a117f917 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-quota-sets/8f92240c957b4dc189fb8322a993d52b" status: 202 len: 0 microversion: 2.1 time: 0.113245 May 21 21:15:39.393717 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 689/1388] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:15:39 2022] DELETE /compute/v2.1/os-quota-sets/8f92240c957b4dc189fb8322a993d52b => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:15:39.399164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-21b717d9-0fd5-4e26-9bdc-ce1f4b510079 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-701501418"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:39.403056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-21b717d9-0fd5-4e26-9bdc-ce1f4b510079 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:39.406875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21b717d9-0fd5-4e26-9bdc-ce1f4b510079 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:39.407340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21b717d9-0fd5-4e26-9bdc-ce1f4b510079 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:39.408759 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21b717d9-0fd5-4e26-9bdc-ce1f4b510079 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:39.409391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21b717d9-0fd5-4e26-9bdc-ce1f4b510079 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:39.938925 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-21b717d9-0fd5-4e26-9bdc-ce1f4b510079 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "POST /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6/action" status: 202 len: 0 microversion: 2.1 time: 0.543882 May 21 21:15:39.939580 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 690/1389] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:15:39 2022] POST /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 21 21:15:39.944420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-17917967-2ead-4fb9-9d45-e59928f9e23c tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Calling method '.version_select at 0x7fc82d196d30>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:40.013991 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-17917967-2ead-4fb9-9d45-e59928f9e23c tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/8f92240c957b4dc189fb8322a993d52b" status: 200 len: 371 microversion: 2.1 time: 0.073244 May 21 21:15:40.014562 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 691/1390] 10.222.0.49 () {58 vars in 1241 bytes} [Sat May 21 21:15:39 2022] GET /compute/v2.1/os-quota-sets/8f92240c957b4dc189fb8322a993d52b => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:40.019017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8932b3a1-8c7a-45f2-9792-bc4fa74d124b tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b3ee430>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:40.071279 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8932b3a1-8c7a-45f2-9792-bc4fa74d124b tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/2f5eec8a-f8ee-48fa-a9cf-d9572da37393" status: 200 len: 1462 microversion: 2.1 time: 0.055459 May 21 21:15:40.072874 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 692/1391] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:40 2022] GET /compute/v2.1/images/2f5eec8a-f8ee-48fa-a9cf-d9572da37393 => generated 1462 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:40.083956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b9d2c7f0-d7af-40c4-9f60-0b861af779fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:40.084732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b9d2c7f0-d7af-40c4-9f60-0b861af779fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:40.095122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9d2c7f0-d7af-40c4-9f60-0b861af779fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:40.095122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9d2c7f0-d7af-40c4-9f60-0b861af779fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:40.095122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9d2c7f0-d7af-40c4-9f60-0b861af779fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:40.095587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9d2c7f0-d7af-40c4-9f60-0b861af779fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:40.259078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b9d2c7f0-d7af-40c4-9f60-0b861af779fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:40.267320 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b9d2c7f0-d7af-40c4-9f60-0b861af779fd tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1312 microversion: 2.1 time: 0.192957 May 21 21:15:40.267896 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 693/1392] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:40 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1312 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:40.272463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-34b2c526-85bb-42ff-a512-f2e6ebcf6374 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:40.273079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-34b2c526-85bb-42ff-a512-f2e6ebcf6374 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:40.279717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34b2c526-85bb-42ff-a512-f2e6ebcf6374 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:40.280167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34b2c526-85bb-42ff-a512-f2e6ebcf6374 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:40.281022 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34b2c526-85bb-42ff-a512-f2e6ebcf6374 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:40.281459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34b2c526-85bb-42ff-a512-f2e6ebcf6374 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:40.436071 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-34b2c526-85bb-42ff-a512-f2e6ebcf6374 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:40.444430 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-34b2c526-85bb-42ff-a512-f2e6ebcf6374 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f" status: 200 len: 1316 microversion: 2.1 time: 0.175431 May 21 21:15:40.446615 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 694/1393] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:40 2022] GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:40.450445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-68368de2-c84c-4209-a350-f58f9372fc28 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '.version_select at 0x7fc81b44e1f0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:40.714459 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-68368de2-c84c-4209-a350-f58f9372fc28 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "DELETE /compute/v2.1/images/f5286ee1-6820-43b0-9941-2b8864a05fd7" status: 204 len: 0 microversion: 2.1 time: 0.268380 May 21 21:15:40.715040 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 695/1394] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:40 2022] DELETE /compute/v2.1/images/f5286ee1-6820-43b0-9941-2b8864a05fd7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:15:40.721168 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c9e07b82-b7e5-4b45-b239-343dc6f3894d tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b3ee790>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:40.771536 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c9e07b82-b7e5-4b45-b239-343dc6f3894d tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/2f5eec8a-f8ee-48fa-a9cf-d9572da37393" status: 200 len: 1462 microversion: 2.1 time: 0.053547 May 21 21:15:40.771536 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 696/1395] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:40 2022] GET /compute/v2.1/images/2f5eec8a-f8ee-48fa-a9cf-d9572da37393 => generated 1462 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:40.781978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3fc91081-fa08-4b98-8395-26545506d6a3 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Calling method '.version_select at 0x7fc81b3b3160>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:40.806273 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8b6906e3-c51b-4aa9-b70b-103ef86b0ed8 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "DELETE /compute/v2.1/images/a01ea977-6a34-4461-99fd-b508fcead394" status: 204 len: 0 microversion: 2.1 time: 1.594326 May 21 21:15:40.806273 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 700/1396] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:39 2022] DELETE /compute/v2.1/images/a01ea977-6a34-4461-99fd-b508fcead394 => generated 0 bytes in 1596 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:15:40.811182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-e0099fe5-88d4-4ec0-adb7-ca408bb03ee8 req-e8bfce95-8716-4700-bf43-cc7cdbb7a628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2efd4657-7152-42ae-92d6-9249939767ed", "name": "network-vif-plugged", "status": "completed", "tag": "500741bf-90f2-4eed-9a27-ca517aaff42a"}, {"server_uuid": "add2b490-a27b-434c-9ff5-aa58ee869b78", "name": "network-vif-plugged", "status": "completed", "tag": "6bd26e7a-5e3e-4a20-8012-db2830ba8f9e"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:40.833523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-e0099fe5-88d4-4ec0-adb7-ca408bb03ee8 req-e8bfce95-8716-4700-bf43-cc7cdbb7a628 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:40.840270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-e0099fe5-88d4-4ec0-adb7-ca408bb03ee8 req-e8bfce95-8716-4700-bf43-cc7cdbb7a628 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:40.846955 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-e0099fe5-88d4-4ec0-adb7-ca408bb03ee8 req-e8bfce95-8716-4700-bf43-cc7cdbb7a628 service nova] Creating event network-vif-plugged:500741bf-90f2-4eed-9a27-ca517aaff42a for instance 2efd4657-7152-42ae-92d6-9249939767ed on nch1-master-1 May 21 21:15:40.847476 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-e0099fe5-88d4-4ec0-adb7-ca408bb03ee8 req-e8bfce95-8716-4700-bf43-cc7cdbb7a628 service nova] Creating event network-vif-plugged:6bd26e7a-5e3e-4a20-8012-db2830ba8f9e for instance add2b490-a27b-434c-9ff5-aa58ee869b78 on nch2-master-1 May 21 21:15:40.856077 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-e0099fe5-88d4-4ec0-adb7-ca408bb03ee8 req-e8bfce95-8716-4700-bf43-cc7cdbb7a628 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048760 May 21 21:15:40.856988 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 701/1397] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:40.862247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-afa84160-9269-4b12-b83a-e06310ee86ea tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '.version_select at 0x7fc81b44d160>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:40.885742 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-afa84160-9269-4b12-b83a-e06310ee86ea tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] HTTP exception thrown: Image not found. May 21 21:15:40.896771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-afa84160-9269-4b12-b83a-e06310ee86ea tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Request method failure captured: May 21 21:15:40.896771 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/images/f5286ee1-6820-43b0-9941-2b8864a05fd7 HTTP/1.1 May 21 21:15:40.896771 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:15:40.896771 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:15:40.896771 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:15:40.896771 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:15:40.896771 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:15:40.896771 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:15:40.896771 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:15:40.896771 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:15:40.896771 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVYcSiyjAIR82oxkRB6GTuWAKVTX4xG5vMYtW_3BeBGCFxFQjKbNKPB4C0xhPGbN3kZTd0vkZOYFJP4MJ1kk_eZN0RsUqNmA1UP-b-s9HcyrYiVjgp1H1dIVPKi3UtrJ4Ob8-qkiVNLHvP2GMr_o_p2pBItaNXntU_KoEaP7ETd6R3M May 21 21:15:40.896771 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:15:40.896771 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:15:40.896771 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:15:40.896771 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:15:40.896771 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:15:40.896771 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:15:40.896771 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:15:40.896771 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:15:40.896771 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:15:40.896771 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:15:40.898583 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85f6ae1864ee43429c910eb27888608f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:15:40.898583 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:15:40.898583 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:15:40.898583 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:15:40.898583 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:15:40.898583 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:15:40.898583 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:15:40.898583 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 186310904c3943fdb63247b58725140e May 21 21:15:40.898583 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:15:40.898583 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:15:40.898583 ncdv-master-1 devstack@n-api.service[131277]: exception: Image not found. May 21 21:15:40.898583 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'f5286ee1-6820-43b0-9941-2b8864a05fd7'} May 21 21:15:40.898583 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:15:40.899689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:40.899689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 21 21:15:40.899689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 21 21:15:40.899689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:15:40.899689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:15:40.899689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 21 21:15:40.899689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 21 21:15:40.899689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:15:40.899689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:15:40.899689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 21 21:15:40.899689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 21 21:15:40.899689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 21 21:15:40.899689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 21 21:15:40.899689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:15:40.899689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:15:40.899689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:15:40.899689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:15:40.899689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f5286ee1-6820-43b0-9941-2b8864a05fd7 May 21 21:15:40.904428 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:40.904428 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:15:40.904428 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:40.904428 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:40.904428 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 21 21:15:40.904428 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 21 21:15:40.904428 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 21 21:15:40.904428 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 21 21:15:40.904428 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 21 21:15:40.904428 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 21 21:15:40.904428 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 21 21:15:40.904428 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 21 21:15:40.904428 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 21 21:15:40.904428 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 21 21:15:40.904428 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:15:40.904428 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:15:40.904428 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 21 21:15:40.904428 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 21 21:15:40.904428 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:15:40.904428 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:15:40.905895 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 21 21:15:40.905895 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 21 21:15:40.905895 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 21 21:15:40.905895 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 21 21:15:40.905895 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:15:40.905895 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:15:40.905895 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:15:40.905895 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:15:40.905895 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f5286ee1-6820-43b0-9941-2b8864a05fd7 could not be found. May 21 21:15:40.905895 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:40.905895 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:15:40.905895 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:40.905895 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:40.905895 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:15:40.905895 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:15:40.905895 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:15:40.905895 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:15:40.905895 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:15:40.905895 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:15:40.907415 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:15:40.907415 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:15:40.907415 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 21 21:15:40.907415 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 21 21:15:40.907415 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:15:40.907415 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:40.907415 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:15:40.907415 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:40.907415 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:40.907415 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:15:40.907415 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:15:40.907415 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:15:40.907415 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:15:40.907415 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:15:40.907415 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:40.907415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-afa84160-9269-4b12-b83a-e06310ee86ea tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Returning 404 to user: Image not found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:15:40.909027 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-afa84160-9269-4b12-b83a-e06310ee86ea tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/images/f5286ee1-6820-43b0-9941-2b8864a05fd7" status: 404 len: 62 microversion: 2.1 time: 0.041234 May 21 21:15:40.909027 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 702/1398] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:40 2022] GET /compute/v2.1/images/f5286ee1-6820-43b0-9941-2b8864a05fd7 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:15:40.909027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c65db638-b7ec-4a87-a4cc-7c325c0c753d tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:40.909027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c65db638-b7ec-4a87-a4cc-7c325c0c753d tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:40.918109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c65db638-b7ec-4a87-a4cc-7c325c0c753d tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:40.918566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c65db638-b7ec-4a87-a4cc-7c325c0c753d tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:40.919349 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c65db638-b7ec-4a87-a4cc-7c325c0c753d tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:40.919787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c65db638-b7ec-4a87-a4cc-7c325c0c753d tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:40.988416 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3fc91081-fa08-4b98-8395-26545506d6a3 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/2731f5561139495e948f8448f05b3c6d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.210877 May 21 21:15:40.989577 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 697/1399] 10.222.0.49 () {58 vars in 1268 bytes} [Sat May 21 21:15:40 2022] GET /compute/v2.1/os-quota-sets/2731f5561139495e948f8448f05b3c6d/defaults => generated 371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:40.998176 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a779a10c-f09b-4181-b3d9-ece4211efc94 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:40.998392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a779a10c-f09b-4181-b3d9-ece4211efc94 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 2efd4657-7152-42ae-92d6-9249939767ed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:41.010597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a779a10c-f09b-4181-b3d9-ece4211efc94 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:41.011295 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a779a10c-f09b-4181-b3d9-ece4211efc94 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:41.012395 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a779a10c-f09b-4181-b3d9-ece4211efc94 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:41.012844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a779a10c-f09b-4181-b3d9-ece4211efc94 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:41.042969 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a779a10c-f09b-4181-b3d9-ece4211efc94 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 2efd4657-7152-42ae-92d6-9249939767ed] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:15:41.116362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c65db638-b7ec-4a87-a4cc-7c325c0c753d tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:41.124758 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c65db638-b7ec-4a87-a4cc-7c325c0c753d tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 1468 microversion: 2.1 time: 0.222035 May 21 21:15:41.125342 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 703/1400] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:40 2022] GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 => generated 1468 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:41.129860 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3fc422ec-51c0-4d02-acc5-e7ba48defed8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:41.130642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3fc422ec-51c0-4d02-acc5-e7ba48defed8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:41.138591 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3fc422ec-51c0-4d02-acc5-e7ba48defed8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:41.139045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3fc422ec-51c0-4d02-acc5-e7ba48defed8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:41.139815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3fc422ec-51c0-4d02-acc5-e7ba48defed8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:41.140258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3fc422ec-51c0-4d02-acc5-e7ba48defed8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:41.296477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3fc422ec-51c0-4d02-acc5-e7ba48defed8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:41.304333 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3fc422ec-51c0-4d02-acc5-e7ba48defed8 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1533 microversion: 2.1 time: 0.178010 May 21 21:15:41.308383 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 704/1401] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:41 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1533 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:41.309830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dd180619-b46a-41d1-95f4-151b37a58760 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-105226806"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:41.310940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dd180619-b46a-41d1-95f4-151b37a58760 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: 55818247-81af-4cf1-bff3-92aeb3f06bba] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:41.317081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd180619-b46a-41d1-95f4-151b37a58760 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:41.317738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd180619-b46a-41d1-95f4-151b37a58760 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:41.318570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd180619-b46a-41d1-95f4-151b37a58760 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:41.319191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd180619-b46a-41d1-95f4-151b37a58760 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:41.515904 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a779a10c-f09b-4181-b3d9-ece4211efc94 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed" status: 204 len: 0 microversion: 2.1 time: 0.524162 May 21 21:15:41.516706 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 698/1402] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:15:40 2022] DELETE /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:15:41.521948 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d8e003cb-59ef-41cd-bea3-e7825070b60e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:41.530056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d8e003cb-59ef-41cd-bea3-e7825070b60e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:41.530056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8e003cb-59ef-41cd-bea3-e7825070b60e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:41.530668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8e003cb-59ef-41cd-bea3-e7825070b60e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:41.531166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8e003cb-59ef-41cd-bea3-e7825070b60e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:41.531603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8e003cb-59ef-41cd-bea3-e7825070b60e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:41.701232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d8e003cb-59ef-41cd-bea3-e7825070b60e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:41.709146 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d8e003cb-59ef-41cd-bea3-e7825070b60e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1312 microversion: 2.1 time: 0.191166 May 21 21:15:41.709707 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 699/1403] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:41 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1312 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:41.714387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d7a9a52c-3b49-4a06-b857-9924803c8ecc tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Action: 'update', calling method: .version_select at 0x7fc81b44e9d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:41.842682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7a9a52c-3b49-4a06-b857-9924803c8ecc tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:41.848230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7a9a52c-3b49-4a06-b857-9924803c8ecc tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:41.848230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7a9a52c-3b49-4a06-b857-9924803c8ecc tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:41.848230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7a9a52c-3b49-4a06-b857-9924803c8ecc tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:41.885924 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dd180619-b46a-41d1-95f4-151b37a58760 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "POST /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba/action" status: 202 len: 0 microversion: 2.1 time: 0.579086 May 21 21:15:41.891445 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 705/1404] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:15:41 2022] POST /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 21 21:15:41.901905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2fec074d-daaf-4804-a309-567f739035a6 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:41.902646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2fec074d-daaf-4804-a309-567f739035a6 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:41.910455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fec074d-daaf-4804-a309-567f739035a6 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:41.910927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fec074d-daaf-4804-a309-567f739035a6 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:41.911739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fec074d-daaf-4804-a309-567f739035a6 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:41.912178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fec074d-daaf-4804-a309-567f739035a6 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:41.981264 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d7a9a52c-3b49-4a06-b857-9924803c8ecc tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/720f745ebd1f4f06a4aa6f2cc65731bd" status: 200 len: 328 microversion: 2.1 time: 0.270292 May 21 21:15:41.982274 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 700/1405] 10.222.0.49 () {60 vars in 1261 bytes} [Sat May 21 21:15:41 2022] PUT /compute/v2.1/os-quota-sets/720f745ebd1f4f06a4aa6f2cc65731bd => generated 328 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:41.987192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-79618d7b-94fb-4e87-9fc3-63a3204ef677 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-947526777", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "c5f18057-839a-44a2-aa7d-5be2d01e71c9"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:42.044557 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-79618d7b-94fb-4e87-9fc3-63a3204ef677 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] validate_networks() for [('c5f18057-839a-44a2-aa7d-5be2d01e71c9', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:15:42.080772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2fec074d-daaf-4804-a309-567f739035a6 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:42.090076 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2fec074d-daaf-4804-a309-567f739035a6 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f" status: 200 len: 1503 microversion: 2.1 time: 0.194795 May 21 21:15:42.090648 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 706/1406] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:41 2022] GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f => generated 1503 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:42.096576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-64a07ac7-da4a-4955-a629-9b8a180c3896 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b57a940>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:42.149912 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-64a07ac7-da4a-4955-a629-9b8a180c3896 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781" status: 200 len: 1452 microversion: 2.1 time: 0.058006 May 21 21:15:42.150577 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 707/1407] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:42 2022] GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781 => generated 1452 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:42.155326 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-45dd0e53-a52d-4688-b18c-5c438e6ff9b0 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Calling method '.version_select at 0x7fc81b4e8790>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:42.232523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-45dd0e53-a52d-4688-b18c-5c438e6ff9b0 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:42.237039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-45dd0e53-a52d-4688-b18c-5c438e6ff9b0 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:42.244105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-45dd0e53-a52d-4688-b18c-5c438e6ff9b0 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:42.244105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-45dd0e53-a52d-4688-b18c-5c438e6ff9b0 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:42.262578 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-45dd0e53-a52d-4688-b18c-5c438e6ff9b0 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/720f745ebd1f4f06a4aa6f2cc65731bd/detail" status: 200 len: 916 microversion: 2.1 time: 0.110476 May 21 21:15:42.271546 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 708/1408] 10.222.0.49 () {58 vars in 1262 bytes} [Sat May 21 21:15:42 2022] GET /compute/v2.1/os-quota-sets/720f745ebd1f4f06a4aa6f2cc65731bd/detail => generated 916 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:42.277484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-da542068-837a-4bf1-a0b3-0d05446b9210 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1392405057"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:42.279103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-da542068-837a-4bf1-a0b3-0d05446b9210 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:42.291805 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da542068-837a-4bf1-a0b3-0d05446b9210 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:42.292435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da542068-837a-4bf1-a0b3-0d05446b9210 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:42.293264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da542068-837a-4bf1-a0b3-0d05446b9210 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:42.293778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da542068-837a-4bf1-a0b3-0d05446b9210 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:42.463513 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.network.security_group_api [None req-da542068-837a-4bf1-a0b3-0d05446b9210 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Adding security group 044be843-af68-4599-ad14-140b8e7a89ff to port 460cd6f3-8f7e-413a-9811-cf5158ce5e95 May 21 21:15:42.594197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-79618d7b-94fb-4e87-9fc3-63a3204ef677 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:15:42.594639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-79618d7b-94fb-4e87-9fc3-63a3204ef677 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:15:42.595118 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-79618d7b-94fb-4e87-9fc3-63a3204ef677 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:15:42.595705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-79618d7b-94fb-4e87-9fc3-63a3204ef677 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:15:42.596605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-79618d7b-94fb-4e87-9fc3-63a3204ef677 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:15:42.607501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-79618d7b-94fb-4e87-9fc3-63a3204ef677 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:42.608240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-79618d7b-94fb-4e87-9fc3-63a3204ef677 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:42.609345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-79618d7b-94fb-4e87-9fc3-63a3204ef677 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:42.609979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-79618d7b-94fb-4e87-9fc3-63a3204ef677 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:42.632919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-79618d7b-94fb-4e87-9fc3-63a3204ef677 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Getting quotas for project 89256ac3448643b6892e74f55bfb31d3. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:15:42.637776 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-79618d7b-94fb-4e87-9fc3-63a3204ef677 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Getting quotas for user 16686b6509f54c4abfe9d519acfb4a73 and project 89256ac3448643b6892e74f55bfb31d3. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:15:42.653954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-79618d7b-94fb-4e87-9fc3-63a3204ef677 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:15:42.661109 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-79618d7b-94fb-4e87-9fc3-63a3204ef677 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:15:42.797362 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-79618d7b-94fb-4e87-9fc3-63a3204ef677 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.813989 May 21 21:15:42.804843 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 701/1409] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:15:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:15:42.804843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8353d6dc-fc1f-40f7-a6db-a326ed01a41b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:42.804843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8353d6dc-fc1f-40f7-a6db-a326ed01a41b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:42.810218 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8353d6dc-fc1f-40f7-a6db-a326ed01a41b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:42.810593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8353d6dc-fc1f-40f7-a6db-a326ed01a41b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:42.811589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8353d6dc-fc1f-40f7-a6db-a326ed01a41b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:42.812025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8353d6dc-fc1f-40f7-a6db-a326ed01a41b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:42.989728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8353d6dc-fc1f-40f7-a6db-a326ed01a41b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:42.999856 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8353d6dc-fc1f-40f7-a6db-a326ed01a41b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1539 microversion: 2.1 time: 0.200357 May 21 21:15:43.001073 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 702/1410] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:42 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1539 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:43.008049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9aa5f4ae-3009-46a4-8744-fc740572d2b4 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Action: 'update', calling method: .version_select at 0x7fc82d133af0>, body: {"quota_set": {"ram": "2048"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:43.085503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9aa5f4ae-3009-46a4-8744-fc740572d2b4 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:43.086262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9aa5f4ae-3009-46a4-8744-fc740572d2b4 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:43.086730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9aa5f4ae-3009-46a4-8744-fc740572d2b4 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:43.087163 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9aa5f4ae-3009-46a4-8744-fc740572d2b4 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:43.127594 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9aa5f4ae-3009-46a4-8744-fc740572d2b4 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:43.127935 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9aa5f4ae-3009-46a4-8744-fc740572d2b4 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:43.129357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9aa5f4ae-3009-46a4-8744-fc740572d2b4 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:43.129357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9aa5f4ae-3009-46a4-8744-fc740572d2b4 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:43.182470 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-da542068-837a-4bf1-a0b3-0d05446b9210 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "POST /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f/action" status: 202 len: 0 microversion: 2.1 time: 0.915097 May 21 21:15:43.184018 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 709/1411] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:15:42 2022] POST /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f/action => generated 0 bytes in 919 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:15:43.189698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6a6b9e0c-1db7-4d72-8256-36aff2819e94 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:43.190433 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6a6b9e0c-1db7-4d72-8256-36aff2819e94 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:43.198420 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6a6b9e0c-1db7-4d72-8256-36aff2819e94 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:43.205268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6a6b9e0c-1db7-4d72-8256-36aff2819e94 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:43.207970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6a6b9e0c-1db7-4d72-8256-36aff2819e94 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:43.209724 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6a6b9e0c-1db7-4d72-8256-36aff2819e94 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:43.306929 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9aa5f4ae-3009-46a4-8744-fc740572d2b4 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/720f745ebd1f4f06a4aa6f2cc65731bd?user_id=e0fba6c97f7e4fe1bc88337fef077008" status: 200 len: 328 microversion: 2.1 time: 0.303856 May 21 21:15:43.313390 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 703/1412] 10.222.0.49 () {60 vars in 1342 bytes} [Sat May 21 21:15:43 2022] PUT /compute/v2.1/os-quota-sets/720f745ebd1f4f06a4aa6f2cc65731bd?user_id=e0fba6c97f7e4fe1bc88337fef077008 => generated 328 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:43.313784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9040b74e-5fcb-446e-9901-daa10c9077e4 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:43.314524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9040b74e-5fcb-446e-9901-daa10c9077e4 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:43.380774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9040b74e-5fcb-446e-9901-daa10c9077e4 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:43.393398 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9040b74e-5fcb-446e-9901-daa10c9077e4 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1207 microversion: 2.1 time: 0.084291 May 21 21:15:43.395029 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 704/1413] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:43 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1207 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:43.421791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6a6b9e0c-1db7-4d72-8256-36aff2819e94 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:43.435798 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6a6b9e0c-1db7-4d72-8256-36aff2819e94 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1462 microversion: 2.1 time: 0.249999 May 21 21:15:43.436997 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 710/1414] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:43 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1462 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:43.442377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-33953e09-ae2d-466d-8c9c-3b27e289d0ec tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b457e50>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:43.487429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-144e99a4-9de0-4285-903b-d88279a09def req-ed0417d7-db0a-4ded-b4f9-1fea4c7dde3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2efd4657-7152-42ae-92d6-9249939767ed", "name": "network-vif-unplugged", "status": "completed", "tag": "500741bf-90f2-4eed-9a27-ca517aaff42a"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:43.495384 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-33953e09-ae2d-466d-8c9c-3b27e289d0ec tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781" status: 200 len: 1452 microversion: 2.1 time: 0.057013 May 21 21:15:43.496233 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 711/1415] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:43 2022] GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781 => generated 1452 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:43.501922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-144e99a4-9de0-4285-903b-d88279a09def req-ed0417d7-db0a-4ded-b4f9-1fea4c7dde3d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:43.502376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-144e99a4-9de0-4285-903b-d88279a09def req-ed0417d7-db0a-4ded-b4f9-1fea4c7dde3d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:43.520593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-738ca408-d8b6-4191-ac07-cbf0c8e16f0a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-804847213"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:43.520593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-738ca408-d8b6-4191-ac07-cbf0c8e16f0a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:43.520593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-738ca408-d8b6-4191-ac07-cbf0c8e16f0a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:43.520593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-738ca408-d8b6-4191-ac07-cbf0c8e16f0a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:43.521266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-738ca408-d8b6-4191-ac07-cbf0c8e16f0a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:43.521266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-738ca408-d8b6-4191-ac07-cbf0c8e16f0a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:43.521750 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-144e99a4-9de0-4285-903b-d88279a09def req-ed0417d7-db0a-4ded-b4f9-1fea4c7dde3d service nova] Creating event network-vif-unplugged:500741bf-90f2-4eed-9a27-ca517aaff42a for instance 2efd4657-7152-42ae-92d6-9249939767ed on nch1-master-1 May 21 21:15:43.521750 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-144e99a4-9de0-4285-903b-d88279a09def req-ed0417d7-db0a-4ded-b4f9-1fea4c7dde3d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123233 May 21 21:15:43.521750 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 705/1416] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:43.527615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-6a214805-87a6-4e0b-b347-82515341d25e req-d6f7778c-487c-415b-be6a-7c5c025d6f1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6300bf23-6e6c-4959-b913-81a4b850397f", "tag": "460cd6f3-8f7e-413a-9811-cf5158ce5e95"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:43.536860 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6a214805-87a6-4e0b-b347-82515341d25e req-d6f7778c-487c-415b-be6a-7c5c025d6f1b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:43.538142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6a214805-87a6-4e0b-b347-82515341d25e req-d6f7778c-487c-415b-be6a-7c5c025d6f1b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:43.550822 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-6a214805-87a6-4e0b-b347-82515341d25e req-d6f7778c-487c-415b-be6a-7c5c025d6f1b service nova] Creating event network-changed:460cd6f3-8f7e-413a-9811-cf5158ce5e95 for instance 6300bf23-6e6c-4959-b913-81a4b850397f on nch1-master-1 May 21 21:15:43.557338 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-6a214805-87a6-4e0b-b347-82515341d25e req-d6f7778c-487c-415b-be6a-7c5c025d6f1b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034309 May 21 21:15:43.561141 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 706/1417] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:43.566343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4d771e80-03c8-44ec-95f6-542a56de968b tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Calling method '.version_select at 0x7fc81b3fc700>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:43.649547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:43.667185 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4d771e80-03c8-44ec-95f6-542a56de968b tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/720f745ebd1f4f06a4aa6f2cc65731bd?user_id=e0fba6c97f7e4fe1bc88337fef077008" status: 200 len: 370 microversion: 2.1 time: 0.104676 May 21 21:15:43.671079 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 707/1418] 10.222.0.49 () {58 vars in 1322 bytes} [Sat May 21 21:15:43 2022] GET /compute/v2.1/os-quota-sets/720f745ebd1f4f06a4aa6f2cc65731bd?user_id=e0fba6c97f7e4fe1bc88337fef077008 => generated 370 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:43.686393 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.network.security_group_api [None req-738ca408-d8b6-4191-ac07-cbf0c8e16f0a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Adding security group 9428e059-1fc4-450c-a791-05743f24f32c to port 460cd6f3-8f7e-413a-9811-cf5158ce5e95 May 21 21:15:43.687980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9e8f929f-1480-4d1f-bfa1-74c40f392372 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:43.689152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9e8f929f-1480-4d1f-bfa1-74c40f392372 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:43.700308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9e8f929f-1480-4d1f-bfa1-74c40f392372 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:43.702885 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9e8f929f-1480-4d1f-bfa1-74c40f392372 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:43.703711 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9e8f929f-1480-4d1f-bfa1-74c40f392372 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:43.704156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9e8f929f-1480-4d1f-bfa1-74c40f392372 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:44.067112 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9e8f929f-1480-4d1f-bfa1-74c40f392372 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1613 microversion: 2.1 time: 0.394537 May 21 21:15:44.067995 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 708/1419] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:43 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1613 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:44.089620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c212a5c3-a430-4573-8004-9f329372d559 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:44.091203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c212a5c3-a430-4573-8004-9f329372d559 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:44.097624 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c212a5c3-a430-4573-8004-9f329372d559 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:44.098318 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c212a5c3-a430-4573-8004-9f329372d559 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:44.099555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c212a5c3-a430-4573-8004-9f329372d559 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:44.100317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c212a5c3-a430-4573-8004-9f329372d559 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:44.565065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c212a5c3-a430-4573-8004-9f329372d559 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:44.579552 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c212a5c3-a430-4573-8004-9f329372d559 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1539 microversion: 2.1 time: 0.510225 May 21 21:15:44.580356 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 709/1420] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:44 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1539 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:44.592952 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6c1e7c45-5a13-4c54-a00b-62c9a9c6c7c8 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:44.593896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6c1e7c45-5a13-4c54-a00b-62c9a9c6c7c8 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:44.602163 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c1e7c45-5a13-4c54-a00b-62c9a9c6c7c8 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:44.604876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c1e7c45-5a13-4c54-a00b-62c9a9c6c7c8 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:44.607977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c1e7c45-5a13-4c54-a00b-62c9a9c6c7c8 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:44.608477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c1e7c45-5a13-4c54-a00b-62c9a9c6c7c8 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:44.612818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:44.640081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6c1e7c45-5a13-4c54-a00b-62c9a9c6c7c8 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'debdf601e2af4bfa8399af03d4c7960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1dd623262494c9187474cbd860b52c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:44.645363 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6c1e7c45-5a13-4c54-a00b-62c9a9c6c7c8 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] flavor_id is None. Assuming migration. {{(pid=131278) resize /opt/stack/nova/nova/compute/api.py:4142}} May 21 21:15:44.645363 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6c1e7c45-5a13-4c54-a00b-62c9a9c6c7c8 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131278) resize /opt/stack/nova/nova/compute/api.py:4166}} May 21 21:15:44.901505 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-738ca408-d8b6-4191-ac07-cbf0c8e16f0a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "POST /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f/action" status: 202 len: 0 microversion: 2.1 time: 1.403038 May 21 21:15:44.907153 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 712/1421] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:15:43 2022] POST /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f/action => generated 0 bytes in 1405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:15:44.907593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-27dfd905-e886-424c-b08a-720525e0d34b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:44.908571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-27dfd905-e886-424c-b08a-720525e0d34b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:44.934404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27dfd905-e886-424c-b08a-720525e0d34b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:44.939766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27dfd905-e886-424c-b08a-720525e0d34b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:44.939766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27dfd905-e886-424c-b08a-720525e0d34b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:44.939766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27dfd905-e886-424c-b08a-720525e0d34b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:45.502113 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6c1e7c45-5a13-4c54-a00b-62c9a9c6c7c8 tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78/action" status: 202 len: 0 microversion: 2.1 time: 0.919122 May 21 21:15:45.502751 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 710/1422] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:15:44 2022] POST /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78/action => generated 0 bytes in 922 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:15:45.530923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-27dfd905-e886-424c-b08a-720525e0d34b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:45.546807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-812c1b2b-3f86-479d-b08c-030866eadece tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc82d133af0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:45.554031 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-27dfd905-e886-424c-b08a-720525e0d34b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1203 microversion: 2.1 time: 0.649036 May 21 21:15:45.554812 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 713/1423] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:44 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1203 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:45.579430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2aacd6f5-a119-483b-8680-5a1ffacd641f tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Calling method '.version_select at 0x7fc81b576c10>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:45.613594 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-812c1b2b-3f86-479d-b08c-030866eadece tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781" status: 200 len: 1452 microversion: 2.1 time: 0.104665 May 21 21:15:45.614358 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 711/1424] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:45 2022] GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781 => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:45.621083 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4bf5f093-64ba-4cb4-bcff-64a810d828c6 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:45.621285 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4bf5f093-64ba-4cb4-bcff-64a810d828c6 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:45.629091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bf5f093-64ba-4cb4-bcff-64a810d828c6 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:45.629557 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bf5f093-64ba-4cb4-bcff-64a810d828c6 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:45.630346 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bf5f093-64ba-4cb4-bcff-64a810d828c6 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:45.630791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bf5f093-64ba-4cb4-bcff-64a810d828c6 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:45.808667 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2aacd6f5-a119-483b-8680-5a1ffacd641f tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/2731f5561139495e948f8448f05b3c6d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.251160 May 21 21:15:45.815347 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 714/1425] 10.222.0.49 () {58 vars in 1268 bytes} [Sat May 21 21:15:45 2022] GET /compute/v2.1/os-quota-sets/2731f5561139495e948f8448f05b3c6d/defaults => generated 371 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:45.820619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8954b2fa-744d-43b4-b434-5508107dd57d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:45.821402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8954b2fa-744d-43b4-b434-5508107dd57d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:45.829752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8954b2fa-744d-43b4-b434-5508107dd57d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:45.831125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8954b2fa-744d-43b4-b434-5508107dd57d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:45.832166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8954b2fa-744d-43b4-b434-5508107dd57d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:45.833315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8954b2fa-744d-43b4-b434-5508107dd57d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:45.861690 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4bf5f093-64ba-4cb4-bcff-64a810d828c6 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.246214 May 21 21:15:45.871581 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 712/1426] 10.222.0.49 () {58 vars in 1292 bytes} [Sat May 21 21:15:45 2022] GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f/os-security-groups => generated 1156 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:45.878269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-8411398a-373e-4ce9-9735-4c507f46adf5 req-00614be0-c222-4289-b4eb-276639e2743a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2efd4657-7152-42ae-92d6-9249939767ed", "name": "network-vif-deleted", "tag": "500741bf-90f2-4eed-9a27-ca517aaff42a"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:45.888555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-8411398a-373e-4ce9-9735-4c507f46adf5 req-00614be0-c222-4289-b4eb-276639e2743a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:45.889218 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-8411398a-373e-4ce9-9735-4c507f46adf5 req-00614be0-c222-4289-b4eb-276639e2743a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:45.903237 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-8411398a-373e-4ce9-9735-4c507f46adf5 req-00614be0-c222-4289-b4eb-276639e2743a service nova] Creating event network-vif-deleted:500741bf-90f2-4eed-9a27-ca517aaff42a for instance 2efd4657-7152-42ae-92d6-9249939767ed on nch1-master-1 May 21 21:15:45.909701 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-8411398a-373e-4ce9-9735-4c507f46adf5 req-00614be0-c222-4289-b4eb-276639e2743a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036583 May 21 21:15:45.912715 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 713/1427] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:45.919949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-4a9ba648-1a29-4668-9eaa-e1b05ed8a5c6 req-32c723d8-0823-4a27-b97d-19e188051764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd05f19-07e5-4ed2-846c-250e839345f6", "name": "network-vif-plugged", "status": "completed", "tag": "525aa738-49ca-4abe-aa07-8919b01951c3"}, {"server_uuid": "f0525194-b3aa-482c-a355-c77c63bf4c88", "name": "network-vif-unplugged", "status": "completed", "tag": "5eb403c4-fa1f-43de-83df-5b9059a1b1b1"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:45.932559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4a9ba648-1a29-4668-9eaa-e1b05ed8a5c6 req-32c723d8-0823-4a27-b97d-19e188051764 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:45.933283 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4a9ba648-1a29-4668-9eaa-e1b05ed8a5c6 req-32c723d8-0823-4a27-b97d-19e188051764 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:45.952407 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-4a9ba648-1a29-4668-9eaa-e1b05ed8a5c6 req-32c723d8-0823-4a27-b97d-19e188051764 service nova] Creating event network-vif-plugged:525aa738-49ca-4abe-aa07-8919b01951c3 for instance 6dd05f19-07e5-4ed2-846c-250e839345f6 on nch2-master-1 May 21 21:15:45.952976 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-4a9ba648-1a29-4668-9eaa-e1b05ed8a5c6 req-32c723d8-0823-4a27-b97d-19e188051764 service nova] Creating event network-vif-unplugged:5eb403c4-fa1f-43de-83df-5b9059a1b1b1 for instance f0525194-b3aa-482c-a355-c77c63bf4c88 on nch2-master-1 May 21 21:15:45.961183 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-4a9ba648-1a29-4668-9eaa-e1b05ed8a5c6 req-32c723d8-0823-4a27-b97d-19e188051764 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.046350 May 21 21:15:45.962142 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 714/1428] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:46.059247 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-53fb0eaa-ba22-4f3e-ac39-8f4825bf2536 req-e6d38925-fbd6-4c08-893d-fdb96aa0ee7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6300bf23-6e6c-4959-b913-81a4b850397f", "tag": "460cd6f3-8f7e-413a-9811-cf5158ce5e95"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:46.087193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-53fb0eaa-ba22-4f3e-ac39-8f4825bf2536 req-e6d38925-fbd6-4c08-893d-fdb96aa0ee7d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:46.089301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-53fb0eaa-ba22-4f3e-ac39-8f4825bf2536 req-e6d38925-fbd6-4c08-893d-fdb96aa0ee7d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:46.111261 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-53fb0eaa-ba22-4f3e-ac39-8f4825bf2536 req-e6d38925-fbd6-4c08-893d-fdb96aa0ee7d service nova] Creating event network-changed:460cd6f3-8f7e-413a-9811-cf5158ce5e95 for instance 6300bf23-6e6c-4959-b913-81a4b850397f on nch1-master-1 May 21 21:15:46.119417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8954b2fa-744d-43b4-b434-5508107dd57d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:46.121461 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-53fb0eaa-ba22-4f3e-ac39-8f4825bf2536 req-e6d38925-fbd6-4c08-893d-fdb96aa0ee7d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157604 May 21 21:15:46.122588 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 715/1429] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:46.130541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3d4a4aa2-1986-4cdd-91ad-72e0c8e097aa tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:46.131900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3d4a4aa2-1986-4cdd-91ad-72e0c8e097aa tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:46.142551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d4a4aa2-1986-4cdd-91ad-72e0c8e097aa tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:46.144546 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d4a4aa2-1986-4cdd-91ad-72e0c8e097aa tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:46.145661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d4a4aa2-1986-4cdd-91ad-72e0c8e097aa tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:46.146387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d4a4aa2-1986-4cdd-91ad-72e0c8e097aa tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:46.147279 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8954b2fa-744d-43b4-b434-5508107dd57d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1471 microversion: 2.1 time: 0.330497 May 21 21:15:46.148180 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 715/1430] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:45 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1471 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:46.152936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c6017f4d-4f11-43d8-8246-1142d63a0d43 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Action: 'update', calling method: .version_select at 0x7fc81b533dc0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:46.294480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6017f4d-4f11-43d8-8246-1142d63a0d43 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:46.295193 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6017f4d-4f11-43d8-8246-1142d63a0d43 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:46.298135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6017f4d-4f11-43d8-8246-1142d63a0d43 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:46.298598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6017f4d-4f11-43d8-8246-1142d63a0d43 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:46.708068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3d4a4aa2-1986-4cdd-91ad-72e0c8e097aa tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:46.717022 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3d4a4aa2-1986-4cdd-91ad-72e0c8e097aa tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1521 microversion: 2.1 time: 0.591940 May 21 21:15:46.717701 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 716/1431] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:46 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1521 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:46.723061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-80a9dd6b-2686-4d85-9ec4-a83f17100dba tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Action: 'create', calling method: .version_select at 0x7fc82d19b3a0>, body: {"security_group": {"name": " tempest-securitygroup -1320613751 ", "description": "tempest-description-1506434783"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:47.887334 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-80a9dd6b-2686-4d85-9ec4-a83f17100dba tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 1.168072 May 21 21:15:47.887958 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 717/1432] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:15:46 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:47.892649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4638c5e6-c81f-4f85-b85b-07256aa28a8f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:47.893259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4638c5e6-c81f-4f85-b85b-07256aa28a8f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:47.900787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4638c5e6-c81f-4f85-b85b-07256aa28a8f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:47.901341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4638c5e6-c81f-4f85-b85b-07256aa28a8f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:47.902951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4638c5e6-c81f-4f85-b85b-07256aa28a8f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:47.903582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4638c5e6-c81f-4f85-b85b-07256aa28a8f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:48.000743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4638c5e6-c81f-4f85-b85b-07256aa28a8f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:48.011744 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4638c5e6-c81f-4f85-b85b-07256aa28a8f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1265 microversion: 2.1 time: 0.122685 May 21 21:15:48.012903 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 718/1433] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:47 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1265 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:48.017931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b2dddc4c-164a-46e1-abef-5fd21427740b tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc82d0ff940>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:48.070968 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b2dddc4c-164a-46e1-abef-5fd21427740b tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781" status: 200 len: 1452 microversion: 2.1 time: 0.056932 May 21 21:15:48.071546 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 719/1434] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:48 2022] GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781 => generated 1452 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:48.082114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-abe55067-18c7-4436-a875-0ee4532a5a26 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:48.082878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-abe55067-18c7-4436-a875-0ee4532a5a26 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:48.090064 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-abe55067-18c7-4436-a875-0ee4532a5a26 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:48.090560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-abe55067-18c7-4436-a875-0ee4532a5a26 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:48.096217 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-abe55067-18c7-4436-a875-0ee4532a5a26 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:48.096217 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-abe55067-18c7-4436-a875-0ee4532a5a26 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:48.177915 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c6017f4d-4f11-43d8-8246-1142d63a0d43 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/2731f5561139495e948f8448f05b3c6d" status: 200 len: 329 microversion: 2.1 time: 2.028505 May 21 21:15:48.178952 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 716/1435] 10.222.0.49 () {60 vars in 1262 bytes} [Sat May 21 21:15:46 2022] PUT /compute/v2.1/os-quota-sets/2731f5561139495e948f8448f05b3c6d => generated 329 bytes in 2030 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:48.187300 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f337ab00-39c6-4601-ac43-8412afdb753d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:48.187995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f337ab00-39c6-4601-ac43-8412afdb753d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:48.195100 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f337ab00-39c6-4601-ac43-8412afdb753d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:48.195563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f337ab00-39c6-4601-ac43-8412afdb753d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:48.196416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f337ab00-39c6-4601-ac43-8412afdb753d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:48.196956 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f337ab00-39c6-4601-ac43-8412afdb753d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:48.324413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-abe55067-18c7-4436-a875-0ee4532a5a26 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:15:48.386327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f337ab00-39c6-4601-ac43-8412afdb753d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:48.395987 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f337ab00-39c6-4601-ac43-8412afdb753d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1471 microversion: 2.1 time: 0.215685 May 21 21:15:48.409542 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 717/1436] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:48 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1471 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:48.421277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-71a0bc2c-73cc-4d48-8d8c-2f4ef8a45824 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81b4e84c0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:48.513274 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-71a0bc2c-73cc-4d48-8d8c-2f4ef8a45824 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/a8369913-24aa-4a6e-bff3-7ae89aae7092" status: 200 len: 224 microversion: 2.1 time: 0.100552 May 21 21:15:48.513854 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 718/1437] 10.222.0.49 () {58 vars in 1268 bytes} [Sat May 21 21:15:48 2022] GET /compute/v2.1/os-security-groups/a8369913-24aa-4a6e-bff3-7ae89aae7092 => generated 224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:48.519974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-6a9fd74e-38d0-488f-92b4-c84318d9d03b req-93b0c0e8-4b60-49c8-a0c5-cb1ad04ddc51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55818247-81af-4cf1-bff3-92aeb3f06bba", "name": "network-vif-plugged", "status": "completed", "tag": "d78ce8f3-1b0e-4e09-b2ee-8d7b3fe8530e"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:48.529877 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6a9fd74e-38d0-488f-92b4-c84318d9d03b req-93b0c0e8-4b60-49c8-a0c5-cb1ad04ddc51 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:48.530591 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6a9fd74e-38d0-488f-92b4-c84318d9d03b req-93b0c0e8-4b60-49c8-a0c5-cb1ad04ddc51 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:48.544851 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-6a9fd74e-38d0-488f-92b4-c84318d9d03b req-93b0c0e8-4b60-49c8-a0c5-cb1ad04ddc51 service nova] Creating event network-vif-plugged:d78ce8f3-1b0e-4e09-b2ee-8d7b3fe8530e for instance 55818247-81af-4cf1-bff3-92aeb3f06bba on nch2-master-1 May 21 21:15:48.549975 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-6a9fd74e-38d0-488f-92b4-c84318d9d03b req-93b0c0e8-4b60-49c8-a0c5-cb1ad04ddc51 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034170 May 21 21:15:48.550699 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 719/1438] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:48.557395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6bd7df2e-9fe7-483b-95a4-af88151f6c73 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Action: 'update', calling method: .version_select at 0x7fc81b44d9d0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:48.644612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6bd7df2e-9fe7-483b-95a4-af88151f6c73 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:48.645074 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6bd7df2e-9fe7-483b-95a4-af88151f6c73 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:48.646911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6bd7df2e-9fe7-483b-95a4-af88151f6c73 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:48.647367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6bd7df2e-9fe7-483b-95a4-af88151f6c73 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:48.668118 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-abe55067-18c7-4436-a875-0ee4532a5a26 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 204 len: 0 microversion: 2.1 time: 0.589450 May 21 21:15:48.668992 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 720/1439] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:15:48 2022] DELETE /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:15:48.675726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e670f0e9-c5c6-4708-b09f-643d0ab20b28 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc82d196b80>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:48.680604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=15 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:49.258128 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e670f0e9-c5c6-4708-b09f-643d0ab20b28 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/a8369913-24aa-4a6e-bff3-7ae89aae7092" status: 202 len: 0 microversion: 2.1 time: 0.587698 May 21 21:15:49.258781 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 721/1440] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:15:48 2022] DELETE /compute/v2.1/os-security-groups/a8369913-24aa-4a6e-bff3-7ae89aae7092 => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:15:49.264630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-36068fea-fbb5-4bd7-b68f-d7772912fe00 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:49.265702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-36068fea-fbb5-4bd7-b68f-d7772912fe00 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:49.272972 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36068fea-fbb5-4bd7-b68f-d7772912fe00 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:49.275161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36068fea-fbb5-4bd7-b68f-d7772912fe00 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:49.275161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36068fea-fbb5-4bd7-b68f-d7772912fe00 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:49.275161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36068fea-fbb5-4bd7-b68f-d7772912fe00 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:49.537699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-36068fea-fbb5-4bd7-b68f-d7772912fe00 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:49.546647 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-36068fea-fbb5-4bd7-b68f-d7772912fe00 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1527 microversion: 2.1 time: 0.285747 May 21 21:15:49.547227 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 722/1441] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:49 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1527 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:49.564403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-30276373-dac7-447c-a92b-d18c55bb3470 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:49.565604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-30276373-dac7-447c-a92b-d18c55bb3470 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:49.573432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30276373-dac7-447c-a92b-d18c55bb3470 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:49.573895 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30276373-dac7-447c-a92b-d18c55bb3470 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:49.574682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30276373-dac7-447c-a92b-d18c55bb3470 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:49.575125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30276373-dac7-447c-a92b-d18c55bb3470 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:49.765050 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-30276373-dac7-447c-a92b-d18c55bb3470 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:49.772805 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-30276373-dac7-447c-a92b-d18c55bb3470 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1307 microversion: 2.1 time: 0.212871 May 21 21:15:49.773370 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 723/1442] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:49 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1307 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:49.777990 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-01fb9767-e694-4358-9c09-895f267933c5 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc82d1253a0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:49.822927 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-01fb9767-e694-4358-9c09-895f267933c5 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781" status: 200 len: 1452 microversion: 2.1 time: 0.048523 May 21 21:15:49.823486 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 724/1443] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:49 2022] GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781 => generated 1452 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:49.827862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-952c9cf4-3740-432c-9643-731e955498e2 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc82d1960d0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:49.889037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG neutronclient.v2_0.client [None req-952c9cf4-3740-432c-9643-731e955498e2 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a8369913-24aa-4a6e-bff3-7ae89aae7092 does not exist", "detail": ""}} {{(pid=131278) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:15:49.889682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.security_group_api [None req-952c9cf4-3740-432c-9643-731e955498e2 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Neutron security group a8369913-24aa-4a6e-bff3-7ae89aae7092 not found {{(pid=131278) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 21 21:15:49.890248 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-952c9cf4-3740-432c-9643-731e955498e2 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] HTTP exception thrown: Security group a8369913-24aa-4a6e-bff3-7ae89aae7092 does not exist May 21 21:15:49.890248 ncdv-master-1 devstack@n-api.service[131278]: Neutron server returns request_ids: ['req-e4b2b362-6210-4042-966f-4a5355d7499b'] May 21 21:15:49.901170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-952c9cf4-3740-432c-9643-731e955498e2 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Request method failure captured: May 21 21:15:49.901170 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-security-groups/a8369913-24aa-4a6e-bff3-7ae89aae7092 HTTP/1.1 May 21 21:15:49.901170 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:15:49.901170 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:15:49.901170 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:15:49.901170 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:15:49.901170 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:15:49.901170 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:15:49.901170 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:15:49.901170 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:15:49.901170 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZSCYysyyOTwVzhR_Vt3Rp4hJGlHQ1xQ5d6hFUxjxvsTAgt6ix0UNE2Z2Vln9ahBs6pfbfiUV8DEik3Vk1FDugBkn4AbmOx4uTGzwiP9EUa_o0XQmPT-P2Agu2oeG_4YhdEiPrs-TaOwa6w5WGXcLQM63lci1mbOXuKdXB18YVm1Hg May 21 21:15:49.901170 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:15:49.901170 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:15:49.901170 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:15:49.901170 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:15:49.901170 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:15:49.901170 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:15:49.901170 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:15:49.901170 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:15:49.901170 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:15:49.901170 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:15:49.902740 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/53774c838bd64b319776f9afa0821b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_53774c838bd64b319776f9afa0821b79", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:15:49.902740 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-SecurityGroupsTestJSON-741901629 May 21 21:15:49.902740 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:15:49.902740 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:15:49.902740 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:15:49.902740 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:15:49.902740 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:15:49.902740 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 5e82c479130c4377a9a27dd7c8bbe611 May 21 21:15:49.902740 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:15:49.902740 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:15:49.902740 ncdv-master-1 devstack@n-api.service[131278]: exception: Security group a8369913-24aa-4a6e-bff3-7ae89aae7092 does not exist May 21 21:15:49.902740 ncdv-master-1 devstack@n-api.service[131278]: Neutron server returns request_ids: ['req-e4b2b362-6210-4042-966f-4a5355d7499b'] May 21 21:15:49.902740 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'a8369913-24aa-4a6e-bff3-7ae89aae7092'} May 21 21:15:49.908022 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:15:49.908022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:49.908022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 21 21:15:49.908022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 21 21:15:49.908022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:15:49.908022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:15:49.908022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 21 21:15:49.908022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 21 21:15:49.908022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:15:49.908022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:15:49.908022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 21 21:15:49.908022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 21 21:15:49.908022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:15:49.908022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:15:49.908022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:15:49.908022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:15:49.908022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:15:49.908022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:15:49.908022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:15:49.909804 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:15:49.909804 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:15:49.909804 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:15:49.909804 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:15:49.909804 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:15:49.909804 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:15:49.909804 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:15:49.909804 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a8369913-24aa-4a6e-bff3-7ae89aae7092 does not exist May 21 21:15:49.909804 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4b2b362-6210-4042-966f-4a5355d7499b'] May 21 21:15:49.909804 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:15:49.909804 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:15:49.909804 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:15:49.909804 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:49.909804 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 21 21:15:49.909804 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 21 21:15:49.909804 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 21 21:15:49.909804 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 21 21:15:49.909804 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a8369913-24aa-4a6e-bff3-7ae89aae7092 does not exist May 21 21:15:49.911170 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4b2b362-6210-4042-966f-4a5355d7499b'] May 21 21:15:49.911170 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:15:49.911170 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:15:49.911170 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:15:49.911170 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:49.911170 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:15:49.911170 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:15:49.911170 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:15:49.911170 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:15:49.911170 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:15:49.911170 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:15:49.911170 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:15:49.911170 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:15:49.911170 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 21 21:15:49.911170 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 21 21:15:49.911170 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a8369913-24aa-4a6e-bff3-7ae89aae7092 does not exist May 21 21:15:49.911170 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4b2b362-6210-4042-966f-4a5355d7499b'] May 21 21:15:49.911170 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:15:49.911170 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:15:49.911170 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:15:49.911170 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:49.912916 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:15:49.912916 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:15:49.912916 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:15:49.912916 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:15:49.912916 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a8369913-24aa-4a6e-bff3-7ae89aae7092 does not exist May 21 21:15:49.912916 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4b2b362-6210-4042-966f-4a5355d7499b'] May 21 21:15:49.912916 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:15:49.912916 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-952c9cf4-3740-432c-9643-731e955498e2 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Returning 404 to user: Security group a8369913-24aa-4a6e-bff3-7ae89aae7092 does not exist May 21 21:15:49.912916 ncdv-master-1 devstack@n-api.service[131278]: Neutron server returns request_ids: ['req-e4b2b362-6210-4042-966f-4a5355d7499b'] {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:15:49.912916 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-952c9cf4-3740-432c-9643-731e955498e2 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/a8369913-24aa-4a6e-bff3-7ae89aae7092" status: 404 len: 194 microversion: 2.1 time: 0.078424 May 21 21:15:49.912916 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 725/1444] 10.222.0.49 () {58 vars in 1268 bytes} [Sat May 21 21:15:49 2022] GET /compute/v2.1/os-security-groups/a8369913-24aa-4a6e-bff3-7ae89aae7092 => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:15:49.913768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1dafd531-6cbf-425f-9c4a-c29c11e4d1aa tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:49.913768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1dafd531-6cbf-425f-9c4a-c29c11e4d1aa tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:49.921943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1dafd531-6cbf-425f-9c4a-c29c11e4d1aa tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:49.927793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1dafd531-6cbf-425f-9c4a-c29c11e4d1aa tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:49.927793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1dafd531-6cbf-425f-9c4a-c29c11e4d1aa tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:49.927793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1dafd531-6cbf-425f-9c4a-c29c11e4d1aa tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:50.073471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1dafd531-6cbf-425f-9c4a-c29c11e4d1aa tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:50.084486 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1dafd531-6cbf-425f-9c4a-c29c11e4d1aa tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1471 microversion: 2.1 time: 0.179993 May 21 21:15:50.094898 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 726/1445] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:49 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1471 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:50.100165 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-3bece4c0-3a68-497f-8187-983afea069b5 req-268252d2-9953-4a88-83a7-75765382eb2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b", "tag": "d45fcb13-cb81-4e01-869d-5e2e4b8084cc"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:50.110568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3bece4c0-3a68-497f-8187-983afea069b5 req-268252d2-9953-4a88-83a7-75765382eb2e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:50.113617 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3bece4c0-3a68-497f-8187-983afea069b5 req-268252d2-9953-4a88-83a7-75765382eb2e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:50.123100 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-3bece4c0-3a68-497f-8187-983afea069b5 req-268252d2-9953-4a88-83a7-75765382eb2e service nova] Creating event network-changed:d45fcb13-cb81-4e01-869d-5e2e4b8084cc for instance 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b on nch2-master-1 May 21 21:15:50.129225 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-3bece4c0-3a68-497f-8187-983afea069b5 req-268252d2-9953-4a88-83a7-75765382eb2e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032418 May 21 21:15:50.129927 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 727/1446] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:50.138365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-774a9a77-1835-4c11-af17-2fc0d8d26f6c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Action: 'create', calling method: .version_select at 0x7fc81b3b24c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1920920318", "description": "tempest-description-1889938287"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:51.129010 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-774a9a77-1835-4c11-af17-2fc0d8d26f6c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.997591 May 21 21:15:51.130825 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 728/1447] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:15:50 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:51.138997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ee4eae06-36bf-49e0-907c-a924c838c4fc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:51.142114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ee4eae06-36bf-49e0-907c-a924c838c4fc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:51.150983 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6bd7df2e-9fe7-483b-95a4-af88151f6c73 tempest-QuotasAdminTestJSON-844448808 tempest-QuotasAdminTestJSON-844448808-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/2731f5561139495e948f8448f05b3c6d" status: 200 len: 329 microversion: 2.1 time: 2.598212 May 21 21:15:51.152891 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 720/1448] 10.222.0.49 () {60 vars in 1262 bytes} [Sat May 21 21:15:48 2022] PUT /compute/v2.1/os-quota-sets/2731f5561139495e948f8448f05b3c6d => generated 329 bytes in 2601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:51.153502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee4eae06-36bf-49e0-907c-a924c838c4fc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:51.154687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee4eae06-36bf-49e0-907c-a924c838c4fc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:51.158704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee4eae06-36bf-49e0-907c-a924c838c4fc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:51.160510 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-2574d903-340f-4fe4-abf1-2d2c7403f112 req-638d0ed5-8e2f-422d-aa32-c9d04fa5a7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd05f19-07e5-4ed2-846c-250e839345f6", "name": "network-vif-unplugged", "status": "completed", "tag": "525aa738-49ca-4abe-aa07-8919b01951c3"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:51.175300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee4eae06-36bf-49e0-907c-a924c838c4fc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:51.176430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2574d903-340f-4fe4-abf1-2d2c7403f112 req-638d0ed5-8e2f-422d-aa32-c9d04fa5a7f9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:51.177077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2574d903-340f-4fe4-abf1-2d2c7403f112 req-638d0ed5-8e2f-422d-aa32-c9d04fa5a7f9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:51.202060 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-2574d903-340f-4fe4-abf1-2d2c7403f112 req-638d0ed5-8e2f-422d-aa32-c9d04fa5a7f9 service nova] Creating event network-vif-unplugged:525aa738-49ca-4abe-aa07-8919b01951c3 for instance 6dd05f19-07e5-4ed2-846c-250e839345f6 on nch2-master-1 May 21 21:15:51.210023 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-2574d903-340f-4fe4-abf1-2d2c7403f112 req-638d0ed5-8e2f-422d-aa32-c9d04fa5a7f9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055333 May 21 21:15:51.210866 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 721/1449] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:51.217352 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-39f99021-ec96-405a-94df-34994864fec3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:51.219718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-39f99021-ec96-405a-94df-34994864fec3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:51.267967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39f99021-ec96-405a-94df-34994864fec3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:51.268958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39f99021-ec96-405a-94df-34994864fec3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:51.269926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39f99021-ec96-405a-94df-34994864fec3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:51.270710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39f99021-ec96-405a-94df-34994864fec3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:51.490198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-39f99021-ec96-405a-94df-34994864fec3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:51.500535 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-39f99021-ec96-405a-94df-34994864fec3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1307 microversion: 2.1 time: 0.287890 May 21 21:15:51.501683 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 722/1450] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:51 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1307 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:51.507096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-918b5ecf-0fa9-43c9-b47f-0e67a6de30ee tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b2df040>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:51.584088 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-918b5ecf-0fa9-43c9-b47f-0e67a6de30ee tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781" status: 200 len: 1452 microversion: 2.1 time: 0.079100 May 21 21:15:51.594142 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 723/1451] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:51 2022] GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781 => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:51.603862 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-63bb995d-ec93-41ff-bff4-1ad5de368a43 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:51.607065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-63bb995d-ec93-41ff-bff4-1ad5de368a43 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:51.615229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-63bb995d-ec93-41ff-bff4-1ad5de368a43 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:51.616109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-63bb995d-ec93-41ff-bff4-1ad5de368a43 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:51.617925 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-63bb995d-ec93-41ff-bff4-1ad5de368a43 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:51.619307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-63bb995d-ec93-41ff-bff4-1ad5de368a43 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:51.787630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ee4eae06-36bf-49e0-907c-a924c838c4fc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:51.799358 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ee4eae06-36bf-49e0-907c-a924c838c4fc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1527 microversion: 2.1 time: 0.666961 May 21 21:15:51.800602 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 729/1452] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:51 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1527 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:51.826918 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1a7869fe-0f78-4c00-b5fe-002dc174c9ab tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Action: 'create', calling method: .version_select at 0x7fc82d175700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-603534420", "description": "tempest-description-2095865940"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:51.981948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-63bb995d-ec93-41ff-bff4-1ad5de368a43 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:51.992206 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-63bb995d-ec93-41ff-bff4-1ad5de368a43 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1471 microversion: 2.1 time: 0.396646 May 21 21:15:52.004448 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 724/1453] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:51 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1471 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:52.218813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-c48cee74-7110-4529-bb5a-8abbf07b3ec9 req-c3c73c5b-5403-47bc-9c96-181f57e4e761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd05f19-07e5-4ed2-846c-250e839345f6", "name": "network-vif-deleted", "tag": "525aa738-49ca-4abe-aa07-8919b01951c3"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:52.242067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c48cee74-7110-4529-bb5a-8abbf07b3ec9 req-c3c73c5b-5403-47bc-9c96-181f57e4e761 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:52.245257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c48cee74-7110-4529-bb5a-8abbf07b3ec9 req-c3c73c5b-5403-47bc-9c96-181f57e4e761 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:52.256557 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:52.286349 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-c48cee74-7110-4529-bb5a-8abbf07b3ec9 req-c3c73c5b-5403-47bc-9c96-181f57e4e761 service nova] Creating event network-vif-deleted:525aa738-49ca-4abe-aa07-8919b01951c3 for instance 6dd05f19-07e5-4ed2-846c-250e839345f6 on nch2-master-1 May 21 21:15:52.294986 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-c48cee74-7110-4529-bb5a-8abbf07b3ec9 req-c3c73c5b-5403-47bc-9c96-181f57e4e761 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082077 May 21 21:15:52.299129 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 725/1454] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:15:52.519306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d1530961-6e64-4830-9fa6-46759b7f84c7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:52.520011 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d1530961-6e64-4830-9fa6-46759b7f84c7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:52.527854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d1530961-6e64-4830-9fa6-46759b7f84c7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:52.528738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d1530961-6e64-4830-9fa6-46759b7f84c7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:52.529688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d1530961-6e64-4830-9fa6-46759b7f84c7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:52.530286 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d1530961-6e64-4830-9fa6-46759b7f84c7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:52.694923 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1a7869fe-0f78-4c00-b5fe-002dc174c9ab tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.891701 May 21 21:15:52.696035 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 730/1455] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:15:51 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:52.710397 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3d88ee92-3943-4456-98ad-aaf29c109f8e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc82d196430>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:52.789191 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3d88ee92-3943-4456-98ad-aaf29c109f8e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781" status: 200 len: 1452 microversion: 2.1 time: 0.083959 May 21 21:15:52.798285 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 731/1456] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:52 2022] GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781 => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:52.806437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-185ab92f-2c2c-4c2c-9d24-74f319ece936 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Action: 'create', calling method: .version_select at 0x7fc82d175b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1577361034", "description": "tempest-description-1446249173"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:52.869186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d1530961-6e64-4830-9fa6-46759b7f84c7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:52.878926 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d1530961-6e64-4830-9fa6-46759b7f84c7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1307 microversion: 2.1 time: 0.364101 May 21 21:15:52.885682 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 726/1457] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:52 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1307 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:15:52.893745 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1ab5e463-87cf-429d-82a9-0c582ebfa687 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:52.897530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1ab5e463-87cf-429d-82a9-0c582ebfa687 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:52.905928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ab5e463-87cf-429d-82a9-0c582ebfa687 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:52.906505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ab5e463-87cf-429d-82a9-0c582ebfa687 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:52.907455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ab5e463-87cf-429d-82a9-0c582ebfa687 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:52.908775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ab5e463-87cf-429d-82a9-0c582ebfa687 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:53.023598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1ab5e463-87cf-429d-82a9-0c582ebfa687 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:53.035376 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1ab5e463-87cf-429d-82a9-0c582ebfa687 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1485 microversion: 2.1 time: 0.148249 May 21 21:15:53.047769 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 727/1458] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:52 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1485 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:53.053364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3673ff8f-6588-470e-814b-db9870968d44 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:53.054340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3673ff8f-6588-470e-814b-db9870968d44 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:53.065976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3673ff8f-6588-470e-814b-db9870968d44 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:53.066792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3673ff8f-6588-470e-814b-db9870968d44 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:53.068481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3673ff8f-6588-470e-814b-db9870968d44 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:53.069158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3673ff8f-6588-470e-814b-db9870968d44 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:53.147660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=9 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:53.395131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3673ff8f-6588-470e-814b-db9870968d44 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:53.407669 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3673ff8f-6588-470e-814b-db9870968d44 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1471 microversion: 2.1 time: 0.358016 May 21 21:15:53.409796 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 728/1459] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:53 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1471 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:53.656693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=34 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:53.726274 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-185ab92f-2c2c-4c2c-9d24-74f319ece936 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.923819 May 21 21:15:53.726274 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 732/1460] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:15:52 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:53.742300 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4abfbde7-a386-4636-bd2f-3568025b647d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81b2df940>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:53.803867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a0bf4836-b436-4059-a8ef-6bb9a5f7e52e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b3b9a60>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:53.872879 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a0bf4836-b436-4059-a8ef-6bb9a5f7e52e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781" status: 200 len: 1452 microversion: 2.1 time: 0.073719 May 21 21:15:53.873775 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 733/1461] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:53 2022] GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781 => generated 1452 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:15:53.902860 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-27be05e1-aee2-4088-9f6f-69c4f1c4f77f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:53.903782 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-27be05e1-aee2-4088-9f6f-69c4f1c4f77f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:53.924880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-27be05e1-aee2-4088-9f6f-69c4f1c4f77f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:53.932032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-27be05e1-aee2-4088-9f6f-69c4f1c4f77f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:53.932032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-27be05e1-aee2-4088-9f6f-69c4f1c4f77f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:53.932639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-27be05e1-aee2-4088-9f6f-69c4f1c4f77f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:54.227325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-27be05e1-aee2-4088-9f6f-69c4f1c4f77f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:54.234537 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4abfbde7-a386-4636-bd2f-3568025b647d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.502696 May 21 21:15:54.235344 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 729/1462] 10.222.0.49 () {58 vars in 1157 bytes} [Sat May 21 21:15:53 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:54.238592 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-27be05e1-aee2-4088-9f6f-69c4f1c4f77f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1307 microversion: 2.1 time: 0.340505 May 21 21:15:54.242565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dab7cd7a-9249-4438-b7af-cb2362535b70 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:54.244111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dab7cd7a-9249-4438-b7af-cb2362535b70 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:54.250140 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 734/1463] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:53 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1307 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:54.261580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-277e0cb5-c828-4e2f-8b6f-a6558bc05a3d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc82d196550>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:54.262611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dab7cd7a-9249-4438-b7af-cb2362535b70 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:54.265139 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dab7cd7a-9249-4438-b7af-cb2362535b70 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:54.266176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dab7cd7a-9249-4438-b7af-cb2362535b70 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:54.266868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dab7cd7a-9249-4438-b7af-cb2362535b70 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:54.317685 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dab7cd7a-9249-4438-b7af-cb2362535b70 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:54.318564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dab7cd7a-9249-4438-b7af-cb2362535b70 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:54.319249 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-dab7cd7a-9249-4438-b7af-cb2362535b70 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lazy-loading 'fault' on Instance uuid 6dd05f19-07e5-4ed2-846c-250e839345f6 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:15:54.403621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-dab7cd7a-9249-4438-b7af-cb2362535b70 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:54.425057 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dab7cd7a-9249-4438-b7af-cb2362535b70 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 200 len: 1314 microversion: 2.1 time: 0.176450 May 21 21:15:54.435681 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 730/1464] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:54 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:54.444557 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e5c08c02-8449-4585-9cdd-6222bd8d683a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:54.445502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e5c08c02-8449-4585-9cdd-6222bd8d683a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:54.472847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5c08c02-8449-4585-9cdd-6222bd8d683a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:54.483022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5c08c02-8449-4585-9cdd-6222bd8d683a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:54.485962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5c08c02-8449-4585-9cdd-6222bd8d683a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:54.487646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5c08c02-8449-4585-9cdd-6222bd8d683a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:54.762844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e5c08c02-8449-4585-9cdd-6222bd8d683a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:54.779920 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e5c08c02-8449-4585-9cdd-6222bd8d683a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1476 microversion: 2.1 time: 0.339466 May 21 21:15:54.779920 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 731/1465] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:54 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1476 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:54.787102 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-277e0cb5-c828-4e2f-8b6f-a6558bc05a3d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/9d088f61-f82f-4e08-a359-9a9e5b4e6bba" status: 202 len: 0 microversion: 2.1 time: 0.534448 May 21 21:15:54.788095 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 735/1466] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:15:54 2022] DELETE /compute/v2.1/os-security-groups/9d088f61-f82f-4e08-a359-9a9e5b4e6bba => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:15:54.812634 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cf147c5f-1884-4c66-b9c2-3d55d897ac63 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81b4e3dc0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:54.863960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG neutronclient.v2_0.client [None req-cf147c5f-1884-4c66-b9c2-3d55d897ac63 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d088f61-f82f-4e08-a359-9a9e5b4e6bba does not exist", "detail": ""}} {{(pid=131277) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:15:54.864764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.security_group_api [None req-cf147c5f-1884-4c66-b9c2-3d55d897ac63 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Neutron security group 9d088f61-f82f-4e08-a359-9a9e5b4e6bba not found {{(pid=131277) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 21 21:15:54.865536 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-cf147c5f-1884-4c66-b9c2-3d55d897ac63 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] HTTP exception thrown: Security group 9d088f61-f82f-4e08-a359-9a9e5b4e6bba does not exist May 21 21:15:54.865536 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-b2b46a64-5751-400f-825f-95707e120ee5'] May 21 21:15:54.869072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cf147c5f-1884-4c66-b9c2-3d55d897ac63 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Request method failure captured: May 21 21:15:54.869072 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/os-security-groups/9d088f61-f82f-4e08-a359-9a9e5b4e6bba HTTP/1.1 May 21 21:15:54.869072 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:15:54.869072 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:15:54.869072 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:15:54.869072 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:15:54.869072 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:15:54.869072 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:15:54.869072 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:15:54.869072 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:15:54.869072 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZSCYysyyOTwVzhR_Vt3Rp4hJGlHQ1xQ5d6hFUxjxvsTAgt6ix0UNE2Z2Vln9ahBs6pfbfiUV8DEik3Vk1FDugBkn4AbmOx4uTGzwiP9EUa_o0XQmPT-P2Agu2oeG_4YhdEiPrs-TaOwa6w5WGXcLQM63lci1mbOXuKdXB18YVm1Hg May 21 21:15:54.869072 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:15:54.869072 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:15:54.869072 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:15:54.869072 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:15:54.869072 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:15:54.869072 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:15:54.869072 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:15:54.869072 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:15:54.869072 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:15:54.869072 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:15:54.870816 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/53774c838bd64b319776f9afa0821b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_53774c838bd64b319776f9afa0821b79", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:15:54.870816 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-SecurityGroupsTestJSON-741901629 May 21 21:15:54.870816 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:15:54.870816 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:15:54.870816 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:15:54.870816 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:15:54.870816 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:15:54.870816 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 5e82c479130c4377a9a27dd7c8bbe611 May 21 21:15:54.870816 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:15:54.870816 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:15:54.870816 ncdv-master-1 devstack@n-api.service[131277]: exception: Security group 9d088f61-f82f-4e08-a359-9a9e5b4e6bba does not exist May 21 21:15:54.870816 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-b2b46a64-5751-400f-825f-95707e120ee5'] May 21 21:15:54.870816 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '9d088f61-f82f-4e08-a359-9a9e5b4e6bba'} May 21 21:15:54.872070 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:15:54.872070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:54.872070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 21 21:15:54.872070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 21 21:15:54.872070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:15:54.872070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:15:54.872070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 21 21:15:54.872070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 21 21:15:54.872070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:15:54.872070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:15:54.872070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 21 21:15:54.872070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 21 21:15:54.872070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:15:54.872070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:15:54.872070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:15:54.872070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:15:54.872070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:15:54.872070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:15:54.872070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:15:54.873540 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:15:54.873540 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:15:54.873540 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:15:54.873540 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:15:54.873540 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:15:54.873540 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:15:54.873540 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:15:54.873540 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9d088f61-f82f-4e08-a359-9a9e5b4e6bba does not exist May 21 21:15:54.873540 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2b46a64-5751-400f-825f-95707e120ee5'] May 21 21:15:54.873540 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:54.873540 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:15:54.873540 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:54.873540 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:54.873540 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 21 21:15:54.873540 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 21 21:15:54.873540 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 21 21:15:54.873540 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 21 21:15:54.873540 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9d088f61-f82f-4e08-a359-9a9e5b4e6bba does not exist May 21 21:15:54.874983 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2b46a64-5751-400f-825f-95707e120ee5'] May 21 21:15:54.874983 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:54.874983 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:15:54.874983 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:54.874983 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:54.874983 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:15:54.874983 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:15:54.874983 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:15:54.874983 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:15:54.874983 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:15:54.874983 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:15:54.874983 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:15:54.874983 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:15:54.874983 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 21 21:15:54.874983 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 21 21:15:54.874983 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9d088f61-f82f-4e08-a359-9a9e5b4e6bba does not exist May 21 21:15:54.874983 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2b46a64-5751-400f-825f-95707e120ee5'] May 21 21:15:54.874983 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:54.874983 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:15:54.874983 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:54.874983 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:54.876686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:15:54.876686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:15:54.876686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:15:54.876686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:15:54.876686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9d088f61-f82f-4e08-a359-9a9e5b4e6bba does not exist May 21 21:15:54.876686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2b46a64-5751-400f-825f-95707e120ee5'] May 21 21:15:54.876686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:54.877945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cf147c5f-1884-4c66-b9c2-3d55d897ac63 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Returning 404 to user: Security group 9d088f61-f82f-4e08-a359-9a9e5b4e6bba does not exist May 21 21:15:54.877945 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-b2b46a64-5751-400f-825f-95707e120ee5'] {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:15:54.879101 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cf147c5f-1884-4c66-b9c2-3d55d897ac63 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/9d088f61-f82f-4e08-a359-9a9e5b4e6bba" status: 404 len: 194 microversion: 2.1 time: 0.086403 May 21 21:15:54.879957 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 732/1467] 10.222.0.49 () {58 vars in 1268 bytes} [Sat May 21 21:15:54 2022] GET /compute/v2.1/os-security-groups/9d088f61-f82f-4e08-a359-9a9e5b4e6bba => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:15:54.888435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a5008780-dbae-4c8d-aacf-cc1225d296a1 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc82d13f5e0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:54.889133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-546819f8-2533-461f-9974-8faed9e6199c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81b4ba790>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:54.962044 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a5008780-dbae-4c8d-aacf-cc1225d296a1 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781" status: 200 len: 1452 microversion: 2.1 time: 0.078751 May 21 21:15:54.969233 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 736/1468] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:54 2022] GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781 => generated 1452 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:55.259079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-37420b20-ac84-448a-adfa-ff2a7577b6a5 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:55.259811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-37420b20-ac84-448a-adfa-ff2a7577b6a5 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:55.278816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-37420b20-ac84-448a-adfa-ff2a7577b6a5 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:55.278816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-37420b20-ac84-448a-adfa-ff2a7577b6a5 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:55.278816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-37420b20-ac84-448a-adfa-ff2a7577b6a5 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:55.278816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-37420b20-ac84-448a-adfa-ff2a7577b6a5 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:55.280750 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-546819f8-2533-461f-9974-8faed9e6199c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/3ac2b536-4d71-449e-9a1c-3a3d6b33f105" status: 202 len: 0 microversion: 2.1 time: 0.389748 May 21 21:15:55.281740 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 733/1469] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:15:54 2022] DELETE /compute/v2.1/os-security-groups/3ac2b536-4d71-449e-9a1c-3a3d6b33f105 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:15:55.301237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0eb039cd-e39b-401b-ab67-9d94a14b1116 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81b44d0d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:55.346040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG neutronclient.v2_0.client [None req-0eb039cd-e39b-401b-ab67-9d94a14b1116 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3ac2b536-4d71-449e-9a1c-3a3d6b33f105 does not exist", "detail": ""}} {{(pid=131277) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:15:55.347062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.security_group_api [None req-0eb039cd-e39b-401b-ab67-9d94a14b1116 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Neutron security group 3ac2b536-4d71-449e-9a1c-3a3d6b33f105 not found {{(pid=131277) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 21 21:15:55.348158 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-0eb039cd-e39b-401b-ab67-9d94a14b1116 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] HTTP exception thrown: Security group 3ac2b536-4d71-449e-9a1c-3a3d6b33f105 does not exist May 21 21:15:55.348158 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-417575e7-f0d9-4113-9fbb-182a8b94147f'] May 21 21:15:55.351615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0eb039cd-e39b-401b-ab67-9d94a14b1116 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Request method failure captured: May 21 21:15:55.351615 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/os-security-groups/3ac2b536-4d71-449e-9a1c-3a3d6b33f105 HTTP/1.1 May 21 21:15:55.351615 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:15:55.351615 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:15:55.351615 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:15:55.351615 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:15:55.351615 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:15:55.351615 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:15:55.351615 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:15:55.351615 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:15:55.351615 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZSCYysyyOTwVzhR_Vt3Rp4hJGlHQ1xQ5d6hFUxjxvsTAgt6ix0UNE2Z2Vln9ahBs6pfbfiUV8DEik3Vk1FDugBkn4AbmOx4uTGzwiP9EUa_o0XQmPT-P2Agu2oeG_4YhdEiPrs-TaOwa6w5WGXcLQM63lci1mbOXuKdXB18YVm1Hg May 21 21:15:55.351615 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:15:55.351615 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:15:55.351615 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:15:55.351615 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:15:55.351615 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:15:55.351615 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:15:55.351615 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:15:55.351615 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:15:55.351615 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:15:55.351615 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:15:55.353993 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/53774c838bd64b319776f9afa0821b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_53774c838bd64b319776f9afa0821b79", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:15:55.353993 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-SecurityGroupsTestJSON-741901629 May 21 21:15:55.353993 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:15:55.353993 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:15:55.353993 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:15:55.353993 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:15:55.353993 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:15:55.353993 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 5e82c479130c4377a9a27dd7c8bbe611 May 21 21:15:55.353993 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:15:55.353993 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:15:55.353993 ncdv-master-1 devstack@n-api.service[131277]: exception: Security group 3ac2b536-4d71-449e-9a1c-3a3d6b33f105 does not exist May 21 21:15:55.353993 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-417575e7-f0d9-4113-9fbb-182a8b94147f'] May 21 21:15:55.353993 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '3ac2b536-4d71-449e-9a1c-3a3d6b33f105'} May 21 21:15:55.355122 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:15:55.355122 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:55.355122 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 21 21:15:55.355122 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 21 21:15:55.355122 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:15:55.355122 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:15:55.355122 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 21 21:15:55.355122 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 21 21:15:55.355122 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:15:55.355122 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:15:55.355122 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 21 21:15:55.355122 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 21 21:15:55.355122 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:15:55.355122 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:15:55.355122 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:15:55.355122 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:15:55.355122 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:15:55.355122 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:15:55.355122 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:15:55.366196 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:15:55.366196 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:15:55.366196 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:15:55.366196 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:15:55.366196 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:15:55.366196 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:15:55.366196 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:15:55.366196 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3ac2b536-4d71-449e-9a1c-3a3d6b33f105 does not exist May 21 21:15:55.366196 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-417575e7-f0d9-4113-9fbb-182a8b94147f'] May 21 21:15:55.366196 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:55.366196 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:15:55.366196 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:55.366196 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:55.366196 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 21 21:15:55.366196 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 21 21:15:55.366196 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 21 21:15:55.366196 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 21 21:15:55.366196 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3ac2b536-4d71-449e-9a1c-3a3d6b33f105 does not exist May 21 21:15:55.367800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-417575e7-f0d9-4113-9fbb-182a8b94147f'] May 21 21:15:55.367800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:55.367800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:15:55.367800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:55.367800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:55.367800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:15:55.367800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:15:55.367800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:15:55.367800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:15:55.367800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:15:55.367800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:15:55.367800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:15:55.367800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:15:55.367800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 21 21:15:55.367800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 21 21:15:55.367800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3ac2b536-4d71-449e-9a1c-3a3d6b33f105 does not exist May 21 21:15:55.367800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-417575e7-f0d9-4113-9fbb-182a8b94147f'] May 21 21:15:55.367800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:55.367800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:15:55.367800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:55.367800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:55.369938 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:15:55.369938 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:15:55.369938 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:15:55.369938 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:15:55.369938 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3ac2b536-4d71-449e-9a1c-3a3d6b33f105 does not exist May 21 21:15:55.369938 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-417575e7-f0d9-4113-9fbb-182a8b94147f'] May 21 21:15:55.369938 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:55.369938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0eb039cd-e39b-401b-ab67-9d94a14b1116 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Returning 404 to user: Security group 3ac2b536-4d71-449e-9a1c-3a3d6b33f105 does not exist May 21 21:15:55.369938 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-417575e7-f0d9-4113-9fbb-182a8b94147f'] {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:15:55.369938 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0eb039cd-e39b-401b-ab67-9d94a14b1116 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/3ac2b536-4d71-449e-9a1c-3a3d6b33f105" status: 404 len: 194 microversion: 2.1 time: 0.076975 May 21 21:15:55.369938 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 734/1470] 10.222.0.49 () {58 vars in 1268 bytes} [Sat May 21 21:15:55 2022] GET /compute/v2.1/os-security-groups/3ac2b536-4d71-449e-9a1c-3a3d6b33f105 => generated 194 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:15:55.378223 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0fd1a3f1-2049-4c4d-9dd1-a3b109aaf0ae tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81b2df8b0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:55.449246 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-37420b20-ac84-448a-adfa-ff2a7577b6a5 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:55.464166 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-37420b20-ac84-448a-adfa-ff2a7577b6a5 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1307 microversion: 2.1 time: 0.205546 May 21 21:15:55.473732 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 737/1471] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:55 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1307 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:55.478965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9e4ad510-365b-4a8a-ad88-c52e33e06c06 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:55.490441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9e4ad510-365b-4a8a-ad88-c52e33e06c06 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:55.495410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9e4ad510-365b-4a8a-ad88-c52e33e06c06 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:55.496203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9e4ad510-365b-4a8a-ad88-c52e33e06c06 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:55.497243 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9e4ad510-365b-4a8a-ad88-c52e33e06c06 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:55.497864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9e4ad510-365b-4a8a-ad88-c52e33e06c06 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:55.523596 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-9e4ad510-365b-4a8a-ad88-c52e33e06c06 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] HTTP exception thrown: Instance 6dd05f19-07e5-4ed2-846c-250e839345f6 could not be found. May 21 21:15:55.525821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9e4ad510-365b-4a8a-ad88-c52e33e06c06 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Request method failure captured: May 21 21:15:55.525821 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 HTTP/1.1 May 21 21:15:55.525821 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:15:55.525821 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:15:55.525821 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:15:55.525821 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:15:55.525821 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:15:55.525821 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:15:55.525821 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:15:55.525821 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:15:55.525821 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVYcSiyjAIR82oxkRB6GTuWAKVTX4xG5vMYtW_3BeBGCFxFQjKbNKPB4C0xhPGbN3kZTd0vkZOYFJP4MJ1kk_eZN0RsUqNmA1UP-b-s9HcyrYiVjgp1H1dIVPKi3UtrJ4Ob8-qkiVNLHvP2GMr_o_p2pBItaNXntU_KoEaP7ETd6R3M May 21 21:15:55.525821 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:15:55.525821 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:15:55.525821 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:15:55.525821 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:15:55.525821 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:15:55.525821 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:15:55.525821 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:15:55.525821 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:15:55.525821 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:15:55.525821 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:15:55.528167 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85f6ae1864ee43429c910eb27888608f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:15:55.528167 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:15:55.528167 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:15:55.528167 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:15:55.528167 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:15:55.528167 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:15:55.528167 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:15:55.528167 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 186310904c3943fdb63247b58725140e May 21 21:15:55.528167 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:15:55.528167 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:15:55.528167 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 6dd05f19-07e5-4ed2-846c-250e839345f6 could not be found. May 21 21:15:55.528167 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '6dd05f19-07e5-4ed2-846c-250e839345f6'} May 21 21:15:55.529885 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:15:55.529885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:55.529885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:15:55.529885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:15:55.529885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:15:55.529885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:15:55.529885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:15:55.529885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:15:55.529885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:15:55.529885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:15:55.529885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd05f19-07e5-4ed2-846c-250e839345f6 could not be found. May 21 21:15:55.529885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:15:55.529885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:15:55.529885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:15:55.529885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:55.529885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:15:55.529885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:15:55.529885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:15:55.529885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:15:55.529885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:15:55.532430 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:15:55.532430 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:15:55.532430 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:15:55.532430 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:15:55.532430 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:15:55.532430 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:15:55.532430 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:15:55.532430 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd05f19-07e5-4ed2-846c-250e839345f6 could not be found. May 21 21:15:55.532430 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:15:55.532430 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:15:55.532430 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:15:55.532430 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:55.532430 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:15:55.532430 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:15:55.532430 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:15:55.532430 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:15:55.532430 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd05f19-07e5-4ed2-846c-250e839345f6 could not be found. May 21 21:15:55.532430 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:15:55.536084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9e4ad510-365b-4a8a-ad88-c52e33e06c06 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Returning 404 to user: Instance 6dd05f19-07e5-4ed2-846c-250e839345f6 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:15:55.536084 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9e4ad510-365b-4a8a-ad88-c52e33e06c06 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 404 len: 111 microversion: 2.1 time: 0.052975 May 21 21:15:55.539393 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 738/1472] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:55 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:15:55.724116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1db9d5d8-7ba3-411d-932f-078b23c0ccad tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1014034117", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:55.792847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-1db9d5d8-7ba3-411d-932f-078b23c0ccad tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] validate_networks() for [('535b779e-2c0d-4051-93ac-b34fe98b76f4', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:15:55.885915 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0fd1a3f1-2049-4c4d-9dd1-a3b109aaf0ae tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/927dc74c-faa2-45fc-ab7f-bc417766516b" status: 202 len: 0 microversion: 2.1 time: 0.512175 May 21 21:15:55.888205 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 735/1473] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:15:55 2022] DELETE /compute/v2.1/os-security-groups/927dc74c-faa2-45fc-ab7f-bc417766516b => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:15:55.897571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-06d668c9-7369-4f63-beb7-5e6bb3149556 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:55.901978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-06d668c9-7369-4f63-beb7-5e6bb3149556 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:55.914437 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06d668c9-7369-4f63-beb7-5e6bb3149556 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:55.914906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06d668c9-7369-4f63-beb7-5e6bb3149556 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:55.916644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06d668c9-7369-4f63-beb7-5e6bb3149556 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:55.917271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06d668c9-7369-4f63-beb7-5e6bb3149556 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:56.184836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-06d668c9-7369-4f63-beb7-5e6bb3149556 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:56.199168 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-06d668c9-7369-4f63-beb7-5e6bb3149556 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1476 microversion: 2.1 time: 0.309612 May 21 21:15:56.209938 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 736/1474] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:55 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1476 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:56.224487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5ed93733-4622-4550-98f7-28491eecd90f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81b4ba3a0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:56.272735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG neutronclient.v2_0.client [None req-5ed93733-4622-4550-98f7-28491eecd90f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 927dc74c-faa2-45fc-ab7f-bc417766516b does not exist", "detail": ""}} {{(pid=131277) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:15:56.273361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.security_group_api [None req-5ed93733-4622-4550-98f7-28491eecd90f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Neutron security group 927dc74c-faa2-45fc-ab7f-bc417766516b not found {{(pid=131277) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 21 21:15:56.273906 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-5ed93733-4622-4550-98f7-28491eecd90f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] HTTP exception thrown: Security group 927dc74c-faa2-45fc-ab7f-bc417766516b does not exist May 21 21:15:56.273906 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-97864c20-747c-4b65-8575-6e3c4512c8bb'] May 21 21:15:56.276688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5ed93733-4622-4550-98f7-28491eecd90f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Request method failure captured: May 21 21:15:56.276688 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/os-security-groups/927dc74c-faa2-45fc-ab7f-bc417766516b HTTP/1.1 May 21 21:15:56.276688 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:15:56.276688 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:15:56.276688 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:15:56.276688 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:15:56.276688 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:15:56.276688 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:15:56.276688 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:15:56.276688 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:15:56.276688 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZSCYysyyOTwVzhR_Vt3Rp4hJGlHQ1xQ5d6hFUxjxvsTAgt6ix0UNE2Z2Vln9ahBs6pfbfiUV8DEik3Vk1FDugBkn4AbmOx4uTGzwiP9EUa_o0XQmPT-P2Agu2oeG_4YhdEiPrs-TaOwa6w5WGXcLQM63lci1mbOXuKdXB18YVm1Hg May 21 21:15:56.276688 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:15:56.276688 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:15:56.276688 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:15:56.276688 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:15:56.276688 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:15:56.276688 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:15:56.276688 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:15:56.276688 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:15:56.276688 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:15:56.276688 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:15:56.278081 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/53774c838bd64b319776f9afa0821b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_53774c838bd64b319776f9afa0821b79", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:15:56.278081 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-SecurityGroupsTestJSON-741901629 May 21 21:15:56.278081 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:15:56.278081 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:15:56.278081 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:15:56.278081 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:15:56.278081 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:15:56.278081 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 5e82c479130c4377a9a27dd7c8bbe611 May 21 21:15:56.278081 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:15:56.278081 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:15:56.278081 ncdv-master-1 devstack@n-api.service[131277]: exception: Security group 927dc74c-faa2-45fc-ab7f-bc417766516b does not exist May 21 21:15:56.278081 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-97864c20-747c-4b65-8575-6e3c4512c8bb'] May 21 21:15:56.278081 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '927dc74c-faa2-45fc-ab7f-bc417766516b'} May 21 21:15:56.278949 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:15:56.278949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:56.278949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 21 21:15:56.278949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 21 21:15:56.278949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:15:56.278949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:15:56.278949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 21 21:15:56.278949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 21 21:15:56.278949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:15:56.278949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:15:56.278949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 21 21:15:56.278949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 21 21:15:56.278949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:15:56.278949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:15:56.278949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:15:56.278949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:15:56.278949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:15:56.278949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:15:56.278949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:15:56.280120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:15:56.280120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:15:56.280120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:15:56.280120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:15:56.280120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:15:56.280120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:15:56.280120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:15:56.280120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 927dc74c-faa2-45fc-ab7f-bc417766516b does not exist May 21 21:15:56.280120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97864c20-747c-4b65-8575-6e3c4512c8bb'] May 21 21:15:56.280120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:56.280120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:15:56.280120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:56.280120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:56.280120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 21 21:15:56.280120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 21 21:15:56.280120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 21 21:15:56.280120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 21 21:15:56.280120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 927dc74c-faa2-45fc-ab7f-bc417766516b does not exist May 21 21:15:56.281384 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97864c20-747c-4b65-8575-6e3c4512c8bb'] May 21 21:15:56.281384 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:56.281384 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:15:56.281384 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:56.281384 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:56.281384 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:15:56.281384 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:15:56.281384 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:15:56.281384 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:15:56.281384 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:15:56.281384 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:15:56.281384 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:15:56.281384 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:15:56.281384 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 21 21:15:56.281384 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 21 21:15:56.281384 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 927dc74c-faa2-45fc-ab7f-bc417766516b does not exist May 21 21:15:56.281384 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97864c20-747c-4b65-8575-6e3c4512c8bb'] May 21 21:15:56.281384 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:56.281384 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:15:56.281384 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:56.281384 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:15:56.285526 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:15:56.285526 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:15:56.285526 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:15:56.285526 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:15:56.285526 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 927dc74c-faa2-45fc-ab7f-bc417766516b does not exist May 21 21:15:56.285526 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97864c20-747c-4b65-8575-6e3c4512c8bb'] May 21 21:15:56.285526 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:15:56.285526 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5ed93733-4622-4550-98f7-28491eecd90f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Returning 404 to user: Security group 927dc74c-faa2-45fc-ab7f-bc417766516b does not exist May 21 21:15:56.285526 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-97864c20-747c-4b65-8575-6e3c4512c8bb'] {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:15:56.287773 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5ed93733-4622-4550-98f7-28491eecd90f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/927dc74c-faa2-45fc-ab7f-bc417766516b" status: 404 len: 194 microversion: 2.1 time: 0.075234 May 21 21:15:56.287773 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 737/1475] 10.222.0.49 () {58 vars in 1268 bytes} [Sat May 21 21:15:56 2022] GET /compute/v2.1/os-security-groups/927dc74c-faa2-45fc-ab7f-bc417766516b => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:15:56.293319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e5a42085-1519-4b05-8f90-bfba0efbd23f tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b408f70>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:56.357844 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e5a42085-1519-4b05-8f90-bfba0efbd23f tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781" status: 200 len: 1452 microversion: 2.1 time: 0.068953 May 21 21:15:56.363776 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 738/1476] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:56 2022] GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781 => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:56.374629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d334bd50-5034-4951-b4fa-1d039369c66d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81b4baaf0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:56.690380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-1db9d5d8-7ba3-411d-932f-078b23c0ccad tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:15:56.690380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-1db9d5d8-7ba3-411d-932f-078b23c0ccad tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:15:56.690380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-1db9d5d8-7ba3-411d-932f-078b23c0ccad tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:15:56.690380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-1db9d5d8-7ba3-411d-932f-078b23c0ccad tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:15:56.690380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-1db9d5d8-7ba3-411d-932f-078b23c0ccad tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:15:56.700197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1db9d5d8-7ba3-411d-932f-078b23c0ccad tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:56.700913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1db9d5d8-7ba3-411d-932f-078b23c0ccad tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:56.701910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1db9d5d8-7ba3-411d-932f-078b23c0ccad tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:56.702516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1db9d5d8-7ba3-411d-932f-078b23c0ccad tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:56.721934 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d334bd50-5034-4951-b4fa-1d039369c66d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.356750 May 21 21:15:56.731596 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 739/1477] 10.222.0.49 () {58 vars in 1157 bytes} [Sat May 21 21:15:56 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:56.734542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-1db9d5d8-7ba3-411d-932f-078b23c0ccad tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Getting quotas for project 85f6ae1864ee43429c910eb27888608f. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:15:56.744748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-2f955a73-7beb-42d3-a342-292a0eb9e7a4 req-150c636b-dfd4-4bf7-a4bb-8fbfbed26022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b", "name": "network-vif-plugged", "status": "completed", "tag": "d45fcb13-cb81-4e01-869d-5e2e4b8084cc"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:56.752700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-1db9d5d8-7ba3-411d-932f-078b23c0ccad tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Getting quotas for user 186310904c3943fdb63247b58725140e and project 85f6ae1864ee43429c910eb27888608f. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:15:56.771178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1db9d5d8-7ba3-411d-932f-078b23c0ccad tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:15:56.773620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1db9d5d8-7ba3-411d-932f-078b23c0ccad tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 109fe86b-c8fa-4563-973a-fd343b14f652] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:15:56.781412 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2f955a73-7beb-42d3-a342-292a0eb9e7a4 req-150c636b-dfd4-4bf7-a4bb-8fbfbed26022 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:56.782437 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2f955a73-7beb-42d3-a342-292a0eb9e7a4 req-150c636b-dfd4-4bf7-a4bb-8fbfbed26022 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:56.801081 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-2f955a73-7beb-42d3-a342-292a0eb9e7a4 req-150c636b-dfd4-4bf7-a4bb-8fbfbed26022 service nova] Creating event network-vif-plugged:d45fcb13-cb81-4e01-869d-5e2e4b8084cc for instance 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b on nch2-master-1 May 21 21:15:56.808382 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-2f955a73-7beb-42d3-a342-292a0eb9e7a4 req-150c636b-dfd4-4bf7-a4bb-8fbfbed26022 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074740 May 21 21:15:56.813614 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 740/1478] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:56.834301 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-839028fa-fef0-4600-846a-1ec668247990 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:56.839266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-839028fa-fef0-4600-846a-1ec668247990 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:56.849216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-839028fa-fef0-4600-846a-1ec668247990 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:56.849599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-839028fa-fef0-4600-846a-1ec668247990 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:56.850462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-839028fa-fef0-4600-846a-1ec668247990 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:56.861868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-839028fa-fef0-4600-846a-1ec668247990 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:56.982077 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1db9d5d8-7ba3-411d-932f-078b23c0ccad tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.263093 May 21 21:15:56.984405 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 739/1479] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:15:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 1268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:15:56.999773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-26cac8e2-ed6e-4406-9c41-f5171b15e457 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Action: 'create', calling method: .version_select at 0x7fc81b3ee940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-298637378", "description": "tempest-description-1801232869"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:57.193784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-839028fa-fef0-4600-846a-1ec668247990 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:57.206395 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-839028fa-fef0-4600-846a-1ec668247990 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1307 microversion: 2.1 time: 0.390970 May 21 21:15:57.208617 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 741/1480] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:56 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1307 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:57.223893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-769cdf56-e042-4a6d-a72a-4e93eb26b5d2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:57.223893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-769cdf56-e042-4a6d-a72a-4e93eb26b5d2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 109fe86b-c8fa-4563-973a-fd343b14f652] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:57.325281 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-769cdf56-e042-4a6d-a72a-4e93eb26b5d2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:57.334375 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-769cdf56-e042-4a6d-a72a-4e93eb26b5d2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652" status: 200 len: 1225 microversion: 2.1 time: 0.125816 May 21 21:15:57.335932 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 742/1481] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:57 2022] GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652 => generated 1225 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:57.342501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2b2f1237-72a3-4663-af5f-06c67c2d97ae tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:57.343457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2b2f1237-72a3-4663-af5f-06c67c2d97ae tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:57.352558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b2f1237-72a3-4663-af5f-06c67c2d97ae tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:57.353542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b2f1237-72a3-4663-af5f-06c67c2d97ae tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:57.354706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b2f1237-72a3-4663-af5f-06c67c2d97ae tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:57.355432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b2f1237-72a3-4663-af5f-06c67c2d97ae tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:57.545553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2b2f1237-72a3-4663-af5f-06c67c2d97ae tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:57.554637 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2b2f1237-72a3-4663-af5f-06c67c2d97ae tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1476 microversion: 2.1 time: 0.216266 May 21 21:15:57.558617 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 743/1482] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:57 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1476 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:57.560873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0947fc1a-3442-4faf-9527-87a638e44771 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b408e50>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:57.661408 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0947fc1a-3442-4faf-9527-87a638e44771 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781" status: 200 len: 1452 microversion: 2.1 time: 0.104732 May 21 21:15:57.667977 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 744/1483] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:57 2022] GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781 => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:57.789783 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-26cac8e2-ed6e-4406-9c41-f5171b15e457 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.802280 May 21 21:15:57.791034 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 740/1484] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:15:56 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:57.802965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ca5c5cf3-7d2e-43d9-8421-8fb80c0b758d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Action: 'create', calling method: .version_select at 0x7fc81b533550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1368768381", "description": "tempest-description-772212675"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:58.237255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-62f5fb56-2124-4f10-ad10-554e404b015c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:58.238677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-62f5fb56-2124-4f10-ad10-554e404b015c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:58.281924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62f5fb56-2124-4f10-ad10-554e404b015c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:58.282652 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62f5fb56-2124-4f10-ad10-554e404b015c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:58.283864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62f5fb56-2124-4f10-ad10-554e404b015c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:58.284502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62f5fb56-2124-4f10-ad10-554e404b015c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:58.306229 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ca5c5cf3-7d2e-43d9-8421-8fb80c0b758d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.504535 May 21 21:15:58.308751 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 745/1485] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:15:57 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:58.625808 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-62f5fb56-2124-4f10-ad10-554e404b015c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:58.641392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:58.643428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dd70f4ee-33f3-4d03-88a9-e2fc9f6c543a tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:58.644977 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:15:58.644977 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:15:58.646467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd70f4ee-33f3-4d03-88a9-e2fc9f6c543a tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:58.646856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd70f4ee-33f3-4d03-88a9-e2fc9f6c543a tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:58.647934 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd70f4ee-33f3-4d03-88a9-e2fc9f6c543a tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:58.648966 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-62f5fb56-2124-4f10-ad10-554e404b015c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1307 microversion: 2.1 time: 0.417086 May 21 21:15:58.650729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd70f4ee-33f3-4d03-88a9-e2fc9f6c543a tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:58.652114 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 741/1486] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:58 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1307 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:58.657957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-95565f4a-cbb2-45f8-bf22-0f55910b8bc1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:58.673930 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-95565f4a-cbb2-45f8-bf22-0f55910b8bc1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 109fe86b-c8fa-4563-973a-fd343b14f652] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:58.680965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95565f4a-cbb2-45f8-bf22-0f55910b8bc1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:58.681658 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95565f4a-cbb2-45f8-bf22-0f55910b8bc1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:58.682649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95565f4a-cbb2-45f8-bf22-0f55910b8bc1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:58.683249 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95565f4a-cbb2-45f8-bf22-0f55910b8bc1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:58.689161 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dd70f4ee-33f3-4d03-88a9-e2fc9f6c543a tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.379146 May 21 21:15:58.690130 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 746/1487] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:15:58 2022] GET /compute/v2.1/os-services => generated 947 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:58.699202 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-74543ce8-df5b-4016-ad7f-086d8332f6e0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:58.700165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-74543ce8-df5b-4016-ad7f-086d8332f6e0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:58.707198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=14,nova_api:UPDATE=14 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:58.711965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-74543ce8-df5b-4016-ad7f-086d8332f6e0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:58.713810 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-74543ce8-df5b-4016-ad7f-086d8332f6e0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:58.714621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-74543ce8-df5b-4016-ad7f-086d8332f6e0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:58.715067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-74543ce8-df5b-4016-ad7f-086d8332f6e0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:58.799467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-95565f4a-cbb2-45f8-bf22-0f55910b8bc1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:58.812132 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-95565f4a-cbb2-45f8-bf22-0f55910b8bc1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652" status: 200 len: 1229 microversion: 2.1 time: 0.158545 May 21 21:15:58.812942 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 742/1488] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:58 2022] GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652 => generated 1229 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:58.818091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-36096839-2af9-4450-b4d9-69a1b143aa2b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-256792011", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "3aca5486-8d2f-4873-a368-534e03eca6d4"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:58.891949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-36096839-2af9-4450-b4d9-69a1b143aa2b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] validate_networks() for [('3aca5486-8d2f-4873-a368-534e03eca6d4', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:15:58.940315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-74543ce8-df5b-4016-ad7f-086d8332f6e0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:58.951435 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-74543ce8-df5b-4016-ad7f-086d8332f6e0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1476 microversion: 2.1 time: 0.260071 May 21 21:15:58.952357 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 747/1489] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:58 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1476 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:58.958436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7ee36858-ea75-46f6-bbaf-7809380a8810 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b4ba0d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:59.018790 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7ee36858-ea75-46f6-bbaf-7809380a8810 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781" status: 200 len: 1452 microversion: 2.1 time: 0.065130 May 21 21:15:59.021186 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 748/1490] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:15:58 2022] GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781 => generated 1452 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:59.025504 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e64cad3f-7798-480c-abdc-d130977eedf0 tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:59.027460 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:15:59.027460 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:15:59.029210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e64cad3f-7798-480c-abdc-d130977eedf0 tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:59.029921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e64cad3f-7798-480c-abdc-d130977eedf0 tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:59.031003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e64cad3f-7798-480c-abdc-d130977eedf0 tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:59.031562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e64cad3f-7798-480c-abdc-d130977eedf0 tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:59.065972 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e64cad3f-7798-480c-abdc-d130977eedf0 tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.045078 May 21 21:15:59.073205 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 749/1491] 10.222.0.49 () {58 vars in 1173 bytes} [Sat May 21 21:15:59 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:15:59.080613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f9ca3cb2-4832-4082-b3b0-10b598c9e656 tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:59.082106 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:15:59.082106 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:15:59.083578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f9ca3cb2-4832-4082-b3b0-10b598c9e656 tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:59.084271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f9ca3cb2-4832-4082-b3b0-10b598c9e656 tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:59.085411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f9ca3cb2-4832-4082-b3b0-10b598c9e656 tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:59.085904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f9ca3cb2-4832-4082-b3b0-10b598c9e656 tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:59.120505 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f9ca3cb2-4832-4082-b3b0-10b598c9e656 tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.045468 May 21 21:15:59.132346 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 750/1492] 10.222.0.49 () {58 vars in 1175 bytes} [Sat May 21 21:15:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:15:59.135385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-02137de5-b929-43d6-967e-eb7dda738aba tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:59.135385 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:15:59.135385 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:15:59.137130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02137de5-b929-43d6-967e-eb7dda738aba tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:59.137595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02137de5-b929-43d6-967e-eb7dda738aba tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:59.139168 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02137de5-b929-43d6-967e-eb7dda738aba tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:59.139168 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02137de5-b929-43d6-967e-eb7dda738aba tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:59.183002 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-02137de5-b929-43d6-967e-eb7dda738aba tempest-ServicesAdminTestJSON-1561700478 tempest-ServicesAdminTestJSON-1561700478-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.053443 May 21 21:15:59.183570 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 751/1493] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:15:59 2022] GET /compute/v2.1/os-services => generated 947 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:15:59.672513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8b2d2b96-7b57-451b-bf3f-3d74230a0445 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:59.672513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8b2d2b96-7b57-451b-bf3f-3d74230a0445 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:59.677962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b2d2b96-7b57-451b-bf3f-3d74230a0445 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:59.678422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b2d2b96-7b57-451b-bf3f-3d74230a0445 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:59.679246 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b2d2b96-7b57-451b-bf3f-3d74230a0445 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:59.679727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b2d2b96-7b57-451b-bf3f-3d74230a0445 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:59.794829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-36096839-2af9-4450-b4d9-69a1b143aa2b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:15:59.795360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-36096839-2af9-4450-b4d9-69a1b143aa2b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:15:59.795853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-36096839-2af9-4450-b4d9-69a1b143aa2b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:15:59.796427 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-36096839-2af9-4450-b4d9-69a1b143aa2b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:15:59.796919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-36096839-2af9-4450-b4d9-69a1b143aa2b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:15:59.807622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36096839-2af9-4450-b4d9-69a1b143aa2b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:59.808183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36096839-2af9-4450-b4d9-69a1b143aa2b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:59.809149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36096839-2af9-4450-b4d9-69a1b143aa2b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:59.817234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36096839-2af9-4450-b4d9-69a1b143aa2b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:59.834228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-36096839-2af9-4450-b4d9-69a1b143aa2b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Getting quotas for project 53774c838bd64b319776f9afa0821b79. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:15:59.835624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8b2d2b96-7b57-451b-bf3f-3d74230a0445 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:59.840025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-36096839-2af9-4450-b4d9-69a1b143aa2b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Getting quotas for user 5e82c479130c4377a9a27dd7c8bbe611 and project 53774c838bd64b319776f9afa0821b79. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:15:59.843943 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8b2d2b96-7b57-451b-bf3f-3d74230a0445 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1487 microversion: 2.1 time: 0.179672 May 21 21:15:59.844605 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 752/1494] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:59 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1487 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:15:59.856133 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-36096839-2af9-4450-b4d9-69a1b143aa2b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:15:59.858527 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-36096839-2af9-4450-b4d9-69a1b143aa2b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:15:59.860517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-67c1ffab-2b26-43e2-aa48-6ef101eb73c4 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:15:59.861461 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-67c1ffab-2b26-43e2-aa48-6ef101eb73c4 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 109fe86b-c8fa-4563-973a-fd343b14f652] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:15:59.869826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67c1ffab-2b26-43e2-aa48-6ef101eb73c4 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:59.870281 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67c1ffab-2b26-43e2-aa48-6ef101eb73c4 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:59.871082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67c1ffab-2b26-43e2-aa48-6ef101eb73c4 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:59.871530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67c1ffab-2b26-43e2-aa48-6ef101eb73c4 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:15:59.955841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-67c1ffab-2b26-43e2-aa48-6ef101eb73c4 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:15:59.970099 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-67c1ffab-2b26-43e2-aa48-6ef101eb73c4 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652" status: 200 len: 1277 microversion: 2.1 time: 0.113466 May 21 21:15:59.973796 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 753/1495] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:15:59 2022] GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652 => generated 1277 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:15:59.984445 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-891d5a3b-bcc1-4a85-9f8b-634ae852a6c6 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:15:59.990810 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-891d5a3b-bcc1-4a85-9f8b-634ae852a6c6 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:15:59.991400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-891d5a3b-bcc1-4a85-9f8b-634ae852a6c6 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:00.080879 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-36096839-2af9-4450-b4d9-69a1b143aa2b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.266448 May 21 21:16:00.088987 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 743/1496] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:15:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:16:00.112596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-891d5a3b-bcc1-4a85-9f8b-634ae852a6c6 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Going to try to stop instance {{(pid=131277) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 21 21:16:00.118724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-14ef8fff-34ab-4941-9eb2-b58d31dd4cc6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:00.125181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-14ef8fff-34ab-4941-9eb2-b58d31dd4cc6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:00.160131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14ef8fff-34ab-4941-9eb2-b58d31dd4cc6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:00.160680 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14ef8fff-34ab-4941-9eb2-b58d31dd4cc6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:00.161535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14ef8fff-34ab-4941-9eb2-b58d31dd4cc6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:00.161983 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14ef8fff-34ab-4941-9eb2-b58d31dd4cc6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:00.473564 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-891d5a3b-bcc1-4a85-9f8b-634ae852a6c6 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "POST /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b/action" status: 202 len: 0 microversion: 2.1 time: 0.498158 May 21 21:16:00.474414 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 754/1497] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:15:59 2022] POST /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:00.494191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6bab06b5-950e-4477-ac70-6c653f0867c4 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b5683a0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:00.566913 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6bab06b5-950e-4477-ac70-6c653f0867c4 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781" status: 200 len: 1452 microversion: 2.1 time: 0.081947 May 21 21:16:00.566913 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 755/1498] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:00 2022] GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781 => generated 1452 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:00.569322 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3b547bb6-ccba-4451-a752-fddd6cc48522 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:00.570271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3b547bb6-ccba-4451-a752-fddd6cc48522 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:00.673273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3b547bb6-ccba-4451-a752-fddd6cc48522 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:00.695443 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-14ef8fff-34ab-4941-9eb2-b58d31dd4cc6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:00.698054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=83 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:00.707046 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-14ef8fff-34ab-4941-9eb2-b58d31dd4cc6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1476 microversion: 2.1 time: 0.605481 May 21 21:16:00.715257 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3b547bb6-ccba-4451-a752-fddd6cc48522 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 200 len: 1215 microversion: 2.1 time: 0.150059 May 21 21:16:00.717733 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 756/1499] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:00 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 1215 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:00.723776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-580c0b37-e683-4f83-aab8-624f72d7366b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:00.724753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-580c0b37-e683-4f83-aab8-624f72d7366b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:00.732744 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 744/1500] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:00 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1476 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:00.763771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-580c0b37-e683-4f83-aab8-624f72d7366b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:00.764588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-580c0b37-e683-4f83-aab8-624f72d7366b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:00.765385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-580c0b37-e683-4f83-aab8-624f72d7366b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:00.784606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-580c0b37-e683-4f83-aab8-624f72d7366b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:00.994094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a19779dc-d36d-4b60-a2fb-8a59e4033356 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:00.995403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a19779dc-d36d-4b60-a2fb-8a59e4033356 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 109fe86b-c8fa-4563-973a-fd343b14f652] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:01.002577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a19779dc-d36d-4b60-a2fb-8a59e4033356 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:01.003427 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a19779dc-d36d-4b60-a2fb-8a59e4033356 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:01.004550 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a19779dc-d36d-4b60-a2fb-8a59e4033356 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:01.005156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a19779dc-d36d-4b60-a2fb-8a59e4033356 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:01.113656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-580c0b37-e683-4f83-aab8-624f72d7366b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:01.132318 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-580c0b37-e683-4f83-aab8-624f72d7366b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1497 microversion: 2.1 time: 0.412603 May 21 21:16:01.134598 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 757/1501] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:00 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1497 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:01.245224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a19779dc-d36d-4b60-a2fb-8a59e4033356 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:01.263740 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a19779dc-d36d-4b60-a2fb-8a59e4033356 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652" status: 200 len: 1283 microversion: 2.1 time: 0.277051 May 21 21:16:01.264365 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 745/1502] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:00 2022] GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652 => generated 1283 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:01.579885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a0185ac7-fad9-441b-b56f-5433d37935b0 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b638af0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:01.665326 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a0185ac7-fad9-441b-b56f-5433d37935b0 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781" status: 200 len: 1452 microversion: 2.1 time: 0.087396 May 21 21:16:01.666378 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 758/1503] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:01 2022] GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781 => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:01.733805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-35926d70-a129-493b-8eef-a61b807742a0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:01.735422 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-35926d70-a129-493b-8eef-a61b807742a0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:01.737410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a1d80793-248f-4289-931f-827fcb9a717f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:01.738172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a1d80793-248f-4289-931f-827fcb9a717f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:01.745042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35926d70-a129-493b-8eef-a61b807742a0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:01.746177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35926d70-a129-493b-8eef-a61b807742a0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:01.747730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35926d70-a129-493b-8eef-a61b807742a0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:01.748494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35926d70-a129-493b-8eef-a61b807742a0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:01.753922 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1d80793-248f-4289-931f-827fcb9a717f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:01.754787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1d80793-248f-4289-931f-827fcb9a717f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:01.756332 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1d80793-248f-4289-931f-827fcb9a717f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:01.756963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1d80793-248f-4289-931f-827fcb9a717f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:01.806033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:01.908190 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a1d80793-248f-4289-931f-827fcb9a717f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:01.928438 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a1d80793-248f-4289-931f-827fcb9a717f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 200 len: 1219 microversion: 2.1 time: 0.195274 May 21 21:16:01.929063 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 759/1504] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:01 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 1219 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:02.059568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-35926d70-a129-493b-8eef-a61b807742a0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:02.067360 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-35926d70-a129-493b-8eef-a61b807742a0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1476 microversion: 2.1 time: 0.345458 May 21 21:16:02.068317 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 746/1505] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:01 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1476 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:02.171146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5c92961c-2490-438c-96ee-fc55620ebd8c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:02.172106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5c92961c-2490-438c-96ee-fc55620ebd8c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:02.179799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c92961c-2490-438c-96ee-fc55620ebd8c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:02.181045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c92961c-2490-438c-96ee-fc55620ebd8c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:02.181998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c92961c-2490-438c-96ee-fc55620ebd8c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:02.182449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c92961c-2490-438c-96ee-fc55620ebd8c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:02.282738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7f4bdff7-4af9-4822-832e-17618a488aa2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:02.283591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7f4bdff7-4af9-4822-832e-17618a488aa2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 109fe86b-c8fa-4563-973a-fd343b14f652] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:02.294398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f4bdff7-4af9-4822-832e-17618a488aa2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:02.295145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f4bdff7-4af9-4822-832e-17618a488aa2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:02.304614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f4bdff7-4af9-4822-832e-17618a488aa2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:02.306150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f4bdff7-4af9-4822-832e-17618a488aa2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:02.367154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5c92961c-2490-438c-96ee-fc55620ebd8c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:02.377003 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5c92961c-2490-438c-96ee-fc55620ebd8c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1497 microversion: 2.1 time: 0.227616 May 21 21:16:02.378090 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 760/1506] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:02 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1497 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:02.676567 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7f4bdff7-4af9-4822-832e-17618a488aa2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:02.689353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-40bc9d7f-7006-496c-b698-d9628d2c43a1 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b4e89d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:02.698705 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7f4bdff7-4af9-4822-832e-17618a488aa2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652" status: 200 len: 1325 microversion: 2.1 time: 0.420791 May 21 21:16:02.709154 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 747/1507] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:02 2022] GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652 => generated 1325 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:02.773745 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-40bc9d7f-7006-496c-b698-d9628d2c43a1 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781" status: 200 len: 1452 microversion: 2.1 time: 0.088132 May 21 21:16:02.776843 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 761/1508] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:02 2022] GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781 => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:02.950679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eefa6ba9-a17d-42bd-b372-f52ab9de449b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:02.951827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-eefa6ba9-a17d-42bd-b372-f52ab9de449b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:02.962831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eefa6ba9-a17d-42bd-b372-f52ab9de449b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:02.963746 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eefa6ba9-a17d-42bd-b372-f52ab9de449b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:02.965423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eefa6ba9-a17d-42bd-b372-f52ab9de449b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:02.966178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eefa6ba9-a17d-42bd-b372-f52ab9de449b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:03.092698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7a1fc5b5-d326-43fa-a25e-4474b924af3f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:03.093733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7a1fc5b5-d326-43fa-a25e-4474b924af3f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:03.123883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a1fc5b5-d326-43fa-a25e-4474b924af3f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:03.126363 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a1fc5b5-d326-43fa-a25e-4474b924af3f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:03.127464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a1fc5b5-d326-43fa-a25e-4474b924af3f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:03.139772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a1fc5b5-d326-43fa-a25e-4474b924af3f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:03.145555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-eefa6ba9-a17d-42bd-b372-f52ab9de449b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:03.162777 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-eefa6ba9-a17d-42bd-b372-f52ab9de449b tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 200 len: 1275 microversion: 2.1 time: 0.215645 May 21 21:16:03.178591 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 748/1509] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:02 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 1275 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:16:03.404998 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-53f67d97-e882-4512-a1da-848b389a6eee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:03.405737 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-53f67d97-e882-4512-a1da-848b389a6eee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:03.439659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-53f67d97-e882-4512-a1da-848b389a6eee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:03.441146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-53f67d97-e882-4512-a1da-848b389a6eee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:03.442307 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-53f67d97-e882-4512-a1da-848b389a6eee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:03.442770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-53f67d97-e882-4512-a1da-848b389a6eee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:03.659716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7a1fc5b5-d326-43fa-a25e-4474b924af3f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:03.691541 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7a1fc5b5-d326-43fa-a25e-4474b924af3f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1476 microversion: 2.1 time: 0.604994 May 21 21:16:03.699422 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 762/1510] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:03 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1476 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:03.731886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-48849537-086c-4ef1-b4be-6213f87d33c1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:03.732556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-48849537-086c-4ef1-b4be-6213f87d33c1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 109fe86b-c8fa-4563-973a-fd343b14f652] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:03.745760 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48849537-086c-4ef1-b4be-6213f87d33c1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:03.746679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48849537-086c-4ef1-b4be-6213f87d33c1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:03.748146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48849537-086c-4ef1-b4be-6213f87d33c1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:03.749274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48849537-086c-4ef1-b4be-6213f87d33c1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:03.917237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-53f67d97-e882-4512-a1da-848b389a6eee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:03.935989 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-53f67d97-e882-4512-a1da-848b389a6eee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1497 microversion: 2.1 time: 0.544964 May 21 21:16:03.938197 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 749/1511] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:03 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1497 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:16:03.947753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c0d638e4-5d42-4958-9045-cda4c5cc0623 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b3acca0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:04.018375 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c0d638e4-5d42-4958-9045-cda4c5cc0623 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781" status: 200 len: 1452 microversion: 2.1 time: 0.078751 May 21 21:16:04.023992 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 750/1512] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:03 2022] GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781 => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:04.036960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-8c907dd1-61df-4bee-b22a-b6c48c873c13 req-fd83d1ef-88e0-4aa1-906f-39022d9c885f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "109fe86b-c8fa-4563-973a-fd343b14f652", "tag": "c303e0ea-3273-47b1-b21a-adfbfbd582b4"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:04.052466 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-8c907dd1-61df-4bee-b22a-b6c48c873c13 req-fd83d1ef-88e0-4aa1-906f-39022d9c885f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:04.055596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-8c907dd1-61df-4bee-b22a-b6c48c873c13 req-fd83d1ef-88e0-4aa1-906f-39022d9c885f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:04.082033 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-8c907dd1-61df-4bee-b22a-b6c48c873c13 req-fd83d1ef-88e0-4aa1-906f-39022d9c885f service nova] Creating event network-changed:c303e0ea-3273-47b1-b21a-adfbfbd582b4 for instance 109fe86b-c8fa-4563-973a-fd343b14f652 on nch1-master-1 May 21 21:16:04.089398 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-8c907dd1-61df-4bee-b22a-b6c48c873c13 req-fd83d1ef-88e0-4aa1-906f-39022d9c885f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056263 May 21 21:16:04.094956 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 751/1513] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:04.187776 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0fa9fe93-ccad-48c1-82cb-30abf0adf6ed tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:04.189360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0fa9fe93-ccad-48c1-82cb-30abf0adf6ed tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:04.197910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fa9fe93-ccad-48c1-82cb-30abf0adf6ed tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:04.198790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fa9fe93-ccad-48c1-82cb-30abf0adf6ed tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:04.199927 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fa9fe93-ccad-48c1-82cb-30abf0adf6ed tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:04.200672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fa9fe93-ccad-48c1-82cb-30abf0adf6ed tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:04.262246 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-48849537-086c-4ef1-b4be-6213f87d33c1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:04.276950 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-48849537-086c-4ef1-b4be-6213f87d33c1 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652" status: 200 len: 1325 microversion: 2.1 time: 0.550218 May 21 21:16:04.292461 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 763/1514] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:03 2022] GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652 => generated 1325 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:04.358336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0fa9fe93-ccad-48c1-82cb-30abf0adf6ed tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:04.370149 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0fa9fe93-ccad-48c1-82cb-30abf0adf6ed tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 200 len: 1273 microversion: 2.1 time: 0.186779 May 21 21:16:04.371094 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 752/1515] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:04 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 1273 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:16:04.712218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-341b55c5-5371-441c-8d40-afbe13ec1f88 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:04.713028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-341b55c5-5371-441c-8d40-afbe13ec1f88 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:04.720343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-341b55c5-5371-441c-8d40-afbe13ec1f88 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:04.721199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-341b55c5-5371-441c-8d40-afbe13ec1f88 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:04.722186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-341b55c5-5371-441c-8d40-afbe13ec1f88 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:04.722697 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-341b55c5-5371-441c-8d40-afbe13ec1f88 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:04.955196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2ecb67ac-2f90-4104-aa2b-1cbdfbef22ea tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:04.956405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2ecb67ac-2f90-4104-aa2b-1cbdfbef22ea tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:04.960928 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:04.986692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2ecb67ac-2f90-4104-aa2b-1cbdfbef22ea tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:04.992564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2ecb67ac-2f90-4104-aa2b-1cbdfbef22ea tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:04.997095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2ecb67ac-2f90-4104-aa2b-1cbdfbef22ea tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:04.997854 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2ecb67ac-2f90-4104-aa2b-1cbdfbef22ea tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:05.090674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-341b55c5-5371-441c-8d40-afbe13ec1f88 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:05.104248 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-341b55c5-5371-441c-8d40-afbe13ec1f88 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1476 microversion: 2.1 time: 0.396626 May 21 21:16:05.108830 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 764/1516] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:04 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1476 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:05.116828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f789bd98-bcb6-4707-803d-94f0cb40c1e9 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b499700>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:05.208148 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f789bd98-bcb6-4707-803d-94f0cb40c1e9 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781" status: 200 len: 1452 microversion: 2.1 time: 0.092740 May 21 21:16:05.210255 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 765/1517] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:05 2022] GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781 => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:05.303924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2ecb67ac-2f90-4104-aa2b-1cbdfbef22ea tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:05.309416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f3d44f24-e9aa-4eb6-baff-4984d58d6eda tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:05.316112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f3d44f24-e9aa-4eb6-baff-4984d58d6eda tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 109fe86b-c8fa-4563-973a-fd343b14f652] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:05.323798 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2ecb67ac-2f90-4104-aa2b-1cbdfbef22ea tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1497 microversion: 2.1 time: 0.372327 May 21 21:16:05.328683 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 753/1518] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:04 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1497 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:05.340895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3d44f24-e9aa-4eb6-baff-4984d58d6eda tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:05.342297 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3d44f24-e9aa-4eb6-baff-4984d58d6eda tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:05.343731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3d44f24-e9aa-4eb6-baff-4984d58d6eda tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:05.344426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3d44f24-e9aa-4eb6-baff-4984d58d6eda tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:05.388510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-862eae16-22e9-4d89-a224-6a7900c1676d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:05.389480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-862eae16-22e9-4d89-a224-6a7900c1676d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:05.399128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-862eae16-22e9-4d89-a224-6a7900c1676d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:05.399786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-862eae16-22e9-4d89-a224-6a7900c1676d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:05.400649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-862eae16-22e9-4d89-a224-6a7900c1676d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:05.401091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-862eae16-22e9-4d89-a224-6a7900c1676d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:05.557912 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f3d44f24-e9aa-4eb6-baff-4984d58d6eda tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:05.565828 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f3d44f24-e9aa-4eb6-baff-4984d58d6eda tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652" status: 200 len: 1325 microversion: 2.1 time: 0.266222 May 21 21:16:05.566509 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 766/1519] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:05 2022] GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652 => generated 1325 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:05.581266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-862eae16-22e9-4d89-a224-6a7900c1676d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:05.589432 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-862eae16-22e9-4d89-a224-6a7900c1676d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 200 len: 1315 microversion: 2.1 time: 0.206337 May 21 21:16:05.590100 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 754/1520] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:05 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:05.938772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-68831372-6ce1-4071-a0ab-22d0e7d73fe5 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:05.957949 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-68831372-6ce1-4071-a0ab-22d0e7d73fe5 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.147069 May 21 21:16:05.959029 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 767/1521] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:16:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:05.970855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fdeaa633-0efe-4af4-95f8-de5a149379b5 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:05.990729 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fdeaa633-0efe-4af4-95f8-de5a149379b5 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] 10.222.0.49 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.023890 May 21 21:16:05.991670 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 755/1522] 10.222.0.49 () {58 vars in 1124 bytes} [Sat May 21 21:16:05 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:06.010526 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b36e73f8-c0d4-41be-8e13-3f54366776ba tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:06.025126 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b36e73f8-c0d4-41be-8e13-3f54366776ba tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019118 May 21 21:16:06.026575 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 768/1523] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:16:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:06.040509 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7af0eb30-40b1-4ce8-a87b-7d21bed9e82e tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:06.050639 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7af0eb30-40b1-4ce8-a87b-7d21bed9e82e tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014272 May 21 21:16:06.051826 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 756/1524] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:16:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:06.063499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bc8c1b02-7e64-4e37-9479-28493cff167c tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:06.097727 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bc8c1b02-7e64-4e37-9479-28493cff167c tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.038746 May 21 21:16:06.098850 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 769/1525] 10.222.0.49 () {58 vars in 1164 bytes} [Sat May 21 21:16:06 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:06.112519 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-89d93a61-3851-449b-8c89-d21b141efc50 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:06.138926 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-89d93a61-3851-449b-8c89-d21b141efc50 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015990 May 21 21:16:06.138926 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 757/1526] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:16:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:06.139222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-31c2e99f-f6f4-4812-8873-a9d0a1fd6db0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:06.139222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-31c2e99f-f6f4-4812-8873-a9d0a1fd6db0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:06.146074 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31c2e99f-f6f4-4812-8873-a9d0a1fd6db0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:06.147611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bcfc2a9c-877e-4bc8-8148-59a250924f52 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:06.148698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31c2e99f-f6f4-4812-8873-a9d0a1fd6db0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:06.150582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31c2e99f-f6f4-4812-8873-a9d0a1fd6db0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:06.151421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31c2e99f-f6f4-4812-8873-a9d0a1fd6db0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:06.176036 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bcfc2a9c-877e-4bc8-8148-59a250924f52 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.036390 May 21 21:16:06.177266 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 758/1527] 10.222.0.49 () {58 vars in 1168 bytes} [Sat May 21 21:16:06 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:16:06.192161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-89faf32d-e726-467d-99d0-fe3784630553 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:06.206575 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-89faf32d-e726-467d-99d0-fe3784630553 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.017801 May 21 21:16:06.209249 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 759/1528] 10.222.0.49 () {58 vars in 1160 bytes} [Sat May 21 21:16:06 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:16:06.231030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-164b9562-8354-4e02-98fa-112a77a9e59f tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:06.246054 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-164b9562-8354-4e02-98fa-112a77a9e59f tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024158 May 21 21:16:06.252270 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 760/1529] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:16:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:06.265459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bdead8f8-5b84-4afd-ac10-dd5a954d28f8 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b493d30>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:06.331222 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bdead8f8-5b84-4afd-ac10-dd5a954d28f8 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781" status: 200 len: 1461 microversion: 2.1 time: 0.081016 May 21 21:16:06.336461 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 761/1530] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:06 2022] GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781 => generated 1461 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:06.339633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6332b01d-a706-4e24-9fff-c3f6fc1ff3c9 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:06.380016 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6332b01d-a706-4e24-9fff-c3f6fc1ff3c9 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.046899 May 21 21:16:06.380857 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 762/1531] 10.222.0.49 () {58 vars in 1166 bytes} [Sat May 21 21:16:06 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:06.392698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a39638eb-a38a-4303-92e0-a3bec5860796 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:06.393342 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a39638eb-a38a-4303-92e0-a3bec5860796 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:06.400770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a39638eb-a38a-4303-92e0-a3bec5860796 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:06.404409 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a39638eb-a38a-4303-92e0-a3bec5860796 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:06.404409 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a39638eb-a38a-4303-92e0-a3bec5860796 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:06.404409 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a39638eb-a38a-4303-92e0-a3bec5860796 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:06.467339 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-31c2e99f-f6f4-4812-8873-a9d0a1fd6db0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:06.479403 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-31c2e99f-f6f4-4812-8873-a9d0a1fd6db0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1476 microversion: 2.1 time: 0.357554 May 21 21:16:06.480012 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 770/1532] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:06 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1476 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:16:06.489362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-794cdb0d-0c59-4c12-b28d-33295c49c1d1 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b638ee0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:06.552166 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-794cdb0d-0c59-4c12-b28d-33295c49c1d1 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781" status: 200 len: 1461 microversion: 2.1 time: 0.070798 May 21 21:16:06.553521 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 771/1533] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:06 2022] GET /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781 => generated 1461 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:06.560018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-258ea995-8a53-4727-a6ff-c1c1dbbf9118 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:06.578389 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-258ea995-8a53-4727-a6ff-c1c1dbbf9118 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023062 May 21 21:16:06.578927 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 772/1534] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:16:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:06.592517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4d30530e-33ae-4833-9ffe-7838fc660617 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:06.594046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4d30530e-33ae-4833-9ffe-7838fc660617 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: 55818247-81af-4cf1-bff3-92aeb3f06bba] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:06.603786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d30530e-33ae-4833-9ffe-7838fc660617 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:06.607051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d30530e-33ae-4833-9ffe-7838fc660617 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:06.608441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d30530e-33ae-4833-9ffe-7838fc660617 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:06.609010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d30530e-33ae-4833-9ffe-7838fc660617 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:06.697794 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a39638eb-a38a-4303-92e0-a3bec5860796 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:06.708108 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a39638eb-a38a-4303-92e0-a3bec5860796 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1497 microversion: 2.1 time: 0.321780 May 21 21:16:06.708748 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 763/1535] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:06 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1497 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:06.714395 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0fb7ff75-70c7-4674-8600-7f39f594dc5e tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:06.715867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0fb7ff75-70c7-4674-8600-7f39f594dc5e tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 109fe86b-c8fa-4563-973a-fd343b14f652] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:06.723690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fb7ff75-70c7-4674-8600-7f39f594dc5e tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:06.724149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fb7ff75-70c7-4674-8600-7f39f594dc5e tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:06.725052 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fb7ff75-70c7-4674-8600-7f39f594dc5e tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:06.725555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fb7ff75-70c7-4674-8600-7f39f594dc5e tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:06.845870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4d30530e-33ae-4833-9ffe-7838fc660617 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:06.856766 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4d30530e-33ae-4833-9ffe-7838fc660617 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba" status: 200 len: 1478 microversion: 2.1 time: 0.275628 May 21 21:16:06.858097 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 773/1536] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:06 2022] GET /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba => generated 1478 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:06.863369 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-074ff0a0-3d78-463d-a7bd-8825c780f9a0 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:06.886200 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-074ff0a0-3d78-463d-a7bd-8825c780f9a0 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] 10.222.0.49 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.026723 May 21 21:16:06.887502 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 774/1537] 10.222.0.49 () {58 vars in 1143 bytes} [Sat May 21 21:16:06 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:06.900076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-315bf7bf-ac35-46fa-885b-69f29d9dcab9 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:06.900344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0fb7ff75-70c7-4674-8600-7f39f594dc5e tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:06.901473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-315bf7bf-ac35-46fa-885b-69f29d9dcab9 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:06.909711 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0fb7ff75-70c7-4674-8600-7f39f594dc5e tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652" status: 200 len: 1325 microversion: 2.1 time: 0.199717 May 21 21:16:06.910304 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 764/1538] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:06 2022] GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652 => generated 1325 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:06.911012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-315bf7bf-ac35-46fa-885b-69f29d9dcab9 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:06.912002 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-315bf7bf-ac35-46fa-885b-69f29d9dcab9 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:06.913030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-315bf7bf-ac35-46fa-885b-69f29d9dcab9 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:06.913529 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-315bf7bf-ac35-46fa-885b-69f29d9dcab9 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:06.922831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-770d7a7c-4e17-4f1e-b1ac-b5819c5fe97b tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:06.929732 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-770d7a7c-4e17-4f1e-b1ac-b5819c5fe97b tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016791 May 21 21:16:06.930464 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 765/1539] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:16:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:06.943475 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1a8e79ec-bfa3-4346-9104-1dc9a0de7e83 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:06.960320 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1a8e79ec-bfa3-4346-9104-1dc9a0de7e83 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] 10.222.0.49 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.022715 May 21 21:16:06.963551 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 766/1540] 10.222.0.49 () {58 vars in 1147 bytes} [Sat May 21 21:16:06 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:06.978413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-23e38839-690d-45c8-90a5-383392b8b3c3 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:06.991014 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-23e38839-690d-45c8-90a5-383392b8b3c3 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] 10.222.0.49 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.019617 May 21 21:16:06.991606 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 767/1541] 10.222.0.49 () {58 vars in 1139 bytes} [Sat May 21 21:16:06 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:07.002881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6cafa85f-341e-4db5-84e7-530d33fe5c4c tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:07.014594 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6cafa85f-341e-4db5-84e7-530d33fe5c4c tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015320 May 21 21:16:07.014961 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 768/1542] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:16:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:16:07.031648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-43244c9e-609a-4f2b-a69e-574d9802dfc4 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:07.055958 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-43244c9e-609a-4f2b-a69e-574d9802dfc4 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] 10.222.0.49 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.033857 May 21 21:16:07.056445 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 769/1543] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:16:07 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:07.069433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-38022c82-7263-4fc8-8729-9d3bc757dd93 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:07.094999 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-38022c82-7263-4fc8-8729-9d3bc757dd93 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029101 May 21 21:16:07.096134 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 770/1544] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:16:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:07.111238 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f0e29903-3d08-48d8-bfd8-56b16a169b38 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:07.119910 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f0e29903-3d08-48d8-bfd8-56b16a169b38 tempest-FlavorsV2TestJSON-771964783 tempest-FlavorsV2TestJSON-771964783-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012623 May 21 21:16:07.120861 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 771/1545] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:16:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:07.209345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-315bf7bf-ac35-46fa-885b-69f29d9dcab9 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:07.220039 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-315bf7bf-ac35-46fa-885b-69f29d9dcab9 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 200 len: 1315 microversion: 2.1 time: 0.331500 May 21 21:16:07.220992 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 775/1546] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:06 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:07.395459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-c4ac9c7f-e9b9-4286-b263-c0eeee2f8975 req-6eba3c3f-d9ce-46cd-9b8b-ff92c4e117cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd8944e0-b77d-4aa0-8d85-b98814346aed", "tag": "950b352f-54b2-4352-a24b-093df72e9046"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:07.404467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c4ac9c7f-e9b9-4286-b263-c0eeee2f8975 req-6eba3c3f-d9ce-46cd-9b8b-ff92c4e117cf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:07.404914 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c4ac9c7f-e9b9-4286-b263-c0eeee2f8975 req-6eba3c3f-d9ce-46cd-9b8b-ff92c4e117cf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:07.420996 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-c4ac9c7f-e9b9-4286-b263-c0eeee2f8975 req-6eba3c3f-d9ce-46cd-9b8b-ff92c4e117cf service nova] Creating event network-changed:950b352f-54b2-4352-a24b-093df72e9046 for instance bd8944e0-b77d-4aa0-8d85-b98814346aed on nch1-master-1 May 21 21:16:07.427705 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-c4ac9c7f-e9b9-4286-b263-c0eeee2f8975 req-6eba3c3f-d9ce-46cd-9b8b-ff92c4e117cf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036032 May 21 21:16:07.428370 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 772/1547] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:16:07.496819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-962b794c-41ef-4e8a-a70b-9340f0b90244 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:07.497450 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-962b794c-41ef-4e8a-a70b-9340f0b90244 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:07.503658 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-962b794c-41ef-4e8a-a70b-9340f0b90244 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:07.504120 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-962b794c-41ef-4e8a-a70b-9340f0b90244 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:07.504933 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-962b794c-41ef-4e8a-a70b-9340f0b90244 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:07.505380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-962b794c-41ef-4e8a-a70b-9340f0b90244 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:07.726539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7ef2cdfa-5def-4b8c-99b7-2832fe304d8b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:07.728414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7ef2cdfa-5def-4b8c-99b7-2832fe304d8b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:07.737525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7ef2cdfa-5def-4b8c-99b7-2832fe304d8b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:07.738693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7ef2cdfa-5def-4b8c-99b7-2832fe304d8b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:07.739903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7ef2cdfa-5def-4b8c-99b7-2832fe304d8b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:07.740387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7ef2cdfa-5def-4b8c-99b7-2832fe304d8b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:07.782133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-962b794c-41ef-4e8a-a70b-9340f0b90244 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:07.797337 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-962b794c-41ef-4e8a-a70b-9340f0b90244 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1476 microversion: 2.1 time: 0.304582 May 21 21:16:07.808258 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 776/1548] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:07 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1476 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:07.874471 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2f1e291d-f24b-4f79-8024-1c8c5cbda4c0 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:07.875094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2f1e291d-f24b-4f79-8024-1c8c5cbda4c0 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: 55818247-81af-4cf1-bff3-92aeb3f06bba] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:07.881564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f1e291d-f24b-4f79-8024-1c8c5cbda4c0 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:07.882020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f1e291d-f24b-4f79-8024-1c8c5cbda4c0 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:07.882808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f1e291d-f24b-4f79-8024-1c8c5cbda4c0 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:07.883281 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f1e291d-f24b-4f79-8024-1c8c5cbda4c0 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:07.966818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7ef2cdfa-5def-4b8c-99b7-2832fe304d8b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:07.975332 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7ef2cdfa-5def-4b8c-99b7-2832fe304d8b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1497 microversion: 2.1 time: 0.252927 May 21 21:16:07.985805 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 773/1549] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:07 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1497 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:16:07.991297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7b571d74-3890-4ce7-bbdd-80456e78e050 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:07.991929 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7b571d74-3890-4ce7-bbdd-80456e78e050 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 109fe86b-c8fa-4563-973a-fd343b14f652] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:07.999167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7b571d74-3890-4ce7-bbdd-80456e78e050 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:07.999626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7b571d74-3890-4ce7-bbdd-80456e78e050 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:08.004011 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7b571d74-3890-4ce7-bbdd-80456e78e050 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:08.004011 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7b571d74-3890-4ce7-bbdd-80456e78e050 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:08.159586 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2f1e291d-f24b-4f79-8024-1c8c5cbda4c0 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:08.174525 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2f1e291d-f24b-4f79-8024-1c8c5cbda4c0 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba" status: 200 len: 1465 microversion: 2.1 time: 0.303735 May 21 21:16:08.177880 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 777/1550] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:07 2022] GET /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba => generated 1465 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:16:08.191663 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-472c3061-df1f-4f09-a67d-b3429ee53646 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b568ee0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:08.254681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7b571d74-3890-4ce7-bbdd-80456e78e050 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:08.266632 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7b571d74-3890-4ce7-bbdd-80456e78e050 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652" status: 200 len: 1325 microversion: 2.1 time: 0.279327 May 21 21:16:08.281810 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 774/1551] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:07 2022] GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652 => generated 1325 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:08.287105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e33588c1-b297-49f6-a44c-9a400b37c4c3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:08.287722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e33588c1-b297-49f6-a44c-9a400b37c4c3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:08.298210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e33588c1-b297-49f6-a44c-9a400b37c4c3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:08.299013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e33588c1-b297-49f6-a44c-9a400b37c4c3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:08.299966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e33588c1-b297-49f6-a44c-9a400b37c4c3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:08.301343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e33588c1-b297-49f6-a44c-9a400b37c4c3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:08.301475 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-472c3061-df1f-4f09-a67d-b3429ee53646 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images?changes-since=2022-05-21T21%3A14%3A17Z" status: 200 len: 1902 microversion: 2.1 time: 0.113479 May 21 21:16:08.310027 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 778/1552] 10.222.0.49 () {58 vars in 1198 bytes} [Sat May 21 21:16:08 2022] GET /compute/v2.1/images?changes-since=2022-05-21T21%3A14%3A17Z => generated 1902 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:08.316719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-afbc5aed-e43e-4703-984a-444d544af66d tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b457940>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:08.428269 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-afbc5aed-e43e-4703-984a-444d544af66d tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-279796775" status: 200 len: 484 microversion: 2.1 time: 0.104517 May 21 21:16:08.428269 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 779/1553] 10.222.0.49 () {58 vars in 1228 bytes} [Sat May 21 21:16:08 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-279796775 => generated 484 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:16:08.434342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9a8e474c-636c-4205-ab2d-b45be9b5283b tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b568c10>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:08.502461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e33588c1-b297-49f6-a44c-9a400b37c4c3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:08.512746 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e33588c1-b297-49f6-a44c-9a400b37c4c3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 200 len: 1315 microversion: 2.1 time: 0.229650 May 21 21:16:08.514255 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 775/1554] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:08 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:08.560470 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9a8e474c-636c-4205-ab2d-b45be9b5283b tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images?server=55818247-81af-4cf1-bff3-92aeb3f06bba" status: 200 len: 957 microversion: 2.1 time: 0.130898 May 21 21:16:08.563034 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 780/1555] 10.222.0.49 () {58 vars in 1208 bytes} [Sat May 21 21:16:08 2022] GET /compute/v2.1/images?server=55818247-81af-4cf1-bff3-92aeb3f06bba => generated 957 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:08.578394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8158f706-5146-4ebc-a1d2-c2bbcb29651c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc82d125940>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:08.630187 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8158f706-5146-4ebc-a1d2-c2bbcb29651c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fv2.1%2Fservers%2Ff0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 485 microversion: 2.1 time: 0.060169 May 21 21:16:08.630755 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 776/1556] 10.222.0.49 () {58 vars in 1316 bytes} [Sat May 21 21:16:08 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fv2.1%2Fservers%2Ff0525194-b3aa-482c-a355-c77c63bf4c88 => generated 485 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:08.645526 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-94735b6f-e865-496e-b542-abc585f408b9 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b4579d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:08.704725 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-94735b6f-e865-496e-b542-abc585f408b9 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fservers%2Ff0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 485 microversion: 2.1 time: 0.067009 May 21 21:16:08.705329 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 781/1557] 10.222.0.49 () {58 vars in 1302 bytes} [Sat May 21 21:16:08 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fservers%2Ff0525194-b3aa-482c-a355-c77c63bf4c88 => generated 485 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:08.718931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-412d9db3-f2bc-42c1-9a12-87e27579c2ab tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b4519d0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:08.816481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d3bb4387-9df9-4196-9947-d18ac5d92865 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:08.817114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d3bb4387-9df9-4196-9947-d18ac5d92865 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:08.825744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3bb4387-9df9-4196-9947-d18ac5d92865 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:08.826354 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3bb4387-9df9-4196-9947-d18ac5d92865 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:08.827170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3bb4387-9df9-4196-9947-d18ac5d92865 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:08.827619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3bb4387-9df9-4196-9947-d18ac5d92865 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:08.849689 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-412d9db3-f2bc-42c1-9a12-87e27579c2ab tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.134434 May 21 21:16:08.850433 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 777/1558] 10.222.0.49 () {58 vars in 1148 bytes} [Sat May 21 21:16:08 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:08.856226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-98216994-fc1d-468e-8342-a77678294e30 req-4438b780-adf5-46d4-8e11-04313445306f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109fe86b-c8fa-4563-973a-fd343b14f652", "name": "network-vif-plugged", "status": "completed", "tag": "c303e0ea-3273-47b1-b21a-adfbfbd582b4"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:08.864846 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-98216994-fc1d-468e-8342-a77678294e30 req-4438b780-adf5-46d4-8e11-04313445306f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:08.865298 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-98216994-fc1d-468e-8342-a77678294e30 req-4438b780-adf5-46d4-8e11-04313445306f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:08.876712 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-98216994-fc1d-468e-8342-a77678294e30 req-4438b780-adf5-46d4-8e11-04313445306f service nova] Creating event network-vif-plugged:c303e0ea-3273-47b1-b21a-adfbfbd582b4 for instance 109fe86b-c8fa-4563-973a-fd343b14f652 on nch1-master-1 May 21 21:16:08.881616 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-98216994-fc1d-468e-8342-a77678294e30 req-4438b780-adf5-46d4-8e11-04313445306f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030220 May 21 21:16:08.882237 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 778/1559] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:08.887623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5011f6dc-96d8-44fe-afa2-d3a19f2b039c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b3ac310>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:08.960124 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5011f6dc-96d8-44fe-afa2-d3a19f2b039c tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.075897 May 21 21:16:08.970004 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 779/1560] 10.222.0.49 () {58 vars in 1148 bytes} [Sat May 21 21:16:08 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:08.976753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6e19a325-1dc6-4cef-8a63-617289472581 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b3ac280>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:09.010970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d3bb4387-9df9-4196-9947-d18ac5d92865 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:09.023182 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d3bb4387-9df9-4196-9947-d18ac5d92865 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1476 microversion: 2.1 time: 0.211584 May 21 21:16:09.025797 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 782/1561] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:08 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1476 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:16:09.031223 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-32b36cbd-1896-4866-a8d4-83f52241639e tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:09.034401 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-32b36cbd-1896-4866-a8d4-83f52241639e tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:09.040669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32b36cbd-1896-4866-a8d4-83f52241639e tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:09.041440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32b36cbd-1896-4866-a8d4-83f52241639e tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:09.043074 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32b36cbd-1896-4866-a8d4-83f52241639e tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:09.044511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32b36cbd-1896-4866-a8d4-83f52241639e tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:09.076680 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6e19a325-1dc6-4cef-8a63-617289472581 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.103895 May 21 21:16:09.077700 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 780/1562] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:16:08 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:09.098945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2265ac21-93f9-4fbf-9317-2040ec013b0e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b4518b0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:09.147051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=16 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:09.188308 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2265ac21-93f9-4fbf-9317-2040ec013b0e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/detail?changes-since=2022-05-21T21%3A14%3A10Z" status: 200 len: 6327 microversion: 2.1 time: 0.098743 May 21 21:16:09.190946 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 781/1563] 10.222.0.49 () {58 vars in 1219 bytes} [Sat May 21 21:16:09 2022] GET /compute/v2.1/images/detail?changes-since=2022-05-21T21%3A14%3A10Z => generated 6327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:16:09.204877 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-236aa316-b291-479e-851c-fa872411caca tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc82d125820>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:09.212672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-32b36cbd-1896-4866-a8d4-83f52241639e tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:09.221354 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-32b36cbd-1896-4866-a8d4-83f52241639e tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1497 microversion: 2.1 time: 0.193804 May 21 21:16:09.228493 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 783/1564] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:09 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:09.259191 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-236aa316-b291-479e-851c-fa872411caca tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-279796775" status: 200 len: 664 microversion: 2.1 time: 0.058179 May 21 21:16:09.259780 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 782/1565] 10.222.0.49 () {58 vars in 1249 bytes} [Sat May 21 21:16:09 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-279796775 => generated 664 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:16:09.273225 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ddbf29bb-f3f4-4ca5-84ac-eb4722506d19 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b533280>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:09.288045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f9791e58-f1ae-4858-8425-5e39d7e6f583 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:09.288826 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f9791e58-f1ae-4858-8425-5e39d7e6f583 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 109fe86b-c8fa-4563-973a-fd343b14f652] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:09.296474 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f9791e58-f1ae-4858-8425-5e39d7e6f583 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:09.297193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f9791e58-f1ae-4858-8425-5e39d7e6f583 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:09.298163 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f9791e58-f1ae-4858-8425-5e39d7e6f583 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:09.298748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f9791e58-f1ae-4858-8425-5e39d7e6f583 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:09.303566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:09.332712 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ddbf29bb-f3f4-4ca5-84ac-eb4722506d19 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fv2.1%2Fservers%2Ff0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 1465 microversion: 2.1 time: 0.063098 May 21 21:16:09.335920 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 784/1566] 10.222.0.49 () {58 vars in 1337 bytes} [Sat May 21 21:16:09 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fv2.1%2Fservers%2Ff0525194-b3aa-482c-a355-c77c63bf4c88 => generated 1465 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:09.347016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f5ee925c-2899-4ad9-8492-bf8f5d3e265b tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b64f160>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:09.404065 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f5ee925c-2899-4ad9-8492-bf8f5d3e265b tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fservers%2Ff0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 1465 microversion: 2.1 time: 0.061321 May 21 21:16:09.404846 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 785/1567] 10.222.0.49 () {58 vars in 1323 bytes} [Sat May 21 21:16:09 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fservers%2Ff0525194-b3aa-482c-a355-c77c63bf4c88 => generated 1465 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:16:09.421905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4811640a-6264-4918-b8da-0799148c1b74 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b64f9d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:09.481327 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f9791e58-f1ae-4858-8425-5e39d7e6f583 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:09.490385 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f9791e58-f1ae-4858-8425-5e39d7e6f583 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652" status: 200 len: 1325 microversion: 2.1 time: 0.206140 May 21 21:16:09.491221 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 783/1568] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:09 2022] GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652 => generated 1325 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:09.530611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d3424188-93a8-460b-9970-400c3cef6c36 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:09.532460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d3424188-93a8-460b-9970-400c3cef6c36 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:09.540701 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4811640a-6264-4918-b8da-0799148c1b74 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7102 microversion: 2.1 time: 0.121994 May 21 21:16:09.541399 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 786/1569] 10.222.0.49 () {58 vars in 1169 bytes} [Sat May 21 21:16:09 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7102 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:09.547054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3424188-93a8-460b-9970-400c3cef6c36 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:09.547577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3424188-93a8-460b-9970-400c3cef6c36 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:09.548423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3424188-93a8-460b-9970-400c3cef6c36 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:09.548872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3424188-93a8-460b-9970-400c3cef6c36 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:09.561140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4a5387de-ff71-4c1b-ad12-036eaea72d2b tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b65caf0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:09.636949 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4a5387de-ff71-4c1b-ad12-036eaea72d2b tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.082539 May 21 21:16:09.637537 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 787/1570] 10.222.0.49 () {58 vars in 1169 bytes} [Sat May 21 21:16:09 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:09.655608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-18c0d57a-4866-4eeb-9d41-feb6d2d1d82e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b555820>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:09.719803 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-18c0d57a-4866-4eeb-9d41-feb6d2d1d82e tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c" status: 200 len: 784 microversion: 2.1 time: 0.071943 May 21 21:16:09.720774 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 788/1571] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:09 2022] GET /compute/v2.1/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c => generated 784 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:09.739311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b875dea5-11ed-4e7e-aa55-2ce39ccc6cc8 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b675af0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:09.744356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d3424188-93a8-460b-9970-400c3cef6c36 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:09.755134 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d3424188-93a8-460b-9970-400c3cef6c36 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 200 len: 1315 microversion: 2.1 time: 0.228434 May 21 21:16:09.755841 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 784/1572] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:09 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:16:09.835372 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b875dea5-11ed-4e7e-aa55-2ce39ccc6cc8 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.102290 May 21 21:16:09.836818 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 789/1573] 10.222.0.49 () {58 vars in 1157 bytes} [Sat May 21 21:16:09 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:09.851272 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a37dd162-f3f4-4da8-8d60-cb59efc5d1d8 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b4511f0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:09.860252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:09.861131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=12 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:10.051640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-db5b47f4-519e-482a-972f-7648bbb735f5 tempest-ListImagesTestJSON-1084127097 tempest-ListImagesTestJSON-1084127097-project] Calling method '.version_select at 0x7fc81b4579d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:10.095607 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-db5b47f4-519e-482a-972f-7648bbb735f5 tempest-ListImagesTestJSON-1084127097 tempest-ListImagesTestJSON-1084127097-project] 10.222.0.49 "GET /compute/v2.1/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c" status: 200 len: 784 microversion: 2.1 time: 0.178766 May 21 21:16:10.096300 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 790/1574] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:09 2022] GET /compute/v2.1/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c => generated 784 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:16:10.101256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1f3d9778-d1be-42c3-8bb5-c7d698dee5ba tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:10.101745 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1f3d9778-d1be-42c3-8bb5-c7d698dee5ba tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:10.109026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f3d9778-d1be-42c3-8bb5-c7d698dee5ba tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:10.109620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f3d9778-d1be-42c3-8bb5-c7d698dee5ba tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:10.110473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f3d9778-d1be-42c3-8bb5-c7d698dee5ba tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:10.110982 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f3d9778-d1be-42c3-8bb5-c7d698dee5ba tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:10.262654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1f3d9778-d1be-42c3-8bb5-c7d698dee5ba tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:10.271001 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1f3d9778-d1be-42c3-8bb5-c7d698dee5ba tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1476 microversion: 2.1 time: 0.173662 May 21 21:16:10.271572 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 791/1575] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:10 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1476 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:10.277118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-efc2484c-50d5-4d4d-a22c-30948e45e852 tempest-ListImagesTestJSON-1084127097 tempest-ListImagesTestJSON-1084127097-project] Calling method '.version_select at 0x7fc81b64f820>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:10.357118 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-efc2484c-50d5-4d4d-a22c-30948e45e852 tempest-ListImagesTestJSON-1084127097 tempest-ListImagesTestJSON-1084127097-project] 10.222.0.49 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.084517 May 21 21:16:10.357782 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 792/1576] 10.222.0.49 () {58 vars in 1121 bytes} [Sat May 21 21:16:10 2022] GET /compute/v2.1/images => generated 445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:10.364541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ac410447-fb28-4f25-a658-c98be93c580f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:10.364541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ac410447-fb28-4f25-a658-c98be93c580f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:10.370982 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ac410447-fb28-4f25-a658-c98be93c580f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:10.371445 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ac410447-fb28-4f25-a658-c98be93c580f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:10.372244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ac410447-fb28-4f25-a658-c98be93c580f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:10.372722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ac410447-fb28-4f25-a658-c98be93c580f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:10.521844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ac410447-fb28-4f25-a658-c98be93c580f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:10.530089 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ac410447-fb28-4f25-a658-c98be93c580f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1497 microversion: 2.1 time: 0.171334 May 21 21:16:10.530660 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 793/1577] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:10 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:10.535722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ba44ea0b-1ac6-4a8f-857b-67677eed758b tempest-ListImagesTestJSON-1084127097 tempest-ListImagesTestJSON-1084127097-project] Calling method '.version_select at 0x7fc81b675430>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:10.585088 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ba44ea0b-1ac6-4a8f-857b-67677eed758b tempest-ListImagesTestJSON-1084127097 tempest-ListImagesTestJSON-1084127097-project] 10.222.0.49 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.053203 May 21 21:16:10.585669 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 794/1578] 10.222.0.49 () {58 vars in 1142 bytes} [Sat May 21 21:16:10 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:10.600797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a67fc2ae-7822-4077-967f-9c372ccb5a66 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:10.600797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a67fc2ae-7822-4077-967f-9c372ccb5a66 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 109fe86b-c8fa-4563-973a-fd343b14f652] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:10.606058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a67fc2ae-7822-4077-967f-9c372ccb5a66 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:10.606513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a67fc2ae-7822-4077-967f-9c372ccb5a66 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:10.607311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a67fc2ae-7822-4077-967f-9c372ccb5a66 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:10.607734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a67fc2ae-7822-4077-967f-9c372ccb5a66 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:10.768132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a67fc2ae-7822-4077-967f-9c372ccb5a66 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:10.776790 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a67fc2ae-7822-4077-967f-9c372ccb5a66 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652" status: 200 len: 1325 microversion: 2.1 time: 0.182272 May 21 21:16:10.777354 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 795/1579] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:10 2022] GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652 => generated 1325 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:10.782647 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5b14c9e9-b476-4c24-8cd4-9b89f2c2085e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:10.783783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5b14c9e9-b476-4c24-8cd4-9b89f2c2085e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:10.799018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b14c9e9-b476-4c24-8cd4-9b89f2c2085e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:10.799018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b14c9e9-b476-4c24-8cd4-9b89f2c2085e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:10.799018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b14c9e9-b476-4c24-8cd4-9b89f2c2085e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:10.799018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b14c9e9-b476-4c24-8cd4-9b89f2c2085e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:10.948264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5b14c9e9-b476-4c24-8cd4-9b89f2c2085e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:10.956995 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5b14c9e9-b476-4c24-8cd4-9b89f2c2085e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 200 len: 1315 microversion: 2.1 time: 0.178654 May 21 21:16:10.957575 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 796/1580] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:10 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:11.491854 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a37dd162-f3f4-4da8-8d60-cb59efc5d1d8 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "DELETE /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781" status: 204 len: 0 microversion: 2.1 time: 1.644643 May 21 21:16:11.494405 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 785/1581] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:09 2022] DELETE /compute/v2.1/images/0458b5fe-ac22-40ba-b558-54d5805fe781 => generated 0 bytes in 1648 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:16:11.503026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-70f5b3d7-244f-48e6-a5db-157daec6206a tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b497430>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:11.520964 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-13cd76b3-aaa9-4a59-843a-74dcf59ca303 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:11.525656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-13cd76b3-aaa9-4a59-843a-74dcf59ca303 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:11.533663 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-13cd76b3-aaa9-4a59-843a-74dcf59ca303 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:11.534782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-13cd76b3-aaa9-4a59-843a-74dcf59ca303 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:11.535862 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-13cd76b3-aaa9-4a59-843a-74dcf59ca303 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:11.536347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-13cd76b3-aaa9-4a59-843a-74dcf59ca303 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:11.551974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:11.594125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:11.715614 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-13cd76b3-aaa9-4a59-843a-74dcf59ca303 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:11.723748 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-13cd76b3-aaa9-4a59-843a-74dcf59ca303 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1476 microversion: 2.1 time: 0.437616 May 21 21:16:11.724332 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 797/1582] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:11 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1476 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:11.729871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bf855b39-c1af-4f05-a9c6-61a98b5670c3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:11.730482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bf855b39-c1af-4f05-a9c6-61a98b5670c3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:11.736558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bf855b39-c1af-4f05-a9c6-61a98b5670c3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:11.737020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bf855b39-c1af-4f05-a9c6-61a98b5670c3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:11.737793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bf855b39-c1af-4f05-a9c6-61a98b5670c3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:11.738234 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bf855b39-c1af-4f05-a9c6-61a98b5670c3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:11.910170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bf855b39-c1af-4f05-a9c6-61a98b5670c3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:11.916910 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bf855b39-c1af-4f05-a9c6-61a98b5670c3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1497 microversion: 2.1 time: 0.191415 May 21 21:16:11.917491 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 798/1583] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:11 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:11.922210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c3882ebf-ef04-475d-a079-382948ec04bc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:11.922809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c3882ebf-ef04-475d-a079-382948ec04bc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 109fe86b-c8fa-4563-973a-fd343b14f652] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:11.929627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c3882ebf-ef04-475d-a079-382948ec04bc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:11.932888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c3882ebf-ef04-475d-a079-382948ec04bc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:11.932888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c3882ebf-ef04-475d-a079-382948ec04bc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:11.932888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c3882ebf-ef04-475d-a079-382948ec04bc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:12.083288 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c3882ebf-ef04-475d-a079-382948ec04bc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:12.096686 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c3882ebf-ef04-475d-a079-382948ec04bc tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652" status: 200 len: 1522 microversion: 2.1 time: 0.177514 May 21 21:16:12.097485 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 799/1584] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:11 2022] GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:12.104838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b43b4765-fca3-4aaf-9c88-c3e4fd8185a1 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:12.105455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b43b4765-fca3-4aaf-9c88-c3e4fd8185a1 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:12.111704 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b43b4765-fca3-4aaf-9c88-c3e4fd8185a1 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:12.112162 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b43b4765-fca3-4aaf-9c88-c3e4fd8185a1 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:12.112970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b43b4765-fca3-4aaf-9c88-c3e4fd8185a1 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:12.113413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b43b4765-fca3-4aaf-9c88-c3e4fd8185a1 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:12.271021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b43b4765-fca3-4aaf-9c88-c3e4fd8185a1 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:12.281363 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b43b4765-fca3-4aaf-9c88-c3e4fd8185a1 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 200 len: 1315 microversion: 2.1 time: 0.182059 May 21 21:16:12.282404 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 800/1585] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:12 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:12.287475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-7261c783-650a-48bf-bbec-6a01d607f60c req-933cb020-81b0-471c-bed6-e335fd2ab2b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55818247-81af-4cf1-bff3-92aeb3f06bba", "name": "network-vif-unplugged", "status": "completed", "tag": "d78ce8f3-1b0e-4e09-b2ee-8d7b3fe8530e"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:12.296906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7261c783-650a-48bf-bbec-6a01d607f60c req-933cb020-81b0-471c-bed6-e335fd2ab2b5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:12.297353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7261c783-650a-48bf-bbec-6a01d607f60c req-933cb020-81b0-471c-bed6-e335fd2ab2b5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:12.308679 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-7261c783-650a-48bf-bbec-6a01d607f60c req-933cb020-81b0-471c-bed6-e335fd2ab2b5 service nova] Creating event network-vif-unplugged:d78ce8f3-1b0e-4e09-b2ee-8d7b3fe8530e for instance 55818247-81af-4cf1-bff3-92aeb3f06bba on nch2-master-1 May 21 21:16:12.314657 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-7261c783-650a-48bf-bbec-6a01d607f60c req-933cb020-81b0-471c-bed6-e335fd2ab2b5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031043 May 21 21:16:12.315270 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 801/1586] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:12.321252 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-80e2ac49-37b9-4b05-93ff-c862132ff96b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:12.321879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-80e2ac49-37b9-4b05-93ff-c862132ff96b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 109fe86b-c8fa-4563-973a-fd343b14f652] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:12.328266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80e2ac49-37b9-4b05-93ff-c862132ff96b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:12.328770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80e2ac49-37b9-4b05-93ff-c862132ff96b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:12.329555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80e2ac49-37b9-4b05-93ff-c862132ff96b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:12.329997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80e2ac49-37b9-4b05-93ff-c862132ff96b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:12.364385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-80e2ac49-37b9-4b05-93ff-c862132ff96b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 109fe86b-c8fa-4563-973a-fd343b14f652] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:16:12.691877 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-80e2ac49-37b9-4b05-93ff-c862132ff96b tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "DELETE /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652" status: 204 len: 0 microversion: 2.1 time: 0.375198 May 21 21:16:12.692684 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 802/1587] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:16:12 2022] DELETE /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:16:12.702932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f2162ca1-ebcb-449a-92ca-ec33096a5a06 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:12.703676 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f2162ca1-ebcb-449a-92ca-ec33096a5a06 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 109fe86b-c8fa-4563-973a-fd343b14f652] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:12.710705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2162ca1-ebcb-449a-92ca-ec33096a5a06 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:12.715621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2162ca1-ebcb-449a-92ca-ec33096a5a06 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:12.715621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2162ca1-ebcb-449a-92ca-ec33096a5a06 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:12.715621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2162ca1-ebcb-449a-92ca-ec33096a5a06 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:12.891334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f2162ca1-ebcb-449a-92ca-ec33096a5a06 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:12.906441 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f2162ca1-ebcb-449a-92ca-ec33096a5a06 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652" status: 200 len: 1528 microversion: 2.1 time: 0.202116 May 21 21:16:12.906441 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 803/1588] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:12 2022] GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652 => generated 1528 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:12.906696 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b2b59a64-a0ab-40f3-b7b0-59b43591adf8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:12.907203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b2b59a64-a0ab-40f3-b7b0-59b43591adf8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:12.920230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2b59a64-a0ab-40f3-b7b0-59b43591adf8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:12.920718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2b59a64-a0ab-40f3-b7b0-59b43591adf8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:12.921495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2b59a64-a0ab-40f3-b7b0-59b43591adf8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:12.922180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2b59a64-a0ab-40f3-b7b0-59b43591adf8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:13.087401 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b2b59a64-a0ab-40f3-b7b0-59b43591adf8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:13.095029 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b2b59a64-a0ab-40f3-b7b0-59b43591adf8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1476 microversion: 2.1 time: 0.192827 May 21 21:16:13.095609 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 804/1589] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:12 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1476 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:13.101021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9f44811b-b542-47f3-b527-df2e20a00b8f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:13.101630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9f44811b-b542-47f3-b527-df2e20a00b8f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:13.108382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f44811b-b542-47f3-b527-df2e20a00b8f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:13.108832 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f44811b-b542-47f3-b527-df2e20a00b8f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:13.109597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f44811b-b542-47f3-b527-df2e20a00b8f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:13.110038 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f44811b-b542-47f3-b527-df2e20a00b8f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:13.243537 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-70f5b3d7-244f-48e6-a5db-157daec6206a tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "DELETE /compute/v2.1/images/2f5eec8a-f8ee-48fa-a9cf-d9572da37393" status: 204 len: 0 microversion: 2.1 time: 1.743967 May 21 21:16:13.244543 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 786/1590] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:11 2022] DELETE /compute/v2.1/images/2f5eec8a-f8ee-48fa-a9cf-d9572da37393 => generated 0 bytes in 1747 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 21:16:13.271160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9f44811b-b542-47f3-b527-df2e20a00b8f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:13.280421 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9f44811b-b542-47f3-b527-df2e20a00b8f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1497 microversion: 2.1 time: 0.182937 May 21 21:16:13.281024 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 805/1591] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:13 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:13.285940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d32260dd-d5de-4936-8b9a-982a36f831f9 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b5554c0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:13.379203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f2fac548-d4b4-44fc-a76f-4493a8cf90d8 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Action: 'create', calling method: .version_select at 0x7fc81b451d30>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5/ttuB6tCPBkEVUsfxz/qY20w5qR7jlXL1LtyjReV5YiJNHCRZ2i2qB7tPr6+smfEytFEGma6oXrxrbFF8Dx1Z0W8GWSreJvVZ49XidrMbg7Mdgnfp6P3ItSIiCOSIow=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:13.384445 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-f2fac548-d4b4-44fc-a76f-4493a8cf90d8 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters May 21 21:16:13.392832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f2fac548-d4b4-44fc-a76f-4493a8cf90d8 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Request method failure captured: May 21 21:16:13.392832 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 21 21:16:13.392832 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:16:13.392832 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:16:13.392832 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:16:13.392832 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 257 May 21 21:16:13.392832 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:16:13.392832 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:16:13.392832 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:16:13.392832 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:16:13.392832 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVada4J65u3xYfvf9-HurstFeK4dkQWukkSGyI-EgJB7bCEKZEoEzjNcnC2wa6hPSvgoDEh4p9pReL5WTF6AzbrSSvaGjnDRhz5e5QkifVvu5p09a45T9Ybqz_OBBZBJs0Y2QSZRGQTPRspd5pBARXzp8rcnTcaTvHzq0cgvcO_oMG4 May 21 21:16:13.392832 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:16:13.392832 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:16:13.392832 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:16:13.392832 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:16:13.392832 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:16:13.392832 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:16:13.392832 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 62c5e3ebeb6740f89f3257b965ca8c0e May 21 21:16:13.392832 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:13.392832 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:16:13.392832 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:16:13.394357 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_62c5e3ebeb6740f89f3257b965ca8c0e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:13.394357 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:13.394357 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 62c5e3ebeb6740f89f3257b965ca8c0e May 21 21:16:13.394357 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:13.394357 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-KeyPairsNegativeTestJSON-1477469549-project May 21 21:16:13.394357 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:16:13.394357 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:16:13.394357 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 92c1083d5ffb404f8102a81ca164a16e May 21 21:16:13.394357 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1477469549-project May 21 21:16:13.394357 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:16:13.394357 ncdv-master-1 devstack@n-api.service[131278]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5/ttuB6tCPBkEVUsfxz/qY20w5qR7jlXL1LtyjReV5YiJNHCRZ2i2qB7tPr6+smfEytFEGma6oXrxrbFF8Dx1Z0W8GWSreJvVZ49XidrMbg7Mdgnfp6P3ItSIiCOSIow=="}} May 21 21:16:13.394357 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:16:13.395168 ncdv-master-1 devstack@n-api.service[131278]: exception: Keypair data is invalid: Keypair name contains unsafe characters May 21 21:16:13.395168 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5/ttuB6tCPBkEVUsfxz/qY20w5qR7jlXL1LtyjReV5YiJNHCRZ2i2qB7tPr6+smfEytFEGma6oXrxrbFF8Dx1Z0W8GWSreJvVZ49XidrMbg7Mdgnfp6P3ItSIiCOSIow=='}}} May 21 21:16:13.395168 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:13.395168 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:13.395168 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 21 21:16:13.395168 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 21 21:16:13.395168 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 21 21:16:13.395168 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 21 21:16:13.395168 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:16:13.395168 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:16:13.395168 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:16:13.395168 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:16:13.395168 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 21 21:16:13.395168 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 21 21:16:13.395168 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair May 21 21:16:13.395168 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) May 21 21:16:13.395168 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair May 21 21:16:13.395168 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 21 21:16:13.396467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters May 21 21:16:13.396467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:13.396467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:13.396467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:13.396467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:13.396467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:13.396467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:13.396467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:13.396467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:13.396467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:13.396467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:13.396467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:13.396467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:13.396467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:16:13.396467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:16:13.396467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:16:13.396467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:16:13.396467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 21 21:16:13.396467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 21 21:16:13.396467 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 21 21:16:13.401110 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 21 21:16:13.401110 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters May 21 21:16:13.401110 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:13.401110 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:13.401110 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:13.401110 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:13.401110 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:13.401110 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:13.401110 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:13.401110 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:13.401110 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters May 21 21:16:13.401110 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:13.401110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f2fac548-d4b4-44fc-a76f-4493a8cf90d8 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:13.401110 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f2fac548-d4b4-44fc-a76f-4493a8cf90d8 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.148807 May 21 21:16:13.403758 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 787/1592] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:16:13 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:16:13.403758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-491b4449-233e-47ca-960e-8c03441a8cd5 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:13.403758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-491b4449-233e-47ca-960e-8c03441a8cd5 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:13.412347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-491b4449-233e-47ca-960e-8c03441a8cd5 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:13.412347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-491b4449-233e-47ca-960e-8c03441a8cd5 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:13.412347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-491b4449-233e-47ca-960e-8c03441a8cd5 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:13.412347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-491b4449-233e-47ca-960e-8c03441a8cd5 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:13.571472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-491b4449-233e-47ca-960e-8c03441a8cd5 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:13.579386 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-491b4449-233e-47ca-960e-8c03441a8cd5 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 200 len: 1315 microversion: 2.1 time: 0.183474 May 21 21:16:13.579949 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 788/1593] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:13 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:13.585556 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e10cfe37-958b-446c-aa59-f917a881d4b4 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Action: 'create', calling method: .version_select at 0x7fc81b451550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-289597894", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:13.600685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-e10cfe37-958b-446c-aa59-f917a881d4b4 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Getting quotas for project 62c5e3ebeb6740f89f3257b965ca8c0e. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:16:13.605634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-e10cfe37-958b-446c-aa59-f917a881d4b4 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Getting quotas for user 92c1083d5ffb404f8102a81ca164a16e and project 62c5e3ebeb6740f89f3257b965ca8c0e. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:16:13.621868 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-e10cfe37-958b-446c-aa59-f917a881d4b4 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e10cfe37-958b-446c-aa59-f917a881d4b4 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Request method failure captured: May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 2166 May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVada4J65u3xYfvf9-HurstFeK4dkQWukkSGyI-EgJB7bCEKZEoEzjNcnC2wa6hPSvgoDEh4p9pReL5WTF6AzbrSSvaGjnDRhz5e5QkifVvu5p09a45T9Ybqz_OBBZBJs0Y2QSZRGQTPRspd5pBARXzp8rcnTcaTvHzq0cgvcO_oMG4 May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 62c5e3ebeb6740f89f3257b965ca8c0e May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_62c5e3ebeb6740f89f3257b965ca8c0e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 62c5e3ebeb6740f89f3257b965ca8c0e May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-KeyPairsNegativeTestJSON-1477469549-project May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 92c1083d5ffb404f8102a81ca164a16e May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1477469549-project May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-289597894", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:16:13.630928 ncdv-master-1 devstack@n-api.service[131278]: exception: Keypair data is invalid: failed to generate fingerprint May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-289597894', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:13.634454 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e10cfe37-958b-446c-aa59-f917a881d4b4 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e10cfe37-958b-446c-aa59-f917a881d4b4 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.051415 May 21 21:16:13.637147 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 789/1594] 10.222.0.49 () {60 vars in 1159 bytes} [Sat May 21 21:16:13 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 21 21:16:13.645440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7be0d437-d4e0-48c3-9f93-86d781607dda tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Action: 'create', calling method: .version_select at 0x7fc81b4feca0>, body: {"keypair": {"name": "tempest-keypair-650571673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2Z3IEC2JXGPdDcVFiVsaQafADDdvV6CxQoyFjnrKcacmwi/ygUfwdgnYyKBhzk0Daa662i0e88fVX9jbdj3+vQwRpnp5Qf8VNTwGXBY9Q3DND7TG3d5MlBrxgJddmwzA=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:13.660836 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-7be0d437-d4e0-48c3-9f93-86d781607dda tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Getting quotas for project 62c5e3ebeb6740f89f3257b965ca8c0e. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:16:13.666209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-7be0d437-d4e0-48c3-9f93-86d781607dda tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Getting quotas for user 92c1083d5ffb404f8102a81ca164a16e and project 62c5e3ebeb6740f89f3257b965ca8c0e. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:16:13.811751 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7be0d437-d4e0-48c3-9f93-86d781607dda tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.170429 May 21 21:16:13.812397 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 790/1595] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:16:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:16:13.825774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3be3def9-ad28-44ce-bf06-6e31c1a05c93 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Action: 'create', calling method: .version_select at 0x7fc81b4fe820>, body: {"keypair": {"name": "tempest-keypair-650571673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI535J4MoSJ+ydVLmGvu53Adj2AG4Pnr4kalxK7OTKMr0Cl6vT5U8VoiKUJP6KcESlKw9BgMotRg5c0MhGcjJljR7E0q6mZlroAuV3qLeo5p+TaBgyZ2X7KM80Ewnql7ng=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:13.840983 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-3be3def9-ad28-44ce-bf06-6e31c1a05c93 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Getting quotas for project 62c5e3ebeb6740f89f3257b965ca8c0e. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:16:13.846456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-3be3def9-ad28-44ce-bf06-6e31c1a05c93 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Getting quotas for user 92c1083d5ffb404f8102a81ca164a16e and project 62c5e3ebeb6740f89f3257b965ca8c0e. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:16:13.916562 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-3be3def9-ad28-44ce-bf06-6e31c1a05c93 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] HTTP exception thrown: Key pair 'tempest-keypair-650571673' already exists. May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3be3def9-ad28-44ce-bf06-6e31c1a05c93 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Request method failure captured: May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 272 May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVada4J65u3xYfvf9-HurstFeK4dkQWukkSGyI-EgJB7bCEKZEoEzjNcnC2wa6hPSvgoDEh4p9pReL5WTF6AzbrSSvaGjnDRhz5e5QkifVvu5p09a45T9Ybqz_OBBZBJs0Y2QSZRGQTPRspd5pBARXzp8rcnTcaTvHzq0cgvcO_oMG4 May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 62c5e3ebeb6740f89f3257b965ca8c0e May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_62c5e3ebeb6740f89f3257b965ca8c0e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 62c5e3ebeb6740f89f3257b965ca8c0e May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-KeyPairsNegativeTestJSON-1477469549-project May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 92c1083d5ffb404f8102a81ca164a16e May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1477469549-project May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: {"keypair": {"name": "tempest-keypair-650571673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI535J4MoSJ+ydVLmGvu53Adj2AG4Pnr4kalxK7OTKMr0Cl6vT5U8VoiKUJP6KcESlKw9BgMotRg5c0MhGcjJljR7E0q6mZlroAuV3qLeo5p+TaBgyZ2X7KM80Ewnql7ng=="}} May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: exception: Key pair 'tempest-keypair-650571673' already exists. May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-650571673', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI535J4MoSJ+ydVLmGvu53Adj2AG4Pnr4kalxK7OTKMr0Cl6vT5U8VoiKUJP6KcESlKw9BgMotRg5c0MhGcjJljR7E0q6mZlroAuV3qLeo5p+TaBgyZ2X7KM80Ewnql7ng=='}}} May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = self._query(query) May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi conn.query(q) May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result.read() May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '92c1083d5ffb404f8102a81ca164a16e-tempest-keypair-650571673' for key 'key_pairs.uniq_key_pairs0user_id0name'") May 21 21:16:13.922826 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi kp.save(context.session) May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi session.flush() May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._flush(objects) May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi compat.raise_( May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi flush_context.execute() May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi rec.execute(self) May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = self._query(query) May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi conn.query(q) May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result.read() May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 21 21:16:13.927413 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '92c1083d5ffb404f8102a81ca164a16e-tempest-keypair-650571673' for key 'key_pairs.uniq_key_pairs0user_id0name'") May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 21, 21, 16, 13, 863745), 'updated_at': None, 'name': 'tempest-keypair-650571673', 'user_id': '92c1083d5ffb404f8102a81ca164a16e', 'fingerprint': '4b:67:c6:84:a6:3f:06:25:75:47:6e:fc:34:79:03:fa', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI535J4MoSJ+ydVLmGvu53Adj2AG4Pnr4kalxK7OTKMr0Cl6vT5U8VoiKUJP6KcESlKw9BgMotRg5c0MhGcjJljR7E0q6mZlroAuV3qLeo5p+TaBgyZ2X7KM80Ewnql7ng==', 'type': 'ssh'}] May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi keypair.create() May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._create() May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-650571673' already exists. May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) May 21 21:16:13.931620 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-650571673' already exists. May 21 21:16:13.936256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:13.936256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:13.936256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:13.936256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:13.936256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:13.936256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:13.936256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:13.936256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:13.936256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-650571673' already exists. May 21 21:16:13.936256 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:13.936256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3be3def9-ad28-44ce-bf06-6e31c1a05c93 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Returning 409 to user: Key pair 'tempest-keypair-650571673' already exists. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:13.936256 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3be3def9-ad28-44ce-bf06-6e31c1a05c93 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.102383 May 21 21:16:13.936256 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 791/1596] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:16:13 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 21 21:16:13.936256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c5923e04-b3d5-4614-97c4-13072946337d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:13.936256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c5923e04-b3d5-4614-97c4-13072946337d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 109fe86b-c8fa-4563-973a-fd343b14f652] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:13.937565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5923e04-b3d5-4614-97c4-13072946337d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:13.937565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5923e04-b3d5-4614-97c4-13072946337d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:13.938303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5923e04-b3d5-4614-97c4-13072946337d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:13.938745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5923e04-b3d5-4614-97c4-13072946337d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:14.086610 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c5923e04-b3d5-4614-97c4-13072946337d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:14.094649 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c5923e04-b3d5-4614-97c4-13072946337d tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652" status: 200 len: 1528 microversion: 2.1 time: 0.168855 May 21 21:16:14.095244 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 792/1597] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:13 2022] GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652 => generated 1528 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:14.100090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8029dbbf-313f-4b81-b479-2328dfe73acc tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Calling method '.version_select at 0x7fc82d125550>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:14.202006 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8029dbbf-313f-4b81-b479-2328dfe73acc tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-650571673" status: 202 len: 0 microversion: 2.1 time: 0.105565 May 21 21:16:14.202736 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 793/1598] 10.222.0.49 () {58 vars in 1217 bytes} [Sat May 21 21:16:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-650571673 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:14.207805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3b49a516-2b26-4647-8d6f-19eb58eabc8f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:14.208907 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3b49a516-2b26-4647-8d6f-19eb58eabc8f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:14.216238 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b49a516-2b26-4647-8d6f-19eb58eabc8f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:14.216725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b49a516-2b26-4647-8d6f-19eb58eabc8f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:14.217513 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b49a516-2b26-4647-8d6f-19eb58eabc8f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:14.217960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b49a516-2b26-4647-8d6f-19eb58eabc8f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:14.373209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3b49a516-2b26-4647-8d6f-19eb58eabc8f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:14.381137 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3b49a516-2b26-4647-8d6f-19eb58eabc8f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1476 microversion: 2.1 time: 0.177254 May 21 21:16:14.381707 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 794/1599] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:14 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1476 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:14.386942 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7550678e-2ba0-4ee1-80eb-e69bfc0245aa tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Action: 'create', calling method: .version_select at 0x7fc81b4fe670>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxMQB+GCcDPbqwEn97asDc2QOcIvHtbN1NGVUxgPNZ55Bzw+kT2q2DYLpipoUCJhl/sTYbZ/x0GXbEFbEhdf0U4T08vHg2pWm1vFoJGT0kQxFope0s7uHKUdudCx0VRWQ=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7550678e-2ba0-4ee1-80eb-e69bfc0245aa tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Request method failure captured: May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 247 May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVada4J65u3xYfvf9-HurstFeK4dkQWukkSGyI-EgJB7bCEKZEoEzjNcnC2wa6hPSvgoDEh4p9pReL5WTF6AzbrSSvaGjnDRhz5e5QkifVvu5p09a45T9Ybqz_OBBZBJs0Y2QSZRGQTPRspd5pBARXzp8rcnTcaTvHzq0cgvcO_oMG4 May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 62c5e3ebeb6740f89f3257b965ca8c0e May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_62c5e3ebeb6740f89f3257b965ca8c0e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 62c5e3ebeb6740f89f3257b965ca8c0e May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-KeyPairsNegativeTestJSON-1477469549-project May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 92c1083d5ffb404f8102a81ca164a16e May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1477469549-project May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxMQB+GCcDPbqwEn97asDc2QOcIvHtbN1NGVUxgPNZ55Bzw+kT2q2DYLpipoUCJhl/sTYbZ/x0GXbEFbEhdf0U4T08vHg2pWm1vFoJGT0kQxFope0s7uHKUdudCx0VRWQ=="}} May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid input for field/attribute name. Value: . '' is too short May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxMQB+GCcDPbqwEn97asDc2QOcIvHtbN1NGVUxgPNZ55Bzw+kT2q2DYLpipoUCJhl/sTYbZ/x0GXbEFbEhdf0U4T08vHg2pWm1vFoJGT0kQxFope0s7uHKUdudCx0VRWQ=='}}} May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise error May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi On instance['keypair']: May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi '' May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:16:14.389373 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:16:14.399617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:16:14.399617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:16:14.399617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:16:14.399617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:16:14.399617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 21 21:16:14.399617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:14.399617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:14.399617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:14.399617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:14.399617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:14.399617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:14.399617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:16:14.399617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:16:14.399617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 21 21:16:14.399617 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:14.399617 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7550678e-2ba0-4ee1-80eb-e69bfc0245aa tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:14.399617 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7550678e-2ba0-4ee1-80eb-e69bfc0245aa tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.008068 May 21 21:16:14.399617 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 795/1600] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:16:14 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:16:14.401068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a07083a4-2bb2-41fe-9889-ab5e5c466f64 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:14.401068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a07083a4-2bb2-41fe-9889-ab5e5c466f64 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:14.407821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a07083a4-2bb2-41fe-9889-ab5e5c466f64 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:14.408757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a07083a4-2bb2-41fe-9889-ab5e5c466f64 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:14.409604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a07083a4-2bb2-41fe-9889-ab5e5c466f64 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:14.410106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a07083a4-2bb2-41fe-9889-ab5e5c466f64 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:14.587216 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a07083a4-2bb2-41fe-9889-ab5e5c466f64 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:14.596846 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a07083a4-2bb2-41fe-9889-ab5e5c466f64 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1497 microversion: 2.1 time: 0.202833 May 21 21:16:14.597531 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 796/1601] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:14 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1497 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:14.603200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-e282d7e4-9dbd-4177-86b2-6173eb5d085f req-4005b083-be02-4d6d-a5fb-809b0e35f05f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd8944e0-b77d-4aa0-8d85-b98814346aed", "name": "network-vif-plugged", "status": "completed", "tag": "950b352f-54b2-4352-a24b-093df72e9046"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:14.612827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e282d7e4-9dbd-4177-86b2-6173eb5d085f req-4005b083-be02-4d6d-a5fb-809b0e35f05f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:14.613362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e282d7e4-9dbd-4177-86b2-6173eb5d085f req-4005b083-be02-4d6d-a5fb-809b0e35f05f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:14.626923 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-e282d7e4-9dbd-4177-86b2-6173eb5d085f req-4005b083-be02-4d6d-a5fb-809b0e35f05f service nova] Creating event network-vif-plugged:950b352f-54b2-4352-a24b-093df72e9046 for instance bd8944e0-b77d-4aa0-8d85-b98814346aed on nch1-master-1 May 21 21:16:14.632512 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-e282d7e4-9dbd-4177-86b2-6173eb5d085f req-4005b083-be02-4d6d-a5fb-809b0e35f05f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033445 May 21 21:16:14.633932 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 797/1602] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:14.640999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f061c817-2166-4624-bce3-992e7e077927 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Action: 'create', calling method: .version_select at 0x7fc81b4fd280>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1248090673", "public_key": " "}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:14.644708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:14.655696 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-f061c817-2166-4624-bce3-992e7e077927 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Getting quotas for project 62c5e3ebeb6740f89f3257b965ca8c0e. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:16:14.669062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-f061c817-2166-4624-bce3-992e7e077927 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Getting quotas for user 92c1083d5ffb404f8102a81ca164a16e and project 62c5e3ebeb6740f89f3257b965ca8c0e. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:16:14.695242 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-f061c817-2166-4624-bce3-992e7e077927 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f061c817-2166-4624-bce3-992e7e077927 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Request method failure captured: May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 95 May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVada4J65u3xYfvf9-HurstFeK4dkQWukkSGyI-EgJB7bCEKZEoEzjNcnC2wa6hPSvgoDEh4p9pReL5WTF6AzbrSSvaGjnDRhz5e5QkifVvu5p09a45T9Ybqz_OBBZBJs0Y2QSZRGQTPRspd5pBARXzp8rcnTcaTvHzq0cgvcO_oMG4 May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 62c5e3ebeb6740f89f3257b965ca8c0e May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_62c5e3ebeb6740f89f3257b965ca8c0e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 62c5e3ebeb6740f89f3257b965ca8c0e May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-KeyPairsNegativeTestJSON-1477469549-project May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 92c1083d5ffb404f8102a81ca164a16e May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1477469549-project May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1248090673", "public_key": " "}} May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: exception: Keypair data is invalid: failed to generate fingerprint May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1248090673', 'public_key': ' '}}} May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:14.697377 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 21 21:16:14.702622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:14.705361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f061c817-2166-4624-bce3-992e7e077927 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:14.706380 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f061c817-2166-4624-bce3-992e7e077927 tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.071169 May 21 21:16:14.714066 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 798/1603] 10.222.0.49 () {60 vars in 1157 bytes} [Sat May 21 21:16:14 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 21 21:16:14.714066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3494a754-a29f-4bb7-8b33-45b35f971c9f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:14.714066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3494a754-a29f-4bb7-8b33-45b35f971c9f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:14.721672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3494a754-a29f-4bb7-8b33-45b35f971c9f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:14.721902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3494a754-a29f-4bb7-8b33-45b35f971c9f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:14.723150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3494a754-a29f-4bb7-8b33-45b35f971c9f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:14.723966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3494a754-a29f-4bb7-8b33-45b35f971c9f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:14.918899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3494a754-a29f-4bb7-8b33-45b35f971c9f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:14.927933 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3494a754-a29f-4bb7-8b33-45b35f971c9f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 200 len: 1315 microversion: 2.1 time: 0.219401 May 21 21:16:14.928479 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 799/1604] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:14 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:14.931071 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d32260dd-d5de-4936-8b9a-982a36f831f9 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "DELETE /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e" status: 204 len: 0 microversion: 2.1 time: 1.648208 May 21 21:16:14.934798 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 806/1605] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:13 2022] DELETE /compute/v2.1/images/34ab0415-9ac8-47ba-9cc1-0f7aad18eb6e => generated 0 bytes in 1650 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:16:14.934947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7c13397a-de03-43ad-97e0-2f6966e24bcd tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Action: 'create', calling method: .version_select at 0x7fc81b4fdee0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7LDG0uZaRRL+tzZP6TD5AXtXfHgwUqxvRfIo7ac2o/q6823w2bZAtij9IAGpqZFWUaAUIMxtRCBLQEhEoI0l9Dx4gozqaibPAzoFn+OFRLa3wG359GkdX1vgcHAyl/yw=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7c13397a-de03-43ad-97e0-2f6966e24bcd tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Request method failure captured: May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 507 May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVada4J65u3xYfvf9-HurstFeK4dkQWukkSGyI-EgJB7bCEKZEoEzjNcnC2wa6hPSvgoDEh4p9pReL5WTF6AzbrSSvaGjnDRhz5e5QkifVvu5p09a45T9Ybqz_OBBZBJs0Y2QSZRGQTPRspd5pBARXzp8rcnTcaTvHzq0cgvcO_oMG4 May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 62c5e3ebeb6740f89f3257b965ca8c0e May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_62c5e3ebeb6740f89f3257b965ca8c0e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 62c5e3ebeb6740f89f3257b965ca8c0e May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-KeyPairsNegativeTestJSON-1477469549-project May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 92c1083d5ffb404f8102a81ca164a16e May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1477469549-project May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7LDG0uZaRRL+tzZP6TD5AXtXfHgwUqxvRfIo7ac2o/q6823w2bZAtij9IAGpqZFWUaAUIMxtRCBLQEhEoI0l9Dx4gozqaibPAzoFn+OFRLa3wG359GkdX1vgcHAyl/yw=="}} May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7LDG0uZaRRL+tzZP6TD5AXtXfHgwUqxvRfIo7ac2o/q6823w2bZAtij9IAGpqZFWUaAUIMxtRCBLQEhEoI0l9Dx4gozqaibPAzoFn+OFRLa3wG359GkdX1vgcHAyl/yw=='}}} May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise error May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi On instance['keypair']: May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' May 21 21:16:14.936786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7c13397a-de03-43ad-97e0-2f6966e24bcd tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7c13397a-de03-43ad-97e0-2f6966e24bcd tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.008553 May 21 21:16:14.941204 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 800/1606] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:16:14 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:16:14.943587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-29e43d7c-c632-4dd3-87cd-06dbd5710b30 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:14.943812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-29e43d7c-c632-4dd3-87cd-06dbd5710b30 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:14.946566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-cdb4e7ba-9981-4fd7-9108-fa938deef4b9 req-1a40827c-a34a-457f-a365-e1d8e0c7027b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109fe86b-c8fa-4563-973a-fd343b14f652", "name": "network-vif-deleted", "tag": "c303e0ea-3273-47b1-b21a-adfbfbd582b4"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:14.951948 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-29e43d7c-c632-4dd3-87cd-06dbd5710b30 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:14.952444 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-29e43d7c-c632-4dd3-87cd-06dbd5710b30 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:14.953219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-29e43d7c-c632-4dd3-87cd-06dbd5710b30 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:14.953666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-29e43d7c-c632-4dd3-87cd-06dbd5710b30 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:14.956207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cdb4e7ba-9981-4fd7-9108-fa938deef4b9 req-1a40827c-a34a-457f-a365-e1d8e0c7027b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:14.956688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cdb4e7ba-9981-4fd7-9108-fa938deef4b9 req-1a40827c-a34a-457f-a365-e1d8e0c7027b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:14.967792 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-cdb4e7ba-9981-4fd7-9108-fa938deef4b9 req-1a40827c-a34a-457f-a365-e1d8e0c7027b service nova] Creating event network-vif-deleted:c303e0ea-3273-47b1-b21a-adfbfbd582b4 for instance 109fe86b-c8fa-4563-973a-fd343b14f652 on nch1-master-1 May 21 21:16:14.972807 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-cdb4e7ba-9981-4fd7-9108-fa938deef4b9 req-1a40827c-a34a-457f-a365-e1d8e0c7027b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039767 May 21 21:16:14.973411 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 807/1607] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:14.979010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a6f7233e-2e30-494d-a43d-04c38ed34a4c tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Action: 'create', calling method: .version_select at 0x7fc81b4ba9d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-649271124", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:14.981603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-29e43d7c-c632-4dd3-87cd-06dbd5710b30 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:16:14.993769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-a6f7233e-2e30-494d-a43d-04c38ed34a4c tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Getting quotas for project 62c5e3ebeb6740f89f3257b965ca8c0e. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:16:14.997609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:14.999684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-a6f7233e-2e30-494d-a43d-04c38ed34a4c tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Getting quotas for user 92c1083d5ffb404f8102a81ca164a16e and project 62c5e3ebeb6740f89f3257b965ca8c0e. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:16:15.016886 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-a6f7233e-2e30-494d-a43d-04c38ed34a4c tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a6f7233e-2e30-494d-a43d-04c38ed34a4c tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Request method failure captured: May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 117 May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVada4J65u3xYfvf9-HurstFeK4dkQWukkSGyI-EgJB7bCEKZEoEzjNcnC2wa6hPSvgoDEh4p9pReL5WTF6AzbrSSvaGjnDRhz5e5QkifVvu5p09a45T9Ybqz_OBBZBJs0Y2QSZRGQTPRspd5pBARXzp8rcnTcaTvHzq0cgvcO_oMG4 May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 62c5e3ebeb6740f89f3257b965ca8c0e May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_62c5e3ebeb6740f89f3257b965ca8c0e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 62c5e3ebeb6740f89f3257b965ca8c0e May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-KeyPairsNegativeTestJSON-1477469549-project May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 92c1083d5ffb404f8102a81ca164a16e May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1477469549-project May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-649271124", "public_key": "ssh-rsa JUNK nova@ubuntu"}} May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: exception: Keypair data is invalid: failed to generate fingerprint May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-649271124', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ValueError: Invalid data May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint May 21 21:16:15.019633 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a6f7233e-2e30-494d-a43d-04c38ed34a4c tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a6f7233e-2e30-494d-a43d-04c38ed34a4c tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.046521 May 21 21:16:15.025103 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 808/1608] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:16:14 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 21 21:16:15.031284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a49cc6a3-2181-4a86-8500-cdab0a0ac55a tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Calling method '.version_select at 0x7fc81b638a60>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:15.043774 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-a49cc6a3-2181-4a86-8500-cdab0a0ac55a tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-2060235076 not found for user 92c1083d5ffb404f8102a81ca164a16e May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a49cc6a3-2181-4a86-8500-cdab0a0ac55a tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Request method failure captured: May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2060235076 HTTP/1.1 May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVada4J65u3xYfvf9-HurstFeK4dkQWukkSGyI-EgJB7bCEKZEoEzjNcnC2wa6hPSvgoDEh4p9pReL5WTF6AzbrSSvaGjnDRhz5e5QkifVvu5p09a45T9Ybqz_OBBZBJs0Y2QSZRGQTPRspd5pBARXzp8rcnTcaTvHzq0cgvcO_oMG4 May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 62c5e3ebeb6740f89f3257b965ca8c0e May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_62c5e3ebeb6740f89f3257b965ca8c0e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/62c5e3ebeb6740f89f3257b965ca8c0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 62c5e3ebeb6740f89f3257b965ca8c0e May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1477469549 May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-KeyPairsNegativeTestJSON-1477469549-project May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 92c1083d5ffb404f8102a81ca164a16e May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1477469549-project May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: exception: Keypair tempest-keypair-non-existent-2060235076 not found for user 92c1083d5ffb404f8102a81ca164a16e May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'tempest-keypair-non-existent-2060235076'} May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-2060235076 not found for user 92c1083d5ffb404f8102a81ca164a16e May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:15.045842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req, id) May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-2060235076 not found for user 92c1083d5ffb404f8102a81ca164a16e May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-2060235076 not found for user 92c1083d5ffb404f8102a81ca164a16e May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a49cc6a3-2181-4a86-8500-cdab0a0ac55a tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] Returning 404 to user: Keypair tempest-keypair-non-existent-2060235076 not found for user 92c1083d5ffb404f8102a81ca164a16e {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a49cc6a3-2181-4a86-8500-cdab0a0ac55a tempest-KeyPairsNegativeTestJSON-1477469549 tempest-KeyPairsNegativeTestJSON-1477469549-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2060235076" status: 404 len: 145 microversion: 2.1 time: 0.019671 May 21 21:16:15.050752 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 809/1609] 10.222.0.49 () {58 vars in 1259 bytes} [Sat May 21 21:16:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2060235076 => generated 145 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:16:15.114062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3ccedcc5-d49f-4114-a551-37f95b403195 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:15.114843 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3ccedcc5-d49f-4114-a551-37f95b403195 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 109fe86b-c8fa-4563-973a-fd343b14f652] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:15.122030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3ccedcc5-d49f-4114-a551-37f95b403195 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:15.122486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3ccedcc5-d49f-4114-a551-37f95b403195 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:15.123267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3ccedcc5-d49f-4114-a551-37f95b403195 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:15.123750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3ccedcc5-d49f-4114-a551-37f95b403195 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:15.200886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3ccedcc5-d49f-4114-a551-37f95b403195 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:15.211755 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3ccedcc5-d49f-4114-a551-37f95b403195 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652" status: 200 len: 1486 microversion: 2.1 time: 0.101412 May 21 21:16:15.212551 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 810/1610] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:15 2022] GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652 => generated 1486 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:16:15.301739 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-29e43d7c-c632-4dd3-87cd-06dbd5710b30 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88" status: 204 len: 0 microversion: 2.1 time: 0.361447 May 21 21:16:15.302336 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 801/1611] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:16:14 2022] DELETE /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:16:15.310822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e6bbce38-21cd-4206-b922-12e5d3393e9f tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:15.311446 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e6bbce38-21cd-4206-b922-12e5d3393e9f tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:15.318092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6bbce38-21cd-4206-b922-12e5d3393e9f tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:15.318543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6bbce38-21cd-4206-b922-12e5d3393e9f tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:15.319314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6bbce38-21cd-4206-b922-12e5d3393e9f tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:15.319755 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6bbce38-21cd-4206-b922-12e5d3393e9f tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:15.400567 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-041876bc-cae9-43bc-9d34-35841c336017 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:15.401419 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-041876bc-cae9-43bc-9d34-35841c336017 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:15.407917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-041876bc-cae9-43bc-9d34-35841c336017 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:15.408722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-041876bc-cae9-43bc-9d34-35841c336017 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:15.409600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-041876bc-cae9-43bc-9d34-35841c336017 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:15.410076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-041876bc-cae9-43bc-9d34-35841c336017 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:15.477141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e6bbce38-21cd-4206-b922-12e5d3393e9f tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:15.486354 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e6bbce38-21cd-4206-b922-12e5d3393e9f tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 1474 microversion: 2.1 time: 0.179145 May 21 21:16:15.487324 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 811/1612] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:15 2022] GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 => generated 1474 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:15.592767 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-041876bc-cae9-43bc-9d34-35841c336017 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:15.603087 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-041876bc-cae9-43bc-9d34-35841c336017 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1476 microversion: 2.1 time: 0.207490 May 21 21:16:15.603877 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 802/1613] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:15 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1476 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:16:15.619248 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0d2d260c-04ed-4334-bf5e-b18e8015b308 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:15.620368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0d2d260c-04ed-4334-bf5e-b18e8015b308 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:15.628230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d2d260c-04ed-4334-bf5e-b18e8015b308 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:15.629083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d2d260c-04ed-4334-bf5e-b18e8015b308 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:15.630504 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d2d260c-04ed-4334-bf5e-b18e8015b308 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:15.631406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d2d260c-04ed-4334-bf5e-b18e8015b308 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:15.811941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0d2d260c-04ed-4334-bf5e-b18e8015b308 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:15.819555 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0d2d260c-04ed-4334-bf5e-b18e8015b308 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1497 microversion: 2.1 time: 0.205334 May 21 21:16:15.820366 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 812/1614] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:15 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1497 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:15.946454 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e03a56de-6ef0-4213-955f-bbe913644e03 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:15.947074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e03a56de-6ef0-4213-955f-bbe913644e03 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:15.953845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e03a56de-6ef0-4213-955f-bbe913644e03 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:15.954302 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e03a56de-6ef0-4213-955f-bbe913644e03 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:15.955423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e03a56de-6ef0-4213-955f-bbe913644e03 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:15.955863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e03a56de-6ef0-4213-955f-bbe913644e03 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:16.174084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e03a56de-6ef0-4213-955f-bbe913644e03 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:16.183741 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e03a56de-6ef0-4213-955f-bbe913644e03 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 200 len: 1315 microversion: 2.1 time: 0.241377 May 21 21:16:16.184267 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 803/1615] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:15 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:16.230548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-80064ab0-2395-49ad-a3cc-58cddb257542 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:16.231174 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-80064ab0-2395-49ad-a3cc-58cddb257542 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 109fe86b-c8fa-4563-973a-fd343b14f652] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:16.237398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80064ab0-2395-49ad-a3cc-58cddb257542 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:16.237846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80064ab0-2395-49ad-a3cc-58cddb257542 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:16.238619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80064ab0-2395-49ad-a3cc-58cddb257542 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:16.239053 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80064ab0-2395-49ad-a3cc-58cddb257542 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:16.271449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80064ab0-2395-49ad-a3cc-58cddb257542 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:16.271895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80064ab0-2395-49ad-a3cc-58cddb257542 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:16.272370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-80064ab0-2395-49ad-a3cc-58cddb257542 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lazy-loading 'fault' on Instance uuid 109fe86b-c8fa-4563-973a-fd343b14f652 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:16:16.324112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-80064ab0-2395-49ad-a3cc-58cddb257542 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186310904c3943fdb63247b58725140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f6ae1864ee43429c910eb27888608f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:16.347970 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-80064ab0-2395-49ad-a3cc-58cddb257542 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652" status: 200 len: 1315 microversion: 2.1 time: 0.106786 May 21 21:16:16.347970 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 813/1616] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:16 2022] GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652 => generated 1315 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:16.507163 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c2ffe416-f4ae-4bc2-a47a-b09ae5cf29e7 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:16.509115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c2ffe416-f4ae-4bc2-a47a-b09ae5cf29e7 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:16.515819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2ffe416-f4ae-4bc2-a47a-b09ae5cf29e7 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:16.516373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2ffe416-f4ae-4bc2-a47a-b09ae5cf29e7 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:16.517144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2ffe416-f4ae-4bc2-a47a-b09ae5cf29e7 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:16.517620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2ffe416-f4ae-4bc2-a47a-b09ae5cf29e7 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:16.621367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c72ee7d5-7752-493e-9b2e-d202ba0d4e11 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:16.622004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c72ee7d5-7752-493e-9b2e-d202ba0d4e11 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:16.628996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c72ee7d5-7752-493e-9b2e-d202ba0d4e11 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:16.629458 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c72ee7d5-7752-493e-9b2e-d202ba0d4e11 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:16.630253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c72ee7d5-7752-493e-9b2e-d202ba0d4e11 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:16.630698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c72ee7d5-7752-493e-9b2e-d202ba0d4e11 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:16.681576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c2ffe416-f4ae-4bc2-a47a-b09ae5cf29e7 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:16.692711 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c2ffe416-f4ae-4bc2-a47a-b09ae5cf29e7 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 1474 microversion: 2.1 time: 0.189530 May 21 21:16:16.693736 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 804/1617] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:16 2022] GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 => generated 1474 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:16.837251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5324cae0-0b13-4656-8a85-f7c69f3559aa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:16.838357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5324cae0-0b13-4656-8a85-f7c69f3559aa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:16.846139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5324cae0-0b13-4656-8a85-f7c69f3559aa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:16.846676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5324cae0-0b13-4656-8a85-f7c69f3559aa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:16.847604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5324cae0-0b13-4656-8a85-f7c69f3559aa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:16.848114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5324cae0-0b13-4656-8a85-f7c69f3559aa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:17.020337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5324cae0-0b13-4656-8a85-f7c69f3559aa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:17.031413 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5324cae0-0b13-4656-8a85-f7c69f3559aa tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1497 microversion: 2.1 time: 0.198389 May 21 21:16:17.032247 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 805/1618] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:16 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1497 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:16:17.129696 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c72ee7d5-7752-493e-9b2e-d202ba0d4e11 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:17.136185 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c72ee7d5-7752-493e-9b2e-d202ba0d4e11 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1476 microversion: 2.1 time: 0.519546 May 21 21:16:17.136811 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 814/1619] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:16 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1476 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:17.201141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b6d9ddee-458f-4bca-8e1e-6c6cb28b3ccc tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:17.201775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b6d9ddee-458f-4bca-8e1e-6c6cb28b3ccc tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:17.209213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6d9ddee-458f-4bca-8e1e-6c6cb28b3ccc tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:17.209678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6d9ddee-458f-4bca-8e1e-6c6cb28b3ccc tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:17.210466 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6d9ddee-458f-4bca-8e1e-6c6cb28b3ccc tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:17.211475 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6d9ddee-458f-4bca-8e1e-6c6cb28b3ccc tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:17.349845 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4316e6e6-a18f-4e73-b904-4c8df85687fd tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:17.350467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4316e6e6-a18f-4e73-b904-4c8df85687fd tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 109fe86b-c8fa-4563-973a-fd343b14f652] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:17.358230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4316e6e6-a18f-4e73-b904-4c8df85687fd tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:17.358690 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4316e6e6-a18f-4e73-b904-4c8df85687fd tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:17.359484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4316e6e6-a18f-4e73-b904-4c8df85687fd tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:17.359930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4316e6e6-a18f-4e73-b904-4c8df85687fd tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:17.374803 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-4316e6e6-a18f-4e73-b904-4c8df85687fd tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] HTTP exception thrown: Instance 109fe86b-c8fa-4563-973a-fd343b14f652 could not be found. May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4316e6e6-a18f-4e73-b904-4c8df85687fd tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Request method failure captured: May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652 HTTP/1.1 May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVYcSiyjAIR82oxkRB6GTuWAKVTX4xG5vMYtW_3BeBGCFxFQjKbNKPB4C0xhPGbN3kZTd0vkZOYFJP4MJ1kk_eZN0RsUqNmA1UP-b-s9HcyrYiVjgp1H1dIVPKi3UtrJ4Ob8-qkiVNLHvP2GMr_o_p2pBItaNXntU_KoEaP7ETd6R3M May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85f6ae1864ee43429c910eb27888608f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 186310904c3943fdb63247b58725140e May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 109fe86b-c8fa-4563-973a-fd343b14f652 could not be found. May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '109fe86b-c8fa-4563-973a-fd343b14f652'} May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 109fe86b-c8fa-4563-973a-fd343b14f652 could not be found. May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 109fe86b-c8fa-4563-973a-fd343b14f652 could not be found. May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.376439 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:17.380721 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.380721 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:17.380721 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:17.380721 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:17.380721 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:17.380721 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:17.380721 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 109fe86b-c8fa-4563-973a-fd343b14f652 could not be found. May 21 21:16:17.380721 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.382127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4316e6e6-a18f-4e73-b904-4c8df85687fd tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Returning 404 to user: Instance 109fe86b-c8fa-4563-973a-fd343b14f652 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:17.383715 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4316e6e6-a18f-4e73-b904-4c8df85687fd tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652" status: 404 len: 111 microversion: 2.1 time: 0.037216 May 21 21:16:17.388879 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 815/1620] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:17 2022] GET /compute/v2.1/servers/109fe86b-c8fa-4563-973a-fd343b14f652 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:16:17.394489 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4df37e47-4c66-4bb2-8e14-7def4964fe26 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '.version_select at 0x7fc81b576d30>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:17.454585 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-4df37e47-4c66-4bb2-8e14-7def4964fe26 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] HTTP exception thrown: Image not found. May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4df37e47-4c66-4bb2-8e14-7def4964fe26 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Request method failure captured: May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/images/f5286ee1-6820-43b0-9941-2b8864a05fd7 HTTP/1.1 May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVYcSiyjAIR82oxkRB6GTuWAKVTX4xG5vMYtW_3BeBGCFxFQjKbNKPB4C0xhPGbN3kZTd0vkZOYFJP4MJ1kk_eZN0RsUqNmA1UP-b-s9HcyrYiVjgp1H1dIVPKi3UtrJ4Ob8-qkiVNLHvP2GMr_o_p2pBItaNXntU_KoEaP7ETd6R3M May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85f6ae1864ee43429c910eb27888608f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 186310904c3943fdb63247b58725140e May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: exception: Image not found. May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'f5286ee1-6820-43b0-9941-2b8864a05fd7'} May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f5286ee1-6820-43b0-9941-2b8864a05fd7 to delete May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f5286ee1-6820-43b0-9941-2b8864a05fd7 could not be found. May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:17.456385 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4df37e47-4c66-4bb2-8e14-7def4964fe26 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Returning 404 to user: Image not found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4df37e47-4c66-4bb2-8e14-7def4964fe26 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "DELETE /compute/v2.1/images/f5286ee1-6820-43b0-9941-2b8864a05fd7" status: 404 len: 62 microversion: 2.1 time: 0.067780 May 21 21:16:17.461626 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 816/1621] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:17 2022] DELETE /compute/v2.1/images/f5286ee1-6820-43b0-9941-2b8864a05fd7 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:16:17.466861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b79ea741-49d6-4154-a3cc-f34a9036eb23 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:17.467372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b79ea741-49d6-4154-a3cc-f34a9036eb23 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:17.475951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b79ea741-49d6-4154-a3cc-f34a9036eb23 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:17.475951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b79ea741-49d6-4154-a3cc-f34a9036eb23 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:17.477125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b79ea741-49d6-4154-a3cc-f34a9036eb23 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:17.477604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b79ea741-49d6-4154-a3cc-f34a9036eb23 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:17.491412 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-b79ea741-49d6-4154-a3cc-f34a9036eb23 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] HTTP exception thrown: Instance 6dd05f19-07e5-4ed2-846c-250e839345f6 could not be found. May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b79ea741-49d6-4154-a3cc-f34a9036eb23 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Request method failure captured: May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 HTTP/1.1 May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVYcSiyjAIR82oxkRB6GTuWAKVTX4xG5vMYtW_3BeBGCFxFQjKbNKPB4C0xhPGbN3kZTd0vkZOYFJP4MJ1kk_eZN0RsUqNmA1UP-b-s9HcyrYiVjgp1H1dIVPKi3UtrJ4Ob8-qkiVNLHvP2GMr_o_p2pBItaNXntU_KoEaP7ETd6R3M May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85f6ae1864ee43429c910eb27888608f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 186310904c3943fdb63247b58725140e May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 6dd05f19-07e5-4ed2-846c-250e839345f6 could not be found. May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '6dd05f19-07e5-4ed2-846c-250e839345f6'} May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd05f19-07e5-4ed2-846c-250e839345f6 could not be found. May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:16:17.493868 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:16:17.498760 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd05f19-07e5-4ed2-846c-250e839345f6 could not be found. May 21 21:16:17.498760 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.498760 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:17.498760 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.498760 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:17.498760 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:17.498760 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:17.498760 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:17.498760 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:17.498760 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd05f19-07e5-4ed2-846c-250e839345f6 could not be found. May 21 21:16:17.498760 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.500748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b79ea741-49d6-4154-a3cc-f34a9036eb23 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Returning 404 to user: Instance 6dd05f19-07e5-4ed2-846c-250e839345f6 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:17.501136 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b6d9ddee-458f-4bca-8e1e-6c6cb28b3ccc tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:17.502008 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b79ea741-49d6-4154-a3cc-f34a9036eb23 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 404 len: 111 microversion: 2.1 time: 0.039176 May 21 21:16:17.506129 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 817/1622] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:16:17 2022] DELETE /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:16:17.512129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7f342965-6b0d-47b7-bb06-82e016dcb286 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:17.513006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7f342965-6b0d-47b7-bb06-82e016dcb286 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: 6dd05f19-07e5-4ed2-846c-250e839345f6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:17.515291 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b6d9ddee-458f-4bca-8e1e-6c6cb28b3ccc tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 200 len: 1502 microversion: 2.1 time: 0.316353 May 21 21:16:17.519377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f342965-6b0d-47b7-bb06-82e016dcb286 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:17.520114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f342965-6b0d-47b7-bb06-82e016dcb286 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:17.521176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f342965-6b0d-47b7-bb06-82e016dcb286 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:17.521847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f342965-6b0d-47b7-bb06-82e016dcb286 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:17.529200 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 806/1623] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:17 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 1502 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:16:17.538166 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-7f342965-6b0d-47b7-bb06-82e016dcb286 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] HTTP exception thrown: Instance 6dd05f19-07e5-4ed2-846c-250e839345f6 could not be found. May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7f342965-6b0d-47b7-bb06-82e016dcb286 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Request method failure captured: May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 HTTP/1.1 May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVYcSiyjAIR82oxkRB6GTuWAKVTX4xG5vMYtW_3BeBGCFxFQjKbNKPB4C0xhPGbN3kZTd0vkZOYFJP4MJ1kk_eZN0RsUqNmA1UP-b-s9HcyrYiVjgp1H1dIVPKi3UtrJ4Ob8-qkiVNLHvP2GMr_o_p2pBItaNXntU_KoEaP7ETd6R3M May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85f6ae1864ee43429c910eb27888608f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 186310904c3943fdb63247b58725140e May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 6dd05f19-07e5-4ed2-846c-250e839345f6 could not be found. May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '6dd05f19-07e5-4ed2-846c-250e839345f6'} May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd05f19-07e5-4ed2-846c-250e839345f6 could not be found. May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd05f19-07e5-4ed2-846c-250e839345f6 could not be found. May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.552477 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:17.558381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.558381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:17.558381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:17.558381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:17.558381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:17.558381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:17.558381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd05f19-07e5-4ed2-846c-250e839345f6 could not be found. May 21 21:16:17.558381 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:17.558381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7f342965-6b0d-47b7-bb06-82e016dcb286 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Returning 404 to user: Instance 6dd05f19-07e5-4ed2-846c-250e839345f6 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:17.560228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d6e4c1fc-d4c9-4358-bc83-73b106a746f3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-298637378"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:17.560764 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7f342965-6b0d-47b7-bb06-82e016dcb286 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6" status: 404 len: 111 microversion: 2.1 time: 0.034782 May 21 21:16:17.560921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d6e4c1fc-d4c9-4358-bc83-73b106a746f3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:17.561088 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 818/1624] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:17 2022] GET /compute/v2.1/servers/6dd05f19-07e5-4ed2-846c-250e839345f6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:16:17.561258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d6e4c1fc-d4c9-4358-bc83-73b106a746f3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:17.561258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d6e4c1fc-d4c9-4358-bc83-73b106a746f3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:17.561258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d6e4c1fc-d4c9-4358-bc83-73b106a746f3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:17.561258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d6e4c1fc-d4c9-4358-bc83-73b106a746f3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:17.562975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aa37169f-645e-4071-8d15-89035281894f tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '.version_select at 0x7fc81b638430>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:17.669976 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aa37169f-645e-4071-8d15-89035281894f tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-901848935" status: 202 len: 0 microversion: 2.1 time: 0.114819 May 21 21:16:17.671912 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 819/1625] 10.222.0.49 () {58 vars in 1217 bytes} [Sat May 21 21:16:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-901848935 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:17.852844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-21758da9-b093-47f2-b037-fa6659d84a1b tempest-AbsoluteLimitsNegativeTestJSON-1156117344 tempest-AbsoluteLimitsNegativeTestJSON-1156117344-project] Calling method '.version_select at 0x7fc81b6604c0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:17.866613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21758da9-b093-47f2-b037-fa6659d84a1b tempest-AbsoluteLimitsNegativeTestJSON-1156117344 tempest-AbsoluteLimitsNegativeTestJSON-1156117344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:17.867059 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21758da9-b093-47f2-b037-fa6659d84a1b tempest-AbsoluteLimitsNegativeTestJSON-1156117344 tempest-AbsoluteLimitsNegativeTestJSON-1156117344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:17.868931 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21758da9-b093-47f2-b037-fa6659d84a1b tempest-AbsoluteLimitsNegativeTestJSON-1156117344 tempest-AbsoluteLimitsNegativeTestJSON-1156117344-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:17.869371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21758da9-b093-47f2-b037-fa6659d84a1b tempest-AbsoluteLimitsNegativeTestJSON-1156117344 tempest-AbsoluteLimitsNegativeTestJSON-1156117344-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:17.876970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:17.908544 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-21758da9-b093-47f2-b037-fa6659d84a1b tempest-AbsoluteLimitsNegativeTestJSON-1156117344 tempest-AbsoluteLimitsNegativeTestJSON-1156117344-project] 10.222.0.49 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.223981 May 21 21:16:17.908544 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 820/1626] 10.222.0.49 () {58 vars in 1121 bytes} [Sat May 21 21:16:17 2022] GET /compute/v2.1/limits => generated 511 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:17.908544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-154fbad4-0ec0-403a-8733-2a55fb457777 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:17.908544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-154fbad4-0ec0-403a-8733-2a55fb457777 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:17.908544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-154fbad4-0ec0-403a-8733-2a55fb457777 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:17.909106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-154fbad4-0ec0-403a-8733-2a55fb457777 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:17.910092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-154fbad4-0ec0-403a-8733-2a55fb457777 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:17.910534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-154fbad4-0ec0-403a-8733-2a55fb457777 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:17.954014 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.network.security_group_api [None req-d6e4c1fc-d4c9-4358-bc83-73b106a746f3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Adding security group c579f2cf-2903-4ff5-b25b-504fe5aba452 to port 950b352f-54b2-4352-a24b-093df72e9046 May 21 21:16:18.210290 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-154fbad4-0ec0-403a-8733-2a55fb457777 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:18.219430 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-154fbad4-0ec0-403a-8733-2a55fb457777 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 1474 microversion: 2.1 time: 0.322075 May 21 21:16:18.220311 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 821/1627] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:17 2022] GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 => generated 1474 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:18.225274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e23cbd0c-3347-48c1-83eb-fb0a81020356 tempest-AbsoluteLimitsNegativeTestJSON-1156117344 tempest-AbsoluteLimitsNegativeTestJSON-1156117344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1850993767", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:18.283891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-e23cbd0c-3347-48c1-83eb-fb0a81020356 tempest-AbsoluteLimitsNegativeTestJSON-1156117344 tempest-AbsoluteLimitsNegativeTestJSON-1156117344-project] validate_networks() for None {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:16:18.722188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-e23cbd0c-3347-48c1-83eb-fb0a81020356 tempest-AbsoluteLimitsNegativeTestJSON-1156117344 tempest-AbsoluteLimitsNegativeTestJSON-1156117344-project] Getting quotas for project bebc5517ed9349ceb4ab5f139edd88e7. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:16:18.728772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-e23cbd0c-3347-48c1-83eb-fb0a81020356 tempest-AbsoluteLimitsNegativeTestJSON-1156117344 tempest-AbsoluteLimitsNegativeTestJSON-1156117344-project] Getting quotas for user bc99b26a7c944772a6714dee10b980fd and project bebc5517ed9349ceb4ab5f139edd88e7. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:16:18.751180 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-e23cbd0c-3347-48c1-83eb-fb0a81020356 tempest-AbsoluteLimitsNegativeTestJSON-1156117344 tempest-AbsoluteLimitsNegativeTestJSON-1156117344-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e23cbd0c-3347-48c1-83eb-fb0a81020356 tempest-AbsoluteLimitsNegativeTestJSON-1156117344 tempest-AbsoluteLimitsNegativeTestJSON-1156117344-project] Request method failure captured: May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 1752 May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVahPHKTmxL0vsohmkjTuPRJ7ryDtCNWuVc8v7SGYwDLKXutQq54N3I2IZjskvxogUazZPXXjrRihRmRQEqYPvYnuk2-Cs--BpGGH22JL0xw8dk-rSqSpUe0OktfQKjx1IGm5ivl9y5S7s2792oa5ac2rPcAyPQYbm_QEGSllJd15MU May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: bebc5517ed9349ceb4ab5f139edd88e7 May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1156117344 May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bebc5517ed9349ceb4ab5f139edd88e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bebc5517ed9349ceb4ab5f139edd88e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bebc5517ed9349ceb4ab5f139edd88e7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bebc5517ed9349ceb4ab5f139edd88e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1156117344 May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: bebc5517ed9349ceb4ab5f139edd88e7 May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1156117344 May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1156117344-project May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: bc99b26a7c944772a6714dee10b980fd May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1156117344-project May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1850993767", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:16:18.783617 ncdv-master-1 devstack@n-api.service[131277]: exception: Maximum number of metadata items exceeds 128 May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1850993767', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._create_instance( May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:16:18.786498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:16:18.790390 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:16:18.790390 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 21 21:16:18.790390 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 21 21:16:18.790390 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 21 21:16:18.790390 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 May 21 21:16:18.790390 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:18.790390 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:18.790390 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:18.790390 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:18.790390 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:18.790390 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:18.790390 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:18.790390 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:18.790390 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 May 21 21:16:18.790390 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:18.790390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e23cbd0c-3347-48c1-83eb-fb0a81020356 tempest-AbsoluteLimitsNegativeTestJSON-1156117344 tempest-AbsoluteLimitsNegativeTestJSON-1156117344-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:18.790390 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e23cbd0c-3347-48c1-83eb-fb0a81020356 tempest-AbsoluteLimitsNegativeTestJSON-1156117344 tempest-AbsoluteLimitsNegativeTestJSON-1156117344-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.561282 May 21 21:16:18.790390 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 822/1628] 10.222.0.49 () {60 vars in 1147 bytes} [Sat May 21 21:16:18 2022] POST /compute/v2.1/servers => generated 87 bytes in 563 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) May 21 21:16:18.794999 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-66da9bc9-a936-43fb-be7f-f5a46f67b2e7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:18.796041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-66da9bc9-a936-43fb-be7f-f5a46f67b2e7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:18.804341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-66da9bc9-a936-43fb-be7f-f5a46f67b2e7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:18.805195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-66da9bc9-a936-43fb-be7f-f5a46f67b2e7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:18.812712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-66da9bc9-a936-43fb-be7f-f5a46f67b2e7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:18.812712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-66da9bc9-a936-43fb-be7f-f5a46f67b2e7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:19.080602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-66da9bc9-a936-43fb-be7f-f5a46f67b2e7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:19.088794 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-66da9bc9-a936-43fb-be7f-f5a46f67b2e7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1497 microversion: 2.1 time: 0.303914 May 21 21:16:19.089366 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 823/1629] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:18 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1497 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:19.094386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0a439997-e4ac-4b1b-b474-09d3e406dc89 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:19.099203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0a439997-e4ac-4b1b-b474-09d3e406dc89 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:19.102646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a439997-e4ac-4b1b-b474-09d3e406dc89 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:19.103122 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a439997-e4ac-4b1b-b474-09d3e406dc89 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:19.104364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a439997-e4ac-4b1b-b474-09d3e406dc89 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:19.104818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a439997-e4ac-4b1b-b474-09d3e406dc89 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:19.265749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0a439997-e4ac-4b1b-b474-09d3e406dc89 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:19.275389 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0a439997-e4ac-4b1b-b474-09d3e406dc89 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1475 microversion: 2.1 time: 0.185004 May 21 21:16:19.275969 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 824/1630] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:19 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1475 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:19.284325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-74760fa3-b6e3-485f-979b-7009ef2e8009 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '.version_select at 0x7fc81b649040>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:19.313894 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-74760fa3-b6e3-485f-979b-7009ef2e8009 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] HTTP exception thrown: Image not found. May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-74760fa3-b6e3-485f-979b-7009ef2e8009 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Request method failure captured: May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/images/a1e797c9-08eb-43bc-ba9a-4e8195f6e076 HTTP/1.1 May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVYcSiyjAIR82oxkRB6GTuWAKVTX4xG5vMYtW_3BeBGCFxFQjKbNKPB4C0xhPGbN3kZTd0vkZOYFJP4MJ1kk_eZN0RsUqNmA1UP-b-s9HcyrYiVjgp1H1dIVPKi3UtrJ4Ob8-qkiVNLHvP2GMr_o_p2pBItaNXntU_KoEaP7ETd6R3M May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85f6ae1864ee43429c910eb27888608f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 186310904c3943fdb63247b58725140e May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: exception: Image not found. May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'a1e797c9-08eb-43bc-ba9a-4e8195f6e076'} May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a1e797c9-08eb-43bc-ba9a-4e8195f6e076 to delete May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a1e797c9-08eb-43bc-ba9a-4e8195f6e076 could not be found. May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:19.315686 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-74760fa3-b6e3-485f-979b-7009ef2e8009 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Returning 404 to user: Image not found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-74760fa3-b6e3-485f-979b-7009ef2e8009 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "DELETE /compute/v2.1/images/a1e797c9-08eb-43bc-ba9a-4e8195f6e076" status: 404 len: 62 microversion: 2.1 time: 0.040184 May 21 21:16:19.320009 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 825/1631] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:19 2022] DELETE /compute/v2.1/images/a1e797c9-08eb-43bc-ba9a-4e8195f6e076 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:16:19.326269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-6a26b9e1-56a0-42aa-b9bb-37a501f1da7e req-85df844c-bfab-46da-9ded-f43dd91d411e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0525194-b3aa-482c-a355-c77c63bf4c88", "name": "network-vif-deleted", "tag": "5eb403c4-fa1f-43de-83df-5b9059a1b1b1"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:19.336723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6a26b9e1-56a0-42aa-b9bb-37a501f1da7e req-85df844c-bfab-46da-9ded-f43dd91d411e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:19.338635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6a26b9e1-56a0-42aa-b9bb-37a501f1da7e req-85df844c-bfab-46da-9ded-f43dd91d411e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:19.350663 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-6a26b9e1-56a0-42aa-b9bb-37a501f1da7e req-85df844c-bfab-46da-9ded-f43dd91d411e service nova] Creating event network-vif-deleted:5eb403c4-fa1f-43de-83df-5b9059a1b1b1 for instance f0525194-b3aa-482c-a355-c77c63bf4c88 on nch2-master-1 May 21 21:16:19.357824 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-6a26b9e1-56a0-42aa-b9bb-37a501f1da7e req-85df844c-bfab-46da-9ded-f43dd91d411e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037643 May 21 21:16:19.357824 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 826/1632] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:19.363274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e54e95d7-3d64-492e-8fe5-e36c0087d853 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:19.363989 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e54e95d7-3d64-492e-8fe5-e36c0087d853 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:19.372428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e54e95d7-3d64-492e-8fe5-e36c0087d853 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:19.373106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e54e95d7-3d64-492e-8fe5-e36c0087d853 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:19.374201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e54e95d7-3d64-492e-8fe5-e36c0087d853 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:19.374816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e54e95d7-3d64-492e-8fe5-e36c0087d853 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:19.491091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e54e95d7-3d64-492e-8fe5-e36c0087d853 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:19.499781 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e54e95d7-3d64-492e-8fe5-e36c0087d853 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88" status: 200 len: 1432 microversion: 2.1 time: 0.141330 May 21 21:16:19.504552 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 827/1633] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:19 2022] GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 => generated 1432 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:19.517487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8fa4e05e-933f-47f1-8a14-a3a2e6cb71aa tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:19.518087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8fa4e05e-933f-47f1-8a14-a3a2e6cb71aa tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:19.527782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8fa4e05e-933f-47f1-8a14-a3a2e6cb71aa tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:19.528958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8fa4e05e-933f-47f1-8a14-a3a2e6cb71aa tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:19.535436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8fa4e05e-933f-47f1-8a14-a3a2e6cb71aa tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:19.536032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8fa4e05e-933f-47f1-8a14-a3a2e6cb71aa tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:19.560680 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-8fa4e05e-933f-47f1-8a14-a3a2e6cb71aa tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] HTTP exception thrown: Instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 could not be found. May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8fa4e05e-933f-47f1-8a14-a3a2e6cb71aa tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Request method failure captured: May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 HTTP/1.1 May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVYcSiyjAIR82oxkRB6GTuWAKVTX4xG5vMYtW_3BeBGCFxFQjKbNKPB4C0xhPGbN3kZTd0vkZOYFJP4MJ1kk_eZN0RsUqNmA1UP-b-s9HcyrYiVjgp1H1dIVPKi3UtrJ4Ob8-qkiVNLHvP2GMr_o_p2pBItaNXntU_KoEaP7ETd6R3M May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85f6ae1864ee43429c910eb27888608f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 186310904c3943fdb63247b58725140e May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 could not be found. May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'b58aadd3-11a8-41dc-9104-b6082e4eeb06'} May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 could not be found. May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:16:19.565078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:16:19.582048 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 could not be found. May 21 21:16:19.582048 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:19.582048 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:19.582048 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:19.582048 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:19.582048 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:19.582048 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:19.582048 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:19.582048 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:19.582048 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 could not be found. May 21 21:16:19.582048 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:19.582048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8fa4e05e-933f-47f1-8a14-a3a2e6cb71aa tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Returning 404 to user: Instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:19.582048 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8fa4e05e-933f-47f1-8a14-a3a2e6cb71aa tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 404 len: 111 microversion: 2.1 time: 0.054217 May 21 21:16:19.582048 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 828/1634] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:16:19 2022] DELETE /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:16:19.582048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5195e669-2c59-418e-b177-445f169b08f2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:19.582048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5195e669-2c59-418e-b177-445f169b08f2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] [instance: b58aadd3-11a8-41dc-9104-b6082e4eeb06] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:19.590673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5195e669-2c59-418e-b177-445f169b08f2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:19.591951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5195e669-2c59-418e-b177-445f169b08f2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:19.593086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5195e669-2c59-418e-b177-445f169b08f2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:19.594017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5195e669-2c59-418e-b177-445f169b08f2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:19.615289 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-5195e669-2c59-418e-b177-445f169b08f2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] HTTP exception thrown: Instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 could not be found. May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5195e669-2c59-418e-b177-445f169b08f2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Request method failure captured: May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 HTTP/1.1 May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVYcSiyjAIR82oxkRB6GTuWAKVTX4xG5vMYtW_3BeBGCFxFQjKbNKPB4C0xhPGbN3kZTd0vkZOYFJP4MJ1kk_eZN0RsUqNmA1UP-b-s9HcyrYiVjgp1H1dIVPKi3UtrJ4Ob8-qkiVNLHvP2GMr_o_p2pBItaNXntU_KoEaP7ETd6R3M May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_85f6ae1864ee43429c910eb27888608f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/85f6ae1864ee43429c910eb27888608f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 85f6ae1864ee43429c910eb27888608f May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-581910967 May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 186310904c3943fdb63247b58725140e May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-581910967-project May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 could not be found. May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'b58aadd3-11a8-41dc-9104-b6082e4eeb06'} May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 could not be found. May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 could not be found. May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:19.618709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:19.624594 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:19.624594 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:19.624594 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:19.624594 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:19.624594 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:19.624594 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:19.624594 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 could not be found. May 21 21:16:19.624594 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:19.624594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5195e669-2c59-418e-b177-445f169b08f2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] Returning 404 to user: Instance b58aadd3-11a8-41dc-9104-b6082e4eeb06 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:19.624594 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5195e669-2c59-418e-b177-445f169b08f2 tempest-ImagesOneServerNegativeTestJSON-581910967 tempest-ImagesOneServerNegativeTestJSON-581910967-project] 10.222.0.49 "GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06" status: 404 len: 111 microversion: 2.1 time: 0.047984 May 21 21:16:19.624594 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 829/1635] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:19 2022] GET /compute/v2.1/servers/b58aadd3-11a8-41dc-9104-b6082e4eeb06 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:16:19.752202 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d6e4c1fc-d4c9-4358-bc83-73b106a746f3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "POST /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed/action" status: 202 len: 0 microversion: 2.1 time: 2.220167 May 21 21:16:19.752873 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 807/1636] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:16:17 2022] POST /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed/action => generated 0 bytes in 2223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:19.765621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-03326855-dd28-4413-931f-8f7f371b93ee tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81b4ba040>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:20.084915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG neutronclient.v2_0.client [None req-03326855-dd28-4413-931f-8f7f371b93ee tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group c579f2cf-2903-4ff5-b25b-504fe5aba452 in use.", "detail": ""}} {{(pid=131277) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:16:20.086457 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-03326855-dd28-4413-931f-8f7f371b93ee tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] HTTP exception thrown: Security Group c579f2cf-2903-4ff5-b25b-504fe5aba452 in use. May 21 21:16:20.086457 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-315b1f8b-5f25-4fa1-8c5f-80d6a3a57bdb'] May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-03326855-dd28-4413-931f-8f7f371b93ee tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Request method failure captured: May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/os-security-groups/c579f2cf-2903-4ff5-b25b-504fe5aba452 HTTP/1.1 May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZSCYysyyOTwVzhR_Vt3Rp4hJGlHQ1xQ5d6hFUxjxvsTAgt6ix0UNE2Z2Vln9ahBs6pfbfiUV8DEik3Vk1FDugBkn4AbmOx4uTGzwiP9EUa_o0XQmPT-P2Agu2oeG_4YhdEiPrs-TaOwa6w5WGXcLQM63lci1mbOXuKdXB18YVm1Hg May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/53774c838bd64b319776f9afa0821b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_53774c838bd64b319776f9afa0821b79", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 5e82c479130c4377a9a27dd7c8bbe611 May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: exception: Security Group c579f2cf-2903-4ff5-b25b-504fe5aba452 in use. May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-315b1f8b-5f25-4fa1-8c5f-80d6a3a57bdb'] May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'c579f2cf-2903-4ff5-b25b-504fe5aba452'} May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:16:20.089289 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group c579f2cf-2903-4ff5-b25b-504fe5aba452 in use. May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-315b1f8b-5f25-4fa1-8c5f-80d6a3a57bdb'] May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group c579f2cf-2903-4ff5-b25b-504fe5aba452 in use. May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-315b1f8b-5f25-4fa1-8c5f-80d6a3a57bdb'] May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group c579f2cf-2903-4ff5-b25b-504fe5aba452 in use. May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-315b1f8b-5f25-4fa1-8c5f-80d6a3a57bdb'] May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group c579f2cf-2903-4ff5-b25b-504fe5aba452 in use. May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-315b1f8b-5f25-4fa1-8c5f-80d6a3a57bdb'] May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-03326855-dd28-4413-931f-8f7f371b93ee tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Returning 400 to user: Security Group c579f2cf-2903-4ff5-b25b-504fe5aba452 in use. May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-315b1f8b-5f25-4fa1-8c5f-80d6a3a57bdb'] {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-03326855-dd28-4413-931f-8f7f371b93ee tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/c579f2cf-2903-4ff5-b25b-504fe5aba452" status: 400 len: 185 microversion: 2.1 time: 0.333608 May 21 21:16:20.096648 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 830/1637] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:19 2022] DELETE /compute/v2.1/os-security-groups/c579f2cf-2903-4ff5-b25b-504fe5aba452 => generated 185 bytes in 335 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:16:20.111186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-46e80554-a62d-425b-9946-748fc01f8ddb tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:20.120729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-46e80554-a62d-425b-9946-748fc01f8ddb tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:20.131698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-deb7f7ff-ad77-4611-9992-7fa2b0f9a035 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:20.137008 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-deb7f7ff-ad77-4611-9992-7fa2b0f9a035 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:20.137610 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-46e80554-a62d-425b-9946-748fc01f8ddb tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:20.142968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-46e80554-a62d-425b-9946-748fc01f8ddb tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:20.144167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-46e80554-a62d-425b-9946-748fc01f8ddb tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:20.144817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-46e80554-a62d-425b-9946-748fc01f8ddb tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:20.167519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-deb7f7ff-ad77-4611-9992-7fa2b0f9a035 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:20.172995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-deb7f7ff-ad77-4611-9992-7fa2b0f9a035 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:20.174048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-deb7f7ff-ad77-4611-9992-7fa2b0f9a035 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:20.178107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-deb7f7ff-ad77-4611-9992-7fa2b0f9a035 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:20.265795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:20.467114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-deb7f7ff-ad77-4611-9992-7fa2b0f9a035 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:20.475677 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-deb7f7ff-ad77-4611-9992-7fa2b0f9a035 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1497 microversion: 2.1 time: 0.351861 May 21 21:16:20.480341 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 831/1638] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:20 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1497 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:20.482083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-995650bc-b537-454f-ae7e-3b3b6257f50c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:20.482769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-995650bc-b537-454f-ae7e-3b3b6257f50c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:20.488921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-995650bc-b537-454f-ae7e-3b3b6257f50c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:20.489428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-995650bc-b537-454f-ae7e-3b3b6257f50c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:20.490160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-995650bc-b537-454f-ae7e-3b3b6257f50c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:20.490604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-995650bc-b537-454f-ae7e-3b3b6257f50c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:20.595683 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-46e80554-a62d-425b-9946-748fc01f8ddb tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "POST /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed/action" status: 202 len: 0 microversion: 2.1 time: 0.490833 May 21 21:16:20.612535 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 808/1639] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:16:20 2022] POST /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:20.630761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8d4d33e3-9649-440e-acde-bd2deb9bb1cd tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:20.631774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8d4d33e3-9649-440e-acde-bd2deb9bb1cd tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: f0525194-b3aa-482c-a355-c77c63bf4c88] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:20.642445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d4d33e3-9649-440e-acde-bd2deb9bb1cd tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:20.643310 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d4d33e3-9649-440e-acde-bd2deb9bb1cd tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:20.644172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d4d33e3-9649-440e-acde-bd2deb9bb1cd tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:20.644856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d4d33e3-9649-440e-acde-bd2deb9bb1cd tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:20.672938 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-8d4d33e3-9649-440e-acde-bd2deb9bb1cd tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] HTTP exception thrown: Instance f0525194-b3aa-482c-a355-c77c63bf4c88 could not be found. May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8d4d33e3-9649-440e-acde-bd2deb9bb1cd tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Request method failure captured: May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 HTTP/1.1 May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVYhEbJ6ZOK0Z6965ozrygWo_e-qZZxbQM8dGzJRZt3q6N_vrVD19Z-SWpGjuo68E5D6Dt_BiyawKSyx15R1qB1IiJ3n6JLZUVNe5EGQy2AJxxBmtLBXt8d7gMe4YgR9IDGiaFQcA9iJF2VYsnq2_HAPkyKim99JBdcxlXAvvzJKqBM May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 0e8dbd3049724928a8db6771b70ad38b May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ListImageFiltersTestJSON-833126973 May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0e8dbd3049724928a8db6771b70ad38b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e8dbd3049724928a8db6771b70ad38b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0e8dbd3049724928a8db6771b70ad38b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e8dbd3049724928a8db6771b70ad38b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ListImageFiltersTestJSON-833126973 May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 0e8dbd3049724928a8db6771b70ad38b May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-833126973 May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ListImageFiltersTestJSON-833126973-project May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 8b5d5f69b7c04811b9dc36daaa17079a May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ListImageFiltersTestJSON-833126973-project May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance f0525194-b3aa-482c-a355-c77c63bf4c88 could not be found. May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'f0525194-b3aa-482c-a355-c77c63bf4c88'} May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0525194-b3aa-482c-a355-c77c63bf4c88 could not be found. May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0525194-b3aa-482c-a355-c77c63bf4c88 could not be found. May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:20.675432 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:20.683280 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:20.683280 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:20.683280 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:20.683280 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:20.683280 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:20.683280 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0525194-b3aa-482c-a355-c77c63bf4c88 could not be found. May 21 21:16:20.683280 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:20.689720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-995650bc-b537-454f-ae7e-3b3b6257f50c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:20.703123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8d4d33e3-9649-440e-acde-bd2deb9bb1cd tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Returning 404 to user: Instance f0525194-b3aa-482c-a355-c77c63bf4c88 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:20.703123 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8d4d33e3-9649-440e-acde-bd2deb9bb1cd tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88" status: 404 len: 111 microversion: 2.1 time: 0.080659 May 21 21:16:20.703123 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 809/1640] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:20 2022] GET /compute/v2.1/servers/f0525194-b3aa-482c-a355-c77c63bf4c88 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:16:20.703459 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-995650bc-b537-454f-ae7e-3b3b6257f50c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1475 microversion: 2.1 time: 0.223670 May 21 21:16:20.710251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5247f1b4-d8e3-4395-8690-2bba3cea4e62 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:20.713709 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 832/1641] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:20 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1475 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:20.715583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5247f1b4-d8e3-4395-8690-2bba3cea4e62 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:20.731240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-978ce073-7dfd-4ceb-a12f-7e0432efd970 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:20.731448 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5247f1b4-d8e3-4395-8690-2bba3cea4e62 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:20.732013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5247f1b4-d8e3-4395-8690-2bba3cea4e62 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:20.737087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-978ce073-7dfd-4ceb-a12f-7e0432efd970 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: 55818247-81af-4cf1-bff3-92aeb3f06bba] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:20.737245 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5247f1b4-d8e3-4395-8690-2bba3cea4e62 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:20.737245 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5247f1b4-d8e3-4395-8690-2bba3cea4e62 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:20.747341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-978ce073-7dfd-4ceb-a12f-7e0432efd970 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:20.747801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-978ce073-7dfd-4ceb-a12f-7e0432efd970 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:20.752716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-978ce073-7dfd-4ceb-a12f-7e0432efd970 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:20.753181 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-978ce073-7dfd-4ceb-a12f-7e0432efd970 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:20.812819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-978ce073-7dfd-4ceb-a12f-7e0432efd970 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: 55818247-81af-4cf1-bff3-92aeb3f06bba] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:16:21.138579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5247f1b4-d8e3-4395-8690-2bba3cea4e62 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:21.146601 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5247f1b4-d8e3-4395-8690-2bba3cea4e62 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 200 len: 1572 microversion: 2.1 time: 0.446759 May 21 21:16:21.153634 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 810/1642] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:20 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 1572 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:21.241379 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-978ce073-7dfd-4ceb-a12f-7e0432efd970 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "DELETE /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba" status: 204 len: 0 microversion: 2.1 time: 0.525460 May 21 21:16:21.242353 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 833/1643] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:16:20 2022] DELETE /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:16:21.250794 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8dde0eae-1436-4a1b-b33b-458d42f66c8b tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:21.251412 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8dde0eae-1436-4a1b-b33b-458d42f66c8b tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: 55818247-81af-4cf1-bff3-92aeb3f06bba] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:21.268333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8dde0eae-1436-4a1b-b33b-458d42f66c8b tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:21.269069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8dde0eae-1436-4a1b-b33b-458d42f66c8b tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:21.269865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8dde0eae-1436-4a1b-b33b-458d42f66c8b tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:21.270308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8dde0eae-1436-4a1b-b33b-458d42f66c8b tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:21.374927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-a80c36c3-ef0d-4f71-ac82-fa517667fe71 req-2eb383a4-6b34-4743-b97c-2b7f29207f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add2b490-a27b-434c-9ff5-aa58ee869b78", "name": "network-vif-unplugged", "status": "completed", "tag": "6bd26e7a-5e3e-4a20-8012-db2830ba8f9e"}, {"name": "network-changed", "server_uuid": "bd8944e0-b77d-4aa0-8d85-b98814346aed", "tag": "950b352f-54b2-4352-a24b-093df72e9046"}, {"name": "network-changed", "server_uuid": "add2b490-a27b-434c-9ff5-aa58ee869b78", "tag": "6bd26e7a-5e3e-4a20-8012-db2830ba8f9e"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:21.390507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a80c36c3-ef0d-4f71-ac82-fa517667fe71 req-2eb383a4-6b34-4743-b97c-2b7f29207f28 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:21.391036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a80c36c3-ef0d-4f71-ac82-fa517667fe71 req-2eb383a4-6b34-4743-b97c-2b7f29207f28 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:21.418940 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a80c36c3-ef0d-4f71-ac82-fa517667fe71 req-2eb383a4-6b34-4743-b97c-2b7f29207f28 service nova] Creating event network-vif-unplugged:6bd26e7a-5e3e-4a20-8012-db2830ba8f9e for instance add2b490-a27b-434c-9ff5-aa58ee869b78 on nch1-master-1 May 21 21:16:21.423405 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a80c36c3-ef0d-4f71-ac82-fa517667fe71 req-2eb383a4-6b34-4743-b97c-2b7f29207f28 service nova] Creating event network-changed:950b352f-54b2-4352-a24b-093df72e9046 for instance bd8944e0-b77d-4aa0-8d85-b98814346aed on nch1-master-1 May 21 21:16:21.424889 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a80c36c3-ef0d-4f71-ac82-fa517667fe71 req-2eb383a4-6b34-4743-b97c-2b7f29207f28 service nova] Creating event network-changed:6bd26e7a-5e3e-4a20-8012-db2830ba8f9e for instance add2b490-a27b-434c-9ff5-aa58ee869b78 on nch1-master-1 May 21 21:16:21.447506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [req-a80c36c3-ef0d-4f71-ac82-fa517667fe71 req-2eb383a4-6b34-4743-b97c-2b7f29207f28 service nova] Instance add2b490-a27b-434c-9ff5-aa58ee869b78 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 21:16:21.473867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8dde0eae-1436-4a1b-b33b-458d42f66c8b tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:21.479439 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-a80c36c3-ef0d-4f71-ac82-fa517667fe71 req-2eb383a4-6b34-4743-b97c-2b7f29207f28 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.108126 May 21 21:16:21.480625 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 834/1644] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:21.489827 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8dde0eae-1436-4a1b-b33b-458d42f66c8b tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba" status: 200 len: 1471 microversion: 2.1 time: 0.242910 May 21 21:16:21.495711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-73d457b0-a3e4-450c-9828-6363e98bb820 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:21.496976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-73d457b0-a3e4-450c-9828-6363e98bb820 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:21.501621 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 811/1645] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:21 2022] GET /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba => generated 1471 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:21.504043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-73d457b0-a3e4-450c-9828-6363e98bb820 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:21.504766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-73d457b0-a3e4-450c-9828-6363e98bb820 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:21.505546 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-73d457b0-a3e4-450c-9828-6363e98bb820 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:21.506099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-73d457b0-a3e4-450c-9828-6363e98bb820 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:21.722909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7986ec31-98d3-40d3-a9c6-694b435ec3ab tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:21.723365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7986ec31-98d3-40d3-a9c6-694b435ec3ab tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:21.732361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7986ec31-98d3-40d3-a9c6-694b435ec3ab tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:21.732865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7986ec31-98d3-40d3-a9c6-694b435ec3ab tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:21.733889 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7986ec31-98d3-40d3-a9c6-694b435ec3ab tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:21.734345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7986ec31-98d3-40d3-a9c6-694b435ec3ab tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:21.789505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-73d457b0-a3e4-450c-9828-6363e98bb820 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:21.799793 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-73d457b0-a3e4-450c-9828-6363e98bb820 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1497 microversion: 2.1 time: 0.310392 May 21 21:16:21.801229 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 835/1646] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:21 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1497 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:16:21.892153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7986ec31-98d3-40d3-a9c6-694b435ec3ab tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:21.907454 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7986ec31-98d3-40d3-a9c6-694b435ec3ab tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1473 microversion: 2.1 time: 0.181851 May 21 21:16:21.907454 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 812/1647] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:21 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1473 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:22.171249 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f1731010-ed40-4f54-8806-451acfcd4cc8 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:22.171830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f1731010-ed40-4f54-8806-451acfcd4cc8 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:22.179092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1731010-ed40-4f54-8806-451acfcd4cc8 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:22.179931 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1731010-ed40-4f54-8806-451acfcd4cc8 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:22.180993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1731010-ed40-4f54-8806-451acfcd4cc8 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:22.181188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1731010-ed40-4f54-8806-451acfcd4cc8 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:22.365915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f1731010-ed40-4f54-8806-451acfcd4cc8 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:22.376429 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f1731010-ed40-4f54-8806-451acfcd4cc8 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 200 len: 1572 microversion: 2.1 time: 0.209406 May 21 21:16:22.381561 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 836/1648] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:22 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 1572 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:22.507967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-33aaf786-483d-4dd5-801d-89c14d3723ef tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:22.508735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-33aaf786-483d-4dd5-801d-89c14d3723ef tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: 55818247-81af-4cf1-bff3-92aeb3f06bba] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:22.516593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33aaf786-483d-4dd5-801d-89c14d3723ef tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:22.517049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33aaf786-483d-4dd5-801d-89c14d3723ef tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:22.517831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33aaf786-483d-4dd5-801d-89c14d3723ef tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:22.518275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33aaf786-483d-4dd5-801d-89c14d3723ef tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:22.682749 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-33aaf786-483d-4dd5-801d-89c14d3723ef tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:22.691659 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-33aaf786-483d-4dd5-801d-89c14d3723ef tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba" status: 200 len: 1471 microversion: 2.1 time: 0.187825 May 21 21:16:22.692346 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 813/1649] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:22 2022] GET /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba => generated 1471 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:22.818367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8698e5b2-9c99-4ba8-8c36-8228c7ca7d4c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:22.820482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8698e5b2-9c99-4ba8-8c36-8228c7ca7d4c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:22.828142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8698e5b2-9c99-4ba8-8c36-8228c7ca7d4c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:22.828719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8698e5b2-9c99-4ba8-8c36-8228c7ca7d4c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:22.829589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8698e5b2-9c99-4ba8-8c36-8228c7ca7d4c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:22.830182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8698e5b2-9c99-4ba8-8c36-8228c7ca7d4c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:22.919447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e2273929-ba51-4df5-b7af-bc2e81ef6dac tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:22.920544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e2273929-ba51-4df5-b7af-bc2e81ef6dac tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:22.947866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e2273929-ba51-4df5-b7af-bc2e81ef6dac tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:22.948639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e2273929-ba51-4df5-b7af-bc2e81ef6dac tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:22.949613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e2273929-ba51-4df5-b7af-bc2e81ef6dac tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:22.950258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e2273929-ba51-4df5-b7af-bc2e81ef6dac tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:23.141826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8698e5b2-9c99-4ba8-8c36-8228c7ca7d4c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:23.155499 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8698e5b2-9c99-4ba8-8c36-8228c7ca7d4c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1497 microversion: 2.1 time: 0.341743 May 21 21:16:23.157661 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 837/1650] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:22 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1497 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:23.394139 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-adfc84e9-40d2-4a73-a59f-136d01f6627c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:23.395757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-adfc84e9-40d2-4a73-a59f-136d01f6627c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:23.408655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-adfc84e9-40d2-4a73-a59f-136d01f6627c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:23.410295 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-adfc84e9-40d2-4a73-a59f-136d01f6627c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:23.412464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-adfc84e9-40d2-4a73-a59f-136d01f6627c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:23.415321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-adfc84e9-40d2-4a73-a59f-136d01f6627c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:23.560093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e2273929-ba51-4df5-b7af-bc2e81ef6dac tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:23.576327 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e2273929-ba51-4df5-b7af-bc2e81ef6dac tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1473 microversion: 2.1 time: 0.661504 May 21 21:16:23.577050 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 814/1651] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:22 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1473 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:23.753766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f0512bac-eed8-464d-b2e5-b1750f8486a6 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:23.755361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f0512bac-eed8-464d-b2e5-b1750f8486a6 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: 55818247-81af-4cf1-bff3-92aeb3f06bba] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:23.776625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0512bac-eed8-464d-b2e5-b1750f8486a6 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:23.777418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0512bac-eed8-464d-b2e5-b1750f8486a6 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:23.778424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0512bac-eed8-464d-b2e5-b1750f8486a6 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:23.779039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0512bac-eed8-464d-b2e5-b1750f8486a6 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:23.853118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-adfc84e9-40d2-4a73-a59f-136d01f6627c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:23.868133 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-adfc84e9-40d2-4a73-a59f-136d01f6627c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 200 len: 1572 microversion: 2.1 time: 0.478096 May 21 21:16:23.869018 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 838/1652] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:23 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 1572 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:16:24.074908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-69c8b051-7b71-4247-b6a5-f12f93db9ea5 tempest-ListImageFiltersNegativeTestJSON-1786555157 tempest-ListImageFiltersNegativeTestJSON-1786555157-project] Calling method '.version_select at 0x7fc81b8f3430>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:24.116234 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-69c8b051-7b71-4247-b6a5-f12f93db9ea5 tempest-ListImageFiltersNegativeTestJSON-1786555157 tempest-ListImageFiltersNegativeTestJSON-1786555157-project] HTTP exception thrown: Image not found. May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-69c8b051-7b71-4247-b6a5-f12f93db9ea5 tempest-ListImageFiltersNegativeTestJSON-1786555157 tempest-ListImageFiltersNegativeTestJSON-1786555157-project] Request method failure captured: May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/images/c58c30e2-e4fa-459b-8251-f295c0ee358a HTTP/1.1 May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVanO0y3tH2_sNR0S0U61EmKgR7GYlDXJpVXAHV_c7lkbK31kFZB0CCRzOIeu62gF8Zzuer1skn-V62TD1XyAHLk-m86vS88f3KfvzyRqqAjYEeVZuQWTFrCl7KqbrmUF3egMExmdJpy0SYHBtlNdKN0Sa2-xkSy2G6Ltx0PWrrD0FQ May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 7aebcebb5c2d447a981666430e588dbf May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1786555157 May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7aebcebb5c2d447a981666430e588dbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7aebcebb5c2d447a981666430e588dbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7aebcebb5c2d447a981666430e588dbf", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7aebcebb5c2d447a981666430e588dbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1786555157 May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 7aebcebb5c2d447a981666430e588dbf May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1786555157 May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ListImageFiltersNegativeTestJSON-1786555157-project May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: df0400b0c65743ff89e02e65060b5422 May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1786555157-project May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: exception: Image not found. May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'c58c30e2-e4fa-459b-8251-f295c0ee358a'} May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c58c30e2-e4fa-459b-8251-f295c0ee358a May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 21 21:16:24.119341 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c58c30e2-e4fa-459b-8251-f295c0ee358a could not be found. May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:16:24.123739 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:24.129433 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-69c8b051-7b71-4247-b6a5-f12f93db9ea5 tempest-ListImageFiltersNegativeTestJSON-1786555157 tempest-ListImageFiltersNegativeTestJSON-1786555157-project] Returning 404 to user: Image not found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:24.130537 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-69c8b051-7b71-4247-b6a5-f12f93db9ea5 tempest-ListImageFiltersNegativeTestJSON-1786555157 tempest-ListImageFiltersNegativeTestJSON-1786555157-project] 10.222.0.49 "GET /compute/v2.1/images/c58c30e2-e4fa-459b-8251-f295c0ee358a" status: 404 len: 62 microversion: 2.1 time: 0.215595 May 21 21:16:24.131113 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 839/1653] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:23 2022] GET /compute/v2.1/images/c58c30e2-e4fa-459b-8251-f295c0ee358a => generated 62 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 21 21:16:24.160004 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f0512bac-eed8-464d-b2e5-b1750f8486a6 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:24.170144 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f0512bac-eed8-464d-b2e5-b1750f8486a6 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba" status: 200 len: 1471 microversion: 2.1 time: 0.460720 May 21 21:16:24.171022 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 815/1654] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:23 2022] GET /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba => generated 1471 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:24.175097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2d010dcd-d433-4494-a70f-13f5b841e734 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:24.175785 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2d010dcd-d433-4494-a70f-13f5b841e734 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:24.194565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2d010dcd-d433-4494-a70f-13f5b841e734 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:24.196595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2d010dcd-d433-4494-a70f-13f5b841e734 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:24.197646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2d010dcd-d433-4494-a70f-13f5b841e734 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:24.204675 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2d010dcd-d433-4494-a70f-13f5b841e734 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:24.488861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2d010dcd-d433-4494-a70f-13f5b841e734 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:24.498405 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2d010dcd-d433-4494-a70f-13f5b841e734 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1497 microversion: 2.1 time: 0.326944 May 21 21:16:24.502381 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 840/1655] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:24 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1497 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:24.576187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-b72689f5-2836-4eda-90e5-0c90c391d46c req-f733b925-b240-4fe5-b598-b81e9f148f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55818247-81af-4cf1-bff3-92aeb3f06bba", "name": "network-vif-deleted", "tag": "d78ce8f3-1b0e-4e09-b2ee-8d7b3fe8530e"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:24.587671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b72689f5-2836-4eda-90e5-0c90c391d46c req-f733b925-b240-4fe5-b598-b81e9f148f2d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:24.588502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b72689f5-2836-4eda-90e5-0c90c391d46c req-f733b925-b240-4fe5-b598-b81e9f148f2d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:24.593526 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-57e1b228-f73b-43f6-87be-b9caf227461b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:24.594150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-57e1b228-f73b-43f6-87be-b9caf227461b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:24.604823 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-b72689f5-2836-4eda-90e5-0c90c391d46c req-f733b925-b240-4fe5-b598-b81e9f148f2d service nova] Creating event network-vif-deleted:d78ce8f3-1b0e-4e09-b2ee-8d7b3fe8530e for instance 55818247-81af-4cf1-bff3-92aeb3f06bba on nch2-master-1 May 21 21:16:24.605260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57e1b228-f73b-43f6-87be-b9caf227461b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:24.605722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57e1b228-f73b-43f6-87be-b9caf227461b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:24.611491 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-b72689f5-2836-4eda-90e5-0c90c391d46c req-f733b925-b240-4fe5-b598-b81e9f148f2d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038900 May 21 21:16:24.612786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57e1b228-f73b-43f6-87be-b9caf227461b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:24.613280 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57e1b228-f73b-43f6-87be-b9caf227461b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:24.613531 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 816/1656] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:24.689846 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=16 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:24.767246 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f5d4d267-5a49-47df-8158-181ecf5d028c tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Action: 'create', calling method: .version_select at 0x7fc81b3c0820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-704888334", "description": "tempest-description-1436780479"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:24.938628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-57e1b228-f73b-43f6-87be-b9caf227461b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:24.948476 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-57e1b228-f73b-43f6-87be-b9caf227461b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1470 microversion: 2.1 time: 0.359668 May 21 21:16:24.949466 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 841/1657] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:24 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1470 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:16:24.954554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-067294ac-5c7c-4636-a5f9-3a32b7389019 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:24.955392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-067294ac-5c7c-4636-a5f9-3a32b7389019 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:24.966761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-067294ac-5c7c-4636-a5f9-3a32b7389019 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:24.970623 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-067294ac-5c7c-4636-a5f9-3a32b7389019 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:24.973375 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-067294ac-5c7c-4636-a5f9-3a32b7389019 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:24.976952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-067294ac-5c7c-4636-a5f9-3a32b7389019 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:24.989500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:25.403940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-067294ac-5c7c-4636-a5f9-3a32b7389019 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:25.414340 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-067294ac-5c7c-4636-a5f9-3a32b7389019 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 200 len: 1570 microversion: 2.1 time: 0.463742 May 21 21:16:25.425349 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 842/1658] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:24 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 1570 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:25.425349 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a5ea0a7b-8a92-4b1c-a875-989e2b01242f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:25.425349 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a5ea0a7b-8a92-4b1c-a875-989e2b01242f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:25.430963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5ea0a7b-8a92-4b1c-a875-989e2b01242f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:25.431497 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5ea0a7b-8a92-4b1c-a875-989e2b01242f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:25.432926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5ea0a7b-8a92-4b1c-a875-989e2b01242f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:25.433425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5ea0a7b-8a92-4b1c-a875-989e2b01242f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:25.529015 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f5d4d267-5a49-47df-8158-181ecf5d028c tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.857934 May 21 21:16:25.531263 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 817/1659] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:16:24 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:16:25.546598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0d312116-3300-4b19-ba80-78ce119562db tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:25.548661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0d312116-3300-4b19-ba80-78ce119562db tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: 55818247-81af-4cf1-bff3-92aeb3f06bba] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:25.556822 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d312116-3300-4b19-ba80-78ce119562db tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:25.557447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d312116-3300-4b19-ba80-78ce119562db tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:25.558341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d312116-3300-4b19-ba80-78ce119562db tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:25.559155 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d312116-3300-4b19-ba80-78ce119562db tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:25.595128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d312116-3300-4b19-ba80-78ce119562db tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:25.595836 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d312116-3300-4b19-ba80-78ce119562db tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:25.596026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-0d312116-3300-4b19-ba80-78ce119562db tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lazy-loading 'fault' on Instance uuid 55818247-81af-4cf1-bff3-92aeb3f06bba {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:16:25.649565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0d312116-3300-4b19-ba80-78ce119562db tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5d5f69b7c04811b9dc36daaa17079a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8dbd3049724928a8db6771b70ad38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:25.661380 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0d312116-3300-4b19-ba80-78ce119562db tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba" status: 200 len: 1307 microversion: 2.1 time: 0.126462 May 21 21:16:25.662551 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 818/1660] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:25 2022] GET /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba => generated 1307 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:25.668726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b1956b4e-4752-43e8-8165-fec57920bff3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1368768381"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:25.669269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b1956b4e-4752-43e8-8165-fec57920bff3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:25.678579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b1956b4e-4752-43e8-8165-fec57920bff3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:25.678956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b1956b4e-4752-43e8-8165-fec57920bff3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:25.680451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b1956b4e-4752-43e8-8165-fec57920bff3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:25.681717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b1956b4e-4752-43e8-8165-fec57920bff3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:25.848846 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.network.security_group_api [None req-b1956b4e-4752-43e8-8165-fec57920bff3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Adding security group d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 to port 950b352f-54b2-4352-a24b-093df72e9046 May 21 21:16:25.878109 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a5ea0a7b-8a92-4b1c-a875-989e2b01242f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "POST /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78/action" status: 202 len: 0 microversion: 2.1 time: 0.461906 May 21 21:16:25.881789 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 843/1661] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:16:25 2022] POST /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:25.884793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-06b936bc-e8dc-43b3-9f7f-768c0fc0b671 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:25.885550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-06b936bc-e8dc-43b3-9f7f-768c0fc0b671 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:25.894503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06b936bc-e8dc-43b3-9f7f-768c0fc0b671 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:25.895108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06b936bc-e8dc-43b3-9f7f-768c0fc0b671 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:25.895774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06b936bc-e8dc-43b3-9f7f-768c0fc0b671 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:25.896219 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06b936bc-e8dc-43b3-9f7f-768c0fc0b671 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:26.132719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-06b936bc-e8dc-43b3-9f7f-768c0fc0b671 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:26.147245 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-06b936bc-e8dc-43b3-9f7f-768c0fc0b671 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1497 microversion: 2.1 time: 0.266877 May 21 21:16:26.147848 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 844/1662] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:25 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1497 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:26.154863 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aa96e71d-d593-44e5-b3b9-8e3790ca6761 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Action: 'create', calling method: .version_select at 0x7fc81b6aa4c0>, body: {"security_group_rule": {"parent_group_id": "27d6875d-77eb-47c4-b877-caf055ea2823", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:26.571704 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b1956b4e-4752-43e8-8165-fec57920bff3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "POST /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed/action" status: 202 len: 0 microversion: 2.1 time: 0.907866 May 21 21:16:26.573030 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 819/1663] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:16:25 2022] POST /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed/action => generated 0 bytes in 910 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:26.580459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dd248742-4831-4c45-b0cc-e7a2b902af98 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:26.581897 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dd248742-4831-4c45-b0cc-e7a2b902af98 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:26.597760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd248742-4831-4c45-b0cc-e7a2b902af98 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:26.598725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd248742-4831-4c45-b0cc-e7a2b902af98 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:26.603594 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd248742-4831-4c45-b0cc-e7a2b902af98 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:26.606135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd248742-4831-4c45-b0cc-e7a2b902af98 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:26.860686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dd248742-4831-4c45-b0cc-e7a2b902af98 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:26.870336 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dd248742-4831-4c45-b0cc-e7a2b902af98 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1469 microversion: 2.1 time: 0.295620 May 21 21:16:26.870929 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 820/1664] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:26 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1469 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:26.884852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3c788be9-bab4-46ea-a245-185dc71b5691 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81b4973a0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:27.029893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG neutronclient.v2_0.client [None req-3c788be9-bab4-46ea-a245-185dc71b5691 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 in use.", "detail": ""}} {{(pid=131278) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:16:27.030615 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-3c788be9-bab4-46ea-a245-185dc71b5691 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] HTTP exception thrown: Security Group d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 in use. May 21 21:16:27.030615 ncdv-master-1 devstack@n-api.service[131278]: Neutron server returns request_ids: ['req-97511f75-4440-4853-a02d-768a669d9dcc'] May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3c788be9-bab4-46ea-a245-185dc71b5691 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Request method failure captured: May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/os-security-groups/d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 HTTP/1.1 May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZSCYysyyOTwVzhR_Vt3Rp4hJGlHQ1xQ5d6hFUxjxvsTAgt6ix0UNE2Z2Vln9ahBs6pfbfiUV8DEik3Vk1FDugBkn4AbmOx4uTGzwiP9EUa_o0XQmPT-P2Agu2oeG_4YhdEiPrs-TaOwa6w5WGXcLQM63lci1mbOXuKdXB18YVm1Hg May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/53774c838bd64b319776f9afa0821b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_53774c838bd64b319776f9afa0821b79", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 5e82c479130c4377a9a27dd7c8bbe611 May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: exception: Security Group d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 in use. May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: Neutron server returns request_ids: ['req-97511f75-4440-4853-a02d-768a669d9dcc'] May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'd8cd11c4-e0bc-436e-baf0-a0f3f17e5f02'} May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:16:27.039270 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 in use. May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97511f75-4440-4853-a02d-768a669d9dcc'] May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 in use. May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97511f75-4440-4853-a02d-768a669d9dcc'] May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 in use. May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97511f75-4440-4853-a02d-768a669d9dcc'] May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 in use. May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97511f75-4440-4853-a02d-768a669d9dcc'] May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3c788be9-bab4-46ea-a245-185dc71b5691 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Returning 400 to user: Security Group d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 in use. May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: Neutron server returns request_ids: ['req-97511f75-4440-4853-a02d-768a669d9dcc'] {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3c788be9-bab4-46ea-a245-185dc71b5691 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02" status: 400 len: 185 microversion: 2.1 time: 0.168894 May 21 21:16:27.048695 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 821/1665] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:26 2022] DELETE /compute/v2.1/os-security-groups/d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 => generated 185 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:16:27.052095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-5ee531d6-9087-43ab-ba07-a9d407610527 req-214a58e1-3a02-47fb-92f5-cb7686dcbdee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd8944e0-b77d-4aa0-8d85-b98814346aed", "tag": "950b352f-54b2-4352-a24b-093df72e9046"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:27.064871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-5ee531d6-9087-43ab-ba07-a9d407610527 req-214a58e1-3a02-47fb-92f5-cb7686dcbdee service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:27.066166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-5ee531d6-9087-43ab-ba07-a9d407610527 req-214a58e1-3a02-47fb-92f5-cb7686dcbdee service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:27.080120 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-5ee531d6-9087-43ab-ba07-a9d407610527 req-214a58e1-3a02-47fb-92f5-cb7686dcbdee service nova] Creating event network-changed:950b352f-54b2-4352-a24b-093df72e9046 for instance bd8944e0-b77d-4aa0-8d85-b98814346aed on nch1-master-1 May 21 21:16:27.086741 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-5ee531d6-9087-43ab-ba07-a9d407610527 req-214a58e1-3a02-47fb-92f5-cb7686dcbdee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040337 May 21 21:16:27.089159 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 822/1666] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:27.095186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6c4bb5f0-9524-4ee1-b692-89b09bc958b8 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:27.096099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6c4bb5f0-9524-4ee1-b692-89b09bc958b8 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] [instance: 55818247-81af-4cf1-bff3-92aeb3f06bba] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:27.103983 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c4bb5f0-9524-4ee1-b692-89b09bc958b8 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:27.104851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c4bb5f0-9524-4ee1-b692-89b09bc958b8 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:27.106065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c4bb5f0-9524-4ee1-b692-89b09bc958b8 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:27.106679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c4bb5f0-9524-4ee1-b692-89b09bc958b8 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:27.124627 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-6c4bb5f0-9524-4ee1-b692-89b09bc958b8 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] HTTP exception thrown: Instance 55818247-81af-4cf1-bff3-92aeb3f06bba could not be found. May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6c4bb5f0-9524-4ee1-b692-89b09bc958b8 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Request method failure captured: May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba HTTP/1.1 May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVYhEbJ6ZOK0Z6965ozrygWo_e-qZZxbQM8dGzJRZt3q6N_vrVD19Z-SWpGjuo68E5D6Dt_BiyawKSyx15R1qB1IiJ3n6JLZUVNe5EGQy2AJxxBmtLBXt8d7gMe4YgR9IDGiaFQcA9iJF2VYsnq2_HAPkyKim99JBdcxlXAvvzJKqBM May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 0e8dbd3049724928a8db6771b70ad38b May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ListImageFiltersTestJSON-833126973 May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0e8dbd3049724928a8db6771b70ad38b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e8dbd3049724928a8db6771b70ad38b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0e8dbd3049724928a8db6771b70ad38b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e8dbd3049724928a8db6771b70ad38b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ListImageFiltersTestJSON-833126973 May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 0e8dbd3049724928a8db6771b70ad38b May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-833126973 May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ListImageFiltersTestJSON-833126973-project May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 8b5d5f69b7c04811b9dc36daaa17079a May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ListImageFiltersTestJSON-833126973-project May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 55818247-81af-4cf1-bff3-92aeb3f06bba could not be found. May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '55818247-81af-4cf1-bff3-92aeb3f06bba'} May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55818247-81af-4cf1-bff3-92aeb3f06bba could not be found. May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55818247-81af-4cf1-bff3-92aeb3f06bba could not be found. May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:27.126730 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:27.132022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:27.132022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:27.132022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:27.132022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:27.132022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:27.132022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55818247-81af-4cf1-bff3-92aeb3f06bba could not be found. May 21 21:16:27.132022 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:27.134591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6c4bb5f0-9524-4ee1-b692-89b09bc958b8 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Returning 404 to user: Instance 55818247-81af-4cf1-bff3-92aeb3f06bba could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:27.135694 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6c4bb5f0-9524-4ee1-b692-89b09bc958b8 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "GET /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba" status: 404 len: 111 microversion: 2.1 time: 0.044828 May 21 21:16:27.136544 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 823/1667] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:27 2022] GET /compute/v2.1/servers/55818247-81af-4cf1-bff3-92aeb3f06bba => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:16:27.146742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bca9cadd-bf50-420d-9df8-581d0ee9897e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:27.147525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bca9cadd-bf50-420d-9df8-581d0ee9897e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:27.157610 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bca9cadd-bf50-420d-9df8-581d0ee9897e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:27.158599 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bca9cadd-bf50-420d-9df8-581d0ee9897e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:27.159914 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bca9cadd-bf50-420d-9df8-581d0ee9897e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:27.160927 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bca9cadd-bf50-420d-9df8-581d0ee9897e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:27.198675 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bca9cadd-bf50-420d-9df8-581d0ee9897e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:16:27.270302 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aa96e71d-d593-44e5-b3b9-8e3790ca6761 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.119554 May 21 21:16:27.276479 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 845/1668] 10.222.0.49 () {60 vars in 1194 bytes} [Sat May 21 21:16:26 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:27.279602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d5b7e113-84a2-4769-89a9-1f82a9dda025 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b6519d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:27.658100 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bca9cadd-bf50-420d-9df8-581d0ee9897e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 204 len: 0 microversion: 2.1 time: 0.519269 May 21 21:16:27.662579 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 824/1669] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:16:27 2022] DELETE /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:16:27.671939 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bd3d93b4-24e0-488a-a4c2-f504e9f4281b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:27.672718 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bd3d93b4-24e0-488a-a4c2-f504e9f4281b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:27.693286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bd3d93b4-24e0-488a-a4c2-f504e9f4281b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:27.694483 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bd3d93b4-24e0-488a-a4c2-f504e9f4281b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:27.700181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bd3d93b4-24e0-488a-a4c2-f504e9f4281b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:27.700671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bd3d93b4-24e0-488a-a4c2-f504e9f4281b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:27.875839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:27.888182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bd3d93b4-24e0-488a-a4c2-f504e9f4281b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:27.895842 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bd3d93b4-24e0-488a-a4c2-f504e9f4281b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 200 len: 1474 microversion: 2.1 time: 0.229920 May 21 21:16:27.896440 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 825/1670] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:27 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 1474 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:27.901459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-7102db7a-6d31-4302-8aa2-ee06a705a127 req-8e451d90-45e0-428c-8902-6a80765d0df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add2b490-a27b-434c-9ff5-aa58ee869b78", "name": "network-vif-plugged", "status": "completed", "tag": "6bd26e7a-5e3e-4a20-8012-db2830ba8f9e"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:27.909493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-7102db7a-6d31-4302-8aa2-ee06a705a127 req-8e451d90-45e0-428c-8902-6a80765d0df8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:27.909950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-7102db7a-6d31-4302-8aa2-ee06a705a127 req-8e451d90-45e0-428c-8902-6a80765d0df8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:27.921969 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-7102db7a-6d31-4302-8aa2-ee06a705a127 req-8e451d90-45e0-428c-8902-6a80765d0df8 service nova] Creating event network-vif-plugged:6bd26e7a-5e3e-4a20-8012-db2830ba8f9e for instance add2b490-a27b-434c-9ff5-aa58ee869b78 on nch1-master-1 May 21 21:16:27.927309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [req-7102db7a-6d31-4302-8aa2-ee06a705a127 req-8e451d90-45e0-428c-8902-6a80765d0df8 service nova] Instance add2b490-a27b-434c-9ff5-aa58ee869b78 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 21:16:27.938073 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-7102db7a-6d31-4302-8aa2-ee06a705a127 req-8e451d90-45e0-428c-8902-6a80765d0df8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040478 May 21 21:16:27.938684 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 826/1671] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:27.943816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6f7d67e5-cced-40a3-9c97-0528d15a1d02 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Action: 'create', calling method: .version_select at 0x7fc81b4d3940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1715027580", "description": "tempest-description-1091175988"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:28.199588 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d5b7e113-84a2-4769-89a9-1f82a9dda025 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "DELETE /compute/v2.1/images/b9f0dcc1-c61a-4326-a35c-23a5dcd833e3" status: 204 len: 0 microversion: 2.1 time: 0.926943 May 21 21:16:28.200183 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 846/1672] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:27 2022] DELETE /compute/v2.1/images/b9f0dcc1-c61a-4326-a35c-23a5dcd833e3 => generated 0 bytes in 928 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:16:28.204837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d66ca4bc-084d-4e8f-9ff3-506340bfa49e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:28.205455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d66ca4bc-084d-4e8f-9ff3-506340bfa49e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:28.212842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d66ca4bc-084d-4e8f-9ff3-506340bfa49e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:28.213346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d66ca4bc-084d-4e8f-9ff3-506340bfa49e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:28.214752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d66ca4bc-084d-4e8f-9ff3-506340bfa49e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:28.215212 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d66ca4bc-084d-4e8f-9ff3-506340bfa49e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:28.290857 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6f7d67e5-cced-40a3-9c97-0528d15a1d02 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.350852 May 21 21:16:28.295426 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 827/1673] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:16:27 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:28.383751 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d66ca4bc-084d-4e8f-9ff3-506340bfa49e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:28.391858 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d66ca4bc-084d-4e8f-9ff3-506340bfa49e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 200 len: 1645 microversion: 2.1 time: 0.190561 May 21 21:16:28.392514 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 847/1674] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:28 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 1645 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:28.403515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9e42e957-4d4f-4a82-9586-520047d7e59e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:28.404311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9e42e957-4d4f-4a82-9586-520047d7e59e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:28.407337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-590cd329-fd20-4ad5-bcb4-26218b9cb414 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Action: 'create', calling method: .version_select at 0x7fc81b58ae50>, body: {"keypair": {"name": "tempest-keypair-1202499598", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6LAiYyBGjQSkVe/k28jdSH/PcU9CO9Vu8473QzkWDZD7AdSyqP89blCTKh5FxWl5+SEpgD+a5eOIeRnAkkj8EXAQDeL0XleRuvcjjkOKFrrNsbg9NtCKSJYUrag23tVw=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:28.410904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e42e957-4d4f-4a82-9586-520047d7e59e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:28.411420 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e42e957-4d4f-4a82-9586-520047d7e59e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:28.412209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e42e957-4d4f-4a82-9586-520047d7e59e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:28.412689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e42e957-4d4f-4a82-9586-520047d7e59e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:28.423168 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-590cd329-fd20-4ad5-bcb4-26218b9cb414 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Getting quotas for project 8f0b81af93d840e9be961481800c0082. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:16:28.428518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-590cd329-fd20-4ad5-bcb4-26218b9cb414 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Getting quotas for user d831787c5d6c4355902fc31d4dc1ae8a and project 8f0b81af93d840e9be961481800c0082. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:16:28.539288 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-590cd329-fd20-4ad5-bcb4-26218b9cb414 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.246235 May 21 21:16:28.540018 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 828/1675] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:16:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:28.544809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0a99c58a-6ee9-46cc-9710-bd644ed5e27d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1137260173"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:28.545968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0a99c58a-6ee9-46cc-9710-bd644ed5e27d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:28.552517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a99c58a-6ee9-46cc-9710-bd644ed5e27d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:28.552970 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a99c58a-6ee9-46cc-9710-bd644ed5e27d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:28.553743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a99c58a-6ee9-46cc-9710-bd644ed5e27d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:28.555388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a99c58a-6ee9-46cc-9710-bd644ed5e27d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:28.568742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9e42e957-4d4f-4a82-9586-520047d7e59e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:28.574967 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9e42e957-4d4f-4a82-9586-520047d7e59e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1469 microversion: 2.1 time: 0.177224 May 21 21:16:28.575543 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 848/1676] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:28 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1469 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:28.580896 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c4b8c86b-f9a3-434a-a51a-4cf0fa18e2e7 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81ba1f310>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:28.741956 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=10 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:28.910082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:29.139523 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0a99c58a-6ee9-46cc-9710-bd644ed5e27d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "POST /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b/action" status: 202 len: 0 microversion: 2.1 time: 0.598170 May 21 21:16:29.140228 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 829/1677] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:16:28 2022] POST /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b/action => generated 0 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 21 21:16:29.146239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-95ef302f-cc54-411c-8eaa-240f40e93f66 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Action: 'create', calling method: .version_select at 0x7fc82d196040>, body: {"security_group_rule": {"parent_group_id": "2ff6d3a5-36b2-44e9-a38e-9c0628d535fc", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:29.210223 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c4b8c86b-f9a3-434a-a51a-4cf0fa18e2e7 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "DELETE /compute/v2.1/images/bf502d24-b9bd-4c44-a7b6-df60c68ed75f" status: 204 len: 0 microversion: 2.1 time: 0.632798 May 21 21:16:29.210925 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 849/1678] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:28 2022] DELETE /compute/v2.1/images/bf502d24-b9bd-4c44-a7b6-df60c68ed75f => generated 0 bytes in 635 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:16:29.216010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3cafc53c-9151-44a2-adf6-bbd2e2c8e2c3 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Calling method '.version_select at 0x7fc81b6b0ee0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:29.220877 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:29.224034 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3cafc53c-9151-44a2-adf6-bbd2e2c8e2c3 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs/tempest-keypair-1202499598" status: 200 len: 497 microversion: 2.1 time: 0.012177 May 21 21:16:29.224631 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 850/1679] 10.222.0.49 () {58 vars in 1217 bytes} [Sat May 21 21:16:29 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1202499598 => generated 497 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:29.229418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-84e054f7-9589-4760-9eef-59ea64a34e42 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1731188798", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "d047b92d-2da6-44d2-8e31-01dbad6dd130"}], "block_device_mapping_v2": [{"uuid": "b9ebacac-5f32-42e3-9194-003aee7e2435", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:29.293509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-84e054f7-9589-4760-9eef-59ea64a34e42 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] validate_networks() for [('d047b92d-2da6-44d2-8e31-01dbad6dd130', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:16:29.582142 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-95ef302f-cc54-411c-8eaa-240f40e93f66 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.440129 May 21 21:16:29.582831 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 830/1680] 10.222.0.49 () {60 vars in 1194 bytes} [Sat May 21 21:16:29 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:29.587951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8b73b185-baea-462d-b68a-4ffbff648eee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b57f160>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:29.635886 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8b73b185-baea-462d-b68a-4ffbff648eee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af" status: 200 len: 1412 microversion: 2.1 time: 0.051898 May 21 21:16:29.636496 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 831/1681] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:29 2022] GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af => generated 1412 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:29.641535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a5146fa9-8d04-4109-87c8-1f37aafab892 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] Calling method '.version_select at 0x7fc81b57f310>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:29.867961 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-84e054f7-9589-4760-9eef-59ea64a34e42 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:16:29.868472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-84e054f7-9589-4760-9eef-59ea64a34e42 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:16:29.868881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-84e054f7-9589-4760-9eef-59ea64a34e42 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:16:29.869291 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-84e054f7-9589-4760-9eef-59ea64a34e42 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:16:29.869705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-84e054f7-9589-4760-9eef-59ea64a34e42 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:16:29.879014 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84e054f7-9589-4760-9eef-59ea64a34e42 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:29.879464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84e054f7-9589-4760-9eef-59ea64a34e42 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:29.880264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84e054f7-9589-4760-9eef-59ea64a34e42 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:29.880743 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84e054f7-9589-4760-9eef-59ea64a34e42 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:29.899061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-84e054f7-9589-4760-9eef-59ea64a34e42 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Getting quotas for project 5284da653ac24d73a21e8442609889c9. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:16:29.903745 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-84e054f7-9589-4760-9eef-59ea64a34e42 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Getting quotas for user 34c22f04c3114d46b6b1b1168aa064f5 and project 5284da653ac24d73a21e8442609889c9. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:16:29.964299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-84e054f7-9589-4760-9eef-59ea64a34e42 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:16:29.966439 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-84e054f7-9589-4760-9eef-59ea64a34e42 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b9ebacac-5f32-42e3-9194-003aee7e2435',volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:16:30.160086 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a5146fa9-8d04-4109-87c8-1f37aafab892 tempest-ListImageFiltersTestJSON-833126973 tempest-ListImageFiltersTestJSON-833126973-project] 10.222.0.49 "DELETE /compute/v2.1/images/7f51617f-5c2a-4842-9e1b-89d7ddfa6acb" status: 204 len: 0 microversion: 2.1 time: 0.522262 May 21 21:16:30.161413 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 832/1682] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:29 2022] DELETE /compute/v2.1/images/7f51617f-5c2a-4842-9e1b-89d7ddfa6acb => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:16:30.176065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5a9c8234-a486-4bb3-8460-25713e6590f0 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Calling method '.version_select at 0x7fc81b568700>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:30.342856 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5a9c8234-a486-4bb3-8460-25713e6590f0 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1202499598" status: 202 len: 0 microversion: 2.1 time: 0.180380 May 21 21:16:30.343473 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 833/1683] 10.222.0.49 () {58 vars in 1220 bytes} [Sat May 21 21:16:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1202499598 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:30.348666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3dfaf041-1c9e-4dd2-b453-225ba0ff0a74 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:30.349408 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3dfaf041-1c9e-4dd2-b453-225ba0ff0a74 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:30.356266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3dfaf041-1c9e-4dd2-b453-225ba0ff0a74 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:30.356755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3dfaf041-1c9e-4dd2-b453-225ba0ff0a74 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:30.357536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3dfaf041-1c9e-4dd2-b453-225ba0ff0a74 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:30.357980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3dfaf041-1c9e-4dd2-b453-225ba0ff0a74 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:30.406431 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-84e054f7-9589-4760-9eef-59ea64a34e42 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.180502 May 21 21:16:30.407249 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 851/1684] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:16:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:16:30.433611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7aaf009e-59be-4805-8658-fc3b1c588ed5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:30.447293 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7aaf009e-59be-4805-8658-fc3b1c588ed5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:30.457334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7aaf009e-59be-4805-8658-fc3b1c588ed5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:30.458055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7aaf009e-59be-4805-8658-fc3b1c588ed5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:30.459814 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7aaf009e-59be-4805-8658-fc3b1c588ed5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:30.462690 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7aaf009e-59be-4805-8658-fc3b1c588ed5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:30.661762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7aaf009e-59be-4805-8658-fc3b1c588ed5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:30.676275 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7aaf009e-59be-4805-8658-fc3b1c588ed5 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1469 microversion: 2.1 time: 0.267713 May 21 21:16:30.682711 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 852/1685] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:30 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1469 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:30.696736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1dcc1c19-f36e-4dbc-9e75-1539b32d5027 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Action: 'create', calling method: .version_select at 0x7fc81bd72310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-321182289", "description": "tempest-description-538697800"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:30.735920 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3dfaf041-1c9e-4dd2-b453-225ba0ff0a74 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:30.747728 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3dfaf041-1c9e-4dd2-b453-225ba0ff0a74 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 200 len: 1645 microversion: 2.1 time: 0.402642 May 21 21:16:30.748668 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 834/1686] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:30 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 1645 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:30.753601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8f33d778-a71d-43f6-b316-056182791ef7 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Action: 'create', calling method: .version_select at 0x7fc81b4fe940>, body: {"keypair": {"name": "tempest-keypair-518944877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEggRw4z85+uHuC+87tSn/h7s+fMsa7jA6nhIDMBNq88U8DPdHHuhY0GKT6sZjTUdo+uCMjfTR02ViEla9rP9p110xk/DLeJTV5TabpR6Md8DETrMoKF6ShNVaDWYzVLrw=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:30.781515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-8f33d778-a71d-43f6-b316-056182791ef7 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Getting quotas for project 8f0b81af93d840e9be961481800c0082. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:16:30.787764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-8f33d778-a71d-43f6-b316-056182791ef7 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Getting quotas for user d831787c5d6c4355902fc31d4dc1ae8a and project 8f0b81af93d840e9be961481800c0082. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:16:30.790790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:30.958193 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8f33d778-a71d-43f6-b316-056182791ef7 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.208210 May 21 21:16:30.958800 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 835/1687] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:16:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:30.968527 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f384cc2b-3190-4664-9fd6-a5b59addb7fc tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:30.969157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f384cc2b-3190-4664-9fd6-a5b59addb7fc tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:31.037935 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f384cc2b-3190-4664-9fd6-a5b59addb7fc tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:31.045994 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f384cc2b-3190-4664-9fd6-a5b59addb7fc tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1053 microversion: 2.1 time: 0.082231 May 21 21:16:31.047228 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 836/1688] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:30 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1053 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:31.052115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-623520fe-e1b4-492d-8451-5183a2dd7f92 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b4518b0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:31.104723 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-623520fe-e1b4-492d-8451-5183a2dd7f92 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af" status: 200 len: 1412 microversion: 2.1 time: 0.056207 May 21 21:16:31.110705 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 837/1689] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:31 2022] GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af => generated 1412 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:31.118453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-202b236a-00db-421c-a3a0-4040ab089907 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Calling method '.version_select at 0x7fc81b4fe820>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:31.238060 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-202b236a-00db-421c-a3a0-4040ab089907 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-518944877" status: 202 len: 0 microversion: 2.1 time: 0.123657 May 21 21:16:31.245355 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 838/1690] 10.222.0.49 () {58 vars in 1217 bytes} [Sat May 21 21:16:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-518944877 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:31.245522 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1dcc1c19-f36e-4dbc-9e75-1539b32d5027 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.560193 May 21 21:16:31.246126 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 853/1691] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:16:30 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:31.251382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-579f278e-d048-443d-9fa4-810a5ad56f8b req-e80714c6-8796-4668-9c67-3b34168ed7cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd8944e0-b77d-4aa0-8d85-b98814346aed", "name": "network-vif-deleted", "tag": "950b352f-54b2-4352-a24b-093df72e9046"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:31.252260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aa8d9954-1088-46db-b567-cb6d4429c1c2 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Action: 'create', calling method: .version_select at 0x7fc81ba68160>, body: {"keypair": {"name": "tempest-keypair-1482580073", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:31.274730 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-aa8d9954-1088-46db-b567-cb6d4429c1c2 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Getting quotas for project 8f0b81af93d840e9be961481800c0082. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:16:31.278120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-579f278e-d048-443d-9fa4-810a5ad56f8b req-e80714c6-8796-4668-9c67-3b34168ed7cd service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:31.281716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-579f278e-d048-443d-9fa4-810a5ad56f8b req-e80714c6-8796-4668-9c67-3b34168ed7cd service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:31.282222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-aa8d9954-1088-46db-b567-cb6d4429c1c2 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Getting quotas for user d831787c5d6c4355902fc31d4dc1ae8a and project 8f0b81af93d840e9be961481800c0082. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:16:31.305004 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-579f278e-d048-443d-9fa4-810a5ad56f8b req-e80714c6-8796-4668-9c67-3b34168ed7cd service nova] Creating event network-vif-deleted:950b352f-54b2-4352-a24b-093df72e9046 for instance bd8944e0-b77d-4aa0-8d85-b98814346aed on nch1-master-1 May 21 21:16:31.311253 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-579f278e-d048-443d-9fa4-810a5ad56f8b req-e80714c6-8796-4668-9c67-3b34168ed7cd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063668 May 21 21:16:31.311865 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 839/1692] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:31.317244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cb6f0ccd-8438-4131-a063-4aaf4e763867 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Action: 'create', calling method: .version_select at 0x7fc81b5f9ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-198876872", "description": "tempest-description-1466597677"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:31.417272 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aa8d9954-1088-46db-b567-cb6d4429c1c2 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.170092 May 21 21:16:31.419930 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 854/1693] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:16:31 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:31.431583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0217d4bc-7233-44b5-8154-0d2bce57c9c0 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Calling method '.version_select at 0x7fc81bb92820>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:31.593949 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0217d4bc-7233-44b5-8154-0d2bce57c9c0 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1482580073" status: 202 len: 0 microversion: 2.1 time: 0.168710 May 21 21:16:31.595102 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 855/1694] 10.222.0.49 () {58 vars in 1220 bytes} [Sat May 21 21:16:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1482580073 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 21 21:16:31.607607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2d29e31d-db8d-4d8c-80da-055fda279df7 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Action: 'create', calling method: .version_select at 0x7fc81bb9c940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-619575792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoi/p1Wzm6B7hp0o1NnLHAHCvnvYJg7Hsk+KCo2AVspGU3SpPBekQ+0ZO932l/a6pDupaVJluWx8u1dueP5q9MJ+qzKkyfu9SFn27/mupoqszvqH3oPDG9fbep18imbuA=="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:31.625434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-2d29e31d-db8d-4d8c-80da-055fda279df7 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Getting quotas for project 8f0b81af93d840e9be961481800c0082. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:16:31.630400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-2d29e31d-db8d-4d8c-80da-055fda279df7 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Getting quotas for user d831787c5d6c4355902fc31d4dc1ae8a and project 8f0b81af93d840e9be961481800c0082. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:16:31.751434 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2d29e31d-db8d-4d8c-80da-055fda279df7 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.147672 May 21 21:16:31.752314 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 856/1695] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:16:31 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:16:31.761683 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e5211c37-b9fd-49bc-8fff-1cf3e03489b9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:31.762430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e5211c37-b9fd-49bc-8fff-1cf3e03489b9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:31.769293 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5211c37-b9fd-49bc-8fff-1cf3e03489b9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:31.769754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5211c37-b9fd-49bc-8fff-1cf3e03489b9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:31.770581 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5211c37-b9fd-49bc-8fff-1cf3e03489b9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:31.770977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5211c37-b9fd-49bc-8fff-1cf3e03489b9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:31.809529 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cb6f0ccd-8438-4131-a063-4aaf4e763867 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.496376 May 21 21:16:31.816032 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 840/1696] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:16:31 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:31.816184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5fd35a89-121a-44ba-83eb-30c925308002 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:31.817233 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5fd35a89-121a-44ba-83eb-30c925308002 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:31.824588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5fd35a89-121a-44ba-83eb-30c925308002 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:31.825122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5fd35a89-121a-44ba-83eb-30c925308002 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:31.826128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5fd35a89-121a-44ba-83eb-30c925308002 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:31.826920 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5fd35a89-121a-44ba-83eb-30c925308002 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:31.865380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5fd35a89-121a-44ba-83eb-30c925308002 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:31.865803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5fd35a89-121a-44ba-83eb-30c925308002 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:31.866266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-5fd35a89-121a-44ba-83eb-30c925308002 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lazy-loading 'fault' on Instance uuid bd8944e0-b77d-4aa0-8d85-b98814346aed {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:16:31.938675 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5fd35a89-121a-44ba-83eb-30c925308002 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:31.986389 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5fd35a89-121a-44ba-83eb-30c925308002 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 200 len: 1305 microversion: 2.1 time: 0.167438 May 21 21:16:31.986531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e5211c37-b9fd-49bc-8fff-1cf3e03489b9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:31.987145 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 841/1697] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:31 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 1305 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:32.002158 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eddd4b20-5910-4d71-a370-3e60e8aada75 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Action: 'create', calling method: .version_select at 0x7fc81b5f9dc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1470174867", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6ogoaybZGx3hSInenPJf/CaKoexAR0/aXT/RVDwG9Ezr8U4rekuTUwlh1YD3qovN9QTdtjZMM/YKpeIpeg4G79RHqRKI043M6KUPoLqxXyeVoSocjWJaG7BXjYLWv+sQ=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:32.006727 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e5211c37-b9fd-49bc-8fff-1cf3e03489b9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1469 microversion: 2.1 time: 0.252940 May 21 21:16:32.019434 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 857/1698] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:31 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1469 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:32.028610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7a451f02-0b23-4c16-87af-e4d318232f24 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Action: 'create', calling method: .version_select at 0x7fc81bd72790>, body: {"security_group_rule": {"parent_group_id": "1f64bd34-26a7-4563-9f30-12dbb9c1e5d8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "2a627aec-39d1-4df0-a793-0a7381a64705"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:32.040683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-eddd4b20-5910-4d71-a370-3e60e8aada75 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Getting quotas for project 8f0b81af93d840e9be961481800c0082. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:16:32.051940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-eddd4b20-5910-4d71-a370-3e60e8aada75 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Getting quotas for user d831787c5d6c4355902fc31d4dc1ae8a and project 8f0b81af93d840e9be961481800c0082. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:16:32.193101 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-eddd4b20-5910-4d71-a370-3e60e8aada75 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.202396 May 21 21:16:32.193898 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 842/1699] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:16:31 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:32.209326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-da9ee667-d2af-4fb9-a179-ec12f79e988d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:32.213941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-da9ee667-d2af-4fb9-a179-ec12f79e988d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:32.227614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da9ee667-d2af-4fb9-a179-ec12f79e988d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:32.230800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da9ee667-d2af-4fb9-a179-ec12f79e988d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:32.233324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da9ee667-d2af-4fb9-a179-ec12f79e988d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:32.236583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da9ee667-d2af-4fb9-a179-ec12f79e988d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:32.372758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-da9ee667-d2af-4fb9-a179-ec12f79e988d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:32.381362 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-da9ee667-d2af-4fb9-a179-ec12f79e988d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1095 microversion: 2.1 time: 0.176045 May 21 21:16:32.381947 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 843/1700] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:32 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1095 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:32.387198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4b5b2599-5e8b-4456-a988-5172c903f111 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b568820>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:32.464062 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4b5b2599-5e8b-4456-a988-5172c903f111 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af" status: 200 len: 1412 microversion: 2.1 time: 0.078653 May 21 21:16:32.467815 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 844/1701] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:32 2022] GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af => generated 1412 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:32.477209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-97eb41c1-407e-46b0-a686-acf6d91246b7 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Action: 'create', calling method: .version_select at 0x7fc81b451670>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-602689592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLu+XXkW5nBjw3LhJyiyPMhc7vyzHyRCVGPsBiYpp4ZwsHMciDkNSmDlRQ9t0Zau9l0IDIFOyaiBz+SoH9jNbMl7u+H3xLLmz6QVz2zY5S29ZBgouXPvekaluguHZiNgg=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:32.497605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-97eb41c1-407e-46b0-a686-acf6d91246b7 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Getting quotas for project 8f0b81af93d840e9be961481800c0082. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:16:32.503538 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-97eb41c1-407e-46b0-a686-acf6d91246b7 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Getting quotas for user d831787c5d6c4355902fc31d4dc1ae8a and project 8f0b81af93d840e9be961481800c0082. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:16:32.659518 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-97eb41c1-407e-46b0-a686-acf6d91246b7 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.189950 May 21 21:16:32.664985 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 845/1702] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:16:32 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:32.670380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-51b2878e-16e4-49df-b6dd-d1fa2d61f4ef req-71078b5f-2654-4c8b-a62b-58001b1460c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b", "name": "network-vif-plugged", "status": "completed", "tag": "d45fcb13-cb81-4e01-869d-5e2e4b8084cc"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:32.685156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-51b2878e-16e4-49df-b6dd-d1fa2d61f4ef req-71078b5f-2654-4c8b-a62b-58001b1460c9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:32.686824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-51b2878e-16e4-49df-b6dd-d1fa2d61f4ef req-71078b5f-2654-4c8b-a62b-58001b1460c9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:32.723631 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-51b2878e-16e4-49df-b6dd-d1fa2d61f4ef req-71078b5f-2654-4c8b-a62b-58001b1460c9 service nova] Creating event network-vif-plugged:d45fcb13-cb81-4e01-869d-5e2e4b8084cc for instance 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b on nch2-master-1 May 21 21:16:32.731325 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-51b2878e-16e4-49df-b6dd-d1fa2d61f4ef req-71078b5f-2654-4c8b-a62b-58001b1460c9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069493 May 21 21:16:32.733064 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 846/1703] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:32.740196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-53e47d10-23a6-4b5a-8de9-e47b4e5347cd tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Calling method '.version_select at 0x7fc81b4fe0d0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:32.744683 ncdv-master-1 devstack@n-api.service[131278]: WARNING oslo_db.sqlalchemy.utils [None req-53e47d10-23a6-4b5a-8de9-e47b4e5347cd tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Unique keys not in sort_keys. The sorting order may be unstable. May 21 21:16:32.751391 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-53e47d10-23a6-4b5a-8de9-e47b4e5347cd tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.016637 May 21 21:16:32.752599 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 847/1704] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:16:32 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:32.772479 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3ff73dee-16a2-4554-a0d2-b0d46bd14972 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Calling method '.version_select at 0x7fc81b4fd940>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:32.799681 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7a451f02-0b23-4c16-87af-e4d318232f24 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.777523 May 21 21:16:32.800945 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 858/1705] 10.222.0.49 () {60 vars in 1194 bytes} [Sat May 21 21:16:32 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:32.813312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f7c7a799-f5b4-4d47-9d09-866853f4d648 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Action: 'create', calling method: .version_select at 0x7fc81bb9c9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1687770979", "description": "tempest-description-1270508803"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:32.892315 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3ff73dee-16a2-4554-a0d2-b0d46bd14972 tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-602689592" status: 202 len: 0 microversion: 2.1 time: 0.130580 May 21 21:16:32.893243 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 848/1706] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 21:16:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-602689592 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:32.902929 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d8240236-d16f-4f16-9960-256982fc938a tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Calling method '.version_select at 0x7fc81b3b28b0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:33.056065 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d8240236-d16f-4f16-9960-256982fc938a tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1470174867" status: 202 len: 0 microversion: 2.1 time: 0.154267 May 21 21:16:33.056065 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 849/1707] 10.222.0.49 () {58 vars in 1277 bytes} [Sat May 21 21:16:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1470174867 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:33.066459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c5d10e7c-3f01-4a2f-9e71-4729e3f4196d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:33.078871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c5d10e7c-3f01-4a2f-9e71-4729e3f4196d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:33.103407 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5d10e7c-3f01-4a2f-9e71-4729e3f4196d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:33.103879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5d10e7c-3f01-4a2f-9e71-4729e3f4196d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:33.104768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5d10e7c-3f01-4a2f-9e71-4729e3f4196d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:33.105221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5d10e7c-3f01-4a2f-9e71-4729e3f4196d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:33.154397 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-c5d10e7c-3f01-4a2f-9e71-4729e3f4196d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] HTTP exception thrown: Instance bd8944e0-b77d-4aa0-8d85-b98814346aed could not be found. May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c5d10e7c-3f01-4a2f-9e71-4729e3f4196d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Request method failure captured: May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed HTTP/1.1 May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZSCYysyyOTwVzhR_Vt3Rp4hJGlHQ1xQ5d6hFUxjxvsTAgt6ix0UNE2Z2Vln9ahBs6pfbfiUV8DEik3Vk1FDugBkn4AbmOx4uTGzwiP9EUa_o0XQmPT-P2Agu2oeG_4YhdEiPrs-TaOwa6w5WGXcLQM63lci1mbOXuKdXB18YVm1Hg May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/53774c838bd64b319776f9afa0821b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_53774c838bd64b319776f9afa0821b79", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 5e82c479130c4377a9a27dd7c8bbe611 May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance bd8944e0-b77d-4aa0-8d85-b98814346aed could not be found. May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'bd8944e0-b77d-4aa0-8d85-b98814346aed'} May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd8944e0-b77d-4aa0-8d85-b98814346aed could not be found. May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd8944e0-b77d-4aa0-8d85-b98814346aed could not be found. May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:33.162813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:33.172582 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:33.172582 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:33.172582 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:33.172582 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:33.172582 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:33.172582 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd8944e0-b77d-4aa0-8d85-b98814346aed could not be found. May 21 21:16:33.172582 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:33.172582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c5d10e7c-3f01-4a2f-9e71-4729e3f4196d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Returning 404 to user: Instance bd8944e0-b77d-4aa0-8d85-b98814346aed could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:33.172582 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c5d10e7c-3f01-4a2f-9e71-4729e3f4196d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 404 len: 111 microversion: 2.1 time: 0.109586 May 21 21:16:33.172582 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 850/1708] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:33 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:16:33.183215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d43fa3fc-96f0-4401-af0c-2f646b271e8d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:33.183911 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d43fa3fc-96f0-4401-af0c-2f646b271e8d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:33.193985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d43fa3fc-96f0-4401-af0c-2f646b271e8d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:33.194453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d43fa3fc-96f0-4401-af0c-2f646b271e8d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:33.196024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d43fa3fc-96f0-4401-af0c-2f646b271e8d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:33.196382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d43fa3fc-96f0-4401-af0c-2f646b271e8d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:33.396598 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f7c7a799-f5b4-4d47-9d09-866853f4d648 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.587522 May 21 21:16:33.397206 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 859/1709] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:16:32 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:33.410955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3c19ab88-eab4-4677-9199-f73186e92b1d tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] Calling method '.version_select at 0x7fc81b6b0a60>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:33.584719 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3c19ab88-eab4-4677-9199-f73186e92b1d tempest-KeyPairsV2TestJSON-671844120 tempest-KeyPairsV2TestJSON-671844120-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-619575792" status: 202 len: 0 microversion: 2.1 time: 0.185088 May 21 21:16:33.587010 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 860/1710] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 21:16:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-619575792 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:33.605434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e6baab63-8216-492f-b1ba-78761f9b8dbf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-537339473", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "4418fa8f-36c6-43c9-9df7-37213ff858a6"}], "block_device_mapping_v2": [{"uuid": "73a5c123-08b5-4e7a-b93d-aa0e02e78bd2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:33.775741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-e6baab63-8216-492f-b1ba-78761f9b8dbf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] validate_networks() for [('4418fa8f-36c6-43c9-9df7-37213ff858a6', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:16:33.955398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d43fa3fc-96f0-4401-af0c-2f646b271e8d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:33.965024 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d43fa3fc-96f0-4401-af0c-2f646b271e8d tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1469 microversion: 2.1 time: 0.791790 May 21 21:16:33.965617 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 851/1711] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:33 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1469 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:33.986533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1b1df56a-2807-42f9-8d2c-f88073a9d9c9 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81b5f9820>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:34.856258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e6baab63-8216-492f-b1ba-78761f9b8dbf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:16:34.856911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e6baab63-8216-492f-b1ba-78761f9b8dbf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:16:34.857299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e6baab63-8216-492f-b1ba-78761f9b8dbf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:16:34.857715 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e6baab63-8216-492f-b1ba-78761f9b8dbf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:16:34.858134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e6baab63-8216-492f-b1ba-78761f9b8dbf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:16:34.869447 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6baab63-8216-492f-b1ba-78761f9b8dbf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:34.869912 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6baab63-8216-492f-b1ba-78761f9b8dbf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:34.870739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6baab63-8216-492f-b1ba-78761f9b8dbf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:34.871185 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6baab63-8216-492f-b1ba-78761f9b8dbf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:34.891576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-e6baab63-8216-492f-b1ba-78761f9b8dbf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Getting quotas for project 220204ccbcf443c98a64994f29700ef0. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:16:34.896937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-e6baab63-8216-492f-b1ba-78761f9b8dbf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Getting quotas for user b7199de1e6f04147b197c086ac6cc6fc and project 220204ccbcf443c98a64994f29700ef0. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:16:34.972788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e6baab63-8216-492f-b1ba-78761f9b8dbf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:16:34.978833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e6baab63-8216-492f-b1ba-78761f9b8dbf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='73a5c123-08b5-4e7a-b93d-aa0e02e78bd2',volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:16:35.558300 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e6baab63-8216-492f-b1ba-78761f9b8dbf tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.965989 May 21 21:16:35.558897 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 861/1712] 10.222.0.49 () {62 vars in 1187 bytes} [Sat May 21 21:16:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1970 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 21 21:16:35.576213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-45de8f92-8442-4b3f-900d-9cf064748cb8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:35.577869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-45de8f92-8442-4b3f-900d-9cf064748cb8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:35.587474 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-45de8f92-8442-4b3f-900d-9cf064748cb8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:35.610178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-45de8f92-8442-4b3f-900d-9cf064748cb8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:35.613459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-45de8f92-8442-4b3f-900d-9cf064748cb8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:35.614931 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1b1df56a-2807-42f9-8d2c-f88073a9d9c9 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/c579f2cf-2903-4ff5-b25b-504fe5aba452" status: 202 len: 0 microversion: 2.1 time: 1.644984 May 21 21:16:35.615530 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 852/1713] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:33 2022] DELETE /compute/v2.1/os-security-groups/c579f2cf-2903-4ff5-b25b-504fe5aba452 => generated 0 bytes in 1646 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:35.618650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-45de8f92-8442-4b3f-900d-9cf064748cb8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:35.623262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-15b1e061-4646-4c7c-9bfb-c7cf9a3bb0bc tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Action: 'create', calling method: .version_select at 0x7fc81b4fe550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1689854942", "description": "tempest-description-630213627"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:35.810494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-45de8f92-8442-4b3f-900d-9cf064748cb8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:35.842498 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-45de8f92-8442-4b3f-900d-9cf064748cb8 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1169 microversion: 2.1 time: 0.277546 May 21 21:16:35.842498 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 862/1714] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:35 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1169 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:35.852765 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3395815f-d324-4b61-8c0a-cd06d919f4cb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b6b09d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:35.948300 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3395815f-d324-4b61-8c0a-cd06d919f4cb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af" status: 200 len: 1412 microversion: 2.1 time: 0.107270 May 21 21:16:35.953471 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 863/1715] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:35 2022] GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af => generated 1412 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:35.965328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-b1cc8957-9bf3-4ebc-9b26-6a2048295ce6 req-95908bba-54cb-4523-8a43-6f71686ebc30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add2b490-a27b-434c-9ff5-aa58ee869b78", "name": "network-vif-unplugged", "status": "completed", "tag": "6bd26e7a-5e3e-4a20-8012-db2830ba8f9e"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:35.994983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b1cc8957-9bf3-4ebc-9b26-6a2048295ce6 req-95908bba-54cb-4523-8a43-6f71686ebc30 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:35.999686 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b1cc8957-9bf3-4ebc-9b26-6a2048295ce6 req-95908bba-54cb-4523-8a43-6f71686ebc30 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:36.019659 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-b1cc8957-9bf3-4ebc-9b26-6a2048295ce6 req-95908bba-54cb-4523-8a43-6f71686ebc30 service nova] Creating event network-vif-unplugged:6bd26e7a-5e3e-4a20-8012-db2830ba8f9e for instance add2b490-a27b-434c-9ff5-aa58ee869b78 on nch2-master-1 May 21 21:16:36.028481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [req-b1cc8957-9bf3-4ebc-9b26-6a2048295ce6 req-95908bba-54cb-4523-8a43-6f71686ebc30 service nova] Instance add2b490-a27b-434c-9ff5-aa58ee869b78 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 21:16:36.057781 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-b1cc8957-9bf3-4ebc-9b26-6a2048295ce6 req-95908bba-54cb-4523-8a43-6f71686ebc30 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101252 May 21 21:16:36.058467 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 864/1716] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:36.087274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4cd413c7-7e14-4a66-97dc-5ac3df84fc54 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:36.087953 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4cd413c7-7e14-4a66-97dc-5ac3df84fc54 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:36.104227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cd413c7-7e14-4a66-97dc-5ac3df84fc54 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:36.104773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cd413c7-7e14-4a66-97dc-5ac3df84fc54 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:36.105621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cd413c7-7e14-4a66-97dc-5ac3df84fc54 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:36.107811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cd413c7-7e14-4a66-97dc-5ac3df84fc54 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:36.500190 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4cd413c7-7e14-4a66-97dc-5ac3df84fc54 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:36.510901 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4cd413c7-7e14-4a66-97dc-5ac3df84fc54 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1469 microversion: 2.1 time: 0.451028 May 21 21:16:36.517113 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 865/1717] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:36 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1469 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:36.527873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-767f7ecf-648c-4b8f-b6e8-996cc6d04d2d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:36.529668 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-767f7ecf-648c-4b8f-b6e8-996cc6d04d2d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:36.647361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-767f7ecf-648c-4b8f-b6e8-996cc6d04d2d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:36.658473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-767f7ecf-648c-4b8f-b6e8-996cc6d04d2d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:36.668091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-767f7ecf-648c-4b8f-b6e8-996cc6d04d2d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:36.672159 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-767f7ecf-648c-4b8f-b6e8-996cc6d04d2d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1103 microversion: 2.25 time: 0.151957 May 21 21:16:36.674440 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 866/1718] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:16:36 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1103 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:16:36.705228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a3742463-d582-4671-86f5-1cbfd327f6f6 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81bb453a0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:36.899567 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-15b1e061-4646-4c7c-9bfb-c7cf9a3bb0bc tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.280887 May 21 21:16:36.899567 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 853/1719] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:16:35 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:37.193817 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a3742463-d582-4671-86f5-1cbfd327f6f6 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02" status: 202 len: 0 microversion: 2.1 time: 0.517949 May 21 21:16:37.195893 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 867/1720] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:36 2022] DELETE /compute/v2.1/os-security-groups/d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:37.203394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a149a886-e11f-43ce-9bc0-df649d1665bc tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:37.207415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a149a886-e11f-43ce-9bc0-df649d1665bc tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:37.238661 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a149a886-e11f-43ce-9bc0-df649d1665bc tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:37.242132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a149a886-e11f-43ce-9bc0-df649d1665bc tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:37.243261 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a149a886-e11f-43ce-9bc0-df649d1665bc tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:37.243902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a149a886-e11f-43ce-9bc0-df649d1665bc tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:37.447399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-98a631b6-b635-4997-9758-c1a8742ba6d1 tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] Calling method '.version_select at 0x7fc81b4adee0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:37.509997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG neutronclient.v2_0.client [None req-98a631b6-b635-4997-9758-c1a8742ba6d1 tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dbb52d0b-569f-4ee7-8f52-9d8d00357781 does not exist", "detail": ""}} {{(pid=131278) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:16:37.510638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.security_group_api [None req-98a631b6-b635-4997-9758-c1a8742ba6d1 tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] Neutron security group dbb52d0b-569f-4ee7-8f52-9d8d00357781 not found {{(pid=131278) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 21 21:16:37.511239 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-98a631b6-b635-4997-9758-c1a8742ba6d1 tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] HTTP exception thrown: Security group dbb52d0b-569f-4ee7-8f52-9d8d00357781 does not exist May 21 21:16:37.511239 ncdv-master-1 devstack@n-api.service[131278]: Neutron server returns request_ids: ['req-9ddd9e28-0341-4fd4-addb-c81228d85c78'] May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-98a631b6-b635-4997-9758-c1a8742ba6d1 tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] Request method failure captured: May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/os-security-groups/dbb52d0b-569f-4ee7-8f52-9d8d00357781 HTTP/1.1 May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVa0lPgX--stqjLmRG0Tc-7ebtky4pQeNJacnq8JwZsclZV7RlCOkFXZrWBjhfnzz3trbe8ft2ZTJtNtj9EQP7M5rdR-qtYKexem8hTP6Nl7VzhZsriJg1TmkUbq7NNfRuANrR-qfF1VXu4kg3L0BfDoNwPW6epeYQbEpE-QIe0Or30 May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: cf1f424d79da4aa981062e2b1cca841b May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1497876098 May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cf1f424d79da4aa981062e2b1cca841b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cf1f424d79da4aa981062e2b1cca841b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cf1f424d79da4aa981062e2b1cca841b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cf1f424d79da4aa981062e2b1cca841b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1497876098 May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: cf1f424d79da4aa981062e2b1cca841b May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1497876098 May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-SecurityGroupsNegativeTestJSON-1497876098-project May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 366565d4da554a3a8b97c91dd747fc6b May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1497876098-project May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: exception: Security group dbb52d0b-569f-4ee7-8f52-9d8d00357781 does not exist May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: Neutron server returns request_ids: ['req-9ddd9e28-0341-4fd4-addb-c81228d85c78'] May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'dbb52d0b-569f-4ee7-8f52-9d8d00357781'} May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:16:37.514187 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dbb52d0b-569f-4ee7-8f52-9d8d00357781 does not exist May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ddd9e28-0341-4fd4-addb-c81228d85c78'] May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dbb52d0b-569f-4ee7-8f52-9d8d00357781 does not exist May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ddd9e28-0341-4fd4-addb-c81228d85c78'] May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dbb52d0b-569f-4ee7-8f52-9d8d00357781 does not exist May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ddd9e28-0341-4fd4-addb-c81228d85c78'] May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dbb52d0b-569f-4ee7-8f52-9d8d00357781 does not exist May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ddd9e28-0341-4fd4-addb-c81228d85c78'] May 21 21:16:37.519762 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:37.532556 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-98a631b6-b635-4997-9758-c1a8742ba6d1 tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] Returning 404 to user: Security group dbb52d0b-569f-4ee7-8f52-9d8d00357781 does not exist May 21 21:16:37.532556 ncdv-master-1 devstack@n-api.service[131278]: Neutron server returns request_ids: ['req-9ddd9e28-0341-4fd4-addb-c81228d85c78'] {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:37.532556 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-98a631b6-b635-4997-9758-c1a8742ba6d1 tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/dbb52d0b-569f-4ee7-8f52-9d8d00357781" status: 404 len: 194 microversion: 2.1 time: 0.624955 May 21 21:16:37.532556 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 854/1721] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:36 2022] DELETE /compute/v2.1/os-security-groups/dbb52d0b-569f-4ee7-8f52-9d8d00357781 => generated 194 bytes in 627 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:16:37.537326 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a149a886-e11f-43ce-9bc0-df649d1665bc tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:37.543335 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0b28ec7b-844d-42e7-8444-dd136a8a680e tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Action: 'create', calling method: .version_select at 0x7fc81b5718b0>, body: {"security_group_rule": {"parent_group_id": "3c9a044b-e18d-4bf9-a8f2-0064a117b723", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "1cb834e3-88c2-4ad6-8bae-b7476003686a"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:37.546876 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a149a886-e11f-43ce-9bc0-df649d1665bc tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1199 microversion: 2.1 time: 0.349635 May 21 21:16:37.557196 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 868/1722] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:37 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1199 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:37.557196 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0e2041cc-0fd2-427e-8b49-d4e919e42342 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81bbe3dc0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:37.625487 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0e2041cc-0fd2-427e-8b49-d4e919e42342 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af" status: 200 len: 1412 microversion: 2.1 time: 0.076067 May 21 21:16:37.626213 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 869/1723] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:37 2022] GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af => generated 1412 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:37.644844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-22db31aa-72b1-46c5-9265-006ecd34823c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Action: 'create', calling method: .version_select at 0x7fc81bb45af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1287020469", "description": "tempest-description-1386394876"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:38.073786 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-22db31aa-72b1-46c5-9265-006ecd34823c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.445801 May 21 21:16:38.076965 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 870/1724] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:16:37 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:38.084772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bae886e9-02b3-4058-820a-48b857362171 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:38.086506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bae886e9-02b3-4058-820a-48b857362171 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:38.109174 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bae886e9-02b3-4058-820a-48b857362171 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:38.109625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bae886e9-02b3-4058-820a-48b857362171 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:38.111435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bae886e9-02b3-4058-820a-48b857362171 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:38.111435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bae886e9-02b3-4058-820a-48b857362171 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:38.476949 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0b28ec7b-844d-42e7-8444-dd136a8a680e tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.941165 May 21 21:16:38.477547 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 855/1725] 10.222.0.49 () {60 vars in 1194 bytes} [Sat May 21 21:16:37 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:38.485648 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4cb1f5dd-c790-4dbb-9edf-217f00962cf5 tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.006082 May 21 21:16:38.493615 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 856/1726] 10.222.0.49 () {58 vars in 1163 bytes} [Sat May 21 21:16:38 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 21 21:16:38.512308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-caa9b9e5-5de4-4a9a-926c-d7513859002d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:38.514245 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-caa9b9e5-5de4-4a9a-926c-d7513859002d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:38.532851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-caa9b9e5-5de4-4a9a-926c-d7513859002d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:38.534794 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-caa9b9e5-5de4-4a9a-926c-d7513859002d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:38.537431 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bae886e9-02b3-4058-820a-48b857362171 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:38.538498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-caa9b9e5-5de4-4a9a-926c-d7513859002d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:38.540845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-caa9b9e5-5de4-4a9a-926c-d7513859002d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:38.548803 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bae886e9-02b3-4058-820a-48b857362171 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1469 microversion: 2.1 time: 0.472742 May 21 21:16:38.549380 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 871/1727] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:38 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1469 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:38.557029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-da0649c7-c84e-4c7e-ae8e-9f9542eb1ea7 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Action: 'update', calling method: .version_select at 0x7fc81b457e50>, body: {"security_group": {"name": "tempest-sg-hth-226307938", "description": "tempest-description-hth-1365753935"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:38.728800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-caa9b9e5-5de4-4a9a-926c-d7513859002d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:38.745420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-caa9b9e5-5de4-4a9a-926c-d7513859002d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:38.748210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-caa9b9e5-5de4-4a9a-926c-d7513859002d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:38.751091 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-caa9b9e5-5de4-4a9a-926c-d7513859002d tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1240 microversion: 2.25 time: 0.254026 May 21 21:16:38.769530 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 857/1728] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:16:38 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1240 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:16:38.780411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-c28d7ac7-0cd0-4eb6-956c-4e2083d318b5 req-2c9ffcdf-bcf0-4c5d-85aa-42d806360e74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add2b490-a27b-434c-9ff5-aa58ee869b78", "tag": "6bd26e7a-5e3e-4a20-8012-db2830ba8f9e"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:38.793608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c28d7ac7-0cd0-4eb6-956c-4e2083d318b5 req-2c9ffcdf-bcf0-4c5d-85aa-42d806360e74 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:38.794070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c28d7ac7-0cd0-4eb6-956c-4e2083d318b5 req-2c9ffcdf-bcf0-4c5d-85aa-42d806360e74 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:38.810133 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-c28d7ac7-0cd0-4eb6-956c-4e2083d318b5 req-2c9ffcdf-bcf0-4c5d-85aa-42d806360e74 service nova] Creating event network-changed:6bd26e7a-5e3e-4a20-8012-db2830ba8f9e for instance add2b490-a27b-434c-9ff5-aa58ee869b78 on nch2-master-1 May 21 21:16:38.816944 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-c28d7ac7-0cd0-4eb6-956c-4e2083d318b5 req-2c9ffcdf-bcf0-4c5d-85aa-42d806360e74 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045769 May 21 21:16:38.818881 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 858/1729] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:39.073422 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-45db009e-ed80-4dc8-a038-11b6641cfb25 tempest-AZV2TestJSON-1593158472 tempest-AZV2TestJSON-1593158472-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:39.075459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-45db009e-ed80-4dc8-a038-11b6641cfb25 tempest-AZV2TestJSON-1593158472 tempest-AZV2TestJSON-1593158472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:39.076129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-45db009e-ed80-4dc8-a038-11b6641cfb25 tempest-AZV2TestJSON-1593158472 tempest-AZV2TestJSON-1593158472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:39.079443 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-45db009e-ed80-4dc8-a038-11b6641cfb25 tempest-AZV2TestJSON-1593158472 tempest-AZV2TestJSON-1593158472-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:39.080139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-45db009e-ed80-4dc8-a038-11b6641cfb25 tempest-AZV2TestJSON-1593158472 tempest-AZV2TestJSON-1593158472-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:39.126191 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-da0649c7-c84e-4c7e-ae8e-9f9542eb1ea7 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "PUT /compute/v2.1/os-security-groups/3b809905-e537-4935-a6d4-e98934ba3297" status: 200 len: 217 microversion: 2.1 time: 0.575708 May 21 21:16:39.130712 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 872/1730] 10.222.0.49 () {60 vars in 1289 bytes} [Sat May 21 21:16:38 2022] PUT /compute/v2.1/os-security-groups/3b809905-e537-4935-a6d4-e98934ba3297 => generated 217 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:39.140768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3719bf3e-df7a-410d-b54a-5d47805b1ac0 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Calling method '.version_select at 0x7fc81b8ca430>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:39.185835 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-45db009e-ed80-4dc8-a038-11b6641cfb25 tempest-AZV2TestJSON-1593158472 tempest-AZV2TestJSON-1593158472-project] 10.222.0.49 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.356581 May 21 21:16:39.187351 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 859/1731] 10.222.0.49 () {58 vars in 1163 bytes} [Sat May 21 21:16:38 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:16:39.255701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-20174e80-4919-4a57-a538-8a6039a99f6c tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] Calling method '.version_select at 0x7fc81b58a4c0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:39.879697 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3719bf3e-df7a-410d-b54a-5d47805b1ac0 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/1cb834e3-88c2-4ad6-8bae-b7476003686a" status: 202 len: 0 microversion: 2.1 time: 0.751365 May 21 21:16:39.884815 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 873/1732] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:39 2022] DELETE /compute/v2.1/os-security-groups/1cb834e3-88c2-4ad6-8bae-b7476003686a => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:39.892475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-371210e5-a960-41fa-bf6a-d291bf32074e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:39.893357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-371210e5-a960-41fa-bf6a-d291bf32074e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:39.929594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-371210e5-a960-41fa-bf6a-d291bf32074e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:39.933786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-371210e5-a960-41fa-bf6a-d291bf32074e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:39.933786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-371210e5-a960-41fa-bf6a-d291bf32074e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:39.933786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-371210e5-a960-41fa-bf6a-d291bf32074e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:40.112576 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-20174e80-4919-4a57-a538-8a6039a99f6c tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.912218 May 21 21:16:40.113194 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 860/1733] 10.222.0.49 () {58 vars in 1157 bytes} [Sat May 21 21:16:39 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:40.129059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-377747dd-bb80-40bc-b9dd-cce4508bc1b0 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b3b28b0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:40.214252 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-377747dd-bb80-40bc-b9dd-cce4508bc1b0 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af" status: 200 len: 1412 microversion: 2.1 time: 0.089149 May 21 21:16:40.215582 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 861/1734] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:40 2022] GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:40.222093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3542a975-fc11-4a24-9c55-8ac257b67f3d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81b5f9a60>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:40.447637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-371210e5-a960-41fa-bf6a-d291bf32074e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:40.464660 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-371210e5-a960-41fa-bf6a-d291bf32074e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1199 microversion: 2.1 time: 0.577406 May 21 21:16:40.466610 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 874/1735] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:39 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1199 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:40.483069 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f0e7dd49-7afb-45a4-abd1-8f3a4553ed0f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:40.483929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f0e7dd49-7afb-45a4-abd1-8f3a4553ed0f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:40.496835 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0e7dd49-7afb-45a4-abd1-8f3a4553ed0f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:40.497302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0e7dd49-7afb-45a4-abd1-8f3a4553ed0f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:40.503355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0e7dd49-7afb-45a4-abd1-8f3a4553ed0f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:40.504089 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0e7dd49-7afb-45a4-abd1-8f3a4553ed0f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:40.510821 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3542a975-fc11-4a24-9c55-8ac257b67f3d tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/3b809905-e537-4935-a6d4-e98934ba3297" status: 200 len: 217 microversion: 2.1 time: 0.293882 May 21 21:16:40.511891 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 862/1736] 10.222.0.49 () {58 vars in 1268 bytes} [Sat May 21 21:16:40 2022] GET /compute/v2.1/os-security-groups/3b809905-e537-4935-a6d4-e98934ba3297 => generated 217 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:40.521579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5620317d-0f19-461c-8f22-e7ac48a148bc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:40.524432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5620317d-0f19-461c-8f22-e7ac48a148bc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:40.567741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5620317d-0f19-461c-8f22-e7ac48a148bc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:40.586363 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5620317d-0f19-461c-8f22-e7ac48a148bc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:40.587345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5620317d-0f19-461c-8f22-e7ac48a148bc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:40.587810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5620317d-0f19-461c-8f22-e7ac48a148bc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:40.871707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f0e7dd49-7afb-45a4-abd1-8f3a4553ed0f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:40.871707 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f0e7dd49-7afb-45a4-abd1-8f3a4553ed0f tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1462 microversion: 2.1 time: 0.401439 May 21 21:16:40.884469 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 875/1737] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:40 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1462 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:40.891836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e3b1f671-9ce5-4dc1-bfbf-b7159fe3528d tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Calling method '.version_select at 0x7fc81bb45550>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:41.011920 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e3b1f671-9ce5-4dc1-bfbf-b7159fe3528d tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/3c9a044b-e18d-4bf9-a8f2-0064a117b723" status: 200 len: 248 microversion: 2.1 time: 0.125400 May 21 21:16:41.012545 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 876/1738] 10.222.0.49 () {58 vars in 1268 bytes} [Sat May 21 21:16:40 2022] GET /compute/v2.1/os-security-groups/3c9a044b-e18d-4bf9-a8f2-0064a117b723 => generated 248 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:41.026232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4a617806-4976-40f8-92fd-070f45a96ad1 tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] Calling method '.version_select at 0x7fc81b649940>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:41.119177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5620317d-0f19-461c-8f22-e7ac48a148bc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:41.151256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5620317d-0f19-461c-8f22-e7ac48a148bc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:41.153906 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5620317d-0f19-461c-8f22-e7ac48a148bc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:41.157781 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5620317d-0f19-461c-8f22-e7ac48a148bc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1292 microversion: 2.25 time: 0.644406 May 21 21:16:41.159706 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 863/1739] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:16:40 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1292 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:16:41.171257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-de35ea29-dccb-48a5-b9e2-0fc27378da3f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81b5d2b80>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG neutronclient.v2_0.client [None req-4a617806-4976-40f8-92fd-070f45a96ad1 tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=131277) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-4a617806-4976-40f8-92fd-070f45a96ad1 tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] HTTP exception thrown: Insufficient rights for removing default security group. May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-3e7fbcb5-24cf-4c34-9541-6ba59c842800'] May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4a617806-4976-40f8-92fd-070f45a96ad1 tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] Request method failure captured: May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/os-security-groups/f13b4c6b-7ae6-4be2-b824-d925dbcceb0b HTTP/1.1 May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVa0lPgX--stqjLmRG0Tc-7ebtky4pQeNJacnq8JwZsclZV7RlCOkFXZrWBjhfnzz3trbe8ft2ZTJtNtj9EQP7M5rdR-qtYKexem8hTP6Nl7VzhZsriJg1TmkUbq7NNfRuANrR-qfF1VXu4kg3L0BfDoNwPW6epeYQbEpE-QIe0Or30 May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: cf1f424d79da4aa981062e2b1cca841b May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1497876098 May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cf1f424d79da4aa981062e2b1cca841b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cf1f424d79da4aa981062e2b1cca841b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cf1f424d79da4aa981062e2b1cca841b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cf1f424d79da4aa981062e2b1cca841b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1497876098 May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: cf1f424d79da4aa981062e2b1cca841b May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1497876098 May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-SecurityGroupsNegativeTestJSON-1497876098-project May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 366565d4da554a3a8b97c91dd747fc6b May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1497876098-project May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: exception: Insufficient rights for removing default security group. May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-3e7fbcb5-24cf-4c34-9541-6ba59c842800'] May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'f13b4c6b-7ae6-4be2-b824-d925dbcceb0b'} May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:41.348086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e7fbcb5-24cf-4c34-9541-6ba59c842800'] May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e7fbcb5-24cf-4c34-9541-6ba59c842800'] May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e7fbcb5-24cf-4c34-9541-6ba59c842800'] May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e7fbcb5-24cf-4c34-9541-6ba59c842800'] May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4a617806-4976-40f8-92fd-070f45a96ad1 tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] Returning 400 to user: Insufficient rights for removing default security group. May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-3e7fbcb5-24cf-4c34-9541-6ba59c842800'] {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:41.354478 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4a617806-4976-40f8-92fd-070f45a96ad1 tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/f13b4c6b-7ae6-4be2-b824-d925dbcceb0b" status: 400 len: 182 microversion: 2.1 time: 0.327435 May 21 21:16:41.364108 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 877/1740] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:41 2022] DELETE /compute/v2.1/os-security-groups/f13b4c6b-7ae6-4be2-b824-d925dbcceb0b => generated 182 bytes in 336 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:16:41.364108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-e80ddac4-6edf-4951-a337-3ee39b7916be req-65b3f22c-73e5-4b7f-a5b5-ed8fa92a4bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add2b490-a27b-434c-9ff5-aa58ee869b78", "name": "network-vif-plugged", "status": "completed", "tag": "6bd26e7a-5e3e-4a20-8012-db2830ba8f9e"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:41.387351 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-e80ddac4-6edf-4951-a337-3ee39b7916be req-65b3f22c-73e5-4b7f-a5b5-ed8fa92a4bd3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:41.388077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-e80ddac4-6edf-4951-a337-3ee39b7916be req-65b3f22c-73e5-4b7f-a5b5-ed8fa92a4bd3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:41.406400 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-e80ddac4-6edf-4951-a337-3ee39b7916be req-65b3f22c-73e5-4b7f-a5b5-ed8fa92a4bd3 service nova] Creating event network-vif-plugged:6bd26e7a-5e3e-4a20-8012-db2830ba8f9e for instance add2b490-a27b-434c-9ff5-aa58ee869b78 on nch2-master-1 May 21 21:16:41.414752 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-e80ddac4-6edf-4951-a337-3ee39b7916be req-65b3f22c-73e5-4b7f-a5b5-ed8fa92a4bd3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053091 May 21 21:16:41.415685 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 878/1741] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:41.431117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-4b1aadf1-946f-42cc-a072-37b9b901a2b5 req-1c296e1b-c84b-4bc1-a15a-a8bfb9a1e1ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ce51e42-255d-45f7-afab-2fdb937e7758", "tag": "13fa11f5-00e8-4fa2-a36a-6c54e56541f6"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:41.440652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-4b1aadf1-946f-42cc-a072-37b9b901a2b5 req-1c296e1b-c84b-4bc1-a15a-a8bfb9a1e1ad service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:41.441338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-4b1aadf1-946f-42cc-a072-37b9b901a2b5 req-1c296e1b-c84b-4bc1-a15a-a8bfb9a1e1ad service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:41.457143 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-4b1aadf1-946f-42cc-a072-37b9b901a2b5 req-1c296e1b-c84b-4bc1-a15a-a8bfb9a1e1ad service nova] Creating event network-changed:13fa11f5-00e8-4fa2-a36a-6c54e56541f6 for instance 4ce51e42-255d-45f7-afab-2fdb937e7758 on nch1-master-1 May 21 21:16:41.463123 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-4b1aadf1-946f-42cc-a072-37b9b901a2b5 req-1c296e1b-c84b-4bc1-a15a-a8bfb9a1e1ad service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045823 May 21 21:16:41.466586 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 879/1742] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:41.778225 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e90e5b18-3b23-4637-8267-23d6ed8728cf tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:41.779039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e90e5b18-3b23-4637-8267-23d6ed8728cf tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:41.787194 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e90e5b18-3b23-4637-8267-23d6ed8728cf tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:41.788266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e90e5b18-3b23-4637-8267-23d6ed8728cf tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:41.789692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e90e5b18-3b23-4637-8267-23d6ed8728cf tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:41.790354 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e90e5b18-3b23-4637-8267-23d6ed8728cf tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:41.796936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:42.085956 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e90e5b18-3b23-4637-8267-23d6ed8728cf tempest-MigrationsAdminTest-554610794 tempest-MigrationsAdminTest-554610794-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1613 microversion: 2.1 time: 0.620278 May 21 21:16:42.087057 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 880/1743] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:41 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1613 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:42.094041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e70350cf-9a87-4b2d-90dc-6adb19f7c8ff tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Action: 'create', calling method: .version_select at 0x7fc81b8f3430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1627245856", "description": "tempest-description-570823127"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:42.195354 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-de35ea29-dccb-48a5-b9e2-0fc27378da3f tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/3b809905-e537-4935-a6d4-e98934ba3297" status: 202 len: 0 microversion: 2.1 time: 1.031992 May 21 21:16:42.196083 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 864/1744] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:41 2022] DELETE /compute/v2.1/os-security-groups/3b809905-e537-4935-a6d4-e98934ba3297 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:42.203888 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7533705d-4c1f-4be0-9ae0-a002d5b22127 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b3b9e50>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:42.265519 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7533705d-4c1f-4be0-9ae0-a002d5b22127 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af" status: 200 len: 1412 microversion: 2.1 time: 0.065299 May 21 21:16:42.266604 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 865/1745] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:42 2022] GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af => generated 1412 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:42.277267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e638d978-03eb-455e-b2b1-20bc6b14de1f tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] Calling method '.version_select at 0x7fc81b5f9f70>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:42.343066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG neutronclient.v2_0.client [None req-e638d978-03eb-455e-b2b1-20bc6b14de1f tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f2348980-0bb7-4964-8d05-43934abe40e5 does not exist", "detail": ""}} {{(pid=131278) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:16:42.344200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.security_group_api [None req-e638d978-03eb-455e-b2b1-20bc6b14de1f tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] Neutron security group f2348980-0bb7-4964-8d05-43934abe40e5 not found {{(pid=131278) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 21 21:16:42.345048 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-e638d978-03eb-455e-b2b1-20bc6b14de1f tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] HTTP exception thrown: Security group f2348980-0bb7-4964-8d05-43934abe40e5 does not exist May 21 21:16:42.345048 ncdv-master-1 devstack@n-api.service[131278]: Neutron server returns request_ids: ['req-f2c8bb1f-3cad-473a-8cac-233514b061a3'] May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e638d978-03eb-455e-b2b1-20bc6b14de1f tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] Request method failure captured: May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-security-groups/f2348980-0bb7-4964-8d05-43934abe40e5 HTTP/1.1 May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVa0lPgX--stqjLmRG0Tc-7ebtky4pQeNJacnq8JwZsclZV7RlCOkFXZrWBjhfnzz3trbe8ft2ZTJtNtj9EQP7M5rdR-qtYKexem8hTP6Nl7VzhZsriJg1TmkUbq7NNfRuANrR-qfF1VXu4kg3L0BfDoNwPW6epeYQbEpE-QIe0Or30 May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: cf1f424d79da4aa981062e2b1cca841b May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1497876098 May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cf1f424d79da4aa981062e2b1cca841b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cf1f424d79da4aa981062e2b1cca841b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cf1f424d79da4aa981062e2b1cca841b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cf1f424d79da4aa981062e2b1cca841b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1497876098 May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: cf1f424d79da4aa981062e2b1cca841b May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1497876098 May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-SecurityGroupsNegativeTestJSON-1497876098-project May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 366565d4da554a3a8b97c91dd747fc6b May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1497876098-project May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: exception: Security group f2348980-0bb7-4964-8d05-43934abe40e5 does not exist May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: Neutron server returns request_ids: ['req-f2c8bb1f-3cad-473a-8cac-233514b061a3'] May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'f2348980-0bb7-4964-8d05-43934abe40e5'} May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:16:42.350104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f2348980-0bb7-4964-8d05-43934abe40e5 does not exist May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2c8bb1f-3cad-473a-8cac-233514b061a3'] May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f2348980-0bb7-4964-8d05-43934abe40e5 does not exist May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2c8bb1f-3cad-473a-8cac-233514b061a3'] May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f2348980-0bb7-4964-8d05-43934abe40e5 does not exist May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2c8bb1f-3cad-473a-8cac-233514b061a3'] May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f2348980-0bb7-4964-8d05-43934abe40e5 does not exist May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2c8bb1f-3cad-473a-8cac-233514b061a3'] May 21 21:16:42.357383 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:42.371546 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e638d978-03eb-455e-b2b1-20bc6b14de1f tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] Returning 404 to user: Security group f2348980-0bb7-4964-8d05-43934abe40e5 does not exist May 21 21:16:42.371546 ncdv-master-1 devstack@n-api.service[131278]: Neutron server returns request_ids: ['req-f2c8bb1f-3cad-473a-8cac-233514b061a3'] {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:42.371546 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e638d978-03eb-455e-b2b1-20bc6b14de1f tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/f2348980-0bb7-4964-8d05-43934abe40e5" status: 404 len: 194 microversion: 2.1 time: 0.097127 May 21 21:16:42.374718 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 866/1746] 10.222.0.49 () {58 vars in 1268 bytes} [Sat May 21 21:16:42 2022] GET /compute/v2.1/os-security-groups/f2348980-0bb7-4964-8d05-43934abe40e5 => generated 194 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:16:42.382228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7a8241ca-b297-4f95-8928-d6b1840a1b6e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:42.384534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7a8241ca-b297-4f95-8928-d6b1840a1b6e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:42.399533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7a8241ca-b297-4f95-8928-d6b1840a1b6e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:42.400424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7a8241ca-b297-4f95-8928-d6b1840a1b6e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:42.401448 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7a8241ca-b297-4f95-8928-d6b1840a1b6e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:42.402076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7a8241ca-b297-4f95-8928-d6b1840a1b6e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:42.514664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=18 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:42.643498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7a8241ca-b297-4f95-8928-d6b1840a1b6e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:42.655128 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7a8241ca-b297-4f95-8928-d6b1840a1b6e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1199 microversion: 2.1 time: 0.278830 May 21 21:16:42.656447 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 867/1747] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:42 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1199 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:42.666161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eea2423d-14ad-461d-ac15-e0d6c9e135d6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:42.666805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-eea2423d-14ad-461d-ac15-e0d6c9e135d6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:42.673758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eea2423d-14ad-461d-ac15-e0d6c9e135d6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:42.674304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eea2423d-14ad-461d-ac15-e0d6c9e135d6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:42.675709 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eea2423d-14ad-461d-ac15-e0d6c9e135d6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:42.676829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eea2423d-14ad-461d-ac15-e0d6c9e135d6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:42.706737 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e70350cf-9a87-4b2d-90dc-6adb19f7c8ff tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.617752 May 21 21:16:42.711270 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 881/1748] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:16:42 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:42.718693 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f591f253-2c59-4c8c-8059-c964c9119374 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:42.721089 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f591f253-2c59-4c8c-8059-c964c9119374 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:42.734366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f591f253-2c59-4c8c-8059-c964c9119374 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:42.739700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f591f253-2c59-4c8c-8059-c964c9119374 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:42.742093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-eea2423d-14ad-461d-ac15-e0d6c9e135d6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:16:42.742715 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f591f253-2c59-4c8c-8059-c964c9119374 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:42.746173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f591f253-2c59-4c8c-8059-c964c9119374 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:42.952401 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f591f253-2c59-4c8c-8059-c964c9119374 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:42.963797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f591f253-2c59-4c8c-8059-c964c9119374 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:42.965430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f591f253-2c59-4c8c-8059-c964c9119374 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:42.966710 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f591f253-2c59-4c8c-8059-c964c9119374 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1280 microversion: 2.25 time: 0.257985 May 21 21:16:42.967282 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 882/1749] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:16:42 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1280 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:16:42.978620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1f628431-5ea9-4d13-8710-afdb2139114a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:42.978620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1f628431-5ea9-4d13-8710-afdb2139114a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:42.988165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f628431-5ea9-4d13-8710-afdb2139114a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:42.988165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f628431-5ea9-4d13-8710-afdb2139114a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:42.989500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f628431-5ea9-4d13-8710-afdb2139114a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:42.989961 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f628431-5ea9-4d13-8710-afdb2139114a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:43.011039 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-1f628431-5ea9-4d13-8710-afdb2139114a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] HTTP exception thrown: Instance bd8944e0-b77d-4aa0-8d85-b98814346aed could not be found. May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1f628431-5ea9-4d13-8710-afdb2139114a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Request method failure captured: May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed HTTP/1.1 May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZSCYysyyOTwVzhR_Vt3Rp4hJGlHQ1xQ5d6hFUxjxvsTAgt6ix0UNE2Z2Vln9ahBs6pfbfiUV8DEik3Vk1FDugBkn4AbmOx4uTGzwiP9EUa_o0XQmPT-P2Agu2oeG_4YhdEiPrs-TaOwa6w5WGXcLQM63lci1mbOXuKdXB18YVm1Hg May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/53774c838bd64b319776f9afa0821b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_53774c838bd64b319776f9afa0821b79", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 5e82c479130c4377a9a27dd7c8bbe611 May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance bd8944e0-b77d-4aa0-8d85-b98814346aed could not be found. May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'bd8944e0-b77d-4aa0-8d85-b98814346aed'} May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd8944e0-b77d-4aa0-8d85-b98814346aed could not be found. May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:16:43.017028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:16:43.022295 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd8944e0-b77d-4aa0-8d85-b98814346aed could not be found. May 21 21:16:43.022295 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:43.022295 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:43.022295 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:43.022295 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:43.022295 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:43.022295 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:43.022295 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:43.022295 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:43.022295 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd8944e0-b77d-4aa0-8d85-b98814346aed could not be found. May 21 21:16:43.022295 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:43.022295 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1f628431-5ea9-4d13-8710-afdb2139114a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Returning 404 to user: Instance bd8944e0-b77d-4aa0-8d85-b98814346aed could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:43.022295 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1f628431-5ea9-4d13-8710-afdb2139114a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 404 len: 111 microversion: 2.1 time: 0.046163 May 21 21:16:43.022295 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 883/1750] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:16:42 2022] DELETE /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:16:43.028220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7cfc3c9e-5bc5-4cc1-83c5-544a598dbb99 tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] Action: 'update', calling method: .version_select at 0x7fc81b6b0790>, body: {"security_group": {"name": "tempest-sg-2105246786", "description": "tempest-description-99832518"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:43.055295 ncdv-master-1 devstack@n-api.service[131277]: DEBUG neutronclient.v2_0.client [None req-7cfc3c9e-5bc5-4cc1-83c5-544a598dbb99 tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6fa415d8-2202-49c4-9d18-f360b177b15b does not exist", "detail": ""}} {{(pid=131277) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:16:43.055917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.security_group_api [None req-7cfc3c9e-5bc5-4cc1-83c5-544a598dbb99 tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] Neutron security group 6fa415d8-2202-49c4-9d18-f360b177b15b not found {{(pid=131277) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 21 21:16:43.056492 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-7cfc3c9e-5bc5-4cc1-83c5-544a598dbb99 tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] HTTP exception thrown: Security group 6fa415d8-2202-49c4-9d18-f360b177b15b does not exist May 21 21:16:43.056492 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-514070ab-d3ec-495a-9572-5aaa0d53cf94'] May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7cfc3c9e-5bc5-4cc1-83c5-544a598dbb99 tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] Request method failure captured: May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: request: PUT /compute/v2.1/os-security-groups/6fa415d8-2202-49c4-9d18-f360b177b15b HTTP/1.1 May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 100 May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVa0lPgX--stqjLmRG0Tc-7ebtky4pQeNJacnq8JwZsclZV7RlCOkFXZrWBjhfnzz3trbe8ft2ZTJtNtj9EQP7M5rdR-qtYKexem8hTP6Nl7VzhZsriJg1TmkUbq7NNfRuANrR-qfF1VXu4kg3L0BfDoNwPW6epeYQbEpE-QIe0Or30 May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: cf1f424d79da4aa981062e2b1cca841b May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1497876098 May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cf1f424d79da4aa981062e2b1cca841b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cf1f424d79da4aa981062e2b1cca841b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cf1f424d79da4aa981062e2b1cca841b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cf1f424d79da4aa981062e2b1cca841b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1497876098 May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: cf1f424d79da4aa981062e2b1cca841b May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1497876098 May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-SecurityGroupsNegativeTestJSON-1497876098-project May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 366565d4da554a3a8b97c91dd747fc6b May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1497876098-project May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: {"security_group": {"name": "tempest-sg-2105246786", "description": "tempest-description-99832518"}} May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: exception: Security group 6fa415d8-2202-49c4-9d18-f360b177b15b does not exist May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-514070ab-d3ec-495a-9572-5aaa0d53cf94'] May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '6fa415d8-2202-49c4-9d18-f360b177b15b', 'body': {'security_group': {'name': 'tempest-sg-2105246786', 'description': 'tempest-description-99832518'}}} May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:16:43.058397 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6fa415d8-2202-49c4-9d18-f360b177b15b does not exist May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-514070ab-d3ec-495a-9572-5aaa0d53cf94'] May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6fa415d8-2202-49c4-9d18-f360b177b15b does not exist May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-514070ab-d3ec-495a-9572-5aaa0d53cf94'] May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6fa415d8-2202-49c4-9d18-f360b177b15b does not exist May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-514070ab-d3ec-495a-9572-5aaa0d53cf94'] May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6fa415d8-2202-49c4-9d18-f360b177b15b does not exist May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-514070ab-d3ec-495a-9572-5aaa0d53cf94'] May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7cfc3c9e-5bc5-4cc1-83c5-544a598dbb99 tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] Returning 404 to user: Security group 6fa415d8-2202-49c4-9d18-f360b177b15b does not exist May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-514070ab-d3ec-495a-9572-5aaa0d53cf94'] {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7cfc3c9e-5bc5-4cc1-83c5-544a598dbb99 tempest-SecurityGroupsNegativeTestJSON-1497876098 tempest-SecurityGroupsNegativeTestJSON-1497876098-project] 10.222.0.49 "PUT /compute/v2.1/os-security-groups/6fa415d8-2202-49c4-9d18-f360b177b15b" status: 404 len: 194 microversion: 2.1 time: 0.040173 May 21 21:16:43.062942 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 884/1751] 10.222.0.49 () {60 vars in 1289 bytes} [Sat May 21 21:16:43 2022] PUT /compute/v2.1/os-security-groups/6fa415d8-2202-49c4-9d18-f360b177b15b => generated 194 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:16:43.071603 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-333f01bb-b8f9-4e93-a713-471de5b16bf9 req-2815e613-4b04-4dff-8f3e-b1dd7a56fad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a55484-c74d-46c8-b37e-1fc43941e895", "tag": "2b5fd365-20f9-4fcc-919f-6f7d08efba8b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:43.082507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-333f01bb-b8f9-4e93-a713-471de5b16bf9 req-2815e613-4b04-4dff-8f3e-b1dd7a56fad4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:43.083367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-333f01bb-b8f9-4e93-a713-471de5b16bf9 req-2815e613-4b04-4dff-8f3e-b1dd7a56fad4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:43.095067 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-333f01bb-b8f9-4e93-a713-471de5b16bf9 req-2815e613-4b04-4dff-8f3e-b1dd7a56fad4 service nova] Creating event network-changed:2b5fd365-20f9-4fcc-919f-6f7d08efba8b for instance c6a55484-c74d-46c8-b37e-1fc43941e895 on nch1-master-1 May 21 21:16:43.100096 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-333f01bb-b8f9-4e93-a713-471de5b16bf9 req-2815e613-4b04-4dff-8f3e-b1dd7a56fad4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037026 May 21 21:16:43.101831 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 885/1752] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:43.107629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e6ff1f70-c4bc-4b0d-ac9b-69b0b19da851 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Action: 'create', calling method: .version_select at 0x7fc81b7fe940>, body: {"security_group_rule": {"parent_group_id": "2010bbe6-8b75-4327-be47-343c667a3bb0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:43.247315 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-eea2423d-14ad-461d-ac15-e0d6c9e135d6 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "DELETE /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 204 len: 0 microversion: 2.1 time: 0.589195 May 21 21:16:43.248530 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 868/1753] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:16:42 2022] DELETE /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:16:43.255518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6c23f89c-cfce-437a-a7e8-ea6d11700cd3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:43.257322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6c23f89c-cfce-437a-a7e8-ea6d11700cd3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: bd8944e0-b77d-4aa0-8d85-b98814346aed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:43.275005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c23f89c-cfce-437a-a7e8-ea6d11700cd3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:43.275932 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c23f89c-cfce-437a-a7e8-ea6d11700cd3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:43.276870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c23f89c-cfce-437a-a7e8-ea6d11700cd3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:43.277396 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c23f89c-cfce-437a-a7e8-ea6d11700cd3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:43.310126 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-6c23f89c-cfce-437a-a7e8-ea6d11700cd3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] HTTP exception thrown: Instance bd8944e0-b77d-4aa0-8d85-b98814346aed could not be found. May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6c23f89c-cfce-437a-a7e8-ea6d11700cd3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Request method failure captured: May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed HTTP/1.1 May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZSCYysyyOTwVzhR_Vt3Rp4hJGlHQ1xQ5d6hFUxjxvsTAgt6ix0UNE2Z2Vln9ahBs6pfbfiUV8DEik3Vk1FDugBkn4AbmOx4uTGzwiP9EUa_o0XQmPT-P2Agu2oeG_4YhdEiPrs-TaOwa6w5WGXcLQM63lci1mbOXuKdXB18YVm1Hg May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/53774c838bd64b319776f9afa0821b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_53774c838bd64b319776f9afa0821b79", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 5e82c479130c4377a9a27dd7c8bbe611 May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance bd8944e0-b77d-4aa0-8d85-b98814346aed could not be found. May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'bd8944e0-b77d-4aa0-8d85-b98814346aed'} May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd8944e0-b77d-4aa0-8d85-b98814346aed could not be found. May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd8944e0-b77d-4aa0-8d85-b98814346aed could not be found. May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:43.312013 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:43.318252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:43.318252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:43.318252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:43.318252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:43.318252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:43.318252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd8944e0-b77d-4aa0-8d85-b98814346aed could not be found. May 21 21:16:43.318252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:43.318252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6c23f89c-cfce-437a-a7e8-ea6d11700cd3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Returning 404 to user: Instance bd8944e0-b77d-4aa0-8d85-b98814346aed could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:43.318252 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6c23f89c-cfce-437a-a7e8-ea6d11700cd3 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed" status: 404 len: 111 microversion: 2.1 time: 0.067829 May 21 21:16:43.322071 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 869/1754] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:43 2022] GET /compute/v2.1/servers/bd8944e0-b77d-4aa0-8d85-b98814346aed => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:16:43.329059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5ca20774-949a-48cd-b03b-d55b08954ecf tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:43.329697 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5ca20774-949a-48cd-b03b-d55b08954ecf tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:43.342388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ca20774-949a-48cd-b03b-d55b08954ecf tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:43.342853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ca20774-949a-48cd-b03b-d55b08954ecf tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:43.343673 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ca20774-949a-48cd-b03b-d55b08954ecf tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:43.344129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ca20774-949a-48cd-b03b-d55b08954ecf tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:43.614007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5ca20774-949a-48cd-b03b-d55b08954ecf tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:43.624751 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5ca20774-949a-48cd-b03b-d55b08954ecf tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1468 microversion: 2.1 time: 0.300955 May 21 21:16:43.625806 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 870/1755] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:43 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1468 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:43.633864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ff8ea057-6129-449c-830f-0f39d2513cc8 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b6e34c0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:43.727733 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ff8ea057-6129-449c-830f-0f39d2513cc8 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af" status: 200 len: 1412 microversion: 2.1 time: 0.100466 May 21 21:16:43.729508 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 871/1756] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:43 2022] GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af => generated 1412 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:43.735666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-506edb3a-9040-432a-8e26-bc872639a983 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81b57f8b0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:43.766393 ncdv-master-1 devstack@n-api.service[131278]: DEBUG neutronclient.v2_0.client [None req-506edb3a-9040-432a-8e26-bc872639a983 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 does not exist", "detail": ""}} {{(pid=131278) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:16:43.767264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.security_group_api [None req-506edb3a-9040-432a-8e26-bc872639a983 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Neutron security group d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 not found {{(pid=131278) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 21 21:16:43.768189 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-506edb3a-9040-432a-8e26-bc872639a983 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] HTTP exception thrown: Security group d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 does not exist May 21 21:16:43.768189 ncdv-master-1 devstack@n-api.service[131278]: Neutron server returns request_ids: ['req-6cf09ada-1801-4e95-8636-4d8e3b5af1d9'] May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-506edb3a-9040-432a-8e26-bc872639a983 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Request method failure captured: May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/os-security-groups/d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 HTTP/1.1 May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZSCYysyyOTwVzhR_Vt3Rp4hJGlHQ1xQ5d6hFUxjxvsTAgt6ix0UNE2Z2Vln9ahBs6pfbfiUV8DEik3Vk1FDugBkn4AbmOx4uTGzwiP9EUa_o0XQmPT-P2Agu2oeG_4YhdEiPrs-TaOwa6w5WGXcLQM63lci1mbOXuKdXB18YVm1Hg May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/53774c838bd64b319776f9afa0821b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_53774c838bd64b319776f9afa0821b79", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 5e82c479130c4377a9a27dd7c8bbe611 May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: exception: Security group d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 does not exist May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: Neutron server returns request_ids: ['req-6cf09ada-1801-4e95-8636-4d8e3b5af1d9'] May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'd8cd11c4-e0bc-436e-baf0-a0f3f17e5f02'} May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:16:43.770388 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 does not exist May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cf09ada-1801-4e95-8636-4d8e3b5af1d9'] May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 does not exist May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cf09ada-1801-4e95-8636-4d8e3b5af1d9'] May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 does not exist May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cf09ada-1801-4e95-8636-4d8e3b5af1d9'] May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 does not exist May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cf09ada-1801-4e95-8636-4d8e3b5af1d9'] May 21 21:16:43.775091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:43.779125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-506edb3a-9040-432a-8e26-bc872639a983 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Returning 404 to user: Security group d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 does not exist May 21 21:16:43.779125 ncdv-master-1 devstack@n-api.service[131278]: Neutron server returns request_ids: ['req-6cf09ada-1801-4e95-8636-4d8e3b5af1d9'] {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:43.780564 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-506edb3a-9040-432a-8e26-bc872639a983 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02" status: 404 len: 194 microversion: 2.1 time: 0.048872 May 21 21:16:43.781761 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 872/1757] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:43 2022] DELETE /compute/v2.1/os-security-groups/d8cd11c4-e0bc-436e-baf0-a0f3f17e5f02 => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:16:43.788916 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ac003031-cf15-472e-924f-f303949e5fb1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:43.793480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ac003031-cf15-472e-924f-f303949e5fb1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:43.799235 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ac003031-cf15-472e-924f-f303949e5fb1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:43.799970 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ac003031-cf15-472e-924f-f303949e5fb1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:43.800993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ac003031-cf15-472e-924f-f303949e5fb1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:43.801712 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ac003031-cf15-472e-924f-f303949e5fb1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:44.060056 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e6ff1f70-c4bc-4b0d-ac9b-69b0b19da851 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.956893 May 21 21:16:44.066525 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 886/1758] 10.222.0.49 () {60 vars in 1194 bytes} [Sat May 21 21:16:43 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:44.072045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-75eb2276-059a-46ee-82a3-aa71a456d1bf tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81bb92550>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:44.104715 ncdv-master-1 devstack@n-api.service[131277]: DEBUG neutronclient.v2_0.client [None req-75eb2276-059a-46ee-82a3-aa71a456d1bf tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c579f2cf-2903-4ff5-b25b-504fe5aba452 does not exist", "detail": ""}} {{(pid=131277) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:16:44.105999 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.security_group_api [None req-75eb2276-059a-46ee-82a3-aa71a456d1bf tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Neutron security group c579f2cf-2903-4ff5-b25b-504fe5aba452 not found {{(pid=131277) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 21 21:16:44.106698 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-75eb2276-059a-46ee-82a3-aa71a456d1bf tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] HTTP exception thrown: Security group c579f2cf-2903-4ff5-b25b-504fe5aba452 does not exist May 21 21:16:44.106698 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-916dc777-0b22-4d14-b074-52e8568af619'] May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-75eb2276-059a-46ee-82a3-aa71a456d1bf tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Request method failure captured: May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/os-security-groups/c579f2cf-2903-4ff5-b25b-504fe5aba452 HTTP/1.1 May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZSCYysyyOTwVzhR_Vt3Rp4hJGlHQ1xQ5d6hFUxjxvsTAgt6ix0UNE2Z2Vln9ahBs6pfbfiUV8DEik3Vk1FDugBkn4AbmOx4uTGzwiP9EUa_o0XQmPT-P2Agu2oeG_4YhdEiPrs-TaOwa6w5WGXcLQM63lci1mbOXuKdXB18YVm1Hg May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/53774c838bd64b319776f9afa0821b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_53774c838bd64b319776f9afa0821b79", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 5e82c479130c4377a9a27dd7c8bbe611 May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: exception: Security group c579f2cf-2903-4ff5-b25b-504fe5aba452 does not exist May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-916dc777-0b22-4d14-b074-52e8568af619'] May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'c579f2cf-2903-4ff5-b25b-504fe5aba452'} May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:16:44.108923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c579f2cf-2903-4ff5-b25b-504fe5aba452 does not exist May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-916dc777-0b22-4d14-b074-52e8568af619'] May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c579f2cf-2903-4ff5-b25b-504fe5aba452 does not exist May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-916dc777-0b22-4d14-b074-52e8568af619'] May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c579f2cf-2903-4ff5-b25b-504fe5aba452 does not exist May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-916dc777-0b22-4d14-b074-52e8568af619'] May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c579f2cf-2903-4ff5-b25b-504fe5aba452 does not exist May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-916dc777-0b22-4d14-b074-52e8568af619'] May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-75eb2276-059a-46ee-82a3-aa71a456d1bf tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Returning 404 to user: Security group c579f2cf-2903-4ff5-b25b-504fe5aba452 does not exist May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-916dc777-0b22-4d14-b074-52e8568af619'] {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-75eb2276-059a-46ee-82a3-aa71a456d1bf tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/c579f2cf-2903-4ff5-b25b-504fe5aba452" status: 404 len: 194 microversion: 2.1 time: 0.042813 May 21 21:16:44.115078 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 887/1759] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:44 2022] DELETE /compute/v2.1/os-security-groups/c579f2cf-2903-4ff5-b25b-504fe5aba452 => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:16:44.121206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-928e288d-1131-4ca2-ad59-ba34c4949f29 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:44.121965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-928e288d-1131-4ca2-ad59-ba34c4949f29 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:44.134449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:DELETE=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:44.136411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-928e288d-1131-4ca2-ad59-ba34c4949f29 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:44.136877 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-928e288d-1131-4ca2-ad59-ba34c4949f29 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:44.144374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-928e288d-1131-4ca2-ad59-ba34c4949f29 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:44.145112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-928e288d-1131-4ca2-ad59-ba34c4949f29 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:44.170822 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ac003031-cf15-472e-924f-f303949e5fb1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:44.183351 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ac003031-cf15-472e-924f-f303949e5fb1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1199 microversion: 2.1 time: 0.399834 May 21 21:16:44.185493 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 873/1760] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:43 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1199 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:44.197702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-41fbced0-c6df-4397-a5a4-aa9780a48c00 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Action: 'create', calling method: .version_select at 0x7fc81b6e3ee0>, body: {"security_group_rule": {"parent_group_id": "2010bbe6-8b75-4327-be47-343c667a3bb0", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:44.367141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-928e288d-1131-4ca2-ad59-ba34c4949f29 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:44.377170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-928e288d-1131-4ca2-ad59-ba34c4949f29 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:44.378955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-928e288d-1131-4ca2-ad59-ba34c4949f29 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:44.380507 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-928e288d-1131-4ca2-ad59-ba34c4949f29 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1280 microversion: 2.25 time: 0.267642 May 21 21:16:44.381235 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 888/1761] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:16:44 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1280 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:16:44.413730 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-088c0fd2-00f4-411e-a1da-87b2dc3d10ce tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81b64fd30>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: DEBUG neutronclient.v2_0.client [None req-088c0fd2-00f4-411e-a1da-87b2dc3d10ce tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 927dc74c-faa2-45fc-ab7f-bc417766516b does not exist", "detail": ""}} {{(pid=131277) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.security_group_api [None req-088c0fd2-00f4-411e-a1da-87b2dc3d10ce tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Neutron security group 927dc74c-faa2-45fc-ab7f-bc417766516b not found {{(pid=131277) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-088c0fd2-00f4-411e-a1da-87b2dc3d10ce tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] HTTP exception thrown: Security group 927dc74c-faa2-45fc-ab7f-bc417766516b does not exist May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-c929c034-b241-4ae7-a918-8d9949ceeb94'] May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-088c0fd2-00f4-411e-a1da-87b2dc3d10ce tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Request method failure captured: May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/os-security-groups/927dc74c-faa2-45fc-ab7f-bc417766516b HTTP/1.1 May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZSCYysyyOTwVzhR_Vt3Rp4hJGlHQ1xQ5d6hFUxjxvsTAgt6ix0UNE2Z2Vln9ahBs6pfbfiUV8DEik3Vk1FDugBkn4AbmOx4uTGzwiP9EUa_o0XQmPT-P2Agu2oeG_4YhdEiPrs-TaOwa6w5WGXcLQM63lci1mbOXuKdXB18YVm1Hg May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/53774c838bd64b319776f9afa0821b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_53774c838bd64b319776f9afa0821b79", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 5e82c479130c4377a9a27dd7c8bbe611 May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: exception: Security group 927dc74c-faa2-45fc-ab7f-bc417766516b does not exist May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-c929c034-b241-4ae7-a918-8d9949ceeb94'] May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '927dc74c-faa2-45fc-ab7f-bc417766516b'} May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:16:44.483696 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 927dc74c-faa2-45fc-ab7f-bc417766516b does not exist May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c929c034-b241-4ae7-a918-8d9949ceeb94'] May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 927dc74c-faa2-45fc-ab7f-bc417766516b does not exist May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c929c034-b241-4ae7-a918-8d9949ceeb94'] May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 927dc74c-faa2-45fc-ab7f-bc417766516b does not exist May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c929c034-b241-4ae7-a918-8d9949ceeb94'] May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 927dc74c-faa2-45fc-ab7f-bc417766516b does not exist May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c929c034-b241-4ae7-a918-8d9949ceeb94'] May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-088c0fd2-00f4-411e-a1da-87b2dc3d10ce tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Returning 404 to user: Security group 927dc74c-faa2-45fc-ab7f-bc417766516b does not exist May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-c929c034-b241-4ae7-a918-8d9949ceeb94'] {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-088c0fd2-00f4-411e-a1da-87b2dc3d10ce tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/927dc74c-faa2-45fc-ab7f-bc417766516b" status: 404 len: 194 microversion: 2.1 time: 0.102908 May 21 21:16:44.492156 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 889/1762] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:44 2022] DELETE /compute/v2.1/os-security-groups/927dc74c-faa2-45fc-ab7f-bc417766516b => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:16:44.500984 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ebb14260-97e7-478f-b12d-92317c491dc1 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81bb920d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:44.578196 ncdv-master-1 devstack@n-api.service[131277]: DEBUG neutronclient.v2_0.client [None req-ebb14260-97e7-478f-b12d-92317c491dc1 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3ac2b536-4d71-449e-9a1c-3a3d6b33f105 does not exist", "detail": ""}} {{(pid=131277) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:16:44.579292 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.security_group_api [None req-ebb14260-97e7-478f-b12d-92317c491dc1 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Neutron security group 3ac2b536-4d71-449e-9a1c-3a3d6b33f105 not found {{(pid=131277) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 21 21:16:44.583141 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-ebb14260-97e7-478f-b12d-92317c491dc1 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] HTTP exception thrown: Security group 3ac2b536-4d71-449e-9a1c-3a3d6b33f105 does not exist May 21 21:16:44.583141 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-fcd41c3c-0a00-46db-8702-63cd542ea651'] May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ebb14260-97e7-478f-b12d-92317c491dc1 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Request method failure captured: May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/os-security-groups/3ac2b536-4d71-449e-9a1c-3a3d6b33f105 HTTP/1.1 May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZSCYysyyOTwVzhR_Vt3Rp4hJGlHQ1xQ5d6hFUxjxvsTAgt6ix0UNE2Z2Vln9ahBs6pfbfiUV8DEik3Vk1FDugBkn4AbmOx4uTGzwiP9EUa_o0XQmPT-P2Agu2oeG_4YhdEiPrs-TaOwa6w5WGXcLQM63lci1mbOXuKdXB18YVm1Hg May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/53774c838bd64b319776f9afa0821b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_53774c838bd64b319776f9afa0821b79", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 5e82c479130c4377a9a27dd7c8bbe611 May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: exception: Security group 3ac2b536-4d71-449e-9a1c-3a3d6b33f105 does not exist May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-fcd41c3c-0a00-46db-8702-63cd542ea651'] May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '3ac2b536-4d71-449e-9a1c-3a3d6b33f105'} May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:16:44.587560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3ac2b536-4d71-449e-9a1c-3a3d6b33f105 does not exist May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcd41c3c-0a00-46db-8702-63cd542ea651'] May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3ac2b536-4d71-449e-9a1c-3a3d6b33f105 does not exist May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcd41c3c-0a00-46db-8702-63cd542ea651'] May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3ac2b536-4d71-449e-9a1c-3a3d6b33f105 does not exist May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcd41c3c-0a00-46db-8702-63cd542ea651'] May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3ac2b536-4d71-449e-9a1c-3a3d6b33f105 does not exist May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcd41c3c-0a00-46db-8702-63cd542ea651'] May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ebb14260-97e7-478f-b12d-92317c491dc1 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Returning 404 to user: Security group 3ac2b536-4d71-449e-9a1c-3a3d6b33f105 does not exist May 21 21:16:44.592205 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-fcd41c3c-0a00-46db-8702-63cd542ea651'] {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:44.601105 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ebb14260-97e7-478f-b12d-92317c491dc1 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/3ac2b536-4d71-449e-9a1c-3a3d6b33f105" status: 404 len: 194 microversion: 2.1 time: 0.109101 May 21 21:16:44.603363 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 890/1763] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:44 2022] DELETE /compute/v2.1/os-security-groups/3ac2b536-4d71-449e-9a1c-3a3d6b33f105 => generated 194 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:16:44.620971 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-24a9e469-359a-4df0-adc9-cbdbfc4f255c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81bced550>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:44.682560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG neutronclient.v2_0.client [None req-24a9e469-359a-4df0-adc9-cbdbfc4f255c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d088f61-f82f-4e08-a359-9a9e5b4e6bba does not exist", "detail": ""}} {{(pid=131277) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:16:44.684728 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.security_group_api [None req-24a9e469-359a-4df0-adc9-cbdbfc4f255c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Neutron security group 9d088f61-f82f-4e08-a359-9a9e5b4e6bba not found {{(pid=131277) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 21 21:16:44.687988 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-24a9e469-359a-4df0-adc9-cbdbfc4f255c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] HTTP exception thrown: Security group 9d088f61-f82f-4e08-a359-9a9e5b4e6bba does not exist May 21 21:16:44.687988 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-f9f560b1-95bc-4503-8624-3ae1fe023529'] May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-24a9e469-359a-4df0-adc9-cbdbfc4f255c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Request method failure captured: May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/os-security-groups/9d088f61-f82f-4e08-a359-9a9e5b4e6bba HTTP/1.1 May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZSCYysyyOTwVzhR_Vt3Rp4hJGlHQ1xQ5d6hFUxjxvsTAgt6ix0UNE2Z2Vln9ahBs6pfbfiUV8DEik3Vk1FDugBkn4AbmOx4uTGzwiP9EUa_o0XQmPT-P2Agu2oeG_4YhdEiPrs-TaOwa6w5WGXcLQM63lci1mbOXuKdXB18YVm1Hg May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/53774c838bd64b319776f9afa0821b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_53774c838bd64b319776f9afa0821b79", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 5e82c479130c4377a9a27dd7c8bbe611 May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: exception: Security group 9d088f61-f82f-4e08-a359-9a9e5b4e6bba does not exist May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-f9f560b1-95bc-4503-8624-3ae1fe023529'] May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '9d088f61-f82f-4e08-a359-9a9e5b4e6bba'} May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:16:44.691231 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9d088f61-f82f-4e08-a359-9a9e5b4e6bba does not exist May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9f560b1-95bc-4503-8624-3ae1fe023529'] May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9d088f61-f82f-4e08-a359-9a9e5b4e6bba does not exist May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9f560b1-95bc-4503-8624-3ae1fe023529'] May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9d088f61-f82f-4e08-a359-9a9e5b4e6bba does not exist May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9f560b1-95bc-4503-8624-3ae1fe023529'] May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9d088f61-f82f-4e08-a359-9a9e5b4e6bba does not exist May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9f560b1-95bc-4503-8624-3ae1fe023529'] May 21 21:16:44.696663 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:44.702082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-24a9e469-359a-4df0-adc9-cbdbfc4f255c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Returning 404 to user: Security group 9d088f61-f82f-4e08-a359-9a9e5b4e6bba does not exist May 21 21:16:44.702082 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-f9f560b1-95bc-4503-8624-3ae1fe023529'] {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:44.705119 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-24a9e469-359a-4df0-adc9-cbdbfc4f255c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/9d088f61-f82f-4e08-a359-9a9e5b4e6bba" status: 404 len: 194 microversion: 2.1 time: 0.093611 May 21 21:16:44.706551 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 891/1764] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:44 2022] DELETE /compute/v2.1/os-security-groups/9d088f61-f82f-4e08-a359-9a9e5b4e6bba => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:16:44.714177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f5c174fe-3940-44f1-b0df-b31df2f909e9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:44.715099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f5c174fe-3940-44f1-b0df-b31df2f909e9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:44.725844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5c174fe-3940-44f1-b0df-b31df2f909e9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:44.726751 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5c174fe-3940-44f1-b0df-b31df2f909e9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:44.727776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5c174fe-3940-44f1-b0df-b31df2f909e9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:44.728485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5c174fe-3940-44f1-b0df-b31df2f909e9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:44.905952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:44.974213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f5c174fe-3940-44f1-b0df-b31df2f909e9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:44.986868 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f5c174fe-3940-44f1-b0df-b31df2f909e9 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1468 microversion: 2.1 time: 0.278666 May 21 21:16:44.987472 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 892/1765] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:44 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1468 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:44.992549 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5e575ead-b396-4666-acba-556f8729a28a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81b64fee0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:45.021401 ncdv-master-1 devstack@n-api.service[131277]: DEBUG neutronclient.v2_0.client [None req-5e575ead-b396-4666-acba-556f8729a28a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a8369913-24aa-4a6e-bff3-7ae89aae7092 does not exist", "detail": ""}} {{(pid=131277) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:16:45.022570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.security_group_api [None req-5e575ead-b396-4666-acba-556f8729a28a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Neutron security group a8369913-24aa-4a6e-bff3-7ae89aae7092 not found {{(pid=131277) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 21 21:16:45.023145 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-5e575ead-b396-4666-acba-556f8729a28a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] HTTP exception thrown: Security group a8369913-24aa-4a6e-bff3-7ae89aae7092 does not exist May 21 21:16:45.023145 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-4798d8ff-e072-41d8-ba86-8c52c4515330'] May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5e575ead-b396-4666-acba-556f8729a28a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Request method failure captured: May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/os-security-groups/a8369913-24aa-4a6e-bff3-7ae89aae7092 HTTP/1.1 May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZSCYysyyOTwVzhR_Vt3Rp4hJGlHQ1xQ5d6hFUxjxvsTAgt6ix0UNE2Z2Vln9ahBs6pfbfiUV8DEik3Vk1FDugBkn4AbmOx4uTGzwiP9EUa_o0XQmPT-P2Agu2oeG_4YhdEiPrs-TaOwa6w5WGXcLQM63lci1mbOXuKdXB18YVm1Hg May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/53774c838bd64b319776f9afa0821b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_53774c838bd64b319776f9afa0821b79", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 5e82c479130c4377a9a27dd7c8bbe611 May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: exception: Security group a8369913-24aa-4a6e-bff3-7ae89aae7092 does not exist May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-4798d8ff-e072-41d8-ba86-8c52c4515330'] May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'a8369913-24aa-4a6e-bff3-7ae89aae7092'} May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:16:45.025006 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a8369913-24aa-4a6e-bff3-7ae89aae7092 does not exist May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4798d8ff-e072-41d8-ba86-8c52c4515330'] May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a8369913-24aa-4a6e-bff3-7ae89aae7092 does not exist May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4798d8ff-e072-41d8-ba86-8c52c4515330'] May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a8369913-24aa-4a6e-bff3-7ae89aae7092 does not exist May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4798d8ff-e072-41d8-ba86-8c52c4515330'] May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a8369913-24aa-4a6e-bff3-7ae89aae7092 does not exist May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4798d8ff-e072-41d8-ba86-8c52c4515330'] May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5e575ead-b396-4666-acba-556f8729a28a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Returning 404 to user: Security group a8369913-24aa-4a6e-bff3-7ae89aae7092 does not exist May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-4798d8ff-e072-41d8-ba86-8c52c4515330'] {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5e575ead-b396-4666-acba-556f8729a28a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/a8369913-24aa-4a6e-bff3-7ae89aae7092" status: 404 len: 194 microversion: 2.1 time: 0.037832 May 21 21:16:45.030057 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 893/1766] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:44 2022] DELETE /compute/v2.1/os-security-groups/a8369913-24aa-4a6e-bff3-7ae89aae7092 => generated 194 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:16:45.034141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aa3727b5-2f54-4b7c-90f5-3d522d94605d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81bb92ee0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:45.085834 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aa3727b5-2f54-4b7c-90f5-3d522d94605d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af" status: 200 len: 1412 microversion: 2.1 time: 0.057107 May 21 21:16:45.086445 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 894/1767] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:45 2022] GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af => generated 1412 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:45.091657 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a6109d6d-57fe-48c4-8fa4-a9fbc1ec537e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:45.098362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a6109d6d-57fe-48c4-8fa4-a9fbc1ec537e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:45.099114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a6109d6d-57fe-48c4-8fa4-a9fbc1ec537e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:45.099567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a6109d6d-57fe-48c4-8fa4-a9fbc1ec537e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:45.101033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a6109d6d-57fe-48c4-8fa4-a9fbc1ec537e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:45.101638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a6109d6d-57fe-48c4-8fa4-a9fbc1ec537e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:45.127524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a6109d6d-57fe-48c4-8fa4-a9fbc1ec537e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:16:45.568186 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a6109d6d-57fe-48c4-8fa4-a9fbc1ec537e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f" status: 204 len: 0 microversion: 2.1 time: 0.478735 May 21 21:16:45.571071 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 895/1768] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:16:45 2022] DELETE /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:16:45.585686 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7b113ae4-72aa-494c-8b50-fb6bee8487f9 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:45.592446 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7b113ae4-72aa-494c-8b50-fb6bee8487f9 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:45.610875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7b113ae4-72aa-494c-8b50-fb6bee8487f9 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:45.612891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7b113ae4-72aa-494c-8b50-fb6bee8487f9 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:45.622141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7b113ae4-72aa-494c-8b50-fb6bee8487f9 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:45.625366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7b113ae4-72aa-494c-8b50-fb6bee8487f9 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:45.874130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7b113ae4-72aa-494c-8b50-fb6bee8487f9 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:45.896820 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7b113ae4-72aa-494c-8b50-fb6bee8487f9 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1199 microversion: 2.1 time: 0.323857 May 21 21:16:45.899010 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 896/1769] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:45 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1199 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:45.906726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-db9a92dd-132a-4211-9b01-ec7783c90bf7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:45.908138 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-db9a92dd-132a-4211-9b01-ec7783c90bf7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:45.917906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db9a92dd-132a-4211-9b01-ec7783c90bf7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:45.918625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db9a92dd-132a-4211-9b01-ec7783c90bf7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:45.919816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db9a92dd-132a-4211-9b01-ec7783c90bf7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:45.920471 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db9a92dd-132a-4211-9b01-ec7783c90bf7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:46.002469 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-41fbced0-c6df-4397-a5a4-aa9780a48c00 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.815653 May 21 21:16:46.005306 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 874/1770] 10.222.0.49 () {60 vars in 1194 bytes} [Sat May 21 21:16:44 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:46.013037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aca1eb5e-a742-4b33-a07a-0e40b8a0116a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:46.013968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-aca1eb5e-a742-4b33-a07a-0e40b8a0116a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:46.023958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aca1eb5e-a742-4b33-a07a-0e40b8a0116a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:46.024691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aca1eb5e-a742-4b33-a07a-0e40b8a0116a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:46.027065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aca1eb5e-a742-4b33-a07a-0e40b8a0116a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:46.027735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aca1eb5e-a742-4b33-a07a-0e40b8a0116a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:46.162321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-db9a92dd-132a-4211-9b01-ec7783c90bf7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:46.178039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-db9a92dd-132a-4211-9b01-ec7783c90bf7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:46.180436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-db9a92dd-132a-4211-9b01-ec7783c90bf7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:46.183001 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-db9a92dd-132a-4211-9b01-ec7783c90bf7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1280 microversion: 2.25 time: 0.282094 May 21 21:16:46.183876 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 897/1771] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:16:45 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1280 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:16:46.197436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-110717b7-efa5-4268-a2d1-2b49f94a0c70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:46.199887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-110717b7-efa5-4268-a2d1-2b49f94a0c70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:46.209088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-110717b7-efa5-4268-a2d1-2b49f94a0c70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:46.211187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-110717b7-efa5-4268-a2d1-2b49f94a0c70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:46.212371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-110717b7-efa5-4268-a2d1-2b49f94a0c70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:46.212983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-110717b7-efa5-4268-a2d1-2b49f94a0c70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:46.514683 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-110717b7-efa5-4268-a2d1-2b49f94a0c70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:46.526821 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-110717b7-efa5-4268-a2d1-2b49f94a0c70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1468 microversion: 2.1 time: 0.341805 May 21 21:16:46.527326 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 898/1772] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:46 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1468 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:46.542525 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-effc4dbd-0fd4-41ae-9d8c-f154fc6c7d1d tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Calling method '.version_select at 0x7fc81b649670>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:46.653345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=22 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:46.663585 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-aca1eb5e-a742-4b33-a07a-0e40b8a0116a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:46.679879 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-aca1eb5e-a742-4b33-a07a-0e40b8a0116a tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f" status: 200 len: 1646 microversion: 2.1 time: 0.672849 May 21 21:16:46.690680 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 875/1773] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:46 2022] GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f => generated 1646 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:46.706189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3cf3f21c-015b-4ff2-8430-dce5125c8860 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b6e3670>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:46.760708 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-effc4dbd-0fd4-41ae-9d8c-f154fc6c7d1d tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/2010bbe6-8b75-4327-be47-343c667a3bb0" status: 200 len: 664 microversion: 2.1 time: 0.229875 May 21 21:16:46.761533 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 899/1774] 10.222.0.49 () {58 vars in 1268 bytes} [Sat May 21 21:16:46 2022] GET /compute/v2.1/os-security-groups/2010bbe6-8b75-4327-be47-343c667a3bb0 => generated 664 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:46.777162 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-842493d0-76ed-4bcd-a3f0-617cef4258ca tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Calling method '.version_select at 0x7fc81bb453a0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:46.811830 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3cf3f21c-015b-4ff2-8430-dce5125c8860 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af" status: 200 len: 1412 microversion: 2.1 time: 0.122460 May 21 21:16:46.812462 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 876/1775] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:46 2022] GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af => generated 1412 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:46.824856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-0ceb63f7-b254-45eb-bf8d-94557c016697 req-726a11d8-9ea3-46b8-ac3d-05a2b573e320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add2b490-a27b-434c-9ff5-aa58ee869b78", "name": "network-vif-deleted", "tag": "6bd26e7a-5e3e-4a20-8012-db2830ba8f9e"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:46.856178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0ceb63f7-b254-45eb-bf8d-94557c016697 req-726a11d8-9ea3-46b8-ac3d-05a2b573e320 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:46.856763 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0ceb63f7-b254-45eb-bf8d-94557c016697 req-726a11d8-9ea3-46b8-ac3d-05a2b573e320 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:46.882442 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-0ceb63f7-b254-45eb-bf8d-94557c016697 req-726a11d8-9ea3-46b8-ac3d-05a2b573e320 service nova] Creating event network-vif-deleted:6bd26e7a-5e3e-4a20-8012-db2830ba8f9e for instance add2b490-a27b-434c-9ff5-aa58ee869b78 on nch2-master-1 May 21 21:16:46.894542 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-0ceb63f7-b254-45eb-bf8d-94557c016697 req-726a11d8-9ea3-46b8-ac3d-05a2b573e320 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080755 May 21 21:16:46.899542 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 877/1776] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:46.927178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0f7b8178-c71e-403f-a598-a28a8b547fbb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:46.927178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0f7b8178-c71e-403f-a598-a28a8b547fbb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:46.937196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f7b8178-c71e-403f-a598-a28a8b547fbb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:46.937699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f7b8178-c71e-403f-a598-a28a8b547fbb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:46.938545 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f7b8178-c71e-403f-a598-a28a8b547fbb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:46.938995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f7b8178-c71e-403f-a598-a28a8b547fbb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:46.998762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:47.293389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0f7b8178-c71e-403f-a598-a28a8b547fbb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:47.332075 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0f7b8178-c71e-403f-a598-a28a8b547fbb tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1199 microversion: 2.1 time: 0.420123 May 21 21:16:47.332710 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 878/1777] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:46 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1199 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:47.374391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-da9c0bb0-44fa-492b-b967-e14815b8aab5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:47.376833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-da9c0bb0-44fa-492b-b967-e14815b8aab5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:47.398108 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da9c0bb0-44fa-492b-b967-e14815b8aab5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:47.400240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da9c0bb0-44fa-492b-b967-e14815b8aab5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:47.402184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da9c0bb0-44fa-492b-b967-e14815b8aab5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:47.403406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da9c0bb0-44fa-492b-b967-e14815b8aab5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:47.436378 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-842493d0-76ed-4bcd-a3f0-617cef4258ca tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-group-rules/3e48dfc1-c168-42fe-adb4-6f146ba5ddbb" status: 202 len: 0 microversion: 2.1 time: 0.666782 May 21 21:16:47.441504 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 900/1778] 10.222.0.49 () {58 vars in 1286 bytes} [Sat May 21 21:16:46 2022] DELETE /compute/v2.1/os-security-group-rules/3e48dfc1-c168-42fe-adb4-6f146ba5ddbb => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:47.468464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-10bf542d-6a75-4eff-9001-9b3ea2e22d22 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Calling method '.version_select at 0x7fc81bb823a0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:47.829095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-da9c0bb0-44fa-492b-b967-e14815b8aab5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:47.842373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-da9c0bb0-44fa-492b-b967-e14815b8aab5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:47.845406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-da9c0bb0-44fa-492b-b967-e14815b8aab5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:47.851644 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-da9c0bb0-44fa-492b-b967-e14815b8aab5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1280 microversion: 2.25 time: 0.508651 May 21 21:16:47.854611 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 879/1779] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:16:47 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1280 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:16:47.861945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-53451c7e-7b34-4a6f-8718-ed91d0ebdf70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:47.867340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-53451c7e-7b34-4a6f-8718-ed91d0ebdf70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:47.884167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-53451c7e-7b34-4a6f-8718-ed91d0ebdf70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:47.884950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-53451c7e-7b34-4a6f-8718-ed91d0ebdf70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:47.885930 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-53451c7e-7b34-4a6f-8718-ed91d0ebdf70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:47.886536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-53451c7e-7b34-4a6f-8718-ed91d0ebdf70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:47.949693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-53451c7e-7b34-4a6f-8718-ed91d0ebdf70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:47.950565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-53451c7e-7b34-4a6f-8718-ed91d0ebdf70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:47.951204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-53451c7e-7b34-4a6f-8718-ed91d0ebdf70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lazy-loading 'fault' on Instance uuid add2b490-a27b-434c-9ff5-aa58ee869b78 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:16:48.024994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-53451c7e-7b34-4a6f-8718-ed91d0ebdf70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:48.034695 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-53451c7e-7b34-4a6f-8718-ed91d0ebdf70 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 200 len: 1302 microversion: 2.1 time: 0.178703 May 21 21:16:48.035591 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 880/1780] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:47 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 1302 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:48.063694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-760dcd48-4bc7-483e-b093-746793b1f995 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:48.064495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-760dcd48-4bc7-483e-b093-746793b1f995 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:48.070593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:48.072393 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-760dcd48-4bc7-483e-b093-746793b1f995 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:48.072857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-760dcd48-4bc7-483e-b093-746793b1f995 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:48.073780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-760dcd48-4bc7-483e-b093-746793b1f995 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:48.074408 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-760dcd48-4bc7-483e-b093-746793b1f995 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:48.481601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-760dcd48-4bc7-483e-b093-746793b1f995 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:48.496535 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-760dcd48-4bc7-483e-b093-746793b1f995 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f" status: 200 len: 1646 microversion: 2.1 time: 0.439494 May 21 21:16:48.500729 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 881/1781] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:48 2022] GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f => generated 1646 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:48.527936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-b5b34828-75c4-4b10-aa3a-2309ab574204 req-50077719-d347-413d-a7ff-13d1aa7f2e1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ce51e42-255d-45f7-afab-2fdb937e7758", "name": "network-vif-plugged", "status": "completed", "tag": "13fa11f5-00e8-4fa2-a36a-6c54e56541f6"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:48.544393 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b5b34828-75c4-4b10-aa3a-2309ab574204 req-50077719-d347-413d-a7ff-13d1aa7f2e1a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:48.546699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b5b34828-75c4-4b10-aa3a-2309ab574204 req-50077719-d347-413d-a7ff-13d1aa7f2e1a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:48.564513 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-b5b34828-75c4-4b10-aa3a-2309ab574204 req-50077719-d347-413d-a7ff-13d1aa7f2e1a service nova] Creating event network-vif-plugged:13fa11f5-00e8-4fa2-a36a-6c54e56541f6 for instance 4ce51e42-255d-45f7-afab-2fdb937e7758 on nch1-master-1 May 21 21:16:48.573104 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-b5b34828-75c4-4b10-aa3a-2309ab574204 req-50077719-d347-413d-a7ff-13d1aa7f2e1a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071963 May 21 21:16:48.576068 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 882/1782] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:48.591988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-41aca140-4d36-4bb9-9f32-771449fce246 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b5684c0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:48.642297 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-41aca140-4d36-4bb9-9f32-771449fce246 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af" status: 200 len: 1412 microversion: 2.1 time: 0.062500 May 21 21:16:48.642297 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 883/1783] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:48 2022] GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af => generated 1412 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:48.667739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f22b9f6a-ee84-4d0c-8c6e-e189c982ff20 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:48.670873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f22b9f6a-ee84-4d0c-8c6e-e189c982ff20 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:48.690155 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f22b9f6a-ee84-4d0c-8c6e-e189c982ff20 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:48.690897 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f22b9f6a-ee84-4d0c-8c6e-e189c982ff20 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:48.691954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f22b9f6a-ee84-4d0c-8c6e-e189c982ff20 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:48.693013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f22b9f6a-ee84-4d0c-8c6e-e189c982ff20 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:48.983701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f22b9f6a-ee84-4d0c-8c6e-e189c982ff20 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:48.997182 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f22b9f6a-ee84-4d0c-8c6e-e189c982ff20 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1199 microversion: 2.1 time: 0.354428 May 21 21:16:48.998305 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 884/1784] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:48 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1199 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:49.006079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-27832c3e-c1a7-471d-884d-00a3e28a2c61 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:49.013434 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-27832c3e-c1a7-471d-884d-00a3e28a2c61 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:49.020976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-27832c3e-c1a7-471d-884d-00a3e28a2c61 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:49.021681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-27832c3e-c1a7-471d-884d-00a3e28a2c61 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:49.029646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-27832c3e-c1a7-471d-884d-00a3e28a2c61 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:49.029646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-27832c3e-c1a7-471d-884d-00a3e28a2c61 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:49.061193 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-10bf542d-6a75-4eff-9001-9b3ea2e22d22 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/2010bbe6-8b75-4327-be47-343c667a3bb0" status: 202 len: 0 microversion: 2.1 time: 1.609613 May 21 21:16:49.061908 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 901/1785] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:47 2022] DELETE /compute/v2.1/os-security-groups/2010bbe6-8b75-4327-be47-343c667a3bb0 => generated 0 bytes in 1612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:49.067049 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d3eff6db-6bcb-41ca-80ef-0c71cb7eda64 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:49.067903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d3eff6db-6bcb-41ca-80ef-0c71cb7eda64 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: add2b490-a27b-434c-9ff5-aa58ee869b78] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:49.081057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3eff6db-6bcb-41ca-80ef-0c71cb7eda64 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:49.085481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3eff6db-6bcb-41ca-80ef-0c71cb7eda64 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:49.086568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3eff6db-6bcb-41ca-80ef-0c71cb7eda64 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:49.087976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3eff6db-6bcb-41ca-80ef-0c71cb7eda64 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:49.112522 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-d3eff6db-6bcb-41ca-80ef-0c71cb7eda64 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] HTTP exception thrown: Instance add2b490-a27b-434c-9ff5-aa58ee869b78 could not be found. May 21 21:16:49.118434 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d3eff6db-6bcb-41ca-80ef-0c71cb7eda64 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Request method failure captured: May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 HTTP/1.1 May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVVrNo4OJOkeIE2CiZd0jTTY5P5q9tx7Z4li1YtIQ90HhP0jnaa2RQ66A7I46wokJAUeeiBJ8gZvALjC6IJp0KWSmejQhNBdpSWA05ZkrN--mepOZfvpCU2--O0LWNFI8mKUbbzglqr9VPPKIoaS0j25XDk3vY3FZ4j37tOnESWLlpE May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 3cdfab8428a54520a01fdde7222835be May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-MigrationsAdminTest-1725319035 May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3cdfab8428a54520a01fdde7222835be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3cdfab8428a54520a01fdde7222835be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3cdfab8428a54520a01fdde7222835be", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3cdfab8428a54520a01fdde7222835be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-MigrationsAdminTest-1725319035 May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 3cdfab8428a54520a01fdde7222835be May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-MigrationsAdminTest-1725319035 May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-MigrationsAdminTest-1725319035-project May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: c3d9543f794d40be9c24715bf530add3 May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-MigrationsAdminTest-1725319035-project May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance add2b490-a27b-434c-9ff5-aa58ee869b78 could not be found. May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'add2b490-a27b-434c-9ff5-aa58ee869b78'} May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance add2b490-a27b-434c-9ff5-aa58ee869b78 could not be found. May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance add2b490-a27b-434c-9ff5-aa58ee869b78 could not be found. May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:49.120682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:49.125442 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:49.125442 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:49.125442 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:49.125442 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:49.125442 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:49.125442 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance add2b490-a27b-434c-9ff5-aa58ee869b78 could not be found. May 21 21:16:49.125442 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:49.130395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d3eff6db-6bcb-41ca-80ef-0c71cb7eda64 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Returning 404 to user: Instance add2b490-a27b-434c-9ff5-aa58ee869b78 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:49.133519 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d3eff6db-6bcb-41ca-80ef-0c71cb7eda64 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78" status: 404 len: 111 microversion: 2.1 time: 0.070359 May 21 21:16:49.137746 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 902/1786] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:49 2022] GET /compute/v2.1/servers/add2b490-a27b-434c-9ff5-aa58ee869b78 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:16:49.151319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-36d27eae-d2c3-4b7f-b191-6b1a02222330 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Calling method '.version_select at 0x7fc81b651e50>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:49.269756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG neutronclient.v2_0.client [None req-36d27eae-d2c3-4b7f-b191-6b1a02222330 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1cb834e3-88c2-4ad6-8bae-b7476003686a does not exist", "detail": ""}} {{(pid=131277) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:16:49.270810 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.security_group_api [None req-36d27eae-d2c3-4b7f-b191-6b1a02222330 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Neutron security group 1cb834e3-88c2-4ad6-8bae-b7476003686a not found {{(pid=131277) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 21 21:16:49.271671 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-36d27eae-d2c3-4b7f-b191-6b1a02222330 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] HTTP exception thrown: Security group 1cb834e3-88c2-4ad6-8bae-b7476003686a does not exist May 21 21:16:49.271671 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-256a0f03-f6f3-4262-bee9-002dc02b9041'] May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-36d27eae-d2c3-4b7f-b191-6b1a02222330 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Request method failure captured: May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/os-security-groups/1cb834e3-88c2-4ad6-8bae-b7476003686a HTTP/1.1 May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVaow6C41BcJeZpxZAicCxUdh9gMOHK0CuIoplcmeVeyd3eohvqiyIY5WYhJVCNzYxhFSmSb8rqEWhz6lGm2_9D2Qc9DoCa4fiWF5xNXABuoW_xoL1gabQIC-ulLDfeKWkTUaQ-wbkWRl5ZiGd4wqwYAh9zmcLfBDZPrmlO4etGiX9g May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: a7c932bd67144657aba9cba40c02945a May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1722124042 May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a7c932bd67144657aba9cba40c02945a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a7c932bd67144657aba9cba40c02945a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a7c932bd67144657aba9cba40c02945a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a7c932bd67144657aba9cba40c02945a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1722124042 May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: a7c932bd67144657aba9cba40c02945a May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1722124042 May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-SecurityGroupRulesTestJSON-1722124042-project May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: f304465c90f04b2990460a031f1f2427 May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1722124042-project May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: exception: Security group 1cb834e3-88c2-4ad6-8bae-b7476003686a does not exist May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-256a0f03-f6f3-4262-bee9-002dc02b9041'] May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '1cb834e3-88c2-4ad6-8bae-b7476003686a'} May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:16:49.274623 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1cb834e3-88c2-4ad6-8bae-b7476003686a does not exist May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-256a0f03-f6f3-4262-bee9-002dc02b9041'] May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1cb834e3-88c2-4ad6-8bae-b7476003686a does not exist May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-256a0f03-f6f3-4262-bee9-002dc02b9041'] May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1cb834e3-88c2-4ad6-8bae-b7476003686a does not exist May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-256a0f03-f6f3-4262-bee9-002dc02b9041'] May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1cb834e3-88c2-4ad6-8bae-b7476003686a does not exist May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-256a0f03-f6f3-4262-bee9-002dc02b9041'] May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-36d27eae-d2c3-4b7f-b191-6b1a02222330 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Returning 404 to user: Security group 1cb834e3-88c2-4ad6-8bae-b7476003686a does not exist May 21 21:16:49.279778 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-256a0f03-f6f3-4262-bee9-002dc02b9041'] {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:49.282891 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-36d27eae-d2c3-4b7f-b191-6b1a02222330 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/1cb834e3-88c2-4ad6-8bae-b7476003686a" status: 404 len: 194 microversion: 2.1 time: 0.139871 May 21 21:16:49.285470 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 903/1787] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:49 2022] DELETE /compute/v2.1/os-security-groups/1cb834e3-88c2-4ad6-8bae-b7476003686a => generated 194 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:16:49.300183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e80b34a4-2bd1-48d5-b3fb-a4618d015a32 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:49.304718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e80b34a4-2bd1-48d5-b3fb-a4618d015a32 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:49.314214 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-27832c3e-c1a7-471d-884d-00a3e28a2c61 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:49.323048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e80b34a4-2bd1-48d5-b3fb-a4618d015a32 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:49.323264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-27832c3e-c1a7-471d-884d-00a3e28a2c61 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:49.324634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-27832c3e-c1a7-471d-884d-00a3e28a2c61 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:49.325567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e80b34a4-2bd1-48d5-b3fb-a4618d015a32 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:49.327000 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-27832c3e-c1a7-471d-884d-00a3e28a2c61 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1280 microversion: 2.25 time: 0.326331 May 21 21:16:49.327468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e80b34a4-2bd1-48d5-b3fb-a4618d015a32 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:49.328010 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 885/1788] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:16:48 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1280 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:16:49.333037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-07c0c398-5a66-4af6-b8ab-d278aeff837d tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Calling method '.version_select at 0x7fc81b5f9f70>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:49.339259 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e80b34a4-2bd1-48d5-b3fb-a4618d015a32 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:49.398494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e80b34a4-2bd1-48d5-b3fb-a4618d015a32 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:16:49.755997 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e80b34a4-2bd1-48d5-b3fb-a4618d015a32 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 204 len: 0 microversion: 2.1 time: 0.469224 May 21 21:16:49.759038 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 904/1789] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:16:49 2022] DELETE /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:16:49.769517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3736e694-8ede-4cb3-9d4f-441413542a6c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:49.771629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3736e694-8ede-4cb3-9d4f-441413542a6c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:49.784086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3736e694-8ede-4cb3-9d4f-441413542a6c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:49.784808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3736e694-8ede-4cb3-9d4f-441413542a6c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:49.789935 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3736e694-8ede-4cb3-9d4f-441413542a6c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:49.790258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3736e694-8ede-4cb3-9d4f-441413542a6c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:49.903135 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-07c0c398-5a66-4af6-b8ab-d278aeff837d tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/3c9a044b-e18d-4bf9-a8f2-0064a117b723" status: 202 len: 0 microversion: 2.1 time: 0.573069 May 21 21:16:49.908521 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 886/1790] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:49 2022] DELETE /compute/v2.1/os-security-groups/3c9a044b-e18d-4bf9-a8f2-0064a117b723 => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:49.916100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-97426c58-09b9-480d-a6e0-bc3810470152 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b57f1f0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:50.004189 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-97426c58-09b9-480d-a6e0-bc3810470152 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af" status: 200 len: 1412 microversion: 2.1 time: 0.094242 May 21 21:16:50.006318 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 887/1791] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:49 2022] GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:50.013151 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-46ebf6f2-1e9a-45fb-9ae9-b970b2cb02bc tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:50.014304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-46ebf6f2-1e9a-45fb-9ae9-b970b2cb02bc tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:50.021585 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-46ebf6f2-1e9a-45fb-9ae9-b970b2cb02bc tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:50.022823 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-46ebf6f2-1e9a-45fb-9ae9-b970b2cb02bc tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:50.023873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-46ebf6f2-1e9a-45fb-9ae9-b970b2cb02bc tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:50.024567 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-46ebf6f2-1e9a-45fb-9ae9-b970b2cb02bc tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:50.245241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-46ebf6f2-1e9a-45fb-9ae9-b970b2cb02bc tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:50.257295 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-46ebf6f2-1e9a-45fb-9ae9-b970b2cb02bc tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1532 microversion: 2.1 time: 0.247365 May 21 21:16:50.258676 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 888/1792] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:50 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1532 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:50.272616 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b95b1052-6c4f-48b3-8e41-e3b6f44cd647 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Calling method '.version_select at 0x7fc81b57f1f0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:50.336232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3736e694-8ede-4cb3-9d4f-441413542a6c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:50.353668 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3736e694-8ede-4cb3-9d4f-441413542a6c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f" status: 200 len: 1467 microversion: 2.1 time: 0.593220 May 21 21:16:50.364694 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 905/1793] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:49 2022] GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f => generated 1467 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:50.374906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-24151ac8-0a17-42fe-ab12-d5a1438eaad1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:50.375952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-24151ac8-0a17-42fe-ab12-d5a1438eaad1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:50.383994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24151ac8-0a17-42fe-ab12-d5a1438eaad1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:50.385540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24151ac8-0a17-42fe-ab12-d5a1438eaad1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:50.386585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24151ac8-0a17-42fe-ab12-d5a1438eaad1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:50.387256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24151ac8-0a17-42fe-ab12-d5a1438eaad1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:50.715396 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b95b1052-6c4f-48b3-8e41-e3b6f44cd647 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/2a627aec-39d1-4df0-a793-0a7381a64705" status: 202 len: 0 microversion: 2.1 time: 0.455325 May 21 21:16:50.718759 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 889/1794] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:50 2022] DELETE /compute/v2.1/os-security-groups/2a627aec-39d1-4df0-a793-0a7381a64705 => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:50.741253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c37c4403-a93b-4385-8c6b-ed33ba537abd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:50.743539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c37c4403-a93b-4385-8c6b-ed33ba537abd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:50.767669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c37c4403-a93b-4385-8c6b-ed33ba537abd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:50.769760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c37c4403-a93b-4385-8c6b-ed33ba537abd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:50.772800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c37c4403-a93b-4385-8c6b-ed33ba537abd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:50.774292 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c37c4403-a93b-4385-8c6b-ed33ba537abd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:51.025000 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c37c4403-a93b-4385-8c6b-ed33ba537abd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:51.046872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c37c4403-a93b-4385-8c6b-ed33ba537abd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:51.056038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c37c4403-a93b-4385-8c6b-ed33ba537abd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:51.058530 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c37c4403-a93b-4385-8c6b-ed33ba537abd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1280 microversion: 2.25 time: 0.337592 May 21 21:16:51.061371 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 890/1795] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:16:50 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1280 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:16:51.070842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-ff955f3b-6d56-4019-9555-8613cbbc164b req-8b71d416-f518-41be-862b-db0dcacc6bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6300bf23-6e6c-4959-b913-81a4b850397f", "name": "network-vif-deleted", "tag": "460cd6f3-8f7e-413a-9811-cf5158ce5e95"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:51.087868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ff955f3b-6d56-4019-9555-8613cbbc164b req-8b71d416-f518-41be-862b-db0dcacc6bcb service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:51.088762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ff955f3b-6d56-4019-9555-8613cbbc164b req-8b71d416-f518-41be-862b-db0dcacc6bcb service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:51.105311 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-ff955f3b-6d56-4019-9555-8613cbbc164b req-8b71d416-f518-41be-862b-db0dcacc6bcb service nova] Creating event network-vif-deleted:460cd6f3-8f7e-413a-9811-cf5158ce5e95 for instance 6300bf23-6e6c-4959-b913-81a4b850397f on nch1-master-1 May 21 21:16:51.128472 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-ff955f3b-6d56-4019-9555-8613cbbc164b req-8b71d416-f518-41be-862b-db0dcacc6bcb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063736 May 21 21:16:51.133385 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 891/1796] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:51.145443 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-57a7d200-cdb6-489b-a66a-82ee9c5c5ba2 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Calling method '.version_select at 0x7fc81b6e31f0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:51.171056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-24151ac8-0a17-42fe-ab12-d5a1438eaad1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:51.180964 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-24151ac8-0a17-42fe-ab12-d5a1438eaad1 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1199 microversion: 2.1 time: 0.813754 May 21 21:16:51.187971 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 906/1797] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:50 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1199 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:51.197073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5121c14c-53ec-4463-aa01-0a7c0ced241d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc82d0f1b80>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:51.296253 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5121c14c-53ec-4463-aa01-0a7c0ced241d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af" status: 200 len: 1412 microversion: 2.1 time: 0.106470 May 21 21:16:51.306269 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 907/1798] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:51 2022] GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af => generated 1412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:51.310395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cc77679c-bbba-4c9a-be21-6e4c91562b18 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:51.311325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cc77679c-bbba-4c9a-be21-6e4c91562b18 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:51.319427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cc77679c-bbba-4c9a-be21-6e4c91562b18 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:51.320335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cc77679c-bbba-4c9a-be21-6e4c91562b18 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:51.321375 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cc77679c-bbba-4c9a-be21-6e4c91562b18 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:51.322206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cc77679c-bbba-4c9a-be21-6e4c91562b18 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:51.722928 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-57a7d200-cdb6-489b-a66a-82ee9c5c5ba2 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/1f64bd34-26a7-4563-9f30-12dbb9c1e5d8" status: 202 len: 0 microversion: 2.1 time: 0.585803 May 21 21:16:51.723526 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 892/1799] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:51 2022] DELETE /compute/v2.1/os-security-groups/1f64bd34-26a7-4563-9f30-12dbb9c1e5d8 => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:51.742990 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1552d28d-5683-4c89-b4de-c6b36a3b980e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:51.743750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1552d28d-5683-4c89-b4de-c6b36a3b980e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:51.782301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1552d28d-5683-4c89-b4de-c6b36a3b980e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:51.782905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1552d28d-5683-4c89-b4de-c6b36a3b980e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:51.784035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1552d28d-5683-4c89-b4de-c6b36a3b980e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:51.784512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1552d28d-5683-4c89-b4de-c6b36a3b980e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:51.969892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1552d28d-5683-4c89-b4de-c6b36a3b980e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:51.971703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1552d28d-5683-4c89-b4de-c6b36a3b980e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:51.973812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-1552d28d-5683-4c89-b4de-c6b36a3b980e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lazy-loading 'fault' on Instance uuid 6300bf23-6e6c-4959-b913-81a4b850397f {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:16:52.056461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1552d28d-5683-4c89-b4de-c6b36a3b980e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e82c479130c4377a9a27dd7c8bbe611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53774c838bd64b319776f9afa0821b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:52.066105 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1552d28d-5683-4c89-b4de-c6b36a3b980e tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f" status: 200 len: 1306 microversion: 2.1 time: 0.341348 May 21 21:16:52.066703 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 893/1800] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:51 2022] GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f => generated 1306 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:52.073799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-75a88c22-d3fc-48e0-903f-9bd6d2a8e04d req-fa7585b7-206b-4f41-901b-9098689687e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a55484-c74d-46c8-b37e-1fc43941e895", "name": "network-vif-plugged", "status": "completed", "tag": "2b5fd365-20f9-4fcc-919f-6f7d08efba8b"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:52.087513 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-75a88c22-d3fc-48e0-903f-9bd6d2a8e04d req-fa7585b7-206b-4f41-901b-9098689687e1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:52.087962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-75a88c22-d3fc-48e0-903f-9bd6d2a8e04d req-fa7585b7-206b-4f41-901b-9098689687e1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:52.106721 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-75a88c22-d3fc-48e0-903f-9bd6d2a8e04d req-fa7585b7-206b-4f41-901b-9098689687e1 service nova] Creating event network-vif-plugged:2b5fd365-20f9-4fcc-919f-6f7d08efba8b for instance c6a55484-c74d-46c8-b37e-1fc43941e895 on nch1-master-1 May 21 21:16:52.121108 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-75a88c22-d3fc-48e0-903f-9bd6d2a8e04d req-fa7585b7-206b-4f41-901b-9098689687e1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052612 May 21 21:16:52.122505 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 894/1801] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:52.132620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bb31fe17-125d-4467-a469-e8ac3ee9278e tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Calling method '.version_select at 0x7fc81b6e3dc0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:52.179857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cc77679c-bbba-4c9a-be21-6e4c91562b18 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:52.207973 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cc77679c-bbba-4c9a-be21-6e4c91562b18 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1532 microversion: 2.1 time: 0.902472 May 21 21:16:52.212723 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 908/1802] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:51 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1532 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:52.226204 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fd884da8-d996-43e7-bbe5-7df47fc8e2a2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:52.227483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fd884da8-d996-43e7-bbe5-7df47fc8e2a2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:52.243176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd884da8-d996-43e7-bbe5-7df47fc8e2a2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:52.243771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd884da8-d996-43e7-bbe5-7df47fc8e2a2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:52.246234 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd884da8-d996-43e7-bbe5-7df47fc8e2a2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:52.247073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd884da8-d996-43e7-bbe5-7df47fc8e2a2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:52.309454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:52.830958 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bb31fe17-125d-4467-a469-e8ac3ee9278e tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/2ff6d3a5-36b2-44e9-a38e-9c0628d535fc" status: 202 len: 0 microversion: 2.1 time: 0.706847 May 21 21:16:52.831975 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 895/1803] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:52 2022] DELETE /compute/v2.1/os-security-groups/2ff6d3a5-36b2-44e9-a38e-9c0628d535fc => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:52.839336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d9dda239-4ef2-4596-a2c0-d4ec57df74af tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:52.840408 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d9dda239-4ef2-4596-a2c0-d4ec57df74af tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:52.871371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9dda239-4ef2-4596-a2c0-d4ec57df74af tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:52.872344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9dda239-4ef2-4596-a2c0-d4ec57df74af tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:52.873314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9dda239-4ef2-4596-a2c0-d4ec57df74af tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:52.873920 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9dda239-4ef2-4596-a2c0-d4ec57df74af tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:53.127541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fd884da8-d996-43e7-bbe5-7df47fc8e2a2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:53.133269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d9dda239-4ef2-4596-a2c0-d4ec57df74af tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:53.146042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fd884da8-d996-43e7-bbe5-7df47fc8e2a2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:53.149416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fd884da8-d996-43e7-bbe5-7df47fc8e2a2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:53.150213 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d9dda239-4ef2-4596-a2c0-d4ec57df74af tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1382 microversion: 2.1 time: 0.315576 May 21 21:16:53.151010 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fd884da8-d996-43e7-bbe5-7df47fc8e2a2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1280 microversion: 2.25 time: 0.936927 May 21 21:16:53.154601 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 896/1804] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:52 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1382 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:53.155025 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 909/1805] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:16:52 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1280 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:16:53.160179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c4546e20-6bb8-4469-8d63-5b5396aa717d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc82d10fdc0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:53.178359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5e1c7860-b592-47c5-9415-263063b60912 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] Calling method '.version_select at 0x7fc81b65edc0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:53.251026 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c4546e20-6bb8-4469-8d63-5b5396aa717d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af" status: 200 len: 1412 microversion: 2.1 time: 0.089527 May 21 21:16:53.261014 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 910/1806] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:53 2022] GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af => generated 1412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:53.274371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-86c823dd-e8fd-403d-8c8c-daf2bb17e37c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:53.280346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-86c823dd-e8fd-403d-8c8c-daf2bb17e37c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] [instance: 6300bf23-6e6c-4959-b913-81a4b850397f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:53.301546 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86c823dd-e8fd-403d-8c8c-daf2bb17e37c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:53.302524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86c823dd-e8fd-403d-8c8c-daf2bb17e37c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:53.307266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86c823dd-e8fd-403d-8c8c-daf2bb17e37c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:53.307768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86c823dd-e8fd-403d-8c8c-daf2bb17e37c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:53.354318 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-86c823dd-e8fd-403d-8c8c-daf2bb17e37c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] HTTP exception thrown: Instance 6300bf23-6e6c-4959-b913-81a4b850397f could not be found. May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-86c823dd-e8fd-403d-8c8c-daf2bb17e37c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Request method failure captured: May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f HTTP/1.1 May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZSCYysyyOTwVzhR_Vt3Rp4hJGlHQ1xQ5d6hFUxjxvsTAgt6ix0UNE2Z2Vln9ahBs6pfbfiUV8DEik3Vk1FDugBkn4AbmOx4uTGzwiP9EUa_o0XQmPT-P2Agu2oeG_4YhdEiPrs-TaOwa6w5WGXcLQM63lci1mbOXuKdXB18YVm1Hg May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/53774c838bd64b319776f9afa0821b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_53774c838bd64b319776f9afa0821b79", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/53774c838bd64b319776f9afa0821b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 53774c838bd64b319776f9afa0821b79 May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-741901629 May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 5e82c479130c4377a9a27dd7c8bbe611 May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-SecurityGroupsTestJSON-741901629-project May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 6300bf23-6e6c-4959-b913-81a4b850397f could not be found. May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '6300bf23-6e6c-4959-b913-81a4b850397f'} May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6300bf23-6e6c-4959-b913-81a4b850397f could not be found. May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6300bf23-6e6c-4959-b913-81a4b850397f could not be found. May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:53.360097 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:53.366651 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:53.366651 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:53.366651 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:53.366651 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:53.366651 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:53.366651 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6300bf23-6e6c-4959-b913-81a4b850397f could not be found. May 21 21:16:53.366651 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:16:53.368893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-86c823dd-e8fd-403d-8c8c-daf2bb17e37c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Returning 404 to user: Instance 6300bf23-6e6c-4959-b913-81a4b850397f could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:53.370042 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-86c823dd-e8fd-403d-8c8c-daf2bb17e37c tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f" status: 404 len: 111 microversion: 2.1 time: 0.105754 May 21 21:16:53.376054 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 911/1807] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:53 2022] GET /compute/v2.1/servers/6300bf23-6e6c-4959-b913-81a4b850397f => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:16:53.391736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-8ec27488-234e-40c1-a2b0-95fcfd3ef5d4 req-ed00747e-23cf-494e-b76c-efdf86c68606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4531a7ea-7be9-48b8-adac-fe968ff5d889", "name": "network-vif-deleted", "tag": "d47da14c-0379-42b1-91a7-7b1098c8cded"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:53.417865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8ec27488-234e-40c1-a2b0-95fcfd3ef5d4 req-ed00747e-23cf-494e-b76c-efdf86c68606 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:53.419706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8ec27488-234e-40c1-a2b0-95fcfd3ef5d4 req-ed00747e-23cf-494e-b76c-efdf86c68606 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:53.452113 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-8ec27488-234e-40c1-a2b0-95fcfd3ef5d4 req-ed00747e-23cf-494e-b76c-efdf86c68606 service nova] Creating event network-vif-deleted:d47da14c-0379-42b1-91a7-7b1098c8cded for instance 4531a7ea-7be9-48b8-adac-fe968ff5d889 on nch1-master-1 May 21 21:16:53.458135 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-8ec27488-234e-40c1-a2b0-95fcfd3ef5d4 req-ed00747e-23cf-494e-b76c-efdf86c68606 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077351 May 21 21:16:53.460745 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 912/1808] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:53.802601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f8952453-d8cd-49d0-a76d-83cd6fb54302 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:53.804480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f8952453-d8cd-49d0-a76d-83cd6fb54302 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:53.815172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f8952453-d8cd-49d0-a76d-83cd6fb54302 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:53.815644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f8952453-d8cd-49d0-a76d-83cd6fb54302 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:53.816642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f8952453-d8cd-49d0-a76d-83cd6fb54302 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:53.817286 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f8952453-d8cd-49d0-a76d-83cd6fb54302 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:53.977781 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f8952453-d8cd-49d0-a76d-83cd6fb54302 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1533 microversion: 2.1 time: 0.514882 May 21 21:16:53.978955 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 913/1809] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:53 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1533 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:53.987190 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c28e2f86-b890-47ce-9887-62d7f7711182 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:53.988381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c28e2f86-b890-47ce-9887-62d7f7711182 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:53.999243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c28e2f86-b890-47ce-9887-62d7f7711182 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:54.002057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c28e2f86-b890-47ce-9887-62d7f7711182 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:54.003669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c28e2f86-b890-47ce-9887-62d7f7711182 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:54.004578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c28e2f86-b890-47ce-9887-62d7f7711182 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:54.016847 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5e1c7860-b592-47c5-9415-263063b60912 tempest-SecurityGroupRulesTestJSON-1722124042 tempest-SecurityGroupRulesTestJSON-1722124042-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/27d6875d-77eb-47c4-b877-caf055ea2823" status: 202 len: 0 microversion: 2.1 time: 0.857653 May 21 21:16:54.017553 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 897/1810] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:53 2022] DELETE /compute/v2.1/os-security-groups/27d6875d-77eb-47c4-b877-caf055ea2823 => generated 0 bytes in 861 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:54.027017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c8210e73-4c89-4c6d-946a-0a6816e2cbb6 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81b6ec550>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:54.050936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c28e2f86-b890-47ce-9887-62d7f7711182 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:54.051299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c28e2f86-b890-47ce-9887-62d7f7711182 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:54.051947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-c28e2f86-b890-47ce-9887-62d7f7711182 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lazy-loading 'fault' on Instance uuid 4531a7ea-7be9-48b8-adac-fe968ff5d889 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:16:54.130050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c28e2f86-b890-47ce-9887-62d7f7711182 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:54.144825 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c28e2f86-b890-47ce-9887-62d7f7711182 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 200 len: 1368 microversion: 2.1 time: 0.162532 May 21 21:16:54.145744 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 914/1811] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:53 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:54.155887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-02e77344-1cdb-488b-bea1-db46f6eab333 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:54.155887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-02e77344-1cdb-488b-bea1-db46f6eab333 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:54.163863 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02e77344-1cdb-488b-bea1-db46f6eab333 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:54.164340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02e77344-1cdb-488b-bea1-db46f6eab333 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:54.165470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02e77344-1cdb-488b-bea1-db46f6eab333 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:54.165958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02e77344-1cdb-488b-bea1-db46f6eab333 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:54.497788 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-02e77344-1cdb-488b-bea1-db46f6eab333 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1533 microversion: 2.1 time: 0.337270 May 21 21:16:54.499119 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 915/1812] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:54 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1533 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:54.517167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-50e3d8d3-802d-4c01-96fc-c8afc7cfbf2a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:54.518605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-50e3d8d3-802d-4c01-96fc-c8afc7cfbf2a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:54.544194 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50e3d8d3-802d-4c01-96fc-c8afc7cfbf2a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:54.545033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50e3d8d3-802d-4c01-96fc-c8afc7cfbf2a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:54.546073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50e3d8d3-802d-4c01-96fc-c8afc7cfbf2a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:54.546734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50e3d8d3-802d-4c01-96fc-c8afc7cfbf2a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:54.896140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-50e3d8d3-802d-4c01-96fc-c8afc7cfbf2a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:54.913188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-50e3d8d3-802d-4c01-96fc-c8afc7cfbf2a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:54.919956 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-50e3d8d3-802d-4c01-96fc-c8afc7cfbf2a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:16:54.930768 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-50e3d8d3-802d-4c01-96fc-c8afc7cfbf2a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1476 microversion: 2.25 time: 0.429711 May 21 21:16:54.931931 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 916/1813] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:16:54 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1476 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:16:54.942702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-36148c7e-f72d-4392-a4d5-313cc465d177 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc82d0f10d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:55.034260 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-36148c7e-f72d-4392-a4d5-313cc465d177 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af" status: 200 len: 1421 microversion: 2.1 time: 0.100873 May 21 21:16:55.034860 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 917/1814] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:54 2022] GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af => generated 1421 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:55.046794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7ea75369-9aea-4424-8036-5a9ebb08e17e tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:55.054291 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:16:55.054291 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:16:55.066540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ea75369-9aea-4424-8036-5a9ebb08e17e tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:55.088268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ea75369-9aea-4424-8036-5a9ebb08e17e tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:55.089858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ea75369-9aea-4424-8036-5a9ebb08e17e tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:55.095671 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ea75369-9aea-4424-8036-5a9ebb08e17e tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:55.148166 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c8210e73-4c89-4c6d-946a-0a6816e2cbb6 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/9428e059-1fc4-450c-a791-05743f24f32c" status: 202 len: 0 microversion: 2.1 time: 1.113587 May 21 21:16:55.150811 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 898/1815] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:54 2022] DELETE /compute/v2.1/os-security-groups/9428e059-1fc4-450c-a791-05743f24f32c => generated 0 bytes in 1129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:55.159231 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e8abc593-e568-4886-9404-d0d3a23c0c71 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:55.160149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e8abc593-e568-4886-9404-d0d3a23c0c71 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:55.163381 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7ea75369-9aea-4424-8036-5a9ebb08e17e tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.125719 May 21 21:16:55.164850 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 918/1816] 10.222.0.49 () {58 vars in 1175 bytes} [Sat May 21 21:16:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:16:55.175510 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-db7f85f0-680c-4289-bce6-95cc833845dd tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc82d10f670>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:55.183388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e8abc593-e568-4886-9404-d0d3a23c0c71 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:55.183388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e8abc593-e568-4886-9404-d0d3a23c0c71 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:55.183388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e8abc593-e568-4886-9404-d0d3a23c0c71 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:55.183388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e8abc593-e568-4886-9404-d0d3a23c0c71 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:55.247058 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-db7f85f0-680c-4289-bce6-95cc833845dd tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af" status: 200 len: 1421 microversion: 2.1 time: 0.080583 May 21 21:16:55.254154 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 919/1817] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:16:55 2022] GET /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af => generated 1421 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:16:55.260251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-14b55372-e549-4b38-8f1c-11477a3e8736 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] Calling method '.version_select at 0x7fc81b6aa9d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:55.779792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-e8abc593-e568-4886-9404-d0d3a23c0c71 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lazy-loading 'services' on Instance uuid c6a55484-c74d-46c8-b37e-1fc43941e895 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:16:55.800310 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e8abc593-e568-4886-9404-d0d3a23c0c71 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1968 microversion: 2.25 time: 0.646111 May 21 21:16:55.811205 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 899/1818] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:16:55 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1968 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:16:55.815636 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-469a67c9-aba2-4c87-bc08-78082046f236 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:55.817216 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-469a67c9-aba2-4c87-bc08-78082046f236 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 4531a7ea-7be9-48b8-adac-fe968ff5d889] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:55.825789 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-469a67c9-aba2-4c87-bc08-78082046f236 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:55.826324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-469a67c9-aba2-4c87-bc08-78082046f236 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:55.827132 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-469a67c9-aba2-4c87-bc08-78082046f236 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:55.827582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-469a67c9-aba2-4c87-bc08-78082046f236 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:55.854873 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-469a67c9-aba2-4c87-bc08-78082046f236 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] HTTP exception thrown: Instance 4531a7ea-7be9-48b8-adac-fe968ff5d889 could not be found. May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-469a67c9-aba2-4c87-bc08-78082046f236 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Request method failure captured: May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 HTTP/1.1 May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVrNo4OJOkeIE2CiZd0jTTY5P5q9tx7Z4li1YtIQ90HhP0jnaa2RQ66A7I46wokJAUeeiBJ8gZvALjC6IJp0KWSmejQhNBdpSWA05ZkrN--mepOZfvpCU2--O0LWNFI8mKUbbzglqr9VPPKIoaS0j25XDk3vY3FZ4j37tOnESWLlpE May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 3cdfab8428a54520a01fdde7222835be May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-MigrationsAdminTest-1725319035 May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3cdfab8428a54520a01fdde7222835be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3cdfab8428a54520a01fdde7222835be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3cdfab8428a54520a01fdde7222835be", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3cdfab8428a54520a01fdde7222835be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-MigrationsAdminTest-1725319035 May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 3cdfab8428a54520a01fdde7222835be May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-MigrationsAdminTest-1725319035 May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-MigrationsAdminTest-1725319035-project May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c3d9543f794d40be9c24715bf530add3 May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-MigrationsAdminTest-1725319035-project May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 4531a7ea-7be9-48b8-adac-fe968ff5d889 could not be found. May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '4531a7ea-7be9-48b8-adac-fe968ff5d889'} May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4531a7ea-7be9-48b8-adac-fe968ff5d889 could not be found. May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4531a7ea-7be9-48b8-adac-fe968ff5d889 could not be found. May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:16:55.859891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:55.866314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:16:55.866314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:16:55.866314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:16:55.866314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:16:55.866314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:16:55.866314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4531a7ea-7be9-48b8-adac-fe968ff5d889 could not be found. May 21 21:16:55.866314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:16:55.866314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-469a67c9-aba2-4c87-bc08-78082046f236 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Returning 404 to user: Instance 4531a7ea-7be9-48b8-adac-fe968ff5d889 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:16:55.866314 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-469a67c9-aba2-4c87-bc08-78082046f236 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889" status: 404 len: 111 microversion: 2.1 time: 0.059268 May 21 21:16:55.866314 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 900/1819] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:55 2022] GET /compute/v2.1/servers/4531a7ea-7be9-48b8-adac-fe968ff5d889 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:16:55.871414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b251ef9e-ba82-4ca5-9e5c-fecf40103045 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:16:55.872780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b251ef9e-ba82-4ca5-9e5c-fecf40103045 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:55.882027 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b251ef9e-ba82-4ca5-9e5c-fecf40103045 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:55.886496 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b251ef9e-ba82-4ca5-9e5c-fecf40103045 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:55.886496 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b251ef9e-ba82-4ca5-9e5c-fecf40103045 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:55.886496 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b251ef9e-ba82-4ca5-9e5c-fecf40103045 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:55.914992 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-b251ef9e-ba82-4ca5-9e5c-fecf40103045 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lazy-loading 'flavor' on Instance uuid 4ce51e42-255d-45f7-afab-2fdb937e7758 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:16:55.929044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b251ef9e-ba82-4ca5-9e5c-fecf40103045 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Going to try to live migrate instance to nch2-master-1 {{(pid=131278) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 21 21:16:56.139256 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-14b55372-e549-4b38-8f1c-11477a3e8736 tempest-SecurityGroupsTestJSON-741901629 tempest-SecurityGroupsTestJSON-741901629-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/044be843-af68-4599-ad14-140b8e7a89ff" status: 202 len: 0 microversion: 2.1 time: 0.889261 May 21 21:16:56.144014 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 920/1820] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:16:55 2022] DELETE /compute/v2.1/os-security-groups/044be843-af68-4599-ad14-140b8e7a89ff => generated 0 bytes in 895 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:16:56.149869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bb7e34fc-132b-4602-948b-fe0c8a2386a1 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81bb45b80>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:57.883249 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bb7e34fc-132b-4602-948b-fe0c8a2386a1 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "DELETE /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af" status: 204 len: 0 microversion: 2.1 time: 1.737712 May 21 21:16:57.884645 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 921/1821] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:16:56 2022] DELETE /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af => generated 0 bytes in 1740 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:16:58.156875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d3d6d8b3-1dc2-406b-a688-71e9a9326e8d tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:58.157743 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d3d6d8b3-1dc2-406b-a688-71e9a9326e8d tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:58.174787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3d6d8b3-1dc2-406b-a688-71e9a9326e8d tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:58.175552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3d6d8b3-1dc2-406b-a688-71e9a9326e8d tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:58.177499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3d6d8b3-1dc2-406b-a688-71e9a9326e8d tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:58.179000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3d6d8b3-1dc2-406b-a688-71e9a9326e8d tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:59.051564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-d3d6d8b3-1dc2-406b-a688-71e9a9326e8d tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lazy-loading 'services' on Instance uuid c6a55484-c74d-46c8-b37e-1fc43941e895 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:16:59.092196 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d3d6d8b3-1dc2-406b-a688-71e9a9326e8d tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1968 microversion: 2.25 time: 1.206277 May 21 21:16:59.098273 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 922/1822] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:16:57 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1968 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:16:59.105016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1fd75bf2-c8c2-4965-bee6-1af19416059a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:59.106746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1fd75bf2-c8c2-4965-bee6-1af19416059a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:59.133500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1fd75bf2-c8c2-4965-bee6-1af19416059a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:59.134374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1fd75bf2-c8c2-4965-bee6-1af19416059a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:59.135348 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1fd75bf2-c8c2-4965-bee6-1af19416059a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:59.135964 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1fd75bf2-c8c2-4965-bee6-1af19416059a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:59.237568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1fd75bf2-c8c2-4965-bee6-1af19416059a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:16:59.732164 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1fd75bf2-c8c2-4965-bee6-1af19416059a tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 204 len: 0 microversion: 2.1 time: 0.637859 May 21 21:16:59.733376 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 923/1823] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:16:59 2022] DELETE /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:16:59.741400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-094e2518-e2f1-4a29-b970-36a2f3ade16d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:16:59.743916 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-094e2518-e2f1-4a29-b970-36a2f3ade16d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:16:59.761741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-094e2518-e2f1-4a29-b970-36a2f3ade16d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:59.763229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-094e2518-e2f1-4a29-b970-36a2f3ade16d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:59.767188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-094e2518-e2f1-4a29-b970-36a2f3ade16d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:16:59.768496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-094e2518-e2f1-4a29-b970-36a2f3ade16d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:16:59.852143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-094e2518-e2f1-4a29-b970-36a2f3ade16d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:17:00.302979 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-094e2518-e2f1-4a29-b970-36a2f3ade16d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "DELETE /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 204 len: 0 microversion: 2.1 time: 0.567639 May 21 21:17:00.304124 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 924/1824] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:16:59 2022] DELETE /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:17:00.310830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-a10ac602-b686-408b-bcab-900e3aed4dff req-f5477252-557d-4170-8c64-51cf2cb137a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b", "name": "network-vif-unplugged", "status": "completed", "tag": "d45fcb13-cb81-4e01-869d-5e2e4b8084cc"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:00.337755 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a10ac602-b686-408b-bcab-900e3aed4dff req-f5477252-557d-4170-8c64-51cf2cb137a7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:00.338225 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a10ac602-b686-408b-bcab-900e3aed4dff req-f5477252-557d-4170-8c64-51cf2cb137a7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:00.382341 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a10ac602-b686-408b-bcab-900e3aed4dff req-f5477252-557d-4170-8c64-51cf2cb137a7 service nova] Creating event network-vif-unplugged:d45fcb13-cb81-4e01-869d-5e2e4b8084cc for instance 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b on nch2-master-1 May 21 21:17:00.397037 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-a10ac602-b686-408b-bcab-900e3aed4dff req-f5477252-557d-4170-8c64-51cf2cb137a7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088186 May 21 21:17:00.398373 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 925/1825] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:00.414382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4e7fd571-9398-4167-901c-d13c28153974 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:00.415791 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:17:00.415791 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:17:00.417305 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e7fd571-9398-4167-901c-d13c28153974 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:00.417756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e7fd571-9398-4167-901c-d13c28153974 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:00.419029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e7fd571-9398-4167-901c-d13c28153974 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:00.421298 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e7fd571-9398-4167-901c-d13c28153974 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:00.450190 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4e7fd571-9398-4167-901c-d13c28153974 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.050774 May 21 21:17:00.456950 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 926/1826] 10.222.0.49 () {60 vars in 1216 bytes} [Sat May 21 21:17:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:17:00.463156 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5d4a5b66-6435-4f1d-99fb-ad56f795aae0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:00.464009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5d4a5b66-6435-4f1d-99fb-ad56f795aae0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:00.478889 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d4a5b66-6435-4f1d-99fb-ad56f795aae0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:00.482576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d4a5b66-6435-4f1d-99fb-ad56f795aae0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:00.483576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d4a5b66-6435-4f1d-99fb-ad56f795aae0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:00.484038 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d4a5b66-6435-4f1d-99fb-ad56f795aae0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:00.702836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5d4a5b66-6435-4f1d-99fb-ad56f795aae0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:00.715099 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5d4a5b66-6435-4f1d-99fb-ad56f795aae0 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1468 microversion: 2.1 time: 0.262914 May 21 21:17:00.729239 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 927/1827] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:00 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1468 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:00.736672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-47c637c4-c6f2-41e2-8091-399cc8cee2fb tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:00.738451 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-47c637c4-c6f2-41e2-8091-399cc8cee2fb tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:00.748099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47c637c4-c6f2-41e2-8091-399cc8cee2fb tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:00.749274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47c637c4-c6f2-41e2-8091-399cc8cee2fb tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:00.750284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47c637c4-c6f2-41e2-8091-399cc8cee2fb tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:00.750903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47c637c4-c6f2-41e2-8091-399cc8cee2fb tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:00.784599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-47c637c4-c6f2-41e2-8091-399cc8cee2fb tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lazy-loading 'flavor' on Instance uuid c6a55484-c74d-46c8-b37e-1fc43941e895 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:17:00.800826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-47c637c4-c6f2-41e2-8091-399cc8cee2fb tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Going to try to live migrate instance to nch2-master-1 {{(pid=131277) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 21 21:17:01.037805 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:01.242269 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b251ef9e-ba82-4ca5-9e5c-fecf40103045 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758/action" status: 202 len: 0 microversion: 2.1 time: 5.378389 May 21 21:17:01.247772 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 901/1828] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:16:55 2022] POST /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758/action => generated 0 bytes in 5384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:17:01.253821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-91ee9423-6f50-424f-8ab5-ae5489c99d22 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1379445583", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "c5f18057-839a-44a2-aa7d-5be2d01e71c9"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:01.423485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-91ee9423-6f50-424f-8ab5-ae5489c99d22 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] validate_networks() for [('c5f18057-839a-44a2-aa7d-5be2d01e71c9', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:17:05.166543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-91ee9423-6f50-424f-8ab5-ae5489c99d22 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:17:05.166543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-91ee9423-6f50-424f-8ab5-ae5489c99d22 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:17:05.167275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-91ee9423-6f50-424f-8ab5-ae5489c99d22 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:17:05.167380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-91ee9423-6f50-424f-8ab5-ae5489c99d22 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:17:05.167970 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-91ee9423-6f50-424f-8ab5-ae5489c99d22 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:17:05.194065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-91ee9423-6f50-424f-8ab5-ae5489c99d22 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:05.198311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-91ee9423-6f50-424f-8ab5-ae5489c99d22 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:05.199696 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-91ee9423-6f50-424f-8ab5-ae5489c99d22 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:05.203337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-91ee9423-6f50-424f-8ab5-ae5489c99d22 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:05.429779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-91ee9423-6f50-424f-8ab5-ae5489c99d22 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Getting quotas for project 89256ac3448643b6892e74f55bfb31d3. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:17:05.429779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-91ee9423-6f50-424f-8ab5-ae5489c99d22 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Getting quotas for user 16686b6509f54c4abfe9d519acfb4a73 and project 89256ac3448643b6892e74f55bfb31d3. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:17:05.429779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-91ee9423-6f50-424f-8ab5-ae5489c99d22 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:17:05.429779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-91ee9423-6f50-424f-8ab5-ae5489c99d22 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:17:05.948472 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-91ee9423-6f50-424f-8ab5-ae5489c99d22 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.698868 May 21 21:17:05.959913 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 902/1829] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:17:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 4710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:17:05.971815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-24db9f91-d732-4be3-9bb9-b82707e75f9c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:05.974753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-24db9f91-d732-4be3-9bb9-b82707e75f9c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:05.995139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24db9f91-d732-4be3-9bb9-b82707e75f9c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:05.995974 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24db9f91-d732-4be3-9bb9-b82707e75f9c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:05.997072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24db9f91-d732-4be3-9bb9-b82707e75f9c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:05.998242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24db9f91-d732-4be3-9bb9-b82707e75f9c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:06.037489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:06.804124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-24db9f91-d732-4be3-9bb9-b82707e75f9c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:06.833645 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-24db9f91-d732-4be3-9bb9-b82707e75f9c tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1392 microversion: 2.1 time: 0.871445 May 21 21:17:06.836680 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 903/1830] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:05 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1392 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:06.846446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-04a2c2de-f8a5-4964-aa8d-75613b40cd42 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:06.850409 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-04a2c2de-f8a5-4964-aa8d-75613b40cd42 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:06.873865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04a2c2de-f8a5-4964-aa8d-75613b40cd42 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:06.881463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04a2c2de-f8a5-4964-aa8d-75613b40cd42 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:06.882933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04a2c2de-f8a5-4964-aa8d-75613b40cd42 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:06.889275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04a2c2de-f8a5-4964-aa8d-75613b40cd42 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:07.120933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-04a2c2de-f8a5-4964-aa8d-75613b40cd42 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:07.141206 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-04a2c2de-f8a5-4964-aa8d-75613b40cd42 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 200 len: 1426 microversion: 2.1 time: 0.303009 May 21 21:17:07.142919 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 904/1831] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:06 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 1426 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:07.415131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aacf6982-501f-4440-909a-9511d3b1a458 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Action: 'create', calling method: .version_select at 0x7fc81b3b30d0>, body: {"keypair": {"name": "tempest-keypair-231693768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEks1bZdnow/bm7ZrNrJOuL14VjysMyovq2hQaUdnxspdvR/JSsILKWbF6LEnlXEEIdkvlgr2zT18QTK8Ahg3aUj4O7QYZgzNGCRj0uFRDDhXrEFVoSTTOU30Vyz3ibG2Q=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:07.453230 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-47c637c4-c6f2-41e2-8091-399cc8cee2fb tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895/action" status: 202 len: 0 microversion: 2.25 time: 6.721251 May 21 21:17:07.456481 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 928/1832] 10.222.0.49 () {62 vars in 1318 bytes} [Sat May 21 21:17:00 2022] POST /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895/action => generated 0 bytes in 6727 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 21 21:17:07.479180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-aacf6982-501f-4440-909a-9511d3b1a458 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Getting quotas for project 28107ae255f24328bcce84129cec62d4. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:17:07.487312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-aacf6982-501f-4440-909a-9511d3b1a458 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Getting quotas for user ac2cc0075e654fe2b9ac0fbad3a7c239 and project 28107ae255f24328bcce84129cec62d4. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:17:07.618065 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-aacf6982-501f-4440-909a-9511d3b1a458 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.473553 May 21 21:17:07.618686 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 905/1833] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:17:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:07.638790 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9f66dbd0-17c7-458a-aef4-5052c8523357 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2142544851", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "f95b9f39-db04-49ea-b57f-7951c8f566a9"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:07.644388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-74f70cbe-70f4-417a-b449-6b8e036835cb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:07.645382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-74f70cbe-70f4-417a-b449-6b8e036835cb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:07.714904 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-74f70cbe-70f4-417a-b449-6b8e036835cb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:07.715680 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-74f70cbe-70f4-417a-b449-6b8e036835cb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:07.718909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-74f70cbe-70f4-417a-b449-6b8e036835cb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:07.719590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-74f70cbe-70f4-417a-b449-6b8e036835cb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:07.749154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-9f66dbd0-17c7-458a-aef4-5052c8523357 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] validate_networks() for [('f95b9f39-db04-49ea-b57f-7951c8f566a9', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:17:07.890595 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-74f70cbe-70f4-417a-b449-6b8e036835cb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:07.904425 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-74f70cbe-70f4-417a-b449-6b8e036835cb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 200 len: 1212 microversion: 2.1 time: 0.283344 May 21 21:17:07.908710 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 906/1834] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:07 2022] GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 1212 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:07.923085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-ea4b9760-c7e8-40f8-99e5-c2976b3ada63 req-6770d747-36f6-4772-b1f1-1402a4cd507f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b", "name": "network-vif-deleted", "tag": "d45fcb13-cb81-4e01-869d-5e2e4b8084cc"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:07.969243 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ea4b9760-c7e8-40f8-99e5-c2976b3ada63 req-6770d747-36f6-4772-b1f1-1402a4cd507f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:07.978398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ea4b9760-c7e8-40f8-99e5-c2976b3ada63 req-6770d747-36f6-4772-b1f1-1402a4cd507f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:08.013221 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-ea4b9760-c7e8-40f8-99e5-c2976b3ada63 req-6770d747-36f6-4772-b1f1-1402a4cd507f service nova] Creating event network-vif-deleted:d45fcb13-cb81-4e01-869d-5e2e4b8084cc for instance 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b on nch2-master-1 May 21 21:17:08.026469 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-ea4b9760-c7e8-40f8-99e5-c2976b3ada63 req-6770d747-36f6-4772-b1f1-1402a4cd507f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112459 May 21 21:17:08.026469 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 907/1835] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:08.040254 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0d2de4bf-a0be-4a97-82e7-bd8d407e1515 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:08.042503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0d2de4bf-a0be-4a97-82e7-bd8d407e1515 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:08.060862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d2de4bf-a0be-4a97-82e7-bd8d407e1515 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:08.060862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d2de4bf-a0be-4a97-82e7-bd8d407e1515 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:08.060862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d2de4bf-a0be-4a97-82e7-bd8d407e1515 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:08.060862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d2de4bf-a0be-4a97-82e7-bd8d407e1515 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:08.547268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0d2de4bf-a0be-4a97-82e7-bd8d407e1515 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:08.560062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0d2de4bf-a0be-4a97-82e7-bd8d407e1515 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:08.567572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0d2de4bf-a0be-4a97-82e7-bd8d407e1515 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:08.569440 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0d2de4bf-a0be-4a97-82e7-bd8d407e1515 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.539967 May 21 21:17:08.580406 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 908/1836] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:08 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:08.580406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3ee0a7cd-7526-4a40-a92e-1443ba5ba1a5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:08.580406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3ee0a7cd-7526-4a40-a92e-1443ba5ba1a5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:08.583559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ee0a7cd-7526-4a40-a92e-1443ba5ba1a5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:08.584043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ee0a7cd-7526-4a40-a92e-1443ba5ba1a5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:08.584904 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ee0a7cd-7526-4a40-a92e-1443ba5ba1a5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:08.585550 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ee0a7cd-7526-4a40-a92e-1443ba5ba1a5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:08.859949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3ee0a7cd-7526-4a40-a92e-1443ba5ba1a5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:08.870919 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3ee0a7cd-7526-4a40-a92e-1443ba5ba1a5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1392 microversion: 2.1 time: 0.299804 May 21 21:17:08.872142 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 909/1837] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:08 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1392 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:08.879477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3aa0fa72-fddd-46f5-b3ca-6c044b88720e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:08.880788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3aa0fa72-fddd-46f5-b3ca-6c044b88720e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 5a995b92-640c-4b35-96a4-abd23d9995e6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:08.890399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3aa0fa72-fddd-46f5-b3ca-6c044b88720e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:08.893209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3aa0fa72-fddd-46f5-b3ca-6c044b88720e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:08.893209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3aa0fa72-fddd-46f5-b3ca-6c044b88720e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:08.893209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3aa0fa72-fddd-46f5-b3ca-6c044b88720e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:08.911144 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-3aa0fa72-fddd-46f5-b3ca-6c044b88720e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] HTTP exception thrown: Instance 5a995b92-640c-4b35-96a4-abd23d9995e6 could not be found. May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3aa0fa72-fddd-46f5-b3ca-6c044b88720e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Request method failure captured: May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 HTTP/1.1 May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVVrNo4OJOkeIE2CiZd0jTTY5P5q9tx7Z4li1YtIQ90HhP0jnaa2RQ66A7I46wokJAUeeiBJ8gZvALjC6IJp0KWSmejQhNBdpSWA05ZkrN--mepOZfvpCU2--O0LWNFI8mKUbbzglqr9VPPKIoaS0j25XDk3vY3FZ4j37tOnESWLlpE May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 3cdfab8428a54520a01fdde7222835be May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-MigrationsAdminTest-1725319035 May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3cdfab8428a54520a01fdde7222835be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3cdfab8428a54520a01fdde7222835be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3cdfab8428a54520a01fdde7222835be", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3cdfab8428a54520a01fdde7222835be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-MigrationsAdminTest-1725319035 May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 3cdfab8428a54520a01fdde7222835be May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-MigrationsAdminTest-1725319035 May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-MigrationsAdminTest-1725319035-project May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c3d9543f794d40be9c24715bf530add3 May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-MigrationsAdminTest-1725319035-project May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 5a995b92-640c-4b35-96a4-abd23d9995e6 could not be found. May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '5a995b92-640c-4b35-96a4-abd23d9995e6'} May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a995b92-640c-4b35-96a4-abd23d9995e6 could not be found. May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a995b92-640c-4b35-96a4-abd23d9995e6 could not be found. May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:17:08.913493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:08.918363 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:08.918363 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:17:08.918363 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:17:08.918363 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:17:08.918363 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:17:08.918363 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a995b92-640c-4b35-96a4-abd23d9995e6 could not be found. May 21 21:17:08.918363 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:08.920775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3aa0fa72-fddd-46f5-b3ca-6c044b88720e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Returning 404 to user: Instance 5a995b92-640c-4b35-96a4-abd23d9995e6 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:17:08.921896 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3aa0fa72-fddd-46f5-b3ca-6c044b88720e tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6" status: 404 len: 111 microversion: 2.1 time: 0.048488 May 21 21:17:08.926079 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 910/1838] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:08 2022] GET /compute/v2.1/servers/5a995b92-640c-4b35-96a4-abd23d9995e6 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:17:08.933433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7be4b144-38c7-43e7-a447-c17418d4d612 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:08.933433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7be4b144-38c7-43e7-a447-c17418d4d612 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:08.944886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7be4b144-38c7-43e7-a447-c17418d4d612 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:08.945332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7be4b144-38c7-43e7-a447-c17418d4d612 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:08.946406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7be4b144-38c7-43e7-a447-c17418d4d612 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:08.947074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7be4b144-38c7-43e7-a447-c17418d4d612 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:09.049478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7be4b144-38c7-43e7-a447-c17418d4d612 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:09.062380 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7be4b144-38c7-43e7-a447-c17418d4d612 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 200 len: 1260 microversion: 2.1 time: 0.131486 May 21 21:17:09.073341 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 911/1839] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:08 2022] GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 1260 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:09.079994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5c8b8cbd-7e21-4fd9-ad44-a039a00a4811 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:09.080796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5c8b8cbd-7e21-4fd9-ad44-a039a00a4811 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:09.108830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c8b8cbd-7e21-4fd9-ad44-a039a00a4811 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:09.111411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c8b8cbd-7e21-4fd9-ad44-a039a00a4811 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:09.112797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c8b8cbd-7e21-4fd9-ad44-a039a00a4811 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:09.113620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c8b8cbd-7e21-4fd9-ad44-a039a00a4811 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:09.176042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5c8b8cbd-7e21-4fd9-ad44-a039a00a4811 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:17:09.229392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-9f66dbd0-17c7-458a-aef4-5052c8523357 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:17:09.230195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-9f66dbd0-17c7-458a-aef4-5052c8523357 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:17:09.230902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-9f66dbd0-17c7-458a-aef4-5052c8523357 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:17:09.231504 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-9f66dbd0-17c7-458a-aef4-5052c8523357 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:17:09.232749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-9f66dbd0-17c7-458a-aef4-5052c8523357 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:17:09.251287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f66dbd0-17c7-458a-aef4-5052c8523357 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:09.258408 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f66dbd0-17c7-458a-aef4-5052c8523357 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:09.259539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f66dbd0-17c7-458a-aef4-5052c8523357 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:09.260403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f66dbd0-17c7-458a-aef4-5052c8523357 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:09.296174 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-9f66dbd0-17c7-458a-aef4-5052c8523357 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Getting quotas for project 8c48385dc5c24377a7be24da93fc54d9. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:17:09.303528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-9f66dbd0-17c7-458a-aef4-5052c8523357 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Getting quotas for user c3e23800ab314cc28dc30330928d8454 and project 8c48385dc5c24377a7be24da93fc54d9. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:17:09.322442 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9f66dbd0-17c7-458a-aef4-5052c8523357 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:17:09.325893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9f66dbd0-17c7-458a-aef4-5052c8523357 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:17:09.520968 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9f66dbd0-17c7-458a-aef4-5052c8523357 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.063103 May 21 21:17:09.522319 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 929/1840] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:17:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:17:09.536406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ef9683e8-70b7-4fad-89d2-046669f2aa99 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:09.539009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ef9683e8-70b7-4fad-89d2-046669f2aa99 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:09.554499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:09.672733 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5c8b8cbd-7e21-4fd9-ad44-a039a00a4811 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "DELETE /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 204 len: 0 microversion: 2.1 time: 0.597089 May 21 21:17:09.678599 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 912/1841] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:17:09 2022] DELETE /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 0 bytes in 599 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:17:09.686864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-00899d7c-867a-47e0-bcf9-e250d8d5e6cc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:09.691189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-00899d7c-867a-47e0-bcf9-e250d8d5e6cc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:09.729417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00899d7c-867a-47e0-bcf9-e250d8d5e6cc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:09.732472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00899d7c-867a-47e0-bcf9-e250d8d5e6cc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:09.738774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00899d7c-867a-47e0-bcf9-e250d8d5e6cc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:09.738774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00899d7c-867a-47e0-bcf9-e250d8d5e6cc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:09.948780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ef9683e8-70b7-4fad-89d2-046669f2aa99 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:09.957846 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ef9683e8-70b7-4fad-89d2-046669f2aa99 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1215 microversion: 2.1 time: 0.428601 May 21 21:17:09.962241 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 930/1842] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:09 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1215 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:09.976924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-08b13349-f93f-45bf-9005-2ca9940425f8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:09.978099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-08b13349-f93f-45bf-9005-2ca9940425f8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:09.992841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08b13349-f93f-45bf-9005-2ca9940425f8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:09.993652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08b13349-f93f-45bf-9005-2ca9940425f8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:09.996062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08b13349-f93f-45bf-9005-2ca9940425f8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:09.996062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08b13349-f93f-45bf-9005-2ca9940425f8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:10.118947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-00899d7c-867a-47e0-bcf9-e250d8d5e6cc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:10.132560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-00899d7c-867a-47e0-bcf9-e250d8d5e6cc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:10.154386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-00899d7c-867a-47e0-bcf9-e250d8d5e6cc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:10.154386 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-00899d7c-867a-47e0-bcf9-e250d8d5e6cc tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.461165 May 21 21:17:10.154386 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 913/1843] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:09 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:10.154386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2deb1a85-53df-408e-b275-f9d30ce12367 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:10.154386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2deb1a85-53df-408e-b275-f9d30ce12367 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:10.173487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2deb1a85-53df-408e-b275-f9d30ce12367 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:10.174077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2deb1a85-53df-408e-b275-f9d30ce12367 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:10.177648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2deb1a85-53df-408e-b275-f9d30ce12367 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:10.183430 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2deb1a85-53df-408e-b275-f9d30ce12367 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:10.337581 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-08b13349-f93f-45bf-9005-2ca9940425f8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:10.347943 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-08b13349-f93f-45bf-9005-2ca9940425f8 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1468 microversion: 2.1 time: 0.383230 May 21 21:17:10.348591 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 931/1844] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:09 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1468 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:10.366897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f2fd322a-f086-4ab8-b63c-2253a7792273 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:10.372811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f2fd322a-f086-4ab8-b63c-2253a7792273 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:10.378212 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2fd322a-f086-4ab8-b63c-2253a7792273 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:10.379084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2fd322a-f086-4ab8-b63c-2253a7792273 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:10.380099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2fd322a-f086-4ab8-b63c-2253a7792273 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:10.380781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2fd322a-f086-4ab8-b63c-2253a7792273 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:10.570350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f2fd322a-f086-4ab8-b63c-2253a7792273 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:10.582302 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f2fd322a-f086-4ab8-b63c-2253a7792273 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 200 len: 1278 microversion: 2.1 time: 0.220886 May 21 21:17:10.587251 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 932/1845] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:10 2022] GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 1278 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:10.605463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-36cbc5b2-bf99-4686-8962-1ec517a80583 req-9e220ed5-56b2-4d2c-b463-3850648579b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a995b92-640c-4b35-96a4-abd23d9995e6", "name": "network-vif-deleted", "tag": "5dcfbf23-d7d5-46ab-8767-b5c1c927ce65"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:10.624757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-36cbc5b2-bf99-4686-8962-1ec517a80583 req-9e220ed5-56b2-4d2c-b463-3850648579b5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:10.632145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-36cbc5b2-bf99-4686-8962-1ec517a80583 req-9e220ed5-56b2-4d2c-b463-3850648579b5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:10.660520 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-36cbc5b2-bf99-4686-8962-1ec517a80583 req-9e220ed5-56b2-4d2c-b463-3850648579b5 service nova] Creating event network-vif-deleted:5dcfbf23-d7d5-46ab-8767-b5c1c927ce65 for instance 5a995b92-640c-4b35-96a4-abd23d9995e6 on nch2-master-1 May 21 21:17:10.692026 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-36cbc5b2-bf99-4686-8962-1ec517a80583 req-9e220ed5-56b2-4d2c-b463-3850648579b5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095491 May 21 21:17:10.692854 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 933/1846] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:10.980214 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-151b2aec-89ff-41de-994f-de4521bb4b50 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:10.981377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-151b2aec-89ff-41de-994f-de4521bb4b50 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:11.125310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-151b2aec-89ff-41de-994f-de4521bb4b50 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:11.135374 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-151b2aec-89ff-41de-994f-de4521bb4b50 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1215 microversion: 2.1 time: 0.161393 May 21 21:17:11.137690 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 934/1847] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:10 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:17:11.163081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0fb55dab-b2a2-429f-b5f3-0eb3421f4c91 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:11.164562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0fb55dab-b2a2-429f-b5f3-0eb3421f4c91 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:11.186603 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0fb55dab-b2a2-429f-b5f3-0eb3421f4c91 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:11.191826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0fb55dab-b2a2-429f-b5f3-0eb3421f4c91 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:11.191826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0fb55dab-b2a2-429f-b5f3-0eb3421f4c91 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:11.192147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0fb55dab-b2a2-429f-b5f3-0eb3421f4c91 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:11.402112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2deb1a85-53df-408e-b275-f9d30ce12367 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:11.414679 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2deb1a85-53df-408e-b275-f9d30ce12367 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1392 microversion: 2.1 time: 1.268519 May 21 21:17:11.432896 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 914/1848] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:10 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1392 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:11.432896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-93adfca2-d7a5-42e1-87d2-8caf0d983a18 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:11.433889 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-93adfca2-d7a5-42e1-87d2-8caf0d983a18 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:11.459215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-93adfca2-d7a5-42e1-87d2-8caf0d983a18 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:11.459678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-93adfca2-d7a5-42e1-87d2-8caf0d983a18 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:11.466839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-93adfca2-d7a5-42e1-87d2-8caf0d983a18 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:11.467380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-93adfca2-d7a5-42e1-87d2-8caf0d983a18 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:11.711664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0fb55dab-b2a2-429f-b5f3-0eb3421f4c91 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:11.720893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0fb55dab-b2a2-429f-b5f3-0eb3421f4c91 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:11.726454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0fb55dab-b2a2-429f-b5f3-0eb3421f4c91 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:11.740855 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0fb55dab-b2a2-429f-b5f3-0eb3421f4c91 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.578652 May 21 21:17:11.749894 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 935/1849] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:11 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:11.769051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-35ef2303-b3ed-4dec-b134-c0f66e9360be tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:11.769680 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-35ef2303-b3ed-4dec-b134-c0f66e9360be tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:11.780811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35ef2303-b3ed-4dec-b134-c0f66e9360be tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:11.781657 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35ef2303-b3ed-4dec-b134-c0f66e9360be tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:11.782637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35ef2303-b3ed-4dec-b134-c0f66e9360be tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:11.786802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35ef2303-b3ed-4dec-b134-c0f66e9360be tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:12.336118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-35ef2303-b3ed-4dec-b134-c0f66e9360be tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:12.347386 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-35ef2303-b3ed-4dec-b134-c0f66e9360be tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 200 len: 1266 microversion: 2.1 time: 0.593894 May 21 21:17:12.353028 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 936/1850] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:11 2022] GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 1266 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:12.362483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aa52f87a-7d11-4a01-b792-8a1dfda2183c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:12.365851 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aa52f87a-7d11-4a01-b792-8a1dfda2183c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:12.390021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa52f87a-7d11-4a01-b792-8a1dfda2183c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:12.390021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa52f87a-7d11-4a01-b792-8a1dfda2183c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:12.390021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa52f87a-7d11-4a01-b792-8a1dfda2183c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:12.390021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa52f87a-7d11-4a01-b792-8a1dfda2183c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:12.890134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aa52f87a-7d11-4a01-b792-8a1dfda2183c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:12.900202 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aa52f87a-7d11-4a01-b792-8a1dfda2183c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1267 microversion: 2.1 time: 0.546005 May 21 21:17:12.902723 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 937/1851] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:12 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1267 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:12.916482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b5c854c2-b43b-46cf-acb4-5af738d2fea6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:12.917370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b5c854c2-b43b-46cf-acb4-5af738d2fea6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:12.943379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b5c854c2-b43b-46cf-acb4-5af738d2fea6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:12.947113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b5c854c2-b43b-46cf-acb4-5af738d2fea6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:12.948397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b5c854c2-b43b-46cf-acb4-5af738d2fea6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:12.950145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b5c854c2-b43b-46cf-acb4-5af738d2fea6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:13.209311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-93adfca2-d7a5-42e1-87d2-8caf0d983a18 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:13.232347 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-93adfca2-d7a5-42e1-87d2-8caf0d983a18 tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1468 microversion: 2.1 time: 1.812867 May 21 21:17:13.234746 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 915/1852] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:11 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1468 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:13.252883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6b4c49bf-30cf-4f34-87bb-cd112ddc3772 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:13.254060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6b4c49bf-30cf-4f34-87bb-cd112ddc3772 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:13.268477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b4c49bf-30cf-4f34-87bb-cd112ddc3772 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:13.273268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b4c49bf-30cf-4f34-87bb-cd112ddc3772 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:13.274487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b4c49bf-30cf-4f34-87bb-cd112ddc3772 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:13.275181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b4c49bf-30cf-4f34-87bb-cd112ddc3772 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:13.370567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b5c854c2-b43b-46cf-acb4-5af738d2fea6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:13.386214 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b5c854c2-b43b-46cf-acb4-5af738d2fea6 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1392 microversion: 2.1 time: 0.479824 May 21 21:17:13.386399 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 938/1853] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:12 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1392 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:13.394612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4aa8ae85-6b9d-49a0-bea3-40362ba04619 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:13.395230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4aa8ae85-6b9d-49a0-bea3-40362ba04619 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:13.413075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4aa8ae85-6b9d-49a0-bea3-40362ba04619 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:13.413811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4aa8ae85-6b9d-49a0-bea3-40362ba04619 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:13.414802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4aa8ae85-6b9d-49a0-bea3-40362ba04619 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:13.415404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4aa8ae85-6b9d-49a0-bea3-40362ba04619 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:13.568493 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4aa8ae85-6b9d-49a0-bea3-40362ba04619 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:13.582018 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4aa8ae85-6b9d-49a0-bea3-40362ba04619 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 200 len: 1266 microversion: 2.1 time: 0.194327 May 21 21:17:13.586724 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 939/1854] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:13 2022] GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:13.921509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-81b147d9-83e8-451d-8f3e-e8d4cccac7f8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:13.923237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-81b147d9-83e8-451d-8f3e-e8d4cccac7f8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:13.948524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81b147d9-83e8-451d-8f3e-e8d4cccac7f8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:13.950778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81b147d9-83e8-451d-8f3e-e8d4cccac7f8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:13.953174 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81b147d9-83e8-451d-8f3e-e8d4cccac7f8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:13.955779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81b147d9-83e8-451d-8f3e-e8d4cccac7f8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:14.149250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-81b147d9-83e8-451d-8f3e-e8d4cccac7f8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:14.159383 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-81b147d9-83e8-451d-8f3e-e8d4cccac7f8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1273 microversion: 2.1 time: 0.242151 May 21 21:17:14.160031 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 940/1855] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:13 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1273 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:14.251351 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4bdd12d1-99fc-4043-8c8c-6669420fb7cc tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:14.252302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4bdd12d1-99fc-4043-8c8c-6669420fb7cc tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:14.285545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4bdd12d1-99fc-4043-8c8c-6669420fb7cc tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:14.286965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4bdd12d1-99fc-4043-8c8c-6669420fb7cc tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:14.290173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4bdd12d1-99fc-4043-8c8c-6669420fb7cc tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:14.290677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4bdd12d1-99fc-4043-8c8c-6669420fb7cc tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:14.637406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4bdd12d1-99fc-4043-8c8c-6669420fb7cc tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:14.647811 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4bdd12d1-99fc-4043-8c8c-6669420fb7cc tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1468 microversion: 2.1 time: 0.400527 May 21 21:17:14.659440 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 941/1856] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:14 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1468 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:17:14.672920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-afe8705c-1428-4e6e-83e2-9f6f2387bd09 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:14.676081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-afe8705c-1428-4e6e-83e2-9f6f2387bd09 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:14.680563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-afe8705c-1428-4e6e-83e2-9f6f2387bd09 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:14.685233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-afe8705c-1428-4e6e-83e2-9f6f2387bd09 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:14.686943 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-afe8705c-1428-4e6e-83e2-9f6f2387bd09 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:14.687573 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-afe8705c-1428-4e6e-83e2-9f6f2387bd09 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:14.743082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6b4c49bf-30cf-4f34-87bb-cd112ddc3772 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:14.756738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6b4c49bf-30cf-4f34-87bb-cd112ddc3772 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:14.758715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6b4c49bf-30cf-4f34-87bb-cd112ddc3772 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:14.764970 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6b4c49bf-30cf-4f34-87bb-cd112ddc3772 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 1.528566 May 21 21:17:14.765944 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 916/1857] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:13 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:14.777453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b4c0d06a-79e6-46d5-9605-5e0627432845 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:14.778274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b4c0d06a-79e6-46d5-9605-5e0627432845 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:14.787564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b4c0d06a-79e6-46d5-9605-5e0627432845 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:14.787564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b4c0d06a-79e6-46d5-9605-5e0627432845 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:14.787564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b4c0d06a-79e6-46d5-9605-5e0627432845 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:14.788021 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b4c0d06a-79e6-46d5-9605-5e0627432845 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:15.231975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:15.350098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-afe8705c-1428-4e6e-83e2-9f6f2387bd09 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:15.373620 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-afe8705c-1428-4e6e-83e2-9f6f2387bd09 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1392 microversion: 2.1 time: 0.710659 May 21 21:17:15.388988 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 942/1858] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:14 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1392 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:15.398764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-8dbbad6f-bddb-4230-9017-827b3976076d req-f842e7f3-f650-4917-9118-8d2b51dd1c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d5f184-08de-44c5-bd8c-051f64fe06fa", "name": "network-vif-unplugged", "status": "completed", "tag": "15fa1734-3d96-43ae-a8b4-3a89b9859f45"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:15.414327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8dbbad6f-bddb-4230-9017-827b3976076d req-f842e7f3-f650-4917-9118-8d2b51dd1c0a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:15.415197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8dbbad6f-bddb-4230-9017-827b3976076d req-f842e7f3-f650-4917-9118-8d2b51dd1c0a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:15.470577 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-8dbbad6f-bddb-4230-9017-827b3976076d req-f842e7f3-f650-4917-9118-8d2b51dd1c0a service nova] Creating event network-vif-unplugged:15fa1734-3d96-43ae-a8b4-3a89b9859f45 for instance 06d5f184-08de-44c5-bd8c-051f64fe06fa on nch2-master-1 May 21 21:17:15.491727 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-8dbbad6f-bddb-4230-9017-827b3976076d req-f842e7f3-f650-4917-9118-8d2b51dd1c0a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095372 May 21 21:17:15.493085 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 943/1859] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:15.506863 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-96cab48e-d5e2-481e-a523-adac0bd4c689 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:15.507808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-96cab48e-d5e2-481e-a523-adac0bd4c689 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:15.523958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96cab48e-d5e2-481e-a523-adac0bd4c689 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:15.524945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96cab48e-d5e2-481e-a523-adac0bd4c689 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:15.526121 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96cab48e-d5e2-481e-a523-adac0bd4c689 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:15.526856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96cab48e-d5e2-481e-a523-adac0bd4c689 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:15.793737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-96cab48e-d5e2-481e-a523-adac0bd4c689 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:15.805140 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-96cab48e-d5e2-481e-a523-adac0bd4c689 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1273 microversion: 2.1 time: 0.310288 May 21 21:17:15.814687 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 944/1860] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:15 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1273 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:15.814687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4595f208-0106-4ef6-b6e8-60e83329338c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:15.814687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4595f208-0106-4ef6-b6e8-60e83329338c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:15.820730 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4595f208-0106-4ef6-b6e8-60e83329338c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:15.821321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4595f208-0106-4ef6-b6e8-60e83329338c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:15.822288 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4595f208-0106-4ef6-b6e8-60e83329338c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:15.823357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4595f208-0106-4ef6-b6e8-60e83329338c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:15.853601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b4c0d06a-79e6-46d5-9605-5e0627432845 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:15.864110 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b4c0d06a-79e6-46d5-9605-5e0627432845 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 200 len: 1308 microversion: 2.1 time: 1.095115 May 21 21:17:15.869554 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 917/1861] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:14 2022] GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 1308 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:15.877049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-02c688ec-df96-41d4-a178-0aba311c8ce3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:15.881541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-02c688ec-df96-41d4-a178-0aba311c8ce3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:15.886187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02c688ec-df96-41d4-a178-0aba311c8ce3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:15.886652 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02c688ec-df96-41d4-a178-0aba311c8ce3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:15.887484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02c688ec-df96-41d4-a178-0aba311c8ce3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:15.888134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02c688ec-df96-41d4-a178-0aba311c8ce3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:15.958973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4595f208-0106-4ef6-b6e8-60e83329338c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:15.967818 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4595f208-0106-4ef6-b6e8-60e83329338c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1426 microversion: 2.1 time: 0.160258 May 21 21:17:15.979054 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 945/1862] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:15 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1426 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:16.405611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b6aa2ff0-6a6a-4e52-b51b-fa4000477206 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:16.406271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b6aa2ff0-6a6a-4e52-b51b-fa4000477206 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:16.416360 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6aa2ff0-6a6a-4e52-b51b-fa4000477206 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:16.416790 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6aa2ff0-6a6a-4e52-b51b-fa4000477206 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:16.417592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6aa2ff0-6a6a-4e52-b51b-fa4000477206 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:16.418036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6aa2ff0-6a6a-4e52-b51b-fa4000477206 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:16.810468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b6aa2ff0-6a6a-4e52-b51b-fa4000477206 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:16.829267 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b6aa2ff0-6a6a-4e52-b51b-fa4000477206 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1392 microversion: 2.1 time: 0.427419 May 21 21:17:16.835297 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 946/1863] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:16 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1392 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:16.850938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a92f3de7-06f2-4edd-91b8-05da8f57a780 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:16.851710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a92f3de7-06f2-4edd-91b8-05da8f57a780 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:16.865325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a92f3de7-06f2-4edd-91b8-05da8f57a780 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:16.866277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a92f3de7-06f2-4edd-91b8-05da8f57a780 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:16.868369 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a92f3de7-06f2-4edd-91b8-05da8f57a780 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:16.869063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a92f3de7-06f2-4edd-91b8-05da8f57a780 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:17.129789 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a92f3de7-06f2-4edd-91b8-05da8f57a780 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:17.146689 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a92f3de7-06f2-4edd-91b8-05da8f57a780 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1273 microversion: 2.1 time: 0.307996 May 21 21:17:17.163786 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 947/1864] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:16 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1273 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:17.174170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-00427ca4-04f2-467f-bb33-3e7d97f5c656 req-01eb205d-b3d7-44b1-9b8a-965667f23bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d5f184-08de-44c5-bd8c-051f64fe06fa", "name": "network-vif-deleted", "tag": "15fa1734-3d96-43ae-a8b4-3a89b9859f45"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:17.189563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-00427ca4-04f2-467f-bb33-3e7d97f5c656 req-01eb205d-b3d7-44b1-9b8a-965667f23bfa service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:17.190491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-00427ca4-04f2-467f-bb33-3e7d97f5c656 req-01eb205d-b3d7-44b1-9b8a-965667f23bfa service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:17.212912 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-00427ca4-04f2-467f-bb33-3e7d97f5c656 req-01eb205d-b3d7-44b1-9b8a-965667f23bfa service nova] Creating event network-vif-deleted:15fa1734-3d96-43ae-a8b4-3a89b9859f45 for instance 06d5f184-08de-44c5-bd8c-051f64fe06fa on nch2-master-1 May 21 21:17:17.219962 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-00427ca4-04f2-467f-bb33-3e7d97f5c656 req-01eb205d-b3d7-44b1-9b8a-965667f23bfa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054366 May 21 21:17:17.221644 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 948/1865] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:17.229011 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6ead0075-0035-43aa-8555-696c621c34da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:17.230804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6ead0075-0035-43aa-8555-696c621c34da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:17.237618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ead0075-0035-43aa-8555-696c621c34da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:17.241910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-02c688ec-df96-41d4-a178-0aba311c8ce3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:17.256324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-02c688ec-df96-41d4-a178-0aba311c8ce3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:17.258416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-02c688ec-df96-41d4-a178-0aba311c8ce3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:17.261697 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-02c688ec-df96-41d4-a178-0aba311c8ce3 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 1.389832 May 21 21:17:17.263154 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 918/1866] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:15 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:17.267140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ead0075-0035-43aa-8555-696c621c34da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:17.268020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ead0075-0035-43aa-8555-696c621c34da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:17.268498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ead0075-0035-43aa-8555-696c621c34da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:17.272126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5c1220c5-1e92-47de-800f-7a2bc059515c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:17.273294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5c1220c5-1e92-47de-800f-7a2bc059515c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:17.283021 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c1220c5-1e92-47de-800f-7a2bc059515c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:17.284903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c1220c5-1e92-47de-800f-7a2bc059515c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:17.287720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c1220c5-1e92-47de-800f-7a2bc059515c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:17.290368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c1220c5-1e92-47de-800f-7a2bc059515c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:17.402761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c1220c5-1e92-47de-800f-7a2bc059515c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:17.404177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c1220c5-1e92-47de-800f-7a2bc059515c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:17.405517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-5c1220c5-1e92-47de-800f-7a2bc059515c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lazy-loading 'fault' on Instance uuid 06d5f184-08de-44c5-bd8c-051f64fe06fa {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:17:17.508073 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=10 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:17.582317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5c1220c5-1e92-47de-800f-7a2bc059515c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3d9543f794d40be9c24715bf530add3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cdfab8428a54520a01fdde7222835be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:17.594116 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5c1220c5-1e92-47de-800f-7a2bc059515c tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 200 len: 1303 microversion: 2.1 time: 0.329161 May 21 21:17:17.595532 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 919/1867] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:17 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 1303 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:17.663819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6ead0075-0035-43aa-8555-696c621c34da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:17.666342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:17.673625 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6ead0075-0035-43aa-8555-696c621c34da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 200 len: 1308 microversion: 2.1 time: 0.450480 May 21 21:17:17.674211 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 949/1868] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:17 2022] GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 1308 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:17.854209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-51cae5a8-f9bf-495c-a7ee-6725d2b8eac3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:17.855565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-51cae5a8-f9bf-495c-a7ee-6725d2b8eac3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:17.868879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-51cae5a8-f9bf-495c-a7ee-6725d2b8eac3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:17.869861 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-51cae5a8-f9bf-495c-a7ee-6725d2b8eac3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:17.871070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-51cae5a8-f9bf-495c-a7ee-6725d2b8eac3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:17.872714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-51cae5a8-f9bf-495c-a7ee-6725d2b8eac3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:17.897943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:18.168255 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-de3bae88-28a3-4074-bc83-1e2f4716cd19 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:18.170516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-de3bae88-28a3-4074-bc83-1e2f4716cd19 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:18.180850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-de3bae88-28a3-4074-bc83-1e2f4716cd19 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:18.181600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-de3bae88-28a3-4074-bc83-1e2f4716cd19 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:18.182929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-de3bae88-28a3-4074-bc83-1e2f4716cd19 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:18.183604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-de3bae88-28a3-4074-bc83-1e2f4716cd19 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:18.381218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-de3bae88-28a3-4074-bc83-1e2f4716cd19 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:18.402495 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-de3bae88-28a3-4074-bc83-1e2f4716cd19 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1315 microversion: 2.1 time: 0.238368 May 21 21:17:18.414409 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 950/1869] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:18 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:18.419523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-454e768c-ecc5-4611-a323-6d40be011798 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:18.421157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-454e768c-ecc5-4611-a323-6d40be011798 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:18.430844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-454e768c-ecc5-4611-a323-6d40be011798 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:18.431679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-454e768c-ecc5-4611-a323-6d40be011798 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:18.433335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-454e768c-ecc5-4611-a323-6d40be011798 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:18.434533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-454e768c-ecc5-4611-a323-6d40be011798 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:18.655994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-454e768c-ecc5-4611-a323-6d40be011798 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:18.675543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-454e768c-ecc5-4611-a323-6d40be011798 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:18.681757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-454e768c-ecc5-4611-a323-6d40be011798 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:18.681757 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-454e768c-ecc5-4611-a323-6d40be011798 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.266102 May 21 21:17:18.688717 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 951/1870] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:18 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:18.694312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-312c7ec9-5cf2-412f-99dc-02fce258613b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:18.695086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-312c7ec9-5cf2-412f-99dc-02fce258613b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] [instance: 06d5f184-08de-44c5-bd8c-051f64fe06fa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:18.702266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-312c7ec9-5cf2-412f-99dc-02fce258613b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:18.702947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-312c7ec9-5cf2-412f-99dc-02fce258613b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:18.703804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-312c7ec9-5cf2-412f-99dc-02fce258613b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:18.704333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-312c7ec9-5cf2-412f-99dc-02fce258613b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:18.722440 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-312c7ec9-5cf2-412f-99dc-02fce258613b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] HTTP exception thrown: Instance 06d5f184-08de-44c5-bd8c-051f64fe06fa could not be found. May 21 21:17:18.722972 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-51cae5a8-f9bf-495c-a7ee-6725d2b8eac3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-312c7ec9-5cf2-412f-99dc-02fce258613b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Request method failure captured: May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa HTTP/1.1 May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVVrNo4OJOkeIE2CiZd0jTTY5P5q9tx7Z4li1YtIQ90HhP0jnaa2RQ66A7I46wokJAUeeiBJ8gZvALjC6IJp0KWSmejQhNBdpSWA05ZkrN--mepOZfvpCU2--O0LWNFI8mKUbbzglqr9VPPKIoaS0j25XDk3vY3FZ4j37tOnESWLlpE May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 3cdfab8428a54520a01fdde7222835be May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-MigrationsAdminTest-1725319035 May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3cdfab8428a54520a01fdde7222835be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3cdfab8428a54520a01fdde7222835be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3cdfab8428a54520a01fdde7222835be", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3cdfab8428a54520a01fdde7222835be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-MigrationsAdminTest-1725319035 May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 3cdfab8428a54520a01fdde7222835be May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-MigrationsAdminTest-1725319035 May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-MigrationsAdminTest-1725319035-project May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: c3d9543f794d40be9c24715bf530add3 May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-MigrationsAdminTest-1725319035-project May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 06d5f184-08de-44c5-bd8c-051f64fe06fa could not be found. May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '06d5f184-08de-44c5-bd8c-051f64fe06fa'} May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d5f184-08de-44c5-bd8c-051f64fe06fa could not be found. May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d5f184-08de-44c5-bd8c-051f64fe06fa could not be found. May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:17:18.724747 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:17:18.738818 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:18.738818 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:17:18.738818 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:17:18.738818 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:17:18.738818 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:17:18.738818 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d5f184-08de-44c5-bd8c-051f64fe06fa could not be found. May 21 21:17:18.738818 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:17:18.738818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-312c7ec9-5cf2-412f-99dc-02fce258613b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] Returning 404 to user: Instance 06d5f184-08de-44c5-bd8c-051f64fe06fa could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:17:18.738818 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-312c7ec9-5cf2-412f-99dc-02fce258613b tempest-MigrationsAdminTest-1725319035 tempest-MigrationsAdminTest-1725319035-project] 10.222.0.49 "GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa" status: 404 len: 111 microversion: 2.1 time: 0.038267 May 21 21:17:18.738818 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 952/1871] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:18 2022] GET /compute/v2.1/servers/06d5f184-08de-44c5-bd8c-051f64fe06fa => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:17:18.749398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-eaa4ece8-0474-49d1-93ce-f845b4b7a040 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:18.751285 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-eaa4ece8-0474-49d1-93ce-f845b4b7a040 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:18.756654 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-51cae5a8-f9bf-495c-a7ee-6725d2b8eac3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1392 microversion: 2.1 time: 0.896380 May 21 21:17:18.758961 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 920/1872] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:17 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1392 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:18.768425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eaa4ece8-0474-49d1-93ce-f845b4b7a040 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:18.768956 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eaa4ece8-0474-49d1-93ce-f845b4b7a040 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:18.770987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eaa4ece8-0474-49d1-93ce-f845b4b7a040 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:18.771633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eaa4ece8-0474-49d1-93ce-f845b4b7a040 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:18.962590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-eaa4ece8-0474-49d1-93ce-f845b4b7a040 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:18.970400 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-eaa4ece8-0474-49d1-93ce-f845b4b7a040 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 200 len: 1308 microversion: 2.1 time: 0.240330 May 21 21:17:18.970975 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 953/1873] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:18 2022] GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 1308 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:19.265237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-7b7518b7-574e-4767-b832-0eadaebefcc2 req-891ce831-8161-41b2-a456-658c3cb5b338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ce51e42-255d-45f7-afab-2fdb937e7758", "name": "network-vif-unplugged", "status": "completed", "tag": "13fa11f5-00e8-4fa2-a36a-6c54e56541f6"}, {"name": "network-changed", "server_uuid": "4ce51e42-255d-45f7-afab-2fdb937e7758", "tag": "13fa11f5-00e8-4fa2-a36a-6c54e56541f6"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:19.277472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:19.293989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-7b7518b7-574e-4767-b832-0eadaebefcc2 req-891ce831-8161-41b2-a456-658c3cb5b338 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:19.296794 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-7b7518b7-574e-4767-b832-0eadaebefcc2 req-891ce831-8161-41b2-a456-658c3cb5b338 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:19.328495 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-7b7518b7-574e-4767-b832-0eadaebefcc2 req-891ce831-8161-41b2-a456-658c3cb5b338 service nova] Creating event network-vif-unplugged:13fa11f5-00e8-4fa2-a36a-6c54e56541f6 for instance 4ce51e42-255d-45f7-afab-2fdb937e7758 on nch1-master-1 May 21 21:17:19.329019 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-7b7518b7-574e-4767-b832-0eadaebefcc2 req-891ce831-8161-41b2-a456-658c3cb5b338 service nova] Creating event network-changed:13fa11f5-00e8-4fa2-a36a-6c54e56541f6 for instance 4ce51e42-255d-45f7-afab-2fdb937e7758 on nch1-master-1 May 21 21:17:19.344920 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-7b7518b7-574e-4767-b832-0eadaebefcc2 req-891ce831-8161-41b2-a456-658c3cb5b338 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.086456 May 21 21:17:19.348933 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 921/1874] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:19.422283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fa92e2a7-fca9-48bc-8d10-4ab8e0e3e9ea tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:19.425140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fa92e2a7-fca9-48bc-8d10-4ab8e0e3e9ea tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:19.429512 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:19.436184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fa92e2a7-fca9-48bc-8d10-4ab8e0e3e9ea tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:19.444940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fa92e2a7-fca9-48bc-8d10-4ab8e0e3e9ea tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:19.445960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fa92e2a7-fca9-48bc-8d10-4ab8e0e3e9ea tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:19.446515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fa92e2a7-fca9-48bc-8d10-4ab8e0e3e9ea tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:19.703989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-15e8f6ea-ea6a-4dba-8dd0-300676530519 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:19.705460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-15e8f6ea-ea6a-4dba-8dd0-300676530519 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:19.714016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-15e8f6ea-ea6a-4dba-8dd0-300676530519 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:19.714771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-15e8f6ea-ea6a-4dba-8dd0-300676530519 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:19.717129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-15e8f6ea-ea6a-4dba-8dd0-300676530519 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:19.717779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-15e8f6ea-ea6a-4dba-8dd0-300676530519 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:19.840752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fa92e2a7-fca9-48bc-8d10-4ab8e0e3e9ea tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:19.862147 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fa92e2a7-fca9-48bc-8d10-4ab8e0e3e9ea tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1315 microversion: 2.1 time: 0.445421 May 21 21:17:19.863784 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 954/1875] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:19 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:19.875477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ee6ce2d1-3589-47cd-9382-ec79a72734e3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:19.876680 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ee6ce2d1-3589-47cd-9382-ec79a72734e3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:19.896887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee6ce2d1-3589-47cd-9382-ec79a72734e3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:19.899948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee6ce2d1-3589-47cd-9382-ec79a72734e3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:19.904806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee6ce2d1-3589-47cd-9382-ec79a72734e3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:19.908762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee6ce2d1-3589-47cd-9382-ec79a72734e3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:20.097713 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-15e8f6ea-ea6a-4dba-8dd0-300676530519 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:20.117239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-15e8f6ea-ea6a-4dba-8dd0-300676530519 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:20.122869 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-15e8f6ea-ea6a-4dba-8dd0-300676530519 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:20.124987 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-15e8f6ea-ea6a-4dba-8dd0-300676530519 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.426759 May 21 21:17:20.127159 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 922/1876] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:19 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:20.152020 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-07e10275-9431-418d-ac78-f7796d2fc3cc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:20.154005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-07e10275-9431-418d-ac78-f7796d2fc3cc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:20.177602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-07e10275-9431-418d-ac78-f7796d2fc3cc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:20.178854 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-07e10275-9431-418d-ac78-f7796d2fc3cc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:20.185822 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-07e10275-9431-418d-ac78-f7796d2fc3cc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:20.201859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-07e10275-9431-418d-ac78-f7796d2fc3cc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:20.348191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ee6ce2d1-3589-47cd-9382-ec79a72734e3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:20.357534 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ee6ce2d1-3589-47cd-9382-ec79a72734e3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1392 microversion: 2.1 time: 0.492155 May 21 21:17:20.359738 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 955/1877] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:19 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1392 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:21.016328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-07e10275-9431-418d-ac78-f7796d2fc3cc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:21.016328 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-07e10275-9431-418d-ac78-f7796d2fc3cc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 200 len: 1308 microversion: 2.1 time: 0.601724 May 21 21:17:21.016328 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 923/1878] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:20 2022] GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 1308 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:21.019681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6a2ee872-ae4f-4f51-a344-d9b234faa43c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:21.019681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6a2ee872-ae4f-4f51-a344-d9b234faa43c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:21.019681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6a2ee872-ae4f-4f51-a344-d9b234faa43c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:21.019681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6a2ee872-ae4f-4f51-a344-d9b234faa43c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:21.019681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6a2ee872-ae4f-4f51-a344-d9b234faa43c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:21.019681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6a2ee872-ae4f-4f51-a344-d9b234faa43c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:21.130337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=10 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:21.146374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e3ef7553-eda2-4c5d-a5ba-8f90b8525ba2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:21.147009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e3ef7553-eda2-4c5d-a5ba-8f90b8525ba2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:21.158879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3ef7553-eda2-4c5d-a5ba-8f90b8525ba2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:21.167182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3ef7553-eda2-4c5d-a5ba-8f90b8525ba2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:21.167182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3ef7553-eda2-4c5d-a5ba-8f90b8525ba2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:21.167182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3ef7553-eda2-4c5d-a5ba-8f90b8525ba2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:21.246948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6a2ee872-ae4f-4f51-a344-d9b234faa43c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:21.258244 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6a2ee872-ae4f-4f51-a344-d9b234faa43c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1315 microversion: 2.1 time: 0.381017 May 21 21:17:21.259331 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 956/1879] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:20 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:21.378407 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7caee777-1acc-456f-8ac3-b12207b431d7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:21.380495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7caee777-1acc-456f-8ac3-b12207b431d7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:21.387948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7caee777-1acc-456f-8ac3-b12207b431d7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:21.391142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7caee777-1acc-456f-8ac3-b12207b431d7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:21.392490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7caee777-1acc-456f-8ac3-b12207b431d7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:21.397083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7caee777-1acc-456f-8ac3-b12207b431d7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:21.855770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7caee777-1acc-456f-8ac3-b12207b431d7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:21.866994 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7caee777-1acc-456f-8ac3-b12207b431d7 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1392 microversion: 2.1 time: 0.492424 May 21 21:17:21.867595 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 957/1880] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:21 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1392 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:17:21.874316 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-d4395229-aa2d-4a46-a953-5936627f27fb req-a28a8b96-7fc1-432e-a478-1bc75cee4ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9930871-f204-4368-a581-87d1b5ed7415", "tag": "e06f96d3-fb3e-437a-8744-1f10e131cd8c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:21.888935 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d4395229-aa2d-4a46-a953-5936627f27fb req-a28a8b96-7fc1-432e-a478-1bc75cee4ac5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:21.888935 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d4395229-aa2d-4a46-a953-5936627f27fb req-a28a8b96-7fc1-432e-a478-1bc75cee4ac5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:21.900415 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-d4395229-aa2d-4a46-a953-5936627f27fb req-a28a8b96-7fc1-432e-a478-1bc75cee4ac5 service nova] Creating event network-changed:e06f96d3-fb3e-437a-8744-1f10e131cd8c for instance b9930871-f204-4368-a581-87d1b5ed7415 on nch2-master-1 May 21 21:17:21.906023 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-d4395229-aa2d-4a46-a953-5936627f27fb req-a28a8b96-7fc1-432e-a478-1bc75cee4ac5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035221 May 21 21:17:21.907381 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 958/1881] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:21.914662 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b9473e32-13d0-476c-901f-dd8b0d87a6da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:21.917098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b9473e32-13d0-476c-901f-dd8b0d87a6da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:21.924536 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b9473e32-13d0-476c-901f-dd8b0d87a6da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:21.925061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b9473e32-13d0-476c-901f-dd8b0d87a6da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:21.925859 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b9473e32-13d0-476c-901f-dd8b0d87a6da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:21.926593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b9473e32-13d0-476c-901f-dd8b0d87a6da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:22.000334 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e3ef7553-eda2-4c5d-a5ba-8f90b8525ba2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:22.014420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e3ef7553-eda2-4c5d-a5ba-8f90b8525ba2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:22.023259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e3ef7553-eda2-4c5d-a5ba-8f90b8525ba2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:22.026122 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e3ef7553-eda2-4c5d-a5ba-8f90b8525ba2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.883735 May 21 21:17:22.027547 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 924/1882] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:21 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:22.278079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cb6b94cb-4de8-4837-bb38-3c0a60f2dfd2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:22.279761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cb6b94cb-4de8-4837-bb38-3c0a60f2dfd2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:22.289770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb6b94cb-4de8-4837-bb38-3c0a60f2dfd2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:22.290615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb6b94cb-4de8-4837-bb38-3c0a60f2dfd2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:22.291674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb6b94cb-4de8-4837-bb38-3c0a60f2dfd2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:22.292380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb6b94cb-4de8-4837-bb38-3c0a60f2dfd2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:22.356519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b9473e32-13d0-476c-901f-dd8b0d87a6da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:22.374090 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b9473e32-13d0-476c-901f-dd8b0d87a6da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 200 len: 1308 microversion: 2.1 time: 0.464798 May 21 21:17:22.389359 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 959/1883] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:21 2022] GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 1308 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:22.575262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cb6b94cb-4de8-4837-bb38-3c0a60f2dfd2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:22.584545 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cb6b94cb-4de8-4837-bb38-3c0a60f2dfd2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1315 microversion: 2.1 time: 0.312648 May 21 21:17:22.585496 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 925/1884] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:22 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:22.884702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-31426a7a-b167-48b9-b156-099e062ea9ca tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:22.885393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-31426a7a-b167-48b9-b156-099e062ea9ca tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:22.892808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31426a7a-b167-48b9-b156-099e062ea9ca tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:22.893846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31426a7a-b167-48b9-b156-099e062ea9ca tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:22.894931 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31426a7a-b167-48b9-b156-099e062ea9ca tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:22.896108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31426a7a-b167-48b9-b156-099e062ea9ca tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:23.047091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-86c22415-5a4a-41c6-83bd-86d004dfa33e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:23.047793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-86c22415-5a4a-41c6-83bd-86d004dfa33e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:23.069507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86c22415-5a4a-41c6-83bd-86d004dfa33e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:23.070999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86c22415-5a4a-41c6-83bd-86d004dfa33e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:23.081350 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86c22415-5a4a-41c6-83bd-86d004dfa33e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:23.083211 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86c22415-5a4a-41c6-83bd-86d004dfa33e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:23.272895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-31426a7a-b167-48b9-b156-099e062ea9ca tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:23.294626 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-31426a7a-b167-48b9-b156-099e062ea9ca tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1392 microversion: 2.1 time: 0.413516 May 21 21:17:23.299905 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 960/1885] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:22 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1392 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:23.403837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c92111a6-1ec4-4c6a-b29e-0e707591edab tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:23.406906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c92111a6-1ec4-4c6a-b29e-0e707591edab tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:23.433321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c92111a6-1ec4-4c6a-b29e-0e707591edab tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:23.438895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c92111a6-1ec4-4c6a-b29e-0e707591edab tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:23.439300 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c92111a6-1ec4-4c6a-b29e-0e707591edab tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:23.439643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c92111a6-1ec4-4c6a-b29e-0e707591edab tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:23.824426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c92111a6-1ec4-4c6a-b29e-0e707591edab tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:23.833790 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c92111a6-1ec4-4c6a-b29e-0e707591edab tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 200 len: 1308 microversion: 2.1 time: 0.441782 May 21 21:17:23.834203 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 961/1886] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:23 2022] GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 1308 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:17:23.841446 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1dbff573-fc78-4143-944f-e7a6e8752e52 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:23.842368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1dbff573-fc78-4143-944f-e7a6e8752e52 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:23.858489 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dbff573-fc78-4143-944f-e7a6e8752e52 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:23.859230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dbff573-fc78-4143-944f-e7a6e8752e52 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:23.860307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dbff573-fc78-4143-944f-e7a6e8752e52 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:23.864479 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dbff573-fc78-4143-944f-e7a6e8752e52 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:23.878824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-86c22415-5a4a-41c6-83bd-86d004dfa33e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:23.900611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-86c22415-5a4a-41c6-83bd-86d004dfa33e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:23.902972 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-86c22415-5a4a-41c6-83bd-86d004dfa33e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:23.905683 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-86c22415-5a4a-41c6-83bd-86d004dfa33e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.862623 May 21 21:17:23.915137 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 926/1887] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:23 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:17:23.934166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-7c22e967-4d09-49c5-b59f-fc2b2a4b955c req-7c4cc0e0-eeb7-425c-9b74-c23835303d98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f6d21d5-3dbc-4822-8d28-42303d1aed09", "tag": "126915c9-8f67-4466-beb6-855ec5fde31b"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:23.950503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-7c22e967-4d09-49c5-b59f-fc2b2a4b955c req-7c4cc0e0-eeb7-425c-9b74-c23835303d98 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:23.950954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-7c22e967-4d09-49c5-b59f-fc2b2a4b955c req-7c4cc0e0-eeb7-425c-9b74-c23835303d98 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:23.989929 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-7c22e967-4d09-49c5-b59f-fc2b2a4b955c req-7c4cc0e0-eeb7-425c-9b74-c23835303d98 service nova] Creating event network-changed:126915c9-8f67-4466-beb6-855ec5fde31b for instance 3f6d21d5-3dbc-4822-8d28-42303d1aed09 on nch2-master-1 May 21 21:17:23.995717 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-7c22e967-4d09-49c5-b59f-fc2b2a4b955c req-7c4cc0e0-eeb7-425c-9b74-c23835303d98 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065790 May 21 21:17:23.996946 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 927/1888] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:17:24.245694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1dbff573-fc78-4143-944f-e7a6e8752e52 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:24.249163 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1dbff573-fc78-4143-944f-e7a6e8752e52 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1315 microversion: 2.1 time: 0.411418 May 21 21:17:24.249787 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 962/1889] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:23 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:24.314855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-99fa67f3-5fa8-4c9d-8cf4-33a124eab6b5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:24.315884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-99fa67f3-5fa8-4c9d-8cf4-33a124eab6b5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:24.363217 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99fa67f3-5fa8-4c9d-8cf4-33a124eab6b5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:24.363685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99fa67f3-5fa8-4c9d-8cf4-33a124eab6b5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:24.365040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99fa67f3-5fa8-4c9d-8cf4-33a124eab6b5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:24.365040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99fa67f3-5fa8-4c9d-8cf4-33a124eab6b5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:24.853008 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1e7923ea-2e25-451f-bd84-f6c6f58e9004 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:24.854218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1e7923ea-2e25-451f-bd84-f6c6f58e9004 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:24.868956 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1e7923ea-2e25-451f-bd84-f6c6f58e9004 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:24.869331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1e7923ea-2e25-451f-bd84-f6c6f58e9004 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:24.874951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1e7923ea-2e25-451f-bd84-f6c6f58e9004 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:24.875461 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1e7923ea-2e25-451f-bd84-f6c6f58e9004 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:24.894049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-99fa67f3-5fa8-4c9d-8cf4-33a124eab6b5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:24.915819 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-99fa67f3-5fa8-4c9d-8cf4-33a124eab6b5 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1392 microversion: 2.1 time: 0.605944 May 21 21:17:24.917034 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 928/1890] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:24 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1392 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:24.931403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cbaf2e7d-3527-4753-a80e-84310428fdc8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:24.932192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cbaf2e7d-3527-4753-a80e-84310428fdc8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:24.941730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbaf2e7d-3527-4753-a80e-84310428fdc8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:24.943695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbaf2e7d-3527-4753-a80e-84310428fdc8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:24.944947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbaf2e7d-3527-4753-a80e-84310428fdc8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:24.945611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbaf2e7d-3527-4753-a80e-84310428fdc8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:25.122590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1e7923ea-2e25-451f-bd84-f6c6f58e9004 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:25.131923 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1e7923ea-2e25-451f-bd84-f6c6f58e9004 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 200 len: 1308 microversion: 2.1 time: 0.286172 May 21 21:17:25.134124 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 963/1891] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:24 2022] GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 1308 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:25.149245 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cbaf2e7d-3527-4753-a80e-84310428fdc8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:25.158600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cbaf2e7d-3527-4753-a80e-84310428fdc8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:25.160416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cbaf2e7d-3527-4753-a80e-84310428fdc8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:25.165969 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cbaf2e7d-3527-4753-a80e-84310428fdc8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.239736 May 21 21:17:25.165969 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 929/1892] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:24 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:17:25.274057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a633c3dd-8742-4d58-a71c-554c97938064 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:25.275030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a633c3dd-8742-4d58-a71c-554c97938064 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:25.283793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a633c3dd-8742-4d58-a71c-554c97938064 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:25.284752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a633c3dd-8742-4d58-a71c-554c97938064 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:25.288556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a633c3dd-8742-4d58-a71c-554c97938064 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:25.289366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a633c3dd-8742-4d58-a71c-554c97938064 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:25.564101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a633c3dd-8742-4d58-a71c-554c97938064 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:25.573690 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a633c3dd-8742-4d58-a71c-554c97938064 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1315 microversion: 2.1 time: 0.305057 May 21 21:17:25.575466 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 964/1893] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:25 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:25.937058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-de34c186-78af-4441-86e9-657ed80d9f3a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:25.938394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-de34c186-78af-4441-86e9-657ed80d9f3a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:25.949799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de34c186-78af-4441-86e9-657ed80d9f3a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:25.954736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de34c186-78af-4441-86e9-657ed80d9f3a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:25.956473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de34c186-78af-4441-86e9-657ed80d9f3a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:25.957479 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de34c186-78af-4441-86e9-657ed80d9f3a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:26.251876 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e7f7d5e7-5f64-4bf0-a997-ce08c3ee452c tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] Action: 'update', calling method: .version_select at 0x7fc81bb9c4c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:26.334799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-de34c186-78af-4441-86e9-657ed80d9f3a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:26.360656 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-de34c186-78af-4441-86e9-657ed80d9f3a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1392 microversion: 2.1 time: 0.427849 May 21 21:17:26.361293 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7f7d5e7-5f64-4bf0-a997-ce08c3ee452c tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:26.371046 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 930/1894] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:25 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1392 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:26.373950 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7f7d5e7-5f64-4bf0-a997-ce08c3ee452c tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:26.375161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7f7d5e7-5f64-4bf0-a997-ce08c3ee452c tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:26.378983 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-00c5329e-8629-4062-896b-326b9576ce90 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:26.380494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7f7d5e7-5f64-4bf0-a997-ce08c3ee452c tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:26.384787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-00c5329e-8629-4062-896b-326b9576ce90 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:26.391467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00c5329e-8629-4062-896b-326b9576ce90 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:26.393234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00c5329e-8629-4062-896b-326b9576ce90 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:26.394512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00c5329e-8629-4062-896b-326b9576ce90 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:26.397987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00c5329e-8629-4062-896b-326b9576ce90 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:26.519389 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e7f7d5e7-5f64-4bf0-a997-ce08c3ee452c tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/582b943341ff470cbe008cffd715b86c" status: 200 len: 148 microversion: 2.57 time: 0.448067 May 21 21:17:26.520042 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 965/1895] 10.222.0.49 () {62 vars in 1302 bytes} [Sat May 21 21:17:26 2022] PUT /compute/v2.1/os-quota-sets/582b943341ff470cbe008cffd715b86c => generated 148 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:17:26.525128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ce854edb-98ca-47cb-a0df-b520d74d3e92 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:26.525967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ce854edb-98ca-47cb-a0df-b520d74d3e92 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:26.533295 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce854edb-98ca-47cb-a0df-b520d74d3e92 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:26.534268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce854edb-98ca-47cb-a0df-b520d74d3e92 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:26.535246 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce854edb-98ca-47cb-a0df-b520d74d3e92 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:26.536457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce854edb-98ca-47cb-a0df-b520d74d3e92 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:26.642125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-00c5329e-8629-4062-896b-326b9576ce90 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:26.654498 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-00c5329e-8629-4062-896b-326b9576ce90 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 200 len: 1308 microversion: 2.1 time: 0.280915 May 21 21:17:26.664702 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 931/1896] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:26 2022] GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 1308 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:26.669871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6d3efa48-d989-4755-94dd-fed2e1f97337 tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] Calling method '.version_select at 0x7fc81b70d700>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:26.769920 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d3efa48-d989-4755-94dd-fed2e1f97337 tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:26.770741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d3efa48-d989-4755-94dd-fed2e1f97337 tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:26.773098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d3efa48-d989-4755-94dd-fed2e1f97337 tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:26.775206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d3efa48-d989-4755-94dd-fed2e1f97337 tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:26.797395 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6d3efa48-d989-4755-94dd-fed2e1f97337 tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/582b943341ff470cbe008cffd715b86c/detail" status: 200 len: 463 microversion: 2.57 time: 0.131209 May 21 21:17:26.805520 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 932/1897] 10.222.0.49 () {60 vars in 1303 bytes} [Sat May 21 21:17:26 2022] GET /compute/v2.1/os-quota-sets/582b943341ff470cbe008cffd715b86c/detail => generated 463 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:17:26.805520 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1038eabf-cd13-441a-a07d-52d7701cd473 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:26.805520 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1038eabf-cd13-441a-a07d-52d7701cd473 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:26.810957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1038eabf-cd13-441a-a07d-52d7701cd473 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:26.811410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1038eabf-cd13-441a-a07d-52d7701cd473 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:26.812243 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1038eabf-cd13-441a-a07d-52d7701cd473 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:26.812736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1038eabf-cd13-441a-a07d-52d7701cd473 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:26.953672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ce854edb-98ca-47cb-a0df-b520d74d3e92 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:26.974486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ce854edb-98ca-47cb-a0df-b520d74d3e92 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:26.976342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ce854edb-98ca-47cb-a0df-b520d74d3e92 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:26.978357 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ce854edb-98ca-47cb-a0df-b520d74d3e92 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.457132 May 21 21:17:26.980009 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 966/1898] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:26 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:26.999657 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1038eabf-cd13-441a-a07d-52d7701cd473 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:27.003482 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1038eabf-cd13-441a-a07d-52d7701cd473 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1315 microversion: 2.1 time: 0.204446 May 21 21:17:27.008861 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 933/1899] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:26 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:27.076969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ee38e29f-cef3-4776-be66-38654884dc20 tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] Action: 'update', calling method: .version_select at 0x7fc82d0d0040>, body: {"quota_set": {"ram": "2048"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:27.156148 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee38e29f-cef3-4776-be66-38654884dc20 tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:27.156740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee38e29f-cef3-4776-be66-38654884dc20 tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:27.157840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee38e29f-cef3-4776-be66-38654884dc20 tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:27.158638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee38e29f-cef3-4776-be66-38654884dc20 tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:27.206769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee38e29f-cef3-4776-be66-38654884dc20 tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:27.208031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee38e29f-cef3-4776-be66-38654884dc20 tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:27.209318 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee38e29f-cef3-4776-be66-38654884dc20 tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:27.209875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee38e29f-cef3-4776-be66-38654884dc20 tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:27.236106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:27.379074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-deeab498-702c-4523-a3f8-ead8408929a0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:27.380296 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-deeab498-702c-4523-a3f8-ead8408929a0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:27.390552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-deeab498-702c-4523-a3f8-ead8408929a0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:27.398072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-deeab498-702c-4523-a3f8-ead8408929a0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:27.398072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-deeab498-702c-4523-a3f8-ead8408929a0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:27.398072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-deeab498-702c-4523-a3f8-ead8408929a0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:27.409653 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ee38e29f-cef3-4776-be66-38654884dc20 tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/582b943341ff470cbe008cffd715b86c?user_id=180c259487cb42b9937cdbce71bd09ff" status: 200 len: 148 microversion: 2.57 time: 0.336406 May 21 21:17:27.412070 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 967/1900] 10.222.0.49 () {62 vars in 1383 bytes} [Sat May 21 21:17:27 2022] PUT /compute/v2.1/os-quota-sets/582b943341ff470cbe008cffd715b86c?user_id=180c259487cb42b9937cdbce71bd09ff => generated 148 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:17:27.423239 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6459a5da-7526-4c6c-a81c-595a3518c545 tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] Calling method '.version_select at 0x7fc82d0cea60>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:27.522333 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6459a5da-7526-4c6c-a81c-595a3518c545 tempest-QuotasAdminTestV257-402777106 tempest-QuotasAdminTestV257-402777106-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/582b943341ff470cbe008cffd715b86c?user_id=180c259487cb42b9937cdbce71bd09ff" status: 200 len: 190 microversion: 2.57 time: 0.104167 May 21 21:17:27.530107 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 968/1901] 10.222.0.49 () {60 vars in 1363 bytes} [Sat May 21 21:17:27 2022] GET /compute/v2.1/os-quota-sets/582b943341ff470cbe008cffd715b86c?user_id=180c259487cb42b9937cdbce71bd09ff => generated 190 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:17:27.575223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-deeab498-702c-4523-a3f8-ead8408929a0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:27.585295 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-deeab498-702c-4523-a3f8-ead8408929a0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1392 microversion: 2.1 time: 0.210061 May 21 21:17:27.594988 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 934/1902] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:27 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1392 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:27.671496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9edddde6-8575-4a2a-9090-88b006ab7e33 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:27.681908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9edddde6-8575-4a2a-9090-88b006ab7e33 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:27.681908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9edddde6-8575-4a2a-9090-88b006ab7e33 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:27.681908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9edddde6-8575-4a2a-9090-88b006ab7e33 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:27.681908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9edddde6-8575-4a2a-9090-88b006ab7e33 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:27.681908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9edddde6-8575-4a2a-9090-88b006ab7e33 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:27.702161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:27.907603 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9edddde6-8575-4a2a-9090-88b006ab7e33 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:27.916635 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9edddde6-8575-4a2a-9090-88b006ab7e33 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 200 len: 1308 microversion: 2.1 time: 0.249278 May 21 21:17:27.917222 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 969/1903] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:27 2022] GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 1308 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:27.997749 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9c322f21-afad-43a9-b215-da583a12e150 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:27.998553 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9c322f21-afad-43a9-b215-da583a12e150 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:28.023170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f3a80306-909d-4a79-b453-72912665b4af tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:28.024993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f3a80306-909d-4a79-b453-72912665b4af tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:28.030659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c322f21-afad-43a9-b215-da583a12e150 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:28.031187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c322f21-afad-43a9-b215-da583a12e150 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:28.035663 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3a80306-909d-4a79-b453-72912665b4af tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:28.036132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3a80306-909d-4a79-b453-72912665b4af tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:28.037236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3a80306-909d-4a79-b453-72912665b4af tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:28.037683 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3a80306-909d-4a79-b453-72912665b4af tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:28.039101 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c322f21-afad-43a9-b215-da583a12e150 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:28.040634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c322f21-afad-43a9-b215-da583a12e150 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:28.329827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9c322f21-afad-43a9-b215-da583a12e150 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:28.354746 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9c322f21-afad-43a9-b215-da583a12e150 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:28.358718 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9c322f21-afad-43a9-b215-da583a12e150 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:28.360770 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9c322f21-afad-43a9-b215-da583a12e150 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.366850 May 21 21:17:28.374129 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 935/1904] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:27 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:28.401126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f3a80306-909d-4a79-b453-72912665b4af tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:28.410145 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f3a80306-909d-4a79-b453-72912665b4af tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1315 microversion: 2.1 time: 0.392732 May 21 21:17:28.420389 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 970/1905] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:28 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:28.602785 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-536198bf-381b-46af-a9f4-9efa28a4c070 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:28.603836 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-536198bf-381b-46af-a9f4-9efa28a4c070 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:28.611391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-536198bf-381b-46af-a9f4-9efa28a4c070 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:28.612135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-536198bf-381b-46af-a9f4-9efa28a4c070 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:28.613390 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-536198bf-381b-46af-a9f4-9efa28a4c070 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:28.614798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-536198bf-381b-46af-a9f4-9efa28a4c070 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:28.832146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-536198bf-381b-46af-a9f4-9efa28a4c070 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:28.841007 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-536198bf-381b-46af-a9f4-9efa28a4c070 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1392 microversion: 2.1 time: 0.242114 May 21 21:17:28.852168 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 936/1906] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:28 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1392 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:28.935631 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0a5a94e4-2927-4e8b-a8c8-9abaa32bc426 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:28.937306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0a5a94e4-2927-4e8b-a8c8-9abaa32bc426 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:28.947671 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a5a94e4-2927-4e8b-a8c8-9abaa32bc426 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:28.949986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a5a94e4-2927-4e8b-a8c8-9abaa32bc426 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:28.951261 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a5a94e4-2927-4e8b-a8c8-9abaa32bc426 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:28.952101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a5a94e4-2927-4e8b-a8c8-9abaa32bc426 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:29.179876 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0a5a94e4-2927-4e8b-a8c8-9abaa32bc426 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:29.189073 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0a5a94e4-2927-4e8b-a8c8-9abaa32bc426 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 200 len: 1308 microversion: 2.1 time: 0.258949 May 21 21:17:29.198926 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 971/1907] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:28 2022] GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 1308 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:29.381594 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5ea76603-2911-46a7-9394-5f4ddd696db7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:29.390309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5ea76603-2911-46a7-9394-5f4ddd696db7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:29.429678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b7455b61-5396-4fe6-b201-74281b1c9689 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:29.434486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b7455b61-5396-4fe6-b201-74281b1c9689 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:29.434636 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ea76603-2911-46a7-9394-5f4ddd696db7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:29.434771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ea76603-2911-46a7-9394-5f4ddd696db7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:29.435603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ea76603-2911-46a7-9394-5f4ddd696db7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:29.436056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ea76603-2911-46a7-9394-5f4ddd696db7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:29.454034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7455b61-5396-4fe6-b201-74281b1c9689 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:29.457790 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7455b61-5396-4fe6-b201-74281b1c9689 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:29.457790 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7455b61-5396-4fe6-b201-74281b1c9689 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:29.457790 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7455b61-5396-4fe6-b201-74281b1c9689 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:29.779462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5ea76603-2911-46a7-9394-5f4ddd696db7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:29.791761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5ea76603-2911-46a7-9394-5f4ddd696db7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:29.793935 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5ea76603-2911-46a7-9394-5f4ddd696db7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:29.800926 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5ea76603-2911-46a7-9394-5f4ddd696db7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.423926 May 21 21:17:29.813874 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 937/1908] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:29 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:29.831322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d0be6904-362e-4336-90e0-2de53c0568a3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-503495208", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "7d36d878-1b46-444e-9b7c-4ece5d08cf06"}, {"uuid": "edf91580-1317-44d6-8392-2dcca81794d9"}, {"uuid": "7d36d878-1b46-444e-9b7c-4ece5d08cf06"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:29.958937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-d0be6904-362e-4336-90e0-2de53c0568a3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] validate_networks() for [('7d36d878-1b46-444e-9b7c-4ece5d08cf06', None, None, None, None, None), ('edf91580-1317-44d6-8392-2dcca81794d9', None, None, None, None, None), ('7d36d878-1b46-444e-9b7c-4ece5d08cf06', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:17:30.106413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b7455b61-5396-4fe6-b201-74281b1c9689 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:30.119479 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b7455b61-5396-4fe6-b201-74281b1c9689 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1315 microversion: 2.1 time: 0.695022 May 21 21:17:30.121181 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 972/1909] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:29 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:30.134651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-08c6e88e-f0f0-48ad-bf85-6ee5dfab7af4 req-24c7635a-9d06-47c6-9ea7-88e37c116177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9930871-f204-4368-a581-87d1b5ed7415", "name": "network-vif-plugged", "status": "completed", "tag": "e06f96d3-fb3e-437a-8744-1f10e131cd8c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:30.163807 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-08c6e88e-f0f0-48ad-bf85-6ee5dfab7af4 req-24c7635a-9d06-47c6-9ea7-88e37c116177 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:30.164723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-08c6e88e-f0f0-48ad-bf85-6ee5dfab7af4 req-24c7635a-9d06-47c6-9ea7-88e37c116177 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:30.184315 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-08c6e88e-f0f0-48ad-bf85-6ee5dfab7af4 req-24c7635a-9d06-47c6-9ea7-88e37c116177 service nova] Creating event network-vif-plugged:e06f96d3-fb3e-437a-8744-1f10e131cd8c for instance b9930871-f204-4368-a581-87d1b5ed7415 on nch2-master-1 May 21 21:17:30.224455 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-08c6e88e-f0f0-48ad-bf85-6ee5dfab7af4 req-24c7635a-9d06-47c6-9ea7-88e37c116177 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089534 May 21 21:17:30.230358 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 973/1910] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:30.242666 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-134b5d47-6f30-4655-a216-3e963dc076bd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:30.244060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-134b5d47-6f30-4655-a216-3e963dc076bd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:30.260252 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-134b5d47-6f30-4655-a216-3e963dc076bd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:30.261378 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-134b5d47-6f30-4655-a216-3e963dc076bd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:30.279379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-134b5d47-6f30-4655-a216-3e963dc076bd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:30.280438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-134b5d47-6f30-4655-a216-3e963dc076bd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:30.846122 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-134b5d47-6f30-4655-a216-3e963dc076bd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:30.856854 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-134b5d47-6f30-4655-a216-3e963dc076bd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1392 microversion: 2.1 time: 0.628709 May 21 21:17:30.869307 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 974/1911] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:30 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1392 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:30.875396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ab269674-0cc8-4973-a49c-f5c4c4817902 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:30.876497 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ab269674-0cc8-4973-a49c-f5c4c4817902 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:30.902180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab269674-0cc8-4973-a49c-f5c4c4817902 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:30.902305 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab269674-0cc8-4973-a49c-f5c4c4817902 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:30.903130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab269674-0cc8-4973-a49c-f5c4c4817902 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:30.903641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab269674-0cc8-4973-a49c-f5c4c4817902 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:31.176843 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ab269674-0cc8-4973-a49c-f5c4c4817902 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:31.186599 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ab269674-0cc8-4973-a49c-f5c4c4817902 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 200 len: 1308 microversion: 2.1 time: 0.315804 May 21 21:17:31.187271 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 975/1912] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:30 2022] GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 1308 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:31.205293 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d08e5bfa-0eaa-49bc-829d-a98c3ecd9190 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:31.206293 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d08e5bfa-0eaa-49bc-829d-a98c3ecd9190 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:31.213823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d08e5bfa-0eaa-49bc-829d-a98c3ecd9190 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:31.214085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d08e5bfa-0eaa-49bc-829d-a98c3ecd9190 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:31.215239 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d08e5bfa-0eaa-49bc-829d-a98c3ecd9190 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:31.215848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d08e5bfa-0eaa-49bc-829d-a98c3ecd9190 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:31.504340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d08e5bfa-0eaa-49bc-829d-a98c3ecd9190 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:31.515561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d08e5bfa-0eaa-49bc-829d-a98c3ecd9190 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:31.522907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d08e5bfa-0eaa-49bc-829d-a98c3ecd9190 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:31.524707 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d08e5bfa-0eaa-49bc-829d-a98c3ecd9190 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.336178 May 21 21:17:31.525281 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 976/1913] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:31 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:31.540977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b0f77f4d-5e43-417d-b3f7-070d9cee4dac tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:31.544260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b0f77f4d-5e43-417d-b3f7-070d9cee4dac tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:31.558098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0f77f4d-5e43-417d-b3f7-070d9cee4dac tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:31.558910 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0f77f4d-5e43-417d-b3f7-070d9cee4dac tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:31.559909 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0f77f4d-5e43-417d-b3f7-070d9cee4dac tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:31.560600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0f77f4d-5e43-417d-b3f7-070d9cee4dac tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:31.682336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d0be6904-362e-4336-90e0-2de53c0568a3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:17:31.682850 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d0be6904-362e-4336-90e0-2de53c0568a3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:17:31.686313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d0be6904-362e-4336-90e0-2de53c0568a3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:17:31.686313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d0be6904-362e-4336-90e0-2de53c0568a3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:17:31.686313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d0be6904-362e-4336-90e0-2de53c0568a3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:17:31.698367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0be6904-362e-4336-90e0-2de53c0568a3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:31.698824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0be6904-362e-4336-90e0-2de53c0568a3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:31.699644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0be6904-362e-4336-90e0-2de53c0568a3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:31.700091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0be6904-362e-4336-90e0-2de53c0568a3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:31.742486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-d0be6904-362e-4336-90e0-2de53c0568a3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Getting quotas for project a97fa11e94da4e72a9a955f8324c2d5e. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:17:31.750968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-d0be6904-362e-4336-90e0-2de53c0568a3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Getting quotas for user 569660c20b044f1aa2df5bdfed1d833c and project a97fa11e94da4e72a9a955f8324c2d5e. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:17:31.766793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d0be6904-362e-4336-90e0-2de53c0568a3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:17:31.769423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d0be6904-362e-4336-90e0-2de53c0568a3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:17:31.781457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b0f77f4d-5e43-417d-b3f7-070d9cee4dac tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:31.794241 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b0f77f4d-5e43-417d-b3f7-070d9cee4dac tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1315 microversion: 2.1 time: 0.265472 May 21 21:17:31.794837 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 977/1914] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:31 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:31.877013 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f96e529e-fae5-4619-8312-f12901be8c1d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:31.877669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f96e529e-fae5-4619-8312-f12901be8c1d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:31.902069 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f96e529e-fae5-4619-8312-f12901be8c1d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:31.902551 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f96e529e-fae5-4619-8312-f12901be8c1d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:31.903345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f96e529e-fae5-4619-8312-f12901be8c1d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:31.904007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f96e529e-fae5-4619-8312-f12901be8c1d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:31.937269 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d0be6904-362e-4336-90e0-2de53c0568a3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.121757 May 21 21:17:31.960542 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 938/1915] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:17:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:17:31.980448 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2b75d7cf-aae9-462e-a384-a3b058bd19b3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:31.982533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2b75d7cf-aae9-462e-a384-a3b058bd19b3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:32.228263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2b75d7cf-aae9-462e-a384-a3b058bd19b3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:32.236196 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2b75d7cf-aae9-462e-a384-a3b058bd19b3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1212 microversion: 2.1 time: 0.273801 May 21 21:17:32.248213 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 939/1916] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:31 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1212 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:32.260630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0ce0e8b4-e9c4-4dc3-a099-9a81e74c435b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:32.261266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0ce0e8b4-e9c4-4dc3-a099-9a81e74c435b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:32.279603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ce0e8b4-e9c4-4dc3-a099-9a81e74c435b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:32.280072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ce0e8b4-e9c4-4dc3-a099-9a81e74c435b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:32.280955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ce0e8b4-e9c4-4dc3-a099-9a81e74c435b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:32.280955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ce0e8b4-e9c4-4dc3-a099-9a81e74c435b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:32.330048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:32.363690 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f96e529e-fae5-4619-8312-f12901be8c1d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:32.381148 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f96e529e-fae5-4619-8312-f12901be8c1d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1392 microversion: 2.1 time: 0.507864 May 21 21:17:32.383172 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 978/1917] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:31 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1392 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:17:32.499423 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-985023419", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d6f1bd34-2e61-4291-a1ae-24d42ac0463b"}], "security_groups": [{"name": "tempest-securitygroup--686031296"}], "key_name": "tempest-keypair-231693768", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "a5550cbf-3582-4751-9f41-ccd248d7de61", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:32.695565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] validate_networks() for [('d6f1bd34-2e61-4291-a1ae-24d42ac0463b', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:17:32.841648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0ce0e8b4-e9c4-4dc3-a099-9a81e74c435b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:32.854563 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0ce0e8b4-e9c4-4dc3-a099-9a81e74c435b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 200 len: 1308 microversion: 2.1 time: 0.605060 May 21 21:17:32.856369 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 940/1918] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:32 2022] GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 1308 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:32.867457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-71ebecc6-c91f-4b93-b02e-14299c38a89f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:32.869029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-71ebecc6-c91f-4b93-b02e-14299c38a89f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:32.927642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71ebecc6-c91f-4b93-b02e-14299c38a89f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:32.929186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71ebecc6-c91f-4b93-b02e-14299c38a89f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:32.935743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71ebecc6-c91f-4b93-b02e-14299c38a89f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:32.936206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71ebecc6-c91f-4b93-b02e-14299c38a89f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:33.442203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-71ebecc6-c91f-4b93-b02e-14299c38a89f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:33.457406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-71ebecc6-c91f-4b93-b02e-14299c38a89f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:33.459763 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-71ebecc6-c91f-4b93-b02e-14299c38a89f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:33.461229 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-71ebecc6-c91f-4b93-b02e-14299c38a89f tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.604163 May 21 21:17:33.473810 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 941/1919] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:32 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:33.480731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-3219c9f3-ac44-4514-8cc0-ebc6d5d44d3c req-db5ce2fa-4ab0-4a1b-b739-ed4e53547c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f6d21d5-3dbc-4822-8d28-42303d1aed09", "name": "network-vif-plugged", "status": "completed", "tag": "126915c9-8f67-4466-beb6-855ec5fde31b"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:33.496444 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3219c9f3-ac44-4514-8cc0-ebc6d5d44d3c req-db5ce2fa-4ab0-4a1b-b739-ed4e53547c21 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:33.496887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3219c9f3-ac44-4514-8cc0-ebc6d5d44d3c req-db5ce2fa-4ab0-4a1b-b739-ed4e53547c21 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:33.510423 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-3219c9f3-ac44-4514-8cc0-ebc6d5d44d3c req-db5ce2fa-4ab0-4a1b-b739-ed4e53547c21 service nova] Creating event network-vif-plugged:126915c9-8f67-4466-beb6-855ec5fde31b for instance 3f6d21d5-3dbc-4822-8d28-42303d1aed09 on nch2-master-1 May 21 21:17:33.516786 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-3219c9f3-ac44-4514-8cc0-ebc6d5d44d3c req-db5ce2fa-4ab0-4a1b-b739-ed4e53547c21 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040447 May 21 21:17:33.517782 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 942/1920] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:33.524324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9394b780-9ba6-4e85-9737-60e1ad1b2ef7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:33.525635 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9394b780-9ba6-4e85-9737-60e1ad1b2ef7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:33.535067 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9394b780-9ba6-4e85-9737-60e1ad1b2ef7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:33.535994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9394b780-9ba6-4e85-9737-60e1ad1b2ef7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:33.537350 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9394b780-9ba6-4e85-9737-60e1ad1b2ef7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:33.538033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9394b780-9ba6-4e85-9737-60e1ad1b2ef7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:33.895760 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Getting quotas for project 28107ae255f24328bcce84129cec62d4. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:17:33.908861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Getting quotas for user ac2cc0075e654fe2b9ac0fbad3a7c239 and project 28107ae255f24328bcce84129cec62d4. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:17:33.974991 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:17:33.975428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:17:33.975912 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:17:33.976353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:17:33.979392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:17:33.996816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:33.997514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:33.998522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:33.998972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:34.031184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Getting quotas for project 28107ae255f24328bcce84129cec62d4. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:17:34.043167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Getting quotas for user ac2cc0075e654fe2b9ac0fbad3a7c239 and project 28107ae255f24328bcce84129cec62d4. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:17:34.044818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9394b780-9ba6-4e85-9737-60e1ad1b2ef7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:34.062954 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9394b780-9ba6-4e85-9737-60e1ad1b2ef7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1315 microversion: 2.1 time: 0.543769 May 21 21:17:34.063549 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 943/1921] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:33 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:34.069576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-495897e3-84e3-470a-a24b-fbc56062a749 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:34.070414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-495897e3-84e3-470a-a24b-fbc56062a749 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:34.083950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-495897e3-84e3-470a-a24b-fbc56062a749 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:34.085091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-495897e3-84e3-470a-a24b-fbc56062a749 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:34.086281 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-495897e3-84e3-470a-a24b-fbc56062a749 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:34.087067 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-495897e3-84e3-470a-a24b-fbc56062a749 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:34.159614 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:17:34.162475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a5550cbf-3582-4751-9f41-ccd248d7de61',volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:17:34.289301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-495897e3-84e3-470a-a24b-fbc56062a749 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:34.301566 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-495897e3-84e3-470a-a24b-fbc56062a749 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1216 microversion: 2.1 time: 0.234236 May 21 21:17:34.302754 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 944/1922] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:34 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1216 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:34.318456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9531e7c0-14e4-4e2a-81eb-966ebd7e0fb3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:34.319581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9531e7c0-14e4-4e2a-81eb-966ebd7e0fb3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:34.327008 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9531e7c0-14e4-4e2a-81eb-966ebd7e0fb3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:34.333865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9531e7c0-14e4-4e2a-81eb-966ebd7e0fb3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:34.333865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9531e7c0-14e4-4e2a-81eb-966ebd7e0fb3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:34.333865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9531e7c0-14e4-4e2a-81eb-966ebd7e0fb3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:34.698656 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9531e7c0-14e4-4e2a-81eb-966ebd7e0fb3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:34.711133 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9531e7c0-14e4-4e2a-81eb-966ebd7e0fb3 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1382 microversion: 2.1 time: 0.402170 May 21 21:17:34.746987 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 945/1923] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:34 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1382 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:34.750862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8a9dffe7-3cce-4e77-a859-8cadf26c29ee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:34.751558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8a9dffe7-3cce-4e77-a859-8cadf26c29ee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:34.768894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8a9dffe7-3cce-4e77-a859-8cadf26c29ee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:34.770208 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8a9dffe7-3cce-4e77-a859-8cadf26c29ee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:34.771268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8a9dffe7-3cce-4e77-a859-8cadf26c29ee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:34.772181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8a9dffe7-3cce-4e77-a859-8cadf26c29ee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:34.800184 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.309251 May 21 21:17:34.801737 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 979/1924] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:17:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 2312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:17:34.812990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3568e17c-162a-44ee-a7f4-8f0a9671cff9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:34.831458 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3568e17c-162a-44ee-a7f4-8f0a9671cff9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:34.873758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3568e17c-162a-44ee-a7f4-8f0a9671cff9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:34.873758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3568e17c-162a-44ee-a7f4-8f0a9671cff9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:34.879847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3568e17c-162a-44ee-a7f4-8f0a9671cff9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:34.880482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3568e17c-162a-44ee-a7f4-8f0a9671cff9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:35.102367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8a9dffe7-3cce-4e77-a859-8cadf26c29ee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:35.114470 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8a9dffe7-3cce-4e77-a859-8cadf26c29ee tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 200 len: 1488 microversion: 2.1 time: 0.371450 May 21 21:17:35.129596 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 946/1925] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:34 2022] GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 1488 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:35.135813 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-99c31e9e-bbeb-4d17-9da9-f281ac078acf tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '.version_select at 0x7fc81ba1cee0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:35.139392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99c31e9e-bbeb-4d17-9da9-f281ac078acf tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:35.139879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99c31e9e-bbeb-4d17-9da9-f281ac078acf tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:35.161450 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-99c31e9e-bbeb-4d17-9da9-f281ac078acf tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 3085 microversion: 2.1 time: 0.030417 May 21 21:17:35.164877 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 947/1926] 10.222.0.49 () {58 vars in 1142 bytes} [Sat May 21 21:17:35 2022] GET /compute/v2.1/os-migrations => generated 3085 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:35.189321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e2b7961a-cc06-4a6b-88f0-78adb96f7ab6 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:35.190062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e2b7961a-cc06-4a6b-88f0-78adb96f7ab6 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:35.234448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3568e17c-162a-44ee-a7f4-8f0a9671cff9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:35.243675 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3568e17c-162a-44ee-a7f4-8f0a9671cff9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:35.245729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3568e17c-162a-44ee-a7f4-8f0a9671cff9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:35.247130 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3568e17c-162a-44ee-a7f4-8f0a9671cff9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.443879 May 21 21:17:35.248027 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 980/1927] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:34 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:35.252934 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d3866858-3d95-4b2f-9a96-170f02cc9bd5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:35.253554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d3866858-3d95-4b2f-9a96-170f02cc9bd5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:35.266808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3866858-3d95-4b2f-9a96-170f02cc9bd5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:35.267317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3866858-3d95-4b2f-9a96-170f02cc9bd5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:35.268114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3866858-3d95-4b2f-9a96-170f02cc9bd5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:35.268586 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3866858-3d95-4b2f-9a96-170f02cc9bd5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:35.291403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e2b7961a-cc06-4a6b-88f0-78adb96f7ab6 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:35.298081 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e2b7961a-cc06-4a6b-88f0-78adb96f7ab6 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 200 len: 1120 microversion: 2.1 time: 0.131203 May 21 21:17:35.298656 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 948/1928] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:35 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 1120 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:35.310455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6b1f4615-aaa2-46ca-978a-0af589eb68c3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:35.314510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6b1f4615-aaa2-46ca-978a-0af589eb68c3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:35.320923 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b1f4615-aaa2-46ca-978a-0af589eb68c3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:35.321379 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b1f4615-aaa2-46ca-978a-0af589eb68c3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:35.322218 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b1f4615-aaa2-46ca-978a-0af589eb68c3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:35.322667 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b1f4615-aaa2-46ca-978a-0af589eb68c3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:35.359823 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-6b1f4615-aaa2-46ca-978a-0af589eb68c3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lazy-loading 'flavor' on Instance uuid b9930871-f204-4368-a581-87d1b5ed7415 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:17:35.462062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d3866858-3d95-4b2f-9a96-170f02cc9bd5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:35.471062 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d3866858-3d95-4b2f-9a96-170f02cc9bd5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1315 microversion: 2.1 time: 0.221449 May 21 21:17:35.472162 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 981/1929] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:35 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:35.479834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3502df8a-4fe0-4387-ab7f-c86e0de815b7 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:35.481081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3502df8a-4fe0-4387-ab7f-c86e0de815b7 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:35.490170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3502df8a-4fe0-4387-ab7f-c86e0de815b7 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:35.490703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3502df8a-4fe0-4387-ab7f-c86e0de815b7 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:35.491855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3502df8a-4fe0-4387-ab7f-c86e0de815b7 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:35.492440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3502df8a-4fe0-4387-ab7f-c86e0de815b7 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:35.668221 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3502df8a-4fe0-4387-ab7f-c86e0de815b7 tempest-LiveMigrationTest-369289799 tempest-LiveMigrationTest-369289799-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1533 microversion: 2.1 time: 0.194631 May 21 21:17:35.669046 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 982/1930] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:35 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1533 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:35.673654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-50d2a634-fea8-4224-b792-6e7c82beec35 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:35.674396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-50d2a634-fea8-4224-b792-6e7c82beec35 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:35.689811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50d2a634-fea8-4224-b792-6e7c82beec35 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:35.690326 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50d2a634-fea8-4224-b792-6e7c82beec35 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:35.691228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50d2a634-fea8-4224-b792-6e7c82beec35 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:35.692450 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50d2a634-fea8-4224-b792-6e7c82beec35 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:35.746858 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6b1f4615-aaa2-46ca-978a-0af589eb68c3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "POST /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415/action" status: 202 len: 0 microversion: 2.1 time: 0.440147 May 21 21:17:35.751551 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 949/1931] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:17:35 2022] POST /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:17:35.759223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5dbc5b33-5953-414d-a738-d4420b77ddd2 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:35.760091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5dbc5b33-5953-414d-a738-d4420b77ddd2 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:35.768034 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5dbc5b33-5953-414d-a738-d4420b77ddd2 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:35.768525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5dbc5b33-5953-414d-a738-d4420b77ddd2 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:35.769319 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5dbc5b33-5953-414d-a738-d4420b77ddd2 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:35.769810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5dbc5b33-5953-414d-a738-d4420b77ddd2 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:35.772954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-50d2a634-fea8-4224-b792-6e7c82beec35 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:35.780895 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-50d2a634-fea8-4224-b792-6e7c82beec35 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1264 microversion: 2.1 time: 0.110763 May 21 21:17:35.781471 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 983/1932] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:35 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1264 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:35.787066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bc076185-b60a-434f-be42-71f6505a0476 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:35.790570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bc076185-b60a-434f-be42-71f6505a0476 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:35.800434 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5dbc5b33-5953-414d-a738-d4420b77ddd2 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:17:35.801932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bc076185-b60a-434f-be42-71f6505a0476 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:35.802463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bc076185-b60a-434f-be42-71f6505a0476 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:35.803782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bc076185-b60a-434f-be42-71f6505a0476 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:35.804864 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bc076185-b60a-434f-be42-71f6505a0476 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:36.018532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bc076185-b60a-434f-be42-71f6505a0476 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:36.036623 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bc076185-b60a-434f-be42-71f6505a0476 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 200 len: 1496 microversion: 2.1 time: 0.252561 May 21 21:17:36.041491 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 984/1933] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:35 2022] GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 1496 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:36.270139 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2e6e5bd8-de4c-4ae6-88f5-86ab236cdca9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:36.271215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2e6e5bd8-de4c-4ae6-88f5-86ab236cdca9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:36.280728 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2e6e5bd8-de4c-4ae6-88f5-86ab236cdca9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:36.281506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2e6e5bd8-de4c-4ae6-88f5-86ab236cdca9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:36.282462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2e6e5bd8-de4c-4ae6-88f5-86ab236cdca9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:36.282989 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2e6e5bd8-de4c-4ae6-88f5-86ab236cdca9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:36.437899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2e6e5bd8-de4c-4ae6-88f5-86ab236cdca9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:36.446290 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2e6e5bd8-de4c-4ae6-88f5-86ab236cdca9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:36.447838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2e6e5bd8-de4c-4ae6-88f5-86ab236cdca9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:36.449049 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2e6e5bd8-de4c-4ae6-88f5-86ab236cdca9 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.185001 May 21 21:17:36.464663 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 985/1934] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:36 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:36.464663 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-993b0355-26a3-47dc-adcd-79f2381208dc tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:36.464663 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-993b0355-26a3-47dc-adcd-79f2381208dc tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:36.498692 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5dbc5b33-5953-414d-a738-d4420b77ddd2 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 204 len: 0 microversion: 2.1 time: 0.745328 May 21 21:17:36.499279 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 950/1935] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:17:35 2022] DELETE /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:17:36.509567 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-677f6324-4693-44b7-b008-f81a5b7ddb6b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:36.516761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-993b0355-26a3-47dc-adcd-79f2381208dc tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:36.518054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-677f6324-4693-44b7-b008-f81a5b7ddb6b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:36.523683 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-993b0355-26a3-47dc-adcd-79f2381208dc tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 200 len: 1120 microversion: 2.1 time: 0.072965 May 21 21:17:36.524271 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 986/1936] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:36 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 1120 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:36.525339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-677f6324-4693-44b7-b008-f81a5b7ddb6b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:36.525998 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-677f6324-4693-44b7-b008-f81a5b7ddb6b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:36.526924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-677f6324-4693-44b7-b008-f81a5b7ddb6b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:36.527536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-677f6324-4693-44b7-b008-f81a5b7ddb6b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:36.528739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-defbdc12-94af-4652-9482-6a141f95b866 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:36.529352 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-defbdc12-94af-4652-9482-6a141f95b866 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:36.545042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-defbdc12-94af-4652-9482-6a141f95b866 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:36.550457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-defbdc12-94af-4652-9482-6a141f95b866 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:36.550457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-defbdc12-94af-4652-9482-6a141f95b866 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:36.552539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-defbdc12-94af-4652-9482-6a141f95b866 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:36.744994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-defbdc12-94af-4652-9482-6a141f95b866 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:36.752965 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-defbdc12-94af-4652-9482-6a141f95b866 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1388 microversion: 2.1 time: 0.227662 May 21 21:17:36.762613 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 987/1937] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:36 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1388 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:36.798788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3153c3ca-6d9c-4e5c-b6bd-eae9989f9a6b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:36.800519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3153c3ca-6d9c-4e5c-b6bd-eae9989f9a6b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:36.805882 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3153c3ca-6d9c-4e5c-b6bd-eae9989f9a6b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:36.806339 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3153c3ca-6d9c-4e5c-b6bd-eae9989f9a6b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:36.807422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3153c3ca-6d9c-4e5c-b6bd-eae9989f9a6b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:36.807898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3153c3ca-6d9c-4e5c-b6bd-eae9989f9a6b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:36.832828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:36.858863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-677f6324-4693-44b7-b008-f81a5b7ddb6b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:36.870415 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-677f6324-4693-44b7-b008-f81a5b7ddb6b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1502 microversion: 2.1 time: 0.364980 May 21 21:17:36.871237 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 951/1938] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:36 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1502 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:36.897492 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-06778a1a-ef85-45f2-a973-e6806bf6da72 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:36.898008 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-06778a1a-ef85-45f2-a973-e6806bf6da72 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:36.915784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06778a1a-ef85-45f2-a973-e6806bf6da72 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:36.916247 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06778a1a-ef85-45f2-a973-e6806bf6da72 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:36.920146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06778a1a-ef85-45f2-a973-e6806bf6da72 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:36.920627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06778a1a-ef85-45f2-a973-e6806bf6da72 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:36.942659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3153c3ca-6d9c-4e5c-b6bd-eae9989f9a6b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:36.950801 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3153c3ca-6d9c-4e5c-b6bd-eae9989f9a6b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1282 microversion: 2.1 time: 0.155774 May 21 21:17:36.951379 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 988/1939] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:36 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1282 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:36.961489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-06778a1a-ef85-45f2-a973-e6806bf6da72 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:17:37.106179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-528850de-b7f8-440f-814c-7753baa9b75c tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Calling method '.version_select at 0x7fc81b6b09d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:37.226720 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-06778a1a-ef85-45f2-a973-e6806bf6da72 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 204 len: 0 microversion: 2.1 time: 0.338613 May 21 21:17:37.231047 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 952/1940] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:17:36 2022] DELETE /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:17:37.234600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-45ea6db1-1338-43b3-9781-83fcbf79663a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:37.236694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-45ea6db1-1338-43b3-9781-83fcbf79663a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:37.242686 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-528850de-b7f8-440f-814c-7753baa9b75c tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/6c0cd10bfccf46b08cc9560172be4102" status: 200 len: 371 microversion: 2.1 time: 0.283955 May 21 21:17:37.243759 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 989/1941] 10.222.0.49 () {58 vars in 1241 bytes} [Sat May 21 21:17:36 2022] GET /compute/v2.1/os-quota-sets/6c0cd10bfccf46b08cc9560172be4102 => generated 371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:37.249510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-45ea6db1-1338-43b3-9781-83fcbf79663a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:37.249510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-45ea6db1-1338-43b3-9781-83fcbf79663a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:37.249510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-45ea6db1-1338-43b3-9781-83fcbf79663a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:37.249510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-45ea6db1-1338-43b3-9781-83fcbf79663a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:37.250936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2867ae93-4f4b-4b59-bf8a-e06eddda544e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:37.251743 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2867ae93-4f4b-4b59-bf8a-e06eddda544e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:37.261720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2867ae93-4f4b-4b59-bf8a-e06eddda544e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:37.264624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2867ae93-4f4b-4b59-bf8a-e06eddda544e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:37.264624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2867ae93-4f4b-4b59-bf8a-e06eddda544e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:37.264624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2867ae93-4f4b-4b59-bf8a-e06eddda544e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:37.520218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2867ae93-4f4b-4b59-bf8a-e06eddda544e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:37.532814 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2867ae93-4f4b-4b59-bf8a-e06eddda544e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1508 microversion: 2.1 time: 0.286096 May 21 21:17:37.536616 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 990/1942] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:37 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1508 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:37.542810 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d476d86d-c241-4138-bc48-803c369a8401 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Action: 'update', calling method: .version_select at 0x7fc82d0d0ee0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:37.606564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d476d86d-c241-4138-bc48-803c369a8401 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:37.607025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d476d86d-c241-4138-bc48-803c369a8401 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:37.607826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d476d86d-c241-4138-bc48-803c369a8401 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:37.608719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d476d86d-c241-4138-bc48-803c369a8401 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:37.703836 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-45ea6db1-1338-43b3-9781-83fcbf79663a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:37.712608 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-45ea6db1-1338-43b3-9781-83fcbf79663a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 200 len: 1479 microversion: 2.1 time: 0.483594 May 21 21:17:37.715344 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 953/1943] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:37 2022] GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 1479 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:37.717834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bec5c151-2ba4-4248-97fe-2963c87c2e6e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:37.718449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bec5c151-2ba4-4248-97fe-2963c87c2e6e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:37.725485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bec5c151-2ba4-4248-97fe-2963c87c2e6e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:37.725938 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bec5c151-2ba4-4248-97fe-2963c87c2e6e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:37.726713 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bec5c151-2ba4-4248-97fe-2963c87c2e6e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:37.727213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bec5c151-2ba4-4248-97fe-2963c87c2e6e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:37.746621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:37.746800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:37.756163 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d476d86d-c241-4138-bc48-803c369a8401 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/6c0cd10bfccf46b08cc9560172be4102" status: 200 len: 328 microversion: 2.1 time: 0.218060 May 21 21:17:37.757372 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 991/1944] 10.222.0.49 () {60 vars in 1261 bytes} [Sat May 21 21:17:37 2022] PUT /compute/v2.1/os-quota-sets/6c0cd10bfccf46b08cc9560172be4102 => generated 328 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:37.762288 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-101d279f-898c-4df9-8f78-ab8f7655dbfd tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:37.762901 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-101d279f-898c-4df9-8f78-ab8f7655dbfd tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:37.778635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-101d279f-898c-4df9-8f78-ab8f7655dbfd tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:37.782098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-101d279f-898c-4df9-8f78-ab8f7655dbfd tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:37.782098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-101d279f-898c-4df9-8f78-ab8f7655dbfd tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:37.782098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-101d279f-898c-4df9-8f78-ab8f7655dbfd tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:37.886605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-101d279f-898c-4df9-8f78-ab8f7655dbfd tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:37.896605 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-101d279f-898c-4df9-8f78-ab8f7655dbfd tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 200 len: 1218 microversion: 2.1 time: 0.137963 May 21 21:17:37.897199 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 992/1945] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:37 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 1218 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:37.904479 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e7ff03ca-5611-4d92-95a4-1d55715ec36c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1607032319"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:37.905893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e7ff03ca-5611-4d92-95a4-1d55715ec36c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:37.913106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7ff03ca-5611-4d92-95a4-1d55715ec36c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:37.913619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7ff03ca-5611-4d92-95a4-1d55715ec36c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:37.918361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7ff03ca-5611-4d92-95a4-1d55715ec36c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:37.918361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7ff03ca-5611-4d92-95a4-1d55715ec36c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:37.974050 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bec5c151-2ba4-4248-97fe-2963c87c2e6e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:37.994251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bec5c151-2ba4-4248-97fe-2963c87c2e6e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:37.996766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bec5c151-2ba4-4248-97fe-2963c87c2e6e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:37.998407 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bec5c151-2ba4-4248-97fe-2963c87c2e6e tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.284096 May 21 21:17:37.999475 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 954/1946] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:37 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:38.005740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-515abff8-7919-40d6-a606-84883ac6cb34 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:38.006803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-515abff8-7919-40d6-a606-84883ac6cb34 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:38.012760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:38.021117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-515abff8-7919-40d6-a606-84883ac6cb34 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:38.021855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-515abff8-7919-40d6-a606-84883ac6cb34 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:38.023024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-515abff8-7919-40d6-a606-84883ac6cb34 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:38.024141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-515abff8-7919-40d6-a606-84883ac6cb34 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:38.225183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-515abff8-7919-40d6-a606-84883ac6cb34 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:38.234842 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-515abff8-7919-40d6-a606-84883ac6cb34 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1388 microversion: 2.1 time: 0.234135 May 21 21:17:38.237958 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 955/1947] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:37 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1388 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:38.310642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9f4fcea8-5517-4804-8b9a-314de17d31b6 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-825493638", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:38.387005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-9f4fcea8-5517-4804-8b9a-314de17d31b6 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] validate_networks() for None {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:17:38.570588 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e7ff03ca-5611-4d92-95a4-1d55715ec36c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "POST /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415/action" status: 202 len: 0 microversion: 2.1 time: 0.672080 May 21 21:17:38.575921 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 993/1948] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:17:37 2022] POST /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415/action => generated 0 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 21 21:17:38.577251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-30cca6f8-1ec1-4186-be1b-fd5f4c1371b8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:38.578674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-30cca6f8-1ec1-4186-be1b-fd5f4c1371b8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:38.585150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-30cca6f8-1ec1-4186-be1b-fd5f4c1371b8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:38.585844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-30cca6f8-1ec1-4186-be1b-fd5f4c1371b8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:38.586525 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-30cca6f8-1ec1-4186-be1b-fd5f4c1371b8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:38.586962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-30cca6f8-1ec1-4186-be1b-fd5f4c1371b8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:38.845694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-30cca6f8-1ec1-4186-be1b-fd5f4c1371b8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:38.859490 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-30cca6f8-1ec1-4186-be1b-fd5f4c1371b8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1312 microversion: 2.1 time: 0.286189 May 21 21:17:38.860153 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 994/1949] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:38 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1312 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:38.873711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5fb4b11b-1746-4a3b-acc0-1e27c386ace3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:38.874625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5fb4b11b-1746-4a3b-acc0-1e27c386ace3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:38.882737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5fb4b11b-1746-4a3b-acc0-1e27c386ace3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:38.883197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5fb4b11b-1746-4a3b-acc0-1e27c386ace3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:38.886126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5fb4b11b-1746-4a3b-acc0-1e27c386ace3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:38.886645 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5fb4b11b-1746-4a3b-acc0-1e27c386ace3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:39.035480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-9f4fcea8-5517-4804-8b9a-314de17d31b6 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:17:39.036553 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-9f4fcea8-5517-4804-8b9a-314de17d31b6 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:17:39.037275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-9f4fcea8-5517-4804-8b9a-314de17d31b6 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:17:39.038183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-9f4fcea8-5517-4804-8b9a-314de17d31b6 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:17:39.038781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-9f4fcea8-5517-4804-8b9a-314de17d31b6 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:17:39.056527 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f4fcea8-5517-4804-8b9a-314de17d31b6 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:39.057297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f4fcea8-5517-4804-8b9a-314de17d31b6 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:39.058298 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f4fcea8-5517-4804-8b9a-314de17d31b6 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:39.058924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f4fcea8-5517-4804-8b9a-314de17d31b6 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:39.105691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-9f4fcea8-5517-4804-8b9a-314de17d31b6 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Getting quotas for project 6c0cd10bfccf46b08cc9560172be4102. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:17:39.122803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-9f4fcea8-5517-4804-8b9a-314de17d31b6 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Getting quotas for user 00e1513821164b2ca1f5fb7e2db5339e and project 6c0cd10bfccf46b08cc9560172be4102. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:17:39.139227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.utils [None req-9f4fcea8-5517-4804-8b9a-314de17d31b6 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] cores quota exceeded for 6c0cd10bfccf46b08cc9560172be4102, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=131278) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 21 21:17:39.140381 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-9f4fcea8-5517-4804-8b9a-314de17d31b6 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9f4fcea8-5517-4804-8b9a-314de17d31b6 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Request method failure captured: May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 144 May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbvlj2TB5WeoYktXznZ-PoNka5NOWUjbS5y7Hszx43GA-jBepPB0g0eDNKluQK8TRSDwWWxgQQthHFmZa8cwHcUTxcux5FEeMeo82DkjKBkLnl_LAlwkDRBbtRUxS5TtfTNzGnsD3sm3Ba3s1z_9s2jygwIVsrUbz_th9ucIE9vAYM May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 6c0cd10bfccf46b08cc9560172be4102 May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-QuotasAdminNegativeTest-1557501701 May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6c0cd10bfccf46b08cc9560172be4102"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6c0cd10bfccf46b08cc9560172be4102"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6c0cd10bfccf46b08cc9560172be4102", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6c0cd10bfccf46b08cc9560172be4102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-QuotasAdminNegativeTest-1557501701 May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 6c0cd10bfccf46b08cc9560172be4102 May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1557501701 May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-QuotasAdminNegativeTest-1557501701-project May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 00e1513821164b2ca1f5fb7e2db5339e May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-QuotasAdminNegativeTest-1557501701-project May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-825493638", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-825493638', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452'}}} May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._create_instance( May 21 21:17:39.148028 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9f4fcea8-5517-4804-8b9a-314de17d31b6 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:17:39.155157 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9f4fcea8-5517-4804-8b9a-314de17d31b6 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.916137 May 21 21:17:39.162241 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 956/1950] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:17:38 2022] POST /compute/v2.1/servers => generated 111 bytes in 921 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:17:39.166063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-226ec75e-0a5d-4986-a8fa-1920e2374f86 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b5ed310>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:39.212371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5fb4b11b-1746-4a3b-acc0-1e27c386ace3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:39.221004 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-226ec75e-0a5d-4986-a8fa-1920e2374f86 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e" status: 200 len: 1438 microversion: 2.1 time: 0.061483 May 21 21:17:39.222562 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 957/1951] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:17:39 2022] GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e => generated 1438 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:39.227241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6b410978-d92c-4cd4-8932-e4a3c59affae tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:39.227878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6b410978-d92c-4cd4-8932-e4a3c59affae tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:39.228149 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5fb4b11b-1746-4a3b-acc0-1e27c386ace3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1508 microversion: 2.1 time: 0.366596 May 21 21:17:39.229133 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 995/1952] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:38 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1508 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:39.235946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5eb854f4-f9a8-4d4e-892c-24fdac7b732c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:39.240812 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5eb854f4-f9a8-4d4e-892c-24fdac7b732c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:39.240951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b410978-d92c-4cd4-8932-e4a3c59affae tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:39.240951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b410978-d92c-4cd4-8932-e4a3c59affae tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:39.241134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b410978-d92c-4cd4-8932-e4a3c59affae tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:39.241433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b410978-d92c-4cd4-8932-e4a3c59affae tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:39.252008 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5eb854f4-f9a8-4d4e-892c-24fdac7b732c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:39.252485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5eb854f4-f9a8-4d4e-892c-24fdac7b732c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:39.253454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5eb854f4-f9a8-4d4e-892c-24fdac7b732c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:39.254268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5eb854f4-f9a8-4d4e-892c-24fdac7b732c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:39.454790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6b410978-d92c-4cd4-8932-e4a3c59affae tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:39.485129 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6b410978-d92c-4cd4-8932-e4a3c59affae tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 200 len: 1226 microversion: 2.1 time: 0.261054 May 21 21:17:39.499324 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 958/1953] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:39 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 1226 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:39.507732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4236045c-9adc-4ae1-9b65-a3447dbf1ef8 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Action: 'update', calling method: .version_select at 0x7fc82d1293a0>, body: {"quota_set": {"cores": 20}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:39.596091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4236045c-9adc-4ae1-9b65-a3447dbf1ef8 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:39.601632 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4236045c-9adc-4ae1-9b65-a3447dbf1ef8 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:39.602340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4236045c-9adc-4ae1-9b65-a3447dbf1ef8 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:39.604512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4236045c-9adc-4ae1-9b65-a3447dbf1ef8 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:39.633448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5eb854f4-f9a8-4d4e-892c-24fdac7b732c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:39.656903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5eb854f4-f9a8-4d4e-892c-24fdac7b732c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:39.660709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5eb854f4-f9a8-4d4e-892c-24fdac7b732c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:39.662286 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5eb854f4-f9a8-4d4e-892c-24fdac7b732c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.432107 May 21 21:17:39.675968 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 996/1954] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:39 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:39.691579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3894c3d5-ed75-40a2-80ee-b3456cb2e77e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:39.693066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3894c3d5-ed75-40a2-80ee-b3456cb2e77e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:39.702546 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3894c3d5-ed75-40a2-80ee-b3456cb2e77e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:39.703544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3894c3d5-ed75-40a2-80ee-b3456cb2e77e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:39.704609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3894c3d5-ed75-40a2-80ee-b3456cb2e77e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:39.706391 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3894c3d5-ed75-40a2-80ee-b3456cb2e77e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:39.933881 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4236045c-9adc-4ae1-9b65-a3447dbf1ef8 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/6c0cd10bfccf46b08cc9560172be4102" status: 200 len: 329 microversion: 2.1 time: 0.432167 May 21 21:17:39.937921 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 959/1955] 10.222.0.49 () {60 vars in 1261 bytes} [Sat May 21 21:17:39 2022] PUT /compute/v2.1/os-quota-sets/6c0cd10bfccf46b08cc9560172be4102 => generated 329 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:39.947199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-63f56d37-81b9-47c7-95d3-0e5e12a7e18e tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:39.948989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-63f56d37-81b9-47c7-95d3-0e5e12a7e18e tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:39.975267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63f56d37-81b9-47c7-95d3-0e5e12a7e18e tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:39.976102 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63f56d37-81b9-47c7-95d3-0e5e12a7e18e tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:39.977077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63f56d37-81b9-47c7-95d3-0e5e12a7e18e tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:39.977620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63f56d37-81b9-47c7-95d3-0e5e12a7e18e tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:40.053385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3894c3d5-ed75-40a2-80ee-b3456cb2e77e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:40.066596 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3894c3d5-ed75-40a2-80ee-b3456cb2e77e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1388 microversion: 2.1 time: 0.388619 May 21 21:17:40.074761 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 997/1956] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:39 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1388 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:40.094838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8dd6cff7-5460-48b0-be4e-867ea40fa9ba tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Calling method '.version_select at 0x7fc81b70bb80>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:40.268226 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8dd6cff7-5460-48b0-be4e-867ea40fa9ba tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/6c0cd10bfccf46b08cc9560172be4102" status: 200 len: 371 microversion: 2.1 time: 0.192086 May 21 21:17:40.269963 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 998/1957] 10.222.0.49 () {58 vars in 1241 bytes} [Sat May 21 21:17:40 2022] GET /compute/v2.1/os-quota-sets/6c0cd10bfccf46b08cc9560172be4102 => generated 371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:40.279496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9d4a39fc-aada-4398-a011-6ccc311e1e1a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81bb73dc0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:40.345547 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9d4a39fc-aada-4398-a011-6ccc311e1e1a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e" status: 200 len: 1438 microversion: 2.1 time: 0.074126 May 21 21:17:40.348373 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 999/1958] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:17:40 2022] GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e => generated 1438 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:40.357980 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-34d1a80c-837a-4a43-8598-982c1f0b0acf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:40.361128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-34d1a80c-837a-4a43-8598-982c1f0b0acf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:40.377514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34d1a80c-837a-4a43-8598-982c1f0b0acf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:40.378099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34d1a80c-837a-4a43-8598-982c1f0b0acf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:40.379448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34d1a80c-837a-4a43-8598-982c1f0b0acf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:40.379969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34d1a80c-837a-4a43-8598-982c1f0b0acf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:40.768876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-63f56d37-81b9-47c7-95d3-0e5e12a7e18e tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:40.789364 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-63f56d37-81b9-47c7-95d3-0e5e12a7e18e tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1312 microversion: 2.1 time: 0.850053 May 21 21:17:40.793482 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 960/1959] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:39 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1312 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:40.811357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c43009c7-61dc-43f4-b097-be4ba34312e7 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Action: 'update', calling method: .version_select at 0x7fc81b65e9d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:40.968928 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c43009c7-61dc-43f4-b097-be4ba34312e7 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:40.969793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c43009c7-61dc-43f4-b097-be4ba34312e7 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:40.977529 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c43009c7-61dc-43f4-b097-be4ba34312e7 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:40.977529 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c43009c7-61dc-43f4-b097-be4ba34312e7 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:41.245377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-34d1a80c-837a-4a43-8598-982c1f0b0acf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:41.255062 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-34d1a80c-837a-4a43-8598-982c1f0b0acf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1508 microversion: 2.1 time: 0.905299 May 21 21:17:41.265278 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1000/1960] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:40 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1508 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:41.271780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3c3e7235-f595-44b7-a58c-42bbf7f771f6 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:41.272598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3c3e7235-f595-44b7-a58c-42bbf7f771f6 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:41.290552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c3e7235-f595-44b7-a58c-42bbf7f771f6 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:41.290552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c3e7235-f595-44b7-a58c-42bbf7f771f6 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:41.291022 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c43009c7-61dc-43f4-b097-be4ba34312e7 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/6c0cd10bfccf46b08cc9560172be4102" status: 200 len: 328 microversion: 2.1 time: 0.489990 May 21 21:17:41.291133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c3e7235-f595-44b7-a58c-42bbf7f771f6 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:41.291133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c3e7235-f595-44b7-a58c-42bbf7f771f6 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:41.307099 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 961/1961] 10.222.0.49 () {60 vars in 1261 bytes} [Sat May 21 21:17:40 2022] PUT /compute/v2.1/os-quota-sets/6c0cd10bfccf46b08cc9560172be4102 => generated 328 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:41.329304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-68f08ea8-abcb-4479-bb8c-def4bf8676a8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:41.330143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-68f08ea8-abcb-4479-bb8c-def4bf8676a8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:41.358472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-68f08ea8-abcb-4479-bb8c-def4bf8676a8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:41.358953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-68f08ea8-abcb-4479-bb8c-def4bf8676a8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:41.365614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-68f08ea8-abcb-4479-bb8c-def4bf8676a8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:41.366185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-68f08ea8-abcb-4479-bb8c-def4bf8676a8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:41.684232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3c3e7235-f595-44b7-a58c-42bbf7f771f6 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:41.695321 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3c3e7235-f595-44b7-a58c-42bbf7f771f6 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 200 len: 1303 microversion: 2.1 time: 0.428750 May 21 21:17:41.699074 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1001/1962] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:41 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 1303 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:41.705188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-9ce485b7-8bae-4d00-8796-96c310acebfa req-7f7f4144-1f82-4c35-96b9-d87a2e542cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ce51e42-255d-45f7-afab-2fdb937e7758", "name": "network-vif-deleted", "tag": "13fa11f5-00e8-4fa2-a36a-6c54e56541f6"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:41.738507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-9ce485b7-8bae-4d00-8796-96c310acebfa req-7f7f4144-1f82-4c35-96b9-d87a2e542cad service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:41.739333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-9ce485b7-8bae-4d00-8796-96c310acebfa req-7f7f4144-1f82-4c35-96b9-d87a2e542cad service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:41.779464 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-9ce485b7-8bae-4d00-8796-96c310acebfa req-7f7f4144-1f82-4c35-96b9-d87a2e542cad service nova] Creating event network-vif-deleted:13fa11f5-00e8-4fa2-a36a-6c54e56541f6 for instance 4ce51e42-255d-45f7-afab-2fdb937e7758 on nch2-master-1 May 21 21:17:41.798755 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-9ce485b7-8bae-4d00-8796-96c310acebfa req-7f7f4144-1f82-4c35-96b9-d87a2e542cad service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098225 May 21 21:17:41.799719 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1002/1963] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:41.808918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fbbeb74b-e669-48fe-a6f2-25a088c867f0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:41.812970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fbbeb74b-e669-48fe-a6f2-25a088c867f0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:41.830310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbbeb74b-e669-48fe-a6f2-25a088c867f0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:41.832633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbbeb74b-e669-48fe-a6f2-25a088c867f0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:41.833751 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbbeb74b-e669-48fe-a6f2-25a088c867f0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:41.837385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbbeb74b-e669-48fe-a6f2-25a088c867f0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:41.902893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-68f08ea8-abcb-4479-bb8c-def4bf8676a8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:41.926402 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-68f08ea8-abcb-4479-bb8c-def4bf8676a8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:41.929150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-68f08ea8-abcb-4479-bb8c-def4bf8676a8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:41.932194 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-68f08ea8-abcb-4479-bb8c-def4bf8676a8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.623961 May 21 21:17:41.933535 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 962/1964] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:41 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:41.950451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3ab611ba-6b5f-49e2-be2f-10f814eddd39 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b872f70>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:42.047878 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3ab611ba-6b5f-49e2-be2f-10f814eddd39 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e" status: 200 len: 1438 microversion: 2.1 time: 0.111302 May 21 21:17:42.048951 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 963/1965] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:17:41 2022] GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e => generated 1438 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:42.057820 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2754a0c0-4638-4a5c-b5fd-f6458ad8d342 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1857454018", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:42.148156 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fbbeb74b-e669-48fe-a6f2-25a088c867f0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:42.156993 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fbbeb74b-e669-48fe-a6f2-25a088c867f0 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 200 len: 1184 microversion: 2.1 time: 0.355765 May 21 21:17:42.161038 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1003/1966] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:41 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 1184 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:42.166975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-520ec3cf-9d1c-435e-9d6c-c88a2b090369 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:42.185798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-520ec3cf-9d1c-435e-9d6c-c88a2b090369 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:42.196981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-2754a0c0-4638-4a5c-b5fd-f6458ad8d342 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] validate_networks() for None {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:17:42.201245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-520ec3cf-9d1c-435e-9d6c-c88a2b090369 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:42.212213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-520ec3cf-9d1c-435e-9d6c-c88a2b090369 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:42.213113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-520ec3cf-9d1c-435e-9d6c-c88a2b090369 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:42.213567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-520ec3cf-9d1c-435e-9d6c-c88a2b090369 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:42.770449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-520ec3cf-9d1c-435e-9d6c-c88a2b090369 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:42.785410 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-520ec3cf-9d1c-435e-9d6c-c88a2b090369 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1333 microversion: 2.1 time: 0.623025 May 21 21:17:42.802712 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1004/1967] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:42 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1333 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:42.802712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-65e27544-7dd1-4793-805f-fec65a6c85df tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:42.803986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-65e27544-7dd1-4793-805f-fec65a6c85df tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:42.832884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65e27544-7dd1-4793-805f-fec65a6c85df tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:42.833315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65e27544-7dd1-4793-805f-fec65a6c85df tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:42.835814 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65e27544-7dd1-4793-805f-fec65a6c85df tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:42.836301 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65e27544-7dd1-4793-805f-fec65a6c85df tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:42.863844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-2754a0c0-4638-4a5c-b5fd-f6458ad8d342 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:17:42.864969 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-2754a0c0-4638-4a5c-b5fd-f6458ad8d342 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:17:42.865851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-2754a0c0-4638-4a5c-b5fd-f6458ad8d342 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:17:42.866501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-2754a0c0-4638-4a5c-b5fd-f6458ad8d342 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:17:42.867146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-2754a0c0-4638-4a5c-b5fd-f6458ad8d342 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:17:42.889594 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2754a0c0-4638-4a5c-b5fd-f6458ad8d342 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:42.890900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2754a0c0-4638-4a5c-b5fd-f6458ad8d342 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:42.892028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2754a0c0-4638-4a5c-b5fd-f6458ad8d342 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:42.894603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2754a0c0-4638-4a5c-b5fd-f6458ad8d342 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:42.923905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65e27544-7dd1-4793-805f-fec65a6c85df tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:42.924403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65e27544-7dd1-4793-805f-fec65a6c85df tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:42.924868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-65e27544-7dd1-4793-805f-fec65a6c85df tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lazy-loading 'fault' on Instance uuid 3f6d21d5-3dbc-4822-8d28-42303d1aed09 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:17:42.930297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-2754a0c0-4638-4a5c-b5fd-f6458ad8d342 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Getting quotas for project 6c0cd10bfccf46b08cc9560172be4102. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:17:42.937620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-2754a0c0-4638-4a5c-b5fd-f6458ad8d342 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Getting quotas for user 00e1513821164b2ca1f5fb7e2db5339e and project 6c0cd10bfccf46b08cc9560172be4102. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:17:42.955046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.utils [None req-2754a0c0-4638-4a5c-b5fd-f6458ad8d342 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] instances quota exceeded for 6c0cd10bfccf46b08cc9560172be4102, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=131278) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 21 21:17:42.956477 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-2754a0c0-4638-4a5c-b5fd-f6458ad8d342 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2754a0c0-4638-4a5c-b5fd-f6458ad8d342 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Request method failure captured: May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 145 May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbvlj2TB5WeoYktXznZ-PoNka5NOWUjbS5y7Hszx43GA-jBepPB0g0eDNKluQK8TRSDwWWxgQQthHFmZa8cwHcUTxcux5FEeMeo82DkjKBkLnl_LAlwkDRBbtRUxS5TtfTNzGnsD3sm3Ba3s1z_9s2jygwIVsrUbz_th9ucIE9vAYM May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 6c0cd10bfccf46b08cc9560172be4102 May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-QuotasAdminNegativeTest-1557501701 May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6c0cd10bfccf46b08cc9560172be4102"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6c0cd10bfccf46b08cc9560172be4102"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6c0cd10bfccf46b08cc9560172be4102", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6c0cd10bfccf46b08cc9560172be4102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-QuotasAdminNegativeTest-1557501701 May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 6c0cd10bfccf46b08cc9560172be4102 May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1557501701 May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-QuotasAdminNegativeTest-1557501701-project May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 00e1513821164b2ca1f5fb7e2db5339e May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-QuotasAdminNegativeTest-1557501701-project May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1857454018", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1857454018', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452'}}} May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._create_instance( May 21 21:17:42.961183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2754a0c0-4638-4a5c-b5fd-f6458ad8d342 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2754a0c0-4638-4a5c-b5fd-f6458ad8d342 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.915365 May 21 21:17:42.973080 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 964/1968] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:17:42 2022] POST /compute/v2.1/servers => generated 119 bytes in 918 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:17:42.981470 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-41337768-562c-4165-8cee-1e351391e891 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:42.981470 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-41337768-562c-4165-8cee-1e351391e891 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:43.001635 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41337768-562c-4165-8cee-1e351391e891 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:43.002102 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41337768-562c-4165-8cee-1e351391e891 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:43.003177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41337768-562c-4165-8cee-1e351391e891 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:43.004599 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41337768-562c-4165-8cee-1e351391e891 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:43.049577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-65e27544-7dd1-4793-805f-fec65a6c85df tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:43.061009 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-65e27544-7dd1-4793-805f-fec65a6c85df tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 200 len: 1305 microversion: 2.1 time: 0.269304 May 21 21:17:43.061624 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1005/1969] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:42 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 1305 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:43.073487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6672628c-4746-46f1-8342-88ad9aec5901 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:43.075316 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6672628c-4746-46f1-8342-88ad9aec5901 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:43.090447 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6672628c-4746-46f1-8342-88ad9aec5901 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:43.091280 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6672628c-4746-46f1-8342-88ad9aec5901 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:43.093158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6672628c-4746-46f1-8342-88ad9aec5901 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:43.095468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6672628c-4746-46f1-8342-88ad9aec5901 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:43.399692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-41337768-562c-4165-8cee-1e351391e891 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:43.423150 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-41337768-562c-4165-8cee-1e351391e891 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 200 len: 1291 microversion: 2.1 time: 0.443948 May 21 21:17:43.423150 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 965/1970] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:42 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 1291 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:43.423150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8eaaae2b-d8d9-436d-a056-26978bf4b533 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Action: 'update', calling method: .version_select at 0x7fc81b3a8dc0>, body: {"quota_set": {"instances": 10}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:43.582485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6672628c-4746-46f1-8342-88ad9aec5901 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:43.596166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8eaaae2b-d8d9-436d-a056-26978bf4b533 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:43.601332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8eaaae2b-d8d9-436d-a056-26978bf4b533 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:43.607447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8eaaae2b-d8d9-436d-a056-26978bf4b533 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:43.607599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6672628c-4746-46f1-8342-88ad9aec5901 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:43.608028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8eaaae2b-d8d9-436d-a056-26978bf4b533 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:43.613487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6672628c-4746-46f1-8342-88ad9aec5901 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:43.617713 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6672628c-4746-46f1-8342-88ad9aec5901 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.555064 May 21 21:17:43.620438 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1006/1971] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:43 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:43.629095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-53899eef-aa1c-4553-96ef-768b38d97a1a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc82d0e1b80>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:43.787325 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-53899eef-aa1c-4553-96ef-768b38d97a1a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e" status: 200 len: 1438 microversion: 2.1 time: 0.165092 May 21 21:17:43.788350 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1007/1972] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:17:43 2022] GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e => generated 1438 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:43.798539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cd7133d4-cafc-462d-b025-a13fab47917e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:43.799186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cd7133d4-cafc-462d-b025-a13fab47917e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: 4ce51e42-255d-45f7-afab-2fdb937e7758] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:43.836835 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd7133d4-cafc-462d-b025-a13fab47917e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:43.837303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd7133d4-cafc-462d-b025-a13fab47917e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:43.838302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd7133d4-cafc-462d-b025-a13fab47917e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:43.838752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd7133d4-cafc-462d-b025-a13fab47917e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:43.907314 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-cd7133d4-cafc-462d-b025-a13fab47917e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] HTTP exception thrown: Instance 4ce51e42-255d-45f7-afab-2fdb937e7758 could not be found. May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cd7133d4-cafc-462d-b025-a13fab47917e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Request method failure captured: May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 HTTP/1.1 May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVV6T3RyEAuEj3kkohi5afNjIZDzMkbpGxSPkhUNQKESnkx5do8rKET_y9FZw2-faVyMNN9INAHvixRDp8oL8FaSX_bHY9TnjbhptGMff12ZRiPOqrrvdfcrZqPgNgT5Hu6C49vopI-OOHSmOYV9aBTZaIqng40vF4GFbrZSYyBOdE8 May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 5284da653ac24d73a21e8442609889c9 May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-LiveMigrationTest-1650172315 May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5284da653ac24d73a21e8442609889c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5284da653ac24d73a21e8442609889c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5284da653ac24d73a21e8442609889c9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5284da653ac24d73a21e8442609889c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-LiveMigrationTest-1650172315 May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 5284da653ac24d73a21e8442609889c9 May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-LiveMigrationTest-1650172315 May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-LiveMigrationTest-1650172315-project May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 34c22f04c3114d46b6b1b1168aa064f5 May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-LiveMigrationTest-1650172315-project May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 4ce51e42-255d-45f7-afab-2fdb937e7758 could not be found. May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '4ce51e42-255d-45f7-afab-2fdb937e7758'} May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ce51e42-255d-45f7-afab-2fdb937e7758 could not be found. May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ce51e42-255d-45f7-afab-2fdb937e7758 could not be found. May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:17:43.912525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:17:43.919453 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:43.919453 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:17:43.919453 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:17:43.919453 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:17:43.919453 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:17:43.919453 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ce51e42-255d-45f7-afab-2fdb937e7758 could not be found. May 21 21:17:43.919453 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:17:43.922292 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cd7133d4-cafc-462d-b025-a13fab47917e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Returning 404 to user: Instance 4ce51e42-255d-45f7-afab-2fdb937e7758 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:17:43.926309 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cd7133d4-cafc-462d-b025-a13fab47917e tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758" status: 404 len: 111 microversion: 2.1 time: 0.136768 May 21 21:17:43.930935 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1008/1973] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:43 2022] GET /compute/v2.1/servers/4ce51e42-255d-45f7-afab-2fdb937e7758 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:17:43.943521 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8eaaae2b-d8d9-436d-a056-26978bf4b533 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/6c0cd10bfccf46b08cc9560172be4102" status: 200 len: 329 microversion: 2.1 time: 0.525657 May 21 21:17:43.946066 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 966/1974] 10.222.0.49 () {60 vars in 1261 bytes} [Sat May 21 21:17:43 2022] PUT /compute/v2.1/os-quota-sets/6c0cd10bfccf46b08cc9560172be4102 => generated 329 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:43.959369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ebf1edd2-88e1-4f76-99c3-eb3bd80930bb tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Calling method '.version_select at 0x7fc81b44e040>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:43.965468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a0e09057-6e24-4d18-83fb-04d0a2ee20b2 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:43.966096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a0e09057-6e24-4d18-83fb-04d0a2ee20b2 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:44.000505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a0e09057-6e24-4d18-83fb-04d0a2ee20b2 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:44.000886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a0e09057-6e24-4d18-83fb-04d0a2ee20b2 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:44.001682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a0e09057-6e24-4d18-83fb-04d0a2ee20b2 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:44.002128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a0e09057-6e24-4d18-83fb-04d0a2ee20b2 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:44.082182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:44.178138 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ebf1edd2-88e1-4f76-99c3-eb3bd80930bb tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/6c0cd10bfccf46b08cc9560172be4102" status: 200 len: 371 microversion: 2.1 time: 0.223066 May 21 21:17:44.179502 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 967/1975] 10.222.0.49 () {58 vars in 1241 bytes} [Sat May 21 21:17:43 2022] GET /compute/v2.1/os-quota-sets/6c0cd10bfccf46b08cc9560172be4102 => generated 371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:44.184338 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bf08e7b0-2f54-49ae-829d-256667461ac3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:44.192879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bf08e7b0-2f54-49ae-829d-256667461ac3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:44.202699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf08e7b0-2f54-49ae-829d-256667461ac3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:44.204124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf08e7b0-2f54-49ae-829d-256667461ac3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:44.207091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf08e7b0-2f54-49ae-829d-256667461ac3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:44.207782 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf08e7b0-2f54-49ae-829d-256667461ac3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:44.249253 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-bf08e7b0-2f54-49ae-829d-256667461ac3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance 3f6d21d5-3dbc-4822-8d28-42303d1aed09 could not be found. May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bf08e7b0-2f54-49ae-829d-256667461ac3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 HTTP/1.1 May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 3f6d21d5-3dbc-4822-8d28-42303d1aed09 could not be found. May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '3f6d21d5-3dbc-4822-8d28-42303d1aed09'} May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f6d21d5-3dbc-4822-8d28-42303d1aed09 could not be found. May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f6d21d5-3dbc-4822-8d28-42303d1aed09 could not be found. May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:17:44.253655 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:44.259224 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:44.259224 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:17:44.259224 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:17:44.259224 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:17:44.259224 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:17:44.259224 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f6d21d5-3dbc-4822-8d28-42303d1aed09 could not be found. May 21 21:17:44.259224 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:44.264023 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bf08e7b0-2f54-49ae-829d-256667461ac3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance 3f6d21d5-3dbc-4822-8d28-42303d1aed09 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:17:44.276507 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bf08e7b0-2f54-49ae-829d-256667461ac3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 404 len: 111 microversion: 2.1 time: 0.095703 May 21 21:17:44.281988 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 968/1976] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:44 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:17:44.316340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-73f29bc2-ef5d-417c-b0fd-5a801536e4f5 req-98ba0a17-397b-4379-b0b6-96ccb522165f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f6d21d5-3dbc-4822-8d28-42303d1aed09", "name": "network-vif-deleted", "tag": "126915c9-8f67-4466-beb6-855ec5fde31b"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:44.350430 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-73f29bc2-ef5d-417c-b0fd-5a801536e4f5 req-98ba0a17-397b-4379-b0b6-96ccb522165f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:44.350430 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-73f29bc2-ef5d-417c-b0fd-5a801536e4f5 req-98ba0a17-397b-4379-b0b6-96ccb522165f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:44.366674 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-73f29bc2-ef5d-417c-b0fd-5a801536e4f5 req-98ba0a17-397b-4379-b0b6-96ccb522165f service nova] Creating event network-vif-deleted:126915c9-8f67-4466-beb6-855ec5fde31b for instance 3f6d21d5-3dbc-4822-8d28-42303d1aed09 on nch2-master-1 May 21 21:17:44.374945 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-73f29bc2-ef5d-417c-b0fd-5a801536e4f5 req-98ba0a17-397b-4379-b0b6-96ccb522165f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089285 May 21 21:17:44.376171 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 969/1977] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:44.389774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-01be6c92-0f5b-45bf-81ca-2d1a41d1c023 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Action: 'update', calling method: .version_select at 0x7fc81b883f70>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:44.696480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-01be6c92-0f5b-45bf-81ca-2d1a41d1c023 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:44.697368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-01be6c92-0f5b-45bf-81ca-2d1a41d1c023 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:44.715514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-01be6c92-0f5b-45bf-81ca-2d1a41d1c023 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:44.715983 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-01be6c92-0f5b-45bf-81ca-2d1a41d1c023 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:45.092810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:45.109601 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-01be6c92-0f5b-45bf-81ca-2d1a41d1c023 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/6c0cd10bfccf46b08cc9560172be4102" status: 200 len: 325 microversion: 2.1 time: 0.728873 May 21 21:17:45.113598 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 970/1978] 10.222.0.49 () {60 vars in 1261 bytes} [Sat May 21 21:17:44 2022] PUT /compute/v2.1/os-quota-sets/6c0cd10bfccf46b08cc9560172be4102 => generated 325 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:45.140196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aca7ed16-5707-4799-b6db-a2e8385dbb70 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:45.141252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-aca7ed16-5707-4799-b6db-a2e8385dbb70 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:45.149903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aca7ed16-5707-4799-b6db-a2e8385dbb70 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:45.150815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aca7ed16-5707-4799-b6db-a2e8385dbb70 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:45.151803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aca7ed16-5707-4799-b6db-a2e8385dbb70 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:45.152591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aca7ed16-5707-4799-b6db-a2e8385dbb70 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:45.167792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a0e09057-6e24-4d18-83fb-04d0a2ee20b2 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:45.176313 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a0e09057-6e24-4d18-83fb-04d0a2ee20b2 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1354 microversion: 2.1 time: 1.243261 May 21 21:17:45.176911 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1009/1979] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:43 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1354 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:45.184668 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f95d805f-7a15-45f9-be38-c2163cd8034b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:45.187763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f95d805f-7a15-45f9-be38-c2163cd8034b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:45.207547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f95d805f-7a15-45f9-be38-c2163cd8034b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:45.207984 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f95d805f-7a15-45f9-be38-c2163cd8034b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:45.209280 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f95d805f-7a15-45f9-be38-c2163cd8034b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:45.212018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f95d805f-7a15-45f9-be38-c2163cd8034b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:45.628831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f95d805f-7a15-45f9-be38-c2163cd8034b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:45.642043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f95d805f-7a15-45f9-be38-c2163cd8034b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:45.656761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f95d805f-7a15-45f9-be38-c2163cd8034b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:45.658707 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f95d805f-7a15-45f9-be38-c2163cd8034b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.480375 May 21 21:17:45.659307 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1010/1980] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:45 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:45.685830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c26744f0-61a9-4bc2-af94-4867dc921033 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-297689195", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "f95b9f39-db04-49ea-b57f-7951c8f566a9"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:45.776029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-c26744f0-61a9-4bc2-af94-4867dc921033 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] validate_networks() for [('f95b9f39-db04-49ea-b57f-7951c8f566a9', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:17:46.349668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-aca7ed16-5707-4799-b6db-a2e8385dbb70 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:46.365603 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-aca7ed16-5707-4799-b6db-a2e8385dbb70 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 200 len: 1291 microversion: 2.1 time: 1.247765 May 21 21:17:46.366740 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 971/1981] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:45 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 1291 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:46.380527 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9243ad83-95e1-4cac-a1c3-2a3ff21030ed tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b6e3c10>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:46.547322 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9243ad83-95e1-4cac-a1c3-2a3ff21030ed tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e" status: 200 len: 1438 microversion: 2.1 time: 0.179437 May 21 21:17:46.548460 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 972/1982] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:17:46 2022] GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e => generated 1438 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:46.562033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0e90d1a9-70d5-4671-953f-31407ac3cfe9 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-330370196", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:46.714675 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-0e90d1a9-70d5-4671-953f-31407ac3cfe9 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] validate_networks() for None {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:17:47.336872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c26744f0-61a9-4bc2-af94-4867dc921033 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:17:47.337547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c26744f0-61a9-4bc2-af94-4867dc921033 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:17:47.337782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c26744f0-61a9-4bc2-af94-4867dc921033 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:17:47.338204 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c26744f0-61a9-4bc2-af94-4867dc921033 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:17:47.338660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c26744f0-61a9-4bc2-af94-4867dc921033 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:17:47.360436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c26744f0-61a9-4bc2-af94-4867dc921033 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:47.366960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c26744f0-61a9-4bc2-af94-4867dc921033 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:47.371244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c26744f0-61a9-4bc2-af94-4867dc921033 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:47.382985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c26744f0-61a9-4bc2-af94-4867dc921033 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:47.469803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-c26744f0-61a9-4bc2-af94-4867dc921033 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Getting quotas for project 8c48385dc5c24377a7be24da93fc54d9. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:17:47.486810 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-c26744f0-61a9-4bc2-af94-4867dc921033 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Getting quotas for user c3e23800ab314cc28dc30330928d8454 and project 8c48385dc5c24377a7be24da93fc54d9. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:17:47.511096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c26744f0-61a9-4bc2-af94-4867dc921033 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:17:47.514595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c26744f0-61a9-4bc2-af94-4867dc921033 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:17:47.811167 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c26744f0-61a9-4bc2-af94-4867dc921033 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.149920 May 21 21:17:47.818559 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1011/1983] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:17:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:17:47.827072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-7f27e6d6-8efb-4ccd-8c3f-9f6489e1fd0f req-9dfe718c-91be-4b6e-940c-0a357a367d49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bd22b39-b6ee-4fbd-a518-98285883af10", "tag": "e6e7b9ba-54d7-426f-b099-2697c07707f7"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:47.849424 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7f27e6d6-8efb-4ccd-8c3f-9f6489e1fd0f req-9dfe718c-91be-4b6e-940c-0a357a367d49 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:47.869664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7f27e6d6-8efb-4ccd-8c3f-9f6489e1fd0f req-9dfe718c-91be-4b6e-940c-0a357a367d49 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:47.947612 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-7f27e6d6-8efb-4ccd-8c3f-9f6489e1fd0f req-9dfe718c-91be-4b6e-940c-0a357a367d49 service nova] Creating event network-changed:e6e7b9ba-54d7-426f-b099-2697c07707f7 for instance 0bd22b39-b6ee-4fbd-a518-98285883af10 on nch2-master-1 May 21 21:17:47.981515 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-7f27e6d6-8efb-4ccd-8c3f-9f6489e1fd0f req-9dfe718c-91be-4b6e-940c-0a357a367d49 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156485 May 21 21:17:47.990064 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1012/1984] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:48.034336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bace414c-eca7-4690-a277-d92fa513df2b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:48.035887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bace414c-eca7-4690-a277-d92fa513df2b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:48.101922 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bace414c-eca7-4690-a277-d92fa513df2b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:48.102624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bace414c-eca7-4690-a277-d92fa513df2b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:48.103491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bace414c-eca7-4690-a277-d92fa513df2b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:48.103950 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bace414c-eca7-4690-a277-d92fa513df2b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:48.190113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0e90d1a9-70d5-4671-953f-31407ac3cfe9 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:17:48.191892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0e90d1a9-70d5-4671-953f-31407ac3cfe9 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:17:48.195872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0e90d1a9-70d5-4671-953f-31407ac3cfe9 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:17:48.195872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0e90d1a9-70d5-4671-953f-31407ac3cfe9 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:17:48.195872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0e90d1a9-70d5-4671-953f-31407ac3cfe9 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:17:48.231137 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=59 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:48.237653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e90d1a9-70d5-4671-953f-31407ac3cfe9 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:48.244669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e90d1a9-70d5-4671-953f-31407ac3cfe9 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:48.245940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e90d1a9-70d5-4671-953f-31407ac3cfe9 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:48.251753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e90d1a9-70d5-4671-953f-31407ac3cfe9 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:48.326827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-0e90d1a9-70d5-4671-953f-31407ac3cfe9 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Getting quotas for project 6c0cd10bfccf46b08cc9560172be4102. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:17:48.341898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-0e90d1a9-70d5-4671-953f-31407ac3cfe9 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Getting quotas for user 00e1513821164b2ca1f5fb7e2db5339e and project 6c0cd10bfccf46b08cc9560172be4102. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:17:48.385897 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.utils [None req-0e90d1a9-70d5-4671-953f-31407ac3cfe9 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] ram quota exceeded for 6c0cd10bfccf46b08cc9560172be4102, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=131278) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 21 21:17:48.386479 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-0e90d1a9-70d5-4671-953f-31407ac3cfe9 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0e90d1a9-70d5-4671-953f-31407ac3cfe9 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Request method failure captured: May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 144 May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbvlj2TB5WeoYktXznZ-PoNka5NOWUjbS5y7Hszx43GA-jBepPB0g0eDNKluQK8TRSDwWWxgQQthHFmZa8cwHcUTxcux5FEeMeo82DkjKBkLnl_LAlwkDRBbtRUxS5TtfTNzGnsD3sm3Ba3s1z_9s2jygwIVsrUbz_th9ucIE9vAYM May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 6c0cd10bfccf46b08cc9560172be4102 May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-QuotasAdminNegativeTest-1557501701 May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6c0cd10bfccf46b08cc9560172be4102"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6c0cd10bfccf46b08cc9560172be4102"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6c0cd10bfccf46b08cc9560172be4102", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6c0cd10bfccf46b08cc9560172be4102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-QuotasAdminNegativeTest-1557501701 May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 6c0cd10bfccf46b08cc9560172be4102 May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1557501701 May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-QuotasAdminNegativeTest-1557501701-project May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 00e1513821164b2ca1f5fb7e2db5339e May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-QuotasAdminNegativeTest-1557501701-project May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-330370196", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-330370196', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452'}}} May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._create_instance( May 21 21:17:48.392523 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0e90d1a9-70d5-4671-953f-31407ac3cfe9 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:17:48.401947 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0e90d1a9-70d5-4671-953f-31407ac3cfe9 tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.850455 May 21 21:17:48.405495 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 973/1985] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:17:46 2022] POST /compute/v2.1/servers => generated 110 bytes in 1856 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:17:48.413674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7e301cb1-19a8-42d0-bbd6-7781a710c817 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:48.414313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7e301cb1-19a8-42d0-bbd6-7781a710c817 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:48.474238 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e301cb1-19a8-42d0-bbd6-7781a710c817 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:48.477951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e301cb1-19a8-42d0-bbd6-7781a710c817 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:48.482342 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e301cb1-19a8-42d0-bbd6-7781a710c817 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:48.485953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e301cb1-19a8-42d0-bbd6-7781a710c817 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:48.964886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bace414c-eca7-4690-a277-d92fa513df2b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:48.977853 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bace414c-eca7-4690-a277-d92fa513df2b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1354 microversion: 2.1 time: 0.982760 May 21 21:17:48.978919 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1013/1986] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:47 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1354 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:48.985124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-d4f2c90a-cd50-4095-80e6-fc6c758204fd req-044d8103-5b97-43ae-ba8d-095a4988d7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9930871-f204-4368-a581-87d1b5ed7415", "name": "network-vif-plugged", "status": "completed", "tag": "e06f96d3-fb3e-437a-8744-1f10e131cd8c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:48.996505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d4f2c90a-cd50-4095-80e6-fc6c758204fd req-044d8103-5b97-43ae-ba8d-095a4988d7f6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:48.997529 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d4f2c90a-cd50-4095-80e6-fc6c758204fd req-044d8103-5b97-43ae-ba8d-095a4988d7f6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:49.013276 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-d4f2c90a-cd50-4095-80e6-fc6c758204fd req-044d8103-5b97-43ae-ba8d-095a4988d7f6 service nova] Creating event network-vif-plugged:e06f96d3-fb3e-437a-8744-1f10e131cd8c for instance b9930871-f204-4368-a581-87d1b5ed7415 on nch2-master-1 May 21 21:17:49.019206 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-d4f2c90a-cd50-4095-80e6-fc6c758204fd req-044d8103-5b97-43ae-ba8d-095a4988d7f6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038439 May 21 21:17:49.020397 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1014/1987] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:49.026893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-be35e85f-2cfc-4af0-969e-9f6d622a0db8 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:49.027832 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-be35e85f-2cfc-4af0-969e-9f6d622a0db8 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:49.036630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be35e85f-2cfc-4af0-969e-9f6d622a0db8 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:49.037380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be35e85f-2cfc-4af0-969e-9f6d622a0db8 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:49.038348 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be35e85f-2cfc-4af0-969e-9f6d622a0db8 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:49.038964 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be35e85f-2cfc-4af0-969e-9f6d622a0db8 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:49.358843 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-be35e85f-2cfc-4af0-969e-9f6d622a0db8 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:49.378797 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-be35e85f-2cfc-4af0-969e-9f6d622a0db8 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 200 len: 1291 microversion: 2.1 time: 0.356348 May 21 21:17:49.379749 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1015/1988] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:49 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 1291 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:49.384636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bfcd874e-24cf-47ea-a2b4-43269426362e tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc82d06a1f0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:49.462099 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bfcd874e-24cf-47ea-a2b4-43269426362e tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e" status: 200 len: 1438 microversion: 2.1 time: 0.081240 May 21 21:17:49.463367 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1016/1989] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:17:49 2022] GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e => generated 1438 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:49.468310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cf081711-ff6d-4cec-a835-507c4f6e2d01 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:49.473223 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cf081711-ff6d-4cec-a835-507c4f6e2d01 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:49.478126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7e301cb1-19a8-42d0-bbd6-7781a710c817 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:49.494112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cf081711-ff6d-4cec-a835-507c4f6e2d01 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:49.495354 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cf081711-ff6d-4cec-a835-507c4f6e2d01 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:49.495487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7e301cb1-19a8-42d0-bbd6-7781a710c817 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:49.495618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cf081711-ff6d-4cec-a835-507c4f6e2d01 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:49.495802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cf081711-ff6d-4cec-a835-507c4f6e2d01 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:49.496610 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7e301cb1-19a8-42d0-bbd6-7781a710c817 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:49.497830 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7e301cb1-19a8-42d0-bbd6-7781a710c817 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 1.090770 May 21 21:17:49.498404 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 974/1990] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:48 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:49.514104 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8d5c998b-d9c4-44a8-9f7a-631ae8ff6c47 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Action: 'update', calling method: .version_select at 0x7fc81b70d820>, body: {"quota_set": {"ram": 51200}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:49.634255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d5c998b-d9c4-44a8-9f7a-631ae8ff6c47 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:49.634995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d5c998b-d9c4-44a8-9f7a-631ae8ff6c47 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:49.636184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d5c998b-d9c4-44a8-9f7a-631ae8ff6c47 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:49.636887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d5c998b-d9c4-44a8-9f7a-631ae8ff6c47 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:49.730114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cf081711-ff6d-4cec-a835-507c4f6e2d01 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:49.739931 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cf081711-ff6d-4cec-a835-507c4f6e2d01 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439" status: 200 len: 1218 microversion: 2.1 time: 0.275096 May 21 21:17:49.740873 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1017/1991] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:49 2022] GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 => generated 1218 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:49.750136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-b7d16f3c-80f2-4f54-bc5f-6187cd66ea7f req-001db115-1226-4a28-b918-a835f9b849d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a55484-c74d-46c8-b37e-1fc43941e895", "name": "network-vif-unplugged", "status": "completed", "tag": "2b5fd365-20f9-4fcc-919f-6f7d08efba8b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:49.763299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b7d16f3c-80f2-4f54-bc5f-6187cd66ea7f req-001db115-1226-4a28-b918-a835f9b849d1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:49.763733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b7d16f3c-80f2-4f54-bc5f-6187cd66ea7f req-001db115-1226-4a28-b918-a835f9b849d1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:49.781934 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-b7d16f3c-80f2-4f54-bc5f-6187cd66ea7f req-001db115-1226-4a28-b918-a835f9b849d1 service nova] Creating event network-vif-unplugged:2b5fd365-20f9-4fcc-919f-6f7d08efba8b for instance c6a55484-c74d-46c8-b37e-1fc43941e895 on nch1-master-1 May 21 21:17:49.790564 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-b7d16f3c-80f2-4f54-bc5f-6187cd66ea7f req-001db115-1226-4a28-b918-a835f9b849d1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047967 May 21 21:17:49.792076 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1018/1992] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:49.891314 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8d5c998b-d9c4-44a8-9f7a-631ae8ff6c47 tempest-QuotasAdminNegativeTest-25387927 tempest-QuotasAdminNegativeTest-25387927-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/6c0cd10bfccf46b08cc9560172be4102" status: 200 len: 329 microversion: 2.1 time: 0.391829 May 21 21:17:49.892781 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 975/1993] 10.222.0.49 () {60 vars in 1261 bytes} [Sat May 21 21:17:49 2022] PUT /compute/v2.1/os-quota-sets/6c0cd10bfccf46b08cc9560172be4102 => generated 329 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:49.910155 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3f7d4247-4708-4be1-b5f5-7f388d3391be tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Action: 'update', calling method: .version_select at 0x7fc82d087670>, body: {"quota_set": {"ram": 0}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:49.921838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3f7d4247-4708-4be1-b5f5-7f388d3391be tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '00e1513821164b2ca1f5fb7e2db5339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0cd10bfccf46b08cc9560172be4102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3f7d4247-4708-4be1-b5f5-7f388d3391be tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Request method failure captured: May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: request: PUT /compute/v2.1/os-quota-sets/6c0cd10bfccf46b08cc9560172be4102 HTTP/1.1 May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 25 May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVbvlj2TB5WeoYktXznZ-PoNka5NOWUjbS5y7Hszx43GA-jBepPB0g0eDNKluQK8TRSDwWWxgQQthHFmZa8cwHcUTxcux5FEeMeo82DkjKBkLnl_LAlwkDRBbtRUxS5TtfTNzGnsD3sm3Ba3s1z_9s2jygwIVsrUbz_th9ucIE9vAYM May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 6c0cd10bfccf46b08cc9560172be4102 May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-QuotasAdminNegativeTest-1557501701 May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6c0cd10bfccf46b08cc9560172be4102"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6c0cd10bfccf46b08cc9560172be4102"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6c0cd10bfccf46b08cc9560172be4102", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6c0cd10bfccf46b08cc9560172be4102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-QuotasAdminNegativeTest-1557501701 May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 6c0cd10bfccf46b08cc9560172be4102 May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1557501701 May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-QuotasAdminNegativeTest-1557501701-project May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 00e1513821164b2ca1f5fb7e2db5339e May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-QuotasAdminNegativeTest-1557501701-project May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: {"quota_set": {"ram": 0}} May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '6c0cd10bfccf46b08cc9560172be4102', 'body': {'quota_set': {'ram': 0}}} May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:17:49.940266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:17:49.950943 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:17:49.950943 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:17:49.950943 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:17:49.950943 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:17:49.950943 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 21 21:17:49.950943 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:17:49.950943 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:17:49.950943 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:17:49.950943 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:49.950943 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:17:49.950943 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:17:49.950943 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:17:49.950943 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:17:49.950943 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 21 21:17:49.950943 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:17:49.950943 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3f7d4247-4708-4be1-b5f5-7f388d3391be tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:17:49.957992 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3f7d4247-4708-4be1-b5f5-7f388d3391be tempest-QuotasAdminNegativeTest-1557501701 tempest-QuotasAdminNegativeTest-1557501701-project] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/6c0cd10bfccf46b08cc9560172be4102" status: 403 len: 116 microversion: 2.1 time: 0.042721 May 21 21:17:49.961497 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1019/1994] 10.222.0.49 () {60 vars in 1261 bytes} [Sat May 21 21:17:49 2022] PUT /compute/v2.1/os-quota-sets/6c0cd10bfccf46b08cc9560172be4102 => generated 116 bytes in 62 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:17:50.000025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f1f5e4d1-0791-4b0b-a3ea-229d785aff86 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:50.000738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f1f5e4d1-0791-4b0b-a3ea-229d785aff86 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:50.041886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1f5e4d1-0791-4b0b-a3ea-229d785aff86 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:50.044530 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1f5e4d1-0791-4b0b-a3ea-229d785aff86 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:50.045500 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1f5e4d1-0791-4b0b-a3ea-229d785aff86 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:50.045967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1f5e4d1-0791-4b0b-a3ea-229d785aff86 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:50.396994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-62f7570a-1bdd-46a2-bb15-301e25cfa366 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:50.398375 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-62f7570a-1bdd-46a2-bb15-301e25cfa366 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:50.425395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-62f7570a-1bdd-46a2-bb15-301e25cfa366 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:50.427523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-62f7570a-1bdd-46a2-bb15-301e25cfa366 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:50.431400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-62f7570a-1bdd-46a2-bb15-301e25cfa366 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:50.432151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-62f7570a-1bdd-46a2-bb15-301e25cfa366 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:50.769782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-62f7570a-1bdd-46a2-bb15-301e25cfa366 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:50.782678 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-62f7570a-1bdd-46a2-bb15-301e25cfa366 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 200 len: 1291 microversion: 2.1 time: 0.390946 May 21 21:17:50.795445 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1020/1995] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:50 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 1291 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:17:50.801785 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-46394611-e6f2-4543-a629-9eee44f0f998 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc82d0cc940>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:50.904251 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-46394611-e6f2-4543-a629-9eee44f0f998 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e" status: 200 len: 1438 microversion: 2.1 time: 0.107441 May 21 21:17:50.905027 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1021/1996] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:17:50 2022] GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e => generated 1438 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:50.917553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d35f78bf-8469-40bb-a5ff-2b6d44e13ea4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:50.920572 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d35f78bf-8469-40bb-a5ff-2b6d44e13ea4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:50.949804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d35f78bf-8469-40bb-a5ff-2b6d44e13ea4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:50.949804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d35f78bf-8469-40bb-a5ff-2b6d44e13ea4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:50.951385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d35f78bf-8469-40bb-a5ff-2b6d44e13ea4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:50.952573 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d35f78bf-8469-40bb-a5ff-2b6d44e13ea4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:51.143005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f1f5e4d1-0791-4b0b-a3ea-229d785aff86 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:51.164072 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f1f5e4d1-0791-4b0b-a3ea-229d785aff86 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1354 microversion: 2.1 time: 1.164982 May 21 21:17:51.184004 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 976/1997] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:49 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1354 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:51.205612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bcdfd4ad-7cc2-499f-89df-27844583de5f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:51.206695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bcdfd4ad-7cc2-499f-89df-27844583de5f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:51.220955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bcdfd4ad-7cc2-499f-89df-27844583de5f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:51.221420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bcdfd4ad-7cc2-499f-89df-27844583de5f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:51.222774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bcdfd4ad-7cc2-499f-89df-27844583de5f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:51.223220 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bcdfd4ad-7cc2-499f-89df-27844583de5f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:51.270271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d35f78bf-8469-40bb-a5ff-2b6d44e13ea4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:51.285455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d35f78bf-8469-40bb-a5ff-2b6d44e13ea4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:51.290415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d35f78bf-8469-40bb-a5ff-2b6d44e13ea4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:51.292706 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d35f78bf-8469-40bb-a5ff-2b6d44e13ea4 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.386388 May 21 21:17:51.307421 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1022/1998] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:50 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:51.392861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3bae42a7-d77c-44fd-937d-b0e22931080b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:51.395553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3bae42a7-d77c-44fd-937d-b0e22931080b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:51.419194 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3bae42a7-d77c-44fd-937d-b0e22931080b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:51.420878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3bae42a7-d77c-44fd-937d-b0e22931080b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:51.426623 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3bae42a7-d77c-44fd-937d-b0e22931080b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:51.427230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3bae42a7-d77c-44fd-937d-b0e22931080b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:51.501514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3bae42a7-d77c-44fd-937d-b0e22931080b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:17:51.793881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bcdfd4ad-7cc2-499f-89df-27844583de5f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:51.812188 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bcdfd4ad-7cc2-499f-89df-27844583de5f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439" status: 200 len: 1266 microversion: 2.1 time: 0.635497 May 21 21:17:51.812919 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 977/1999] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:51 2022] GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 => generated 1266 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:51.879923 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9a138fb9-da19-4256-8ca5-90544a40e17e tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:51.879923 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9a138fb9-da19-4256-8ca5-90544a40e17e tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:51.879923 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a138fb9-da19-4256-8ca5-90544a40e17e tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:51.879923 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a138fb9-da19-4256-8ca5-90544a40e17e tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:51.879923 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a138fb9-da19-4256-8ca5-90544a40e17e tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:51.879923 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a138fb9-da19-4256-8ca5-90544a40e17e tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:52.161441 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3bae42a7-d77c-44fd-937d-b0e22931080b tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "DELETE /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 204 len: 0 microversion: 2.1 time: 0.785209 May 21 21:17:52.162307 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1023/2000] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:17:51 2022] DELETE /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 0 bytes in 790 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:17:52.172076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-694da43e-40e5-4788-8526-67ebc1eaedb2 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81bb9c9d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:52.264332 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-694da43e-40e5-4788-8526-67ebc1eaedb2 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e" status: 200 len: 1438 microversion: 2.1 time: 0.098446 May 21 21:17:52.265004 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1024/2001] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:17:52 2022] GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e => generated 1438 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:52.279658 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-ee680a99-2a85-4946-a132-8819dccaf7ee req-d31bde89-59f9-4485-9715-51826b09dff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a55484-c74d-46c8-b37e-1fc43941e895", "tag": "2b5fd365-20f9-4fcc-919f-6f7d08efba8b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:52.308508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ee680a99-2a85-4946-a132-8819dccaf7ee req-d31bde89-59f9-4485-9715-51826b09dff0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:52.309919 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ee680a99-2a85-4946-a132-8819dccaf7ee req-d31bde89-59f9-4485-9715-51826b09dff0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:52.354252 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-ee680a99-2a85-4946-a132-8819dccaf7ee req-d31bde89-59f9-4485-9715-51826b09dff0 service nova] Creating event network-changed:2b5fd365-20f9-4fcc-919f-6f7d08efba8b for instance c6a55484-c74d-46c8-b37e-1fc43941e895 on nch1-master-1 May 21 21:17:52.369681 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-ee680a99-2a85-4946-a132-8819dccaf7ee req-d31bde89-59f9-4485-9715-51826b09dff0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103012 May 21 21:17:52.375791 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1025/2002] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:52.400270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-08814eb6-8eee-487b-96b9-d2b67e3a4061 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:52.402189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-08814eb6-8eee-487b-96b9-d2b67e3a4061 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:52.414550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08814eb6-8eee-487b-96b9-d2b67e3a4061 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:52.415309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08814eb6-8eee-487b-96b9-d2b67e3a4061 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:52.416565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08814eb6-8eee-487b-96b9-d2b67e3a4061 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:52.417111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08814eb6-8eee-487b-96b9-d2b67e3a4061 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:52.863262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9a138fb9-da19-4256-8ca5-90544a40e17e tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:52.894899 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9a138fb9-da19-4256-8ca5-90544a40e17e tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 200 len: 1291 microversion: 2.1 time: 1.067632 May 21 21:17:52.896827 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 978/2003] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:51 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 1291 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:52.904746 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8d1a2c2c-f1e9-4893-99dc-00a20031af69 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:52.911699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8d1a2c2c-f1e9-4893-99dc-00a20031af69 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:52.915304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d1a2c2c-f1e9-4893-99dc-00a20031af69 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:52.917285 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d1a2c2c-f1e9-4893-99dc-00a20031af69 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:52.919026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d1a2c2c-f1e9-4893-99dc-00a20031af69 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:52.920780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d1a2c2c-f1e9-4893-99dc-00a20031af69 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:53.006801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-08814eb6-8eee-487b-96b9-d2b67e3a4061 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:53.056591 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-08814eb6-8eee-487b-96b9-d2b67e3a4061 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1501 microversion: 2.1 time: 0.668031 May 21 21:17:53.061072 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1026/2004] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:52 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1501 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:53.079997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-91ef1621-12b2-4292-83c7-3248a43833f0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:53.079997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-91ef1621-12b2-4292-83c7-3248a43833f0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:53.102393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-91ef1621-12b2-4292-83c7-3248a43833f0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:53.103297 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-91ef1621-12b2-4292-83c7-3248a43833f0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:53.105301 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-91ef1621-12b2-4292-83c7-3248a43833f0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:53.105866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-91ef1621-12b2-4292-83c7-3248a43833f0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:53.617498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8d1a2c2c-f1e9-4893-99dc-00a20031af69 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:53.633813 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8d1a2c2c-f1e9-4893-99dc-00a20031af69 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1354 microversion: 2.1 time: 0.733024 May 21 21:17:53.636685 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 979/2005] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:52 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1354 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:53.660353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c146398d-5382-48c8-90c5-8a4460d2e7f7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:53.663039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c146398d-5382-48c8-90c5-8a4460d2e7f7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:53.689421 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c146398d-5382-48c8-90c5-8a4460d2e7f7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:53.694316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c146398d-5382-48c8-90c5-8a4460d2e7f7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:53.698875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c146398d-5382-48c8-90c5-8a4460d2e7f7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:53.699777 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c146398d-5382-48c8-90c5-8a4460d2e7f7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:53.914469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c146398d-5382-48c8-90c5-8a4460d2e7f7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:53.926451 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c146398d-5382-48c8-90c5-8a4460d2e7f7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439" status: 200 len: 1272 microversion: 2.1 time: 0.284503 May 21 21:17:53.931412 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 980/2006] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:53 2022] GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 => generated 1272 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:53.947271 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-81ee2394-ee8d-4e73-82eb-cf98adf52ce2 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b6f6280>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:54.036706 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-81ee2394-ee8d-4e73-82eb-cf98adf52ce2 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e" status: 200 len: 1438 microversion: 2.1 time: 0.103865 May 21 21:17:54.038341 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 981/2007] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:17:53 2022] GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e => generated 1438 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:54.042379 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d261858c-cc9f-4312-8360-ff9fdfb2576b tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:54.043021 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d261858c-cc9f-4312-8360-ff9fdfb2576b tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:54.062079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d261858c-cc9f-4312-8360-ff9fdfb2576b tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:54.063102 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d261858c-cc9f-4312-8360-ff9fdfb2576b tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:54.063337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d261858c-cc9f-4312-8360-ff9fdfb2576b tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:54.063783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d261858c-cc9f-4312-8360-ff9fdfb2576b tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:54.196165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-91ef1621-12b2-4292-83c7-3248a43833f0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:54.209455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-91ef1621-12b2-4292-83c7-3248a43833f0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:54.211051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-91ef1621-12b2-4292-83c7-3248a43833f0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:54.220699 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-91ef1621-12b2-4292-83c7-3248a43833f0 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 1.140382 May 21 21:17:54.230711 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1027/2008] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:53 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:54.236141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-451f1044-8a31-4df4-a23d-2bc535406849 req-0d3d84a9-554b-44f2-920e-718eabf3909c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bd22b39-b6ee-4fbd-a518-98285883af10", "name": "network-vif-plugged", "status": "completed", "tag": "e6e7b9ba-54d7-426f-b099-2697c07707f7"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:54.245851 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-451f1044-8a31-4df4-a23d-2bc535406849 req-0d3d84a9-554b-44f2-920e-718eabf3909c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:54.246719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-451f1044-8a31-4df4-a23d-2bc535406849 req-0d3d84a9-554b-44f2-920e-718eabf3909c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:54.261751 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-451f1044-8a31-4df4-a23d-2bc535406849 req-0d3d84a9-554b-44f2-920e-718eabf3909c service nova] Creating event network-vif-plugged:e6e7b9ba-54d7-426f-b099-2697c07707f7 for instance 0bd22b39-b6ee-4fbd-a518-98285883af10 on nch2-master-1 May 21 21:17:54.269226 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-451f1044-8a31-4df4-a23d-2bc535406849 req-0d3d84a9-554b-44f2-920e-718eabf3909c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036217 May 21 21:17:54.273597 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1028/2009] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:54.281660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d8344c74-ef7b-41be-b2f8-cead38313644 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:54.282600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d8344c74-ef7b-41be-b2f8-cead38313644 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:54.303298 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8344c74-ef7b-41be-b2f8-cead38313644 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:54.305936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8344c74-ef7b-41be-b2f8-cead38313644 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:54.305936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8344c74-ef7b-41be-b2f8-cead38313644 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:54.305936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8344c74-ef7b-41be-b2f8-cead38313644 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:54.538679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d8344c74-ef7b-41be-b2f8-cead38313644 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:54.546908 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d8344c74-ef7b-41be-b2f8-cead38313644 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 200 len: 1459 microversion: 2.1 time: 0.271286 May 21 21:17:54.550213 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1029/2010] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:54 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 1459 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:54.565514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-40588427-8ae9-4806-9d21-0d2f380c8cd8 req-b6310557-88a7-47dc-a2ee-6141ff6ee7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc6789c-29a3-4a84-8045-36b96ce9e9fe", "name": "network-vif-deleted", "tag": "5f73169d-eef2-4b97-bed3-b8b63c509864"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:54.575597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-40588427-8ae9-4806-9d21-0d2f380c8cd8 req-b6310557-88a7-47dc-a2ee-6141ff6ee7f3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:54.576435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-40588427-8ae9-4806-9d21-0d2f380c8cd8 req-b6310557-88a7-47dc-a2ee-6141ff6ee7f3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:54.593399 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-40588427-8ae9-4806-9d21-0d2f380c8cd8 req-b6310557-88a7-47dc-a2ee-6141ff6ee7f3 service nova] Creating event network-vif-deleted:5f73169d-eef2-4b97-bed3-b8b63c509864 for instance afc6789c-29a3-4a84-8045-36b96ce9e9fe on nch1-master-1 May 21 21:17:54.600686 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-40588427-8ae9-4806-9d21-0d2f380c8cd8 req-b6310557-88a7-47dc-a2ee-6141ff6ee7f3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039929 May 21 21:17:54.602106 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1030/2011] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:17:54.673296 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9d2fe223-71f4-4188-9c45-eff374b42eb1 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:54.687783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9d2fe223-71f4-4188-9c45-eff374b42eb1 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:54.709331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d2fe223-71f4-4188-9c45-eff374b42eb1 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:54.709562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d2fe223-71f4-4188-9c45-eff374b42eb1 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:54.710299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d2fe223-71f4-4188-9c45-eff374b42eb1 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:54.710754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d2fe223-71f4-4188-9c45-eff374b42eb1 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:55.058315 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d261858c-cc9f-4312-8360-ff9fdfb2576b tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:55.063605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:55.076588 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d261858c-cc9f-4312-8360-ff9fdfb2576b tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 200 len: 1291 microversion: 2.1 time: 1.038196 May 21 21:17:55.077189 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 982/2012] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:54 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 1291 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:55.102140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-b1b4c3e0-4781-4d23-bbc9-804a352a6366 req-819ae249-c1bc-47f8-889e-96936d4867d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f63b08d-aaa7-4639-827f-d32bc60a78c8", "tag": "eee9373e-9e37-4ade-a694-8d3cfc96d47f"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:55.121925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b1b4c3e0-4781-4d23-bbc9-804a352a6366 req-819ae249-c1bc-47f8-889e-96936d4867d9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:55.122723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b1b4c3e0-4781-4d23-bbc9-804a352a6366 req-819ae249-c1bc-47f8-889e-96936d4867d9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:55.139288 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-b1b4c3e0-4781-4d23-bbc9-804a352a6366 req-819ae249-c1bc-47f8-889e-96936d4867d9 service nova] Creating event network-changed:eee9373e-9e37-4ade-a694-8d3cfc96d47f for instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 on nch2-master-1 May 21 21:17:55.152889 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-b1b4c3e0-4781-4d23-bbc9-804a352a6366 req-819ae249-c1bc-47f8-889e-96936d4867d9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069803 May 21 21:17:55.156123 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 983/2013] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:55.167678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3b97a7d0-92ac-4b2e-99ed-1c9ea24d4956 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:55.176903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3b97a7d0-92ac-4b2e-99ed-1c9ea24d4956 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:55.186650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b97a7d0-92ac-4b2e-99ed-1c9ea24d4956 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:55.187228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b97a7d0-92ac-4b2e-99ed-1c9ea24d4956 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:55.187894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b97a7d0-92ac-4b2e-99ed-1c9ea24d4956 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:55.188362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b97a7d0-92ac-4b2e-99ed-1c9ea24d4956 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:55.260951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9d2fe223-71f4-4188-9c45-eff374b42eb1 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:55.272460 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9d2fe223-71f4-4188-9c45-eff374b42eb1 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1354 microversion: 2.1 time: 0.620394 May 21 21:17:55.288856 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1031/2014] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:54 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1354 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:55.301601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-25cdccac-c29c-4db3-b547-5935a6c7ffcb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc82d087280>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:55.404820 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-25cdccac-c29c-4db3-b547-5935a6c7ffcb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e" status: 200 len: 1438 microversion: 2.1 time: 0.114345 May 21 21:17:55.405962 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1032/2015] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:17:55 2022] GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e => generated 1438 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:55.411261 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-88554446-bb41-45b5-be2f-b6ca6ea363af tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:55.411886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-88554446-bb41-45b5-be2f-b6ca6ea363af tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:55.418688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88554446-bb41-45b5-be2f-b6ca6ea363af tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:55.421931 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88554446-bb41-45b5-be2f-b6ca6ea363af tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:55.421931 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88554446-bb41-45b5-be2f-b6ca6ea363af tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:55.421931 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88554446-bb41-45b5-be2f-b6ca6ea363af tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:56.032690 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-88554446-bb41-45b5-be2f-b6ca6ea363af tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:56.034776 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3b97a7d0-92ac-4b2e-99ed-1c9ea24d4956 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:56.057113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-88554446-bb41-45b5-be2f-b6ca6ea363af tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:56.058973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-88554446-bb41-45b5-be2f-b6ca6ea363af tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:56.060190 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-88554446-bb41-45b5-be2f-b6ca6ea363af tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.653064 May 21 21:17:56.061683 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3b97a7d0-92ac-4b2e-99ed-1c9ea24d4956 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439" status: 200 len: 1314 microversion: 2.1 time: 0.903983 May 21 21:17:56.062641 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 984/2016] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:55 2022] GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 => generated 1314 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:56.076256 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1033/2017] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:55 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:56.081718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dd6b7459-5990-45ce-af1b-f7a476a904be tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:56.082340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dd6b7459-5990-45ce-af1b-f7a476a904be tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: afc6789c-29a3-4a84-8045-36b96ce9e9fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:56.085733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-63195109-bad1-4fd3-b2b2-053ca5a18237 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Action: 'create', calling method: .version_select at 0x7fc81b709430>, body: {"keypair": {"name": "tempest-keypair-551607892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfkVwPn3UJx/wI10+5NL12dfJZKp0HGVCeHKFTF/xq8eGcXvqkcyFhrfheg7fFZECab+Vd2fEcG0/EuySoXlVIYpfdLF31joCP0vDVRsRjWKZtQpiQxNJq9j1u1V0Wu2Q=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:56.100034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd6b7459-5990-45ce-af1b-f7a476a904be tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:56.100521 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd6b7459-5990-45ce-af1b-f7a476a904be tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:56.103791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd6b7459-5990-45ce-af1b-f7a476a904be tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:56.104246 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd6b7459-5990-45ce-af1b-f7a476a904be tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:56.108879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:56.118204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-63195109-bad1-4fd3-b2b2-053ca5a18237 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Getting quotas for project e409e3743001461b9dee85d7db50f6a0. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:17:56.132230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-63195109-bad1-4fd3-b2b2-053ca5a18237 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Getting quotas for user c07dc02a0f494ff99b010cf0447c8338 and project e409e3743001461b9dee85d7db50f6a0. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:17:56.147772 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-dd6b7459-5990-45ce-af1b-f7a476a904be tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] HTTP exception thrown: Instance afc6789c-29a3-4a84-8045-36b96ce9e9fe could not be found. May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dd6b7459-5990-45ce-af1b-f7a476a904be tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Request method failure captured: May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe HTTP/1.1 May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVV6T3RyEAuEj3kkohi5afNjIZDzMkbpGxSPkhUNQKESnkx5do8rKET_y9FZw2-faVyMNN9INAHvixRDp8oL8FaSX_bHY9TnjbhptGMff12ZRiPOqrrvdfcrZqPgNgT5Hu6C49vopI-OOHSmOYV9aBTZaIqng40vF4GFbrZSYyBOdE8 May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 5284da653ac24d73a21e8442609889c9 May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-LiveMigrationTest-1650172315 May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5284da653ac24d73a21e8442609889c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5284da653ac24d73a21e8442609889c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5284da653ac24d73a21e8442609889c9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5284da653ac24d73a21e8442609889c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-LiveMigrationTest-1650172315 May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 5284da653ac24d73a21e8442609889c9 May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-LiveMigrationTest-1650172315 May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-LiveMigrationTest-1650172315-project May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 34c22f04c3114d46b6b1b1168aa064f5 May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-LiveMigrationTest-1650172315-project May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance afc6789c-29a3-4a84-8045-36b96ce9e9fe could not be found. May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'afc6789c-29a3-4a84-8045-36b96ce9e9fe'} May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc6789c-29a3-4a84-8045-36b96ce9e9fe could not be found. May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc6789c-29a3-4a84-8045-36b96ce9e9fe could not be found. May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:17:56.150012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:17:56.155555 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:17:56.155555 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:17:56.155555 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:17:56.155555 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:17:56.155555 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:17:56.155555 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc6789c-29a3-4a84-8045-36b96ce9e9fe could not be found. May 21 21:17:56.155555 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:17:56.155555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dd6b7459-5990-45ce-af1b-f7a476a904be tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Returning 404 to user: Instance afc6789c-29a3-4a84-8045-36b96ce9e9fe could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:17:56.155555 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dd6b7459-5990-45ce-af1b-f7a476a904be tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe" status: 404 len: 111 microversion: 2.1 time: 0.077079 May 21 21:17:56.160136 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1034/2018] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:56 2022] GET /compute/v2.1/servers/afc6789c-29a3-4a84-8045-36b96ce9e9fe => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:17:56.166078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bbab73bb-a7c4-4829-b1f6-c7b928071803 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:56.167022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bbab73bb-a7c4-4829-b1f6-c7b928071803 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:56.171065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:56.177144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bbab73bb-a7c4-4829-b1f6-c7b928071803 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:56.177808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bbab73bb-a7c4-4829-b1f6-c7b928071803 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:56.178884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bbab73bb-a7c4-4829-b1f6-c7b928071803 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:56.179501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bbab73bb-a7c4-4829-b1f6-c7b928071803 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:56.246125 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-63195109-bad1-4fd3-b2b2-053ca5a18237 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.182193 May 21 21:17:56.251865 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 985/2019] 10.222.0.49 () {62 vars in 1199 bytes} [Sat May 21 21:17:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 184 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 21 21:17:56.252678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-44d41dda-b1c2-4a2d-aeb5-0232100d58ea tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:56.255143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-44d41dda-b1c2-4a2d-aeb5-0232100d58ea tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:56.269760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44d41dda-b1c2-4a2d-aeb5-0232100d58ea tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:56.270317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44d41dda-b1c2-4a2d-aeb5-0232100d58ea tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:56.272583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44d41dda-b1c2-4a2d-aeb5-0232100d58ea tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:56.279259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44d41dda-b1c2-4a2d-aeb5-0232100d58ea tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:56.340720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-44d41dda-b1c2-4a2d-aeb5-0232100d58ea tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:17:56.565619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bbab73bb-a7c4-4829-b1f6-c7b928071803 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:56.575148 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bbab73bb-a7c4-4829-b1f6-c7b928071803 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 200 len: 1291 microversion: 2.1 time: 0.413926 May 21 21:17:56.577525 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1035/2020] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:56 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 1291 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:56.589966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d9b44bf7-7e40-4043-aa7c-a9ecfb7d31b5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:56.590601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d9b44bf7-7e40-4043-aa7c-a9ecfb7d31b5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:56.610948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d9b44bf7-7e40-4043-aa7c-a9ecfb7d31b5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:56.611409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d9b44bf7-7e40-4043-aa7c-a9ecfb7d31b5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:56.612270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d9b44bf7-7e40-4043-aa7c-a9ecfb7d31b5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:56.612994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d9b44bf7-7e40-4043-aa7c-a9ecfb7d31b5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:56.780206 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-44d41dda-b1c2-4a2d-aeb5-0232100d58ea tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 204 len: 0 microversion: 2.1 time: 0.531427 May 21 21:17:56.781455 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 986/2021] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:17:56 2022] DELETE /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:17:56.788066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-abed3259-bacd-4924-b4a8-f9da155d79de tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc82d008310>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:56.870258 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-abed3259-bacd-4924-b4a8-f9da155d79de tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e" status: 200 len: 1438 microversion: 2.1 time: 0.087061 May 21 21:17:56.871618 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 987/2022] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:17:56 2022] GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e => generated 1438 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:56.881741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-62d0ae86-b16e-448b-8157-5212f8e49f10 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:56.882501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-62d0ae86-b16e-448b-8157-5212f8e49f10 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:56.901396 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62d0ae86-b16e-448b-8157-5212f8e49f10 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:56.901851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62d0ae86-b16e-448b-8157-5212f8e49f10 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:56.902647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62d0ae86-b16e-448b-8157-5212f8e49f10 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:56.903090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62d0ae86-b16e-448b-8157-5212f8e49f10 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:57.195535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d9b44bf7-7e40-4043-aa7c-a9ecfb7d31b5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:57.210040 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d9b44bf7-7e40-4043-aa7c-a9ecfb7d31b5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1354 microversion: 2.1 time: 0.625757 May 21 21:17:57.210735 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1036/2023] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:56 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1354 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:57.226455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9d14990f-e1fd-4faf-b56a-4bcda9067370 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:57.227079 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9d14990f-e1fd-4faf-b56a-4bcda9067370 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:57.263313 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d14990f-e1fd-4faf-b56a-4bcda9067370 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:57.265183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d14990f-e1fd-4faf-b56a-4bcda9067370 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:57.267707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d14990f-e1fd-4faf-b56a-4bcda9067370 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:57.269824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d14990f-e1fd-4faf-b56a-4bcda9067370 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:57.428080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=13 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:57.499710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=54 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:57.532187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-62d0ae86-b16e-448b-8157-5212f8e49f10 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:57.579125 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-62d0ae86-b16e-448b-8157-5212f8e49f10 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1486 microversion: 2.1 time: 0.705239 May 21 21:17:57.585636 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 988/2024] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:56 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1486 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:57.601226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2c0e4fed-fab6-4b66-97f2-4d197f8fe56b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:57.602305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2c0e4fed-fab6-4b66-97f2-4d197f8fe56b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:57.612093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c0e4fed-fab6-4b66-97f2-4d197f8fe56b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:57.622032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c0e4fed-fab6-4b66-97f2-4d197f8fe56b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:57.622032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c0e4fed-fab6-4b66-97f2-4d197f8fe56b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:57.622032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c0e4fed-fab6-4b66-97f2-4d197f8fe56b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:57.964955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9d14990f-e1fd-4faf-b56a-4bcda9067370 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:57.982284 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9d14990f-e1fd-4faf-b56a-4bcda9067370 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439" status: 200 len: 1314 microversion: 2.1 time: 0.767002 May 21 21:17:57.983196 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1037/2025] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:57 2022] GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 => generated 1314 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:57.989916 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f4a459a6-a25a-42ee-886f-05f9843a0778 req-08fc81e1-781a-4b6e-a8ab-7fad3605d847 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f63b08d-aaa7-4639-827f-d32bc60a78c8", "tag": "727bcbb6-7735-41db-859d-5524186926b9"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:58.008869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f4a459a6-a25a-42ee-886f-05f9843a0778 req-08fc81e1-781a-4b6e-a8ab-7fad3605d847 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:58.008869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f4a459a6-a25a-42ee-886f-05f9843a0778 req-08fc81e1-781a-4b6e-a8ab-7fad3605d847 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:58.021905 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f4a459a6-a25a-42ee-886f-05f9843a0778 req-08fc81e1-781a-4b6e-a8ab-7fad3605d847 service nova] Creating event network-changed:727bcbb6-7735-41db-859d-5524186926b9 for instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 on nch2-master-1 May 21 21:17:58.043870 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f4a459a6-a25a-42ee-886f-05f9843a0778 req-08fc81e1-781a-4b6e-a8ab-7fad3605d847 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055290 May 21 21:17:58.046914 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1038/2026] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:58.061771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-eb7e40b4-0c6a-4332-9be1-61c3f8039468 req-00bf9238-5a2d-4610-81c2-9eda26701538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9e520cb-58ff-4e71-bf09-f171b2d09439", "tag": "7fc4e4c5-c1ef-4e72-8b4d-d8c80f413ad1"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:17:58.083995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-eb7e40b4-0c6a-4332-9be1-61c3f8039468 req-00bf9238-5a2d-4610-81c2-9eda26701538 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:58.084996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-eb7e40b4-0c6a-4332-9be1-61c3f8039468 req-00bf9238-5a2d-4610-81c2-9eda26701538 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:58.107286 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-eb7e40b4-0c6a-4332-9be1-61c3f8039468 req-00bf9238-5a2d-4610-81c2-9eda26701538 service nova] Creating event network-changed:7fc4e4c5-c1ef-4e72-8b4d-d8c80f413ad1 for instance e9e520cb-58ff-4e71-bf09-f171b2d09439 on nch1-master-1 May 21 21:17:58.113400 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-eb7e40b4-0c6a-4332-9be1-61c3f8039468 req-00bf9238-5a2d-4610-81c2-9eda26701538 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063863 May 21 21:17:58.114641 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1039/2027] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:58.120658 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d5b73efb-b243-43ee-be38-53e42fb1f654 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:58.123719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d5b73efb-b243-43ee-be38-53e42fb1f654 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:58.129770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5b73efb-b243-43ee-be38-53e42fb1f654 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:58.130513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5b73efb-b243-43ee-be38-53e42fb1f654 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:58.131613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5b73efb-b243-43ee-be38-53e42fb1f654 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:58.132568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5b73efb-b243-43ee-be38-53e42fb1f654 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:58.541723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d5b73efb-b243-43ee-be38-53e42fb1f654 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:58.555476 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d5b73efb-b243-43ee-be38-53e42fb1f654 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 200 len: 1482 microversion: 2.1 time: 0.439302 May 21 21:17:58.561261 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1040/2028] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:58 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 1482 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:58.604326 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8945a2e5-670b-4023-8998-d6eaee5328d3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc82d0d0af0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:58.688328 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8945a2e5-670b-4023-8998-d6eaee5328d3 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e" status: 200 len: 1438 microversion: 2.1 time: 0.121336 May 21 21:17:58.688886 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1041/2029] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:17:58 2022] GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e => generated 1438 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:58.712080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-48933577-2240-4e70-a4ee-fd621391b1c5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:58.714749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-48933577-2240-4e70-a4ee-fd621391b1c5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:58.759137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48933577-2240-4e70-a4ee-fd621391b1c5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:58.759702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48933577-2240-4e70-a4ee-fd621391b1c5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:58.760624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48933577-2240-4e70-a4ee-fd621391b1c5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:58.761136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48933577-2240-4e70-a4ee-fd621391b1c5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:58.958296 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-48933577-2240-4e70-a4ee-fd621391b1c5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:58.967267 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-48933577-2240-4e70-a4ee-fd621391b1c5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1354 microversion: 2.1 time: 0.271774 May 21 21:17:58.968118 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1042/2030] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:58 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1354 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:58.974467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c11505e2-8076-41cc-9f16-4ec8ce66ae90 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:58.975220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c11505e2-8076-41cc-9f16-4ec8ce66ae90 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:58.981874 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c11505e2-8076-41cc-9f16-4ec8ce66ae90 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:58.982334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c11505e2-8076-41cc-9f16-4ec8ce66ae90 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:58.983153 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c11505e2-8076-41cc-9f16-4ec8ce66ae90 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:58.983642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c11505e2-8076-41cc-9f16-4ec8ce66ae90 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:59.080546 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c11505e2-8076-41cc-9f16-4ec8ce66ae90 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110919 May 21 21:17:59.081881 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1043/2031] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 21:17:58 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:17:59.086564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-264f47c2-2abe-458a-9c6b-082b00612c5a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:59.087184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-264f47c2-2abe-458a-9c6b-082b00612c5a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:59.093780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-264f47c2-2abe-458a-9c6b-082b00612c5a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:59.094238 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-264f47c2-2abe-458a-9c6b-082b00612c5a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:59.095022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-264f47c2-2abe-458a-9c6b-082b00612c5a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:59.095636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-264f47c2-2abe-458a-9c6b-082b00612c5a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:59.108743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2c0e4fed-fab6-4b66-97f2-4d197f8fe56b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:59.121684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2c0e4fed-fab6-4b66-97f2-4d197f8fe56b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:59.123888 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2c0e4fed-fab6-4b66-97f2-4d197f8fe56b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:59.125364 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2c0e4fed-fab6-4b66-97f2-4d197f8fe56b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 1.535957 May 21 21:17:59.126438 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 989/2032] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:17:57 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:17:59.135870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-75fc4837-ea67-4788-bdd7-c2aa5fe77779 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:59.136718 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-75fc4837-ea67-4788-bdd7-c2aa5fe77779 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:17:59.152406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-75fc4837-ea67-4788-bdd7-c2aa5fe77779 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:59.152863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-75fc4837-ea67-4788-bdd7-c2aa5fe77779 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:59.153684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-75fc4837-ea67-4788-bdd7-c2aa5fe77779 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:17:59.154122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-75fc4837-ea67-4788-bdd7-c2aa5fe77779 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:17:59.588969 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-75fc4837-ea67-4788-bdd7-c2aa5fe77779 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:59.610169 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-75fc4837-ea67-4788-bdd7-c2aa5fe77779 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439" status: 200 len: 1314 microversion: 2.1 time: 0.480528 May 21 21:17:59.611793 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 990/2033] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:59 2022] GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:59.703352 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5beba0fb-e539-4426-8967-3b6a9ee33edc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b70db80>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:59.715897 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=20 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:59.783610 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5beba0fb-e539-4426-8967-3b6a9ee33edc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e" status: 200 len: 1438 microversion: 2.1 time: 0.084919 May 21 21:17:59.791947 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 991/2034] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:17:59 2022] GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e => generated 1438 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:59.950011 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-264f47c2-2abe-458a-9c6b-082b00612c5a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:17:59.962676 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-264f47c2-2abe-458a-9c6b-082b00612c5a tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 200 len: 1486 microversion: 2.1 time: 0.879724 May 21 21:17:59.981704 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1044/2035] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:59 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 1486 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:17:59.986446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6808017c-c935-428a-ab83-5e30c2c4954b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:17:59.988700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6808017c-c935-428a-ab83-5e30c2c4954b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:00.029431 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6808017c-c935-428a-ab83-5e30c2c4954b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:00.030205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6808017c-c935-428a-ab83-5e30c2c4954b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:00.032250 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6808017c-c935-428a-ab83-5e30c2c4954b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:00.033213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6808017c-c935-428a-ab83-5e30c2c4954b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:00.146380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5f484b33-6b7b-44e9-98ff-0f9433ebba02 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:00.147013 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5f484b33-6b7b-44e9-98ff-0f9433ebba02 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:00.166125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5f484b33-6b7b-44e9-98ff-0f9433ebba02 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:00.166954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5f484b33-6b7b-44e9-98ff-0f9433ebba02 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:00.168202 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5f484b33-6b7b-44e9-98ff-0f9433ebba02 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:00.181097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5f484b33-6b7b-44e9-98ff-0f9433ebba02 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:00.713873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6808017c-c935-428a-ab83-5e30c2c4954b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:00.731995 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6808017c-c935-428a-ab83-5e30c2c4954b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1354 microversion: 2.1 time: 0.747064 May 21 21:18:00.742628 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 992/2036] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:17:59 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1354 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:00.748699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-01700210-b03a-48fe-9ba4-7f6719767367 req-2db124dd-2b2f-4103-a379-f9adbfaa7cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f63b08d-aaa7-4639-827f-d32bc60a78c8", "tag": "ed56d410-5713-462c-bfbe-91491c8c21c6"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:00.771278 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-01700210-b03a-48fe-9ba4-7f6719767367 req-2db124dd-2b2f-4103-a379-f9adbfaa7cb3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:00.777218 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-01700210-b03a-48fe-9ba4-7f6719767367 req-2db124dd-2b2f-4103-a379-f9adbfaa7cb3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:00.804583 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-01700210-b03a-48fe-9ba4-7f6719767367 req-2db124dd-2b2f-4103-a379-f9adbfaa7cb3 service nova] Creating event network-changed:ed56d410-5713-462c-bfbe-91491c8c21c6 for instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 on nch2-master-1 May 21 21:18:00.815098 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-01700210-b03a-48fe-9ba4-7f6719767367 req-2db124dd-2b2f-4103-a379-f9adbfaa7cb3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071314 May 21 21:18:00.816432 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 993/2037] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:00.826987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-f3b03277-8b7e-482e-bfb3-ea3edbb8306f req-0192eea7-3788-4f52-823c-587271b4f7ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1861c5f-d59a-4d75-9849-ecd40aeb32fe", "name": "network-vif-deleted", "tag": "f0278179-1509-4b53-9291-18dd7c351135"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:00.848539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f3b03277-8b7e-482e-bfb3-ea3edbb8306f req-0192eea7-3788-4f52-823c-587271b4f7ff service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:00.849033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f3b03277-8b7e-482e-bfb3-ea3edbb8306f req-0192eea7-3788-4f52-823c-587271b4f7ff service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:00.887564 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-f3b03277-8b7e-482e-bfb3-ea3edbb8306f req-0192eea7-3788-4f52-823c-587271b4f7ff service nova] Creating event network-vif-deleted:f0278179-1509-4b53-9291-18dd7c351135 for instance d1861c5f-d59a-4d75-9849-ecd40aeb32fe on nch1-master-1 May 21 21:18:00.901143 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-f3b03277-8b7e-482e-bfb3-ea3edbb8306f req-0192eea7-3788-4f52-823c-587271b4f7ff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082851 May 21 21:18:00.902578 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 994/2038] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:01.068576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-63e569ff-57a9-4f30-9bc0-79014973cfb5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-70468387", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:01.136091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-63e569ff-57a9-4f30-9bc0-79014973cfb5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] validate_networks() for None {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:18:01.619650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5f484b33-6b7b-44e9-98ff-0f9433ebba02 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:01.638998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5f484b33-6b7b-44e9-98ff-0f9433ebba02 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:01.642881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5f484b33-6b7b-44e9-98ff-0f9433ebba02 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:01.647691 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5f484b33-6b7b-44e9-98ff-0f9433ebba02 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 1.506957 May 21 21:18:01.650923 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1045/2039] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:00 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:18:01.682776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f77844f2-b098-4982-a570-93acdf4ec6ca tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:01.687480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f77844f2-b098-4982-a570-93acdf4ec6ca tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:01.706728 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f77844f2-b098-4982-a570-93acdf4ec6ca tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:01.712543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f77844f2-b098-4982-a570-93acdf4ec6ca tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:01.715790 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f77844f2-b098-4982-a570-93acdf4ec6ca tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:01.716489 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f77844f2-b098-4982-a570-93acdf4ec6ca tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:02.348521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-63e569ff-57a9-4f30-9bc0-79014973cfb5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:18:02.349505 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-63e569ff-57a9-4f30-9bc0-79014973cfb5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:18:02.352412 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-63e569ff-57a9-4f30-9bc0-79014973cfb5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:18:02.352412 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-63e569ff-57a9-4f30-9bc0-79014973cfb5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:18:02.352412 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-63e569ff-57a9-4f30-9bc0-79014973cfb5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:18:02.352768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f77844f2-b098-4982-a570-93acdf4ec6ca tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:02.360468 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f77844f2-b098-4982-a570-93acdf4ec6ca tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439" status: 200 len: 1314 microversion: 2.1 time: 0.692194 May 21 21:18:02.361021 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1046/2040] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:01 2022] GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 => generated 1314 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:02.369190 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3297e7c3-149c-48f8-a807-37e4a97569d7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81bb733a0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:02.374583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63e569ff-57a9-4f30-9bc0-79014973cfb5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:02.375288 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63e569ff-57a9-4f30-9bc0-79014973cfb5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:02.376362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63e569ff-57a9-4f30-9bc0-79014973cfb5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:02.376983 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63e569ff-57a9-4f30-9bc0-79014973cfb5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:02.456461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-63e569ff-57a9-4f30-9bc0-79014973cfb5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Getting quotas for project 38e743b29f0d4b9899537992aad63696. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:18:02.462428 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3297e7c3-149c-48f8-a807-37e4a97569d7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e" status: 200 len: 1438 microversion: 2.1 time: 0.093969 May 21 21:18:02.462428 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1047/2041] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:18:02 2022] GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e => generated 1438 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:02.470757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-63e569ff-57a9-4f30-9bc0-79014973cfb5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Getting quotas for user 10d6821eac1b49e986073f36962b3046 and project 38e743b29f0d4b9899537992aad63696. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:18:02.475469 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f5a949ab-df06-4e6c-898f-a205a2a2ebdd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:02.489277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f5a949ab-df06-4e6c-898f-a205a2a2ebdd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: d1861c5f-d59a-4d75-9849-ecd40aeb32fe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:02.493353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-63e569ff-57a9-4f30-9bc0-79014973cfb5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:18:02.495974 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-63e569ff-57a9-4f30-9bc0-79014973cfb5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] [instance: 8af764f8-b932-44e9-a9ca-abe1d1238e8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:18:02.496353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5a949ab-df06-4e6c-898f-a205a2a2ebdd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:02.496918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5a949ab-df06-4e6c-898f-a205a2a2ebdd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:02.497795 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5a949ab-df06-4e6c-898f-a205a2a2ebdd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:02.498417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5a949ab-df06-4e6c-898f-a205a2a2ebdd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:02.526200 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-f5a949ab-df06-4e6c-898f-a205a2a2ebdd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] HTTP exception thrown: Instance d1861c5f-d59a-4d75-9849-ecd40aeb32fe could not be found. May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f5a949ab-df06-4e6c-898f-a205a2a2ebdd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Request method failure captured: May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe HTTP/1.1 May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVV6T3RyEAuEj3kkohi5afNjIZDzMkbpGxSPkhUNQKESnkx5do8rKET_y9FZw2-faVyMNN9INAHvixRDp8oL8FaSX_bHY9TnjbhptGMff12ZRiPOqrrvdfcrZqPgNgT5Hu6C49vopI-OOHSmOYV9aBTZaIqng40vF4GFbrZSYyBOdE8 May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 5284da653ac24d73a21e8442609889c9 May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-LiveMigrationTest-1650172315 May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5284da653ac24d73a21e8442609889c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5284da653ac24d73a21e8442609889c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5284da653ac24d73a21e8442609889c9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5284da653ac24d73a21e8442609889c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-LiveMigrationTest-1650172315 May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 5284da653ac24d73a21e8442609889c9 May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-LiveMigrationTest-1650172315 May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-LiveMigrationTest-1650172315-project May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 34c22f04c3114d46b6b1b1168aa064f5 May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-LiveMigrationTest-1650172315-project May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance d1861c5f-d59a-4d75-9849-ecd40aeb32fe could not be found. May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'd1861c5f-d59a-4d75-9849-ecd40aeb32fe'} May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1861c5f-d59a-4d75-9849-ecd40aeb32fe could not be found. May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1861c5f-d59a-4d75-9849-ecd40aeb32fe could not be found. May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:02.541219 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:02.555133 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:02.555133 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:02.555133 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:02.555133 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:02.555133 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:02.555133 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1861c5f-d59a-4d75-9849-ecd40aeb32fe could not be found. May 21 21:18:02.555133 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:02.555133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f5a949ab-df06-4e6c-898f-a205a2a2ebdd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Returning 404 to user: Instance d1861c5f-d59a-4d75-9849-ecd40aeb32fe could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:02.555133 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f5a949ab-df06-4e6c-898f-a205a2a2ebdd tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe" status: 404 len: 111 microversion: 2.1 time: 0.081787 May 21 21:18:02.555133 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1048/2042] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:02 2022] GET /compute/v2.1/servers/d1861c5f-d59a-4d75-9849-ecd40aeb32fe => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:18:02.555133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-166e09c2-ca10-422c-a63d-6a1d4c1fc66b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:02.557658 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-166e09c2-ca10-422c-a63d-6a1d4c1fc66b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:02.567564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-166e09c2-ca10-422c-a63d-6a1d4c1fc66b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:02.568172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-166e09c2-ca10-422c-a63d-6a1d4c1fc66b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:02.569092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-166e09c2-ca10-422c-a63d-6a1d4c1fc66b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:02.570647 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-166e09c2-ca10-422c-a63d-6a1d4c1fc66b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:02.613082 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-63e569ff-57a9-4f30-9bc0-79014973cfb5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.708708 May 21 21:18:02.613746 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 995/2043] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:18:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:18:02.618769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-23557881-de9b-43e9-a16f-b4bcc6b56649 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:02.625265 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-23557881-de9b-43e9-a16f-b4bcc6b56649 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:02.632805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-23557881-de9b-43e9-a16f-b4bcc6b56649 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:02.633489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-23557881-de9b-43e9-a16f-b4bcc6b56649 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:02.634476 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-23557881-de9b-43e9-a16f-b4bcc6b56649 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:02.635116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-23557881-de9b-43e9-a16f-b4bcc6b56649 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:02.694680 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-23557881-de9b-43e9-a16f-b4bcc6b56649 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:18:02.962496 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:02.972600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-166e09c2-ca10-422c-a63d-6a1d4c1fc66b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:03.025547 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-166e09c2-ca10-422c-a63d-6a1d4c1fc66b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1354 microversion: 2.1 time: 0.477717 May 21 21:18:03.027710 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1049/2044] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:02 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1354 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:03.038607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a25d2998-28f9-422a-929d-c94e8c0451e1 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:03.045751 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a25d2998-28f9-422a-929d-c94e8c0451e1 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] [instance: 8af764f8-b932-44e9-a9ca-abe1d1238e8b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:03.072662 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-23557881-de9b-43e9-a16f-b4bcc6b56649 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 204 len: 0 microversion: 2.1 time: 0.457594 May 21 21:18:03.073265 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 996/2045] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:18:02 2022] DELETE /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:18:03.084267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f38c6fa5-f349-461f-aaba-f0af48542c44 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:03.087850 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f38c6fa5-f349-461f-aaba-f0af48542c44 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:03.108812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f38c6fa5-f349-461f-aaba-f0af48542c44 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:03.109663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f38c6fa5-f349-461f-aaba-f0af48542c44 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:03.110889 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f38c6fa5-f349-461f-aaba-f0af48542c44 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:03.112379 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f38c6fa5-f349-461f-aaba-f0af48542c44 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:03.166226 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a25d2998-28f9-422a-929d-c94e8c0451e1 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d6821eac1b49e986073f36962b3046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e743b29f0d4b9899537992aad63696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:03.181413 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a25d2998-28f9-422a-929d-c94e8c0451e1 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] 10.222.0.49 "GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b" status: 200 len: 1221 microversion: 2.1 time: 0.146902 May 21 21:18:03.183137 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1050/2046] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:03 2022] GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b => generated 1221 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:03.200875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6020b9c4-b68f-49e5-bfc3-ee3535017f7a tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:03.203555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6020b9c4-b68f-49e5-bfc3-ee3535017f7a tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:03.223362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6020b9c4-b68f-49e5-bfc3-ee3535017f7a tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:03.225818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6020b9c4-b68f-49e5-bfc3-ee3535017f7a tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:03.227054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6020b9c4-b68f-49e5-bfc3-ee3535017f7a tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:03.229052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6020b9c4-b68f-49e5-bfc3-ee3535017f7a tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:03.768644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6020b9c4-b68f-49e5-bfc3-ee3535017f7a tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:03.781962 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6020b9c4-b68f-49e5-bfc3-ee3535017f7a tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 200 len: 1482 microversion: 2.1 time: 0.593018 May 21 21:18:03.789196 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1051/2047] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:03 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 1482 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:03.801545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-4a6a3cda-b9f6-4e4c-bca7-ee5b5642ae1d req-a9d1a8ef-aefe-40a8-b118-1b7e23061c74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bd22b39-b6ee-4fbd-a518-98285883af10", "tag": "e6e7b9ba-54d7-426f-b099-2697c07707f7"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:03.824129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-4a6a3cda-b9f6-4e4c-bca7-ee5b5642ae1d req-a9d1a8ef-aefe-40a8-b118-1b7e23061c74 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:03.824878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-4a6a3cda-b9f6-4e4c-bca7-ee5b5642ae1d req-a9d1a8ef-aefe-40a8-b118-1b7e23061c74 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:03.858636 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-4a6a3cda-b9f6-4e4c-bca7-ee5b5642ae1d req-a9d1a8ef-aefe-40a8-b118-1b7e23061c74 service nova] Creating event network-changed:e6e7b9ba-54d7-426f-b099-2697c07707f7 for instance 0bd22b39-b6ee-4fbd-a518-98285883af10 on nch2-master-1 May 21 21:18:03.866026 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-4a6a3cda-b9f6-4e4c-bca7-ee5b5642ae1d req-a9d1a8ef-aefe-40a8-b118-1b7e23061c74 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075108 May 21 21:18:03.867131 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1052/2048] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:03.879288 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-af97e25b-5439-4867-a637-d92d43c9e84d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:03.882503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-af97e25b-5439-4867-a637-d92d43c9e84d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:03.898728 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af97e25b-5439-4867-a637-d92d43c9e84d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:03.901601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af97e25b-5439-4867-a637-d92d43c9e84d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:03.905085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af97e25b-5439-4867-a637-d92d43c9e84d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:03.905871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af97e25b-5439-4867-a637-d92d43c9e84d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:03.911305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f38c6fa5-f349-461f-aaba-f0af48542c44 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:03.925803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f38c6fa5-f349-461f-aaba-f0af48542c44 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:03.927762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f38c6fa5-f349-461f-aaba-f0af48542c44 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:03.932015 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f38c6fa5-f349-461f-aaba-f0af48542c44 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1486 microversion: 2.25 time: 0.854542 May 21 21:18:03.934874 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 997/2049] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:03 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1486 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:03.950496 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dcc0e9d3-cfa6-47a2-bcf8-88e021e66812 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:03.958523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dcc0e9d3-cfa6-47a2-bcf8-88e021e66812 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:03.984528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dcc0e9d3-cfa6-47a2-bcf8-88e021e66812 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:03.984929 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dcc0e9d3-cfa6-47a2-bcf8-88e021e66812 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:03.988219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dcc0e9d3-cfa6-47a2-bcf8-88e021e66812 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:03.988717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dcc0e9d3-cfa6-47a2-bcf8-88e021e66812 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:04.318583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-af97e25b-5439-4867-a637-d92d43c9e84d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:04.332942 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-af97e25b-5439-4867-a637-d92d43c9e84d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1500 microversion: 2.1 time: 0.464398 May 21 21:18:04.338106 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1053/2050] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:03 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1500 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:04.349893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-65620fae-22eb-4a0b-a86b-051fd3db06da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc82d090ee0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:04.447450 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-65620fae-22eb-4a0b-a86b-051fd3db06da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e" status: 200 len: 1438 microversion: 2.1 time: 0.110149 May 21 21:18:04.448089 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1054/2051] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:18:04 2022] GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e => generated 1438 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:04.464118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-29faa15f-b15e-4b22-bf6f-8c81ff72b6c9 req-4a1d977c-b92d-478b-a03b-48132d5de451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9e520cb-58ff-4e71-bf09-f171b2d09439", "name": "network-vif-plugged", "status": "completed", "tag": "7fc4e4c5-c1ef-4e72-8b4d-d8c80f413ad1"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:04.489596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-29faa15f-b15e-4b22-bf6f-8c81ff72b6c9 req-4a1d977c-b92d-478b-a03b-48132d5de451 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:04.490042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-29faa15f-b15e-4b22-bf6f-8c81ff72b6c9 req-4a1d977c-b92d-478b-a03b-48132d5de451 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:04.519804 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-29faa15f-b15e-4b22-bf6f-8c81ff72b6c9 req-4a1d977c-b92d-478b-a03b-48132d5de451 service nova] Creating event network-vif-plugged:7fc4e4c5-c1ef-4e72-8b4d-d8c80f413ad1 for instance e9e520cb-58ff-4e71-bf09-f171b2d09439 on nch1-master-1 May 21 21:18:04.534931 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-29faa15f-b15e-4b22-bf6f-8c81ff72b6c9 req-4a1d977c-b92d-478b-a03b-48132d5de451 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084986 May 21 21:18:04.551325 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1055/2052] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:04.567174 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3265714c-fa94-4a0d-8dba-2850d184a43d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:04.568266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3265714c-fa94-4a0d-8dba-2850d184a43d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:04.584374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3265714c-fa94-4a0d-8dba-2850d184a43d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:04.585480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3265714c-fa94-4a0d-8dba-2850d184a43d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:04.587971 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3265714c-fa94-4a0d-8dba-2850d184a43d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:04.589789 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3265714c-fa94-4a0d-8dba-2850d184a43d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:05.076820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3265714c-fa94-4a0d-8dba-2850d184a43d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:05.087871 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3265714c-fa94-4a0d-8dba-2850d184a43d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1354 microversion: 2.1 time: 0.531400 May 21 21:18:05.089131 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1056/2053] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:04 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1354 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:05.098122 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d4e36b11-468a-4d8e-b53b-e04661fa7ff5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:05.099417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d4e36b11-468a-4d8e-b53b-e04661fa7ff5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] [instance: 8af764f8-b932-44e9-a9ca-abe1d1238e8b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:05.111410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d4e36b11-468a-4d8e-b53b-e04661fa7ff5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:05.114831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d4e36b11-468a-4d8e-b53b-e04661fa7ff5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:05.116212 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d4e36b11-468a-4d8e-b53b-e04661fa7ff5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:05.117649 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d4e36b11-468a-4d8e-b53b-e04661fa7ff5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:05.230497 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d4e36b11-468a-4d8e-b53b-e04661fa7ff5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d6821eac1b49e986073f36962b3046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e743b29f0d4b9899537992aad63696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:05.240578 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d4e36b11-468a-4d8e-b53b-e04661fa7ff5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] 10.222.0.49 "GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b" status: 200 len: 1225 microversion: 2.1 time: 0.149980 May 21 21:18:05.241184 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1057/2054] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:05 2022] GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b => generated 1225 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:05.246083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d3c0a556-263b-4b97-83c5-1c98d9d40b46 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:05.246799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d3c0a556-263b-4b97-83c5-1c98d9d40b46 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:05.261985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3c0a556-263b-4b97-83c5-1c98d9d40b46 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:05.262447 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3c0a556-263b-4b97-83c5-1c98d9d40b46 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:05.264347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3c0a556-263b-4b97-83c5-1c98d9d40b46 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:05.264802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3c0a556-263b-4b97-83c5-1c98d9d40b46 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:05.498735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d3c0a556-263b-4b97-83c5-1c98d9d40b46 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:05.526389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d3c0a556-263b-4b97-83c5-1c98d9d40b46 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:05.527910 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d3c0a556-263b-4b97-83c5-1c98d9d40b46 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:05.531103 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d3c0a556-263b-4b97-83c5-1c98d9d40b46 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1476 microversion: 2.25 time: 0.288846 May 21 21:18:05.551540 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1058/2055] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:05 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1476 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:05.557649 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fe1cbfee-4ee0-47e7-a5e3-43e02e2f970d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:05.558275 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fe1cbfee-4ee0-47e7-a5e3-43e02e2f970d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:05.573757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe1cbfee-4ee0-47e7-a5e3-43e02e2f970d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:05.574283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe1cbfee-4ee0-47e7-a5e3-43e02e2f970d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:05.575292 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe1cbfee-4ee0-47e7-a5e3-43e02e2f970d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:05.575803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe1cbfee-4ee0-47e7-a5e3-43e02e2f970d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:05.596683 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:05.662224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fe1cbfee-4ee0-47e7-a5e3-43e02e2f970d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:05.704388 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fe1cbfee-4ee0-47e7-a5e3-43e02e2f970d tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1296 microversion: 2.1 time: 0.150411 May 21 21:18:05.706089 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1059/2056] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:05 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1296 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:05.712924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6a7bfed9-3ee0-47f0-8db4-b6089a2e3e42 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc82d049af0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:05.804317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dcc0e9d3-cfa6-47a2-bcf8-88e021e66812 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:05.835116 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dcc0e9d3-cfa6-47a2-bcf8-88e021e66812 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439" status: 200 len: 1314 microversion: 2.1 time: 1.897937 May 21 21:18:05.835701 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 998/2057] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:03 2022] GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 => generated 1314 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:05.837482 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6a7bfed9-3ee0-47f0-8db4-b6089a2e3e42 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e" status: 200 len: 1438 microversion: 2.1 time: 0.130011 May 21 21:18:05.838430 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1060/2058] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:18:05 2022] GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e => generated 1438 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:05.841068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3184c402-4f6f-43ee-81ef-3bfd0740a6a0 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '.version_select at 0x7fc82d008310>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:05.845148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3184c402-4f6f-43ee-81ef-3bfd0740a6a0 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:05.845688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3184c402-4f6f-43ee-81ef-3bfd0740a6a0 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:05.862562 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3184c402-4f6f-43ee-81ef-3bfd0740a6a0 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 2363 microversion: 2.25 time: 0.024423 May 21 21:18:05.864007 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 999/2059] 10.222.0.49 () {60 vars in 1183 bytes} [Sat May 21 21:18:05 2022] GET /compute/v2.1/os-migrations => generated 2363 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:05.878573 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c9952b8a-bd0d-4d69-851d-c3d36c60c327 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:05.880770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c9952b8a-bd0d-4d69-851d-c3d36c60c327 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:05.892070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c9952b8a-bd0d-4d69-851d-c3d36c60c327 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:05.892824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c9952b8a-bd0d-4d69-851d-c3d36c60c327 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:05.897472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c9952b8a-bd0d-4d69-851d-c3d36c60c327 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:05.897933 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c9952b8a-bd0d-4d69-851d-c3d36c60c327 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:05.899425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-c055c956-6ad2-49be-b275-c86a954e06e5 req-ad02afa9-cd22-47aa-9721-af84117f58ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b5633e-336c-45cc-927e-8bc71bd6e52f", "name": "network-vif-deleted", "tag": "dc7021f0-e141-4045-80b4-042a54a3e380"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:05.919992 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c055c956-6ad2-49be-b275-c86a954e06e5 req-ad02afa9-cd22-47aa-9721-af84117f58ea service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:05.920401 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c055c956-6ad2-49be-b275-c86a954e06e5 req-ad02afa9-cd22-47aa-9721-af84117f58ea service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:05.946268 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-c055c956-6ad2-49be-b275-c86a954e06e5 req-ad02afa9-cd22-47aa-9721-af84117f58ea service nova] Creating event network-vif-deleted:dc7021f0-e141-4045-80b4-042a54a3e380 for instance a6b5633e-336c-45cc-927e-8bc71bd6e52f on nch1-master-1 May 21 21:18:05.956969 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-c055c956-6ad2-49be-b275-c86a954e06e5 req-ad02afa9-cd22-47aa-9721-af84117f58ea service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060390 May 21 21:18:05.958079 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1000/2060] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:06.107751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e697c7ed-101d-4b47-91bc-2c2a3b2f521e tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:06.108572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e697c7ed-101d-4b47-91bc-2c2a3b2f521e tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:06.116135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e697c7ed-101d-4b47-91bc-2c2a3b2f521e tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:06.120872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e697c7ed-101d-4b47-91bc-2c2a3b2f521e tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:06.122043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e697c7ed-101d-4b47-91bc-2c2a3b2f521e tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:06.125415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-c9952b8a-bd0d-4d69-851d-c3d36c60c327 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] Lazy-loading 'services' on Instance uuid c6a55484-c74d-46c8-b37e-1fc43941e895 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:18:06.127113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e697c7ed-101d-4b47-91bc-2c2a3b2f521e tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:06.144625 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c9952b8a-bd0d-4d69-851d-c3d36c60c327 tempest-LiveAutoBlockMigrationV225Test-1494818173 tempest-LiveAutoBlockMigrationV225Test-1494818173-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1968 microversion: 2.25 time: 0.272118 May 21 21:18:06.145553 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1061/2061] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:05 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1968 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:18:06.193142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6a86565e-7ba2-43ec-8e40-b674f19786f2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:06.193886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6a86565e-7ba2-43ec-8e40-b674f19786f2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:06.201343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6a86565e-7ba2-43ec-8e40-b674f19786f2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:06.203555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6a86565e-7ba2-43ec-8e40-b674f19786f2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:06.204982 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6a86565e-7ba2-43ec-8e40-b674f19786f2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:06.206582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6a86565e-7ba2-43ec-8e40-b674f19786f2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:06.244449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6a86565e-7ba2-43ec-8e40-b674f19786f2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:18:06.456459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e697c7ed-101d-4b47-91bc-2c2a3b2f521e tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:06.464173 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e697c7ed-101d-4b47-91bc-2c2a3b2f521e tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1354 microversion: 2.1 time: 0.360926 May 21 21:18:06.464832 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1001/2062] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:06 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1354 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:18:06.469522 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f7323123-072e-4cb2-9b1a-d59e98514a44 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:06.470269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f7323123-072e-4cb2-9b1a-d59e98514a44 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] [instance: 8af764f8-b932-44e9-a9ca-abe1d1238e8b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:06.476801 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f7323123-072e-4cb2-9b1a-d59e98514a44 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:06.477261 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f7323123-072e-4cb2-9b1a-d59e98514a44 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:06.478043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f7323123-072e-4cb2-9b1a-d59e98514a44 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:06.478488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f7323123-072e-4cb2-9b1a-d59e98514a44 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:06.561088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f7323123-072e-4cb2-9b1a-d59e98514a44 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d6821eac1b49e986073f36962b3046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e743b29f0d4b9899537992aad63696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:06.568961 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f7323123-072e-4cb2-9b1a-d59e98514a44 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] 10.222.0.49 "GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b" status: 200 len: 1273 microversion: 2.1 time: 0.102989 May 21 21:18:06.569532 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1002/2063] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:06 2022] GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b => generated 1273 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:06.722584 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bb0f0485-ea58-494c-b963-ab2bdf1ccc94 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:06.723292 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bb0f0485-ea58-494c-b963-ab2bdf1ccc94 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:06.728794 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6a86565e-7ba2-43ec-8e40-b674f19786f2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 204 len: 0 microversion: 2.25 time: 0.541594 May 21 21:18:06.730351 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb0f0485-ea58-494c-b963-ab2bdf1ccc94 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:06.732031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb0f0485-ea58-494c-b963-ab2bdf1ccc94 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:06.733004 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb0f0485-ea58-494c-b963-ab2bdf1ccc94 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:06.733666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb0f0485-ea58-494c-b963-ab2bdf1ccc94 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:06.733796 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1062/2064] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:18:06 2022] DELETE /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:18:06.738683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:06.743494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e315b7eb-fce7-4636-b0c1-823a1de7ddcd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:06.744471 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e315b7eb-fce7-4636-b0c1-823a1de7ddcd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:06.751880 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e315b7eb-fce7-4636-b0c1-823a1de7ddcd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:06.752863 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e315b7eb-fce7-4636-b0c1-823a1de7ddcd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:06.755331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e315b7eb-fce7-4636-b0c1-823a1de7ddcd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:06.755871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e315b7eb-fce7-4636-b0c1-823a1de7ddcd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:06.770848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb0f0485-ea58-494c-b963-ab2bdf1ccc94 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:06.771405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb0f0485-ea58-494c-b963-ab2bdf1ccc94 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:06.771943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-bb0f0485-ea58-494c-b963-ab2bdf1ccc94 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lazy-loading 'fault' on Instance uuid a6b5633e-336c-45cc-927e-8bc71bd6e52f {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:18:06.829639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bb0f0485-ea58-494c-b963-ab2bdf1ccc94 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284da653ac24d73a21e8442609889c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:06.838493 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bb0f0485-ea58-494c-b963-ab2bdf1ccc94 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 200 len: 1301 microversion: 2.1 time: 0.120965 May 21 21:18:06.839511 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1003/2065] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:06 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 1301 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:18:06.852650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a051673f-94cf-400a-b429-28aa3b28f07e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:06.857989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a051673f-94cf-400a-b429-28aa3b28f07e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:06.859751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a051673f-94cf-400a-b429-28aa3b28f07e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:06.860208 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a051673f-94cf-400a-b429-28aa3b28f07e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:06.861237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a051673f-94cf-400a-b429-28aa3b28f07e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:06.861828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a051673f-94cf-400a-b429-28aa3b28f07e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:06.935381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e315b7eb-fce7-4636-b0c1-823a1de7ddcd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:06.958340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e315b7eb-fce7-4636-b0c1-823a1de7ddcd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:06.958340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e315b7eb-fce7-4636-b0c1-823a1de7ddcd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:06.958340 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e315b7eb-fce7-4636-b0c1-823a1de7ddcd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1482 microversion: 2.25 time: 0.212966 May 21 21:18:06.958340 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1063/2066] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:06 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1482 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:06.958340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e8c8ee60-cb10-44f6-804c-8b248cef5156 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc82d02bf70>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:07.035251 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e8c8ee60-cb10-44f6-804c-8b248cef5156 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e" status: 200 len: 1447 microversion: 2.1 time: 0.084424 May 21 21:18:07.035828 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1064/2067] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:18:06 2022] GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e => generated 1447 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:07.041596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2043834899", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "6f811373-4d9f-4ffb-9ae6-578f87c4b79c"}, {"port": "62b0f605-35ad-4b1a-80f3-ed4bb5d39355", "tag": "port-1"}, {"port": "138f2620-7e88-4702-9a4f-46aec93115ea", "tag": "port-2"}, {"uuid": "59d2f945-49d8-4ba4-a4ac-d3450936b652", "tag": "net-1"}, {"uuid": "59d2f945-49d8-4ba4-a4ac-d3450936b652"}, {"uuid": "bcec2c63-a1ee-4fc9-8f58-c7d84923b4ef", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "bcec2c63-a1ee-4fc9-8f58-c7d84923b4ef", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "827936d3-46db-437b-a044-b86ceba4daab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "2ec648c5-31f0-4665-a957-6a17147b791e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "bdba9bc9-a60d-4ef9-b90d-a73d75b3bf73", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1477478547"}], "key_name": "tempest-keypair-551607892", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:07.164141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] validate_networks() for [('6f811373-4d9f-4ffb-9ae6-578f87c4b79c', None, None, None, None, None), (None, None, '62b0f605-35ad-4b1a-80f3-ed4bb5d39355', None, None, None), (None, None, '138f2620-7e88-4702-9a4f-46aec93115ea', None, None, None), ('59d2f945-49d8-4ba4-a4ac-d3450936b652', None, None, None, None, None), ('59d2f945-49d8-4ba4-a4ac-d3450936b652', None, None, None, None, None), ('bcec2c63-a1ee-4fc9-8f58-c7d84923b4ef', '10.2.2.100', None, None, None, None), ('bcec2c63-a1ee-4fc9-8f58-c7d84923b4ef', '10.2.2.200', None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:18:07.204240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a051673f-94cf-400a-b429-28aa3b28f07e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:07.216943 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a051673f-94cf-400a-b429-28aa3b28f07e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439" status: 200 len: 1314 microversion: 2.1 time: 0.368000 May 21 21:18:07.227874 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1004/2068] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:06 2022] GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:18:07.234912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fcddaafe-f7ca-44e4-a36c-0889635bc285 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b6fc280>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:07.307612 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fcddaafe-f7ca-44e4-a36c-0889635bc285 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e" status: 200 len: 1447 microversion: 2.1 time: 0.077880 May 21 21:18:07.308720 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1005/2069] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:18:07 2022] GET /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e => generated 1447 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:07.321946 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3c0ef5d9-bfb5-4b8a-8606-df3f38cd869b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc82cf82430>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:08.911467 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3c0ef5d9-bfb5-4b8a-8606-df3f38cd869b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "DELETE /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e" status: 204 len: 0 microversion: 2.1 time: 1.593892 May 21 21:18:08.912378 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1006/2070] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:07 2022] DELETE /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e => generated 0 bytes in 1595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:18:08.917328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d1f8b11c-d364-41e0-a0cb-44c73a3e5ef8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:08.918093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d1f8b11c-d364-41e0-a0cb-44c73a3e5ef8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:08.927264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d1f8b11c-d364-41e0-a0cb-44c73a3e5ef8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:08.932761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d1f8b11c-d364-41e0-a0cb-44c73a3e5ef8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:08.932761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d1f8b11c-d364-41e0-a0cb-44c73a3e5ef8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:08.932761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d1f8b11c-d364-41e0-a0cb-44c73a3e5ef8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:09.247291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d1f8b11c-d364-41e0-a0cb-44c73a3e5ef8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:09.257304 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d1f8b11c-d364-41e0-a0cb-44c73a3e5ef8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1354 microversion: 2.1 time: 0.343868 May 21 21:18:09.258873 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1007/2071] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:08 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1354 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:09.268947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-84c415ad-6eed-442a-b899-b7c1334d3565 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:09.268947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-84c415ad-6eed-442a-b899-b7c1334d3565 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] [instance: 8af764f8-b932-44e9-a9ca-abe1d1238e8b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:09.279705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-84c415ad-6eed-442a-b899-b7c1334d3565 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:09.280490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-84c415ad-6eed-442a-b899-b7c1334d3565 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:09.281661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-84c415ad-6eed-442a-b899-b7c1334d3565 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:09.282290 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-84c415ad-6eed-442a-b899-b7c1334d3565 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:09.593293 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-84c415ad-6eed-442a-b899-b7c1334d3565 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d6821eac1b49e986073f36962b3046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e743b29f0d4b9899537992aad63696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:09.606476 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-84c415ad-6eed-442a-b899-b7c1334d3565 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] 10.222.0.49 "GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b" status: 200 len: 1321 microversion: 2.1 time: 0.346278 May 21 21:18:09.608248 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1008/2072] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:09 2022] GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b => generated 1321 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:09.619140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8cb6349a-0f0e-4048-8446-e49ef7815c43 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:09.624003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8cb6349a-0f0e-4048-8446-e49ef7815c43 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] [instance: a6b5633e-336c-45cc-927e-8bc71bd6e52f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:09.626247 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8cb6349a-0f0e-4048-8446-e49ef7815c43 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:09.626939 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8cb6349a-0f0e-4048-8446-e49ef7815c43 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:09.628787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8cb6349a-0f0e-4048-8446-e49ef7815c43 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:09.629457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8cb6349a-0f0e-4048-8446-e49ef7815c43 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:09.645924 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-8cb6349a-0f0e-4048-8446-e49ef7815c43 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] HTTP exception thrown: Instance a6b5633e-336c-45cc-927e-8bc71bd6e52f could not be found. May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8cb6349a-0f0e-4048-8446-e49ef7815c43 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Request method failure captured: May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f HTTP/1.1 May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVV6T3RyEAuEj3kkohi5afNjIZDzMkbpGxSPkhUNQKESnkx5do8rKET_y9FZw2-faVyMNN9INAHvixRDp8oL8FaSX_bHY9TnjbhptGMff12ZRiPOqrrvdfcrZqPgNgT5Hu6C49vopI-OOHSmOYV9aBTZaIqng40vF4GFbrZSYyBOdE8 May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 5284da653ac24d73a21e8442609889c9 May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-LiveMigrationTest-1650172315 May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5284da653ac24d73a21e8442609889c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5284da653ac24d73a21e8442609889c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5284da653ac24d73a21e8442609889c9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5284da653ac24d73a21e8442609889c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-LiveMigrationTest-1650172315 May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 5284da653ac24d73a21e8442609889c9 May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-LiveMigrationTest-1650172315 May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-LiveMigrationTest-1650172315-project May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 34c22f04c3114d46b6b1b1168aa064f5 May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-LiveMigrationTest-1650172315-project May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance a6b5633e-336c-45cc-927e-8bc71bd6e52f could not be found. May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'a6b5633e-336c-45cc-927e-8bc71bd6e52f'} May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6b5633e-336c-45cc-927e-8bc71bd6e52f could not be found. May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6b5633e-336c-45cc-927e-8bc71bd6e52f could not be found. May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:09.647969 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:09.653991 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:09.653991 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:09.653991 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:09.653991 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:09.653991 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:09.653991 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6b5633e-336c-45cc-927e-8bc71bd6e52f could not be found. May 21 21:18:09.653991 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:09.655802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8cb6349a-0f0e-4048-8446-e49ef7815c43 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] Returning 404 to user: Instance a6b5633e-336c-45cc-927e-8bc71bd6e52f could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:09.656971 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8cb6349a-0f0e-4048-8446-e49ef7815c43 tempest-LiveMigrationTest-1650172315 tempest-LiveMigrationTest-1650172315-project] 10.222.0.49 "GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f" status: 404 len: 111 microversion: 2.1 time: 0.047692 May 21 21:18:09.675308 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1009/2073] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:09 2022] GET /compute/v2.1/servers/a6b5633e-336c-45cc-927e-8bc71bd6e52f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:18:09.675308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d2635b4d-3040-4797-9e16-1441a4b0c538 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:09.675308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d2635b4d-3040-4797-9e16-1441a4b0c538 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:09.675308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2635b4d-3040-4797-9e16-1441a4b0c538 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:09.675308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2635b4d-3040-4797-9e16-1441a4b0c538 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:09.675308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2635b4d-3040-4797-9e16-1441a4b0c538 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:09.675308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2635b4d-3040-4797-9e16-1441a4b0c538 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:10.022600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d2635b4d-3040-4797-9e16-1441a4b0c538 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:10.035354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d2635b4d-3040-4797-9e16-1441a4b0c538 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:10.037536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d2635b4d-3040-4797-9e16-1441a4b0c538 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:10.038949 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d2635b4d-3040-4797-9e16-1441a4b0c538 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1482 microversion: 2.25 time: 0.378855 May 21 21:18:10.040107 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1010/2074] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:09 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1482 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:10.045209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1485b5f1-c123-416d-8f64-08f83dbc0dc4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:10.046252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1485b5f1-c123-416d-8f64-08f83dbc0dc4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:10.056318 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1485b5f1-c123-416d-8f64-08f83dbc0dc4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:10.057249 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1485b5f1-c123-416d-8f64-08f83dbc0dc4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:10.058424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1485b5f1-c123-416d-8f64-08f83dbc0dc4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:10.058719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1485b5f1-c123-416d-8f64-08f83dbc0dc4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:10.276492 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1485b5f1-c123-416d-8f64-08f83dbc0dc4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:10.287791 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1485b5f1-c123-416d-8f64-08f83dbc0dc4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439" status: 200 len: 1501 microversion: 2.1 time: 0.246270 May 21 21:18:10.288439 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1011/2075] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:10 2022] GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 => generated 1501 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:10.293360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-22c97434-6247-4121-8ed4-100556f225bf tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:10.293861 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-22c97434-6247-4121-8ed4-100556f225bf tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:10.303910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22c97434-6247-4121-8ed4-100556f225bf tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:10.303910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22c97434-6247-4121-8ed4-100556f225bf tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:10.304628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22c97434-6247-4121-8ed4-100556f225bf tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:10.305238 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22c97434-6247-4121-8ed4-100556f225bf tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:10.349442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-22c97434-6247-4121-8ed4-100556f225bf tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:18:10.723565 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-22c97434-6247-4121-8ed4-100556f225bf tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 204 len: 0 microversion: 2.1 time: 0.433743 May 21 21:18:10.727597 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1012/2076] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:18:10 2022] DELETE /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:18:10.739341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-88b0b4a2-0499-47d3-8549-53cb2b477ec5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:10.740896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-88b0b4a2-0499-47d3-8549-53cb2b477ec5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:10.753118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:18:10.754135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:18:10.754728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-88b0b4a2-0499-47d3-8549-53cb2b477ec5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:10.755112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:18:10.755341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-88b0b4a2-0499-47d3-8549-53cb2b477ec5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:10.756552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:18:10.757208 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:18:10.764009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-88b0b4a2-0499-47d3-8549-53cb2b477ec5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:10.764576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-88b0b4a2-0499-47d3-8549-53cb2b477ec5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:10.769301 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:10.769993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:10.771000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:10.774679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:10.798338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Getting quotas for project e409e3743001461b9dee85d7db50f6a0. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:18:10.807055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Getting quotas for user c07dc02a0f494ff99b010cf0447c8338 and project e409e3743001461b9dee85d7db50f6a0. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:18:11.053252 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:18:11.057345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='827936d3-46db-437b-a044-b86ceba4daab',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='2ec648c5-31f0-4665-a957-6a17147b791e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bdba9bc9-a60d-4ef9-b90d-a73d75b3bf73',volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:18:11.275690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-88b0b4a2-0499-47d3-8549-53cb2b477ec5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:11.284855 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-88b0b4a2-0499-47d3-8549-53cb2b477ec5 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1354 microversion: 2.1 time: 0.555441 May 21 21:18:11.285443 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1013/2077] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:10 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1354 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:11.294610 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-86692bf2-ad1e-4095-b352-d7fde56298fa tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:11.294610 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-86692bf2-ad1e-4095-b352-d7fde56298fa tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] [instance: 8af764f8-b932-44e9-a9ca-abe1d1238e8b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:11.297882 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86692bf2-ad1e-4095-b352-d7fde56298fa tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:11.298347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86692bf2-ad1e-4095-b352-d7fde56298fa tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:11.299897 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86692bf2-ad1e-4095-b352-d7fde56298fa tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:11.300363 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86692bf2-ad1e-4095-b352-d7fde56298fa tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:11.664989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-86692bf2-ad1e-4095-b352-d7fde56298fa tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d6821eac1b49e986073f36962b3046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e743b29f0d4b9899537992aad63696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:11.674892 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-86692bf2-ad1e-4095-b352-d7fde56298fa tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] 10.222.0.49 "GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b" status: 200 len: 1321 microversion: 2.1 time: 0.388234 May 21 21:18:11.675478 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1014/2078] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:11 2022] GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:11.688891 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0cabe6ff-8193-4185-b223-ce440d012220 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-188255243", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "c5f18057-839a-44a2-aa7d-5be2d01e71c9"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:11.756560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-0cabe6ff-8193-4185-b223-ce440d012220 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] validate_networks() for [('c5f18057-839a-44a2-aa7d-5be2d01e71c9', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:18:12.419705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:12.436034 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 5.399043 May 21 21:18:12.443584 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1065/2079] 10.222.0.49 () {62 vars in 1188 bytes} [Sat May 21 21:18:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 5407 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 21 21:18:12.448938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f30acf1b-de5b-40d2-9260-9ef9b5676fb7 req-88f5c34d-4f17-4116-b795-cb5489d42c89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8af764f8-b932-44e9-a9ca-abe1d1238e8b", "tag": "109ee926-6b2d-48e6-9fe0-33b202aa73b1"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:12.470413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f30acf1b-de5b-40d2-9260-9ef9b5676fb7 req-88f5c34d-4f17-4116-b795-cb5489d42c89 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:12.474720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f30acf1b-de5b-40d2-9260-9ef9b5676fb7 req-88f5c34d-4f17-4116-b795-cb5489d42c89 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:12.488731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=23 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:12.502941 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f30acf1b-de5b-40d2-9260-9ef9b5676fb7 req-88f5c34d-4f17-4116-b795-cb5489d42c89 service nova] Creating event network-changed:109ee926-6b2d-48e6-9fe0-33b202aa73b1 for instance 8af764f8-b932-44e9-a9ca-abe1d1238e8b on nch1-master-1 May 21 21:18:12.507594 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f30acf1b-de5b-40d2-9260-9ef9b5676fb7 req-88f5c34d-4f17-4116-b795-cb5489d42c89 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062287 May 21 21:18:12.509249 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1066/2080] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:12.515167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cac66715-c01d-4b28-b03b-c08f178b8b15 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:12.516255 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cac66715-c01d-4b28-b03b-c08f178b8b15 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:12.526335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cac66715-c01d-4b28-b03b-c08f178b8b15 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:12.526849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cac66715-c01d-4b28-b03b-c08f178b8b15 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:12.527638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cac66715-c01d-4b28-b03b-c08f178b8b15 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:12.528075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cac66715-c01d-4b28-b03b-c08f178b8b15 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:12.698726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0cabe6ff-8193-4185-b223-ce440d012220 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:18:12.700006 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0cabe6ff-8193-4185-b223-ce440d012220 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:18:12.700905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0cabe6ff-8193-4185-b223-ce440d012220 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:18:12.701392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0cabe6ff-8193-4185-b223-ce440d012220 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:18:12.702223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0cabe6ff-8193-4185-b223-ce440d012220 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:18:12.716576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0cabe6ff-8193-4185-b223-ce440d012220 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:12.717303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0cabe6ff-8193-4185-b223-ce440d012220 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:12.718462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0cabe6ff-8193-4185-b223-ce440d012220 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:12.719324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0cabe6ff-8193-4185-b223-ce440d012220 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:12.741535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-0cabe6ff-8193-4185-b223-ce440d012220 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Getting quotas for project 89256ac3448643b6892e74f55bfb31d3. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:18:12.746607 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-0cabe6ff-8193-4185-b223-ce440d012220 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Getting quotas for user 16686b6509f54c4abfe9d519acfb4a73 and project 89256ac3448643b6892e74f55bfb31d3. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:18:12.764547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0cabe6ff-8193-4185-b223-ce440d012220 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:18:12.767055 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0cabe6ff-8193-4185-b223-ce440d012220 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:18:12.843482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cac66715-c01d-4b28-b03b-c08f178b8b15 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:12.852452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cac66715-c01d-4b28-b03b-c08f178b8b15 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:12.854106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cac66715-c01d-4b28-b03b-c08f178b8b15 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:12.855590 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cac66715-c01d-4b28-b03b-c08f178b8b15 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1482 microversion: 2.25 time: 0.344983 May 21 21:18:12.856263 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1067/2081] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:12 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1482 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:12.860935 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8804b755-0b4f-4a09-8cf3-01abf29296ff tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:12.862465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8804b755-0b4f-4a09-8cf3-01abf29296ff tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:12.868744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8804b755-0b4f-4a09-8cf3-01abf29296ff tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:12.869459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8804b755-0b4f-4a09-8cf3-01abf29296ff tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:12.870246 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8804b755-0b4f-4a09-8cf3-01abf29296ff tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:12.870694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8804b755-0b4f-4a09-8cf3-01abf29296ff tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:12.933669 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0cabe6ff-8193-4185-b223-ce440d012220 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.257123 May 21 21:18:12.935018 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1015/2082] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:18:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:18:12.954173 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-58474e1e-161f-42f7-8cb5-2d2a9b5a629a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:12.958274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-58474e1e-161f-42f7-8cb5-2d2a9b5a629a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:13.081875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-58474e1e-161f-42f7-8cb5-2d2a9b5a629a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:13.094118 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-58474e1e-161f-42f7-8cb5-2d2a9b5a629a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:13.097772 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-58474e1e-161f-42f7-8cb5-2d2a9b5a629a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:13.099339 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-58474e1e-161f-42f7-8cb5-2d2a9b5a629a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1285 microversion: 2.32 time: 0.163160 May 21 21:18:13.100247 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1016/2083] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:12 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1285 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:13.105497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ee58e1a1-d7b6-426d-b1c7-3ec61ced9666 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:13.107532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ee58e1a1-d7b6-426d-b1c7-3ec61ced9666 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] [instance: 8af764f8-b932-44e9-a9ca-abe1d1238e8b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:13.117704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee58e1a1-d7b6-426d-b1c7-3ec61ced9666 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:13.118516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee58e1a1-d7b6-426d-b1c7-3ec61ced9666 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:13.119795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee58e1a1-d7b6-426d-b1c7-3ec61ced9666 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:13.120485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee58e1a1-d7b6-426d-b1c7-3ec61ced9666 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:13.182873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8804b755-0b4f-4a09-8cf3-01abf29296ff tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:13.189862 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8804b755-0b4f-4a09-8cf3-01abf29296ff tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1354 microversion: 2.1 time: 0.331870 May 21 21:18:13.190472 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1068/2084] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:12 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1354 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:13.204138 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f3eb5e0f-bcdd-4274-9be3-a7b9a445d42f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:13.206801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f3eb5e0f-bcdd-4274-9be3-a7b9a445d42f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:13.308523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f3eb5e0f-bcdd-4274-9be3-a7b9a445d42f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:13.322876 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f3eb5e0f-bcdd-4274-9be3-a7b9a445d42f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1207 microversion: 2.1 time: 0.130929 May 21 21:18:13.324350 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1069/2085] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:13 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1207 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:13.330798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c5b0f510-54e1-4ad8-bf16-4a240df7c0d1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10da5ce0-93b8-4d63-ac54-7c0b2e6dc51f"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:13.332602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c5b0f510-54e1-4ad8-bf16-4a240df7c0d1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:13.340715 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c5b0f510-54e1-4ad8-bf16-4a240df7c0d1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:13.341663 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c5b0f510-54e1-4ad8-bf16-4a240df7c0d1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:13.342673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c5b0f510-54e1-4ad8-bf16-4a240df7c0d1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:13.343344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c5b0f510-54e1-4ad8-bf16-4a240df7c0d1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:13.539959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ee58e1a1-d7b6-426d-b1c7-3ec61ced9666 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d6821eac1b49e986073f36962b3046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e743b29f0d4b9899537992aad63696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:13.548551 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ee58e1a1-d7b6-426d-b1c7-3ec61ced9666 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] 10.222.0.49 "GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b" status: 200 len: 1321 microversion: 2.1 time: 0.447004 May 21 21:18:13.561578 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1017/2086] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:13 2022] GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b => generated 1321 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:13.874905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-df42bcf2-cbef-427a-83ab-412791039085 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:13.875789 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-df42bcf2-cbef-427a-83ab-412791039085 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:13.884028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df42bcf2-cbef-427a-83ab-412791039085 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:13.884525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df42bcf2-cbef-427a-83ab-412791039085 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:13.885498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df42bcf2-cbef-427a-83ab-412791039085 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:13.885943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df42bcf2-cbef-427a-83ab-412791039085 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:14.220746 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-df42bcf2-cbef-427a-83ab-412791039085 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:14.230677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-df42bcf2-cbef-427a-83ab-412791039085 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:14.232841 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-df42bcf2-cbef-427a-83ab-412791039085 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:14.234339 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-df42bcf2-cbef-427a-83ab-412791039085 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1482 microversion: 2.25 time: 0.364235 May 21 21:18:14.235122 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1018/2087] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:13 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1482 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:14.240923 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3e0d8187-0a93-4b73-b215-2e8a31f2c339 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:14.241824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3e0d8187-0a93-4b73-b215-2e8a31f2c339 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:14.288831 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c5b0f510-54e1-4ad8-bf16-4a240df7c0d1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "POST /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.962667 May 21 21:18:14.298606 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1070/2088] 10.222.0.49 () {60 vars in 1322 bytes} [Sat May 21 21:18:13 2022] POST /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439/os-volume_attachments => generated 194 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:14.307722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aa7ddb97-a95e-4228-b673-adbee4dc4732 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:14.308626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aa7ddb97-a95e-4228-b673-adbee4dc4732 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:14.319417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa7ddb97-a95e-4228-b673-adbee4dc4732 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:14.320256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa7ddb97-a95e-4228-b673-adbee4dc4732 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:14.321542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa7ddb97-a95e-4228-b673-adbee4dc4732 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:14.330753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa7ddb97-a95e-4228-b673-adbee4dc4732 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:14.331664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3e0d8187-0a93-4b73-b215-2e8a31f2c339 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:14.342570 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3e0d8187-0a93-4b73-b215-2e8a31f2c339 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:14.350029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3e0d8187-0a93-4b73-b215-2e8a31f2c339 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:14.351945 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3e0d8187-0a93-4b73-b215-2e8a31f2c339 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1285 microversion: 2.32 time: 0.115466 May 21 21:18:14.357718 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1019/2089] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:14 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:14.372131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b5825f25-71ec-4ab6-9a8d-6cee5c56bd41 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:14.373268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b5825f25-71ec-4ab6-9a8d-6cee5c56bd41 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:14.390309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5825f25-71ec-4ab6-9a8d-6cee5c56bd41 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:14.391053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5825f25-71ec-4ab6-9a8d-6cee5c56bd41 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:14.392239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5825f25-71ec-4ab6-9a8d-6cee5c56bd41 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:14.393260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5825f25-71ec-4ab6-9a8d-6cee5c56bd41 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:14.469381 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b5825f25-71ec-4ab6-9a8d-6cee5c56bd41 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:14.481147 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b5825f25-71ec-4ab6-9a8d-6cee5c56bd41 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1211 microversion: 2.1 time: 0.122010 May 21 21:18:14.482718 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1020/2090] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:14 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1211 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:14.528605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aa7ddb97-a95e-4228-b673-adbee4dc4732 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:14.530812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-77f66e12-531f-4341-9746-e7f4743e41f3 req-ad5941c7-b2d0-4a10-b7f1-6da42ea9d053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9930871-f204-4368-a581-87d1b5ed7415", "name": "network-vif-deleted", "tag": "e06f96d3-fb3e-437a-8744-1f10e131cd8c"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:14.541365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-77f66e12-531f-4341-9746-e7f4743e41f3 req-ad5941c7-b2d0-4a10-b7f1-6da42ea9d053 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:14.542026 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aa7ddb97-a95e-4228-b673-adbee4dc4732 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1354 microversion: 2.1 time: 0.250525 May 21 21:18:14.542630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-77f66e12-531f-4341-9746-e7f4743e41f3 req-ad5941c7-b2d0-4a10-b7f1-6da42ea9d053 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:14.543378 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1071/2091] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:14 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1354 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:14.572359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-66aa7a9d-8c59-4473-8874-40074d3fe381 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:14.575016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-66aa7a9d-8c59-4473-8874-40074d3fe381 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] [instance: 8af764f8-b932-44e9-a9ca-abe1d1238e8b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:14.588745 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-66aa7a9d-8c59-4473-8874-40074d3fe381 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:14.589421 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-77f66e12-531f-4341-9746-e7f4743e41f3 req-ad5941c7-b2d0-4a10-b7f1-6da42ea9d053 service nova] Creating event network-vif-deleted:e06f96d3-fb3e-437a-8744-1f10e131cd8c for instance b9930871-f204-4368-a581-87d1b5ed7415 on nch2-master-1 May 21 21:18:14.591114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-66aa7a9d-8c59-4473-8874-40074d3fe381 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:14.593421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-66aa7a9d-8c59-4473-8874-40074d3fe381 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:14.594219 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-66aa7a9d-8c59-4473-8874-40074d3fe381 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:14.604888 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-77f66e12-531f-4341-9746-e7f4743e41f3 req-ad5941c7-b2d0-4a10-b7f1-6da42ea9d053 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074003 May 21 21:18:14.610417 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1021/2092] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:18:14.843166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-66aa7a9d-8c59-4473-8874-40074d3fe381 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d6821eac1b49e986073f36962b3046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e743b29f0d4b9899537992aad63696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:14.852412 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-66aa7a9d-8c59-4473-8874-40074d3fe381 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] 10.222.0.49 "GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b" status: 200 len: 1321 microversion: 2.1 time: 0.289269 May 21 21:18:14.854772 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1072/2093] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:14 2022] GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:15.255143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-717a95c7-bceb-41b2-802a-3ae23619be41 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:15.255848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-717a95c7-bceb-41b2-802a-3ae23619be41 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:15.268524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-717a95c7-bceb-41b2-802a-3ae23619be41 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:15.268524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-717a95c7-bceb-41b2-802a-3ae23619be41 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:15.268524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-717a95c7-bceb-41b2-802a-3ae23619be41 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:15.269304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-717a95c7-bceb-41b2-802a-3ae23619be41 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:15.379613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f77ba940-4d5e-4d2c-9eae-8574d5eb866f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:15.380833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-717a95c7-bceb-41b2-802a-3ae23619be41 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:15.385586 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f77ba940-4d5e-4d2c-9eae-8574d5eb866f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:15.415835 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f77ba940-4d5e-4d2c-9eae-8574d5eb866f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:15.424191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-717a95c7-bceb-41b2-802a-3ae23619be41 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:15.424400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f77ba940-4d5e-4d2c-9eae-8574d5eb866f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:15.424400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f77ba940-4d5e-4d2c-9eae-8574d5eb866f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:15.424400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f77ba940-4d5e-4d2c-9eae-8574d5eb866f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:15.430684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-717a95c7-bceb-41b2-802a-3ae23619be41 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:15.432459 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-717a95c7-bceb-41b2-802a-3ae23619be41 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1440 microversion: 2.25 time: 0.182580 May 21 21:18:15.434976 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1022/2094] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:15 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1440 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:15.504495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c9aad407-3247-44a9-8df5-35f746f1e126 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:15.504495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c9aad407-3247-44a9-8df5-35f746f1e126 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:15.516049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9aad407-3247-44a9-8df5-35f746f1e126 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:15.518753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9aad407-3247-44a9-8df5-35f746f1e126 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:15.521852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9aad407-3247-44a9-8df5-35f746f1e126 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:15.522314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9aad407-3247-44a9-8df5-35f746f1e126 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:15.633361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f77ba940-4d5e-4d2c-9eae-8574d5eb866f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:15.646791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f77ba940-4d5e-4d2c-9eae-8574d5eb866f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:15.647962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c9aad407-3247-44a9-8df5-35f746f1e126 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:15.648506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f77ba940-4d5e-4d2c-9eae-8574d5eb866f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:15.649499 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f77ba940-4d5e-4d2c-9eae-8574d5eb866f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1519 microversion: 2.32 time: 0.277504 May 21 21:18:15.650445 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1073/2095] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:15 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1519 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:15.651338 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:15.659244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-40fb99aa-8f3b-4d84-81ef-46f48daf99e8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:15.659244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-40fb99aa-8f3b-4d84-81ef-46f48daf99e8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:15.662312 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c9aad407-3247-44a9-8df5-35f746f1e126 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1259 microversion: 2.1 time: 0.167262 May 21 21:18:15.663147 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1023/2096] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:15 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:18:15.667747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-40fb99aa-8f3b-4d84-81ef-46f48daf99e8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:15.668212 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-40fb99aa-8f3b-4d84-81ef-46f48daf99e8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:15.669152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-40fb99aa-8f3b-4d84-81ef-46f48daf99e8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:15.669595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-40fb99aa-8f3b-4d84-81ef-46f48daf99e8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:15.670757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-51ad0e35-59b5-41a5-bd82-f42cd79b1f0a req-8c3223c1-55c7-4e79-8b12-797606cf827f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af764f8-b932-44e9-a9ca-abe1d1238e8b", "name": "network-vif-plugged", "status": "completed", "tag": "109ee926-6b2d-48e6-9fe0-33b202aa73b1"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:15.683212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-51ad0e35-59b5-41a5-bd82-f42cd79b1f0a req-8c3223c1-55c7-4e79-8b12-797606cf827f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:15.684307 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-51ad0e35-59b5-41a5-bd82-f42cd79b1f0a req-8c3223c1-55c7-4e79-8b12-797606cf827f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:15.701242 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-51ad0e35-59b5-41a5-bd82-f42cd79b1f0a req-8c3223c1-55c7-4e79-8b12-797606cf827f service nova] Creating event network-vif-plugged:109ee926-6b2d-48e6-9fe0-33b202aa73b1 for instance 8af764f8-b932-44e9-a9ca-abe1d1238e8b on nch1-master-1 May 21 21:18:15.709348 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-51ad0e35-59b5-41a5-bd82-f42cd79b1f0a req-8c3223c1-55c7-4e79-8b12-797606cf827f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044491 May 21 21:18:15.711668 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1024/2097] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:15.872871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a5aab3d7-4246-4d43-8e49-92c4c5905afd tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:15.874465 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a5aab3d7-4246-4d43-8e49-92c4c5905afd tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] [instance: 8af764f8-b932-44e9-a9ca-abe1d1238e8b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:15.881802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5aab3d7-4246-4d43-8e49-92c4c5905afd tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:15.882519 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5aab3d7-4246-4d43-8e49-92c4c5905afd tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:15.883583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5aab3d7-4246-4d43-8e49-92c4c5905afd tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:15.884575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5aab3d7-4246-4d43-8e49-92c4c5905afd tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:16.051999 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-40fb99aa-8f3b-4d84-81ef-46f48daf99e8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:16.068693 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-40fb99aa-8f3b-4d84-81ef-46f48daf99e8 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1354 microversion: 2.1 time: 0.414532 May 21 21:18:16.069827 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1074/2098] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:15 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1354 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:16.075448 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a5aab3d7-4246-4d43-8e49-92c4c5905afd tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d6821eac1b49e986073f36962b3046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e743b29f0d4b9899537992aad63696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:16.088585 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a5aab3d7-4246-4d43-8e49-92c4c5905afd tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] 10.222.0.49 "GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b" status: 200 len: 1321 microversion: 2.1 time: 0.221190 May 21 21:18:16.096732 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1025/2099] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:15 2022] GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:18:16.454102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c95def5c-0608-486d-af77-ac74f88de8d5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:16.455687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c95def5c-0608-486d-af77-ac74f88de8d5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:16.463126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c95def5c-0608-486d-af77-ac74f88de8d5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:16.463588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c95def5c-0608-486d-af77-ac74f88de8d5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:16.464498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c95def5c-0608-486d-af77-ac74f88de8d5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:16.471236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c95def5c-0608-486d-af77-ac74f88de8d5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:16.504601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c95def5c-0608-486d-af77-ac74f88de8d5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:16.505294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c95def5c-0608-486d-af77-ac74f88de8d5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:16.506073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-c95def5c-0608-486d-af77-ac74f88de8d5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lazy-loading 'fault' on Instance uuid c6a55484-c74d-46c8-b37e-1fc43941e895 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:18:16.619005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c95def5c-0608-486d-af77-ac74f88de8d5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:16.644747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c95def5c-0608-486d-af77-ac74f88de8d5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:16.648651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c95def5c-0608-486d-af77-ac74f88de8d5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:16.650683 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c95def5c-0608-486d-af77-ac74f88de8d5 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 200 len: 1270 microversion: 2.25 time: 0.201797 May 21 21:18:16.651570 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1075/2100] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:16 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 1270 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:16.672248 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9eaf3d3c-b006-4947-b334-152f7cc09dff tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:16.673144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9eaf3d3c-b006-4947-b334-152f7cc09dff tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:16.682428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ed7b9ef1-e7f9-4a75-bb5d-a2b71b42cb98 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:16.683264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ed7b9ef1-e7f9-4a75-bb5d-a2b71b42cb98 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:16.696750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9eaf3d3c-b006-4947-b334-152f7cc09dff tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:16.699087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:16.702128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9eaf3d3c-b006-4947-b334-152f7cc09dff tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:16.702700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed7b9ef1-e7f9-4a75-bb5d-a2b71b42cb98 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:16.703438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed7b9ef1-e7f9-4a75-bb5d-a2b71b42cb98 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:16.704571 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9eaf3d3c-b006-4947-b334-152f7cc09dff tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:16.707174 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed7b9ef1-e7f9-4a75-bb5d-a2b71b42cb98 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:16.707174 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed7b9ef1-e7f9-4a75-bb5d-a2b71b42cb98 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:16.708457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9eaf3d3c-b006-4947-b334-152f7cc09dff tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:16.733346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:16.801391 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ed7b9ef1-e7f9-4a75-bb5d-a2b71b42cb98 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:16.815613 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ed7b9ef1-e7f9-4a75-bb5d-a2b71b42cb98 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1265 microversion: 2.1 time: 0.137215 May 21 21:18:16.817029 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1076/2101] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:16 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:16.823012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-90b003aa-f278-438d-91db-92073b50f348 req-15e72080-0ab2-4538-b4e8-8b0a9b598076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a55484-c74d-46c8-b37e-1fc43941e895", "name": "network-vif-deleted", "tag": "2b5fd365-20f9-4fcc-919f-6f7d08efba8b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:16.833434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-90b003aa-f278-438d-91db-92073b50f348 req-15e72080-0ab2-4538-b4e8-8b0a9b598076 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:16.834194 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-90b003aa-f278-438d-91db-92073b50f348 req-15e72080-0ab2-4538-b4e8-8b0a9b598076 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:16.847257 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-90b003aa-f278-438d-91db-92073b50f348 req-15e72080-0ab2-4538-b4e8-8b0a9b598076 service nova] Creating event network-vif-deleted:2b5fd365-20f9-4fcc-919f-6f7d08efba8b for instance c6a55484-c74d-46c8-b37e-1fc43941e895 on nch2-master-1 May 21 21:18:16.853359 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-90b003aa-f278-438d-91db-92073b50f348 req-15e72080-0ab2-4538-b4e8-8b0a9b598076 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034866 May 21 21:18:16.854701 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1077/2102] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:16.857237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9eaf3d3c-b006-4947-b334-152f7cc09dff tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:16.867993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9eaf3d3c-b006-4947-b334-152f7cc09dff tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:16.869934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9eaf3d3c-b006-4947-b334-152f7cc09dff tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:16.871293 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9eaf3d3c-b006-4947-b334-152f7cc09dff tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1583 microversion: 2.32 time: 0.204533 May 21 21:18:16.872033 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1026/2103] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:16 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1583 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:17.087228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-35bc1f9e-90ee-49e5-9614-cd6b29aa55e6 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:17.088141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-35bc1f9e-90ee-49e5-9614-cd6b29aa55e6 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:17.097063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35bc1f9e-90ee-49e5-9614-cd6b29aa55e6 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:17.097759 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35bc1f9e-90ee-49e5-9614-cd6b29aa55e6 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:17.098582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35bc1f9e-90ee-49e5-9614-cd6b29aa55e6 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:17.099024 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35bc1f9e-90ee-49e5-9614-cd6b29aa55e6 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:17.105665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7e3af943-3050-43c5-bb93-8550a0712ca3 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:17.106343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7e3af943-3050-43c5-bb93-8550a0712ca3 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] [instance: 8af764f8-b932-44e9-a9ca-abe1d1238e8b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:17.124636 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e3af943-3050-43c5-bb93-8550a0712ca3 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:17.128472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e3af943-3050-43c5-bb93-8550a0712ca3 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:17.129883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e3af943-3050-43c5-bb93-8550a0712ca3 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:17.130311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e3af943-3050-43c5-bb93-8550a0712ca3 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:17.348174 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7e3af943-3050-43c5-bb93-8550a0712ca3 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d6821eac1b49e986073f36962b3046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e743b29f0d4b9899537992aad63696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:17.356866 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7e3af943-3050-43c5-bb93-8550a0712ca3 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] 10.222.0.49 "GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b" status: 200 len: 1321 microversion: 2.1 time: 0.255066 May 21 21:18:17.357949 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1027/2104] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:17 2022] GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:18:17.401036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-35bc1f9e-90ee-49e5-9614-cd6b29aa55e6 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:17.410150 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-35bc1f9e-90ee-49e5-9614-cd6b29aa55e6 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1354 microversion: 2.1 time: 0.328107 May 21 21:18:17.410729 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1078/2105] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:17 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1354 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:17.671222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e2b71e07-cbee-41f5-aa02-c41a44999a52 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:17.672226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e2b71e07-cbee-41f5-aa02-c41a44999a52 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: c6a55484-c74d-46c8-b37e-1fc43941e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:17.679233 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e2b71e07-cbee-41f5-aa02-c41a44999a52 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:17.680759 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e2b71e07-cbee-41f5-aa02-c41a44999a52 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:17.686189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e2b71e07-cbee-41f5-aa02-c41a44999a52 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:17.688275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e2b71e07-cbee-41f5-aa02-c41a44999a52 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:17.725547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-48030ee2-5ae5-44ce-adc8-d9249c2a8087 req-839970b7-328b-4d26-8849-f997f2aa4337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f63b08d-aaa7-4639-827f-d32bc60a78c8", "name": "network-vif-plugged", "status": "completed", "tag": "eee9373e-9e37-4ade-a694-8d3cfc96d47f"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:17.740401 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-e2b71e07-cbee-41f5-aa02-c41a44999a52 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] HTTP exception thrown: Instance c6a55484-c74d-46c8-b37e-1fc43941e895 could not be found. May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e2b71e07-cbee-41f5-aa02-c41a44999a52 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Request method failure captured: May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 HTTP/1.1 May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVV5MQ6wjX3e56hMYL2H6QpgG2OGlj7_WVu_9F0M9B0qG3q3UUDg996Rddujz6fUPxExXOpXkryXyYL-Wd8knK-7jGRmDNL-ylu-28gtS7k7dx0YNwh29VSnNOjvK9_KwSh8lCreK7X11V9JuHX_06dql2Z6V9Brqagrb3wXR5ML4fw May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: X-Openstack-Nova-Api-Version: 2.25 May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 220204ccbcf443c98a64994f29700ef0 May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1048081752 May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/220204ccbcf443c98a64994f29700ef0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/220204ccbcf443c98a64994f29700ef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_220204ccbcf443c98a64994f29700ef0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/220204ccbcf443c98a64994f29700ef0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1048081752 May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 220204ccbcf443c98a64994f29700ef0 May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1048081752 May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-LiveAutoBlockMigrationV225Test-1048081752-project May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: b7199de1e6f04147b197c086ac6cc6fc May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1048081752-project May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance c6a55484-c74d-46c8-b37e-1fc43941e895 could not be found. May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'c6a55484-c74d-46c8-b37e-1fc43941e895'} May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a55484-c74d-46c8-b37e-1fc43941e895 could not be found. May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a55484-c74d-46c8-b37e-1fc43941e895 could not be found. May 21 21:18:17.742135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:17.749222 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:17.749222 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:17.749222 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:17.749222 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:17.749222 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:17.749222 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:17.749222 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:17.749222 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a55484-c74d-46c8-b37e-1fc43941e895 could not be found. May 21 21:18:17.749222 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:17.749222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e2b71e07-cbee-41f5-aa02-c41a44999a52 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Returning 404 to user: Instance c6a55484-c74d-46c8-b37e-1fc43941e895 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:17.749222 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e2b71e07-cbee-41f5-aa02-c41a44999a52 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895" status: 404 len: 111 microversion: 2.25 time: 0.076612 May 21 21:18:17.749222 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1028/2106] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:17 2022] GET /compute/v2.1/servers/c6a55484-c74d-46c8-b37e-1fc43941e895 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:18:17.750347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-48030ee2-5ae5-44ce-adc8-d9249c2a8087 req-839970b7-328b-4d26-8849-f997f2aa4337 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:17.750347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-48030ee2-5ae5-44ce-adc8-d9249c2a8087 req-839970b7-328b-4d26-8849-f997f2aa4337 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:17.762473 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-48030ee2-5ae5-44ce-adc8-d9249c2a8087 req-839970b7-328b-4d26-8849-f997f2aa4337 service nova] Creating event network-vif-plugged:eee9373e-9e37-4ade-a694-8d3cfc96d47f for instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 on nch2-master-1 May 21 21:18:17.769622 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-48030ee2-5ae5-44ce-adc8-d9249c2a8087 req-839970b7-328b-4d26-8849-f997f2aa4337 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049089 May 21 21:18:17.770932 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1079/2107] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:17.833189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cdc36a8d-bdba-44cd-b456-c0b29433364d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:17.833968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cdc36a8d-bdba-44cd-b456-c0b29433364d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:17.840146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cdc36a8d-bdba-44cd-b456-c0b29433364d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:17.840678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cdc36a8d-bdba-44cd-b456-c0b29433364d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:17.841456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cdc36a8d-bdba-44cd-b456-c0b29433364d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:17.841901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cdc36a8d-bdba-44cd-b456-c0b29433364d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:17.892348 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ba1696f1-ce49-4af8-948b-371caaa910be tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:17.893924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ba1696f1-ce49-4af8-948b-371caaa910be tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:17.901198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba1696f1-ce49-4af8-948b-371caaa910be tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:17.901650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba1696f1-ce49-4af8-948b-371caaa910be tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:17.902989 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba1696f1-ce49-4af8-948b-371caaa910be tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:17.903135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba1696f1-ce49-4af8-948b-371caaa910be tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:17.993783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ba1696f1-ce49-4af8-948b-371caaa910be tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:18.003742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ba1696f1-ce49-4af8-948b-371caaa910be tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:18.005566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cdc36a8d-bdba-44cd-b456-c0b29433364d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:18.009042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ba1696f1-ce49-4af8-948b-371caaa910be tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:18.010472 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ba1696f1-ce49-4af8-948b-371caaa910be tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1593 microversion: 2.32 time: 0.122832 May 21 21:18:18.011362 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1080/2108] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:17 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1593 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:18.018392 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cdc36a8d-bdba-44cd-b456-c0b29433364d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1307 microversion: 2.1 time: 0.189059 May 21 21:18:18.018993 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1029/2109] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:17 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1307 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:18.375597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-074dd31a-0dd0-460b-ae49-99f45e914c13 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:18.377172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-074dd31a-0dd0-460b-ae49-99f45e914c13 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] [instance: 8af764f8-b932-44e9-a9ca-abe1d1238e8b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:18.385477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-074dd31a-0dd0-460b-ae49-99f45e914c13 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:18.386205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-074dd31a-0dd0-460b-ae49-99f45e914c13 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:18.387253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-074dd31a-0dd0-460b-ae49-99f45e914c13 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:18.387922 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-074dd31a-0dd0-460b-ae49-99f45e914c13 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:18.431714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4d1e870c-61be-46ec-9cdf-290b46d5f7d0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:18.432978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4d1e870c-61be-46ec-9cdf-290b46d5f7d0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:18.445857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d1e870c-61be-46ec-9cdf-290b46d5f7d0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:18.446567 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d1e870c-61be-46ec-9cdf-290b46d5f7d0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:18.451186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d1e870c-61be-46ec-9cdf-290b46d5f7d0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:18.451186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d1e870c-61be-46ec-9cdf-290b46d5f7d0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:18.813081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4d1e870c-61be-46ec-9cdf-290b46d5f7d0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:18.823729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-074dd31a-0dd0-460b-ae49-99f45e914c13 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d6821eac1b49e986073f36962b3046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e743b29f0d4b9899537992aad63696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:18.828453 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4d1e870c-61be-46ec-9cdf-290b46d5f7d0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1354 microversion: 2.1 time: 0.402291 May 21 21:18:18.829129 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1030/2110] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:18 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1354 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:18.841803 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-074dd31a-0dd0-460b-ae49-99f45e914c13 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] 10.222.0.49 "GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b" status: 200 len: 1471 microversion: 2.1 time: 0.470540 May 21 21:18:18.842938 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1081/2111] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:18 2022] GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b => generated 1471 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:18.860563 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0eb3337b-baf2-4642-a223-0736d8d6ffa6 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:18.861622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0eb3337b-baf2-4642-a223-0736d8d6ffa6 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] [instance: 8af764f8-b932-44e9-a9ca-abe1d1238e8b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:18.869680 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0eb3337b-baf2-4642-a223-0736d8d6ffa6 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:18.870143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0eb3337b-baf2-4642-a223-0736d8d6ffa6 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:18.870942 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0eb3337b-baf2-4642-a223-0736d8d6ffa6 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:18.871396 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0eb3337b-baf2-4642-a223-0736d8d6ffa6 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:18.902706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-192ed803-2044-471d-b569-4872b90cf419 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:18.903661 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-192ed803-2044-471d-b569-4872b90cf419 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:18.913966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0eb3337b-baf2-4642-a223-0736d8d6ffa6 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '10d6821eac1b49e986073f36962b3046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e743b29f0d4b9899537992aad63696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:18.914210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-192ed803-2044-471d-b569-4872b90cf419 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:18.914545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-192ed803-2044-471d-b569-4872b90cf419 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:18.915903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-192ed803-2044-471d-b569-4872b90cf419 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:18.916344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-192ed803-2044-471d-b569-4872b90cf419 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0eb3337b-baf2-4642-a223-0736d8d6ffa6 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Request method failure captured: May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b/diagnostics HTTP/1.1 May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVcGTvYBNxU3KJ6aQVr05LA1YCN5MrIewsrGlebLHLIlqh7W4VhIP_hIOGmDgVgA0MLqSC-FlAMuywBfOwm2ofqGaQoE04M9iWOww15ZZmgzBZiT3_FL2B7dvlY0F5pBcGSf1akiVkdy47jSym9mO4oVWF83DGBZcnqcfbPVrsC5AZk May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 38e743b29f0d4b9899537992aad63696 May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1225150597 May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/38e743b29f0d4b9899537992aad63696"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/38e743b29f0d4b9899537992aad63696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_38e743b29f0d4b9899537992aad63696", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/38e743b29f0d4b9899537992aad63696"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1225150597 May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 38e743b29f0d4b9899537992aad63696 May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1225150597 May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerDiagnosticsNegativeTest-1225150597-project May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 10d6821eac1b49e986073f36962b3046 May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1225150597-project May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'server_id': '8af764f8-b932-44e9-a9ca-abe1d1238e8b'} May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:18.921624 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:18.926644 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:18.926644 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:18.926644 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:18:18.926644 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:18:18.926644 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 21 21:18:18.926644 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:18.927736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0eb3337b-baf2-4642-a223-0736d8d6ffa6 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:18.931141 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0eb3337b-baf2-4642-a223-0736d8d6ffa6 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] 10.222.0.49 "GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.072439 May 21 21:18:18.937428 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1031/2112] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:18:18 2022] GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b/diagnostics => generated 117 bytes in 82 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:18:18.983231 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f6676ac3-ca0c-47dd-b7d9-b2ef1ea5b80c tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:18.984814 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f6676ac3-ca0c-47dd-b7d9-b2ef1ea5b80c tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] [instance: 8af764f8-b932-44e9-a9ca-abe1d1238e8b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:19.003834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6676ac3-ca0c-47dd-b7d9-b2ef1ea5b80c tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:19.004316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6676ac3-ca0c-47dd-b7d9-b2ef1ea5b80c tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:19.016662 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6676ac3-ca0c-47dd-b7d9-b2ef1ea5b80c tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:19.016662 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6676ac3-ca0c-47dd-b7d9-b2ef1ea5b80c tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:19.026378 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-192ed803-2044-471d-b569-4872b90cf419 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:18:19.076367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f6676ac3-ca0c-47dd-b7d9-b2ef1ea5b80c tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] [instance: 8af764f8-b932-44e9-a9ca-abe1d1238e8b] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:18:19.367768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:19.457760 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f6676ac3-ca0c-47dd-b7d9-b2ef1ea5b80c tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b" status: 204 len: 0 microversion: 2.1 time: 0.517973 May 21 21:18:19.458603 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-192ed803-2044-471d-b569-4872b90cf419 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439" status: 204 len: 0 microversion: 2.1 time: 0.559688 May 21 21:18:19.459050 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1032/2113] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:18:18 2022] DELETE /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:18:19.463362 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1082/2114] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:18:18 2022] DELETE /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 21:18:19.468343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ae3090bf-5d51-4084-85ec-dc216c0e871e tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:19.469078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ae3090bf-5d51-4084-85ec-dc216c0e871e tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:19.469969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-301d5963-f8d2-472e-b2d8-c1b0290666da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:19.470909 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-301d5963-f8d2-472e-b2d8-c1b0290666da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:19.479231 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ae3090bf-5d51-4084-85ec-dc216c0e871e tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:19.479596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-301d5963-f8d2-472e-b2d8-c1b0290666da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:19.480143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-301d5963-f8d2-472e-b2d8-c1b0290666da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:19.491629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-301d5963-f8d2-472e-b2d8-c1b0290666da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:19.491629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-301d5963-f8d2-472e-b2d8-c1b0290666da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:19.493473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ae3090bf-5d51-4084-85ec-dc216c0e871e tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:19.494464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ae3090bf-5d51-4084-85ec-dc216c0e871e tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:19.494926 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ae3090bf-5d51-4084-85ec-dc216c0e871e tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:19.702649 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-301d5963-f8d2-472e-b2d8-c1b0290666da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:19.715956 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-301d5963-f8d2-472e-b2d8-c1b0290666da tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1307 microversion: 2.1 time: 0.254461 May 21 21:18:19.716909 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1083/2115] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:19 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1307 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:19.722262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-40364a4f-d7e5-489b-880d-47b4f42f7aa3 req-1a0d1327-578d-418d-8bfc-367abf378abc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9be9b1d-6502-4335-90b3-677ff81f4efc", "tag": "779a6c9f-256c-48e3-976d-aa8ffc3d3790"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:19.739790 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-40364a4f-d7e5-489b-880d-47b4f42f7aa3 req-1a0d1327-578d-418d-8bfc-367abf378abc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:19.740244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-40364a4f-d7e5-489b-880d-47b4f42f7aa3 req-1a0d1327-578d-418d-8bfc-367abf378abc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:19.753145 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-40364a4f-d7e5-489b-880d-47b4f42f7aa3 req-1a0d1327-578d-418d-8bfc-367abf378abc service nova] Creating event network-changed:779a6c9f-256c-48e3-976d-aa8ffc3d3790 for instance a9be9b1d-6502-4335-90b3-677ff81f4efc on nch1-master-1 May 21 21:18:19.758065 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-40364a4f-d7e5-489b-880d-47b4f42f7aa3 req-1a0d1327-578d-418d-8bfc-367abf378abc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039791 May 21 21:18:19.759006 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1084/2116] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:19.763978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ced04c04-f0cf-45ab-9971-4f57f32a51b5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:19.764885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ced04c04-f0cf-45ab-9971-4f57f32a51b5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:19.771194 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ced04c04-f0cf-45ab-9971-4f57f32a51b5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:19.771657 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ced04c04-f0cf-45ab-9971-4f57f32a51b5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:19.773030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ced04c04-f0cf-45ab-9971-4f57f32a51b5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:19.773481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ced04c04-f0cf-45ab-9971-4f57f32a51b5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:19.782283 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ae3090bf-5d51-4084-85ec-dc216c0e871e tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:19.792591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ae3090bf-5d51-4084-85ec-dc216c0e871e tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:19.794109 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ae3090bf-5d51-4084-85ec-dc216c0e871e tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:19.795253 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ae3090bf-5d51-4084-85ec-dc216c0e871e tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1661 microversion: 2.32 time: 0.332001 May 21 21:18:19.795817 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1033/2117] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:19 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1661 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:19.800383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ed03653f-3735-4639-ba16-bf6be9d9a83c tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:19.800992 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ed03653f-3735-4639-ba16-bf6be9d9a83c tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] [instance: 8af764f8-b932-44e9-a9ca-abe1d1238e8b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:19.807412 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed03653f-3735-4639-ba16-bf6be9d9a83c tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:19.807987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed03653f-3735-4639-ba16-bf6be9d9a83c tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:19.808979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed03653f-3735-4639-ba16-bf6be9d9a83c tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:19.809515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed03653f-3735-4639-ba16-bf6be9d9a83c tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:19.960094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ced04c04-f0cf-45ab-9971-4f57f32a51b5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:19.968504 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ced04c04-f0cf-45ab-9971-4f57f32a51b5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439" status: 200 len: 1553 microversion: 2.1 time: 0.208321 May 21 21:18:19.969087 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1085/2118] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:19 2022] GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 => generated 1553 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:19.974299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-a42b5e44-5b2e-483a-95a5-c2f5660a0242 req-91762c84-414c-48f6-ad1f-95d2684c4919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f63b08d-aaa7-4639-827f-d32bc60a78c8", "name": "network-vif-plugged", "status": "completed", "tag": "727bcbb6-7735-41db-859d-5524186926b9"}, {"server_uuid": "7f63b08d-aaa7-4639-827f-d32bc60a78c8", "name": "network-vif-plugged", "status": "completed", "tag": "ed56d410-5713-462c-bfbe-91491c8c21c6"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:19.982591 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a42b5e44-5b2e-483a-95a5-c2f5660a0242 req-91762c84-414c-48f6-ad1f-95d2684c4919 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:19.983045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a42b5e44-5b2e-483a-95a5-c2f5660a0242 req-91762c84-414c-48f6-ad1f-95d2684c4919 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:19.994740 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a42b5e44-5b2e-483a-95a5-c2f5660a0242 req-91762c84-414c-48f6-ad1f-95d2684c4919 service nova] Creating event network-vif-plugged:727bcbb6-7735-41db-859d-5524186926b9 for instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 on nch2-master-1 May 21 21:18:19.999622 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a42b5e44-5b2e-483a-95a5-c2f5660a0242 req-91762c84-414c-48f6-ad1f-95d2684c4919 service nova] Creating event network-vif-plugged:ed56d410-5713-462c-bfbe-91491c8c21c6 for instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 on nch2-master-1 May 21 21:18:20.000400 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-a42b5e44-5b2e-483a-95a5-c2f5660a0242 req-91762c84-414c-48f6-ad1f-95d2684c4919 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030141 May 21 21:18:20.001076 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1086/2119] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:20.005083 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ed03653f-3735-4639-ba16-bf6be9d9a83c tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d6821eac1b49e986073f36962b3046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e743b29f0d4b9899537992aad63696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:20.006721 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1f9d2eb5-389b-4ce2-b6e9-e9bad2870457 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:20.007434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1f9d2eb5-389b-4ce2-b6e9-e9bad2870457 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:20.013782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f9d2eb5-389b-4ce2-b6e9-e9bad2870457 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:20.014241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f9d2eb5-389b-4ce2-b6e9-e9bad2870457 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:20.014884 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ed03653f-3735-4639-ba16-bf6be9d9a83c tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] 10.222.0.49 "GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b" status: 200 len: 1477 microversion: 2.1 time: 0.217897 May 21 21:18:20.015006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f9d2eb5-389b-4ce2-b6e9-e9bad2870457 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:20.015449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f9d2eb5-389b-4ce2-b6e9-e9bad2870457 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:20.026523 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1034/2120] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:19 2022] GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b => generated 1477 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:20.188609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1f9d2eb5-389b-4ce2-b6e9-e9bad2870457 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:20.194333 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1f9d2eb5-389b-4ce2-b6e9-e9bad2870457 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1354 microversion: 2.1 time: 0.191791 May 21 21:18:20.195064 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1087/2121] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:20 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1354 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:20.733428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a7b21649-e6cd-4fdf-9871-fbae8658ee3d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:20.734054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a7b21649-e6cd-4fdf-9871-fbae8658ee3d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:20.742186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7b21649-e6cd-4fdf-9871-fbae8658ee3d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:20.742658 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7b21649-e6cd-4fdf-9871-fbae8658ee3d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:20.743436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7b21649-e6cd-4fdf-9871-fbae8658ee3d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:20.743915 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7b21649-e6cd-4fdf-9871-fbae8658ee3d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:20.813507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b7b226b8-9ae3-4d31-afcd-382c2e724723 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:20.814980 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b7b226b8-9ae3-4d31-afcd-382c2e724723 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:20.818530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:20.825715 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7b226b8-9ae3-4d31-afcd-382c2e724723 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:20.826401 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7b226b8-9ae3-4d31-afcd-382c2e724723 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:20.829248 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7b226b8-9ae3-4d31-afcd-382c2e724723 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:20.829248 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7b226b8-9ae3-4d31-afcd-382c2e724723 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:20.942143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a7b21649-e6cd-4fdf-9871-fbae8658ee3d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:20.950370 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a7b21649-e6cd-4fdf-9871-fbae8658ee3d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1307 microversion: 2.1 time: 0.221264 May 21 21:18:20.958704 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1035/2122] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:20 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1307 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:20.986626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-341f2f53-fe57-42e7-8504-9afeb51c1622 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:20.987432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-341f2f53-fe57-42e7-8504-9afeb51c1622 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:20.993880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-341f2f53-fe57-42e7-8504-9afeb51c1622 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:20.994402 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-341f2f53-fe57-42e7-8504-9afeb51c1622 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:20.995251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-341f2f53-fe57-42e7-8504-9afeb51c1622 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:20.995766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-341f2f53-fe57-42e7-8504-9afeb51c1622 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:21.047700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b7b226b8-9ae3-4d31-afcd-382c2e724723 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:21.058742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b7b226b8-9ae3-4d31-afcd-382c2e724723 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:21.060692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b7b226b8-9ae3-4d31-afcd-382c2e724723 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:21.062315 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b7b226b8-9ae3-4d31-afcd-382c2e724723 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1661 microversion: 2.32 time: 0.252349 May 21 21:18:21.064977 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1088/2123] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:20 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1661 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:18:21.069372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2cc3656a-041d-4e22-923e-8b4396ddc6e5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:21.070214 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2cc3656a-041d-4e22-923e-8b4396ddc6e5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] [instance: 8af764f8-b932-44e9-a9ca-abe1d1238e8b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:21.081642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2cc3656a-041d-4e22-923e-8b4396ddc6e5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:21.082106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2cc3656a-041d-4e22-923e-8b4396ddc6e5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:21.082898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2cc3656a-041d-4e22-923e-8b4396ddc6e5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:21.083573 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2cc3656a-041d-4e22-923e-8b4396ddc6e5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:21.148952 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-341f2f53-fe57-42e7-8504-9afeb51c1622 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:21.157342 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-341f2f53-fe57-42e7-8504-9afeb51c1622 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439" status: 200 len: 1553 microversion: 2.1 time: 0.175218 May 21 21:18:21.158710 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1036/2124] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:20 2022] GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 => generated 1553 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:18:21.211885 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ecf41ba0-b98d-4e25-ae75-5f6b10f16ad9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:21.212459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ecf41ba0-b98d-4e25-ae75-5f6b10f16ad9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:21.219549 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ecf41ba0-b98d-4e25-ae75-5f6b10f16ad9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:21.220417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ecf41ba0-b98d-4e25-ae75-5f6b10f16ad9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:21.221606 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ecf41ba0-b98d-4e25-ae75-5f6b10f16ad9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:21.222049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ecf41ba0-b98d-4e25-ae75-5f6b10f16ad9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:21.239318 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2cc3656a-041d-4e22-923e-8b4396ddc6e5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d6821eac1b49e986073f36962b3046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e743b29f0d4b9899537992aad63696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:21.249668 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2cc3656a-041d-4e22-923e-8b4396ddc6e5 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] 10.222.0.49 "GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b" status: 200 len: 1477 microversion: 2.1 time: 0.183795 May 21 21:18:21.250213 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1089/2125] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:21 2022] GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b => generated 1477 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:21.402497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ecf41ba0-b98d-4e25-ae75-5f6b10f16ad9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:21.411502 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ecf41ba0-b98d-4e25-ae75-5f6b10f16ad9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1354 microversion: 2.1 time: 0.203560 May 21 21:18:21.412091 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1037/2126] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:21 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1354 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:18:21.967261 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-44df89e9-7647-4a6f-a5a6-e8ec7f1bebb1 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:21.967923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-44df89e9-7647-4a6f-a5a6-e8ec7f1bebb1 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:21.976804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44df89e9-7647-4a6f-a5a6-e8ec7f1bebb1 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:21.977261 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44df89e9-7647-4a6f-a5a6-e8ec7f1bebb1 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:21.978060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44df89e9-7647-4a6f-a5a6-e8ec7f1bebb1 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:21.978664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44df89e9-7647-4a6f-a5a6-e8ec7f1bebb1 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:22.081751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1213f3f9-dc2f-484d-8f47-e0f60789be5a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:22.082867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1213f3f9-dc2f-484d-8f47-e0f60789be5a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:22.095688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1213f3f9-dc2f-484d-8f47-e0f60789be5a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:22.096260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1213f3f9-dc2f-484d-8f47-e0f60789be5a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:22.097370 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1213f3f9-dc2f-484d-8f47-e0f60789be5a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:22.097829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1213f3f9-dc2f-484d-8f47-e0f60789be5a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:22.479809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1213f3f9-dc2f-484d-8f47-e0f60789be5a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:22.494394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1213f3f9-dc2f-484d-8f47-e0f60789be5a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:22.496024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1213f3f9-dc2f-484d-8f47-e0f60789be5a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:22.502675 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1213f3f9-dc2f-484d-8f47-e0f60789be5a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1661 microversion: 2.32 time: 0.423598 May 21 21:18:22.505540 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1038/2127] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:22 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1661 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:18:22.516903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cab3b58a-02d2-47ef-9c71-5934b0ac6dc0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:22.521093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cab3b58a-02d2-47ef-9c71-5934b0ac6dc0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:22.530450 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cab3b58a-02d2-47ef-9c71-5934b0ac6dc0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:22.533319 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cab3b58a-02d2-47ef-9c71-5934b0ac6dc0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:22.537800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cab3b58a-02d2-47ef-9c71-5934b0ac6dc0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:22.538513 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cab3b58a-02d2-47ef-9c71-5934b0ac6dc0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:22.730129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:22.770352 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-44df89e9-7647-4a6f-a5a6-e8ec7f1bebb1 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:22.782420 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-44df89e9-7647-4a6f-a5a6-e8ec7f1bebb1 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1307 microversion: 2.1 time: 0.819067 May 21 21:18:22.785606 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1090/2128] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:21 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1307 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:22.791057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3d71f2e1-ce68-46dd-8161-369b91af94e2 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:22.791928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3d71f2e1-ce68-46dd-8161-369b91af94e2 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] [instance: 8af764f8-b932-44e9-a9ca-abe1d1238e8b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:22.801745 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d71f2e1-ce68-46dd-8161-369b91af94e2 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:22.802523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d71f2e1-ce68-46dd-8161-369b91af94e2 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:22.803959 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d71f2e1-ce68-46dd-8161-369b91af94e2 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:22.804752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d71f2e1-ce68-46dd-8161-369b91af94e2 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:22.930308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cab3b58a-02d2-47ef-9c71-5934b0ac6dc0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:22.940698 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cab3b58a-02d2-47ef-9c71-5934b0ac6dc0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439" status: 200 len: 1553 microversion: 2.1 time: 0.433863 May 21 21:18:22.941715 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1039/2129] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:22 2022] GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 => generated 1553 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:22.957623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b9e95195-c8d2-40b9-9b89-9c34bf9e8c56 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:22.958801 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b9e95195-c8d2-40b9-9b89-9c34bf9e8c56 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:22.975457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9e95195-c8d2-40b9-9b89-9c34bf9e8c56 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:22.976175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9e95195-c8d2-40b9-9b89-9c34bf9e8c56 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:22.977540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9e95195-c8d2-40b9-9b89-9c34bf9e8c56 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:22.978226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9e95195-c8d2-40b9-9b89-9c34bf9e8c56 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:23.008701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:23.311907 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b9e95195-c8d2-40b9-9b89-9c34bf9e8c56 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:23.313694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=10 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:23.326478 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b9e95195-c8d2-40b9-9b89-9c34bf9e8c56 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1802 microversion: 2.1 time: 0.382489 May 21 21:18:23.327918 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1040/2130] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:22 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1802 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:23.350929 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a37349da-e514-46db-a95c-e2bf5cbe3f9f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:23.351762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a37349da-e514-46db-a95c-e2bf5cbe3f9f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:23.361073 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a37349da-e514-46db-a95c-e2bf5cbe3f9f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:23.361073 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a37349da-e514-46db-a95c-e2bf5cbe3f9f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:23.362618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a37349da-e514-46db-a95c-e2bf5cbe3f9f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:23.363307 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a37349da-e514-46db-a95c-e2bf5cbe3f9f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:23.408726 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a37349da-e514-46db-a95c-e2bf5cbe3f9f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8/ips" status: 200 len: 216 microversion: 2.1 time: 0.056771 May 21 21:18:23.408726 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1041/2131] 10.222.0.49 () {58 vars in 1247 bytes} [Sat May 21 21:18:23 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8/ips => generated 216 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:23.421429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f7ad6936-a792-4b20-9ee5-85dfeba83633 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:23.423361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f7ad6936-a792-4b20-9ee5-85dfeba83633 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:23.430759 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f7ad6936-a792-4b20-9ee5-85dfeba83633 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:23.431378 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f7ad6936-a792-4b20-9ee5-85dfeba83633 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:23.433854 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f7ad6936-a792-4b20-9ee5-85dfeba83633 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:23.434410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f7ad6936-a792-4b20-9ee5-85dfeba83633 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:23.464634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f7ad6936-a792-4b20-9ee5-85dfeba83633 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:18:23.478944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3d71f2e1-ce68-46dd-8161-369b91af94e2 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d6821eac1b49e986073f36962b3046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e743b29f0d4b9899537992aad63696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:23.489802 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3d71f2e1-ce68-46dd-8161-369b91af94e2 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] 10.222.0.49 "GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b" status: 200 len: 1477 microversion: 2.1 time: 0.702767 May 21 21:18:23.496677 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1091/2132] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:22 2022] GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b => generated 1477 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:23.526056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a92e04d9-359b-473b-a0ac-e7bdf16b10aa tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:23.527109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a92e04d9-359b-473b-a0ac-e7bdf16b10aa tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:23.546513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a92e04d9-359b-473b-a0ac-e7bdf16b10aa tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:23.546749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a92e04d9-359b-473b-a0ac-e7bdf16b10aa tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:23.552897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a92e04d9-359b-473b-a0ac-e7bdf16b10aa tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:23.553367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a92e04d9-359b-473b-a0ac-e7bdf16b10aa tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:23.847654 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f7ad6936-a792-4b20-9ee5-85dfeba83633 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 204 len: 0 microversion: 2.1 time: 0.432395 May 21 21:18:23.848933 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1042/2133] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:18:23 2022] DELETE /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:18:23.855222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0e832050-780c-4b76-9367-afbf6265b7b8 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:23.856306 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0e832050-780c-4b76-9367-afbf6265b7b8 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:23.869797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e832050-780c-4b76-9367-afbf6265b7b8 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:23.872825 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e832050-780c-4b76-9367-afbf6265b7b8 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:23.873631 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e832050-780c-4b76-9367-afbf6265b7b8 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:23.874076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e832050-780c-4b76-9367-afbf6265b7b8 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:24.053319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a92e04d9-359b-473b-a0ac-e7bdf16b10aa tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:24.063488 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a92e04d9-359b-473b-a0ac-e7bdf16b10aa tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:24.065976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a92e04d9-359b-473b-a0ac-e7bdf16b10aa tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:24.067998 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a92e04d9-359b-473b-a0ac-e7bdf16b10aa tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1708 microversion: 2.32 time: 0.547593 May 21 21:18:24.080197 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1092/2134] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:23 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1708 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:24.086876 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1611dd86-79fb-4293-96b3-521d638d73a0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:24.093474 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1611dd86-79fb-4293-96b3-521d638d73a0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:24.094580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1611dd86-79fb-4293-96b3-521d638d73a0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:24.095414 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1611dd86-79fb-4293-96b3-521d638d73a0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:24.096635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1611dd86-79fb-4293-96b3-521d638d73a0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:24.097253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1611dd86-79fb-4293-96b3-521d638d73a0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:24.161376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0e832050-780c-4b76-9367-afbf6265b7b8 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:24.186259 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0e832050-780c-4b76-9367-afbf6265b7b8 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1307 microversion: 2.1 time: 0.334163 May 21 21:18:24.188905 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1043/2135] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:23 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1307 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:24.199408 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6b21aff8-7fe2-4c5b-86e6-a32a4b9ecdfc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:24.202908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6b21aff8-7fe2-4c5b-86e6-a32a4b9ecdfc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:24.216155 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b21aff8-7fe2-4c5b-86e6-a32a4b9ecdfc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:24.218418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b21aff8-7fe2-4c5b-86e6-a32a4b9ecdfc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:24.219244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b21aff8-7fe2-4c5b-86e6-a32a4b9ecdfc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:24.219694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b21aff8-7fe2-4c5b-86e6-a32a4b9ecdfc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:24.327309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6b21aff8-7fe2-4c5b-86e6-a32a4b9ecdfc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:24.336274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=10 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:24.339846 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6b21aff8-7fe2-4c5b-86e6-a32a4b9ecdfc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439" status: 200 len: 1511 microversion: 2.1 time: 0.149372 May 21 21:18:24.340690 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1044/2136] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:24 2022] GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:24.532140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f87b34c0-7cd7-4ee6-9857-6a5aefd9cd18 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1391950358", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:24.616702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-f87b34c0-7cd7-4ee6-9857-6a5aefd9cd18 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] validate_networks() for None {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:18:24.668406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1611dd86-79fb-4293-96b3-521d638d73a0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:24.678369 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1611dd86-79fb-4293-96b3-521d638d73a0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1808 microversion: 2.1 time: 0.596582 May 21 21:18:24.679603 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1093/2137] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:24 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1808 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:24.684775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-25cb707a-0076-405c-85f0-ae7440bf1dbb req-6ce3fe99-f427-4b4a-bf07-b534bb6628a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9e520cb-58ff-4e71-bf09-f171b2d09439", "name": "network-vif-deleted", "tag": "7fc4e4c5-c1ef-4e72-8b4d-d8c80f413ad1"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:24.699565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-25cb707a-0076-405c-85f0-ae7440bf1dbb req-6ce3fe99-f427-4b4a-bf07-b534bb6628a2 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:24.700293 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-25cb707a-0076-405c-85f0-ae7440bf1dbb req-6ce3fe99-f427-4b4a-bf07-b534bb6628a2 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:24.708451 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:24.723249 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-25cb707a-0076-405c-85f0-ae7440bf1dbb req-6ce3fe99-f427-4b4a-bf07-b534bb6628a2 service nova] Creating event network-vif-deleted:7fc4e4c5-c1ef-4e72-8b4d-d8c80f413ad1 for instance e9e520cb-58ff-4e71-bf09-f171b2d09439 on nch1-master-1 May 21 21:18:24.729140 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-25cb707a-0076-405c-85f0-ae7440bf1dbb req-6ce3fe99-f427-4b4a-bf07-b534bb6628a2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047763 May 21 21:18:24.734856 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1094/2138] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:24.743391 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9f274653-048a-4278-8365-72916a65ab1e tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:24.745287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9f274653-048a-4278-8365-72916a65ab1e tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] [instance: 8af764f8-b932-44e9-a9ca-abe1d1238e8b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:24.753040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f274653-048a-4278-8365-72916a65ab1e tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:24.754299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f274653-048a-4278-8365-72916a65ab1e tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:24.755308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f274653-048a-4278-8365-72916a65ab1e tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:24.755930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f274653-048a-4278-8365-72916a65ab1e tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:24.834542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9f274653-048a-4278-8365-72916a65ab1e tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d6821eac1b49e986073f36962b3046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e743b29f0d4b9899537992aad63696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:24.843352 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9f274653-048a-4278-8365-72916a65ab1e tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] 10.222.0.49 "GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b" status: 200 len: 1435 microversion: 2.1 time: 0.106262 May 21 21:18:24.844017 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1095/2139] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:24 2022] GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b => generated 1435 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:25.067967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f87b34c0-7cd7-4ee6-9857-6a5aefd9cd18 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:18:25.069635 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f87b34c0-7cd7-4ee6-9857-6a5aefd9cd18 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:18:25.070759 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f87b34c0-7cd7-4ee6-9857-6a5aefd9cd18 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:18:25.072083 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f87b34c0-7cd7-4ee6-9857-6a5aefd9cd18 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:18:25.072669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f87b34c0-7cd7-4ee6-9857-6a5aefd9cd18 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:18:25.093563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fd220724-9484-4e05-aad4-c747ebfdb191 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:25.093563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fd220724-9484-4e05-aad4-c747ebfdb191 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:25.096201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd220724-9484-4e05-aad4-c747ebfdb191 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:25.096896 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd220724-9484-4e05-aad4-c747ebfdb191 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:25.097865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd220724-9484-4e05-aad4-c747ebfdb191 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:25.098485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd220724-9484-4e05-aad4-c747ebfdb191 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:25.107651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f87b34c0-7cd7-4ee6-9857-6a5aefd9cd18 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:25.108109 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f87b34c0-7cd7-4ee6-9857-6a5aefd9cd18 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:25.109009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f87b34c0-7cd7-4ee6-9857-6a5aefd9cd18 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:25.109625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f87b34c0-7cd7-4ee6-9857-6a5aefd9cd18 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:25.145052 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-f87b34c0-7cd7-4ee6-9857-6a5aefd9cd18 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Getting quotas for project a9bb4d7f9fb14923bd3fb8a4146f737c. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:18:25.155661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-f87b34c0-7cd7-4ee6-9857-6a5aefd9cd18 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Getting quotas for user d128df9f2acf4b14aeb3d6b4ba3012ff and project a9bb4d7f9fb14923bd3fb8a4146f737c. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:18:25.171061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f87b34c0-7cd7-4ee6-9857-6a5aefd9cd18 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:18:25.174074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f87b34c0-7cd7-4ee6-9857-6a5aefd9cd18 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:18:25.277644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fd220724-9484-4e05-aad4-c747ebfdb191 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:25.288319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fd220724-9484-4e05-aad4-c747ebfdb191 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:25.289831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fd220724-9484-4e05-aad4-c747ebfdb191 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:25.291126 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fd220724-9484-4e05-aad4-c747ebfdb191 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1755 microversion: 2.32 time: 0.208070 May 21 21:18:25.291684 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1096/2140] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:25 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1755 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:18:25.296271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-88e6a693-1dbb-4309-ad67-287f52515e51 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:25.296904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-88e6a693-1dbb-4309-ad67-287f52515e51 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:25.304273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88e6a693-1dbb-4309-ad67-287f52515e51 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:25.307714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88e6a693-1dbb-4309-ad67-287f52515e51 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:25.307714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88e6a693-1dbb-4309-ad67-287f52515e51 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:25.307714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88e6a693-1dbb-4309-ad67-287f52515e51 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:25.403628 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f87b34c0-7cd7-4ee6-9857-6a5aefd9cd18 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.061653 May 21 21:18:25.404302 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1045/2141] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:18:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:18:25.410091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-814e273f-f96b-4af4-bf2c-39957ea7f393 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:25.410703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-814e273f-f96b-4af4-bf2c-39957ea7f393 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:25.418810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-814e273f-f96b-4af4-bf2c-39957ea7f393 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:25.419275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-814e273f-f96b-4af4-bf2c-39957ea7f393 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:25.420125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-814e273f-f96b-4af4-bf2c-39957ea7f393 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:25.420596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-814e273f-f96b-4af4-bf2c-39957ea7f393 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:25.542347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-88e6a693-1dbb-4309-ad67-287f52515e51 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:25.554548 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-88e6a693-1dbb-4309-ad67-287f52515e51 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1307 microversion: 2.1 time: 0.261766 May 21 21:18:25.555804 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1097/2142] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:25 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1307 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:25.565443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-06157e50-57ce-4f7c-939c-db0e2798f0f9 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:25.567173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-06157e50-57ce-4f7c-939c-db0e2798f0f9 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:25.573715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-814e273f-f96b-4af4-bf2c-39957ea7f393 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:25.595098 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-814e273f-f96b-4af4-bf2c-39957ea7f393 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439" status: 200 len: 1345 microversion: 2.1 time: 0.189657 May 21 21:18:25.596473 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1046/2143] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:25 2022] GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 => generated 1345 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:25.639637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-06157e50-57ce-4f7c-939c-db0e2798f0f9 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128df9f2acf4b14aeb3d6b4ba3012ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bb4d7f9fb14923bd3fb8a4146f737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:25.649623 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-06157e50-57ce-4f7c-939c-db0e2798f0f9 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca" status: 200 len: 1214 microversion: 2.1 time: 0.091680 May 21 21:18:25.652331 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1098/2144] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:25 2022] GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:25.700561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-48b4341b-7bba-4802-91d0-0c66e18930d1 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:25.701436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-48b4341b-7bba-4802-91d0-0c66e18930d1 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:25.718416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-48b4341b-7bba-4802-91d0-0c66e18930d1 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:25.719193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-48b4341b-7bba-4802-91d0-0c66e18930d1 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:25.719886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-48b4341b-7bba-4802-91d0-0c66e18930d1 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:25.720580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-48b4341b-7bba-4802-91d0-0c66e18930d1 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:25.862181 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-43134298-5272-4821-bf79-cf3d6e9534c2 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:25.862929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-43134298-5272-4821-bf79-cf3d6e9534c2 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] [instance: 8af764f8-b932-44e9-a9ca-abe1d1238e8b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:25.869939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43134298-5272-4821-bf79-cf3d6e9534c2 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:25.870467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43134298-5272-4821-bf79-cf3d6e9534c2 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:25.871275 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43134298-5272-4821-bf79-cf3d6e9534c2 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:25.871756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43134298-5272-4821-bf79-cf3d6e9534c2 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:25.906226 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43134298-5272-4821-bf79-cf3d6e9534c2 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:25.906697 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43134298-5272-4821-bf79-cf3d6e9534c2 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:25.907198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-43134298-5272-4821-bf79-cf3d6e9534c2 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lazy-loading 'fault' on Instance uuid 8af764f8-b932-44e9-a9ca-abe1d1238e8b {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:18:25.958817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-43134298-5272-4821-bf79-cf3d6e9534c2 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d6821eac1b49e986073f36962b3046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e743b29f0d4b9899537992aad63696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:25.967753 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-43134298-5272-4821-bf79-cf3d6e9534c2 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] 10.222.0.49 "GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b" status: 200 len: 1311 microversion: 2.1 time: 0.110289 May 21 21:18:25.970676 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1099/2145] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:25 2022] GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:18:26.312304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-54ff032b-60c3-41e8-842e-acaf70fa77cd tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:26.313193 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-54ff032b-60c3-41e8-842e-acaf70fa77cd tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:26.321319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54ff032b-60c3-41e8-842e-acaf70fa77cd tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:26.321855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54ff032b-60c3-41e8-842e-acaf70fa77cd tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:26.322736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54ff032b-60c3-41e8-842e-acaf70fa77cd tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:26.323292 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54ff032b-60c3-41e8-842e-acaf70fa77cd tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:26.331656 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-48b4341b-7bba-4802-91d0-0c66e18930d1 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:26.341569 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-48b4341b-7bba-4802-91d0-0c66e18930d1 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1808 microversion: 2.1 time: 0.647914 May 21 21:18:26.342676 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1047/2146] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:25 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1808 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:18:26.534186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-54ff032b-60c3-41e8-842e-acaf70fa77cd tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:26.544436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-54ff032b-60c3-41e8-842e-acaf70fa77cd tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:26.548687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-54ff032b-60c3-41e8-842e-acaf70fa77cd tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:26.548687 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-54ff032b-60c3-41e8-842e-acaf70fa77cd tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1755 microversion: 2.32 time: 0.238945 May 21 21:18:26.548687 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1100/2147] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:26 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1755 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:26.571915 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-227e6a74-ae11-4c86-9844-24cf30d9eceb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:26.572817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-227e6a74-ae11-4c86-9844-24cf30d9eceb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:26.581116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-227e6a74-ae11-4c86-9844-24cf30d9eceb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:26.581711 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-227e6a74-ae11-4c86-9844-24cf30d9eceb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:26.582614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-227e6a74-ae11-4c86-9844-24cf30d9eceb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:26.583064 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-227e6a74-ae11-4c86-9844-24cf30d9eceb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:26.618098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-eb952efc-7425-43c8-b786-a8f79779be13 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:26.618829 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-eb952efc-7425-43c8-b786-a8f79779be13 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:26.634052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eb952efc-7425-43c8-b786-a8f79779be13 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:26.634964 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eb952efc-7425-43c8-b786-a8f79779be13 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:26.635974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eb952efc-7425-43c8-b786-a8f79779be13 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:26.636794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eb952efc-7425-43c8-b786-a8f79779be13 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:26.695816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eb952efc-7425-43c8-b786-a8f79779be13 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:26.696432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eb952efc-7425-43c8-b786-a8f79779be13 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:26.705489 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-eb952efc-7425-43c8-b786-a8f79779be13 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lazy-loading 'fault' on Instance uuid e9e520cb-58ff-4e71-bf09-f171b2d09439 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:18:26.762773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-eb952efc-7425-43c8-b786-a8f79779be13 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:26.775987 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-eb952efc-7425-43c8-b786-a8f79779be13 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439" status: 200 len: 1350 microversion: 2.1 time: 0.165963 May 21 21:18:26.777341 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1101/2148] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:26 2022] GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 => generated 1350 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:18:26.783483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f7dcae2b-9101-4759-9194-f1ef88b13efd tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:26.784035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f7dcae2b-9101-4759-9194-f1ef88b13efd tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:26.793145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7dcae2b-9101-4759-9194-f1ef88b13efd tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:26.805903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7dcae2b-9101-4759-9194-f1ef88b13efd tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:26.805903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7dcae2b-9101-4759-9194-f1ef88b13efd tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:26.805903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7dcae2b-9101-4759-9194-f1ef88b13efd tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:26.876836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f7dcae2b-9101-4759-9194-f1ef88b13efd tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128df9f2acf4b14aeb3d6b4ba3012ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bb4d7f9fb14923bd3fb8a4146f737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:26.885164 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f7dcae2b-9101-4759-9194-f1ef88b13efd tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca" status: 200 len: 1218 microversion: 2.1 time: 0.105807 May 21 21:18:26.886194 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1102/2149] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:26 2022] GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:26.899369 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-99ac98eb-7a1e-44e9-bd68-f118ec694474 req-5de66e88-bf9f-47b8-8bd6-24eeabc334b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af764f8-b932-44e9-a9ca-abe1d1238e8b", "name": "network-vif-deleted", "tag": "109ee926-6b2d-48e6-9fe0-33b202aa73b1"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:26.910731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-99ac98eb-7a1e-44e9-bd68-f118ec694474 req-5de66e88-bf9f-47b8-8bd6-24eeabc334b1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:26.911430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-99ac98eb-7a1e-44e9-bd68-f118ec694474 req-5de66e88-bf9f-47b8-8bd6-24eeabc334b1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:26.924190 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-99ac98eb-7a1e-44e9-bd68-f118ec694474 req-5de66e88-bf9f-47b8-8bd6-24eeabc334b1 service nova] Creating event network-vif-deleted:109ee926-6b2d-48e6-9fe0-33b202aa73b1 for instance 8af764f8-b932-44e9-a9ca-abe1d1238e8b on nch1-master-1 May 21 21:18:26.929359 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-99ac98eb-7a1e-44e9-bd68-f118ec694474 req-5de66e88-bf9f-47b8-8bd6-24eeabc334b1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041954 May 21 21:18:26.930039 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1103/2150] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:26.987215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-78f14da1-9e6f-4f5b-8d6f-aca49abbd476 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:26.988104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-78f14da1-9e6f-4f5b-8d6f-aca49abbd476 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] [instance: 8af764f8-b932-44e9-a9ca-abe1d1238e8b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:26.999896 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78f14da1-9e6f-4f5b-8d6f-aca49abbd476 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:27.000443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78f14da1-9e6f-4f5b-8d6f-aca49abbd476 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:27.001583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78f14da1-9e6f-4f5b-8d6f-aca49abbd476 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:27.002046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78f14da1-9e6f-4f5b-8d6f-aca49abbd476 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:27.015580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-227e6a74-ae11-4c86-9844-24cf30d9eceb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:27.021459 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-78f14da1-9e6f-4f5b-8d6f-aca49abbd476 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] HTTP exception thrown: Instance 8af764f8-b932-44e9-a9ca-abe1d1238e8b could not be found. May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-78f14da1-9e6f-4f5b-8d6f-aca49abbd476 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Request method failure captured: May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b HTTP/1.1 May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVcGTvYBNxU3KJ6aQVr05LA1YCN5MrIewsrGlebLHLIlqh7W4VhIP_hIOGmDgVgA0MLqSC-FlAMuywBfOwm2ofqGaQoE04M9iWOww15ZZmgzBZiT3_FL2B7dvlY0F5pBcGSf1akiVkdy47jSym9mO4oVWF83DGBZcnqcfbPVrsC5AZk May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 38e743b29f0d4b9899537992aad63696 May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1225150597 May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/38e743b29f0d4b9899537992aad63696"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/38e743b29f0d4b9899537992aad63696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_38e743b29f0d4b9899537992aad63696", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/38e743b29f0d4b9899537992aad63696"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1225150597 May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 38e743b29f0d4b9899537992aad63696 May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1225150597 May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerDiagnosticsNegativeTest-1225150597-project May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 10d6821eac1b49e986073f36962b3046 May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1225150597-project May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 8af764f8-b932-44e9-a9ca-abe1d1238e8b could not be found. May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '8af764f8-b932-44e9-a9ca-abe1d1238e8b'} May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8af764f8-b932-44e9-a9ca-abe1d1238e8b could not be found. May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8af764f8-b932-44e9-a9ca-abe1d1238e8b could not be found. May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:27.023560 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:27.030331 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:27.030331 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:27.030331 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:27.030331 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:27.030331 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:27.030331 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:27.030331 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8af764f8-b932-44e9-a9ca-abe1d1238e8b could not be found. May 21 21:18:27.030331 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:27.030331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-78f14da1-9e6f-4f5b-8d6f-aca49abbd476 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] Returning 404 to user: Instance 8af764f8-b932-44e9-a9ca-abe1d1238e8b could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:27.030331 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-78f14da1-9e6f-4f5b-8d6f-aca49abbd476 tempest-ServerDiagnosticsNegativeTest-1225150597 tempest-ServerDiagnosticsNegativeTest-1225150597-project] 10.222.0.49 "GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b" status: 404 len: 111 microversion: 2.1 time: 0.042988 May 21 21:18:27.033558 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-227e6a74-ae11-4c86-9844-24cf30d9eceb tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1307 microversion: 2.1 time: 0.462932 May 21 21:18:27.033558 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1048/2152] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:26 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1307 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:27.042625 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1104/2152] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:26 2022] GET /compute/v2.1/servers/8af764f8-b932-44e9-a9ca-abe1d1238e8b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:18:27.223995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-2d9ddf27-7f86-4e00-a270-83741076a243 req-a7ff4be7-e66a-43ac-ad5d-e3e9196cfc1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f63b08d-aaa7-4639-827f-d32bc60a78c8", "name": "network-vif-deleted", "tag": "eee9373e-9e37-4ade-a694-8d3cfc96d47f"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:27.238583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2d9ddf27-7f86-4e00-a270-83741076a243 req-a7ff4be7-e66a-43ac-ad5d-e3e9196cfc1c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:27.239093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2d9ddf27-7f86-4e00-a270-83741076a243 req-a7ff4be7-e66a-43ac-ad5d-e3e9196cfc1c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:27.254649 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-2d9ddf27-7f86-4e00-a270-83741076a243 req-a7ff4be7-e66a-43ac-ad5d-e3e9196cfc1c service nova] Creating event network-vif-deleted:eee9373e-9e37-4ade-a694-8d3cfc96d47f for instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 on nch2-master-1 May 21 21:18:27.260516 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-2d9ddf27-7f86-4e00-a270-83741076a243 req-a7ff4be7-e66a-43ac-ad5d-e3e9196cfc1c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042821 May 21 21:18:27.261997 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1049/2153] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:27.367655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-48696e17-85d3-4108-abd3-f5a8a7a3c45a tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:27.368516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-48696e17-85d3-4108-abd3-f5a8a7a3c45a tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:27.383183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48696e17-85d3-4108-abd3-f5a8a7a3c45a tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:27.383850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48696e17-85d3-4108-abd3-f5a8a7a3c45a tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:27.384800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48696e17-85d3-4108-abd3-f5a8a7a3c45a tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:27.395050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48696e17-85d3-4108-abd3-f5a8a7a3c45a tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:27.568596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b2558857-66bb-4e35-a7ec-dbe548d51af1 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:27.570242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b2558857-66bb-4e35-a7ec-dbe548d51af1 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:27.579618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2558857-66bb-4e35-a7ec-dbe548d51af1 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:27.580093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2558857-66bb-4e35-a7ec-dbe548d51af1 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:27.580927 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2558857-66bb-4e35-a7ec-dbe548d51af1 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:27.581376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2558857-66bb-4e35-a7ec-dbe548d51af1 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:27.599924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-48696e17-85d3-4108-abd3-f5a8a7a3c45a tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:27.612528 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-48696e17-85d3-4108-abd3-f5a8a7a3c45a tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1672 microversion: 2.1 time: 0.247973 May 21 21:18:27.613144 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1105/2154] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:27 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1672 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:27.801073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6eab57fb-7795-472f-a380-20a58271db7f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:27.801073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6eab57fb-7795-472f-a380-20a58271db7f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:27.809791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6eab57fb-7795-472f-a380-20a58271db7f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:27.810076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6eab57fb-7795-472f-a380-20a58271db7f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:27.811085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6eab57fb-7795-472f-a380-20a58271db7f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:27.811994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6eab57fb-7795-472f-a380-20a58271db7f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:27.832827 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-6eab57fb-7795-472f-a380-20a58271db7f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6eab57fb-7795-472f-a380-20a58271db7f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 HTTP/1.1 May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'e9e520cb-58ff-4e71-bf09-f171b2d09439'} May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:27.852742 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:27.858084 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:27.858084 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:27.858084 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:27.858084 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:27.858084 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:27.858084 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. May 21 21:18:27.858084 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:27.858084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6eab57fb-7795-472f-a380-20a58271db7f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:27.858084 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6eab57fb-7795-472f-a380-20a58271db7f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439" status: 404 len: 111 microversion: 2.1 time: 0.054495 May 21 21:18:27.858084 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1106/2155] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:27 2022] GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:18:27.903584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-33820ea7-ad79-4b1c-beaa-2563ec00c373 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:27.904351 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-33820ea7-ad79-4b1c-beaa-2563ec00c373 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:27.913533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33820ea7-ad79-4b1c-beaa-2563ec00c373 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:27.914278 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33820ea7-ad79-4b1c-beaa-2563ec00c373 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:27.915147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33820ea7-ad79-4b1c-beaa-2563ec00c373 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:27.915600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33820ea7-ad79-4b1c-beaa-2563ec00c373 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:27.917345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b2558857-66bb-4e35-a7ec-dbe548d51af1 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:27.960552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b2558857-66bb-4e35-a7ec-dbe548d51af1 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:27.965879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b2558857-66bb-4e35-a7ec-dbe548d51af1 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:27.967242 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b2558857-66bb-4e35-a7ec-dbe548d51af1 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1743 microversion: 2.32 time: 0.404799 May 21 21:18:27.967988 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1050/2156] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:27 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1743 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:28.011094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-33820ea7-ad79-4b1c-beaa-2563ec00c373 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128df9f2acf4b14aeb3d6b4ba3012ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bb4d7f9fb14923bd3fb8a4146f737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:28.022955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d7d08230-c23a-46f6-8847-e2f84c5ee226 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:28.022955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d7d08230-c23a-46f6-8847-e2f84c5ee226 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:28.030465 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7d08230-c23a-46f6-8847-e2f84c5ee226 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:28.030875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7d08230-c23a-46f6-8847-e2f84c5ee226 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:28.031748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7d08230-c23a-46f6-8847-e2f84c5ee226 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:28.032223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7d08230-c23a-46f6-8847-e2f84c5ee226 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:28.034052 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-33820ea7-ad79-4b1c-beaa-2563ec00c373 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca" status: 200 len: 1266 microversion: 2.1 time: 0.134838 May 21 21:18:28.042249 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1107/2157] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:27 2022] GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:28.054019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-edccbf90-ff9a-4d63-9653-658709f3acdc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:28.054694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-edccbf90-ff9a-4d63-9653-658709f3acdc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:28.080309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-edccbf90-ff9a-4d63-9653-658709f3acdc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:28.080309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-edccbf90-ff9a-4d63-9653-658709f3acdc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:28.080309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-edccbf90-ff9a-4d63-9653-658709f3acdc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:28.081438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-edccbf90-ff9a-4d63-9653-658709f3acdc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:28.089425 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-d7d08230-c23a-46f6-8847-e2f84c5ee226 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d7d08230-c23a-46f6-8847-e2f84c5ee226 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439/os-volume_attachments HTTP/1.1 May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'server_id': 'e9e520cb-58ff-4e71-bf09-f171b2d09439'} May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:18:28.098215 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. May 21 21:18:28.104397 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:28.104397 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:28.104397 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:28.104397 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:28.104397 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:28.104397 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:28.104397 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:28.104397 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:28.104397 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. May 21 21:18:28.104397 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:28.104397 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d7d08230-c23a-46f6-8847-e2f84c5ee226 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:28.104397 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d7d08230-c23a-46f6-8847-e2f84c5ee226 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.084165 May 21 21:18:28.104397 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1051/2158] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:18:28 2022] GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439/os-volume_attachments => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:18:28.442329 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-edccbf90-ff9a-4d63-9653-658709f3acdc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:28.445169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cd76fa4f-4f48-46b9-8390-0f1479992ea0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1624148504", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "f95b9f39-db04-49ea-b57f-7951c8f566a9"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:28.460827 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-edccbf90-ff9a-4d63-9653-658709f3acdc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1307 microversion: 2.1 time: 0.411983 May 21 21:18:28.461418 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1108/2159] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:28 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1307 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:18:28.508175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-cd76fa4f-4f48-46b9-8390-0f1479992ea0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] validate_networks() for [('f95b9f39-db04-49ea-b57f-7951c8f566a9', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:18:28.630341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cc2cda2b-93fa-4dbe-a6d1-73b1b4f6ae7b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:28.630992 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cc2cda2b-93fa-4dbe-a6d1-73b1b4f6ae7b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:28.637202 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cc2cda2b-93fa-4dbe-a6d1-73b1b4f6ae7b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:28.637653 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cc2cda2b-93fa-4dbe-a6d1-73b1b4f6ae7b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:28.638421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cc2cda2b-93fa-4dbe-a6d1-73b1b4f6ae7b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:28.638858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cc2cda2b-93fa-4dbe-a6d1-73b1b4f6ae7b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:28.858796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cc2cda2b-93fa-4dbe-a6d1-73b1b4f6ae7b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:28.872535 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cc2cda2b-93fa-4dbe-a6d1-73b1b4f6ae7b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1651 microversion: 2.1 time: 0.246759 May 21 21:18:28.873245 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1109/2160] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:28 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1651 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:18:28.988728 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-037319df-fb25-4f5c-9fdf-5fef5d7fbffb tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:28.990124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-037319df-fb25-4f5c-9fdf-5fef5d7fbffb tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:28.996931 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-037319df-fb25-4f5c-9fdf-5fef5d7fbffb tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:28.997389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-037319df-fb25-4f5c-9fdf-5fef5d7fbffb tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:28.998189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-037319df-fb25-4f5c-9fdf-5fef5d7fbffb tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:28.998635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-037319df-fb25-4f5c-9fdf-5fef5d7fbffb tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:29.205962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-037319df-fb25-4f5c-9fdf-5fef5d7fbffb tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:29.215397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-037319df-fb25-4f5c-9fdf-5fef5d7fbffb tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:29.218131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-037319df-fb25-4f5c-9fdf-5fef5d7fbffb tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:29.219582 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-037319df-fb25-4f5c-9fdf-5fef5d7fbffb tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1790 microversion: 2.32 time: 0.236204 May 21 21:18:29.223136 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1110/2161] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:28 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1790 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:18:29.237684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e8709f04-3101-4672-9b0a-919c3718e86e tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:29.238473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e8709f04-3101-4672-9b0a-919c3718e86e tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:29.246725 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8709f04-3101-4672-9b0a-919c3718e86e tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:29.247388 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8709f04-3101-4672-9b0a-919c3718e86e tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:29.252075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8709f04-3101-4672-9b0a-919c3718e86e tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:29.252075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8709f04-3101-4672-9b0a-919c3718e86e tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:29.340658 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e8709f04-3101-4672-9b0a-919c3718e86e tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128df9f2acf4b14aeb3d6b4ba3012ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bb4d7f9fb14923bd3fb8a4146f737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:29.352363 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e8709f04-3101-4672-9b0a-919c3718e86e tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca" status: 200 len: 1272 microversion: 2.1 time: 0.127784 May 21 21:18:29.353586 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1111/2162] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:29 2022] GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca => generated 1272 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:29.364027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-fba2f8f4-8ef6-4a6e-94ab-a2c10d52934d req-557574a7-6c62-43ac-b221-8f011d1279ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f63b08d-aaa7-4639-827f-d32bc60a78c8", "name": "network-vif-unplugged", "status": "completed", "tag": "727bcbb6-7735-41db-859d-5524186926b9"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:29.375940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-fba2f8f4-8ef6-4a6e-94ab-a2c10d52934d req-557574a7-6c62-43ac-b221-8f011d1279ce service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:29.377087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-fba2f8f4-8ef6-4a6e-94ab-a2c10d52934d req-557574a7-6c62-43ac-b221-8f011d1279ce service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:29.393553 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-fba2f8f4-8ef6-4a6e-94ab-a2c10d52934d req-557574a7-6c62-43ac-b221-8f011d1279ce service nova] Creating event network-vif-unplugged:727bcbb6-7735-41db-859d-5524186926b9 for instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 on nch2-master-1 May 21 21:18:29.398976 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-fba2f8f4-8ef6-4a6e-94ab-a2c10d52934d req-557574a7-6c62-43ac-b221-8f011d1279ce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043890 May 21 21:18:29.399799 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1112/2163] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:29.404913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-bf8fc156-679c-4bcd-8d64-1c6c1f0693c4 req-1eb3f3c7-af2b-4775-b243-ef7dc59cfc25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f63b08d-aaa7-4639-827f-d32bc60a78c8", "name": "network-vif-deleted", "tag": "ed56d410-5713-462c-bfbe-91491c8c21c6"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:29.414741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-bf8fc156-679c-4bcd-8d64-1c6c1f0693c4 req-1eb3f3c7-af2b-4775-b243-ef7dc59cfc25 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:29.415099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-bf8fc156-679c-4bcd-8d64-1c6c1f0693c4 req-1eb3f3c7-af2b-4775-b243-ef7dc59cfc25 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:29.436025 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-bf8fc156-679c-4bcd-8d64-1c6c1f0693c4 req-1eb3f3c7-af2b-4775-b243-ef7dc59cfc25 service nova] Creating event network-vif-deleted:ed56d410-5713-462c-bfbe-91491c8c21c6 for instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 on nch2-master-1 May 21 21:18:29.444519 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-bf8fc156-679c-4bcd-8d64-1c6c1f0693c4 req-1eb3f3c7-af2b-4775-b243-ef7dc59cfc25 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043426 May 21 21:18:29.445440 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1113/2164] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:29.490135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7cdb2471-869a-42b5-a116-ea8833f69986 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:29.491272 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7cdb2471-869a-42b5-a116-ea8833f69986 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:29.503554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7cdb2471-869a-42b5-a116-ea8833f69986 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:29.509455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7cdb2471-869a-42b5-a116-ea8833f69986 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:29.509455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7cdb2471-869a-42b5-a116-ea8833f69986 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:29.509455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7cdb2471-869a-42b5-a116-ea8833f69986 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:29.803385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7cdb2471-869a-42b5-a116-ea8833f69986 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:29.817870 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7cdb2471-869a-42b5-a116-ea8833f69986 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1307 microversion: 2.1 time: 0.341217 May 21 21:18:29.818991 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1114/2165] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:29 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1307 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:29.891877 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0bc29a77-4e33-46b0-b0b8-62488feaf508 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:29.892699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0bc29a77-4e33-46b0-b0b8-62488feaf508 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:29.900599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0bc29a77-4e33-46b0-b0b8-62488feaf508 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:29.901270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0bc29a77-4e33-46b0-b0b8-62488feaf508 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:29.902734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0bc29a77-4e33-46b0-b0b8-62488feaf508 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:29.902734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0bc29a77-4e33-46b0-b0b8-62488feaf508 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:29.954524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:30.144559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-cd76fa4f-4f48-46b9-8390-0f1479992ea0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:18:30.146297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-cd76fa4f-4f48-46b9-8390-0f1479992ea0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:18:30.147123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-cd76fa4f-4f48-46b9-8390-0f1479992ea0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:18:30.148159 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-cd76fa4f-4f48-46b9-8390-0f1479992ea0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:18:30.149587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-cd76fa4f-4f48-46b9-8390-0f1479992ea0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:18:30.159800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0bc29a77-4e33-46b0-b0b8-62488feaf508 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:30.169015 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0bc29a77-4e33-46b0-b0b8-62488feaf508 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1494 microversion: 2.1 time: 0.281687 May 21 21:18:30.169638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd76fa4f-4f48-46b9-8390-0f1479992ea0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:30.170486 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1115/2166] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:29 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1494 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:30.170811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd76fa4f-4f48-46b9-8390-0f1479992ea0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:30.171862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd76fa4f-4f48-46b9-8390-0f1479992ea0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:30.172509 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd76fa4f-4f48-46b9-8390-0f1479992ea0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:30.178864 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-51e67c0b-2024-447c-b231-a48a32be421b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:30.183654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-51e67c0b-2024-447c-b231-a48a32be421b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:30.187071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-51e67c0b-2024-447c-b231-a48a32be421b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:30.187742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-51e67c0b-2024-447c-b231-a48a32be421b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:30.188788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-51e67c0b-2024-447c-b231-a48a32be421b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:30.189447 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-51e67c0b-2024-447c-b231-a48a32be421b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:30.222092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-51e67c0b-2024-447c-b231-a48a32be421b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:18:30.248960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-cd76fa4f-4f48-46b9-8390-0f1479992ea0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Getting quotas for project 8c48385dc5c24377a7be24da93fc54d9. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:18:30.266380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-cd76fa4f-4f48-46b9-8390-0f1479992ea0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Getting quotas for user c3e23800ab314cc28dc30330928d8454 and project 8c48385dc5c24377a7be24da93fc54d9. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:18:30.293280 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cd76fa4f-4f48-46b9-8390-0f1479992ea0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:18:30.296672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cd76fa4f-4f48-46b9-8390-0f1479992ea0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e88f28fe-a897-4690-8460-43bf4d7453d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:18:30.506641 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cd76fa4f-4f48-46b9-8390-0f1479992ea0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.071467 May 21 21:18:30.510576 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1052/2167] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:18:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:18:30.523256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8b810cda-e0cc-4ef1-b2cb-725191e2b0d3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:30.523886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8b810cda-e0cc-4ef1-b2cb-725191e2b0d3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:30.556800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b810cda-e0cc-4ef1-b2cb-725191e2b0d3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:30.557383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b810cda-e0cc-4ef1-b2cb-725191e2b0d3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:30.558198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b810cda-e0cc-4ef1-b2cb-725191e2b0d3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:30.558611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b810cda-e0cc-4ef1-b2cb-725191e2b0d3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:30.649049 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-51e67c0b-2024-447c-b231-a48a32be421b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "DELETE /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 204 len: 0 microversion: 2.25 time: 0.476832 May 21 21:18:30.651708 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1116/2168] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:18:30 2022] DELETE /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:18:30.660504 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f6486714-3d3f-493f-976b-b31ac9bedd34 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:30.661414 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f6486714-3d3f-493f-976b-b31ac9bedd34 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:30.664198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:30.669236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6486714-3d3f-493f-976b-b31ac9bedd34 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:30.670118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6486714-3d3f-493f-976b-b31ac9bedd34 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:30.671276 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6486714-3d3f-493f-976b-b31ac9bedd34 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:30.672050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6486714-3d3f-493f-976b-b31ac9bedd34 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:30.762218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f6486714-3d3f-493f-976b-b31ac9bedd34 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128df9f2acf4b14aeb3d6b4ba3012ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bb4d7f9fb14923bd3fb8a4146f737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:30.772428 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f6486714-3d3f-493f-976b-b31ac9bedd34 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca" status: 200 len: 1272 microversion: 2.1 time: 0.118607 May 21 21:18:30.788453 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1117/2169] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:30 2022] GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca => generated 1272 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:30.788453 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c0d1f728-ec22-4dac-8b0a-de3b019eb7ce tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:30.788453 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c0d1f728-ec22-4dac-8b0a-de3b019eb7ce tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e88f28fe-a897-4690-8460-43bf4d7453d5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:30.862791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c0d1f728-ec22-4dac-8b0a-de3b019eb7ce tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:30.872017 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c0d1f728-ec22-4dac-8b0a-de3b019eb7ce tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e88f28fe-a897-4690-8460-43bf4d7453d5" status: 200 len: 1215 microversion: 2.1 time: 0.091273 May 21 21:18:30.884150 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1118/2170] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:30 2022] GET /compute/v2.1/servers/e88f28fe-a897-4690-8460-43bf4d7453d5 => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:30.884150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4d6ed102-a507-4c6a-bb84-264824f93ef8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:30.884150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4d6ed102-a507-4c6a-bb84-264824f93ef8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:30.887791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d6ed102-a507-4c6a-bb84-264824f93ef8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:30.888335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d6ed102-a507-4c6a-bb84-264824f93ef8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:30.891176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d6ed102-a507-4c6a-bb84-264824f93ef8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:30.891176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d6ed102-a507-4c6a-bb84-264824f93ef8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:31.101730 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4d6ed102-a507-4c6a-bb84-264824f93ef8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:31.109893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4d6ed102-a507-4c6a-bb84-264824f93ef8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:31.113272 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4d6ed102-a507-4c6a-bb84-264824f93ef8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:31.117051 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4d6ed102-a507-4c6a-bb84-264824f93ef8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1563 microversion: 2.25 time: 0.242859 May 21 21:18:31.119753 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1119/2171] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:30 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:31.125058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4cf1c15e-8f2e-448d-93fd-a52ddf9ca221 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:31.126476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4cf1c15e-8f2e-448d-93fd-a52ddf9ca221 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:31.137997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cf1c15e-8f2e-448d-93fd-a52ddf9ca221 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:31.138483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cf1c15e-8f2e-448d-93fd-a52ddf9ca221 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:31.139280 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cf1c15e-8f2e-448d-93fd-a52ddf9ca221 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:31.139729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cf1c15e-8f2e-448d-93fd-a52ddf9ca221 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:31.330928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4cf1c15e-8f2e-448d-93fd-a52ddf9ca221 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:31.342944 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4cf1c15e-8f2e-448d-93fd-a52ddf9ca221 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1307 microversion: 2.1 time: 0.221089 May 21 21:18:31.344225 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1120/2172] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:31 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1307 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:31.350215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-26a9369b-a2d0-41c0-84cb-3e402b004410 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:31.351286 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-26a9369b-a2d0-41c0-84cb-3e402b004410 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e88f28fe-a897-4690-8460-43bf4d7453d5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:31.373671 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-26a9369b-a2d0-41c0-84cb-3e402b004410 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e88f28fe-a897-4690-8460-43bf4d7453d5] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:18:31.658116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8b810cda-e0cc-4ef1-b2cb-725191e2b0d3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:31.676604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8b810cda-e0cc-4ef1-b2cb-725191e2b0d3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:31.679992 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8b810cda-e0cc-4ef1-b2cb-725191e2b0d3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:31.681560 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8b810cda-e0cc-4ef1-b2cb-725191e2b0d3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1790 microversion: 2.32 time: 1.169558 May 21 21:18:31.685149 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1053/2173] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:30 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1790 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:31.698082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6eb1edb6-2831-4923-ad52-6cc45a8130f3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:31.699949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6eb1edb6-2831-4923-ad52-6cc45a8130f3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:31.722518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6eb1edb6-2831-4923-ad52-6cc45a8130f3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:31.723300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6eb1edb6-2831-4923-ad52-6cc45a8130f3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:31.724400 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6eb1edb6-2831-4923-ad52-6cc45a8130f3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:31.725023 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6eb1edb6-2831-4923-ad52-6cc45a8130f3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:31.791596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6eb1edb6-2831-4923-ad52-6cc45a8130f3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:31.795446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6eb1edb6-2831-4923-ad52-6cc45a8130f3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:31.796948 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-6eb1edb6-2831-4923-ad52-6cc45a8130f3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lazy-loading 'fault' on Instance uuid 7f63b08d-aaa7-4639-827f-d32bc60a78c8 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:18:31.929847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6eb1edb6-2831-4923-ad52-6cc45a8130f3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:31.940887 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6eb1edb6-2831-4923-ad52-6cc45a8130f3 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 200 len: 1302 microversion: 2.1 time: 0.252243 May 21 21:18:31.944048 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1054/2174] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:31 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 1302 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:31.960956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-27dd1d4d-ea3b-4794-8529-2151e8d602b1 req-e0e8c088-75f7-4ae2-87bc-42e823d81341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f63b08d-aaa7-4639-827f-d32bc60a78c8", "name": "network-vif-deleted", "tag": "727bcbb6-7735-41db-859d-5524186926b9"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:31.970583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-27dd1d4d-ea3b-4794-8529-2151e8d602b1 req-e0e8c088-75f7-4ae2-87bc-42e823d81341 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:31.971038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-27dd1d4d-ea3b-4794-8529-2151e8d602b1 req-e0e8c088-75f7-4ae2-87bc-42e823d81341 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:31.985245 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-27dd1d4d-ea3b-4794-8529-2151e8d602b1 req-e0e8c088-75f7-4ae2-87bc-42e823d81341 service nova] Creating event network-vif-deleted:727bcbb6-7735-41db-859d-5524186926b9 for instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 on nch2-master-1 May 21 21:18:31.991200 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-27dd1d4d-ea3b-4794-8529-2151e8d602b1 req-e0e8c088-75f7-4ae2-87bc-42e823d81341 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045558 May 21 21:18:31.992385 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1055/2175] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:31.998020 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-6bb0ec2e-1b56-4733-90a4-d47577c92100 req-d3f32de5-074d-4941-800b-f7bf4f1e6b4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9be9b1d-6502-4335-90b3-677ff81f4efc", "name": "network-vif-plugged", "status": "completed", "tag": "779a6c9f-256c-48e3-976d-aa8ffc3d3790"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:32.007351 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6bb0ec2e-1b56-4733-90a4-d47577c92100 req-d3f32de5-074d-4941-800b-f7bf4f1e6b4f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:32.008088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6bb0ec2e-1b56-4733-90a4-d47577c92100 req-d3f32de5-074d-4941-800b-f7bf4f1e6b4f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:32.020867 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-6bb0ec2e-1b56-4733-90a4-d47577c92100 req-d3f32de5-074d-4941-800b-f7bf4f1e6b4f service nova] Creating event network-vif-plugged:779a6c9f-256c-48e3-976d-aa8ffc3d3790 for instance a9be9b1d-6502-4335-90b3-677ff81f4efc on nch1-master-1 May 21 21:18:32.026172 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-6bb0ec2e-1b56-4733-90a4-d47577c92100 req-d3f32de5-074d-4941-800b-f7bf4f1e6b4f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031973 May 21 21:18:32.027013 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1056/2176] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:32.034562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d8041f72-954f-49b1-9470-4f62577eb628 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:32.035268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d8041f72-954f-49b1-9470-4f62577eb628 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:32.042477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8041f72-954f-49b1-9470-4f62577eb628 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:32.046207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8041f72-954f-49b1-9470-4f62577eb628 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:32.046207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8041f72-954f-49b1-9470-4f62577eb628 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:32.046207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8041f72-954f-49b1-9470-4f62577eb628 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:32.228773 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.scheduler.client.report [None req-26a9369b-a2d0-41c0-84cb-3e402b004410 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Deleted allocations for instance e88f28fe-a897-4690-8460-43bf4d7453d5 May 21 21:18:32.331397 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-26a9369b-a2d0-41c0-84cb-3e402b004410 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e88f28fe-a897-4690-8460-43bf4d7453d5" status: 204 len: 0 microversion: 2.1 time: 0.984199 May 21 21:18:32.332080 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1121/2177] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:18:31 2022] DELETE /compute/v2.1/servers/e88f28fe-a897-4690-8460-43bf4d7453d5 => generated 0 bytes in 987 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:18:32.337682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c031169a-0bec-4e38-93c7-11120b787666 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:32.338377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c031169a-0bec-4e38-93c7-11120b787666 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:32.347311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c031169a-0bec-4e38-93c7-11120b787666 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:32.347744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c031169a-0bec-4e38-93c7-11120b787666 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:32.348548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c031169a-0bec-4e38-93c7-11120b787666 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:32.348985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c031169a-0bec-4e38-93c7-11120b787666 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:32.540583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d8041f72-954f-49b1-9470-4f62577eb628 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128df9f2acf4b14aeb3d6b4ba3012ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bb4d7f9fb14923bd3fb8a4146f737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:32.550196 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d8041f72-954f-49b1-9470-4f62577eb628 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca" status: 200 len: 1314 microversion: 2.1 time: 0.521745 May 21 21:18:32.564175 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1057/2178] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:32 2022] GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:32.564545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c031169a-0bec-4e38-93c7-11120b787666 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:32.565396 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d598c9fe-38d0-4dce-b28c-590900224a5f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:32.565396 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d598c9fe-38d0-4dce-b28c-590900224a5f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e88f28fe-a897-4690-8460-43bf4d7453d5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:32.574488 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c031169a-0bec-4e38-93c7-11120b787666 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:32.574921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d598c9fe-38d0-4dce-b28c-590900224a5f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:32.575449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d598c9fe-38d0-4dce-b28c-590900224a5f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:32.576785 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c031169a-0bec-4e38-93c7-11120b787666 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:32.577763 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d598c9fe-38d0-4dce-b28c-590900224a5f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:32.578033 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c031169a-0bec-4e38-93c7-11120b787666 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1563 microversion: 2.25 time: 0.244715 May 21 21:18:32.580534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d598c9fe-38d0-4dce-b28c-590900224a5f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:32.591482 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1122/2179] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:32 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1563 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:32.601930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-55a10145-1772-41ea-aa34-93b62c4d52a0 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:32.603230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-55a10145-1772-41ea-aa34-93b62c4d52a0 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:32.607378 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-d598c9fe-38d0-4dce-b28c-590900224a5f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance e88f28fe-a897-4690-8460-43bf4d7453d5 could not be found. May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d598c9fe-38d0-4dce-b28c-590900224a5f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/e88f28fe-a897-4690-8460-43bf4d7453d5 HTTP/1.1 May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance e88f28fe-a897-4690-8460-43bf4d7453d5 could not be found. May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'e88f28fe-a897-4690-8460-43bf4d7453d5'} May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88f28fe-a897-4690-8460-43bf4d7453d5 could not be found. May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88f28fe-a897-4690-8460-43bf4d7453d5 could not be found. May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:32.609104 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:32.623683 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:32.623683 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:32.623683 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:32.623683 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:32.623683 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:32.623683 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88f28fe-a897-4690-8460-43bf4d7453d5 could not be found. May 21 21:18:32.623683 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:32.623683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d598c9fe-38d0-4dce-b28c-590900224a5f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance e88f28fe-a897-4690-8460-43bf4d7453d5 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:32.623683 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d598c9fe-38d0-4dce-b28c-590900224a5f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e88f28fe-a897-4690-8460-43bf4d7453d5" status: 404 len: 111 microversion: 2.1 time: 0.054312 May 21 21:18:32.625562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-55a10145-1772-41ea-aa34-93b62c4d52a0 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:32.625562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-55a10145-1772-41ea-aa34-93b62c4d52a0 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:32.625765 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1058/2180] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:32 2022] GET /compute/v2.1/servers/e88f28fe-a897-4690-8460-43bf4d7453d5 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:18:32.626418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-55a10145-1772-41ea-aa34-93b62c4d52a0 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:32.626418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-55a10145-1772-41ea-aa34-93b62c4d52a0 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:32.707464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1ad3cee7-2490-40f3-bcea-517fba27a7c6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:32.708409 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1ad3cee7-2490-40f3-bcea-517fba27a7c6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:32.717719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ad3cee7-2490-40f3-bcea-517fba27a7c6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:32.718531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ad3cee7-2490-40f3-bcea-517fba27a7c6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:32.720703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ad3cee7-2490-40f3-bcea-517fba27a7c6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:32.721471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ad3cee7-2490-40f3-bcea-517fba27a7c6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:32.837969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-55a10145-1772-41ea-aa34-93b62c4d52a0 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:32.846870 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-55a10145-1772-41ea-aa34-93b62c4d52a0 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1307 microversion: 2.1 time: 0.253928 May 21 21:18:32.847532 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1123/2181] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:32 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1307 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:32.853881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-49113497-7e0e-43f5-98ac-2044752cb699 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-379507723", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "f95b9f39-db04-49ea-b57f-7951c8f566a9"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:32.907152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-49113497-7e0e-43f5-98ac-2044752cb699 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] validate_networks() for [('f95b9f39-db04-49ea-b57f-7951c8f566a9', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:18:33.267709 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1ad3cee7-2490-40f3-bcea-517fba27a7c6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:33.281528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1ad3cee7-2490-40f3-bcea-517fba27a7c6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:33.284126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1ad3cee7-2490-40f3-bcea-517fba27a7c6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:33.291691 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1ad3cee7-2490-40f3-bcea-517fba27a7c6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1837 microversion: 2.32 time: 0.582586 May 21 21:18:33.303436 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1059/2182] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:32 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1837 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:18:33.360549 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-49113497-7e0e-43f5-98ac-2044752cb699 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:18:33.361393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-49113497-7e0e-43f5-98ac-2044752cb699 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:18:33.362072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-49113497-7e0e-43f5-98ac-2044752cb699 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:18:33.362498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-49113497-7e0e-43f5-98ac-2044752cb699 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:18:33.362921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-49113497-7e0e-43f5-98ac-2044752cb699 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:18:33.373625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49113497-7e0e-43f5-98ac-2044752cb699 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:33.376393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49113497-7e0e-43f5-98ac-2044752cb699 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:33.376393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49113497-7e0e-43f5-98ac-2044752cb699 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:33.376393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49113497-7e0e-43f5-98ac-2044752cb699 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:33.393948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-49113497-7e0e-43f5-98ac-2044752cb699 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Getting quotas for project 8c48385dc5c24377a7be24da93fc54d9. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:18:33.399470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-49113497-7e0e-43f5-98ac-2044752cb699 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Getting quotas for user c3e23800ab314cc28dc30330928d8454 and project 8c48385dc5c24377a7be24da93fc54d9. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:18:33.414077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-49113497-7e0e-43f5-98ac-2044752cb699 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:18:33.419396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-49113497-7e0e-43f5-98ac-2044752cb699 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:18:33.444745 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7369fed5-8415-4de0-b9b9-e599ad61f525 tempest-TenantUsagesNegativeTestJSON-46138009 tempest-TenantUsagesNegativeTestJSON-46138009-project-admin] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-05-20T21%3A18%3A32.807569&end=2022-05-22T21%3A18%3A32.807569" status: 404 len: 112 microversion: - time: 0.138929 May 21 21:18:33.445743 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1060/2183] 10.222.0.49 () {58 vars in 1315 bytes} [Sat May 21 21:18:33 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-05-20T21%3A18%3A32.807569&end=2022-05-22T21%3A18%3A32.807569 => generated 112 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 21 21:18:33.451306 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-50141516-a4a7-4a41-b309-5cd6f96649ae tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:33.452119 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-50141516-a4a7-4a41-b309-5cd6f96649ae tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:33.459255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50141516-a4a7-4a41-b309-5cd6f96649ae tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:33.460124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50141516-a4a7-4a41-b309-5cd6f96649ae tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:33.461199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50141516-a4a7-4a41-b309-5cd6f96649ae tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:33.461821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50141516-a4a7-4a41-b309-5cd6f96649ae tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:33.467261 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:33.477334 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-50141516-a4a7-4a41-b309-5cd6f96649ae tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] HTTP exception thrown: Instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 could not be found. May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-50141516-a4a7-4a41-b309-5cd6f96649ae tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Request method failure captured: May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 HTTP/1.1 May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbl2GGOyhWnIQCo9Dy6hXXaekAe2KkKGf28Bu-9KrnRKxrmtThyB71Nn4r6R-488E9H8X44TsXQcgwmtriG9f_-qqEWVOkF89BpohQ47_XBStbc2DTAuHclzWryZ611cp3YzgmgGw_W_5ok9Gm_7C9YxKnVb2Q9sl8Fh5UrHosmgBw May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: a97fa11e94da4e72a9a955f8324c2d5e May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersTestMultiNic-1771539510 May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a97fa11e94da4e72a9a955f8324c2d5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a97fa11e94da4e72a9a955f8324c2d5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a97fa11e94da4e72a9a955f8324c2d5e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a97fa11e94da4e72a9a955f8324c2d5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersTestMultiNic-1771539510 May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: a97fa11e94da4e72a9a955f8324c2d5e May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersTestMultiNic-1771539510 May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersTestMultiNic-1771539510-project May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 569660c20b044f1aa2df5bdfed1d833c May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersTestMultiNic-1771539510-project May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 could not be found. May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '7f63b08d-aaa7-4639-827f-d32bc60a78c8'} May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 could not be found. May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 could not be found. May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:33.478937 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:33.484876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:33.484876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:33.484876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:33.484876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:33.484876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:33.484876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 could not be found. May 21 21:18:33.484876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:33.484876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-50141516-a4a7-4a41-b309-5cd6f96649ae tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Returning 404 to user: Instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:33.484876 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-50141516-a4a7-4a41-b309-5cd6f96649ae tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 404 len: 111 microversion: 2.1 time: 0.033468 May 21 21:18:33.484876 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1061/2184] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:33 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:18:33.489237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-80a346d9-8fde-450e-bfc6-a8236fb16fe8 tempest-TenantUsagesNegativeTestJSON-46138009 tempest-TenantUsagesNegativeTestJSON-46138009-project-admin] Calling method '.version_select at 0x7fc8284084c0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:33.494053 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-80a346d9-8fde-450e-bfc6-a8236fb16fe8 tempest-TenantUsagesNegativeTestJSON-46138009 tempest-TenantUsagesNegativeTestJSON-46138009-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-80a346d9-8fde-450e-bfc6-a8236fb16fe8 tempest-TenantUsagesNegativeTestJSON-46138009 tempest-TenantUsagesNegativeTestJSON-46138009-project-admin] Request method failure captured: May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-simple-tenant-usage/b830fce8e75f4fdcbd16be7a8012548f?start=2022-05-22T21%3A18%3A32.807569&end=2022-05-20T21%3A18%3A32.807569 HTTP/1.1 May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVcoIFogTXkSFBXGrdUImCax2wGGCZb8qQbubah-hn98tn7ZesbV_HOTKCNM2zZSMPW-DXKo7RcglvhPEKZtHaINJv_mVJGPZLBeK1G7IryHSMgHFxhraKbKqoBSFEP5-gqsA5nrBP00b7AeY_pWACVRO-5m7COaY9bW4ZIuy5s1tsM May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 144f62c0b7114bd88d46fa0e37e513be May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-46138009 May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,admin,member May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,admin,member May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/144f62c0b7114bd88d46fa0e37e513be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/144f62c0b7114bd88d46fa0e37e513be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_144f62c0b7114bd88d46fa0e37e513be", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/144f62c0b7114bd88d46fa0e37e513be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-46138009 May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 144f62c0b7114bd88d46fa0e37e513be May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-46138009 May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TenantUsagesNegativeTestJSON-46138009-project-admin May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: ee3309fc8124445a9a4103aa947e5816 May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-46138009-project-admin May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid start time. The start time cannot occur after the end time. May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'b830fce8e75f4fdcbd16be7a8012548f'} May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. May 21 21:18:33.496178 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:33.506329 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-80a346d9-8fde-450e-bfc6-a8236fb16fe8 tempest-TenantUsagesNegativeTestJSON-46138009 tempest-TenantUsagesNegativeTestJSON-46138009-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:33.506329 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-80a346d9-8fde-450e-bfc6-a8236fb16fe8 tempest-TenantUsagesNegativeTestJSON-46138009 tempest-TenantUsagesNegativeTestJSON-46138009-project-admin] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage/b830fce8e75f4fdcbd16be7a8012548f?start=2022-05-22T21%3A18%3A32.807569&end=2022-05-20T21%3A18%3A32.807569" status: 400 len: 111 microversion: 2.1 time: 0.012469 May 21 21:18:33.506329 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1062/2185] 10.222.0.49 () {58 vars in 1411 bytes} [Sat May 21 21:18:33 2022] GET /compute/v2.1/os-simple-tenant-usage/b830fce8e75f4fdcbd16be7a8012548f?start=2022-05-22T21%3A18%3A32.807569&end=2022-05-20T21%3A18%3A32.807569 => generated 111 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:18:33.561544 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-49113497-7e0e-43f5-98ac-2044752cb699 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.712825 May 21 21:18:33.566638 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1124/2186] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:18:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:18:33.589929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f7308e5c-ac2e-4c3f-911c-5509e3f5d8a1 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:33.591096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f7308e5c-ac2e-4c3f-911c-5509e3f5d8a1 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:33.605990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7308e5c-ac2e-4c3f-911c-5509e3f5d8a1 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:33.607065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7308e5c-ac2e-4c3f-911c-5509e3f5d8a1 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:33.608267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7308e5c-ac2e-4c3f-911c-5509e3f5d8a1 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:33.608951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7308e5c-ac2e-4c3f-911c-5509e3f5d8a1 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:33.763872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-47c8ea79-c87a-47f1-9b62-01c0689e10ed tempest-TenantUsagesNegativeTestJSON-383943427 tempest-TenantUsagesNegativeTestJSON-383943427-project] Calling method '.version_select at 0x7fc82cf764c0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:33.794661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-47c8ea79-c87a-47f1-9b62-01c0689e10ed tempest-TenantUsagesNegativeTestJSON-383943427 tempest-TenantUsagesNegativeTestJSON-383943427-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '4b8307493022475b9a3c79f8d5f955bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830fce8e75f4fdcbd16be7a8012548f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-47c8ea79-c87a-47f1-9b62-01c0689e10ed tempest-TenantUsagesNegativeTestJSON-383943427 tempest-TenantUsagesNegativeTestJSON-383943427-project] Request method failure captured: May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-20T21%3A18%3A32.807569&end=2022-05-22T21%3A18%3A32.807569&detailed=1 HTTP/1.1 May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVcnc5TKJhNfLRMrs0lKyjjm22BIqM82_oG2kyQg-4HIIovX6DD1_J61XSMAzBv70ZunRmkzAfHE6c6tejY2cdFWkbfXESXsJO2wA9c8ikjcQGgF-MN_1_y2ClBMR_pYPSsKla1yRA3E9oucwlEKEtaRPF37aerkGN0og9QI-BsvQF0 May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: b830fce8e75f4fdcbd16be7a8012548f May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-383943427 May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b830fce8e75f4fdcbd16be7a8012548f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b830fce8e75f4fdcbd16be7a8012548f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b830fce8e75f4fdcbd16be7a8012548f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b830fce8e75f4fdcbd16be7a8012548f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-383943427 May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: b830fce8e75f4fdcbd16be7a8012548f May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-383943427 May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TenantUsagesNegativeTestJSON-383943427-project May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 4b8307493022475b9a3c79f8d5f955bc May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-383943427-project May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: action_args: {} May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._index(req) May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:18:33.797638 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:18:33.809545 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 21 21:18:33.809545 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:33.809545 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:33.809545 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:33.809545 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:33.809545 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:33.809545 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:33.809545 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:18:33.809545 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:18:33.809545 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 21 21:18:33.809545 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:33.809545 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-47c8ea79-c87a-47f1-9b62-01c0689e10ed tempest-TenantUsagesNegativeTestJSON-383943427 tempest-TenantUsagesNegativeTestJSON-383943427-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:33.809545 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-47c8ea79-c87a-47f1-9b62-01c0689e10ed tempest-TenantUsagesNegativeTestJSON-383943427 tempest-TenantUsagesNegativeTestJSON-383943427-project] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-20T21%3A18%3A32.807569&end=2022-05-22T21%3A18%3A32.807569&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.289327 May 21 21:18:33.809545 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1063/2187] 10.222.0.49 () {58 vars in 1334 bytes} [Sat May 21 21:18:33 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-20T21%3A18%3A32.807569&end=2022-05-22T21%3A18%3A32.807569&detailed=1 => generated 123 bytes in 296 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 21 21:18:33.813100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3e8528d2-f1ec-474e-b0d1-576c436fd833 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:33.813100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3e8528d2-f1ec-474e-b0d1-576c436fd833 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:34.031643 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3e8528d2-f1ec-474e-b0d1-576c436fd833 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:34.043231 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3e8528d2-f1ec-474e-b0d1-576c436fd833 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 200 len: 1214 microversion: 2.1 time: 0.236468 May 21 21:18:34.055845 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1064/2188] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:33 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 1214 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:34.061363 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e68b6ba0-58dd-4066-9601-f3e4b6ab1b1a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:34.062321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e68b6ba0-58dd-4066-9601-f3e4b6ab1b1a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:34.066813 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:34.071606 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e68b6ba0-58dd-4066-9601-f3e4b6ab1b1a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:34.072460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e68b6ba0-58dd-4066-9601-f3e4b6ab1b1a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:34.073357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e68b6ba0-58dd-4066-9601-f3e4b6ab1b1a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:34.074054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e68b6ba0-58dd-4066-9601-f3e4b6ab1b1a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:34.130688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e68b6ba0-58dd-4066-9601-f3e4b6ab1b1a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:34.132746 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e68b6ba0-58dd-4066-9601-f3e4b6ab1b1a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:34.133344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-e68b6ba0-58dd-4066-9601-f3e4b6ab1b1a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lazy-loading 'fault' on Instance uuid 13739e66-c933-4b7b-b4a9-365b8b4c65cb {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:18:34.228883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e68b6ba0-58dd-4066-9601-f3e4b6ab1b1a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:34.247769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e68b6ba0-58dd-4066-9601-f3e4b6ab1b1a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:34.252016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e68b6ba0-58dd-4066-9601-f3e4b6ab1b1a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:34.253690 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e68b6ba0-58dd-4066-9601-f3e4b6ab1b1a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 200 len: 1352 microversion: 2.25 time: 0.196671 May 21 21:18:34.254513 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1065/2189] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:34 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 1352 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:34.259753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2dd5ce6b-ba72-40d2-bf8b-f579c9424205 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:34.260773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2dd5ce6b-ba72-40d2-bf8b-f579c9424205 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:34.272593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2dd5ce6b-ba72-40d2-bf8b-f579c9424205 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:34.273699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2dd5ce6b-ba72-40d2-bf8b-f579c9424205 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:34.274508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2dd5ce6b-ba72-40d2-bf8b-f579c9424205 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:34.275684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2dd5ce6b-ba72-40d2-bf8b-f579c9424205 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:34.295953 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f7308e5c-ac2e-4c3f-911c-5509e3f5d8a1 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128df9f2acf4b14aeb3d6b4ba3012ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bb4d7f9fb14923bd3fb8a4146f737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:34.312002 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f7308e5c-ac2e-4c3f-911c-5509e3f5d8a1 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca" status: 200 len: 1314 microversion: 2.1 time: 0.739815 May 21 21:18:34.312884 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1125/2190] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:33 2022] GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca => generated 1314 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:34.319587 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-7fcc46fe-930e-48b0-8a41-cf89217964c8 req-3f0b47ba-3b06-44b3-922d-190425d05ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13739e66-c933-4b7b-b4a9-365b8b4c65cb", "name": "network-vif-deleted", "tag": "c87e240a-00db-4d2f-b98a-859d7a88abad"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:34.331472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7fcc46fe-930e-48b0-8a41-cf89217964c8 req-3f0b47ba-3b06-44b3-922d-190425d05ac4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:34.332002 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7fcc46fe-930e-48b0-8a41-cf89217964c8 req-3f0b47ba-3b06-44b3-922d-190425d05ac4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:34.347052 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-7fcc46fe-930e-48b0-8a41-cf89217964c8 req-3f0b47ba-3b06-44b3-922d-190425d05ac4 service nova] Creating event network-vif-deleted:c87e240a-00db-4d2f-b98a-859d7a88abad for instance 13739e66-c933-4b7b-b4a9-365b8b4c65cb on nch2-master-1 May 21 21:18:34.352435 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-7fcc46fe-930e-48b0-8a41-cf89217964c8 req-3f0b47ba-3b06-44b3-922d-190425d05ac4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036735 May 21 21:18:34.354080 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1126/2191] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:34.360897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0c78677b-4f81-4dc7-8a4a-f96fdfad1775 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:34.363526 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0c78677b-4f81-4dc7-8a4a-f96fdfad1775 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:34.370615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0c78677b-4f81-4dc7-8a4a-f96fdfad1775 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:34.377968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0c78677b-4f81-4dc7-8a4a-f96fdfad1775 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:34.377968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0c78677b-4f81-4dc7-8a4a-f96fdfad1775 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:34.377968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0c78677b-4f81-4dc7-8a4a-f96fdfad1775 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:34.596413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2dd5ce6b-ba72-40d2-bf8b-f579c9424205 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:34.608678 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2dd5ce6b-ba72-40d2-bf8b-f579c9424205 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1487 microversion: 2.1 time: 0.349722 May 21 21:18:34.609630 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1066/2192] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:34 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1487 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:34.634736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b666e5b7-98a3-4c3b-8cac-20c21a2f9ec8 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-857980005"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:34.634736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b666e5b7-98a3-4c3b-8cac-20c21a2f9ec8 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:34.648930 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b666e5b7-98a3-4c3b-8cac-20c21a2f9ec8 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:34.649405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b666e5b7-98a3-4c3b-8cac-20c21a2f9ec8 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:34.664484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b666e5b7-98a3-4c3b-8cac-20c21a2f9ec8 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:34.666340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b666e5b7-98a3-4c3b-8cac-20c21a2f9ec8 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:34.951758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0c78677b-4f81-4dc7-8a4a-f96fdfad1775 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:34.967975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0c78677b-4f81-4dc7-8a4a-f96fdfad1775 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:34.973700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0c78677b-4f81-4dc7-8a4a-f96fdfad1775 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:34.976882 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0c78677b-4f81-4dc7-8a4a-f96fdfad1775 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1837 microversion: 2.32 time: 0.621439 May 21 21:18:34.977521 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1127/2193] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:34 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1837 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:35.062284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9298bd24-e8f4-4e3b-bec3-5b36bfda81e2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:35.062284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9298bd24-e8f4-4e3b-bec3-5b36bfda81e2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:35.084383 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9298bd24-e8f4-4e3b-bec3-5b36bfda81e2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:35.085509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9298bd24-e8f4-4e3b-bec3-5b36bfda81e2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:35.090018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9298bd24-e8f4-4e3b-bec3-5b36bfda81e2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:35.090018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9298bd24-e8f4-4e3b-bec3-5b36bfda81e2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:35.285059 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9298bd24-e8f4-4e3b-bec3-5b36bfda81e2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:35.301275 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9298bd24-e8f4-4e3b-bec3-5b36bfda81e2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 200 len: 1218 microversion: 2.1 time: 0.243428 May 21 21:18:35.319150 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1128/2194] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:35 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 1218 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:35.347289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-33220e4d-86c0-4707-954f-0456a38319b6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:35.348433 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-33220e4d-86c0-4707-954f-0456a38319b6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 13739e66-c933-4b7b-b4a9-365b8b4c65cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:35.367480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33220e4d-86c0-4707-954f-0456a38319b6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:35.368808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33220e4d-86c0-4707-954f-0456a38319b6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:35.369848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33220e4d-86c0-4707-954f-0456a38319b6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:35.370468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33220e4d-86c0-4707-954f-0456a38319b6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:35.404153 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-33220e4d-86c0-4707-954f-0456a38319b6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] HTTP exception thrown: Instance 13739e66-c933-4b7b-b4a9-365b8b4c65cb could not be found. May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-33220e4d-86c0-4707-954f-0456a38319b6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Request method failure captured: May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb HTTP/1.1 May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVV5MQ6wjX3e56hMYL2H6QpgG2OGlj7_WVu_9F0M9B0qG3q3UUDg996Rddujz6fUPxExXOpXkryXyYL-Wd8knK-7jGRmDNL-ylu-28gtS7k7dx0YNwh29VSnNOjvK9_KwSh8lCreK7X11V9JuHX_06dql2Z6V9Brqagrb3wXR5ML4fw May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: X-Openstack-Nova-Api-Version: 2.25 May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 220204ccbcf443c98a64994f29700ef0 May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1048081752 May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/220204ccbcf443c98a64994f29700ef0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/220204ccbcf443c98a64994f29700ef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_220204ccbcf443c98a64994f29700ef0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/220204ccbcf443c98a64994f29700ef0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1048081752 May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 220204ccbcf443c98a64994f29700ef0 May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1048081752 May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-LiveAutoBlockMigrationV225Test-1048081752-project May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: b7199de1e6f04147b197c086ac6cc6fc May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1048081752-project May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 13739e66-c933-4b7b-b4a9-365b8b4c65cb could not be found. May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '13739e66-c933-4b7b-b4a9-365b8b4c65cb'} May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13739e66-c933-4b7b-b4a9-365b8b4c65cb could not be found. May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13739e66-c933-4b7b-b4a9-365b8b4c65cb could not be found. May 21 21:18:35.409375 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:35.416746 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:35.416746 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:35.416746 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:35.416746 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:35.416746 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:35.416746 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:35.416746 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:35.416746 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13739e66-c933-4b7b-b4a9-365b8b4c65cb could not be found. May 21 21:18:35.416746 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:35.421354 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-33220e4d-86c0-4707-954f-0456a38319b6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Returning 404 to user: Instance 13739e66-c933-4b7b-b4a9-365b8b4c65cb could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:35.422580 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-33220e4d-86c0-4707-954f-0456a38319b6 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb" status: 404 len: 111 microversion: 2.25 time: 0.101731 May 21 21:18:35.423900 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1129/2195] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:35 2022] GET /compute/v2.1/servers/13739e66-c933-4b7b-b4a9-365b8b4c65cb => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:18:35.435945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-940a9b72-38f5-43e8-8d28-9a489b98eead tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:35.437247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-940a9b72-38f5-43e8-8d28-9a489b98eead tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:35.449886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-940a9b72-38f5-43e8-8d28-9a489b98eead tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:35.452194 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-940a9b72-38f5-43e8-8d28-9a489b98eead tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:35.453492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-940a9b72-38f5-43e8-8d28-9a489b98eead tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:35.454201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-940a9b72-38f5-43e8-8d28-9a489b98eead tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:35.646509 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b666e5b7-98a3-4c3b-8cac-20c21a2f9ec8 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "POST /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc/action" status: 202 len: 0 microversion: 2.1 time: 1.021304 May 21 21:18:35.648200 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1067/2196] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:18:34 2022] POST /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc/action => generated 0 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) May 21 21:18:35.673899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5575e2bc-3364-4871-81e8-3180f1588019 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:35.674510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5575e2bc-3364-4871-81e8-3180f1588019 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:35.698237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5575e2bc-3364-4871-81e8-3180f1588019 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:35.698692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5575e2bc-3364-4871-81e8-3180f1588019 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:35.712958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5575e2bc-3364-4871-81e8-3180f1588019 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:35.713458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5575e2bc-3364-4871-81e8-3180f1588019 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:35.746476 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5575e2bc-3364-4871-81e8-3180f1588019 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:18:35.855935 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-940a9b72-38f5-43e8-8d28-9a489b98eead tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128df9f2acf4b14aeb3d6b4ba3012ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bb4d7f9fb14923bd3fb8a4146f737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:35.881543 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-940a9b72-38f5-43e8-8d28-9a489b98eead tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca" status: 200 len: 1314 microversion: 2.1 time: 0.452540 May 21 21:18:35.892805 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1130/2197] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:35 2022] GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:35.897754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-118c5d62-0626-435d-a33f-ba02f482c646 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc82cf2a430>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:36.011952 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-118c5d62-0626-435d-a33f-ba02f482c646 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/c8e212db-2ab1-4233-b4f7-7352a6413d72" status: 200 len: 1411 microversion: 2.1 time: 0.117827 May 21 21:18:36.013333 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1131/2198] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:18:35 2022] GET /compute/v2.1/images/c8e212db-2ab1-4233-b4f7-7352a6413d72 => generated 1411 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:36.020519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6bef3fbf-5414-487b-b3ab-1eff96a63fee tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:36.022442 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6bef3fbf-5414-487b-b3ab-1eff96a63fee tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:36.031621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6bef3fbf-5414-487b-b3ab-1eff96a63fee tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:36.032649 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6bef3fbf-5414-487b-b3ab-1eff96a63fee tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:36.038617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6bef3fbf-5414-487b-b3ab-1eff96a63fee tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:36.038617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6bef3fbf-5414-487b-b3ab-1eff96a63fee tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:36.123705 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5575e2bc-3364-4871-81e8-3180f1588019 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "DELETE /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 204 len: 0 microversion: 2.25 time: 0.471877 May 21 21:18:36.124658 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1068/2199] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:18:35 2022] DELETE /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:18:36.131234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a25ad64d-8977-4f37-9be1-8aa0820fcd27 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81b6e3e50>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:36.242946 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a25ad64d-8977-4f37-9be1-8aa0820fcd27 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/c8e212db-2ab1-4233-b4f7-7352a6413d72" status: 200 len: 1411 microversion: 2.1 time: 0.116642 May 21 21:18:36.244204 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1069/2200] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:18:36 2022] GET /compute/v2.1/images/c8e212db-2ab1-4233-b4f7-7352a6413d72 => generated 1411 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:36.252548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4815fdb7-a021-4d59-be5e-86ea50fc62b7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:36.254100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4815fdb7-a021-4d59-be5e-86ea50fc62b7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:36.265282 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4815fdb7-a021-4d59-be5e-86ea50fc62b7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:36.266026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4815fdb7-a021-4d59-be5e-86ea50fc62b7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:36.268143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4815fdb7-a021-4d59-be5e-86ea50fc62b7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:36.268735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4815fdb7-a021-4d59-be5e-86ea50fc62b7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:36.537696 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6bef3fbf-5414-487b-b3ab-1eff96a63fee tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:36.548034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6bef3fbf-5414-487b-b3ab-1eff96a63fee tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:36.549839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6bef3fbf-5414-487b-b3ab-1eff96a63fee tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:36.550852 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6bef3fbf-5414-487b-b3ab-1eff96a63fee tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1858 microversion: 2.32 time: 0.536252 May 21 21:18:36.551420 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1132/2201] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:36 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1858 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:36.556192 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5490b68b-c3f1-4c08-945f-b32ecafb60df tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc82cfc9820>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:36.646588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4815fdb7-a021-4d59-be5e-86ea50fc62b7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:36.660328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4815fdb7-a021-4d59-be5e-86ea50fc62b7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:36.675786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4815fdb7-a021-4d59-be5e-86ea50fc62b7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:36.685914 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4815fdb7-a021-4d59-be5e-86ea50fc62b7 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1548 microversion: 2.25 time: 0.439921 May 21 21:18:36.701552 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1070/2202] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:36 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1548 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:36.701552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3e1783db-9ec0-444c-aabb-1c1c08283947 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:36.701552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3e1783db-9ec0-444c-aabb-1c1c08283947 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:36.709658 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e1783db-9ec0-444c-aabb-1c1c08283947 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:36.710306 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e1783db-9ec0-444c-aabb-1c1c08283947 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:36.712234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e1783db-9ec0-444c-aabb-1c1c08283947 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:36.713350 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e1783db-9ec0-444c-aabb-1c1c08283947 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:36.923208 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3e1783db-9ec0-444c-aabb-1c1c08283947 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:36.934787 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3e1783db-9ec0-444c-aabb-1c1c08283947 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 200 len: 1284 microversion: 2.1 time: 0.246743 May 21 21:18:36.935478 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1071/2203] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:36 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 1284 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:36.943272 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-236f3b9d-7e34-4923-8260-630636dc4bfa req-b46db42f-f8c7-4cc4-8910-1007704d47f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "tag": "47e2d024-64c4-4e87-9d61-1a91c3bdd681"}, {"name": "network-changed", "server_uuid": "a60dc0bc-d248-4b55-9d38-defb6caf9bca", "tag": "87d9ef09-56e5-4f1b-8766-9da713e1fdd6"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:36.953360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-236f3b9d-7e34-4923-8260-630636dc4bfa req-b46db42f-f8c7-4cc4-8910-1007704d47f7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:36.953758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-236f3b9d-7e34-4923-8260-630636dc4bfa req-b46db42f-f8c7-4cc4-8910-1007704d47f7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:36.967974 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-236f3b9d-7e34-4923-8260-630636dc4bfa req-b46db42f-f8c7-4cc4-8910-1007704d47f7 service nova] Creating event network-changed:47e2d024-64c4-4e87-9d61-1a91c3bdd681 for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:18:36.974828 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-236f3b9d-7e34-4923-8260-630636dc4bfa req-b46db42f-f8c7-4cc4-8910-1007704d47f7 service nova] Creating event network-changed:87d9ef09-56e5-4f1b-8766-9da713e1fdd6 for instance a60dc0bc-d248-4b55-9d38-defb6caf9bca on nch2-master-1 May 21 21:18:36.987064 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-236f3b9d-7e34-4923-8260-630636dc4bfa req-b46db42f-f8c7-4cc4-8910-1007704d47f7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.049423 May 21 21:18:36.987514 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1072/2204] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:36.992783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cd50d801-25f1-4dcc-bb99-dbbce7ccf9fa tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:36.995334 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cd50d801-25f1-4dcc-bb99-dbbce7ccf9fa tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:37.010773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd50d801-25f1-4dcc-bb99-dbbce7ccf9fa tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:37.010773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd50d801-25f1-4dcc-bb99-dbbce7ccf9fa tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:37.010773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd50d801-25f1-4dcc-bb99-dbbce7ccf9fa tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:37.010773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd50d801-25f1-4dcc-bb99-dbbce7ccf9fa tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:37.037979 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5490b68b-c3f1-4c08-945f-b32ecafb60df tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "DELETE /compute/v2.1/images/c8e212db-2ab1-4233-b4f7-7352a6413d72" status: 204 len: 0 microversion: 2.1 time: 0.484535 May 21 21:18:37.039031 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1133/2205] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:36 2022] DELETE /compute/v2.1/images/c8e212db-2ab1-4233-b4f7-7352a6413d72 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:18:37.048045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-512d63f6-7797-4608-85bc-e14e4c7eee60 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc82cfc91f0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:37.082342 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-512d63f6-7797-4608-85bc-e14e4c7eee60 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] HTTP exception thrown: Image not found. May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-512d63f6-7797-4608-85bc-e14e4c7eee60 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Request method failure captured: May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/images/c8e212db-2ab1-4233-b4f7-7352a6413d72 HTTP/1.1 May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVZLKVF_0aMOhVIeqq5PZErHtckKoguxWytvpp4S28q9Pdx8q3uz3rVIFRXI4FoERKrjvIDzWO3p8pvi6UhDlrMoz3J4UFBQ_IWaO6EGM1JzEegQEdU5azkIU2fKFrqrY_jw5jN_B5V2Z2Mxpn43FDgou6Q2ufOeqKKBNrRQgYjU_Mk May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_89256ac3448643b6892e74f55bfb31d3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesTestJSON-388705491 May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesTestJSON-388705491-project May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 16686b6509f54c4abfe9d519acfb4a73 May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesTestJSON-388705491-project May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: exception: Image not found. May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'c8e212db-2ab1-4233-b4f7-7352a6413d72'} May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c8e212db-2ab1-4233-b4f7-7352a6413d72 May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 21 21:18:37.084787 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c8e212db-2ab1-4233-b4f7-7352a6413d72 could not be found. May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-512d63f6-7797-4608-85bc-e14e4c7eee60 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Returning 404 to user: Image not found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-512d63f6-7797-4608-85bc-e14e4c7eee60 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/images/c8e212db-2ab1-4233-b4f7-7352a6413d72" status: 404 len: 62 microversion: 2.1 time: 0.043375 May 21 21:18:37.091011 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1134/2206] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:18:37 2022] GET /compute/v2.1/images/c8e212db-2ab1-4233-b4f7-7352a6413d72 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 21 21:18:37.100269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cb4afdd8-1bb4-4000-9e5d-ee52e6f83200 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:37.101914 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cb4afdd8-1bb4-4000-9e5d-ee52e6f83200 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:37.118137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb4afdd8-1bb4-4000-9e5d-ee52e6f83200 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:37.118723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb4afdd8-1bb4-4000-9e5d-ee52e6f83200 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:37.120478 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb4afdd8-1bb4-4000-9e5d-ee52e6f83200 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:37.125295 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb4afdd8-1bb4-4000-9e5d-ee52e6f83200 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:37.633215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cb4afdd8-1bb4-4000-9e5d-ee52e6f83200 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:37.641995 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cb4afdd8-1bb4-4000-9e5d-ee52e6f83200 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1499 microversion: 2.1 time: 0.548591 May 21 21:18:37.642784 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1135/2207] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:37 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1499 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:37.659868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6a8f8e4c-d915-4d5d-915b-8582ea43ea2f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:37.666739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6a8f8e4c-d915-4d5d-915b-8582ea43ea2f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:37.681004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6a8f8e4c-d915-4d5d-915b-8582ea43ea2f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:37.682071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6a8f8e4c-d915-4d5d-915b-8582ea43ea2f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:37.683281 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6a8f8e4c-d915-4d5d-915b-8582ea43ea2f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:37.683926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6a8f8e4c-d915-4d5d-915b-8582ea43ea2f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:37.873954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cd50d801-25f1-4dcc-bb99-dbbce7ccf9fa tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128df9f2acf4b14aeb3d6b4ba3012ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bb4d7f9fb14923bd3fb8a4146f737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:37.886811 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cd50d801-25f1-4dcc-bb99-dbbce7ccf9fa tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca" status: 200 len: 1314 microversion: 2.1 time: 0.897701 May 21 21:18:37.898309 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1073/2208] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:36 2022] GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca => generated 1314 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:37.898309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-65aac9d4-6c02-46a0-ac43-0a350e16ea69 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:37.898309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-65aac9d4-6c02-46a0-ac43-0a350e16ea69 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:37.915573 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65aac9d4-6c02-46a0-ac43-0a350e16ea69 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:37.916137 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65aac9d4-6c02-46a0-ac43-0a350e16ea69 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:37.919211 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65aac9d4-6c02-46a0-ac43-0a350e16ea69 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:37.919842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65aac9d4-6c02-46a0-ac43-0a350e16ea69 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:38.145242 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6a8f8e4c-d915-4d5d-915b-8582ea43ea2f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:38.145242 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6a8f8e4c-d915-4d5d-915b-8582ea43ea2f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:38.145242 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6a8f8e4c-d915-4d5d-915b-8582ea43ea2f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:38.147185 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6a8f8e4c-d915-4d5d-915b-8582ea43ea2f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1858 microversion: 2.32 time: 0.491952 May 21 21:18:38.148507 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1136/2209] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:37 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1858 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:38.153606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-534cc8fe-ca41-4c3b-b379-e1d883d48e23 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:38.154468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-534cc8fe-ca41-4c3b-b379-e1d883d48e23 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:38.182513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-534cc8fe-ca41-4c3b-b379-e1d883d48e23 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:38.182971 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-534cc8fe-ca41-4c3b-b379-e1d883d48e23 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:38.183783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-534cc8fe-ca41-4c3b-b379-e1d883d48e23 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:38.185895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-534cc8fe-ca41-4c3b-b379-e1d883d48e23 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:38.191734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:38.305891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-534cc8fe-ca41-4c3b-b379-e1d883d48e23 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:38.308928 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-534cc8fe-ca41-4c3b-b379-e1d883d48e23 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 200 len: 1272 microversion: 2.1 time: 0.159118 May 21 21:18:38.309630 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1137/2210] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:38 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:38.380084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-65aac9d4-6c02-46a0-ac43-0a350e16ea69 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:38.390502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-65aac9d4-6c02-46a0-ac43-0a350e16ea69 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:38.392934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-65aac9d4-6c02-46a0-ac43-0a350e16ea69 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:38.394106 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-65aac9d4-6c02-46a0-ac43-0a350e16ea69 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1548 microversion: 2.25 time: 0.505120 May 21 21:18:38.394983 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1074/2211] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:37 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1548 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:38.661197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7321ee63-a21f-46b1-b62b-149a25afd40d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:38.662736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7321ee63-a21f-46b1-b62b-149a25afd40d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:38.674250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7321ee63-a21f-46b1-b62b-149a25afd40d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:38.677252 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7321ee63-a21f-46b1-b62b-149a25afd40d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:38.681118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7321ee63-a21f-46b1-b62b-149a25afd40d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:38.681803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7321ee63-a21f-46b1-b62b-149a25afd40d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:38.906422 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0fc9da98-ee9b-473b-b7e8-e1de938d9a29 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:38.908892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0fc9da98-ee9b-473b-b7e8-e1de938d9a29 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:38.918952 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fc9da98-ee9b-473b-b7e8-e1de938d9a29 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:38.919828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fc9da98-ee9b-473b-b7e8-e1de938d9a29 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:38.921086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fc9da98-ee9b-473b-b7e8-e1de938d9a29 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:38.921600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fc9da98-ee9b-473b-b7e8-e1de938d9a29 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:39.142445 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7321ee63-a21f-46b1-b62b-149a25afd40d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:39.185743 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7321ee63-a21f-46b1-b62b-149a25afd40d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1505 microversion: 2.1 time: 0.530493 May 21 21:18:39.191851 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1138/2212] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:38 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1505 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:39.207839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-a15f41a9-7bb2-47e3-8ce3-1a238911de46 req-a316f9ac-e39c-43fc-9ec7-149d6684ae22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "tag": "62b0f605-35ad-4b1a-80f3-ed4bb5d39355"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:39.227862 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a15f41a9-7bb2-47e3-8ce3-1a238911de46 req-a316f9ac-e39c-43fc-9ec7-149d6684ae22 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:39.228708 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a15f41a9-7bb2-47e3-8ce3-1a238911de46 req-a316f9ac-e39c-43fc-9ec7-149d6684ae22 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:39.499436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0fc9da98-ee9b-473b-b7e8-e1de938d9a29 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128df9f2acf4b14aeb3d6b4ba3012ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bb4d7f9fb14923bd3fb8a4146f737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:39.515731 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0fc9da98-ee9b-473b-b7e8-e1de938d9a29 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca" status: 200 len: 1314 microversion: 2.1 time: 0.611907 May 21 21:18:39.528081 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1075/2213] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:38 2022] GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:39.544110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-126c47ee-6f16-44f0-86a2-ccd575fd2065 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:39.544870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-126c47ee-6f16-44f0-86a2-ccd575fd2065 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:39.575359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-126c47ee-6f16-44f0-86a2-ccd575fd2065 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:39.577463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-126c47ee-6f16-44f0-86a2-ccd575fd2065 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:39.585927 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-126c47ee-6f16-44f0-86a2-ccd575fd2065 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:39.589735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-126c47ee-6f16-44f0-86a2-ccd575fd2065 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:39.787555 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a15f41a9-7bb2-47e3-8ce3-1a238911de46 req-a316f9ac-e39c-43fc-9ec7-149d6684ae22 service nova] Creating event network-changed:62b0f605-35ad-4b1a-80f3-ed4bb5d39355 for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:18:39.795918 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-a15f41a9-7bb2-47e3-8ce3-1a238911de46 req-a316f9ac-e39c-43fc-9ec7-149d6684ae22 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.602938 May 21 21:18:39.797136 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1139/2214] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:39.803706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ebaa8599-2202-4e50-8f26-c7bcf5ea3696 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:39.805198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ebaa8599-2202-4e50-8f26-c7bcf5ea3696 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:39.813528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebaa8599-2202-4e50-8f26-c7bcf5ea3696 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:39.814427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebaa8599-2202-4e50-8f26-c7bcf5ea3696 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:39.815518 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebaa8599-2202-4e50-8f26-c7bcf5ea3696 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:39.816381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebaa8599-2202-4e50-8f26-c7bcf5ea3696 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:40.069485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-126c47ee-6f16-44f0-86a2-ccd575fd2065 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:40.086798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-126c47ee-6f16-44f0-86a2-ccd575fd2065 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:40.088385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-126c47ee-6f16-44f0-86a2-ccd575fd2065 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:40.089586 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-126c47ee-6f16-44f0-86a2-ccd575fd2065 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.560208 May 21 21:18:40.104686 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1076/2215] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:39 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:40.109808 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bfb2315a-fb6d-4bc5-b310-8f3b270091b8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:40.110457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bfb2315a-fb6d-4bc5-b310-8f3b270091b8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:40.123961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bfb2315a-fb6d-4bc5-b310-8f3b270091b8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:40.124448 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bfb2315a-fb6d-4bc5-b310-8f3b270091b8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:40.125255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bfb2315a-fb6d-4bc5-b310-8f3b270091b8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:40.126250 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bfb2315a-fb6d-4bc5-b310-8f3b270091b8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:40.194893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:40.197629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bfb2315a-fb6d-4bc5-b310-8f3b270091b8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:40.198267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bfb2315a-fb6d-4bc5-b310-8f3b270091b8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:40.200773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-bfb2315a-fb6d-4bc5-b310-8f3b270091b8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lazy-loading 'fault' on Instance uuid 604b986c-b195-4646-879b-a74b61a9b786 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:18:40.345662 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bfb2315a-fb6d-4bc5-b310-8f3b270091b8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:40.373483 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bfb2315a-fb6d-4bc5-b310-8f3b270091b8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:40.382471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bfb2315a-fb6d-4bc5-b310-8f3b270091b8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:40.384619 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bfb2315a-fb6d-4bc5-b310-8f3b270091b8 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 200 len: 1351 microversion: 2.25 time: 0.278322 May 21 21:18:40.385849 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1077/2216] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:40 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 1351 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:40.400771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a1981b18-4841-4384-8ae3-0e1d75b34e8a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:40.401650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a1981b18-4841-4384-8ae3-0e1d75b34e8a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:40.418169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a1981b18-4841-4384-8ae3-0e1d75b34e8a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:40.418967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a1981b18-4841-4384-8ae3-0e1d75b34e8a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:40.420061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a1981b18-4841-4384-8ae3-0e1d75b34e8a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:40.420899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a1981b18-4841-4384-8ae3-0e1d75b34e8a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:40.817521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a1981b18-4841-4384-8ae3-0e1d75b34e8a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:40.831732 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a1981b18-4841-4384-8ae3-0e1d75b34e8a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1487 microversion: 2.1 time: 0.444200 May 21 21:18:40.849156 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1078/2217] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:40 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1487 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:40.859832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-25d91035-e114-4b85-9ee7-e82d1ecc5506 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:40.870204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-25d91035-e114-4b85-9ee7-e82d1ecc5506 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:40.870918 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25d91035-e114-4b85-9ee7-e82d1ecc5506 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:40.871253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25d91035-e114-4b85-9ee7-e82d1ecc5506 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:40.872439 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25d91035-e114-4b85-9ee7-e82d1ecc5506 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:40.873084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25d91035-e114-4b85-9ee7-e82d1ecc5506 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:40.900858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:41.115682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-25d91035-e114-4b85-9ee7-e82d1ecc5506 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128df9f2acf4b14aeb3d6b4ba3012ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bb4d7f9fb14923bd3fb8a4146f737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:41.126110 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-25d91035-e114-4b85-9ee7-e82d1ecc5506 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca" status: 200 len: 1314 microversion: 2.1 time: 0.275681 May 21 21:18:41.127156 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1079/2218] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:40 2022] GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:41.140480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-81dd9d7e-332d-4d32-a72b-671231b3647b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:41.141933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-81dd9d7e-332d-4d32-a72b-671231b3647b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:41.151572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81dd9d7e-332d-4d32-a72b-671231b3647b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:41.152434 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81dd9d7e-332d-4d32-a72b-671231b3647b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:41.153311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81dd9d7e-332d-4d32-a72b-671231b3647b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:41.154058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81dd9d7e-332d-4d32-a72b-671231b3647b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:41.188410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-81dd9d7e-332d-4d32-a72b-671231b3647b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:18:41.195168 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ebaa8599-2202-4e50-8f26-c7bcf5ea3696 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:41.243922 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ebaa8599-2202-4e50-8f26-c7bcf5ea3696 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 200 len: 1314 microversion: 2.1 time: 1.443896 May 21 21:18:41.246237 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1140/2219] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:39 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 1314 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:41.263024 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c2ded51f-399c-45ed-8274-0befbddff3e1 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:41.263658 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c2ded51f-399c-45ed-8274-0befbddff3e1 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:41.281500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2ded51f-399c-45ed-8274-0befbddff3e1 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:41.286066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2ded51f-399c-45ed-8274-0befbddff3e1 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:41.286066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2ded51f-399c-45ed-8274-0befbddff3e1 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:41.286066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2ded51f-399c-45ed-8274-0befbddff3e1 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:41.584356 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-81dd9d7e-332d-4d32-a72b-671231b3647b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 204 len: 0 microversion: 2.1 time: 0.454763 May 21 21:18:41.585857 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1080/2220] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:18:41 2022] DELETE /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:18:41.592141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-52ca7175-6ee1-4a18-8504-3709cb454d0a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:41.593124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-52ca7175-6ee1-4a18-8504-3709cb454d0a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 604b986c-b195-4646-879b-a74b61a9b786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:41.603073 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-52ca7175-6ee1-4a18-8504-3709cb454d0a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:41.603536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-52ca7175-6ee1-4a18-8504-3709cb454d0a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:41.604430 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-52ca7175-6ee1-4a18-8504-3709cb454d0a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:41.604932 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-52ca7175-6ee1-4a18-8504-3709cb454d0a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:41.624534 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-52ca7175-6ee1-4a18-8504-3709cb454d0a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] HTTP exception thrown: Instance 604b986c-b195-4646-879b-a74b61a9b786 could not be found. May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-52ca7175-6ee1-4a18-8504-3709cb454d0a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Request method failure captured: May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 HTTP/1.1 May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVV5MQ6wjX3e56hMYL2H6QpgG2OGlj7_WVu_9F0M9B0qG3q3UUDg996Rddujz6fUPxExXOpXkryXyYL-Wd8knK-7jGRmDNL-ylu-28gtS7k7dx0YNwh29VSnNOjvK9_KwSh8lCreK7X11V9JuHX_06dql2Z6V9Brqagrb3wXR5ML4fw May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: X-Openstack-Nova-Api-Version: 2.25 May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 220204ccbcf443c98a64994f29700ef0 May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1048081752 May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/220204ccbcf443c98a64994f29700ef0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/220204ccbcf443c98a64994f29700ef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_220204ccbcf443c98a64994f29700ef0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/220204ccbcf443c98a64994f29700ef0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1048081752 May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 220204ccbcf443c98a64994f29700ef0 May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1048081752 May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-LiveAutoBlockMigrationV225Test-1048081752-project May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: b7199de1e6f04147b197c086ac6cc6fc May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1048081752-project May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 604b986c-b195-4646-879b-a74b61a9b786 could not be found. May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '604b986c-b195-4646-879b-a74b61a9b786'} May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 604b986c-b195-4646-879b-a74b61a9b786 could not be found. May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 604b986c-b195-4646-879b-a74b61a9b786 could not be found. May 21 21:18:41.627633 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:41.634139 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:41.634139 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:41.634139 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:41.634139 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:41.634139 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:41.634139 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:41.634139 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:41.634139 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 604b986c-b195-4646-879b-a74b61a9b786 could not be found. May 21 21:18:41.634139 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:41.637360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-52ca7175-6ee1-4a18-8504-3709cb454d0a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Returning 404 to user: Instance 604b986c-b195-4646-879b-a74b61a9b786 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:41.638479 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-52ca7175-6ee1-4a18-8504-3709cb454d0a tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786" status: 404 len: 111 microversion: 2.25 time: 0.051337 May 21 21:18:41.639577 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1081/2221] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:41 2022] GET /compute/v2.1/servers/604b986c-b195-4646-879b-a74b61a9b786 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:18:41.646671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-13ca4f1c-f115-4f31-9b96-73ed6b7bee64 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81ae3d8b0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:41.698232 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-13ca4f1c-f115-4f31-9b96-73ed6b7bee64 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] HTTP exception thrown: Image not found. May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-13ca4f1c-f115-4f31-9b96-73ed6b7bee64 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Request method failure captured: May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/images/c8e212db-2ab1-4233-b4f7-7352a6413d72 HTTP/1.1 May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZLKVF_0aMOhVIeqq5PZErHtckKoguxWytvpp4S28q9Pdx8q3uz3rVIFRXI4FoERKrjvIDzWO3p8pvi6UhDlrMoz3J4UFBQ_IWaO6EGM1JzEegQEdU5azkIU2fKFrqrY_jw5jN_B5V2Z2Mxpn43FDgou6Q2ufOeqKKBNrRQgYjU_Mk May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_89256ac3448643b6892e74f55bfb31d3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesTestJSON-388705491 May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesTestJSON-388705491-project May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 16686b6509f54c4abfe9d519acfb4a73 May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesTestJSON-388705491-project May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: exception: Image not found. May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'c8e212db-2ab1-4233-b4f7-7352a6413d72'} May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c8e212db-2ab1-4233-b4f7-7352a6413d72 to delete May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c8e212db-2ab1-4233-b4f7-7352a6413d72 could not be found. May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:41.700265 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-13ca4f1c-f115-4f31-9b96-73ed6b7bee64 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Returning 404 to user: Image not found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-13ca4f1c-f115-4f31-9b96-73ed6b7bee64 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "DELETE /compute/v2.1/images/c8e212db-2ab1-4233-b4f7-7352a6413d72" status: 404 len: 62 microversion: 2.1 time: 0.060898 May 21 21:18:41.706885 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1082/2222] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:41 2022] DELETE /compute/v2.1/images/c8e212db-2ab1-4233-b4f7-7352a6413d72 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:18:41.713455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4f71cc27-fdea-4341-9d91-591c550e4c21 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:41.715004 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4f71cc27-fdea-4341-9d91-591c550e4c21 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:41.723616 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f71cc27-fdea-4341-9d91-591c550e4c21 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:41.731660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f71cc27-fdea-4341-9d91-591c550e4c21 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:41.731660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f71cc27-fdea-4341-9d91-591c550e4c21 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:41.731660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f71cc27-fdea-4341-9d91-591c550e4c21 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:41.787794 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4f71cc27-fdea-4341-9d91-591c550e4c21 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:18:41.975064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c2ded51f-399c-45ed-8274-0befbddff3e1 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:41.986159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c2ded51f-399c-45ed-8274-0befbddff3e1 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:41.987674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c2ded51f-399c-45ed-8274-0befbddff3e1 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:41.989122 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c2ded51f-399c-45ed-8274-0befbddff3e1 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.736652 May 21 21:18:41.989683 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1141/2223] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:41 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:41.994838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-09a20586-8b12-408d-bf18-2954cf61a3bc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:41.996753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-09a20586-8b12-408d-bf18-2954cf61a3bc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:42.002228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-09a20586-8b12-408d-bf18-2954cf61a3bc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:42.002691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-09a20586-8b12-408d-bf18-2954cf61a3bc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:42.003476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-09a20586-8b12-408d-bf18-2954cf61a3bc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:42.004049 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-09a20586-8b12-408d-bf18-2954cf61a3bc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:42.034850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-09a20586-8b12-408d-bf18-2954cf61a3bc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:18:42.210814 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4f71cc27-fdea-4341-9d91-591c550e4c21 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "DELETE /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 204 len: 0 microversion: 2.25 time: 0.505992 May 21 21:18:42.211525 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1083/2224] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:18:41 2022] DELETE /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:18:42.218742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-e52e320d-87c7-4d1e-b9e6-f402902cfc51 req-101b5639-d83a-48a0-a04f-eaf245310f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "604b986c-b195-4646-879b-a74b61a9b786", "name": "network-vif-deleted", "tag": "113f7a42-78cc-499f-8f86-1ff9d0dcd6e5"}, {"name": "network-changed", "server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "tag": "138f2620-7e88-4702-9a4f-46aec93115ea"}, {"name": "network-changed", "server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "tag": "48dd9dc9-3303-40c5-903b-4f36c5908e91"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:42.231699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e52e320d-87c7-4d1e-b9e6-f402902cfc51 req-101b5639-d83a-48a0-a04f-eaf245310f55 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:42.231699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e52e320d-87c7-4d1e-b9e6-f402902cfc51 req-101b5639-d83a-48a0-a04f-eaf245310f55 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:42.245182 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.compute.api [None req-09a20586-8b12-408d-bf18-2954cf61a3bc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Instance is already in deleting state, ignoring this request May 21 21:18:42.245935 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-09a20586-8b12-408d-bf18-2954cf61a3bc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 204 len: 0 microversion: 2.1 time: 0.255284 May 21 21:18:42.246791 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-e52e320d-87c7-4d1e-b9e6-f402902cfc51 req-101b5639-d83a-48a0-a04f-eaf245310f55 service nova] Creating event network-vif-deleted:113f7a42-78cc-499f-8f86-1ff9d0dcd6e5 for instance 604b986c-b195-4646-879b-a74b61a9b786 on nch2-master-1 May 21 21:18:42.247497 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1142/2225] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:18:41 2022] DELETE /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:18:42.249234 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-e52e320d-87c7-4d1e-b9e6-f402902cfc51 req-101b5639-d83a-48a0-a04f-eaf245310f55 service nova] Creating event network-changed:138f2620-7e88-4702-9a4f-46aec93115ea for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:18:42.254249 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-a9e23a30-f35f-4682-a0a2-9c14648f609e req-a5037ae3-13a8-43f0-b48f-b4700cfbc3ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9be9b1d-6502-4335-90b3-677ff81f4efc", "name": "network-vif-plugged", "status": "completed", "tag": "779a6c9f-256c-48e3-976d-aa8ffc3d3790"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:42.257968 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-e52e320d-87c7-4d1e-b9e6-f402902cfc51 req-101b5639-d83a-48a0-a04f-eaf245310f55 service nova] Creating event network-changed:48dd9dc9-3303-40c5-903b-4f36c5908e91 for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:18:42.268652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a9e23a30-f35f-4682-a0a2-9c14648f609e req-a5037ae3-13a8-43f0-b48f-b4700cfbc3ef service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:42.269113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a9e23a30-f35f-4682-a0a2-9c14648f609e req-a5037ae3-13a8-43f0-b48f-b4700cfbc3ef service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:42.277711 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-e52e320d-87c7-4d1e-b9e6-f402902cfc51 req-101b5639-d83a-48a0-a04f-eaf245310f55 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.063994 May 21 21:18:42.284850 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1084/2226] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:42.291536 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a9e23a30-f35f-4682-a0a2-9c14648f609e req-a5037ae3-13a8-43f0-b48f-b4700cfbc3ef service nova] Creating event network-vif-plugged:779a6c9f-256c-48e3-976d-aa8ffc3d3790 for instance a9be9b1d-6502-4335-90b3-677ff81f4efc on nch1-master-1 May 21 21:18:42.293078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-04bb8bd6-a2d6-4f56-a515-9a1113c62cf6 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:42.294164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-04bb8bd6-a2d6-4f56-a515-9a1113c62cf6 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:42.298552 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-a9e23a30-f35f-4682-a0a2-9c14648f609e req-a5037ae3-13a8-43f0-b48f-b4700cfbc3ef service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049511 May 21 21:18:42.300119 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1143/2227] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:42.303689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04bb8bd6-a2d6-4f56-a515-9a1113c62cf6 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:42.304340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04bb8bd6-a2d6-4f56-a515-9a1113c62cf6 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:42.305470 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04bb8bd6-a2d6-4f56-a515-9a1113c62cf6 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:42.306154 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04bb8bd6-a2d6-4f56-a515-9a1113c62cf6 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:42.308832 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-37f1486e-bb14-4826-8f30-67119096dd1c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:42.314585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-37f1486e-bb14-4826-8f30-67119096dd1c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:42.320624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-37f1486e-bb14-4826-8f30-67119096dd1c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:42.321606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-37f1486e-bb14-4826-8f30-67119096dd1c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:42.322423 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-37f1486e-bb14-4826-8f30-67119096dd1c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:42.322876 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-37f1486e-bb14-4826-8f30-67119096dd1c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:42.477699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-04bb8bd6-a2d6-4f56-a515-9a1113c62cf6 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128df9f2acf4b14aeb3d6b4ba3012ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bb4d7f9fb14923bd3fb8a4146f737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:42.487070 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-04bb8bd6-a2d6-4f56-a515-9a1113c62cf6 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca" status: 200 len: 1314 microversion: 2.1 time: 0.199841 May 21 21:18:42.487794 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1085/2228] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:42 2022] GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:42.505334 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-63662697-8769-4502-a39e-3f6f97a3d37a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:42.506286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-63662697-8769-4502-a39e-3f6f97a3d37a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:42.513909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63662697-8769-4502-a39e-3f6f97a3d37a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:42.517626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63662697-8769-4502-a39e-3f6f97a3d37a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:42.517626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63662697-8769-4502-a39e-3f6f97a3d37a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:42.517626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63662697-8769-4502-a39e-3f6f97a3d37a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:42.672863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-63662697-8769-4502-a39e-3f6f97a3d37a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:42.682090 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-63662697-8769-4502-a39e-3f6f97a3d37a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1493 microversion: 2.1 time: 0.193149 May 21 21:18:42.683078 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1086/2229] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:42 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1493 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:42.692239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c225f420-a8b7-4dcc-9fac-abeea4380d08 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:42.693065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c225f420-a8b7-4dcc-9fac-abeea4380d08 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:42.699717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c225f420-a8b7-4dcc-9fac-abeea4380d08 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:42.700253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c225f420-a8b7-4dcc-9fac-abeea4380d08 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:42.701110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c225f420-a8b7-4dcc-9fac-abeea4380d08 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:42.702016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c225f420-a8b7-4dcc-9fac-abeea4380d08 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:42.716237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-37f1486e-bb14-4826-8f30-67119096dd1c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:42.727321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-37f1486e-bb14-4826-8f30-67119096dd1c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:42.729616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-37f1486e-bb14-4826-8f30-67119096dd1c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:42.732895 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-37f1486e-bb14-4826-8f30-67119096dd1c tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1562 microversion: 2.25 time: 0.431222 May 21 21:18:42.734106 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1144/2230] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:42 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1562 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:42.893127 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c225f420-a8b7-4dcc-9fac-abeea4380d08 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:42.903401 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c225f420-a8b7-4dcc-9fac-abeea4380d08 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 200 len: 1314 microversion: 2.1 time: 0.218041 May 21 21:18:42.915945 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1087/2231] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:42 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:43.008186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-40700b67-79d8-400c-b635-f22bb696c978 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:43.010241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-40700b67-79d8-400c-b635-f22bb696c978 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:43.017339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-6a2cfa89-8449-4ea4-8cb3-2696f8d2600b req-587ffba9-1754-4557-9350-8ef7501dfa5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d980d7ff-026f-459d-9e56-1a94f395ae0c", "tag": "082823dd-94f5-471c-bc0f-58c62e99cd30"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:43.022516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-40700b67-79d8-400c-b635-f22bb696c978 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:43.022982 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-40700b67-79d8-400c-b635-f22bb696c978 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:43.023779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-40700b67-79d8-400c-b635-f22bb696c978 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:43.024227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-40700b67-79d8-400c-b635-f22bb696c978 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:43.044420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6a2cfa89-8449-4ea4-8cb3-2696f8d2600b req-587ffba9-1754-4557-9350-8ef7501dfa5a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:43.044882 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6a2cfa89-8449-4ea4-8cb3-2696f8d2600b req-587ffba9-1754-4557-9350-8ef7501dfa5a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:43.065720 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-6a2cfa89-8449-4ea4-8cb3-2696f8d2600b req-587ffba9-1754-4557-9350-8ef7501dfa5a service nova] Creating event network-changed:082823dd-94f5-471c-bc0f-58c62e99cd30 for instance d980d7ff-026f-459d-9e56-1a94f395ae0c on nch1-master-1 May 21 21:18:43.073528 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-6a2cfa89-8449-4ea4-8cb3-2696f8d2600b req-587ffba9-1754-4557-9350-8ef7501dfa5a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059595 May 21 21:18:43.074295 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1088/2232] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:43.384756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:43.406438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=12 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:43.506154 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6b942ae0-3df8-4ee3-a7c3-a69d0a36ad08 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:43.506898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6b942ae0-3df8-4ee3-a7c3-a69d0a36ad08 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:43.516869 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b942ae0-3df8-4ee3-a7c3-a69d0a36ad08 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:43.517330 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b942ae0-3df8-4ee3-a7c3-a69d0a36ad08 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:43.518653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b942ae0-3df8-4ee3-a7c3-a69d0a36ad08 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:43.519110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b942ae0-3df8-4ee3-a7c3-a69d0a36ad08 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:44.042822 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=14 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:44.052399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6b942ae0-3df8-4ee3-a7c3-a69d0a36ad08 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128df9f2acf4b14aeb3d6b4ba3012ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bb4d7f9fb14923bd3fb8a4146f737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:44.060459 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6b942ae0-3df8-4ee3-a7c3-a69d0a36ad08 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca" status: 200 len: 1314 microversion: 2.1 time: 0.560042 May 21 21:18:44.061400 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1089/2233] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:43 2022] GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:44.066919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-44e1eaa6-9036-409c-9e42-32101330193a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:44.067784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-44e1eaa6-9036-409c-9e42-32101330193a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:44.074161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44e1eaa6-9036-409c-9e42-32101330193a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:44.074617 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44e1eaa6-9036-409c-9e42-32101330193a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:44.075399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44e1eaa6-9036-409c-9e42-32101330193a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:44.076030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44e1eaa6-9036-409c-9e42-32101330193a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:44.103393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-40700b67-79d8-400c-b635-f22bb696c978 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:44.113963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-40700b67-79d8-400c-b635-f22bb696c978 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:44.115585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-40700b67-79d8-400c-b635-f22bb696c978 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:44.116858 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-40700b67-79d8-400c-b635-f22bb696c978 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 1.113122 May 21 21:18:44.117415 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1145/2234] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:43 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:44.122404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5616f429-429e-49bd-88b3-1f049c6ea1cd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:44.123325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5616f429-429e-49bd-88b3-1f049c6ea1cd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:44.131687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5616f429-429e-49bd-88b3-1f049c6ea1cd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:44.132270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5616f429-429e-49bd-88b3-1f049c6ea1cd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:44.133151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5616f429-429e-49bd-88b3-1f049c6ea1cd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:44.133681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5616f429-429e-49bd-88b3-1f049c6ea1cd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:44.363244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-44e1eaa6-9036-409c-9e42-32101330193a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:44.373674 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-44e1eaa6-9036-409c-9e42-32101330193a tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1493 microversion: 2.1 time: 0.309976 May 21 21:18:44.374578 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1090/2235] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:44 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1493 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:44.380061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-59882e65-6ce3-49ea-92b9-587263cf3511 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:44.380865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-59882e65-6ce3-49ea-92b9-587263cf3511 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:44.391383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59882e65-6ce3-49ea-92b9-587263cf3511 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:44.391513 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59882e65-6ce3-49ea-92b9-587263cf3511 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:44.392247 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59882e65-6ce3-49ea-92b9-587263cf3511 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:44.392714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59882e65-6ce3-49ea-92b9-587263cf3511 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:44.599779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-59882e65-6ce3-49ea-92b9-587263cf3511 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:44.608318 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-59882e65-6ce3-49ea-92b9-587263cf3511 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 200 len: 1314 microversion: 2.1 time: 0.232562 May 21 21:18:44.608895 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1091/2236] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:44 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:44.614027 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-c09a0350-57ae-4a4e-a50f-7ea73881ce5b req-a59bee42-943f-4c2d-911f-ed18150ea288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a60dc0bc-d248-4b55-9d38-defb6caf9bca", "name": "network-vif-plugged", "status": "completed", "tag": "87d9ef09-56e5-4f1b-8766-9da713e1fdd6"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:44.622244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c09a0350-57ae-4a4e-a50f-7ea73881ce5b req-a59bee42-943f-4c2d-911f-ed18150ea288 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:44.622704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c09a0350-57ae-4a4e-a50f-7ea73881ce5b req-a59bee42-943f-4c2d-911f-ed18150ea288 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:44.637112 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-c09a0350-57ae-4a4e-a50f-7ea73881ce5b req-a59bee42-943f-4c2d-911f-ed18150ea288 service nova] Creating event network-vif-plugged:87d9ef09-56e5-4f1b-8766-9da713e1fdd6 for instance a60dc0bc-d248-4b55-9d38-defb6caf9bca on nch2-master-1 May 21 21:18:44.645168 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-c09a0350-57ae-4a4e-a50f-7ea73881ce5b req-a59bee42-943f-4c2d-911f-ed18150ea288 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034650 May 21 21:18:44.646318 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1092/2237] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:44.697044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-8b5f16c6-c572-4971-81c2-7ef545898e95 req-95e96669-da89-4539-b1b2-235fa3fcc16c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "tag": "e9977234-a2ec-4c9f-a0fe-3e3caa959f0c"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:44.713260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-8b5f16c6-c572-4971-81c2-7ef545898e95 req-95e96669-da89-4539-b1b2-235fa3fcc16c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:44.714625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-8b5f16c6-c572-4971-81c2-7ef545898e95 req-95e96669-da89-4539-b1b2-235fa3fcc16c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:44.733689 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-8b5f16c6-c572-4971-81c2-7ef545898e95 req-95e96669-da89-4539-b1b2-235fa3fcc16c service nova] Creating event network-changed:e9977234-a2ec-4c9f-a0fe-3e3caa959f0c for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:18:44.739994 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-8b5f16c6-c572-4971-81c2-7ef545898e95 req-95e96669-da89-4539-b1b2-235fa3fcc16c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050376 May 21 21:18:44.741384 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1093/2238] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:45.081422 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-337de325-d8af-4359-ac4e-5cd48a06af97 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:45.083579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-337de325-d8af-4359-ac4e-5cd48a06af97 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:45.090972 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-337de325-d8af-4359-ac4e-5cd48a06af97 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:45.091882 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-337de325-d8af-4359-ac4e-5cd48a06af97 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:45.093084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-337de325-d8af-4359-ac4e-5cd48a06af97 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:45.093997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-337de325-d8af-4359-ac4e-5cd48a06af97 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:45.290414 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5616f429-429e-49bd-88b3-1f049c6ea1cd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:45.312374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5616f429-429e-49bd-88b3-1f049c6ea1cd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:45.312374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5616f429-429e-49bd-88b3-1f049c6ea1cd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:45.316248 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5616f429-429e-49bd-88b3-1f049c6ea1cd tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1562 microversion: 2.25 time: 1.197506 May 21 21:18:45.318823 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1146/2239] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:44 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1562 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:45.326655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f782fef0-76d6-43c1-a442-b960df6a5f21 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:45.327460 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f782fef0-76d6-43c1-a442-b960df6a5f21 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:45.339600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f782fef0-76d6-43c1-a442-b960df6a5f21 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:45.340417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f782fef0-76d6-43c1-a442-b960df6a5f21 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:45.342911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f782fef0-76d6-43c1-a442-b960df6a5f21 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:45.343583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f782fef0-76d6-43c1-a442-b960df6a5f21 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:45.433331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-337de325-d8af-4359-ac4e-5cd48a06af97 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128df9f2acf4b14aeb3d6b4ba3012ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bb4d7f9fb14923bd3fb8a4146f737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:45.456017 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-337de325-d8af-4359-ac4e-5cd48a06af97 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca" status: 200 len: 1314 microversion: 2.1 time: 0.374586 May 21 21:18:45.458548 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1094/2240] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:45 2022] GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:45.468816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9b8f7895-77be-4429-bdd6-b483bd59c52f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:45.470518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9b8f7895-77be-4429-bdd6-b483bd59c52f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:45.477750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9b8f7895-77be-4429-bdd6-b483bd59c52f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:45.479401 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9b8f7895-77be-4429-bdd6-b483bd59c52f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:45.480467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9b8f7895-77be-4429-bdd6-b483bd59c52f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:45.481133 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9b8f7895-77be-4429-bdd6-b483bd59c52f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:45.770452 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9b8f7895-77be-4429-bdd6-b483bd59c52f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:45.784253 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9b8f7895-77be-4429-bdd6-b483bd59c52f tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1493 microversion: 2.1 time: 0.323436 May 21 21:18:45.785793 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1095/2241] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:45 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1493 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:45.795171 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-29310aca-4914-44c2-ac18-515337f0b184 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:45.805739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-29310aca-4914-44c2-ac18-515337f0b184 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:45.824034 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-29310aca-4914-44c2-ac18-515337f0b184 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:45.824595 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-29310aca-4914-44c2-ac18-515337f0b184 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:45.825445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-29310aca-4914-44c2-ac18-515337f0b184 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:45.825953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-29310aca-4914-44c2-ac18-515337f0b184 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:46.146645 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f782fef0-76d6-43c1-a442-b960df6a5f21 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:46.195500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f782fef0-76d6-43c1-a442-b960df6a5f21 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:46.198459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f782fef0-76d6-43c1-a442-b960df6a5f21 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:46.199684 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f782fef0-76d6-43c1-a442-b960df6a5f21 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.878428 May 21 21:18:46.200241 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1147/2242] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:45 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:46.325414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-29310aca-4914-44c2-ac18-515337f0b184 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:46.339899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0db019ef-b8f5-4d79-bdb2-289003acbab2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:46.341195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0db019ef-b8f5-4d79-bdb2-289003acbab2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:46.352610 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-29310aca-4914-44c2-ac18-515337f0b184 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 200 len: 1314 microversion: 2.1 time: 0.565324 May 21 21:18:46.362820 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1096/2243] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:45 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:46.372064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0db019ef-b8f5-4d79-bdb2-289003acbab2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:46.374221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0db019ef-b8f5-4d79-bdb2-289003acbab2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:46.374899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0db019ef-b8f5-4d79-bdb2-289003acbab2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:46.378653 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0db019ef-b8f5-4d79-bdb2-289003acbab2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:46.476749 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-af39ba3c-efa1-422c-8489-53807b63455c tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:46.478755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-af39ba3c-efa1-422c-8489-53807b63455c tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:46.505047 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-af39ba3c-efa1-422c-8489-53807b63455c tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:46.505589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-af39ba3c-efa1-422c-8489-53807b63455c tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:46.506472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-af39ba3c-efa1-422c-8489-53807b63455c tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:46.506993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-af39ba3c-efa1-422c-8489-53807b63455c tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:46.517911 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:46.603080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0db019ef-b8f5-4d79-bdb2-289003acbab2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:46.613220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0db019ef-b8f5-4d79-bdb2-289003acbab2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:46.615022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0db019ef-b8f5-4d79-bdb2-289003acbab2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:46.616539 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0db019ef-b8f5-4d79-bdb2-289003acbab2 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1520 microversion: 2.25 time: 0.282633 May 21 21:18:46.617668 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1148/2244] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:46 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:46.735774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-7f95b8a9-db7c-4cd7-8522-cee518fa7a0c req-f2e2bc93-1a5b-48a3-8bbf-715116e67916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9be9b1d-6502-4335-90b3-677ff81f4efc", "name": "network-vif-unplugged", "status": "completed", "tag": "779a6c9f-256c-48e3-976d-aa8ffc3d3790"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:46.759928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7f95b8a9-db7c-4cd7-8522-cee518fa7a0c req-f2e2bc93-1a5b-48a3-8bbf-715116e67916 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:46.761069 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7f95b8a9-db7c-4cd7-8522-cee518fa7a0c req-f2e2bc93-1a5b-48a3-8bbf-715116e67916 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:46.800686 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-7f95b8a9-db7c-4cd7-8522-cee518fa7a0c req-f2e2bc93-1a5b-48a3-8bbf-715116e67916 service nova] Creating event network-vif-unplugged:779a6c9f-256c-48e3-976d-aa8ffc3d3790 for instance a9be9b1d-6502-4335-90b3-677ff81f4efc on nch1-master-1 May 21 21:18:46.808473 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-7f95b8a9-db7c-4cd7-8522-cee518fa7a0c req-f2e2bc93-1a5b-48a3-8bbf-715116e67916 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076883 May 21 21:18:46.810415 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1149/2245] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:18:46.819465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-aebfc2c8-e779-424a-a467-4fd82f144b25 req-23049530-b5cb-4d19-a65d-de5593d4fabe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9be9b1d-6502-4335-90b3-677ff81f4efc", "name": "network-vif-deleted", "tag": "779a6c9f-256c-48e3-976d-aa8ffc3d3790"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:46.831598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-aebfc2c8-e779-424a-a467-4fd82f144b25 req-23049530-b5cb-4d19-a65d-de5593d4fabe service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:46.832568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-aebfc2c8-e779-424a-a467-4fd82f144b25 req-23049530-b5cb-4d19-a65d-de5593d4fabe service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:46.847518 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-aebfc2c8-e779-424a-a467-4fd82f144b25 req-23049530-b5cb-4d19-a65d-de5593d4fabe service nova] Creating event network-vif-deleted:779a6c9f-256c-48e3-976d-aa8ffc3d3790 for instance a9be9b1d-6502-4335-90b3-677ff81f4efc on nch1-master-1 May 21 21:18:46.858974 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-aebfc2c8-e779-424a-a467-4fd82f144b25 req-23049530-b5cb-4d19-a65d-de5593d4fabe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042661 May 21 21:18:46.867182 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1150/2246] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:46.883657 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d5814e44-0c9b-479e-b839-ec3653f9abfd tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:46.885857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d5814e44-0c9b-479e-b839-ec3653f9abfd tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:46.898978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5814e44-0c9b-479e-b839-ec3653f9abfd tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:46.899601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5814e44-0c9b-479e-b839-ec3653f9abfd tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:46.900811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5814e44-0c9b-479e-b839-ec3653f9abfd tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:46.903007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5814e44-0c9b-479e-b839-ec3653f9abfd tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:46.919624 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-af39ba3c-efa1-422c-8489-53807b63455c tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128df9f2acf4b14aeb3d6b4ba3012ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bb4d7f9fb14923bd3fb8a4146f737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:46.940796 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-af39ba3c-efa1-422c-8489-53807b63455c tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca" status: 200 len: 1464 microversion: 2.1 time: 0.463690 May 21 21:18:46.942178 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1097/2247] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:46 2022] GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca => generated 1464 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:18:47.411488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1eb0c65d-1620-4ee1-895d-88163fedcf2e tempest-TenantUsagesTestJSON-577957267 tempest-TenantUsagesTestJSON-577957267-project-admin] Calling method '.version_select at 0x7fc81ae29af0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:47.422038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1eb0c65d-1620-4ee1-895d-88163fedcf2e tempest-TenantUsagesTestJSON-577957267 tempest-TenantUsagesTestJSON-577957267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:47.422725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1eb0c65d-1620-4ee1-895d-88163fedcf2e tempest-TenantUsagesTestJSON-577957267 tempest-TenantUsagesTestJSON-577957267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:47.461402 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1eb0c65d-1620-4ee1-895d-88163fedcf2e tempest-TenantUsagesTestJSON-577957267 tempest-TenantUsagesTestJSON-577957267-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:47.462340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1eb0c65d-1620-4ee1-895d-88163fedcf2e tempest-TenantUsagesTestJSON-577957267 tempest-TenantUsagesTestJSON-577957267-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:47.503692 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1eb0c65d-1620-4ee1-895d-88163fedcf2e tempest-TenantUsagesTestJSON-577957267 tempest-TenantUsagesTestJSON-577957267-project-admin] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage/a9bb4d7f9fb14923bd3fb8a4146f737c?start=2022-05-20T21%3A18%3A46.951289&end=2022-05-22T21%3A18%3A46.951289" status: 200 len: 695 microversion: 2.1 time: 0.548618 May 21 21:18:47.507521 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1098/2248] 10.222.0.49 () {58 vars in 1411 bytes} [Sat May 21 21:18:46 2022] GET /compute/v2.1/os-simple-tenant-usage/a9bb4d7f9fb14923bd3fb8a4146f737c?start=2022-05-20T21%3A18%3A46.951289&end=2022-05-22T21%3A18%3A46.951289 => generated 695 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:18:47.512718 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-fa568659-3a1e-4c27-a837-5e04c4750dfb req-a4046b1d-5a2f-4277-8f14-f0514ec6fcd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "tag": "372fb508-d9ed-4893-bad7-003dffcb0ca7"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:47.536251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-fa568659-3a1e-4c27-a837-5e04c4750dfb req-a4046b1d-5a2f-4277-8f14-f0514ec6fcd8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:47.538125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-fa568659-3a1e-4c27-a837-5e04c4750dfb req-a4046b1d-5a2f-4277-8f14-f0514ec6fcd8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:47.577689 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-fa568659-3a1e-4c27-a837-5e04c4750dfb req-a4046b1d-5a2f-4277-8f14-f0514ec6fcd8 service nova] Creating event network-changed:372fb508-d9ed-4893-bad7-003dffcb0ca7 for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:18:47.583090 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-fa568659-3a1e-4c27-a837-5e04c4750dfb req-a4046b1d-5a2f-4277-8f14-f0514ec6fcd8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073967 May 21 21:18:47.584128 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1099/2249] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:47.589374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cfa66e5c-c0fc-4214-b028-ce5bbce9afcc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:47.590241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cfa66e5c-c0fc-4214-b028-ce5bbce9afcc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:47.598418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cfa66e5c-c0fc-4214-b028-ce5bbce9afcc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:47.599019 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cfa66e5c-c0fc-4214-b028-ce5bbce9afcc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:47.599916 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cfa66e5c-c0fc-4214-b028-ce5bbce9afcc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:47.600495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cfa66e5c-c0fc-4214-b028-ce5bbce9afcc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:47.606541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d5814e44-0c9b-479e-b839-ec3653f9abfd tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:47.621382 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d5814e44-0c9b-479e-b839-ec3653f9abfd tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1451 microversion: 2.1 time: 0.747756 May 21 21:18:47.621382 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1151/2250] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:46 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1451 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:47.638937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f78f263a-6563-4856-9966-8c9afd69767e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:47.644088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f78f263a-6563-4856-9966-8c9afd69767e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:47.662360 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f78f263a-6563-4856-9966-8c9afd69767e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:47.667243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f78f263a-6563-4856-9966-8c9afd69767e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:47.667243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f78f263a-6563-4856-9966-8c9afd69767e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:47.667243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f78f263a-6563-4856-9966-8c9afd69767e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:47.893380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f78f263a-6563-4856-9966-8c9afd69767e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:47.909758 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f78f263a-6563-4856-9966-8c9afd69767e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 200 len: 1314 microversion: 2.1 time: 0.279336 May 21 21:18:47.912589 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1152/2251] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:47 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:47.923633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fe8d33c7-4724-4c4a-bc33-66ce2f84bf16 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Calling method '.version_select at 0x7fc82d087430>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:47.943987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe8d33c7-4724-4c4a-bc33-66ce2f84bf16 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:47.944839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe8d33c7-4724-4c4a-bc33-66ce2f84bf16 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:47.975853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe8d33c7-4724-4c4a-bc33-66ce2f84bf16 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:47.975853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe8d33c7-4724-4c4a-bc33-66ce2f84bf16 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:48.000679 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fe8d33c7-4724-4c4a-bc33-66ce2f84bf16 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage/a9bb4d7f9fb14923bd3fb8a4146f737c?start=2022-05-20T21%3A18%3A46.951289&end=2022-05-22T21%3A18%3A46.951289" status: 200 len: 695 microversion: 2.1 time: 0.086694 May 21 21:18:48.014478 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1153/2252] 10.222.0.49 () {58 vars in 1411 bytes} [Sat May 21 21:18:47 2022] GET /compute/v2.1/os-simple-tenant-usage/a9bb4d7f9fb14923bd3fb8a4146f737c?start=2022-05-20T21%3A18%3A46.951289&end=2022-05-22T21%3A18%3A46.951289 => generated 695 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:48.023705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-85ce5188-5b58-46c7-a46d-ec012983b44b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:48.024591 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-85ce5188-5b58-46c7-a46d-ec012983b44b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:48.039260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85ce5188-5b58-46c7-a46d-ec012983b44b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:48.042168 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85ce5188-5b58-46c7-a46d-ec012983b44b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:48.043338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85ce5188-5b58-46c7-a46d-ec012983b44b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:48.044332 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85ce5188-5b58-46c7-a46d-ec012983b44b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:48.094091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cfa66e5c-c0fc-4214-b028-ce5bbce9afcc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:48.095756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:48.101222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85ce5188-5b58-46c7-a46d-ec012983b44b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:48.101975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85ce5188-5b58-46c7-a46d-ec012983b44b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:48.102640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-85ce5188-5b58-46c7-a46d-ec012983b44b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lazy-loading 'fault' on Instance uuid 99d32d33-c3d7-4c41-a4cf-f804fac41120 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:18:48.111637 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cfa66e5c-c0fc-4214-b028-ce5bbce9afcc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:48.117506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cfa66e5c-c0fc-4214-b028-ce5bbce9afcc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:48.124561 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cfa66e5c-c0fc-4214-b028-ce5bbce9afcc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.536213 May 21 21:18:48.138078 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1100/2253] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:47 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:48.153596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a3bb06d8-2c27-443c-86db-f5713d8c728d tempest-TenantUsagesTestJSON-577957267 tempest-TenantUsagesTestJSON-577957267-project-admin] Calling method '.version_select at 0x7fc81ae3ad30>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:48.174375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3bb06d8-2c27-443c-86db-f5713d8c728d tempest-TenantUsagesTestJSON-577957267 tempest-TenantUsagesTestJSON-577957267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:48.175555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3bb06d8-2c27-443c-86db-f5713d8c728d tempest-TenantUsagesTestJSON-577957267 tempest-TenantUsagesTestJSON-577957267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:48.215469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3bb06d8-2c27-443c-86db-f5713d8c728d tempest-TenantUsagesTestJSON-577957267 tempest-TenantUsagesTestJSON-577957267-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:48.217255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3bb06d8-2c27-443c-86db-f5713d8c728d tempest-TenantUsagesTestJSON-577957267 tempest-TenantUsagesTestJSON-577957267-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:48.254747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-85ce5188-5b58-46c7-a46d-ec012983b44b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:48.269617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-85ce5188-5b58-46c7-a46d-ec012983b44b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:48.271960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-85ce5188-5b58-46c7-a46d-ec012983b44b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7199de1e6f04147b197c086ac6cc6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220204ccbcf443c98a64994f29700ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:48.277669 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-85ce5188-5b58-46c7-a46d-ec012983b44b tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 200 len: 1351 microversion: 2.25 time: 0.261738 May 21 21:18:48.295481 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1154/2254] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:48 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 1351 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:48.393178 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a3bb06d8-2c27-443c-86db-f5713d8c728d tempest-TenantUsagesTestJSON-577957267 tempest-TenantUsagesTestJSON-577957267-project-admin] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-20T21%3A18%3A46.951289&end=2022-05-22T21%3A18%3A46.951289&detailed=1" status: 200 len: 23328 microversion: 2.1 time: 0.250549 May 21 21:18:48.395945 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1101/2255] 10.222.0.49 () {58 vars in 1334 bytes} [Sat May 21 21:18:48 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-20T21%3A18%3A46.951289&end=2022-05-22T21%3A18%3A46.951289&detailed=1 => generated 23328 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:18:48.426501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f212d6a4-0d6d-49eb-8b29-1cba6c6c82ad tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:48.427015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f212d6a4-0d6d-49eb-8b29-1cba6c6c82ad tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:48.435117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f212d6a4-0d6d-49eb-8b29-1cba6c6c82ad tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:48.435554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f212d6a4-0d6d-49eb-8b29-1cba6c6c82ad tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:48.439500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f212d6a4-0d6d-49eb-8b29-1cba6c6c82ad tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:48.439500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f212d6a4-0d6d-49eb-8b29-1cba6c6c82ad tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:48.478561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:48.507303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f212d6a4-0d6d-49eb-8b29-1cba6c6c82ad tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:18:48.638303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cbed03cc-de1f-4ff5-a7f1-feed3eda3f54 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:48.646139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cbed03cc-de1f-4ff5-a7f1-feed3eda3f54 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:48.671848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbed03cc-de1f-4ff5-a7f1-feed3eda3f54 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:48.672898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbed03cc-de1f-4ff5-a7f1-feed3eda3f54 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:48.704190 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbed03cc-de1f-4ff5-a7f1-feed3eda3f54 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:48.705339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbed03cc-de1f-4ff5-a7f1-feed3eda3f54 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:48.809300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbed03cc-de1f-4ff5-a7f1-feed3eda3f54 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:48.810531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbed03cc-de1f-4ff5-a7f1-feed3eda3f54 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:48.811649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-cbed03cc-de1f-4ff5-a7f1-feed3eda3f54 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lazy-loading 'fault' on Instance uuid a9be9b1d-6502-4335-90b3-677ff81f4efc {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:18:48.973251 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f212d6a4-0d6d-49eb-8b29-1cba6c6c82ad tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca" status: 204 len: 0 microversion: 2.1 time: 0.551414 May 21 21:18:48.975431 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1155/2256] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:18:48 2022] DELETE /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:18:48.982511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-c14dd8e0-5384-4026-9526-a73a34b113dd req-6e7514ab-63e1-48c3-bbc6-65b9172610da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d32d33-c3d7-4c41-a4cf-f804fac41120", "name": "network-vif-deleted", "tag": "2e166c5d-4aab-4618-98ae-7042d9891722"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:49.006602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c14dd8e0-5384-4026-9526-a73a34b113dd req-6e7514ab-63e1-48c3-bbc6-65b9172610da service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:49.007172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c14dd8e0-5384-4026-9526-a73a34b113dd req-6e7514ab-63e1-48c3-bbc6-65b9172610da service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:49.050463 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-c14dd8e0-5384-4026-9526-a73a34b113dd req-6e7514ab-63e1-48c3-bbc6-65b9172610da service nova] Creating event network-vif-deleted:2e166c5d-4aab-4618-98ae-7042d9891722 for instance 99d32d33-c3d7-4c41-a4cf-f804fac41120 on nch1-master-1 May 21 21:18:49.060347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cbed03cc-de1f-4ff5-a7f1-feed3eda3f54 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16686b6509f54c4abfe9d519acfb4a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89256ac3448643b6892e74f55bfb31d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:49.074551 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-c14dd8e0-5384-4026-9526-a73a34b113dd req-6e7514ab-63e1-48c3-bbc6-65b9172610da service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096750 May 21 21:18:49.077199 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1156/2257] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:49.082877 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cbed03cc-de1f-4ff5-a7f1-feed3eda3f54 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 200 len: 1297 microversion: 2.1 time: 0.446567 May 21 21:18:49.093528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4cf1b235-eb8d-4780-b2ca-1a1e7f921d02 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:49.094763 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1102/2258] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:48 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 1297 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:18:49.096221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4cf1b235-eb8d-4780-b2ca-1a1e7f921d02 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:49.107507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8183e4e7-7308-4376-ba71-4c07db1449e4 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:49.108999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8183e4e7-7308-4376-ba71-4c07db1449e4 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:49.124892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cf1b235-eb8d-4780-b2ca-1a1e7f921d02 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:49.127773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8183e4e7-7308-4376-ba71-4c07db1449e4 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:49.128812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8183e4e7-7308-4376-ba71-4c07db1449e4 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:49.130165 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8183e4e7-7308-4376-ba71-4c07db1449e4 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:49.131454 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8183e4e7-7308-4376-ba71-4c07db1449e4 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:49.147259 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cf1b235-eb8d-4780-b2ca-1a1e7f921d02 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:49.148309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cf1b235-eb8d-4780-b2ca-1a1e7f921d02 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:49.157189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cf1b235-eb8d-4780-b2ca-1a1e7f921d02 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:49.488323 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8183e4e7-7308-4376-ba71-4c07db1449e4 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128df9f2acf4b14aeb3d6b4ba3012ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bb4d7f9fb14923bd3fb8a4146f737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:49.507283 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8183e4e7-7308-4376-ba71-4c07db1449e4 tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca" status: 200 len: 1470 microversion: 2.1 time: 0.400898 May 21 21:18:49.507283 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1103/2259] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:49 2022] GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca => generated 1470 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:49.523130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-feec2c1c-b904-47cb-8824-da046e817767 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:49.526080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-feec2c1c-b904-47cb-8824-da046e817767 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:49.535920 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-feec2c1c-b904-47cb-8824-da046e817767 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:49.536839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-feec2c1c-b904-47cb-8824-da046e817767 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:49.537804 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-feec2c1c-b904-47cb-8824-da046e817767 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:49.538784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-feec2c1c-b904-47cb-8824-da046e817767 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:49.756237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4cf1b235-eb8d-4780-b2ca-1a1e7f921d02 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:49.764943 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4cf1b235-eb8d-4780-b2ca-1a1e7f921d02 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 200 len: 1314 microversion: 2.1 time: 0.683480 May 21 21:18:49.766871 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1157/2260] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:49 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 1314 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:49.773150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1694b1ef-e153-41a3-b655-0641bebfe194 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:49.777022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1694b1ef-e153-41a3-b655-0641bebfe194 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] [instance: 99d32d33-c3d7-4c41-a4cf-f804fac41120] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:49.786428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1694b1ef-e153-41a3-b655-0641bebfe194 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:49.793542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1694b1ef-e153-41a3-b655-0641bebfe194 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:49.795244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1694b1ef-e153-41a3-b655-0641bebfe194 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:49.801072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1694b1ef-e153-41a3-b655-0641bebfe194 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:49.847659 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-1694b1ef-e153-41a3-b655-0641bebfe194 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] HTTP exception thrown: Instance 99d32d33-c3d7-4c41-a4cf-f804fac41120 could not be found. May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1694b1ef-e153-41a3-b655-0641bebfe194 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Request method failure captured: May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 HTTP/1.1 May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVV5MQ6wjX3e56hMYL2H6QpgG2OGlj7_WVu_9F0M9B0qG3q3UUDg996Rddujz6fUPxExXOpXkryXyYL-Wd8knK-7jGRmDNL-ylu-28gtS7k7dx0YNwh29VSnNOjvK9_KwSh8lCreK7X11V9JuHX_06dql2Z6V9Brqagrb3wXR5ML4fw May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: X-Openstack-Nova-Api-Version: 2.25 May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 220204ccbcf443c98a64994f29700ef0 May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1048081752 May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/220204ccbcf443c98a64994f29700ef0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/220204ccbcf443c98a64994f29700ef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_220204ccbcf443c98a64994f29700ef0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/220204ccbcf443c98a64994f29700ef0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1048081752 May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 220204ccbcf443c98a64994f29700ef0 May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1048081752 May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-LiveAutoBlockMigrationV225Test-1048081752-project May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: b7199de1e6f04147b197c086ac6cc6fc May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1048081752-project May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 99d32d33-c3d7-4c41-a4cf-f804fac41120 could not be found. May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '99d32d33-c3d7-4c41-a4cf-f804fac41120'} May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d32d33-c3d7-4c41-a4cf-f804fac41120 could not be found. May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d32d33-c3d7-4c41-a4cf-f804fac41120 could not be found. May 21 21:18:49.852524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:49.858096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:49.858096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:49.858096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:49.858096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:49.858096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:49.858096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:49.858096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:49.858096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d32d33-c3d7-4c41-a4cf-f804fac41120 could not be found. May 21 21:18:49.858096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:18:49.858096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1694b1ef-e153-41a3-b655-0641bebfe194 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] Returning 404 to user: Instance 99d32d33-c3d7-4c41-a4cf-f804fac41120 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:49.858096 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1694b1ef-e153-41a3-b655-0641bebfe194 tempest-LiveAutoBlockMigrationV225Test-1048081752 tempest-LiveAutoBlockMigrationV225Test-1048081752-project] 10.222.0.49 "GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120" status: 404 len: 111 microversion: 2.25 time: 0.089887 May 21 21:18:49.863949 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1158/2261] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:49 2022] GET /compute/v2.1/servers/99d32d33-c3d7-4c41-a4cf-f804fac41120 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:18:49.865909 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-631bf7f8-48ae-4435-b1e5-d6bda4abaf4d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-601287877", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "f113117c-671a-4dba-92c0-6bfe73bbc698"}, {"uuid": "d3264743-2a36-4526-9b87-9e52809799be"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:49.969924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-631bf7f8-48ae-4435-b1e5-d6bda4abaf4d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] validate_networks() for [('f113117c-671a-4dba-92c0-6bfe73bbc698', None, None, None, None, None), ('d3264743-2a36-4526-9b87-9e52809799be', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:18:50.071957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-feec2c1c-b904-47cb-8824-da046e817767 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:50.084803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-feec2c1c-b904-47cb-8824-da046e817767 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:50.086493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-feec2c1c-b904-47cb-8824-da046e817767 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:50.087827 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-feec2c1c-b904-47cb-8824-da046e817767 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.573758 May 21 21:18:50.100134 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1104/2262] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:49 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:50.106373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-32773a1f-0e9a-49e4-b2ca-7542b11979aa req-60e51307-f646-4099-9ff1-d02a5f532ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "tag": "3d35e5b8-e654-4f4c-91c1-813a3bf3bedf"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:50.113349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:50.119310 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-32773a1f-0e9a-49e4-b2ca-7542b11979aa req-60e51307-f646-4099-9ff1-d02a5f532ee1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:50.121591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-32773a1f-0e9a-49e4-b2ca-7542b11979aa req-60e51307-f646-4099-9ff1-d02a5f532ee1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:50.137232 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-32773a1f-0e9a-49e4-b2ca-7542b11979aa req-60e51307-f646-4099-9ff1-d02a5f532ee1 service nova] Creating event network-changed:3d35e5b8-e654-4f4c-91c1-813a3bf3bedf for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:18:50.144644 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-32773a1f-0e9a-49e4-b2ca-7542b11979aa req-60e51307-f646-4099-9ff1-d02a5f532ee1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041993 May 21 21:18:50.152929 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1105/2263] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:50.156571 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c23cd5b0-b2a2-4508-9256-01091f23cb09 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:50.157394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c23cd5b0-b2a2-4508-9256-01091f23cb09 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: a9be9b1d-6502-4335-90b3-677ff81f4efc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:50.166545 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c23cd5b0-b2a2-4508-9256-01091f23cb09 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:50.167202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c23cd5b0-b2a2-4508-9256-01091f23cb09 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:50.168103 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c23cd5b0-b2a2-4508-9256-01091f23cb09 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:50.168711 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c23cd5b0-b2a2-4508-9256-01091f23cb09 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:50.189596 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-c23cd5b0-b2a2-4508-9256-01091f23cb09 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] HTTP exception thrown: Instance a9be9b1d-6502-4335-90b3-677ff81f4efc could not be found. May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c23cd5b0-b2a2-4508-9256-01091f23cb09 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Request method failure captured: May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc HTTP/1.1 May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZLKVF_0aMOhVIeqq5PZErHtckKoguxWytvpp4S28q9Pdx8q3uz3rVIFRXI4FoERKrjvIDzWO3p8pvi6UhDlrMoz3J4UFBQ_IWaO6EGM1JzEegQEdU5azkIU2fKFrqrY_jw5jN_B5V2Z2Mxpn43FDgou6Q2ufOeqKKBNrRQgYjU_Mk May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_89256ac3448643b6892e74f55bfb31d3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesTestJSON-388705491 May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesTestJSON-388705491-project May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 16686b6509f54c4abfe9d519acfb4a73 May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesTestJSON-388705491-project May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance a9be9b1d-6502-4335-90b3-677ff81f4efc could not be found. May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'a9be9b1d-6502-4335-90b3-677ff81f4efc'} May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9be9b1d-6502-4335-90b3-677ff81f4efc could not be found. May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9be9b1d-6502-4335-90b3-677ff81f4efc could not be found. May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.192062 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:50.197856 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:50.197856 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:50.197856 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:50.197856 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:50.197856 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9be9b1d-6502-4335-90b3-677ff81f4efc could not be found. May 21 21:18:50.197856 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.197856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c23cd5b0-b2a2-4508-9256-01091f23cb09 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Returning 404 to user: Instance a9be9b1d-6502-4335-90b3-677ff81f4efc could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:50.199391 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c23cd5b0-b2a2-4508-9256-01091f23cb09 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc" status: 404 len: 111 microversion: 2.1 time: 0.048661 May 21 21:18:50.200132 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1106/2264] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:50 2022] GET /compute/v2.1/servers/a9be9b1d-6502-4335-90b3-677ff81f4efc => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:18:50.219287 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-74f3518e-9f8e-419c-ae0e-c13e88beff0b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81ae505e0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:50.273284 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-74f3518e-9f8e-419c-ae0e-c13e88beff0b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] HTTP exception thrown: Image not found. May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-74f3518e-9f8e-419c-ae0e-c13e88beff0b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Request method failure captured: May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e HTTP/1.1 May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZLKVF_0aMOhVIeqq5PZErHtckKoguxWytvpp4S28q9Pdx8q3uz3rVIFRXI4FoERKrjvIDzWO3p8pvi6UhDlrMoz3J4UFBQ_IWaO6EGM1JzEegQEdU5azkIU2fKFrqrY_jw5jN_B5V2Z2Mxpn43FDgou6Q2ufOeqKKBNrRQgYjU_Mk May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_89256ac3448643b6892e74f55bfb31d3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesTestJSON-388705491 May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesTestJSON-388705491-project May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 16686b6509f54c4abfe9d519acfb4a73 May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesTestJSON-388705491-project May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: exception: Image not found. May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'd71035aa-e619-40f1-a87b-2751bb076c2e'} May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d71035aa-e619-40f1-a87b-2751bb076c2e to delete May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d71035aa-e619-40f1-a87b-2751bb076c2e could not be found. May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.275720 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:50.284817 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:50.284817 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:50.284817 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:50.284817 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:50.284817 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:18:50.284817 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:18:50.284817 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:50.284817 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:50.284817 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 21 21:18:50.284817 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 21 21:18:50.284817 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:18:50.284817 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.284817 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:50.284817 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.284817 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:50.284817 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:50.284817 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:50.284817 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:50.284817 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:50.284817 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:18:50.284817 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.290823 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-74f3518e-9f8e-419c-ae0e-c13e88beff0b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Returning 404 to user: Image not found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:50.298443 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-74f3518e-9f8e-419c-ae0e-c13e88beff0b tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "DELETE /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e" status: 404 len: 62 microversion: 2.1 time: 0.077636 May 21 21:18:50.298443 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1107/2265] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:50 2022] DELETE /compute/v2.1/images/d71035aa-e619-40f1-a87b-2751bb076c2e => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:18:50.320184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-46a01e5c-0cab-45e6-a558-9cdb6cd5097d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:50.323681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-46a01e5c-0cab-45e6-a558-9cdb6cd5097d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:50.342717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-46a01e5c-0cab-45e6-a558-9cdb6cd5097d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:50.347937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-46a01e5c-0cab-45e6-a558-9cdb6cd5097d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:50.352737 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-46a01e5c-0cab-45e6-a558-9cdb6cd5097d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:50.353650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-46a01e5c-0cab-45e6-a558-9cdb6cd5097d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:50.404729 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-46a01e5c-0cab-45e6-a558-9cdb6cd5097d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] HTTP exception thrown: Instance b9930871-f204-4368-a581-87d1b5ed7415 could not be found. May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-46a01e5c-0cab-45e6-a558-9cdb6cd5097d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Request method failure captured: May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 HTTP/1.1 May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZLKVF_0aMOhVIeqq5PZErHtckKoguxWytvpp4S28q9Pdx8q3uz3rVIFRXI4FoERKrjvIDzWO3p8pvi6UhDlrMoz3J4UFBQ_IWaO6EGM1JzEegQEdU5azkIU2fKFrqrY_jw5jN_B5V2Z2Mxpn43FDgou6Q2ufOeqKKBNrRQgYjU_Mk May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_89256ac3448643b6892e74f55bfb31d3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesTestJSON-388705491 May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesTestJSON-388705491-project May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 16686b6509f54c4abfe9d519acfb4a73 May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesTestJSON-388705491-project May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance b9930871-f204-4368-a581-87d1b5ed7415 could not be found. May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'b9930871-f204-4368-a581-87d1b5ed7415'} May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9930871-f204-4368-a581-87d1b5ed7415 could not be found. May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:18:50.414521 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9930871-f204-4368-a581-87d1b5ed7415 could not be found. May 21 21:18:50.422905 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.422905 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:50.422905 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.422905 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:50.422905 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:50.422905 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:50.422905 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:50.422905 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:50.422905 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9930871-f204-4368-a581-87d1b5ed7415 could not be found. May 21 21:18:50.422905 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.422905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-46a01e5c-0cab-45e6-a558-9cdb6cd5097d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Returning 404 to user: Instance b9930871-f204-4368-a581-87d1b5ed7415 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:50.422905 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-46a01e5c-0cab-45e6-a558-9cdb6cd5097d tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 404 len: 111 microversion: 2.1 time: 0.114376 May 21 21:18:50.424113 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1108/2266] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:18:50 2022] DELETE /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:18:50.434353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-25f2c295-2a35-4985-a022-a486f33653cc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:50.435831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-25f2c295-2a35-4985-a022-a486f33653cc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: b9930871-f204-4368-a581-87d1b5ed7415] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:50.445904 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25f2c295-2a35-4985-a022-a486f33653cc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:50.449821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25f2c295-2a35-4985-a022-a486f33653cc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:50.450958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25f2c295-2a35-4985-a022-a486f33653cc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:50.451690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25f2c295-2a35-4985-a022-a486f33653cc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:50.468442 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-25f2c295-2a35-4985-a022-a486f33653cc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] HTTP exception thrown: Instance b9930871-f204-4368-a581-87d1b5ed7415 could not be found. May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-25f2c295-2a35-4985-a022-a486f33653cc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Request method failure captured: May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 HTTP/1.1 May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZLKVF_0aMOhVIeqq5PZErHtckKoguxWytvpp4S28q9Pdx8q3uz3rVIFRXI4FoERKrjvIDzWO3p8pvi6UhDlrMoz3J4UFBQ_IWaO6EGM1JzEegQEdU5azkIU2fKFrqrY_jw5jN_B5V2Z2Mxpn43FDgou6Q2ufOeqKKBNrRQgYjU_Mk May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_89256ac3448643b6892e74f55bfb31d3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesTestJSON-388705491 May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesTestJSON-388705491-project May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 16686b6509f54c4abfe9d519acfb4a73 May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesTestJSON-388705491-project May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance b9930871-f204-4368-a581-87d1b5ed7415 could not be found. May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'b9930871-f204-4368-a581-87d1b5ed7415'} May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9930871-f204-4368-a581-87d1b5ed7415 could not be found. May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9930871-f204-4368-a581-87d1b5ed7415 could not be found. May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.470423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:50.476591 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:50.476591 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:50.476591 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:50.476591 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:50.476591 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9930871-f204-4368-a581-87d1b5ed7415 could not be found. May 21 21:18:50.476591 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.478977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-25f2c295-2a35-4985-a022-a486f33653cc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Returning 404 to user: Instance b9930871-f204-4368-a581-87d1b5ed7415 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:50.480878 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-25f2c295-2a35-4985-a022-a486f33653cc tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415" status: 404 len: 111 microversion: 2.1 time: 0.054677 May 21 21:18:50.482023 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1109/2267] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:50 2022] GET /compute/v2.1/servers/b9930871-f204-4368-a581-87d1b5ed7415 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:18:50.489665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9821fca6-cbb0-4178-9478-c6ec76cb1d72 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81ae3aa60>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:50.523940 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-9821fca6-cbb0-4178-9478-c6ec76cb1d72 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] HTTP exception thrown: Image not found. May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9821fca6-cbb0-4178-9478-c6ec76cb1d72 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Request method failure captured: May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af HTTP/1.1 May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZLKVF_0aMOhVIeqq5PZErHtckKoguxWytvpp4S28q9Pdx8q3uz3rVIFRXI4FoERKrjvIDzWO3p8pvi6UhDlrMoz3J4UFBQ_IWaO6EGM1JzEegQEdU5azkIU2fKFrqrY_jw5jN_B5V2Z2Mxpn43FDgou6Q2ufOeqKKBNrRQgYjU_Mk May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_89256ac3448643b6892e74f55bfb31d3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesTestJSON-388705491 May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesTestJSON-388705491-project May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 16686b6509f54c4abfe9d519acfb4a73 May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesTestJSON-388705491-project May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: exception: Image not found. May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '5da94fbd-fe0e-4584-962b-477cea7513af'} May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5da94fbd-fe0e-4584-962b-477cea7513af to delete May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5da94fbd-fe0e-4584-962b-477cea7513af could not be found. May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.525717 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9821fca6-cbb0-4178-9478-c6ec76cb1d72 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Returning 404 to user: Image not found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9821fca6-cbb0-4178-9478-c6ec76cb1d72 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "DELETE /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af" status: 404 len: 62 microversion: 2.1 time: 0.041267 May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1110/2268] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:50 2022] DELETE /compute/v2.1/images/5da94fbd-fe0e-4584-962b-477cea7513af => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5d88c187-d112-4677-947e-22261e82f82e tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:50.535288 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5d88c187-d112-4677-947e-22261e82f82e tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:50.546063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d88c187-d112-4677-947e-22261e82f82e tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:50.546667 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d88c187-d112-4677-947e-22261e82f82e tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:50.552760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d88c187-d112-4677-947e-22261e82f82e tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:50.552760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d88c187-d112-4677-947e-22261e82f82e tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:50.885538 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5d88c187-d112-4677-947e-22261e82f82e tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128df9f2acf4b14aeb3d6b4ba3012ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bb4d7f9fb14923bd3fb8a4146f737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:50.914214 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5d88c187-d112-4677-947e-22261e82f82e tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca" status: 200 len: 1470 microversion: 2.1 time: 0.373136 May 21 21:18:50.926284 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1111/2269] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:50 2022] GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca => generated 1470 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:50.936565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c71a6623-cb82-423e-beb1-c9c5a20d1dd7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:50.941725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c71a6623-cb82-423e-beb1-c9c5a20d1dd7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:50.965250 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c71a6623-cb82-423e-beb1-c9c5a20d1dd7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:50.966781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c71a6623-cb82-423e-beb1-c9c5a20d1dd7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:50.975778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c71a6623-cb82-423e-beb1-c9c5a20d1dd7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:50.976816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c71a6623-cb82-423e-beb1-c9c5a20d1dd7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:51.010117 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-c71a6623-cb82-423e-beb1-c9c5a20d1dd7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] HTTP exception thrown: Instance 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b could not be found. May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c71a6623-cb82-423e-beb1-c9c5a20d1dd7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Request method failure captured: May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b HTTP/1.1 May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZLKVF_0aMOhVIeqq5PZErHtckKoguxWytvpp4S28q9Pdx8q3uz3rVIFRXI4FoERKrjvIDzWO3p8pvi6UhDlrMoz3J4UFBQ_IWaO6EGM1JzEegQEdU5azkIU2fKFrqrY_jw5jN_B5V2Z2Mxpn43FDgou6Q2ufOeqKKBNrRQgYjU_Mk May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_89256ac3448643b6892e74f55bfb31d3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesTestJSON-388705491 May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesTestJSON-388705491-project May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 16686b6509f54c4abfe9d519acfb4a73 May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesTestJSON-388705491-project May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b could not be found. May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b'} May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b could not be found. May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:18:51.019913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b could not be found. May 21 21:18:51.024915 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.024915 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:51.024915 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.024915 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:51.024915 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:51.024915 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:51.024915 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:51.024915 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:51.024915 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b could not be found. May 21 21:18:51.024915 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.024915 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c71a6623-cb82-423e-beb1-c9c5a20d1dd7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Returning 404 to user: Instance 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:51.024915 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c71a6623-cb82-423e-beb1-c9c5a20d1dd7 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "DELETE /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 404 len: 111 microversion: 2.1 time: 0.103534 May 21 21:18:51.045199 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1112/2270] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:18:50 2022] DELETE /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:18:51.045199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ae2c3737-ace3-4f69-8817-171132469f9c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:51.045199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ae2c3737-ace3-4f69-8817-171132469f9c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:51.045199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ae2c3737-ace3-4f69-8817-171132469f9c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:51.045199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ae2c3737-ace3-4f69-8817-171132469f9c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:51.045199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ae2c3737-ace3-4f69-8817-171132469f9c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:51.045199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ae2c3737-ace3-4f69-8817-171132469f9c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:51.323034 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ae2c3737-ace3-4f69-8817-171132469f9c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:51.338358 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ae2c3737-ace3-4f69-8817-171132469f9c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 200 len: 1314 microversion: 2.1 time: 0.309656 May 21 21:18:51.339278 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1113/2271] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:51 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:51.352796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b61adaad-1cc4-4ffe-bc94-fed51a23bc6c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:51.355240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b61adaad-1cc4-4ffe-bc94-fed51a23bc6c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:51.366964 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b61adaad-1cc4-4ffe-bc94-fed51a23bc6c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:51.367848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b61adaad-1cc4-4ffe-bc94-fed51a23bc6c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:51.369037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b61adaad-1cc4-4ffe-bc94-fed51a23bc6c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:51.369735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b61adaad-1cc4-4ffe-bc94-fed51a23bc6c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:51.394527 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-b61adaad-1cc4-4ffe-bc94-fed51a23bc6c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] HTTP exception thrown: Instance 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b could not be found. May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b61adaad-1cc4-4ffe-bc94-fed51a23bc6c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Request method failure captured: May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b HTTP/1.1 May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZLKVF_0aMOhVIeqq5PZErHtckKoguxWytvpp4S28q9Pdx8q3uz3rVIFRXI4FoERKrjvIDzWO3p8pvi6UhDlrMoz3J4UFBQ_IWaO6EGM1JzEegQEdU5azkIU2fKFrqrY_jw5jN_B5V2Z2Mxpn43FDgou6Q2ufOeqKKBNrRQgYjU_Mk May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_89256ac3448643b6892e74f55bfb31d3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesTestJSON-388705491 May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesTestJSON-388705491-project May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 16686b6509f54c4abfe9d519acfb4a73 May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesTestJSON-388705491-project May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b could not be found. May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b'} May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b could not be found. May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b could not be found. May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.396611 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:51.402584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:51.402584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:51.402584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:51.402584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:51.402584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b could not be found. May 21 21:18:51.402584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.405170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b61adaad-1cc4-4ffe-bc94-fed51a23bc6c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Returning 404 to user: Instance 94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:51.407264 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b61adaad-1cc4-4ffe-bc94-fed51a23bc6c tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b" status: 404 len: 111 microversion: 2.1 time: 0.065926 May 21 21:18:51.408882 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1114/2272] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:51 2022] GET /compute/v2.1/servers/94bbf3c0-9f1e-4cae-97dd-f9cbfe964e6b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:18:51.415979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d08fb85c-5905-493f-bfc5-4ac965a873a6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:51.416907 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d08fb85c-5905-493f-bfc5-4ac965a873a6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:51.426979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d08fb85c-5905-493f-bfc5-4ac965a873a6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:51.427937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d08fb85c-5905-493f-bfc5-4ac965a873a6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:51.429926 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d08fb85c-5905-493f-bfc5-4ac965a873a6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:51.430837 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d08fb85c-5905-493f-bfc5-4ac965a873a6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:51.752814 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d08fb85c-5905-493f-bfc5-4ac965a873a6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:51.772044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d08fb85c-5905-493f-bfc5-4ac965a873a6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:51.776798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d08fb85c-5905-493f-bfc5-4ac965a873a6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:51.781683 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d08fb85c-5905-493f-bfc5-4ac965a873a6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.370275 May 21 21:18:51.794100 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1115/2273] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:51 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:51.802203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c0e41c3a-1633-48f1-8a62-201ed1b00534 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '.version_select at 0x7fc81adf64c0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:51.828268 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-c0e41c3a-1633-48f1-8a62-201ed1b00534 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] HTTP exception thrown: Image not found. May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c0e41c3a-1633-48f1-8a62-201ed1b00534 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Request method failure captured: May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/images/a01ea977-6a34-4461-99fd-b508fcead394 HTTP/1.1 May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZLKVF_0aMOhVIeqq5PZErHtckKoguxWytvpp4S28q9Pdx8q3uz3rVIFRXI4FoERKrjvIDzWO3p8pvi6UhDlrMoz3J4UFBQ_IWaO6EGM1JzEegQEdU5azkIU2fKFrqrY_jw5jN_B5V2Z2Mxpn43FDgou6Q2ufOeqKKBNrRQgYjU_Mk May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_89256ac3448643b6892e74f55bfb31d3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesTestJSON-388705491 May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesTestJSON-388705491-project May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 16686b6509f54c4abfe9d519acfb4a73 May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesTestJSON-388705491-project May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: exception: Image not found. May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'a01ea977-6a34-4461-99fd-b508fcead394'} May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a01ea977-6a34-4461-99fd-b508fcead394 to delete May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a01ea977-6a34-4461-99fd-b508fcead394 could not be found. May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.830216 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c0e41c3a-1633-48f1-8a62-201ed1b00534 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Returning 404 to user: Image not found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c0e41c3a-1633-48f1-8a62-201ed1b00534 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "DELETE /compute/v2.1/images/a01ea977-6a34-4461-99fd-b508fcead394" status: 404 len: 62 microversion: 2.1 time: 0.034457 May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1116/2274] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:51 2022] DELETE /compute/v2.1/images/a01ea977-6a34-4461-99fd-b508fcead394 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d21fabb5-1e8f-4546-a72d-fdd1861638d9 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:51.847610 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d21fabb5-1e8f-4546-a72d-fdd1861638d9 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 2efd4657-7152-42ae-92d6-9249939767ed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:51.879128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d21fabb5-1e8f-4546-a72d-fdd1861638d9 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:51.881821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d21fabb5-1e8f-4546-a72d-fdd1861638d9 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:51.882991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d21fabb5-1e8f-4546-a72d-fdd1861638d9 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:51.883978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d21fabb5-1e8f-4546-a72d-fdd1861638d9 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:51.945493 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-d21fabb5-1e8f-4546-a72d-fdd1861638d9 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] HTTP exception thrown: Instance 2efd4657-7152-42ae-92d6-9249939767ed could not be found. May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d21fabb5-1e8f-4546-a72d-fdd1861638d9 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Request method failure captured: May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed HTTP/1.1 May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZLKVF_0aMOhVIeqq5PZErHtckKoguxWytvpp4S28q9Pdx8q3uz3rVIFRXI4FoERKrjvIDzWO3p8pvi6UhDlrMoz3J4UFBQ_IWaO6EGM1JzEegQEdU5azkIU2fKFrqrY_jw5jN_B5V2Z2Mxpn43FDgou6Q2ufOeqKKBNrRQgYjU_Mk May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_89256ac3448643b6892e74f55bfb31d3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesTestJSON-388705491 May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesTestJSON-388705491-project May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 16686b6509f54c4abfe9d519acfb4a73 May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesTestJSON-388705491-project May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 2efd4657-7152-42ae-92d6-9249939767ed could not be found. May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '2efd4657-7152-42ae-92d6-9249939767ed'} May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2efd4657-7152-42ae-92d6-9249939767ed could not be found. May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:18:51.953546 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2efd4657-7152-42ae-92d6-9249939767ed could not be found. May 21 21:18:51.962797 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.962797 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:51.962797 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.962797 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:51.962797 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:51.962797 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:51.962797 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:51.962797 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:51.962797 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2efd4657-7152-42ae-92d6-9249939767ed could not be found. May 21 21:18:51.962797 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:51.968223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d21fabb5-1e8f-4546-a72d-fdd1861638d9 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Returning 404 to user: Instance 2efd4657-7152-42ae-92d6-9249939767ed could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:51.970363 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d21fabb5-1e8f-4546-a72d-fdd1861638d9 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed" status: 404 len: 111 microversion: 2.1 time: 0.132517 May 21 21:18:51.972194 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1117/2275] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:18:51 2022] DELETE /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:18:51.978711 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-309d15d0-ad29-40de-a752-62ae4b46331c tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:51.979534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-309d15d0-ad29-40de-a752-62ae4b46331c tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:51.991446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-309d15d0-ad29-40de-a752-62ae4b46331c tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:51.992793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-309d15d0-ad29-40de-a752-62ae4b46331c tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:51.994038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-309d15d0-ad29-40de-a752-62ae4b46331c tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:51.994840 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-309d15d0-ad29-40de-a752-62ae4b46331c tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:52.045070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-309d15d0-ad29-40de-a752-62ae4b46331c tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:52.045903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-309d15d0-ad29-40de-a752-62ae4b46331c tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:52.046690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-309d15d0-ad29-40de-a752-62ae4b46331c tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lazy-loading 'fault' on Instance uuid a60dc0bc-d248-4b55-9d38-defb6caf9bca {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:18:52.131786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-309d15d0-ad29-40de-a752-62ae4b46331c tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd128df9f2acf4b14aeb3d6b4ba3012ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bb4d7f9fb14923bd3fb8a4146f737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:52.146561 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-309d15d0-ad29-40de-a752-62ae4b46331c tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca" status: 200 len: 1304 microversion: 2.1 time: 0.172679 May 21 21:18:52.147690 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1118/2276] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:51 2022] GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca => generated 1304 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:52.152620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4ea971fa-bc11-437c-a4b5-1db2a1ca3878 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:52.153619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4ea971fa-bc11-437c-a4b5-1db2a1ca3878 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] [instance: 2efd4657-7152-42ae-92d6-9249939767ed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:52.162659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4ea971fa-bc11-437c-a4b5-1db2a1ca3878 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:52.163468 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4ea971fa-bc11-437c-a4b5-1db2a1ca3878 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:52.164803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4ea971fa-bc11-437c-a4b5-1db2a1ca3878 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:52.165493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4ea971fa-bc11-437c-a4b5-1db2a1ca3878 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:52.181948 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-4ea971fa-bc11-437c-a4b5-1db2a1ca3878 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] HTTP exception thrown: Instance 2efd4657-7152-42ae-92d6-9249939767ed could not be found. May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4ea971fa-bc11-437c-a4b5-1db2a1ca3878 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Request method failure captured: May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed HTTP/1.1 May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVZLKVF_0aMOhVIeqq5PZErHtckKoguxWytvpp4S28q9Pdx8q3uz3rVIFRXI4FoERKrjvIDzWO3p8pvi6UhDlrMoz3J4UFBQ_IWaO6EGM1JzEegQEdU5azkIU2fKFrqrY_jw5jN_B5V2Z2Mxpn43FDgou6Q2ufOeqKKBNrRQgYjU_Mk May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_89256ac3448643b6892e74f55bfb31d3", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89256ac3448643b6892e74f55bfb31d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesTestJSON-388705491 May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 89256ac3448643b6892e74f55bfb31d3 May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesTestJSON-388705491 May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesTestJSON-388705491-project May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 16686b6509f54c4abfe9d519acfb4a73 May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesTestJSON-388705491-project May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 2efd4657-7152-42ae-92d6-9249939767ed could not be found. May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '2efd4657-7152-42ae-92d6-9249939767ed'} May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2efd4657-7152-42ae-92d6-9249939767ed could not be found. May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2efd4657-7152-42ae-92d6-9249939767ed could not be found. May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:52.183913 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:52.190886 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:52.190886 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:52.190886 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:52.190886 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:52.190886 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2efd4657-7152-42ae-92d6-9249939767ed could not be found. May 21 21:18:52.190886 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:52.193359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4ea971fa-bc11-437c-a4b5-1db2a1ca3878 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] Returning 404 to user: Instance 2efd4657-7152-42ae-92d6-9249939767ed could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:52.194510 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4ea971fa-bc11-437c-a4b5-1db2a1ca3878 tempest-ImagesTestJSON-388705491 tempest-ImagesTestJSON-388705491-project] 10.222.0.49 "GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed" status: 404 len: 111 microversion: 2.1 time: 0.045605 May 21 21:18:52.195716 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1119/2277] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:52 2022] GET /compute/v2.1/servers/2efd4657-7152-42ae-92d6-9249939767ed => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:18:52.210735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-b413b000-4698-4003-86b5-14388768c238 req-b29dcf0d-657b-4cae-acb6-9918067e2e72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a60dc0bc-d248-4b55-9d38-defb6caf9bca", "name": "network-vif-deleted", "tag": "87d9ef09-56e5-4f1b-8766-9da713e1fdd6"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:52.222053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b413b000-4698-4003-86b5-14388768c238 req-b29dcf0d-657b-4cae-acb6-9918067e2e72 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:52.224343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b413b000-4698-4003-86b5-14388768c238 req-b29dcf0d-657b-4cae-acb6-9918067e2e72 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:52.239592 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-b413b000-4698-4003-86b5-14388768c238 req-b29dcf0d-657b-4cae-acb6-9918067e2e72 service nova] Creating event network-vif-deleted:87d9ef09-56e5-4f1b-8766-9da713e1fdd6 for instance a60dc0bc-d248-4b55-9d38-defb6caf9bca on nch2-master-1 May 21 21:18:52.245856 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-b413b000-4698-4003-86b5-14388768c238 req-b29dcf0d-657b-4cae-acb6-9918067e2e72 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048107 May 21 21:18:52.247370 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1120/2278] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:52.355353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-73527034-84a6-4366-87f8-94e40d59e9c2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:52.356810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-73527034-84a6-4366-87f8-94e40d59e9c2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:52.369305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-73527034-84a6-4366-87f8-94e40d59e9c2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:52.369305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-73527034-84a6-4366-87f8-94e40d59e9c2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:52.369305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-73527034-84a6-4366-87f8-94e40d59e9c2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:52.369305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-73527034-84a6-4366-87f8-94e40d59e9c2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:52.731053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-73527034-84a6-4366-87f8-94e40d59e9c2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:52.746927 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-73527034-84a6-4366-87f8-94e40d59e9c2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 200 len: 1314 microversion: 2.1 time: 0.395456 May 21 21:18:52.748248 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1121/2279] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:52 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:18:52.814701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c92dca9c-3050-4487-aa24-ba2deeebd59d tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:52.815381 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c92dca9c-3050-4487-aa24-ba2deeebd59d tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:52.840491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c92dca9c-3050-4487-aa24-ba2deeebd59d tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:52.845983 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c92dca9c-3050-4487-aa24-ba2deeebd59d tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:52.845983 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c92dca9c-3050-4487-aa24-ba2deeebd59d tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:52.845983 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c92dca9c-3050-4487-aa24-ba2deeebd59d tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:53.164505 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c92dca9c-3050-4487-aa24-ba2deeebd59d tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:53.174564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c92dca9c-3050-4487-aa24-ba2deeebd59d tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:53.176202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c92dca9c-3050-4487-aa24-ba2deeebd59d tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:53.177381 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c92dca9c-3050-4487-aa24-ba2deeebd59d tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.380697 May 21 21:18:53.178481 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1122/2280] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:52 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:53.182795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3fe2b971-f4e9-42f3-b7d5-74ffd5fe39dc tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:53.183503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3fe2b971-f4e9-42f3-b7d5-74ffd5fe39dc tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] [instance: a60dc0bc-d248-4b55-9d38-defb6caf9bca] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:53.191084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3fe2b971-f4e9-42f3-b7d5-74ffd5fe39dc tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:53.191812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3fe2b971-f4e9-42f3-b7d5-74ffd5fe39dc tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:53.192257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3fe2b971-f4e9-42f3-b7d5-74ffd5fe39dc tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:53.192775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3fe2b971-f4e9-42f3-b7d5-74ffd5fe39dc tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:53.198723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-631bf7f8-48ae-4435-b1e5-d6bda4abaf4d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:18:53.198723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-631bf7f8-48ae-4435-b1e5-d6bda4abaf4d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:18:53.198723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-631bf7f8-48ae-4435-b1e5-d6bda4abaf4d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:18:53.198723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-631bf7f8-48ae-4435-b1e5-d6bda4abaf4d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:18:53.199644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-631bf7f8-48ae-4435-b1e5-d6bda4abaf4d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:18:53.213624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-631bf7f8-48ae-4435-b1e5-d6bda4abaf4d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:53.214083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-631bf7f8-48ae-4435-b1e5-d6bda4abaf4d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:53.214883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-631bf7f8-48ae-4435-b1e5-d6bda4abaf4d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:53.215319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-631bf7f8-48ae-4435-b1e5-d6bda4abaf4d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:53.233828 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-3fe2b971-f4e9-42f3-b7d5-74ffd5fe39dc tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] HTTP exception thrown: Instance a60dc0bc-d248-4b55-9d38-defb6caf9bca could not be found. May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3fe2b971-f4e9-42f3-b7d5-74ffd5fe39dc tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Request method failure captured: May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca HTTP/1.1 May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVce-Dt1pceTgDdv2iNm4vmAAIsp_92v3XI6PIBM2FTRnlaexXdVH-W2yOE6QPDvxmT5SSCUJsXWgrdxw0oF25cqQeyn147QArur3RVwwhFJ8fAG3KTck1pLmbdsrlAocSiomIp-DYv0F62w0FcBWggNAaONZ3e3LpFXqb70J5zWKzY May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: a9bb4d7f9fb14923bd3fb8a4146f737c May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TenantUsagesTestJSON-442610358 May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a9bb4d7f9fb14923bd3fb8a4146f737c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a9bb4d7f9fb14923bd3fb8a4146f737c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a9bb4d7f9fb14923bd3fb8a4146f737c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a9bb4d7f9fb14923bd3fb8a4146f737c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TenantUsagesTestJSON-442610358 May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: a9bb4d7f9fb14923bd3fb8a4146f737c May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TenantUsagesTestJSON-442610358 May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TenantUsagesTestJSON-442610358-project May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: d128df9f2acf4b14aeb3d6b4ba3012ff May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TenantUsagesTestJSON-442610358-project May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance a60dc0bc-d248-4b55-9d38-defb6caf9bca could not be found. May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'a60dc0bc-d248-4b55-9d38-defb6caf9bca'} May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a60dc0bc-d248-4b55-9d38-defb6caf9bca could not be found. May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a60dc0bc-d248-4b55-9d38-defb6caf9bca could not be found. May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:18:53.237353 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:53.243177 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:18:53.243177 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:18:53.243177 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:18:53.243177 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:18:53.243177 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:18:53.243177 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a60dc0bc-d248-4b55-9d38-defb6caf9bca could not be found. May 21 21:18:53.243177 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:18:53.243177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3fe2b971-f4e9-42f3-b7d5-74ffd5fe39dc tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] Returning 404 to user: Instance a60dc0bc-d248-4b55-9d38-defb6caf9bca could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:18:53.247014 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3fe2b971-f4e9-42f3-b7d5-74ffd5fe39dc tempest-TenantUsagesTestJSON-442610358 tempest-TenantUsagesTestJSON-442610358-project] 10.222.0.49 "GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca" status: 404 len: 111 microversion: 2.1 time: 0.067647 May 21 21:18:53.247741 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1123/2281] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:53 2022] GET /compute/v2.1/servers/a60dc0bc-d248-4b55-9d38-defb6caf9bca => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:18:53.261983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-631bf7f8-48ae-4435-b1e5-d6bda4abaf4d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Getting quotas for project a97fa11e94da4e72a9a955f8324c2d5e. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:18:53.274040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-631bf7f8-48ae-4435-b1e5-d6bda4abaf4d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Getting quotas for user 569660c20b044f1aa2df5bdfed1d833c and project a97fa11e94da4e72a9a955f8324c2d5e. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:18:53.284780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-631bf7f8-48ae-4435-b1e5-d6bda4abaf4d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:18:53.287137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-631bf7f8-48ae-4435-b1e5-d6bda4abaf4d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:18:53.444947 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-631bf7f8-48ae-4435-b1e5-d6bda4abaf4d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.583244 May 21 21:18:53.448078 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1159/2282] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:18:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:18:53.462888 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c2f02a8a-3f4f-46ad-a853-21e574de3fdc tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:53.463527 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c2f02a8a-3f4f-46ad-a853-21e574de3fdc tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:53.765164 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c42f2ec2-4326-46f6-8915-91180ff7e629 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:53.766755 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c42f2ec2-4326-46f6-8915-91180ff7e629 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:53.781056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c42f2ec2-4326-46f6-8915-91180ff7e629 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:53.781799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c42f2ec2-4326-46f6-8915-91180ff7e629 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:53.783175 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c42f2ec2-4326-46f6-8915-91180ff7e629 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:53.790615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c42f2ec2-4326-46f6-8915-91180ff7e629 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:54.044089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c2f02a8a-3f4f-46ad-a853-21e574de3fdc tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:54.053436 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c2f02a8a-3f4f-46ad-a853-21e574de3fdc tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1212 microversion: 2.1 time: 0.597306 May 21 21:18:54.058608 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1124/2283] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:53 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1212 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:54.072868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-31275b25-3d5c-4b13-8ae4-8c1dba7e7cc3 req-69690266-19bc-411f-bb70-d47fc2c8b3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d980d7ff-026f-459d-9e56-1a94f395ae0c", "name": "network-vif-plugged", "status": "completed", "tag": "082823dd-94f5-471c-bc0f-58c62e99cd30"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:54.098380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-31275b25-3d5c-4b13-8ae4-8c1dba7e7cc3 req-69690266-19bc-411f-bb70-d47fc2c8b3c6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:54.099065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-31275b25-3d5c-4b13-8ae4-8c1dba7e7cc3 req-69690266-19bc-411f-bb70-d47fc2c8b3c6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:54.135265 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-31275b25-3d5c-4b13-8ae4-8c1dba7e7cc3 req-69690266-19bc-411f-bb70-d47fc2c8b3c6 service nova] Creating event network-vif-plugged:082823dd-94f5-471c-bc0f-58c62e99cd30 for instance d980d7ff-026f-459d-9e56-1a94f395ae0c on nch1-master-1 May 21 21:18:54.146865 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-31275b25-3d5c-4b13-8ae4-8c1dba7e7cc3 req-69690266-19bc-411f-bb70-d47fc2c8b3c6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086224 May 21 21:18:54.148851 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1125/2284] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:18:54.201907 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-03358363-0c89-4a35-856d-9a7d44bb7fcc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:54.226108 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-03358363-0c89-4a35-856d-9a7d44bb7fcc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:54.248845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03358363-0c89-4a35-856d-9a7d44bb7fcc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:54.255406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03358363-0c89-4a35-856d-9a7d44bb7fcc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:54.257665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03358363-0c89-4a35-856d-9a7d44bb7fcc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:54.267853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03358363-0c89-4a35-856d-9a7d44bb7fcc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:54.322768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:54.526560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c42f2ec2-4326-46f6-8915-91180ff7e629 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:54.555854 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c42f2ec2-4326-46f6-8915-91180ff7e629 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 200 len: 1314 microversion: 2.1 time: 0.794967 May 21 21:18:54.559180 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1160/2285] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:53 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 1314 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:54.952173 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-03358363-0c89-4a35-856d-9a7d44bb7fcc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:54.967793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-03358363-0c89-4a35-856d-9a7d44bb7fcc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:54.971235 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-03358363-0c89-4a35-856d-9a7d44bb7fcc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:54.973678 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-03358363-0c89-4a35-856d-9a7d44bb7fcc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.780768 May 21 21:18:54.975788 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1126/2286] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:54 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:55.076155 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e9d5e4be-4b9f-4ae8-ae55-7bd7ffdc3c7f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:55.076850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e9d5e4be-4b9f-4ae8-ae55-7bd7ffdc3c7f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:55.085964 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9d5e4be-4b9f-4ae8-ae55-7bd7ffdc3c7f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:55.094604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9d5e4be-4b9f-4ae8-ae55-7bd7ffdc3c7f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:55.094604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9d5e4be-4b9f-4ae8-ae55-7bd7ffdc3c7f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:55.095485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9d5e4be-4b9f-4ae8-ae55-7bd7ffdc3c7f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:55.258945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e9d5e4be-4b9f-4ae8-ae55-7bd7ffdc3c7f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:55.295702 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e9d5e4be-4b9f-4ae8-ae55-7bd7ffdc3c7f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1216 microversion: 2.1 time: 0.224289 May 21 21:18:55.298861 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1161/2287] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:55 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1216 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:55.575308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-87536194-5a9e-4933-9f25-c2b7b3e58a21 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:55.576165 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-87536194-5a9e-4933-9f25-c2b7b3e58a21 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:55.586004 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87536194-5a9e-4933-9f25-c2b7b3e58a21 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:55.586687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87536194-5a9e-4933-9f25-c2b7b3e58a21 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:55.587654 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87536194-5a9e-4933-9f25-c2b7b3e58a21 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:55.588268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87536194-5a9e-4933-9f25-c2b7b3e58a21 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:55.949149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-87536194-5a9e-4933-9f25-c2b7b3e58a21 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:55.960830 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-87536194-5a9e-4933-9f25-c2b7b3e58a21 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 200 len: 1314 microversion: 2.1 time: 0.391144 May 21 21:18:55.967631 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1127/2288] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:55 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:55.995093 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6c0f4317-7ee2-4eed-b73d-20ff885626d0 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:55.996489 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6c0f4317-7ee2-4eed-b73d-20ff885626d0 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:56.008042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6c0f4317-7ee2-4eed-b73d-20ff885626d0 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:56.008781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6c0f4317-7ee2-4eed-b73d-20ff885626d0 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:56.010046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6c0f4317-7ee2-4eed-b73d-20ff885626d0 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:56.010679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6c0f4317-7ee2-4eed-b73d-20ff885626d0 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:56.316981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-255b09e8-0fb5-475a-9dcc-39d95689b704 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:56.317609 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-255b09e8-0fb5-475a-9dcc-39d95689b704 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:56.331884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-255b09e8-0fb5-475a-9dcc-39d95689b704 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:56.332319 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-255b09e8-0fb5-475a-9dcc-39d95689b704 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:56.333138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-255b09e8-0fb5-475a-9dcc-39d95689b704 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:56.337027 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-255b09e8-0fb5-475a-9dcc-39d95689b704 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:56.443358 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6c0f4317-7ee2-4eed-b73d-20ff885626d0 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:56.461560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6c0f4317-7ee2-4eed-b73d-20ff885626d0 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:56.465082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6c0f4317-7ee2-4eed-b73d-20ff885626d0 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:56.469092 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6c0f4317-7ee2-4eed-b73d-20ff885626d0 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.476622 May 21 21:18:56.470019 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1162/2289] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:55 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:56.567220 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-255b09e8-0fb5-475a-9dcc-39d95689b704 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:56.579556 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-255b09e8-0fb5-475a-9dcc-39d95689b704 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1264 microversion: 2.1 time: 0.269446 May 21 21:18:56.604508 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1128/2290] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:56 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1264 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:56.982058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d74efa6c-512e-42fc-95fb-87a4d7e85c57 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:56.982787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d74efa6c-512e-42fc-95fb-87a4d7e85c57 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:57.003553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d74efa6c-512e-42fc-95fb-87a4d7e85c57 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:57.008454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d74efa6c-512e-42fc-95fb-87a4d7e85c57 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:57.009417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d74efa6c-512e-42fc-95fb-87a4d7e85c57 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:57.010096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d74efa6c-512e-42fc-95fb-87a4d7e85c57 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:57.408271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d74efa6c-512e-42fc-95fb-87a4d7e85c57 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:57.417479 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d74efa6c-512e-42fc-95fb-87a4d7e85c57 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 200 len: 1500 microversion: 2.1 time: 0.442144 May 21 21:18:57.418336 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1163/2291] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:56 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 1500 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:57.445224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7416f31f-fbed-4730-bebf-ab63d1343b3d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:57.446353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7416f31f-fbed-4730-bebf-ab63d1343b3d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:57.455594 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7416f31f-fbed-4730-bebf-ab63d1343b3d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:57.456321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7416f31f-fbed-4730-bebf-ab63d1343b3d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:57.457300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7416f31f-fbed-4730-bebf-ab63d1343b3d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:57.457909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7416f31f-fbed-4730-bebf-ab63d1343b3d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:57.491870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ea1093ce-da56-4c5a-bdd7-6c312f21773f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:57.494062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ea1093ce-da56-4c5a-bdd7-6c312f21773f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:57.509915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea1093ce-da56-4c5a-bdd7-6c312f21773f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:57.510921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea1093ce-da56-4c5a-bdd7-6c312f21773f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:57.511767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea1093ce-da56-4c5a-bdd7-6c312f21773f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:57.514858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea1093ce-da56-4c5a-bdd7-6c312f21773f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:57.821741 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7416f31f-fbed-4730-bebf-ab63d1343b3d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "POST /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c/action" status: 202 len: 0 microversion: 2.1 time: 0.382931 May 21 21:18:57.825811 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1129/2292] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:18:57 2022] POST /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:18:57.834478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e081cc8a-23ae-4331-b6bf-c7b717acdffb tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:57.837686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e081cc8a-23ae-4331-b6bf-c7b717acdffb tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:57.854203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e081cc8a-23ae-4331-b6bf-c7b717acdffb tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:57.855017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e081cc8a-23ae-4331-b6bf-c7b717acdffb tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:57.855817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e081cc8a-23ae-4331-b6bf-c7b717acdffb tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:57.856391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e081cc8a-23ae-4331-b6bf-c7b717acdffb tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:58.051489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e081cc8a-23ae-4331-b6bf-c7b717acdffb tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:58.063508 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e081cc8a-23ae-4331-b6bf-c7b717acdffb tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1270 microversion: 2.1 time: 0.236282 May 21 21:18:58.065094 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1130/2293] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:57 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1270 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:58.075725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-662be417-a192-4eb3-845f-a3ab5b006911 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:58.077229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-662be417-a192-4eb3-845f-a3ab5b006911 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:58.084383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-662be417-a192-4eb3-845f-a3ab5b006911 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:58.085850 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-662be417-a192-4eb3-845f-a3ab5b006911 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:58.087714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-662be417-a192-4eb3-845f-a3ab5b006911 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:58.088459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-662be417-a192-4eb3-845f-a3ab5b006911 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:58.215720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:58.239625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ea1093ce-da56-4c5a-bdd7-6c312f21773f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:58.250371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ea1093ce-da56-4c5a-bdd7-6c312f21773f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:58.252336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ea1093ce-da56-4c5a-bdd7-6c312f21773f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:58.259386 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ea1093ce-da56-4c5a-bdd7-6c312f21773f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.772741 May 21 21:18:58.262700 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1164/2294] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:57 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:18:58.491436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-662be417-a192-4eb3-845f-a3ab5b006911 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:58.505183 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-662be417-a192-4eb3-845f-a3ab5b006911 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 200 len: 1505 microversion: 2.1 time: 0.437008 May 21 21:18:58.506287 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1131/2295] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:58 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 1505 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:58.676754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2afa6fa1-54e5-4348-b7df-c5e416c1b153 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-468464321", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:18:58.763434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-2afa6fa1-54e5-4348-b7df-c5e416c1b153 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] validate_networks() for None {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:18:59.082611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-95c76360-f62a-4070-89f1-5bfbe286e3ef tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:59.084027 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-95c76360-f62a-4070-89f1-5bfbe286e3ef tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:59.098780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95c76360-f62a-4070-89f1-5bfbe286e3ef tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:59.105198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95c76360-f62a-4070-89f1-5bfbe286e3ef tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:59.105198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95c76360-f62a-4070-89f1-5bfbe286e3ef tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:59.105198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95c76360-f62a-4070-89f1-5bfbe286e3ef tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:59.416650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-2afa6fa1-54e5-4348-b7df-c5e416c1b153 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:18:59.417780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-2afa6fa1-54e5-4348-b7df-c5e416c1b153 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:18:59.418481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-2afa6fa1-54e5-4348-b7df-c5e416c1b153 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:18:59.425175 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-2afa6fa1-54e5-4348-b7df-c5e416c1b153 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:18:59.425365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-2afa6fa1-54e5-4348-b7df-c5e416c1b153 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:18:59.445476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2afa6fa1-54e5-4348-b7df-c5e416c1b153 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:59.446380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2afa6fa1-54e5-4348-b7df-c5e416c1b153 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:59.447808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2afa6fa1-54e5-4348-b7df-c5e416c1b153 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:59.448981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2afa6fa1-54e5-4348-b7df-c5e416c1b153 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:59.472619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-2afa6fa1-54e5-4348-b7df-c5e416c1b153 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Getting quotas for project 84f878f565614ccd8043f3712c27e8fe. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:18:59.478405 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-2afa6fa1-54e5-4348-b7df-c5e416c1b153 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Getting quotas for user a7d7728c54a0441da5cae942997be179 and project 84f878f565614ccd8043f3712c27e8fe. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:18:59.497193 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2afa6fa1-54e5-4348-b7df-c5e416c1b153 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:18:59.501632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2afa6fa1-54e5-4348-b7df-c5e416c1b153 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:18:59.605485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-95c76360-f62a-4070-89f1-5bfbe286e3ef tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:59.613584 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-95c76360-f62a-4070-89f1-5bfbe286e3ef tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1312 microversion: 2.1 time: 0.536335 May 21 21:18:59.622621 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1132/2296] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:59 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1312 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:18:59.628475 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ef41c59d-fe4b-4851-a4bd-67e817bfece6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:59.629324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ef41c59d-fe4b-4851-a4bd-67e817bfece6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:59.646371 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2afa6fa1-54e5-4348-b7df-c5e416c1b153 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.171318 May 21 21:18:59.647617 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1165/2297] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:18:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 21 21:18:59.648327 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef41c59d-fe4b-4851-a4bd-67e817bfece6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:59.648841 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef41c59d-fe4b-4851-a4bd-67e817bfece6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:59.649610 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef41c59d-fe4b-4851-a4bd-67e817bfece6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:59.650065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef41c59d-fe4b-4851-a4bd-67e817bfece6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:59.653246 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-eeff035d-2441-4f12-afd5-82a424f5f90f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:59.654079 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-eeff035d-2441-4f12-afd5-82a424f5f90f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:18:59.672039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eeff035d-2441-4f12-afd5-82a424f5f90f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:59.672811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eeff035d-2441-4f12-afd5-82a424f5f90f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:59.674756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eeff035d-2441-4f12-afd5-82a424f5f90f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:18:59.675594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eeff035d-2441-4f12-afd5-82a424f5f90f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:18:59.862804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-eeff035d-2441-4f12-afd5-82a424f5f90f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:18:59.876135 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-eeff035d-2441-4f12-afd5-82a424f5f90f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 200 len: 1485 microversion: 2.1 time: 0.224176 May 21 21:18:59.885019 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1166/2298] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:59 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 1485 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:18:59.895836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7c9a2c49-2755-48a0-bd7e-c09ab35482fa tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:18:59.897305 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7c9a2c49-2755-48a0-bd7e-c09ab35482fa tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:00.044176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7c9a2c49-2755-48a0-bd7e-c09ab35482fa tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7728c54a0441da5cae942997be179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f878f565614ccd8043f3712c27e8fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:00.055921 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7c9a2c49-2755-48a0-bd7e-c09ab35482fa tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 200 len: 1215 microversion: 2.1 time: 0.168310 May 21 21:19:00.056814 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1167/2299] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:18:59 2022] GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 1215 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:00.075691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-694e4a69-a9e9-4598-b871-a4edb690671b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:00.086691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-694e4a69-a9e9-4598-b871-a4edb690671b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:00.099389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-694e4a69-a9e9-4598-b871-a4edb690671b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:00.100005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-694e4a69-a9e9-4598-b871-a4edb690671b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:00.105246 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-694e4a69-a9e9-4598-b871-a4edb690671b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:00.106033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-694e4a69-a9e9-4598-b871-a4edb690671b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:00.152474 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-694e4a69-a9e9-4598-b871-a4edb690671b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:19:00.187367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ef41c59d-fe4b-4851-a4bd-67e817bfece6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:00.199604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ef41c59d-fe4b-4851-a4bd-67e817bfece6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:00.203258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ef41c59d-fe4b-4851-a4bd-67e817bfece6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:00.204837 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ef41c59d-fe4b-4851-a4bd-67e817bfece6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.580875 May 21 21:19:00.205986 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1133/2300] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:18:59 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:19:00.624215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-331563f2-34d6-4a0b-b02e-88bcca531244 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Action: 'create', calling method: .version_select at 0x7fc81ad761f0>, body: {"keypair": {"name": "tempest-keypair-251655860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWMVQhvi9jqfDHqjFp76GK0lk7UE5p+n1S92jmHolhZRWDN+VyPsevCAEZ3TgAL7suNfbd1+mrztJTecJqMV3TrwuIX8GxQWzTAZCStWjLLI9rlY9AZlMJJdBqIcy8a1w=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:00.681891 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-694e4a69-a9e9-4598-b871-a4edb690671b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 204 len: 0 microversion: 2.1 time: 0.614440 May 21 21:19:00.681891 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1168/2301] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:19:00 2022] DELETE /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 0 bytes in 616 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:19:00.682603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-331563f2-34d6-4a0b-b02e-88bcca531244 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Getting quotas for project 3f2ac2f445b543c2b9d7322c11cdde91. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:00.687595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-360d0bbf-26ad-4649-a2c5-07160532f30a tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:00.688791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-360d0bbf-26ad-4649-a2c5-07160532f30a tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:00.689351 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-331563f2-34d6-4a0b-b02e-88bcca531244 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Getting quotas for user 9370665c0d4c471ba4b7d19e27964dce and project 3f2ac2f445b543c2b9d7322c11cdde91. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:00.701550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-360d0bbf-26ad-4649-a2c5-07160532f30a tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:00.706192 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-360d0bbf-26ad-4649-a2c5-07160532f30a tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:00.710001 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-360d0bbf-26ad-4649-a2c5-07160532f30a tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:00.710687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-360d0bbf-26ad-4649-a2c5-07160532f30a tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:00.819884 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-331563f2-34d6-4a0b-b02e-88bcca531244 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.387063 May 21 21:19:00.821584 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1134/2302] 10.222.0.49 () {62 vars in 1198 bytes} [Sat May 21 21:19:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 389 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 21 21:19:00.831542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9937ea32-b8f0-45f3-8cfe-dc4e6ad1f600 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:00.832513 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9937ea32-b8f0-45f3-8cfe-dc4e6ad1f600 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:00.845303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9937ea32-b8f0-45f3-8cfe-dc4e6ad1f600 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:00.848192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9937ea32-b8f0-45f3-8cfe-dc4e6ad1f600 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:00.849289 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9937ea32-b8f0-45f3-8cfe-dc4e6ad1f600 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:00.851880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9937ea32-b8f0-45f3-8cfe-dc4e6ad1f600 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:00.963232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-360d0bbf-26ad-4649-a2c5-07160532f30a tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:00.973382 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-360d0bbf-26ad-4649-a2c5-07160532f30a tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1312 microversion: 2.1 time: 0.295332 May 21 21:19:00.974256 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1169/2303] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:00 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1312 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:00.979307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7db91d2b-64f3-4cff-b368-271b5eeec5c4 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Calling method '.version_select at 0x7fc82cfa9430>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:00.988848 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7db91d2b-64f3-4cff-b368-271b5eeec5c4 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs/tempest-keypair-251655860" status: 200 len: 512 microversion: 2.2 time: 0.013091 May 21 21:19:00.989528 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1170/2304] 10.222.0.49 () {60 vars in 1254 bytes} [Sat May 21 21:19:00 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-251655860 => generated 512 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:01.074586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9937ea32-b8f0-45f3-8cfe-dc4e6ad1f600 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:01.079487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dfbbc87e-7fde-4c94-96a3-aec0fccc64db tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] Action: 'create', calling method: .version_select at 0x7fc82cfdad30>, body: {"pool": null} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:01.083295 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9937ea32-b8f0-45f3-8cfe-dc4e6ad1f600 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 200 len: 1491 microversion: 2.1 time: 0.260430 May 21 21:19:01.086772 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1135/2305] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:00 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 1491 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:01.112056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f9be1c3b-9b22-415f-8314-e5e86a6e9af8 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Calling method '.version_select at 0x7fc81ad76f70>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:01.214479 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f9be1c3b-9b22-415f-8314-e5e86a6e9af8 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-251655860" status: 204 len: 0 microversion: 2.2 time: 0.126107 May 21 21:19:01.222873 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1136/2306] 10.222.0.49 () {60 vars in 1257 bytes} [Sat May 21 21:19:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-251655860 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:19:01.229357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6797e403-d1d8-4bcd-b802-4a2ef44433c7 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:01.231446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6797e403-d1d8-4bcd-b802-4a2ef44433c7 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:01.327993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6797e403-d1d8-4bcd-b802-4a2ef44433c7 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7728c54a0441da5cae942997be179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f878f565614ccd8043f3712c27e8fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:01.347677 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6797e403-d1d8-4bcd-b802-4a2ef44433c7 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 200 len: 1215 microversion: 2.1 time: 0.117460 May 21 21:19:01.347677 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1137/2307] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:01 2022] GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 1215 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:01.347677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1e2a815e-c0b6-48e1-8b5a-1dfed44543b5 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:01.348240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1e2a815e-c0b6-48e1-8b5a-1dfed44543b5 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:01.357984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e2a815e-c0b6-48e1-8b5a-1dfed44543b5 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:01.359618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e2a815e-c0b6-48e1-8b5a-1dfed44543b5 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:01.360990 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e2a815e-c0b6-48e1-8b5a-1dfed44543b5 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:01.361933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e2a815e-c0b6-48e1-8b5a-1dfed44543b5 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:01.784056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1e2a815e-c0b6-48e1-8b5a-1dfed44543b5 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:01.799274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1e2a815e-c0b6-48e1-8b5a-1dfed44543b5 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:01.801262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1e2a815e-c0b6-48e1-8b5a-1dfed44543b5 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:01.803118 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1e2a815e-c0b6-48e1-8b5a-1dfed44543b5 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.459420 May 21 21:19:01.804683 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1138/2308] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:19:01 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:19:01.819253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0f4ecc9d-3d0b-4bac-95d1-2ebccd2ce935 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Action: 'create', calling method: .version_select at 0x7fc81ad76ee0>, body: {"keypair": {"name": "tempest-keypair-1138938444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWGHanfWP9LOB2oqUNTJeHRgplGGeLQalKUwyxdslRaV/oFvxrSyHYpakgU+2AgRR05Z9hVLqepZB9HcXVtDSrHMMBvHGmCl3fvvailcaaB8iVtt/MiVmVUzCcx+irHug=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:01.849389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-0f4ecc9d-3d0b-4bac-95d1-2ebccd2ce935 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Getting quotas for project 3f2ac2f445b543c2b9d7322c11cdde91. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:01.857199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-0f4ecc9d-3d0b-4bac-95d1-2ebccd2ce935 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Getting quotas for user 9370665c0d4c471ba4b7d19e27964dce and project 3f2ac2f445b543c2b9d7322c11cdde91. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:01.952324 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0f4ecc9d-3d0b-4bac-95d1-2ebccd2ce935 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.145571 May 21 21:19:01.955394 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1139/2309] 10.222.0.49 () {62 vars in 1198 bytes} [Sat May 21 21:19:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 149 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 21 21:19:01.967793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-515adcba-6206-475a-80f0-798a0810179c tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Calling method '.version_select at 0x7fc81ae3ad30>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:02.054958 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-515adcba-6206-475a-80f0-798a0810179c tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1138938444" status: 204 len: 0 microversion: 2.2 time: 0.092922 May 21 21:19:02.057563 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1140/2310] 10.222.0.49 () {60 vars in 1260 bytes} [Sat May 21 21:19:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1138938444 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:19:02.060555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a17d2667-0ab2-4b65-8a50-b4d9df988fd9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:02.061466 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a17d2667-0ab2-4b65-8a50-b4d9df988fd9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:02.071147 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a17d2667-0ab2-4b65-8a50-b4d9df988fd9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:02.071943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a17d2667-0ab2-4b65-8a50-b4d9df988fd9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:02.072987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a17d2667-0ab2-4b65-8a50-b4d9df988fd9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:02.073668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a17d2667-0ab2-4b65-8a50-b4d9df988fd9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:02.615141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a17d2667-0ab2-4b65-8a50-b4d9df988fd9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:02.623371 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a17d2667-0ab2-4b65-8a50-b4d9df988fd9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1333 microversion: 2.1 time: 0.566490 May 21 21:19:02.636711 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1141/2311] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:02 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1333 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:02.874125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c59f585f-281b-4275-b74a-6f9cabc4b800 tempest-QuotaClassesAdminTestJSON-563413367 tempest-QuotaClassesAdminTestJSON-563413367-project-admin] Calling method '.version_select at 0x7fc81adf6ee0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:02.875074 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:19:02.875074 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:19:02.897799 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c59f585f-281b-4275-b74a-6f9cabc4b800 tempest-QuotaClassesAdminTestJSON-563413367 tempest-QuotaClassesAdminTestJSON-563413367-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.259560 May 21 21:19:02.898669 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1142/2312] 10.222.0.49 () {58 vars in 1184 bytes} [Sat May 21 21:19:02 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:02.910738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ffd82853-5c64-4e93-8966-180606104ebf tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Action: 'create', calling method: .version_select at 0x7fc81ae3a280>, body: {"keypair": {"name": "tempest-keypair-1732605657", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:02.931127 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:02.950735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-ffd82853-5c64-4e93-8966-180606104ebf tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Getting quotas for project 3f2ac2f445b543c2b9d7322c11cdde91. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:02.965701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-ffd82853-5c64-4e93-8966-180606104ebf tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Getting quotas for user 9370665c0d4c471ba4b7d19e27964dce and project 3f2ac2f445b543c2b9d7322c11cdde91. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:03.125247 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ffd82853-5c64-4e93-8966-180606104ebf tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.225383 May 21 21:19:03.125885 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1143/2313] 10.222.0.49 () {62 vars in 1198 bytes} [Sat May 21 21:19:02 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 227 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 21 21:19:03.130677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c67348dc-25cd-415f-9a9f-9a37cd52b34c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:03.131307 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c67348dc-25cd-415f-9a9f-9a37cd52b34c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:03.160398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c67348dc-25cd-415f-9a9f-9a37cd52b34c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:03.163608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c67348dc-25cd-415f-9a9f-9a37cd52b34c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:03.169586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c67348dc-25cd-415f-9a9f-9a37cd52b34c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:03.170017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c67348dc-25cd-415f-9a9f-9a37cd52b34c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:03.988061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c67348dc-25cd-415f-9a9f-9a37cd52b34c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:03.999489 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c67348dc-25cd-415f-9a9f-9a37cd52b34c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 200 len: 1491 microversion: 2.1 time: 0.872447 May 21 21:19:04.000078 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1144/2314] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:03 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 1491 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:04.014101 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4bf9569a-0b89-4d77-b9e9-11a03bf81cbb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:04.015270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4bf9569a-0b89-4d77-b9e9-11a03bf81cbb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:04.022644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bf9569a-0b89-4d77-b9e9-11a03bf81cbb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:04.023342 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bf9569a-0b89-4d77-b9e9-11a03bf81cbb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:04.024357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bf9569a-0b89-4d77-b9e9-11a03bf81cbb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:04.024965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bf9569a-0b89-4d77-b9e9-11a03bf81cbb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:04.166277 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dfbbc87e-7fde-4c94-96a3-aec0fccc64db tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.175405 May 21 21:19:04.167324 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1171/2315] 10.222.0.49 () {60 vars in 1169 bytes} [Sat May 21 21:19:00 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:04.178362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4bba4c73-4076-49df-b952-4ffaf1e938e2 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:04.178996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4bba4c73-4076-49df-b952-4ffaf1e938e2 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:04.186187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4bba4c73-4076-49df-b952-4ffaf1e938e2 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:04.186818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4bba4c73-4076-49df-b952-4ffaf1e938e2 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:04.187781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4bba4c73-4076-49df-b952-4ffaf1e938e2 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:04.188794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4bba4c73-4076-49df-b952-4ffaf1e938e2 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:04.191390 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4bf9569a-0b89-4d77-b9e9-11a03bf81cbb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7728c54a0441da5cae942997be179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f878f565614ccd8043f3712c27e8fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:04.232330 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4bf9569a-0b89-4d77-b9e9-11a03bf81cbb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 200 len: 1273 microversion: 2.1 time: 0.223120 May 21 21:19:04.233978 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1145/2316] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:04 2022] GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 1273 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:04.247949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f5f43c72-5c05-4ecb-8c10-0783c57579f7 tempest-QuotaClassesAdminTestJSON-563413367 tempest-QuotaClassesAdminTestJSON-563413367-project-admin] Action: 'update', calling method: .version_select at 0x7fc81adf6ee0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:04.249906 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:19:04.249906 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:19:04.532432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4bba4c73-4076-49df-b952-4ffaf1e938e2 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:04.543409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4bba4c73-4076-49df-b952-4ffaf1e938e2 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:04.545731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4bba4c73-4076-49df-b952-4ffaf1e938e2 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:04.548026 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4bba4c73-4076-49df-b952-4ffaf1e938e2 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.379633 May 21 21:19:04.549083 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1172/2317] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:19:04 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:19:04.556150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-006c37f0-2039-4ebc-9fff-99434bdec078 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Calling method '.version_select at 0x7fc82d087dc0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:04.662549 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-006c37f0-2039-4ebc-9fff-99434bdec078 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1732605657" status: 204 len: 0 microversion: 2.2 time: 0.112128 May 21 21:19:04.671940 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1173/2318] 10.222.0.49 () {60 vars in 1260 bytes} [Sat May 21 21:19:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1732605657 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:19:04.677403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3a377991-909d-4fdd-8665-e8bcd825f442 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:04.678502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3a377991-909d-4fdd-8665-e8bcd825f442 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:04.685880 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a377991-909d-4fdd-8665-e8bcd825f442 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:04.686351 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a377991-909d-4fdd-8665-e8bcd825f442 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:04.687741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a377991-909d-4fdd-8665-e8bcd825f442 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:04.687741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a377991-909d-4fdd-8665-e8bcd825f442 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:04.867133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3a377991-909d-4fdd-8665-e8bcd825f442 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:04.876380 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3a377991-909d-4fdd-8665-e8bcd825f442 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1333 microversion: 2.1 time: 0.202994 May 21 21:19:04.877287 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1174/2319] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:04 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1333 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:04.882359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a6beab1a-1165-40db-910c-7cd1aaf1b2ea tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] Action: 'create', calling method: .version_select at 0x7fc82d0cc430>, body: {"pool": null} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:05.574134 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f5f43c72-5c05-4ecb-8c10-0783c57579f7 tempest-QuotaClassesAdminTestJSON-563413367 tempest-QuotaClassesAdminTestJSON-563413367-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.331250 May 21 21:19:05.576866 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1146/2320] 10.222.0.49 () {60 vars in 1205 bytes} [Sat May 21 21:19:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:05.590786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-4d233749-3bec-4876-89d7-a8f2486ad09a req-14fae5eb-db48-4674-a1b1-ac411886db42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "374e77c0-3a9e-4a57-8320-0546efbbf7a3", "tag": "58141793-884a-4d34-a6e7-df3411a26412"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:05.607243 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4d233749-3bec-4876-89d7-a8f2486ad09a req-14fae5eb-db48-4674-a1b1-ac411886db42 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:05.612497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4d233749-3bec-4876-89d7-a8f2486ad09a req-14fae5eb-db48-4674-a1b1-ac411886db42 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:05.621136 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-4d233749-3bec-4876-89d7-a8f2486ad09a req-14fae5eb-db48-4674-a1b1-ac411886db42 service nova] Creating event network-changed:58141793-884a-4d34-a6e7-df3411a26412 for instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 on nch2-master-1 May 21 21:19:05.626658 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-4d233749-3bec-4876-89d7-a8f2486ad09a req-14fae5eb-db48-4674-a1b1-ac411886db42 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047060 May 21 21:19:05.627626 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1147/2321] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:05.645384 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b69c099d-25f2-426d-98ce-5136f3cb860e tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Action: 'create', calling method: .version_select at 0x7fc81ad2e700>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1007227344", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELh50B1BdcBVJiPKHJCFPMq8FQ50K1XgV5yFtdlynEyX3esJGEe0FyT+82gaR+wyEV+qzFDjFogaYhXyFF0+0EJhTuUJhAERFMprj69mWBSx/Jz8jnnlUEuIe2HjbUJzA=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:05.667169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-b69c099d-25f2-426d-98ce-5136f3cb860e tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Getting quotas for project 3f2ac2f445b543c2b9d7322c11cdde91. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:05.675503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-b69c099d-25f2-426d-98ce-5136f3cb860e tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Getting quotas for user 9370665c0d4c471ba4b7d19e27964dce and project 3f2ac2f445b543c2b9d7322c11cdde91. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:05.808365 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b69c099d-25f2-426d-98ce-5136f3cb860e tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.179409 May 21 21:19:05.809315 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1148/2322] 10.222.0.49 () {62 vars in 1198 bytes} [Sat May 21 21:19:05 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 21 21:19:05.814727 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a2774b5f-bfee-43aa-a258-f7ff940c7734 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:05.815451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a2774b5f-bfee-43aa-a258-f7ff940c7734 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:05.831351 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2774b5f-bfee-43aa-a258-f7ff940c7734 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:05.831803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2774b5f-bfee-43aa-a258-f7ff940c7734 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:05.832660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2774b5f-bfee-43aa-a258-f7ff940c7734 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:05.833088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2774b5f-bfee-43aa-a258-f7ff940c7734 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:05.893916 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2774b5f-bfee-43aa-a258-f7ff940c7734 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:05.894427 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2774b5f-bfee-43aa-a258-f7ff940c7734 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:05.895106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-a2774b5f-bfee-43aa-a258-f7ff940c7734 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lazy-loading 'fault' on Instance uuid d980d7ff-026f-459d-9e56-1a94f395ae0c {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:19:06.025302 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a2774b5f-bfee-43aa-a258-f7ff940c7734 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:06.039606 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a2774b5f-bfee-43aa-a258-f7ff940c7734 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 200 len: 1304 microversion: 2.1 time: 0.229324 May 21 21:19:06.040960 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1149/2323] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:05 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 1304 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:06.046745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2b078fdc-2bb5-4214-8bba-e59576f6440a tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:06.047780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2b078fdc-2bb5-4214-8bba-e59576f6440a tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:06.062723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b078fdc-2bb5-4214-8bba-e59576f6440a tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:06.062723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b078fdc-2bb5-4214-8bba-e59576f6440a tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:06.062723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b078fdc-2bb5-4214-8bba-e59576f6440a tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:06.062723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b078fdc-2bb5-4214-8bba-e59576f6440a tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:06.708557 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2b078fdc-2bb5-4214-8bba-e59576f6440a tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7728c54a0441da5cae942997be179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f878f565614ccd8043f3712c27e8fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:06.722451 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2b078fdc-2bb5-4214-8bba-e59576f6440a tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 200 len: 1315 microversion: 2.1 time: 0.680063 May 21 21:19:06.733228 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1150/2324] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:06 2022] GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 1315 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:06.739251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3255df8a-0257-4b91-83b4-3671eb3fe1bc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:06.740128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3255df8a-0257-4b91-83b4-3671eb3fe1bc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:06.760483 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3255df8a-0257-4b91-83b4-3671eb3fe1bc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:06.760945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3255df8a-0257-4b91-83b4-3671eb3fe1bc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:06.761755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3255df8a-0257-4b91-83b4-3671eb3fe1bc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:06.762202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3255df8a-0257-4b91-83b4-3671eb3fe1bc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:06.783366 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:07.087534 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a6beab1a-1165-40db-910c-7cd1aaf1b2ea tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.208748 May 21 21:19:07.088142 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1175/2325] 10.222.0.49 () {60 vars in 1169 bytes} [Sat May 21 21:19:04 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:07.093270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-482e120a-5a41-46f3-b149-dc16ca14be76 tempest-QuotaClassesAdminTestJSON-563413367 tempest-QuotaClassesAdminTestJSON-563413367-project-admin] Calling method '.version_select at 0x7fc82d0acee0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:07.095210 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:19:07.095210 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:19:07.114015 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-482e120a-5a41-46f3-b149-dc16ca14be76 tempest-QuotaClassesAdminTestJSON-563413367 tempest-QuotaClassesAdminTestJSON-563413367-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.024744 May 21 21:19:07.119150 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1176/2326] 10.222.0.49 () {58 vars in 1184 bytes} [Sat May 21 21:19:07 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:07.120076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a939d9c4-1143-423d-8180-9f437ae7727c tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Action: 'create', calling method: .version_select at 0x7fc82cfe70d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1095002095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOQAmZTbMsy7Yum2aUcpN4qrvNIJt6uFQxAKK1uMPhu7c5LSdf79CxgyFBSrRQQOdACrvRUoxF0UwVJT7Nlze50pyxAzm6b+fIcGNFa3uWvuUXjNyVQX8by4TxVyr95Hw=="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:07.135215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-a939d9c4-1143-423d-8180-9f437ae7727c tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Getting quotas for project 3f2ac2f445b543c2b9d7322c11cdde91. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:07.141772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-a939d9c4-1143-423d-8180-9f437ae7727c tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Getting quotas for user 9370665c0d4c471ba4b7d19e27964dce and project 3f2ac2f445b543c2b9d7322c11cdde91. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:07.223929 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a939d9c4-1143-423d-8180-9f437ae7727c tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.108089 May 21 21:19:07.224741 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1177/2327] 10.222.0.49 () {62 vars in 1198 bytes} [Sat May 21 21:19:07 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 21 21:19:07.229742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8bbeba34-6996-4d41-9665-603409201c04 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:07.230482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8bbeba34-6996-4d41-9665-603409201c04 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:07.238299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8bbeba34-6996-4d41-9665-603409201c04 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:07.238853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8bbeba34-6996-4d41-9665-603409201c04 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:07.239710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8bbeba34-6996-4d41-9665-603409201c04 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:07.240163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8bbeba34-6996-4d41-9665-603409201c04 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:07.255403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3255df8a-0257-4b91-83b4-3671eb3fe1bc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:07.261395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:07.267280 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3255df8a-0257-4b91-83b4-3671eb3fe1bc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:07.268986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3255df8a-0257-4b91-83b4-3671eb3fe1bc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:07.270430 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3255df8a-0257-4b91-83b4-3671eb3fe1bc tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.535153 May 21 21:19:07.271221 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1151/2328] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:19:06 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:19:07.287833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-37e4b3d2-49f1-4a2c-afae-66eeed4741cc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:07.291786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-37e4b3d2-49f1-4a2c-afae-66eeed4741cc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:07.299306 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-37e4b3d2-49f1-4a2c-afae-66eeed4741cc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:07.299769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-37e4b3d2-49f1-4a2c-afae-66eeed4741cc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:07.300591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-37e4b3d2-49f1-4a2c-afae-66eeed4741cc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:07.301095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-37e4b3d2-49f1-4a2c-afae-66eeed4741cc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:07.316704 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-37e4b3d2-49f1-4a2c-afae-66eeed4741cc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance d980d7ff-026f-459d-9e56-1a94f395ae0c could not be found. May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-37e4b3d2-49f1-4a2c-afae-66eeed4741cc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c HTTP/1.1 May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance d980d7ff-026f-459d-9e56-1a94f395ae0c could not be found. May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'd980d7ff-026f-459d-9e56-1a94f395ae0c'} May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d980d7ff-026f-459d-9e56-1a94f395ae0c could not be found. May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d980d7ff-026f-459d-9e56-1a94f395ae0c could not be found. May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:07.318653 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:07.324174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:07.324174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:07.324174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:07.324174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:19:07.324174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:19:07.324174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d980d7ff-026f-459d-9e56-1a94f395ae0c could not be found. May 21 21:19:07.324174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:07.325568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-37e4b3d2-49f1-4a2c-afae-66eeed4741cc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance d980d7ff-026f-459d-9e56-1a94f395ae0c could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:19:07.326447 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-37e4b3d2-49f1-4a2c-afae-66eeed4741cc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 404 len: 111 microversion: 2.1 time: 0.054011 May 21 21:19:07.327015 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1152/2329] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:07 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:19:07.343158 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d6d3d22f-18b5-4abc-9f6e-760578bf35d1 tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] Action: 'create', calling method: .version_select at 0x7fc81ad52af0>, body: {"pool": null} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:07.403126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8bbeba34-6996-4d41-9665-603409201c04 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:07.412671 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8bbeba34-6996-4d41-9665-603409201c04 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1333 microversion: 2.1 time: 0.186712 May 21 21:19:07.423546 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1178/2330] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:07 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1333 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:07.430315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-52c948c9-de52-449e-ab78-39f2e7f42959 tempest-QuotaClassesAdminTestJSON-563413367 tempest-QuotaClassesAdminTestJSON-563413367-project-admin] Action: 'update', calling method: .version_select at 0x7fc82d087d30>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:07.432553 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:19:07.432553 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:19:07.437259 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:08.634337 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-52c948c9-de52-449e-ab78-39f2e7f42959 tempest-QuotaClassesAdminTestJSON-563413367 tempest-QuotaClassesAdminTestJSON-563413367-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.209306 May 21 21:19:08.635716 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1179/2331] 10.222.0.49 () {60 vars in 1205 bytes} [Sat May 21 21:19:07 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:08.642385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0f2bb6c6-864c-436f-863e-c813a9ecddb1 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Action: 'create', calling method: .version_select at 0x7fc82d0873a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1751147754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLowhwDBVxllNIc93f8rCY/+W+EwCUJmony4yBi1cVhd6VJdCFGE7VqWgjhp4QGweSvCNMgIm7415gOoqiJYARawzMtA9d+SJpQ3+len+JrjjYuWRGT2r9Ah+mfJU3tnoA=="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:08.665554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-0f2bb6c6-864c-436f-863e-c813a9ecddb1 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Getting quotas for project 3f2ac2f445b543c2b9d7322c11cdde91. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:08.673292 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-0f2bb6c6-864c-436f-863e-c813a9ecddb1 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Getting quotas for user 9370665c0d4c471ba4b7d19e27964dce and project 3f2ac2f445b543c2b9d7322c11cdde91. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:08.770708 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0f2bb6c6-864c-436f-863e-c813a9ecddb1 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.131568 May 21 21:19:08.770708 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1180/2332] 10.222.0.49 () {62 vars in 1198 bytes} [Sat May 21 21:19:08 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 133 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 21 21:19:08.775446 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cf653956-dbfa-4714-901b-9739e454db1c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-149585267", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "f95b9f39-db04-49ea-b57f-7951c8f566a9"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:08.851720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-cf653956-dbfa-4714-901b-9739e454db1c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] validate_networks() for [('f95b9f39-db04-49ea-b57f-7951c8f566a9', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:19:09.337885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-cf653956-dbfa-4714-901b-9739e454db1c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:19:09.338337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-cf653956-dbfa-4714-901b-9739e454db1c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:19:09.339971 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-cf653956-dbfa-4714-901b-9739e454db1c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:19:09.344419 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-cf653956-dbfa-4714-901b-9739e454db1c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:19:09.344906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-cf653956-dbfa-4714-901b-9739e454db1c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:19:09.372967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cf653956-dbfa-4714-901b-9739e454db1c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:09.373703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cf653956-dbfa-4714-901b-9739e454db1c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:09.376412 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cf653956-dbfa-4714-901b-9739e454db1c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:09.376888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cf653956-dbfa-4714-901b-9739e454db1c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:09.412011 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-cf653956-dbfa-4714-901b-9739e454db1c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Getting quotas for project 8c48385dc5c24377a7be24da93fc54d9. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:09.419817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-cf653956-dbfa-4714-901b-9739e454db1c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Getting quotas for user c3e23800ab314cc28dc30330928d8454 and project 8c48385dc5c24377a7be24da93fc54d9. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:09.453547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cf653956-dbfa-4714-901b-9739e454db1c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:19:09.456958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cf653956-dbfa-4714-901b-9739e454db1c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:19:09.594111 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cf653956-dbfa-4714-901b-9739e454db1c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.822744 May 21 21:19:09.601038 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1181/2333] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:19:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:19:09.612182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-433c26ba-f48d-4ea3-81f2-796bd9edaf25 req-047430e5-c938-4c47-b6b0-85660cf7a32f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d980d7ff-026f-459d-9e56-1a94f395ae0c", "name": "network-vif-deleted", "tag": "082823dd-94f5-471c-bc0f-58c62e99cd30"}, {"name": "network-changed", "server_uuid": "374e77c0-3a9e-4a57-8320-0546efbbf7a3", "tag": "7b127940-a46f-4616-b38b-4f295f2bde61"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:09.622814 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-433c26ba-f48d-4ea3-81f2-796bd9edaf25 req-047430e5-c938-4c47-b6b0-85660cf7a32f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:09.626656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-433c26ba-f48d-4ea3-81f2-796bd9edaf25 req-047430e5-c938-4c47-b6b0-85660cf7a32f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:09.647137 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-433c26ba-f48d-4ea3-81f2-796bd9edaf25 req-047430e5-c938-4c47-b6b0-85660cf7a32f service nova] Creating event network-vif-deleted:082823dd-94f5-471c-bc0f-58c62e99cd30 for instance d980d7ff-026f-459d-9e56-1a94f395ae0c on nch1-master-1 May 21 21:19:09.649622 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-433c26ba-f48d-4ea3-81f2-796bd9edaf25 req-047430e5-c938-4c47-b6b0-85660cf7a32f service nova] Creating event network-changed:7b127940-a46f-4616-b38b-4f295f2bde61 for instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 on nch2-master-1 May 21 21:19:09.671074 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-433c26ba-f48d-4ea3-81f2-796bd9edaf25 req-047430e5-c938-4c47-b6b0-85660cf7a32f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.068095 May 21 21:19:09.675949 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1182/2334] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:09.681746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2b27d936-65a6-4dbc-bce7-be919b39f5b1 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:09.682552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2b27d936-65a6-4dbc-bce7-be919b39f5b1 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:09.691393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b27d936-65a6-4dbc-bce7-be919b39f5b1 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:09.691833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b27d936-65a6-4dbc-bce7-be919b39f5b1 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:09.692746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b27d936-65a6-4dbc-bce7-be919b39f5b1 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:09.693267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b27d936-65a6-4dbc-bce7-be919b39f5b1 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:09.941351 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2b27d936-65a6-4dbc-bce7-be919b39f5b1 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7728c54a0441da5cae942997be179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f878f565614ccd8043f3712c27e8fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:09.950329 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2b27d936-65a6-4dbc-bce7-be919b39f5b1 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 200 len: 1315 microversion: 2.1 time: 0.272955 May 21 21:19:09.950912 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1183/2335] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:09 2022] GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:09.956159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-894bf32e-dc29-4ebf-b0ee-68587d0615e6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:09.957063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-894bf32e-dc29-4ebf-b0ee-68587d0615e6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:09.964565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-894bf32e-dc29-4ebf-b0ee-68587d0615e6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:09.965292 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-894bf32e-dc29-4ebf-b0ee-68587d0615e6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:09.966154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-894bf32e-dc29-4ebf-b0ee-68587d0615e6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:09.966822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-894bf32e-dc29-4ebf-b0ee-68587d0615e6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:10.233072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-894bf32e-dc29-4ebf-b0ee-68587d0615e6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:10.243908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-894bf32e-dc29-4ebf-b0ee-68587d0615e6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:10.245988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-894bf32e-dc29-4ebf-b0ee-68587d0615e6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:10.247175 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-894bf32e-dc29-4ebf-b0ee-68587d0615e6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.295155 May 21 21:19:10.248067 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1184/2336] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:19:09 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:19:10.255540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ebae5ade-e6f1-4be1-b943-b77870db5b60 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:10.255540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ebae5ade-e6f1-4be1-b943-b77870db5b60 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:10.260530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebae5ade-e6f1-4be1-b943-b77870db5b60 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:10.260987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebae5ade-e6f1-4be1-b943-b77870db5b60 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:10.261768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebae5ade-e6f1-4be1-b943-b77870db5b60 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:10.262395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebae5ade-e6f1-4be1-b943-b77870db5b60 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:10.443191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ebae5ade-e6f1-4be1-b943-b77870db5b60 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:10.457699 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ebae5ade-e6f1-4be1-b943-b77870db5b60 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1333 microversion: 2.1 time: 0.208166 May 21 21:19:10.468926 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1185/2337] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:10 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1333 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:10.468926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4422f063-5795-4b98-8bfa-107ebc64094a tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Calling method '.version_select at 0x7fc82d0ce0d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:10.468926 ncdv-master-1 devstack@n-api.service[131277]: WARNING oslo_db.sqlalchemy.utils [None req-4422f063-5795-4b98-8bfa-107ebc64094a tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Unique keys not in sort_keys. The sorting order may be unstable. May 21 21:19:10.474497 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4422f063-5795-4b98-8bfa-107ebc64094a tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.014676 May 21 21:19:10.480499 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1186/2338] 10.222.0.49 () {60 vars in 1176 bytes} [Sat May 21 21:19:10 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:10.481753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e8e0ddb9-d48d-4822-b63b-a04408fde81d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:10.482391 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e8e0ddb9-d48d-4822-b63b-a04408fde81d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:10.560654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e8e0ddb9-d48d-4822-b63b-a04408fde81d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:10.585288 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e8e0ddb9-d48d-4822-b63b-a04408fde81d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1214 microversion: 2.1 time: 0.107702 May 21 21:19:10.598653 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1187/2339] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:10 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:10.603951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a065d046-efd7-4f45-a58a-45a8e7e72277 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Calling method '.version_select at 0x7fc82d0ced30>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:10.700370 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a065d046-efd7-4f45-a58a-45a8e7e72277 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1751147754" status: 204 len: 0 microversion: 2.2 time: 0.100011 May 21 21:19:10.701144 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1188/2340] 10.222.0.49 () {60 vars in 1320 bytes} [Sat May 21 21:19:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1751147754 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:19:10.709851 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-940f3010-b0e9-4c5d-9fd5-252b2da5c1ad tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Calling method '.version_select at 0x7fc81ac07b80>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:10.778250 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-940f3010-b0e9-4c5d-9fd5-252b2da5c1ad tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1095002095" status: 204 len: 0 microversion: 2.2 time: 0.072441 May 21 21:19:10.779324 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1189/2341] 10.222.0.49 () {60 vars in 1320 bytes} [Sat May 21 21:19:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1095002095 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:19:10.795524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d4a85f50-4d55-405b-87fe-def6993e519b tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Calling method '.version_select at 0x7fc82d0875e0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:10.813584 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d6d3d22f-18b5-4abc-9f6e-760578bf35d1 tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.475710 May 21 21:19:10.823833 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1153/2342] 10.222.0.49 () {60 vars in 1169 bytes} [Sat May 21 21:19:07 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:10.825186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ef2adda5-d2d0-4bf4-8cf2-95c2300a691f tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] Action: 'create', calling method: .version_select at 0x7fc81aded160>, body: {"pool": null} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:10.882393 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d4a85f50-4d55-405b-87fe-def6993e519b tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1007227344" status: 204 len: 0 microversion: 2.2 time: 0.097291 May 21 21:19:10.883226 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1190/2343] 10.222.0.49 () {60 vars in 1320 bytes} [Sat May 21 21:19:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1007227344 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:19:10.895910 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-de49de7d-5de6-4d4c-a589-29147cfa66ac tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Action: 'create', calling method: .version_select at 0x7fc82d0cc820>, body: {"keypair": {"name": "tempest-keypair-1127181466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHhmgnOVDwIKjD6IKO5gG/BXXogxSTXZ4OXzYw/d1FyMhh1GGY6i7BkWPeHCPu0lmCUNoe01j3laiS7+6tp3kqF8G7pFXrHyVlQAyWj0WJ7PsslSp/qmPsU0RkEGY6ArA=="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:10.913879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-de49de7d-5de6-4d4c-a589-29147cfa66ac tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Getting quotas for project 3f2ac2f445b543c2b9d7322c11cdde91. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:10.919304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-de49de7d-5de6-4d4c-a589-29147cfa66ac tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Getting quotas for user 9370665c0d4c471ba4b7d19e27964dce and project 3f2ac2f445b543c2b9d7322c11cdde91. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:11.030430 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-de49de7d-5de6-4d4c-a589-29147cfa66ac tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.138199 May 21 21:19:11.031452 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1191/2344] 10.222.0.49 () {62 vars in 1198 bytes} [Sat May 21 21:19:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 140 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 21 21:19:11.037150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5d4fdcf9-cfe6-4a6f-b525-f1ed8fbbd6b8 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:11.037781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5d4fdcf9-cfe6-4a6f-b525-f1ed8fbbd6b8 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:11.044034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d4fdcf9-cfe6-4a6f-b525-f1ed8fbbd6b8 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:11.044557 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d4fdcf9-cfe6-4a6f-b525-f1ed8fbbd6b8 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:11.045337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d4fdcf9-cfe6-4a6f-b525-f1ed8fbbd6b8 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:11.046493 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d4fdcf9-cfe6-4a6f-b525-f1ed8fbbd6b8 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:11.275444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5d4fdcf9-cfe6-4a6f-b525-f1ed8fbbd6b8 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7728c54a0441da5cae942997be179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f878f565614ccd8043f3712c27e8fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:11.294910 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5d4fdcf9-cfe6-4a6f-b525-f1ed8fbbd6b8 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 200 len: 1315 microversion: 2.1 time: 0.262055 May 21 21:19:11.297276 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1192/2345] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:11 2022] GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:11.302747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-58d9c5ce-f3a5-4a86-8c09-2a4a75cebb6a tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Calling method '.version_select at 0x7fc81ac073a0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:11.314477 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-58d9c5ce-f3a5-4a86-8c09-2a4a75cebb6a tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs/tempest-keypair-1127181466" status: 200 len: 513 microversion: 2.2 time: 0.015427 May 21 21:19:11.316385 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1193/2346] 10.222.0.49 () {60 vars in 1257 bytes} [Sat May 21 21:19:11 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1127181466 => generated 513 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:11.322118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-42819a9e-3593-4245-963d-0e5b998156ef tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:11.324268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-42819a9e-3593-4245-963d-0e5b998156ef tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:11.335327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42819a9e-3593-4245-963d-0e5b998156ef tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:11.335776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42819a9e-3593-4245-963d-0e5b998156ef tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:11.337182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42819a9e-3593-4245-963d-0e5b998156ef tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:11.337891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42819a9e-3593-4245-963d-0e5b998156ef tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:11.599787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-42819a9e-3593-4245-963d-0e5b998156ef tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:11.612046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-42819a9e-3593-4245-963d-0e5b998156ef tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:11.613646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-42819a9e-3593-4245-963d-0e5b998156ef tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:11.615766 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-42819a9e-3593-4245-963d-0e5b998156ef tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.297865 May 21 21:19:11.616385 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1194/2347] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:19:11 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:19:11.627644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bf4caac6-a0d8-428e-b48c-6478dac633b0 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Calling method '.version_select at 0x7fc82d0ceee0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:11.630742 ncdv-master-1 devstack@n-api.service[131277]: WARNING oslo_db.sqlalchemy.utils [None req-bf4caac6-a0d8-428e-b48c-6478dac633b0 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Unique keys not in sort_keys. The sorting order may be unstable. May 21 21:19:11.640089 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bf4caac6-a0d8-428e-b48c-6478dac633b0 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.018135 May 21 21:19:11.641097 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1195/2348] 10.222.0.49 () {60 vars in 1176 bytes} [Sat May 21 21:19:11 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:11.650390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-347fccc1-1119-42e9-bd39-f2f8482e99dd tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:11.650390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-347fccc1-1119-42e9-bd39-f2f8482e99dd tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:11.652191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:UPDATE=12,nova_api:SELECT=80,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:11.656978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-347fccc1-1119-42e9-bd39-f2f8482e99dd tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:11.659537 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-347fccc1-1119-42e9-bd39-f2f8482e99dd tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:11.665816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-347fccc1-1119-42e9-bd39-f2f8482e99dd tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:11.665816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-347fccc1-1119-42e9-bd39-f2f8482e99dd tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:11.873341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-347fccc1-1119-42e9-bd39-f2f8482e99dd tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:11.884820 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-347fccc1-1119-42e9-bd39-f2f8482e99dd tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1333 microversion: 2.1 time: 0.241706 May 21 21:19:11.894616 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1196/2349] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:11 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1333 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:11.894616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f1378f92-5ffb-4f9b-8fb7-57590f23c1f2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:11.894616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f1378f92-5ffb-4f9b-8fb7-57590f23c1f2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:11.900952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1378f92-5ffb-4f9b-8fb7-57590f23c1f2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:11.901697 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1378f92-5ffb-4f9b-8fb7-57590f23c1f2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:11.902505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1378f92-5ffb-4f9b-8fb7-57590f23c1f2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:11.902952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1378f92-5ffb-4f9b-8fb7-57590f23c1f2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:11.987235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f1378f92-5ffb-4f9b-8fb7-57590f23c1f2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:11.997840 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f1378f92-5ffb-4f9b-8fb7-57590f23c1f2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1266 microversion: 2.1 time: 0.111271 May 21 21:19:11.999047 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1197/2350] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:11 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:12.005487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-83888099-0814-4cb5-aa09-f5302ae183a6 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Calling method '.version_select at 0x7fc82d0cc4c0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:12.077324 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-83888099-0814-4cb5-aa09-f5302ae183a6 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1127181466" status: 204 len: 0 microversion: 2.2 time: 0.075723 May 21 21:19:12.083029 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1198/2351] 10.222.0.49 () {60 vars in 1260 bytes} [Sat May 21 21:19:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1127181466 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:19:12.084549 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-9bff0e2a-b516-4d03-92de-39343667cdf4 req-4dd61fdb-6fae-486b-b7e5-5ba718e2964d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff836353-3537-443f-b089-b8b3480308c5", "tag": "0bc52466-5c29-43a9-902b-85fb9eea0ac4"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:12.095520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-9bff0e2a-b516-4d03-92de-39343667cdf4 req-4dd61fdb-6fae-486b-b7e5-5ba718e2964d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:12.105466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-9bff0e2a-b516-4d03-92de-39343667cdf4 req-4dd61fdb-6fae-486b-b7e5-5ba718e2964d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:12.110025 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-9bff0e2a-b516-4d03-92de-39343667cdf4 req-4dd61fdb-6fae-486b-b7e5-5ba718e2964d service nova] Creating event network-changed:0bc52466-5c29-43a9-902b-85fb9eea0ac4 for instance ff836353-3537-443f-b089-b8b3480308c5 on nch2-master-1 May 21 21:19:12.115857 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-9bff0e2a-b516-4d03-92de-39343667cdf4 req-4dd61fdb-6fae-486b-b7e5-5ba718e2964d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036097 May 21 21:19:12.116881 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1199/2352] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:12.122841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a84f8908-95b2-42cb-9d94-51014bb5246e tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Action: 'create', calling method: .version_select at 0x7fc82d0acca0>, body: {"keypair": {"name": "tempest-keypair-1538425878", "type": "x509"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:12.154799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-a84f8908-95b2-42cb-9d94-51014bb5246e tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Getting quotas for project 3f2ac2f445b543c2b9d7322c11cdde91. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:12.162494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-a84f8908-95b2-42cb-9d94-51014bb5246e tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Getting quotas for user 9370665c0d4c471ba4b7d19e27964dce and project 3f2ac2f445b543c2b9d7322c11cdde91. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:12.196689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.processutils [None req-a84f8908-95b2-42cb-9d94-51014bb5246e tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpcspkcase/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpcspkcase/temp.key -subj /CN=9370665c0d4c471ba4b7d19e27964dce -extensions v3_req_client {{(pid=131277) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:19:12.801176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.processutils [None req-a84f8908-95b2-42cb-9d94-51014bb5246e tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpcspkcase/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpcspkcase/temp.key -subj /CN=9370665c0d4c471ba4b7d19e27964dce -extensions v3_req_client" returned: 0 in 0.603s {{(pid=131277) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:19:12.801176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.processutils [None req-a84f8908-95b2-42cb-9d94-51014bb5246e tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpcspkcase/temp.key -password pass: {{(pid=131277) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:19:12.822241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.processutils [None req-a84f8908-95b2-42cb-9d94-51014bb5246e tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpcspkcase/temp.key -password pass:" returned: 0 in 0.026s {{(pid=131277) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:19:12.968381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-a84f8908-95b2-42cb-9d94-51014bb5246e tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Getting quotas for project 3f2ac2f445b543c2b9d7322c11cdde91. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:12.977626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-a84f8908-95b2-42cb-9d94-51014bb5246e tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Getting quotas for user 9370665c0d4c471ba4b7d19e27964dce and project 3f2ac2f445b543c2b9d7322c11cdde91. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:13.019472 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a84f8908-95b2-42cb-9d94-51014bb5246e tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.900899 May 21 21:19:13.026273 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1200/2353] 10.222.0.49 () {62 vars in 1197 bytes} [Sat May 21 21:19:12 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 908 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) May 21 21:19:13.037496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-485d20a9-bcd0-4028-aaeb-8c3927374039 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:13.038775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-485d20a9-bcd0-4028-aaeb-8c3927374039 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:13.050547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-485d20a9-bcd0-4028-aaeb-8c3927374039 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:13.051486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-485d20a9-bcd0-4028-aaeb-8c3927374039 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:13.052077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-485d20a9-bcd0-4028-aaeb-8c3927374039 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:13.052689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-485d20a9-bcd0-4028-aaeb-8c3927374039 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:13.275443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-485d20a9-bcd0-4028-aaeb-8c3927374039 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7728c54a0441da5cae942997be179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f878f565614ccd8043f3712c27e8fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:13.290624 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-485d20a9-bcd0-4028-aaeb-8c3927374039 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 200 len: 1315 microversion: 2.1 time: 0.255762 May 21 21:19:13.290624 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1201/2354] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:13 2022] GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:13.290624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fa17d094-be25-406d-82b1-b4a2a9047c0b tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:13.291039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fa17d094-be25-406d-82b1-b4a2a9047c0b tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:13.299924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fa17d094-be25-406d-82b1-b4a2a9047c0b tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:13.300430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fa17d094-be25-406d-82b1-b4a2a9047c0b tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:13.301224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fa17d094-be25-406d-82b1-b4a2a9047c0b tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:13.301725 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fa17d094-be25-406d-82b1-b4a2a9047c0b tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:13.569289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fa17d094-be25-406d-82b1-b4a2a9047c0b tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:13.583499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fa17d094-be25-406d-82b1-b4a2a9047c0b tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:13.586805 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fa17d094-be25-406d-82b1-b4a2a9047c0b tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:13.588353 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fa17d094-be25-406d-82b1-b4a2a9047c0b tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.301916 May 21 21:19:13.589846 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1202/2355] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:19:13 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:19:13.598064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7ff9b540-ec5d-4761-a1e0-7f0d5a3d5c85 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:13.598895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7ff9b540-ec5d-4761-a1e0-7f0d5a3d5c85 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:13.608946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ff9b540-ec5d-4761-a1e0-7f0d5a3d5c85 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:13.609667 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ff9b540-ec5d-4761-a1e0-7f0d5a3d5c85 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:13.612907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ff9b540-ec5d-4761-a1e0-7f0d5a3d5c85 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:13.613458 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ff9b540-ec5d-4761-a1e0-7f0d5a3d5c85 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:13.855742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7ff9b540-ec5d-4761-a1e0-7f0d5a3d5c85 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:13.866572 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7ff9b540-ec5d-4761-a1e0-7f0d5a3d5c85 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1333 microversion: 2.1 time: 0.275190 May 21 21:19:13.866941 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1203/2356] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:13 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1333 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:13.876849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-19f6a55c-d3dd-4607-af94-52fca120a6b9 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:13.877466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-19f6a55c-d3dd-4607-af94-52fca120a6b9 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:13.885541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19f6a55c-d3dd-4607-af94-52fca120a6b9 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:13.892806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19f6a55c-d3dd-4607-af94-52fca120a6b9 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:13.892806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19f6a55c-d3dd-4607-af94-52fca120a6b9 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:13.892806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19f6a55c-d3dd-4607-af94-52fca120a6b9 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:13.981210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-19f6a55c-d3dd-4607-af94-52fca120a6b9 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:13.990158 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-19f6a55c-d3dd-4607-af94-52fca120a6b9 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1272 microversion: 2.1 time: 0.122178 May 21 21:19:13.990758 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1204/2357] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:13 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1272 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:13.995603 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-458a21e2-a740-4f5c-be4c-b262bf826359 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Calling method '.version_select at 0x7fc82d06aee0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:14.004597 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-458a21e2-a740-4f5c-be4c-b262bf826359 tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs/tempest-keypair-1538425878" status: 200 len: 1534 microversion: 2.2 time: 0.012562 May 21 21:19:14.015451 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1205/2358] 10.222.0.49 () {60 vars in 1257 bytes} [Sat May 21 21:19:13 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1538425878 => generated 1534 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:14.022183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-3593f1af-e341-4732-810f-2781dd8d2bad req-2856fb1e-7e14-4b20-b447-97f15ae2986d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "name": "network-vif-plugged", "status": "completed", "tag": "138f2620-7e88-4702-9a4f-46aec93115ea"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:14.049303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-3593f1af-e341-4732-810f-2781dd8d2bad req-2856fb1e-7e14-4b20-b447-97f15ae2986d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:14.049303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-3593f1af-e341-4732-810f-2781dd8d2bad req-2856fb1e-7e14-4b20-b447-97f15ae2986d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:14.062605 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-3593f1af-e341-4732-810f-2781dd8d2bad req-2856fb1e-7e14-4b20-b447-97f15ae2986d service nova] Creating event network-vif-plugged:138f2620-7e88-4702-9a4f-46aec93115ea for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:19:14.068777 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-3593f1af-e341-4732-810f-2781dd8d2bad req-2856fb1e-7e14-4b20-b447-97f15ae2986d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051952 May 21 21:19:14.069547 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1206/2359] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:14.075283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c695949a-6648-4811-b298-1e3f898ef54f tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Calling method '.version_select at 0x7fc82cfc98b0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:14.078671 ncdv-master-1 devstack@n-api.service[131277]: WARNING oslo_db.sqlalchemy.utils [None req-c695949a-6648-4811-b298-1e3f898ef54f tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Unique keys not in sort_keys. The sorting order may be unstable. May 21 21:19:14.084527 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c695949a-6648-4811-b298-1e3f898ef54f tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.013424 May 21 21:19:14.088540 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1207/2360] 10.222.0.49 () {60 vars in 1176 bytes} [Sat May 21 21:19:14 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:14.095595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-90f3aaf2-0dbb-42d4-8d03-f1ac5d71072e tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] Calling method '.version_select at 0x7fc82d0ce430>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:14.188526 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-90f3aaf2-0dbb-42d4-8d03-f1ac5d71072e tempest-KeyPairsV22TestJSON-334110366 tempest-KeyPairsV22TestJSON-334110366-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538425878" status: 204 len: 0 microversion: 2.2 time: 0.097493 May 21 21:19:14.189573 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1208/2361] 10.222.0.49 () {60 vars in 1260 bytes} [Sat May 21 21:19:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538425878 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 21:19:14.305603 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9f2239c0-42f9-40bf-9298-2310ef923985 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:14.307962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9f2239c0-42f9-40bf-9298-2310ef923985 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:14.322507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f2239c0-42f9-40bf-9298-2310ef923985 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:14.323408 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f2239c0-42f9-40bf-9298-2310ef923985 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:14.326169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f2239c0-42f9-40bf-9298-2310ef923985 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:14.327794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f2239c0-42f9-40bf-9298-2310ef923985 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:14.625079 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9f2239c0-42f9-40bf-9298-2310ef923985 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7728c54a0441da5cae942997be179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f878f565614ccd8043f3712c27e8fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:14.636622 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9f2239c0-42f9-40bf-9298-2310ef923985 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 200 len: 1315 microversion: 2.1 time: 0.338196 May 21 21:19:14.646524 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1209/2362] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:14 2022] GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:19:14.649520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-842ab6a3-044f-45bd-a304-d66ed51f05b5 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:14.650156 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-842ab6a3-044f-45bd-a304-d66ed51f05b5 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:14.658622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-842ab6a3-044f-45bd-a304-d66ed51f05b5 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:14.659086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-842ab6a3-044f-45bd-a304-d66ed51f05b5 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:14.659898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-842ab6a3-044f-45bd-a304-d66ed51f05b5 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:14.661775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-842ab6a3-044f-45bd-a304-d66ed51f05b5 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:14.851981 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ef2adda5-d2d0-4bf4-8cf2-95c2300a691f tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.030402 May 21 21:19:14.859315 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1154/2363] 10.222.0.49 () {60 vars in 1169 bytes} [Sat May 21 21:19:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:14.864367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6e17d493-a5fa-4379-8158-209f5df47d6a tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] Calling method '.version_select at 0x7fc81ad330d0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:14.925634 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-842ab6a3-044f-45bd-a304-d66ed51f05b5 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:14.938638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-842ab6a3-044f-45bd-a304-d66ed51f05b5 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:14.940182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-842ab6a3-044f-45bd-a304-d66ed51f05b5 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:14.941464 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-842ab6a3-044f-45bd-a304-d66ed51f05b5 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.300303 May 21 21:19:14.942037 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1210/2364] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:19:14 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:19:14.956922 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-407ea70d-2087-4948-b45f-66fe30d64d76 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:14.957730 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-407ea70d-2087-4948-b45f-66fe30d64d76 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:14.964204 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-407ea70d-2087-4948-b45f-66fe30d64d76 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:14.964967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-407ea70d-2087-4948-b45f-66fe30d64d76 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:14.966005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-407ea70d-2087-4948-b45f-66fe30d64d76 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:14.966443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-407ea70d-2087-4948-b45f-66fe30d64d76 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:15.179165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-407ea70d-2087-4948-b45f-66fe30d64d76 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:15.202754 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-407ea70d-2087-4948-b45f-66fe30d64d76 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1333 microversion: 2.1 time: 0.252480 May 21 21:19:15.204782 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1211/2365] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:14 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1333 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:15.213521 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dd9a85b7-894b-4357-819a-cc517fa4fe2b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:15.214490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dd9a85b7-894b-4357-819a-cc517fa4fe2b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:15.226332 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd9a85b7-894b-4357-819a-cc517fa4fe2b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:15.231247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd9a85b7-894b-4357-819a-cc517fa4fe2b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:15.231247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd9a85b7-894b-4357-819a-cc517fa4fe2b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:15.231247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd9a85b7-894b-4357-819a-cc517fa4fe2b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:15.287357 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6e17d493-a5fa-4379-8158-209f5df47d6a tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips/e8bf247e-bcf5-4aa8-a134-3290f6e5b30a" status: 200 len: 142 microversion: 2.1 time: 0.426778 May 21 21:19:15.294176 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1155/2366] 10.222.0.49 () {58 vars in 1259 bytes} [Sat May 21 21:19:14 2022] GET /compute/v2.1/os-floating-ips/e8bf247e-bcf5-4aa8-a134-3290f6e5b30a => generated 142 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:15.299673 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d556cc36-30ee-42a0-b327-59b4ebe451dd tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] Calling method '.version_select at 0x7fc81ad2ec10>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:15.527426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-dd9a85b7-894b-4357-819a-cc517fa4fe2b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:15.537093 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:15.548842 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dd9a85b7-894b-4357-819a-cc517fa4fe2b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1314 microversion: 2.1 time: 0.341838 May 21 21:19:15.550498 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1212/2367] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:15 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:15.699698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=45,nova_cell0:UPDATE=7 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:15.721853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-49da5b9c-c79e-4bdd-af48-ce65792b1767 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-262745596", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:15.782777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-49da5b9c-c79e-4bdd-af48-ce65792b1767 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] validate_networks() for None {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:19:16.122007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-49da5b9c-c79e-4bdd-af48-ce65792b1767 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:19:16.122625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-49da5b9c-c79e-4bdd-af48-ce65792b1767 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:19:16.123431 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-49da5b9c-c79e-4bdd-af48-ce65792b1767 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:19:16.124923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-49da5b9c-c79e-4bdd-af48-ce65792b1767 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:19:16.125808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-49da5b9c-c79e-4bdd-af48-ce65792b1767 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:19:16.137073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=47 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:16.142610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49da5b9c-c79e-4bdd-af48-ce65792b1767 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:16.143173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49da5b9c-c79e-4bdd-af48-ce65792b1767 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:16.144077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49da5b9c-c79e-4bdd-af48-ce65792b1767 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:16.144839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49da5b9c-c79e-4bdd-af48-ce65792b1767 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:16.154182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=9 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:16.193539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-49da5b9c-c79e-4bdd-af48-ce65792b1767 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Getting quotas for project 0c0ac2ac25374777ba3c25d31ea96dc5. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:16.210178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-49da5b9c-c79e-4bdd-af48-ce65792b1767 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Getting quotas for user b54cc2165959478ba95981c81864118a and project 0c0ac2ac25374777ba3c25d31ea96dc5. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:16.226553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-49da5b9c-c79e-4bdd-af48-ce65792b1767 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:19:16.229727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-49da5b9c-c79e-4bdd-af48-ce65792b1767 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:19:16.501272 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-49da5b9c-c79e-4bdd-af48-ce65792b1767 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949357 May 21 21:19:16.513696 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1213/2368] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:19:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:19:16.520473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-07c3370d-aa59-45c9-ba5b-10f4fd2d166e tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:16.521613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-07c3370d-aa59-45c9-ba5b-10f4fd2d166e tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:16.529328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07c3370d-aa59-45c9-ba5b-10f4fd2d166e tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:16.530959 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07c3370d-aa59-45c9-ba5b-10f4fd2d166e tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:16.532317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07c3370d-aa59-45c9-ba5b-10f4fd2d166e tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:16.533900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07c3370d-aa59-45c9-ba5b-10f4fd2d166e tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:16.793238 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-07c3370d-aa59-45c9-ba5b-10f4fd2d166e tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7728c54a0441da5cae942997be179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f878f565614ccd8043f3712c27e8fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:16.803336 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-07c3370d-aa59-45c9-ba5b-10f4fd2d166e tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 200 len: 1315 microversion: 2.1 time: 0.287577 May 21 21:19:16.814458 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1214/2369] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:16 2022] GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:16.821111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a9547507-fd8b-4248-8431-959753da716a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:16.821952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a9547507-fd8b-4248-8431-959753da716a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:16.829569 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9547507-fd8b-4248-8431-959753da716a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:16.830023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9547507-fd8b-4248-8431-959753da716a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:16.830856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9547507-fd8b-4248-8431-959753da716a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:16.831552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9547507-fd8b-4248-8431-959753da716a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:16.964623 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d556cc36-30ee-42a0-b327-59b4ebe451dd tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/e8bf247e-bcf5-4aa8-a134-3290f6e5b30a" status: 202 len: 0 microversion: 2.1 time: 1.669257 May 21 21:19:16.965589 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1156/2370] 10.222.0.49 () {58 vars in 1262 bytes} [Sat May 21 21:19:15 2022] DELETE /compute/v2.1/os-floating-ips/e8bf247e-bcf5-4aa8-a134-3290f6e5b30a => generated 0 bytes in 1671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:19:16.972245 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-e9c74509-3564-4cc9-888e-35b605940af5 req-b0c53140-e668-4660-ac75-b89c3a1159a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "name": "network-vif-plugged", "status": "completed", "tag": "3d35e5b8-e654-4f4c-91c1-813a3bf3bedf"}, {"server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "name": "network-vif-plugged", "status": "completed", "tag": "47e2d024-64c4-4e87-9d61-1a91c3bdd681"}, {"server_uuid": "374e77c0-3a9e-4a57-8320-0546efbbf7a3", "name": "network-vif-plugged", "status": "completed", "tag": "58141793-884a-4d34-a6e7-df3411a26412"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:16.996406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e9c74509-3564-4cc9-888e-35b605940af5 req-b0c53140-e668-4660-ac75-b89c3a1159a7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:16.997253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e9c74509-3564-4cc9-888e-35b605940af5 req-b0c53140-e668-4660-ac75-b89c3a1159a7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:17.035966 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-e9c74509-3564-4cc9-888e-35b605940af5 req-b0c53140-e668-4660-ac75-b89c3a1159a7 service nova] Creating event network-vif-plugged:3d35e5b8-e654-4f4c-91c1-813a3bf3bedf for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:19:17.037086 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-e9c74509-3564-4cc9-888e-35b605940af5 req-b0c53140-e668-4660-ac75-b89c3a1159a7 service nova] Creating event network-vif-plugged:47e2d024-64c4-4e87-9d61-1a91c3bdd681 for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:19:17.038235 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-e9c74509-3564-4cc9-888e-35b605940af5 req-b0c53140-e668-4660-ac75-b89c3a1159a7 service nova] Creating event network-vif-plugged:58141793-884a-4d34-a6e7-df3411a26412 for instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 on nch2-master-1 May 21 21:19:17.053997 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-e9c74509-3564-4cc9-888e-35b605940af5 req-b0c53140-e668-4660-ac75-b89c3a1159a7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.087036 May 21 21:19:17.054783 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1157/2371] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:17.061829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2818519d-a0e9-44de-a0a1-1dc77af22b1b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:17.062628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2818519d-a0e9-44de-a0a1-1dc77af22b1b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:17.069671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2818519d-a0e9-44de-a0a1-1dc77af22b1b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:17.070218 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2818519d-a0e9-44de-a0a1-1dc77af22b1b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:17.071112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2818519d-a0e9-44de-a0a1-1dc77af22b1b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:17.071698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2818519d-a0e9-44de-a0a1-1dc77af22b1b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:17.189810 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a9547507-fd8b-4248-8431-959753da716a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:17.205952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a9547507-fd8b-4248-8431-959753da716a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:17.208771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a9547507-fd8b-4248-8431-959753da716a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:17.213676 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a9547507-fd8b-4248-8431-959753da716a tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.397369 May 21 21:19:17.215201 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1215/2372] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:19:16 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:19:17.239413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9d964ec3-732c-4021-bd0a-eeb7959469ce tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:17.240240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9d964ec3-732c-4021-bd0a-eeb7959469ce tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:17.250387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d964ec3-732c-4021-bd0a-eeb7959469ce tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:17.251570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d964ec3-732c-4021-bd0a-eeb7959469ce tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:17.253796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d964ec3-732c-4021-bd0a-eeb7959469ce tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:17.254555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d964ec3-732c-4021-bd0a-eeb7959469ce tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:17.408512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2818519d-a0e9-44de-a0a1-1dc77af22b1b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:17.419412 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2818519d-a0e9-44de-a0a1-1dc77af22b1b tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1333 microversion: 2.1 time: 0.363181 May 21 21:19:17.420970 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1158/2373] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:17 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1333 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:17.428873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-792f7b59-71d1-49c1-931d-35135dee8d33 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-852233429", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:17.460778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9d964ec3-732c-4021-bd0a-eeb7959469ce tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:17.474511 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9d964ec3-732c-4021-bd0a-eeb7959469ce tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1314 microversion: 2.1 time: 0.243281 May 21 21:19:17.477886 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1216/2374] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:17 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:17.495213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-79d7e930-12d0-463a-b8d5-a273c942ec47 req-7c6e89a2-1b3d-4964-a5b3-1da014756bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c07e27-b31b-4712-9bb2-19a2eca3b35b", "tag": "b3fdc189-fac8-4e7f-96a7-d1881a26a02b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:17.495393 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-792f7b59-71d1-49c1-931d-35135dee8d33 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] validate_networks() for None {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:19:17.505174 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-79d7e930-12d0-463a-b8d5-a273c942ec47 req-7c6e89a2-1b3d-4964-a5b3-1da014756bd0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:17.505986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-79d7e930-12d0-463a-b8d5-a273c942ec47 req-7c6e89a2-1b3d-4964-a5b3-1da014756bd0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:17.519330 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-79d7e930-12d0-463a-b8d5-a273c942ec47 req-7c6e89a2-1b3d-4964-a5b3-1da014756bd0 service nova] Creating event network-changed:b3fdc189-fac8-4e7f-96a7-d1881a26a02b for instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b on nch1-master-1 May 21 21:19:17.524685 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-79d7e930-12d0-463a-b8d5-a273c942ec47 req-7c6e89a2-1b3d-4964-a5b3-1da014756bd0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045210 May 21 21:19:17.525627 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1217/2375] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:17.531229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5e759194-d8f0-4246-9aa3-40ed03ad5a2a tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] Calling method '.version_select at 0x7fc82d0ac3a0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:17.808905 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5e759194-d8f0-4246-9aa3-40ed03ad5a2a tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.281770 May 21 21:19:17.809636 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1218/2376] 10.222.0.49 () {58 vars in 1163 bytes} [Sat May 21 21:19:17 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:19:17.864117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-792f7b59-71d1-49c1-931d-35135dee8d33 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:19:17.864691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-792f7b59-71d1-49c1-931d-35135dee8d33 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:19:17.865179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-792f7b59-71d1-49c1-931d-35135dee8d33 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:19:17.865872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-792f7b59-71d1-49c1-931d-35135dee8d33 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:19:17.866303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-792f7b59-71d1-49c1-931d-35135dee8d33 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:19:17.876842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-792f7b59-71d1-49c1-931d-35135dee8d33 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:17.877450 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-792f7b59-71d1-49c1-931d-35135dee8d33 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:17.878277 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-792f7b59-71d1-49c1-931d-35135dee8d33 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:17.878717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-792f7b59-71d1-49c1-931d-35135dee8d33 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:17.907177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-792f7b59-71d1-49c1-931d-35135dee8d33 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Getting quotas for project 0c0ac2ac25374777ba3c25d31ea96dc5. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:17.908786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-792f7b59-71d1-49c1-931d-35135dee8d33 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Getting quotas for user b54cc2165959478ba95981c81864118a and project 0c0ac2ac25374777ba3c25d31ea96dc5. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:17.919325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=9,nova_api:UPDATE=12 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:17.924056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-792f7b59-71d1-49c1-931d-35135dee8d33 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:19:17.926395 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-792f7b59-71d1-49c1-931d-35135dee8d33 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:19:17.966750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-90ab3a59-52d6-4718-94d1-13ae9875dd94 tempest-AbsoluteLimitsTestJSON-1119199606 tempest-AbsoluteLimitsTestJSON-1119199606-project] Calling method '.version_select at 0x7fc82d115ee0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:17.977321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90ab3a59-52d6-4718-94d1-13ae9875dd94 tempest-AbsoluteLimitsTestJSON-1119199606 tempest-AbsoluteLimitsTestJSON-1119199606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:17.977779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90ab3a59-52d6-4718-94d1-13ae9875dd94 tempest-AbsoluteLimitsTestJSON-1119199606 tempest-AbsoluteLimitsTestJSON-1119199606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:17.978597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90ab3a59-52d6-4718-94d1-13ae9875dd94 tempest-AbsoluteLimitsTestJSON-1119199606 tempest-AbsoluteLimitsTestJSON-1119199606-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:17.979058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90ab3a59-52d6-4718-94d1-13ae9875dd94 tempest-AbsoluteLimitsTestJSON-1119199606 tempest-AbsoluteLimitsTestJSON-1119199606-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:18.000620 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-90ab3a59-52d6-4718-94d1-13ae9875dd94 tempest-AbsoluteLimitsTestJSON-1119199606 tempest-AbsoluteLimitsTestJSON-1119199606-project] 10.222.0.49 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.189826 May 21 21:19:18.001211 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1219/2377] 10.222.0.49 () {58 vars in 1121 bytes} [Sat May 21 21:19:17 2022] GET /compute/v2.1/limits => generated 511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:18.005712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fe3596ad-910d-445f-a5b3-1d21257c04f8 tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] Calling method '.version_select at 0x7fc82d115160>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:18.059966 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-792f7b59-71d1-49c1-931d-35135dee8d33 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637289 May 21 21:19:18.062239 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1159/2378] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:19:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:19:18.067789 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7bfd681f-b09b-462f-b723-268d924becd7 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:18.069203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7bfd681f-b09b-462f-b723-268d924becd7 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:18.075281 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7bfd681f-b09b-462f-b723-268d924becd7 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:18.076007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7bfd681f-b09b-462f-b723-268d924becd7 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:18.077135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7bfd681f-b09b-462f-b723-268d924becd7 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:18.077958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7bfd681f-b09b-462f-b723-268d924becd7 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:18.268082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7bfd681f-b09b-462f-b723-268d924becd7 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7728c54a0441da5cae942997be179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f878f565614ccd8043f3712c27e8fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:18.593245 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7bfd681f-b09b-462f-b723-268d924becd7 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 200 len: 1315 microversion: 2.1 time: 0.212792 May 21 21:19:18.593245 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1160/2379] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:18 2022] GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:18.596116 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fe3596ad-910d-445f-a5b3-1d21257c04f8 tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.288672 May 21 21:19:18.596116 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1220/2380] 10.222.0.49 () {58 vars in 1148 bytes} [Sat May 21 21:19:18 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:18.598631 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2ff614d7-49df-49e7-a690-42f46b91ed3f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:18.598631 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2ff614d7-49df-49e7-a690-42f46b91ed3f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:18.601664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5bc6c872-c722-4840-ac96-ef5f1ddf484c tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:18.601664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5bc6c872-c722-4840-ac96-ef5f1ddf484c tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:18.601664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5bc6c872-c722-4840-ac96-ef5f1ddf484c tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:18.601664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5bc6c872-c722-4840-ac96-ef5f1ddf484c tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:18.601664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5bc6c872-c722-4840-ac96-ef5f1ddf484c tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:18.601664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5bc6c872-c722-4840-ac96-ef5f1ddf484c tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:18.602202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2ff614d7-49df-49e7-a690-42f46b91ed3f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:18.602202 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2ff614d7-49df-49e7-a690-42f46b91ed3f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea" status: 200 len: 1213 microversion: 2.1 time: 0.074064 May 21 21:19:18.602202 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1161/2381] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:18 2022] GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:18.602202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c5870d1a-bea9-4635-a827-ffa44b2eaa3f tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] Calling method '.version_select at 0x7fc81aded0d0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:18.935206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5bc6c872-c722-4840-ac96-ef5f1ddf484c tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:18.945488 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5bc6c872-c722-4840-ac96-ef5f1ddf484c tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:18.952115 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5bc6c872-c722-4840-ac96-ef5f1ddf484c tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:18.964133 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5bc6c872-c722-4840-ac96-ef5f1ddf484c tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.671286 May 21 21:19:18.964941 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1221/2382] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:19:18 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:19:18.970605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4a72ee60-f619-4651-980c-3530c0e0a859 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:18.971351 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4a72ee60-f619-4651-980c-3530c0e0a859 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:18.985795 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a72ee60-f619-4651-980c-3530c0e0a859 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:18.987254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a72ee60-f619-4651-980c-3530c0e0a859 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:18.989058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a72ee60-f619-4651-980c-3530c0e0a859 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:18.990830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a72ee60-f619-4651-980c-3530c0e0a859 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:19.160115 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4a72ee60-f619-4651-980c-3530c0e0a859 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:19.181726 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4a72ee60-f619-4651-980c-3530c0e0a859 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1333 microversion: 2.1 time: 0.215355 May 21 21:19:19.182574 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1222/2383] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:18 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1333 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:19.191445 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9f54901d-f713-4dde-ba81-0247c1ca81a6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:19.193223 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9f54901d-f713-4dde-ba81-0247c1ca81a6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:19.206581 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f54901d-f713-4dde-ba81-0247c1ca81a6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:19.206581 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f54901d-f713-4dde-ba81-0247c1ca81a6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:19.206581 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f54901d-f713-4dde-ba81-0247c1ca81a6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:19.206581 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f54901d-f713-4dde-ba81-0247c1ca81a6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:19.480556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9f54901d-f713-4dde-ba81-0247c1ca81a6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:19.491738 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9f54901d-f713-4dde-ba81-0247c1ca81a6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1314 microversion: 2.1 time: 0.307834 May 21 21:19:19.492400 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1223/2384] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:19 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:19.501246 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-c7060b33-7c09-4f72-8a2b-38730bdf48f1 req-702c0271-9f16-4059-8e76-92561a330f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "name": "network-vif-plugged", "status": "completed", "tag": "48dd9dc9-3303-40c5-903b-4f36c5908e91"}, {"server_uuid": "374e77c0-3a9e-4a57-8320-0546efbbf7a3", "name": "network-vif-plugged", "status": "completed", "tag": "7b127940-a46f-4616-b38b-4f295f2bde61"}, {"server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "name": "network-vif-plugged", "status": "completed", "tag": "e9977234-a2ec-4c9f-a0fe-3e3caa959f0c"}, {"server_uuid": "ff836353-3537-443f-b089-b8b3480308c5", "name": "network-vif-plugged", "status": "completed", "tag": "0bc52466-5c29-43a9-902b-85fb9eea0ac4"}, {"server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "name": "network-vif-plugged", "status": "completed", "tag": "62b0f605-35ad-4b1a-80f3-ed4bb5d39355"}, {"server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "name": "network-vif-plugged", "status": "completed", "tag": "372fb508-d9ed-4893-bad7-003dffcb0ca7"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:19.514607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c7060b33-7c09-4f72-8a2b-38730bdf48f1 req-702c0271-9f16-4059-8e76-92561a330f8b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:19.515341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c7060b33-7c09-4f72-8a2b-38730bdf48f1 req-702c0271-9f16-4059-8e76-92561a330f8b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:19.542080 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-c7060b33-7c09-4f72-8a2b-38730bdf48f1 req-702c0271-9f16-4059-8e76-92561a330f8b service nova] Creating event network-vif-plugged:48dd9dc9-3303-40c5-903b-4f36c5908e91 for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:19:19.542859 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-c7060b33-7c09-4f72-8a2b-38730bdf48f1 req-702c0271-9f16-4059-8e76-92561a330f8b service nova] Creating event network-vif-plugged:7b127940-a46f-4616-b38b-4f295f2bde61 for instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 on nch2-master-1 May 21 21:19:19.543623 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-c7060b33-7c09-4f72-8a2b-38730bdf48f1 req-702c0271-9f16-4059-8e76-92561a330f8b service nova] Creating event network-vif-plugged:e9977234-a2ec-4c9f-a0fe-3e3caa959f0c for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:19:19.544445 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-c7060b33-7c09-4f72-8a2b-38730bdf48f1 req-702c0271-9f16-4059-8e76-92561a330f8b service nova] Creating event network-vif-plugged:0bc52466-5c29-43a9-902b-85fb9eea0ac4 for instance ff836353-3537-443f-b089-b8b3480308c5 on nch2-master-1 May 21 21:19:19.545364 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-c7060b33-7c09-4f72-8a2b-38730bdf48f1 req-702c0271-9f16-4059-8e76-92561a330f8b service nova] Creating event network-vif-plugged:62b0f605-35ad-4b1a-80f3-ed4bb5d39355 for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:19:19.547999 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-c7060b33-7c09-4f72-8a2b-38730bdf48f1 req-702c0271-9f16-4059-8e76-92561a330f8b service nova] Creating event network-vif-plugged:372fb508-d9ed-4893-bad7-003dffcb0ca7 for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:19:19.561974 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-c7060b33-7c09-4f72-8a2b-38730bdf48f1 req-702c0271-9f16-4059-8e76-92561a330f8b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.067722 May 21 21:19:19.562696 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1224/2385] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:19.568007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-71271dab-ae2f-4911-84f4-29af4dd8f48d tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:19.568914 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-71271dab-ae2f-4911-84f4-29af4dd8f48d tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:19.575985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-71271dab-ae2f-4911-84f4-29af4dd8f48d tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:19.576995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-71271dab-ae2f-4911-84f4-29af4dd8f48d tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:19.577962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-71271dab-ae2f-4911-84f4-29af4dd8f48d tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:19.578519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-71271dab-ae2f-4911-84f4-29af4dd8f48d tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:19.849596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-71271dab-ae2f-4911-84f4-29af4dd8f48d tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7728c54a0441da5cae942997be179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f878f565614ccd8043f3712c27e8fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:19.859174 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-71271dab-ae2f-4911-84f4-29af4dd8f48d tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 200 len: 1315 microversion: 2.1 time: 0.295132 May 21 21:19:19.860105 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1225/2386] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:19 2022] GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:19.865484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e44f7a14-d223-48d1-9b79-726767593e9e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:19.866281 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e44f7a14-d223-48d1-9b79-726767593e9e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:19.872429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e44f7a14-d223-48d1-9b79-726767593e9e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:19.873023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e44f7a14-d223-48d1-9b79-726767593e9e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:19.874748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e44f7a14-d223-48d1-9b79-726767593e9e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:19.875327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e44f7a14-d223-48d1-9b79-726767593e9e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:19.973359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e44f7a14-d223-48d1-9b79-726767593e9e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:19.989037 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e44f7a14-d223-48d1-9b79-726767593e9e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea" status: 200 len: 1209 microversion: 2.1 time: 0.127532 May 21 21:19:19.990087 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1226/2387] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:19 2022] GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea => generated 1209 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:19.995535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a490fe44-898c-41f2-be08-f31f4d5eda12 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:19.996677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a490fe44-898c-41f2-be08-f31f4d5eda12 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:20.001285 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:20.006240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a490fe44-898c-41f2-be08-f31f4d5eda12 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:20.007020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a490fe44-898c-41f2-be08-f31f4d5eda12 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:20.009443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a490fe44-898c-41f2-be08-f31f4d5eda12 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:20.009443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a490fe44-898c-41f2-be08-f31f4d5eda12 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:20.053714 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c5870d1a-bea9-4635-a827-ffa44b2eaa3f tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/6ec774d5-1e88-416f-a99a-e097489d9811" status: 202 len: 0 microversion: 2.1 time: 1.687907 May 21 21:19:20.056619 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1162/2388] 10.222.0.49 () {58 vars in 1262 bytes} [Sat May 21 21:19:18 2022] DELETE /compute/v2.1/os-floating-ips/6ec774d5-1e88-416f-a99a-e097489d9811 => generated 0 bytes in 1693 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:19:20.062956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0e5a6dfc-8ba9-4eaf-a0a9-2318f15f22d1 tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] Calling method '.version_select at 0x7fc81ad36d30>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:20.278550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a490fe44-898c-41f2-be08-f31f4d5eda12 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:20.297855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a490fe44-898c-41f2-be08-f31f4d5eda12 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:20.299524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a490fe44-898c-41f2-be08-f31f4d5eda12 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:20.300931 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a490fe44-898c-41f2-be08-f31f4d5eda12 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.309379 May 21 21:19:20.301506 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1227/2389] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:19:19 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:19:20.306718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9721a853-8ae9-4e56-bd7e-88f2f4ee461d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:20.307533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9721a853-8ae9-4e56-bd7e-88f2f4ee461d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:20.316055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9721a853-8ae9-4e56-bd7e-88f2f4ee461d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:20.316561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9721a853-8ae9-4e56-bd7e-88f2f4ee461d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:20.317616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9721a853-8ae9-4e56-bd7e-88f2f4ee461d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:20.318055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9721a853-8ae9-4e56-bd7e-88f2f4ee461d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:20.594911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9721a853-8ae9-4e56-bd7e-88f2f4ee461d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:20.604621 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9721a853-8ae9-4e56-bd7e-88f2f4ee461d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1333 microversion: 2.1 time: 0.301829 May 21 21:19:20.605212 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1228/2390] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:20 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1333 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:20.617066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8c63f0c4-9bad-4cf6-8e62-118feb292787 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:20.619035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8c63f0c4-9bad-4cf6-8e62-118feb292787 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:20.626004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c63f0c4-9bad-4cf6-8e62-118feb292787 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:20.626685 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c63f0c4-9bad-4cf6-8e62-118feb292787 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:20.627869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c63f0c4-9bad-4cf6-8e62-118feb292787 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:20.628597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c63f0c4-9bad-4cf6-8e62-118feb292787 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:20.799018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8c63f0c4-9bad-4cf6-8e62-118feb292787 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:20.807436 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8c63f0c4-9bad-4cf6-8e62-118feb292787 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1314 microversion: 2.1 time: 0.200955 May 21 21:19:20.808023 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1229/2391] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:20 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:20.880157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1a154b37-5fc2-4534-848c-6a53211ecbeb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:20.881550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1a154b37-5fc2-4534-848c-6a53211ecbeb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:20.889769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a154b37-5fc2-4534-848c-6a53211ecbeb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:20.891152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a154b37-5fc2-4534-848c-6a53211ecbeb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:20.892096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a154b37-5fc2-4534-848c-6a53211ecbeb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:20.892759 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a154b37-5fc2-4534-848c-6a53211ecbeb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:21.109202 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0e5a6dfc-8ba9-4eaf-a0a9-2318f15f22d1 tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/5c044543-5bad-4801-ba68-b6c3a221f045" status: 202 len: 0 microversion: 2.1 time: 1.050933 May 21 21:19:21.111013 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1163/2392] 10.222.0.49 () {58 vars in 1262 bytes} [Sat May 21 21:19:20 2022] DELETE /compute/v2.1/os-floating-ips/5c044543-5bad-4801-ba68-b6c3a221f045 => generated 0 bytes in 1054 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:19:21.117285 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3d0f89a5-5037-42f1-8bcf-8af048e1d619 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:21.121106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3d0f89a5-5037-42f1-8bcf-8af048e1d619 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:21.128062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d0f89a5-5037-42f1-8bcf-8af048e1d619 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:21.128769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d0f89a5-5037-42f1-8bcf-8af048e1d619 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:21.129486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d0f89a5-5037-42f1-8bcf-8af048e1d619 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:21.129934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d0f89a5-5037-42f1-8bcf-8af048e1d619 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:21.135694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1a154b37-5fc2-4534-848c-6a53211ecbeb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7728c54a0441da5cae942997be179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f878f565614ccd8043f3712c27e8fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:21.143854 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1a154b37-5fc2-4534-848c-6a53211ecbeb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 200 len: 1315 microversion: 2.1 time: 0.270984 May 21 21:19:21.144853 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1230/2393] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:20 2022] GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:19:21.149579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fe29f752-35a7-4bf7-a7ef-7e1e10545d88 tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] Calling method '.version_select at 0x7fc82d08a550>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:21.209642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3d0f89a5-5037-42f1-8bcf-8af048e1d619 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:21.218788 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3d0f89a5-5037-42f1-8bcf-8af048e1d619 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea" status: 200 len: 1265 microversion: 2.1 time: 0.106454 May 21 21:19:21.219098 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1164/2394] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:21 2022] GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:21.321294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9318e849-f85b-4bc0-bf41-557d7009c995 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:21.321957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9318e849-f85b-4bc0-bf41-557d7009c995 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:21.329442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9318e849-f85b-4bc0-bf41-557d7009c995 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:21.330170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9318e849-f85b-4bc0-bf41-557d7009c995 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:21.331102 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9318e849-f85b-4bc0-bf41-557d7009c995 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:21.331678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9318e849-f85b-4bc0-bf41-557d7009c995 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:22.109950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9318e849-f85b-4bc0-bf41-557d7009c995 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:22.134721 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9318e849-f85b-4bc0-bf41-557d7009c995 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:22.137505 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9318e849-f85b-4bc0-bf41-557d7009c995 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:22.138729 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9318e849-f85b-4bc0-bf41-557d7009c995 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1879 microversion: 2.32 time: 0.822468 May 21 21:19:22.139644 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1165/2395] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:19:21 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1879 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:19:22.145596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8bf0028b-9d3e-4d6b-9772-f16e57500517 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:22.147600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8bf0028b-9d3e-4d6b-9772-f16e57500517 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:22.160823 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8bf0028b-9d3e-4d6b-9772-f16e57500517 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:22.161568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8bf0028b-9d3e-4d6b-9772-f16e57500517 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:22.162520 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8bf0028b-9d3e-4d6b-9772-f16e57500517 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:22.164217 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8bf0028b-9d3e-4d6b-9772-f16e57500517 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:22.461041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8bf0028b-9d3e-4d6b-9772-f16e57500517 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:22.469590 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8bf0028b-9d3e-4d6b-9772-f16e57500517 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1667 microversion: 2.1 time: 0.328384 May 21 21:19:22.470176 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1166/2396] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:22 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1667 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:22.474653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-99e43446-8f18-48d5-ad71-11691ed27dc5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:22.475262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-99e43446-8f18-48d5-ad71-11691ed27dc5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:22.481377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99e43446-8f18-48d5-ad71-11691ed27dc5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:22.481835 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99e43446-8f18-48d5-ad71-11691ed27dc5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:22.483151 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99e43446-8f18-48d5-ad71-11691ed27dc5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:22.484186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99e43446-8f18-48d5-ad71-11691ed27dc5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:22.784377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-99e43446-8f18-48d5-ad71-11691ed27dc5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:22.790827 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fe29f752-35a7-4bf7-a7ef-7e1e10545d88 tempest-FloatingIPDetailsTestJSON-2070417618 tempest-FloatingIPDetailsTestJSON-2070417618-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/3defea53-97b7-44a2-968a-286c294ce197" status: 202 len: 0 microversion: 2.1 time: 1.644667 May 21 21:19:22.794347 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1231/2397] 10.222.0.49 () {58 vars in 1262 bytes} [Sat May 21 21:19:21 2022] DELETE /compute/v2.1/os-floating-ips/3defea53-97b7-44a2-968a-286c294ce197 => generated 0 bytes in 1649 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:19:22.799144 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-99e43446-8f18-48d5-ad71-11691ed27dc5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1314 microversion: 2.1 time: 0.327808 May 21 21:19:22.800866 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1167/2398] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:22 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:22.804886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2a3147e5-c59d-41ad-ac2c-6ac724b06232 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:22.806437 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2a3147e5-c59d-41ad-ac2c-6ac724b06232 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:22.815107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aafcb04d-c3ea-45f5-a4d8-c8d0c409fe99 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:22.816863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-aafcb04d-c3ea-45f5-a4d8-c8d0c409fe99 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:22.823812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aafcb04d-c3ea-45f5-a4d8-c8d0c409fe99 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:22.825302 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aafcb04d-c3ea-45f5-a4d8-c8d0c409fe99 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:22.826421 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aafcb04d-c3ea-45f5-a4d8-c8d0c409fe99 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:22.827039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a3147e5-c59d-41ad-ac2c-6ac724b06232 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:22.827630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aafcb04d-c3ea-45f5-a4d8-c8d0c409fe99 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:22.827735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a3147e5-c59d-41ad-ac2c-6ac724b06232 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:22.828553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a3147e5-c59d-41ad-ac2c-6ac724b06232 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:22.829008 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a3147e5-c59d-41ad-ac2c-6ac724b06232 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:23.059740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-aafcb04d-c3ea-45f5-a4d8-c8d0c409fe99 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:23.078416 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-aafcb04d-c3ea-45f5-a4d8-c8d0c409fe99 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea" status: 200 len: 1271 microversion: 2.1 time: 0.275068 May 21 21:19:23.088166 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1168/2399] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:22 2022] GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea => generated 1271 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:23.088166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4d8f8113-a362-48b5-b44a-cf63abb27e5f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:23.088166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4d8f8113-a362-48b5-b44a-cf63abb27e5f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:23.094108 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d8f8113-a362-48b5-b44a-cf63abb27e5f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:23.094656 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d8f8113-a362-48b5-b44a-cf63abb27e5f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:23.095546 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d8f8113-a362-48b5-b44a-cf63abb27e5f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:23.096221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d8f8113-a362-48b5-b44a-cf63abb27e5f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:23.132048 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4d8f8113-a362-48b5-b44a-cf63abb27e5f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3/ips" status: 200 len: 178 microversion: 2.1 time: 0.051272 May 21 21:19:23.134283 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1169/2400] 10.222.0.49 () {58 vars in 1247 bytes} [Sat May 21 21:19:23 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3/ips => generated 178 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:23.147749 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3ee6c53c-85c7-4ac6-9a19-c2f3f82d6b08 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:23.149000 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3ee6c53c-85c7-4ac6-9a19-c2f3f82d6b08 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:23.159558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ee6c53c-85c7-4ac6-9a19-c2f3f82d6b08 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:23.160711 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ee6c53c-85c7-4ac6-9a19-c2f3f82d6b08 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:23.162050 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ee6c53c-85c7-4ac6-9a19-c2f3f82d6b08 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:23.162678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ee6c53c-85c7-4ac6-9a19-c2f3f82d6b08 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:23.203679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3ee6c53c-85c7-4ac6-9a19-c2f3f82d6b08 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:19:23.218542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2a3147e5-c59d-41ad-ac2c-6ac724b06232 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7728c54a0441da5cae942997be179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f878f565614ccd8043f3712c27e8fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:23.227927 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2a3147e5-c59d-41ad-ac2c-6ac724b06232 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 200 len: 1465 microversion: 2.1 time: 0.430579 May 21 21:19:23.240372 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1232/2401] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:22 2022] GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 1465 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:23.247861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-eeff8ac9-cf9e-4151-a366-5b0ecff82562 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:23.249240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-eeff8ac9-cf9e-4151-a366-5b0ecff82562 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:23.255796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eeff8ac9-cf9e-4151-a366-5b0ecff82562 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:23.256251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eeff8ac9-cf9e-4151-a366-5b0ecff82562 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:23.257082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eeff8ac9-cf9e-4151-a366-5b0ecff82562 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:23.258345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eeff8ac9-cf9e-4151-a366-5b0ecff82562 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:23.640899 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3ee6c53c-85c7-4ac6-9a19-c2f3f82d6b08 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 204 len: 0 microversion: 2.1 time: 0.499007 May 21 21:19:23.641509 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1170/2402] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:19:23 2022] DELETE /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:19:23.657006 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7aecbe02-d21b-414b-bd51-c3b88b571294 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:23.658183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7aecbe02-d21b-414b-bd51-c3b88b571294 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:23.676014 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7aecbe02-d21b-414b-bd51-c3b88b571294 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:23.680482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7aecbe02-d21b-414b-bd51-c3b88b571294 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:23.680482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7aecbe02-d21b-414b-bd51-c3b88b571294 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:23.681680 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7aecbe02-d21b-414b-bd51-c3b88b571294 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:23.722602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7aecbe02-d21b-414b-bd51-c3b88b571294 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:19:23.919729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-eeff8ac9-cf9e-4151-a366-5b0ecff82562 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:23.931443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-eeff8ac9-cf9e-4151-a366-5b0ecff82562 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:23.933078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-eeff8ac9-cf9e-4151-a366-5b0ecff82562 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:23.938502 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-eeff8ac9-cf9e-4151-a366-5b0ecff82562 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 2831 microversion: 2.32 time: 0.692932 May 21 21:19:23.938502 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1233/2403] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:19:23 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 2831 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:19:23.946337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-778a3662-d6c0-4dad-b7e1-8ea45369acec tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:23.947437 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-778a3662-d6c0-4dad-b7e1-8ea45369acec tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:23.954828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-778a3662-d6c0-4dad-b7e1-8ea45369acec tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:23.955426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-778a3662-d6c0-4dad-b7e1-8ea45369acec tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:23.956381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-778a3662-d6c0-4dad-b7e1-8ea45369acec tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:23.956988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-778a3662-d6c0-4dad-b7e1-8ea45369acec tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:24.143781 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7aecbe02-d21b-414b-bd51-c3b88b571294 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 204 len: 0 microversion: 2.1 time: 0.497034 May 21 21:19:24.144544 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1171/2404] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:19:23 2022] DELETE /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:19:24.150489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-0621bc9a-4aa2-4221-922d-94f582bd8209 req-afc8a60d-a6dc-4b3b-a722-09f538c0aa44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c07e27-b31b-4712-9bb2-19a2eca3b35b", "name": "network-vif-plugged", "status": "completed", "tag": "b3fdc189-fac8-4e7f-96a7-d1881a26a02b"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:24.160873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0621bc9a-4aa2-4221-922d-94f582bd8209 req-afc8a60d-a6dc-4b3b-a722-09f538c0aa44 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:24.161316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0621bc9a-4aa2-4221-922d-94f582bd8209 req-afc8a60d-a6dc-4b3b-a722-09f538c0aa44 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:24.175000 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-0621bc9a-4aa2-4221-922d-94f582bd8209 req-afc8a60d-a6dc-4b3b-a722-09f538c0aa44 service nova] Creating event network-vif-plugged:b3fdc189-fac8-4e7f-96a7-d1881a26a02b for instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b on nch1-master-1 May 21 21:19:24.180702 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-0621bc9a-4aa2-4221-922d-94f582bd8209 req-afc8a60d-a6dc-4b3b-a722-09f538c0aa44 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034553 May 21 21:19:24.181327 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1172/2405] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:24.187642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-076cac4b-c6bf-4e38-879c-09f806f1b0e8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:24.188380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-076cac4b-c6bf-4e38-879c-09f806f1b0e8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:24.197540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-076cac4b-c6bf-4e38-879c-09f806f1b0e8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:24.197739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-076cac4b-c6bf-4e38-879c-09f806f1b0e8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:24.198494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-076cac4b-c6bf-4e38-879c-09f806f1b0e8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:24.199688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-076cac4b-c6bf-4e38-879c-09f806f1b0e8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:24.438124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-076cac4b-c6bf-4e38-879c-09f806f1b0e8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:24.447477 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-076cac4b-c6bf-4e38-879c-09f806f1b0e8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1314 microversion: 2.1 time: 0.264475 May 21 21:19:24.448609 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1173/2406] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:24 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:24.454657 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-471b201d-3482-47d1-bf1b-477eff741365 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:24.455596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-471b201d-3482-47d1-bf1b-477eff741365 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:24.462294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-471b201d-3482-47d1-bf1b-477eff741365 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:24.463039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-471b201d-3482-47d1-bf1b-477eff741365 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:24.464055 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-471b201d-3482-47d1-bf1b-477eff741365 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:24.464760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-471b201d-3482-47d1-bf1b-477eff741365 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:24.643193 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-471b201d-3482-47d1-bf1b-477eff741365 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.193210 May 21 21:19:24.644157 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1174/2407] 10.222.0.49 () {60 vars in 1315 bytes} [Sat May 21 21:19:24 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941/os-interface => generated 1830 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:19:24.651661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c3e4f17b-2723-4b5f-8889-63159defc819 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:24.652622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c3e4f17b-2723-4b5f-8889-63159defc819 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:24.662289 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3e4f17b-2723-4b5f-8889-63159defc819 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:24.663052 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3e4f17b-2723-4b5f-8889-63159defc819 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:24.665150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3e4f17b-2723-4b5f-8889-63159defc819 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:24.665150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3e4f17b-2723-4b5f-8889-63159defc819 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:24.669031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:24.712720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-778a3662-d6c0-4dad-b7e1-8ea45369acec tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:24.723456 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-778a3662-d6c0-4dad-b7e1-8ea45369acec tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1673 microversion: 2.1 time: 0.786655 May 21 21:19:24.734592 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1234/2408] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:23 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1673 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:24.740023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-09ea41b2-9305-48dd-a2c4-365feab60dcb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:24.740939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-09ea41b2-9305-48dd-a2c4-365feab60dcb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:24.747947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-09ea41b2-9305-48dd-a2c4-365feab60dcb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:24.749000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-09ea41b2-9305-48dd-a2c4-365feab60dcb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:24.750028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-09ea41b2-9305-48dd-a2c4-365feab60dcb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:24.750674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-09ea41b2-9305-48dd-a2c4-365feab60dcb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:24.755867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:25.115351 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-09ea41b2-9305-48dd-a2c4-365feab60dcb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7728c54a0441da5cae942997be179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f878f565614ccd8043f3712c27e8fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:25.125826 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-09ea41b2-9305-48dd-a2c4-365feab60dcb tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 200 len: 1471 microversion: 2.1 time: 0.388166 May 21 21:19:25.131333 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1235/2409] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:24 2022] GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 1471 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:25.464651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-de278866-c4bd-47ce-898f-90aae5bd47c2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:25.465520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-de278866-c4bd-47ce-898f-90aae5bd47c2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:25.473328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-de278866-c4bd-47ce-898f-90aae5bd47c2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:25.473986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-de278866-c4bd-47ce-898f-90aae5bd47c2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:25.474935 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-de278866-c4bd-47ce-898f-90aae5bd47c2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:25.475525 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-de278866-c4bd-47ce-898f-90aae5bd47c2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:25.510374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c3e4f17b-2723-4b5f-8889-63159defc819 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:25.518513 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c3e4f17b-2723-4b5f-8889-63159defc819 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea" status: 200 len: 1313 microversion: 2.1 time: 0.872776 May 21 21:19:25.519295 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1175/2410] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:24 2022] GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea => generated 1313 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:25.744342 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7c0ca982-3e11-4a1c-b1f9-2d4586ac6704 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:25.746066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7c0ca982-3e11-4a1c-b1f9-2d4586ac6704 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:25.768704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c0ca982-3e11-4a1c-b1f9-2d4586ac6704 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:25.771655 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c0ca982-3e11-4a1c-b1f9-2d4586ac6704 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:25.775770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c0ca982-3e11-4a1c-b1f9-2d4586ac6704 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:25.777144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c0ca982-3e11-4a1c-b1f9-2d4586ac6704 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:25.819276 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-de278866-c4bd-47ce-898f-90aae5bd47c2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:25.839690 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-de278866-c4bd-47ce-898f-90aae5bd47c2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1314 microversion: 2.1 time: 0.375733 May 21 21:19:25.858806 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1236/2411] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:25 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:19:25.931273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-198dba5d-a6e6-43db-ab8d-9f0f63f51002 req-ceb237af-2b08-4866-b424-ec6d98f8b6e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6825da6e-8b02-486c-8461-41f10572c810", "tag": "976547b8-31f4-469e-8c56-e9286444cdde"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:25.942541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-198dba5d-a6e6-43db-ab8d-9f0f63f51002 req-ceb237af-2b08-4866-b424-ec6d98f8b6e8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:25.943858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-198dba5d-a6e6-43db-ab8d-9f0f63f51002 req-ceb237af-2b08-4866-b424-ec6d98f8b6e8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:25.970815 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-198dba5d-a6e6-43db-ab8d-9f0f63f51002 req-ceb237af-2b08-4866-b424-ec6d98f8b6e8 service nova] Creating event network-changed:976547b8-31f4-469e-8c56-e9286444cdde for instance 6825da6e-8b02-486c-8461-41f10572c810 on nch1-master-1 May 21 21:19:25.989357 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-198dba5d-a6e6-43db-ab8d-9f0f63f51002 req-ceb237af-2b08-4866-b424-ec6d98f8b6e8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063115 May 21 21:19:25.996224 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1237/2412] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:19:26.147905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5511dabc-607f-4cc0-b8f3-50a515889b1c tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:26.155108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5511dabc-607f-4cc0-b8f3-50a515889b1c tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:26.159038 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5511dabc-607f-4cc0-b8f3-50a515889b1c tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:26.164811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5511dabc-607f-4cc0-b8f3-50a515889b1c tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:26.165818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5511dabc-607f-4cc0-b8f3-50a515889b1c tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:26.166357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5511dabc-607f-4cc0-b8f3-50a515889b1c tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:26.629085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5511dabc-607f-4cc0-b8f3-50a515889b1c tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7728c54a0441da5cae942997be179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f878f565614ccd8043f3712c27e8fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:26.645291 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5511dabc-607f-4cc0-b8f3-50a515889b1c tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 200 len: 1471 microversion: 2.1 time: 0.501902 May 21 21:19:26.646309 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1238/2413] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:26 2022] GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 1471 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:19:26.657053 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8558b4f5-5b24-433f-ba3b-9fdfa020c63f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:26.658372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8558b4f5-5b24-433f-ba3b-9fdfa020c63f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:26.672845 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8558b4f5-5b24-433f-ba3b-9fdfa020c63f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:26.675817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8558b4f5-5b24-433f-ba3b-9fdfa020c63f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:26.676939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8558b4f5-5b24-433f-ba3b-9fdfa020c63f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:26.678798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8558b4f5-5b24-433f-ba3b-9fdfa020c63f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:27.044149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7c0ca982-3e11-4a1c-b1f9-2d4586ac6704 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:27.055358 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7c0ca982-3e11-4a1c-b1f9-2d4586ac6704 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1673 microversion: 2.1 time: 1.316566 May 21 21:19:27.060006 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1176/2414] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:25 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1673 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:27.063498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4b1627e3-4a18-42e8-813a-9eb214646dd2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:27.064375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4b1627e3-4a18-42e8-813a-9eb214646dd2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:27.075154 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b1627e3-4a18-42e8-813a-9eb214646dd2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:27.076045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b1627e3-4a18-42e8-813a-9eb214646dd2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:27.079648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b1627e3-4a18-42e8-813a-9eb214646dd2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:27.080877 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b1627e3-4a18-42e8-813a-9eb214646dd2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:27.204619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8558b4f5-5b24-433f-ba3b-9fdfa020c63f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:27.215606 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8558b4f5-5b24-433f-ba3b-9fdfa020c63f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea" status: 200 len: 1313 microversion: 2.1 time: 0.567835 May 21 21:19:27.216207 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1239/2415] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:26 2022] GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:27.671702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b640a9c8-1549-42f7-9b89-8d3bf186b306 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:27.672367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b640a9c8-1549-42f7-9b89-8d3bf186b306 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:27.688083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b640a9c8-1549-42f7-9b89-8d3bf186b306 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:27.688854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b640a9c8-1549-42f7-9b89-8d3bf186b306 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:27.689832 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b640a9c8-1549-42f7-9b89-8d3bf186b306 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:27.690438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b640a9c8-1549-42f7-9b89-8d3bf186b306 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:27.847721 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4b1627e3-4a18-42e8-813a-9eb214646dd2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:27.863208 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4b1627e3-4a18-42e8-813a-9eb214646dd2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1500 microversion: 2.1 time: 0.804510 May 21 21:19:27.875207 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1177/2416] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:27 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1500 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:27.883370 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-190249a9-3933-4fee-860a-e0fc9a1b0938 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:27.888353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-190249a9-3933-4fee-860a-e0fc9a1b0938 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:27.888353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:27.892819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-190249a9-3933-4fee-860a-e0fc9a1b0938 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:27.893281 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-190249a9-3933-4fee-860a-e0fc9a1b0938 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:27.894081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-190249a9-3933-4fee-860a-e0fc9a1b0938 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:27.894519 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-190249a9-3933-4fee-860a-e0fc9a1b0938 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:27.933776 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-190249a9-3933-4fee-860a-e0fc9a1b0938 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lazy-loading 'flavor' on Instance uuid e4c07e27-b31b-4712-9bb2-19a2eca3b35b {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:19:27.975594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=7 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:27.988269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:28.047750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b640a9c8-1549-42f7-9b89-8d3bf186b306 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7728c54a0441da5cae942997be179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f878f565614ccd8043f3712c27e8fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:28.075466 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b640a9c8-1549-42f7-9b89-8d3bf186b306 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 200 len: 1471 microversion: 2.1 time: 0.416961 May 21 21:19:28.085936 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1240/2417] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:27 2022] GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 1471 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:19:28.087264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-15a4778d-f52f-476c-a74f-815fa94031fe tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:28.087909 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-15a4778d-f52f-476c-a74f-815fa94031fe tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:28.096516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15a4778d-f52f-476c-a74f-815fa94031fe tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:28.096985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15a4778d-f52f-476c-a74f-815fa94031fe tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:28.097936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15a4778d-f52f-476c-a74f-815fa94031fe tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:28.098527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15a4778d-f52f-476c-a74f-815fa94031fe tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:28.354768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-15a4778d-f52f-476c-a74f-815fa94031fe tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:28.367694 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-15a4778d-f52f-476c-a74f-815fa94031fe tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1673 microversion: 2.1 time: 0.286324 May 21 21:19:28.368329 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1241/2418] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:28 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1673 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:28.375262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5734b593-e1d2-4a6a-8d2c-71d2cf1a5b36 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:28.378492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5734b593-e1d2-4a6a-8d2c-71d2cf1a5b36 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:28.387235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5734b593-e1d2-4a6a-8d2c-71d2cf1a5b36 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:28.387884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5734b593-e1d2-4a6a-8d2c-71d2cf1a5b36 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:28.389484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5734b593-e1d2-4a6a-8d2c-71d2cf1a5b36 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:28.390114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5734b593-e1d2-4a6a-8d2c-71d2cf1a5b36 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:28.481850 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=8 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:28.658477 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-190249a9-3933-4fee-860a-e0fc9a1b0938 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "POST /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b/action" status: 202 len: 0 microversion: 2.1 time: 0.780703 May 21 21:19:28.662792 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1178/2419] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:19:27 2022] POST /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b/action => generated 0 bytes in 786 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:19:28.677059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e3b61285-495f-4ba1-872c-bc356268d127 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:28.677862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e3b61285-495f-4ba1-872c-bc356268d127 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:28.685037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3b61285-495f-4ba1-872c-bc356268d127 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:28.685644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3b61285-495f-4ba1-872c-bc356268d127 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:28.687304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3b61285-495f-4ba1-872c-bc356268d127 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:28.687871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3b61285-495f-4ba1-872c-bc356268d127 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:29.004879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5734b593-e1d2-4a6a-8d2c-71d2cf1a5b36 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:29.040236 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5734b593-e1d2-4a6a-8d2c-71d2cf1a5b36 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea" status: 200 len: 1313 microversion: 2.1 time: 0.668046 May 21 21:19:29.043478 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1242/2420] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:28 2022] GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea => generated 1313 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:29.053979 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-6c5d0531-7eee-455b-89e7-b6724c424512 req-b2c567e4-a170-4083-9b48-ff09b8305848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c83883e1-bf1c-43dd-a43a-3c82e4a3dbea", "tag": "283ab589-fb64-424b-a0f0-273a885f9a8c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:29.073860 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6c5d0531-7eee-455b-89e7-b6724c424512 req-b2c567e4-a170-4083-9b48-ff09b8305848 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:29.075178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6c5d0531-7eee-455b-89e7-b6724c424512 req-b2c567e4-a170-4083-9b48-ff09b8305848 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:29.105317 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-6c5d0531-7eee-455b-89e7-b6724c424512 req-b2c567e4-a170-4083-9b48-ff09b8305848 service nova] Creating event network-changed:283ab589-fb64-424b-a0f0-273a885f9a8c for instance c83883e1-bf1c-43dd-a43a-3c82e4a3dbea on nch1-master-1 May 21 21:19:29.117857 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-6c5d0531-7eee-455b-89e7-b6724c424512 req-b2c567e4-a170-4083-9b48-ff09b8305848 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063527 May 21 21:19:29.119135 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1243/2421] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:29.125336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e826f801-8484-4287-9aa3-5a1da23672cd tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:29.126271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e826f801-8484-4287-9aa3-5a1da23672cd tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:29.136616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e826f801-8484-4287-9aa3-5a1da23672cd tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:29.137432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e826f801-8484-4287-9aa3-5a1da23672cd tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:29.141572 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e826f801-8484-4287-9aa3-5a1da23672cd tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:29.143023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e826f801-8484-4287-9aa3-5a1da23672cd tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:29.257304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e826f801-8484-4287-9aa3-5a1da23672cd tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7728c54a0441da5cae942997be179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f878f565614ccd8043f3712c27e8fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:29.278040 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e826f801-8484-4287-9aa3-5a1da23672cd tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 200 len: 1429 microversion: 2.1 time: 0.156992 May 21 21:19:29.279452 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1244/2422] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:29 2022] GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 1429 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:29.354718 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e3b61285-495f-4ba1-872c-bc356268d127 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:29.390061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-96649f42-7c12-46fe-a5b1-e2a320def578 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:29.396013 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-96649f42-7c12-46fe-a5b1-e2a320def578 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:29.411202 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e3b61285-495f-4ba1-872c-bc356268d127 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1506 microversion: 2.1 time: 0.742861 May 21 21:19:29.412998 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1179/2423] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:28 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1506 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:29.421679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96649f42-7c12-46fe-a5b1-e2a320def578 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:29.422482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96649f42-7c12-46fe-a5b1-e2a320def578 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:29.424124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96649f42-7c12-46fe-a5b1-e2a320def578 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:29.427478 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96649f42-7c12-46fe-a5b1-e2a320def578 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:29.895011 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-96649f42-7c12-46fe-a5b1-e2a320def578 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:29.910419 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-96649f42-7c12-46fe-a5b1-e2a320def578 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1652 microversion: 2.1 time: 0.524957 May 21 21:19:29.923622 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1245/2424] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:29 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1652 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:30.064363 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-24e7bd16-bc9b-4ed6-a877-0b9a1c706e4a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:30.065279 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-24e7bd16-bc9b-4ed6-a877-0b9a1c706e4a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:30.091408 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24e7bd16-bc9b-4ed6-a877-0b9a1c706e4a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:30.099200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24e7bd16-bc9b-4ed6-a877-0b9a1c706e4a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:30.100448 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24e7bd16-bc9b-4ed6-a877-0b9a1c706e4a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:30.101096 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24e7bd16-bc9b-4ed6-a877-0b9a1c706e4a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:30.180700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-324e47eb-0f5d-4536-b0a8-9a2cb35e28c8 req-2494fcdc-4606-4c26-94b8-619ebe1d5fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374e77c0-3a9e-4a57-8320-0546efbbf7a3", "name": "network-vif-unplugged", "status": "completed", "tag": "58141793-884a-4d34-a6e7-df3411a26412"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:30.201034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-324e47eb-0f5d-4536-b0a8-9a2cb35e28c8 req-2494fcdc-4606-4c26-94b8-619ebe1d5fc2 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:30.202609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-324e47eb-0f5d-4536-b0a8-9a2cb35e28c8 req-2494fcdc-4606-4c26-94b8-619ebe1d5fc2 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:30.217323 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-324e47eb-0f5d-4536-b0a8-9a2cb35e28c8 req-2494fcdc-4606-4c26-94b8-619ebe1d5fc2 service nova] Creating event network-vif-unplugged:58141793-884a-4d34-a6e7-df3411a26412 for instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 on nch2-master-1 May 21 21:19:30.224047 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-324e47eb-0f5d-4536-b0a8-9a2cb35e28c8 req-2494fcdc-4606-4c26-94b8-619ebe1d5fc2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047166 May 21 21:19:30.225202 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1246/2425] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:30.300844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9c54f8d3-41ae-4c07-bcd7-4a0afc9b3a18 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:30.301838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9c54f8d3-41ae-4c07-bcd7-4a0afc9b3a18 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:30.310399 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c54f8d3-41ae-4c07-bcd7-4a0afc9b3a18 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:30.321723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c54f8d3-41ae-4c07-bcd7-4a0afc9b3a18 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:30.321723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c54f8d3-41ae-4c07-bcd7-4a0afc9b3a18 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:30.321723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c54f8d3-41ae-4c07-bcd7-4a0afc9b3a18 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:30.354203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c54f8d3-41ae-4c07-bcd7-4a0afc9b3a18 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:30.354972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c54f8d3-41ae-4c07-bcd7-4a0afc9b3a18 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:30.355604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-9c54f8d3-41ae-4c07-bcd7-4a0afc9b3a18 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lazy-loading 'fault' on Instance uuid ff836353-3537-443f-b089-b8b3480308c5 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:19:30.441338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9c54f8d3-41ae-4c07-bcd7-4a0afc9b3a18 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d7728c54a0441da5cae942997be179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f878f565614ccd8043f3712c27e8fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:30.470708 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9c54f8d3-41ae-4c07-bcd7-4a0afc9b3a18 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 200 len: 1305 microversion: 2.1 time: 0.171989 May 21 21:19:30.472820 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1247/2426] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:30 2022] GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 1305 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:19:30.481399 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-da35b05a-8a64-4897-b5b9-9611cf316ab4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:30.482647 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-da35b05a-8a64-4897-b5b9-9611cf316ab4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:30.490142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da35b05a-8a64-4897-b5b9-9611cf316ab4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:30.490819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da35b05a-8a64-4897-b5b9-9611cf316ab4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:30.491807 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da35b05a-8a64-4897-b5b9-9611cf316ab4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:30.492474 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da35b05a-8a64-4897-b5b9-9611cf316ab4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:30.864482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-da35b05a-8a64-4897-b5b9-9611cf316ab4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:30.879927 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-da35b05a-8a64-4897-b5b9-9611cf316ab4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1506 microversion: 2.1 time: 0.402315 May 21 21:19:30.884362 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1248/2427] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:30 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:30.944749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-47413cff-c636-46ca-a840-08d30f703619 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:30.953190 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-47413cff-c636-46ca-a840-08d30f703619 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:30.965105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47413cff-c636-46ca-a840-08d30f703619 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:30.965569 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47413cff-c636-46ca-a840-08d30f703619 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:30.966388 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47413cff-c636-46ca-a840-08d30f703619 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:30.966928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47413cff-c636-46ca-a840-08d30f703619 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:31.010704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-24e7bd16-bc9b-4ed6-a877-0b9a1c706e4a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:31.020504 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-24e7bd16-bc9b-4ed6-a877-0b9a1c706e4a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea" status: 200 len: 1313 microversion: 2.1 time: 0.962780 May 21 21:19:31.043546 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1180/2428] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:30 2022] GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea => generated 1313 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:31.168471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-d19fd86b-485e-4227-ad36-f666e1c8e9c4 req-22572439-1f78-4515-957e-b41868eebd0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374e77c0-3a9e-4a57-8320-0546efbbf7a3", "name": "network-vif-deleted", "tag": "7b127940-a46f-4616-b38b-4f295f2bde61"}, {"name": "network-changed", "server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "tag": "47e2d024-64c4-4e87-9d61-1a91c3bdd681"}, {"server_uuid": "ff836353-3537-443f-b089-b8b3480308c5", "name": "network-vif-deleted", "tag": "0bc52466-5c29-43a9-902b-85fb9eea0ac4"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:31.181392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-d19fd86b-485e-4227-ad36-f666e1c8e9c4 req-22572439-1f78-4515-957e-b41868eebd0c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:31.182196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-d19fd86b-485e-4227-ad36-f666e1c8e9c4 req-22572439-1f78-4515-957e-b41868eebd0c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:31.199585 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-d19fd86b-485e-4227-ad36-f666e1c8e9c4 req-22572439-1f78-4515-957e-b41868eebd0c service nova] Creating event network-vif-deleted:7b127940-a46f-4616-b38b-4f295f2bde61 for instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 on nch2-master-1 May 21 21:19:31.200456 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-d19fd86b-485e-4227-ad36-f666e1c8e9c4 req-22572439-1f78-4515-957e-b41868eebd0c service nova] Creating event network-changed:47e2d024-64c4-4e87-9d61-1a91c3bdd681 for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:19:31.201445 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-d19fd86b-485e-4227-ad36-f666e1c8e9c4 req-22572439-1f78-4515-957e-b41868eebd0c service nova] Creating event network-vif-deleted:0bc52466-5c29-43a9-902b-85fb9eea0ac4 for instance ff836353-3537-443f-b089-b8b3480308c5 on nch2-master-1 May 21 21:19:31.213850 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-d19fd86b-485e-4227-ad36-f666e1c8e9c4 req-22572439-1f78-4515-957e-b41868eebd0c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.049670 May 21 21:19:31.215164 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1181/2429] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:19:31.269046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-47413cff-c636-46ca-a840-08d30f703619 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:31.277301 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-47413cff-c636-46ca-a840-08d30f703619 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1652 microversion: 2.1 time: 0.340167 May 21 21:19:31.277936 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1249/2430] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:30 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1652 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:31.491448 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8848f630-eafa-42e7-bea7-a5b30e762b90 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:31.492714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8848f630-eafa-42e7-bea7-a5b30e762b90 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:31.515914 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8848f630-eafa-42e7-bea7-a5b30e762b90 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:31.518207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8848f630-eafa-42e7-bea7-a5b30e762b90 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:31.522259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8848f630-eafa-42e7-bea7-a5b30e762b90 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:31.522259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8848f630-eafa-42e7-bea7-a5b30e762b90 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:31.568117 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-8848f630-eafa-42e7-bea7-a5b30e762b90 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] HTTP exception thrown: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8848f630-eafa-42e7-bea7-a5b30e762b90 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Request method failure captured: May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 HTTP/1.1 May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVdC1l_fd5J96A6VAukj8oUPQDLnnUo3442-32w-WFOT9V5z06SMv2ZGe0iNbB9lN3IKaff6VI1XAlcv5CI3prsE0_c3119pWEvDqgktSoADSbRITC9lMXziw7ma0JQ7PrCXDIU6i0vZZfABfdyXjV253umGWQ7HgWrRUNwxGc4v7mA May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 84f878f565614ccd8043f3712c27e8fe May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesNegativeTestJSON-1815632198 May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84f878f565614ccd8043f3712c27e8fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84f878f565614ccd8043f3712c27e8fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84f878f565614ccd8043f3712c27e8fe", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84f878f565614ccd8043f3712c27e8fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesNegativeTestJSON-1815632198 May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 84f878f565614ccd8043f3712c27e8fe May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1815632198 May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesNegativeTestJSON-1815632198-project May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: a7d7728c54a0441da5cae942997be179 May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesNegativeTestJSON-1815632198-project May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'ff836353-3537-443f-b089-b8b3480308c5'} May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:31.575313 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:31.582701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:31.582701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:31.582701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:31.582701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:19:31.582701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:19:31.582701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. May 21 21:19:31.582701 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:31.582701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8848f630-eafa-42e7-bea7-a5b30e762b90 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Returning 404 to user: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:19:31.582701 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8848f630-eafa-42e7-bea7-a5b30e762b90 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 404 len: 111 microversion: 2.1 time: 0.092258 May 21 21:19:31.582701 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1182/2431] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:31 2022] GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:19:31.600493 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6f8d255a-a605-4bc7-a06d-42aee3d917a9 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2038808081", "metadata": {"image_type": "test"}}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:31.603870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6f8d255a-a605-4bc7-a06d-42aee3d917a9 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:31.614235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f8d255a-a605-4bc7-a06d-42aee3d917a9 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:31.615000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f8d255a-a605-4bc7-a06d-42aee3d917a9 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:31.616121 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f8d255a-a605-4bc7-a06d-42aee3d917a9 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:31.616919 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f8d255a-a605-4bc7-a06d-42aee3d917a9 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-6f8d255a-a605-4bc7-a06d-42aee3d917a9 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] HTTP exception thrown: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6f8d255a-a605-4bc7-a06d-42aee3d917a9 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Request method failure captured: May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5/action HTTP/1.1 May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 112 May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVdC1l_fd5J96A6VAukj8oUPQDLnnUo3442-32w-WFOT9V5z06SMv2ZGe0iNbB9lN3IKaff6VI1XAlcv5CI3prsE0_c3119pWEvDqgktSoADSbRITC9lMXziw7ma0JQ7PrCXDIU6i0vZZfABfdyXjV253umGWQ7HgWrRUNwxGc4v7mA May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 84f878f565614ccd8043f3712c27e8fe May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesNegativeTestJSON-1815632198 May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84f878f565614ccd8043f3712c27e8fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84f878f565614ccd8043f3712c27e8fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84f878f565614ccd8043f3712c27e8fe", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84f878f565614ccd8043f3712c27e8fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesNegativeTestJSON-1815632198 May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 84f878f565614ccd8043f3712c27e8fe May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1815632198 May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesNegativeTestJSON-1815632198-project May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a7d7728c54a0441da5cae942997be179 May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesNegativeTestJSON-1815632198-project May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2038808081", "metadata": {"image_type": "test"}}} May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'ff836353-3537-443f-b089-b8b3480308c5', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2038808081', 'metadata': {'image_type': 'test'}}}} May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:19:31.648939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:19:31.651925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 21 21:19:31.651925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 21 21:19:31.651925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:19:31.651925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:19:31.651925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:19:31.651925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:19:31.651925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. May 21 21:19:31.651925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:31.651925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:31.651925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:31.651925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:31.651925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:31.651925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:31.651925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:19:31.651925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:19:31.651925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. May 21 21:19:31.651925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:31.651925 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6f8d255a-a605-4bc7-a06d-42aee3d917a9 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Returning 404 to user: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:19:31.657971 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6f8d255a-a605-4bc7-a06d-42aee3d917a9 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "POST /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5/action" status: 404 len: 111 microversion: 2.1 time: 0.073170 May 21 21:19:31.682792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-989d403b-1981-4b99-8545-251ffc55f0d0 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1557800018", "metadata": {"image_type": "test"}}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:31.687621 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-989d403b-1981-4b99-8545-251ffc55f0d0 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Failed to fetch instance by id tempest-invalid-557661228 {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2926}} May 21 21:19:31.688535 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-989d403b-1981-4b99-8545-251ffc55f0d0 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] HTTP exception thrown: Instance tempest-invalid-557661228 could not be found. May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-989d403b-1981-4b99-8545-251ffc55f0d0 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Request method failure captured: May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/tempest-invalid-557661228/action HTTP/1.1 May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 112 May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVdC1l_fd5J96A6VAukj8oUPQDLnnUo3442-32w-WFOT9V5z06SMv2ZGe0iNbB9lN3IKaff6VI1XAlcv5CI3prsE0_c3119pWEvDqgktSoADSbRITC9lMXziw7ma0JQ7PrCXDIU6i0vZZfABfdyXjV253umGWQ7HgWrRUNwxGc4v7mA May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 84f878f565614ccd8043f3712c27e8fe May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesNegativeTestJSON-1815632198 May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84f878f565614ccd8043f3712c27e8fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84f878f565614ccd8043f3712c27e8fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84f878f565614ccd8043f3712c27e8fe", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84f878f565614ccd8043f3712c27e8fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesNegativeTestJSON-1815632198 May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 84f878f565614ccd8043f3712c27e8fe May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1815632198 May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesNegativeTestJSON-1815632198-project May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: a7d7728c54a0441da5cae942997be179 May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesNegativeTestJSON-1815632198-project May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1557800018", "metadata": {"image_type": "test"}}} May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance tempest-invalid-557661228 could not be found. May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'tempest-invalid-557661228', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1557800018', 'metadata': {'image_type': 'test'}}}} May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-557661228 could not be found. May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:19:31.690325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-557661228 could not be found. May 21 21:19:31.693902 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:31.693902 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:31.693902 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:31.693902 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:31.693902 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:31.693902 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:31.693902 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:19:31.693902 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:19:31.693902 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-557661228 could not be found. May 21 21:19:31.693902 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:31.695992 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1250/2432] 10.222.0.49 () {60 vars in 1278 bytes} [Sat May 21 21:19:31 2022] POST /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5/action => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:19:31.704586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-989d403b-1981-4b99-8545-251ffc55f0d0 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Returning 404 to user: Instance tempest-invalid-557661228 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:19:31.710340 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-989d403b-1981-4b99-8545-251ffc55f0d0 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "POST /compute/v2.1/servers/tempest-invalid-557661228/action" status: 404 len: 100 microversion: 2.1 time: 0.041591 May 21 21:19:31.722959 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1183/2433] 10.222.0.49 () {60 vars in 1245 bytes} [Sat May 21 21:19:31 2022] POST /compute/v2.1/servers/tempest-invalid-557661228/action => generated 100 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:19:31.739971 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-12dd3ff5-0d13-44dd-a7fb-51f603a2c8d7 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-682726644"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:31.742649 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-12dd3ff5-0d13-44dd-a7fb-51f603a2c8d7 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2926}} May 21 21:19:31.743354 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-12dd3ff5-0d13-44dd-a7fb-51f603a2c8d7 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-12dd3ff5-0d13-44dd-a7fb-51f603a2c8d7 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Request method failure captured: May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 56 May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVdC1l_fd5J96A6VAukj8oUPQDLnnUo3442-32w-WFOT9V5z06SMv2ZGe0iNbB9lN3IKaff6VI1XAlcv5CI3prsE0_c3119pWEvDqgktSoADSbRITC9lMXziw7ma0JQ7PrCXDIU6i0vZZfABfdyXjV253umGWQ7HgWrRUNwxGc4v7mA May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 84f878f565614ccd8043f3712c27e8fe May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesNegativeTestJSON-1815632198 May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84f878f565614ccd8043f3712c27e8fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84f878f565614ccd8043f3712c27e8fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84f878f565614ccd8043f3712c27e8fe", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84f878f565614ccd8043f3712c27e8fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesNegativeTestJSON-1815632198 May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 84f878f565614ccd8043f3712c27e8fe May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1815632198 May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesNegativeTestJSON-1815632198-project May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a7d7728c54a0441da5cae942997be179 May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesNegativeTestJSON-1815632198-project May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: {"createImage": {"name": "tempest-test-snap-682726644"}} May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-682726644'}}} May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 21 21:19:31.745272 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:31.749923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:31.749923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:31.749923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:31.749923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:31.749923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:31.749923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:19:31.749923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:19:31.749923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 21 21:19:31.749923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:31.749923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-12dd3ff5-0d13-44dd-a7fb-51f603a2c8d7 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:19:31.750735 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-12dd3ff5-0d13-44dd-a7fb-51f603a2c8d7 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.031283 May 21 21:19:31.762044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4d987c49-3e9e-4a7c-b4ad-6163fdf56927 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-955804846"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:31.763005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4d987c49-3e9e-4a7c-b4ad-6163fdf56927 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2926}} May 21 21:19:31.764990 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-4d987c49-3e9e-4a7c-b4ad-6163fdf56927 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4d987c49-3e9e-4a7c-b4ad-6163fdf56927 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Request method failure captured: May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 56 May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVdC1l_fd5J96A6VAukj8oUPQDLnnUo3442-32w-WFOT9V5z06SMv2ZGe0iNbB9lN3IKaff6VI1XAlcv5CI3prsE0_c3119pWEvDqgktSoADSbRITC9lMXziw7ma0JQ7PrCXDIU6i0vZZfABfdyXjV253umGWQ7HgWrRUNwxGc4v7mA May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 84f878f565614ccd8043f3712c27e8fe May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesNegativeTestJSON-1815632198 May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84f878f565614ccd8043f3712c27e8fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84f878f565614ccd8043f3712c27e8fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84f878f565614ccd8043f3712c27e8fe", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84f878f565614ccd8043f3712c27e8fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesNegativeTestJSON-1815632198 May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 84f878f565614ccd8043f3712c27e8fe May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1815632198 May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesNegativeTestJSON-1815632198-project May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: a7d7728c54a0441da5cae942997be179 May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesNegativeTestJSON-1815632198-project May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: {"createImage": {"name": "tempest-test-snap-955804846"}} May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-955804846'}}} May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 21 21:19:31.767391 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:31.770803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:31.770803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:31.770803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:31.770803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:31.770803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:31.770803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:19:31.770803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:19:31.770803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 21 21:19:31.770803 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:31.771251 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1251/2434] 10.222.0.49 () {60 vars in 1274 bytes} [Sat May 21 21:19:31 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:19:31.771416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4d987c49-3e9e-4a7c-b4ad-6163fdf56927 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:19:31.771416 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4d987c49-3e9e-4a7c-b4ad-6163fdf56927 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.013022 May 21 21:19:31.781572 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1184/2435] 10.222.0.49 () {60 vars in 1280 bytes} [Sat May 21 21:19:31 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:19:31.783983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8972ad7a-542f-460b-8943-05cf51c6e18e tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:31.791864 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8972ad7a-542f-460b-8943-05cf51c6e18e tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:31.793408 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8972ad7a-542f-460b-8943-05cf51c6e18e tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:31.793927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8972ad7a-542f-460b-8943-05cf51c6e18e tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:31.795314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8972ad7a-542f-460b-8943-05cf51c6e18e tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:31.796463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8972ad7a-542f-460b-8943-05cf51c6e18e tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:31.819990 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-8972ad7a-542f-460b-8943-05cf51c6e18e tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] HTTP exception thrown: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8972ad7a-542f-460b-8943-05cf51c6e18e tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Request method failure captured: May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 HTTP/1.1 May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVdC1l_fd5J96A6VAukj8oUPQDLnnUo3442-32w-WFOT9V5z06SMv2ZGe0iNbB9lN3IKaff6VI1XAlcv5CI3prsE0_c3119pWEvDqgktSoADSbRITC9lMXziw7ma0JQ7PrCXDIU6i0vZZfABfdyXjV253umGWQ7HgWrRUNwxGc4v7mA May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 84f878f565614ccd8043f3712c27e8fe May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesNegativeTestJSON-1815632198 May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84f878f565614ccd8043f3712c27e8fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84f878f565614ccd8043f3712c27e8fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84f878f565614ccd8043f3712c27e8fe", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84f878f565614ccd8043f3712c27e8fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesNegativeTestJSON-1815632198 May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 84f878f565614ccd8043f3712c27e8fe May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1815632198 May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesNegativeTestJSON-1815632198-project May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a7d7728c54a0441da5cae942997be179 May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesNegativeTestJSON-1815632198-project May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'ff836353-3537-443f-b089-b8b3480308c5'} May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:19:31.822176 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:19:31.835188 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. May 21 21:19:31.835188 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:31.835188 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:31.835188 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:31.835188 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:31.835188 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:31.835188 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:31.835188 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:19:31.835188 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:19:31.835188 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. May 21 21:19:31.835188 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:31.835188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8972ad7a-542f-460b-8943-05cf51c6e18e tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Returning 404 to user: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:19:31.835188 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8972ad7a-542f-460b-8943-05cf51c6e18e tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 404 len: 111 microversion: 2.1 time: 0.048312 May 21 21:19:31.835188 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1252/2436] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:19:31 2022] DELETE /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:19:31.846608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b917e198-bf49-470e-b2df-5ebc7378a6f8 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:31.847858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b917e198-bf49-470e-b2df-5ebc7378a6f8 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] [instance: ff836353-3537-443f-b089-b8b3480308c5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:31.858477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b917e198-bf49-470e-b2df-5ebc7378a6f8 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:31.864263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b917e198-bf49-470e-b2df-5ebc7378a6f8 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:31.864263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b917e198-bf49-470e-b2df-5ebc7378a6f8 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:31.864263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b917e198-bf49-470e-b2df-5ebc7378a6f8 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:31.899938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-684c02a4-7a9e-45fa-bde1-488e79b2e819 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:31.901029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-684c02a4-7a9e-45fa-bde1-488e79b2e819 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:31.910366 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-b917e198-bf49-470e-b2df-5ebc7378a6f8 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] HTTP exception thrown: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b917e198-bf49-470e-b2df-5ebc7378a6f8 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Request method failure captured: May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 HTTP/1.1 May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVdC1l_fd5J96A6VAukj8oUPQDLnnUo3442-32w-WFOT9V5z06SMv2ZGe0iNbB9lN3IKaff6VI1XAlcv5CI3prsE0_c3119pWEvDqgktSoADSbRITC9lMXziw7ma0JQ7PrCXDIU6i0vZZfABfdyXjV253umGWQ7HgWrRUNwxGc4v7mA May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 84f878f565614ccd8043f3712c27e8fe May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesNegativeTestJSON-1815632198 May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84f878f565614ccd8043f3712c27e8fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84f878f565614ccd8043f3712c27e8fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84f878f565614ccd8043f3712c27e8fe", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84f878f565614ccd8043f3712c27e8fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesNegativeTestJSON-1815632198 May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 84f878f565614ccd8043f3712c27e8fe May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1815632198 May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesNegativeTestJSON-1815632198-project May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: a7d7728c54a0441da5cae942997be179 May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesNegativeTestJSON-1815632198-project May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'ff836353-3537-443f-b089-b8b3480308c5'} May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:31.912115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:31.916475 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:31.916475 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:31.916475 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:31.916475 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:19:31.916475 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:19:31.916475 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. May 21 21:19:31.916475 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:31.916475 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b917e198-bf49-470e-b2df-5ebc7378a6f8 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] Returning 404 to user: Instance ff836353-3537-443f-b089-b8b3480308c5 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:19:31.916475 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b917e198-bf49-470e-b2df-5ebc7378a6f8 tempest-ImagesNegativeTestJSON-1815632198 tempest-ImagesNegativeTestJSON-1815632198-project] 10.222.0.49 "GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5" status: 404 len: 111 microversion: 2.1 time: 0.078297 May 21 21:19:31.916475 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1185/2437] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:31 2022] GET /compute/v2.1/servers/ff836353-3537-443f-b089-b8b3480308c5 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:19:31.925386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-684c02a4-7a9e-45fa-bde1-488e79b2e819 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:31.926096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-684c02a4-7a9e-45fa-bde1-488e79b2e819 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:31.927058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-684c02a4-7a9e-45fa-bde1-488e79b2e819 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:31.927655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-684c02a4-7a9e-45fa-bde1-488e79b2e819 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:32.052135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2ada0213-9440-4cd0-9a7f-d1537ab48b81 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:32.061876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2ada0213-9440-4cd0-9a7f-d1537ab48b81 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:32.073552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2ada0213-9440-4cd0-9a7f-d1537ab48b81 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:32.077684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2ada0213-9440-4cd0-9a7f-d1537ab48b81 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:32.078653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2ada0213-9440-4cd0-9a7f-d1537ab48b81 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:32.079285 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2ada0213-9440-4cd0-9a7f-d1537ab48b81 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:32.282008 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-684c02a4-7a9e-45fa-bde1-488e79b2e819 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:32.297920 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-684c02a4-7a9e-45fa-bde1-488e79b2e819 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1506 microversion: 2.1 time: 0.402865 May 21 21:19:32.299215 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1253/2438] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:31 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:19:32.318949 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f041111b-8301-44d6-8c17-5f0c384cf9d9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:32.319614 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f041111b-8301-44d6-8c17-5f0c384cf9d9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:32.329691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f041111b-8301-44d6-8c17-5f0c384cf9d9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:32.330149 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f041111b-8301-44d6-8c17-5f0c384cf9d9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:32.331354 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f041111b-8301-44d6-8c17-5f0c384cf9d9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:32.333754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f041111b-8301-44d6-8c17-5f0c384cf9d9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:32.375633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2ada0213-9440-4cd0-9a7f-d1537ab48b81 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:32.380101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f041111b-8301-44d6-8c17-5f0c384cf9d9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:32.380591 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f041111b-8301-44d6-8c17-5f0c384cf9d9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:32.385641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-f041111b-8301-44d6-8c17-5f0c384cf9d9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lazy-loading 'fault' on Instance uuid 374e77c0-3a9e-4a57-8320-0546efbbf7a3 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:19:32.385787 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2ada0213-9440-4cd0-9a7f-d1537ab48b81 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea" status: 200 len: 1313 microversion: 2.1 time: 0.337468 May 21 21:19:32.387387 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1186/2439] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:32 2022] GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:32.438274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f041111b-8301-44d6-8c17-5f0c384cf9d9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569660c20b044f1aa2df5bdfed1d833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97fa11e94da4e72a9a955f8324c2d5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:32.446588 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f041111b-8301-44d6-8c17-5f0c384cf9d9 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 200 len: 1302 microversion: 2.1 time: 0.146110 May 21 21:19:32.452771 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1254/2440] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:32 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 1302 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:33.242641 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-8090cd7e-deae-4a25-8d7b-602b50365ea9 req-47fdc703-b2b2-4e3e-8356-0b3a56879012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374e77c0-3a9e-4a57-8320-0546efbbf7a3", "name": "network-vif-deleted", "tag": "58141793-884a-4d34-a6e7-df3411a26412"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:33.253671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-8090cd7e-deae-4a25-8d7b-602b50365ea9 req-47fdc703-b2b2-4e3e-8356-0b3a56879012 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:33.254462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-8090cd7e-deae-4a25-8d7b-602b50365ea9 req-47fdc703-b2b2-4e3e-8356-0b3a56879012 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:33.270392 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-8090cd7e-deae-4a25-8d7b-602b50365ea9 req-47fdc703-b2b2-4e3e-8356-0b3a56879012 service nova] Creating event network-vif-deleted:58141793-884a-4d34-a6e7-df3411a26412 for instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 on nch2-master-1 May 21 21:19:33.275822 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-8090cd7e-deae-4a25-8d7b-602b50365ea9 req-47fdc703-b2b2-4e3e-8356-0b3a56879012 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037333 May 21 21:19:33.277213 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1187/2441] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:33.317406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b6d2c04e-1f1c-47a8-82bb-2a169f6fa064 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:33.318215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b6d2c04e-1f1c-47a8-82bb-2a169f6fa064 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:33.327732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6d2c04e-1f1c-47a8-82bb-2a169f6fa064 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:33.328362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6d2c04e-1f1c-47a8-82bb-2a169f6fa064 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:33.329900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6d2c04e-1f1c-47a8-82bb-2a169f6fa064 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:33.331425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6d2c04e-1f1c-47a8-82bb-2a169f6fa064 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:33.355294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:33.403467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3b960ef8-0fe5-4e7f-9508-16629714c40b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:33.405832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3b960ef8-0fe5-4e7f-9508-16629714c40b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:33.413599 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b960ef8-0fe5-4e7f-9508-16629714c40b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:33.414378 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b960ef8-0fe5-4e7f-9508-16629714c40b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:33.415424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b960ef8-0fe5-4e7f-9508-16629714c40b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:33.416097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b960ef8-0fe5-4e7f-9508-16629714c40b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:33.659665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3b960ef8-0fe5-4e7f-9508-16629714c40b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:33.670609 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3b960ef8-0fe5-4e7f-9508-16629714c40b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea" status: 200 len: 1313 microversion: 2.1 time: 0.271403 May 21 21:19:33.682084 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1188/2442] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:33 2022] GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:19:33.689139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d96b2c92-b4bb-457f-b469-fb65a5d5c990 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:33.690471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d96b2c92-b4bb-457f-b469-fb65a5d5c990 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:33.696743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d96b2c92-b4bb-457f-b469-fb65a5d5c990 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:33.697202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d96b2c92-b4bb-457f-b469-fb65a5d5c990 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:33.697994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d96b2c92-b4bb-457f-b469-fb65a5d5c990 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:33.698604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d96b2c92-b4bb-457f-b469-fb65a5d5c990 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:33.721921 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-d96b2c92-b4bb-457f-b469-fb65a5d5c990 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] HTTP exception thrown: Instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 could not be found. May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d96b2c92-b4bb-457f-b469-fb65a5d5c990 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Request method failure captured: May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 HTTP/1.1 May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbl2GGOyhWnIQCo9Dy6hXXaekAe2KkKGf28Bu-9KrnRKxrmtThyB71Nn4r6R-488E9H8X44TsXQcgwmtriG9f_-qqEWVOkF89BpohQ47_XBStbc2DTAuHclzWryZ611cp3YzgmgGw_W_5ok9Gm_7C9YxKnVb2Q9sl8Fh5UrHosmgBw May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: a97fa11e94da4e72a9a955f8324c2d5e May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersTestMultiNic-1771539510 May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a97fa11e94da4e72a9a955f8324c2d5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a97fa11e94da4e72a9a955f8324c2d5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a97fa11e94da4e72a9a955f8324c2d5e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a97fa11e94da4e72a9a955f8324c2d5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersTestMultiNic-1771539510 May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: a97fa11e94da4e72a9a955f8324c2d5e May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersTestMultiNic-1771539510 May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersTestMultiNic-1771539510-project May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 569660c20b044f1aa2df5bdfed1d833c May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersTestMultiNic-1771539510-project May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 could not be found. May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '374e77c0-3a9e-4a57-8320-0546efbbf7a3'} May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 could not be found. May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 could not be found. May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:33.723811 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:33.727707 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:33.727707 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:33.727707 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:33.727707 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:19:33.727707 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:19:33.727707 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 could not be found. May 21 21:19:33.727707 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:33.727707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d96b2c92-b4bb-457f-b469-fb65a5d5c990 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Returning 404 to user: Instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:19:33.727707 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d96b2c92-b4bb-457f-b469-fb65a5d5c990 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 404 len: 111 microversion: 2.1 time: 0.041867 May 21 21:19:33.730907 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1189/2443] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:33 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:19:33.743746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b6d2c04e-1f1c-47a8-82bb-2a169f6fa064 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:33.754847 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b6d2c04e-1f1c-47a8-82bb-2a169f6fa064 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1506 microversion: 2.1 time: 0.442892 May 21 21:19:33.755912 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1255/2444] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:33 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1506 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:34.693403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5c197b2d-f799-42e3-9e3a-d023e88a5381 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:34.694760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5c197b2d-f799-42e3-9e3a-d023e88a5381 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:34.715766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c197b2d-f799-42e3-9e3a-d023e88a5381 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:34.717720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c197b2d-f799-42e3-9e3a-d023e88a5381 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:34.719251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c197b2d-f799-42e3-9e3a-d023e88a5381 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:34.720142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c197b2d-f799-42e3-9e3a-d023e88a5381 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:34.778844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bfa042f7-86a4-47f9-bab5-43f25c399041 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:34.780981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bfa042f7-86a4-47f9-bab5-43f25c399041 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:34.802824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bfa042f7-86a4-47f9-bab5-43f25c399041 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:34.805254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bfa042f7-86a4-47f9-bab5-43f25c399041 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:34.807505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bfa042f7-86a4-47f9-bab5-43f25c399041 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:34.808639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bfa042f7-86a4-47f9-bab5-43f25c399041 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:35.218907 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5c197b2d-f799-42e3-9e3a-d023e88a5381 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:35.231762 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5c197b2d-f799-42e3-9e3a-d023e88a5381 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea" status: 200 len: 1313 microversion: 2.1 time: 0.543172 May 21 21:19:35.238214 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1190/2445] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:34 2022] GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea => generated 1313 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:35.250794 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-22edbdbf-f3b6-44f5-ab4c-b86e4b7d6b6c req-1a6570c1-8677-47bc-ae16-8da9a7c151c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6825da6e-8b02-486c-8461-41f10572c810", "name": "network-vif-plugged", "status": "completed", "tag": "976547b8-31f4-469e-8c56-e9286444cdde"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:35.264391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-22edbdbf-f3b6-44f5-ab4c-b86e4b7d6b6c req-1a6570c1-8677-47bc-ae16-8da9a7c151c5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:35.264784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-22edbdbf-f3b6-44f5-ab4c-b86e4b7d6b6c req-1a6570c1-8677-47bc-ae16-8da9a7c151c5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:35.300508 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-22edbdbf-f3b6-44f5-ab4c-b86e4b7d6b6c req-1a6570c1-8677-47bc-ae16-8da9a7c151c5 service nova] Creating event network-vif-plugged:976547b8-31f4-469e-8c56-e9286444cdde for instance 6825da6e-8b02-486c-8461-41f10572c810 on nch1-master-1 May 21 21:19:35.305878 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-22edbdbf-f3b6-44f5-ab4c-b86e4b7d6b6c req-1a6570c1-8677-47bc-ae16-8da9a7c151c5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066196 May 21 21:19:35.306661 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1191/2446] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:35.350595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bfa042f7-86a4-47f9-bab5-43f25c399041 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:35.367219 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bfa042f7-86a4-47f9-bab5-43f25c399041 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1506 microversion: 2.1 time: 0.596147 May 21 21:19:35.369416 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1256/2447] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:34 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1506 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:19:35.719586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f1c7c51c-40d2-4b9e-bbc8-25ec76745f94 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1070236295", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:35.824567 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-f1c7c51c-40d2-4b9e-bbc8-25ec76745f94 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] validate_networks() for None {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:19:36.208120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f1c7c51c-40d2-4b9e-bbc8-25ec76745f94 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:19:36.208575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f1c7c51c-40d2-4b9e-bbc8-25ec76745f94 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:19:36.209242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f1c7c51c-40d2-4b9e-bbc8-25ec76745f94 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:19:36.209684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f1c7c51c-40d2-4b9e-bbc8-25ec76745f94 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:19:36.210797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f1c7c51c-40d2-4b9e-bbc8-25ec76745f94 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:19:36.234171 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1c7c51c-40d2-4b9e-bbc8-25ec76745f94 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:36.234621 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1c7c51c-40d2-4b9e-bbc8-25ec76745f94 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:36.235429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1c7c51c-40d2-4b9e-bbc8-25ec76745f94 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:36.235863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1c7c51c-40d2-4b9e-bbc8-25ec76745f94 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:36.254736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f5a3b520-73a9-4c5f-9ec7-2c543b640af1 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:36.255337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f5a3b520-73a9-4c5f-9ec7-2c543b640af1 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:36.264367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-f1c7c51c-40d2-4b9e-bbc8-25ec76745f94 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Getting quotas for project 496224b299024b6d80653bc12f672f8c. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:36.267134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-f1c7c51c-40d2-4b9e-bbc8-25ec76745f94 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Getting quotas for user 8b6c47e9586f4a70b86651a35f9bcbbb and project 496224b299024b6d80653bc12f672f8c. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:36.268059 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5a3b520-73a9-4c5f-9ec7-2c543b640af1 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:36.268543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5a3b520-73a9-4c5f-9ec7-2c543b640af1 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:36.269336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5a3b520-73a9-4c5f-9ec7-2c543b640af1 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:36.269770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5a3b520-73a9-4c5f-9ec7-2c543b640af1 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:36.282196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f1c7c51c-40d2-4b9e-bbc8-25ec76745f94 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:19:36.294994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f1c7c51c-40d2-4b9e-bbc8-25ec76745f94 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:19:36.492350 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f1c7c51c-40d2-4b9e-bbc8-25ec76745f94 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.048064 May 21 21:19:36.498317 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1192/2448] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:19:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:19:36.507978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-25a5fc5f-6c10-4a83-83b6-1c418625583b tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Calling method '.version_select at 0x7fc81ad769d0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:36.558824 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-25a5fc5f-6c10-4a83-83b6-1c418625583b tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] 10.222.0.49 "GET /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b" status: 200 len: 636 microversion: 2.1 time: 0.059366 May 21 21:19:36.560000 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1193/2449] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:19:36 2022] GET /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b => generated 636 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:36.565430 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0c763e64-9ef5-4574-9d3a-a4edeba82b3b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:36.566340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0c763e64-9ef5-4574-9d3a-a4edeba82b3b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:36.574437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c763e64-9ef5-4574-9d3a-a4edeba82b3b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:36.576038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c763e64-9ef5-4574-9d3a-a4edeba82b3b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:36.577086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c763e64-9ef5-4574-9d3a-a4edeba82b3b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:36.577736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c763e64-9ef5-4574-9d3a-a4edeba82b3b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:36.766965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0c763e64-9ef5-4574-9d3a-a4edeba82b3b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:36.777859 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0c763e64-9ef5-4574-9d3a-a4edeba82b3b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1506 microversion: 2.1 time: 0.216568 May 21 21:19:36.779982 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1194/2450] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:36 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:36.785276 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b54da1a0-e4f6-4655-8b8f-3a2309b2d229 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:36.785977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b54da1a0-e4f6-4655-8b8f-3a2309b2d229 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:36.863943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b54da1a0-e4f6-4655-8b8f-3a2309b2d229 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:36.876381 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b54da1a0-e4f6-4655-8b8f-3a2309b2d229 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1217 microversion: 2.1 time: 0.095000 May 21 21:19:36.886551 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1195/2451] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:36 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:36.896640 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a47edd89-54d7-4a0c-87b4-0bc6f913ce04 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Action: 'update_all', calling method: .version_select at 0x7fc81ad2ec10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:36.966700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-a47edd89-54d7-4a0c-87b4-0bc6f913ce04 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Getting quotas for project ba3a2f9c3a8e4342898c632959b35b47. Resources: dict_keys(['metadata_items']) {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:36.970975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:36.975144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-a47edd89-54d7-4a0c-87b4-0bc6f913ce04 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Getting quotas for user 714278ffc37d4dcc8c6c5090754966b5 and project ba3a2f9c3a8e4342898c632959b35b47. Resources: dict_keys(['metadata_items']) {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:37.018055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f5a3b520-73a9-4c5f-9ec7-2c543b640af1 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:37.031896 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f5a3b520-73a9-4c5f-9ec7-2c543b640af1 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea" status: 200 len: 1313 microversion: 2.1 time: 0.780895 May 21 21:19:37.040705 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1257/2452] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:36 2022] GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea => generated 1313 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:37.716761 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a47edd89-54d7-4a0c-87b4-0bc6f913ce04 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] 10.222.0.49 "PUT /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.828812 May 21 21:19:37.716761 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1196/2453] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:19:36 2022] PUT /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata => generated 61 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:19:37.722649 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5098df01-56a3-428f-a935-3fffdc6e5fa6 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Calling method '.version_select at 0x7fc81bb92af0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:37.795925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f70c0113-226a-4376-931e-c072387f4c73 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:37.797445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f70c0113-226a-4376-931e-c072387f4c73 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:37.805307 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f70c0113-226a-4376-931e-c072387f4c73 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:37.805981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f70c0113-226a-4376-931e-c072387f4c73 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:37.807113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f70c0113-226a-4376-931e-c072387f4c73 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:37.807776 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f70c0113-226a-4376-931e-c072387f4c73 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:38.433979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f70c0113-226a-4376-931e-c072387f4c73 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:38.448883 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5098df01-56a3-428f-a935-3fffdc6e5fa6 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] 10.222.0.49 "DELETE /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.730965 May 21 21:19:38.449929 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1258/2454] 10.222.0.49 () {58 vars in 1295 bytes} [Sat May 21 21:19:37 2022] DELETE /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata/os_version => generated 0 bytes in 733 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 21:19:38.451542 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f70c0113-226a-4376-931e-c072387f4c73 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1506 microversion: 2.1 time: 0.660403 May 21 21:19:38.452403 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1197/2455] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:37 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1506 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:19:38.457409 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-91d7244e-df8f-4b9a-afbd-511ce0ab387c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:38.462750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-91d7244e-df8f-4b9a-afbd-511ce0ab387c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:38.467861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d05d1904-290b-4868-bead-1b72b6abad12 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:38.474811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-91d7244e-df8f-4b9a-afbd-511ce0ab387c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:38.482852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-91d7244e-df8f-4b9a-afbd-511ce0ab387c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:38.482852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-91d7244e-df8f-4b9a-afbd-511ce0ab387c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:38.483350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d05d1904-290b-4868-bead-1b72b6abad12 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:38.483444 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-91d7244e-df8f-4b9a-afbd-511ce0ab387c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:38.496127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d05d1904-290b-4868-bead-1b72b6abad12 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:38.511694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d05d1904-290b-4868-bead-1b72b6abad12 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:38.515017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d05d1904-290b-4868-bead-1b72b6abad12 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:38.515997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d05d1904-290b-4868-bead-1b72b6abad12 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:38.624154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d05d1904-290b-4868-bead-1b72b6abad12 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:38.636503 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d05d1904-290b-4868-bead-1b72b6abad12 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1221 microversion: 2.1 time: 0.183964 May 21 21:19:38.637103 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1259/2456] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:38 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1221 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:38.642529 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1f68830e-dd48-44d1-bf2f-d74197cea43f tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Calling method '.version_select at 0x7fc82d079550>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:38.712822 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1f68830e-dd48-44d1-bf2f-d74197cea43f tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] 10.222.0.49 "GET /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata" status: 200 len: 37 microversion: 2.1 time: 0.074128 May 21 21:19:38.714070 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1260/2457] 10.222.0.49 () {58 vars in 1259 bytes} [Sat May 21 21:19:38 2022] GET /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata => generated 37 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:19:38.723190 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-c84322f0-c55b-4a56-a339-d4545be20e92 req-f4a00b4a-1641-4785-8695-b7853430b7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c83883e1-bf1c-43dd-a43a-3c82e4a3dbea", "name": "network-vif-plugged", "status": "completed", "tag": "283ab589-fb64-424b-a0f0-273a885f9a8c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:38.740041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c84322f0-c55b-4a56-a339-d4545be20e92 req-f4a00b4a-1641-4785-8695-b7853430b7b3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:38.740897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c84322f0-c55b-4a56-a339-d4545be20e92 req-f4a00b4a-1641-4785-8695-b7853430b7b3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:38.755935 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-c84322f0-c55b-4a56-a339-d4545be20e92 req-f4a00b4a-1641-4785-8695-b7853430b7b3 service nova] Creating event network-vif-plugged:283ab589-fb64-424b-a0f0-273a885f9a8c for instance c83883e1-bf1c-43dd-a43a-3c82e4a3dbea on nch1-master-1 May 21 21:19:38.763946 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-c84322f0-c55b-4a56-a339-d4545be20e92 req-f4a00b4a-1641-4785-8695-b7853430b7b3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045522 May 21 21:19:38.765394 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1261/2458] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:38.773522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bd6b54bb-87fb-4ff3-9e31-dd1358c0ba63 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:38.774444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bd6b54bb-87fb-4ff3-9e31-dd1358c0ba63 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:38.783410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd6b54bb-87fb-4ff3-9e31-dd1358c0ba63 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:38.784269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd6b54bb-87fb-4ff3-9e31-dd1358c0ba63 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:38.785327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd6b54bb-87fb-4ff3-9e31-dd1358c0ba63 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:38.786111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd6b54bb-87fb-4ff3-9e31-dd1358c0ba63 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:38.807081 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-bd6b54bb-87fb-4ff3-9e31-dd1358c0ba63 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] HTTP exception thrown: Instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 could not be found. May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bd6b54bb-87fb-4ff3-9e31-dd1358c0ba63 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Request method failure captured: May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 HTTP/1.1 May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVbl2GGOyhWnIQCo9Dy6hXXaekAe2KkKGf28Bu-9KrnRKxrmtThyB71Nn4r6R-488E9H8X44TsXQcgwmtriG9f_-qqEWVOkF89BpohQ47_XBStbc2DTAuHclzWryZ611cp3YzgmgGw_W_5ok9Gm_7C9YxKnVb2Q9sl8Fh5UrHosmgBw May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: a97fa11e94da4e72a9a955f8324c2d5e May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersTestMultiNic-1771539510 May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a97fa11e94da4e72a9a955f8324c2d5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a97fa11e94da4e72a9a955f8324c2d5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a97fa11e94da4e72a9a955f8324c2d5e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a97fa11e94da4e72a9a955f8324c2d5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersTestMultiNic-1771539510 May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: a97fa11e94da4e72a9a955f8324c2d5e May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersTestMultiNic-1771539510 May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersTestMultiNic-1771539510-project May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 569660c20b044f1aa2df5bdfed1d833c May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersTestMultiNic-1771539510-project May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 could not be found. May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '374e77c0-3a9e-4a57-8320-0546efbbf7a3'} May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 could not be found. May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:19:38.809533 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:19:38.813707 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 could not be found. May 21 21:19:38.813707 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:38.813707 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:38.813707 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:38.813707 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:38.813707 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:38.813707 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:38.813707 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:19:38.813707 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:19:38.813707 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 could not be found. May 21 21:19:38.813707 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:38.816865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bd6b54bb-87fb-4ff3-9e31-dd1358c0ba63 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Returning 404 to user: Instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:19:38.818334 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bd6b54bb-87fb-4ff3-9e31-dd1358c0ba63 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 404 len: 111 microversion: 2.1 time: 0.050003 May 21 21:19:38.819445 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1262/2459] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:19:38 2022] DELETE /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:19:38.825183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0421bfb5-92f3-4d11-8015-278430abf561 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Action: 'update_all', calling method: .version_select at 0x7fc81b8de820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:38.837891 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-91d7244e-df8f-4b9a-afbd-511ce0ab387c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:38.844883 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-91d7244e-df8f-4b9a-afbd-511ce0ab387c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea" status: 200 len: 1313 microversion: 2.1 time: 0.391108 May 21 21:19:38.845459 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1198/2460] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:38 2022] GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:38.876428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3513d1b6-32c3-4609-8487-45ef45d0459f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:38.877210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3513d1b6-32c3-4609-8487-45ef45d0459f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 374e77c0-3a9e-4a57-8320-0546efbbf7a3] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:38.894161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3513d1b6-32c3-4609-8487-45ef45d0459f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:38.894658 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3513d1b6-32c3-4609-8487-45ef45d0459f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:38.895502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3513d1b6-32c3-4609-8487-45ef45d0459f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:38.895949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3513d1b6-32c3-4609-8487-45ef45d0459f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:38.902601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-0421bfb5-92f3-4d11-8015-278430abf561 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Getting quotas for project ba3a2f9c3a8e4342898c632959b35b47. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:38.911673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-0421bfb5-92f3-4d11-8015-278430abf561 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Getting quotas for user 714278ffc37d4dcc8c6c5090754966b5 and project ba3a2f9c3a8e4342898c632959b35b47. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:38.947184 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-3513d1b6-32c3-4609-8487-45ef45d0459f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] HTTP exception thrown: Instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 could not be found. May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3513d1b6-32c3-4609-8487-45ef45d0459f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Request method failure captured: May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 HTTP/1.1 May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbl2GGOyhWnIQCo9Dy6hXXaekAe2KkKGf28Bu-9KrnRKxrmtThyB71Nn4r6R-488E9H8X44TsXQcgwmtriG9f_-qqEWVOkF89BpohQ47_XBStbc2DTAuHclzWryZ611cp3YzgmgGw_W_5ok9Gm_7C9YxKnVb2Q9sl8Fh5UrHosmgBw May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: a97fa11e94da4e72a9a955f8324c2d5e May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersTestMultiNic-1771539510 May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a97fa11e94da4e72a9a955f8324c2d5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a97fa11e94da4e72a9a955f8324c2d5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a97fa11e94da4e72a9a955f8324c2d5e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a97fa11e94da4e72a9a955f8324c2d5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersTestMultiNic-1771539510 May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: a97fa11e94da4e72a9a955f8324c2d5e May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersTestMultiNic-1771539510 May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersTestMultiNic-1771539510-project May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 569660c20b044f1aa2df5bdfed1d833c May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersTestMultiNic-1771539510-project May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 could not be found. May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '374e77c0-3a9e-4a57-8320-0546efbbf7a3'} May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 could not be found. May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 could not be found. May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:38.949239 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:38.953910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:38.953910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:38.953910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:38.953910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:19:38.953910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:19:38.953910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 could not be found. May 21 21:19:38.953910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:38.958172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3513d1b6-32c3-4609-8487-45ef45d0459f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Returning 404 to user: Instance 374e77c0-3a9e-4a57-8320-0546efbbf7a3 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:19:38.959282 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3513d1b6-32c3-4609-8487-45ef45d0459f tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3" status: 404 len: 111 microversion: 2.1 time: 0.112895 May 21 21:19:38.963005 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1199/2461] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:38 2022] GET /compute/v2.1/servers/374e77c0-3a9e-4a57-8320-0546efbbf7a3 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:19:38.983769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1fe5bb6b-0e72-40ba-a263-28d5c5cc156d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:38.985468 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1fe5bb6b-0e72-40ba-a263-28d5c5cc156d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:38.992687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1fe5bb6b-0e72-40ba-a263-28d5c5cc156d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:38.993543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1fe5bb6b-0e72-40ba-a263-28d5c5cc156d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:38.994516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1fe5bb6b-0e72-40ba-a263-28d5c5cc156d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:38.995121 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1fe5bb6b-0e72-40ba-a263-28d5c5cc156d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:39.003393 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:39.016922 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-1fe5bb6b-0e72-40ba-a263-28d5c5cc156d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] HTTP exception thrown: Instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 could not be found. May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1fe5bb6b-0e72-40ba-a263-28d5c5cc156d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Request method failure captured: May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 HTTP/1.1 May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbl2GGOyhWnIQCo9Dy6hXXaekAe2KkKGf28Bu-9KrnRKxrmtThyB71Nn4r6R-488E9H8X44TsXQcgwmtriG9f_-qqEWVOkF89BpohQ47_XBStbc2DTAuHclzWryZ611cp3YzgmgGw_W_5ok9Gm_7C9YxKnVb2Q9sl8Fh5UrHosmgBw May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: a97fa11e94da4e72a9a955f8324c2d5e May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersTestMultiNic-1771539510 May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a97fa11e94da4e72a9a955f8324c2d5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a97fa11e94da4e72a9a955f8324c2d5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a97fa11e94da4e72a9a955f8324c2d5e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a97fa11e94da4e72a9a955f8324c2d5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersTestMultiNic-1771539510 May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: a97fa11e94da4e72a9a955f8324c2d5e May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersTestMultiNic-1771539510 May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersTestMultiNic-1771539510-project May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 569660c20b044f1aa2df5bdfed1d833c May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersTestMultiNic-1771539510-project May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 could not be found. May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '7f63b08d-aaa7-4639-827f-d32bc60a78c8'} May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 could not be found. May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:19:39.018711 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:19:39.022973 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 could not be found. May 21 21:19:39.022973 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:39.022973 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:39.022973 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:39.022973 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:39.022973 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:39.022973 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:39.022973 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:19:39.022973 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:19:39.022973 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 could not be found. May 21 21:19:39.022973 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:39.045183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1fe5bb6b-0e72-40ba-a263-28d5c5cc156d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Returning 404 to user: Instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:19:39.046090 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1fe5bb6b-0e72-40ba-a263-28d5c5cc156d tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 404 len: 111 microversion: 2.1 time: 0.078398 May 21 21:19:39.046929 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1200/2462] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:19:38 2022] DELETE /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:19:39.055969 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7e1455b8-6beb-42e6-b881-114ee56018f0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:39.056746 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7e1455b8-6beb-42e6-b881-114ee56018f0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] [instance: 7f63b08d-aaa7-4639-827f-d32bc60a78c8] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:39.064565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e1455b8-6beb-42e6-b881-114ee56018f0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:39.064774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e1455b8-6beb-42e6-b881-114ee56018f0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:39.066244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e1455b8-6beb-42e6-b881-114ee56018f0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:39.066698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e1455b8-6beb-42e6-b881-114ee56018f0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:39.085717 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-7e1455b8-6beb-42e6-b881-114ee56018f0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] HTTP exception thrown: Instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 could not be found. May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7e1455b8-6beb-42e6-b881-114ee56018f0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Request method failure captured: May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 HTTP/1.1 May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbl2GGOyhWnIQCo9Dy6hXXaekAe2KkKGf28Bu-9KrnRKxrmtThyB71Nn4r6R-488E9H8X44TsXQcgwmtriG9f_-qqEWVOkF89BpohQ47_XBStbc2DTAuHclzWryZ611cp3YzgmgGw_W_5ok9Gm_7C9YxKnVb2Q9sl8Fh5UrHosmgBw May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: a97fa11e94da4e72a9a955f8324c2d5e May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersTestMultiNic-1771539510 May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a97fa11e94da4e72a9a955f8324c2d5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a97fa11e94da4e72a9a955f8324c2d5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a97fa11e94da4e72a9a955f8324c2d5e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a97fa11e94da4e72a9a955f8324c2d5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersTestMultiNic-1771539510 May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: a97fa11e94da4e72a9a955f8324c2d5e May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersTestMultiNic-1771539510 May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersTestMultiNic-1771539510-project May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 569660c20b044f1aa2df5bdfed1d833c May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersTestMultiNic-1771539510-project May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 could not be found. May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '7f63b08d-aaa7-4639-827f-d32bc60a78c8'} May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 could not be found. May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 could not be found. May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:39.087564 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:39.090936 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:39.090936 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:39.090936 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:39.090936 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:19:39.090936 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:19:39.090936 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 could not be found. May 21 21:19:39.090936 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:39.090936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7e1455b8-6beb-42e6-b881-114ee56018f0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] Returning 404 to user: Instance 7f63b08d-aaa7-4639-827f-d32bc60a78c8 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:19:39.090936 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7e1455b8-6beb-42e6-b881-114ee56018f0 tempest-ServersTestMultiNic-1771539510 tempest-ServersTestMultiNic-1771539510-project] 10.222.0.49 "GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8" status: 404 len: 111 microversion: 2.1 time: 0.038024 May 21 21:19:39.096549 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1201/2463] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:39 2022] GET /compute/v2.1/servers/7f63b08d-aaa7-4639-827f-d32bc60a78c8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:19:39.478328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-abb83292-afc9-4dfe-96f1-b25d9b449412 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:39.479419 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-abb83292-afc9-4dfe-96f1-b25d9b449412 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:39.499495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-abb83292-afc9-4dfe-96f1-b25d9b449412 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:39.500933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-abb83292-afc9-4dfe-96f1-b25d9b449412 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:39.501883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-abb83292-afc9-4dfe-96f1-b25d9b449412 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:39.502937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-abb83292-afc9-4dfe-96f1-b25d9b449412 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:39.529445 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0421bfb5-92f3-4d11-8015-278430abf561 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] 10.222.0.49 "PUT /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.707661 May 21 21:19:39.530589 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1263/2464] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:19:38 2022] PUT /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata => generated 61 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:19:39.541149 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5b3d592e-2001-4c71-97ca-270399c0d258 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Calling method '.version_select at 0x7fc82d0ce5e0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:39.612172 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5b3d592e-2001-4c71-97ca-270399c0d258 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] 10.222.0.49 "GET /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.075776 May 21 21:19:39.618146 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1264/2465] 10.222.0.49 () {58 vars in 1289 bytes} [Sat May 21 21:19:39 2022] GET /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata/os_distro => generated 33 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 21 21:19:39.624044 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-93246196-6382-4efc-b7cf-630110d2ec3c tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Action: 'update_all', calling method: .version_select at 0x7fc82cfa9430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:39.710681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-93246196-6382-4efc-b7cf-630110d2ec3c tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Getting quotas for project ba3a2f9c3a8e4342898c632959b35b47. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:39.721972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-93246196-6382-4efc-b7cf-630110d2ec3c tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Getting quotas for user 714278ffc37d4dcc8c6c5090754966b5 and project ba3a2f9c3a8e4342898c632959b35b47. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:39.889573 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-abb83292-afc9-4dfe-96f1-b25d9b449412 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:39.897373 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-abb83292-afc9-4dfe-96f1-b25d9b449412 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1506 microversion: 2.1 time: 0.431437 May 21 21:19:39.900464 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1202/2466] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:39 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:39.903303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-938a498d-61e7-457f-b512-2cdd239cdb18 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:39.904716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-938a498d-61e7-457f-b512-2cdd239cdb18 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:39.913555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-938a498d-61e7-457f-b512-2cdd239cdb18 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:39.914119 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-938a498d-61e7-457f-b512-2cdd239cdb18 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:39.914987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-938a498d-61e7-457f-b512-2cdd239cdb18 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:39.915501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-938a498d-61e7-457f-b512-2cdd239cdb18 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:40.105106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-938a498d-61e7-457f-b512-2cdd239cdb18 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:40.113780 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-938a498d-61e7-457f-b512-2cdd239cdb18 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1277 microversion: 2.1 time: 0.214138 May 21 21:19:40.116257 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1203/2467] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:39 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:40.133593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-046155c0-3d5a-45b4-84ab-ef704784ba9f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:40.135664 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-93246196-6382-4efc-b7cf-630110d2ec3c tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] 10.222.0.49 "PUT /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.516112 May 21 21:19:40.137296 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1265/2468] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:19:39 2022] PUT /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata => generated 61 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:19:40.142838 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-046155c0-3d5a-45b4-84ab-ef704784ba9f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:40.147461 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a3a3dd90-3e1e-49b0-9ca8-bd463e33cc99 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Calling method '.version_select at 0x7fc81bcedf70>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:40.162899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-046155c0-3d5a-45b4-84ab-ef704784ba9f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:40.163553 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-046155c0-3d5a-45b4-84ab-ef704784ba9f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:40.164566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-046155c0-3d5a-45b4-84ab-ef704784ba9f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:40.165150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-046155c0-3d5a-45b4-84ab-ef704784ba9f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:40.212865 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a3a3dd90-3e1e-49b0-9ca8-bd463e33cc99 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] 10.222.0.49 "GET /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.069185 May 21 21:19:40.213906 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1266/2469] 10.222.0.49 () {58 vars in 1259 bytes} [Sat May 21 21:19:40 2022] GET /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata => generated 61 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:19:40.224370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7984874f-2163-437f-964f-2ac24d203caf tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Action: 'update_all', calling method: .version_select at 0x7fc82d0ce8b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:40.308988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-7984874f-2163-437f-964f-2ac24d203caf tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Getting quotas for project ba3a2f9c3a8e4342898c632959b35b47. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:40.316855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-7984874f-2163-437f-964f-2ac24d203caf tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Getting quotas for user 714278ffc37d4dcc8c6c5090754966b5 and project ba3a2f9c3a8e4342898c632959b35b47. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:40.725805 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7984874f-2163-437f-964f-2ac24d203caf tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] 10.222.0.49 "PUT /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.505174 May 21 21:19:40.726912 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1267/2470] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:19:40 2022] PUT /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata => generated 61 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 21 21:19:40.736418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b2642540-f6b1-40f8-8e5e-2edf78a0054d tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Action: 'update_all', calling method: .version_select at 0x7fc81b6b00d0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:40.833269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-b2642540-f6b1-40f8-8e5e-2edf78a0054d tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Getting quotas for project ba3a2f9c3a8e4342898c632959b35b47. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:40.845778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-b2642540-f6b1-40f8-8e5e-2edf78a0054d tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Getting quotas for user 714278ffc37d4dcc8c6c5090754966b5 and project ba3a2f9c3a8e4342898c632959b35b47. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:40.867971 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-046155c0-3d5a-45b4-84ab-ef704784ba9f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:40.879355 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-046155c0-3d5a-45b4-84ab-ef704784ba9f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea" status: 200 len: 1313 microversion: 2.1 time: 0.751437 May 21 21:19:40.884450 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1204/2471] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:40 2022] GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea => generated 1313 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:40.924472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1737b662-cc91-4162-a399-6afd368cfd31 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:40.926207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1737b662-cc91-4162-a399-6afd368cfd31 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:40.938963 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1737b662-cc91-4162-a399-6afd368cfd31 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:40.943502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1737b662-cc91-4162-a399-6afd368cfd31 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:40.945052 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1737b662-cc91-4162-a399-6afd368cfd31 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:40.945704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1737b662-cc91-4162-a399-6afd368cfd31 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:41.402385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1737b662-cc91-4162-a399-6afd368cfd31 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:41.412135 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1737b662-cc91-4162-a399-6afd368cfd31 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1506 microversion: 2.1 time: 0.500539 May 21 21:19:41.413344 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1205/2472] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:40 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1506 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:19:41.418186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-54373a2d-4b71-48b1-bd31-8e47272e3062 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:41.419083 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-54373a2d-4b71-48b1-bd31-8e47272e3062 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:41.431575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54373a2d-4b71-48b1-bd31-8e47272e3062 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:41.432263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54373a2d-4b71-48b1-bd31-8e47272e3062 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:41.433235 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54373a2d-4b71-48b1-bd31-8e47272e3062 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:41.433865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54373a2d-4b71-48b1-bd31-8e47272e3062 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:41.518556 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b2642540-f6b1-40f8-8e5e-2edf78a0054d tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] 10.222.0.49 "PUT /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata" status: 200 len: 64 microversion: 2.1 time: 0.786817 May 21 21:19:41.519247 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1268/2473] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:19:40 2022] PUT /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata => generated 64 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 21 21:19:41.528109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5e5c1efa-85b2-4ae0-83da-ed8b08e256b7 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Calling method '.version_select at 0x7fc82d11f310>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:41.587273 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5e5c1efa-85b2-4ae0-83da-ed8b08e256b7 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] 10.222.0.49 "GET /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata" status: 200 len: 64 microversion: 2.1 time: 0.062995 May 21 21:19:41.588050 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1269/2474] 10.222.0.49 () {58 vars in 1259 bytes} [Sat May 21 21:19:41 2022] GET /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata => generated 64 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:19:41.599136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fb0d3ee4-eee0-4194-bc66-2c7024791ce0 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Action: 'update_all', calling method: .version_select at 0x7fc82d0ce4c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:41.623325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-54373a2d-4b71-48b1-bd31-8e47272e3062 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:41.639238 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-54373a2d-4b71-48b1-bd31-8e47272e3062 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1275 microversion: 2.1 time: 0.221092 May 21 21:19:41.639238 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1206/2475] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:41 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1275 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:41.646968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:41.655600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-fb0d3ee4-eee0-4194-bc66-2c7024791ce0 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Getting quotas for project ba3a2f9c3a8e4342898c632959b35b47. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:41.669578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-fb0d3ee4-eee0-4194-bc66-2c7024791ce0 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Getting quotas for user 714278ffc37d4dcc8c6c5090754966b5 and project ba3a2f9c3a8e4342898c632959b35b47. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:41.900899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fe6efe0c-6bb3-4e70-9fc8-4c89070a177e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:41.901514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fe6efe0c-6bb3-4e70-9fc8-4c89070a177e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:41.914666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fe6efe0c-6bb3-4e70-9fc8-4c89070a177e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:41.915131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fe6efe0c-6bb3-4e70-9fc8-4c89070a177e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:41.918208 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fe6efe0c-6bb3-4e70-9fc8-4c89070a177e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:41.919544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fe6efe0c-6bb3-4e70-9fc8-4c89070a177e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:42.155573 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fb0d3ee4-eee0-4194-bc66-2c7024791ce0 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] 10.222.0.49 "PUT /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.560084 May 21 21:19:42.156732 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1270/2476] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:19:41 2022] PUT /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata => generated 61 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:19:42.166471 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-42b291c1-4669-4854-aa88-794ab39359df tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Action: 'update', calling method: .version_select at 0x7fc81b8de310>, body: {"meta": {"os_version": "alt"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:42.275473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-42b291c1-4669-4854-aa88-794ab39359df tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Getting quotas for project ba3a2f9c3a8e4342898c632959b35b47. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:42.286419 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-42b291c1-4669-4854-aa88-794ab39359df tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Getting quotas for user 714278ffc37d4dcc8c6c5090754966b5 and project ba3a2f9c3a8e4342898c632959b35b47. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:42.425266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fe6efe0c-6bb3-4e70-9fc8-4c89070a177e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:42.440889 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fe6efe0c-6bb3-4e70-9fc8-4c89070a177e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea" status: 200 len: 1462 microversion: 2.1 time: 0.543756 May 21 21:19:42.452663 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1207/2477] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:41 2022] GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea => generated 1462 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:42.458324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f2c8d896-61ac-4357-adf5-72c754cd4f90 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:42.461199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f2c8d896-61ac-4357-adf5-72c754cd4f90 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:42.466771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2c8d896-61ac-4357-adf5-72c754cd4f90 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:42.467768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2c8d896-61ac-4357-adf5-72c754cd4f90 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:42.468903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2c8d896-61ac-4357-adf5-72c754cd4f90 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:42.469499 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2c8d896-61ac-4357-adf5-72c754cd4f90 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:42.803945 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-42b291c1-4669-4854-aa88-794ab39359df tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] 10.222.0.49 "PUT /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.641808 May 21 21:19:42.805948 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1271/2478] 10.222.0.49 () {60 vars in 1312 bytes} [Sat May 21 21:19:42 2022] PUT /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata/os_version => generated 31 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 21 21:19:42.813831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-28740f44-9a9a-4758-86b8-2a91bfa50134 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:42.815500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-28740f44-9a9a-4758-86b8-2a91bfa50134 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:42.823186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-28740f44-9a9a-4758-86b8-2a91bfa50134 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:42.823727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-28740f44-9a9a-4758-86b8-2a91bfa50134 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:42.827854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-28740f44-9a9a-4758-86b8-2a91bfa50134 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:42.828580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-28740f44-9a9a-4758-86b8-2a91bfa50134 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:43.100432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-28740f44-9a9a-4758-86b8-2a91bfa50134 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:43.111088 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-28740f44-9a9a-4758-86b8-2a91bfa50134 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1463 microversion: 2.1 time: 0.303938 May 21 21:19:43.111904 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1272/2479] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:42 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1463 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:43.118145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bbd13407-09ac-4467-a76b-865ea4881d25 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:43.119005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bbd13407-09ac-4467-a76b-865ea4881d25 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:43.135809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bbd13407-09ac-4467-a76b-865ea4881d25 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:43.136265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bbd13407-09ac-4467-a76b-865ea4881d25 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:43.137089 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bbd13407-09ac-4467-a76b-865ea4881d25 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:43.138808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bbd13407-09ac-4467-a76b-865ea4881d25 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:43.257872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bbd13407-09ac-4467-a76b-865ea4881d25 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:43.266958 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bbd13407-09ac-4467-a76b-865ea4881d25 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1275 microversion: 2.1 time: 0.152464 May 21 21:19:43.267545 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1273/2480] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:43 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1275 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:43.272774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3108889c-20f5-43f7-b762-e5950653194e tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Calling method '.version_select at 0x7fc81bb9c430>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:43.303202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f2c8d896-61ac-4357-adf5-72c754cd4f90 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:43.312122 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f2c8d896-61ac-4357-adf5-72c754cd4f90 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1506 microversion: 2.1 time: 0.857919 May 21 21:19:43.322210 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1208/2481] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:42 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1506 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:43.336361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fd0c5dc2-dc47-42d3-a4c5-3b1f238252e2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1447476924", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "6825da6e-8b02-486c-8461-41f10572c810"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:43.356692 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3108889c-20f5-43f7-b762-e5950653194e tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] 10.222.0.49 "GET /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata" status: 200 len: 58 microversion: 2.1 time: 0.087980 May 21 21:19:43.357426 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1274/2482] 10.222.0.49 () {58 vars in 1259 bytes} [Sat May 21 21:19:43 2022] GET /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata => generated 58 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:19:43.370348 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b665a140-4228-4241-8e31-0c421ba55786 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Action: 'update_all', calling method: .version_select at 0x7fc82d0790d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:43.431433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-fd0c5dc2-dc47-42d3-a4c5-3b1f238252e2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] validate_networks() for None {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:19:43.457622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-b665a140-4228-4241-8e31-0c421ba55786 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Getting quotas for project ba3a2f9c3a8e4342898c632959b35b47. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:43.464003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-b665a140-4228-4241-8e31-0c421ba55786 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Getting quotas for user 714278ffc37d4dcc8c6c5090754966b5 and project ba3a2f9c3a8e4342898c632959b35b47. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:43.987151 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b665a140-4228-4241-8e31-0c421ba55786 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] 10.222.0.49 "PUT /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.622679 May 21 21:19:43.988005 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1275/2483] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:19:43 2022] PUT /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata => generated 61 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:19:43.999869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d14570d4-050f-4321-b1dd-69a13ffd0516 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Action: 'create', calling method: .version_select at 0x7fc81bb92ee0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:44.064794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-d14570d4-050f-4321-b1dd-69a13ffd0516 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Getting quotas for project ba3a2f9c3a8e4342898c632959b35b47. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:44.072523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-d14570d4-050f-4321-b1dd-69a13ffd0516 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Getting quotas for user 714278ffc37d4dcc8c6c5090754966b5 and project ba3a2f9c3a8e4342898c632959b35b47. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:44.535858 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d14570d4-050f-4321-b1dd-69a13ffd0516 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] 10.222.0.49 "POST /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata" status: 200 len: 85 microversion: 2.1 time: 0.542166 May 21 21:19:44.536971 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1276/2484] 10.222.0.49 () {60 vars in 1280 bytes} [Sat May 21 21:19:43 2022] POST /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata => generated 85 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 21 21:19:44.545545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-931bf863-c327-4d9a-8b85-2db00bd44556 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:44.546403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-931bf863-c327-4d9a-8b85-2db00bd44556 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:44.553450 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-931bf863-c327-4d9a-8b85-2db00bd44556 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:44.553905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-931bf863-c327-4d9a-8b85-2db00bd44556 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:44.554838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-931bf863-c327-4d9a-8b85-2db00bd44556 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:44.555308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-931bf863-c327-4d9a-8b85-2db00bd44556 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:44.637236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-931bf863-c327-4d9a-8b85-2db00bd44556 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:44.647862 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-931bf863-c327-4d9a-8b85-2db00bd44556 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1275 microversion: 2.1 time: 0.109688 May 21 21:19:44.648957 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1277/2485] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:44 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1275 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:44.656759 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-be2d783e-25fe-4314-96d8-cdcc534acccc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:44.658152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-be2d783e-25fe-4314-96d8-cdcc534acccc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:44.665266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be2d783e-25fe-4314-96d8-cdcc534acccc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:44.665938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be2d783e-25fe-4314-96d8-cdcc534acccc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:44.666823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be2d783e-25fe-4314-96d8-cdcc534acccc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:44.667384 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be2d783e-25fe-4314-96d8-cdcc534acccc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:44.768863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-fd0c5dc2-dc47-42d3-a4c5-3b1f238252e2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:19:44.769320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-fd0c5dc2-dc47-42d3-a4c5-3b1f238252e2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:19:44.769742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-fd0c5dc2-dc47-42d3-a4c5-3b1f238252e2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:19:44.770878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-fd0c5dc2-dc47-42d3-a4c5-3b1f238252e2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:19:44.771731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-fd0c5dc2-dc47-42d3-a4c5-3b1f238252e2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:19:44.786124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fd0c5dc2-dc47-42d3-a4c5-3b1f238252e2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:44.786809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fd0c5dc2-dc47-42d3-a4c5-3b1f238252e2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:44.787799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fd0c5dc2-dc47-42d3-a4c5-3b1f238252e2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:44.788452 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fd0c5dc2-dc47-42d3-a4c5-3b1f238252e2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:44.810058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-fd0c5dc2-dc47-42d3-a4c5-3b1f238252e2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Getting quotas for project 0c0ac2ac25374777ba3c25d31ea96dc5. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:44.816480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-fd0c5dc2-dc47-42d3-a4c5-3b1f238252e2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Getting quotas for user b54cc2165959478ba95981c81864118a and project 0c0ac2ac25374777ba3c25d31ea96dc5. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:44.830856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fd0c5dc2-dc47-42d3-a4c5-3b1f238252e2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:19:44.835086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fd0c5dc2-dc47-42d3-a4c5-3b1f238252e2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:19:44.837370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-be2d783e-25fe-4314-96d8-cdcc534acccc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:44.846638 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-be2d783e-25fe-4314-96d8-cdcc534acccc tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1506 microversion: 2.1 time: 0.196402 May 21 21:19:44.847223 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1278/2486] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:44 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:44.865807 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bcab6413-bd3f-4e02-8302-8b42f4219495 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] Calling method '.version_select at 0x7fc81bb9c9d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:44.915599 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bcab6413-bd3f-4e02-8302-8b42f4219495 tempest-ImagesMetadataTestJSON-406291529 tempest-ImagesMetadataTestJSON-406291529-project] 10.222.0.49 "GET /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata" status: 200 len: 85 microversion: 2.1 time: 0.067305 May 21 21:19:44.916172 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1279/2487] 10.222.0.49 () {58 vars in 1259 bytes} [Sat May 21 21:19:44 2022] GET /compute/v2.1/images/147f6fa6-ace7-4d14-b600-2567c931692b/metadata => generated 85 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:19:44.958067 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fd0c5dc2-dc47-42d3-a4c5-3b1f238252e2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.634182 May 21 21:19:44.959755 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1209/2488] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:19:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:19:44.970413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-293bc3f3-ea22-4113-9dce-9d838017318e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:44.971667 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-293bc3f3-ea22-4113-9dce-9d838017318e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:45.111222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-293bc3f3-ea22-4113-9dce-9d838017318e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:45.120475 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-293bc3f3-ea22-4113-9dce-9d838017318e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80" status: 200 len: 1214 microversion: 2.1 time: 0.153840 May 21 21:19:45.131327 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1280/2489] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:44 2022] GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80 => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:45.667042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-77a1425f-a485-459b-90f0-4f82452134e8 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:45.667900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-77a1425f-a485-459b-90f0-4f82452134e8 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:45.689757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-77a1425f-a485-459b-90f0-4f82452134e8 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:45.690555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-77a1425f-a485-459b-90f0-4f82452134e8 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:45.692995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-77a1425f-a485-459b-90f0-4f82452134e8 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:45.695166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-77a1425f-a485-459b-90f0-4f82452134e8 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:45.864726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a59b0745-e13e-4802-9853-aa42ccdd2c6b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:45.865980 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a59b0745-e13e-4802-9853-aa42ccdd2c6b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:45.879629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a59b0745-e13e-4802-9853-aa42ccdd2c6b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:45.880570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a59b0745-e13e-4802-9853-aa42ccdd2c6b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:45.881919 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a59b0745-e13e-4802-9853-aa42ccdd2c6b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:45.882462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a59b0745-e13e-4802-9853-aa42ccdd2c6b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:46.111036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-77a1425f-a485-459b-90f0-4f82452134e8 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:46.122812 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-77a1425f-a485-459b-90f0-4f82452134e8 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1317 microversion: 2.1 time: 0.460554 May 21 21:19:46.126074 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1210/2490] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:45 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:46.142858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-28a0777c-4242-4df5-b5e0-ce012a787c77 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:46.144485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-28a0777c-4242-4df5-b5e0-ce012a787c77 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:46.284789 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-28a0777c-4242-4df5-b5e0-ce012a787c77 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:46.296359 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-28a0777c-4242-4df5-b5e0-ce012a787c77 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80" status: 200 len: 1214 microversion: 2.1 time: 0.160579 May 21 21:19:46.297854 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1211/2491] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:46 2022] GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80 => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:46.362991 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a59b0745-e13e-4802-9853-aa42ccdd2c6b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:46.384669 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a59b0745-e13e-4802-9853-aa42ccdd2c6b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1506 microversion: 2.1 time: 0.523996 May 21 21:19:46.386143 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1281/2492] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:45 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1506 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:47.143998 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8f65260e-17a4-4767-9425-130350063280 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:47.144862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8f65260e-17a4-4767-9425-130350063280 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:47.154711 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f65260e-17a4-4767-9425-130350063280 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:47.155257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f65260e-17a4-4767-9425-130350063280 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:47.156123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f65260e-17a4-4767-9425-130350063280 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:47.156756 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f65260e-17a4-4767-9425-130350063280 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:47.314117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-49ad4363-a3ec-4055-b837-7277947681ac tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:47.315033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-49ad4363-a3ec-4055-b837-7277947681ac tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:47.322879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49ad4363-a3ec-4055-b837-7277947681ac tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:47.323333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49ad4363-a3ec-4055-b837-7277947681ac tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:47.324346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49ad4363-a3ec-4055-b837-7277947681ac tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:47.325740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49ad4363-a3ec-4055-b837-7277947681ac tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:47.442626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-49ad4363-a3ec-4055-b837-7277947681ac tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:47.456195 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-49ad4363-a3ec-4055-b837-7277947681ac tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80" status: 200 len: 1266 microversion: 2.1 time: 0.146134 May 21 21:19:47.456878 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1282/2493] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:47 2022] GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:19:47.463541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-63e2f362-ec91-4641-96b9-06ad1965fe6d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:47.464251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-63e2f362-ec91-4641-96b9-06ad1965fe6d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:47.488597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-63e2f362-ec91-4641-96b9-06ad1965fe6d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:47.490183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-63e2f362-ec91-4641-96b9-06ad1965fe6d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:47.491027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-63e2f362-ec91-4641-96b9-06ad1965fe6d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:47.503336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-63e2f362-ec91-4641-96b9-06ad1965fe6d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:47.827730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8f65260e-17a4-4767-9425-130350063280 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:47.853688 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8f65260e-17a4-4767-9425-130350063280 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1317 microversion: 2.1 time: 0.713535 May 21 21:19:47.869003 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1212/2494] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:47 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1317 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:47.876828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-f2690457-1b48-4ba8-a4b6-213af24bf303 req-52d188e7-7b90-4c03-8fd3-4ba2ecd9ee09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac", "tag": "8d6ae2f7-1fa6-41fb-9029-17a3c0e7fb0d"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:47.906086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f2690457-1b48-4ba8-a4b6-213af24bf303 req-52d188e7-7b90-4c03-8fd3-4ba2ecd9ee09 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:47.909048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f2690457-1b48-4ba8-a4b6-213af24bf303 req-52d188e7-7b90-4c03-8fd3-4ba2ecd9ee09 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:47.952040 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-f2690457-1b48-4ba8-a4b6-213af24bf303 req-52d188e7-7b90-4c03-8fd3-4ba2ecd9ee09 service nova] Creating event network-changed:8d6ae2f7-1fa6-41fb-9029-17a3c0e7fb0d for instance a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac on nch2-master-1 May 21 21:19:47.960823 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-f2690457-1b48-4ba8-a4b6-213af24bf303 req-52d188e7-7b90-4c03-8fd3-4ba2ecd9ee09 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100686 May 21 21:19:47.961806 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1213/2495] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:48.144679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-63e2f362-ec91-4641-96b9-06ad1965fe6d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:48.162534 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-63e2f362-ec91-4641-96b9-06ad1965fe6d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1506 microversion: 2.1 time: 0.699003 May 21 21:19:48.163371 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1283/2496] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:47 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1506 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:48.475391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d0949542-e0bd-4213-b05b-fd2ace9a3ab2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:48.475391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d0949542-e0bd-4213-b05b-fd2ace9a3ab2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:48.492441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0949542-e0bd-4213-b05b-fd2ace9a3ab2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:48.493000 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0949542-e0bd-4213-b05b-fd2ace9a3ab2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:48.493755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0949542-e0bd-4213-b05b-fd2ace9a3ab2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:48.494207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0949542-e0bd-4213-b05b-fd2ace9a3ab2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:48.896571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3e600e36-81ff-4c9a-ad6a-23cd6500fef8 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:48.898262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3e600e36-81ff-4c9a-ad6a-23cd6500fef8 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:48.909731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e600e36-81ff-4c9a-ad6a-23cd6500fef8 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:48.910874 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e600e36-81ff-4c9a-ad6a-23cd6500fef8 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:48.914216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e600e36-81ff-4c9a-ad6a-23cd6500fef8 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:48.914216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e600e36-81ff-4c9a-ad6a-23cd6500fef8 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:49.304471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d0949542-e0bd-4213-b05b-fd2ace9a3ab2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:49.314876 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d0949542-e0bd-4213-b05b-fd2ace9a3ab2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80" status: 200 len: 1272 microversion: 2.1 time: 0.843768 May 21 21:19:49.316681 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1214/2497] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:48 2022] GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80 => generated 1272 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:19:49.321810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dfe6b984-a378-46c9-99d3-f49d2bbb4b8c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:49.322839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dfe6b984-a378-46c9-99d3-f49d2bbb4b8c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:49.337528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dfe6b984-a378-46c9-99d3-f49d2bbb4b8c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:49.338180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dfe6b984-a378-46c9-99d3-f49d2bbb4b8c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:49.339565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dfe6b984-a378-46c9-99d3-f49d2bbb4b8c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:49.340388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dfe6b984-a378-46c9-99d3-f49d2bbb4b8c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:49.730738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3e600e36-81ff-4c9a-ad6a-23cd6500fef8 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:49.747830 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3e600e36-81ff-4c9a-ad6a-23cd6500fef8 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1317 microversion: 2.1 time: 0.873569 May 21 21:19:49.749935 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1284/2498] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:48 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1317 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:50.048049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dfe6b984-a378-46c9-99d3-f49d2bbb4b8c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:50.061586 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dfe6b984-a378-46c9-99d3-f49d2bbb4b8c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1506 microversion: 2.1 time: 0.743516 May 21 21:19:50.062802 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1215/2499] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:49 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1506 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:50.437107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9b59b01a-5cf9-4e15-8c9a-d5c4afa58235 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:50.437107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9b59b01a-5cf9-4e15-8c9a-d5c4afa58235 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:50.437107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b59b01a-5cf9-4e15-8c9a-d5c4afa58235 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:50.437107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b59b01a-5cf9-4e15-8c9a-d5c4afa58235 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:50.437107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b59b01a-5cf9-4e15-8c9a-d5c4afa58235 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:50.437107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b59b01a-5cf9-4e15-8c9a-d5c4afa58235 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:50.642473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9b59b01a-5cf9-4e15-8c9a-d5c4afa58235 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:50.642473 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9b59b01a-5cf9-4e15-8c9a-d5c4afa58235 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80" status: 200 len: 1272 microversion: 2.1 time: 0.227616 May 21 21:19:50.642473 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1285/2500] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:50 2022] GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80 => generated 1272 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:19:50.766021 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3a50ef7b-019e-4c15-8c6c-bd60e16e43c3 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:50.771056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3a50ef7b-019e-4c15-8c6c-bd60e16e43c3 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:50.783180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a50ef7b-019e-4c15-8c6c-bd60e16e43c3 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:50.784799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a50ef7b-019e-4c15-8c6c-bd60e16e43c3 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:50.794703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a50ef7b-019e-4c15-8c6c-bd60e16e43c3 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:50.798464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a50ef7b-019e-4c15-8c6c-bd60e16e43c3 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:51.083106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0ec19b46-7c1c-4ef0-8411-74b8720283d8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:51.084152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0ec19b46-7c1c-4ef0-8411-74b8720283d8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:51.097946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ec19b46-7c1c-4ef0-8411-74b8720283d8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:51.100067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ec19b46-7c1c-4ef0-8411-74b8720283d8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:51.101650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ec19b46-7c1c-4ef0-8411-74b8720283d8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:51.102310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ec19b46-7c1c-4ef0-8411-74b8720283d8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:51.239126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3a50ef7b-019e-4c15-8c6c-bd60e16e43c3 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:51.256943 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3a50ef7b-019e-4c15-8c6c-bd60e16e43c3 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1317 microversion: 2.1 time: 0.495138 May 21 21:19:51.259797 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1216/2501] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:50 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1317 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:51.659184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ffd3a539-ffca-4e35-872f-dd1d5418838d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:51.664536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ffd3a539-ffca-4e35-872f-dd1d5418838d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:51.675296 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffd3a539-ffca-4e35-872f-dd1d5418838d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:51.678374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffd3a539-ffca-4e35-872f-dd1d5418838d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:51.679491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffd3a539-ffca-4e35-872f-dd1d5418838d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:51.680813 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffd3a539-ffca-4e35-872f-dd1d5418838d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:51.868728 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0ec19b46-7c1c-4ef0-8411-74b8720283d8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:51.877822 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0ec19b46-7c1c-4ef0-8411-74b8720283d8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1506 microversion: 2.1 time: 0.801491 May 21 21:19:51.891558 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1286/2502] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:51 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1506 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:52.274873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a7199969-394e-4d0d-9f76-df57432151ae tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:52.275498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a7199969-394e-4d0d-9f76-df57432151ae tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:52.285119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7199969-394e-4d0d-9f76-df57432151ae tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:52.285635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7199969-394e-4d0d-9f76-df57432151ae tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:52.286424 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7199969-394e-4d0d-9f76-df57432151ae tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:52.286863 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7199969-394e-4d0d-9f76-df57432151ae tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:52.422491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ffd3a539-ffca-4e35-872f-dd1d5418838d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:52.451716 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ffd3a539-ffca-4e35-872f-dd1d5418838d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80" status: 200 len: 1314 microversion: 2.1 time: 0.808715 May 21 21:19:52.454233 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1217/2503] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:51 2022] GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80 => generated 1314 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:19:52.708520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a7199969-394e-4d0d-9f76-df57432151ae tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:52.727825 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a7199969-394e-4d0d-9f76-df57432151ae tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1317 microversion: 2.1 time: 0.456017 May 21 21:19:52.732207 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1287/2504] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:52 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1317 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:52.897931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-135d48fd-2fa3-4601-9432-2825de07dc37 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:52.898567 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-135d48fd-2fa3-4601-9432-2825de07dc37 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:52.907580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-135d48fd-2fa3-4601-9432-2825de07dc37 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:52.908676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-135d48fd-2fa3-4601-9432-2825de07dc37 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:52.926883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-135d48fd-2fa3-4601-9432-2825de07dc37 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:52.927778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-135d48fd-2fa3-4601-9432-2825de07dc37 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:53.447965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-135d48fd-2fa3-4601-9432-2825de07dc37 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:53.470007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3d314bd1-c9f2-4ec1-8ac2-4741cb83df9e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:53.471032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3d314bd1-c9f2-4ec1-8ac2-4741cb83df9e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:53.491865 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-135d48fd-2fa3-4601-9432-2825de07dc37 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1506 microversion: 2.1 time: 0.599242 May 21 21:19:53.495039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d314bd1-c9f2-4ec1-8ac2-4741cb83df9e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:53.495507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d314bd1-c9f2-4ec1-8ac2-4741cb83df9e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:53.496343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d314bd1-c9f2-4ec1-8ac2-4741cb83df9e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:53.497338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d314bd1-c9f2-4ec1-8ac2-4741cb83df9e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:53.500508 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1218/2505] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:52 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1506 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:53.749480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8e9b288f-905d-4b28-af86-f6250d110e5c tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:53.750339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8e9b288f-905d-4b28-af86-f6250d110e5c tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:53.761333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e9b288f-905d-4b28-af86-f6250d110e5c tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:53.761333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e9b288f-905d-4b28-af86-f6250d110e5c tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:53.761333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e9b288f-905d-4b28-af86-f6250d110e5c tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:53.761638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e9b288f-905d-4b28-af86-f6250d110e5c tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:54.013913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3d314bd1-c9f2-4ec1-8ac2-4741cb83df9e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:54.021975 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3d314bd1-c9f2-4ec1-8ac2-4741cb83df9e tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80" status: 200 len: 1314 microversion: 2.1 time: 0.556596 May 21 21:19:54.040607 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1288/2506] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:53 2022] GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80 => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:54.151598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8e9b288f-905d-4b28-af86-f6250d110e5c tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:54.163918 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8e9b288f-905d-4b28-af86-f6250d110e5c tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1317 microversion: 2.1 time: 0.418410 May 21 21:19:54.167444 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1219/2507] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:53 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:54.462455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-6331ed32-a2e0-4899-9df0-14be7344e839 req-a64f44b2-6ff7-4943-80f4-c50293d0b904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5868fd53-6447-43b2-bb05-f443e7b3cb80", "tag": "da3ae4a4-627c-435b-b807-255ce68f8428"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:54.497926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6331ed32-a2e0-4899-9df0-14be7344e839 req-a64f44b2-6ff7-4943-80f4-c50293d0b904 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:54.499656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6331ed32-a2e0-4899-9df0-14be7344e839 req-a64f44b2-6ff7-4943-80f4-c50293d0b904 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:54.518321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-21658ff1-1646-42a9-b74e-05031f702778 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:54.526936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-21658ff1-1646-42a9-b74e-05031f702778 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:54.526936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21658ff1-1646-42a9-b74e-05031f702778 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:54.526936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21658ff1-1646-42a9-b74e-05031f702778 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:54.527641 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21658ff1-1646-42a9-b74e-05031f702778 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:54.528183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21658ff1-1646-42a9-b74e-05031f702778 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:54.551343 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-6331ed32-a2e0-4899-9df0-14be7344e839 req-a64f44b2-6ff7-4943-80f4-c50293d0b904 service nova] Creating event network-changed:da3ae4a4-627c-435b-b807-255ce68f8428 for instance 5868fd53-6447-43b2-bb05-f443e7b3cb80 on nch1-master-1 May 21 21:19:54.559611 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-6331ed32-a2e0-4899-9df0-14be7344e839 req-a64f44b2-6ff7-4943-80f4-c50293d0b904 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103843 May 21 21:19:54.565746 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1289/2508] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:54.570923 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:54.800004 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:54.885128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d45b0b51-dbdc-48d0-9375-d7b3cf961e13 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Action: 'create', calling method: .version_select at 0x7fc81bbee4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1139429742", "description": "tempest-description-493496615"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:55.074329 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-21658ff1-1646-42a9-b74e-05031f702778 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:55.084261 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-21658ff1-1646-42a9-b74e-05031f702778 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1506 microversion: 2.1 time: 0.569719 May 21 21:19:55.085846 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1220/2509] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:54 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1506 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:19:55.100084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d2c19039-d221-47dd-980a-43086e1c8615 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:55.100986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d2c19039-d221-47dd-980a-43086e1c8615 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:55.109731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2c19039-d221-47dd-980a-43086e1c8615 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:55.110288 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2c19039-d221-47dd-980a-43086e1c8615 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:55.112320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2c19039-d221-47dd-980a-43086e1c8615 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:55.116440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2c19039-d221-47dd-980a-43086e1c8615 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:55.118866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=34 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:55.734037 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d45b0b51-dbdc-48d0-9375-d7b3cf961e13 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.065434 May 21 21:19:55.736015 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1290/2510] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:19:54 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:55.744312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cc00590b-19c5-42c8-81f2-9c28266f8ddf tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:55.747055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cc00590b-19c5-42c8-81f2-9c28266f8ddf tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:55.759706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cc00590b-19c5-42c8-81f2-9c28266f8ddf tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:55.760299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cc00590b-19c5-42c8-81f2-9c28266f8ddf tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:55.761415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cc00590b-19c5-42c8-81f2-9c28266f8ddf tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:55.762757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cc00590b-19c5-42c8-81f2-9c28266f8ddf tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:55.790677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:55.873307 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d2c19039-d221-47dd-980a-43086e1c8615 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:55.885894 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d2c19039-d221-47dd-980a-43086e1c8615 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80" status: 200 len: 1314 microversion: 2.1 time: 0.797955 May 21 21:19:55.886810 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1221/2511] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:55 2022] GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80 => generated 1314 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:55.896469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-20faef31-2af2-40bb-83b7-267848e1faed tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Action: 'create', calling method: .version_select at 0x7fc81ae3d700>, body: {"security_group_rule": {"parent_group_id": "2b412e6b-aacd-4192-b0b3-02f9a9f50ac1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:56.120050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cc00590b-19c5-42c8-81f2-9c28266f8ddf tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:56.129936 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cc00590b-19c5-42c8-81f2-9c28266f8ddf tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1317 microversion: 2.1 time: 0.392351 May 21 21:19:56.131164 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1291/2512] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:55 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:56.136337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-295a592d-2093-4778-96bf-1e96ad2ff7d4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:56.137870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-295a592d-2093-4778-96bf-1e96ad2ff7d4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:56.144585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-295a592d-2093-4778-96bf-1e96ad2ff7d4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:56.145755 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-295a592d-2093-4778-96bf-1e96ad2ff7d4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:56.146721 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-295a592d-2093-4778-96bf-1e96ad2ff7d4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:56.147591 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-295a592d-2093-4778-96bf-1e96ad2ff7d4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:56.295404 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=20 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:56.343482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-295a592d-2093-4778-96bf-1e96ad2ff7d4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:56.352296 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-295a592d-2093-4778-96bf-1e96ad2ff7d4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1506 microversion: 2.1 time: 0.219777 May 21 21:19:56.353917 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1292/2513] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:56 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1506 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:56.671459 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-20faef31-2af2-40bb-83b7-267848e1faed tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.782139 May 21 21:19:56.672081 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1222/2514] 10.222.0.49 () {60 vars in 1194 bytes} [Sat May 21 21:19:55 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:56.682781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0b37ef77-b8ef-4850-bbf9-377129581f6c tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Action: 'create', calling method: .version_select at 0x7fc81bb92ee0>, body: {"security_group_rule": {"parent_group_id": "2b412e6b-aacd-4192-b0b3-02f9a9f50ac1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:56.905543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-670b09f6-bf7d-4915-b4f3-3f586d3ee86a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:56.910653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-670b09f6-bf7d-4915-b4f3-3f586d3ee86a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:56.924164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-670b09f6-bf7d-4915-b4f3-3f586d3ee86a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:56.924686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-670b09f6-bf7d-4915-b4f3-3f586d3ee86a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:56.926210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-670b09f6-bf7d-4915-b4f3-3f586d3ee86a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:56.926689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-670b09f6-bf7d-4915-b4f3-3f586d3ee86a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:57.060910 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-0b37ef77-b8ef-4850-bbf9-377129581f6c tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] HTTP exception thrown: This rule already exists in group 2b412e6b-aacd-4192-b0b3-02f9a9f50ac1 May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0b37ef77-b8ef-4850-bbf9-377129581f6c tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Request method failure captured: May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 138 May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVd6bTdRG4EQBrWJkPM02UchWuHl8O8ibJaudEVI93D7a6IJFyfLY43j5zsdMBsKuQIp_EiGipmFqnycZXS611D5M_PlZwEePeQikeHO_N8DQZOziwCJW0hgMCIIOEjEUXKxVjAs-oWm5q3zPYsEVtlj2oCpUyz4pKCEWQ2NGQOFMHw May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 864226dca081457d832e1ce34131e1e0 May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/864226dca081457d832e1ce34131e1e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/864226dca081457d832e1ce34131e1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_864226dca081457d832e1ce34131e1e0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/864226dca081457d832e1ce34131e1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 864226dca081457d832e1ce34131e1e0 May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-324342634-project May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 0bf91341e5b04b29bf474bbd99d84738 May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634-project May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: {"security_group_rule": {"parent_group_id": "2b412e6b-aacd-4192-b0b3-02f9a9f50ac1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: exception: This rule already exists in group 2b412e6b-aacd-4192-b0b3-02f9a9f50ac1 May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2b412e6b-aacd-4192-b0b3-02f9a9f50ac1', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 2b412e6b-aacd-4192-b0b3-02f9a9f50ac1 May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 2b412e6b-aacd-4192-b0b3-02f9a9f50ac1 May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:57.062574 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:57.066854 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:19:57.066854 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:19:57.066854 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 2b412e6b-aacd-4192-b0b3-02f9a9f50ac1 May 21 21:19:57.066854 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:57.066854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0b37ef77-b8ef-4850-bbf9-377129581f6c tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Returning 400 to user: This rule already exists in group 2b412e6b-aacd-4192-b0b3-02f9a9f50ac1 {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:19:57.066854 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0b37ef77-b8ef-4850-bbf9-377129581f6c tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.385185 May 21 21:19:57.068274 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1293/2515] 10.222.0.49 () {60 vars in 1194 bytes} [Sat May 21 21:19:56 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 390 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:19:57.074165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3b933a2e-6e62-4668-b52b-6c96261db3c5 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Calling method '.version_select at 0x7fc82d0ccf70>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:57.171975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-670b09f6-bf7d-4915-b4f3-3f586d3ee86a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:57.196754 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-670b09f6-bf7d-4915-b4f3-3f586d3ee86a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80" status: 200 len: 1314 microversion: 2.1 time: 0.296584 May 21 21:19:57.206449 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1223/2516] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:56 2022] GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:19:57.214241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e1f0b867-96e3-472d-8883-860aa4663513 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:57.218663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e1f0b867-96e3-472d-8883-860aa4663513 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:57.233398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1f0b867-96e3-472d-8883-860aa4663513 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:57.236018 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1f0b867-96e3-472d-8883-860aa4663513 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:57.236018 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1f0b867-96e3-472d-8883-860aa4663513 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:57.236018 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1f0b867-96e3-472d-8883-860aa4663513 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:57.422765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e1f0b867-96e3-472d-8883-860aa4663513 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:57.430492 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e1f0b867-96e3-472d-8883-860aa4663513 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1317 microversion: 2.1 time: 0.222069 May 21 21:19:57.443461 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1224/2517] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:57 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:57.513009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2a567155-e4b3-431b-8f2d-69644a282dea tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1146832142", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "899ce359-a3c5-46d0-8834-497b9e954e1b"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:57.528918 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3b933a2e-6e62-4668-b52b-6c96261db3c5 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-group-rules/99ab2d0b-45a6-449c-ba45-2d23906eb410" status: 202 len: 0 microversion: 2.1 time: 0.458810 May 21 21:19:57.529835 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1294/2518] 10.222.0.49 () {58 vars in 1286 bytes} [Sat May 21 21:19:57 2022] DELETE /compute/v2.1/os-security-group-rules/99ab2d0b-45a6-449c-ba45-2d23906eb410 => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:19:57.550492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-462357cd-b78c-4473-a246-893516589d0e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:57.552875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-462357cd-b78c-4473-a246-893516589d0e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:57.562460 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-462357cd-b78c-4473-a246-893516589d0e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:57.563105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-462357cd-b78c-4473-a246-893516589d0e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:57.564004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-462357cd-b78c-4473-a246-893516589d0e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:57.564484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-462357cd-b78c-4473-a246-893516589d0e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:57.588419 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-2a567155-e4b3-431b-8f2d-69644a282dea tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] validate_networks() for [('899ce359-a3c5-46d0-8834-497b9e954e1b', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:19:57.977997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-462357cd-b78c-4473-a246-893516589d0e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:57.991859 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-462357cd-b78c-4473-a246-893516589d0e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1506 microversion: 2.1 time: 0.460242 May 21 21:19:58.000506 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1295/2519] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:57 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1506 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:58.005944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-384331f3-85ca-40ab-8119-472531e27dc1 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Action: 'create', calling method: .version_select at 0x7fc81ba1f1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1524472561", "description": "tempest-description-235446828"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:58.151322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-2a567155-e4b3-431b-8f2d-69644a282dea tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:19:58.151882 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-2a567155-e4b3-431b-8f2d-69644a282dea tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:19:58.152213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-2a567155-e4b3-431b-8f2d-69644a282dea tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:19:58.153331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-2a567155-e4b3-431b-8f2d-69644a282dea tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:19:58.153898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-2a567155-e4b3-431b-8f2d-69644a282dea tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:19:58.163939 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a567155-e4b3-431b-8f2d-69644a282dea tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:58.164343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a567155-e4b3-431b-8f2d-69644a282dea tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:58.165358 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a567155-e4b3-431b-8f2d-69644a282dea tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:58.165800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a567155-e4b3-431b-8f2d-69644a282dea tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:58.193026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-2a567155-e4b3-431b-8f2d-69644a282dea tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Getting quotas for project 7436c4edd7f24a738bf6455c71511e24. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:19:58.207846 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-2a567155-e4b3-431b-8f2d-69644a282dea tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Getting quotas for user ef11e71018c54fd58b36183687630a57 and project 7436c4edd7f24a738bf6455c71511e24. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:19:58.239125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2a567155-e4b3-431b-8f2d-69644a282dea tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:19:58.242548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2a567155-e4b3-431b-8f2d-69644a282dea tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] [instance: 3b5199d5-87d8-4bde-ae22-452a8c2f1b64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:19:58.346294 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2a567155-e4b3-431b-8f2d-69644a282dea tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.900887 May 21 21:19:58.347065 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1225/2520] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:19:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:19:58.352717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-a4c348b8-31bf-4a48-9c91-693adc37d2cd req-e6e9bb26-833d-43b5-a569-15524a6ec03f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac", "name": "network-vif-plugged", "status": "completed", "tag": "8d6ae2f7-1fa6-41fb-9029-17a3c0e7fb0d"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:58.364462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a4c348b8-31bf-4a48-9c91-693adc37d2cd req-e6e9bb26-833d-43b5-a569-15524a6ec03f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:58.365180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a4c348b8-31bf-4a48-9c91-693adc37d2cd req-e6e9bb26-833d-43b5-a569-15524a6ec03f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:58.378678 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-a4c348b8-31bf-4a48-9c91-693adc37d2cd req-e6e9bb26-833d-43b5-a569-15524a6ec03f service nova] Creating event network-vif-plugged:8d6ae2f7-1fa6-41fb-9029-17a3c0e7fb0d for instance a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac on nch2-master-1 May 21 21:19:58.384997 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-a4c348b8-31bf-4a48-9c91-693adc37d2cd req-e6e9bb26-833d-43b5-a569-15524a6ec03f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036454 May 21 21:19:58.385668 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1226/2521] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:58.393040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-466b4525-444a-4a65-8722-96e3f9953913 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:58.394139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-466b4525-444a-4a65-8722-96e3f9953913 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:58.403258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-466b4525-444a-4a65-8722-96e3f9953913 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:58.403945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-466b4525-444a-4a65-8722-96e3f9953913 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:58.405019 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-466b4525-444a-4a65-8722-96e3f9953913 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:58.407579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-466b4525-444a-4a65-8722-96e3f9953913 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:58.462239 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-384331f3-85ca-40ab-8119-472531e27dc1 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.453833 May 21 21:19:58.462239 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1296/2522] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:19:58 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:58.463719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-29cffabf-5fb8-4bad-98b8-c4c5805bc723 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:58.464442 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-29cffabf-5fb8-4bad-98b8-c4c5805bc723 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] [instance: 3b5199d5-87d8-4bde-ae22-452a8c2f1b64] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:58.542737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-29cffabf-5fb8-4bad-98b8-c4c5805bc723 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef11e71018c54fd58b36183687630a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436c4edd7f24a738bf6455c71511e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:58.553341 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-29cffabf-5fb8-4bad-98b8-c4c5805bc723 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64" status: 200 len: 1224 microversion: 2.1 time: 0.095458 May 21 21:19:58.554264 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1297/2523] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:58 2022] GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:58.564913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ef9b56af-fcbc-433b-a317-450e2f10e804 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:58.565571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ef9b56af-fcbc-433b-a317-450e2f10e804 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:58.586786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef9b56af-fcbc-433b-a317-450e2f10e804 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:58.586786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef9b56af-fcbc-433b-a317-450e2f10e804 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:58.587720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef9b56af-fcbc-433b-a317-450e2f10e804 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:58.588224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef9b56af-fcbc-433b-a317-450e2f10e804 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:58.702620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-466b4525-444a-4a65-8722-96e3f9953913 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:58.712148 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-466b4525-444a-4a65-8722-96e3f9953913 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80" status: 200 len: 1314 microversion: 2.1 time: 0.325089 May 21 21:19:58.712810 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1227/2524] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:58 2022] GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:58.729195 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f911b2e0-3e73-415e-8cb6-3d7a0e779943 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Action: 'create', calling method: .version_select at 0x7fc81ad100d0>, body: {"security_group_rule": {"parent_group_id": "65f09399-de65-4d5a-8f22-60d7fdd2c1f8", "ip_protocol": "tcp", "from_port": 1131606831, "to_port": 22}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:58.764807 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ef9b56af-fcbc-433b-a317-450e2f10e804 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:58.783628 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ef9b56af-fcbc-433b-a317-450e2f10e804 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1317 microversion: 2.1 time: 0.227314 May 21 21:19:58.785982 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1298/2525] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:58 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:58.801892 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-f911b2e0-3e73-415e-8cb6-3d7a0e779943 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] HTTP exception thrown: Invalid port range 1131606831:22. Former value cannot be greater than the later May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f911b2e0-3e73-415e-8cb6-3d7a0e779943 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Request method failure captured: May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 146 May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVd6bTdRG4EQBrWJkPM02UchWuHl8O8ibJaudEVI93D7a6IJFyfLY43j5zsdMBsKuQIp_EiGipmFqnycZXS611D5M_PlZwEePeQikeHO_N8DQZOziwCJW0hgMCIIOEjEUXKxVjAs-oWm5q3zPYsEVtlj2oCpUyz4pKCEWQ2NGQOFMHw May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 864226dca081457d832e1ce34131e1e0 May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/864226dca081457d832e1ce34131e1e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/864226dca081457d832e1ce34131e1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_864226dca081457d832e1ce34131e1e0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/864226dca081457d832e1ce34131e1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 864226dca081457d832e1ce34131e1e0 May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-324342634-project May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 0bf91341e5b04b29bf474bbd99d84738 May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634-project May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: {"security_group_rule": {"parent_group_id": "65f09399-de65-4d5a-8f22-60d7fdd2c1f8", "ip_protocol": "tcp", "from_port": 1131606831, "to_port": 22}} May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid port range 1131606831:22. Former value cannot be greater than the later May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'security_group_rule': {'parent_group_id': '65f09399-de65-4d5a-8f22-60d7fdd2c1f8', 'ip_protocol': 'tcp', 'from_port': 1131606831, 'to_port': 22}}} May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1131606831:22. Former value cannot be greater than the later May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1131606831:22. Former value cannot be greater than the later May 21 21:19:58.805676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:58.810671 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:58.810671 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:58.810671 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:58.810671 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:58.810671 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:58.810671 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:19:58.810671 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:19:58.810671 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1131606831:22. Former value cannot be greater than the later May 21 21:19:58.810671 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:58.810671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f911b2e0-3e73-415e-8cb6-3d7a0e779943 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Returning 400 to user: Invalid port range 1131606831:22. Former value cannot be greater than the later {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:19:58.810671 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f911b2e0-3e73-415e-8cb6-3d7a0e779943 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.080299 May 21 21:19:58.812920 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1228/2526] 10.222.0.49 () {60 vars in 1194 bytes} [Sat May 21 21:19:58 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 88 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:19:58.817792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6f11142f-968c-42ef-883d-a2a715ccede0 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Action: 'create', calling method: .version_select at 0x7fc81b649b80>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-284416391", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:58.820789 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-6f11142f-968c-42ef-883d-a2a715ccede0 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] HTTP exception thrown: Security group id should be uuid May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6f11142f-968c-42ef-883d-a2a715ccede0 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Request method failure captured: May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 130 May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVd6bTdRG4EQBrWJkPM02UchWuHl8O8ibJaudEVI93D7a6IJFyfLY43j5zsdMBsKuQIp_EiGipmFqnycZXS611D5M_PlZwEePeQikeHO_N8DQZOziwCJW0hgMCIIOEjEUXKxVjAs-oWm5q3zPYsEVtlj2oCpUyz4pKCEWQ2NGQOFMHw May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 864226dca081457d832e1ce34131e1e0 May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/864226dca081457d832e1ce34131e1e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/864226dca081457d832e1ce34131e1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_864226dca081457d832e1ce34131e1e0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/864226dca081457d832e1ce34131e1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 864226dca081457d832e1ce34131e1e0 May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-324342634-project May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 0bf91341e5b04b29bf474bbd99d84738 May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634-project May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-284416391", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: exception: Security group id should be uuid May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-284416391', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:19:58.822416 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:19:58.831834 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid May 21 21:19:58.831834 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:58.831834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6f11142f-968c-42ef-883d-a2a715ccede0 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Returning 400 to user: Security group id should be uuid {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:19:58.831834 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6f11142f-968c-42ef-883d-a2a715ccede0 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.010164 May 21 21:19:58.831834 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1299/2527] 10.222.0.49 () {60 vars in 1194 bytes} [Sat May 21 21:19:58 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) May 21 21:19:58.834267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dd8caf77-3247-440e-af5b-bce93a610d32 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Action: 'create', calling method: .version_select at 0x7fc81adf6a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-885282208", "description": "tempest-description-1864889688"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:59.020973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b16268b7-5af6-4bc0-b114-e72affa8c3f4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:59.021608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b16268b7-5af6-4bc0-b114-e72affa8c3f4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:59.029648 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b16268b7-5af6-4bc0-b114-e72affa8c3f4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:59.030340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b16268b7-5af6-4bc0-b114-e72affa8c3f4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:59.031296 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b16268b7-5af6-4bc0-b114-e72affa8c3f4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:59.031744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b16268b7-5af6-4bc0-b114-e72affa8c3f4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:59.187727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b16268b7-5af6-4bc0-b114-e72affa8c3f4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:59.198421 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b16268b7-5af6-4bc0-b114-e72affa8c3f4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1506 microversion: 2.1 time: 0.182231 May 21 21:19:59.201992 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1300/2528] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:59 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:19:59.256491 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dd8caf77-3247-440e-af5b-bce93a610d32 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.426072 May 21 21:19:59.257769 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1229/2529] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:19:58 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:59.269498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bd1d36e1-9a3f-4e43-89b9-463a67f65182 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Action: 'create', calling method: .version_select at 0x7fc81b649040>, body: {"security_group_rule": {"parent_group_id": "cf76d874-69e0-4167-a864-32a356957139", "ip_protocol": "tempest-999-395791896", "from_port": 22, "to_port": 22}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:59.325059 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-bd1d36e1-9a3f-4e43-89b9-463a67f65182 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] HTTP exception thrown: Invalid IP protocol tempest-999-395791896. May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bd1d36e1-9a3f-4e43-89b9-463a67f65182 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Request method failure captured: May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 156 May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVd6bTdRG4EQBrWJkPM02UchWuHl8O8ibJaudEVI93D7a6IJFyfLY43j5zsdMBsKuQIp_EiGipmFqnycZXS611D5M_PlZwEePeQikeHO_N8DQZOziwCJW0hgMCIIOEjEUXKxVjAs-oWm5q3zPYsEVtlj2oCpUyz4pKCEWQ2NGQOFMHw May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 864226dca081457d832e1ce34131e1e0 May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/864226dca081457d832e1ce34131e1e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/864226dca081457d832e1ce34131e1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_864226dca081457d832e1ce34131e1e0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/864226dca081457d832e1ce34131e1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 864226dca081457d832e1ce34131e1e0 May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-324342634-project May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 0bf91341e5b04b29bf474bbd99d84738 May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634-project May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: {"security_group_rule": {"parent_group_id": "cf76d874-69e0-4167-a864-32a356957139", "ip_protocol": "tempest-999-395791896", "from_port": 22, "to_port": 22}} May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid IP protocol tempest-999-395791896. May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cf76d874-69e0-4167-a864-32a356957139', 'ip_protocol': 'tempest-999-395791896', 'from_port': 22, 'to_port': 22}}} May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-395791896. May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-395791896. May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:59.328970 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:59.332513 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:59.332513 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:59.332513 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:59.332513 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:59.332513 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:19:59.332513 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:19:59.332513 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-395791896. May 21 21:19:59.332513 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:19:59.332513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bd1d36e1-9a3f-4e43-89b9-463a67f65182 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Returning 400 to user: Invalid IP protocol tempest-999-395791896. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:19:59.332513 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bd1d36e1-9a3f-4e43-89b9-463a67f65182 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.062707 May 21 21:19:59.332513 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1301/2530] 10.222.0.49 () {60 vars in 1194 bytes} [Sat May 21 21:19:59 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) May 21 21:19:59.345997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-beb7c967-da01-4e07-9f69-a318dc44d761 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Action: 'create', calling method: .version_select at 0x7fc81ad10550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-923115407", "description": "tempest-description-1124196043"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:59.570795 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2f7063e9-eef2-41f8-bced-5ae47a669536 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:59.571422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2f7063e9-eef2-41f8-bced-5ae47a669536 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] [instance: 3b5199d5-87d8-4bde-ae22-452a8c2f1b64] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:59.648487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2f7063e9-eef2-41f8-bced-5ae47a669536 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef11e71018c54fd58b36183687630a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436c4edd7f24a738bf6455c71511e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:59.658176 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2f7063e9-eef2-41f8-bced-5ae47a669536 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64" status: 200 len: 1224 microversion: 2.1 time: 0.091413 May 21 21:19:59.658809 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1302/2531] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:59 2022] GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:19:59.730132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4e45f5f8-29d6-4f08-aeb9-56ddba0df617 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:59.731260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4e45f5f8-29d6-4f08-aeb9-56ddba0df617 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:59.737950 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e45f5f8-29d6-4f08-aeb9-56ddba0df617 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:59.738488 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e45f5f8-29d6-4f08-aeb9-56ddba0df617 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:59.739445 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e45f5f8-29d6-4f08-aeb9-56ddba0df617 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:59.739896 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e45f5f8-29d6-4f08-aeb9-56ddba0df617 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:59.893838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4e45f5f8-29d6-4f08-aeb9-56ddba0df617 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:19:59.901710 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4e45f5f8-29d6-4f08-aeb9-56ddba0df617 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80" status: 200 len: 1314 microversion: 2.1 time: 0.175699 May 21 21:19:59.902284 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1303/2532] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:59 2022] GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:19:59.908624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b2645828-0953-4828-a054-09c4ced1fa14 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:19:59.909436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b2645828-0953-4828-a054-09c4ced1fa14 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:19:59.913250 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-beb7c967-da01-4e07-9f69-a318dc44d761 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.578095 May 21 21:19:59.914388 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1230/2533] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:19:59 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:19:59.916680 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2645828-0953-4828-a054-09c4ced1fa14 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:59.917291 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2645828-0953-4828-a054-09c4ced1fa14 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:59.918231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2645828-0953-4828-a054-09c4ced1fa14 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:19:59.918673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2645828-0953-4828-a054-09c4ced1fa14 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:19:59.925175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-458e4d6b-e3fb-4beb-a99e-6a7e1cb421a4 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Action: 'create', calling method: .version_select at 0x7fc81ad2e700>, body: {"security_group_rule": {"parent_group_id": "7f0adb39-83aa-47a7-b89b-e23941b82ed1", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:19:59.982748 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-458e4d6b-e3fb-4beb-a99e-6a7e1cb421a4 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-458e4d6b-e3fb-4beb-a99e-6a7e1cb421a4 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Request method failure captured: May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 138 May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVd6bTdRG4EQBrWJkPM02UchWuHl8O8ibJaudEVI93D7a6IJFyfLY43j5zsdMBsKuQIp_EiGipmFqnycZXS611D5M_PlZwEePeQikeHO_N8DQZOziwCJW0hgMCIIOEjEUXKxVjAs-oWm5q3zPYsEVtlj2oCpUyz4pKCEWQ2NGQOFMHw May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 864226dca081457d832e1ce34131e1e0 May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/864226dca081457d832e1ce34131e1e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/864226dca081457d832e1ce34131e1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_864226dca081457d832e1ce34131e1e0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/864226dca081457d832e1ce34131e1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 864226dca081457d832e1ce34131e1e0 May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-324342634-project May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 0bf91341e5b04b29bf474bbd99d84738 May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634-project May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: {"security_group_rule": {"parent_group_id": "7f0adb39-83aa-47a7-b89b-e23941b82ed1", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid port range 22:21. Former value cannot be greater than the later May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7f0adb39-83aa-47a7-b89b-e23941b82ed1', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later May 21 21:19:59.984786 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:59.988598 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:19:59.988598 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:59.988598 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:19:59.988598 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:19:59.988598 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:19:59.988598 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:19:59.988598 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:19:59.988598 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later May 21 21:19:59.988598 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:19:59.991109 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-458e4d6b-e3fb-4beb-a99e-6a7e1cb421a4 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:19:59.992677 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-458e4d6b-e3fb-4beb-a99e-6a7e1cb421a4 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.071129 May 21 21:19:59.994102 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1231/2534] 10.222.0.49 () {60 vars in 1194 bytes} [Sat May 21 21:19:59 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 21 21:20:00.005928 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e343f991-d651-423e-9408-bd93809336fa tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Action: 'create', calling method: .version_select at 0x7fc81ad521f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-537099559", "description": "tempest-description-2049889931"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:00.095838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b2645828-0953-4828-a054-09c4ced1fa14 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:00.103898 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b2645828-0953-4828-a054-09c4ced1fa14 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1317 microversion: 2.1 time: 0.200035 May 21 21:20:00.104511 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1304/2535] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:19:59 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:00.216741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9d519081-1f3a-4f6d-9c86-8d65032ebb85 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:00.217371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9d519081-1f3a-4f6d-9c86-8d65032ebb85 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:00.223716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d519081-1f3a-4f6d-9c86-8d65032ebb85 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:00.224168 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d519081-1f3a-4f6d-9c86-8d65032ebb85 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:00.227179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d519081-1f3a-4f6d-9c86-8d65032ebb85 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:00.227738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d519081-1f3a-4f6d-9c86-8d65032ebb85 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:00.397234 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9d519081-1f3a-4f6d-9c86-8d65032ebb85 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:00.406263 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9d519081-1f3a-4f6d-9c86-8d65032ebb85 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1527 microversion: 2.1 time: 0.193388 May 21 21:20:00.406880 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1305/2536] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:00 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1527 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:20:00.440722 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e343f991-d651-423e-9408-bd93809336fa tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.439599 May 21 21:20:00.440722 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1232/2537] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:19:59 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:20:00.450535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4b2493b7-e4ee-45f6-b634-c30f7ff8175c tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Action: 'create', calling method: .version_select at 0x7fc81bb82700>, body: {"security_group_rule": {"parent_group_id": "6fd0cee8-7869-4bc2-bdf7-e24445d8034c", "ip_protocol": "tcp", "from_port": 22, "to_port": 1409590089}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:00.503942 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-4b2493b7-e4ee-45f6-b634-c30f7ff8175c tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] HTTP exception thrown: Invalid port range 22:1409590089. Valid TCP ports should be between 1-65535 May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4b2493b7-e4ee-45f6-b634-c30f7ff8175c tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Request method failure captured: May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 146 May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVd6bTdRG4EQBrWJkPM02UchWuHl8O8ibJaudEVI93D7a6IJFyfLY43j5zsdMBsKuQIp_EiGipmFqnycZXS611D5M_PlZwEePeQikeHO_N8DQZOziwCJW0hgMCIIOEjEUXKxVjAs-oWm5q3zPYsEVtlj2oCpUyz4pKCEWQ2NGQOFMHw May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 864226dca081457d832e1ce34131e1e0 May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/864226dca081457d832e1ce34131e1e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/864226dca081457d832e1ce34131e1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_864226dca081457d832e1ce34131e1e0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/864226dca081457d832e1ce34131e1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 864226dca081457d832e1ce34131e1e0 May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-324342634-project May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 0bf91341e5b04b29bf474bbd99d84738 May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634-project May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: {"security_group_rule": {"parent_group_id": "6fd0cee8-7869-4bc2-bdf7-e24445d8034c", "ip_protocol": "tcp", "from_port": 22, "to_port": 1409590089}} May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid port range 22:1409590089. Valid TCP ports should be between 1-65535 May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6fd0cee8-7869-4bc2-bdf7-e24445d8034c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1409590089}}} May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1409590089. Valid TCP ports should be between 1-65535 May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1409590089. Valid TCP ports should be between 1-65535 May 21 21:20:00.510159 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:00.516046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:00.516046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:00.516046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:00.516046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:00.516046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:00.516046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:20:00.516046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:20:00.516046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1409590089. Valid TCP ports should be between 1-65535 May 21 21:20:00.516046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:00.516046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4b2493b7-e4ee-45f6-b634-c30f7ff8175c tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Returning 400 to user: Invalid port range 22:1409590089. Valid TCP ports should be between 1-65535 {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:20:00.516046 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4b2493b7-e4ee-45f6-b634-c30f7ff8175c tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.065366 May 21 21:20:00.518781 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1306/2538] 10.222.0.49 () {60 vars in 1194 bytes} [Sat May 21 21:20:00 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:20:00.524086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6725bf31-86f2-407c-80a4-5075348c390e tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Action: 'create', calling method: .version_select at 0x7fc81adf6160>, body: {"security_group_rule": {"parent_group_id": "30444dba-bc2a-4a95-9510-eb4ce01a36a8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:00.548513 ncdv-master-1 devstack@n-api.service[131278]: DEBUG neutronclient.v2_0.client [None req-6725bf31-86f2-407c-80a4-5075348c390e tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 30444dba-bc2a-4a95-9510-eb4ce01a36a8 does not exist", "detail": ""}} {{(pid=131278) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:20:00.549125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.security_group_api [None req-6725bf31-86f2-407c-80a4-5075348c390e tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Neutron security group 30444dba-bc2a-4a95-9510-eb4ce01a36a8 not found {{(pid=131278) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 21 21:20:00.549697 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-6725bf31-86f2-407c-80a4-5075348c390e tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] HTTP exception thrown: Security group 30444dba-bc2a-4a95-9510-eb4ce01a36a8 does not exist May 21 21:20:00.549697 ncdv-master-1 devstack@n-api.service[131278]: Neutron server returns request_ids: ['req-cf16552b-88c1-4c3a-8ca8-a7edd55001a3'] May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6725bf31-86f2-407c-80a4-5075348c390e tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Request method failure captured: May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 138 May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVd6bTdRG4EQBrWJkPM02UchWuHl8O8ibJaudEVI93D7a6IJFyfLY43j5zsdMBsKuQIp_EiGipmFqnycZXS611D5M_PlZwEePeQikeHO_N8DQZOziwCJW0hgMCIIOEjEUXKxVjAs-oWm5q3zPYsEVtlj2oCpUyz4pKCEWQ2NGQOFMHw May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 864226dca081457d832e1ce34131e1e0 May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/864226dca081457d832e1ce34131e1e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/864226dca081457d832e1ce34131e1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_864226dca081457d832e1ce34131e1e0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/864226dca081457d832e1ce34131e1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 864226dca081457d832e1ce34131e1e0 May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-324342634-project May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 0bf91341e5b04b29bf474bbd99d84738 May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634-project May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: {"security_group_rule": {"parent_group_id": "30444dba-bc2a-4a95-9510-eb4ce01a36a8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: exception: Security group 30444dba-bc2a-4a95-9510-eb4ce01a36a8 does not exist May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: Neutron server returns request_ids: ['req-cf16552b-88c1-4c3a-8ca8-a7edd55001a3'] May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'security_group_rule': {'parent_group_id': '30444dba-bc2a-4a95-9510-eb4ce01a36a8', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:20:00.551622 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 30444dba-bc2a-4a95-9510-eb4ce01a36a8 does not exist May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf16552b-88c1-4c3a-8ca8-a7edd55001a3'] May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 30444dba-bc2a-4a95-9510-eb4ce01a36a8 does not exist May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf16552b-88c1-4c3a-8ca8-a7edd55001a3'] May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 30444dba-bc2a-4a95-9510-eb4ce01a36a8 does not exist May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf16552b-88c1-4c3a-8ca8-a7edd55001a3'] May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 30444dba-bc2a-4a95-9510-eb4ce01a36a8 does not exist May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf16552b-88c1-4c3a-8ca8-a7edd55001a3'] May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6725bf31-86f2-407c-80a4-5075348c390e tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Returning 404 to user: Security group 30444dba-bc2a-4a95-9510-eb4ce01a36a8 does not exist May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: Neutron server returns request_ids: ['req-cf16552b-88c1-4c3a-8ca8-a7edd55001a3'] {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6725bf31-86f2-407c-80a4-5075348c390e tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.033033 May 21 21:20:00.555191 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1233/2539] 10.222.0.49 () {60 vars in 1194 bytes} [Sat May 21 21:20:00 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:20:00.565699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a2fc5d3f-c87a-46a5-aefa-7916b727eb49 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Calling method '.version_select at 0x7fc81b651c10>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:00.588524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG neutronclient.v2_0.client [None req-a2fc5d3f-c87a-46a5-aefa-7916b727eb49 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule b1e72015-ab7e-4734-88d1-bebd6630df9a does not exist", "detail": ""}} {{(pid=131277) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 21 21:20:00.589216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.security_group_api [None req-a2fc5d3f-c87a-46a5-aefa-7916b727eb49 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Neutron security group rule b1e72015-ab7e-4734-88d1-bebd6630df9a not found {{(pid=131277) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} May 21 21:20:00.590544 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-a2fc5d3f-c87a-46a5-aefa-7916b727eb49 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] HTTP exception thrown: Security group rule b1e72015-ab7e-4734-88d1-bebd6630df9a does not exist May 21 21:20:00.590544 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-6771cafe-8e40-4115-8c06-e07fc25dd169'] May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a2fc5d3f-c87a-46a5-aefa-7916b727eb49 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Request method failure captured: May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/os-security-group-rules/b1e72015-ab7e-4734-88d1-bebd6630df9a HTTP/1.1 May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVd6bTdRG4EQBrWJkPM02UchWuHl8O8ibJaudEVI93D7a6IJFyfLY43j5zsdMBsKuQIp_EiGipmFqnycZXS611D5M_PlZwEePeQikeHO_N8DQZOziwCJW0hgMCIIOEjEUXKxVjAs-oWm5q3zPYsEVtlj2oCpUyz4pKCEWQ2NGQOFMHw May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 864226dca081457d832e1ce34131e1e0 May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/864226dca081457d832e1ce34131e1e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/864226dca081457d832e1ce34131e1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_864226dca081457d832e1ce34131e1e0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/864226dca081457d832e1ce34131e1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 864226dca081457d832e1ce34131e1e0 May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634 May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-324342634-project May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 0bf91341e5b04b29bf474bbd99d84738 May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-324342634-project May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: exception: Security group rule b1e72015-ab7e-4734-88d1-bebd6630df9a does not exist May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-6771cafe-8e40-4115-8c06-e07fc25dd169'] May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'b1e72015-ab7e-4734-88d1-bebd6630df9a'} May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 21 21:20:00.592552 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule b1e72015-ab7e-4734-88d1-bebd6630df9a does not exist May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6771cafe-8e40-4115-8c06-e07fc25dd169'] May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule b1e72015-ab7e-4734-88d1-bebd6630df9a does not exist May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6771cafe-8e40-4115-8c06-e07fc25dd169'] May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule b1e72015-ab7e-4734-88d1-bebd6630df9a does not exist May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6771cafe-8e40-4115-8c06-e07fc25dd169'] May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule b1e72015-ab7e-4734-88d1-bebd6630df9a does not exist May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6771cafe-8e40-4115-8c06-e07fc25dd169'] May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a2fc5d3f-c87a-46a5-aefa-7916b727eb49 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Returning 404 to user: Security group rule b1e72015-ab7e-4734-88d1-bebd6630df9a does not exist May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: Neutron server returns request_ids: ['req-6771cafe-8e40-4115-8c06-e07fc25dd169'] {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a2fc5d3f-c87a-46a5-aefa-7916b727eb49 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-group-rules/b1e72015-ab7e-4734-88d1-bebd6630df9a" status: 404 len: 199 microversion: 2.1 time: 0.033448 May 21 21:20:00.596433 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1307/2540] 10.222.0.49 () {58 vars in 1286 bytes} [Sat May 21 21:20:00 2022] DELETE /compute/v2.1/os-security-group-rules/b1e72015-ab7e-4734-88d1-bebd6630df9a => generated 199 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:20:00.603824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5a7902f2-3d76-48aa-9487-ebe997c002a2 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Calling method '.version_select at 0x7fc81ae3dd30>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:00.677469 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-97c7652f-596e-407a-bf24-36b78dd9b183 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:00.678787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-97c7652f-596e-407a-bf24-36b78dd9b183 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] [instance: 3b5199d5-87d8-4bde-ae22-452a8c2f1b64] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:00.686482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-97c7652f-596e-407a-bf24-36b78dd9b183 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:00.687130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-97c7652f-596e-407a-bf24-36b78dd9b183 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:00.688851 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-97c7652f-596e-407a-bf24-36b78dd9b183 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:00.689600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-97c7652f-596e-407a-bf24-36b78dd9b183 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:00.766594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-97c7652f-596e-407a-bf24-36b78dd9b183 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef11e71018c54fd58b36183687630a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436c4edd7f24a738bf6455c71511e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:00.775884 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-97c7652f-596e-407a-bf24-36b78dd9b183 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64" status: 200 len: 1276 microversion: 2.1 time: 0.104634 May 21 21:20:00.776493 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1308/2541] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:00 2022] GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64 => generated 1276 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:20:00.920219 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-11f6229a-0cd8-4192-aadb-847f5bf57d68 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:00.920869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-11f6229a-0cd8-4192-aadb-847f5bf57d68 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:00.927989 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-11f6229a-0cd8-4192-aadb-847f5bf57d68 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:00.932369 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-11f6229a-0cd8-4192-aadb-847f5bf57d68 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:00.932369 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-11f6229a-0cd8-4192-aadb-847f5bf57d68 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:00.932369 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-11f6229a-0cd8-4192-aadb-847f5bf57d68 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:00.932694 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5a7902f2-3d76-48aa-9487-ebe997c002a2 tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/6fd0cee8-7869-4bc2-bdf7-e24445d8034c" status: 202 len: 0 microversion: 2.1 time: 0.330934 May 21 21:20:00.932694 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1234/2542] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:20:00 2022] DELETE /compute/v2.1/os-security-groups/6fd0cee8-7869-4bc2-bdf7-e24445d8034c => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 21 21:20:00.940673 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a16b8289-bff6-4e85-b178-c87d4605682f tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Calling method '.version_select at 0x7fc81adf6b80>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:01.107144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-11f6229a-0cd8-4192-aadb-847f5bf57d68 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:01.115097 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-11f6229a-0cd8-4192-aadb-847f5bf57d68 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80" status: 200 len: 1314 microversion: 2.1 time: 0.199234 May 21 21:20:01.123663 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1309/2543] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:00 2022] GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:20:01.129257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-04758159-48ca-4f08-8cf6-b66a7b5cd399 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:01.129883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-04758159-48ca-4f08-8cf6-b66a7b5cd399 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:01.136507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-04758159-48ca-4f08-8cf6-b66a7b5cd399 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:01.137801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-04758159-48ca-4f08-8cf6-b66a7b5cd399 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:01.138115 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-04758159-48ca-4f08-8cf6-b66a7b5cd399 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:01.138561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-04758159-48ca-4f08-8cf6-b66a7b5cd399 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:01.313727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-04758159-48ca-4f08-8cf6-b66a7b5cd399 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:01.323989 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-04758159-48ca-4f08-8cf6-b66a7b5cd399 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1467 microversion: 2.1 time: 0.199182 May 21 21:20:01.325153 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1310/2544] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:01 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1467 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:01.342125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ea02f096-4605-4fcc-bcf8-a8308519d872 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1551312642", "metadata": {"image_type": "test"}}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:01.356741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ea02f096-4605-4fcc-bcf8-a8308519d872 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:01.356741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea02f096-4605-4fcc-bcf8-a8308519d872 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:01.356741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea02f096-4605-4fcc-bcf8-a8308519d872 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:01.356741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea02f096-4605-4fcc-bcf8-a8308519d872 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:01.356741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea02f096-4605-4fcc-bcf8-a8308519d872 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:01.390370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ea02f096-4605-4fcc-bcf8-a8308519d872 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Getting quotas for project 496224b299024b6d80653bc12f672f8c. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:20:01.395682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ea02f096-4605-4fcc-bcf8-a8308519d872 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Getting quotas for user 8b6c47e9586f4a70b86651a35f9bcbbb and project 496224b299024b6d80653bc12f672f8c. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:20:01.407604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:01.453594 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a16b8289-bff6-4e85-b178-c87d4605682f tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/7f0adb39-83aa-47a7-b89b-e23941b82ed1" status: 202 len: 0 microversion: 2.1 time: 0.516835 May 21 21:20:01.454185 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1235/2545] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:20:00 2022] DELETE /compute/v2.1/os-security-groups/7f0adb39-83aa-47a7-b89b-e23941b82ed1 => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 21 21:20:01.460902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-176bc228-ed3d-483e-9195-fcb35c73b5ef tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:01.461526 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-176bc228-ed3d-483e-9195-fcb35c73b5ef tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:01.472220 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-176bc228-ed3d-483e-9195-fcb35c73b5ef tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:01.472707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-176bc228-ed3d-483e-9195-fcb35c73b5ef tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:01.474542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-176bc228-ed3d-483e-9195-fcb35c73b5ef tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:01.475765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-176bc228-ed3d-483e-9195-fcb35c73b5ef tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:01.755531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-176bc228-ed3d-483e-9195-fcb35c73b5ef tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:01.759211 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-176bc228-ed3d-483e-9195-fcb35c73b5ef tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1527 microversion: 2.1 time: 0.303805 May 21 21:20:01.759974 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1236/2546] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:01 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1527 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:01.774688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6be953c7-b52c-4f44-812e-635b27f4307c tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Calling method '.version_select at 0x7fc81adf6280>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:01.886182 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ea02f096-4605-4fcc-bcf8-a8308519d872 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "POST /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac/action" status: 202 len: 0 microversion: 2.1 time: 0.548472 May 21 21:20:01.888990 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1311/2547] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:20:01 2022] POST /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) May 21 21:20:01.894717 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-63f6e5f3-3b47-444f-9311-7a27974ecc57 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:01.895417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-63f6e5f3-3b47-444f-9311-7a27974ecc57 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] [instance: 3b5199d5-87d8-4bde-ae22-452a8c2f1b64] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:01.905379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-63f6e5f3-3b47-444f-9311-7a27974ecc57 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:01.908426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-63f6e5f3-3b47-444f-9311-7a27974ecc57 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:01.908426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-63f6e5f3-3b47-444f-9311-7a27974ecc57 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:01.908426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-63f6e5f3-3b47-444f-9311-7a27974ecc57 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:01.984824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-63f6e5f3-3b47-444f-9311-7a27974ecc57 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef11e71018c54fd58b36183687630a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436c4edd7f24a738bf6455c71511e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:01.994306 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-63f6e5f3-3b47-444f-9311-7a27974ecc57 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64" status: 200 len: 1282 microversion: 2.1 time: 0.104098 May 21 21:20:02.005642 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1312/2548] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:01 2022] GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64 => generated 1282 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:02.014393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-08200ab8-25c0-4e2b-b040-a730282f7b5b tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b6aa820>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:02.069203 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-08200ab8-25c0-4e2b-b040-a730282f7b5b tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33" status: 200 len: 1424 microversion: 2.1 time: 0.061830 May 21 21:20:02.072359 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1313/2549] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:02 2022] GET /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33 => generated 1424 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:02.132133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ec9569bd-d716-49a1-88f3-d3ac339320f6 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:02.132799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ec9569bd-d716-49a1-88f3-d3ac339320f6 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:02.140463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ec9569bd-d716-49a1-88f3-d3ac339320f6 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:02.140930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ec9569bd-d716-49a1-88f3-d3ac339320f6 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:02.141731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ec9569bd-d716-49a1-88f3-d3ac339320f6 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:02.142210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ec9569bd-d716-49a1-88f3-d3ac339320f6 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:02.256613 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6be953c7-b52c-4f44-812e-635b27f4307c tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/cf76d874-69e0-4167-a864-32a356957139" status: 202 len: 0 microversion: 2.1 time: 0.474106 May 21 21:20:02.256613 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1237/2550] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:20:01 2022] DELETE /compute/v2.1/os-security-groups/cf76d874-69e0-4167-a864-32a356957139 => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:20:02.256613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-47a116a7-819b-448b-bf25-7c5b0f7d5f8b tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Calling method '.version_select at 0x7fc81ae66d30>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:02.329540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ec9569bd-d716-49a1-88f3-d3ac339320f6 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:02.338310 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ec9569bd-d716-49a1-88f3-d3ac339320f6 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80" status: 200 len: 1314 microversion: 2.1 time: 0.210038 May 21 21:20:02.339434 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1314/2551] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:02 2022] GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:02.397369 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-17835b36-b284-43fe-8093-dd63649ed1c1 req-db81a212-4c0c-445e-85c8-f51f64f90a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5868fd53-6447-43b2-bb05-f443e7b3cb80", "name": "network-vif-plugged", "status": "completed", "tag": "da3ae4a4-627c-435b-b807-255ce68f8428"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:02.409474 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-17835b36-b284-43fe-8093-dd63649ed1c1 req-db81a212-4c0c-445e-85c8-f51f64f90a6d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:02.410368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-17835b36-b284-43fe-8093-dd63649ed1c1 req-db81a212-4c0c-445e-85c8-f51f64f90a6d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:02.454360 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-17835b36-b284-43fe-8093-dd63649ed1c1 req-db81a212-4c0c-445e-85c8-f51f64f90a6d service nova] Creating event network-vif-plugged:da3ae4a4-627c-435b-b807-255ce68f8428 for instance 5868fd53-6447-43b2-bb05-f443e7b3cb80 on nch1-master-1 May 21 21:20:02.462531 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-17835b36-b284-43fe-8093-dd63649ed1c1 req-db81a212-4c0c-445e-85c8-f51f64f90a6d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068818 May 21 21:20:02.464313 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1315/2552] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:20:02.778718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-11d2a1b3-df12-40df-b9d5-33870a4dca97 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:02.779370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-11d2a1b3-df12-40df-b9d5-33870a4dca97 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:02.786534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-11d2a1b3-df12-40df-b9d5-33870a4dca97 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:02.786986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-11d2a1b3-df12-40df-b9d5-33870a4dca97 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:02.787781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-11d2a1b3-df12-40df-b9d5-33870a4dca97 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:02.788219 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-11d2a1b3-df12-40df-b9d5-33870a4dca97 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:02.807357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:02.923121 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-47a116a7-819b-448b-bf25-7c5b0f7d5f8b tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/65f09399-de65-4d5a-8f22-60d7fdd2c1f8" status: 202 len: 0 microversion: 2.1 time: 0.673008 May 21 21:20:02.928661 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1238/2553] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:20:02 2022] DELETE /compute/v2.1/os-security-groups/65f09399-de65-4d5a-8f22-60d7fdd2c1f8 => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:20:02.945128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4aae5366-3082-4ca3-ae0b-30126d34e21c tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] Calling method '.version_select at 0x7fc81ae75c10>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:02.973927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-11d2a1b3-df12-40df-b9d5-33870a4dca97 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:02.976933 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-11d2a1b3-df12-40df-b9d5-33870a4dca97 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1527 microversion: 2.1 time: 0.202840 May 21 21:20:02.980322 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1316/2554] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:02 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1527 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:20:03.013809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-232835ea-5ce3-4f97-9dbf-d18dd7532534 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:03.014751 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-232835ea-5ce3-4f97-9dbf-d18dd7532534 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] [instance: 3b5199d5-87d8-4bde-ae22-452a8c2f1b64] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:03.021927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-232835ea-5ce3-4f97-9dbf-d18dd7532534 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:03.022728 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-232835ea-5ce3-4f97-9dbf-d18dd7532534 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:03.023595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-232835ea-5ce3-4f97-9dbf-d18dd7532534 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:03.024111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-232835ea-5ce3-4f97-9dbf-d18dd7532534 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:03.202709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-232835ea-5ce3-4f97-9dbf-d18dd7532534 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef11e71018c54fd58b36183687630a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436c4edd7f24a738bf6455c71511e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:03.211545 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-232835ea-5ce3-4f97-9dbf-d18dd7532534 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64" status: 200 len: 1324 microversion: 2.1 time: 0.202227 May 21 21:20:03.212182 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1317/2555] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:03 2022] GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64 => generated 1324 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:03.225659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cc7ea8cd-1076-4282-a9bb-a6648d0804c2 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b8ca5e0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:03.282982 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cc7ea8cd-1076-4282-a9bb-a6648d0804c2 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33" status: 200 len: 1424 microversion: 2.1 time: 0.068997 May 21 21:20:03.283693 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1318/2556] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:03 2022] GET /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33 => generated 1424 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:03.356777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7cd6247a-df4b-4eb0-b1b5-e14e1eee34c2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:03.357355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7cd6247a-df4b-4eb0-b1b5-e14e1eee34c2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:03.363780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7cd6247a-df4b-4eb0-b1b5-e14e1eee34c2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:03.364585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7cd6247a-df4b-4eb0-b1b5-e14e1eee34c2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:03.366252 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7cd6247a-df4b-4eb0-b1b5-e14e1eee34c2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:03.366366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7cd6247a-df4b-4eb0-b1b5-e14e1eee34c2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:03.407994 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4aae5366-3082-4ca3-ae0b-30126d34e21c tempest-SecurityGroupRulesNegativeTestJSON-324342634 tempest-SecurityGroupRulesNegativeTestJSON-324342634-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/2b412e6b-aacd-4192-b0b3-02f9a9f50ac1" status: 202 len: 0 microversion: 2.1 time: 0.474338 May 21 21:20:03.409368 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1239/2557] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:20:02 2022] DELETE /compute/v2.1/os-security-groups/2b412e6b-aacd-4192-b0b3-02f9a9f50ac1 => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:20:03.546160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7cd6247a-df4b-4eb0-b1b5-e14e1eee34c2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:03.557900 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7cd6247a-df4b-4eb0-b1b5-e14e1eee34c2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80" status: 200 len: 1314 microversion: 2.1 time: 0.205279 May 21 21:20:03.560921 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1319/2558] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:03 2022] GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:20:04.000623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-104eb313-7e72-41a4-abbc-20af7b7623ba tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:04.002371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-104eb313-7e72-41a4-abbc-20af7b7623ba tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:04.035438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-104eb313-7e72-41a4-abbc-20af7b7623ba tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:04.038686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-104eb313-7e72-41a4-abbc-20af7b7623ba tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:04.039729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-104eb313-7e72-41a4-abbc-20af7b7623ba tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:04.044172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-104eb313-7e72-41a4-abbc-20af7b7623ba tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:04.060690 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-cfb70846-0807-4fd2-ace5-938f731f0975 req-8c97bfc6-1540-4c29-814b-6eb35228aad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b5199d5-87d8-4bde-ae22-452a8c2f1b64", "tag": "d2e27846-408a-45f6-86fc-6fa6672c5352"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:04.085340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cfb70846-0807-4fd2-ace5-938f731f0975 req-8c97bfc6-1540-4c29-814b-6eb35228aad5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:04.086104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cfb70846-0807-4fd2-ace5-938f731f0975 req-8c97bfc6-1540-4c29-814b-6eb35228aad5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:04.105743 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-cfb70846-0807-4fd2-ace5-938f731f0975 req-8c97bfc6-1540-4c29-814b-6eb35228aad5 service nova] Creating event network-changed:d2e27846-408a-45f6-86fc-6fa6672c5352 for instance 3b5199d5-87d8-4bde-ae22-452a8c2f1b64 on nch2-master-1 May 21 21:20:04.111014 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-cfb70846-0807-4fd2-ace5-938f731f0975 req-8c97bfc6-1540-4c29-814b-6eb35228aad5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055046 May 21 21:20:04.111986 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1320/2559] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:20:04.240029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-effb7de6-b063-4233-81cf-503fa11e909f tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:04.240347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-effb7de6-b063-4233-81cf-503fa11e909f tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] [instance: 3b5199d5-87d8-4bde-ae22-452a8c2f1b64] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:04.266983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-effb7de6-b063-4233-81cf-503fa11e909f tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:04.266983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-effb7de6-b063-4233-81cf-503fa11e909f tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:04.266983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-effb7de6-b063-4233-81cf-503fa11e909f tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:04.266983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-effb7de6-b063-4233-81cf-503fa11e909f tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:04.429667 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-104eb313-7e72-41a4-abbc-20af7b7623ba tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:04.437909 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-104eb313-7e72-41a4-abbc-20af7b7623ba tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1522 microversion: 2.1 time: 0.445232 May 21 21:20:04.438408 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1240/2560] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:03 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:04.450335 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-29f40164-d7ab-4b45-bb85-6d97101d767f tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81adf6790>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:04.522444 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-29f40164-d7ab-4b45-bb85-6d97101d767f tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33" status: 200 len: 1424 microversion: 2.1 time: 0.082983 May 21 21:20:04.523187 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1241/2561] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:04 2022] GET /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33 => generated 1424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:04.530721 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-6ef6a794-a4d4-4bfd-b495-db80c37f597f req-787b9875-8e08-4422-8b45-851760598e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c07e27-b31b-4712-9bb2-19a2eca3b35b", "name": "network-vif-plugged", "status": "completed", "tag": "b3fdc189-fac8-4e7f-96a7-d1881a26a02b"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:04.539665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:04.548741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6ef6a794-a4d4-4bfd-b495-db80c37f597f req-787b9875-8e08-4422-8b45-851760598e9a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:04.553453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6ef6a794-a4d4-4bfd-b495-db80c37f597f req-787b9875-8e08-4422-8b45-851760598e9a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:04.569334 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-6ef6a794-a4d4-4bfd-b495-db80c37f597f req-787b9875-8e08-4422-8b45-851760598e9a service nova] Creating event network-vif-plugged:b3fdc189-fac8-4e7f-96a7-d1881a26a02b for instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b on nch1-master-1 May 21 21:20:04.578071 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-6ef6a794-a4d4-4bfd-b495-db80c37f597f req-787b9875-8e08-4422-8b45-851760598e9a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053016 May 21 21:20:04.579226 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1242/2562] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:20:04.587720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-96136302-32fd-40c2-b186-761b6cb84092 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:04.588722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-96136302-32fd-40c2-b186-761b6cb84092 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:04.599283 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-96136302-32fd-40c2-b186-761b6cb84092 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:04.599840 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-96136302-32fd-40c2-b186-761b6cb84092 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:04.601083 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-96136302-32fd-40c2-b186-761b6cb84092 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:04.603436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-96136302-32fd-40c2-b186-761b6cb84092 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:04.669208 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-effb7de6-b063-4233-81cf-503fa11e909f tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef11e71018c54fd58b36183687630a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436c4edd7f24a738bf6455c71511e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:04.693670 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-effb7de6-b063-4233-81cf-503fa11e909f tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64" status: 200 len: 1324 microversion: 2.1 time: 0.468275 May 21 21:20:04.693953 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1321/2563] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:04 2022] GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64 => generated 1324 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:20:04.977364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-96136302-32fd-40c2-b186-761b6cb84092 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:04.993979 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-96136302-32fd-40c2-b186-761b6cb84092 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80" status: 200 len: 1464 microversion: 2.1 time: 0.413365 May 21 21:20:04.994681 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1243/2564] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:04 2022] GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80 => generated 1464 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:05.253891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cdbaf0e5-495f-4a21-941e-f5b11f90d3c0 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:05.258223 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cdbaf0e5-495f-4a21-941e-f5b11f90d3c0 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Searching by: {'deleted': False, 'project_id': 'a9a2e62beaf84b2cb331d8ba7831cbc2'} {{(pid=131277) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:20:05.279748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdbaf0e5-495f-4a21-941e-f5b11f90d3c0 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:05.281229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdbaf0e5-495f-4a21-941e-f5b11f90d3c0 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:05.288338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdbaf0e5-495f-4a21-941e-f5b11f90d3c0 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:05.288338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdbaf0e5-495f-4a21-941e-f5b11f90d3c0 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:05.408325 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cdbaf0e5-495f-4a21-941e-f5b11f90d3c0 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.394987 May 21 21:20:05.420980 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1322/2565] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:20:05 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:20:05.426026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-02d31ffe-49e9-4748-ac83-8512405d7480 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:05.431699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-02d31ffe-49e9-4748-ac83-8512405d7480 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Searching by: {'deleted': False} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:20:05.456037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-881d8ec3-1b8d-495e-81c0-d6bc7f7be123 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:05.456837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-881d8ec3-1b8d-495e-81c0-d6bc7f7be123 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:05.462655 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02d31ffe-49e9-4748-ac83-8512405d7480 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:05.463796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02d31ffe-49e9-4748-ac83-8512405d7480 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:05.465497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02d31ffe-49e9-4748-ac83-8512405d7480 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:05.466078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02d31ffe-49e9-4748-ac83-8512405d7480 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:05.471142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-881d8ec3-1b8d-495e-81c0-d6bc7f7be123 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:05.471889 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-881d8ec3-1b8d-495e-81c0-d6bc7f7be123 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:05.472907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-881d8ec3-1b8d-495e-81c0-d6bc7f7be123 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:05.473578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-881d8ec3-1b8d-495e-81c0-d6bc7f7be123 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:05.713561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-02d31ffe-49e9-4748-ac83-8512405d7480 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:20:05.811107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-881d8ec3-1b8d-495e-81c0-d6bc7f7be123 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:05.819828 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-881d8ec3-1b8d-495e-81c0-d6bc7f7be123 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1522 microversion: 2.1 time: 0.367619 May 21 21:20:05.828269 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1323/2566] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:05 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:20:05.848617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-255dbad5-0059-4782-af2b-f2d9e775f905 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b8ca160>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:05.956015 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02d31ffe-49e9-4748-ac83-8512405d7480 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:05.956650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02d31ffe-49e9-4748-ac83-8512405d7480 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:06.752164 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-02d31ffe-49e9-4748-ac83-8512405d7480 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 14260 microversion: 2.1 time: 1.329930 May 21 21:20:06.764604 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1244/2567] 10.222.0.49 () {58 vars in 1170 bytes} [Sat May 21 21:20:05 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 14260 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:20:06.764604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3f450847-675e-4c9b-9032-b84bc4767c1a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:06.764604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3f450847-675e-4c9b-9032-b84bc4767c1a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] [instance: 3b5199d5-87d8-4bde-ae22-452a8c2f1b64] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:06.791768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f450847-675e-4c9b-9032-b84bc4767c1a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:06.791768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f450847-675e-4c9b-9032-b84bc4767c1a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:06.791768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f450847-675e-4c9b-9032-b84bc4767c1a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:06.791768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f450847-675e-4c9b-9032-b84bc4767c1a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:07.049322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3f450847-675e-4c9b-9032-b84bc4767c1a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef11e71018c54fd58b36183687630a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436c4edd7f24a738bf6455c71511e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:07.062926 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3f450847-675e-4c9b-9032-b84bc4767c1a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64" status: 200 len: 1324 microversion: 2.1 time: 0.308347 May 21 21:20:07.064629 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1245/2568] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:06 2022] GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64 => generated 1324 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:07.070162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-6855ccd1-604b-420f-8d86-81159639320a req-5bac8913-9d05-416c-8288-59f2d51b622f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac", "name": "network-vif-plugged", "status": "completed", "tag": "8d6ae2f7-1fa6-41fb-9029-17a3c0e7fb0d"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:07.086583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6855ccd1-604b-420f-8d86-81159639320a req-5bac8913-9d05-416c-8288-59f2d51b622f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:07.090576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6855ccd1-604b-420f-8d86-81159639320a req-5bac8913-9d05-416c-8288-59f2d51b622f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:07.104212 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-6855ccd1-604b-420f-8d86-81159639320a req-5bac8913-9d05-416c-8288-59f2d51b622f service nova] Creating event network-vif-plugged:8d6ae2f7-1fa6-41fb-9029-17a3c0e7fb0d for instance a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac on nch2-master-1 May 21 21:20:07.117850 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-6855ccd1-604b-420f-8d86-81159639320a req-5bac8913-9d05-416c-8288-59f2d51b622f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051029 May 21 21:20:07.121996 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1246/2569] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:20:07.127033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f177cbb3-c954-4938-bb94-1b73fe2be5b1 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:07.130787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f177cbb3-c954-4938-bb94-1b73fe2be5b1 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Searching by: {'deleted': False, 'project_id': 'a9a2e62beaf84b2cb331d8ba7831cbc2'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:20:07.154125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f177cbb3-c954-4938-bb94-1b73fe2be5b1 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:07.154849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f177cbb3-c954-4938-bb94-1b73fe2be5b1 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:07.155841 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f177cbb3-c954-4938-bb94-1b73fe2be5b1 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:07.157953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f177cbb3-c954-4938-bb94-1b73fe2be5b1 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:07.341103 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f177cbb3-c954-4938-bb94-1b73fe2be5b1 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail?tenant_id=0c0ac2ac25374777ba3c25d31ea96dc5" status: 200 len: 15 microversion: 2.1 time: 0.215151 May 21 21:20:07.346829 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1247/2570] 10.222.0.49 () {58 vars in 1230 bytes} [Sat May 21 21:20:07 2022] GET /compute/v2.1/servers/detail?tenant_id=0c0ac2ac25374777ba3c25d31ea96dc5 => generated 15 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:20:07.352763 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-25034016-9526-48c8-ae75-b65995855f86 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:07.353796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-25034016-9526-48c8-ae75-b65995855f86 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:07.378141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25034016-9526-48c8-ae75-b65995855f86 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:07.381150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25034016-9526-48c8-ae75-b65995855f86 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:07.386153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25034016-9526-48c8-ae75-b65995855f86 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:07.386153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25034016-9526-48c8-ae75-b65995855f86 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:07.751140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-25034016-9526-48c8-ae75-b65995855f86 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:07.759466 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-25034016-9526-48c8-ae75-b65995855f86 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1522 microversion: 2.1 time: 0.411258 May 21 21:20:07.774360 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1248/2571] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:07 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:07.783225 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d8bcec89-dea6-4ffa-9c3c-6aab13ec2921 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:07.796882 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d8bcec89-dea6-4ffa-9c3c-6aab13ec2921 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Searching by: {'tenant_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'deleted': False} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:20:07.809962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8bcec89-dea6-4ffa-9c3c-6aab13ec2921 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:07.810881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8bcec89-dea6-4ffa-9c3c-6aab13ec2921 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:07.811876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8bcec89-dea6-4ffa-9c3c-6aab13ec2921 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:07.812985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8bcec89-dea6-4ffa-9c3c-6aab13ec2921 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:07.899309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-d8bcec89-dea6-4ffa-9c3c-6aab13ec2921 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:20:08.134461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8bcec89-dea6-4ffa-9c3c-6aab13ec2921 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:08.136059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8bcec89-dea6-4ffa-9c3c-6aab13ec2921 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:08.502542 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d8bcec89-dea6-4ffa-9c3c-6aab13ec2921 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0c0ac2ac25374777ba3c25d31ea96dc5" status: 200 len: 4825 microversion: 2.1 time: 0.726832 May 21 21:20:08.503375 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1249/2572] 10.222.0.49 () {58 vars in 1256 bytes} [Sat May 21 21:20:07 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0c0ac2ac25374777ba3c25d31ea96dc5 => generated 4825 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:08.525011 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ea4de3d7-429d-4774-94f0-e2b9460d170c tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:08.530495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ea4de3d7-429d-4774-94f0-e2b9460d170c tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] [instance: 3b5199d5-87d8-4bde-ae22-452a8c2f1b64] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:08.551114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ea4de3d7-429d-4774-94f0-e2b9460d170c tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:08.561741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ea4de3d7-429d-4774-94f0-e2b9460d170c tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:08.563305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ea4de3d7-429d-4774-94f0-e2b9460d170c tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:08.567334 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ea4de3d7-429d-4774-94f0-e2b9460d170c tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:09.012759 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ea4de3d7-429d-4774-94f0-e2b9460d170c tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef11e71018c54fd58b36183687630a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436c4edd7f24a738bf6455c71511e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:09.041492 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ea4de3d7-429d-4774-94f0-e2b9460d170c tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64" status: 200 len: 1324 microversion: 2.1 time: 0.535306 May 21 21:20:09.051718 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1250/2573] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:08 2022] GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64 => generated 1324 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:09.060199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3d1232fa-30ee-4fa1-9fc4-f9e9a7492481 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:09.074986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3d1232fa-30ee-4fa1-9fc4-f9e9a7492481 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Searching by: {'tenant_id': 'a9a2e62beaf84b2cb331d8ba7831cbc2', 'deleted': False} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:20:09.087473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d1232fa-30ee-4fa1-9fc4-f9e9a7492481 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:09.087473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d1232fa-30ee-4fa1-9fc4-f9e9a7492481 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:09.087473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d1232fa-30ee-4fa1-9fc4-f9e9a7492481 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:09.096015 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d1232fa-30ee-4fa1-9fc4-f9e9a7492481 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:09.140831 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3d1232fa-30ee-4fa1-9fc4-f9e9a7492481 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a9a2e62beaf84b2cb331d8ba7831cbc2" status: 200 len: 15 microversion: 2.1 time: 0.088786 May 21 21:20:09.159944 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1251/2574] 10.222.0.49 () {58 vars in 1256 bytes} [Sat May 21 21:20:09 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a9a2e62beaf84b2cb331d8ba7831cbc2 => generated 15 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:20:09.164269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-283637bf-e357-4bd2-8f2f-97df4f9fc3ad tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:09.165025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-283637bf-e357-4bd2-8f2f-97df4f9fc3ad tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:09.173208 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-283637bf-e357-4bd2-8f2f-97df4f9fc3ad tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:09.173760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-283637bf-e357-4bd2-8f2f-97df4f9fc3ad tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:09.174617 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-283637bf-e357-4bd2-8f2f-97df4f9fc3ad tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:09.175129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-283637bf-e357-4bd2-8f2f-97df4f9fc3ad tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:09.526618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-283637bf-e357-4bd2-8f2f-97df4f9fc3ad tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:09.530570 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:09.666666 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-283637bf-e357-4bd2-8f2f-97df4f9fc3ad tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1522 microversion: 2.1 time: 0.403046 May 21 21:20:09.666666 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1252/2575] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:09 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1522 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:09.666666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8e14526d-e86e-4218-8a2c-e8d92c7e76a5 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:09.666666 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8e14526d-e86e-4218-8a2c-e8d92c7e76a5 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.012920 May 21 21:20:09.666666 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1253/2576] 10.222.0.49 () {58 vars in 1188 bytes} [Sat May 21 21:20:09 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:20:09.666666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-50ae677d-e68d-4f76-aa9f-7db02feddbec tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:09.666666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-50ae677d-e68d-4f76-aa9f-7db02feddbec tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:09.666666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50ae677d-e68d-4f76-aa9f-7db02feddbec tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:09.666666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50ae677d-e68d-4f76-aa9f-7db02feddbec tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:09.666666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50ae677d-e68d-4f76-aa9f-7db02feddbec tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:09.666666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50ae677d-e68d-4f76-aa9f-7db02feddbec tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:09.668092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:10.159610 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-50ae677d-e68d-4f76-aa9f-7db02feddbec tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810/action" status: 202 len: 0 microversion: 2.1 time: 0.576830 May 21 21:20:10.161753 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1254/2577] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:20:09 2022] POST /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:20:10.185487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c3e07d4d-3a15-4778-b0df-92ff4e7fd76c tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:10.189852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c3e07d4d-3a15-4778-b0df-92ff4e7fd76c tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] [instance: 3b5199d5-87d8-4bde-ae22-452a8c2f1b64] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:10.208836 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3e07d4d-3a15-4778-b0df-92ff4e7fd76c tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:10.210411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3e07d4d-3a15-4778-b0df-92ff4e7fd76c tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:10.213712 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3e07d4d-3a15-4778-b0df-92ff4e7fd76c tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:10.214469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3e07d4d-3a15-4778-b0df-92ff4e7fd76c tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:10.471102 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c3e07d4d-3a15-4778-b0df-92ff4e7fd76c tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef11e71018c54fd58b36183687630a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436c4edd7f24a738bf6455c71511e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:10.479665 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c3e07d4d-3a15-4778-b0df-92ff4e7fd76c tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64" status: 200 len: 1324 microversion: 2.1 time: 0.316486 May 21 21:20:10.481097 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1255/2578] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:10 2022] GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64 => generated 1324 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:10.486976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-53c850bc-277d-4414-858f-615e0d156b6a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:10.490908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-53c850bc-277d-4414-858f-615e0d156b6a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:10.491726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-53c850bc-277d-4414-858f-615e0d156b6a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:20:10.500559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-53c850bc-277d-4414-858f-615e0d156b6a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:10.501218 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-53c850bc-277d-4414-858f-615e0d156b6a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:10.502179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-53c850bc-277d-4414-858f-615e0d156b6a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:10.502781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-53c850bc-277d-4414-858f-615e0d156b6a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:10.670833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-53c850bc-277d-4414-858f-615e0d156b6a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:20:10.862633 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-53c850bc-277d-4414-858f-615e0d156b6a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.379366 May 21 21:20:10.863303 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1256/2579] 10.222.0.49 () {58 vars in 1149 bytes} [Sat May 21 21:20:10 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:20:10.883872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-00de25e8-dd07-4c26-bdde-7ac1e54d4a78 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:10.891407 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-00de25e8-dd07-4c26-bdde-7ac1e54d4a78 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:10.926631 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00de25e8-dd07-4c26-bdde-7ac1e54d4a78 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:10.929975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00de25e8-dd07-4c26-bdde-7ac1e54d4a78 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:10.931875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00de25e8-dd07-4c26-bdde-7ac1e54d4a78 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:10.931875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00de25e8-dd07-4c26-bdde-7ac1e54d4a78 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:11.207565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-00de25e8-dd07-4c26-bdde-7ac1e54d4a78 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:11.218430 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-00de25e8-dd07-4c26-bdde-7ac1e54d4a78 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1522 microversion: 2.1 time: 0.353943 May 21 21:20:11.219964 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1257/2580] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:10 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:11.226029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0941bb52-319a-4a45-964c-a3a8b2cf96b8 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:11.231934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0941bb52-319a-4a45-964c-a3a8b2cf96b8 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:11.244908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0941bb52-319a-4a45-964c-a3a8b2cf96b8 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:11.245916 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0941bb52-319a-4a45-964c-a3a8b2cf96b8 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:11.247498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0941bb52-319a-4a45-964c-a3a8b2cf96b8 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:11.248219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0941bb52-319a-4a45-964c-a3a8b2cf96b8 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:11.889686 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0941bb52-319a-4a45-964c-a3a8b2cf96b8 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810/action" status: 202 len: 0 microversion: 2.1 time: 0.668261 May 21 21:20:11.891246 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1258/2581] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:20:11 2022] POST /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810/action => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:20:11.900425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-fa63b7b6-c01b-40cc-8f5d-2aab5a375ec4 req-a310c527-6b70-4048-a8ef-73e2cc00a925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b5199d5-87d8-4bde-ae22-452a8c2f1b64", "name": "network-vif-plugged", "status": "completed", "tag": "d2e27846-408a-45f6-86fc-6fa6672c5352"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:11.923895 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-fa63b7b6-c01b-40cc-8f5d-2aab5a375ec4 req-a310c527-6b70-4048-a8ef-73e2cc00a925 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:11.924438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-fa63b7b6-c01b-40cc-8f5d-2aab5a375ec4 req-a310c527-6b70-4048-a8ef-73e2cc00a925 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:11.940499 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-fa63b7b6-c01b-40cc-8f5d-2aab5a375ec4 req-a310c527-6b70-4048-a8ef-73e2cc00a925 service nova] Creating event network-vif-plugged:d2e27846-408a-45f6-86fc-6fa6672c5352 for instance 3b5199d5-87d8-4bde-ae22-452a8c2f1b64 on nch2-master-1 May 21 21:20:11.946418 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-fa63b7b6-c01b-40cc-8f5d-2aab5a375ec4 req-a310c527-6b70-4048-a8ef-73e2cc00a925 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054168 May 21 21:20:11.947222 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1259/2582] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:20:11.955339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a2fd1a96-a8bf-41c7-b56d-703b0887d9dd tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:11.956878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a2fd1a96-a8bf-41c7-b56d-703b0887d9dd tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] [instance: 3b5199d5-87d8-4bde-ae22-452a8c2f1b64] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:11.966241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2fd1a96-a8bf-41c7-b56d-703b0887d9dd tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:11.970894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2fd1a96-a8bf-41c7-b56d-703b0887d9dd tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:11.970894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2fd1a96-a8bf-41c7-b56d-703b0887d9dd tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:11.970894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2fd1a96-a8bf-41c7-b56d-703b0887d9dd tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:12.614223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a2fd1a96-a8bf-41c7-b56d-703b0887d9dd tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef11e71018c54fd58b36183687630a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436c4edd7f24a738bf6455c71511e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:12.631508 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a2fd1a96-a8bf-41c7-b56d-703b0887d9dd tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64" status: 200 len: 1324 microversion: 2.1 time: 0.682899 May 21 21:20:12.635324 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1260/2583] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:11 2022] GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64 => generated 1324 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:12.678999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ad34f5e1-7c55-4ad5-981a-2a4e8644e2ec tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:12.679305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ad34f5e1-7c55-4ad5-981a-2a4e8644e2ec tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:12.706474 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ad34f5e1-7c55-4ad5-981a-2a4e8644e2ec tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:12.712549 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ad34f5e1-7c55-4ad5-981a-2a4e8644e2ec tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:12.713892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ad34f5e1-7c55-4ad5-981a-2a4e8644e2ec tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:12.714331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ad34f5e1-7c55-4ad5-981a-2a4e8644e2ec tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:13.402093 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ad34f5e1-7c55-4ad5-981a-2a4e8644e2ec tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1614 microversion: 2.1 time: 0.720984 May 21 21:20:13.403167 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1261/2584] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:12 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1614 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:13.413789 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c28ea166-c946-456f-849a-e7ff7cd4a0fe tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:13.416921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c28ea166-c946-456f-849a-e7ff7cd4a0fe tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:13.448114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c28ea166-c946-456f-849a-e7ff7cd4a0fe tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:13.449665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c28ea166-c946-456f-849a-e7ff7cd4a0fe tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:13.450041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c28ea166-c946-456f-849a-e7ff7cd4a0fe tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:13.450456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c28ea166-c946-456f-849a-e7ff7cd4a0fe tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:14.140124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c28ea166-c946-456f-849a-e7ff7cd4a0fe tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:14.155286 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c28ea166-c946-456f-849a-e7ff7cd4a0fe tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1522 microversion: 2.1 time: 0.750945 May 21 21:20:14.156154 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1262/2585] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:13 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1522 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:14.168823 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e12b58e7-1465-4a50-9d76-e9bad05be1b1 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:14.172984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e12b58e7-1465-4a50-9d76-e9bad05be1b1 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:14.188824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e12b58e7-1465-4a50-9d76-e9bad05be1b1 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:14.192617 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e12b58e7-1465-4a50-9d76-e9bad05be1b1 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:14.195988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e12b58e7-1465-4a50-9d76-e9bad05be1b1 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:14.196237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e12b58e7-1465-4a50-9d76-e9bad05be1b1 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:15.341879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:15.401383 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e12b58e7-1465-4a50-9d76-e9bad05be1b1 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1614 microversion: 2.1 time: 1.239208 May 21 21:20:15.404520 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1263/2586] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:14 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1614 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:15.422373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5c7e2216-988a-483a-9d69-bf9967e80c3a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:15.439159 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5c7e2216-988a-483a-9d69-bf9967e80c3a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] [instance: 3b5199d5-87d8-4bde-ae22-452a8c2f1b64] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:15.458047 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c7e2216-988a-483a-9d69-bf9967e80c3a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:15.460933 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=23 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:15.476682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c7e2216-988a-483a-9d69-bf9967e80c3a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:15.477620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c7e2216-988a-483a-9d69-bf9967e80c3a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:15.478094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c7e2216-988a-483a-9d69-bf9967e80c3a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:15.819982 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=30 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:16.029096 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5c7e2216-988a-483a-9d69-bf9967e80c3a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef11e71018c54fd58b36183687630a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436c4edd7f24a738bf6455c71511e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:16.046515 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5c7e2216-988a-483a-9d69-bf9967e80c3a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64" status: 200 len: 1519 microversion: 2.1 time: 0.640640 May 21 21:20:16.047287 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1264/2587] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:15 2022] GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64 => generated 1519 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:16.073704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-972b14ec-0e8a-4bfc-a595-95d9bc47dc05 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:16.076163 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-972b14ec-0e8a-4bfc-a595-95d9bc47dc05 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:16.094371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-972b14ec-0e8a-4bfc-a595-95d9bc47dc05 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:16.095112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-972b14ec-0e8a-4bfc-a595-95d9bc47dc05 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:16.096078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-972b14ec-0e8a-4bfc-a595-95d9bc47dc05 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:16.098172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-972b14ec-0e8a-4bfc-a595-95d9bc47dc05 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:17.079884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-972b14ec-0e8a-4bfc-a595-95d9bc47dc05 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:17.098221 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-972b14ec-0e8a-4bfc-a595-95d9bc47dc05 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1522 microversion: 2.1 time: 1.035037 May 21 21:20:17.099197 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1265/2588] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:16 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1522 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:17.105781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-28935328-d1bc-4e89-be57-01286f935840 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:17.111521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-28935328-d1bc-4e89-be57-01286f935840 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Searching by: {'host': 'nch1-master-1', 'deleted': False} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:20:17.118305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28935328-d1bc-4e89-be57-01286f935840 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:17.119035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28935328-d1bc-4e89-be57-01286f935840 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:17.119855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28935328-d1bc-4e89-be57-01286f935840 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:17.121821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28935328-d1bc-4e89-be57-01286f935840 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:17.264381 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-28935328-d1bc-4e89-be57-01286f935840 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:20:17.347046 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-28935328-d1bc-4e89-be57-01286f935840 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] 10.222.0.49 "GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1" status: 200 len: 1635 microversion: 2.1 time: 0.246556 May 21 21:20:17.356463 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1266/2589] 10.222.0.49 () {58 vars in 1189 bytes} [Sat May 21 21:20:17 2022] GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1 => generated 1635 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:17.384040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e1d32e57-72ae-4190-8efa-ad2fbdacd97b tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-201608890", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "899ce359-a3c5-46d0-8834-497b9e954e1b"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e1d32e57-72ae-4190-8efa-ad2fbdacd97b tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Request method failure captured: May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 242 May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVd9Kb0x3UK_hN-HT66GU7RKAG36w9prdIw0rax73NYBL-GaRTs_CwMtPYweXWWrghK1YREGOGYfgB3564Ovf_vqU4zf8WyYtdswW0hr3P8irTWzNiZ__fr7rpU7EWuOSGjduMX2fNfcDm54IAjMmD14u2Q6ErXOq6ZRQt2k713FiR0 May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 7436c4edd7f24a738bf6455c71511e24 May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7436c4edd7f24a738bf6455c71511e24", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 7436c4edd7f24a738bf6455c71511e24 May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerMetadataNegativeTestJSON-1562567064-project May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: ef11e71018c54fd58b36183687630a57 May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1562567064-project May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-201608890", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "899ce359-a3c5-46d0-8834-497b9e954e1b"}]}} May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-201608890', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '899ce359-a3c5-46d0-8834-497b9e954e1b'}]}}} May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise error May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi On instance['server']: May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'': 'data1'} May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:20:17.389493 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:20:17.393198 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:20:17.393198 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:20:17.393198 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:20:17.393198 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:20:17.393198 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:20:17.393198 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:20:17.393198 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:20:17.393198 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:17.393198 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:17.393198 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:17.393198 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:17.393198 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:17.393198 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:17.393198 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:20:17.393198 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:20:17.393198 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:20:17.393198 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:17.393198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e1d32e57-72ae-4190-8efa-ad2fbdacd97b tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:20:17.393198 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e1d32e57-72ae-4190-8efa-ad2fbdacd97b tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.032277 May 21 21:20:17.393198 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1267/2590] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:20:17 2022] POST /compute/v2.1/servers => generated 175 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:20:17.400441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-35a61502-3479-4f56-b879-9fca44de7707 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:17.407016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-35a61502-3479-4f56-b879-9fca44de7707 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:20:17.414185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35a61502-3479-4f56-b879-9fca44de7707 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:17.414648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35a61502-3479-4f56-b879-9fca44de7707 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:17.415589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35a61502-3479-4f56-b879-9fca44de7707 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:17.419961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35a61502-3479-4f56-b879-9fca44de7707 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:17.458023 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-35a61502-3479-4f56-b879-9fca44de7707 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] 10.222.0.49 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.064263 May 21 21:20:17.459113 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1268/2591] 10.222.0.49 () {58 vars in 1195 bytes} [Sat May 21 21:20:17 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:20:17.466136 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4f060d41-0e44-4733-985e-499008fa22f0 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:17.466658 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4f060d41-0e44-4733-985e-499008fa22f0 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] [instance: f3ac50a9-cdbd-489f-9089-e1bc232724bc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:17.473618 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-4f060d41-0e44-4733-985e-499008fa22f0 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] HTTP exception thrown: Instance f3ac50a9-cdbd-489f-9089-e1bc232724bc could not be found. May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4f060d41-0e44-4733-985e-499008fa22f0 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Request method failure captured: May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/f3ac50a9-cdbd-489f-9089-e1bc232724bc/metadata HTTP/1.1 May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVd9Kb0x3UK_hN-HT66GU7RKAG36w9prdIw0rax73NYBL-GaRTs_CwMtPYweXWWrghK1YREGOGYfgB3564Ovf_vqU4zf8WyYtdswW0hr3P8irTWzNiZ__fr7rpU7EWuOSGjduMX2fNfcDm54IAjMmD14u2Q6ErXOq6ZRQt2k713FiR0 May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 7436c4edd7f24a738bf6455c71511e24 May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7436c4edd7f24a738bf6455c71511e24", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 7436c4edd7f24a738bf6455c71511e24 May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerMetadataNegativeTestJSON-1562567064-project May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: ef11e71018c54fd58b36183687630a57 May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1562567064-project May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance f3ac50a9-cdbd-489f-9089-e1bc232724bc could not be found. May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'server_id': 'f3ac50a9-cdbd-489f-9089-e1bc232724bc'} May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3ac50a9-cdbd-489f-9089-e1bc232724bc could not be found. May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3ac50a9-cdbd-489f-9089-e1bc232724bc could not be found. May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:17.478921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:17.483760 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:20:17.483760 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:20:17.483760 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3ac50a9-cdbd-489f-9089-e1bc232724bc could not be found. May 21 21:20:17.483760 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:17.483760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4f060d41-0e44-4733-985e-499008fa22f0 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Returning 404 to user: Instance f3ac50a9-cdbd-489f-9089-e1bc232724bc could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:20:17.483760 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4f060d41-0e44-4733-985e-499008fa22f0 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ac50a9-cdbd-489f-9089-e1bc232724bc/metadata" status: 404 len: 111 microversion: 2.1 time: 0.020549 May 21 21:20:17.483760 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1269/2592] 10.222.0.49 () {58 vars in 1262 bytes} [Sat May 21 21:20:17 2022] GET /compute/v2.1/servers/f3ac50a9-cdbd-489f-9089-e1bc232724bc/metadata => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:20:17.490332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1b114028-60ce-4c85-8dc6-e09f1409a7cf tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:17.497840 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1b114028-60ce-4c85-8dc6-e09f1409a7cf tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:17.515172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b114028-60ce-4c85-8dc6-e09f1409a7cf tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:17.515927 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b114028-60ce-4c85-8dc6-e09f1409a7cf tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:17.517204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b114028-60ce-4c85-8dc6-e09f1409a7cf tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:17.518715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b114028-60ce-4c85-8dc6-e09f1409a7cf tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:17.525131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:18.009988 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1b114028-60ce-4c85-8dc6-e09f1409a7cf tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810/action" status: 202 len: 0 microversion: 2.1 time: 0.526771 May 21 21:20:18.015877 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1270/2593] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:20:17 2022] POST /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:20:18.022093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-270ef0c0-7259-45a8-b2fb-2e9432e21a94 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1153367342", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "899ce359-a3c5-46d0-8834-497b9e954e1b"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-270ef0c0-7259-45a8-b2fb-2e9432e21a94 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Request method failure captured: May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 499 May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVd9Kb0x3UK_hN-HT66GU7RKAG36w9prdIw0rax73NYBL-GaRTs_CwMtPYweXWWrghK1YREGOGYfgB3564Ovf_vqU4zf8WyYtdswW0hr3P8irTWzNiZ__fr7rpU7EWuOSGjduMX2fNfcDm54IAjMmD14u2Q6ErXOq6ZRQt2k713FiR0 May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 7436c4edd7f24a738bf6455c71511e24 May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7436c4edd7f24a738bf6455c71511e24", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 7436c4edd7f24a738bf6455c71511e24 May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerMetadataNegativeTestJSON-1562567064-project May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: ef11e71018c54fd58b36183687630a57 May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1562567064-project May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1153367342", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "899ce359-a3c5-46d0-8834-497b9e954e1b"}]}} May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1153367342', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '899ce359-a3c5-46d0-8834-497b9e954e1b'}]}}} May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise error May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 21 21:20:18.040115 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi On instance['server']: May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:18.043090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-270ef0c0-7259-45a8-b2fb-2e9432e21a94 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:20:18.061915 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-270ef0c0-7259-45a8-b2fb-2e9432e21a94 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.043081 May 21 21:20:18.070381 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1271/2594] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:20:18 2022] POST /compute/v2.1/servers => generated 687 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:20:18.090945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4787a057-430c-476c-9c69-1f37dddd0929 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:18.090945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4787a057-430c-476c-9c69-1f37dddd0929 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:18.095970 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4787a057-430c-476c-9c69-1f37dddd0929 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:18.096463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4787a057-430c-476c-9c69-1f37dddd0929 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:18.097275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4787a057-430c-476c-9c69-1f37dddd0929 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:18.097717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4787a057-430c-476c-9c69-1f37dddd0929 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:18.133906 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=10 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:23.252942 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-255dbad5-0059-4782-af2b-f2d9e775f905 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33" status: 200 len: 1424 microversion: 2.1 time: 17.409493 May 21 21:20:23.253536 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1324/2595] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:05 2022] GET /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33 => generated 1424 bytes in 17411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:23.268028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-751536a5-869e-4edd-80a9-85ab752249b2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:23.268709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-751536a5-869e-4edd-80a9-85ab752249b2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:23.280830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-4787a057-430c-476c-9c69-1f37dddd0929 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:20:23.281340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-4787a057-430c-476c-9c69-1f37dddd0929 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:20:23.281725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-4787a057-430c-476c-9c69-1f37dddd0929 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:20:23.282574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-4787a057-430c-476c-9c69-1f37dddd0929 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:20:23.282975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-4787a057-430c-476c-9c69-1f37dddd0929 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:20:23.296536 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-751536a5-869e-4edd-80a9-85ab752249b2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:23.296921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-751536a5-869e-4edd-80a9-85ab752249b2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:23.297727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-751536a5-869e-4edd-80a9-85ab752249b2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:23.298430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-751536a5-869e-4edd-80a9-85ab752249b2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:23.577962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4787a057-430c-476c-9c69-1f37dddd0929 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:23.594152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4787a057-430c-476c-9c69-1f37dddd0929 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:23.594856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4787a057-430c-476c-9c69-1f37dddd0929 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:23.595868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4787a057-430c-476c-9c69-1f37dddd0929 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:23.596737 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4787a057-430c-476c-9c69-1f37dddd0929 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:23.637333 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4787a057-430c-476c-9c69-1f37dddd0929 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "POST /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810/action" status: 202 len: 1067 microversion: 2.1 time: 5.571822 May 21 21:20:23.638971 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1272/2596] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:20:18 2022] POST /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810/action => generated 1067 bytes in 5574 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 21 21:20:23.659853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4623f1e9-f7f7-4e29-ad3e-d288b3d57381 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2076162853", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "899ce359-a3c5-46d0-8834-497b9e954e1b"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4623f1e9-f7f7-4e29-ad3e-d288b3d57381 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Request method failure captured: May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 500 May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVd9Kb0x3UK_hN-HT66GU7RKAG36w9prdIw0rax73NYBL-GaRTs_CwMtPYweXWWrghK1YREGOGYfgB3564Ovf_vqU4zf8WyYtdswW0hr3P8irTWzNiZ__fr7rpU7EWuOSGjduMX2fNfcDm54IAjMmD14u2Q6ErXOq6ZRQt2k713FiR0 May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 7436c4edd7f24a738bf6455c71511e24 May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7436c4edd7f24a738bf6455c71511e24", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 7436c4edd7f24a738bf6455c71511e24 May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerMetadataNegativeTestJSON-1562567064-project May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: ef11e71018c54fd58b36183687630a57 May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1562567064-project May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2076162853", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "899ce359-a3c5-46d0-8834-497b9e954e1b"}]}} May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2076162853', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '899ce359-a3c5-46d0-8834-497b9e954e1b'}]}}} May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise error May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 21 21:20:23.666612 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi On instance['server']: May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:20:23.670132 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:23.673505 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4623f1e9-f7f7-4e29-ad3e-d288b3d57381 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:20:23.674538 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4623f1e9-f7f7-4e29-ad3e-d288b3d57381 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.034478 May 21 21:20:23.675637 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1273/2597] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:20:23 2022] POST /compute/v2.1/servers => generated 689 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:20:23.682131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0adf15fe-5809-4bbc-b316-e499c5d6d1cc tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Action: 'create', calling method: .version_select at 0x7fc82d0848b0>, body: {"keypair": {"name": "tempest-keypair-973765525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlK0ERvT+oLeUEdserHVQMOHrjDJwadK9bDKBVl0Rc5LVOrQYlDMBduaa/UM22lQ9WG6+AQFw/wFCzT5AXoR4kYPUH0cWUhvTDhmkKVSxV1jUC724mR/n77Csg2FsDihA=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:23.751037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-0adf15fe-5809-4bbc-b316-e499c5d6d1cc tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Getting quotas for project 60dca17b0239494f9e8effb6d535311f. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:20:23.764241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-0adf15fe-5809-4bbc-b316-e499c5d6d1cc tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Getting quotas for user 3d4f720a68014a829929d6586cd9154d and project 60dca17b0239494f9e8effb6d535311f. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:20:24.046983 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0adf15fe-5809-4bbc-b316-e499c5d6d1cc tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.368069 May 21 21:20:24.046983 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1274/2598] 10.222.0.49 () {62 vars in 1199 bytes} [Sat May 21 21:20:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 370 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 21 21:20:24.052667 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f3bffab5-1bd6-4c52-b7e1-55e52ecdaca5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:24.052774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f3bffab5-1bd6-4c52-b7e1-55e52ecdaca5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:24.076035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3bffab5-1bd6-4c52-b7e1-55e52ecdaca5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:24.076035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3bffab5-1bd6-4c52-b7e1-55e52ecdaca5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:24.076035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3bffab5-1bd6-4c52-b7e1-55e52ecdaca5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:24.076035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3bffab5-1bd6-4c52-b7e1-55e52ecdaca5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:24.407527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-751536a5-869e-4edd-80a9-85ab752249b2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:24.434612 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-751536a5-869e-4edd-80a9-85ab752249b2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1522 microversion: 2.1 time: 1.174978 May 21 21:20:24.440022 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1325/2599] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:23 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1522 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:24.448846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7debd0fe-1fe8-4845-b7a1-7b1198d6aeff tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-712468557", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "899ce359-a3c5-46d0-8834-497b9e954e1b"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7debd0fe-1fe8-4845-b7a1-7b1198d6aeff tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Request method failure captured: May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 753 May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVd9Kb0x3UK_hN-HT66GU7RKAG36w9prdIw0rax73NYBL-GaRTs_CwMtPYweXWWrghK1YREGOGYfgB3564Ovf_vqU4zf8WyYtdswW0hr3P8irTWzNiZ__fr7rpU7EWuOSGjduMX2fNfcDm54IAjMmD14u2Q6ErXOq6ZRQt2k713FiR0 May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 7436c4edd7f24a738bf6455c71511e24 May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7436c4edd7f24a738bf6455c71511e24", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 7436c4edd7f24a738bf6455c71511e24 May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerMetadataNegativeTestJSON-1562567064-project May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: ef11e71018c54fd58b36183687630a57 May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1562567064-project May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-712468557", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "899ce359-a3c5-46d0-8834-497b9e954e1b"}]}} May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-712468557', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '899ce359-a3c5-46d0-8834-497b9e954e1b'}]}}} May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:20:24.461404 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise error May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi On instance['server']: May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:20:24.464919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:20:24.467032 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:20:24.467032 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:24.467032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7debd0fe-1fe8-4845-b7a1-7b1198d6aeff tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:20:24.467304 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7debd0fe-1fe8-4845-b7a1-7b1198d6aeff tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.026205 May 21 21:20:24.471289 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1326/2600] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:20:24 2022] POST /compute/v2.1/servers => generated 1197 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) May 21 21:20:24.481661 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-47678271-e968-4a84-a8af-0b49adc69cca tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81ba770d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:24.488316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f3bffab5-1bd6-4c52-b7e1-55e52ecdaca5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:24.508647 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f3bffab5-1bd6-4c52-b7e1-55e52ecdaca5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1471 microversion: 2.1 time: 0.461160 May 21 21:20:24.519365 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1275/2601] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:24 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1471 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:24.602849 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-47678271-e968-4a84-a8af-0b49adc69cca tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33" status: 200 len: 1424 microversion: 2.1 time: 0.130251 May 21 21:20:24.603438 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1327/2602] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:24 2022] GET /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33 => generated 1424 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:24.611867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-56232f50-3040-44e5-bffb-58f9512721da tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-737884983", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "899ce359-a3c5-46d0-8834-497b9e954e1b"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-56232f50-3040-44e5-bffb-58f9512721da tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Request method failure captured: May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 1265 May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVd9Kb0x3UK_hN-HT66GU7RKAG36w9prdIw0rax73NYBL-GaRTs_CwMtPYweXWWrghK1YREGOGYfgB3564Ovf_vqU4zf8WyYtdswW0hr3P8irTWzNiZ__fr7rpU7EWuOSGjduMX2fNfcDm54IAjMmD14u2Q6ErXOq6ZRQt2k713FiR0 May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 7436c4edd7f24a738bf6455c71511e24 May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7436c4edd7f24a738bf6455c71511e24", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 7436c4edd7f24a738bf6455c71511e24 May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerMetadataNegativeTestJSON-1562567064-project May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: ef11e71018c54fd58b36183687630a57 May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1562567064-project May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-737884983", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "899ce359-a3c5-46d0-8834-497b9e954e1b"}]}} May 21 21:20:24.616345 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:20:24.618284 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:20:24.618284 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-737884983', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '899ce359-a3c5-46d0-8834-497b9e954e1b'}]}}} May 21 21:20:24.618284 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:20:24.618284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:24.618284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:20:24.618284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:20:24.618284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:20:24.618284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise error May 21 21:20:24.618284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:20:24.618284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:24.618284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 21 21:20:24.618284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 21 21:20:24.618284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 21 21:20:24.618284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 21 21:20:24.618284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 21 21:20:24.618284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:24.618284 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi On instance['server']: May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:20:24.619482 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:20:24.621280 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 21 21:20:24.621280 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:24.623557 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-56232f50-3040-44e5-bffb-58f9512721da tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:20:24.625426 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-56232f50-3040-44e5-bffb-58f9512721da tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.018729 May 21 21:20:24.626544 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1328/2603] 10.222.0.49 () {60 vars in 1147 bytes} [Sat May 21 21:20:24 2022] POST /compute/v2.1/servers => generated 2221 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) May 21 21:20:24.639158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a5bad158-8547-4104-a404-2101bf6a648d tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:24.639990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a5bad158-8547-4104-a404-2101bf6a648d tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] [instance: 81e3f583-d5db-4292-a451-9a8988c56db5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:24.650268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-445babb9-b9e0-43da-bc58-dc800e8d8fc2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Action: 'create', calling method: .version_select at 0x7fc82cf76c10>, body: {"keypair": {"name": "tempest-keypair-2118406534", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmH5Ml5nu0GFJVwFgqURK02GSacHVfAtPwV96g+Ca8Sv+KLVKAzFhIlpA+35/lfLMsEsion7Sin0omODBivsesBk1uNAzCJyOxj8n4UOzBlUPFsEOGomNZUjNsrZNLbbw=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:24.675880 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-a5bad158-8547-4104-a404-2101bf6a648d tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] HTTP exception thrown: Instance 81e3f583-d5db-4292-a451-9a8988c56db5 could not be found. May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a5bad158-8547-4104-a404-2101bf6a648d tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Request method failure captured: May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/81e3f583-d5db-4292-a451-9a8988c56db5/metadata/test2 HTTP/1.1 May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVd9Kb0x3UK_hN-HT66GU7RKAG36w9prdIw0rax73NYBL-GaRTs_CwMtPYweXWWrghK1YREGOGYfgB3564Ovf_vqU4zf8WyYtdswW0hr3P8irTWzNiZ__fr7rpU7EWuOSGjduMX2fNfcDm54IAjMmD14u2Q6ErXOq6ZRQt2k713FiR0 May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 7436c4edd7f24a738bf6455c71511e24 May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7436c4edd7f24a738bf6455c71511e24", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 7436c4edd7f24a738bf6455c71511e24 May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerMetadataNegativeTestJSON-1562567064-project May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: ef11e71018c54fd58b36183687630a57 May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1562567064-project May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 81e3f583-d5db-4292-a451-9a8988c56db5 could not be found. May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'server_id': '81e3f583-d5db-4292-a451-9a8988c56db5', 'id': 'test2'} May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81e3f583-d5db-4292-a451-9a8988c56db5 could not be found. May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81e3f583-d5db-4292-a451-9a8988c56db5 could not be found. May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:24.683467 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:24.691484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:20:24.691484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:20:24.691484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81e3f583-d5db-4292-a451-9a8988c56db5 could not be found. May 21 21:20:24.691484 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:24.691484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a5bad158-8547-4104-a404-2101bf6a648d tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Returning 404 to user: Instance 81e3f583-d5db-4292-a451-9a8988c56db5 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:20:24.694439 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a5bad158-8547-4104-a404-2101bf6a648d tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "GET /compute/v2.1/servers/81e3f583-d5db-4292-a451-9a8988c56db5/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.060379 May 21 21:20:24.705699 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1329/2604] 10.222.0.49 () {58 vars in 1280 bytes} [Sat May 21 21:20:24 2022] GET /compute/v2.1/servers/81e3f583-d5db-4292-a451-9a8988c56db5/metadata/test2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:20:24.712072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a0c03f4c-0081-454e-8a01-58cce76ba55a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:24.719206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-445babb9-b9e0-43da-bc58-dc800e8d8fc2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Getting quotas for project bc039eff465a4f068284e9b62e10b195. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:20:24.720965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a0c03f4c-0081-454e-8a01-58cce76ba55a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] [instance: 3b5199d5-87d8-4bde-ae22-452a8c2f1b64] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:24.738908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-445babb9-b9e0-43da-bc58-dc800e8d8fc2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Getting quotas for user e316b7ec96f14eedbd57fe097c9fce0b and project bc039eff465a4f068284e9b62e10b195. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:20:24.740570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a0c03f4c-0081-454e-8a01-58cce76ba55a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:24.741041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a0c03f4c-0081-454e-8a01-58cce76ba55a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:24.741862 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a0c03f4c-0081-454e-8a01-58cce76ba55a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:24.746520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a0c03f4c-0081-454e-8a01-58cce76ba55a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:24.825178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a0c03f4c-0081-454e-8a01-58cce76ba55a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] [instance: 3b5199d5-87d8-4bde-ae22-452a8c2f1b64] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:20:24.905091 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-445babb9-b9e0-43da-bc58-dc800e8d8fc2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.379886 May 21 21:20:24.905091 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1276/2605] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:20:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:20:25.457684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-109cb53b-24cd-4a5d-a885-77102ea7b6e4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:25.459414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-109cb53b-24cd-4a5d-a885-77102ea7b6e4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:25.469016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-109cb53b-24cd-4a5d-a885-77102ea7b6e4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:25.469669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-109cb53b-24cd-4a5d-a885-77102ea7b6e4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:25.471309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-109cb53b-24cd-4a5d-a885-77102ea7b6e4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:25.472103 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-109cb53b-24cd-4a5d-a885-77102ea7b6e4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:25.498087 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a0c03f4c-0081-454e-8a01-58cce76ba55a tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64" status: 204 len: 0 microversion: 2.1 time: 0.790187 May 21 21:20:25.504581 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1330/2606] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:20:24 2022] DELETE /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:20:25.517519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-02c3ab53-ff62-4a17-b3f2-2b8239bc4cc4 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:25.521867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-02c3ab53-ff62-4a17-b3f2-2b8239bc4cc4 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] [instance: 3b5199d5-87d8-4bde-ae22-452a8c2f1b64] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:25.536965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02c3ab53-ff62-4a17-b3f2-2b8239bc4cc4 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:25.537695 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02c3ab53-ff62-4a17-b3f2-2b8239bc4cc4 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:25.539064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02c3ab53-ff62-4a17-b3f2-2b8239bc4cc4 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:25.539866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02c3ab53-ff62-4a17-b3f2-2b8239bc4cc4 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:25.689013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-109cb53b-24cd-4a5d-a885-77102ea7b6e4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:25.703504 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-109cb53b-24cd-4a5d-a885-77102ea7b6e4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1504 microversion: 2.1 time: 0.250440 May 21 21:20:25.714158 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1277/2607] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:25 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1504 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:20:25.719539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0d0b6bd7-b0b9-47bc-a99e-24e85b578a1c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:25.720172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0d0b6bd7-b0b9-47bc-a99e-24e85b578a1c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:25.726699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d0b6bd7-b0b9-47bc-a99e-24e85b578a1c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:25.727207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d0b6bd7-b0b9-47bc-a99e-24e85b578a1c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:25.728037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d0b6bd7-b0b9-47bc-a99e-24e85b578a1c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:25.728661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d0b6bd7-b0b9-47bc-a99e-24e85b578a1c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:25.741505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-02c3ab53-ff62-4a17-b3f2-2b8239bc4cc4 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef11e71018c54fd58b36183687630a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436c4edd7f24a738bf6455c71511e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:25.751112 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-02c3ab53-ff62-4a17-b3f2-2b8239bc4cc4 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64" status: 200 len: 1525 microversion: 2.1 time: 0.241895 May 21 21:20:25.761779 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1331/2608] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:25 2022] GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64 => generated 1525 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:25.761779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5de6ebdb-925c-4eca-9b0c-36ef5705a6d5 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b65c820>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:25.811559 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5de6ebdb-925c-4eca-9b0c-36ef5705a6d5 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33" status: 200 len: 1424 microversion: 2.1 time: 0.057830 May 21 21:20:25.812609 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1332/2609] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:25 2022] GET /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33 => generated 1424 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:25.945806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0d0b6bd7-b0b9-47bc-a99e-24e85b578a1c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:25.960255 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0d0b6bd7-b0b9-47bc-a99e-24e85b578a1c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1471 microversion: 2.1 time: 0.244704 May 21 21:20:25.961779 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1278/2610] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:25 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1471 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:26.722083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a9bcff08-2b8c-4af7-847b-6f7787ea80cb tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:26.722775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a9bcff08-2b8c-4af7-847b-6f7787ea80cb tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:26.745562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9bcff08-2b8c-4af7-847b-6f7787ea80cb tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:26.746520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9bcff08-2b8c-4af7-847b-6f7787ea80cb tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:26.748698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9bcff08-2b8c-4af7-847b-6f7787ea80cb tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:26.748698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9bcff08-2b8c-4af7-847b-6f7787ea80cb tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:26.772820 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e5199e7a-bb14-4db9-82b5-5504a11783e5 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:26.773541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e5199e7a-bb14-4db9-82b5-5504a11783e5 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] [instance: 3b5199d5-87d8-4bde-ae22-452a8c2f1b64] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:26.789768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e5199e7a-bb14-4db9-82b5-5504a11783e5 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:26.793034 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e5199e7a-bb14-4db9-82b5-5504a11783e5 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:26.794317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e5199e7a-bb14-4db9-82b5-5504a11783e5 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:26.799373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e5199e7a-bb14-4db9-82b5-5504a11783e5 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:27.015849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e5199e7a-bb14-4db9-82b5-5504a11783e5 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef11e71018c54fd58b36183687630a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436c4edd7f24a738bf6455c71511e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:27.034727 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e5199e7a-bb14-4db9-82b5-5504a11783e5 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64" status: 200 len: 1525 microversion: 2.1 time: 0.269424 May 21 21:20:27.048249 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1279/2611] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:26 2022] GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64 => generated 1525 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:20:27.062150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2722ac0a-5494-4cf4-95d6-7f649a92d20e tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81ba01040>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:27.129829 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a9bcff08-2b8c-4af7-847b-6f7787ea80cb tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:27.148424 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a9bcff08-2b8c-4af7-847b-6f7787ea80cb tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1504 microversion: 2.1 time: 0.430800 May 21 21:20:27.149541 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1333/2612] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:26 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1504 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:27.161972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-235eb0a4-0006-41b9-8178-76b65156311d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:27.162182 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2722ac0a-5494-4cf4-95d6-7f649a92d20e tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33" status: 200 len: 1433 microversion: 2.1 time: 0.111549 May 21 21:20:27.164641 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1280/2613] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:27 2022] GET /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33 => generated 1433 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:27.164812 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-235eb0a4-0006-41b9-8178-76b65156311d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:27.179460 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-235eb0a4-0006-41b9-8178-76b65156311d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:27.180300 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-235eb0a4-0006-41b9-8178-76b65156311d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:27.181250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-235eb0a4-0006-41b9-8178-76b65156311d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:27.181850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-235eb0a4-0006-41b9-8178-76b65156311d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:27.188452 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8966f0c9-9985-4f78-89cc-ba4f6a105c1b tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b70d700>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:27.250862 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8966f0c9-9985-4f78-89cc-ba4f6a105c1b tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33" status: 200 len: 1433 microversion: 2.1 time: 0.076021 May 21 21:20:27.253051 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1281/2614] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:27 2022] GET /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33 => generated 1433 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:27.273067 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-40418006-567b-48ba-84c9-bc80774bc159 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:27.273935 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-40418006-567b-48ba-84c9-bc80774bc159 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:27.276808 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:27.290001 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40418006-567b-48ba-84c9-bc80774bc159 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:27.292593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40418006-567b-48ba-84c9-bc80774bc159 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:27.295156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40418006-567b-48ba-84c9-bc80774bc159 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:27.295608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40418006-567b-48ba-84c9-bc80774bc159 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:27.442795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=16 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:27.561216 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-40418006-567b-48ba-84c9-bc80774bc159 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:27.572182 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-40418006-567b-48ba-84c9-bc80774bc159 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1480 microversion: 2.1 time: 0.309439 May 21 21:20:27.581262 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1282/2615] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:27 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1480 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:27.606783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-235eb0a4-0006-41b9-8178-76b65156311d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:27.615653 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-235eb0a4-0006-41b9-8178-76b65156311d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1471 microversion: 2.1 time: 0.464928 May 21 21:20:27.616232 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1334/2616] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:27 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1471 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:28.059852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-631371fb-1a28-4f52-81cc-a5d18ca84de0 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:28.060523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-631371fb-1a28-4f52-81cc-a5d18ca84de0 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] [instance: 3b5199d5-87d8-4bde-ae22-452a8c2f1b64] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:28.070931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-631371fb-1a28-4f52-81cc-a5d18ca84de0 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:28.071617 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-631371fb-1a28-4f52-81cc-a5d18ca84de0 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:28.072859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-631371fb-1a28-4f52-81cc-a5d18ca84de0 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:28.073580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-631371fb-1a28-4f52-81cc-a5d18ca84de0 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:28.175901 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-79dce1e3-7fb3-423f-8a7f-2459b4c19113 req-54f3a1f7-65ef-470e-ac42-8d593498b128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b5199d5-87d8-4bde-ae22-452a8c2f1b64", "name": "network-vif-deleted", "tag": "d2e27846-408a-45f6-86fc-6fa6672c5352"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:28.194939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-79dce1e3-7fb3-423f-8a7f-2459b4c19113 req-54f3a1f7-65ef-470e-ac42-8d593498b128 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:28.195857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-631371fb-1a28-4f52-81cc-a5d18ca84de0 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef11e71018c54fd58b36183687630a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436c4edd7f24a738bf6455c71511e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:28.196133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-79dce1e3-7fb3-423f-8a7f-2459b4c19113 req-54f3a1f7-65ef-470e-ac42-8d593498b128 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:28.205173 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-631371fb-1a28-4f52-81cc-a5d18ca84de0 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64" status: 200 len: 1483 microversion: 2.1 time: 0.154259 May 21 21:20:28.205765 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1283/2617] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:28 2022] GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64 => generated 1483 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:28.218588 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-79dce1e3-7fb3-423f-8a7f-2459b4c19113 req-54f3a1f7-65ef-470e-ac42-8d593498b128 service nova] Creating event network-vif-deleted:d2e27846-408a-45f6-86fc-6fa6672c5352 for instance 3b5199d5-87d8-4bde-ae22-452a8c2f1b64 on nch2-master-1 May 21 21:20:28.222256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7900e124-8db1-4e8d-986c-25ae751cb611 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:28.223084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7900e124-8db1-4e8d-986c-25ae751cb611 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:28.233348 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-79dce1e3-7fb3-423f-8a7f-2459b4c19113 req-54f3a1f7-65ef-470e-ac42-8d593498b128 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070130 May 21 21:20:28.234630 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1335/2618] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:20:28.236848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7900e124-8db1-4e8d-986c-25ae751cb611 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:28.238383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7900e124-8db1-4e8d-986c-25ae751cb611 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:28.249491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7900e124-8db1-4e8d-986c-25ae751cb611 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:28.249950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7900e124-8db1-4e8d-986c-25ae751cb611 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:28.486663 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-ef5af30e-a170-49b4-880d-fd349db139b2 req-0a391fb1-08aa-48c5-92cf-066cd706048b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c07e27-b31b-4712-9bb2-19a2eca3b35b", "name": "network-vif-unplugged", "status": "completed", "tag": "b3fdc189-fac8-4e7f-96a7-d1881a26a02b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:28.503478 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ef5af30e-a170-49b4-880d-fd349db139b2 req-0a391fb1-08aa-48c5-92cf-066cd706048b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:28.504429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ef5af30e-a170-49b4-880d-fd349db139b2 req-0a391fb1-08aa-48c5-92cf-066cd706048b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:28.518588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.compute.server_external_events [req-ef5af30e-a170-49b4-880d-fd349db139b2 req-0a391fb1-08aa-48c5-92cf-066cd706048b service nova] Unable to find a host for instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b. Dropping event network-vif-unplugged {{(pid=131277) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 21 21:20:28.519722 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-ef5af30e-a170-49b4-880d-fd349db139b2 req-0a391fb1-08aa-48c5-92cf-066cd706048b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042134 May 21 21:20:28.520835 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1336/2619] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 21 21:20:28.601052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5ed5d39a-51f9-4133-92d6-cc50e0778d68 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:28.602236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5ed5d39a-51f9-4133-92d6-cc50e0778d68 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:28.627086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ed5d39a-51f9-4133-92d6-cc50e0778d68 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:28.628161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ed5d39a-51f9-4133-92d6-cc50e0778d68 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:28.631640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ed5d39a-51f9-4133-92d6-cc50e0778d68 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:28.633213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ed5d39a-51f9-4133-92d6-cc50e0778d68 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:28.885786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7900e124-8db1-4e8d-986c-25ae751cb611 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:28.894376 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7900e124-8db1-4e8d-986c-25ae751cb611 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 200 len: 1507 microversion: 2.1 time: 0.687540 May 21 21:20:28.897484 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1284/2620] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:28 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 1507 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:28.912710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5ed5d39a-51f9-4133-92d6-cc50e0778d68 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:28.918519 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-48af9dc5-ac18-42f8-aefd-8766f59855cc tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:28.919392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-48af9dc5-ac18-42f8-aefd-8766f59855cc tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:28.926119 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5ed5d39a-51f9-4133-92d6-cc50e0778d68 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1467 microversion: 2.1 time: 0.332284 May 21 21:20:28.927050 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1337/2621] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:28 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1467 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:28.932472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-48af9dc5-ac18-42f8-aefd-8766f59855cc tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:28.933326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-48af9dc5-ac18-42f8-aefd-8766f59855cc tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:28.934848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-48af9dc5-ac18-42f8-aefd-8766f59855cc tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:28.936558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-48af9dc5-ac18-42f8-aefd-8766f59855cc tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:28.947785 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0470c2c1-e422-44d3-be3f-90d6cc672da0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:28.951258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0470c2c1-e422-44d3-be3f-90d6cc672da0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:28.962760 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0470c2c1-e422-44d3-be3f-90d6cc672da0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:28.966153 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0470c2c1-e422-44d3-be3f-90d6cc672da0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:28.967303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0470c2c1-e422-44d3-be3f-90d6cc672da0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:28.969984 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0470c2c1-e422-44d3-be3f-90d6cc672da0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:29.022777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0470c2c1-e422-44d3-be3f-90d6cc672da0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:20:29.030515 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.compute.api [None req-0470c2c1-e422-44d3-be3f-90d6cc672da0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Working on deleting snapshot 2c51165e-100a-4731-ad5b-e55ef8a734a0 from shelved instance... May 21 21:20:29.260913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-48af9dc5-ac18-42f8-aefd-8766f59855cc tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:29.277205 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-48af9dc5-ac18-42f8-aefd-8766f59855cc tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1471 microversion: 2.1 time: 0.376729 May 21 21:20:29.278584 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1285/2622] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:28 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1471 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:29.310473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6045d41c-2e82-4fb1-ae27-465e05d34843 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc82d0840d0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:29.361695 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6045d41c-2e82-4fb1-ae27-465e05d34843 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c" status: 200 len: 784 microversion: 2.1 time: 0.081816 May 21 21:20:29.362282 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1286/2623] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:29 2022] GET /compute/v2.1/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c => generated 784 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:20:29.367510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-22f94443-0265-40eb-b3dd-e1e4bd444224 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1712575959", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "4b4ae44a-344c-414c-9407-d9df9d39bbe6"}, {"port": "4c631ba5-27ae-4db4-9ea4-c4c2d4945e7c", "tag": "port-1"}, {"port": "45483686-8652-4059-bc41-0b17ce21b793", "tag": "port-2"}, {"uuid": "810ec3d5-7c79-4479-87e7-6ace90943eb2", "tag": "net-1"}, {"uuid": "810ec3d5-7c79-4479-87e7-6ace90943eb2"}, {"uuid": "047a9abc-2f48-4141-a927-14782a2a4498", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "047a9abc-2f48-4141-a927-14782a2a4498", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "fbd362bc-b589-4852-bb3e-750dd5c3fb67", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "fb3476d9-3053-4b91-b4d4-9120b75e4434", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1958049234"}], "key_name": "tempest-keypair-973765525", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:29.558816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-22f94443-0265-40eb-b3dd-e1e4bd444224 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] validate_networks() for [('4b4ae44a-344c-414c-9407-d9df9d39bbe6', None, None, None, None, None), (None, None, '4c631ba5-27ae-4db4-9ea4-c4c2d4945e7c', None, None, None), (None, None, '45483686-8652-4059-bc41-0b17ce21b793', None, None, None), ('810ec3d5-7c79-4479-87e7-6ace90943eb2', None, None, None, None, None), ('810ec3d5-7c79-4479-87e7-6ace90943eb2', None, None, None, None, None), ('047a9abc-2f48-4141-a927-14782a2a4498', '10.2.2.100', None, None, None, None), ('047a9abc-2f48-4141-a927-14782a2a4498', '10.2.2.200', None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:20:30.852271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0470c2c1-e422-44d3-be3f-90d6cc672da0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Doing local delete in cell 4f046ce9-ac6c-44d8-b1fb-b7063eef06e7(cell1) {{(pid=131277) _delete /opt/stack/nova/nova/compute/api.py:2489}} May 21 21:20:30.853756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0470c2c1-e422-44d3-be3f-90d6cc672da0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:30.854346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0470c2c1-e422-44d3-be3f-90d6cc672da0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:30.854808 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.compute.api [None req-0470c2c1-e422-44d3-be3f-90d6cc672da0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. May 21 21:20:30.858698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-0470c2c1-e422-44d3-be3f-90d6cc672da0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] deallocate_for_instance() {{(pid=131277) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} May 21 21:20:31.533831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-0470c2c1-e422-44d3-be3f-90d6cc672da0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Updating instance_info_cache with network_info: [] {{(pid=131277) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 21 21:20:32.075547 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0470c2c1-e422-44d3-be3f-90d6cc672da0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 204 len: 0 microversion: 2.1 time: 3.146422 May 21 21:20:32.079154 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1338/2624] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:20:28 2022] DELETE /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 0 bytes in 3149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:20:32.081455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ba4a0413-0ff0-4c32-99cf-00af3b78e568 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:32.082102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ba4a0413-0ff0-4c32-99cf-00af3b78e568 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] [instance: 3b5199d5-87d8-4bde-ae22-452a8c2f1b64] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:32.088424 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba4a0413-0ff0-4c32-99cf-00af3b78e568 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:32.088848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba4a0413-0ff0-4c32-99cf-00af3b78e568 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:32.089638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba4a0413-0ff0-4c32-99cf-00af3b78e568 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:32.090083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba4a0413-0ff0-4c32-99cf-00af3b78e568 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:32.104146 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-ba4a0413-0ff0-4c32-99cf-00af3b78e568 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] HTTP exception thrown: Instance 3b5199d5-87d8-4bde-ae22-452a8c2f1b64 could not be found. May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ba4a0413-0ff0-4c32-99cf-00af3b78e568 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Request method failure captured: May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64 HTTP/1.1 May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVd9Kb0x3UK_hN-HT66GU7RKAG36w9prdIw0rax73NYBL-GaRTs_CwMtPYweXWWrghK1YREGOGYfgB3564Ovf_vqU4zf8WyYtdswW0hr3P8irTWzNiZ__fr7rpU7EWuOSGjduMX2fNfcDm54IAjMmD14u2Q6ErXOq6ZRQt2k713FiR0 May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 7436c4edd7f24a738bf6455c71511e24 May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7436c4edd7f24a738bf6455c71511e24", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7436c4edd7f24a738bf6455c71511e24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 7436c4edd7f24a738bf6455c71511e24 May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1562567064 May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerMetadataNegativeTestJSON-1562567064-project May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: ef11e71018c54fd58b36183687630a57 May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1562567064-project May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 3b5199d5-87d8-4bde-ae22-452a8c2f1b64 could not be found. May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '3b5199d5-87d8-4bde-ae22-452a8c2f1b64'} May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b5199d5-87d8-4bde-ae22-452a8c2f1b64 could not be found. May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b5199d5-87d8-4bde-ae22-452a8c2f1b64 could not be found. May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:32.106086 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:32.110171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:32.110171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:32.110171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:32.110171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:32.110171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:20:32.110171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:20:32.110171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b5199d5-87d8-4bde-ae22-452a8c2f1b64 could not be found. May 21 21:20:32.110171 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:32.110171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ba4a0413-0ff0-4c32-99cf-00af3b78e568 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] Returning 404 to user: Instance 3b5199d5-87d8-4bde-ae22-452a8c2f1b64 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:20:32.110171 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ba4a0413-0ff0-4c32-99cf-00af3b78e568 tempest-ServerMetadataNegativeTestJSON-1562567064 tempest-ServerMetadataNegativeTestJSON-1562567064-project] 10.222.0.49 "GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64" status: 404 len: 111 microversion: 2.1 time: 0.030089 May 21 21:20:32.110171 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1339/2625] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:32 2022] GET /compute/v2.1/servers/3b5199d5-87d8-4bde-ae22-452a8c2f1b64 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:20:32.113036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e3e9912f-d9c4-4f9b-b1eb-ed86b329230b tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:32.116848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-22f94443-0265-40eb-b3dd-e1e4bd444224 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:20:32.121344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-22f94443-0265-40eb-b3dd-e1e4bd444224 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:20:32.121344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-22f94443-0265-40eb-b3dd-e1e4bd444224 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:20:32.121344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-22f94443-0265-40eb-b3dd-e1e4bd444224 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:20:32.121344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-22f94443-0265-40eb-b3dd-e1e4bd444224 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:20:32.122205 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e3e9912f-d9c4-4f9b-b1eb-ed86b329230b tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012800 May 21 21:20:32.122999 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1340/2626] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:20:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:20:32.128393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b73a9eb2-0c3b-4145-869d-77da8f0ca691 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:32.129285 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b73a9eb2-0c3b-4145-869d-77da8f0ca691 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:32.130388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22f94443-0265-40eb-b3dd-e1e4bd444224 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:32.130844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22f94443-0265-40eb-b3dd-e1e4bd444224 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:32.131858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22f94443-0265-40eb-b3dd-e1e4bd444224 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:32.132556 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22f94443-0265-40eb-b3dd-e1e4bd444224 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:32.135425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b73a9eb2-0c3b-4145-869d-77da8f0ca691 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:32.135892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b73a9eb2-0c3b-4145-869d-77da8f0ca691 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:32.136710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b73a9eb2-0c3b-4145-869d-77da8f0ca691 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:32.137157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b73a9eb2-0c3b-4145-869d-77da8f0ca691 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:32.153247 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-22f94443-0265-40eb-b3dd-e1e4bd444224 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Getting quotas for project 60dca17b0239494f9e8effb6d535311f. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:20:32.156895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:32.159647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-22f94443-0265-40eb-b3dd-e1e4bd444224 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Getting quotas for user 3d4f720a68014a829929d6586cd9154d and project 60dca17b0239494f9e8effb6d535311f. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:20:32.323623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-22f94443-0265-40eb-b3dd-e1e4bd444224 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:20:32.327230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-22f94443-0265-40eb-b3dd-e1e4bd444224 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='fbd362bc-b589-4852-bb3e-750dd5c3fb67',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fb3476d9-3053-4b91-b4d4-9120b75e4434',volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:20:32.373440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b73a9eb2-0c3b-4145-869d-77da8f0ca691 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:32.381206 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b73a9eb2-0c3b-4145-869d-77da8f0ca691 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1471 microversion: 2.1 time: 0.256995 May 21 21:20:32.390964 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1341/2627] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:32 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1471 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:32.396642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dd0c1413-3961-42c9-9ac4-90df7f78bd8a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1201293925", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "6a46acbc-d74a-4d0c-96e7-09419be0470b"}], "security_groups": [{"name": "tempest-securitygroup--2024529948"}], "key_name": "tempest-keypair-2118406534", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:32.525345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-dd0c1413-3961-42c9-9ac4-90df7f78bd8a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] validate_networks() for [('6a46acbc-d74a-4d0c-96e7-09419be0470b', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:20:33.076042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-dd0c1413-3961-42c9-9ac4-90df7f78bd8a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Getting quotas for project bc039eff465a4f068284e9b62e10b195. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:20:33.081547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-dd0c1413-3961-42c9-9ac4-90df7f78bd8a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Getting quotas for user e316b7ec96f14eedbd57fe097c9fce0b and project bc039eff465a4f068284e9b62e10b195. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:20:33.095315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-dd0c1413-3961-42c9-9ac4-90df7f78bd8a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:20:33.095748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-dd0c1413-3961-42c9-9ac4-90df7f78bd8a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:20:33.096269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-dd0c1413-3961-42c9-9ac4-90df7f78bd8a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:20:33.096725 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-dd0c1413-3961-42c9-9ac4-90df7f78bd8a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:20:33.097146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-dd0c1413-3961-42c9-9ac4-90df7f78bd8a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:20:33.107590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd0c1413-3961-42c9-9ac4-90df7f78bd8a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:33.108457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd0c1413-3961-42c9-9ac4-90df7f78bd8a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:33.109926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd0c1413-3961-42c9-9ac4-90df7f78bd8a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:33.113865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd0c1413-3961-42c9-9ac4-90df7f78bd8a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:33.130414 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-dd0c1413-3961-42c9-9ac4-90df7f78bd8a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Getting quotas for project bc039eff465a4f068284e9b62e10b195. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:20:33.137885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-dd0c1413-3961-42c9-9ac4-90df7f78bd8a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Getting quotas for user e316b7ec96f14eedbd57fe097c9fce0b and project bc039eff465a4f068284e9b62e10b195. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:20:33.154906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dd0c1413-3961-42c9-9ac4-90df7f78bd8a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:20:33.159817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dd0c1413-3961-42c9-9ac4-90df7f78bd8a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:20:33.303182 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dd0c1413-3961-42c9-9ac4-90df7f78bd8a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.910612 May 21 21:20:33.309409 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1342/2628] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:20:32 2022] POST /compute/v2.1/servers => generated 407 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:20:33.309409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-2cdff2a2-df8a-46c2-965e-9736bbf34b74 req-34c159b8-2119-4513-8584-fedad182094a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c07e27-b31b-4712-9bb2-19a2eca3b35b", "name": "network-vif-deleted", "tag": "b3fdc189-fac8-4e7f-96a7-d1881a26a02b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:33.319876 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2cdff2a2-df8a-46c2-965e-9736bbf34b74 req-34c159b8-2119-4513-8584-fedad182094a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:33.320400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2cdff2a2-df8a-46c2-965e-9736bbf34b74 req-34c159b8-2119-4513-8584-fedad182094a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:33.332071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.compute.server_external_events [req-2cdff2a2-df8a-46c2-965e-9736bbf34b74 req-34c159b8-2119-4513-8584-fedad182094a service nova] Unable to find a host for instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b. Dropping event network-vif-deleted {{(pid=131277) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 21 21:20:33.333008 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-2cdff2a2-df8a-46c2-965e-9736bbf34b74 req-34c159b8-2119-4513-8584-fedad182094a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.028099 May 21 21:20:33.333618 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1343/2629] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 21 21:20:33.338197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-49835d3d-d10a-4fb3-ba46-b71242f33ad7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:33.338873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-49835d3d-d10a-4fb3-ba46-b71242f33ad7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:33.345809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49835d3d-d10a-4fb3-ba46-b71242f33ad7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:33.346533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49835d3d-d10a-4fb3-ba46-b71242f33ad7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:33.347346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49835d3d-d10a-4fb3-ba46-b71242f33ad7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:33.347782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-49835d3d-d10a-4fb3-ba46-b71242f33ad7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:33.363497 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-49835d3d-d10a-4fb3-ba46-b71242f33ad7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b could not be found. May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-49835d3d-d10a-4fb3-ba46-b71242f33ad7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b HTTP/1.1 May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b could not be found. May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'e4c07e27-b31b-4712-9bb2-19a2eca3b35b'} May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b could not be found. May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b could not be found. May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:33.365134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:33.376070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:33.376070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:33.376070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:33.376070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:20:33.376070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:20:33.376070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b could not be found. May 21 21:20:33.376070 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:20:33.376070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-49835d3d-d10a-4fb3-ba46-b71242f33ad7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:20:33.376070 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-49835d3d-d10a-4fb3-ba46-b71242f33ad7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 404 len: 111 microversion: 2.1 time: 0.031972 May 21 21:20:33.376070 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1344/2630] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:33 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:20:33.379017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2a696e67-e9b9-46c6-98c4-38e6c55292df tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b646790>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:33.627362 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-22f94443-0265-40eb-b3dd-e1e4bd444224 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 4.263545 May 21 21:20:33.628012 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1287/2631] 10.222.0.49 () {62 vars in 1188 bytes} [Sat May 21 21:20:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 4265 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 21 21:20:33.633436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-33d87e6e-36ef-4cf6-ad75-c6845b31dae0 req-65ea1a56-42fc-47bc-a074-412e604d5931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac", "name": "network-vif-unplugged", "status": "completed", "tag": "8d6ae2f7-1fa6-41fb-9029-17a3c0e7fb0d"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:33.643023 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-33d87e6e-36ef-4cf6-ad75-c6845b31dae0 req-65ea1a56-42fc-47bc-a074-412e604d5931 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:33.643478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-33d87e6e-36ef-4cf6-ad75-c6845b31dae0 req-65ea1a56-42fc-47bc-a074-412e604d5931 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:33.657667 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-33d87e6e-36ef-4cf6-ad75-c6845b31dae0 req-65ea1a56-42fc-47bc-a074-412e604d5931 service nova] Creating event network-vif-unplugged:8d6ae2f7-1fa6-41fb-9029-17a3c0e7fb0d for instance a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac on nch2-master-1 May 21 21:20:33.664180 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-33d87e6e-36ef-4cf6-ad75-c6845b31dae0 req-65ea1a56-42fc-47bc-a074-412e604d5931 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034817 May 21 21:20:33.665054 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1288/2632] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:20:33.673876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-790d1f3e-7425-46b9-96d6-915d08ce5b29 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:33.674688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-790d1f3e-7425-46b9-96d6-915d08ce5b29 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:33.767740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-790d1f3e-7425-46b9-96d6-915d08ce5b29 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:33.778900 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-790d1f3e-7425-46b9-96d6-915d08ce5b29 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 200 len: 1270 microversion: 2.1 time: 0.112072 May 21 21:20:33.780052 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1289/2633] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:33 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 1270 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:33.786701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0baa496d-d0e9-4c44-843a-f36ab595f839 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:33.787517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0baa496d-d0e9-4c44-843a-f36ab595f839 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:33.799706 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0baa496d-d0e9-4c44-843a-f36ab595f839 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:33.801442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0baa496d-d0e9-4c44-843a-f36ab595f839 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:33.803626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0baa496d-d0e9-4c44-843a-f36ab595f839 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:33.804370 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0baa496d-d0e9-4c44-843a-f36ab595f839 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:34.002956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0baa496d-d0e9-4c44-843a-f36ab595f839 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:34.012165 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0baa496d-d0e9-4c44-843a-f36ab595f839 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1471 microversion: 2.1 time: 0.230569 May 21 21:20:34.013107 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1290/2634] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:33 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1471 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:34.019548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c3f3e7c8-1e77-49d3-b4c6-a8940f2665cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-857249821", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "f95b9f39-db04-49ea-b57f-7951c8f566a9"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:34.091562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-c3f3e7c8-1e77-49d3-b4c6-a8940f2665cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] validate_networks() for [('f95b9f39-db04-49ea-b57f-7951c8f566a9', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:20:34.535555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-c3f3e7c8-1e77-49d3-b4c6-a8940f2665cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:20:34.535992 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-c3f3e7c8-1e77-49d3-b4c6-a8940f2665cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:20:34.536512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-c3f3e7c8-1e77-49d3-b4c6-a8940f2665cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:20:34.536964 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-c3f3e7c8-1e77-49d3-b4c6-a8940f2665cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:20:34.537421 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-c3f3e7c8-1e77-49d3-b4c6-a8940f2665cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:20:34.547833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3f3e7c8-1e77-49d3-b4c6-a8940f2665cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:34.548440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3f3e7c8-1e77-49d3-b4c6-a8940f2665cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:34.549177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3f3e7c8-1e77-49d3-b4c6-a8940f2665cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:34.556113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3f3e7c8-1e77-49d3-b4c6-a8940f2665cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:34.579460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-c3f3e7c8-1e77-49d3-b4c6-a8940f2665cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Getting quotas for project 8c48385dc5c24377a7be24da93fc54d9. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:20:34.585270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-c3f3e7c8-1e77-49d3-b4c6-a8940f2665cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Getting quotas for user c3e23800ab314cc28dc30330928d8454 and project 8c48385dc5c24377a7be24da93fc54d9. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:20:34.599509 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c3f3e7c8-1e77-49d3-b4c6-a8940f2665cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:20:34.602038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c3f3e7c8-1e77-49d3-b4c6-a8940f2665cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:20:34.810609 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c3f3e7c8-1e77-49d3-b4c6-a8940f2665cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.796219 May 21 21:20:34.816244 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1291/2635] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:20:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:20:34.821945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-92c0ac6a-05e1-4568-b94d-a163f4cf5a13 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:34.823225 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-92c0ac6a-05e1-4568-b94d-a163f4cf5a13 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:34.902939 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-92c0ac6a-05e1-4568-b94d-a163f4cf5a13 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:34.912211 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-92c0ac6a-05e1-4568-b94d-a163f4cf5a13 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:34.914225 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-92c0ac6a-05e1-4568-b94d-a163f4cf5a13 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:34.915654 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-92c0ac6a-05e1-4568-b94d-a163f4cf5a13 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1285 microversion: 2.42 time: 0.098087 May 21 21:20:34.916600 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1292/2636] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:34 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:34.933714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-89977bcd-574e-4db8-8dd2-8958e9cad83f tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:34.933714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-89977bcd-574e-4db8-8dd2-8958e9cad83f tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:34.995865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-89977bcd-574e-4db8-8dd2-8958e9cad83f tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:35.003981 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-89977bcd-574e-4db8-8dd2-8958e9cad83f tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 200 len: 1270 microversion: 2.1 time: 0.086151 May 21 21:20:35.004844 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1293/2637] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:34 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:35.010520 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bf21a350-3776-483b-9e80-00ce3c675e28 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:35.011198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bf21a350-3776-483b-9e80-00ce3c675e28 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:35.057755 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2a696e67-e9b9-46c6-98c4-38e6c55292df tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "DELETE /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33" status: 204 len: 0 microversion: 2.1 time: 1.689227 May 21 21:20:35.058326 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1345/2638] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:33 2022] DELETE /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33 => generated 0 bytes in 1690 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:20:35.063849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cb31b58f-b889-44ff-a090-96d076b8b576 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:35.064417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cb31b58f-b889-44ff-a090-96d076b8b576 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:35.080404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb31b58f-b889-44ff-a090-96d076b8b576 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:35.080963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb31b58f-b889-44ff-a090-96d076b8b576 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:35.081816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb31b58f-b889-44ff-a090-96d076b8b576 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:35.082264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb31b58f-b889-44ff-a090-96d076b8b576 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:35.103509 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bf21a350-3776-483b-9e80-00ce3c675e28 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:35.112746 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bf21a350-3776-483b-9e80-00ce3c675e28 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1214 microversion: 2.1 time: 0.106457 May 21 21:20:35.113337 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1294/2639] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:35 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:35.118301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f7eba2ff-597d-44ff-9ae4-e6fe25b8eed4 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81bc7b670>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:35.139647 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-f7eba2ff-597d-44ff-9ae4-e6fe25b8eed4 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] HTTP exception thrown: Image not found. May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f7eba2ff-597d-44ff-9ae4-e6fe25b8eed4 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Request method failure captured: May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33 HTTP/1.1 May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVdnJPe2QpOAqIgfS_lQUmFzCyNAQMixmHahDCMVRXM3RX5T0IUgSoOXyzj3HD9hX_mZSQHZXhON28qMMGkAQnHzL_XTq6oaV2xpU8b7kVJZqVHhALustU3qAEFvUQK8zLm6yW-3346WaxxeSLRoX2PWggdlmWxSzWlh9dq98hCRnjc May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 496224b299024b6d80653bc12f672f8c May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesOneServerTestJSON-1954921495 May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/496224b299024b6d80653bc12f672f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/496224b299024b6d80653bc12f672f8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_496224b299024b6d80653bc12f672f8c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/496224b299024b6d80653bc12f672f8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesOneServerTestJSON-1954921495 May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 496224b299024b6d80653bc12f672f8c May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1954921495 May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesOneServerTestJSON-1954921495-project May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 8b6c47e9586f4a70b86651a35f9bcbbb May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesOneServerTestJSON-1954921495-project May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: exception: Image not found. May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '9d7584f4-9aee-43e4-96ab-27fed0337f33'} May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9d7584f4-9aee-43e4-96ab-27fed0337f33 May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 21 21:20:35.141921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9d7584f4-9aee-43e4-96ab-27fed0337f33 could not be found. May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f7eba2ff-597d-44ff-9ae4-e6fe25b8eed4 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Returning 404 to user: Image not found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f7eba2ff-597d-44ff-9ae4-e6fe25b8eed4 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33" status: 404 len: 62 microversion: 2.1 time: 0.029058 May 21 21:20:35.146042 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1295/2640] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:35 2022] GET /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33 => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:20:35.153806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-184c050e-fa12-4801-8a61-399b35e21994 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-868141961"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:35.155162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-184c050e-fa12-4801-8a61-399b35e21994 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:35.163010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-184c050e-fa12-4801-8a61-399b35e21994 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:35.163467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-184c050e-fa12-4801-8a61-399b35e21994 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:35.164600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-184c050e-fa12-4801-8a61-399b35e21994 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:35.165145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-184c050e-fa12-4801-8a61-399b35e21994 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:35.274778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cb31b58f-b889-44ff-a090-96d076b8b576 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:35.284073 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cb31b58f-b889-44ff-a090-96d076b8b576 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1471 microversion: 2.1 time: 0.224586 May 21 21:20:35.284675 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1346/2641] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:35 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1471 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:35.535095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:35.812782 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-184c050e-fa12-4801-8a61-399b35e21994 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "POST /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac/action" status: 202 len: 0 microversion: 2.1 time: 0.662621 May 21 21:20:35.816676 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1296/2642] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:20:35 2022] POST /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac/action => generated 0 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 21 21:20:35.823142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5ca8695e-9106-4e2b-9ec6-d6e4767045cd tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b646c10>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:35.873273 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5ca8695e-9106-4e2b-9ec6-d6e4767045cd tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 200 len: 1428 microversion: 2.1 time: 0.054027 May 21 21:20:35.873960 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1347/2643] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:35 2022] GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 1428 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:35.936895 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ee0514a9-892a-4ad6-9238-21b50e40c4ee tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:35.937633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ee0514a9-892a-4ad6-9238-21b50e40c4ee tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:35.944620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee0514a9-892a-4ad6-9238-21b50e40c4ee tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:35.945082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee0514a9-892a-4ad6-9238-21b50e40c4ee tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:35.945897 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee0514a9-892a-4ad6-9238-21b50e40c4ee tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:35.946335 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee0514a9-892a-4ad6-9238-21b50e40c4ee tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:36.021788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-092a4ede-a500-4472-b860-1c0c65cc5d50 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:36.022480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-092a4ede-a500-4472-b860-1c0c65cc5d50 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:36.024785 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ee0514a9-892a-4ad6-9238-21b50e40c4ee tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:36.030813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-092a4ede-a500-4472-b860-1c0c65cc5d50 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:36.031749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-092a4ede-a500-4472-b860-1c0c65cc5d50 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:36.033717 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-092a4ede-a500-4472-b860-1c0c65cc5d50 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:36.034279 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-092a4ede-a500-4472-b860-1c0c65cc5d50 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:36.035272 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ee0514a9-892a-4ad6-9238-21b50e40c4ee tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:36.036940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ee0514a9-892a-4ad6-9238-21b50e40c4ee tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:36.038454 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ee0514a9-892a-4ad6-9238-21b50e40c4ee tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1519 microversion: 2.42 time: 0.107204 May 21 21:20:36.039024 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1297/2644] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:35 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1519 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:36.121628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-092a4ede-a500-4472-b860-1c0c65cc5d50 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:36.130233 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0b0117e2-280a-49f7-b42a-4d4e12338d73 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:36.131423 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-092a4ede-a500-4472-b860-1c0c65cc5d50 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 200 len: 1322 microversion: 2.1 time: 0.114353 May 21 21:20:36.131681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0b0117e2-280a-49f7-b42a-4d4e12338d73 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:36.132084 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1348/2645] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:36 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 1322 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:36.140755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b0117e2-280a-49f7-b42a-4d4e12338d73 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:36.141814 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b0117e2-280a-49f7-b42a-4d4e12338d73 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:36.142789 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b0117e2-280a-49f7-b42a-4d4e12338d73 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:36.143588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b0117e2-280a-49f7-b42a-4d4e12338d73 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:36.230987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0b0117e2-280a-49f7-b42a-4d4e12338d73 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:36.238543 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0b0117e2-280a-49f7-b42a-4d4e12338d73 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1218 microversion: 2.1 time: 0.112689 May 21 21:20:36.248855 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1298/2646] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:36 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:20:36.304311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4605c890-3afb-4e7b-a51c-26a8b41cdd1b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:36.304954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4605c890-3afb-4e7b-a51c-26a8b41cdd1b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:36.315525 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4605c890-3afb-4e7b-a51c-26a8b41cdd1b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:36.316245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4605c890-3afb-4e7b-a51c-26a8b41cdd1b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:36.317230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4605c890-3afb-4e7b-a51c-26a8b41cdd1b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:36.317835 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4605c890-3afb-4e7b-a51c-26a8b41cdd1b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:36.479317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4605c890-3afb-4e7b-a51c-26a8b41cdd1b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:36.486668 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4605c890-3afb-4e7b-a51c-26a8b41cdd1b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1471 microversion: 2.1 time: 0.187462 May 21 21:20:36.492099 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1349/2647] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:36 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1471 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:36.887180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6f6ddff5-3360-4611-8e71-6c14e6eb000d tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b8c7dc0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:36.934767 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6f6ddff5-3360-4611-8e71-6c14e6eb000d tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 200 len: 1428 microversion: 2.1 time: 0.051563 May 21 21:20:36.935338 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1299/2648] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:36 2022] GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 1428 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:37.059988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c605ac63-ef35-4ef9-952d-7d594145e248 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:37.061028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c605ac63-ef35-4ef9-952d-7d594145e248 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:37.075894 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c605ac63-ef35-4ef9-952d-7d594145e248 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:37.076819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c605ac63-ef35-4ef9-952d-7d594145e248 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:37.077199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c605ac63-ef35-4ef9-952d-7d594145e248 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:37.077645 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c605ac63-ef35-4ef9-952d-7d594145e248 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:37.153621 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8c808e6a-c7a2-4576-8226-825d47f892b7 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:37.154719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8c808e6a-c7a2-4576-8226-825d47f892b7 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:37.172920 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c808e6a-c7a2-4576-8226-825d47f892b7 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:37.173508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c808e6a-c7a2-4576-8226-825d47f892b7 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:37.174383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c808e6a-c7a2-4576-8226-825d47f892b7 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:37.180428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c808e6a-c7a2-4576-8226-825d47f892b7 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:37.223259 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c605ac63-ef35-4ef9-952d-7d594145e248 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:37.267476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c605ac63-ef35-4ef9-952d-7d594145e248 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:37.269747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c605ac63-ef35-4ef9-952d-7d594145e248 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:37.288733 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c605ac63-ef35-4ef9-952d-7d594145e248 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1575 microversion: 2.42 time: 0.232678 May 21 21:20:37.292004 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1350/2649] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:37 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1575 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:37.301552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5567b28b-8a95-4dd4-a667-66d7d7f9f228 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:37.312391 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5567b28b-8a95-4dd4-a667-66d7d7f9f228 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:37.326203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8c808e6a-c7a2-4576-8226-825d47f892b7 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:37.340147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5567b28b-8a95-4dd4-a667-66d7d7f9f228 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:37.344845 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8c808e6a-c7a2-4576-8226-825d47f892b7 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 200 len: 1330 microversion: 2.1 time: 0.199245 May 21 21:20:37.348723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5567b28b-8a95-4dd4-a667-66d7d7f9f228 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:37.354346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5567b28b-8a95-4dd4-a667-66d7d7f9f228 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:37.354346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5567b28b-8a95-4dd4-a667-66d7d7f9f228 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:37.356060 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1300/2650] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:37 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 1330 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:37.493089 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5567b28b-8a95-4dd4-a667-66d7d7f9f228 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:37.504318 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5567b28b-8a95-4dd4-a667-66d7d7f9f228 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1266 microversion: 2.1 time: 0.209772 May 21 21:20:37.504962 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1351/2651] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:37 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:37.513141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dec02b2b-0d8f-4102-aad1-9a1e243a18b4 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:37.514277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dec02b2b-0d8f-4102-aad1-9a1e243a18b4 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:37.521287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dec02b2b-0d8f-4102-aad1-9a1e243a18b4 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:37.521810 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dec02b2b-0d8f-4102-aad1-9a1e243a18b4 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:37.522865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dec02b2b-0d8f-4102-aad1-9a1e243a18b4 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:37.523308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dec02b2b-0d8f-4102-aad1-9a1e243a18b4 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:37.569625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7c74d845-9870-42c3-8cfe-3b7ba6bfd496 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1590903770", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "cf98f3ea-93c2-4975-a4c5-ab86241352d9"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:37.624103 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-7c74d845-9870-42c3-8cfe-3b7ba6bfd496 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] validate_networks() for [('cf98f3ea-93c2-4975-a4c5-ab86241352d9', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:20:37.688100 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-dec02b2b-0d8f-4102-aad1-9a1e243a18b4 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:37.696167 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dec02b2b-0d8f-4102-aad1-9a1e243a18b4 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1471 microversion: 2.1 time: 0.189958 May 21 21:20:37.697502 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1352/2652] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:37 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1471 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:37.947966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-238fa346-a958-4039-b7c6-d1ec67461141 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b620310>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:38.014631 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-238fa346-a958-4039-b7c6-d1ec67461141 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 200 len: 1428 microversion: 2.1 time: 0.071109 May 21 21:20:38.015191 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1353/2653] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:37 2022] GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 1428 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:20:38.310465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-328c86b0-ce35-4fba-aa86-ac5f25fd88dd tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:38.312264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-328c86b0-ce35-4fba-aa86-ac5f25fd88dd tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:38.321864 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-328c86b0-ce35-4fba-aa86-ac5f25fd88dd tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:38.323485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-328c86b0-ce35-4fba-aa86-ac5f25fd88dd tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:38.324711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-328c86b0-ce35-4fba-aa86-ac5f25fd88dd tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:38.325771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-328c86b0-ce35-4fba-aa86-ac5f25fd88dd tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:38.409411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-328c86b0-ce35-4fba-aa86-ac5f25fd88dd tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:38.419569 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-328c86b0-ce35-4fba-aa86-ac5f25fd88dd tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:38.422517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-328c86b0-ce35-4fba-aa86-ac5f25fd88dd tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:38.424959 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-328c86b0-ce35-4fba-aa86-ac5f25fd88dd tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1593 microversion: 2.42 time: 0.118056 May 21 21:20:38.426059 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1354/2654] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:38 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1593 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:38.439227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5605627a-355b-494b-8581-9cad33931e05 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:38.440119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5605627a-355b-494b-8581-9cad33931e05 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:38.449497 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5605627a-355b-494b-8581-9cad33931e05 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:38.450236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5605627a-355b-494b-8581-9cad33931e05 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:38.451284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5605627a-355b-494b-8581-9cad33931e05 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:38.451921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5605627a-355b-494b-8581-9cad33931e05 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:38.555173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5605627a-355b-494b-8581-9cad33931e05 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:38.566458 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5605627a-355b-494b-8581-9cad33931e05 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 200 len: 1328 microversion: 2.1 time: 0.138794 May 21 21:20:38.567560 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1355/2655] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:38 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 1328 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:38.581380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ff36e287-719c-4860-909e-aaf1c99735c8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:38.582422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ff36e287-719c-4860-909e-aaf1c99735c8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:38.593315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff36e287-719c-4860-909e-aaf1c99735c8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:38.593851 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff36e287-719c-4860-909e-aaf1c99735c8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:38.594740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff36e287-719c-4860-909e-aaf1c99735c8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:38.595301 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff36e287-719c-4860-909e-aaf1c99735c8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:38.684007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ff36e287-719c-4860-909e-aaf1c99735c8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:38.693176 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ff36e287-719c-4860-909e-aaf1c99735c8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1272 microversion: 2.1 time: 0.124241 May 21 21:20:38.693763 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1356/2656] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:38 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1272 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:38.714838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4dcdabe3-cdde-4631-ae35-32a1355e57c7 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:38.715735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4dcdabe3-cdde-4631-ae35-32a1355e57c7 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:38.723549 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4dcdabe3-cdde-4631-ae35-32a1355e57c7 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:38.724236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4dcdabe3-cdde-4631-ae35-32a1355e57c7 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:38.725595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4dcdabe3-cdde-4631-ae35-32a1355e57c7 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:38.726976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4dcdabe3-cdde-4631-ae35-32a1355e57c7 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:38.936660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4dcdabe3-cdde-4631-ae35-32a1355e57c7 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:38.950537 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4dcdabe3-cdde-4631-ae35-32a1355e57c7 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1471 microversion: 2.1 time: 0.240007 May 21 21:20:38.951265 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1357/2657] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:38 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1471 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:39.027688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-637a525e-ccb5-4d29-996d-7febbad5a74d tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81bced430>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:39.074211 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-637a525e-ccb5-4d29-996d-7febbad5a74d tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 200 len: 1428 microversion: 2.1 time: 0.050688 May 21 21:20:39.077594 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1358/2658] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:39 2022] GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 1428 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:20:39.189643 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-7c74d845-9870-42c3-8cfe-3b7ba6bfd496 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:20:39.192253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-7c74d845-9870-42c3-8cfe-3b7ba6bfd496 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:20:39.192253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-7c74d845-9870-42c3-8cfe-3b7ba6bfd496 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:20:39.192253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-7c74d845-9870-42c3-8cfe-3b7ba6bfd496 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:20:39.192253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-7c74d845-9870-42c3-8cfe-3b7ba6bfd496 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:20:39.201324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c74d845-9870-42c3-8cfe-3b7ba6bfd496 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:39.206860 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c74d845-9870-42c3-8cfe-3b7ba6bfd496 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:39.206860 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c74d845-9870-42c3-8cfe-3b7ba6bfd496 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:39.206860 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c74d845-9870-42c3-8cfe-3b7ba6bfd496 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:39.221680 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-7c74d845-9870-42c3-8cfe-3b7ba6bfd496 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Getting quotas for project e341c8308bde44b19203f2eb21a16dc9. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:20:39.227172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-7c74d845-9870-42c3-8cfe-3b7ba6bfd496 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Getting quotas for user 48247ec5dc95420aadf9bda93a3ef118 and project e341c8308bde44b19203f2eb21a16dc9. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:20:39.241764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7c74d845-9870-42c3-8cfe-3b7ba6bfd496 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:20:39.243572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7c74d845-9870-42c3-8cfe-3b7ba6bfd496 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:20:39.389910 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7c74d845-9870-42c3-8cfe-3b7ba6bfd496 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.001888 May 21 21:20:39.402124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a5b3647d-c814-42c8-9a99-1a0830b17ca1 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:39.402790 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a5b3647d-c814-42c8-9a99-1a0830b17ca1 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:39.406113 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1301/2659] 10.222.0.49 () {62 vars in 1187 bytes} [Sat May 21 21:20:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2018 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 21 21:20:39.445465 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-74024927-9d77-462c-81f9-400352a2b568 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:39.446006 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-74024927-9d77-462c-81f9-400352a2b568 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:39.455776 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-74024927-9d77-462c-81f9-400352a2b568 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:39.460056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-74024927-9d77-462c-81f9-400352a2b568 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:39.460056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-74024927-9d77-462c-81f9-400352a2b568 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:39.460056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-74024927-9d77-462c-81f9-400352a2b568 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:39.473338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a5b3647d-c814-42c8-9a99-1a0830b17ca1 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:39.489142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a5b3647d-c814-42c8-9a99-1a0830b17ca1 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:39.489142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a5b3647d-c814-42c8-9a99-1a0830b17ca1 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:39.489142 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a5b3647d-c814-42c8-9a99-1a0830b17ca1 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d" status: 200 len: 1262 microversion: 2.26 time: 0.087738 May 21 21:20:39.496700 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1359/2660] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:39 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d => generated 1262 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:39.562694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-74024927-9d77-462c-81f9-400352a2b568 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:39.580901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-74024927-9d77-462c-81f9-400352a2b568 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:39.583166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-74024927-9d77-462c-81f9-400352a2b568 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:39.584376 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-74024927-9d77-462c-81f9-400352a2b568 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1593 microversion: 2.42 time: 0.143071 May 21 21:20:39.585201 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1302/2661] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:39 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1593 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:20:39.601541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-341df027-c1d4-4168-8251-b26e7164c5f2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:39.601541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-341df027-c1d4-4168-8251-b26e7164c5f2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:39.604906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-341df027-c1d4-4168-8251-b26e7164c5f2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:39.605356 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-341df027-c1d4-4168-8251-b26e7164c5f2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:39.606524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-341df027-c1d4-4168-8251-b26e7164c5f2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:39.606965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-341df027-c1d4-4168-8251-b26e7164c5f2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:39.720101 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b99d6c6d-ecaf-44e6-aea3-aab8a6225702 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:39.721802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b99d6c6d-ecaf-44e6-aea3-aab8a6225702 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:39.735951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b99d6c6d-ecaf-44e6-aea3-aab8a6225702 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:39.736801 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b99d6c6d-ecaf-44e6-aea3-aab8a6225702 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:39.737846 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b99d6c6d-ecaf-44e6-aea3-aab8a6225702 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:39.738576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b99d6c6d-ecaf-44e6-aea3-aab8a6225702 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:39.813536 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-341df027-c1d4-4168-8251-b26e7164c5f2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:39.823065 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-341df027-c1d4-4168-8251-b26e7164c5f2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 200 len: 1396 microversion: 2.1 time: 0.240364 May 21 21:20:39.824268 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1360/2662] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:39 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 1396 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:39.919602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b99d6c6d-ecaf-44e6-aea3-aab8a6225702 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:39.928931 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b99d6c6d-ecaf-44e6-aea3-aab8a6225702 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1272 microversion: 2.1 time: 0.214364 May 21 21:20:39.929516 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1303/2663] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:39 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1272 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:39.968153 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fdf11270-d45e-421d-ab1c-c91e08ad01a2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:39.968711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fdf11270-d45e-421d-ab1c-c91e08ad01a2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:39.981968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fdf11270-d45e-421d-ab1c-c91e08ad01a2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:39.982297 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fdf11270-d45e-421d-ab1c-c91e08ad01a2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:39.983109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fdf11270-d45e-421d-ab1c-c91e08ad01a2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:39.983553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fdf11270-d45e-421d-ab1c-c91e08ad01a2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:40.090560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a93ddc20-cfdc-463c-a5c7-a91f54b11489 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b65ef70>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:40.168766 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a93ddc20-cfdc-463c-a5c7-a91f54b11489 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 200 len: 1428 microversion: 2.1 time: 0.079803 May 21 21:20:40.170579 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1304/2664] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:40 2022] GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 1428 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:40.261022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fdf11270-d45e-421d-ab1c-c91e08ad01a2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:40.269101 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fdf11270-d45e-421d-ab1c-c91e08ad01a2 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1471 microversion: 2.1 time: 0.304927 May 21 21:20:40.269900 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1361/2665] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:39 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1471 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:40.521205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b52faca2-33a8-4532-bfe6-2e6e152720ad tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:40.523432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b52faca2-33a8-4532-bfe6-2e6e152720ad tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:40.603027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a976d879-f4ba-4e6d-9c0f-8c06be676817 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:40.604230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a976d879-f4ba-4e6d-9c0f-8c06be676817 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:40.608150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:40.611702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a976d879-f4ba-4e6d-9c0f-8c06be676817 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:40.612150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a976d879-f4ba-4e6d-9c0f-8c06be676817 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:40.612944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a976d879-f4ba-4e6d-9c0f-8c06be676817 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:40.613379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a976d879-f4ba-4e6d-9c0f-8c06be676817 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:40.720780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a976d879-f4ba-4e6d-9c0f-8c06be676817 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:40.732872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a976d879-f4ba-4e6d-9c0f-8c06be676817 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:40.734749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a976d879-f4ba-4e6d-9c0f-8c06be676817 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:40.736320 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a976d879-f4ba-4e6d-9c0f-8c06be676817 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1593 microversion: 2.42 time: 0.137228 May 21 21:20:40.737405 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1362/2666] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:40 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1593 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:20:40.753343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-8881796f-1cc3-4d1c-922f-7c8358ee4f41 req-6a261596-f1c9-4d69-9db8-40460a77bac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac", "name": "network-vif-plugged", "status": "completed", "tag": "8d6ae2f7-1fa6-41fb-9029-17a3c0e7fb0d"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:40.764311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8881796f-1cc3-4d1c-922f-7c8358ee4f41 req-6a261596-f1c9-4d69-9db8-40460a77bac7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:40.767308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8881796f-1cc3-4d1c-922f-7c8358ee4f41 req-6a261596-f1c9-4d69-9db8-40460a77bac7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:40.780339 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-8881796f-1cc3-4d1c-922f-7c8358ee4f41 req-6a261596-f1c9-4d69-9db8-40460a77bac7 service nova] Creating event network-vif-plugged:8d6ae2f7-1fa6-41fb-9029-17a3c0e7fb0d for instance a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac on nch2-master-1 May 21 21:20:40.786783 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-8881796f-1cc3-4d1c-922f-7c8358ee4f41 req-6a261596-f1c9-4d69-9db8-40460a77bac7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037320 May 21 21:20:40.791318 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1363/2667] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:20:40.840830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-796bfff2-1b32-4ce3-ab58-0fbfc09418c0 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:40.841856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-796bfff2-1b32-4ce3-ab58-0fbfc09418c0 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:40.855026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-796bfff2-1b32-4ce3-ab58-0fbfc09418c0 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:40.855746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-796bfff2-1b32-4ce3-ab58-0fbfc09418c0 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:40.856722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-796bfff2-1b32-4ce3-ab58-0fbfc09418c0 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:40.857368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-796bfff2-1b32-4ce3-ab58-0fbfc09418c0 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:40.970226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b52faca2-33a8-4532-bfe6-2e6e152720ad tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:40.981193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b52faca2-33a8-4532-bfe6-2e6e152720ad tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:40.983566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b52faca2-33a8-4532-bfe6-2e6e152720ad tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:40.984330 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b52faca2-33a8-4532-bfe6-2e6e152720ad tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d" status: 200 len: 1262 microversion: 2.26 time: 0.484990 May 21 21:20:40.996260 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1305/2668] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:40 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d => generated 1262 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:41.001646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-349d8971-9999-4b97-883b-92dee4366b23 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:41.002604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-349d8971-9999-4b97-883b-92dee4366b23 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:41.009215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-349d8971-9999-4b97-883b-92dee4366b23 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:41.011079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-349d8971-9999-4b97-883b-92dee4366b23 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:41.011949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-349d8971-9999-4b97-883b-92dee4366b23 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:41.012546 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-349d8971-9999-4b97-883b-92dee4366b23 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:41.102165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-796bfff2-1b32-4ce3-ab58-0fbfc09418c0 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:41.110954 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-796bfff2-1b32-4ce3-ab58-0fbfc09418c0 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 200 len: 1396 microversion: 2.1 time: 0.274940 May 21 21:20:41.111544 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1364/2669] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:40 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 1396 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:20:41.194850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4bb0d02a-f906-4ebe-953b-1bab08a9c4d6 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b3d1160>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:41.268808 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4bb0d02a-f906-4ebe-953b-1bab08a9c4d6 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 200 len: 1428 microversion: 2.1 time: 0.078378 May 21 21:20:41.270171 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1365/2670] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:41 2022] GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 1428 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:41.288683 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-676f7a68-38e5-4d8e-9a8e-d260fbe3201a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:41.291554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-676f7a68-38e5-4d8e-9a8e-d260fbe3201a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:41.307368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-676f7a68-38e5-4d8e-9a8e-d260fbe3201a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:41.307867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-676f7a68-38e5-4d8e-9a8e-d260fbe3201a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:41.308727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-676f7a68-38e5-4d8e-9a8e-d260fbe3201a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:41.309351 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-676f7a68-38e5-4d8e-9a8e-d260fbe3201a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:41.448490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-349d8971-9999-4b97-883b-92dee4366b23 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:41.457613 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-349d8971-9999-4b97-883b-92dee4366b23 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1314 microversion: 2.1 time: 0.459871 May 21 21:20:41.458435 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1306/2671] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:40 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:41.487674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-676f7a68-38e5-4d8e-9a8e-d260fbe3201a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:41.491651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:41.498144 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-676f7a68-38e5-4d8e-9a8e-d260fbe3201a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1489 microversion: 2.1 time: 0.214394 May 21 21:20:41.512462 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1366/2672] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:41 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1489 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:41.755417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3f8f99f4-ae8c-49c9-b9ef-1ad36b8da0ab tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:41.755968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3f8f99f4-ae8c-49c9-b9ef-1ad36b8da0ab tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:41.765357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f8f99f4-ae8c-49c9-b9ef-1ad36b8da0ab tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:41.768512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f8f99f4-ae8c-49c9-b9ef-1ad36b8da0ab tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:41.778237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f8f99f4-ae8c-49c9-b9ef-1ad36b8da0ab tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:41.778237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f8f99f4-ae8c-49c9-b9ef-1ad36b8da0ab tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:42.004227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-15ae27b6-7730-4e9d-9349-4cddd56aff91 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:42.005927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-15ae27b6-7730-4e9d-9349-4cddd56aff91 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:42.024252 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15ae27b6-7730-4e9d-9349-4cddd56aff91 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:42.031750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15ae27b6-7730-4e9d-9349-4cddd56aff91 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:42.033163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15ae27b6-7730-4e9d-9349-4cddd56aff91 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:42.033702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15ae27b6-7730-4e9d-9349-4cddd56aff91 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:42.161509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-15ae27b6-7730-4e9d-9349-4cddd56aff91 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:42.172089 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-15ae27b6-7730-4e9d-9349-4cddd56aff91 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:42.174464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-15ae27b6-7730-4e9d-9349-4cddd56aff91 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:42.175823 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-15ae27b6-7730-4e9d-9349-4cddd56aff91 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d" status: 200 len: 1314 microversion: 2.26 time: 0.175831 May 21 21:20:42.177011 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1367/2673] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:41 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:42.199172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7794b25f-273d-419c-955b-2db4f0af5194 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:42.201289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7794b25f-273d-419c-955b-2db4f0af5194 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:42.209327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7794b25f-273d-419c-955b-2db4f0af5194 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:42.210167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7794b25f-273d-419c-955b-2db4f0af5194 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:42.211169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7794b25f-273d-419c-955b-2db4f0af5194 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:42.211755 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7794b25f-273d-419c-955b-2db4f0af5194 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:42.365557 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3f8f99f4-ae8c-49c9-b9ef-1ad36b8da0ab tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:42.376933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3f8f99f4-ae8c-49c9-b9ef-1ad36b8da0ab tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:42.382569 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3f8f99f4-ae8c-49c9-b9ef-1ad36b8da0ab tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:42.387509 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3f8f99f4-ae8c-49c9-b9ef-1ad36b8da0ab tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1661 microversion: 2.42 time: 0.634889 May 21 21:20:42.400663 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1307/2674] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:41 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1661 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:42.407850 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a2ec2c15-5d6a-4a57-86da-ad34689baf2e tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b65e4c0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:42.488404 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a2ec2c15-5d6a-4a57-86da-ad34689baf2e tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 200 len: 1428 microversion: 2.1 time: 0.086279 May 21 21:20:42.492365 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1308/2675] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:42 2022] GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 1428 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:42.495089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f3f7372a-769b-4f63-91dc-7fb3616ba85a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:42.495900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f3f7372a-769b-4f63-91dc-7fb3616ba85a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:42.505140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3f7372a-769b-4f63-91dc-7fb3616ba85a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:42.505844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3f7372a-769b-4f63-91dc-7fb3616ba85a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:42.506818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3f7372a-769b-4f63-91dc-7fb3616ba85a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:42.507408 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3f7372a-769b-4f63-91dc-7fb3616ba85a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:42.545258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7794b25f-273d-419c-955b-2db4f0af5194 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:42.554101 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7794b25f-273d-419c-955b-2db4f0af5194 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 200 len: 1396 microversion: 2.1 time: 0.375599 May 21 21:20:42.564727 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1368/2676] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:42 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 1396 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:42.569929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9b456728-6ca2-40c7-a157-005470ce4d17 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:42.570776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9b456728-6ca2-40c7-a157-005470ce4d17 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:42.581551 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b456728-6ca2-40c7-a157-005470ce4d17 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:42.582282 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b456728-6ca2-40c7-a157-005470ce4d17 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:42.583313 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b456728-6ca2-40c7-a157-005470ce4d17 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:42.584037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b456728-6ca2-40c7-a157-005470ce4d17 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:42.795481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9b456728-6ca2-40c7-a157-005470ce4d17 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:42.808107 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9b456728-6ca2-40c7-a157-005470ce4d17 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1477 microversion: 2.1 time: 0.241458 May 21 21:20:42.809293 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1369/2677] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:42 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1477 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:43.195528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d540d154-748e-4dca-b9ca-17eae81ffdbb tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:43.197973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d540d154-748e-4dca-b9ca-17eae81ffdbb tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:43.201642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:43.225406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d540d154-748e-4dca-b9ca-17eae81ffdbb tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:43.229639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d540d154-748e-4dca-b9ca-17eae81ffdbb tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:43.237454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d540d154-748e-4dca-b9ca-17eae81ffdbb tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:43.240037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d540d154-748e-4dca-b9ca-17eae81ffdbb tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:43.252726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f3f7372a-769b-4f63-91dc-7fb3616ba85a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:43.262638 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f3f7372a-769b-4f63-91dc-7fb3616ba85a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1314 microversion: 2.1 time: 0.772155 May 21 21:20:43.276250 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1309/2678] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:42 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1314 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:43.408400 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-44d0c199-7ecf-4c0d-bb72-7b3771c1ae4b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:43.409718 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-44d0c199-7ecf-4c0d-bb72-7b3771c1ae4b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:43.412359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:43.418720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d540d154-748e-4dca-b9ca-17eae81ffdbb tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:43.437904 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44d0c199-7ecf-4c0d-bb72-7b3771c1ae4b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:43.439805 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d540d154-748e-4dca-b9ca-17eae81ffdbb tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:43.441775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d540d154-748e-4dca-b9ca-17eae81ffdbb tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:43.442905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44d0c199-7ecf-4c0d-bb72-7b3771c1ae4b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:43.445694 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d540d154-748e-4dca-b9ca-17eae81ffdbb tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d" status: 200 len: 1322 microversion: 2.26 time: 0.254390 May 21 21:20:43.460691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44d0c199-7ecf-4c0d-bb72-7b3771c1ae4b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:43.465361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44d0c199-7ecf-4c0d-bb72-7b3771c1ae4b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:43.465915 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1370/2679] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:43 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:43.501884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-46886117-639f-4d91-b41a-d7f4849bb87f tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b620790>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:43.559016 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-46886117-639f-4d91-b41a-d7f4849bb87f tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 200 len: 1428 microversion: 2.1 time: 0.060947 May 21 21:20:43.570644 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1371/2680] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:43 2022] GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 1428 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:43.584332 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b0ace2d2-9c71-4dcd-ad03-e596be2c1967 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:43.591745 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b0ace2d2-9c71-4dcd-ad03-e596be2c1967 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:43.601705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0ace2d2-9c71-4dcd-ad03-e596be2c1967 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:43.602326 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0ace2d2-9c71-4dcd-ad03-e596be2c1967 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:43.606033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0ace2d2-9c71-4dcd-ad03-e596be2c1967 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:43.606610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0ace2d2-9c71-4dcd-ad03-e596be2c1967 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:43.875179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b0ace2d2-9c71-4dcd-ad03-e596be2c1967 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:43.883829 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b0ace2d2-9c71-4dcd-ad03-e596be2c1967 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 200 len: 1396 microversion: 2.1 time: 0.311666 May 21 21:20:43.885622 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1372/2681] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:43 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 1396 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:43.890555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b82e314e-a4e4-46db-80d2-e07146dcb538 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:43.891312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b82e314e-a4e4-46db-80d2-e07146dcb538 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:43.907985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b82e314e-a4e4-46db-80d2-e07146dcb538 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:43.907985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b82e314e-a4e4-46db-80d2-e07146dcb538 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:43.909070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b82e314e-a4e4-46db-80d2-e07146dcb538 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:43.909530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b82e314e-a4e4-46db-80d2-e07146dcb538 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:44.367780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b82e314e-a4e4-46db-80d2-e07146dcb538 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:44.382095 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b82e314e-a4e4-46db-80d2-e07146dcb538 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1477 microversion: 2.1 time: 0.495128 May 21 21:20:44.383304 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1373/2682] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:43 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1477 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:44.591506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-1f94e585-dbe2-40b0-bc9a-3fad51923d6b req-de5c7b6d-8e41-42b1-89fc-2fc08f6c34fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d45434b-365f-4365-be8d-6deb86191f5d", "tag": "656ca91f-9485-4d21-afa8-cb10bd9cff2c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:44.611307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-1f94e585-dbe2-40b0-bc9a-3fad51923d6b req-de5c7b6d-8e41-42b1-89fc-2fc08f6c34fc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:44.612388 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-1f94e585-dbe2-40b0-bc9a-3fad51923d6b req-de5c7b6d-8e41-42b1-89fc-2fc08f6c34fc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:44.653832 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-1f94e585-dbe2-40b0-bc9a-3fad51923d6b req-de5c7b6d-8e41-42b1-89fc-2fc08f6c34fc service nova] Creating event network-changed:656ca91f-9485-4d21-afa8-cb10bd9cff2c for instance 6d45434b-365f-4365-be8d-6deb86191f5d on nch2-master-1 May 21 21:20:44.673821 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-1f94e585-dbe2-40b0-bc9a-3fad51923d6b req-de5c7b6d-8e41-42b1-89fc-2fc08f6c34fc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.280810 May 21 21:20:44.673821 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1374/2683] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:20:44.683983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a8b128d8-d043-4f5a-a44b-008e4e9d240a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:44.685296 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a8b128d8-d043-4f5a-a44b-008e4e9d240a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:44.701295 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8b128d8-d043-4f5a-a44b-008e4e9d240a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:44.702113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8b128d8-d043-4f5a-a44b-008e4e9d240a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:44.703481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8b128d8-d043-4f5a-a44b-008e4e9d240a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:44.704139 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8b128d8-d043-4f5a-a44b-008e4e9d240a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:45.135427 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-44d0c199-7ecf-4c0d-bb72-7b3771c1ae4b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:45.154240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-44d0c199-7ecf-4c0d-bb72-7b3771c1ae4b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:45.158673 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-44d0c199-7ecf-4c0d-bb72-7b3771c1ae4b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:45.162296 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-44d0c199-7ecf-4c0d-bb72-7b3771c1ae4b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1661 microversion: 2.42 time: 1.759098 May 21 21:20:45.167784 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1310/2684] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:43 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1661 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:20:45.169970 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d0c0211e-e50f-43ea-a373-978f4c08e38f tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:45.171000 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d0c0211e-e50f-43ea-a373-978f4c08e38f tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:45.183545 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0c0211e-e50f-43ea-a373-978f4c08e38f tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:45.190734 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0c0211e-e50f-43ea-a373-978f4c08e38f tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:45.190734 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0c0211e-e50f-43ea-a373-978f4c08e38f tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:45.190734 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0c0211e-e50f-43ea-a373-978f4c08e38f tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:45.543322 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a8b128d8-d043-4f5a-a44b-008e4e9d240a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:45.555307 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a8b128d8-d043-4f5a-a44b-008e4e9d240a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1314 microversion: 2.1 time: 0.877946 May 21 21:20:45.556995 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1375/2685] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:44 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1314 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:45.562485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3bbe49d5-b1e3-416e-9514-0d1b49489512 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b4e3e50>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:45.632024 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3bbe49d5-b1e3-416e-9514-0d1b49489512 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 200 len: 1428 microversion: 2.1 time: 0.073834 May 21 21:20:45.632993 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1376/2686] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:45 2022] GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 1428 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:45.646189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c9698761-7cf7-4af4-94fd-ae2019be6646 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:45.647097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c9698761-7cf7-4af4-94fd-ae2019be6646 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:45.670719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c9698761-7cf7-4af4-94fd-ae2019be6646 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:45.671460 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c9698761-7cf7-4af4-94fd-ae2019be6646 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:45.676517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c9698761-7cf7-4af4-94fd-ae2019be6646 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:45.676517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c9698761-7cf7-4af4-94fd-ae2019be6646 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:45.742059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d0c0211e-e50f-43ea-a373-978f4c08e38f tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:45.752799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d0c0211e-e50f-43ea-a373-978f4c08e38f tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:45.757100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d0c0211e-e50f-43ea-a373-978f4c08e38f tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:45.757100 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d0c0211e-e50f-43ea-a373-978f4c08e38f tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d" status: 200 len: 1362 microversion: 2.26 time: 0.591604 May 21 21:20:45.758363 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1311/2687] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:45 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d => generated 1362 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:45.764341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f1dcf449-fcf1-4492-a641-d1650af3f165 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:45.765262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f1dcf449-fcf1-4492-a641-d1650af3f165 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:45.774192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1dcf449-fcf1-4492-a641-d1650af3f165 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:45.775613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1dcf449-fcf1-4492-a641-d1650af3f165 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:45.776795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1dcf449-fcf1-4492-a641-d1650af3f165 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:45.777629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1dcf449-fcf1-4492-a641-d1650af3f165 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:45.920955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c9698761-7cf7-4af4-94fd-ae2019be6646 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:45.930112 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c9698761-7cf7-4af4-94fd-ae2019be6646 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 200 len: 1396 microversion: 2.1 time: 0.295769 May 21 21:20:45.937086 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1377/2688] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:45 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 1396 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:46.183682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0bfd5140-4215-4898-863a-a60b051355eb tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:46.184816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0bfd5140-4215-4898-863a-a60b051355eb tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:46.192027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0bfd5140-4215-4898-863a-a60b051355eb tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:46.198058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0bfd5140-4215-4898-863a-a60b051355eb tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:46.201896 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0bfd5140-4215-4898-863a-a60b051355eb tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:46.204345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0bfd5140-4215-4898-863a-a60b051355eb tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:46.330918 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f1dcf449-fcf1-4492-a641-d1650af3f165 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:46.346311 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f1dcf449-fcf1-4492-a641-d1650af3f165 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1477 microversion: 2.1 time: 0.586520 May 21 21:20:46.358031 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1312/2689] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:45 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1477 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:46.574082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a72e417c-b9ed-4451-b3a8-70a9dc04304a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:46.581843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a72e417c-b9ed-4451-b3a8-70a9dc04304a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:46.600441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a72e417c-b9ed-4451-b3a8-70a9dc04304a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:46.601098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a72e417c-b9ed-4451-b3a8-70a9dc04304a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:46.601490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0bfd5140-4215-4898-863a-a60b051355eb tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:46.603626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a72e417c-b9ed-4451-b3a8-70a9dc04304a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:46.604239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a72e417c-b9ed-4451-b3a8-70a9dc04304a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:46.615336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0bfd5140-4215-4898-863a-a60b051355eb tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:46.617775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0bfd5140-4215-4898-863a-a60b051355eb tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:46.622969 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0bfd5140-4215-4898-863a-a60b051355eb tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1696 microversion: 2.42 time: 0.442199 May 21 21:20:46.634964 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1378/2690] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:46 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1696 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:46.647592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c8f9b22e-1742-4622-9d6a-a60eb211e60b tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b457ca0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:46.717250 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c8f9b22e-1742-4622-9d6a-a60eb211e60b tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 200 len: 1428 microversion: 2.1 time: 0.073496 May 21 21:20:46.723373 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1379/2691] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:46 2022] GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 1428 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:20:46.779116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-72d87a36-fd08-4229-bc9f-134e2785504d req-d784f2c8-2ad8-49e7-bd9c-71f43ed5c49e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b1cd26e-bb18-4119-a747-e73ad8a39343", "tag": "a746937e-95f0-441c-b889-b5791e78c9ed"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:46.790775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-72d87a36-fd08-4229-bc9f-134e2785504d req-d784f2c8-2ad8-49e7-bd9c-71f43ed5c49e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:46.791496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-72d87a36-fd08-4229-bc9f-134e2785504d req-d784f2c8-2ad8-49e7-bd9c-71f43ed5c49e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:46.806664 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-72d87a36-fd08-4229-bc9f-134e2785504d req-d784f2c8-2ad8-49e7-bd9c-71f43ed5c49e service nova] Creating event network-changed:a746937e-95f0-441c-b889-b5791e78c9ed for instance 4b1cd26e-bb18-4119-a747-e73ad8a39343 on nch2-master-1 May 21 21:20:46.813863 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-72d87a36-fd08-4229-bc9f-134e2785504d req-d784f2c8-2ad8-49e7-bd9c-71f43ed5c49e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042190 May 21 21:20:46.814966 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1380/2692] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:20:46.821123 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b560ac84-80af-4151-966d-abb1f72b6de1 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:46.822838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b560ac84-80af-4151-966d-abb1f72b6de1 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:46.832952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b560ac84-80af-4151-966d-abb1f72b6de1 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:46.837761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b560ac84-80af-4151-966d-abb1f72b6de1 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:46.837761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b560ac84-80af-4151-966d-abb1f72b6de1 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:46.837761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b560ac84-80af-4151-966d-abb1f72b6de1 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:46.871344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a72e417c-b9ed-4451-b3a8-70a9dc04304a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:46.883976 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a72e417c-b9ed-4451-b3a8-70a9dc04304a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1314 microversion: 2.1 time: 0.314723 May 21 21:20:46.885494 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1313/2693] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:46 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:20:47.030497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-f1e1c71e-333d-4baf-9125-76a7b4b37b7e req-1fc60839-217f-4aad-af23-54a7123a156c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6825da6e-8b02-486c-8461-41f10572c810", "name": "network-vif-plugged", "status": "completed", "tag": "976547b8-31f4-469e-8c56-e9286444cdde"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:47.042856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f1e1c71e-333d-4baf-9125-76a7b4b37b7e req-1fc60839-217f-4aad-af23-54a7123a156c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:47.043621 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f1e1c71e-333d-4baf-9125-76a7b4b37b7e req-1fc60839-217f-4aad-af23-54a7123a156c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:47.060934 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-f1e1c71e-333d-4baf-9125-76a7b4b37b7e req-1fc60839-217f-4aad-af23-54a7123a156c service nova] Creating event network-vif-plugged:976547b8-31f4-469e-8c56-e9286444cdde for instance 6825da6e-8b02-486c-8461-41f10572c810 on nch1-master-1 May 21 21:20:47.077952 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-f1e1c71e-333d-4baf-9125-76a7b4b37b7e req-1fc60839-217f-4aad-af23-54a7123a156c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190923 May 21 21:20:47.078865 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1314/2694] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:20:47.085993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3cf5be11-dc86-4091-828e-9c8332bf40fd tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:47.090225 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3cf5be11-dc86-4091-828e-9c8332bf40fd tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:47.097908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cf5be11-dc86-4091-828e-9c8332bf40fd tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:47.098727 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cf5be11-dc86-4091-828e-9c8332bf40fd tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:47.100475 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cf5be11-dc86-4091-828e-9c8332bf40fd tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:47.101366 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cf5be11-dc86-4091-828e-9c8332bf40fd tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:47.168662 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b560ac84-80af-4151-966d-abb1f72b6de1 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:47.185383 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b560ac84-80af-4151-966d-abb1f72b6de1 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:47.190095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b560ac84-80af-4151-966d-abb1f72b6de1 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:47.191567 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b560ac84-80af-4151-966d-abb1f72b6de1 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d" status: 200 len: 1362 microversion: 2.26 time: 0.375343 May 21 21:20:47.192733 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1381/2695] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:46 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:47.278197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3cf5be11-dc86-4091-828e-9c8332bf40fd tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:47.289415 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3cf5be11-dc86-4091-828e-9c8332bf40fd tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 200 len: 1396 microversion: 2.1 time: 0.209031 May 21 21:20:47.290003 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1315/2696] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:47 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 1396 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:47.365266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1f7a762b-0f6d-49bd-8ab4-af353070e84d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:47.366108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1f7a762b-0f6d-49bd-8ab4-af353070e84d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:47.373872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f7a762b-0f6d-49bd-8ab4-af353070e84d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:47.378188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f7a762b-0f6d-49bd-8ab4-af353070e84d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:47.378188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f7a762b-0f6d-49bd-8ab4-af353070e84d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:47.378188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f7a762b-0f6d-49bd-8ab4-af353070e84d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:47.630486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-2b98ffb2-878d-4386-9339-ddb3c67c8556 req-910e480b-8414-458b-9f0f-3ba401ea25d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d53249c-9046-4097-bc4d-c7f0dbd95e7d", "tag": "6bb8e744-3b44-4866-b40b-e804d8612b42"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:47.660967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2b98ffb2-878d-4386-9339-ddb3c67c8556 req-910e480b-8414-458b-9f0f-3ba401ea25d7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:47.661871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2b98ffb2-878d-4386-9339-ddb3c67c8556 req-910e480b-8414-458b-9f0f-3ba401ea25d7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:47.709375 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-2b98ffb2-878d-4386-9339-ddb3c67c8556 req-910e480b-8414-458b-9f0f-3ba401ea25d7 service nova] Creating event network-changed:6bb8e744-3b44-4866-b40b-e804d8612b42 for instance 5d53249c-9046-4097-bc4d-c7f0dbd95e7d on nch1-master-1 May 21 21:20:47.721510 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-2b98ffb2-878d-4386-9339-ddb3c67c8556 req-910e480b-8414-458b-9f0f-3ba401ea25d7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250223 May 21 21:20:47.722945 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1316/2697] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:20:47.731481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1a241d57-0a98-40c0-8e25-d448a1283601 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:47.732818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1a241d57-0a98-40c0-8e25-d448a1283601 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:47.752765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a241d57-0a98-40c0-8e25-d448a1283601 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:47.759783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a241d57-0a98-40c0-8e25-d448a1283601 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:47.759783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a241d57-0a98-40c0-8e25-d448a1283601 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:47.759783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a241d57-0a98-40c0-8e25-d448a1283601 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:47.938624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1f7a762b-0f6d-49bd-8ab4-af353070e84d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:47.951852 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1f7a762b-0f6d-49bd-8ab4-af353070e84d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1477 microversion: 2.1 time: 0.590361 May 21 21:20:47.970812 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1382/2698] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:47 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1477 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:47.975856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f7d52b2c-bb81-4e06-b40a-e529fda6868b tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b499940>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:48.033562 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f7d52b2c-bb81-4e06-b40a-e529fda6868b tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 200 len: 1428 microversion: 2.1 time: 0.061449 May 21 21:20:48.034445 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1383/2699] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:47 2022] GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 1428 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:48.039844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cb6b27e2-a740-4f95-9ee4-f179025cb3d8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:48.041709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cb6b27e2-a740-4f95-9ee4-f179025cb3d8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:48.048757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb6b27e2-a740-4f95-9ee4-f179025cb3d8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:48.049494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb6b27e2-a740-4f95-9ee4-f179025cb3d8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:48.050491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb6b27e2-a740-4f95-9ee4-f179025cb3d8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:48.051118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb6b27e2-a740-4f95-9ee4-f179025cb3d8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:48.055839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1a241d57-0a98-40c0-8e25-d448a1283601 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:48.066020 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1a241d57-0a98-40c0-8e25-d448a1283601 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:48.071016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1a241d57-0a98-40c0-8e25-d448a1283601 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:48.074279 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1a241d57-0a98-40c0-8e25-d448a1283601 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1696 microversion: 2.42 time: 0.350196 May 21 21:20:48.076655 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1317/2700] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:47 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1696 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:48.215390 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2a92fc2a-3dfe-4bff-8fb2-825b237d97a7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:48.216550 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2a92fc2a-3dfe-4bff-8fb2-825b237d97a7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:48.228953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a92fc2a-3dfe-4bff-8fb2-825b237d97a7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:48.232147 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a92fc2a-3dfe-4bff-8fb2-825b237d97a7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:48.235468 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a92fc2a-3dfe-4bff-8fb2-825b237d97a7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:48.236196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a92fc2a-3dfe-4bff-8fb2-825b237d97a7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:48.289543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:48.365356 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cb6b27e2-a740-4f95-9ee4-f179025cb3d8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:48.380077 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cb6b27e2-a740-4f95-9ee4-f179025cb3d8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1314 microversion: 2.1 time: 0.344177 May 21 21:20:48.380722 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1384/2701] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:48 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:48.386936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d94f15e0-cd42-44ff-93cc-66de23eb5005 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:48.387741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d94f15e0-cd42-44ff-93cc-66de23eb5005 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:48.395807 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d94f15e0-cd42-44ff-93cc-66de23eb5005 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:48.396271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d94f15e0-cd42-44ff-93cc-66de23eb5005 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:48.397111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d94f15e0-cd42-44ff-93cc-66de23eb5005 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:48.397588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d94f15e0-cd42-44ff-93cc-66de23eb5005 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:48.904854 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2a92fc2a-3dfe-4bff-8fb2-825b237d97a7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:48.923424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2a92fc2a-3dfe-4bff-8fb2-825b237d97a7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:48.925037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2a92fc2a-3dfe-4bff-8fb2-825b237d97a7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:48.931847 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2a92fc2a-3dfe-4bff-8fb2-825b237d97a7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d" status: 200 len: 1362 microversion: 2.26 time: 0.722257 May 21 21:20:48.943613 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1318/2702] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:48 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d => generated 1362 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:48.977685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c0c0b973-52c7-4e85-92b6-01c3a0631dff tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:48.980044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c0c0b973-52c7-4e85-92b6-01c3a0631dff tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:49.014124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c0c0b973-52c7-4e85-92b6-01c3a0631dff tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:49.015516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c0c0b973-52c7-4e85-92b6-01c3a0631dff tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:49.016442 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d94f15e0-cd42-44ff-93cc-66de23eb5005 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:49.017388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c0c0b973-52c7-4e85-92b6-01c3a0631dff tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:49.018069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c0c0b973-52c7-4e85-92b6-01c3a0631dff tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:49.027845 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d94f15e0-cd42-44ff-93cc-66de23eb5005 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 200 len: 1396 microversion: 2.1 time: 0.646007 May 21 21:20:49.044434 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1385/2703] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:48 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 1396 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:49.053250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9a0496f8-a68e-4537-8445-dd4ed703c368 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b39e310>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:49.162796 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9a0496f8-a68e-4537-8445-dd4ed703c368 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 200 len: 1428 microversion: 2.1 time: 0.111458 May 21 21:20:49.162796 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1386/2704] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:49 2022] GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 1428 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:49.167139 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a47ad0f9-d02a-4f9a-a62a-b87403d58e20 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:49.177362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a47ad0f9-d02a-4f9a-a62a-b87403d58e20 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:49.188074 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a47ad0f9-d02a-4f9a-a62a-b87403d58e20 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:49.192774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a47ad0f9-d02a-4f9a-a62a-b87403d58e20 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:49.193752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a47ad0f9-d02a-4f9a-a62a-b87403d58e20 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:49.194200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a47ad0f9-d02a-4f9a-a62a-b87403d58e20 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:49.211603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:49.479553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=12 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:49.840721 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c0c0b973-52c7-4e85-92b6-01c3a0631dff tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:49.849795 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c0c0b973-52c7-4e85-92b6-01c3a0631dff tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1477 microversion: 2.1 time: 0.876206 May 21 21:20:49.856437 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1319/2705] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:48 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1477 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:49.873304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b97b073d-216e-4bab-9ca7-e00c53ec23a5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:49.873934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b97b073d-216e-4bab-9ca7-e00c53ec23a5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:49.886788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b97b073d-216e-4bab-9ca7-e00c53ec23a5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:49.887482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b97b073d-216e-4bab-9ca7-e00c53ec23a5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:49.889031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b97b073d-216e-4bab-9ca7-e00c53ec23a5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:49.889624 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b97b073d-216e-4bab-9ca7-e00c53ec23a5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:50.086417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a47ad0f9-d02a-4f9a-a62a-b87403d58e20 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:50.098958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a47ad0f9-d02a-4f9a-a62a-b87403d58e20 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:50.101747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a47ad0f9-d02a-4f9a-a62a-b87403d58e20 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:50.106374 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a47ad0f9-d02a-4f9a-a62a-b87403d58e20 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1743 microversion: 2.42 time: 0.943987 May 21 21:20:50.109312 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1387/2706] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:49 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1743 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:50.114459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d7c806de-fd70-47a0-b08c-39611f07a874 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:50.117954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d7c806de-fd70-47a0-b08c-39611f07a874 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:50.135612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7c806de-fd70-47a0-b08c-39611f07a874 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:50.136353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7c806de-fd70-47a0-b08c-39611f07a874 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:50.137406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7c806de-fd70-47a0-b08c-39611f07a874 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:50.139343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7c806de-fd70-47a0-b08c-39611f07a874 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:50.448266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d7c806de-fd70-47a0-b08c-39611f07a874 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:50.459836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d7c806de-fd70-47a0-b08c-39611f07a874 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:50.465766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d7c806de-fd70-47a0-b08c-39611f07a874 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:50.467571 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d7c806de-fd70-47a0-b08c-39611f07a874 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d" status: 200 len: 1362 microversion: 2.26 time: 0.356911 May 21 21:20:50.486536 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1388/2707] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:50 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d => generated 1362 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:50.498961 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7c6abbd8-167f-4216-9227-f6d59c69656c tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:50.500064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7c6abbd8-167f-4216-9227-f6d59c69656c tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:50.516604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c6abbd8-167f-4216-9227-f6d59c69656c tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:50.517515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c6abbd8-167f-4216-9227-f6d59c69656c tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:50.518564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c6abbd8-167f-4216-9227-f6d59c69656c tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:50.519238 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c6abbd8-167f-4216-9227-f6d59c69656c tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:50.938404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7c6abbd8-167f-4216-9227-f6d59c69656c tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:50.942959 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:50.951462 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7c6abbd8-167f-4216-9227-f6d59c69656c tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 200 len: 1396 microversion: 2.1 time: 0.463324 May 21 21:20:50.955120 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1389/2708] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:50 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 1396 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:50.966473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-445a297f-22f0-4e69-9923-d91350a77f31 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b474c10>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:50.973748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b97b073d-216e-4bab-9ca7-e00c53ec23a5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:51.007336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=36 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:51.019091 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b97b073d-216e-4bab-9ca7-e00c53ec23a5 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1314 microversion: 2.1 time: 1.159607 May 21 21:20:51.023667 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1320/2709] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:49 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1314 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:51.042893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-95169d5b-7285-48a6-a705-bacf479f069b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:51.044188 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-95169d5b-7285-48a6-a705-bacf479f069b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:51.071194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95169d5b-7285-48a6-a705-bacf479f069b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:51.075367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95169d5b-7285-48a6-a705-bacf479f069b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:51.077933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95169d5b-7285-48a6-a705-bacf479f069b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:51.080382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95169d5b-7285-48a6-a705-bacf479f069b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:51.103264 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-445a297f-22f0-4e69-9923-d91350a77f31 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 200 len: 1428 microversion: 2.1 time: 0.145838 May 21 21:20:51.105140 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1390/2710] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:50 2022] GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 1428 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:51.136362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e94f2317-827d-4e1c-b4ea-20d5f54e0b49 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:51.137339 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e94f2317-827d-4e1c-b4ea-20d5f54e0b49 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:51.149285 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e94f2317-827d-4e1c-b4ea-20d5f54e0b49 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:51.151093 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e94f2317-827d-4e1c-b4ea-20d5f54e0b49 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:51.152354 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e94f2317-827d-4e1c-b4ea-20d5f54e0b49 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:51.152550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e94f2317-827d-4e1c-b4ea-20d5f54e0b49 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:51.867468 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-95169d5b-7285-48a6-a705-bacf479f069b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:51.880910 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-95169d5b-7285-48a6-a705-bacf479f069b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1463 microversion: 2.1 time: 0.855704 May 21 21:20:51.893918 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1321/2711] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:51 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1463 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:51.899593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-42664511-5692-48ff-8090-28e5d1100436 req-8ae562fb-5251-4a9f-9ad3-eef582a78474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d45434b-365f-4365-be8d-6deb86191f5d", "name": "network-vif-plugged", "status": "completed", "tag": "656ca91f-9485-4d21-afa8-cb10bd9cff2c"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:51.909399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-42664511-5692-48ff-8090-28e5d1100436 req-8ae562fb-5251-4a9f-9ad3-eef582a78474 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:51.910094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-42664511-5692-48ff-8090-28e5d1100436 req-8ae562fb-5251-4a9f-9ad3-eef582a78474 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:51.933961 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-42664511-5692-48ff-8090-28e5d1100436 req-8ae562fb-5251-4a9f-9ad3-eef582a78474 service nova] Creating event network-vif-plugged:656ca91f-9485-4d21-afa8-cb10bd9cff2c for instance 6d45434b-365f-4365-be8d-6deb86191f5d on nch2-master-1 May 21 21:20:51.941694 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-42664511-5692-48ff-8090-28e5d1100436 req-8ae562fb-5251-4a9f-9ad3-eef582a78474 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046136 May 21 21:20:51.944593 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1322/2712] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:20:51.962488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ba48e908-2ff3-424f-bd19-ef62d6c66274 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:51.963745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ba48e908-2ff3-424f-bd19-ef62d6c66274 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:51.970991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba48e908-2ff3-424f-bd19-ef62d6c66274 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:51.972049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba48e908-2ff3-424f-bd19-ef62d6c66274 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:51.972890 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba48e908-2ff3-424f-bd19-ef62d6c66274 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:51.973514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba48e908-2ff3-424f-bd19-ef62d6c66274 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:52.006941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e94f2317-827d-4e1c-b4ea-20d5f54e0b49 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:52.023258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e94f2317-827d-4e1c-b4ea-20d5f54e0b49 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:52.028917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e94f2317-827d-4e1c-b4ea-20d5f54e0b49 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:52.030258 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e94f2317-827d-4e1c-b4ea-20d5f54e0b49 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1743 microversion: 2.42 time: 0.906608 May 21 21:20:52.033253 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1391/2713] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:51 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1743 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:20:52.044052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2129bd9f-3fb9-472d-bd13-b69794399f02 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:52.044941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2129bd9f-3fb9-472d-bd13-b69794399f02 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:52.053351 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2129bd9f-3fb9-472d-bd13-b69794399f02 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:52.054087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2129bd9f-3fb9-472d-bd13-b69794399f02 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:52.055052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2129bd9f-3fb9-472d-bd13-b69794399f02 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:52.055655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2129bd9f-3fb9-472d-bd13-b69794399f02 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:52.260990 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ba48e908-2ff3-424f-bd19-ef62d6c66274 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:52.273541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ba48e908-2ff3-424f-bd19-ef62d6c66274 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:52.275289 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ba48e908-2ff3-424f-bd19-ef62d6c66274 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:52.276511 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ba48e908-2ff3-424f-bd19-ef62d6c66274 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d" status: 200 len: 1362 microversion: 2.26 time: 0.330559 May 21 21:20:52.285991 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1323/2714] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:51 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d => generated 1362 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:52.295044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d2dfbd07-68f0-4961-a9f1-77adffc0f1cc tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:52.296614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d2dfbd07-68f0-4961-a9f1-77adffc0f1cc tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:52.311011 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2dfbd07-68f0-4961-a9f1-77adffc0f1cc tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:52.311458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2dfbd07-68f0-4961-a9f1-77adffc0f1cc tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:52.312243 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2dfbd07-68f0-4961-a9f1-77adffc0f1cc tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:52.312715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2dfbd07-68f0-4961-a9f1-77adffc0f1cc tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:52.532796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2129bd9f-3fb9-472d-bd13-b69794399f02 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:52.543651 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2129bd9f-3fb9-472d-bd13-b69794399f02 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1463 microversion: 2.1 time: 0.509056 May 21 21:20:52.545906 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1392/2715] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:52 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1463 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:52.557640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2d82743d-db80-495b-9298-0821e9941e4e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:52.558506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2d82743d-db80-495b-9298-0821e9941e4e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:52.560210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d2dfbd07-68f0-4961-a9f1-77adffc0f1cc tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:52.572058 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d2dfbd07-68f0-4961-a9f1-77adffc0f1cc tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 200 len: 1396 microversion: 2.1 time: 0.284878 May 21 21:20:52.574788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2d82743d-db80-495b-9298-0821e9941e4e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:52.576989 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2d82743d-db80-495b-9298-0821e9941e4e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:52.583036 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1324/2716] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:52 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 1396 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:52.589421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2d82743d-db80-495b-9298-0821e9941e4e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:52.589965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2d82743d-db80-495b-9298-0821e9941e4e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:52.598361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f522a9e1-b678-4959-b93f-1874c5b05249 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b57ff70>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:52.720197 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f522a9e1-b678-4959-b93f-1874c5b05249 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 200 len: 1428 microversion: 2.1 time: 0.135314 May 21 21:20:52.721092 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1325/2717] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:52 2022] GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 1428 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:52.734389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8a2e345c-d471-46ff-b618-82e5a093b48a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:52.741649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8a2e345c-d471-46ff-b618-82e5a093b48a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:52.772987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8a2e345c-d471-46ff-b618-82e5a093b48a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:52.775200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8a2e345c-d471-46ff-b618-82e5a093b48a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:52.776261 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8a2e345c-d471-46ff-b618-82e5a093b48a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:52.782483 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8a2e345c-d471-46ff-b618-82e5a093b48a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:52.933804 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-8a2e345c-d471-46ff-b618-82e5a093b48a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:20:52.936602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-8a2e345c-d471-46ff-b618-82e5a093b48a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:20:52.936602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-8a2e345c-d471-46ff-b618-82e5a093b48a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:20:52.936602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-8a2e345c-d471-46ff-b618-82e5a093b48a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:20:52.936602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-8a2e345c-d471-46ff-b618-82e5a093b48a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:20:52.973485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2d82743d-db80-495b-9298-0821e9941e4e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:52.989001 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2d82743d-db80-495b-9298-0821e9941e4e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1314 microversion: 2.1 time: 0.435362 May 21 21:20:52.990539 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1393/2718] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:52 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:53.055531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-58f41ebc-e3ef-4f5b-88fa-b2422cf7fdff tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:53.056716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-58f41ebc-e3ef-4f5b-88fa-b2422cf7fdff tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:53.065533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-58f41ebc-e3ef-4f5b-88fa-b2422cf7fdff tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:53.067399 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-58f41ebc-e3ef-4f5b-88fa-b2422cf7fdff tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:53.067399 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-58f41ebc-e3ef-4f5b-88fa-b2422cf7fdff tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:53.067672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-58f41ebc-e3ef-4f5b-88fa-b2422cf7fdff tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:53.240036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8a2e345c-d471-46ff-b618-82e5a093b48a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:53.249944 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8a2e345c-d471-46ff-b618-82e5a093b48a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:53.250411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8a2e345c-d471-46ff-b618-82e5a093b48a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:53.251222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8a2e345c-d471-46ff-b618-82e5a093b48a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:53.251666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8a2e345c-d471-46ff-b618-82e5a093b48a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:53.294270 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8a2e345c-d471-46ff-b618-82e5a093b48a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "POST /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810/action" status: 202 len: 1067 microversion: 2.1 time: 0.570119 May 21 21:20:53.304516 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1326/2719] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:20:52 2022] POST /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810/action => generated 1067 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 21 21:20:53.310452 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9aa13de0-b0ea-4852-bc8e-f9a717d03b8a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:53.311113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9aa13de0-b0ea-4852-bc8e-f9a717d03b8a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:53.317594 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9aa13de0-b0ea-4852-bc8e-f9a717d03b8a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:53.320321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9aa13de0-b0ea-4852-bc8e-f9a717d03b8a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:53.320321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9aa13de0-b0ea-4852-bc8e-f9a717d03b8a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:53.320321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9aa13de0-b0ea-4852-bc8e-f9a717d03b8a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:53.323483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-58f41ebc-e3ef-4f5b-88fa-b2422cf7fdff tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:53.335589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-58f41ebc-e3ef-4f5b-88fa-b2422cf7fdff tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:53.337535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-58f41ebc-e3ef-4f5b-88fa-b2422cf7fdff tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:53.338898 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-58f41ebc-e3ef-4f5b-88fa-b2422cf7fdff tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1790 microversion: 2.42 time: 0.287945 May 21 21:20:53.339479 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1394/2720] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:53 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1790 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:53.345355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-54d1b7cd-f446-4f46-be43-4de1d73d42d0 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:53.346186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-54d1b7cd-f446-4f46-be43-4de1d73d42d0 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:53.354434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54d1b7cd-f446-4f46-be43-4de1d73d42d0 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:53.354952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54d1b7cd-f446-4f46-be43-4de1d73d42d0 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:53.355757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54d1b7cd-f446-4f46-be43-4de1d73d42d0 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:53.356201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54d1b7cd-f446-4f46-be43-4de1d73d42d0 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:53.515552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-54d1b7cd-f446-4f46-be43-4de1d73d42d0 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:53.524179 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-54d1b7cd-f446-4f46-be43-4de1d73d42d0 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1472 microversion: 2.1 time: 0.183440 May 21 21:20:53.525337 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1395/2721] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:53 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1472 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:53.537548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9aa13de0-b0ea-4852-bc8e-f9a717d03b8a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:53.555496 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9aa13de0-b0ea-4852-bc8e-f9a717d03b8a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:53.557077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9aa13de0-b0ea-4852-bc8e-f9a717d03b8a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:53.558223 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9aa13de0-b0ea-4852-bc8e-f9a717d03b8a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d" status: 200 len: 1362 microversion: 2.26 time: 0.252580 May 21 21:20:53.558781 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1327/2722] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:53 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:53.597123 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a930254f-6926-498c-80fb-d93fe6265316 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:53.598432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a930254f-6926-498c-80fb-d93fe6265316 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:53.609147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a930254f-6926-498c-80fb-d93fe6265316 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:53.609608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a930254f-6926-498c-80fb-d93fe6265316 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:53.611034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a930254f-6926-498c-80fb-d93fe6265316 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:53.611780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a930254f-6926-498c-80fb-d93fe6265316 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:53.734840 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-681a8afb-d2a4-41ef-8f0d-ca1e78c3ea0c tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b6f6dc0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:53.818859 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-681a8afb-d2a4-41ef-8f0d-ca1e78c3ea0c tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 200 len: 1428 microversion: 2.1 time: 0.087967 May 21 21:20:53.825618 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1328/2723] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:53 2022] GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 1428 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:53.841490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a930254f-6926-498c-80fb-d93fe6265316 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:53.849607 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a930254f-6926-498c-80fb-d93fe6265316 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 200 len: 1396 microversion: 2.1 time: 0.258135 May 21 21:20:53.850275 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1396/2724] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:53 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 1396 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:53.962575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-d6d7dfcb-c85d-47ca-bbae-4b595c185dfc req-f23cdea3-d944-404b-9c20-cd7059d25886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b1cd26e-bb18-4119-a747-e73ad8a39343", "name": "network-vif-plugged", "status": "completed", "tag": "a746937e-95f0-441c-b889-b5791e78c9ed"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:53.979553 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-d6d7dfcb-c85d-47ca-bbae-4b595c185dfc req-f23cdea3-d944-404b-9c20-cd7059d25886 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:53.983762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-d6d7dfcb-c85d-47ca-bbae-4b595c185dfc req-f23cdea3-d944-404b-9c20-cd7059d25886 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:54.007024 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3e64c675-8fb2-4ddf-ae8d-48d79e4d6944 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:54.007603 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-d6d7dfcb-c85d-47ca-bbae-4b595c185dfc req-f23cdea3-d944-404b-9c20-cd7059d25886 service nova] Creating event network-vif-plugged:a746937e-95f0-441c-b889-b5791e78c9ed for instance 4b1cd26e-bb18-4119-a747-e73ad8a39343 on nch2-master-1 May 21 21:20:54.008374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3e64c675-8fb2-4ddf-ae8d-48d79e4d6944 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:54.017076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e64c675-8fb2-4ddf-ae8d-48d79e4d6944 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:54.017877 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e64c675-8fb2-4ddf-ae8d-48d79e4d6944 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:54.018900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e64c675-8fb2-4ddf-ae8d-48d79e4d6944 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:54.019718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e64c675-8fb2-4ddf-ae8d-48d79e4d6944 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:54.021349 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-d6d7dfcb-c85d-47ca-bbae-4b595c185dfc req-f23cdea3-d944-404b-9c20-cd7059d25886 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063778 May 21 21:20:54.022003 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1329/2725] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:20:54.226644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3e64c675-8fb2-4ddf-ae8d-48d79e4d6944 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:54.238445 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3e64c675-8fb2-4ddf-ae8d-48d79e4d6944 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1314 microversion: 2.1 time: 0.234313 May 21 21:20:54.240106 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1397/2726] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:54 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:54.358506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0e20fd8a-9171-4370-8d31-16f914f45967 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:54.359249 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0e20fd8a-9171-4370-8d31-16f914f45967 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:54.365909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e20fd8a-9171-4370-8d31-16f914f45967 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:54.366392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e20fd8a-9171-4370-8d31-16f914f45967 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:54.367188 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e20fd8a-9171-4370-8d31-16f914f45967 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:54.367635 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e20fd8a-9171-4370-8d31-16f914f45967 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:54.552743 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f50b3ea6-ef1f-49f5-b140-c838e82a3ad6 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:54.553536 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f50b3ea6-ef1f-49f5-b140-c838e82a3ad6 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:54.562787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f50b3ea6-ef1f-49f5-b140-c838e82a3ad6 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:54.564935 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f50b3ea6-ef1f-49f5-b140-c838e82a3ad6 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:54.566006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f50b3ea6-ef1f-49f5-b140-c838e82a3ad6 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:54.566599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f50b3ea6-ef1f-49f5-b140-c838e82a3ad6 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:54.712367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0e20fd8a-9171-4370-8d31-16f914f45967 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:54.728484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0e20fd8a-9171-4370-8d31-16f914f45967 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:54.740107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0e20fd8a-9171-4370-8d31-16f914f45967 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:54.743277 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0e20fd8a-9171-4370-8d31-16f914f45967 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1790 microversion: 2.42 time: 0.389548 May 21 21:20:54.744525 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1330/2727] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:54 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1790 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:54.766335 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5f5478d6-11ea-4774-85d0-b12a17df4274 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:54.767556 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5f5478d6-11ea-4774-85d0-b12a17df4274 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:54.786212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5f5478d6-11ea-4774-85d0-b12a17df4274 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:54.786941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5f5478d6-11ea-4774-85d0-b12a17df4274 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:54.798239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5f5478d6-11ea-4774-85d0-b12a17df4274 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:54.798842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5f5478d6-11ea-4774-85d0-b12a17df4274 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:54.927889 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f50b3ea6-ef1f-49f5-b140-c838e82a3ad6 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:54.939319 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f50b3ea6-ef1f-49f5-b140-c838e82a3ad6 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1472 microversion: 2.1 time: 0.391007 May 21 21:20:54.943354 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1398/2728] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:54 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1472 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:54.949885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5fb7e1fd-bc1c-4e51-98cf-b722d00333db tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b620790>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:55.030551 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5fb7e1fd-bc1c-4e51-98cf-b722d00333db tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 200 len: 1428 microversion: 2.1 time: 0.085944 May 21 21:20:55.031419 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1399/2729] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:54 2022] GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 1428 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:55.048219 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-17a39b77-fee5-479b-a025-837b4d86c132 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:55.049120 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-17a39b77-fee5-479b-a025-837b4d86c132 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:55.059394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-17a39b77-fee5-479b-a025-837b4d86c132 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:55.059939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-17a39b77-fee5-479b-a025-837b4d86c132 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:55.060753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-17a39b77-fee5-479b-a025-837b4d86c132 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:55.069924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-17a39b77-fee5-479b-a025-837b4d86c132 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:55.293988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5f5478d6-11ea-4774-85d0-b12a17df4274 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:55.304007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5f5478d6-11ea-4774-85d0-b12a17df4274 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:55.313580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5f5478d6-11ea-4774-85d0-b12a17df4274 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:55.314792 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5f5478d6-11ea-4774-85d0-b12a17df4274 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d" status: 200 len: 1362 microversion: 2.26 time: 0.568601 May 21 21:20:55.315544 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1331/2730] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:54 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d => generated 1362 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:55.333357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-17a39b77-fee5-479b-a025-837b4d86c132 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:55.336188 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bb23bc7d-c746-4b12-8438-062e7f24ab0a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:55.339166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bb23bc7d-c746-4b12-8438-062e7f24ab0a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:55.344544 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-17a39b77-fee5-479b-a025-837b4d86c132 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 200 len: 1578 microversion: 2.1 time: 0.311595 May 21 21:20:55.345855 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1400/2731] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:55 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 1578 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:55.354443 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb23bc7d-c746-4b12-8438-062e7f24ab0a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:55.363025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb23bc7d-c746-4b12-8438-062e7f24ab0a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:55.363025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb23bc7d-c746-4b12-8438-062e7f24ab0a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:55.363025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb23bc7d-c746-4b12-8438-062e7f24ab0a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:55.370843 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-23860a8f-41df-42b5-8b92-951ff2bb304e tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:55.371854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-23860a8f-41df-42b5-8b92-951ff2bb304e tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:55.379336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23860a8f-41df-42b5-8b92-951ff2bb304e tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:55.380380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23860a8f-41df-42b5-8b92-951ff2bb304e tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:55.381406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23860a8f-41df-42b5-8b92-951ff2bb304e tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:55.382024 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23860a8f-41df-42b5-8b92-951ff2bb304e tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:55.514855 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-23860a8f-41df-42b5-8b92-951ff2bb304e tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.148166 May 21 21:20:55.515464 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1401/2732] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 21:20:55 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:20:55.764794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f2495784-b18e-47ff-9cab-1a01758e8b3d tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:55.765857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f2495784-b18e-47ff-9cab-1a01758e8b3d tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:55.774900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2495784-b18e-47ff-9cab-1a01758e8b3d tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:55.780070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2495784-b18e-47ff-9cab-1a01758e8b3d tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:55.780070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2495784-b18e-47ff-9cab-1a01758e8b3d tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:55.780070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2495784-b18e-47ff-9cab-1a01758e8b3d tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:55.853318 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bb23bc7d-c746-4b12-8438-062e7f24ab0a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:55.861881 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bb23bc7d-c746-4b12-8438-062e7f24ab0a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1314 microversion: 2.1 time: 0.534233 May 21 21:20:55.865089 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1332/2733] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:55 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:55.958650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-20c6666c-4e4e-4917-9ffd-122e7c474906 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:55.959627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-20c6666c-4e4e-4917-9ffd-122e7c474906 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:55.976667 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20c6666c-4e4e-4917-9ffd-122e7c474906 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:55.978893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20c6666c-4e4e-4917-9ffd-122e7c474906 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:55.979924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20c6666c-4e4e-4917-9ffd-122e7c474906 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:55.983065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20c6666c-4e4e-4917-9ffd-122e7c474906 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:56.060770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f2495784-b18e-47ff-9cab-1a01758e8b3d tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:56.078068 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f2495784-b18e-47ff-9cab-1a01758e8b3d tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:56.080368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f2495784-b18e-47ff-9cab-1a01758e8b3d tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:56.093236 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f2495784-b18e-47ff-9cab-1a01758e8b3d tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1837 microversion: 2.42 time: 0.322037 May 21 21:20:56.094326 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1402/2734] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:55 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1837 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:56.101396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8e00562a-21f4-4b69-9287-5f1309b44c9c tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b44d8b0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:56.154699 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8e00562a-21f4-4b69-9287-5f1309b44c9c tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 200 len: 1428 microversion: 2.1 time: 0.058989 May 21 21:20:56.160742 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1403/2735] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:56 2022] GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 1428 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:56.334778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2a3c7c36-d30e-4857-8414-7ffe426a4822 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:56.335320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2a3c7c36-d30e-4857-8414-7ffe426a4822 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:56.345907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a3c7c36-d30e-4857-8414-7ffe426a4822 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:56.346123 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a3c7c36-d30e-4857-8414-7ffe426a4822 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:56.346959 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a3c7c36-d30e-4857-8414-7ffe426a4822 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:56.347467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a3c7c36-d30e-4857-8414-7ffe426a4822 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:56.516162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-20c6666c-4e4e-4917-9ffd-122e7c474906 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:56.528640 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-20c6666c-4e4e-4917-9ffd-122e7c474906 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1472 microversion: 2.1 time: 0.574742 May 21 21:20:56.533018 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1333/2736] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:55 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1472 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:20:56.582750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2a3c7c36-d30e-4857-8414-7ffe426a4822 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:56.593270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2a3c7c36-d30e-4857-8414-7ffe426a4822 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:56.594965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2a3c7c36-d30e-4857-8414-7ffe426a4822 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:56.596133 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2a3c7c36-d30e-4857-8414-7ffe426a4822 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d" status: 200 len: 1362 microversion: 2.26 time: 0.265785 May 21 21:20:56.607378 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1404/2737] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:56 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:20:56.882502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eb058734-3e2c-461b-b8a4-05c67ff5ba0c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:56.884168 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-eb058734-3e2c-461b-b8a4-05c67ff5ba0c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:56.903032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-a85bab2f-9a46-40e8-a132-6f05faa9ed4f req-49337d30-0994-4566-8188-35d493c07a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d53249c-9046-4097-bc4d-c7f0dbd95e7d", "name": "network-vif-plugged", "status": "completed", "tag": "6bb8e744-3b44-4866-b40b-e804d8612b42"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:56.912010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb058734-3e2c-461b-b8a4-05c67ff5ba0c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:56.912702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb058734-3e2c-461b-b8a4-05c67ff5ba0c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:56.913334 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb058734-3e2c-461b-b8a4-05c67ff5ba0c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:56.920030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb058734-3e2c-461b-b8a4-05c67ff5ba0c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:56.929173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a85bab2f-9a46-40e8-a132-6f05faa9ed4f req-49337d30-0994-4566-8188-35d493c07a60 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:56.929631 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a85bab2f-9a46-40e8-a132-6f05faa9ed4f req-49337d30-0994-4566-8188-35d493c07a60 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:56.955817 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a85bab2f-9a46-40e8-a132-6f05faa9ed4f req-49337d30-0994-4566-8188-35d493c07a60 service nova] Creating event network-vif-plugged:6bb8e744-3b44-4866-b40b-e804d8612b42 for instance 5d53249c-9046-4097-bc4d-c7f0dbd95e7d on nch1-master-1 May 21 21:20:56.970258 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-a85bab2f-9a46-40e8-a132-6f05faa9ed4f req-49337d30-0994-4566-8188-35d493c07a60 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071004 May 21 21:20:56.971542 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1405/2738] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:20:57.117063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4297de2c-e047-48e7-a28b-7130493cd662 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:57.118612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4297de2c-e047-48e7-a28b-7130493cd662 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:57.132898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4297de2c-e047-48e7-a28b-7130493cd662 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:57.137696 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4297de2c-e047-48e7-a28b-7130493cd662 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:57.141355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4297de2c-e047-48e7-a28b-7130493cd662 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:57.141837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4297de2c-e047-48e7-a28b-7130493cd662 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:57.421886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-eb058734-3e2c-461b-b8a4-05c67ff5ba0c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:57.443588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4297de2c-e047-48e7-a28b-7130493cd662 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:57.444687 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-eb058734-3e2c-461b-b8a4-05c67ff5ba0c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1501 microversion: 2.1 time: 0.565783 May 21 21:20:57.445503 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1334/2739] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:56 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1501 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:57.453765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3ea12ab3-e702-4cba-948e-c06df72fa34c tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b3a8f70>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:57.455781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4297de2c-e047-48e7-a28b-7130493cd662 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:57.457703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4297de2c-e047-48e7-a28b-7130493cd662 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:57.459014 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4297de2c-e047-48e7-a28b-7130493cd662 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1837 microversion: 2.42 time: 0.353588 May 21 21:20:57.459700 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1406/2740] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:57 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1837 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:57.465716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-505c95c9-9941-4509-a381-6e4146c19471 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:57.471561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-505c95c9-9941-4509-a381-6e4146c19471 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:57.472922 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-505c95c9-9941-4509-a381-6e4146c19471 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:57.504385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-505c95c9-9941-4509-a381-6e4146c19471 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Going to try to stop instance {{(pid=131277) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 21 21:20:57.539584 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3ea12ab3-e702-4cba-948e-c06df72fa34c tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 200 len: 1428 microversion: 2.1 time: 0.092276 May 21 21:20:57.540956 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1335/2741] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:57 2022] GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 1428 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:57.549767 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-65dd9f88-91d8-4aa9-887c-bb041205b860 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:57.550397 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-65dd9f88-91d8-4aa9-887c-bb041205b860 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:57.558058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65dd9f88-91d8-4aa9-887c-bb041205b860 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:57.558523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65dd9f88-91d8-4aa9-887c-bb041205b860 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:57.559316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65dd9f88-91d8-4aa9-887c-bb041205b860 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:57.559761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65dd9f88-91d8-4aa9-887c-bb041205b860 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:57.804002 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-505c95c9-9941-4509-a381-6e4146c19471 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "POST /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343/action" status: 202 len: 0 microversion: 2.1 time: 0.342728 May 21 21:20:57.822287 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1407/2742] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:20:57 2022] POST /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:20:57.830566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5795e0bd-2e24-45ce-9fee-a7daab4e33fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:57.831842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5795e0bd-2e24-45ce-9fee-a7daab4e33fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:57.841020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5795e0bd-2e24-45ce-9fee-a7daab4e33fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:57.846527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5795e0bd-2e24-45ce-9fee-a7daab4e33fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:57.846527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5795e0bd-2e24-45ce-9fee-a7daab4e33fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:57.846527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5795e0bd-2e24-45ce-9fee-a7daab4e33fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:58.047050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5795e0bd-2e24-45ce-9fee-a7daab4e33fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:58.057307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5795e0bd-2e24-45ce-9fee-a7daab4e33fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:58.067906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5795e0bd-2e24-45ce-9fee-a7daab4e33fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:58.075931 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5795e0bd-2e24-45ce-9fee-a7daab4e33fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d" status: 200 len: 1362 microversion: 2.26 time: 0.251217 May 21 21:20:58.076958 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1408/2743] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:57 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:58.099703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f2f1cd10-b0a0-4828-8b78-dd4c3ff1621a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:58.104208 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f2f1cd10-b0a0-4828-8b78-dd4c3ff1621a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:58.121632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2f1cd10-b0a0-4828-8b78-dd4c3ff1621a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:58.121632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2f1cd10-b0a0-4828-8b78-dd4c3ff1621a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:58.122505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2f1cd10-b0a0-4828-8b78-dd4c3ff1621a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:58.122774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2f1cd10-b0a0-4828-8b78-dd4c3ff1621a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:58.159287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:58.346310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f2f1cd10-b0a0-4828-8b78-dd4c3ff1621a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:58.355418 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f2f1cd10-b0a0-4828-8b78-dd4c3ff1621a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.261114 May 21 21:20:58.359105 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1409/2744] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:58 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:58.370962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f6d4b9fe-e622-41b9-a591-12997ff70151 req-6de1b9c8-e79d-4714-88b8-2b51fa9d0a19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "tag": "fb6fdb78-778e-40f4-b501-95a96aca53fe"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:20:58.382081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f6d4b9fe-e622-41b9-a591-12997ff70151 req-6de1b9c8-e79d-4714-88b8-2b51fa9d0a19 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:58.382081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f6d4b9fe-e622-41b9-a591-12997ff70151 req-6de1b9c8-e79d-4714-88b8-2b51fa9d0a19 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:58.390310 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-65dd9f88-91d8-4aa9-887c-bb041205b860 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:58.399209 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f6d4b9fe-e622-41b9-a591-12997ff70151 req-6de1b9c8-e79d-4714-88b8-2b51fa9d0a19 service nova] Creating event network-changed:fb6fdb78-778e-40f4-b501-95a96aca53fe for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:20:58.407084 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-65dd9f88-91d8-4aa9-887c-bb041205b860 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1472 microversion: 2.1 time: 0.860310 May 21 21:20:58.407600 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f6d4b9fe-e622-41b9-a591-12997ff70151 req-6de1b9c8-e79d-4714-88b8-2b51fa9d0a19 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039236 May 21 21:20:58.408471 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1336/2745] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:57 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1472 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:58.409094 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1410/2746] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:20:58.480377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-66f93ad2-cee9-4bc9-a41e-b9f77799d03a tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:58.486361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-66f93ad2-cee9-4bc9-a41e-b9f77799d03a tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:58.500161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66f93ad2-cee9-4bc9-a41e-b9f77799d03a tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:58.503369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66f93ad2-cee9-4bc9-a41e-b9f77799d03a tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:58.504603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66f93ad2-cee9-4bc9-a41e-b9f77799d03a tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:58.505392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66f93ad2-cee9-4bc9-a41e-b9f77799d03a tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:58.537492 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:58.553638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7b7a391a-ebd0-4e46-a384-82a8c4ba361d tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b2df1f0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:58.639144 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7b7a391a-ebd0-4e46-a384-82a8c4ba361d tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 200 len: 1428 microversion: 2.1 time: 0.089600 May 21 21:20:58.640484 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1411/2747] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:58 2022] GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 1428 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:20:59.096195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-734e4787-abd9-4dcc-a1f5-845828c0afbf tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:59.097114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-734e4787-abd9-4dcc-a1f5-845828c0afbf tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:59.104972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-734e4787-abd9-4dcc-a1f5-845828c0afbf tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:59.105472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-734e4787-abd9-4dcc-a1f5-845828c0afbf tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:59.106262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-734e4787-abd9-4dcc-a1f5-845828c0afbf tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:59.106768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-734e4787-abd9-4dcc-a1f5-845828c0afbf tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:59.134591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-66f93ad2-cee9-4bc9-a41e-b9f77799d03a tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:59.153288 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-66f93ad2-cee9-4bc9-a41e-b9f77799d03a tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:59.154975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-66f93ad2-cee9-4bc9-a41e-b9f77799d03a tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:59.156188 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-66f93ad2-cee9-4bc9-a41e-b9f77799d03a tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1837 microversion: 2.42 time: 0.679891 May 21 21:20:59.157051 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1337/2748] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:58 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1837 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:20:59.186182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f44dbfa3-effe-4819-8fc5-63ecc4bfcdd2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:59.189610 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f44dbfa3-effe-4819-8fc5-63ecc4bfcdd2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:59.198337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f44dbfa3-effe-4819-8fc5-63ecc4bfcdd2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:59.199098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f44dbfa3-effe-4819-8fc5-63ecc4bfcdd2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:59.200127 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f44dbfa3-effe-4819-8fc5-63ecc4bfcdd2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:59.200806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f44dbfa3-effe-4819-8fc5-63ecc4bfcdd2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:59.345349 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-734e4787-abd9-4dcc-a1f5-845828c0afbf tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:59.357630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-734e4787-abd9-4dcc-a1f5-845828c0afbf tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:59.359678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-734e4787-abd9-4dcc-a1f5-845828c0afbf tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:59.361718 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-734e4787-abd9-4dcc-a1f5-845828c0afbf tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d" status: 200 len: 1546 microversion: 2.26 time: 0.270568 May 21 21:20:59.362602 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1412/2749] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:20:59 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d => generated 1546 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:20:59.379643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-502b4cd9-d893-4193-bd24-527aff83453a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:59.380597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-502b4cd9-d893-4193-bd24-527aff83453a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:59.388846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-502b4cd9-d893-4193-bd24-527aff83453a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:59.389287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-502b4cd9-d893-4193-bd24-527aff83453a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:59.390307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-502b4cd9-d893-4193-bd24-527aff83453a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:59.391158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-502b4cd9-d893-4193-bd24-527aff83453a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:59.512898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f44dbfa3-effe-4819-8fc5-63ecc4bfcdd2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:59.522324 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f44dbfa3-effe-4819-8fc5-63ecc4bfcdd2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 200 len: 1578 microversion: 2.1 time: 0.340752 May 21 21:20:59.523536 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1338/2750] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:59 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 1578 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:59.530827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-36d20cc7-4933-440b-80db-fd94a3b5218a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '.version_select at 0x7fc81b571160>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:59.542247 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36d20cc7-4933-440b-80db-fd94a3b5218a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:59.543007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36d20cc7-4933-440b-80db-fd94a3b5218a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:59.543671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-36d20cc7-4933-440b-80db-fd94a3b5218a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:59.551902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36d20cc7-4933-440b-80db-fd94a3b5218a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:59.552638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36d20cc7-4933-440b-80db-fd94a3b5218a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:59.553601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36d20cc7-4933-440b-80db-fd94a3b5218a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:59.554206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36d20cc7-4933-440b-80db-fd94a3b5218a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:59.558037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-502b4cd9-d893-4193-bd24-527aff83453a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:59.571382 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-502b4cd9-d893-4193-bd24-527aff83453a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.195579 May 21 21:20:59.573850 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1413/2751] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:59 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:20:59.582275 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-823301bb-46d5-4f97-a15c-43eb8e249121 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:59.583557 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-823301bb-46d5-4f97-a15c-43eb8e249121 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:59.588163 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36d20cc7-4933-440b-80db-fd94a3b5218a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:59.588678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36d20cc7-4933-440b-80db-fd94a3b5218a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:59.592772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-823301bb-46d5-4f97-a15c-43eb8e249121 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:59.593429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-823301bb-46d5-4f97-a15c-43eb8e249121 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:59.605575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36d20cc7-4933-440b-80db-fd94a3b5218a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:59.606207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36d20cc7-4933-440b-80db-fd94a3b5218a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:59.609361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-823301bb-46d5-4f97-a15c-43eb8e249121 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:59.612362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-823301bb-46d5-4f97-a15c-43eb8e249121 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:59.715964 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-36d20cc7-4933-440b-80db-fd94a3b5218a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lazy-loading 'flavor' on Instance uuid 5d53249c-9046-4097-bc4d-c7f0dbd95e7d {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:20:59.761387 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-36d20cc7-4933-440b-80db-fd94a3b5218a tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "PUT /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags/tempest-tag-985723036" status: 201 len: 0 microversion: 2.26 time: 0.234814 May 21 21:20:59.765021 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1339/2752] 10.222.0.49 () {62 vars in 1376 bytes} [Sat May 21 21:20:59 2022] PUT /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags/tempest-tag-985723036 => generated 0 bytes in 241 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) May 21 21:20:59.778313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e71b7fd2-2576-4bf6-b05d-80d0148d3dab tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b5719d0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:59.859071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-823301bb-46d5-4f97-a15c-43eb8e249121 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:20:59.872235 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-823301bb-46d5-4f97-a15c-43eb8e249121 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1472 microversion: 2.1 time: 0.290836 May 21 21:20:59.873905 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1414/2753] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:59 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1472 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:59.876513 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e71b7fd2-2576-4bf6-b05d-80d0148d3dab tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 200 len: 1437 microversion: 2.1 time: 0.103950 May 21 21:20:59.884866 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1340/2754] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:59 2022] GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 1437 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:59.887799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1a8df7a1-9c9f-4c69-a337-d5dcdfb98dd5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '.version_select at 0x7fc81b39e700>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:59.890978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b35991c9-5a32-4cd1-b06c-faff80c66ce0 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b3a8790>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:59.905398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a8df7a1-9c9f-4c69-a337-d5dcdfb98dd5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:59.905853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a8df7a1-9c9f-4c69-a337-d5dcdfb98dd5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:59.952800 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b35991c9-5a32-4cd1-b06c-faff80c66ce0 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 200 len: 1437 microversion: 2.1 time: 0.066198 May 21 21:20:59.956325 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1a8df7a1-9c9f-4c69-a337-d5dcdfb98dd5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags/tempest-tag-985723036" status: 204 len: 0 microversion: 2.26 time: 0.079871 May 21 21:20:59.956325 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1415/2755] 10.222.0.49 () {60 vars in 1357 bytes} [Sat May 21 21:20:59 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags/tempest-tag-985723036 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:20:59.957094 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1341/2756] 10.222.0.49 () {58 vars in 1232 bytes} [Sat May 21 21:20:59 2022] GET /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 1437 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:20:59.965597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9a196b62-6a4a-4596-9c51-79a79d049774 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '.version_select at 0x7fc81b499f70>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:59.969154 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1efb4518-86b5-4821-9756-de0a6ea9c736 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:20:59.970469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1efb4518-86b5-4821-9756-de0a6ea9c736 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:20:59.980124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1efb4518-86b5-4821-9756-de0a6ea9c736 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:59.981040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1efb4518-86b5-4821-9756-de0a6ea9c736 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:59.982305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1efb4518-86b5-4821-9756-de0a6ea9c736 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:59.982955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1efb4518-86b5-4821-9756-de0a6ea9c736 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:59.987148 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a196b62-6a4a-4596-9c51-79a79d049774 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:20:59.987545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a196b62-6a4a-4596-9c51-79a79d049774 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:20:59.988031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9a196b62-6a4a-4596-9c51-79a79d049774 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:00.001800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a196b62-6a4a-4596-9c51-79a79d049774 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:00.002257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a196b62-6a4a-4596-9c51-79a79d049774 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:00.006215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a196b62-6a4a-4596-9c51-79a79d049774 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:00.006215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a196b62-6a4a-4596-9c51-79a79d049774 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:00.030005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a196b62-6a4a-4596-9c51-79a79d049774 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:00.030461 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a196b62-6a4a-4596-9c51-79a79d049774 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:00.119151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-9a196b62-6a4a-4596-9c51-79a79d049774 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lazy-loading 'flavor' on Instance uuid 5d53249c-9046-4097-bc4d-c7f0dbd95e7d {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:21:00.199596 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9a196b62-6a4a-4596-9c51-79a79d049774 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags" status: 204 len: 0 microversion: 2.26 time: 0.238048 May 21 21:21:00.206937 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1416/2757] 10.222.0.49 () {60 vars in 1294 bytes} [Sat May 21 21:20:59 2022] DELETE /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 21 21:21:00.213394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ee578bcc-d296-47fe-b6ff-d58075268207 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:00.218481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ee578bcc-d296-47fe-b6ff-d58075268207 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:00.221945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee578bcc-d296-47fe-b6ff-d58075268207 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:00.221945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee578bcc-d296-47fe-b6ff-d58075268207 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:00.222493 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee578bcc-d296-47fe-b6ff-d58075268207 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:00.223011 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee578bcc-d296-47fe-b6ff-d58075268207 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:00.297732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1efb4518-86b5-4821-9756-de0a6ea9c736 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:00.306629 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1efb4518-86b5-4821-9756-de0a6ea9c736 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1467 microversion: 2.1 time: 0.341123 May 21 21:21:00.307455 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1342/2758] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:20:59 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1467 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:00.312973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5ce2d27c-cf69-45ca-b44b-4731fb0008f9 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '.version_select at 0x7fc81b6540d0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:00.322301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ce2d27c-cf69-45ca-b44b-4731fb0008f9 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:00.323062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ce2d27c-cf69-45ca-b44b-4731fb0008f9 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:00.340046 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5ce2d27c-cf69-45ca-b44b-4731fb0008f9 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags" status: 200 len: 12 microversion: 2.26 time: 0.031008 May 21 21:21:00.341104 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1343/2759] 10.222.0.49 () {60 vars in 1291 bytes} [Sat May 21 21:21:00 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags => generated 12 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:00.347294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3c59270e-731b-4851-8f15-161ed175ccd2 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b6fca60>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:00.502061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ee578bcc-d296-47fe-b6ff-d58075268207 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:00.513859 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ee578bcc-d296-47fe-b6ff-d58075268207 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:00.515390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ee578bcc-d296-47fe-b6ff-d58075268207 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:00.516608 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ee578bcc-d296-47fe-b6ff-d58075268207 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1858 microversion: 2.42 time: 0.308521 May 21 21:21:00.518016 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1417/2760] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:00 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1858 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:00.523429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7fce981d-6612-495c-ae06-95d2c51c0363 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '.version_select at 0x7fc81b64f700>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:00.534514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fce981d-6612-495c-ae06-95d2c51c0363 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:00.535185 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fce981d-6612-495c-ae06-95d2c51c0363 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:00.535919 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7fce981d-6612-495c-ae06-95d2c51c0363 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:00.547482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fce981d-6612-495c-ae06-95d2c51c0363 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:00.547482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fce981d-6612-495c-ae06-95d2c51c0363 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:00.547482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fce981d-6612-495c-ae06-95d2c51c0363 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:00.547482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fce981d-6612-495c-ae06-95d2c51c0363 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:00.580521 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fce981d-6612-495c-ae06-95d2c51c0363 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:00.580968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fce981d-6612-495c-ae06-95d2c51c0363 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:00.592871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fce981d-6612-495c-ae06-95d2c51c0363 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:00.593828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fce981d-6612-495c-ae06-95d2c51c0363 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:00.718010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-7fce981d-6612-495c-ae06-95d2c51c0363 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lazy-loading 'flavor' on Instance uuid 5d53249c-9046-4097-bc4d-c7f0dbd95e7d {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:21:00.738495 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7fce981d-6612-495c-ae06-95d2c51c0363 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "PUT /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags/tempest-tag-1666541788" status: 201 len: 0 microversion: 2.26 time: 0.219194 May 21 21:21:00.739685 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1418/2761] 10.222.0.49 () {62 vars in 1379 bytes} [Sat May 21 21:21:00 2022] PUT /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags/tempest-tag-1666541788 => generated 0 bytes in 221 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 21 21:21:00.745205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-435fe648-f1a3-4fb5-8f42-e5b0fa8e5a1d req-32666d04-2e94-4605-9fcf-e7da3bee14cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d45434b-365f-4365-be8d-6deb86191f5d", "tag": "656ca91f-9485-4d21-afa8-cb10bd9cff2c"}, {"name": "network-changed", "server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "tag": "4c631ba5-27ae-4db4-9ea4-c4c2d4945e7c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:00.757126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-435fe648-f1a3-4fb5-8f42-e5b0fa8e5a1d req-32666d04-2e94-4605-9fcf-e7da3bee14cf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:00.757937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-435fe648-f1a3-4fb5-8f42-e5b0fa8e5a1d req-32666d04-2e94-4605-9fcf-e7da3bee14cf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:00.774800 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-435fe648-f1a3-4fb5-8f42-e5b0fa8e5a1d req-32666d04-2e94-4605-9fcf-e7da3bee14cf service nova] Creating event network-changed:656ca91f-9485-4d21-afa8-cb10bd9cff2c for instance 6d45434b-365f-4365-be8d-6deb86191f5d on nch2-master-1 May 21 21:21:00.783914 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-435fe648-f1a3-4fb5-8f42-e5b0fa8e5a1d req-32666d04-2e94-4605-9fcf-e7da3bee14cf service nova] Creating event network-changed:4c631ba5-27ae-4db4-9ea4-c4c2d4945e7c for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:21:00.783914 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-435fe648-f1a3-4fb5-8f42-e5b0fa8e5a1d req-32666d04-2e94-4605-9fcf-e7da3bee14cf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042233 May 21 21:21:00.785205 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1419/2762] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:00.794137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8489bc98-3632-4187-9393-3d7eb09d5c09 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:00.795089 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8489bc98-3632-4187-9393-3d7eb09d5c09 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:00.799002 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:00.805976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8489bc98-3632-4187-9393-3d7eb09d5c09 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:00.812828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8489bc98-3632-4187-9393-3d7eb09d5c09 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:00.812828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8489bc98-3632-4187-9393-3d7eb09d5c09 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:00.812828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8489bc98-3632-4187-9393-3d7eb09d5c09 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:00.971349 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8489bc98-3632-4187-9393-3d7eb09d5c09 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:00.981653 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8489bc98-3632-4187-9393-3d7eb09d5c09 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.194341 May 21 21:21:00.982780 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1420/2763] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:00 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:00.988906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-23396afa-85fa-4048-91d8-36bd8ace8618 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '.version_select at 0x7fc81b2cd040>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:00.997896 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23396afa-85fa-4048-91d8-36bd8ace8618 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:00.998615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23396afa-85fa-4048-91d8-36bd8ace8618 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.007848 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-23396afa-85fa-4048-91d8-36bd8ace8618 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags" status: 200 len: 36 microversion: 2.26 time: 0.023852 May 21 21:21:01.008513 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1421/2764] 10.222.0.49 () {60 vars in 1291 bytes} [Sat May 21 21:21:00 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags => generated 36 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:01.013422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-38178747-0c2f-43c4-9b2f-61930a46da80 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:01.014340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-38178747-0c2f-43c4-9b2f-61930a46da80 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:01.020664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38178747-0c2f-43c4-9b2f-61930a46da80 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.021116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38178747-0c2f-43c4-9b2f-61930a46da80 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.021906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38178747-0c2f-43c4-9b2f-61930a46da80 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.022365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38178747-0c2f-43c4-9b2f-61930a46da80 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.219134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-38178747-0c2f-43c4-9b2f-61930a46da80 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:01.229193 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-38178747-0c2f-43c4-9b2f-61930a46da80 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1472 microversion: 2.1 time: 0.219440 May 21 21:21:01.230259 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1422/2765] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:01 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1472 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:01.235137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ea1f51b4-c8c3-4dc9-bdae-a9c329aea0a5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '.version_select at 0x7fc81b4573a0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:01.244461 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea1f51b4-c8c3-4dc9-bdae-a9c329aea0a5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.244913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea1f51b4-c8c3-4dc9-bdae-a9c329aea0a5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.247383 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ea1f51b4-c8c3-4dc9-bdae-a9c329aea0a5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:01.259374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea1f51b4-c8c3-4dc9-bdae-a9c329aea0a5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.259833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea1f51b4-c8c3-4dc9-bdae-a9c329aea0a5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.260680 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea1f51b4-c8c3-4dc9-bdae-a9c329aea0a5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.261117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea1f51b4-c8c3-4dc9-bdae-a9c329aea0a5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.290121 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea1f51b4-c8c3-4dc9-bdae-a9c329aea0a5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.290648 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea1f51b4-c8c3-4dc9-bdae-a9c329aea0a5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.423220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-ea1f51b4-c8c3-4dc9-bdae-a9c329aea0a5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lazy-loading 'flavor' on Instance uuid 5d53249c-9046-4097-bc4d-c7f0dbd95e7d {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:21:01.439656 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ea1f51b4-c8c3-4dc9-bdae-a9c329aea0a5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags/tempest-tag-1666541788" status: 204 len: 0 microversion: 2.26 time: 0.208486 May 21 21:21:01.443556 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1423/2766] 10.222.0.49 () {60 vars in 1363 bytes} [Sat May 21 21:21:01 2022] DELETE /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags/tempest-tag-1666541788 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:21:01.448610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e7ee440d-59be-4405-b657-3979298bb825 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '.version_select at 0x7fc81b2cd550>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:01.456197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7ee440d-59be-4405-b657-3979298bb825 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.456678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7ee440d-59be-4405-b657-3979298bb825 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.465402 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e7ee440d-59be-4405-b657-3979298bb825 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags" status: 200 len: 12 microversion: 2.26 time: 0.020741 May 21 21:21:01.466000 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1424/2767] 10.222.0.49 () {60 vars in 1291 bytes} [Sat May 21 21:21:01 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags => generated 12 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:01.476197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-048d6eb1-d7a8-46a3-baea-673190000ba7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '.version_select at 0x7fc81b22ff70>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:01.485089 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-048d6eb1-d7a8-46a3-baea-673190000ba7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.485666 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-048d6eb1-d7a8-46a3-baea-673190000ba7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.486153 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-048d6eb1-d7a8-46a3-baea-673190000ba7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:01.491908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-048d6eb1-d7a8-46a3-baea-673190000ba7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.492392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-048d6eb1-d7a8-46a3-baea-673190000ba7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.493749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-048d6eb1-d7a8-46a3-baea-673190000ba7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.494280 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-048d6eb1-d7a8-46a3-baea-673190000ba7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.519319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-048d6eb1-d7a8-46a3-baea-673190000ba7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.519934 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-048d6eb1-d7a8-46a3-baea-673190000ba7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.533849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-048d6eb1-d7a8-46a3-baea-673190000ba7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lazy-loading 'flavor' on Instance uuid 5d53249c-9046-4097-bc4d-c7f0dbd95e7d {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:21:01.550172 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-048d6eb1-d7a8-46a3-baea-673190000ba7 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags" status: 204 len: 0 microversion: 2.26 time: 0.078463 May 21 21:21:01.551071 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1425/2768] 10.222.0.49 () {60 vars in 1294 bytes} [Sat May 21 21:21:01 2022] DELETE /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:21:01.556820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-496e0d73-8549-43d5-a205-09a480dde732 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:01.557656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-496e0d73-8549-43d5-a205-09a480dde732 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:01.564828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-496e0d73-8549-43d5-a205-09a480dde732 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.564967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-496e0d73-8549-43d5-a205-09a480dde732 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.565721 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-496e0d73-8549-43d5-a205-09a480dde732 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.566170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-496e0d73-8549-43d5-a205-09a480dde732 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.571532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=94,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:01.716806 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3c59270e-731b-4851-8f15-161ed175ccd2 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "DELETE /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52" status: 204 len: 0 microversion: 2.1 time: 1.374475 May 21 21:21:01.721060 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1344/2769] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:00 2022] DELETE /compute/v2.1/images/0ada6b96-1d45-4c73-8900-6822e61f0f52 => generated 0 bytes in 1377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:21:01.726481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-87351eb6-1269-4a0d-8318-2f1d80aef145 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '.version_select at 0x7fc81b5d20d0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:01.735717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87351eb6-1269-4a0d-8318-2f1d80aef145 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.736159 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87351eb6-1269-4a0d-8318-2f1d80aef145 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.736676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-87351eb6-1269-4a0d-8318-2f1d80aef145 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:01.749459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87351eb6-1269-4a0d-8318-2f1d80aef145 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.755332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87351eb6-1269-4a0d-8318-2f1d80aef145 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.756253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87351eb6-1269-4a0d-8318-2f1d80aef145 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.756735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87351eb6-1269-4a0d-8318-2f1d80aef145 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.788137 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87351eb6-1269-4a0d-8318-2f1d80aef145 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.788908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87351eb6-1269-4a0d-8318-2f1d80aef145 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.793826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-496e0d73-8549-43d5-a205-09a480dde732 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:01.804487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87351eb6-1269-4a0d-8318-2f1d80aef145 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.804964 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87351eb6-1269-4a0d-8318-2f1d80aef145 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.808151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-496e0d73-8549-43d5-a205-09a480dde732 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:01.811861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-496e0d73-8549-43d5-a205-09a480dde732 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:01.811861 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-496e0d73-8549-43d5-a205-09a480dde732 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.259297 May 21 21:21:01.812879 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1426/2770] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:01 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:01.818711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-83d19ee0-5f1b-450f-ab2b-e12aa63ecf50 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '.version_select at 0x7fc81b4089d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:01.845384 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-83d19ee0-5f1b-450f-ab2b-e12aa63ecf50 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] HTTP exception thrown: Image not found. May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-83d19ee0-5f1b-450f-ab2b-e12aa63ecf50 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Request method failure captured: May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33 HTTP/1.1 May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVdnJPe2QpOAqIgfS_lQUmFzCyNAQMixmHahDCMVRXM3RX5T0IUgSoOXyzj3HD9hX_mZSQHZXhON28qMMGkAQnHzL_XTq6oaV2xpU8b7kVJZqVHhALustU3qAEFvUQK8zLm6yW-3346WaxxeSLRoX2PWggdlmWxSzWlh9dq98hCRnjc May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 496224b299024b6d80653bc12f672f8c May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesOneServerTestJSON-1954921495 May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/496224b299024b6d80653bc12f672f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/496224b299024b6d80653bc12f672f8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_496224b299024b6d80653bc12f672f8c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/496224b299024b6d80653bc12f672f8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesOneServerTestJSON-1954921495 May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 496224b299024b6d80653bc12f672f8c May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1954921495 May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesOneServerTestJSON-1954921495-project May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 8b6c47e9586f4a70b86651a35f9bcbbb May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesOneServerTestJSON-1954921495-project May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: exception: Image not found. May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '9d7584f4-9aee-43e4-96ab-27fed0337f33'} May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9d7584f4-9aee-43e4-96ab-27fed0337f33 to delete May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9d7584f4-9aee-43e4-96ab-27fed0337f33 could not be found. May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:21:01.847605 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:01.856261 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:01.856261 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:01.856261 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:21:01.856261 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:21:01.856261 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:21:01.856261 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:21:01.856261 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:21:01.856261 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:21:01.856261 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 21 21:21:01.856261 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 21 21:21:01.856261 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:21:01.856261 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:21:01.856261 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:01.856261 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:21:01.856261 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:01.856261 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:01.856261 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:01.856261 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:21:01.856261 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:21:01.856261 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:21:01.856261 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:21:01.858277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-83d19ee0-5f1b-450f-ab2b-e12aa63ecf50 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Returning 404 to user: Image not found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:21:01.859644 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-83d19ee0-5f1b-450f-ab2b-e12aa63ecf50 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "DELETE /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33" status: 404 len: 62 microversion: 2.1 time: 0.045616 May 21 21:21:01.860925 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1427/2771] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:01 2022] DELETE /compute/v2.1/images/9d7584f4-9aee-43e4-96ab-27fed0337f33 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:21:01.879269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ef621de1-ccfc-4d78-9f9d-1f2895076e5e tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:01.879794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ef621de1-ccfc-4d78-9f9d-1f2895076e5e tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:01.889669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef621de1-ccfc-4d78-9f9d-1f2895076e5e tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.890129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef621de1-ccfc-4d78-9f9d-1f2895076e5e tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.890930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef621de1-ccfc-4d78-9f9d-1f2895076e5e tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.891374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef621de1-ccfc-4d78-9f9d-1f2895076e5e tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.922055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ef621de1-ccfc-4d78-9f9d-1f2895076e5e tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:21:01.950426 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-87351eb6-1269-4a0d-8318-2f1d80aef145 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lazy-loading 'flavor' on Instance uuid 5d53249c-9046-4097-bc4d-c7f0dbd95e7d {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:21:01.968268 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-87351eb6-1269-4a0d-8318-2f1d80aef145 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "PUT /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags/tempest-tag-2056577065" status: 201 len: 0 microversion: 2.26 time: 0.245877 May 21 21:21:01.973847 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1345/2772] 10.222.0.49 () {62 vars in 1379 bytes} [Sat May 21 21:21:01 2022] PUT /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags/tempest-tag-2056577065 => generated 0 bytes in 252 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 21 21:21:01.980094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-304fb94b-a496-43df-bfe1-69f335d5bb78 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '.version_select at 0x7fc81b57f940>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:01.990034 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-304fb94b-a496-43df-bfe1-69f335d5bb78 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.990491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-304fb94b-a496-43df-bfe1-69f335d5bb78 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.991156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-304fb94b-a496-43df-bfe1-69f335d5bb78 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:01.998379 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-304fb94b-a496-43df-bfe1-69f335d5bb78 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:01.998787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-304fb94b-a496-43df-bfe1-69f335d5bb78 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:01.999579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-304fb94b-a496-43df-bfe1-69f335d5bb78 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.000026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-304fb94b-a496-43df-bfe1-69f335d5bb78 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.025805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-304fb94b-a496-43df-bfe1-69f335d5bb78 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.026271 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-304fb94b-a496-43df-bfe1-69f335d5bb78 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.035974 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-304fb94b-a496-43df-bfe1-69f335d5bb78 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.036729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-304fb94b-a496-43df-bfe1-69f335d5bb78 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.110374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-304fb94b-a496-43df-bfe1-69f335d5bb78 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lazy-loading 'flavor' on Instance uuid 5d53249c-9046-4097-bc4d-c7f0dbd95e7d {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:21:02.129378 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-304fb94b-a496-43df-bfe1-69f335d5bb78 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "PUT /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags/tempest-tag-94729846" status: 201 len: 0 microversion: 2.26 time: 0.154414 May 21 21:21:02.130368 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1346/2773] 10.222.0.49 () {62 vars in 1373 bytes} [Sat May 21 21:21:01 2022] PUT /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags/tempest-tag-94729846 => generated 0 bytes in 156 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) May 21 21:21:02.141349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f4ac5613-efce-4512-8276-b51e38652d8f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:02.144514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f4ac5613-efce-4512-8276-b51e38652d8f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:02.149357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f4ac5613-efce-4512-8276-b51e38652d8f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.150058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f4ac5613-efce-4512-8276-b51e38652d8f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.150514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f4ac5613-efce-4512-8276-b51e38652d8f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.150956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f4ac5613-efce-4512-8276-b51e38652d8f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.268110 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ef621de1-ccfc-4d78-9f9d-1f2895076e5e tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 204 len: 0 microversion: 2.1 time: 0.396951 May 21 21:21:02.268991 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1428/2774] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:21:01 2022] DELETE /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:21:02.280226 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ebac22fb-c248-4cc4-b805-1fa9ebbae6df tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '.version_select at 0x7fc81b408700>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:02.290799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebac22fb-c248-4cc4-b805-1fa9ebbae6df tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.291465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebac22fb-c248-4cc4-b805-1fa9ebbae6df tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.292063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ebac22fb-c248-4cc4-b805-1fa9ebbae6df tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:02.393984 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebac22fb-c248-4cc4-b805-1fa9ebbae6df tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.394390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebac22fb-c248-4cc4-b805-1fa9ebbae6df tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.395211 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebac22fb-c248-4cc4-b805-1fa9ebbae6df tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.395691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebac22fb-c248-4cc4-b805-1fa9ebbae6df tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.420233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebac22fb-c248-4cc4-b805-1fa9ebbae6df tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.420816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebac22fb-c248-4cc4-b805-1fa9ebbae6df tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.466078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f4ac5613-efce-4512-8276-b51e38652d8f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:02.484527 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f4ac5613-efce-4512-8276-b51e38652d8f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.351947 May 21 21:21:02.485395 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1347/2775] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:02 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:02.487799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-ebac22fb-c248-4cc4-b805-1fa9ebbae6df tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lazy-loading 'flavor' on Instance uuid 5d53249c-9046-4097-bc4d-c7f0dbd95e7d {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:21:02.490410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e14b48d7-72de-49b5-a0ac-c291f11b2794 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:02.491206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e14b48d7-72de-49b5-a0ac-c291f11b2794 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:02.498606 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e14b48d7-72de-49b5-a0ac-c291f11b2794 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.499068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e14b48d7-72de-49b5-a0ac-c291f11b2794 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.499872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e14b48d7-72de-49b5-a0ac-c291f11b2794 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.500405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e14b48d7-72de-49b5-a0ac-c291f11b2794 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.506315 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ebac22fb-c248-4cc4-b805-1fa9ebbae6df tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags" status: 204 len: 0 microversion: 2.26 time: 0.232761 May 21 21:21:02.507202 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1429/2776] 10.222.0.49 () {60 vars in 1294 bytes} [Sat May 21 21:21:02 2022] DELETE /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:21:02.513344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f4c9007f-6517-4852-87b9-16bf16f0ba93 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:02.514012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f4c9007f-6517-4852-87b9-16bf16f0ba93 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:02.520589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4c9007f-6517-4852-87b9-16bf16f0ba93 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.521164 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4c9007f-6517-4852-87b9-16bf16f0ba93 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.521783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4c9007f-6517-4852-87b9-16bf16f0ba93 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.522218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4c9007f-6517-4852-87b9-16bf16f0ba93 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.687198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f4c9007f-6517-4852-87b9-16bf16f0ba93 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:02.694911 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f4c9007f-6517-4852-87b9-16bf16f0ba93 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1473 microversion: 2.1 time: 0.186151 May 21 21:21:02.695514 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1430/2777] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:02 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1473 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:02.700499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9a1c8019-e516-47c2-9dec-fcc8c6715fa2 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '.version_select at 0x7fc81b16ef70>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:02.707908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a1c8019-e516-47c2-9dec-fcc8c6715fa2 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.708428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a1c8019-e516-47c2-9dec-fcc8c6715fa2 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.724875 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9a1c8019-e516-47c2-9dec-fcc8c6715fa2 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags" status: 200 len: 12 microversion: 2.26 time: 0.021476 May 21 21:21:02.724875 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1431/2778] 10.222.0.49 () {60 vars in 1291 bytes} [Sat May 21 21:21:02 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags => generated 12 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:02.725083 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e14b48d7-72de-49b5-a0ac-c291f11b2794 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:02.730815 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e14b48d7-72de-49b5-a0ac-c291f11b2794 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1472 microversion: 2.1 time: 0.244214 May 21 21:21:02.739734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-92dd6ed3-4f12-47c1-aa67-902fd240e2fe tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '.version_select at 0x7fc81b16e820>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:02.741984 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1348/2779] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:02 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1472 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:02.751006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-92dd6ed3-4f12-47c1-aa67-902fd240e2fe tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.761372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-92dd6ed3-4f12-47c1-aa67-902fd240e2fe tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.761372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-92dd6ed3-4f12-47c1-aa67-902fd240e2fe tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:02.761372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-92dd6ed3-4f12-47c1-aa67-902fd240e2fe tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.761372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-92dd6ed3-4f12-47c1-aa67-902fd240e2fe tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.762711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-92dd6ed3-4f12-47c1-aa67-902fd240e2fe tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.762711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-92dd6ed3-4f12-47c1-aa67-902fd240e2fe tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.788386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-92dd6ed3-4f12-47c1-aa67-902fd240e2fe tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.788875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-92dd6ed3-4f12-47c1-aa67-902fd240e2fe tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.801400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-92dd6ed3-4f12-47c1-aa67-902fd240e2fe tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lazy-loading 'flavor' on Instance uuid 5d53249c-9046-4097-bc4d-c7f0dbd95e7d {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:21:02.818169 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-92dd6ed3-4f12-47c1-aa67-902fd240e2fe tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags" status: 204 len: 0 microversion: 2.26 time: 0.084201 May 21 21:21:02.818776 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-9c9e5c55-620c-4a7c-9fd7-e51bf8d62ca2 req-9764b527-b12d-4960-9d45-427fbfb9c7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "tag": "45483686-8652-4059-bc41-0b17ce21b793"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:02.819122 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1432/2780] 10.222.0.49 () {60 vars in 1294 bytes} [Sat May 21 21:21:02 2022] DELETE /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:21:02.831314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9c9e5c55-620c-4a7c-9fd7-e51bf8d62ca2 req-9764b527-b12d-4960-9d45-427fbfb9c7e9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.832006 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9c9e5c55-620c-4a7c-9fd7-e51bf8d62ca2 req-9764b527-b12d-4960-9d45-427fbfb9c7e9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.832171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1dcbab1e-45b4-4b15-b42e-f34460885741 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '.version_select at 0x7fc81b474e50>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:02.842332 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dcbab1e-45b4-4b15-b42e-f34460885741 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.843550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dcbab1e-45b4-4b15-b42e-f34460885741 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.844126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1dcbab1e-45b4-4b15-b42e-f34460885741 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:02.848607 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-9c9e5c55-620c-4a7c-9fd7-e51bf8d62ca2 req-9764b527-b12d-4960-9d45-427fbfb9c7e9 service nova] Creating event network-changed:45483686-8652-4059-bc41-0b17ce21b793 for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:21:02.852684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dcbab1e-45b4-4b15-b42e-f34460885741 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.855054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dcbab1e-45b4-4b15-b42e-f34460885741 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.856441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dcbab1e-45b4-4b15-b42e-f34460885741 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.856975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dcbab1e-45b4-4b15-b42e-f34460885741 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.857475 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-9c9e5c55-620c-4a7c-9fd7-e51bf8d62ca2 req-9764b527-b12d-4960-9d45-427fbfb9c7e9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044578 May 21 21:21:02.858790 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1349/2781] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:02.869117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b355946d-1fbd-42ce-b0b3-9ac9db761593 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:02.871705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b355946d-1fbd-42ce-b0b3-9ac9db761593 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:02.876844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b355946d-1fbd-42ce-b0b3-9ac9db761593 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.878222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b355946d-1fbd-42ce-b0b3-9ac9db761593 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.879135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b355946d-1fbd-42ce-b0b3-9ac9db761593 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.879590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b355946d-1fbd-42ce-b0b3-9ac9db761593 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.888862 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dcbab1e-45b4-4b15-b42e-f34460885741 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.889558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dcbab1e-45b4-4b15-b42e-f34460885741 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:02.900727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dcbab1e-45b4-4b15-b42e-f34460885741 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:02.901485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dcbab1e-45b4-4b15-b42e-f34460885741 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.019277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-1dcbab1e-45b4-4b15-b42e-f34460885741 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lazy-loading 'flavor' on Instance uuid 5d53249c-9046-4097-bc4d-c7f0dbd95e7d {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:21:03.035148 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1dcbab1e-45b4-4b15-b42e-f34460885741 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "PUT /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags/tempest-tag-2030618409" status: 201 len: 0 microversion: 2.26 time: 0.208467 May 21 21:21:03.035802 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1433/2782] 10.222.0.49 () {62 vars in 1379 bytes} [Sat May 21 21:21:02 2022] PUT /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags/tempest-tag-2030618409 => generated 0 bytes in 210 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 21 21:21:03.045956 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-082a2553-1b87-4891-8012-fb4c765b4b42 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '.version_select at 0x7fc81b64f700>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:03.054097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-082a2553-1b87-4891-8012-fb4c765b4b42 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.054704 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-082a2553-1b87-4891-8012-fb4c765b4b42 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.055758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-082a2553-1b87-4891-8012-fb4c765b4b42 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:03.062357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-082a2553-1b87-4891-8012-fb4c765b4b42 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.063192 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-082a2553-1b87-4891-8012-fb4c765b4b42 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.064052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-082a2553-1b87-4891-8012-fb4c765b4b42 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.064540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-082a2553-1b87-4891-8012-fb4c765b4b42 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.092553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-082a2553-1b87-4891-8012-fb4c765b4b42 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.092991 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-082a2553-1b87-4891-8012-fb4c765b4b42 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.103299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-082a2553-1b87-4891-8012-fb4c765b4b42 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.103736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-082a2553-1b87-4891-8012-fb4c765b4b42 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.171871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b355946d-1fbd-42ce-b0b3-9ac9db761593 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:03.172924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-082a2553-1b87-4891-8012-fb4c765b4b42 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lazy-loading 'flavor' on Instance uuid 5d53249c-9046-4097-bc4d-c7f0dbd95e7d {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:21:03.187412 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b355946d-1fbd-42ce-b0b3-9ac9db761593 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:03.189167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b355946d-1fbd-42ce-b0b3-9ac9db761593 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:03.190331 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b355946d-1fbd-42ce-b0b3-9ac9db761593 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.330151 May 21 21:21:03.191365 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1350/2783] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:02 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:03.209608 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-082a2553-1b87-4891-8012-fb4c765b4b42 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "PUT /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags/tempest-tag-157692901" status: 201 len: 0 microversion: 2.26 time: 0.167800 May 21 21:21:03.210528 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1434/2784] 10.222.0.49 () {62 vars in 1376 bytes} [Sat May 21 21:21:03 2022] PUT /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags/tempest-tag-157692901 => generated 0 bytes in 169 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) May 21 21:21:03.231008 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-568cd08a-1277-4ed3-8ded-544c8ce3b8fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Action: 'update_all', calling method: .version_select at 0x7fc81b70d5e0>, body: {"tags": ["tempest-tag-2002800468", "tempest-tag-280795998"]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:03.240211 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-568cd08a-1277-4ed3-8ded-544c8ce3b8fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.240702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-568cd08a-1277-4ed3-8ded-544c8ce3b8fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.241257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-568cd08a-1277-4ed3-8ded-544c8ce3b8fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:03.247913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-568cd08a-1277-4ed3-8ded-544c8ce3b8fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.248535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-568cd08a-1277-4ed3-8ded-544c8ce3b8fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.249319 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-568cd08a-1277-4ed3-8ded-544c8ce3b8fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.249798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-568cd08a-1277-4ed3-8ded-544c8ce3b8fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.275815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-568cd08a-1277-4ed3-8ded-544c8ce3b8fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.276588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-568cd08a-1277-4ed3-8ded-544c8ce3b8fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.381503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-568cd08a-1277-4ed3-8ded-544c8ce3b8fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lazy-loading 'flavor' on Instance uuid 5d53249c-9046-4097-bc4d-c7f0dbd95e7d {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:21:03.386369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:DELETE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:03.398790 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-568cd08a-1277-4ed3-8ded-544c8ce3b8fd tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "PUT /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags" status: 200 len: 61 microversion: 2.26 time: 0.173071 May 21 21:21:03.400251 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1351/2785] 10.222.0.49 () {62 vars in 1311 bytes} [Sat May 21 21:21:03 2022] PUT /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags => generated 61 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:03.410118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7a017433-706d-4824-97c5-6e1bbafd56da tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '.version_select at 0x7fc81b2bc3a0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:03.418361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a017433-706d-4824-97c5-6e1bbafd56da tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.418816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a017433-706d-4824-97c5-6e1bbafd56da tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.428628 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7a017433-706d-4824-97c5-6e1bbafd56da tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags" status: 200 len: 61 microversion: 2.26 time: 0.022989 May 21 21:21:03.429228 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1435/2786] 10.222.0.49 () {60 vars in 1291 bytes} [Sat May 21 21:21:03 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags => generated 61 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:03.439745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a2d7cce4-ef89-4e44-be64-19c11ed594cc tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '.version_select at 0x7fc82cf76040>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:03.447768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2d7cce4-ef89-4e44-be64-19c11ed594cc tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.448226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2d7cce4-ef89-4e44-be64-19c11ed594cc tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.448736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a2d7cce4-ef89-4e44-be64-19c11ed594cc tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:03.454350 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2d7cce4-ef89-4e44-be64-19c11ed594cc tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.454801 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2d7cce4-ef89-4e44-be64-19c11ed594cc tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.455552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2d7cce4-ef89-4e44-be64-19c11ed594cc tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.455991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2d7cce4-ef89-4e44-be64-19c11ed594cc tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.479258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2d7cce4-ef89-4e44-be64-19c11ed594cc tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.479674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2d7cce4-ef89-4e44-be64-19c11ed594cc tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.503713 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d7a81df4-4733-45ad-8b7f-0a5556cba430 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:03.504397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d7a81df4-4733-45ad-8b7f-0a5556cba430 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:03.511357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7a81df4-4733-45ad-8b7f-0a5556cba430 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.511833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7a81df4-4733-45ad-8b7f-0a5556cba430 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.512613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7a81df4-4733-45ad-8b7f-0a5556cba430 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.513057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7a81df4-4733-45ad-8b7f-0a5556cba430 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.541291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-a2d7cce4-ef89-4e44-be64-19c11ed594cc tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lazy-loading 'flavor' on Instance uuid 5d53249c-9046-4097-bc4d-c7f0dbd95e7d {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:21:03.557544 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a2d7cce4-ef89-4e44-be64-19c11ed594cc tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags" status: 204 len: 0 microversion: 2.26 time: 0.122025 May 21 21:21:03.558264 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1352/2787] 10.222.0.49 () {60 vars in 1294 bytes} [Sat May 21 21:21:03 2022] DELETE /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d/tags => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:21:03.575753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f2943920-ee53-434f-9f61-8733867aac11 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:03.576264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f2943920-ee53-434f-9f61-8733867aac11 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:03.582544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2943920-ee53-434f-9f61-8733867aac11 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.582997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2943920-ee53-434f-9f61-8733867aac11 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.583772 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2943920-ee53-434f-9f61-8733867aac11 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.584218 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2943920-ee53-434f-9f61-8733867aac11 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.610572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f2943920-ee53-434f-9f61-8733867aac11 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:21:03.663817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d7a81df4-4733-45ad-8b7f-0a5556cba430 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:03.672254 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d7a81df4-4733-45ad-8b7f-0a5556cba430 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.172617 May 21 21:21:03.672851 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1436/2788] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:03 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:03.713358 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0a14e866-0caf-4bb2-9733-110db6991433 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:03.713825 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0a14e866-0caf-4bb2-9733-110db6991433 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:03.720781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a14e866-0caf-4bb2-9733-110db6991433 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.726787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a14e866-0caf-4bb2-9733-110db6991433 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.726787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a14e866-0caf-4bb2-9733-110db6991433 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.726787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a14e866-0caf-4bb2-9733-110db6991433 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.882959 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f2943920-ee53-434f-9f61-8733867aac11 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d" status: 204 len: 0 microversion: 2.26 time: 0.311580 May 21 21:21:03.885795 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0a14e866-0caf-4bb2-9733-110db6991433 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:03.885933 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1353/2789] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:21:03 2022] DELETE /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 21 21:21:03.889653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-50437be5-71de-4ac2-a56a-7121695b1833 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:03.890411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-50437be5-71de-4ac2-a56a-7121695b1833 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:03.891475 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0a14e866-0caf-4bb2-9733-110db6991433 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1473 microversion: 2.1 time: 0.182841 May 21 21:21:03.902441 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1437/2790] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:03 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1473 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:03.902441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-486d507e-ca4c-46ac-9d0d-addfd2dd12e5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:03.902441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-486d507e-ca4c-46ac-9d0d-addfd2dd12e5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:03.906133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-486d507e-ca4c-46ac-9d0d-addfd2dd12e5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.907540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-486d507e-ca4c-46ac-9d0d-addfd2dd12e5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.908643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-486d507e-ca4c-46ac-9d0d-addfd2dd12e5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.909350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-486d507e-ca4c-46ac-9d0d-addfd2dd12e5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.913223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50437be5-71de-4ac2-a56a-7121695b1833 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.915612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50437be5-71de-4ac2-a56a-7121695b1833 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.917164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50437be5-71de-4ac2-a56a-7121695b1833 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:03.918135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50437be5-71de-4ac2-a56a-7121695b1833 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:03.933628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=3,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:04.078658 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-486d507e-ca4c-46ac-9d0d-addfd2dd12e5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:04.087098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-486d507e-ca4c-46ac-9d0d-addfd2dd12e5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:04.088912 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-486d507e-ca4c-46ac-9d0d-addfd2dd12e5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:04.090156 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-486d507e-ca4c-46ac-9d0d-addfd2dd12e5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d" status: 200 len: 1552 microversion: 2.26 time: 0.196788 May 21 21:21:04.090770 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1438/2791] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:03 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d => generated 1552 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:04.132268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-50437be5-71de-4ac2-a56a-7121695b1833 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:04.141237 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-50437be5-71de-4ac2-a56a-7121695b1833 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1472 microversion: 2.1 time: 0.256091 May 21 21:21:04.141841 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1354/2792] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:03 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1472 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:04.209228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ec6ce4e8-370e-4458-9934-097daf984a4c tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:04.210461 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ec6ce4e8-370e-4458-9934-097daf984a4c tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:04.218440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ec6ce4e8-370e-4458-9934-097daf984a4c tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:04.218895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ec6ce4e8-370e-4458-9934-097daf984a4c tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:04.219680 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ec6ce4e8-370e-4458-9934-097daf984a4c tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:04.220182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ec6ce4e8-370e-4458-9934-097daf984a4c tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:04.443069 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ec6ce4e8-370e-4458-9934-097daf984a4c tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:04.453284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ec6ce4e8-370e-4458-9934-097daf984a4c tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:04.455219 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ec6ce4e8-370e-4458-9934-097daf984a4c tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:04.456655 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ec6ce4e8-370e-4458-9934-097daf984a4c tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.251747 May 21 21:21:04.457463 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1439/2793] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:04 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:04.575552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-ef3c2543-023f-4207-a0c2-4c9f7a3ef393 req-dbfd8ef2-c0d3-4ebd-838c-cb6c72ab93fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac", "name": "network-vif-unplugged", "status": "completed", "tag": "8d6ae2f7-1fa6-41fb-9029-17a3c0e7fb0d"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:04.586811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ef3c2543-023f-4207-a0c2-4c9f7a3ef393 req-dbfd8ef2-c0d3-4ebd-838c-cb6c72ab93fb service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:04.586811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ef3c2543-023f-4207-a0c2-4c9f7a3ef393 req-dbfd8ef2-c0d3-4ebd-838c-cb6c72ab93fb service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:04.598124 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-ef3c2543-023f-4207-a0c2-4c9f7a3ef393 req-dbfd8ef2-c0d3-4ebd-838c-cb6c72ab93fb service nova] Creating event network-vif-unplugged:8d6ae2f7-1fa6-41fb-9029-17a3c0e7fb0d for instance a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac on nch2-master-1 May 21 21:21:04.603965 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-ef3c2543-023f-4207-a0c2-4c9f7a3ef393 req-dbfd8ef2-c0d3-4ebd-838c-cb6c72ab93fb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032188 May 21 21:21:04.604627 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1355/2794] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:04.695055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e7eb1393-9066-4f79-8739-276fe3b53e80 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:04.695755 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e7eb1393-9066-4f79-8739-276fe3b53e80 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:04.722040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7eb1393-9066-4f79-8739-276fe3b53e80 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:04.722511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7eb1393-9066-4f79-8739-276fe3b53e80 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:04.723314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7eb1393-9066-4f79-8739-276fe3b53e80 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:04.723766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7eb1393-9066-4f79-8739-276fe3b53e80 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:04.883082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e7eb1393-9066-4f79-8739-276fe3b53e80 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:04.886423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-9c35570b-37e7-47e4-aaf1-c91a0177ac90 req-df43e047-0974-433d-85ac-87a0958711f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "tag": "1a250478-2823-459d-8b34-27d5cf96fda6"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:04.890699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:04.892721 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e7eb1393-9066-4f79-8739-276fe3b53e80 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.206069 May 21 21:21:04.893310 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1440/2795] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:04 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:04.901429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9c35570b-37e7-47e4-aaf1-c91a0177ac90 req-df43e047-0974-433d-85ac-87a0958711f9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:04.902167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9c35570b-37e7-47e4-aaf1-c91a0177ac90 req-df43e047-0974-433d-85ac-87a0958711f9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:04.918506 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-9c35570b-37e7-47e4-aaf1-c91a0177ac90 req-df43e047-0974-433d-85ac-87a0958711f9 service nova] Creating event network-changed:1a250478-2823-459d-8b34-27d5cf96fda6 for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:21:04.920161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-013ec182-5a82-4001-b2e7-2927047aef07 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:04.920966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-013ec182-5a82-4001-b2e7-2927047aef07 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:04.923676 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-9c35570b-37e7-47e4-aaf1-c91a0177ac90 req-df43e047-0974-433d-85ac-87a0958711f9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042938 May 21 21:21:04.924812 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1356/2796] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:04.929792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-013ec182-5a82-4001-b2e7-2927047aef07 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:04.930272 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-013ec182-5a82-4001-b2e7-2927047aef07 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:04.932603 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-013ec182-5a82-4001-b2e7-2927047aef07 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:04.933057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-013ec182-5a82-4001-b2e7-2927047aef07 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:05.089052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-013ec182-5a82-4001-b2e7-2927047aef07 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:05.097469 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-013ec182-5a82-4001-b2e7-2927047aef07 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1473 microversion: 2.1 time: 0.181254 May 21 21:21:05.098138 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1441/2797] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:04 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1473 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:05.110390 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0bbc248a-bfe9-4458-9d2b-04066967e1e4 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:05.111099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0bbc248a-bfe9-4458-9d2b-04066967e1e4 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:05.118513 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bbc248a-bfe9-4458-9d2b-04066967e1e4 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:05.119049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bbc248a-bfe9-4458-9d2b-04066967e1e4 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:05.119836 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bbc248a-bfe9-4458-9d2b-04066967e1e4 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:05.120267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bbc248a-bfe9-4458-9d2b-04066967e1e4 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:05.159652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fe815cff-802c-451e-b44c-3e9aa5a0aa2b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:05.160301 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fe815cff-802c-451e-b44c-3e9aa5a0aa2b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:05.167393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe815cff-802c-451e-b44c-3e9aa5a0aa2b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:05.167856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe815cff-802c-451e-b44c-3e9aa5a0aa2b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:05.168671 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe815cff-802c-451e-b44c-3e9aa5a0aa2b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:05.169122 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe815cff-802c-451e-b44c-3e9aa5a0aa2b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:05.333274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fe815cff-802c-451e-b44c-3e9aa5a0aa2b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:05.342091 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fe815cff-802c-451e-b44c-3e9aa5a0aa2b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1472 microversion: 2.1 time: 0.186668 May 21 21:21:05.342671 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1442/2798] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:05 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1472 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:05.475079 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c48b3a4f-d665-4f99-9882-0bfc53f7bfea tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:05.475698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c48b3a4f-d665-4f99-9882-0bfc53f7bfea tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:05.483052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c48b3a4f-d665-4f99-9882-0bfc53f7bfea tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:05.483498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c48b3a4f-d665-4f99-9882-0bfc53f7bfea tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:05.485072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c48b3a4f-d665-4f99-9882-0bfc53f7bfea tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:05.485517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c48b3a4f-d665-4f99-9882-0bfc53f7bfea tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:05.623344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0bbc248a-bfe9-4458-9d2b-04066967e1e4 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:05.640165 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0bbc248a-bfe9-4458-9d2b-04066967e1e4 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:05.642227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0bbc248a-bfe9-4458-9d2b-04066967e1e4 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:05.646600 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0bbc248a-bfe9-4458-9d2b-04066967e1e4 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d" status: 200 len: 1552 microversion: 2.26 time: 0.541264 May 21 21:21:05.649408 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1357/2799] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:05 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d => generated 1552 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:05.838484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c48b3a4f-d665-4f99-9882-0bfc53f7bfea tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:05.852827 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c48b3a4f-d665-4f99-9882-0bfc53f7bfea tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:05.854678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c48b3a4f-d665-4f99-9882-0bfc53f7bfea tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:05.855924 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c48b3a4f-d665-4f99-9882-0bfc53f7bfea tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.384919 May 21 21:21:05.856623 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1443/2800] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:05 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:21:05.911376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bd78d517-51bf-4be7-b1ff-9bf176c94732 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:05.912194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bd78d517-51bf-4be7-b1ff-9bf176c94732 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:05.920782 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bd78d517-51bf-4be7-b1ff-9bf176c94732 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:05.921488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bd78d517-51bf-4be7-b1ff-9bf176c94732 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:05.922812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bd78d517-51bf-4be7-b1ff-9bf176c94732 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:05.923160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bd78d517-51bf-4be7-b1ff-9bf176c94732 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:06.114938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bb7112a2-3ffd-4605-b58b-796cf2c8e4d7 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:06.115554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bb7112a2-3ffd-4605-b58b-796cf2c8e4d7 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:06.124095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb7112a2-3ffd-4605-b58b-796cf2c8e4d7 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:06.139553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb7112a2-3ffd-4605-b58b-796cf2c8e4d7 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:06.139553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb7112a2-3ffd-4605-b58b-796cf2c8e4d7 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:06.139553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb7112a2-3ffd-4605-b58b-796cf2c8e4d7 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:06.261129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bb7112a2-3ffd-4605-b58b-796cf2c8e4d7 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:06.269649 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bb7112a2-3ffd-4605-b58b-796cf2c8e4d7 tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1431 microversion: 2.1 time: 0.158508 May 21 21:21:06.283165 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1444/2801] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:06 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1431 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:06.288355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-fa7ac8bd-c143-4583-91ca-ad1cd007feb5 req-12bbb5ff-5eff-4f85-b9ef-e22f56d0ad11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d53249c-9046-4097-bc4d-c7f0dbd95e7d", "name": "network-vif-deleted", "tag": "6bb8e744-3b44-4866-b40b-e804d8612b42"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:06.297745 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-fa7ac8bd-c143-4583-91ca-ad1cd007feb5 req-12bbb5ff-5eff-4f85-b9ef-e22f56d0ad11 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:06.298209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-fa7ac8bd-c143-4583-91ca-ad1cd007feb5 req-12bbb5ff-5eff-4f85-b9ef-e22f56d0ad11 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:06.317047 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-fa7ac8bd-c143-4583-91ca-ad1cd007feb5 req-12bbb5ff-5eff-4f85-b9ef-e22f56d0ad11 service nova] Creating event network-vif-deleted:6bb8e744-3b44-4866-b40b-e804d8612b42 for instance 5d53249c-9046-4097-bc4d-c7f0dbd95e7d on nch1-master-1 May 21 21:21:06.326362 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-fa7ac8bd-c143-4583-91ca-ad1cd007feb5 req-12bbb5ff-5eff-4f85-b9ef-e22f56d0ad11 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041451 May 21 21:21:06.327455 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1445/2802] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:06.380963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f0fea0b6-5a2f-4930-8950-2c84623a630b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:06.380963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f0fea0b6-5a2f-4930-8950-2c84623a630b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:06.380963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0fea0b6-5a2f-4930-8950-2c84623a630b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:06.380963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0fea0b6-5a2f-4930-8950-2c84623a630b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:06.380963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0fea0b6-5a2f-4930-8950-2c84623a630b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:06.380963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0fea0b6-5a2f-4930-8950-2c84623a630b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:06.483189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bd78d517-51bf-4be7-b1ff-9bf176c94732 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:06.494633 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bd78d517-51bf-4be7-b1ff-9bf176c94732 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.588499 May 21 21:21:06.495711 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1358/2803] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:05 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:06.567910 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f0fea0b6-5a2f-4930-8950-2c84623a630b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:06.577292 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f0fea0b6-5a2f-4930-8950-2c84623a630b tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1472 microversion: 2.1 time: 0.221896 May 21 21:21:06.577964 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1446/2804] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:06 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1472 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:06.667819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7a69f655-1806-4bcf-a5fd-0eae5f28a4b5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:06.668389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7a69f655-1806-4bcf-a5fd-0eae5f28a4b5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:06.675295 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7a69f655-1806-4bcf-a5fd-0eae5f28a4b5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:06.675786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7a69f655-1806-4bcf-a5fd-0eae5f28a4b5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:06.676591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7a69f655-1806-4bcf-a5fd-0eae5f28a4b5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:06.677041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7a69f655-1806-4bcf-a5fd-0eae5f28a4b5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:06.712258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7a69f655-1806-4bcf-a5fd-0eae5f28a4b5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:06.712805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7a69f655-1806-4bcf-a5fd-0eae5f28a4b5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:06.713290 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-7a69f655-1806-4bcf-a5fd-0eae5f28a4b5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lazy-loading 'fault' on Instance uuid 5d53249c-9046-4097-bc4d-c7f0dbd95e7d {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:21:06.766146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7a69f655-1806-4bcf-a5fd-0eae5f28a4b5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:06.784837 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7a69f655-1806-4bcf-a5fd-0eae5f28a4b5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:06.786377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7a69f655-1806-4bcf-a5fd-0eae5f28a4b5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48247ec5dc95420aadf9bda93a3ef118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e341c8308bde44b19203f2eb21a16dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:06.787579 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7a69f655-1806-4bcf-a5fd-0eae5f28a4b5 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d" status: 200 len: 1352 microversion: 2.26 time: 0.124502 May 21 21:21:06.789597 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1359/2805] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:06 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d => generated 1352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:06.875995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-55ab2e4d-77d4-49be-8b88-6eb9e9d16675 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:06.877025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-55ab2e4d-77d4-49be-8b88-6eb9e9d16675 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:06.885620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-55ab2e4d-77d4-49be-8b88-6eb9e9d16675 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:06.886234 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-55ab2e4d-77d4-49be-8b88-6eb9e9d16675 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:06.887294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-55ab2e4d-77d4-49be-8b88-6eb9e9d16675 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:06.888118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-55ab2e4d-77d4-49be-8b88-6eb9e9d16675 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:07.017077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-cede07c8-ba2a-4b7a-84a2-75efcb7d805c req-4bdde382-1f1d-4cdf-9a04-230950006efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac", "name": "network-vif-deleted", "tag": "8d6ae2f7-1fa6-41fb-9029-17a3c0e7fb0d"}, {"name": "network-changed", "server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "tag": "259477b1-cfd2-4e6b-a20e-7bab0eec7c14"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:07.035721 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-cede07c8-ba2a-4b7a-84a2-75efcb7d805c req-4bdde382-1f1d-4cdf-9a04-230950006efd service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:07.036715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-cede07c8-ba2a-4b7a-84a2-75efcb7d805c req-4bdde382-1f1d-4cdf-9a04-230950006efd service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:07.067173 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-cede07c8-ba2a-4b7a-84a2-75efcb7d805c req-4bdde382-1f1d-4cdf-9a04-230950006efd service nova] Creating event network-vif-deleted:8d6ae2f7-1fa6-41fb-9029-17a3c0e7fb0d for instance a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac on nch2-master-1 May 21 21:21:07.067173 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-cede07c8-ba2a-4b7a-84a2-75efcb7d805c req-4bdde382-1f1d-4cdf-9a04-230950006efd service nova] Creating event network-changed:259477b1-cfd2-4e6b-a20e-7bab0eec7c14 for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:21:07.067173 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-cede07c8-ba2a-4b7a-84a2-75efcb7d805c req-4bdde382-1f1d-4cdf-9a04-230950006efd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.053479 May 21 21:21:07.067173 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1360/2806] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:21:07.115435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-55ab2e4d-77d4-49be-8b88-6eb9e9d16675 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:07.125002 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-55ab2e4d-77d4-49be-8b88-6eb9e9d16675 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:07.126487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-55ab2e4d-77d4-49be-8b88-6eb9e9d16675 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:07.127631 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-55ab2e4d-77d4-49be-8b88-6eb9e9d16675 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.256873 May 21 21:21:07.128196 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1447/2807] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:06 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:07.288035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cafa584e-0b78-4dac-a641-89242260006b tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:07.288789 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cafa584e-0b78-4dac-a641-89242260006b tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:07.297591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cafa584e-0b78-4dac-a641-89242260006b tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:07.298046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cafa584e-0b78-4dac-a641-89242260006b tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:07.298873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cafa584e-0b78-4dac-a641-89242260006b tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:07.299319 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cafa584e-0b78-4dac-a641-89242260006b tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:07.334885 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cafa584e-0b78-4dac-a641-89242260006b tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:07.335344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cafa584e-0b78-4dac-a641-89242260006b tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:07.335807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-cafa584e-0b78-4dac-a641-89242260006b tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lazy-loading 'fault' on Instance uuid a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:21:07.423449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cafa584e-0b78-4dac-a641-89242260006b tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6c47e9586f4a70b86651a35f9bcbbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496224b299024b6d80653bc12f672f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:07.434842 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cafa584e-0b78-4dac-a641-89242260006b tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 200 len: 1307 microversion: 2.1 time: 0.151002 May 21 21:21:07.435866 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1361/2808] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:07 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 1307 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:07.518034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-07e36b2b-7fd2-4f4c-aa89-91caa04ef41a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:07.518661 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-07e36b2b-7fd2-4f4c-aa89-91caa04ef41a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:07.525977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07e36b2b-7fd2-4f4c-aa89-91caa04ef41a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:07.526436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07e36b2b-7fd2-4f4c-aa89-91caa04ef41a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:07.527294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07e36b2b-7fd2-4f4c-aa89-91caa04ef41a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:07.527741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07e36b2b-7fd2-4f4c-aa89-91caa04ef41a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:07.595863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2c5d78cc-ca2a-4303-8f92-dc29bf032ec9 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:07.596532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2c5d78cc-ca2a-4303-8f92-dc29bf032ec9 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:07.603563 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c5d78cc-ca2a-4303-8f92-dc29bf032ec9 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:07.607838 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c5d78cc-ca2a-4303-8f92-dc29bf032ec9 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:07.607838 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c5d78cc-ca2a-4303-8f92-dc29bf032ec9 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:07.607838 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c5d78cc-ca2a-4303-8f92-dc29bf032ec9 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:07.729035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-07e36b2b-7fd2-4f4c-aa89-91caa04ef41a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:07.736723 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-07e36b2b-7fd2-4f4c-aa89-91caa04ef41a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.222601 May 21 21:21:07.737420 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1448/2809] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:07 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:07.810056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ce6dd7fc-2b54-494b-b3b4-7ae04a1cde63 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:07.810725 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ce6dd7fc-2b54-494b-b3b4-7ae04a1cde63 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] [instance: 5d53249c-9046-4097-bc4d-c7f0dbd95e7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:07.817575 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce6dd7fc-2b54-494b-b3b4-7ae04a1cde63 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:07.818027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce6dd7fc-2b54-494b-b3b4-7ae04a1cde63 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:07.818822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce6dd7fc-2b54-494b-b3b4-7ae04a1cde63 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:07.819262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce6dd7fc-2b54-494b-b3b4-7ae04a1cde63 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:07.836542 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-ce6dd7fc-2b54-494b-b3b4-7ae04a1cde63 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] HTTP exception thrown: Instance 5d53249c-9046-4097-bc4d-c7f0dbd95e7d could not be found. May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ce6dd7fc-2b54-494b-b3b4-7ae04a1cde63 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Request method failure captured: May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d HTTP/1.1 May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVel34DKOXnQSn5EH00-JuGXtojrO2nE3H4hCwh5YyAI15-qSMAcSbCEksMfiztA0mhWYkkSUFgHUXt4Iu3iu_Pq162mdD7QWjURiPOz5oDOlNC5Wi2ESwLtahNFkUnDJxAJwDBTj6UygMxp9AGIMAwZCCp0Ss2MyLH058SSOiJIoNY May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: X-Openstack-Nova-Api-Version: 2.26 May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: e341c8308bde44b19203f2eb21a16dc9 May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerTagsTestJSON-1636157918 May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e341c8308bde44b19203f2eb21a16dc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e341c8308bde44b19203f2eb21a16dc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e341c8308bde44b19203f2eb21a16dc9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e341c8308bde44b19203f2eb21a16dc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerTagsTestJSON-1636157918 May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: e341c8308bde44b19203f2eb21a16dc9 May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerTagsTestJSON-1636157918 May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerTagsTestJSON-1636157918-project May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 48247ec5dc95420aadf9bda93a3ef118 May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerTagsTestJSON-1636157918-project May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 5d53249c-9046-4097-bc4d-c7f0dbd95e7d could not be found. May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '5d53249c-9046-4097-bc4d-c7f0dbd95e7d'} May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d53249c-9046-4097-bc4d-c7f0dbd95e7d could not be found. May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d53249c-9046-4097-bc4d-c7f0dbd95e7d could not be found. May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:07.839091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:21:07.845949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:07.845949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:07.845949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:07.845949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:21:07.845949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:21:07.845949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d53249c-9046-4097-bc4d-c7f0dbd95e7d could not be found. May 21 21:21:07.845949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:21:07.845949 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ce6dd7fc-2b54-494b-b3b4-7ae04a1cde63 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] Returning 404 to user: Instance 5d53249c-9046-4097-bc4d-c7f0dbd95e7d could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:21:07.845949 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ce6dd7fc-2b54-494b-b3b4-7ae04a1cde63 tempest-ServerTagsTestJSON-1636157918 tempest-ServerTagsTestJSON-1636157918-project] 10.222.0.49 "GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d" status: 404 len: 111 microversion: 2.26 time: 0.035692 May 21 21:21:07.845949 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1449/2810] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:07 2022] GET /compute/v2.1/servers/5d53249c-9046-4097-bc4d-c7f0dbd95e7d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 21 21:21:07.981807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2c5d78cc-ca2a-4303-8f92-dc29bf032ec9 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:07.998271 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2c5d78cc-ca2a-4303-8f92-dc29bf032ec9 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1472 microversion: 2.1 time: 0.406589 May 21 21:21:07.999124 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1362/2811] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:07 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1472 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:08.149698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6d65d811-b6c1-48f1-a6ba-a7c0ae2306c4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:08.150772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6d65d811-b6c1-48f1-a6ba-a7c0ae2306c4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:08.161412 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d65d811-b6c1-48f1-a6ba-a7c0ae2306c4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:08.161869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d65d811-b6c1-48f1-a6ba-a7c0ae2306c4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:08.162972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d65d811-b6c1-48f1-a6ba-a7c0ae2306c4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:08.163415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d65d811-b6c1-48f1-a6ba-a7c0ae2306c4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:08.441256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6d65d811-b6c1-48f1-a6ba-a7c0ae2306c4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:08.458819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6d65d811-b6c1-48f1-a6ba-a7c0ae2306c4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:08.461578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-da57da73-f16e-457b-b4ef-bb6c14c251aa tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:08.462318 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6d65d811-b6c1-48f1-a6ba-a7c0ae2306c4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:08.462318 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6d65d811-b6c1-48f1-a6ba-a7c0ae2306c4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.318407 May 21 21:21:08.464349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-da57da73-f16e-457b-b4ef-bb6c14c251aa tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] [instance: a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:08.473312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da57da73-f16e-457b-b4ef-bb6c14c251aa tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:08.474234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da57da73-f16e-457b-b4ef-bb6c14c251aa tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:08.475528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da57da73-f16e-457b-b4ef-bb6c14c251aa tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:08.476384 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1450/2812] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:08 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:21:08.477702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da57da73-f16e-457b-b4ef-bb6c14c251aa tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:08.504710 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-da57da73-f16e-457b-b4ef-bb6c14c251aa tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] HTTP exception thrown: Instance a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac could not be found. May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-da57da73-f16e-457b-b4ef-bb6c14c251aa tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Request method failure captured: May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac HTTP/1.1 May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVdnJPe2QpOAqIgfS_lQUmFzCyNAQMixmHahDCMVRXM3RX5T0IUgSoOXyzj3HD9hX_mZSQHZXhON28qMMGkAQnHzL_XTq6oaV2xpU8b7kVJZqVHhALustU3qAEFvUQK8zLm6yW-3346WaxxeSLRoX2PWggdlmWxSzWlh9dq98hCRnjc May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 496224b299024b6d80653bc12f672f8c May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesOneServerTestJSON-1954921495 May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/496224b299024b6d80653bc12f672f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/496224b299024b6d80653bc12f672f8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_496224b299024b6d80653bc12f672f8c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/496224b299024b6d80653bc12f672f8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesOneServerTestJSON-1954921495 May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 496224b299024b6d80653bc12f672f8c May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1954921495 May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesOneServerTestJSON-1954921495-project May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 8b6c47e9586f4a70b86651a35f9bcbbb May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesOneServerTestJSON-1954921495-project May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac could not be found. May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac'} May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac could not be found. May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac could not be found. May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:08.508181 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:08.512569 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:08.512569 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:08.512569 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:08.512569 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:21:08.512569 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:21:08.512569 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac could not be found. May 21 21:21:08.512569 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:08.514788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-da57da73-f16e-457b-b4ef-bb6c14c251aa tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] Returning 404 to user: Instance a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:21:08.521171 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-da57da73-f16e-457b-b4ef-bb6c14c251aa tempest-ImagesOneServerTestJSON-1954921495 tempest-ImagesOneServerTestJSON-1954921495-project] 10.222.0.49 "GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac" status: 404 len: 111 microversion: 2.1 time: 0.072088 May 21 21:21:08.522395 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1363/2813] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:08 2022] GET /compute/v2.1/servers/a5ca3f73-e312-4ec1-9f27-4c2e21ed95ac => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:21:08.754209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-044f1cbd-0c62-451d-839e-23fe69a76107 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:08.754826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-044f1cbd-0c62-451d-839e-23fe69a76107 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:08.762441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-044f1cbd-0c62-451d-839e-23fe69a76107 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:08.763201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-044f1cbd-0c62-451d-839e-23fe69a76107 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:08.764237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-044f1cbd-0c62-451d-839e-23fe69a76107 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:08.765020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-044f1cbd-0c62-451d-839e-23fe69a76107 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:09.018097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-044f1cbd-0c62-451d-839e-23fe69a76107 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:09.018845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-78ee1e43-8919-4bb5-bf1e-9ea45091a464 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:09.019473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-78ee1e43-8919-4bb5-bf1e-9ea45091a464 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:09.027183 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-044f1cbd-0c62-451d-839e-23fe69a76107 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.276379 May 21 21:21:09.028027 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1451/2814] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:08 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:09.028137 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78ee1e43-8919-4bb5-bf1e-9ea45091a464 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:09.028581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78ee1e43-8919-4bb5-bf1e-9ea45091a464 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:09.029732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78ee1e43-8919-4bb5-bf1e-9ea45091a464 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:09.030174 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78ee1e43-8919-4bb5-bf1e-9ea45091a464 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:09.114596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-37c2b1ed-b073-4bc9-bf3d-5e8e8e404ec3 req-6dad4b2e-c8a7-4635-8d2c-3909f24def28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "tag": "5b797786-d747-4356-b9a8-cebf01987ee4"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:09.129172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-37c2b1ed-b073-4bc9-bf3d-5e8e8e404ec3 req-6dad4b2e-c8a7-4635-8d2c-3909f24def28 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:09.131003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-37c2b1ed-b073-4bc9-bf3d-5e8e8e404ec3 req-6dad4b2e-c8a7-4635-8d2c-3909f24def28 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:09.146314 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-37c2b1ed-b073-4bc9-bf3d-5e8e8e404ec3 req-6dad4b2e-c8a7-4635-8d2c-3909f24def28 service nova] Creating event network-changed:5b797786-d747-4356-b9a8-cebf01987ee4 for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:21:09.152535 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-37c2b1ed-b073-4bc9-bf3d-5e8e8e404ec3 req-6dad4b2e-c8a7-4635-8d2c-3909f24def28 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042029 May 21 21:21:09.153579 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1452/2815] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:21:09.427045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-78ee1e43-8919-4bb5-bf1e-9ea45091a464 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:09.440633 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-78ee1e43-8919-4bb5-bf1e-9ea45091a464 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1472 microversion: 2.1 time: 0.425153 May 21 21:21:09.452150 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1364/2816] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:09 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1472 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:09.482335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5b3c8db5-f57d-43df-a3b1-b4199ba26ba0 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:09.483052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5b3c8db5-f57d-43df-a3b1-b4199ba26ba0 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:09.504494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b3c8db5-f57d-43df-a3b1-b4199ba26ba0 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:09.504964 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b3c8db5-f57d-43df-a3b1-b4199ba26ba0 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:09.510147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b3c8db5-f57d-43df-a3b1-b4199ba26ba0 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:09.511111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b3c8db5-f57d-43df-a3b1-b4199ba26ba0 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:09.876160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5b3c8db5-f57d-43df-a3b1-b4199ba26ba0 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:09.885990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5b3c8db5-f57d-43df-a3b1-b4199ba26ba0 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:09.887552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5b3c8db5-f57d-43df-a3b1-b4199ba26ba0 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:09.888738 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5b3c8db5-f57d-43df-a3b1-b4199ba26ba0 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.411613 May 21 21:21:09.889393 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1453/2817] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:09 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:10.045383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e24a0abe-2e78-4087-84e9-49a21cf0c41b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:10.046303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e24a0abe-2e78-4087-84e9-49a21cf0c41b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:10.053967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e24a0abe-2e78-4087-84e9-49a21cf0c41b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:10.054419 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e24a0abe-2e78-4087-84e9-49a21cf0c41b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:10.055282 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e24a0abe-2e78-4087-84e9-49a21cf0c41b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:10.055702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e24a0abe-2e78-4087-84e9-49a21cf0c41b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:10.382467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e24a0abe-2e78-4087-84e9-49a21cf0c41b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:10.391607 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e24a0abe-2e78-4087-84e9-49a21cf0c41b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.350135 May 21 21:21:10.392907 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1365/2818] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:10 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:10.458707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3dd8460e-25e4-4ba9-9cd9-db896ce3efed tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:10.459428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3dd8460e-25e4-4ba9-9cd9-db896ce3efed tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:10.466918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3dd8460e-25e4-4ba9-9cd9-db896ce3efed tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:10.467370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3dd8460e-25e4-4ba9-9cd9-db896ce3efed tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:10.468323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3dd8460e-25e4-4ba9-9cd9-db896ce3efed tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:10.468704 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3dd8460e-25e4-4ba9-9cd9-db896ce3efed tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:10.654922 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3dd8460e-25e4-4ba9-9cd9-db896ce3efed tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:10.670285 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3dd8460e-25e4-4ba9-9cd9-db896ce3efed tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1472 microversion: 2.1 time: 0.215687 May 21 21:21:10.671445 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1454/2819] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:10 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1472 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:10.912194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b85d7219-76f2-41e6-8787-76b22edcff86 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:10.912877 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b85d7219-76f2-41e6-8787-76b22edcff86 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:10.920793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b85d7219-76f2-41e6-8787-76b22edcff86 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:10.921244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b85d7219-76f2-41e6-8787-76b22edcff86 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:10.922499 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b85d7219-76f2-41e6-8787-76b22edcff86 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:10.923089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b85d7219-76f2-41e6-8787-76b22edcff86 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:11.406612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-2d6101da-c6a1-4d17-8de2-8e3e2d18e4fe req-f5e7b2f2-68ac-4881-9ede-03e20b39ef9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "tag": "412a55b1-ca87-468e-871f-1a2e9ad7520f"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:11.418479 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2d6101da-c6a1-4d17-8de2-8e3e2d18e4fe req-f5e7b2f2-68ac-4881-9ede-03e20b39ef9d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:11.430505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2d6101da-c6a1-4d17-8de2-8e3e2d18e4fe req-f5e7b2f2-68ac-4881-9ede-03e20b39ef9d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:11.433423 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-2d6101da-c6a1-4d17-8de2-8e3e2d18e4fe req-f5e7b2f2-68ac-4881-9ede-03e20b39ef9d service nova] Creating event network-changed:412a55b1-ca87-468e-871f-1a2e9ad7520f for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:21:11.438646 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-2d6101da-c6a1-4d17-8de2-8e3e2d18e4fe req-f5e7b2f2-68ac-4881-9ede-03e20b39ef9d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035843 May 21 21:21:11.439964 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1455/2820] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:21:11.446310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0abb48e7-c6bd-4654-9820-b831e4ed63bf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:11.447336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0abb48e7-c6bd-4654-9820-b831e4ed63bf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:11.454103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0abb48e7-c6bd-4654-9820-b831e4ed63bf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:11.454871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0abb48e7-c6bd-4654-9820-b831e4ed63bf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:11.455849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0abb48e7-c6bd-4654-9820-b831e4ed63bf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:11.456531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0abb48e7-c6bd-4654-9820-b831e4ed63bf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:11.725523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b85d7219-76f2-41e6-8787-76b22edcff86 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:11.735972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0abb48e7-c6bd-4654-9820-b831e4ed63bf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:11.737021 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b85d7219-76f2-41e6-8787-76b22edcff86 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:11.738633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b85d7219-76f2-41e6-8787-76b22edcff86 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:11.741261 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b85d7219-76f2-41e6-8787-76b22edcff86 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.834078 May 21 21:21:11.741261 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1366/2821] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:10 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:11.748964 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0abb48e7-c6bd-4654-9820-b831e4ed63bf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.306196 May 21 21:21:11.750052 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1456/2822] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:11 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:11.762406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ec3ee474-d501-4335-aa58-21b2a676583d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:11.763038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ec3ee474-d501-4335-aa58-21b2a676583d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:11.781009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ec3ee474-d501-4335-aa58-21b2a676583d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:11.781472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ec3ee474-d501-4335-aa58-21b2a676583d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:11.782750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ec3ee474-d501-4335-aa58-21b2a676583d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:11.783352 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ec3ee474-d501-4335-aa58-21b2a676583d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:12.002295 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ec3ee474-d501-4335-aa58-21b2a676583d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:12.013297 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ec3ee474-d501-4335-aa58-21b2a676583d tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1490 microversion: 2.1 time: 0.271515 May 21 21:21:12.015003 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1367/2823] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:11 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1490 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:12.768572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-41f2ece0-4802-4e66-84fd-6df562816e10 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:12.769211 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-41f2ece0-4802-4e66-84fd-6df562816e10 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:12.770272 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-19bb76f8-e043-4957-9310-9c05adb32edf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:12.772419 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-19bb76f8-e043-4957-9310-9c05adb32edf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:12.779459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41f2ece0-4802-4e66-84fd-6df562816e10 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:12.779922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41f2ece0-4802-4e66-84fd-6df562816e10 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:12.780749 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41f2ece0-4802-4e66-84fd-6df562816e10 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:12.781194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41f2ece0-4802-4e66-84fd-6df562816e10 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:12.781516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19bb76f8-e043-4957-9310-9c05adb32edf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:12.782632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19bb76f8-e043-4957-9310-9c05adb32edf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:12.783674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19bb76f8-e043-4957-9310-9c05adb32edf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:12.784695 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19bb76f8-e043-4957-9310-9c05adb32edf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:12.806163 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:12.988403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-19bb76f8-e043-4957-9310-9c05adb32edf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:12.992902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:12.999147 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-19bb76f8-e043-4957-9310-9c05adb32edf tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.235768 May 21 21:21:13.004678 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1457/2824] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:12 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:13.032196 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ab016e76-8ea2-4770-b0b4-1a2536d41955 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:13.033095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ab016e76-8ea2-4770-b0b4-1a2536d41955 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:13.040590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab016e76-8ea2-4770-b0b4-1a2536d41955 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:13.041277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab016e76-8ea2-4770-b0b4-1a2536d41955 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:13.042360 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab016e76-8ea2-4770-b0b4-1a2536d41955 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:13.042974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab016e76-8ea2-4770-b0b4-1a2536d41955 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:13.138045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-41f2ece0-4802-4e66-84fd-6df562816e10 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:13.147782 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-41f2ece0-4802-4e66-84fd-6df562816e10 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:13.151209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-41f2ece0-4802-4e66-84fd-6df562816e10 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:13.153114 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-41f2ece0-4802-4e66-84fd-6df562816e10 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.388401 May 21 21:21:13.153944 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1368/2825] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:12 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:21:13.405378 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ab016e76-8ea2-4770-b0b4-1a2536d41955 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:13.423152 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ab016e76-8ea2-4770-b0b4-1a2536d41955 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1478 microversion: 2.1 time: 0.394594 May 21 21:21:13.424070 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1458/2826] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:13 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1478 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:14.021315 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c0a7fba3-857c-4342-83ba-aa854ab2fd5b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:14.021948 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c0a7fba3-857c-4342-83ba-aa854ab2fd5b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:14.044619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c0a7fba3-857c-4342-83ba-aa854ab2fd5b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:14.045362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c0a7fba3-857c-4342-83ba-aa854ab2fd5b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:14.047093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c0a7fba3-857c-4342-83ba-aa854ab2fd5b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:14.048048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c0a7fba3-857c-4342-83ba-aa854ab2fd5b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:14.174892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e897d71a-7d9b-4921-9288-955c449a8ce7 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:14.176081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e897d71a-7d9b-4921-9288-955c449a8ce7 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:14.186087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e897d71a-7d9b-4921-9288-955c449a8ce7 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:14.189817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e897d71a-7d9b-4921-9288-955c449a8ce7 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:14.190846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e897d71a-7d9b-4921-9288-955c449a8ce7 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:14.191724 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e897d71a-7d9b-4921-9288-955c449a8ce7 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:14.324005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c0a7fba3-857c-4342-83ba-aa854ab2fd5b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:14.335480 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c0a7fba3-857c-4342-83ba-aa854ab2fd5b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.320066 May 21 21:21:14.355102 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1369/2827] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:14 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:14.430364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c50d33b6-1d74-4fac-9f24-a91b534f832d tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] Calling method '.version_select at 0x7fc81b70db80>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:14.498816 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c50d33b6-1d74-4fac-9f24-a91b534f832d tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3b7d520e-3696-4938-889b-84c0b5218515" status: 200 len: 342 microversion: 2.1 time: 0.070597 May 21 21:21:14.499997 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1370/2828] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:21:14 2022] GET /compute/v2.1/os-volumes/3b7d520e-3696-4938-889b-84c0b5218515 => generated 342 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:21:14.520741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ad13e4c9-9507-44a8-a1a7-a2d3bed3ea3f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:14.520741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ad13e4c9-9507-44a8-a1a7-a2d3bed3ea3f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:14.535197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ad13e4c9-9507-44a8-a1a7-a2d3bed3ea3f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:14.536848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ad13e4c9-9507-44a8-a1a7-a2d3bed3ea3f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:14.536848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ad13e4c9-9507-44a8-a1a7-a2d3bed3ea3f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:14.537095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ad13e4c9-9507-44a8-a1a7-a2d3bed3ea3f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:14.789570 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ad13e4c9-9507-44a8-a1a7-a2d3bed3ea3f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:14.801482 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ad13e4c9-9507-44a8-a1a7-a2d3bed3ea3f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1478 microversion: 2.1 time: 0.297085 May 21 21:21:14.802808 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1371/2829] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:14 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1478 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:15.011187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e897d71a-7d9b-4921-9288-955c449a8ce7 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:15.027699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e897d71a-7d9b-4921-9288-955c449a8ce7 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:15.029328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e897d71a-7d9b-4921-9288-955c449a8ce7 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:15.033694 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e897d71a-7d9b-4921-9288-955c449a8ce7 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.863571 May 21 21:21:15.034388 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1459/2830] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:14 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:15.363488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-648ec5ff-601a-48cc-9372-46704f652353 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:15.364857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-648ec5ff-601a-48cc-9372-46704f652353 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:15.373570 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-648ec5ff-601a-48cc-9372-46704f652353 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:15.374332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-648ec5ff-601a-48cc-9372-46704f652353 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:15.375341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-648ec5ff-601a-48cc-9372-46704f652353 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:15.375963 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-648ec5ff-601a-48cc-9372-46704f652353 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:15.801912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-648ec5ff-601a-48cc-9372-46704f652353 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:15.810692 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-648ec5ff-601a-48cc-9372-46704f652353 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.452274 May 21 21:21:15.821838 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1372/2831] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:15 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:15.822269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-50245688-fd7f-4dc0-8971-7f30b746c478 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:15.822269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-50245688-fd7f-4dc0-8971-7f30b746c478 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:15.848036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50245688-fd7f-4dc0-8971-7f30b746c478 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:15.848533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50245688-fd7f-4dc0-8971-7f30b746c478 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:15.849370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50245688-fd7f-4dc0-8971-7f30b746c478 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:15.849822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50245688-fd7f-4dc0-8971-7f30b746c478 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:16.054460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7059c488-c166-4172-a6d8-3d47472ba575 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:16.055461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7059c488-c166-4172-a6d8-3d47472ba575 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:16.067435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7059c488-c166-4172-a6d8-3d47472ba575 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:16.068844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7059c488-c166-4172-a6d8-3d47472ba575 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:16.070975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7059c488-c166-4172-a6d8-3d47472ba575 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:16.071517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7059c488-c166-4172-a6d8-3d47472ba575 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:16.074116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-50245688-fd7f-4dc0-8971-7f30b746c478 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:16.087522 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-50245688-fd7f-4dc0-8971-7f30b746c478 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1463 microversion: 2.1 time: 0.272276 May 21 21:21:16.088727 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1460/2832] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:15 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1463 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:16.113567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-88de172e-d23f-46ed-b43c-82f22ea4d42c tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:16.114660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-88de172e-d23f-46ed-b43c-82f22ea4d42c tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:16.122890 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88de172e-d23f-46ed-b43c-82f22ea4d42c tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:16.123571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88de172e-d23f-46ed-b43c-82f22ea4d42c tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:16.124700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88de172e-d23f-46ed-b43c-82f22ea4d42c tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:16.125303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88de172e-d23f-46ed-b43c-82f22ea4d42c tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:16.354703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7059c488-c166-4172-a6d8-3d47472ba575 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:16.364107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7059c488-c166-4172-a6d8-3d47472ba575 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:16.365680 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7059c488-c166-4172-a6d8-3d47472ba575 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:16.366916 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7059c488-c166-4172-a6d8-3d47472ba575 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.316633 May 21 21:21:16.367899 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1373/2833] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:16 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:16.470740 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-88de172e-d23f-46ed-b43c-82f22ea4d42c tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810/action" status: 202 len: 0 microversion: 2.1 time: 0.361149 May 21 21:21:16.474191 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1461/2834] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:21:16 2022] POST /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:21:16.484622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8e1d1f8a-eb3e-45c1-a54f-debf92eb83b4 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:16.485380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8e1d1f8a-eb3e-45c1-a54f-debf92eb83b4 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:16.492515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e1d1f8a-eb3e-45c1-a54f-debf92eb83b4 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:16.493218 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e1d1f8a-eb3e-45c1-a54f-debf92eb83b4 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:16.494040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e1d1f8a-eb3e-45c1-a54f-debf92eb83b4 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:16.494484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e1d1f8a-eb3e-45c1-a54f-debf92eb83b4 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:16.538866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e1d1f8a-eb3e-45c1-a54f-debf92eb83b4 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:16.540683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e1d1f8a-eb3e-45c1-a54f-debf92eb83b4 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:16.541182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-8e1d1f8a-eb3e-45c1-a54f-debf92eb83b4 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lazy-loading 'fault' on Instance uuid 6825da6e-8b02-486c-8461-41f10572c810 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:21:16.704212 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8e1d1f8a-eb3e-45c1-a54f-debf92eb83b4 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1597 microversion: 2.1 time: 0.223256 May 21 21:21:16.705262 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1374/2835] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:16 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1597 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:16.723673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f6fe2ac5-5278-4bf2-bba0-10de1461da85 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:16.725821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f6fe2ac5-5278-4bf2-bba0-10de1461da85 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:16.731364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:16.733108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6fe2ac5-5278-4bf2-bba0-10de1461da85 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:16.733722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6fe2ac5-5278-4bf2-bba0-10de1461da85 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:16.734712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6fe2ac5-5278-4bf2-bba0-10de1461da85 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:16.735261 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6fe2ac5-5278-4bf2-bba0-10de1461da85 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:16.796569 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-96ad78d6-5698-456f-bb0e-382515e0103d req-d990b6e6-346a-450f-823b-a1c5a27bf547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6825da6e-8b02-486c-8461-41f10572c810", "name": "network-vif-plugged", "status": "completed", "tag": "976547b8-31f4-469e-8c56-e9286444cdde"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:16.806149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-96ad78d6-5698-456f-bb0e-382515e0103d req-d990b6e6-346a-450f-823b-a1c5a27bf547 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:16.806810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-96ad78d6-5698-456f-bb0e-382515e0103d req-d990b6e6-346a-450f-823b-a1c5a27bf547 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:16.819427 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-96ad78d6-5698-456f-bb0e-382515e0103d req-d990b6e6-346a-450f-823b-a1c5a27bf547 service nova] Creating event network-vif-plugged:976547b8-31f4-469e-8c56-e9286444cdde for instance 6825da6e-8b02-486c-8461-41f10572c810 on nch1-master-1 May 21 21:21:16.828633 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-96ad78d6-5698-456f-bb0e-382515e0103d req-d990b6e6-346a-450f-823b-a1c5a27bf547 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036566 May 21 21:21:16.829415 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1375/2836] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:21:16.836099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-044e43d4-6fec-4280-b90e-e3f4ca5b5102 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:16.837144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-044e43d4-6fec-4280-b90e-e3f4ca5b5102 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:16.843814 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-044e43d4-6fec-4280-b90e-e3f4ca5b5102 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:16.844594 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-044e43d4-6fec-4280-b90e-e3f4ca5b5102 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:16.845556 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-044e43d4-6fec-4280-b90e-e3f4ca5b5102 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:16.846330 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-044e43d4-6fec-4280-b90e-e3f4ca5b5102 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:17.043022 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-044e43d4-6fec-4280-b90e-e3f4ca5b5102 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:17.051998 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-044e43d4-6fec-4280-b90e-e3f4ca5b5102 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.221187 May 21 21:21:17.052765 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1376/2837] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:16 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:17.099182 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f6fe2ac5-5278-4bf2-bba0-10de1461da85 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810/action" status: 202 len: 0 microversion: 2.1 time: 0.381817 May 21 21:21:17.101865 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1462/2838] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:21:16 2022] POST /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 21 21:21:17.108917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-acaf8ac3-f508-4957-8cdc-e3b10eacd974 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:17.110279 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-acaf8ac3-f508-4957-8cdc-e3b10eacd974 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:17.116793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-acaf8ac3-f508-4957-8cdc-e3b10eacd974 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:17.117902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-acaf8ac3-f508-4957-8cdc-e3b10eacd974 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:17.119141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-acaf8ac3-f508-4957-8cdc-e3b10eacd974 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:17.119887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-acaf8ac3-f508-4957-8cdc-e3b10eacd974 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:17.277726 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-acaf8ac3-f508-4957-8cdc-e3b10eacd974 tempest-ServersAdminTestJSON-1251748184 tempest-ServersAdminTestJSON-1251748184-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1614 microversion: 2.1 time: 0.172860 May 21 21:21:17.278407 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1377/2839] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:17 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1614 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:17.295644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8b5cfbdd-f021-4d52-a58c-de6ed4ed60e8 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:17.296074 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8b5cfbdd-f021-4d52-a58c-de6ed4ed60e8 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:17.302478 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b5cfbdd-f021-4d52-a58c-de6ed4ed60e8 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:17.302936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b5cfbdd-f021-4d52-a58c-de6ed4ed60e8 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:17.306754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b5cfbdd-f021-4d52-a58c-de6ed4ed60e8 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:17.306754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b5cfbdd-f021-4d52-a58c-de6ed4ed60e8 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:17.329918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8b5cfbdd-f021-4d52-a58c-de6ed4ed60e8 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:21:17.388693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ad0e65fc-047b-4a3d-acc6-7b9931c34844 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:17.389581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ad0e65fc-047b-4a3d-acc6-7b9931c34844 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:17.396817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ad0e65fc-047b-4a3d-acc6-7b9931c34844 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:17.397415 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ad0e65fc-047b-4a3d-acc6-7b9931c34844 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:17.398701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ad0e65fc-047b-4a3d-acc6-7b9931c34844 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:17.399490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ad0e65fc-047b-4a3d-acc6-7b9931c34844 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:17.694618 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8b5cfbdd-f021-4d52-a58c-de6ed4ed60e8 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80" status: 204 len: 0 microversion: 2.1 time: 0.401878 May 21 21:21:17.699280 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1463/2840] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:21:17 2022] DELETE /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:21:17.705548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a7f4e4d8-2e83-44c0-86a6-8e45593a6765 tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] Calling method '.version_select at 0x7fc829d4e5e0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:17.753260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ad0e65fc-047b-4a3d-acc6-7b9931c34844 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:17.764877 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ad0e65fc-047b-4a3d-acc6-7b9931c34844 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:17.766692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ad0e65fc-047b-4a3d-acc6-7b9931c34844 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:17.768119 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ad0e65fc-047b-4a3d-acc6-7b9931c34844 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.383691 May 21 21:21:17.768811 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1378/2841] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:17 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:17.774374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d734570a-53d2-4a1d-a714-d0de6064209f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:17.775252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d734570a-53d2-4a1d-a714-d0de6064209f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:17.777705 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a7f4e4d8-2e83-44c0-86a6-8e45593a6765 tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/e9c58c21-81f7-4ba4-ad1a-047c07c77a3b" status: 200 len: 344 microversion: 2.1 time: 0.076644 May 21 21:21:17.778614 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1464/2842] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:21:17 2022] GET /compute/v2.1/os-volumes/e9c58c21-81f7-4ba4-ad1a-047c07c77a3b => generated 344 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:17.782556 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d734570a-53d2-4a1d-a714-d0de6064209f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:17.783120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d734570a-53d2-4a1d-a714-d0de6064209f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:17.784021 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d734570a-53d2-4a1d-a714-d0de6064209f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:17.784574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d734570a-53d2-4a1d-a714-d0de6064209f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:17.971866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d734570a-53d2-4a1d-a714-d0de6064209f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:17.980682 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d734570a-53d2-4a1d-a714-d0de6064209f tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80" status: 200 len: 1470 microversion: 2.1 time: 0.210442 May 21 21:21:17.991344 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1379/2843] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:17 2022] GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80 => generated 1470 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:18.074747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7c1657ef-2d34-4afd-976a-5da6be3a41d3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:18.076262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7c1657ef-2d34-4afd-976a-5da6be3a41d3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:18.087294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c1657ef-2d34-4afd-976a-5da6be3a41d3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:18.088303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c1657ef-2d34-4afd-976a-5da6be3a41d3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:18.100952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c1657ef-2d34-4afd-976a-5da6be3a41d3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:18.100952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c1657ef-2d34-4afd-976a-5da6be3a41d3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:18.313374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7c1657ef-2d34-4afd-976a-5da6be3a41d3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:18.316214 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7c1657ef-2d34-4afd-976a-5da6be3a41d3 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.249640 May 21 21:21:18.316808 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1465/2844] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:18 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:18.793991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cb519e8a-bf65-412a-ad9a-13256cf02590 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:18.795281 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cb519e8a-bf65-412a-ad9a-13256cf02590 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:18.803909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb519e8a-bf65-412a-ad9a-13256cf02590 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:18.807065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb519e8a-bf65-412a-ad9a-13256cf02590 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:18.808141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb519e8a-bf65-412a-ad9a-13256cf02590 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:18.808774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb519e8a-bf65-412a-ad9a-13256cf02590 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:18.999813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e9051187-1acf-496d-acdb-803a37494cce tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:19.000626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e9051187-1acf-496d-acdb-803a37494cce tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:19.014754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9051187-1acf-496d-acdb-803a37494cce tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:19.018595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9051187-1acf-496d-acdb-803a37494cce tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:19.018595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9051187-1acf-496d-acdb-803a37494cce tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:19.018595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9051187-1acf-496d-acdb-803a37494cce tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:19.090720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cb519e8a-bf65-412a-ad9a-13256cf02590 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:19.107414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cb519e8a-bf65-412a-ad9a-13256cf02590 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:19.114571 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cb519e8a-bf65-412a-ad9a-13256cf02590 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:19.116024 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cb519e8a-bf65-412a-ad9a-13256cf02590 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.331451 May 21 21:21:19.117021 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1380/2845] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:18 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:19.276564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e9e22cfe-c14d-444d-ae1d-67b05ed4b15b tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Action: 'create', calling method: .version_select at 0x7fc81b654280>, body: {"keypair": {"name": "tempest-keypair-1694979399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvI5/qdxut5U3EtkFNlSug8+sbcX04YLrqxfCZ0heepgjsDCrz2kcY6QvSuzHLcvVU5Oy+KLQNnWwc/dgjDam5SUm+Rb5qtQ341m8xVRRu6pAaEX+zGa1e5DPXRZ4/UPw=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:19.291385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-e9e22cfe-c14d-444d-ae1d-67b05ed4b15b tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Getting quotas for project 6e4473aa2ed54e1fafaf2f8b339bb065. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:21:19.296752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-e9e22cfe-c14d-444d-ae1d-67b05ed4b15b tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Getting quotas for user 9c12cdb0dccf44b989a23724b1d87870 and project 6e4473aa2ed54e1fafaf2f8b339bb065. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:21:19.351892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e9051187-1acf-496d-acdb-803a37494cce tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:19.360216 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e9051187-1acf-496d-acdb-803a37494cce tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80" status: 200 len: 1470 microversion: 2.1 time: 0.365148 May 21 21:21:19.360905 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1466/2846] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:18 2022] GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80 => generated 1470 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:19.365897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2da06e17-2542-48cf-8445-665dd04fce72 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:19.366684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2da06e17-2542-48cf-8445-665dd04fce72 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:19.373276 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2da06e17-2542-48cf-8445-665dd04fce72 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:19.376767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2da06e17-2542-48cf-8445-665dd04fce72 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:19.377854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2da06e17-2542-48cf-8445-665dd04fce72 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:19.378442 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2da06e17-2542-48cf-8445-665dd04fce72 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:19.420645 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e9e22cfe-c14d-444d-ae1d-67b05ed4b15b tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.274886 May 21 21:21:19.421637 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1381/2847] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:21:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:21:19.622613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2da06e17-2542-48cf-8445-665dd04fce72 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:19.634835 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2da06e17-2542-48cf-8445-665dd04fce72 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.271959 May 21 21:21:19.650380 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1467/2848] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:19 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:19.998336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-b7c80035-56fd-40b0-8be3-ea4591889e38 req-f8465617-7a80-41df-ad96-1ea5dd447a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5868fd53-6447-43b2-bb05-f443e7b3cb80", "name": "network-vif-deleted", "tag": "da3ae4a4-627c-435b-b807-255ce68f8428"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:20.010881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b7c80035-56fd-40b0-8be3-ea4591889e38 req-f8465617-7a80-41df-ad96-1ea5dd447a39 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:20.011380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b7c80035-56fd-40b0-8be3-ea4591889e38 req-f8465617-7a80-41df-ad96-1ea5dd447a39 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:20.030309 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-b7c80035-56fd-40b0-8be3-ea4591889e38 req-f8465617-7a80-41df-ad96-1ea5dd447a39 service nova] Creating event network-vif-deleted:da3ae4a4-627c-435b-b807-255ce68f8428 for instance 5868fd53-6447-43b2-bb05-f443e7b3cb80 on nch1-master-1 May 21 21:21:20.036410 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-b7c80035-56fd-40b0-8be3-ea4591889e38 req-f8465617-7a80-41df-ad96-1ea5dd447a39 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044364 May 21 21:21:20.048714 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1382/2849] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:20.135154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-46ccdfda-a0d9-4174-adab-ee2718a8d2c3 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:20.135894 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-46ccdfda-a0d9-4174-adab-ee2718a8d2c3 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:20.143479 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46ccdfda-a0d9-4174-adab-ee2718a8d2c3 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:20.144152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46ccdfda-a0d9-4174-adab-ee2718a8d2c3 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:20.145148 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46ccdfda-a0d9-4174-adab-ee2718a8d2c3 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:20.145755 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46ccdfda-a0d9-4174-adab-ee2718a8d2c3 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:20.378608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-19ad6ff4-50ee-4d18-b276-e892561baf32 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:20.379514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-19ad6ff4-50ee-4d18-b276-e892561baf32 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:20.387224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19ad6ff4-50ee-4d18-b276-e892561baf32 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:20.387683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19ad6ff4-50ee-4d18-b276-e892561baf32 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:20.388774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19ad6ff4-50ee-4d18-b276-e892561baf32 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:20.389510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19ad6ff4-50ee-4d18-b276-e892561baf32 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:20.421180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-46ccdfda-a0d9-4174-adab-ee2718a8d2c3 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:20.434555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-46ccdfda-a0d9-4174-adab-ee2718a8d2c3 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:20.435276 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19ad6ff4-50ee-4d18-b276-e892561baf32 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:20.435737 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19ad6ff4-50ee-4d18-b276-e892561baf32 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:20.436199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-19ad6ff4-50ee-4d18-b276-e892561baf32 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lazy-loading 'fault' on Instance uuid 5868fd53-6447-43b2-bb05-f443e7b3cb80 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:21:20.436964 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-46ccdfda-a0d9-4174-adab-ee2718a8d2c3 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:20.438411 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-46ccdfda-a0d9-4174-adab-ee2718a8d2c3 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.307380 May 21 21:21:20.450307 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1468/2850] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:20 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:20.494681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-19ad6ff4-50ee-4d18-b276-e892561baf32 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:20.502741 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-19ad6ff4-50ee-4d18-b276-e892561baf32 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80" status: 200 len: 1304 microversion: 2.1 time: 0.129195 May 21 21:21:20.503446 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1383/2851] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:20 2022] GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80 => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:20.683418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ab7dc32d-c3bc-4ff1-8a39-19fb0f06729c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:20.685608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ab7dc32d-c3bc-4ff1-8a39-19fb0f06729c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:20.704633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab7dc32d-c3bc-4ff1-8a39-19fb0f06729c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:20.705244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab7dc32d-c3bc-4ff1-8a39-19fb0f06729c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:20.706777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab7dc32d-c3bc-4ff1-8a39-19fb0f06729c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:20.707637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab7dc32d-c3bc-4ff1-8a39-19fb0f06729c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:20.800576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1d19d4e4-fe3c-46b3-9391-bb8451dbb048 tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] Calling method '.version_select at 0x7fc81b6fc550>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:20.874433 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1d19d4e4-fe3c-46b3-9391-bb8451dbb048 tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/59322661-c94f-4319-9ddc-f03dd1d6b786" status: 200 len: 342 microversion: 2.1 time: 0.094432 May 21 21:21:20.875489 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1384/2852] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:21:20 2022] GET /compute/v2.1/os-volumes/59322661-c94f-4319-9ddc-f03dd1d6b786 => generated 342 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:21:20.896870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-76e21bc3-4437-4530-a156-91259100adfd tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] Calling method '.version_select at 0x7fc81b4d33a0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:20.919479 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ab7dc32d-c3bc-4ff1-8a39-19fb0f06729c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:20.923747 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ab7dc32d-c3bc-4ff1-8a39-19fb0f06729c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.249239 May 21 21:21:20.934563 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1469/2853] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:20 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:21.014924 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-76e21bc3-4437-4530-a156-91259100adfd tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1011 microversion: 2.1 time: 0.124387 May 21 21:21:21.020334 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1385/2854] 10.222.0.49 () {58 vars in 1133 bytes} [Sat May 21 21:21:20 2022] GET /compute/v2.1/os-volumes => generated 1011 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:21.031225 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c5310356-c84e-44f7-bccf-a4c211b3dd14 tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] Calling method '.version_select at 0x7fc81ac17ca0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:21.137257 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c5310356-c84e-44f7-bccf-a4c211b3dd14 tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 679 microversion: 2.1 time: 0.110968 May 21 21:21:21.146987 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1470/2855] 10.222.0.49 () {58 vars in 1148 bytes} [Sat May 21 21:21:21 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 679 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:21:21.153592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-469e16ed-6471-4c15-8379-3b2aba20670d tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] Calling method '.version_select at 0x7fc81b808a60>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:21.252394 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-469e16ed-6471-4c15-8379-3b2aba20670d tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1011 microversion: 2.1 time: 0.104098 May 21 21:21:21.253194 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1386/2856] 10.222.0.49 () {58 vars in 1133 bytes} [Sat May 21 21:21:21 2022] GET /compute/v2.1/os-volumes => generated 1011 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:21.267114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a152fbfb-adc8-487e-955d-0ab0930deab2 tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] Calling method '.version_select at 0x7fc81b3ca310>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:21.388613 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a152fbfb-adc8-487e-955d-0ab0930deab2 tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.126333 May 21 21:21:21.397711 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1471/2857] 10.222.0.49 () {58 vars in 1166 bytes} [Sat May 21 21:21:21 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 347 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:21:21.402347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0ecdfb4e-a318-4234-8d6c-af6f2e422926 tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] Calling method '.version_select at 0x7fc81b654550>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:21.458166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-07499b82-113c-4f6b-a91e-e3eecf6bd27b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:21.461239 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-07499b82-113c-4f6b-a91e-e3eecf6bd27b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:21.468178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07499b82-113c-4f6b-a91e-e3eecf6bd27b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:21.468749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07499b82-113c-4f6b-a91e-e3eecf6bd27b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:21.469777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07499b82-113c-4f6b-a91e-e3eecf6bd27b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:21.470306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07499b82-113c-4f6b-a91e-e3eecf6bd27b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:21.494148 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0ecdfb4e-a318-4234-8d6c-af6f2e422926 tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 679 microversion: 2.1 time: 0.095737 May 21 21:21:21.494957 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1387/2858] 10.222.0.49 () {58 vars in 1169 bytes} [Sat May 21 21:21:21 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 679 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:21:21.507377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eec1ead0-5ebf-44fa-b9af-850725967e36 tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] Calling method '.version_select at 0x7fc81b493310>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:21.639064 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-eec1ead0-5ebf-44fa-b9af-850725967e36 tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1011 microversion: 2.1 time: 0.132628 May 21 21:21:21.639064 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1388/2859] 10.222.0.49 () {58 vars in 1154 bytes} [Sat May 21 21:21:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1011 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:21.658571 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0ad44f32-cdb2-4517-b30d-ddccbe2b5fcd tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:21.660904 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0ad44f32-cdb2-4517-b30d-ddccbe2b5fcd tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 5868fd53-6447-43b2-bb05-f443e7b3cb80] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:21.672532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ad44f32-cdb2-4517-b30d-ddccbe2b5fcd tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:21.673601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ad44f32-cdb2-4517-b30d-ddccbe2b5fcd tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:21.674452 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ad44f32-cdb2-4517-b30d-ddccbe2b5fcd tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:21.674945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ad44f32-cdb2-4517-b30d-ddccbe2b5fcd tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:21.693425 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-0ad44f32-cdb2-4517-b30d-ddccbe2b5fcd tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] HTTP exception thrown: Instance 5868fd53-6447-43b2-bb05-f443e7b3cb80 could not be found. May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0ad44f32-cdb2-4517-b30d-ddccbe2b5fcd tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Request method failure captured: May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80 HTTP/1.1 May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVdRfOJ-puh8NIinm8LBPIR0iDZ8LAeWMNBTvbwI3cZ2HbwR9Kuc2I7ezu8n2WUxhNen34ro-gisY9t7mm2lfsBw5rHww9pGOb45ZgqDxspXWbTPTYvSJXumm7tHRcrhM4AG4DHUIH6LMBNKNIT4C0zCj3oTJtzCR8tPdcUHGPUF3EE May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 0c0ac2ac25374777ba3c25d31ea96dc5 May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersAdminTestJSON-1240622121 May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0c0ac2ac25374777ba3c25d31ea96dc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0c0ac2ac25374777ba3c25d31ea96dc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0c0ac2ac25374777ba3c25d31ea96dc5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0c0ac2ac25374777ba3c25d31ea96dc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersAdminTestJSON-1240622121 May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 0c0ac2ac25374777ba3c25d31ea96dc5 May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersAdminTestJSON-1240622121 May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersAdminTestJSON-1240622121-project May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: b54cc2165959478ba95981c81864118a May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersAdminTestJSON-1240622121-project May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 5868fd53-6447-43b2-bb05-f443e7b3cb80 could not be found. May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '5868fd53-6447-43b2-bb05-f443e7b3cb80'} May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5868fd53-6447-43b2-bb05-f443e7b3cb80 could not be found. May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5868fd53-6447-43b2-bb05-f443e7b3cb80 could not be found. May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:21.696384 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:21.701079 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:21.701079 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:21.701079 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:21.701079 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:21:21.701079 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:21:21.701079 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5868fd53-6447-43b2-bb05-f443e7b3cb80 could not be found. May 21 21:21:21.701079 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:21.701079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0ad44f32-cdb2-4517-b30d-ddccbe2b5fcd tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Returning 404 to user: Instance 5868fd53-6447-43b2-bb05-f443e7b3cb80 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:21:21.702304 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0ad44f32-cdb2-4517-b30d-ddccbe2b5fcd tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80" status: 404 len: 111 microversion: 2.1 time: 0.055736 May 21 21:21:21.703020 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1389/2860] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:21 2022] GET /compute/v2.1/servers/5868fd53-6447-43b2-bb05-f443e7b3cb80 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:21:21.711072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-52584c0f-4e78-45f2-88a5-041f130a2b0e tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] Calling method '.version_select at 0x7fc81b6fc550>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:21.760773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-07499b82-113c-4f6b-a91e-e3eecf6bd27b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:21.766521 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:21.772641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-07499b82-113c-4f6b-a91e-e3eecf6bd27b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:21.774496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-07499b82-113c-4f6b-a91e-e3eecf6bd27b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:21.775873 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-07499b82-113c-4f6b-a91e-e3eecf6bd27b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.321579 May 21 21:21:21.776569 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1472/2861] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:21 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:21:21.781006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-db4b4b5a-dcc3-4548-aa5b-d463f63ccaa3 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:21.781839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-db4b4b5a-dcc3-4548-aa5b-d463f63ccaa3 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:21.788087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db4b4b5a-dcc3-4548-aa5b-d463f63ccaa3 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:21.789338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db4b4b5a-dcc3-4548-aa5b-d463f63ccaa3 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:21.790185 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db4b4b5a-dcc3-4548-aa5b-d463f63ccaa3 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:21.790694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db4b4b5a-dcc3-4548-aa5b-d463f63ccaa3 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:21.817424 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-52584c0f-4e78-45f2-88a5-041f130a2b0e tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.112402 May 21 21:21:21.817826 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1390/2862] 10.222.0.49 () {58 vars in 1187 bytes} [Sat May 21 21:21:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 347 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:21.821764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-db4b4b5a-dcc3-4548-aa5b-d463f63ccaa3 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:21:21.829819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-99b87c35-ce07-4b97-b455-7bb9026d027d tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] Calling method '.version_select at 0x7fc82d13f5e0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:21.940670 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-99b87c35-ce07-4b97-b455-7bb9026d027d tempest-VolumesTestJSON-1575055885 tempest-VolumesTestJSON-1575055885-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1011 microversion: 2.1 time: 0.114602 May 21 21:21:21.941250 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1391/2863] 10.222.0.49 () {58 vars in 1154 bytes} [Sat May 21 21:21:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1011 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:21.949424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a5cfa7dc-0443-4ee8-acb8-8fd70ed5a33c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:21.950391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a5cfa7dc-0443-4ee8-acb8-8fd70ed5a33c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:21.963602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5cfa7dc-0443-4ee8-acb8-8fd70ed5a33c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:21.964756 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5cfa7dc-0443-4ee8-acb8-8fd70ed5a33c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:21.966022 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5cfa7dc-0443-4ee8-acb8-8fd70ed5a33c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:21.966624 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5cfa7dc-0443-4ee8-acb8-8fd70ed5a33c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:22.259949 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-db4b4b5a-dcc3-4548-aa5b-d463f63ccaa3 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea" status: 204 len: 0 microversion: 2.1 time: 0.480126 May 21 21:21:22.262167 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1473/2864] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:21:21 2022] DELETE /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:21:22.276989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a5cfa7dc-0443-4ee8-acb8-8fd70ed5a33c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:22.282977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e19562be-5aea-4aab-8296-17bce41bd30c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:22.284333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e19562be-5aea-4aab-8296-17bce41bd30c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:22.291857 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a5cfa7dc-0443-4ee8-acb8-8fd70ed5a33c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.348609 May 21 21:21:22.292493 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1392/2865] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:21 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:22.295916 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e19562be-5aea-4aab-8296-17bce41bd30c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:22.296694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e19562be-5aea-4aab-8296-17bce41bd30c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:22.298169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e19562be-5aea-4aab-8296-17bce41bd30c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:22.298893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e19562be-5aea-4aab-8296-17bce41bd30c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:22.477870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e19562be-5aea-4aab-8296-17bce41bd30c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:22.509171 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e19562be-5aea-4aab-8296-17bce41bd30c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea" status: 200 len: 1468 microversion: 2.1 time: 0.236633 May 21 21:21:22.510618 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1474/2866] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:22 2022] GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea => generated 1468 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:22.708386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8dea59e6-afb3-44fe-affc-e55ec5adecd6 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "f33cc76e-b98e-469c-b304-409b6dde26d8"}], "security_groups": [{"name": "tempest-securitygroup--872060331"}], "key_name": "tempest-keypair-1694979399", "user_data": "}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:22.795334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b3cd2979-3fe6-4ccb-8cce-737e564205a4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:22.796252 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b3cd2979-3fe6-4ccb-8cce-737e564205a4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:22.805969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b3cd2979-3fe6-4ccb-8cce-737e564205a4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:22.806432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b3cd2979-3fe6-4ccb-8cce-737e564205a4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:22.807289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b3cd2979-3fe6-4ccb-8cce-737e564205a4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:22.808233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b3cd2979-3fe6-4ccb-8cce-737e564205a4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:22.842621 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-8dea59e6-afb3-44fe-affc-e55ec5adecd6 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] validate_networks() for [('f33cc76e-b98e-469c-b304-409b6dde26d8', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:21:23.107304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b3cd2979-3fe6-4ccb-8cce-737e564205a4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:23.119135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b3cd2979-3fe6-4ccb-8cce-737e564205a4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:23.120742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b3cd2979-3fe6-4ccb-8cce-737e564205a4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:23.122229 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b3cd2979-3fe6-4ccb-8cce-737e564205a4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.331038 May 21 21:21:23.122793 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1475/2867] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:22 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:23.310512 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-36f2ad7a-736c-47cc-a131-09ed9b1db33b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:23.311687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-36f2ad7a-736c-47cc-a131-09ed9b1db33b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:23.320495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-36f2ad7a-736c-47cc-a131-09ed9b1db33b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:23.321152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-36f2ad7a-736c-47cc-a131-09ed9b1db33b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:23.322381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-36f2ad7a-736c-47cc-a131-09ed9b1db33b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:23.323165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-36f2ad7a-736c-47cc-a131-09ed9b1db33b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:23.408169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-8dea59e6-afb3-44fe-affc-e55ec5adecd6 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:21:23.408692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-8dea59e6-afb3-44fe-affc-e55ec5adecd6 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:21:23.409087 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-8dea59e6-afb3-44fe-affc-e55ec5adecd6 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:21:23.409507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-8dea59e6-afb3-44fe-affc-e55ec5adecd6 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:21:23.410029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-8dea59e6-afb3-44fe-affc-e55ec5adecd6 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:21:23.420960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8dea59e6-afb3-44fe-affc-e55ec5adecd6 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:23.421412 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8dea59e6-afb3-44fe-affc-e55ec5adecd6 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:23.429890 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8dea59e6-afb3-44fe-affc-e55ec5adecd6 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:23.429890 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8dea59e6-afb3-44fe-affc-e55ec5adecd6 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:23.445702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-8dea59e6-afb3-44fe-affc-e55ec5adecd6 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Getting quotas for project 6e4473aa2ed54e1fafaf2f8b339bb065. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:21:23.452030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-8dea59e6-afb3-44fe-affc-e55ec5adecd6 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Getting quotas for user 9c12cdb0dccf44b989a23724b1d87870 and project 6e4473aa2ed54e1fafaf2f8b339bb065. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:21:23.467921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8dea59e6-afb3-44fe-affc-e55ec5adecd6 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:21:23.470764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8dea59e6-afb3-44fe-affc-e55ec5adecd6 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:21:23.619334 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8dea59e6-afb3-44fe-affc-e55ec5adecd6 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.915487 May 21 21:21:23.620395 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1393/2868] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:21:22 2022] POST /compute/v2.1/servers => generated 408 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:21:23.625696 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4cec86a6-9b63-4b4b-b9c0-ced866dbe94a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:23.626637 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4cec86a6-9b63-4b4b-b9c0-ced866dbe94a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:23.634742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cec86a6-9b63-4b4b-b9c0-ced866dbe94a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:23.635496 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cec86a6-9b63-4b4b-b9c0-ced866dbe94a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:23.637243 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cec86a6-9b63-4b4b-b9c0-ced866dbe94a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:23.637870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cec86a6-9b63-4b4b-b9c0-ced866dbe94a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:23.979612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4cec86a6-9b63-4b4b-b9c0-ced866dbe94a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:24.013927 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4cec86a6-9b63-4b4b-b9c0-ced866dbe94a tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea" status: 200 len: 1468 microversion: 2.1 time: 0.392253 May 21 21:21:24.014775 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1394/2869] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:23 2022] GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea => generated 1468 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:24.026166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-56416a86-f2db-4a7c-8a0f-0eb0f03c5c45 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:24.029192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-56416a86-f2db-4a7c-8a0f-0eb0f03c5c45 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:24.106353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-36f2ad7a-736c-47cc-a131-09ed9b1db33b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:24.120919 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-36f2ad7a-736c-47cc-a131-09ed9b1db33b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.816027 May 21 21:21:24.131500 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1476/2870] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:23 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:24.143694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-286e8a47-ad7e-47d6-bc54-019ffcc76d95 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:24.144620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-286e8a47-ad7e-47d6-bc54-019ffcc76d95 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:24.152938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-286e8a47-ad7e-47d6-bc54-019ffcc76d95 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:24.153867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-286e8a47-ad7e-47d6-bc54-019ffcc76d95 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:24.154900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-286e8a47-ad7e-47d6-bc54-019ffcc76d95 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:24.155547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-286e8a47-ad7e-47d6-bc54-019ffcc76d95 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:24.162724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-56416a86-f2db-4a7c-8a0f-0eb0f03c5c45 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c12cdb0dccf44b989a23724b1d87870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4473aa2ed54e1fafaf2f8b339bb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:24.173599 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-56416a86-f2db-4a7c-8a0f-0eb0f03c5c45 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d" status: 200 len: 1226 microversion: 2.1 time: 0.156944 May 21 21:21:24.174222 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1395/2871] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:24 2022] GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d => generated 1226 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:24.562909 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-286e8a47-ad7e-47d6-bc54-019ffcc76d95 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:24.577637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-286e8a47-ad7e-47d6-bc54-019ffcc76d95 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:24.579472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-286e8a47-ad7e-47d6-bc54-019ffcc76d95 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:24.580996 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-286e8a47-ad7e-47d6-bc54-019ffcc76d95 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.441096 May 21 21:21:24.581758 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1477/2872] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:24 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:25.005947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-1a00f015-2d0d-4c05-a771-c33a30d0be66 req-45c436b0-1551-40d2-857d-b162753a90ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c83883e1-bf1c-43dd-a43a-3c82e4a3dbea", "name": "network-vif-deleted", "tag": "283ab589-fb64-424b-a0f0-273a885f9a8c"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:25.011104 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:25.023761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-1a00f015-2d0d-4c05-a771-c33a30d0be66 req-45c436b0-1551-40d2-857d-b162753a90ae service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:25.024441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-1a00f015-2d0d-4c05-a771-c33a30d0be66 req-45c436b0-1551-40d2-857d-b162753a90ae service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:25.033674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-667dbe4c-cfa7-4533-bbfc-d9428402cca0 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:25.036433 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-667dbe4c-cfa7-4533-bbfc-d9428402cca0 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:25.039961 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-1a00f015-2d0d-4c05-a771-c33a30d0be66 req-45c436b0-1551-40d2-857d-b162753a90ae service nova] Creating event network-vif-deleted:283ab589-fb64-424b-a0f0-273a885f9a8c for instance c83883e1-bf1c-43dd-a43a-3c82e4a3dbea on nch1-master-1 May 21 21:21:25.044039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-667dbe4c-cfa7-4533-bbfc-d9428402cca0 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:25.047006 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-1a00f015-2d0d-4c05-a771-c33a30d0be66 req-45c436b0-1551-40d2-857d-b162753a90ae service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044957 May 21 21:21:25.047552 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1396/2873] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:25.048012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-667dbe4c-cfa7-4533-bbfc-d9428402cca0 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:25.049094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-667dbe4c-cfa7-4533-bbfc-d9428402cca0 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:25.049701 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-667dbe4c-cfa7-4533-bbfc-d9428402cca0 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:25.135161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-667dbe4c-cfa7-4533-bbfc-d9428402cca0 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:25.139924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4a8d5df2-1f9f-40ea-9c99-d9c1f2aa61c8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:25.140661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4a8d5df2-1f9f-40ea-9c99-d9c1f2aa61c8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:25.144016 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-667dbe4c-cfa7-4533-bbfc-d9428402cca0 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea" status: 200 len: 1426 microversion: 2.1 time: 0.114819 May 21 21:21:25.144649 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1478/2874] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:25 2022] GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea => generated 1426 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:25.147210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4a8d5df2-1f9f-40ea-9c99-d9c1f2aa61c8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:25.147882 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4a8d5df2-1f9f-40ea-9c99-d9c1f2aa61c8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:25.148697 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4a8d5df2-1f9f-40ea-9c99-d9c1f2aa61c8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:25.149311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4a8d5df2-1f9f-40ea-9c99-d9c1f2aa61c8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:25.195390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bf53ad6a-60e8-44d2-96f7-f61e5d2cd3ef tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:25.196754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bf53ad6a-60e8-44d2-96f7-f61e5d2cd3ef tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:25.206186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bf53ad6a-60e8-44d2-96f7-f61e5d2cd3ef tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:25.206727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bf53ad6a-60e8-44d2-96f7-f61e5d2cd3ef tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:25.207524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bf53ad6a-60e8-44d2-96f7-f61e5d2cd3ef tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:25.208124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bf53ad6a-60e8-44d2-96f7-f61e5d2cd3ef tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:25.333416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bf53ad6a-60e8-44d2-96f7-f61e5d2cd3ef tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c12cdb0dccf44b989a23724b1d87870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4473aa2ed54e1fafaf2f8b339bb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:25.345123 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bf53ad6a-60e8-44d2-96f7-f61e5d2cd3ef tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d" status: 200 len: 1230 microversion: 2.1 time: 0.156235 May 21 21:21:25.346459 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1479/2875] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:25 2022] GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d => generated 1230 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:25.402634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4a8d5df2-1f9f-40ea-9c99-d9c1f2aa61c8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:25.410639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:25.415489 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4a8d5df2-1f9f-40ea-9c99-d9c1f2aa61c8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.280290 May 21 21:21:25.416133 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1397/2876] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:25 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:25.600226 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5561e85b-14e6-40b2-a516-18d6e638b47c tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:25.601335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5561e85b-14e6-40b2-a516-18d6e638b47c tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:25.607665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5561e85b-14e6-40b2-a516-18d6e638b47c tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:25.608121 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5561e85b-14e6-40b2-a516-18d6e638b47c tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:25.608935 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5561e85b-14e6-40b2-a516-18d6e638b47c tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:25.609380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5561e85b-14e6-40b2-a516-18d6e638b47c tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:25.820624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5561e85b-14e6-40b2-a516-18d6e638b47c tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:25.830232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5561e85b-14e6-40b2-a516-18d6e638b47c tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:25.831779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5561e85b-14e6-40b2-a516-18d6e638b47c tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:25.833144 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5561e85b-14e6-40b2-a516-18d6e638b47c tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.236971 May 21 21:21:25.833711 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1480/2877] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:25 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:26.162605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-573f1a82-9070-4fd8-8c4d-d5a1790ebfb5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:26.163747 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-573f1a82-9070-4fd8-8c4d-d5a1790ebfb5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: c83883e1-bf1c-43dd-a43a-3c82e4a3dbea] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:26.172548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-573f1a82-9070-4fd8-8c4d-d5a1790ebfb5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:26.173013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-573f1a82-9070-4fd8-8c4d-d5a1790ebfb5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:26.174917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-573f1a82-9070-4fd8-8c4d-d5a1790ebfb5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:26.174917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-573f1a82-9070-4fd8-8c4d-d5a1790ebfb5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:26.191606 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-573f1a82-9070-4fd8-8c4d-d5a1790ebfb5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] HTTP exception thrown: Instance c83883e1-bf1c-43dd-a43a-3c82e4a3dbea could not be found. May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-573f1a82-9070-4fd8-8c4d-d5a1790ebfb5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Request method failure captured: May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea HTTP/1.1 May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVdRfOJ-puh8NIinm8LBPIR0iDZ8LAeWMNBTvbwI3cZ2HbwR9Kuc2I7ezu8n2WUxhNen34ro-gisY9t7mm2lfsBw5rHww9pGOb45ZgqDxspXWbTPTYvSJXumm7tHRcrhM4AG4DHUIH6LMBNKNIT4C0zCj3oTJtzCR8tPdcUHGPUF3EE May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 0c0ac2ac25374777ba3c25d31ea96dc5 May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersAdminTestJSON-1240622121 May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0c0ac2ac25374777ba3c25d31ea96dc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0c0ac2ac25374777ba3c25d31ea96dc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0c0ac2ac25374777ba3c25d31ea96dc5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0c0ac2ac25374777ba3c25d31ea96dc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersAdminTestJSON-1240622121 May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 0c0ac2ac25374777ba3c25d31ea96dc5 May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersAdminTestJSON-1240622121 May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersAdminTestJSON-1240622121-project May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: b54cc2165959478ba95981c81864118a May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersAdminTestJSON-1240622121-project May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance c83883e1-bf1c-43dd-a43a-3c82e4a3dbea could not be found. May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'c83883e1-bf1c-43dd-a43a-3c82e4a3dbea'} May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c83883e1-bf1c-43dd-a43a-3c82e4a3dbea could not be found. May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c83883e1-bf1c-43dd-a43a-3c82e4a3dbea could not be found. May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:26.193404 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:26.197691 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:26.197691 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:26.197691 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:26.197691 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:21:26.197691 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:21:26.197691 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c83883e1-bf1c-43dd-a43a-3c82e4a3dbea could not be found. May 21 21:21:26.197691 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:26.197691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-573f1a82-9070-4fd8-8c4d-d5a1790ebfb5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Returning 404 to user: Instance c83883e1-bf1c-43dd-a43a-3c82e4a3dbea could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:21:26.197691 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-573f1a82-9070-4fd8-8c4d-d5a1790ebfb5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea" status: 404 len: 111 microversion: 2.1 time: 0.036764 May 21 21:21:26.200050 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1398/2878] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:26 2022] GET /compute/v2.1/servers/c83883e1-bf1c-43dd-a43a-3c82e4a3dbea => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:21:26.206282 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ef151735-53de-49f7-9df4-a7a2274a2c6c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:26.206806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ef151735-53de-49f7-9df4-a7a2274a2c6c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:26.214174 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef151735-53de-49f7-9df4-a7a2274a2c6c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:26.215029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef151735-53de-49f7-9df4-a7a2274a2c6c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:26.216126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef151735-53de-49f7-9df4-a7a2274a2c6c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:26.216761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef151735-53de-49f7-9df4-a7a2274a2c6c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:26.246131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ef151735-53de-49f7-9df4-a7a2274a2c6c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:21:26.363308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-519e7c56-c961-4a08-9569-f24f7efc3990 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:26.363925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-519e7c56-c961-4a08-9569-f24f7efc3990 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:26.371608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-519e7c56-c961-4a08-9569-f24f7efc3990 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:26.372060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-519e7c56-c961-4a08-9569-f24f7efc3990 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:26.372858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-519e7c56-c961-4a08-9569-f24f7efc3990 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:26.373295 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-519e7c56-c961-4a08-9569-f24f7efc3990 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:26.462758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-519e7c56-c961-4a08-9569-f24f7efc3990 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c12cdb0dccf44b989a23724b1d87870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4473aa2ed54e1fafaf2f8b339bb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:26.470737 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-519e7c56-c961-4a08-9569-f24f7efc3990 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d" status: 200 len: 1278 microversion: 2.1 time: 0.111553 May 21 21:21:26.471313 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1399/2879] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:26 2022] GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d => generated 1278 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:26.479033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-761d7b95-5ad9-4f2c-802f-e357c09ec8e0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:26.480023 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-761d7b95-5ad9-4f2c-802f-e357c09ec8e0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:26.486294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-761d7b95-5ad9-4f2c-802f-e357c09ec8e0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:26.486745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-761d7b95-5ad9-4f2c-802f-e357c09ec8e0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:26.488081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-761d7b95-5ad9-4f2c-802f-e357c09ec8e0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:26.488561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-761d7b95-5ad9-4f2c-802f-e357c09ec8e0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:26.733109 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ef151735-53de-49f7-9df4-a7a2274a2c6c tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 204 len: 0 microversion: 2.1 time: 0.531196 May 21 21:21:26.733708 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1481/2880] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:21:26 2022] DELETE /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 21:21:26.745977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7892eef6-e5bc-4088-b26e-9204e5f08b71 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:26.747713 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7892eef6-e5bc-4088-b26e-9204e5f08b71 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:26.753489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-761d7b95-5ad9-4f2c-802f-e357c09ec8e0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:26.758474 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7892eef6-e5bc-4088-b26e-9204e5f08b71 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:26.759175 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7892eef6-e5bc-4088-b26e-9204e5f08b71 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:26.760817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7892eef6-e5bc-4088-b26e-9204e5f08b71 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:26.761458 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7892eef6-e5bc-4088-b26e-9204e5f08b71 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:26.762157 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-761d7b95-5ad9-4f2c-802f-e357c09ec8e0 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.287567 May 21 21:21:26.763113 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1400/2881] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:26 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:26.853849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ccf56517-e03c-4843-9618-5090eddede08 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:26.854877 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ccf56517-e03c-4843-9618-5090eddede08 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:26.862273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ccf56517-e03c-4843-9618-5090eddede08 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:26.862717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ccf56517-e03c-4843-9618-5090eddede08 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:26.863707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ccf56517-e03c-4843-9618-5090eddede08 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:26.864142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ccf56517-e03c-4843-9618-5090eddede08 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:26.943605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7892eef6-e5bc-4088-b26e-9204e5f08b71 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:26.952304 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7892eef6-e5bc-4088-b26e-9204e5f08b71 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1469 microversion: 2.1 time: 0.214303 May 21 21:21:26.953179 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1482/2882] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:26 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1469 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:27.093955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ccf56517-e03c-4843-9618-5090eddede08 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:27.103367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ccf56517-e03c-4843-9618-5090eddede08 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:27.104923 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ccf56517-e03c-4843-9618-5090eddede08 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:27.106083 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ccf56517-e03c-4843-9618-5090eddede08 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.258138 May 21 21:21:27.106643 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1401/2883] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:26 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:21:27.494546 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8174bb84-df35-4489-99c5-d2282b7ee912 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:27.495336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8174bb84-df35-4489-99c5-d2282b7ee912 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:27.502467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8174bb84-df35-4489-99c5-d2282b7ee912 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:27.503031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8174bb84-df35-4489-99c5-d2282b7ee912 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:27.503931 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8174bb84-df35-4489-99c5-d2282b7ee912 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:27.504543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8174bb84-df35-4489-99c5-d2282b7ee912 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:27.577262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8174bb84-df35-4489-99c5-d2282b7ee912 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c12cdb0dccf44b989a23724b1d87870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4473aa2ed54e1fafaf2f8b339bb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:27.587727 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8174bb84-df35-4489-99c5-d2282b7ee912 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d" status: 200 len: 1296 microversion: 2.1 time: 0.097159 May 21 21:21:27.588415 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1483/2884] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:27 2022] GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d => generated 1296 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:27.779301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e7d848a8-8f7d-451a-9073-4a78ef593ca4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:27.779962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e7d848a8-8f7d-451a-9073-4a78ef593ca4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:27.787351 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7d848a8-8f7d-451a-9073-4a78ef593ca4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:27.791065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7d848a8-8f7d-451a-9073-4a78ef593ca4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:27.791065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7d848a8-8f7d-451a-9073-4a78ef593ca4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:27.791065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7d848a8-8f7d-451a-9073-4a78ef593ca4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:27.946237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e7d848a8-8f7d-451a-9073-4a78ef593ca4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:27.954277 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e7d848a8-8f7d-451a-9073-4a78ef593ca4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1511 microversion: 2.1 time: 0.179150 May 21 21:21:27.955007 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1402/2885] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:27 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1511 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:27.970582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-34783e95-0d20-4296-914c-f03b71f2b293 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:27.971277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-34783e95-0d20-4296-914c-f03b71f2b293 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:27.979026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34783e95-0d20-4296-914c-f03b71f2b293 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:27.979551 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34783e95-0d20-4296-914c-f03b71f2b293 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:27.980418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34783e95-0d20-4296-914c-f03b71f2b293 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:27.980952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34783e95-0d20-4296-914c-f03b71f2b293 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:28.125691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-03cc67a2-2ecf-471e-ae40-a8f61f4b38da tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:28.126405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-03cc67a2-2ecf-471e-ae40-a8f61f4b38da tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:28.133838 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03cc67a2-2ecf-471e-ae40-a8f61f4b38da tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:28.134304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03cc67a2-2ecf-471e-ae40-a8f61f4b38da tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:28.135092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03cc67a2-2ecf-471e-ae40-a8f61f4b38da tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:28.135548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03cc67a2-2ecf-471e-ae40-a8f61f4b38da tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:28.236162 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-34783e95-0d20-4296-914c-f03b71f2b293 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:28.236162 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-34783e95-0d20-4296-914c-f03b71f2b293 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1469 microversion: 2.1 time: 0.248882 May 21 21:21:28.236162 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1484/2886] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:27 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1469 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:28.342557 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-03cc67a2-2ecf-471e-ae40-a8f61f4b38da tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:28.352661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-03cc67a2-2ecf-471e-ae40-a8f61f4b38da tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:28.359060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-03cc67a2-2ecf-471e-ae40-a8f61f4b38da tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:28.359060 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-03cc67a2-2ecf-471e-ae40-a8f61f4b38da tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.233836 May 21 21:21:28.359060 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1403/2887] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:28 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:21:28.609298 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-db2472cf-6ebe-44ef-a447-6e71b563a7e0 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:28.610258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-db2472cf-6ebe-44ef-a447-6e71b563a7e0 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:28.619965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db2472cf-6ebe-44ef-a447-6e71b563a7e0 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:28.620592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db2472cf-6ebe-44ef-a447-6e71b563a7e0 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:28.621636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db2472cf-6ebe-44ef-a447-6e71b563a7e0 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:28.622155 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db2472cf-6ebe-44ef-a447-6e71b563a7e0 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:28.728890 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-db2472cf-6ebe-44ef-a447-6e71b563a7e0 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c12cdb0dccf44b989a23724b1d87870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4473aa2ed54e1fafaf2f8b339bb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:28.736798 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-db2472cf-6ebe-44ef-a447-6e71b563a7e0 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d" status: 200 len: 1284 microversion: 2.1 time: 0.132469 May 21 21:21:28.737379 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1485/2888] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:28 2022] GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d => generated 1284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:28.972167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f0459fe4-6154-4807-b2b8-1c6aa400b996 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:28.972819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f0459fe4-6154-4807-b2b8-1c6aa400b996 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:28.980611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0459fe4-6154-4807-b2b8-1c6aa400b996 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:28.981063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0459fe4-6154-4807-b2b8-1c6aa400b996 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:28.981840 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0459fe4-6154-4807-b2b8-1c6aa400b996 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:28.982315 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0459fe4-6154-4807-b2b8-1c6aa400b996 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:29.151424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f0459fe4-6154-4807-b2b8-1c6aa400b996 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:29.160677 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f0459fe4-6154-4807-b2b8-1c6aa400b996 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1488 microversion: 2.1 time: 0.192337 May 21 21:21:29.163415 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1404/2889] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:28 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1488 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:29.179325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cdf38c58-6c7b-49e2-b753-7f78083ea29d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:29.179829 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cdf38c58-6c7b-49e2-b753-7f78083ea29d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:29.198286 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdf38c58-6c7b-49e2-b753-7f78083ea29d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:29.198286 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdf38c58-6c7b-49e2-b753-7f78083ea29d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:29.198286 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdf38c58-6c7b-49e2-b753-7f78083ea29d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:29.198286 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdf38c58-6c7b-49e2-b753-7f78083ea29d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:29.198286 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:29.218106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-c4b36f11-b7d8-4e51-87c0-9f46372377cf req-5ea37725-66d9-4bd1-a690-1b9dab6abc9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6825da6e-8b02-486c-8461-41f10572c810", "name": "network-vif-deleted", "tag": "976547b8-31f4-469e-8c56-e9286444cdde"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:29.229896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c4b36f11-b7d8-4e51-87c0-9f46372377cf req-5ea37725-66d9-4bd1-a690-1b9dab6abc9b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:29.237311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c4b36f11-b7d8-4e51-87c0-9f46372377cf req-5ea37725-66d9-4bd1-a690-1b9dab6abc9b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:29.244862 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cdf38c58-6c7b-49e2-b753-7f78083ea29d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:21:29.272010 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-c4b36f11-b7d8-4e51-87c0-9f46372377cf req-5ea37725-66d9-4bd1-a690-1b9dab6abc9b service nova] Creating event network-vif-deleted:976547b8-31f4-469e-8c56-e9286444cdde for instance 6825da6e-8b02-486c-8461-41f10572c810 on nch1-master-1 May 21 21:21:29.278550 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-c4b36f11-b7d8-4e51-87c0-9f46372377cf req-5ea37725-66d9-4bd1-a690-1b9dab6abc9b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064234 May 21 21:21:29.279482 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1405/2890] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:29.285328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e1c3ecff-189e-44af-8633-a0822a0d48f5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:29.286044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e1c3ecff-189e-44af-8633-a0822a0d48f5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:29.310681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1c3ecff-189e-44af-8633-a0822a0d48f5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:29.311156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1c3ecff-189e-44af-8633-a0822a0d48f5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:29.311965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1c3ecff-189e-44af-8633-a0822a0d48f5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:29.312782 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1c3ecff-189e-44af-8633-a0822a0d48f5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:29.392164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e1c3ecff-189e-44af-8633-a0822a0d48f5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54cc2165959478ba95981c81864118a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0ac2ac25374777ba3c25d31ea96dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:29.402182 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e1c3ecff-189e-44af-8633-a0822a0d48f5 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 200 len: 1427 microversion: 2.1 time: 0.121467 May 21 21:21:29.402914 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1406/2891] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:29 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 1427 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:29.413941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9803d773-cb5d-4a4f-be99-2cc946a3d9fd tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:29.414677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9803d773-cb5d-4a4f-be99-2cc946a3d9fd tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:29.421864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9803d773-cb5d-4a4f-be99-2cc946a3d9fd tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:29.422622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9803d773-cb5d-4a4f-be99-2cc946a3d9fd tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:29.423408 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9803d773-cb5d-4a4f-be99-2cc946a3d9fd tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:29.423848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9803d773-cb5d-4a4f-be99-2cc946a3d9fd tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:29.650695 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cdf38c58-6c7b-49e2-b753-7f78083ea29d tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 204 len: 0 microversion: 2.1 time: 0.473534 May 21 21:21:29.651321 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1486/2892] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:21:29 2022] DELETE /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:21:29.666555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1d9fd47b-e530-4c1b-8b8c-379803408880 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:29.670132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1d9fd47b-e530-4c1b-8b8c-379803408880 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:29.675420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9803d773-cb5d-4a4f-be99-2cc946a3d9fd tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:29.680782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d9fd47b-e530-4c1b-8b8c-379803408880 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:29.681360 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d9fd47b-e530-4c1b-8b8c-379803408880 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:29.682295 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d9fd47b-e530-4c1b-8b8c-379803408880 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:29.682830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d9fd47b-e530-4c1b-8b8c-379803408880 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:29.695417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9803d773-cb5d-4a4f-be99-2cc946a3d9fd tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:29.697260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9803d773-cb5d-4a4f-be99-2cc946a3d9fd tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:29.698448 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9803d773-cb5d-4a4f-be99-2cc946a3d9fd tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.294484 May 21 21:21:29.699017 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1407/2893] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:29 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:29.755330 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1e27961e-89a9-4c1f-bf4c-5370989adcd5 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:29.755986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1e27961e-89a9-4c1f-bf4c-5370989adcd5 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:29.763036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e27961e-89a9-4c1f-bf4c-5370989adcd5 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:29.763487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e27961e-89a9-4c1f-bf4c-5370989adcd5 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:29.764450 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e27961e-89a9-4c1f-bf4c-5370989adcd5 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:29.765059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e27961e-89a9-4c1f-bf4c-5370989adcd5 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:29.922957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1e27961e-89a9-4c1f-bf4c-5370989adcd5 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c12cdb0dccf44b989a23724b1d87870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4473aa2ed54e1fafaf2f8b339bb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:29.930953 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1e27961e-89a9-4c1f-bf4c-5370989adcd5 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d" status: 200 len: 1351 microversion: 2.1 time: 0.180084 May 21 21:21:29.931526 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1408/2894] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:29 2022] GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d => generated 1351 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:29.993787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1d9fd47b-e530-4c1b-8b8c-379803408880 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:30.002886 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1d9fd47b-e530-4c1b-8b8c-379803408880 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1494 microversion: 2.1 time: 0.347100 May 21 21:21:30.003687 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1487/2895] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:29 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1494 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:30.419836 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4c998d83-faa1-47c1-9b86-48fb623ed152 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:30.421160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4c998d83-faa1-47c1-9b86-48fb623ed152 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] [instance: 6825da6e-8b02-486c-8461-41f10572c810] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:30.429158 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4c998d83-faa1-47c1-9b86-48fb623ed152 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:30.430103 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4c998d83-faa1-47c1-9b86-48fb623ed152 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:30.431184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4c998d83-faa1-47c1-9b86-48fb623ed152 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:30.432094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4c998d83-faa1-47c1-9b86-48fb623ed152 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:30.449663 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-4c998d83-faa1-47c1-9b86-48fb623ed152 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] HTTP exception thrown: Instance 6825da6e-8b02-486c-8461-41f10572c810 could not be found. May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4c998d83-faa1-47c1-9b86-48fb623ed152 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Request method failure captured: May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 HTTP/1.1 May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVdRfOJ-puh8NIinm8LBPIR0iDZ8LAeWMNBTvbwI3cZ2HbwR9Kuc2I7ezu8n2WUxhNen34ro-gisY9t7mm2lfsBw5rHww9pGOb45ZgqDxspXWbTPTYvSJXumm7tHRcrhM4AG4DHUIH6LMBNKNIT4C0zCj3oTJtzCR8tPdcUHGPUF3EE May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 0c0ac2ac25374777ba3c25d31ea96dc5 May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersAdminTestJSON-1240622121 May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0c0ac2ac25374777ba3c25d31ea96dc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0c0ac2ac25374777ba3c25d31ea96dc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0c0ac2ac25374777ba3c25d31ea96dc5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0c0ac2ac25374777ba3c25d31ea96dc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersAdminTestJSON-1240622121 May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 0c0ac2ac25374777ba3c25d31ea96dc5 May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersAdminTestJSON-1240622121 May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersAdminTestJSON-1240622121-project May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: b54cc2165959478ba95981c81864118a May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersAdminTestJSON-1240622121-project May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 6825da6e-8b02-486c-8461-41f10572c810 could not be found. May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '6825da6e-8b02-486c-8461-41f10572c810'} May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6825da6e-8b02-486c-8461-41f10572c810 could not be found. May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6825da6e-8b02-486c-8461-41f10572c810 could not be found. May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:30.451406 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:30.456394 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:30.456394 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:30.456394 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:30.456394 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:21:30.456394 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:21:30.456394 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6825da6e-8b02-486c-8461-41f10572c810 could not be found. May 21 21:21:30.456394 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:30.456394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4c998d83-faa1-47c1-9b86-48fb623ed152 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] Returning 404 to user: Instance 6825da6e-8b02-486c-8461-41f10572c810 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:21:30.456394 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4c998d83-faa1-47c1-9b86-48fb623ed152 tempest-ServersAdminTestJSON-1240622121 tempest-ServersAdminTestJSON-1240622121-project] 10.222.0.49 "GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810" status: 404 len: 111 microversion: 2.1 time: 0.037427 May 21 21:21:30.456394 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1409/2896] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:30 2022] GET /compute/v2.1/servers/6825da6e-8b02-486c-8461-41f10572c810 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:21:30.719052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6b12f11f-27ed-4271-8b5e-8e21be5895d6 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:30.720274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6b12f11f-27ed-4271-8b5e-8e21be5895d6 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:30.729621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6b12f11f-27ed-4271-8b5e-8e21be5895d6 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:30.734816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6b12f11f-27ed-4271-8b5e-8e21be5895d6 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:30.734816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6b12f11f-27ed-4271-8b5e-8e21be5895d6 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:30.734816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6b12f11f-27ed-4271-8b5e-8e21be5895d6 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:30.949181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ef865913-8616-412b-9788-39ca21667f4d tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:30.950117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ef865913-8616-412b-9788-39ca21667f4d tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:30.963468 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef865913-8616-412b-9788-39ca21667f4d tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:30.966157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef865913-8616-412b-9788-39ca21667f4d tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:30.966157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef865913-8616-412b-9788-39ca21667f4d tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:30.966157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef865913-8616-412b-9788-39ca21667f4d tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:31.080084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6b12f11f-27ed-4271-8b5e-8e21be5895d6 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:31.096259 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6b12f11f-27ed-4271-8b5e-8e21be5895d6 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:31.097892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6b12f11f-27ed-4271-8b5e-8e21be5895d6 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:31.100737 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6b12f11f-27ed-4271-8b5e-8e21be5895d6 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.386854 May 21 21:21:31.102969 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1488/2897] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:30 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:31.130350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-00b32dad-a5c3-44a1-9f91-eb4084b54911 req-f1e6f3c6-2c46-4539-b466-21172eaef7de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "name": "network-vif-plugged", "status": "completed", "tag": "4c631ba5-27ae-4db4-9ea4-c4c2d4945e7c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:31.149996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-00b32dad-a5c3-44a1-9f91-eb4084b54911 req-f1e6f3c6-2c46-4539-b466-21172eaef7de service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:31.150449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-00b32dad-a5c3-44a1-9f91-eb4084b54911 req-f1e6f3c6-2c46-4539-b466-21172eaef7de service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:31.179457 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-00b32dad-a5c3-44a1-9f91-eb4084b54911 req-f1e6f3c6-2c46-4539-b466-21172eaef7de service nova] Creating event network-vif-plugged:4c631ba5-27ae-4db4-9ea4-c4c2d4945e7c for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:21:31.189511 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-00b32dad-a5c3-44a1-9f91-eb4084b54911 req-f1e6f3c6-2c46-4539-b466-21172eaef7de service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070174 May 21 21:21:31.197186 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1489/2898] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:31.205232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cdbd5c15-582d-44e1-a177-adffa005b335 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:31.206338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cdbd5c15-582d-44e1-a177-adffa005b335 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:31.229269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdbd5c15-582d-44e1-a177-adffa005b335 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:31.236545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdbd5c15-582d-44e1-a177-adffa005b335 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:31.236545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdbd5c15-582d-44e1-a177-adffa005b335 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:31.236545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdbd5c15-582d-44e1-a177-adffa005b335 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:31.394073 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ef865913-8616-412b-9788-39ca21667f4d tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c12cdb0dccf44b989a23724b1d87870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4473aa2ed54e1fafaf2f8b339bb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:31.404398 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ef865913-8616-412b-9788-39ca21667f4d tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d" status: 200 len: 1351 microversion: 2.1 time: 0.460570 May 21 21:21:31.405137 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1410/2899] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:30 2022] GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d => generated 1351 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:31.410840 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e767b62f-653d-4efb-9f84-74c2d7dbbf82 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:31.412093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e767b62f-653d-4efb-9f84-74c2d7dbbf82 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:31.419832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e767b62f-653d-4efb-9f84-74c2d7dbbf82 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:31.420629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e767b62f-653d-4efb-9f84-74c2d7dbbf82 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:31.422452 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e767b62f-653d-4efb-9f84-74c2d7dbbf82 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:31.423088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e767b62f-653d-4efb-9f84-74c2d7dbbf82 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:31.492372 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e767b62f-653d-4efb-9f84-74c2d7dbbf82 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "POST /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10/action" status: 200 len: 24574 microversion: 2.1 time: 0.085444 May 21 21:21:31.493208 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1411/2900] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:21:31 2022] POST /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10/action => generated 24574 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:21:31.499281 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-f122063a-0c99-4998-b2d1-17bd0e1f6018 req-a8e9cee2-5efe-4f5a-a2df-493963120684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fd11a9f-6f38-4281-bbb1-747ed176df6d", "tag": "f5b2c3de-be0f-4b80-b734-600dc61538bd"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:31.513170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f122063a-0c99-4998-b2d1-17bd0e1f6018 req-a8e9cee2-5efe-4f5a-a2df-493963120684 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:31.513988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f122063a-0c99-4998-b2d1-17bd0e1f6018 req-a8e9cee2-5efe-4f5a-a2df-493963120684 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:31.532824 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-f122063a-0c99-4998-b2d1-17bd0e1f6018 req-a8e9cee2-5efe-4f5a-a2df-493963120684 service nova] Creating event network-changed:f5b2c3de-be0f-4b80-b734-600dc61538bd for instance 9fd11a9f-6f38-4281-bbb1-747ed176df6d on nch1-master-1 May 21 21:21:31.539187 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-f122063a-0c99-4998-b2d1-17bd0e1f6018 req-a8e9cee2-5efe-4f5a-a2df-493963120684 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044476 May 21 21:21:31.541265 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1412/2901] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:31.558660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ed4ba580-f66d-44b2-9849-c426de839a8d tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:31.564995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ed4ba580-f66d-44b2-9849-c426de839a8d tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:31.566608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ed4ba580-f66d-44b2-9849-c426de839a8d tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Searching by: {'deleted': False, 'project_id': '28107ae255f24328bcce84129cec62d4'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:21:31.593061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed4ba580-f66d-44b2-9849-c426de839a8d tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:31.593061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed4ba580-f66d-44b2-9849-c426de839a8d tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:31.593061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed4ba580-f66d-44b2-9849-c426de839a8d tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:31.593061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed4ba580-f66d-44b2-9849-c426de839a8d tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:31.684557 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-ed4ba580-f66d-44b2-9849-c426de839a8d tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:21:31.686111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cdbd5c15-582d-44e1-a177-adffa005b335 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:31.695854 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cdbd5c15-582d-44e1-a177-adffa005b335 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1494 microversion: 2.1 time: 0.496806 May 21 21:21:31.696814 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1490/2902] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:31 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1494 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:31.777161 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ed4ba580-f66d-44b2-9849-c426de839a8d tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.233671 May 21 21:21:31.778381 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1413/2903] 10.222.0.49 () {58 vars in 1124 bytes} [Sat May 21 21:21:31 2022] GET /compute/v2.1/servers => generated 343 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:31.790466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0281112f-dadd-48a3-8d15-a2e83fd75b6c tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:31.796337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0281112f-dadd-48a3-8d15-a2e83fd75b6c tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:31.797429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0281112f-dadd-48a3-8d15-a2e83fd75b6c tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Searching by: {'deleted': False, 'project_id': '28107ae255f24328bcce84129cec62d4'} {{(pid=131277) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:21:31.809092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0281112f-dadd-48a3-8d15-a2e83fd75b6c tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:31.809542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0281112f-dadd-48a3-8d15-a2e83fd75b6c tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:31.810388 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0281112f-dadd-48a3-8d15-a2e83fd75b6c tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:31.810829 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0281112f-dadd-48a3-8d15-a2e83fd75b6c tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:31.842146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.multi_cell_list [None req-0281112f-dadd-48a3-8d15-a2e83fd75b6c tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131277) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:21:31.865426 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-bfe18dfe-982f-43b2-8633-17a86a42933b req-b4cf5e9e-3b47-422c-b777-4b9510f8acda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b1cd26e-bb18-4119-a747-e73ad8a39343", "name": "network-vif-deleted", "tag": "a746937e-95f0-441c-b889-b5791e78c9ed"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:31.880673 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-bfe18dfe-982f-43b2-8633-17a86a42933b req-b4cf5e9e-3b47-422c-b777-4b9510f8acda service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:31.881377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-bfe18dfe-982f-43b2-8633-17a86a42933b req-b4cf5e9e-3b47-422c-b777-4b9510f8acda service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:31.903480 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-bfe18dfe-982f-43b2-8633-17a86a42933b req-b4cf5e9e-3b47-422c-b777-4b9510f8acda service nova] Creating event network-vif-deleted:a746937e-95f0-441c-b889-b5791e78c9ed for instance 4b1cd26e-bb18-4119-a747-e73ad8a39343 on nch2-master-1 May 21 21:21:31.910517 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-bfe18dfe-982f-43b2-8633-17a86a42933b req-b4cf5e9e-3b47-422c-b777-4b9510f8acda service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049384 May 21 21:21:31.911812 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1414/2904] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:21:32.034047 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0281112f-dadd-48a3-8d15-a2e83fd75b6c tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:32.042157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0281112f-dadd-48a3-8d15-a2e83fd75b6c tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:32.042157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0281112f-dadd-48a3-8d15-a2e83fd75b6c tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:32.122113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-04e5de69-aed4-4248-b074-43e1c4004d30 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:32.122831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-04e5de69-aed4-4248-b074-43e1c4004d30 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:32.129724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04e5de69-aed4-4248-b074-43e1c4004d30 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:32.130662 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04e5de69-aed4-4248-b074-43e1c4004d30 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:32.130965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04e5de69-aed4-4248-b074-43e1c4004d30 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:32.131399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04e5de69-aed4-4248-b074-43e1c4004d30 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:32.222006 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0281112f-dadd-48a3-8d15-a2e83fd75b6c tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.436504 May 21 21:21:32.222635 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1491/2905] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:21:31 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:32.243050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ee072d6d-b7b1-48c8-b229-9af93ee3293c tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:32.253350 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ee072d6d-b7b1-48c8-b229-9af93ee3293c tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014077 May 21 21:21:32.254493 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1492/2906] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:21:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:21:32.377712 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-04e5de69-aed4-4248-b074-43e1c4004d30 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:32.386948 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-04e5de69-aed4-4248-b074-43e1c4004d30 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:32.388621 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-04e5de69-aed4-4248-b074-43e1c4004d30 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:32.389782 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-04e5de69-aed4-4248-b074-43e1c4004d30 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.272115 May 21 21:21:32.390347 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1415/2907] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:32 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:21:32.422644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5404b853-da27-4bfa-9b0c-ff15c075d3c2 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:32.428253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5404b853-da27-4bfa-9b0c-ff15c075d3c2 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:32.430201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5404b853-da27-4bfa-9b0c-ff15c075d3c2 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:32.430740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5404b853-da27-4bfa-9b0c-ff15c075d3c2 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:32.431605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5404b853-da27-4bfa-9b0c-ff15c075d3c2 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:32.432241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5404b853-da27-4bfa-9b0c-ff15c075d3c2 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:32.592656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5404b853-da27-4bfa-9b0c-ff15c075d3c2 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c12cdb0dccf44b989a23724b1d87870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4473aa2ed54e1fafaf2f8b339bb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:32.601377 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5404b853-da27-4bfa-9b0c-ff15c075d3c2 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d" status: 200 len: 1351 microversion: 2.1 time: 0.182652 May 21 21:21:32.601965 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1493/2908] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:32 2022] GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d => generated 1351 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:32.724788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3dc38953-36e2-41be-b6ef-76f84aa80e4f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:32.726045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3dc38953-36e2-41be-b6ef-76f84aa80e4f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:32.749995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3dc38953-36e2-41be-b6ef-76f84aa80e4f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:32.750600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3dc38953-36e2-41be-b6ef-76f84aa80e4f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:32.751480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3dc38953-36e2-41be-b6ef-76f84aa80e4f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:32.752018 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3dc38953-36e2-41be-b6ef-76f84aa80e4f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:32.795446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3dc38953-36e2-41be-b6ef-76f84aa80e4f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:32.796012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3dc38953-36e2-41be-b6ef-76f84aa80e4f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:32.796597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-3dc38953-36e2-41be-b6ef-76f84aa80e4f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lazy-loading 'fault' on Instance uuid 4b1cd26e-bb18-4119-a747-e73ad8a39343 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:21:32.860554 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3dc38953-36e2-41be-b6ef-76f84aa80e4f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:32.869979 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3dc38953-36e2-41be-b6ef-76f84aa80e4f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 200 len: 1304 microversion: 2.1 time: 0.153494 May 21 21:21:32.871831 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1416/2909] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:32 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 1304 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:33.220161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-4ac502f0-080e-47b4-be7c-6c6055ed61ad req-df49d62c-53f2-4bd3-a317-53a2c527955e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "name": "network-vif-plugged", "status": "completed", "tag": "5b797786-d747-4356-b9a8-cebf01987ee4"}, {"server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "name": "network-vif-plugged", "status": "completed", "tag": "412a55b1-ca87-468e-871f-1a2e9ad7520f"}, {"server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "name": "network-vif-plugged", "status": "completed", "tag": "259477b1-cfd2-4e6b-a20e-7bab0eec7c14"}, {"server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "name": "network-vif-plugged", "status": "completed", "tag": "45483686-8652-4059-bc41-0b17ce21b793"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:33.230359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-4ac502f0-080e-47b4-be7c-6c6055ed61ad req-df49d62c-53f2-4bd3-a317-53a2c527955e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:33.231125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-4ac502f0-080e-47b4-be7c-6c6055ed61ad req-df49d62c-53f2-4bd3-a317-53a2c527955e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:33.243825 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-4ac502f0-080e-47b4-be7c-6c6055ed61ad req-df49d62c-53f2-4bd3-a317-53a2c527955e service nova] Creating event network-vif-plugged:5b797786-d747-4356-b9a8-cebf01987ee4 for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:21:33.244549 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-4ac502f0-080e-47b4-be7c-6c6055ed61ad req-df49d62c-53f2-4bd3-a317-53a2c527955e service nova] Creating event network-vif-plugged:412a55b1-ca87-468e-871f-1a2e9ad7520f for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:21:33.245064 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-4ac502f0-080e-47b4-be7c-6c6055ed61ad req-df49d62c-53f2-4bd3-a317-53a2c527955e service nova] Creating event network-vif-plugged:259477b1-cfd2-4e6b-a20e-7bab0eec7c14 for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:21:33.246196 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-4ac502f0-080e-47b4-be7c-6c6055ed61ad req-df49d62c-53f2-4bd3-a317-53a2c527955e service nova] Creating event network-vif-plugged:45483686-8652-4059-bc41-0b17ce21b793 for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:21:33.259226 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-4ac502f0-080e-47b4-be7c-6c6055ed61ad req-df49d62c-53f2-4bd3-a317-53a2c527955e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.042044 May 21 21:21:33.261011 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1494/2910] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:33.409374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dbf7ef2e-1ac5-4fef-9805-cba7ff4eebf5 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:33.410357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dbf7ef2e-1ac5-4fef-9805-cba7ff4eebf5 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:33.417177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbf7ef2e-1ac5-4fef-9805-cba7ff4eebf5 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:33.425708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbf7ef2e-1ac5-4fef-9805-cba7ff4eebf5 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:33.425708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbf7ef2e-1ac5-4fef-9805-cba7ff4eebf5 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:33.425708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbf7ef2e-1ac5-4fef-9805-cba7ff4eebf5 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:33.441684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:33.619832 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8da3e0a7-24df-4127-a411-8b3b766612be tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:33.621175 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8da3e0a7-24df-4127-a411-8b3b766612be tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:33.631247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8da3e0a7-24df-4127-a411-8b3b766612be tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:33.632380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8da3e0a7-24df-4127-a411-8b3b766612be tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:33.634072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8da3e0a7-24df-4127-a411-8b3b766612be tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:33.635064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8da3e0a7-24df-4127-a411-8b3b766612be tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:33.662059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dbf7ef2e-1ac5-4fef-9805-cba7ff4eebf5 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:33.672397 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dbf7ef2e-1ac5-4fef-9805-cba7ff4eebf5 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:33.674321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dbf7ef2e-1ac5-4fef-9805-cba7ff4eebf5 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:33.675749 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dbf7ef2e-1ac5-4fef-9805-cba7ff4eebf5 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.270470 May 21 21:21:33.676341 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1417/2911] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:33 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:33.819503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8da3e0a7-24df-4127-a411-8b3b766612be tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c12cdb0dccf44b989a23724b1d87870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4473aa2ed54e1fafaf2f8b339bb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:33.828069 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8da3e0a7-24df-4127-a411-8b3b766612be tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d" status: 200 len: 1351 microversion: 2.1 time: 0.213103 May 21 21:21:33.828945 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1495/2912] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:33 2022] GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d => generated 1351 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:33.891817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0148c969-e41d-4b1e-9509-cbffd3a1574a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:33.892466 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0148c969-e41d-4b1e-9509-cbffd3a1574a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:33.911677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0148c969-e41d-4b1e-9509-cbffd3a1574a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:33.912136 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0148c969-e41d-4b1e-9509-cbffd3a1574a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:33.913073 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0148c969-e41d-4b1e-9509-cbffd3a1574a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:33.913723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0148c969-e41d-4b1e-9509-cbffd3a1574a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:33.929530 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-0148c969-e41d-4b1e-9509-cbffd3a1574a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance 4b1cd26e-bb18-4119-a747-e73ad8a39343 could not be found. May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0148c969-e41d-4b1e-9509-cbffd3a1574a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 HTTP/1.1 May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 4b1cd26e-bb18-4119-a747-e73ad8a39343 could not be found. May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '4b1cd26e-bb18-4119-a747-e73ad8a39343'} May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b1cd26e-bb18-4119-a747-e73ad8a39343 could not be found. May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b1cd26e-bb18-4119-a747-e73ad8a39343 could not be found. May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:33.931427 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:33.936193 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:33.936193 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:33.936193 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:33.936193 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:21:33.936193 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:21:33.936193 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b1cd26e-bb18-4119-a747-e73ad8a39343 could not be found. May 21 21:21:33.936193 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:33.936193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0148c969-e41d-4b1e-9509-cbffd3a1574a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance 4b1cd26e-bb18-4119-a747-e73ad8a39343 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:21:33.936193 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0148c969-e41d-4b1e-9509-cbffd3a1574a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 404 len: 111 microversion: 2.1 time: 0.046249 May 21 21:21:33.936193 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1418/2913] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:33 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:21:34.058714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b8acf3d0-49a9-4b3d-a7ae-334ab603833f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-294130888", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "f95b9f39-db04-49ea-b57f-7951c8f566a9"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:34.111221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-b8acf3d0-49a9-4b3d-a7ae-334ab603833f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] validate_networks() for [('f95b9f39-db04-49ea-b57f-7951c8f566a9', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:21:34.324057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e0c3c345-b2dc-4e74-ba25-9ed07aa3a237 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:34.325335 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e0c3c345-b2dc-4e74-ba25-9ed07aa3a237 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:34.326112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e0c3c345-b2dc-4e74-ba25-9ed07aa3a237 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Searching by: {'deleted': False, 'project_id': 'bc039eff465a4f068284e9b62e10b195'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:21:34.327882 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=12 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:34.332241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0c3c345-b2dc-4e74-ba25-9ed07aa3a237 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:34.332726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0c3c345-b2dc-4e74-ba25-9ed07aa3a237 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:34.333531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0c3c345-b2dc-4e74-ba25-9ed07aa3a237 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:34.333972 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0c3c345-b2dc-4e74-ba25-9ed07aa3a237 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:34.373921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-e0c3c345-b2dc-4e74-ba25-9ed07aa3a237 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:21:34.395873 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e0c3c345-b2dc-4e74-ba25-9ed07aa3a237 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.078170 May 21 21:21:34.396507 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1419/2914] 10.222.0.49 () {58 vars in 1124 bytes} [Sat May 21 21:21:34 2022] GET /compute/v2.1/servers => generated 334 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:21:34.410797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-34ad3714-34a0-4491-b933-921c73674fa2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:34.415809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-34ad3714-34a0-4491-b933-921c73674fa2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:34.417050 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-34ad3714-34a0-4491-b933-921c73674fa2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Searching by: {'deleted': False, 'project_id': 'bc039eff465a4f068284e9b62e10b195'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:21:34.424328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34ad3714-34a0-4491-b933-921c73674fa2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:34.425226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34ad3714-34a0-4491-b933-921c73674fa2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:34.426247 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34ad3714-34a0-4491-b933-921c73674fa2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:34.426771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34ad3714-34a0-4491-b933-921c73674fa2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:34.478430 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-34ad3714-34a0-4491-b933-921c73674fa2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:21:34.537376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-34ad3714-34a0-4491-b933-921c73674fa2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:34.543847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34ad3714-34a0-4491-b933-921c73674fa2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:34.544392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34ad3714-34a0-4491-b933-921c73674fa2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:34.709003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-b8acf3d0-49a9-4b3d-a7ae-334ab603833f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:21:34.710738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-b8acf3d0-49a9-4b3d-a7ae-334ab603833f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:21:34.711296 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-b8acf3d0-49a9-4b3d-a7ae-334ab603833f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:21:34.711915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-b8acf3d0-49a9-4b3d-a7ae-334ab603833f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:21:34.712581 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-b8acf3d0-49a9-4b3d-a7ae-334ab603833f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:21:34.716493 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-34ad3714-34a0-4491-b933-921c73674fa2 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 0.311285 May 21 21:21:34.717089 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1420/2915] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:21:34 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:34.733317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a6cb3f09-9e0d-418c-8840-2e8ab7758635 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:34.734174 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a6cb3f09-9e0d-418c-8840-2e8ab7758635 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:34.737732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8acf3d0-49a9-4b3d-a7ae-334ab603833f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:34.738227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8acf3d0-49a9-4b3d-a7ae-334ab603833f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:34.739122 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8acf3d0-49a9-4b3d-a7ae-334ab603833f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:34.739570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8acf3d0-49a9-4b3d-a7ae-334ab603833f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:34.752523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a6cb3f09-9e0d-418c-8840-2e8ab7758635 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:34.753374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a6cb3f09-9e0d-418c-8840-2e8ab7758635 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:34.753977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a6cb3f09-9e0d-418c-8840-2e8ab7758635 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:34.754726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a6cb3f09-9e0d-418c-8840-2e8ab7758635 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:34.773141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-b8acf3d0-49a9-4b3d-a7ae-334ab603833f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Getting quotas for project 8c48385dc5c24377a7be24da93fc54d9. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:21:34.779495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-b8acf3d0-49a9-4b3d-a7ae-334ab603833f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Getting quotas for user c3e23800ab314cc28dc30330928d8454 and project 8c48385dc5c24377a7be24da93fc54d9. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:21:34.792552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b8acf3d0-49a9-4b3d-a7ae-334ab603833f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:21:34.796791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b8acf3d0-49a9-4b3d-a7ae-334ab603833f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:21:34.810296 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:34.963042 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b8acf3d0-49a9-4b3d-a7ae-334ab603833f tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908544 May 21 21:21:34.968716 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1496/2916] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:21:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:21:34.982823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5e806d91-f14b-4e74-92b0-2e940264898c tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:35.016835 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5e806d91-f14b-4e74-92b0-2e940264898c tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.047249 May 21 21:21:35.017429 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1497/2917] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:21:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:35.028407 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-be35ff10-8e53-4f35-bdcc-93d95be9882b tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:35.032630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-be35ff10-8e53-4f35-bdcc-93d95be9882b tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:35.034038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a6cb3f09-9e0d-418c-8840-2e8ab7758635 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:35.041042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be35ff10-8e53-4f35-bdcc-93d95be9882b tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:35.041577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be35ff10-8e53-4f35-bdcc-93d95be9882b tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:35.042502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be35ff10-8e53-4f35-bdcc-93d95be9882b tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:35.042995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be35ff10-8e53-4f35-bdcc-93d95be9882b tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:35.051651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a6cb3f09-9e0d-418c-8840-2e8ab7758635 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:35.053227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a6cb3f09-9e0d-418c-8840-2e8ab7758635 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:35.055145 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a6cb3f09-9e0d-418c-8840-2e8ab7758635 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.336730 May 21 21:21:35.055721 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1421/2918] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:34 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:35.075449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bbe4de45-bdc3-4d60-9219-9a4257e3f7c7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:35.076076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bbe4de45-bdc3-4d60-9219-9a4257e3f7c7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:35.142225 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bbe4de45-bdc3-4d60-9219-9a4257e3f7c7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:35.152035 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bbe4de45-bdc3-4d60-9219-9a4257e3f7c7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 200 len: 1214 microversion: 2.1 time: 0.080752 May 21 21:21:35.161966 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1422/2919] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:35 2022] GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:35.244433 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-be35ff10-8e53-4f35-bdcc-93d95be9882b tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c12cdb0dccf44b989a23724b1d87870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4473aa2ed54e1fafaf2f8b339bb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:35.254308 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-be35ff10-8e53-4f35-bdcc-93d95be9882b tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d" status: 200 len: 1351 microversion: 2.1 time: 0.231402 May 21 21:21:35.256156 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1498/2920] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:35 2022] GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d => generated 1351 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:35.287354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-f1103456-312f-478a-aa7d-a5ec6c3506ec req-ac2e8541-c056-42fd-a8a1-dff3366548db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "name": "network-vif-plugged", "status": "completed", "tag": "1a250478-2823-459d-8b34-27d5cf96fda6"}, {"server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "name": "network-vif-plugged", "status": "completed", "tag": "fb6fdb78-778e-40f4-b501-95a96aca53fe"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:35.302035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f1103456-312f-478a-aa7d-a5ec6c3506ec req-ac2e8541-c056-42fd-a8a1-dff3366548db service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:35.302035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f1103456-312f-478a-aa7d-a5ec6c3506ec req-ac2e8541-c056-42fd-a8a1-dff3366548db service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:35.310572 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-f1103456-312f-478a-aa7d-a5ec6c3506ec req-ac2e8541-c056-42fd-a8a1-dff3366548db service nova] Creating event network-vif-plugged:1a250478-2823-459d-8b34-27d5cf96fda6 for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:21:35.310854 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-f1103456-312f-478a-aa7d-a5ec6c3506ec req-ac2e8541-c056-42fd-a8a1-dff3366548db service nova] Creating event network-vif-plugged:fb6fdb78-778e-40f4-b501-95a96aca53fe for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:21:35.318219 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-f1103456-312f-478a-aa7d-a5ec6c3506ec req-ac2e8541-c056-42fd-a8a1-dff3366548db service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033556 May 21 21:21:35.318219 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1423/2921] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:35.504944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4f10c27c-93a9-452e-8bf6-8ee20401b6b9 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:35.505784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4f10c27c-93a9-452e-8bf6-8ee20401b6b9 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:35.513435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f10c27c-93a9-452e-8bf6-8ee20401b6b9 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:35.519945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f10c27c-93a9-452e-8bf6-8ee20401b6b9 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:35.521620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f10c27c-93a9-452e-8bf6-8ee20401b6b9 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:35.522441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f10c27c-93a9-452e-8bf6-8ee20401b6b9 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:35.576105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4f10c27c-93a9-452e-8bf6-8ee20401b6b9 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:21:35.864516 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4f10c27c-93a9-452e-8bf6-8ee20401b6b9 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 204 len: 0 microversion: 2.1 time: 0.363088 May 21 21:21:35.865275 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1499/2922] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:21:35 2022] DELETE /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:21:35.874400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c08905fe-35c6-49e9-a434-8cd4f576bf82 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:35.875145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c08905fe-35c6-49e9-a434-8cd4f576bf82 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:35.882083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c08905fe-35c6-49e9-a434-8cd4f576bf82 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:35.882548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c08905fe-35c6-49e9-a434-8cd4f576bf82 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:35.883343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c08905fe-35c6-49e9-a434-8cd4f576bf82 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:35.883812 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c08905fe-35c6-49e9-a434-8cd4f576bf82 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:35.955887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-94cfb321-2634-4a69-9bd2-4f98c722d26d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-695567895", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:36.018961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-94cfb321-2634-4a69-9bd2-4f98c722d26d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] validate_networks() for None {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:21:36.043159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c08905fe-35c6-49e9-a434-8cd4f576bf82 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:36.051013 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c08905fe-35c6-49e9-a434-8cd4f576bf82 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 200 len: 1702 microversion: 2.1 time: 0.180811 May 21 21:21:36.051579 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1500/2923] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:35 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 1702 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:36.082066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4e1d4f13-cba1-45bb-92bd-15cd8d628131 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:36.082600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4e1d4f13-cba1-45bb-92bd-15cd8d628131 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:36.089550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e1d4f13-cba1-45bb-92bd-15cd8d628131 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:36.089999 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e1d4f13-cba1-45bb-92bd-15cd8d628131 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:36.090764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e1d4f13-cba1-45bb-92bd-15cd8d628131 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:36.091205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e1d4f13-cba1-45bb-92bd-15cd8d628131 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:36.264349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-94cfb321-2634-4a69-9bd2-4f98c722d26d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:21:36.264895 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-94cfb321-2634-4a69-9bd2-4f98c722d26d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:21:36.265134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-94cfb321-2634-4a69-9bd2-4f98c722d26d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:21:36.265545 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-94cfb321-2634-4a69-9bd2-4f98c722d26d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:21:36.265954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-94cfb321-2634-4a69-9bd2-4f98c722d26d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:21:36.276189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94cfb321-2634-4a69-9bd2-4f98c722d26d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:36.276667 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94cfb321-2634-4a69-9bd2-4f98c722d26d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:36.277656 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94cfb321-2634-4a69-9bd2-4f98c722d26d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:36.278094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94cfb321-2634-4a69-9bd2-4f98c722d26d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:36.301242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-94cfb321-2634-4a69-9bd2-4f98c722d26d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:21:36.310961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-94cfb321-2634-4a69-9bd2-4f98c722d26d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for user 945ab557c0e24cfdbcab74684a5d5800 and project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:21:36.318314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4e1d4f13-cba1-45bb-92bd-15cd8d628131 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:36.325320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-94cfb321-2634-4a69-9bd2-4f98c722d26d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:21:36.327677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-94cfb321-2634-4a69-9bd2-4f98c722d26d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:21:36.328907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4e1d4f13-cba1-45bb-92bd-15cd8d628131 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:36.330500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4e1d4f13-cba1-45bb-92bd-15cd8d628131 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:36.331709 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4e1d4f13-cba1-45bb-92bd-15cd8d628131 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.254185 May 21 21:21:36.332521 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1501/2924] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:36 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:21:36.337248 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fe29d268-86e8-4460-8e9a-a1e45b2996b4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:36.337865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fe29d268-86e8-4460-8e9a-a1e45b2996b4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:36.343820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe29d268-86e8-4460-8e9a-a1e45b2996b4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:36.344314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe29d268-86e8-4460-8e9a-a1e45b2996b4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:36.345285 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe29d268-86e8-4460-8e9a-a1e45b2996b4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:36.345893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe29d268-86e8-4460-8e9a-a1e45b2996b4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:36.417737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fe29d268-86e8-4460-8e9a-a1e45b2996b4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:36.421569 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:36.425906 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fe29d268-86e8-4460-8e9a-a1e45b2996b4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 200 len: 1218 microversion: 2.1 time: 0.092272 May 21 21:21:36.426487 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1502/2925] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:36 2022] GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:36.431265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-48b22beb-d6c4-4773-abf4-7765843504d4 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:36.431888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-48b22beb-d6c4-4773-abf4-7765843504d4 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:36.437798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48b22beb-d6c4-4773-abf4-7765843504d4 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:36.438572 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48b22beb-d6c4-4773-abf4-7765843504d4 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:36.439533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48b22beb-d6c4-4773-abf4-7765843504d4 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:36.439986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48b22beb-d6c4-4773-abf4-7765843504d4 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:36.454732 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-94cfb321-2634-4a69-9bd2-4f98c722d26d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.630585 May 21 21:21:36.455383 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1424/2926] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:21:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:21:36.465993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3fb9912a-bbf4-4b18-abd8-109cd5278425 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:36.466748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3fb9912a-bbf4-4b18-abd8-109cd5278425 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:36.547918 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3fb9912a-bbf4-4b18-abd8-109cd5278425 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:36.563924 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3fb9912a-bbf4-4b18-abd8-109cd5278425 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1216 microversion: 2.1 time: 0.101361 May 21 21:21:36.573388 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1425/2927] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:36 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1216 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:36.622585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-48b22beb-d6c4-4773-abf4-7765843504d4 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c12cdb0dccf44b989a23724b1d87870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4473aa2ed54e1fafaf2f8b339bb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:36.631843 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-48b22beb-d6c4-4773-abf4-7765843504d4 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d" status: 200 len: 1351 microversion: 2.1 time: 0.204297 May 21 21:21:36.632475 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1503/2928] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:36 2022] GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d => generated 1351 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:37.068976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cb15cabc-57f1-4540-9759-2ba46bcab344 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:37.069601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cb15cabc-57f1-4540-9759-2ba46bcab344 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:37.076939 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb15cabc-57f1-4540-9759-2ba46bcab344 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:37.077404 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb15cabc-57f1-4540-9759-2ba46bcab344 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:37.078179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb15cabc-57f1-4540-9759-2ba46bcab344 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:37.078627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb15cabc-57f1-4540-9759-2ba46bcab344 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:37.228207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cb15cabc-57f1-4540-9759-2ba46bcab344 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:37.243825 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cb15cabc-57f1-4540-9759-2ba46bcab344 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 200 len: 1702 microversion: 2.1 time: 0.171740 May 21 21:21:37.243825 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1426/2929] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:37 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 1702 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:37.333852 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-9de9914f-145d-4e35-9b84-d1d5ec640531 req-87e8730c-bf3b-4c95-a19f-86df6701b1df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fd11a9f-6f38-4281-bbb1-747ed176df6d", "name": "network-vif-plugged", "status": "completed", "tag": "f5b2c3de-be0f-4b80-b734-600dc61538bd"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:37.344321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-9de9914f-145d-4e35-9b84-d1d5ec640531 req-87e8730c-bf3b-4c95-a19f-86df6701b1df service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:37.345893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-9de9914f-145d-4e35-9b84-d1d5ec640531 req-87e8730c-bf3b-4c95-a19f-86df6701b1df service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:37.351928 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cfcba0e7-b947-41ff-89dc-3ebf3f01630a tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:37.352675 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cfcba0e7-b947-41ff-89dc-3ebf3f01630a tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:37.356937 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-9de9914f-145d-4e35-9b84-d1d5ec640531 req-87e8730c-bf3b-4c95-a19f-86df6701b1df service nova] Creating event network-vif-plugged:f5b2c3de-be0f-4b80-b734-600dc61538bd for instance 9fd11a9f-6f38-4281-bbb1-747ed176df6d on nch1-master-1 May 21 21:21:37.359183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cfcba0e7-b947-41ff-89dc-3ebf3f01630a tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:37.359734 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cfcba0e7-b947-41ff-89dc-3ebf3f01630a tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:37.360656 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cfcba0e7-b947-41ff-89dc-3ebf3f01630a tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:37.361236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cfcba0e7-b947-41ff-89dc-3ebf3f01630a tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:37.361880 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-9de9914f-145d-4e35-9b84-d1d5ec640531 req-87e8730c-bf3b-4c95-a19f-86df6701b1df service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032098 May 21 21:21:37.362565 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1504/2930] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:37.442788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-efead457-887f-4b8e-808c-6f18ac14940c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:37.443503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-efead457-887f-4b8e-808c-6f18ac14940c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:37.451353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efead457-887f-4b8e-808c-6f18ac14940c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:37.451815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efead457-887f-4b8e-808c-6f18ac14940c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:37.453387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efead457-887f-4b8e-808c-6f18ac14940c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:37.453967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efead457-887f-4b8e-808c-6f18ac14940c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:37.607903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-efead457-887f-4b8e-808c-6f18ac14940c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:37.618026 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-efead457-887f-4b8e-808c-6f18ac14940c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 200 len: 1274 microversion: 2.1 time: 0.179483 May 21 21:21:37.629494 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1505/2931] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:37 2022] GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 1274 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:37.635645 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0efbaea0-3dde-4287-9e87-22bf293ce481 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:37.636447 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0efbaea0-3dde-4287-9e87-22bf293ce481 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:37.756133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0efbaea0-3dde-4287-9e87-22bf293ce481 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:37.764607 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0efbaea0-3dde-4287-9e87-22bf293ce481 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1216 microversion: 2.1 time: 0.133417 May 21 21:21:37.765441 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1506/2932] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:37 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1216 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:37.770310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c1f14072-c4f3-4253-b95b-da0d6ad51e91 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:37.771881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c1f14072-c4f3-4253-b95b-da0d6ad51e91 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:37.779651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1f14072-c4f3-4253-b95b-da0d6ad51e91 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:37.780531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1f14072-c4f3-4253-b95b-da0d6ad51e91 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:37.781886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1f14072-c4f3-4253-b95b-da0d6ad51e91 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:37.782558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1f14072-c4f3-4253-b95b-da0d6ad51e91 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:38.033556 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cfcba0e7-b947-41ff-89dc-3ebf3f01630a tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:38.042454 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cfcba0e7-b947-41ff-89dc-3ebf3f01630a tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:38.044240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cfcba0e7-b947-41ff-89dc-3ebf3f01630a tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:38.045879 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cfcba0e7-b947-41ff-89dc-3ebf3f01630a tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1879 microversion: 2.42 time: 0.698421 May 21 21:21:38.046706 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1427/2933] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:37 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1879 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:38.258226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aed9e84c-1671-496c-8bbe-e14fd0fae23a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:38.259714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-aed9e84c-1671-496c-8bbe-e14fd0fae23a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:38.271337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aed9e84c-1671-496c-8bbe-e14fd0fae23a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:38.271795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aed9e84c-1671-496c-8bbe-e14fd0fae23a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:38.273577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aed9e84c-1671-496c-8bbe-e14fd0fae23a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:38.273950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aed9e84c-1671-496c-8bbe-e14fd0fae23a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:38.378756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c1f14072-c4f3-4253-b95b-da0d6ad51e91 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c12cdb0dccf44b989a23724b1d87870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4473aa2ed54e1fafaf2f8b339bb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:38.387237 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c1f14072-c4f3-4253-b95b-da0d6ad51e91 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d" status: 200 len: 1351 microversion: 2.1 time: 0.620432 May 21 21:21:38.394069 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1507/2934] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:37 2022] GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d => generated 1351 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:38.528199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-aed9e84c-1671-496c-8bbe-e14fd0fae23a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:38.538860 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-aed9e84c-1671-496c-8bbe-e14fd0fae23a tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 200 len: 1702 microversion: 2.1 time: 0.285635 May 21 21:21:38.540043 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1428/2935] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:38 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 1702 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:38.636670 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f06603b9-2e9c-4e57-b3ab-f895f27ebf98 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:38.637322 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f06603b9-2e9c-4e57-b3ab-f895f27ebf98 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:38.645189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f06603b9-2e9c-4e57-b3ab-f895f27ebf98 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:38.645834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f06603b9-2e9c-4e57-b3ab-f895f27ebf98 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:38.646617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f06603b9-2e9c-4e57-b3ab-f895f27ebf98 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:38.647722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f06603b9-2e9c-4e57-b3ab-f895f27ebf98 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:38.730200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f06603b9-2e9c-4e57-b3ab-f895f27ebf98 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:38.738255 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f06603b9-2e9c-4e57-b3ab-f895f27ebf98 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 200 len: 1272 microversion: 2.1 time: 0.105595 May 21 21:21:38.738838 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1508/2936] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:38 2022] GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 1272 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:38.783009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1255588b-1f4e-4fdc-9ed0-2c451d3ee17d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:38.783730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1255588b-1f4e-4fdc-9ed0-2c451d3ee17d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:38.800371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1255588b-1f4e-4fdc-9ed0-2c451d3ee17d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:38.801097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1255588b-1f4e-4fdc-9ed0-2c451d3ee17d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:38.802082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1255588b-1f4e-4fdc-9ed0-2c451d3ee17d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:38.802715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1255588b-1f4e-4fdc-9ed0-2c451d3ee17d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:38.923255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1255588b-1f4e-4fdc-9ed0-2c451d3ee17d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:38.932269 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1255588b-1f4e-4fdc-9ed0-2c451d3ee17d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1212 microversion: 2.1 time: 0.154078 May 21 21:21:38.933534 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1429/2937] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:38 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1212 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:39.065402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d93191ae-e3e0-4736-92e8-0b733cce94b9 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:39.066580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d93191ae-e3e0-4736-92e8-0b733cce94b9 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:39.076045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d93191ae-e3e0-4736-92e8-0b733cce94b9 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:39.076860 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d93191ae-e3e0-4736-92e8-0b733cce94b9 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:39.077655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d93191ae-e3e0-4736-92e8-0b733cce94b9 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:39.078104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d93191ae-e3e0-4736-92e8-0b733cce94b9 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:39.248650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-81e6c804-4bd9-40c7-be4c-df905c7345d7 req-29b070db-81ef-41d0-9135-ea2d0fd6a06c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d45434b-365f-4365-be8d-6deb86191f5d", "name": "network-vif-deleted", "tag": "656ca91f-9485-4d21-afa8-cb10bd9cff2c"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:39.261273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-81e6c804-4bd9-40c7-be4c-df905c7345d7 req-29b070db-81ef-41d0-9135-ea2d0fd6a06c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:39.261727 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-81e6c804-4bd9-40c7-be4c-df905c7345d7 req-29b070db-81ef-41d0-9135-ea2d0fd6a06c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:39.277103 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-81e6c804-4bd9-40c7-be4c-df905c7345d7 req-29b070db-81ef-41d0-9135-ea2d0fd6a06c service nova] Creating event network-vif-deleted:656ca91f-9485-4d21-afa8-cb10bd9cff2c for instance 6d45434b-365f-4365-be8d-6deb86191f5d on nch2-master-1 May 21 21:21:39.283044 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-81e6c804-4bd9-40c7-be4c-df905c7345d7 req-29b070db-81ef-41d0-9135-ea2d0fd6a06c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043410 May 21 21:21:39.288576 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1430/2938] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:39.385014 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d93191ae-e3e0-4736-92e8-0b733cce94b9 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:39.395150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d93191ae-e3e0-4736-92e8-0b733cce94b9 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:39.397769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d93191ae-e3e0-4736-92e8-0b733cce94b9 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:39.399228 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d93191ae-e3e0-4736-92e8-0b733cce94b9 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 2836 microversion: 2.42 time: 0.338015 May 21 21:21:39.399566 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1509/2939] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:21:39 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 2836 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:21:39.412107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-98274102-6eea-4b67-8202-c6f244ce1591 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:39.413670 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-98274102-6eea-4b67-8202-c6f244ce1591 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:39.423034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3b8d0a2c-4590-4197-b939-31da5fbdf3e2 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:39.423507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3b8d0a2c-4590-4197-b939-31da5fbdf3e2 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:39.435009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98274102-6eea-4b67-8202-c6f244ce1591 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:39.435350 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98274102-6eea-4b67-8202-c6f244ce1591 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:39.436149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98274102-6eea-4b67-8202-c6f244ce1591 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:39.436354 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b8d0a2c-4590-4197-b939-31da5fbdf3e2 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:39.436623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98274102-6eea-4b67-8202-c6f244ce1591 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:39.437022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b8d0a2c-4590-4197-b939-31da5fbdf3e2 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:39.437836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b8d0a2c-4590-4197-b939-31da5fbdf3e2 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:39.438290 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b8d0a2c-4590-4197-b939-31da5fbdf3e2 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:39.638883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-98274102-6eea-4b67-8202-c6f244ce1591 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c12cdb0dccf44b989a23724b1d87870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4473aa2ed54e1fafaf2f8b339bb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:39.653728 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-98274102-6eea-4b67-8202-c6f244ce1591 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d" status: 200 len: 1351 microversion: 2.1 time: 0.245866 May 21 21:21:39.655034 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1431/2940] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:39 2022] GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d => generated 1351 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:39.664868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1dbcba6b-b960-4521-9eae-4d64281ab37f tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:39.665131 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3b8d0a2c-4590-4197-b939-31da5fbdf3e2 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.236133 May 21 21:21:39.666344 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1510/2941] 10.222.0.49 () {60 vars in 1315 bytes} [Sat May 21 21:21:39 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac/os-interface => generated 1831 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:21:39.667205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1dbcba6b-b960-4521-9eae-4d64281ab37f tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:39.681924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1dbcba6b-b960-4521-9eae-4d64281ab37f tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:39.682383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1dbcba6b-b960-4521-9eae-4d64281ab37f tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:39.683185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1dbcba6b-b960-4521-9eae-4d64281ab37f tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:39.695709 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1dbcba6b-b960-4521-9eae-4d64281ab37f tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:39.734848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1dbcba6b-b960-4521-9eae-4d64281ab37f tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:39.735760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1dbcba6b-b960-4521-9eae-4d64281ab37f tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:39.736413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-1dbcba6b-b960-4521-9eae-4d64281ab37f tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lazy-loading 'fault' on Instance uuid 6d45434b-365f-4365-be8d-6deb86191f5d {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:21:39.755084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-19826bcf-ae0d-4270-8fa1-12cdd4d90825 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:39.757103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-19826bcf-ae0d-4270-8fa1-12cdd4d90825 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:39.765608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19826bcf-ae0d-4270-8fa1-12cdd4d90825 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:39.766539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19826bcf-ae0d-4270-8fa1-12cdd4d90825 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:39.767572 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19826bcf-ae0d-4270-8fa1-12cdd4d90825 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:39.767999 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19826bcf-ae0d-4270-8fa1-12cdd4d90825 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:39.872213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1dbcba6b-b960-4521-9eae-4d64281ab37f tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e316b7ec96f14eedbd57fe097c9fce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc039eff465a4f068284e9b62e10b195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:39.896061 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1dbcba6b-b960-4521-9eae-4d64281ab37f tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 200 len: 1360 microversion: 2.1 time: 0.239007 May 21 21:21:39.897967 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1432/2942] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:39 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 1360 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:39.954076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a9bcc9e6-b275-4363-830f-8d26df7d4b44 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:39.955065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a9bcc9e6-b275-4363-830f-8d26df7d4b44 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:39.965632 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a9bcc9e6-b275-4363-830f-8d26df7d4b44 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:39.966501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a9bcc9e6-b275-4363-830f-8d26df7d4b44 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:39.967457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a9bcc9e6-b275-4363-830f-8d26df7d4b44 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:39.968226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a9bcc9e6-b275-4363-830f-8d26df7d4b44 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:40.097213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a9bcc9e6-b275-4363-830f-8d26df7d4b44 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:40.109284 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a9bcc9e6-b275-4363-830f-8d26df7d4b44 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1276 microversion: 2.1 time: 0.160954 May 21 21:21:40.109913 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1433/2943] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:39 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:40.448820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-19826bcf-ae0d-4270-8fa1-12cdd4d90825 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:40.461514 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-19826bcf-ae0d-4270-8fa1-12cdd4d90825 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 200 len: 1314 microversion: 2.1 time: 0.710225 May 21 21:21:40.462941 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1511/2944] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:39 2022] GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 1314 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:40.671045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a93c7a7f-35a0-4b95-bf2b-41af6f9139bf tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:40.671833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a93c7a7f-35a0-4b95-bf2b-41af6f9139bf tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:40.675643 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:40.681907 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a93c7a7f-35a0-4b95-bf2b-41af6f9139bf tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:40.682477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a93c7a7f-35a0-4b95-bf2b-41af6f9139bf tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:40.683321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a93c7a7f-35a0-4b95-bf2b-41af6f9139bf tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:40.683955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a93c7a7f-35a0-4b95-bf2b-41af6f9139bf tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:40.914968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9bf7e972-27e2-41e2-9c09-32565c5d605d tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:40.915589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9bf7e972-27e2-41e2-9c09-32565c5d605d tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] [instance: 6d45434b-365f-4365-be8d-6deb86191f5d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:40.932954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9bf7e972-27e2-41e2-9c09-32565c5d605d tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:40.933409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9bf7e972-27e2-41e2-9c09-32565c5d605d tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:40.934227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9bf7e972-27e2-41e2-9c09-32565c5d605d tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:40.934665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9bf7e972-27e2-41e2-9c09-32565c5d605d tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:40.935319 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a93c7a7f-35a0-4b95-bf2b-41af6f9139bf tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c12cdb0dccf44b989a23724b1d87870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4473aa2ed54e1fafaf2f8b339bb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:40.944482 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a93c7a7f-35a0-4b95-bf2b-41af6f9139bf tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d" status: 200 len: 1541 microversion: 2.1 time: 0.277323 May 21 21:21:40.945255 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1434/2945] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:40 2022] GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d => generated 1541 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:40.951749 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-9bf7e972-27e2-41e2-9c09-32565c5d605d tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] HTTP exception thrown: Instance 6d45434b-365f-4365-be8d-6deb86191f5d could not be found. May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9bf7e972-27e2-41e2-9c09-32565c5d605d tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Request method failure captured: May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d HTTP/1.1 May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVeYDgnI4JNKepJKkoL4i4zMwtfh4Y3wb6QwFL8RiSQLm5QpKFvrSvvj1-ji0NjqnSImCj0Il54gwZeDfZT1kYrGebihMzMg42DilvlJbChAuM547sdgPieUtc_iFIz7Q4FpmFgcHeKYvOhzPwCBjXScXSswhH9eqFntV2sObCn8U2U May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: bc039eff465a4f068284e9b62e10b195 May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersTestJSON-1089946658 May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bc039eff465a4f068284e9b62e10b195"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bc039eff465a4f068284e9b62e10b195"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bc039eff465a4f068284e9b62e10b195", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bc039eff465a4f068284e9b62e10b195"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersTestJSON-1089946658 May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: bc039eff465a4f068284e9b62e10b195 May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersTestJSON-1089946658 May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersTestJSON-1089946658-project May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: e316b7ec96f14eedbd57fe097c9fce0b May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersTestJSON-1089946658-project May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 6d45434b-365f-4365-be8d-6deb86191f5d could not be found. May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '6d45434b-365f-4365-be8d-6deb86191f5d'} May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d45434b-365f-4365-be8d-6deb86191f5d could not be found. May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d45434b-365f-4365-be8d-6deb86191f5d could not be found. May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:21:40.953939 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:40.958383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:40.958383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:40.958383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:21:40.958383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:21:40.958383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d45434b-365f-4365-be8d-6deb86191f5d could not be found. May 21 21:21:40.958383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:21:40.961392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9bf7e972-27e2-41e2-9c09-32565c5d605d tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Returning 404 to user: Instance 6d45434b-365f-4365-be8d-6deb86191f5d could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:21:40.962281 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9bf7e972-27e2-41e2-9c09-32565c5d605d tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d" status: 404 len: 111 microversion: 2.1 time: 0.051588 May 21 21:21:40.962885 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1512/2946] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:40 2022] GET /compute/v2.1/servers/6d45434b-365f-4365-be8d-6deb86191f5d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:21:40.966186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8dbdd938-9b46-4324-b75e-f3cb26c32fa2 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:40.966727 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8dbdd938-9b46-4324-b75e-f3cb26c32fa2 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:40.972541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-53dce4f0-9d6e-4245-83a5-99a8e78c5a77 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] Calling method '.version_select at 0x7fc81a9dbb80>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:40.974682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8dbdd938-9b46-4324-b75e-f3cb26c32fa2 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:40.975970 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8dbdd938-9b46-4324-b75e-f3cb26c32fa2 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:40.977724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8dbdd938-9b46-4324-b75e-f3cb26c32fa2 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:40.978494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8dbdd938-9b46-4324-b75e-f3cb26c32fa2 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:41.074096 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-53dce4f0-9d6e-4245-83a5-99a8e78c5a77 tempest-ServersTestJSON-1089946658 tempest-ServersTestJSON-1089946658-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2118406534" status: 202 len: 0 microversion: 2.1 time: 0.106796 May 21 21:21:41.074966 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1513/2947] 10.222.0.49 () {58 vars in 1220 bytes} [Sat May 21 21:21:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2118406534 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 21 21:21:41.127396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4f280b04-83ca-4aa8-9cf6-1fb074938b13 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:41.128230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4f280b04-83ca-4aa8-9cf6-1fb074938b13 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:41.136397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f280b04-83ca-4aa8-9cf6-1fb074938b13 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:41.136990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f280b04-83ca-4aa8-9cf6-1fb074938b13 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:41.137922 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f280b04-83ca-4aa8-9cf6-1fb074938b13 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:41.138453 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f280b04-83ca-4aa8-9cf6-1fb074938b13 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:41.164133 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8dbdd938-9b46-4324-b75e-f3cb26c32fa2 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.203000 May 21 21:21:41.173853 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1435/2948] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 21:21:40 2022] GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d/os-interface => generated 285 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:41.321925 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4f280b04-83ca-4aa8-9cf6-1fb074938b13 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:41.340109 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4f280b04-83ca-4aa8-9cf6-1fb074938b13 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1274 microversion: 2.1 time: 0.216039 May 21 21:21:41.341176 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1514/2949] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:41 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1274 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:41.483767 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d9a13a38-562e-4fbb-82f7-98d3fea20eb1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:41.485239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d9a13a38-562e-4fbb-82f7-98d3fea20eb1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:41.515570 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9a13a38-562e-4fbb-82f7-98d3fea20eb1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:41.516009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-799a790d-1579-4961-bbb9-6701613247b0 req-c26f89bf-970d-4eae-96a2-440d3d94a902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "tag": "fb6fdb78-778e-40f4-b501-95a96aca53fe"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:41.517703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9a13a38-562e-4fbb-82f7-98d3fea20eb1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:41.518514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9a13a38-562e-4fbb-82f7-98d3fea20eb1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:41.520253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9a13a38-562e-4fbb-82f7-98d3fea20eb1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:41.541774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-799a790d-1579-4961-bbb9-6701613247b0 req-c26f89bf-970d-4eae-96a2-440d3d94a902 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:41.542236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-799a790d-1579-4961-bbb9-6701613247b0 req-c26f89bf-970d-4eae-96a2-440d3d94a902 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:41.562524 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-799a790d-1579-4961-bbb9-6701613247b0 req-c26f89bf-970d-4eae-96a2-440d3d94a902 service nova] Creating event network-changed:fb6fdb78-778e-40f4-b501-95a96aca53fe for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:21:41.570445 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-799a790d-1579-4961-bbb9-6701613247b0 req-c26f89bf-970d-4eae-96a2-440d3d94a902 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060881 May 21 21:21:41.571397 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1515/2950] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:21:41.577532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-c21bba39-baff-4074-81b6-1c30a21588ec req-d3988367-afd9-4a40-ad54-023739577d1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9975900-222e-4cd4-bd6e-c67c60a504c0", "tag": "946ddca3-fc0a-42ce-8743-6f61e94df3eb"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:41.587731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c21bba39-baff-4074-81b6-1c30a21588ec req-d3988367-afd9-4a40-ad54-023739577d1e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:41.588444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c21bba39-baff-4074-81b6-1c30a21588ec req-d3988367-afd9-4a40-ad54-023739577d1e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:41.622526 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-c21bba39-baff-4074-81b6-1c30a21588ec req-d3988367-afd9-4a40-ad54-023739577d1e service nova] Creating event network-changed:946ddca3-fc0a-42ce-8743-6f61e94df3eb for instance f9975900-222e-4cd4-bd6e-c67c60a504c0 on nch1-master-1 May 21 21:21:41.629166 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-c21bba39-baff-4074-81b6-1c30a21588ec req-d3988367-afd9-4a40-ad54-023739577d1e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055802 May 21 21:21:41.645942 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1516/2951] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:42.146085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d9a13a38-562e-4fbb-82f7-98d3fea20eb1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:42.163839 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d9a13a38-562e-4fbb-82f7-98d3fea20eb1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 200 len: 1314 microversion: 2.1 time: 0.687948 May 21 21:21:42.172736 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1436/2952] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:41 2022] GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 1314 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:42.361737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7a66477c-086e-4023-beb4-7430c1eb7de4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:42.363007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7a66477c-086e-4023-beb4-7430c1eb7de4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:42.372948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a66477c-086e-4023-beb4-7430c1eb7de4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:42.373820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a66477c-086e-4023-beb4-7430c1eb7de4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:42.375328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a66477c-086e-4023-beb4-7430c1eb7de4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:42.376615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a66477c-086e-4023-beb4-7430c1eb7de4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:42.589467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7a66477c-086e-4023-beb4-7430c1eb7de4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:42.602795 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7a66477c-086e-4023-beb4-7430c1eb7de4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1274 microversion: 2.1 time: 0.246574 May 21 21:21:42.604776 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1517/2953] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:42 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1274 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:43.199973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0fffee71-fe5b-4ce4-80aa-3099ee77dfe4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:43.200679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0fffee71-fe5b-4ce4-80aa-3099ee77dfe4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:43.217986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fffee71-fe5b-4ce4-80aa-3099ee77dfe4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:43.218441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fffee71-fe5b-4ce4-80aa-3099ee77dfe4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:43.219234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fffee71-fe5b-4ce4-80aa-3099ee77dfe4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:43.221830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fffee71-fe5b-4ce4-80aa-3099ee77dfe4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:43.622628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0108cfc8-e39b-4712-aeba-9b47323fc244 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:43.623227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0108cfc8-e39b-4712-aeba-9b47323fc244 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:43.630856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0108cfc8-e39b-4712-aeba-9b47323fc244 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:43.631283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0108cfc8-e39b-4712-aeba-9b47323fc244 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:43.634227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0108cfc8-e39b-4712-aeba-9b47323fc244 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:43.634843 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0108cfc8-e39b-4712-aeba-9b47323fc244 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:43.712640 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0fffee71-fe5b-4ce4-80aa-3099ee77dfe4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:43.716693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:43.721352 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0fffee71-fe5b-4ce4-80aa-3099ee77dfe4 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 200 len: 1314 microversion: 2.1 time: 0.535394 May 21 21:21:43.721951 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1437/2954] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:43 2022] GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:43.899358 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0108cfc8-e39b-4712-aeba-9b47323fc244 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:43.907449 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0108cfc8-e39b-4712-aeba-9b47323fc244 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1316 microversion: 2.1 time: 0.288704 May 21 21:21:43.920729 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1518/2955] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:43 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:43.977457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-46ab0f48-ab98-49b5-852b-57af543b7914 req-c33d9adf-2f76-4f7c-b9c9-5f36a8fe0389 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fd11a9f-6f38-4281-bbb1-747ed176df6d", "tag": "f5b2c3de-be0f-4b80-b734-600dc61538bd"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:43.986552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-46ab0f48-ab98-49b5-852b-57af543b7914 req-c33d9adf-2f76-4f7c-b9c9-5f36a8fe0389 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:43.987152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-46ab0f48-ab98-49b5-852b-57af543b7914 req-c33d9adf-2f76-4f7c-b9c9-5f36a8fe0389 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:44.000030 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-46ab0f48-ab98-49b5-852b-57af543b7914 req-c33d9adf-2f76-4f7c-b9c9-5f36a8fe0389 service nova] Creating event network-changed:f5b2c3de-be0f-4b80-b734-600dc61538bd for instance 9fd11a9f-6f38-4281-bbb1-747ed176df6d on nch1-master-1 May 21 21:21:44.010772 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-46ab0f48-ab98-49b5-852b-57af543b7914 req-c33d9adf-2f76-4f7c-b9c9-5f36a8fe0389 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031929 May 21 21:21:44.010772 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1438/2956] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:44.739546 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e7f6c8d3-bf1b-4153-8178-f54fe879201c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:44.741215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e7f6c8d3-bf1b-4153-8178-f54fe879201c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:44.749059 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7f6c8d3-bf1b-4153-8178-f54fe879201c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:44.749682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7f6c8d3-bf1b-4153-8178-f54fe879201c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:44.750743 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7f6c8d3-bf1b-4153-8178-f54fe879201c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:44.751326 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7f6c8d3-bf1b-4153-8178-f54fe879201c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:44.756564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:44.926941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-00b9ac2f-4a6d-41b8-b641-034fc04c8010 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:44.927655 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-00b9ac2f-4a6d-41b8-b641-034fc04c8010 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:44.935059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00b9ac2f-4a6d-41b8-b641-034fc04c8010 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:44.935786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00b9ac2f-4a6d-41b8-b641-034fc04c8010 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:44.936823 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00b9ac2f-4a6d-41b8-b641-034fc04c8010 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:44.937421 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00b9ac2f-4a6d-41b8-b641-034fc04c8010 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:45.117381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e7f6c8d3-bf1b-4153-8178-f54fe879201c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:45.128772 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e7f6c8d3-bf1b-4153-8178-f54fe879201c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 200 len: 1314 microversion: 2.1 time: 0.391448 May 21 21:21:45.130563 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1519/2957] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:44 2022] GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:45.287371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-00b9ac2f-4a6d-41b8-b641-034fc04c8010 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:45.303602 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-00b9ac2f-4a6d-41b8-b641-034fc04c8010 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1316 microversion: 2.1 time: 0.376953 May 21 21:21:45.304058 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1439/2958] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:44 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:46.027729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-cdad9f84-e9ab-4d05-9186-62bd492bb742 req-d70b6b2f-8074-4070-8253-a4f8854cc1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2402f588-3d04-418d-ac2d-d38d77c92205", "tag": "07cc5127-42d1-43e3-bab2-5dd19189b67c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:46.045041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cdad9f84-e9ab-4d05-9186-62bd492bb742 req-d70b6b2f-8074-4070-8253-a4f8854cc1b7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:46.045498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cdad9f84-e9ab-4d05-9186-62bd492bb742 req-d70b6b2f-8074-4070-8253-a4f8854cc1b7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:46.082691 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-cdad9f84-e9ab-4d05-9186-62bd492bb742 req-d70b6b2f-8074-4070-8253-a4f8854cc1b7 service nova] Creating event network-changed:07cc5127-42d1-43e3-bab2-5dd19189b67c for instance 2402f588-3d04-418d-ac2d-d38d77c92205 on nch1-master-1 May 21 21:21:46.094695 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-cdad9f84-e9ab-4d05-9186-62bd492bb742 req-d70b6b2f-8074-4070-8253-a4f8854cc1b7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072922 May 21 21:21:46.098328 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1520/2959] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:46.149252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aabc9b1c-04ae-4c52-9614-8826f2e357f1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:46.151111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-aabc9b1c-04ae-4c52-9614-8826f2e357f1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:46.162189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aabc9b1c-04ae-4c52-9614-8826f2e357f1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:46.162652 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aabc9b1c-04ae-4c52-9614-8826f2e357f1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:46.163627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aabc9b1c-04ae-4c52-9614-8826f2e357f1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:46.164725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aabc9b1c-04ae-4c52-9614-8826f2e357f1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:46.288566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=10 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:46.320430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a1d70c08-bb5d-4aa0-8411-62dd8fdc480b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:46.321133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a1d70c08-bb5d-4aa0-8411-62dd8fdc480b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:46.328244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1d70c08-bb5d-4aa0-8411-62dd8fdc480b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:46.328733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1d70c08-bb5d-4aa0-8411-62dd8fdc480b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:46.329591 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1d70c08-bb5d-4aa0-8411-62dd8fdc480b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:46.330032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1d70c08-bb5d-4aa0-8411-62dd8fdc480b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:46.408269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-aabc9b1c-04ae-4c52-9614-8826f2e357f1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:46.422473 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-aabc9b1c-04ae-4c52-9614-8826f2e357f1 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 200 len: 1314 microversion: 2.1 time: 0.279254 May 21 21:21:46.425007 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1440/2960] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:46 2022] GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:46.620872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a1d70c08-bb5d-4aa0-8411-62dd8fdc480b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:46.639498 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a1d70c08-bb5d-4aa0-8411-62dd8fdc480b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1316 microversion: 2.1 time: 0.324201 May 21 21:21:46.640652 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1521/2961] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:46 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:47.441497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-69a88c33-8e68-4195-81a5-29f9194b7381 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:47.442129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-69a88c33-8e68-4195-81a5-29f9194b7381 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:47.446140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=12 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:47.463302 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69a88c33-8e68-4195-81a5-29f9194b7381 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:47.464791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69a88c33-8e68-4195-81a5-29f9194b7381 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:47.465991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69a88c33-8e68-4195-81a5-29f9194b7381 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:47.466445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69a88c33-8e68-4195-81a5-29f9194b7381 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:47.659211 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0507429f-1ebb-4692-be6b-939ea91de7d4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:47.660102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0507429f-1ebb-4692-be6b-939ea91de7d4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:47.667402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0507429f-1ebb-4692-be6b-939ea91de7d4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:47.667847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0507429f-1ebb-4692-be6b-939ea91de7d4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:47.668712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0507429f-1ebb-4692-be6b-939ea91de7d4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:47.669323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0507429f-1ebb-4692-be6b-939ea91de7d4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:47.677373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-69a88c33-8e68-4195-81a5-29f9194b7381 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:47.688593 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-69a88c33-8e68-4195-81a5-29f9194b7381 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 200 len: 1314 microversion: 2.1 time: 0.251903 May 21 21:21:47.689402 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1441/2962] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:47 2022] GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:47.761570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=10 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:47.871216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0507429f-1ebb-4692-be6b-939ea91de7d4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:47.875937 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0507429f-1ebb-4692-be6b-939ea91de7d4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1316 microversion: 2.1 time: 0.221707 May 21 21:21:47.889361 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1522/2963] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:47 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:48.707466 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-230ddef7-79ea-4e8c-b471-b47ed6bc8166 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:48.708095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-230ddef7-79ea-4e8c-b471-b47ed6bc8166 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:48.717342 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-230ddef7-79ea-4e8c-b471-b47ed6bc8166 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:48.718034 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-230ddef7-79ea-4e8c-b471-b47ed6bc8166 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:48.719227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-230ddef7-79ea-4e8c-b471-b47ed6bc8166 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:48.719678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-230ddef7-79ea-4e8c-b471-b47ed6bc8166 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:48.871754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-230ddef7-79ea-4e8c-b471-b47ed6bc8166 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:48.876827 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-94a92f84-fb7b-40f8-8465-c5f6830f8330 req-f4045fd3-bc38-4524-ba8b-57e19ce3615e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9975900-222e-4cd4-bd6e-c67c60a504c0", "name": "network-vif-plugged", "status": "completed", "tag": "946ddca3-fc0a-42ce-8743-6f61e94df3eb"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:48.880376 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-230ddef7-79ea-4e8c-b471-b47ed6bc8166 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 200 len: 1314 microversion: 2.1 time: 0.176916 May 21 21:21:48.882293 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1442/2964] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:48 2022] GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:48.896028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fd0413b0-939c-4153-b179-852418485965 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:48.896275 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-94a92f84-fb7b-40f8-8465-c5f6830f8330 req-f4045fd3-bc38-4524-ba8b-57e19ce3615e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:48.896843 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-94a92f84-fb7b-40f8-8465-c5f6830f8330 req-f4045fd3-bc38-4524-ba8b-57e19ce3615e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:48.897127 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fd0413b0-939c-4153-b179-852418485965 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:48.903624 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fd0413b0-939c-4153-b179-852418485965 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:48.904516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fd0413b0-939c-4153-b179-852418485965 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:48.905079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fd0413b0-939c-4153-b179-852418485965 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:48.905602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fd0413b0-939c-4153-b179-852418485965 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:48.911013 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-94a92f84-fb7b-40f8-8465-c5f6830f8330 req-f4045fd3-bc38-4524-ba8b-57e19ce3615e service nova] Creating event network-vif-plugged:946ddca3-fc0a-42ce-8743-6f61e94df3eb for instance f9975900-222e-4cd4-bd6e-c67c60a504c0 on nch1-master-1 May 21 21:21:48.915912 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-94a92f84-fb7b-40f8-8465-c5f6830f8330 req-f4045fd3-bc38-4524-ba8b-57e19ce3615e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043217 May 21 21:21:48.916554 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1523/2965] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:49.419393 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fd0413b0-939c-4153-b179-852418485965 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:49.434248 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fd0413b0-939c-4153-b179-852418485965 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1316 microversion: 2.1 time: 0.541737 May 21 21:21:49.434850 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1443/2966] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:48 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1316 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:49.906124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b649ab71-c5b2-42ce-a29b-7a59290b8213 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:49.908165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b649ab71-c5b2-42ce-a29b-7a59290b8213 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:49.918921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b649ab71-c5b2-42ce-a29b-7a59290b8213 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:49.919681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b649ab71-c5b2-42ce-a29b-7a59290b8213 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:49.921155 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b649ab71-c5b2-42ce-a29b-7a59290b8213 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:49.921669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b649ab71-c5b2-42ce-a29b-7a59290b8213 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:50.351684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b649ab71-c5b2-42ce-a29b-7a59290b8213 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:50.369715 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b649ab71-c5b2-42ce-a29b-7a59290b8213 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 200 len: 1314 microversion: 2.1 time: 0.472846 May 21 21:21:50.371295 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1524/2967] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:49 2022] GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 1314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:50.452787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e5473004-9484-4c7f-870a-2bcc3c9e6166 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:50.453471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e5473004-9484-4c7f-870a-2bcc3c9e6166 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:50.461625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e5473004-9484-4c7f-870a-2bcc3c9e6166 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:50.462070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e5473004-9484-4c7f-870a-2bcc3c9e6166 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:50.462941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e5473004-9484-4c7f-870a-2bcc3c9e6166 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:50.463663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e5473004-9484-4c7f-870a-2bcc3c9e6166 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:50.637849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e5473004-9484-4c7f-870a-2bcc3c9e6166 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:50.651409 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e5473004-9484-4c7f-870a-2bcc3c9e6166 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1316 microversion: 2.1 time: 0.200637 May 21 21:21:50.652387 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1444/2968] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:50 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:51.390551 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-07d24a1f-4286-4f45-b22d-893cff1d4067 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:51.391926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-07d24a1f-4286-4f45-b22d-893cff1d4067 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:51.409582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07d24a1f-4286-4f45-b22d-893cff1d4067 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:51.410038 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07d24a1f-4286-4f45-b22d-893cff1d4067 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:51.410840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07d24a1f-4286-4f45-b22d-893cff1d4067 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:51.411276 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07d24a1f-4286-4f45-b22d-893cff1d4067 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:51.641347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-07d24a1f-4286-4f45-b22d-893cff1d4067 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:51.647920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:51.654928 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-07d24a1f-4286-4f45-b22d-893cff1d4067 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 200 len: 1500 microversion: 2.1 time: 0.269271 May 21 21:21:51.657181 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1525/2969] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:51 2022] GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 1500 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:51.668906 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-17c1ee1d-b282-451d-ba87-b93c19e69e40 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:51.669526 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-17c1ee1d-b282-451d-ba87-b93c19e69e40 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:51.676167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17c1ee1d-b282-451d-ba87-b93c19e69e40 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:51.678379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1b7981b9-78aa-4b12-bb4f-1ebe76bb0130 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:51.679139 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1b7981b9-78aa-4b12-bb4f-1ebe76bb0130 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:51.680318 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17c1ee1d-b282-451d-ba87-b93c19e69e40 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:51.681173 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17c1ee1d-b282-451d-ba87-b93c19e69e40 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:51.681628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17c1ee1d-b282-451d-ba87-b93c19e69e40 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:51.685540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1b7981b9-78aa-4b12-bb4f-1ebe76bb0130 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:51.686000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1b7981b9-78aa-4b12-bb4f-1ebe76bb0130 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:51.686868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1b7981b9-78aa-4b12-bb4f-1ebe76bb0130 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:51.687385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1b7981b9-78aa-4b12-bb4f-1ebe76bb0130 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:51.713554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-1b7981b9-78aa-4b12-bb4f-1ebe76bb0130 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lazy-loading 'flavor' on Instance uuid f9975900-222e-4cd4-bd6e-c67c60a504c0 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:21:51.969637 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-17c1ee1d-b282-451d-ba87-b93c19e69e40 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:51.978303 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-17c1ee1d-b282-451d-ba87-b93c19e69e40 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1316 microversion: 2.1 time: 0.313239 May 21 21:21:51.978889 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1445/2970] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:51 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:52.004832 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1b7981b9-78aa-4b12-bb4f-1ebe76bb0130 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "POST /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0/action" status: 202 len: 0 microversion: 2.1 time: 0.330889 May 21 21:21:52.006196 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1526/2971] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:21:51 2022] POST /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:21:52.014541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-018e673e-6e4b-417a-9970-2e71a2fca91b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:52.015289 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-018e673e-6e4b-417a-9970-2e71a2fca91b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:52.022563 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-018e673e-6e4b-417a-9970-2e71a2fca91b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:52.023012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-018e673e-6e4b-417a-9970-2e71a2fca91b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:52.023804 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-018e673e-6e4b-417a-9970-2e71a2fca91b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:52.024250 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-018e673e-6e4b-417a-9970-2e71a2fca91b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:52.214244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-018e673e-6e4b-417a-9970-2e71a2fca91b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:52.225861 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-018e673e-6e4b-417a-9970-2e71a2fca91b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 200 len: 1508 microversion: 2.1 time: 0.215114 May 21 21:21:52.239679 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1446/2972] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:52 2022] GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 1508 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:52.524138 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2a0d754d-1634-47f6-9af6-dab808bfee3b tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1002670546", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "6d9aed3d-ec5c-4b34-a57a-6481b29d6287"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:52.580763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-2a0d754d-1634-47f6-9af6-dab808bfee3b tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] validate_networks() for [('6d9aed3d-ec5c-4b34-a57a-6481b29d6287', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:21:52.896801 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-a836097e-cdba-410d-82e4-34ebaae3eee1 req-c20d2886-0a13-47ad-8f8c-d58c6d463db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2402f588-3d04-418d-ac2d-d38d77c92205", "name": "network-vif-plugged", "status": "completed", "tag": "07cc5127-42d1-43e3-bab2-5dd19189b67c"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:52.907557 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a836097e-cdba-410d-82e4-34ebaae3eee1 req-c20d2886-0a13-47ad-8f8c-d58c6d463db7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:52.912643 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a836097e-cdba-410d-82e4-34ebaae3eee1 req-c20d2886-0a13-47ad-8f8c-d58c6d463db7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:52.920877 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-a836097e-cdba-410d-82e4-34ebaae3eee1 req-c20d2886-0a13-47ad-8f8c-d58c6d463db7 service nova] Creating event network-vif-plugged:07cc5127-42d1-43e3-bab2-5dd19189b67c for instance 2402f588-3d04-418d-ac2d-d38d77c92205 on nch1-master-1 May 21 21:21:52.925886 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-a836097e-cdba-410d-82e4-34ebaae3eee1 req-c20d2886-0a13-47ad-8f8c-d58c6d463db7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033806 May 21 21:21:52.926564 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1447/2973] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:52.997111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a2bd103c-7909-4706-b081-417df7d7a0f5 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:52.998524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a2bd103c-7909-4706-b081-417df7d7a0f5 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:53.011851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2bd103c-7909-4706-b081-417df7d7a0f5 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:53.011851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2bd103c-7909-4706-b081-417df7d7a0f5 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:53.011851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2bd103c-7909-4706-b081-417df7d7a0f5 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:53.012750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2bd103c-7909-4706-b081-417df7d7a0f5 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:53.087428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-2a0d754d-1634-47f6-9af6-dab808bfee3b tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:21:53.088075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-2a0d754d-1634-47f6-9af6-dab808bfee3b tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:21:53.088918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-2a0d754d-1634-47f6-9af6-dab808bfee3b tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:21:53.089515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-2a0d754d-1634-47f6-9af6-dab808bfee3b tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:21:53.090100 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-2a0d754d-1634-47f6-9af6-dab808bfee3b tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:21:53.108543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a0d754d-1634-47f6-9af6-dab808bfee3b tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:53.110740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a0d754d-1634-47f6-9af6-dab808bfee3b tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:53.110740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a0d754d-1634-47f6-9af6-dab808bfee3b tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:53.110740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a0d754d-1634-47f6-9af6-dab808bfee3b tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:53.129751 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-2a0d754d-1634-47f6-9af6-dab808bfee3b tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Getting quotas for project 5ea414da0f424c348f190edade999c31. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:21:53.135775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-2a0d754d-1634-47f6-9af6-dab808bfee3b tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Getting quotas for user 14070cbc4d534f849ba72736b1617cf5 and project 5ea414da0f424c348f190edade999c31. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:21:53.149609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2a0d754d-1634-47f6-9af6-dab808bfee3b tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:21:53.152085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2a0d754d-1634-47f6-9af6-dab808bfee3b tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] [instance: 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:21:53.215534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a2bd103c-7909-4706-b081-417df7d7a0f5 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:53.223605 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a2bd103c-7909-4706-b081-417df7d7a0f5 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1316 microversion: 2.1 time: 0.231620 May 21 21:21:53.224873 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1448/2974] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:52 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1316 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:53.247109 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a3165422-c9a7-44ff-9655-c97146082118 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:53.247881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a3165422-c9a7-44ff-9655-c97146082118 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:53.254215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3165422-c9a7-44ff-9655-c97146082118 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:53.254525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3165422-c9a7-44ff-9655-c97146082118 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:53.255282 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3165422-c9a7-44ff-9655-c97146082118 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:53.255775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3165422-c9a7-44ff-9655-c97146082118 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:53.317640 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2a0d754d-1634-47f6-9af6-dab808bfee3b tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927281 May 21 21:21:53.319418 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1527/2975] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:21:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:21:53.331831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fe1a8912-349a-4cf2-8822-2af8bc654d19 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:53.332883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fe1a8912-349a-4cf2-8822-2af8bc654d19 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] [instance: 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:53.411601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fe1a8912-349a-4cf2-8822-2af8bc654d19 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14070cbc4d534f849ba72736b1617cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea414da0f424c348f190edade999c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:53.420153 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fe1a8912-349a-4cf2-8822-2af8bc654d19 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] 10.222.0.49 "GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d" status: 200 len: 1225 microversion: 2.1 time: 0.092477 May 21 21:21:53.428317 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1528/2976] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:53 2022] GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:53.445719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a3165422-c9a7-44ff-9655-c97146082118 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:53.455645 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a3165422-c9a7-44ff-9655-c97146082118 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 200 len: 1491 microversion: 2.1 time: 0.212066 May 21 21:21:53.456272 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1449/2977] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:53 2022] GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 1491 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:53.473091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e90583bf-f329-4cef-97f5-74da8b393556 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:53.473592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e90583bf-f329-4cef-97f5-74da8b393556 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:53.480826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e90583bf-f329-4cef-97f5-74da8b393556 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:53.481277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e90583bf-f329-4cef-97f5-74da8b393556 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:53.482118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e90583bf-f329-4cef-97f5-74da8b393556 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:53.482477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e90583bf-f329-4cef-97f5-74da8b393556 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:53.512316 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e90583bf-f329-4cef-97f5-74da8b393556 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:21:53.736923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:53.858477 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e90583bf-f329-4cef-97f5-74da8b393556 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 204 len: 0 microversion: 2.1 time: 0.388891 May 21 21:21:53.859066 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1529/2978] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:21:53 2022] DELETE /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:21:53.869342 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c866857b-6028-4280-9ec1-8df22dff47a2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:53.870115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c866857b-6028-4280-9ec1-8df22dff47a2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:53.876675 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c866857b-6028-4280-9ec1-8df22dff47a2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:53.877566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c866857b-6028-4280-9ec1-8df22dff47a2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:53.878539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c866857b-6028-4280-9ec1-8df22dff47a2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:53.879135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c866857b-6028-4280-9ec1-8df22dff47a2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:54.040592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c866857b-6028-4280-9ec1-8df22dff47a2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:54.049351 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c866857b-6028-4280-9ec1-8df22dff47a2 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 200 len: 1497 microversion: 2.1 time: 0.185889 May 21 21:21:54.050430 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1450/2979] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:53 2022] GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:54.243532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4bcf0329-567f-4010-8c7c-ea284a2a42b3 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:54.244353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4bcf0329-567f-4010-8c7c-ea284a2a42b3 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:54.250955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4bcf0329-567f-4010-8c7c-ea284a2a42b3 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:54.251413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4bcf0329-567f-4010-8c7c-ea284a2a42b3 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:54.252193 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4bcf0329-567f-4010-8c7c-ea284a2a42b3 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:54.252700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4bcf0329-567f-4010-8c7c-ea284a2a42b3 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:54.411685 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4bcf0329-567f-4010-8c7c-ea284a2a42b3 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:54.419438 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4bcf0329-567f-4010-8c7c-ea284a2a42b3 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1316 microversion: 2.1 time: 0.180213 May 21 21:21:54.420008 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1530/2980] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:54 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:54.437771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6caa5739-d103-4181-afbc-5a60c6d3d42a tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:54.438397 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6caa5739-d103-4181-afbc-5a60c6d3d42a tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] [instance: 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:54.499451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6caa5739-d103-4181-afbc-5a60c6d3d42a tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14070cbc4d534f849ba72736b1617cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea414da0f424c348f190edade999c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:54.506886 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6caa5739-d103-4181-afbc-5a60c6d3d42a tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] 10.222.0.49 "GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d" status: 200 len: 1225 microversion: 2.1 time: 0.073001 May 21 21:21:54.507784 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1451/2981] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:54 2022] GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d => generated 1225 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:55.066793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6e270a2c-6b1a-46d5-8723-2bbdb703ba3a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:55.067605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6e270a2c-6b1a-46d5-8723-2bbdb703ba3a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:55.074642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6e270a2c-6b1a-46d5-8723-2bbdb703ba3a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:55.075094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6e270a2c-6b1a-46d5-8723-2bbdb703ba3a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:55.075943 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6e270a2c-6b1a-46d5-8723-2bbdb703ba3a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:55.076491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6e270a2c-6b1a-46d5-8723-2bbdb703ba3a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:55.232480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6e270a2c-6b1a-46d5-8723-2bbdb703ba3a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:55.237952 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6e270a2c-6b1a-46d5-8723-2bbdb703ba3a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 200 len: 1497 microversion: 2.1 time: 0.175440 May 21 21:21:55.238618 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1531/2982] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:55 2022] GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:55.436725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8c741d82-c078-4191-a498-561bf207a83e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:55.437345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8c741d82-c078-4191-a498-561bf207a83e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:55.445883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c741d82-c078-4191-a498-561bf207a83e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:55.446343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c741d82-c078-4191-a498-561bf207a83e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:55.447164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c741d82-c078-4191-a498-561bf207a83e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:55.447614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c741d82-c078-4191-a498-561bf207a83e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:55.525145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-069d5651-bdd8-4a2d-8764-e5e0f1d1e263 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:55.526784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-069d5651-bdd8-4a2d-8764-e5e0f1d1e263 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] [instance: 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:55.536018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-069d5651-bdd8-4a2d-8764-e5e0f1d1e263 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:55.536540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-069d5651-bdd8-4a2d-8764-e5e0f1d1e263 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:55.537883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-069d5651-bdd8-4a2d-8764-e5e0f1d1e263 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:55.538340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-069d5651-bdd8-4a2d-8764-e5e0f1d1e263 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:55.608936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8c741d82-c078-4191-a498-561bf207a83e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:55.615069 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-069d5651-bdd8-4a2d-8764-e5e0f1d1e263 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14070cbc4d534f849ba72736b1617cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea414da0f424c348f190edade999c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:55.619163 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8c741d82-c078-4191-a498-561bf207a83e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1316 microversion: 2.1 time: 0.186387 May 21 21:21:55.620292 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1452/2983] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:55 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1316 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:55.623376 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-069d5651-bdd8-4a2d-8764-e5e0f1d1e263 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] 10.222.0.49 "GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d" status: 200 len: 1277 microversion: 2.1 time: 0.103356 May 21 21:21:55.624330 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1532/2984] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:55 2022] GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:56.260839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bc7018ae-3db7-4117-9067-6dd9673f8c2b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:56.261707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bc7018ae-3db7-4117-9067-6dd9673f8c2b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:56.269389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc7018ae-3db7-4117-9067-6dd9673f8c2b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:56.270069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc7018ae-3db7-4117-9067-6dd9673f8c2b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:56.271071 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc7018ae-3db7-4117-9067-6dd9673f8c2b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:56.272540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc7018ae-3db7-4117-9067-6dd9673f8c2b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:56.370932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-b53e935b-0611-4d31-be95-8e866e7bfc77 req-a1939d74-ba51-428e-814c-b260602c74b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9975900-222e-4cd4-bd6e-c67c60a504c0", "name": "network-vif-deleted", "tag": "946ddca3-fc0a-42ce-8743-6f61e94df3eb"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:56.379306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b53e935b-0611-4d31-be95-8e866e7bfc77 req-a1939d74-ba51-428e-814c-b260602c74b8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:56.379740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b53e935b-0611-4d31-be95-8e866e7bfc77 req-a1939d74-ba51-428e-814c-b260602c74b8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:56.392016 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-b53e935b-0611-4d31-be95-8e866e7bfc77 req-a1939d74-ba51-428e-814c-b260602c74b8 service nova] Creating event network-vif-deleted:946ddca3-fc0a-42ce-8743-6f61e94df3eb for instance f9975900-222e-4cd4-bd6e-c67c60a504c0 on nch1-master-1 May 21 21:21:56.397064 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-b53e935b-0611-4d31-be95-8e866e7bfc77 req-a1939d74-ba51-428e-814c-b260602c74b8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029931 May 21 21:21:56.397223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bc7018ae-3db7-4117-9067-6dd9673f8c2b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e23800ab314cc28dc30330928d8454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c48385dc5c24377a7be24da93fc54d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:56.397811 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1533/2985] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:21:56.406952 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bc7018ae-3db7-4117-9067-6dd9673f8c2b tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 200 len: 1455 microversion: 2.1 time: 0.155353 May 21 21:21:56.407720 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1453/2986] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:56 2022] GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 1455 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:56.641835 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-15994822-583a-474e-9bf8-1ef54c98a4ae tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:56.643133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-15994822-583a-474e-9bf8-1ef54c98a4ae tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:56.652850 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d7be7c77-9965-4496-ba7d-ae9e0a19f443 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:56.654322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d7be7c77-9965-4496-ba7d-ae9e0a19f443 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] [instance: 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:56.657187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15994822-583a-474e-9bf8-1ef54c98a4ae tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:56.658029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15994822-583a-474e-9bf8-1ef54c98a4ae tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:56.659412 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15994822-583a-474e-9bf8-1ef54c98a4ae tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:56.660244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15994822-583a-474e-9bf8-1ef54c98a4ae tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:56.675490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7be7c77-9965-4496-ba7d-ae9e0a19f443 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:56.676208 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7be7c77-9965-4496-ba7d-ae9e0a19f443 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:56.686148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7be7c77-9965-4496-ba7d-ae9e0a19f443 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:56.692307 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7be7c77-9965-4496-ba7d-ae9e0a19f443 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:56.868159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-15994822-583a-474e-9bf8-1ef54c98a4ae tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:56.876875 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-15994822-583a-474e-9bf8-1ef54c98a4ae tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1466 microversion: 2.1 time: 0.241909 May 21 21:21:56.877582 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1534/2987] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:56 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1466 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:56.931598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d7be7c77-9965-4496-ba7d-ae9e0a19f443 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14070cbc4d534f849ba72736b1617cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea414da0f424c348f190edade999c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:56.941751 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d7be7c77-9965-4496-ba7d-ae9e0a19f443 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] 10.222.0.49 "GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d" status: 200 len: 1325 microversion: 2.1 time: 0.298467 May 21 21:21:56.952946 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1454/2988] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:56 2022] GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d => generated 1325 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:57.154593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-08e64c19-a033-423e-96b5-a0e310729505 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:57.155208 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-08e64c19-a033-423e-96b5-a0e310729505 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:57.163831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08e64c19-a033-423e-96b5-a0e310729505 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.164428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08e64c19-a033-423e-96b5-a0e310729505 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.165167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08e64c19-a033-423e-96b5-a0e310729505 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.165617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08e64c19-a033-423e-96b5-a0e310729505 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.424112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-de8cbf6d-842d-4051-b3ba-9930a25305cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:57.424860 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-de8cbf6d-842d-4051-b3ba-9930a25305cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:57.432936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de8cbf6d-842d-4051-b3ba-9930a25305cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.433363 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de8cbf6d-842d-4051-b3ba-9930a25305cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.434166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de8cbf6d-842d-4051-b3ba-9930a25305cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.434619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de8cbf6d-842d-4051-b3ba-9930a25305cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.449935 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-de8cbf6d-842d-4051-b3ba-9930a25305cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance f9975900-222e-4cd4-bd6e-c67c60a504c0 could not be found. May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-de8cbf6d-842d-4051-b3ba-9930a25305cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 HTTP/1.1 May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance f9975900-222e-4cd4-bd6e-c67c60a504c0 could not be found. May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'f9975900-222e-4cd4-bd6e-c67c60a504c0'} May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9975900-222e-4cd4-bd6e-c67c60a504c0 could not be found. May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9975900-222e-4cd4-bd6e-c67c60a504c0 could not be found. May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.451904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.455979 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.455979 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.455979 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.455979 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:21:57.455979 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:21:57.455979 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9975900-222e-4cd4-bd6e-c67c60a504c0 could not be found. May 21 21:21:57.455979 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.457194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-de8cbf6d-842d-4051-b3ba-9930a25305cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance f9975900-222e-4cd4-bd6e-c67c60a504c0 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:21:57.458065 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-de8cbf6d-842d-4051-b3ba-9930a25305cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 404 len: 111 microversion: 2.1 time: 0.038451 May 21 21:21:57.458626 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1455/2989] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:57 2022] GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:21:57.470384 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5420f080-43cd-410c-b74f-e72fdbd11236 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:57.471148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5420f080-43cd-410c-b74f-e72fdbd11236 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:57.478674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5420f080-43cd-410c-b74f-e72fdbd11236 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.479233 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5420f080-43cd-410c-b74f-e72fdbd11236 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.480029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5420f080-43cd-410c-b74f-e72fdbd11236 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.480709 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5420f080-43cd-410c-b74f-e72fdbd11236 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.497262 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-5420f080-43cd-410c-b74f-e72fdbd11236 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance f9975900-222e-4cd4-bd6e-c67c60a504c0 could not be found. May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5420f080-43cd-410c-b74f-e72fdbd11236 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 HTTP/1.1 May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance f9975900-222e-4cd4-bd6e-c67c60a504c0 could not be found. May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'f9975900-222e-4cd4-bd6e-c67c60a504c0'} May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9975900-222e-4cd4-bd6e-c67c60a504c0 could not be found. May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:21:57.499114 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:21:57.511188 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9975900-222e-4cd4-bd6e-c67c60a504c0 could not be found. May 21 21:21:57.511188 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.511188 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.511188 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.511188 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.511188 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.511188 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.511188 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:21:57.511188 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:21:57.511188 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9975900-222e-4cd4-bd6e-c67c60a504c0 could not be found. May 21 21:21:57.511188 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.511188 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5420f080-43cd-410c-b74f-e72fdbd11236 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance f9975900-222e-4cd4-bd6e-c67c60a504c0 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:21:57.511188 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5420f080-43cd-410c-b74f-e72fdbd11236 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 404 len: 111 microversion: 2.1 time: 0.037062 May 21 21:21:57.511188 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1456/2990] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:21:57 2022] DELETE /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:21:57.513354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eaa44155-6f16-42c7-ba47-6f3be5984298 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:57.514135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-eaa44155-6f16-42c7-ba47-6f3be5984298 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: f9975900-222e-4cd4-bd6e-c67c60a504c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:57.522395 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eaa44155-6f16-42c7-ba47-6f3be5984298 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.523425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eaa44155-6f16-42c7-ba47-6f3be5984298 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.524563 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eaa44155-6f16-42c7-ba47-6f3be5984298 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.525232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eaa44155-6f16-42c7-ba47-6f3be5984298 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.541765 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-eaa44155-6f16-42c7-ba47-6f3be5984298 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance f9975900-222e-4cd4-bd6e-c67c60a504c0 could not be found. May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eaa44155-6f16-42c7-ba47-6f3be5984298 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 HTTP/1.1 May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance f9975900-222e-4cd4-bd6e-c67c60a504c0 could not be found. May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'f9975900-222e-4cd4-bd6e-c67c60a504c0'} May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9975900-222e-4cd4-bd6e-c67c60a504c0 could not be found. May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9975900-222e-4cd4-bd6e-c67c60a504c0 could not be found. May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.543314 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.548393 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.548393 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.548393 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.548393 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:21:57.548393 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:21:57.548393 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9975900-222e-4cd4-bd6e-c67c60a504c0 could not be found. May 21 21:21:57.548393 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.548393 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eaa44155-6f16-42c7-ba47-6f3be5984298 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance f9975900-222e-4cd4-bd6e-c67c60a504c0 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:21:57.548393 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-eaa44155-6f16-42c7-ba47-6f3be5984298 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0" status: 404 len: 111 microversion: 2.1 time: 0.035476 May 21 21:21:57.548393 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1457/2991] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:57 2022] GET /compute/v2.1/servers/f9975900-222e-4cd4-bd6e-c67c60a504c0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:21:57.554085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4562b315-4d3e-470d-8d2c-43c2336a32d7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:57.554694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4562b315-4d3e-470d-8d2c-43c2336a32d7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:57.561197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4562b315-4d3e-470d-8d2c-43c2336a32d7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.561780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4562b315-4d3e-470d-8d2c-43c2336a32d7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.562670 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4562b315-4d3e-470d-8d2c-43c2336a32d7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.563197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4562b315-4d3e-470d-8d2c-43c2336a32d7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.581266 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-4562b315-4d3e-470d-8d2c-43c2336a32d7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance 4b1cd26e-bb18-4119-a747-e73ad8a39343 could not be found. May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4562b315-4d3e-470d-8d2c-43c2336a32d7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 HTTP/1.1 May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 4b1cd26e-bb18-4119-a747-e73ad8a39343 could not be found. May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '4b1cd26e-bb18-4119-a747-e73ad8a39343'} May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b1cd26e-bb18-4119-a747-e73ad8a39343 could not be found. May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:21:57.582938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:21:57.589848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b1cd26e-bb18-4119-a747-e73ad8a39343 could not be found. May 21 21:21:57.589848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.589848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.589848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.589848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.589848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.589848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.589848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:21:57.589848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:21:57.589848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b1cd26e-bb18-4119-a747-e73ad8a39343 could not be found. May 21 21:21:57.589848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.589848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4562b315-4d3e-470d-8d2c-43c2336a32d7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance 4b1cd26e-bb18-4119-a747-e73ad8a39343 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:21:57.589848 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4562b315-4d3e-470d-8d2c-43c2336a32d7 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 404 len: 111 microversion: 2.1 time: 0.036170 May 21 21:21:57.589848 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1458/2992] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:21:57 2022] DELETE /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:21:57.595814 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1c8d89fa-fd14-4fa0-b235-86ecd9471eed tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:57.596714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1c8d89fa-fd14-4fa0-b235-86ecd9471eed tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 4b1cd26e-bb18-4119-a747-e73ad8a39343] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:57.604013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1c8d89fa-fd14-4fa0-b235-86ecd9471eed tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.604864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1c8d89fa-fd14-4fa0-b235-86ecd9471eed tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.605893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1c8d89fa-fd14-4fa0-b235-86ecd9471eed tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.606447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1c8d89fa-fd14-4fa0-b235-86ecd9471eed tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.625078 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-1c8d89fa-fd14-4fa0-b235-86ecd9471eed tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance 4b1cd26e-bb18-4119-a747-e73ad8a39343 could not be found. May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1c8d89fa-fd14-4fa0-b235-86ecd9471eed tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 HTTP/1.1 May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 4b1cd26e-bb18-4119-a747-e73ad8a39343 could not be found. May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '4b1cd26e-bb18-4119-a747-e73ad8a39343'} May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b1cd26e-bb18-4119-a747-e73ad8a39343 could not be found. May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b1cd26e-bb18-4119-a747-e73ad8a39343 could not be found. May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.626933 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.634099 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.634099 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.634099 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.634099 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:21:57.634099 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:21:57.634099 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b1cd26e-bb18-4119-a747-e73ad8a39343 could not be found. May 21 21:21:57.634099 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.634099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1c8d89fa-fd14-4fa0-b235-86ecd9471eed tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance 4b1cd26e-bb18-4119-a747-e73ad8a39343 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:21:57.634099 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1c8d89fa-fd14-4fa0-b235-86ecd9471eed tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343" status: 404 len: 111 microversion: 2.1 time: 0.037312 May 21 21:21:57.634099 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1459/2993] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:57 2022] GET /compute/v2.1/servers/4b1cd26e-bb18-4119-a747-e73ad8a39343 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:21:57.642870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b97f0930-165a-4962-b244-a0f4aba21c2e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:57.643385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b97f0930-165a-4962-b244-a0f4aba21c2e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:57.650741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b97f0930-165a-4962-b244-a0f4aba21c2e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.651010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b97f0930-165a-4962-b244-a0f4aba21c2e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.651809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b97f0930-165a-4962-b244-a0f4aba21c2e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.652310 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b97f0930-165a-4962-b244-a0f4aba21c2e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.657477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:57.669886 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-b97f0930-165a-4962-b244-a0f4aba21c2e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b could not be found. May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b97f0930-165a-4962-b244-a0f4aba21c2e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b HTTP/1.1 May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b could not be found. May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'e4c07e27-b31b-4712-9bb2-19a2eca3b35b'} May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b could not be found. May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:21:57.671420 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:21:57.681469 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b could not be found. May 21 21:21:57.681469 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.681469 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.681469 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.681469 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.681469 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.681469 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.681469 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:21:57.681469 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:21:57.681469 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b could not be found. May 21 21:21:57.681469 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.681469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b97f0930-165a-4962-b244-a0f4aba21c2e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:21:57.681469 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b97f0930-165a-4962-b244-a0f4aba21c2e tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 404 len: 111 microversion: 2.1 time: 0.035746 May 21 21:21:57.681469 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1460/2994] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:21:57 2022] DELETE /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:21:57.691194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0fe668cd-966a-46dd-b439-70a5bf9ea8f9 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:57.692009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0fe668cd-966a-46dd-b439-70a5bf9ea8f9 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e4c07e27-b31b-4712-9bb2-19a2eca3b35b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:57.692698 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-08e64c19-a033-423e-96b5-a0e310729505 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1617 microversion: 2.1 time: 0.802144 May 21 21:21:57.694533 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1535/2995] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:56 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1617 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:57.701507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fe668cd-966a-46dd-b439-70a5bf9ea8f9 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.702289 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fe668cd-966a-46dd-b439-70a5bf9ea8f9 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.703087 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fe668cd-966a-46dd-b439-70a5bf9ea8f9 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.703535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fe668cd-966a-46dd-b439-70a5bf9ea8f9 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.718836 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-0fe668cd-966a-46dd-b439-70a5bf9ea8f9 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b could not be found. May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0fe668cd-966a-46dd-b439-70a5bf9ea8f9 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b HTTP/1.1 May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b could not be found. May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'e4c07e27-b31b-4712-9bb2-19a2eca3b35b'} May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b could not be found. May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b could not be found. May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.720525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.733008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.733008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.733008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.733008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:21:57.733008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:21:57.733008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b could not be found. May 21 21:21:57.733008 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.733464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b982ea47-8b84-407f-a63b-f259cf04eef7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Action: 'create', calling method: .version_select at 0x7fc81b435700>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-900574385", "policies": ["affinity"]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:57.733568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0fe668cd-966a-46dd-b439-70a5bf9ea8f9 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance e4c07e27-b31b-4712-9bb2-19a2eca3b35b could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:21:57.733568 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0fe668cd-966a-46dd-b439-70a5bf9ea8f9 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b" status: 404 len: 111 microversion: 2.1 time: 0.040831 May 21 21:21:57.733568 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1461/2996] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:57 2022] GET /compute/v2.1/servers/e4c07e27-b31b-4712-9bb2-19a2eca3b35b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:21:57.743740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-b982ea47-8b84-407f-a63b-f259cf04eef7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_groups'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:21:57.743934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b985ffb9-837c-4193-b641-9e1fb79916c6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:57.744461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b985ffb9-837c-4193-b641-9e1fb79916c6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:57.749570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-b982ea47-8b84-407f-a63b-f259cf04eef7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for user 945ab557c0e24cfdbcab74684a5d5800 and project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_groups'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:21:57.750990 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b985ffb9-837c-4193-b641-9e1fb79916c6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.751445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b985ffb9-837c-4193-b641-9e1fb79916c6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.752226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b985ffb9-837c-4193-b641-9e1fb79916c6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.752690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b985ffb9-837c-4193-b641-9e1fb79916c6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.769249 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-b985ffb9-837c-4193-b641-9e1fb79916c6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance d980d7ff-026f-459d-9e56-1a94f395ae0c could not be found. May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b985ffb9-837c-4193-b641-9e1fb79916c6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c HTTP/1.1 May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance d980d7ff-026f-459d-9e56-1a94f395ae0c could not be found. May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'd980d7ff-026f-459d-9e56-1a94f395ae0c'} May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d980d7ff-026f-459d-9e56-1a94f395ae0c could not be found. May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:21:57.771080 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:21:57.778947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d980d7ff-026f-459d-9e56-1a94f395ae0c could not be found. May 21 21:21:57.778947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.778947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.778947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.778947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.778947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.778947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.778947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:21:57.778947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:21:57.778947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d980d7ff-026f-459d-9e56-1a94f395ae0c could not be found. May 21 21:21:57.778947 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.778947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b985ffb9-837c-4193-b641-9e1fb79916c6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance d980d7ff-026f-459d-9e56-1a94f395ae0c could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:21:57.778947 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b985ffb9-837c-4193-b641-9e1fb79916c6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 404 len: 111 microversion: 2.1 time: 0.038556 May 21 21:21:57.778947 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1462/2997] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:21:57 2022] DELETE /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:21:57.792139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-54487843-531e-40ad-87dc-2562987bf3cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:57.793612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-54487843-531e-40ad-87dc-2562987bf3cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: d980d7ff-026f-459d-9e56-1a94f395ae0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:57.800444 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54487843-531e-40ad-87dc-2562987bf3cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.801178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54487843-531e-40ad-87dc-2562987bf3cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.802407 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54487843-531e-40ad-87dc-2562987bf3cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.803560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54487843-531e-40ad-87dc-2562987bf3cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.823508 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-54487843-531e-40ad-87dc-2562987bf3cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance d980d7ff-026f-459d-9e56-1a94f395ae0c could not be found. May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-54487843-531e-40ad-87dc-2562987bf3cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c HTTP/1.1 May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance d980d7ff-026f-459d-9e56-1a94f395ae0c could not be found. May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'd980d7ff-026f-459d-9e56-1a94f395ae0c'} May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d980d7ff-026f-459d-9e56-1a94f395ae0c could not be found. May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d980d7ff-026f-459d-9e56-1a94f395ae0c could not be found. May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.825075 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.830648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.830648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.830648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.830648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:21:57.830648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:21:57.830648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d980d7ff-026f-459d-9e56-1a94f395ae0c could not be found. May 21 21:21:57.830648 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.830648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-54487843-531e-40ad-87dc-2562987bf3cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance d980d7ff-026f-459d-9e56-1a94f395ae0c could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:21:57.830648 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-54487843-531e-40ad-87dc-2562987bf3cd tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c" status: 404 len: 111 microversion: 2.1 time: 0.040914 May 21 21:21:57.830648 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1463/2998] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:57 2022] GET /compute/v2.1/servers/d980d7ff-026f-459d-9e56-1a94f395ae0c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:21:57.836820 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c2cc1ee0-00f4-4db7-bbd3-e3ecb8464ff8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:57.837511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c2cc1ee0-00f4-4db7-bbd3-e3ecb8464ff8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e88f28fe-a897-4690-8460-43bf4d7453d5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:57.846671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2cc1ee0-00f4-4db7-bbd3-e3ecb8464ff8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.846671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2cc1ee0-00f4-4db7-bbd3-e3ecb8464ff8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.846671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2cc1ee0-00f4-4db7-bbd3-e3ecb8464ff8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.846671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2cc1ee0-00f4-4db7-bbd3-e3ecb8464ff8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.863620 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-c2cc1ee0-00f4-4db7-bbd3-e3ecb8464ff8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance e88f28fe-a897-4690-8460-43bf4d7453d5 could not be found. May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c2cc1ee0-00f4-4db7-bbd3-e3ecb8464ff8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/e88f28fe-a897-4690-8460-43bf4d7453d5 HTTP/1.1 May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance e88f28fe-a897-4690-8460-43bf4d7453d5 could not be found. May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'e88f28fe-a897-4690-8460-43bf4d7453d5'} May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88f28fe-a897-4690-8460-43bf4d7453d5 could not be found. May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:21:57.866505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:21:57.870328 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88f28fe-a897-4690-8460-43bf4d7453d5 could not be found. May 21 21:21:57.870328 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.870328 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.870328 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.870328 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.870328 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.870328 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.870328 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:21:57.870328 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:21:57.870328 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88f28fe-a897-4690-8460-43bf4d7453d5 could not be found. May 21 21:21:57.870328 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.870328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c2cc1ee0-00f4-4db7-bbd3-e3ecb8464ff8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance e88f28fe-a897-4690-8460-43bf4d7453d5 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:21:57.870328 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c2cc1ee0-00f4-4db7-bbd3-e3ecb8464ff8 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e88f28fe-a897-4690-8460-43bf4d7453d5" status: 404 len: 111 microversion: 2.1 time: 0.035614 May 21 21:21:57.870328 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1464/2999] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:21:57 2022] DELETE /compute/v2.1/servers/e88f28fe-a897-4690-8460-43bf4d7453d5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:21:57.876719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a668320c-4fcb-4a46-8fa7-721312e2cde6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:57.877395 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a668320c-4fcb-4a46-8fa7-721312e2cde6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e88f28fe-a897-4690-8460-43bf4d7453d5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:57.884180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a668320c-4fcb-4a46-8fa7-721312e2cde6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.884767 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a668320c-4fcb-4a46-8fa7-721312e2cde6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.885563 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a668320c-4fcb-4a46-8fa7-721312e2cde6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.886015 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a668320c-4fcb-4a46-8fa7-721312e2cde6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.901522 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-a668320c-4fcb-4a46-8fa7-721312e2cde6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance e88f28fe-a897-4690-8460-43bf4d7453d5 could not be found. May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a668320c-4fcb-4a46-8fa7-721312e2cde6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/e88f28fe-a897-4690-8460-43bf4d7453d5 HTTP/1.1 May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance e88f28fe-a897-4690-8460-43bf4d7453d5 could not be found. May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'e88f28fe-a897-4690-8460-43bf4d7453d5'} May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88f28fe-a897-4690-8460-43bf4d7453d5 could not be found. May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88f28fe-a897-4690-8460-43bf4d7453d5 could not be found. May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:21:57.903060 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.908618 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:21:57.908618 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:21:57.908618 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:21:57.908618 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:21:57.908618 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:21:57.908618 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88f28fe-a897-4690-8460-43bf4d7453d5 could not be found. May 21 21:21:57.908618 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:21:57.908618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a668320c-4fcb-4a46-8fa7-721312e2cde6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance e88f28fe-a897-4690-8460-43bf4d7453d5 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:21:57.908618 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a668320c-4fcb-4a46-8fa7-721312e2cde6 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e88f28fe-a897-4690-8460-43bf4d7453d5" status: 404 len: 111 microversion: 2.1 time: 0.031454 May 21 21:21:57.908618 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1465/3000] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:57 2022] GET /compute/v2.1/servers/e88f28fe-a897-4690-8460-43bf4d7453d5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:21:57.960968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-418f0699-1601-42e4-9b6e-578abf9cdfdd tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:57.961600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-418f0699-1601-42e4-9b6e-578abf9cdfdd tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] [instance: 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:57.967937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-418f0699-1601-42e4-9b6e-578abf9cdfdd tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.968643 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-418f0699-1601-42e4-9b6e-578abf9cdfdd tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.969424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-418f0699-1601-42e4-9b6e-578abf9cdfdd tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:57.969873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-418f0699-1601-42e4-9b6e-578abf9cdfdd tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:57.998377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-b982ea47-8b84-407f-a63b-f259cf04eef7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_groups'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:21:58.005262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-b982ea47-8b84-407f-a63b-f259cf04eef7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for user 945ab557c0e24cfdbcab74684a5d5800 and project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_groups'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:21:58.023482 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b982ea47-8b84-407f-a63b-f259cf04eef7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.308425 May 21 21:21:58.024513 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1536/3001] 10.222.0.49 () {60 vars in 1173 bytes} [Sat May 21 21:21:57 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:21:58.135698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-25f9ee29-fbf0-4043-a674-2d59ddca75c4 req-a432d2f8-ea00-4d03-9365-f65ae68e7e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d", "tag": "968f68f1-382d-44b8-93df-f947c03f48cd"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:58.150994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-25f9ee29-fbf0-4043-a674-2d59ddca75c4 req-a432d2f8-ea00-4d03-9365-f65ae68e7e28 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:58.151978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-25f9ee29-fbf0-4043-a674-2d59ddca75c4 req-a432d2f8-ea00-4d03-9365-f65ae68e7e28 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:58.170051 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-25f9ee29-fbf0-4043-a674-2d59ddca75c4 req-a432d2f8-ea00-4d03-9365-f65ae68e7e28 service nova] Creating event network-changed:968f68f1-382d-44b8-93df-f947c03f48cd for instance 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d on nch2-master-1 May 21 21:21:58.176221 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-25f9ee29-fbf0-4043-a674-2d59ddca75c4 req-a432d2f8-ea00-4d03-9365-f65ae68e7e28 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047172 May 21 21:21:58.177169 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1537/3002] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:21:58.187610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1487925102", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "ef2f2b7c-8671-4cf6-ac5a-42662612f946"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:21:58.248744 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-418f0699-1601-42e4-9b6e-578abf9cdfdd tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14070cbc4d534f849ba72736b1617cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea414da0f424c348f190edade999c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:58.259446 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] validate_networks() for None {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:21:58.266279 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-418f0699-1601-42e4-9b6e-578abf9cdfdd tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] 10.222.0.49 "GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d" status: 200 len: 1325 microversion: 2.1 time: 0.310752 May 21 21:21:58.269334 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1466/3003] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:57 2022] GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d => generated 1325 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:58.571676 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:21:58.573055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:21:58.574144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:21:58.575091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:21:58.575816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:21:58.613455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:58.614141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:58.615827 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:58.616317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:58.639220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:21:58.645032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for user 945ab557c0e24cfdbcab74684a5d5800 and project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:21:58.660844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Going to run 2 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:21:58.667769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 97b22b0c-a0a1-48d7-96b0-448cbabe4fae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:21:58.799071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=131277) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} May 21 21:21:58.820999 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_group_members'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:21:58.828308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for user 945ab557c0e24cfdbcab74684a5d5800 and project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_group_members'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:21:58.958465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_group_members'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:21:58.966866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for user 945ab557c0e24cfdbcab74684a5d5800 and project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_group_members'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:21:58.983767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=97b22b0c-a0a1-48d7-96b0-448cbabe4fae,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:21:59.286691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6b9b489b-9bb4-4490-aeb1-8c978cbe9118 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:59.288205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6b9b489b-9bb4-4490-aeb1-8c978cbe9118 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] [instance: 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:59.295369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b9b489b-9bb4-4490-aeb1-8c978cbe9118 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:59.295825 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b9b489b-9bb4-4490-aeb1-8c978cbe9118 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:59.296649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b9b489b-9bb4-4490-aeb1-8c978cbe9118 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:59.297090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b9b489b-9bb4-4490-aeb1-8c978cbe9118 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:59.448201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6b9b489b-9bb4-4490-aeb1-8c978cbe9118 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14070cbc4d534f849ba72736b1617cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea414da0f424c348f190edade999c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:59.455801 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6b9b489b-9bb4-4490-aeb1-8c978cbe9118 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] 10.222.0.49 "GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d" status: 200 len: 1325 microversion: 2.1 time: 0.173659 May 21 21:21:59.456384 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1467/3004] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:59 2022] GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d => generated 1325 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:21:59.497071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_group_members'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:21:59.502707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for user 945ab557c0e24cfdbcab74684a5d5800 and project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_group_members'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:21:59.512421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:59.638674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_group_members'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:21:59.644802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for user 945ab557c0e24cfdbcab74684a5d5800 and project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_group_members'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:21:59.685684 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4ab23ab4-16b9-47f3-86a0-cef365e34202 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.506348 May 21 21:21:59.686575 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1538/3005] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:21:58 2022] POST /compute/v2.1/servers => generated 32 bytes in 1508 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 21 21:21:59.696229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c1657e85-a772-4490-9113-89b5d82cf1b6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:59.704600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c1657e85-a772-4490-9113-89b5d82cf1b6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:59.707010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c1657e85-a772-4490-9113-89b5d82cf1b6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Searching by: {'deleted': False, 'project_id': '00752ed7cdc0495dbf5533e82dccc017'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:21:59.727486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1657e85-a772-4490-9113-89b5d82cf1b6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:59.727957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1657e85-a772-4490-9113-89b5d82cf1b6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:59.728866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1657e85-a772-4490-9113-89b5d82cf1b6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:21:59.729397 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1657e85-a772-4490-9113-89b5d82cf1b6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:21:59.757590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-c1657e85-a772-4490-9113-89b5d82cf1b6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:21:59.792035 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c1657e85-a772-4490-9113-89b5d82cf1b6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.100430 May 21 21:21:59.792678 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1468/3006] 10.222.0.49 () {58 vars in 1124 bytes} [Sat May 21 21:21:59 2022] GET /compute/v2.1/servers => generated 1003 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:21:59.804873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-50b275d9-e490-4131-afc8-b106beb22906 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:21:59.805504 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-50b275d9-e490-4131-afc8-b106beb22906 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:21:59.869520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-50b275d9-e490-4131-afc8-b106beb22906 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:21:59.888705 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-50b275d9-e490-4131-afc8-b106beb22906 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb" status: 200 len: 1219 microversion: 2.1 time: 0.079623 May 21 21:21:59.888705 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1539/3007] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:21:59 2022] GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:00.473288 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a2de515d-5984-43c9-b255-781afefc17a1 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:00.478652 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a2de515d-5984-43c9-b255-781afefc17a1 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] [instance: 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:00.482289 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2de515d-5984-43c9-b255-781afefc17a1 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:00.482674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2de515d-5984-43c9-b255-781afefc17a1 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:00.483499 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2de515d-5984-43c9-b255-781afefc17a1 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:00.484010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2de515d-5984-43c9-b255-781afefc17a1 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:00.636664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a2de515d-5984-43c9-b255-781afefc17a1 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14070cbc4d534f849ba72736b1617cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea414da0f424c348f190edade999c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:00.653075 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a2de515d-5984-43c9-b255-781afefc17a1 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] 10.222.0.49 "GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d" status: 200 len: 1325 microversion: 2.1 time: 0.176833 May 21 21:22:00.658092 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1469/3008] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:00 2022] GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d => generated 1325 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:00.896854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d51e720a-627d-4c10-94d6-2a247b1f72ab tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:00.897490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d51e720a-627d-4c10-94d6-2a247b1f72ab tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:00.962690 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d51e720a-627d-4c10-94d6-2a247b1f72ab tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:00.974990 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d51e720a-627d-4c10-94d6-2a247b1f72ab tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb" status: 200 len: 1219 microversion: 2.1 time: 0.078398 May 21 21:22:00.974990 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1540/3009] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:00 2022] GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:01.673434 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bf2d4fd8-fed2-4f2f-8ae7-16594e2667a1 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:01.674055 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bf2d4fd8-fed2-4f2f-8ae7-16594e2667a1 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] [instance: 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:01.699177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf2d4fd8-fed2-4f2f-8ae7-16594e2667a1 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:01.699636 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf2d4fd8-fed2-4f2f-8ae7-16594e2667a1 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:01.700471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf2d4fd8-fed2-4f2f-8ae7-16594e2667a1 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:01.700975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf2d4fd8-fed2-4f2f-8ae7-16594e2667a1 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:01.880839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bf2d4fd8-fed2-4f2f-8ae7-16594e2667a1 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14070cbc4d534f849ba72736b1617cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea414da0f424c348f190edade999c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:01.889462 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bf2d4fd8-fed2-4f2f-8ae7-16594e2667a1 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] 10.222.0.49 "GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d" status: 200 len: 1325 microversion: 2.1 time: 0.221160 May 21 21:22:01.889666 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1470/3010] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:01 2022] GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d => generated 1325 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:01.989416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ab79413e-95e3-4acb-aaa4-ec49345054a0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:01.990151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ab79413e-95e3-4acb-aaa4-ec49345054a0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:01.998840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab79413e-95e3-4acb-aaa4-ec49345054a0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:01.999296 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab79413e-95e3-4acb-aaa4-ec49345054a0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:02.000079 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab79413e-95e3-4acb-aaa4-ec49345054a0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:02.000555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab79413e-95e3-4acb-aaa4-ec49345054a0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:02.081044 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ab79413e-95e3-4acb-aaa4-ec49345054a0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:02.090889 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ab79413e-95e3-4acb-aaa4-ec49345054a0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb" status: 200 len: 1223 microversion: 2.1 time: 0.106172 May 21 21:22:02.091571 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1541/3011] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:01 2022] GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:02.907034 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-20b1eb8d-b188-4258-abe6-da40aae8d49a tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:02.908346 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-20b1eb8d-b188-4258-abe6-da40aae8d49a tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] [instance: 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:02.916704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20b1eb8d-b188-4258-abe6-da40aae8d49a tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:02.917105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20b1eb8d-b188-4258-abe6-da40aae8d49a tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:02.918092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20b1eb8d-b188-4258-abe6-da40aae8d49a tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:02.918539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20b1eb8d-b188-4258-abe6-da40aae8d49a tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:03.108213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0d28d373-4185-43e0-a291-30c0aecd4201 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:03.108880 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0d28d373-4185-43e0-a291-30c0aecd4201 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:03.124417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d28d373-4185-43e0-a291-30c0aecd4201 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:03.124889 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d28d373-4185-43e0-a291-30c0aecd4201 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:03.125774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d28d373-4185-43e0-a291-30c0aecd4201 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:03.126231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d28d373-4185-43e0-a291-30c0aecd4201 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:03.243833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-20b1eb8d-b188-4258-abe6-da40aae8d49a tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14070cbc4d534f849ba72736b1617cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea414da0f424c348f190edade999c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:03.257067 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-20b1eb8d-b188-4258-abe6-da40aae8d49a tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] 10.222.0.49 "GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d" status: 200 len: 1325 microversion: 2.1 time: 0.355147 May 21 21:22:03.266631 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1471/3012] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:02 2022] GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d => generated 1325 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:03.266631 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-29f96d00-cd21-4eee-8e24-685af6768bb2 req-c2bf5fbf-9e1c-4df0-bde0-fb6bafe8ab4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d", "name": "network-vif-plugged", "status": "completed", "tag": "968f68f1-382d-44b8-93df-f947c03f48cd"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:03.274468 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-29f96d00-cd21-4eee-8e24-685af6768bb2 req-c2bf5fbf-9e1c-4df0-bde0-fb6bafe8ab4d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:03.275676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-29f96d00-cd21-4eee-8e24-685af6768bb2 req-c2bf5fbf-9e1c-4df0-bde0-fb6bafe8ab4d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:03.288839 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-29f96d00-cd21-4eee-8e24-685af6768bb2 req-c2bf5fbf-9e1c-4df0-bde0-fb6bafe8ab4d service nova] Creating event network-vif-plugged:968f68f1-382d-44b8-93df-f947c03f48cd for instance 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d on nch2-master-1 May 21 21:22:03.295854 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-29f96d00-cd21-4eee-8e24-685af6768bb2 req-c2bf5fbf-9e1c-4df0-bde0-fb6bafe8ab4d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035796 May 21 21:22:03.296480 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1472/3013] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:03.348393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0d28d373-4185-43e0-a291-30c0aecd4201 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:03.365451 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0d28d373-4185-43e0-a291-30c0aecd4201 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb" status: 200 len: 1279 microversion: 2.1 time: 0.258119 May 21 21:22:03.366346 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1542/3014] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:03 2022] GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb => generated 1279 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:04.278604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-06bd285a-3f5e-4d24-9f5e-101eaffabe81 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:04.287177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-06bd285a-3f5e-4d24-9f5e-101eaffabe81 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] [instance: 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:04.294907 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06bd285a-3f5e-4d24-9f5e-101eaffabe81 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:04.295298 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06bd285a-3f5e-4d24-9f5e-101eaffabe81 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:04.296107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06bd285a-3f5e-4d24-9f5e-101eaffabe81 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:04.296575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06bd285a-3f5e-4d24-9f5e-101eaffabe81 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:04.388908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-29d342fb-6367-4add-bfac-5308bec14e25 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:04.390452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-29d342fb-6367-4add-bfac-5308bec14e25 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:04.402002 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29d342fb-6367-4add-bfac-5308bec14e25 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:04.404870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29d342fb-6367-4add-bfac-5308bec14e25 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:04.404870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29d342fb-6367-4add-bfac-5308bec14e25 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:04.404870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29d342fb-6367-4add-bfac-5308bec14e25 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:04.503753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:04.557172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-06bd285a-3f5e-4d24-9f5e-101eaffabe81 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14070cbc4d534f849ba72736b1617cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea414da0f424c348f190edade999c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:04.602333 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-06bd285a-3f5e-4d24-9f5e-101eaffabe81 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] 10.222.0.49 "GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d" status: 200 len: 1325 microversion: 2.1 time: 0.331697 May 21 21:22:04.614521 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1473/3015] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:04 2022] GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d => generated 1325 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:04.835661 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-29d342fb-6367-4add-bfac-5308bec14e25 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:04.845362 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-29d342fb-6367-4add-bfac-5308bec14e25 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb" status: 200 len: 1319 microversion: 2.1 time: 0.464917 May 21 21:22:04.850618 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1543/3016] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:04 2022] GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb => generated 1319 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:05.622663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5be49113-cb88-4134-ac79-e9d79f96ac6d tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:05.623298 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5be49113-cb88-4134-ac79-e9d79f96ac6d tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] [instance: 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:05.639764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5be49113-cb88-4134-ac79-e9d79f96ac6d tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:05.647462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5be49113-cb88-4134-ac79-e9d79f96ac6d tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:05.647462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5be49113-cb88-4134-ac79-e9d79f96ac6d tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:05.647462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5be49113-cb88-4134-ac79-e9d79f96ac6d tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:05.647783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-e11edfb6-c2a6-4f34-99b0-4e678c9bad7e req-c3e94bd1-e96d-44bd-b380-d3a4244b4ffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a3e8eee-b681-4b0a-becf-41eb4d6b19fb", "tag": "93ef5409-7b0f-46d9-afec-d432287a117d"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:05.659324 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-e11edfb6-c2a6-4f34-99b0-4e678c9bad7e req-c3e94bd1-e96d-44bd-b380-d3a4244b4ffc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:05.660151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-e11edfb6-c2a6-4f34-99b0-4e678c9bad7e req-c3e94bd1-e96d-44bd-b380-d3a4244b4ffc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:05.683955 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-e11edfb6-c2a6-4f34-99b0-4e678c9bad7e req-c3e94bd1-e96d-44bd-b380-d3a4244b4ffc service nova] Creating event network-changed:93ef5409-7b0f-46d9-afec-d432287a117d for instance 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb on nch1-master-1 May 21 21:22:05.695409 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-e11edfb6-c2a6-4f34-99b0-4e678c9bad7e req-c3e94bd1-e96d-44bd-b380-d3a4244b4ffc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053595 May 21 21:22:05.699923 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1544/3017] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:05.881993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e9cd8597-778c-459f-9453-fd73d86224ee tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:05.882856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e9cd8597-778c-459f-9453-fd73d86224ee tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:05.894396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9cd8597-778c-459f-9453-fd73d86224ee tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:05.895096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9cd8597-778c-459f-9453-fd73d86224ee tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:05.896556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9cd8597-778c-459f-9453-fd73d86224ee tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:05.897533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9cd8597-778c-459f-9453-fd73d86224ee tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:05.935568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5be49113-cb88-4134-ac79-e9d79f96ac6d tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14070cbc4d534f849ba72736b1617cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea414da0f424c348f190edade999c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:05.947622 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5be49113-cb88-4134-ac79-e9d79f96ac6d tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] 10.222.0.49 "GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d" status: 200 len: 1522 microversion: 2.1 time: 0.329619 May 21 21:22:05.949414 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1474/3018] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:05 2022] GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:05.968827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-10c1337e-30ac-40eb-9e58-fc9979d1ef83 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:05.970135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-10c1337e-30ac-40eb-9e58-fc9979d1ef83 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] [instance: 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:05.982749 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-10c1337e-30ac-40eb-9e58-fc9979d1ef83 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:05.983538 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-10c1337e-30ac-40eb-9e58-fc9979d1ef83 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:05.985252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-10c1337e-30ac-40eb-9e58-fc9979d1ef83 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:05.985815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-10c1337e-30ac-40eb-9e58-fc9979d1ef83 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:06.037901 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-10c1337e-30ac-40eb-9e58-fc9979d1ef83 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] HTTP exception thrown: Action 999 not found May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-10c1337e-30ac-40eb-9e58-fc9979d1ef83 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Request method failure captured: May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d/os-instance-actions/999 HTTP/1.1 May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVfwPFJnbi-ZGmQJdwAXglh75EfdnWJ0XsBwT3ne1UuPTxcxV8cnmI-D0molcsd1cs2uLQbkIfkJqJvykDSAfsnzhUrNo4hvgc6y0rkF2xhqmmKvalxRCpnpJSw3z-lf_zN-T3mVYYbXbY_Uzqw72ZpfsOM0XV6zPZi7LSVqe1DK0Gs May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 5ea414da0f424c348f190edade999c31 May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1440409288 May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5ea414da0f424c348f190edade999c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5ea414da0f424c348f190edade999c31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5ea414da0f424c348f190edade999c31", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5ea414da0f424c348f190edade999c31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1440409288 May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 5ea414da0f424c348f190edade999c31 May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1440409288 May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-InstanceActionsNegativeTestJSON-1440409288-project May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 14070cbc4d534f849ba72736b1617cf5 May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1440409288-project May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: exception: Action 999 not found May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'server_id': '51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d', 'id': '999'} May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found May 21 21:22:06.046670 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:22:06.050478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-10c1337e-30ac-40eb-9e58-fc9979d1ef83 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Returning 404 to user: Action 999 not found {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:22:06.050478 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-10c1337e-30ac-40eb-9e58-fc9979d1ef83 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] 10.222.0.49 "GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.086059 May 21 21:22:06.050478 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1475/3019] 10.222.0.49 () {58 vars in 1307 bytes} [Sat May 21 21:22:05 2022] GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d/os-instance-actions/999 => generated 66 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:22:06.058213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-65ea0dab-4818-4d36-9251-56c2af39cbc6 req-413adca1-43e5-4172-9909-323626b2b306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b22b0c-a0a1-48d7-96b0-448cbabe4fae", "tag": "a0c5cbf4-ae56-4f2d-a540-a0044b6063ac"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:06.072122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-65ea0dab-4818-4d36-9251-56c2af39cbc6 req-413adca1-43e5-4172-9909-323626b2b306 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:06.073094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-65ea0dab-4818-4d36-9251-56c2af39cbc6 req-413adca1-43e5-4172-9909-323626b2b306 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:06.092127 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-65ea0dab-4818-4d36-9251-56c2af39cbc6 req-413adca1-43e5-4172-9909-323626b2b306 service nova] Creating event network-changed:a0c5cbf4-ae56-4f2d-a540-a0044b6063ac for instance 97b22b0c-a0a1-48d7-96b0-448cbabe4fae on nch1-master-1 May 21 21:22:06.098644 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-65ea0dab-4818-4d36-9251-56c2af39cbc6 req-413adca1-43e5-4172-9909-323626b2b306 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047530 May 21 21:22:06.100264 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1476/3020] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:06.110516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-de8e3b3e-a573-495c-973b-2c5eaeb92e03 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Calling method '.version_select at 0x7fc81b65e0d0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:06.112100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-de8e3b3e-a573-495c-973b-2c5eaeb92e03 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] [instance: ed308311-0f4f-4671-8cb6-015f4636dd39] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:06.126823 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-de8e3b3e-a573-495c-973b-2c5eaeb92e03 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] HTTP exception thrown: Instance ed308311-0f4f-4671-8cb6-015f4636dd39 could not be found. May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-de8e3b3e-a573-495c-973b-2c5eaeb92e03 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Request method failure captured: May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/ed308311-0f4f-4671-8cb6-015f4636dd39/os-instance-actions HTTP/1.1 May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVfwPFJnbi-ZGmQJdwAXglh75EfdnWJ0XsBwT3ne1UuPTxcxV8cnmI-D0molcsd1cs2uLQbkIfkJqJvykDSAfsnzhUrNo4hvgc6y0rkF2xhqmmKvalxRCpnpJSw3z-lf_zN-T3mVYYbXbY_Uzqw72ZpfsOM0XV6zPZi7LSVqe1DK0Gs May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 5ea414da0f424c348f190edade999c31 May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1440409288 May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5ea414da0f424c348f190edade999c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5ea414da0f424c348f190edade999c31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5ea414da0f424c348f190edade999c31", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5ea414da0f424c348f190edade999c31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1440409288 May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 5ea414da0f424c348f190edade999c31 May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1440409288 May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-InstanceActionsNegativeTestJSON-1440409288-project May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 14070cbc4d534f849ba72736b1617cf5 May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1440409288-project May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance ed308311-0f4f-4671-8cb6-015f4636dd39 could not be found. May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'server_id': 'ed308311-0f4f-4671-8cb6-015f4636dd39'} May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed308311-0f4f-4671-8cb6-015f4636dd39 could not be found. May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:22:06.139088 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:22:06.143267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed308311-0f4f-4671-8cb6-015f4636dd39 could not be found. May 21 21:22:06.143267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:22:06.143267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:22:06.143267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:22:06.143267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:06.143267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:22:06.143267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:22:06.143267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:22:06.143267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:22:06.143267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed308311-0f4f-4671-8cb6-015f4636dd39 could not be found. May 21 21:22:06.143267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:22:06.143267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-de8e3b3e-a573-495c-973b-2c5eaeb92e03 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Returning 404 to user: Instance ed308311-0f4f-4671-8cb6-015f4636dd39 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:22:06.143267 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-de8e3b3e-a573-495c-973b-2c5eaeb92e03 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] 10.222.0.49 "GET /compute/v2.1/servers/ed308311-0f4f-4671-8cb6-015f4636dd39/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.028568 May 21 21:22:06.143267 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1477/3021] 10.222.0.49 () {58 vars in 1295 bytes} [Sat May 21 21:22:06 2022] GET /compute/v2.1/servers/ed308311-0f4f-4671-8cb6-015f4636dd39/os-instance-actions => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:22:06.143267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-683f61a0-9955-47f0-9e33-a1d6d851b390 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:06.143267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-683f61a0-9955-47f0-9e33-a1d6d851b390 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] [instance: 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:06.150536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-683f61a0-9955-47f0-9e33-a1d6d851b390 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:06.150975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-683f61a0-9955-47f0-9e33-a1d6d851b390 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:06.151960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-683f61a0-9955-47f0-9e33-a1d6d851b390 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:06.152433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-683f61a0-9955-47f0-9e33-a1d6d851b390 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:06.193735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-683f61a0-9955-47f0-9e33-a1d6d851b390 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] [instance: 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:22:06.256540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e9cd8597-778c-459f-9453-fd73d86224ee tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:06.268380 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e9cd8597-778c-459f-9453-fd73d86224ee tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb" status: 200 len: 1319 microversion: 2.1 time: 0.396816 May 21 21:22:06.269116 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1545/3022] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:05 2022] GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb => generated 1319 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:06.641056 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-683f61a0-9955-47f0-9e33-a1d6d851b390 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] 10.222.0.49 "DELETE /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d" status: 204 len: 0 microversion: 2.1 time: 0.504255 May 21 21:22:06.642708 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1478/3023] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:22:06 2022] DELETE /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 21:22:06.652233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dea14935-d5ae-48ed-8d39-9f4d3f865783 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:06.654815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dea14935-d5ae-48ed-8d39-9f4d3f865783 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] [instance: 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:06.661634 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dea14935-d5ae-48ed-8d39-9f4d3f865783 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:06.662754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dea14935-d5ae-48ed-8d39-9f4d3f865783 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:06.663834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dea14935-d5ae-48ed-8d39-9f4d3f865783 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:06.664527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dea14935-d5ae-48ed-8d39-9f4d3f865783 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:06.691291 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:06.876899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-dea14935-d5ae-48ed-8d39-9f4d3f865783 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14070cbc4d534f849ba72736b1617cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea414da0f424c348f190edade999c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:06.887149 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dea14935-d5ae-48ed-8d39-9f4d3f865783 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] 10.222.0.49 "GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d" status: 200 len: 1528 microversion: 2.1 time: 0.238532 May 21 21:22:06.888258 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1546/3024] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:06 2022] GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d => generated 1528 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:07.288400 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0636d200-9729-4bff-8005-9a61674512e0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:07.289580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0636d200-9729-4bff-8005-9a61674512e0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:07.295921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0636d200-9729-4bff-8005-9a61674512e0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:07.296334 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0636d200-9729-4bff-8005-9a61674512e0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:07.297337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0636d200-9729-4bff-8005-9a61674512e0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:07.297793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0636d200-9729-4bff-8005-9a61674512e0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:07.452334 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0636d200-9729-4bff-8005-9a61674512e0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:07.461171 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0636d200-9729-4bff-8005-9a61674512e0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb" status: 200 len: 1319 microversion: 2.1 time: 0.178580 May 21 21:22:07.461740 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1479/3025] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:07 2022] GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:07.906936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-42031d50-2e59-4a26-b401-f27b278c9b36 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:07.907551 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-42031d50-2e59-4a26-b401-f27b278c9b36 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] [instance: 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:07.918539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42031d50-2e59-4a26-b401-f27b278c9b36 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:07.922784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42031d50-2e59-4a26-b401-f27b278c9b36 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:07.925310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42031d50-2e59-4a26-b401-f27b278c9b36 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:07.926829 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42031d50-2e59-4a26-b401-f27b278c9b36 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:08.133324 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-42031d50-2e59-4a26-b401-f27b278c9b36 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14070cbc4d534f849ba72736b1617cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea414da0f424c348f190edade999c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:08.143729 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-42031d50-2e59-4a26-b401-f27b278c9b36 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] 10.222.0.49 "GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d" status: 200 len: 1528 microversion: 2.1 time: 0.240887 May 21 21:22:08.145550 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1547/3026] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:07 2022] GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d => generated 1528 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:08.180482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0060f742-c1da-4770-8833-cabb5989066a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:08.181080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0060f742-c1da-4770-8833-cabb5989066a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:08.184414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:08.191152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0060f742-c1da-4770-8833-cabb5989066a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:08.191955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0060f742-c1da-4770-8833-cabb5989066a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:08.193485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0060f742-c1da-4770-8833-cabb5989066a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:08.194165 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0060f742-c1da-4770-8833-cabb5989066a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:08.209772 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-0060f742-c1da-4770-8833-cabb5989066a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0060f742-c1da-4770-8833-cabb5989066a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 HTTP/1.1 May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'e9e520cb-58ff-4e71-bf09-f171b2d09439'} May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:22:08.215713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:22:08.220719 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. May 21 21:22:08.220719 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:22:08.220719 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:22:08.220719 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:22:08.220719 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:08.220719 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:22:08.220719 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:22:08.220719 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:22:08.220719 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:22:08.220719 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. May 21 21:22:08.220719 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:22:08.220719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0060f742-c1da-4770-8833-cabb5989066a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:22:08.220719 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0060f742-c1da-4770-8833-cabb5989066a tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439" status: 404 len: 111 microversion: 2.1 time: 0.039745 May 21 21:22:08.220719 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1480/3027] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:22:08 2022] DELETE /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:22:08.225827 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-530d833c-2139-4b8e-8230-67812be42a9c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:08.226457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-530d833c-2139-4b8e-8230-67812be42a9c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: e9e520cb-58ff-4e71-bf09-f171b2d09439] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:08.237402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-530d833c-2139-4b8e-8230-67812be42a9c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:08.237402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-530d833c-2139-4b8e-8230-67812be42a9c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:08.237402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-530d833c-2139-4b8e-8230-67812be42a9c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:08.237402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-530d833c-2139-4b8e-8230-67812be42a9c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:08.251687 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-530d833c-2139-4b8e-8230-67812be42a9c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-530d833c-2139-4b8e-8230-67812be42a9c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 HTTP/1.1 May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'e9e520cb-58ff-4e71-bf09-f171b2d09439'} May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:22:08.253089 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:22:08.262956 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:08.262956 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:22:08.262956 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:22:08.262956 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:22:08.262956 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:22:08.262956 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. May 21 21:22:08.262956 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:22:08.262956 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-530d833c-2139-4b8e-8230-67812be42a9c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance e9e520cb-58ff-4e71-bf09-f171b2d09439 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:22:08.262956 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-530d833c-2139-4b8e-8230-67812be42a9c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439" status: 404 len: 111 microversion: 2.1 time: 0.036618 May 21 21:22:08.262956 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1548/3028] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:08 2022] GET /compute/v2.1/servers/e9e520cb-58ff-4e71-bf09-f171b2d09439 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:22:08.268771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6d42af39-bb65-4b20-a4f9-6133b355a010 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:08.269294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6d42af39-bb65-4b20-a4f9-6133b355a010 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:08.277526 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d42af39-bb65-4b20-a4f9-6133b355a010 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:08.277891 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d42af39-bb65-4b20-a4f9-6133b355a010 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:08.278734 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d42af39-bb65-4b20-a4f9-6133b355a010 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:08.279181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d42af39-bb65-4b20-a4f9-6133b355a010 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:08.294026 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-6d42af39-bb65-4b20-a4f9-6133b355a010 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance 3f6d21d5-3dbc-4822-8d28-42303d1aed09 could not be found. May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6d42af39-bb65-4b20-a4f9-6133b355a010 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 HTTP/1.1 May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 3f6d21d5-3dbc-4822-8d28-42303d1aed09 could not be found. May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '3f6d21d5-3dbc-4822-8d28-42303d1aed09'} May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f6d21d5-3dbc-4822-8d28-42303d1aed09 could not be found. May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:22:08.295642 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:22:08.299381 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f6d21d5-3dbc-4822-8d28-42303d1aed09 could not be found. May 21 21:22:08.299381 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:22:08.299381 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:22:08.299381 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:22:08.299381 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:08.299381 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:22:08.299381 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:22:08.299381 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:22:08.299381 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:22:08.299381 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f6d21d5-3dbc-4822-8d28-42303d1aed09 could not be found. May 21 21:22:08.299381 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:22:08.299381 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6d42af39-bb65-4b20-a4f9-6133b355a010 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance 3f6d21d5-3dbc-4822-8d28-42303d1aed09 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:22:08.299381 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6d42af39-bb65-4b20-a4f9-6133b355a010 tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 404 len: 111 microversion: 2.1 time: 0.036741 May 21 21:22:08.299381 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1481/3029] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:22:08 2022] DELETE /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:22:08.305926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-db6d94d9-6062-4049-86a2-f181e324f45c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:08.306497 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-db6d94d9-6062-4049-86a2-f181e324f45c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] [instance: 3f6d21d5-3dbc-4822-8d28-42303d1aed09] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:08.312960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db6d94d9-6062-4049-86a2-f181e324f45c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:08.313424 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db6d94d9-6062-4049-86a2-f181e324f45c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:08.314211 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db6d94d9-6062-4049-86a2-f181e324f45c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:08.314659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db6d94d9-6062-4049-86a2-f181e324f45c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:08.329578 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-db6d94d9-6062-4049-86a2-f181e324f45c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] HTTP exception thrown: Instance 3f6d21d5-3dbc-4822-8d28-42303d1aed09 could not be found. May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-db6d94d9-6062-4049-86a2-f181e324f45c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Request method failure captured: May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 HTTP/1.1 May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVbRqhR9HduHrjEz7zXaebMzotjexGmWIP087LGVWfEFUg0IBBQI63QdmGH1J0aCCF2aPZhOAZQb0Pn67Qm8fe0ztw6fTUtdpaCHP_FGVnpeRNrJ8-42klA-BWKxuxH8cvnNQsERg8Bu1axyyzI795gnxIjr3_piYThbFw2ZziI1NTQ May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c48385dc5c24377a7be24da93fc54d9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c48385dc5c24377a7be24da93fc54d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-DeleteServersTestJSON-232394369 May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 8c48385dc5c24377a7be24da93fc54d9 May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-DeleteServersTestJSON-232394369 May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-DeleteServersTestJSON-232394369-project May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: c3e23800ab314cc28dc30330928d8454 May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-DeleteServersTestJSON-232394369-project May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 3f6d21d5-3dbc-4822-8d28-42303d1aed09 could not be found. May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '3f6d21d5-3dbc-4822-8d28-42303d1aed09'} May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f6d21d5-3dbc-4822-8d28-42303d1aed09 could not be found. May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f6d21d5-3dbc-4822-8d28-42303d1aed09 could not be found. May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:22:08.331134 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:22:08.337131 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:08.337131 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:22:08.337131 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:22:08.337131 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:22:08.337131 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:22:08.337131 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f6d21d5-3dbc-4822-8d28-42303d1aed09 could not be found. May 21 21:22:08.337131 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:22:08.337131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-db6d94d9-6062-4049-86a2-f181e324f45c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] Returning 404 to user: Instance 3f6d21d5-3dbc-4822-8d28-42303d1aed09 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:22:08.337131 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-db6d94d9-6062-4049-86a2-f181e324f45c tempest-DeleteServersTestJSON-232394369 tempest-DeleteServersTestJSON-232394369-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09" status: 404 len: 111 microversion: 2.1 time: 0.030696 May 21 21:22:08.337797 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1549/3030] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:08 2022] GET /compute/v2.1/servers/3f6d21d5-3dbc-4822-8d28-42303d1aed09 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:22:08.478756 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fac3a5ff-0ec1-4a34-8140-8532586cbc54 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:08.479472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fac3a5ff-0ec1-4a34-8140-8532586cbc54 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:08.485873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fac3a5ff-0ec1-4a34-8140-8532586cbc54 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:08.486385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fac3a5ff-0ec1-4a34-8140-8532586cbc54 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:08.488927 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fac3a5ff-0ec1-4a34-8140-8532586cbc54 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:08.488927 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fac3a5ff-0ec1-4a34-8140-8532586cbc54 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:08.508765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:08.731159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-20a6430b-b651-48b5-b10a-59ca36478ec5 req-1393a6d0-6828-4406-8ee4-8970cc591198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d", "name": "network-vif-deleted", "tag": "968f68f1-382d-44b8-93df-f947c03f48cd"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:08.738806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:08.742099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-20a6430b-b651-48b5-b10a-59ca36478ec5 req-1393a6d0-6828-4406-8ee4-8970cc591198 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:08.742720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-20a6430b-b651-48b5-b10a-59ca36478ec5 req-1393a6d0-6828-4406-8ee4-8970cc591198 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:08.755745 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-20a6430b-b651-48b5-b10a-59ca36478ec5 req-1393a6d0-6828-4406-8ee4-8970cc591198 service nova] Creating event network-vif-deleted:968f68f1-382d-44b8-93df-f947c03f48cd for instance 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d on nch2-master-1 May 21 21:22:08.761526 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-20a6430b-b651-48b5-b10a-59ca36478ec5 req-1393a6d0-6828-4406-8ee4-8970cc591198 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034126 May 21 21:22:08.762422 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1550/3031] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:08.785185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fac3a5ff-0ec1-4a34-8140-8532586cbc54 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:08.794346 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fac3a5ff-0ec1-4a34-8140-8532586cbc54 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb" status: 200 len: 1319 microversion: 2.1 time: 0.320436 May 21 21:22:08.802581 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1482/3032] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:08 2022] GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:09.167838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9dfee658-1e73-42d5-bed3-09fd880a6f6f tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:09.168875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9dfee658-1e73-42d5-bed3-09fd880a6f6f tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] [instance: 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:09.178473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9dfee658-1e73-42d5-bed3-09fd880a6f6f tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:09.183019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9dfee658-1e73-42d5-bed3-09fd880a6f6f tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:09.183019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9dfee658-1e73-42d5-bed3-09fd880a6f6f tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:09.183019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9dfee658-1e73-42d5-bed3-09fd880a6f6f tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:09.232796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9dfee658-1e73-42d5-bed3-09fd880a6f6f tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:09.233534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9dfee658-1e73-42d5-bed3-09fd880a6f6f tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:09.234089 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-9dfee658-1e73-42d5-bed3-09fd880a6f6f tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lazy-loading 'fault' on Instance uuid 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:22:09.324532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9dfee658-1e73-42d5-bed3-09fd880a6f6f tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14070cbc4d534f849ba72736b1617cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea414da0f424c348f190edade999c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:09.335268 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9dfee658-1e73-42d5-bed3-09fd880a6f6f tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] 10.222.0.49 "GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d" status: 200 len: 1315 microversion: 2.1 time: 0.176076 May 21 21:22:09.339799 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1551/3033] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:09 2022] GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:09.822770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b13e277c-3b21-4035-ab5b-546e9a5ade46 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:09.825144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b13e277c-3b21-4035-ab5b-546e9a5ade46 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:09.835532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:09.838449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b13e277c-3b21-4035-ab5b-546e9a5ade46 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:09.838993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b13e277c-3b21-4035-ab5b-546e9a5ade46 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:09.840033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b13e277c-3b21-4035-ab5b-546e9a5ade46 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:09.840858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b13e277c-3b21-4035-ab5b-546e9a5ade46 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:10.011460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b13e277c-3b21-4035-ab5b-546e9a5ade46 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:10.021401 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b13e277c-3b21-4035-ab5b-546e9a5ade46 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb" status: 200 len: 1319 microversion: 2.1 time: 0.207668 May 21 21:22:10.021796 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1483/3034] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:09 2022] GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:10.352563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4cda6a4b-168a-4b78-9dae-53e2332fa3d2 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:10.353242 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4cda6a4b-168a-4b78-9dae-53e2332fa3d2 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] [instance: 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:10.360646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cda6a4b-168a-4b78-9dae-53e2332fa3d2 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:10.361107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cda6a4b-168a-4b78-9dae-53e2332fa3d2 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:10.361929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cda6a4b-168a-4b78-9dae-53e2332fa3d2 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:10.362382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cda6a4b-168a-4b78-9dae-53e2332fa3d2 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:10.376482 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-4cda6a4b-168a-4b78-9dae-53e2332fa3d2 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] HTTP exception thrown: Instance 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d could not be found. May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4cda6a4b-168a-4b78-9dae-53e2332fa3d2 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Request method failure captured: May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d HTTP/1.1 May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVfwPFJnbi-ZGmQJdwAXglh75EfdnWJ0XsBwT3ne1UuPTxcxV8cnmI-D0molcsd1cs2uLQbkIfkJqJvykDSAfsnzhUrNo4hvgc6y0rkF2xhqmmKvalxRCpnpJSw3z-lf_zN-T3mVYYbXbY_Uzqw72ZpfsOM0XV6zPZi7LSVqe1DK0Gs May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 5ea414da0f424c348f190edade999c31 May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1440409288 May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5ea414da0f424c348f190edade999c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5ea414da0f424c348f190edade999c31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5ea414da0f424c348f190edade999c31", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5ea414da0f424c348f190edade999c31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1440409288 May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 5ea414da0f424c348f190edade999c31 May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1440409288 May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-InstanceActionsNegativeTestJSON-1440409288-project May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 14070cbc4d534f849ba72736b1617cf5 May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1440409288-project May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d could not be found. May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d'} May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d could not be found. May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d could not be found. May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:22:10.378129 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:22:10.383544 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:22:10.383544 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:10.383544 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:22:10.383544 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:22:10.383544 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:22:10.383544 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:22:10.383544 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d could not be found. May 21 21:22:10.383544 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:22:10.383544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4cda6a4b-168a-4b78-9dae-53e2332fa3d2 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] Returning 404 to user: Instance 51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:22:10.383544 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4cda6a4b-168a-4b78-9dae-53e2332fa3d2 tempest-InstanceActionsNegativeTestJSON-1440409288 tempest-InstanceActionsNegativeTestJSON-1440409288-project] 10.222.0.49 "GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d" status: 404 len: 111 microversion: 2.1 time: 0.031145 May 21 21:22:10.383544 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1552/3035] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:10 2022] GET /compute/v2.1/servers/51c2eb56-5fd4-4998-9fb1-f6d6c55fb51d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:22:11.038958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ba940d9b-4ef1-44a0-b2b2-1636d1cf085c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:11.039592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ba940d9b-4ef1-44a0-b2b2-1636d1cf085c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:11.058289 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba940d9b-4ef1-44a0-b2b2-1636d1cf085c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:11.058745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba940d9b-4ef1-44a0-b2b2-1636d1cf085c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:11.059841 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba940d9b-4ef1-44a0-b2b2-1636d1cf085c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:11.060476 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba940d9b-4ef1-44a0-b2b2-1636d1cf085c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:11.313405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ba940d9b-4ef1-44a0-b2b2-1636d1cf085c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:11.322770 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ba940d9b-4ef1-44a0-b2b2-1636d1cf085c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb" status: 200 len: 1319 microversion: 2.1 time: 0.288832 May 21 21:22:11.323417 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1484/3036] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:11 2022] GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:12.340250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5929872a-8bdc-4740-907a-d88d1f46b340 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:12.341594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5929872a-8bdc-4740-907a-d88d1f46b340 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:12.343676 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=42 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:12.350134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5929872a-8bdc-4740-907a-d88d1f46b340 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:12.350804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5929872a-8bdc-4740-907a-d88d1f46b340 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:12.351604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5929872a-8bdc-4740-907a-d88d1f46b340 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:12.352057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5929872a-8bdc-4740-907a-d88d1f46b340 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:12.507290 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5929872a-8bdc-4740-907a-d88d1f46b340 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:12.515020 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5929872a-8bdc-4740-907a-d88d1f46b340 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb" status: 200 len: 1319 microversion: 2.1 time: 0.178749 May 21 21:22:12.515615 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1553/3037] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:12 2022] GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:13.532697 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b9f66e0f-db73-4651-906b-9f2d4a91480c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:13.533553 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b9f66e0f-db73-4651-906b-9f2d4a91480c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:13.542150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9f66e0f-db73-4651-906b-9f2d4a91480c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:13.542634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9f66e0f-db73-4651-906b-9f2d4a91480c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:13.545264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9f66e0f-db73-4651-906b-9f2d4a91480c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:13.545264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9f66e0f-db73-4651-906b-9f2d4a91480c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:13.730754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b9f66e0f-db73-4651-906b-9f2d4a91480c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:13.739741 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b9f66e0f-db73-4651-906b-9f2d4a91480c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb" status: 200 len: 1319 microversion: 2.1 time: 0.211026 May 21 21:22:13.741660 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1485/3038] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:13 2022] GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:14.344733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-9245c24c-75a9-4b77-9c75-3de14278346a req-7cfef650-d0d3-41b7-be34-7b759a547ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b22b0c-a0a1-48d7-96b0-448cbabe4fae", "name": "network-vif-plugged", "status": "completed", "tag": "a0c5cbf4-ae56-4f2d-a540-a0044b6063ac"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:14.353400 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9245c24c-75a9-4b77-9c75-3de14278346a req-7cfef650-d0d3-41b7-be34-7b759a547ed7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:14.354221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9245c24c-75a9-4b77-9c75-3de14278346a req-7cfef650-d0d3-41b7-be34-7b759a547ed7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:14.367923 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-9245c24c-75a9-4b77-9c75-3de14278346a req-7cfef650-d0d3-41b7-be34-7b759a547ed7 service nova] Creating event network-vif-plugged:a0c5cbf4-ae56-4f2d-a540-a0044b6063ac for instance 97b22b0c-a0a1-48d7-96b0-448cbabe4fae on nch1-master-1 May 21 21:22:14.372997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dae04fb4-fdad-4f62-a7d7-250688d96cc5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-24390212", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "7d6f74c3-ca85-4df0-b0af-012061e01c5e"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:14.373503 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-9245c24c-75a9-4b77-9c75-3de14278346a req-7cfef650-d0d3-41b7-be34-7b759a547ed7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032039 May 21 21:22:14.374063 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1486/3039] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:14.474073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-dae04fb4-fdad-4f62-a7d7-250688d96cc5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] validate_networks() for [('7d6f74c3-ca85-4df0-b0af-012061e01c5e', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:22:14.762155 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a913c692-b182-43dc-a98a-b2cdd1089b41 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:14.763934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a913c692-b182-43dc-a98a-b2cdd1089b41 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:14.773518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a913c692-b182-43dc-a98a-b2cdd1089b41 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:14.774651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a913c692-b182-43dc-a98a-b2cdd1089b41 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:14.776793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a913c692-b182-43dc-a98a-b2cdd1089b41 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:14.777432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a913c692-b182-43dc-a98a-b2cdd1089b41 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:15.014303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-dae04fb4-fdad-4f62-a7d7-250688d96cc5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:22:15.015135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-dae04fb4-fdad-4f62-a7d7-250688d96cc5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:22:15.015893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-dae04fb4-fdad-4f62-a7d7-250688d96cc5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:22:15.016534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-dae04fb4-fdad-4f62-a7d7-250688d96cc5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:22:15.017133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-dae04fb4-fdad-4f62-a7d7-250688d96cc5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:22:15.027686 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dae04fb4-fdad-4f62-a7d7-250688d96cc5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:15.028364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dae04fb4-fdad-4f62-a7d7-250688d96cc5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:15.029439 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dae04fb4-fdad-4f62-a7d7-250688d96cc5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:15.030266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dae04fb4-fdad-4f62-a7d7-250688d96cc5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:15.045790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a913c692-b182-43dc-a98a-b2cdd1089b41 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:15.051520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-dae04fb4-fdad-4f62-a7d7-250688d96cc5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Getting quotas for project c10e7136b9a5458f8370f7c4e4798415. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:22:15.053405 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a913c692-b182-43dc-a98a-b2cdd1089b41 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb" status: 200 len: 1319 microversion: 2.1 time: 0.298348 May 21 21:22:15.063081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-dae04fb4-fdad-4f62-a7d7-250688d96cc5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Getting quotas for user 043d150ebd3548cc9afb4064fc0f2520 and project c10e7136b9a5458f8370f7c4e4798415. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:22:15.063699 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1487/3040] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:14 2022] GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:15.078062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dae04fb4-fdad-4f62-a7d7-250688d96cc5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:22:15.081406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dae04fb4-fdad-4f62-a7d7-250688d96cc5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:22:15.298689 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dae04fb4-fdad-4f62-a7d7-250688d96cc5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.070655 May 21 21:22:15.299261 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1554/3041] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:22:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:22:15.417615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-55b0f39e-5aac-4251-bf45-1163104a7e7d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2132345637", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "7d6f74c3-ca85-4df0-b0af-012061e01c5e"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:15.523597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-55b0f39e-5aac-4251-bf45-1163104a7e7d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] validate_networks() for [('7d6f74c3-ca85-4df0-b0af-012061e01c5e', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:22:16.072514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-122857d0-23dd-4ec2-82ac-8ef32a108b87 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:16.073306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-122857d0-23dd-4ec2-82ac-8ef32a108b87 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:16.093135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-122857d0-23dd-4ec2-82ac-8ef32a108b87 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:16.093607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-122857d0-23dd-4ec2-82ac-8ef32a108b87 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:16.094420 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-122857d0-23dd-4ec2-82ac-8ef32a108b87 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:16.094878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-122857d0-23dd-4ec2-82ac-8ef32a108b87 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:16.516998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-122857d0-23dd-4ec2-82ac-8ef32a108b87 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:16.528110 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-122857d0-23dd-4ec2-82ac-8ef32a108b87 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb" status: 200 len: 1319 microversion: 2.1 time: 0.461336 May 21 21:22:16.532354 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1555/3042] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:16 2022] GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb => generated 1319 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:16.542593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f9c37b5a-7f2f-4a29-a5c4-4d47784b163b req-1a4675fb-7018-4f25-b955-0d31ba7bc38c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a3e8eee-b681-4b0a-becf-41eb4d6b19fb", "name": "network-vif-plugged", "status": "completed", "tag": "93ef5409-7b0f-46d9-afec-d432287a117d"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:16.574540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f9c37b5a-7f2f-4a29-a5c4-4d47784b163b req-1a4675fb-7018-4f25-b955-0d31ba7bc38c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:16.575145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f9c37b5a-7f2f-4a29-a5c4-4d47784b163b req-1a4675fb-7018-4f25-b955-0d31ba7bc38c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:16.606857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-55b0f39e-5aac-4251-bf45-1163104a7e7d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:22:16.607429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-55b0f39e-5aac-4251-bf45-1163104a7e7d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:22:16.607909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-55b0f39e-5aac-4251-bf45-1163104a7e7d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:22:16.608432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-55b0f39e-5aac-4251-bf45-1163104a7e7d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:22:16.608917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-55b0f39e-5aac-4251-bf45-1163104a7e7d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:22:16.610720 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f9c37b5a-7f2f-4a29-a5c4-4d47784b163b req-1a4675fb-7018-4f25-b955-0d31ba7bc38c service nova] Creating event network-vif-plugged:93ef5409-7b0f-46d9-afec-d432287a117d for instance 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb on nch1-master-1 May 21 21:22:16.629242 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f9c37b5a-7f2f-4a29-a5c4-4d47784b163b req-1a4675fb-7018-4f25-b955-0d31ba7bc38c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095202 May 21 21:22:16.630597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-55b0f39e-5aac-4251-bf45-1163104a7e7d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:16.631315 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-55b0f39e-5aac-4251-bf45-1163104a7e7d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:16.632659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-55b0f39e-5aac-4251-bf45-1163104a7e7d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:16.633898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-55b0f39e-5aac-4251-bf45-1163104a7e7d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:16.636609 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1556/3043] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:16.690979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-55b0f39e-5aac-4251-bf45-1163104a7e7d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Getting quotas for project c10e7136b9a5458f8370f7c4e4798415. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:22:16.703009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-55b0f39e-5aac-4251-bf45-1163104a7e7d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Getting quotas for user 043d150ebd3548cc9afb4064fc0f2520 and project c10e7136b9a5458f8370f7c4e4798415. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:22:16.735615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-55b0f39e-5aac-4251-bf45-1163104a7e7d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:22:16.742036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-55b0f39e-5aac-4251-bf45-1163104a7e7d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: e4143810-5eb7-4f74-b8d7-26207617a6a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:22:16.989543 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-55b0f39e-5aac-4251-bf45-1163104a7e7d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.577232 May 21 21:22:16.991479 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1488/3044] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:22:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:22:17.148183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5d253996-ef06-429a-8ca6-2cc7f197bb8f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1723327100", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "451", "networks": [{"uuid": "7d6f74c3-ca85-4df0-b0af-012061e01c5e"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:17.264792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-5d253996-ef06-429a-8ca6-2cc7f197bb8f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] validate_networks() for [('7d6f74c3-ca85-4df0-b0af-012061e01c5e', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:22:17.547766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-df1854dc-815d-4b82-8423-1746aeb3a17e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:17.548440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-df1854dc-815d-4b82-8423-1746aeb3a17e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:17.566314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df1854dc-815d-4b82-8423-1746aeb3a17e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:17.566861 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df1854dc-815d-4b82-8423-1746aeb3a17e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:17.567780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df1854dc-815d-4b82-8423-1746aeb3a17e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:17.569264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df1854dc-815d-4b82-8423-1746aeb3a17e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:17.820322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-df1854dc-815d-4b82-8423-1746aeb3a17e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:17.844135 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-df1854dc-815d-4b82-8423-1746aeb3a17e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb" status: 200 len: 1319 microversion: 2.1 time: 0.300598 May 21 21:22:17.848339 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1489/3045] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:17 2022] GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:17.859036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9544de49-c6c7-481c-8472-657816063627 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:17.859790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9544de49-c6c7-481c-8472-657816063627 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:17.867914 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9544de49-c6c7-481c-8472-657816063627 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:17.868408 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9544de49-c6c7-481c-8472-657816063627 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:17.869367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9544de49-c6c7-481c-8472-657816063627 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:17.869750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9544de49-c6c7-481c-8472-657816063627 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:17.910493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9544de49-c6c7-481c-8472-657816063627 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:22:18.366708 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9544de49-c6c7-481c-8472-657816063627 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d" status: 204 len: 0 microversion: 2.1 time: 0.513567 May 21 21:22:18.367495 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1490/3046] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:22:17 2022] DELETE /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:22:18.374147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-5d253996-ef06-429a-8ca6-2cc7f197bb8f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:22:18.375306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-5d253996-ef06-429a-8ca6-2cc7f197bb8f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:22:18.376126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-5d253996-ef06-429a-8ca6-2cc7f197bb8f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:22:18.376338 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-59df32d7-51ab-42d3-8c9d-6825f2552ba5 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:18.376901 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-5d253996-ef06-429a-8ca6-2cc7f197bb8f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:22:18.377397 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-59df32d7-51ab-42d3-8c9d-6825f2552ba5 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:18.377556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-5d253996-ef06-429a-8ca6-2cc7f197bb8f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:22:18.385299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59df32d7-51ab-42d3-8c9d-6825f2552ba5 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:18.386420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59df32d7-51ab-42d3-8c9d-6825f2552ba5 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:18.391478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59df32d7-51ab-42d3-8c9d-6825f2552ba5 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:18.391478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59df32d7-51ab-42d3-8c9d-6825f2552ba5 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:18.391692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d253996-ef06-429a-8ca6-2cc7f197bb8f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:18.391692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d253996-ef06-429a-8ca6-2cc7f197bb8f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:18.391692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d253996-ef06-429a-8ca6-2cc7f197bb8f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:18.391692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d253996-ef06-429a-8ca6-2cc7f197bb8f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:18.422728 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-5d253996-ef06-429a-8ca6-2cc7f197bb8f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Getting quotas for project c10e7136b9a5458f8370f7c4e4798415. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:22:18.429382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-5d253996-ef06-429a-8ca6-2cc7f197bb8f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Getting quotas for user 043d150ebd3548cc9afb4064fc0f2520 and project c10e7136b9a5458f8370f7c4e4798415. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:22:18.446100 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5d253996-ef06-429a-8ca6-2cc7f197bb8f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:22:18.448780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5d253996-ef06-429a-8ca6-2cc7f197bb8f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:22:18.734266 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5d253996-ef06-429a-8ca6-2cc7f197bb8f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.595156 May 21 21:22:18.735224 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1557/3047] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:22:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:22:18.746719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-799ca34d-65c6-4fd3-9f0f-ff53163b72ba tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:18.754339 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-799ca34d-65c6-4fd3-9f0f-ff53163b72ba tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:19.014227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-59df32d7-51ab-42d3-8c9d-6825f2552ba5 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c12cdb0dccf44b989a23724b1d87870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4473aa2ed54e1fafaf2f8b339bb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:19.034301 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-59df32d7-51ab-42d3-8c9d-6825f2552ba5 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d" status: 200 len: 1666 microversion: 2.1 time: 0.648171 May 21 21:22:19.034947 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1491/3048] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:18 2022] GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d => generated 1666 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:19.044802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1d1e9149-2a29-4dd0-b9d0-5f2b0710b453 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:19.044802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1d1e9149-2a29-4dd0-b9d0-5f2b0710b453 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:19.058313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d1e9149-2a29-4dd0-b9d0-5f2b0710b453 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:19.059035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d1e9149-2a29-4dd0-b9d0-5f2b0710b453 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:19.060660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d1e9149-2a29-4dd0-b9d0-5f2b0710b453 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:19.064112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d1e9149-2a29-4dd0-b9d0-5f2b0710b453 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:19.418225 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1d1e9149-2a29-4dd0-b9d0-5f2b0710b453 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:19.440101 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1d1e9149-2a29-4dd0-b9d0-5f2b0710b453 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb" status: 200 len: 1469 microversion: 2.1 time: 0.404038 May 21 21:22:19.453371 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1492/3049] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:19 2022] GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb => generated 1469 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:19.458704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-797b17ab-f0eb-4732-988e-b93c923b5635 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:19.461430 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-797b17ab-f0eb-4732-988e-b93c923b5635 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 97b22b0c-a0a1-48d7-96b0-448cbabe4fae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:19.466426 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-797b17ab-f0eb-4732-988e-b93c923b5635 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:19.466882 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-797b17ab-f0eb-4732-988e-b93c923b5635 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:19.467673 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-797b17ab-f0eb-4732-988e-b93c923b5635 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:19.468363 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-797b17ab-f0eb-4732-988e-b93c923b5635 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:19.498164 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-799ca34d-65c6-4fd3-9f0f-ff53163b72ba tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:19.508390 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-799ca34d-65c6-4fd3-9f0f-ff53163b72ba tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 200 len: 1221 microversion: 2.1 time: 0.765596 May 21 21:22:19.510223 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1558/3050] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:18 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 1221 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:19.725344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-797b17ab-f0eb-4732-988e-b93c923b5635 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:19.739399 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-797b17ab-f0eb-4732-988e-b93c923b5635 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/97b22b0c-a0a1-48d7-96b0-448cbabe4fae" status: 200 len: 1469 microversion: 2.1 time: 0.284644 May 21 21:22:19.743552 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1493/3051] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:19 2022] GET /compute/v2.1/servers/97b22b0c-a0a1-48d7-96b0-448cbabe4fae => generated 1469 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:19.765531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7ac5adaa-dbf9-44cb-a335-ef3205264dd4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:19.773806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7ac5adaa-dbf9-44cb-a335-ef3205264dd4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:19.774918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7ac5adaa-dbf9-44cb-a335-ef3205264dd4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Searching by: {'reservation_id': 'r-0at8plf5', 'deleted': False, 'project_id': '00752ed7cdc0495dbf5533e82dccc017'} {{(pid=131277) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:22:19.791936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ac5adaa-dbf9-44cb-a335-ef3205264dd4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:19.793121 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ac5adaa-dbf9-44cb-a335-ef3205264dd4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:19.794145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ac5adaa-dbf9-44cb-a335-ef3205264dd4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:19.794795 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ac5adaa-dbf9-44cb-a335-ef3205264dd4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:19.965542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.multi_cell_list [None req-7ac5adaa-dbf9-44cb-a335-ef3205264dd4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131277) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:22:20.062520 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-526741ca-d49a-494b-9e83-058e5bfc92a4 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:20.065565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-526741ca-d49a-494b-9e83-058e5bfc92a4 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:20.078232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7ac5adaa-dbf9-44cb-a335-ef3205264dd4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:20.088455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ac5adaa-dbf9-44cb-a335-ef3205264dd4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:20.095123 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ac5adaa-dbf9-44cb-a335-ef3205264dd4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:20.095273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-526741ca-d49a-494b-9e83-058e5bfc92a4 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:20.095273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-526741ca-d49a-494b-9e83-058e5bfc92a4 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:20.095273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-526741ca-d49a-494b-9e83-058e5bfc92a4 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:20.095273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-526741ca-d49a-494b-9e83-058e5bfc92a4 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:20.341841 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7ac5adaa-dbf9-44cb-a335-ef3205264dd4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?reservation_id=r-0at8plf5" status: 200 len: 2931 microversion: 2.1 time: 0.583318 May 21 21:22:20.342663 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1559/3052] 10.222.0.49 () {58 vars in 1196 bytes} [Sat May 21 21:22:19 2022] GET /compute/v2.1/servers/detail?reservation_id=r-0at8plf5 => generated 2931 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:20.371574 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c757d086-9053-46d1-84b1-f7dc03acb6e3 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:20.403600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.compute.server_groups [None req-c757d086-9053-46d1-84b1-f7dc03acb6e3 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Querying cell 4f046ce9-ac6c-44d8-b1fb-b7063eef06e7(cell1) for 2 instances {{(pid=131277) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 21 21:22:20.411327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c757d086-9053-46d1-84b1-f7dc03acb6e3 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:20.411327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c757d086-9053-46d1-84b1-f7dc03acb6e3 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:20.482286 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c757d086-9053-46d1-84b1-f7dc03acb6e3 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups/ef2f2b7c-8671-4cf6-ac5a-42662612f946" status: 200 len: 265 microversion: 2.1 time: 0.114604 May 21 21:22:20.485406 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1560/3053] 10.222.0.49 () {58 vars in 1262 bytes} [Sat May 21 21:22:20 2022] GET /compute/v2.1/os-server-groups/ef2f2b7c-8671-4cf6-ac5a-42662612f946 => generated 265 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:20.498031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a9148c0f-7d67-402d-aec6-9e99144d63d0 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:20.499782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a9148c0f-7d67-402d-aec6-9e99144d63d0 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] [instance: 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:20.515492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9148c0f-7d67-402d-aec6-9e99144d63d0 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:20.519460 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9148c0f-7d67-402d-aec6-9e99144d63d0 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:20.520747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9148c0f-7d67-402d-aec6-9e99144d63d0 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:20.524691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9148c0f-7d67-402d-aec6-9e99144d63d0 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:20.957182 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a9148c0f-7d67-402d-aec6-9e99144d63d0 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb" status: 200 len: 1620 microversion: 2.1 time: 0.455621 May 21 21:22:20.957182 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1561/3054] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:20 2022] GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb => generated 1620 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:20.957182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-54e1216b-33c8-46d5-98bc-08485864db59 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:20.957182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-54e1216b-33c8-46d5-98bc-08485864db59 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:20.957182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:20.965231 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-526741ca-d49a-494b-9e83-058e5bfc92a4 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c12cdb0dccf44b989a23724b1d87870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4473aa2ed54e1fafaf2f8b339bb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:20.976408 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54e1216b-33c8-46d5-98bc-08485864db59 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:20.977798 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-526741ca-d49a-494b-9e83-058e5bfc92a4 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d" status: 200 len: 1666 microversion: 2.1 time: 0.928337 May 21 21:22:20.978410 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1494/3055] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:20 2022] GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d => generated 1666 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:20.979486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54e1216b-33c8-46d5-98bc-08485864db59 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:20.982746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54e1216b-33c8-46d5-98bc-08485864db59 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:20.983416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54e1216b-33c8-46d5-98bc-08485864db59 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:20.991498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fa78cd34-61a6-424e-b702-285129914f7f tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:20.992197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fa78cd34-61a6-424e-b702-285129914f7f tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] [instance: 97b22b0c-a0a1-48d7-96b0-448cbabe4fae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:21.010034 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa78cd34-61a6-424e-b702-285129914f7f tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:21.010583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa78cd34-61a6-424e-b702-285129914f7f tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:21.012436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa78cd34-61a6-424e-b702-285129914f7f tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:21.013000 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa78cd34-61a6-424e-b702-285129914f7f tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:21.168450 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-54e1216b-33c8-46d5-98bc-08485864db59 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:21.184259 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-54e1216b-33c8-46d5-98bc-08485864db59 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 200 len: 1217 microversion: 2.1 time: 0.236810 May 21 21:22:21.185469 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1562/3056] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:20 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 1217 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:21.825294 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fa78cd34-61a6-424e-b702-285129914f7f tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/97b22b0c-a0a1-48d7-96b0-448cbabe4fae" status: 200 len: 1620 microversion: 2.1 time: 0.845751 May 21 21:22:21.827695 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1495/3057] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:20 2022] GET /compute/v2.1/servers/97b22b0c-a0a1-48d7-96b0-448cbabe4fae => generated 1620 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:21.847054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-270b5ee7-7866-496c-91a4-a2754a90813a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Action: 'create', calling method: .version_select at 0x7fc81b435550>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-425489877", "policies": ["anti-affinity"]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:21.872222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-270b5ee7-7866-496c-91a4-a2754a90813a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_groups'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:22:21.878239 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-270b5ee7-7866-496c-91a4-a2754a90813a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for user 945ab557c0e24cfdbcab74684a5d5800 and project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_groups'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:22:21.996633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d123fc16-194e-4959-a0dd-32a36296d31d tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:21.997531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d123fc16-194e-4959-a0dd-32a36296d31d tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:21.999080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-270b5ee7-7866-496c-91a4-a2754a90813a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_groups'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:22:22.008473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-270b5ee7-7866-496c-91a4-a2754a90813a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for user 945ab557c0e24cfdbcab74684a5d5800 and project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_groups'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:22:22.009322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d123fc16-194e-4959-a0dd-32a36296d31d tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:22.012447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d123fc16-194e-4959-a0dd-32a36296d31d tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:22.012447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d123fc16-194e-4959-a0dd-32a36296d31d tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:22.012447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d123fc16-194e-4959-a0dd-32a36296d31d tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:22.030961 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-270b5ee7-7866-496c-91a4-a2754a90813a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.187637 May 21 21:22:22.033301 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1563/3058] 10.222.0.49 () {60 vars in 1173 bytes} [Sat May 21 21:22:21 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:22.250000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-133eb8fb-7322-44e4-a702-3c62180caa1f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:22.251339 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-133eb8fb-7322-44e4-a702-3c62180caa1f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:22.261037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-133eb8fb-7322-44e4-a702-3c62180caa1f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:22.261499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-133eb8fb-7322-44e4-a702-3c62180caa1f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:22.262809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-133eb8fb-7322-44e4-a702-3c62180caa1f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:22.268409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-133eb8fb-7322-44e4-a702-3c62180caa1f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:22.475169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-133eb8fb-7322-44e4-a702-3c62180caa1f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:22.485654 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-133eb8fb-7322-44e4-a702-3c62180caa1f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 200 len: 1291 microversion: 2.1 time: 0.240390 May 21 21:22:22.495232 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1564/3059] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:22 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 1291 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:22.495232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-822587357", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "4c2367df-271d-4b8f-a5dd-415602156def"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:22.528770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d123fc16-194e-4959-a0dd-32a36296d31d tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c12cdb0dccf44b989a23724b1d87870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4473aa2ed54e1fafaf2f8b339bb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:22.534139 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d123fc16-194e-4959-a0dd-32a36296d31d tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d" status: 200 len: 1599 microversion: 2.1 time: 0.540782 May 21 21:22:22.534867 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1496/3060] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:21 2022] GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d => generated 1599 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:22.554703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] validate_networks() for None {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:22:22.997770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:22:22.998459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:22:22.998721 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:22:22.999256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:22:22.999761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:22:23.024810 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:23.031481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:23.031481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:23.031481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:23.065047 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:22:23.081507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for user 945ab557c0e24cfdbcab74684a5d5800 and project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:22:23.098350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Going to run 2 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:22:23.101596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: ca640d8e-17ec-4ff3-940f-39d6976115f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:22:23.331216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_group_members'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:22:23.337598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for user 945ab557c0e24cfdbcab74684a5d5800 and project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_group_members'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:22:23.473341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_group_members'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:22:23.478136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for user 945ab557c0e24cfdbcab74684a5d5800 and project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_group_members'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:22:23.503963 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-307c0f18-d8c5-499a-a83f-d3671a00c557 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:23.504782 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-307c0f18-d8c5-499a-a83f-d3671a00c557 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:23.507824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=ca640d8e-17ec-4ff3-940f-39d6976115f7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:22:23.516228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-307c0f18-d8c5-499a-a83f-d3671a00c557 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:23.516732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-307c0f18-d8c5-499a-a83f-d3671a00c557 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:23.524732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-307c0f18-d8c5-499a-a83f-d3671a00c557 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:23.525429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-307c0f18-d8c5-499a-a83f-d3671a00c557 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:23.632129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_group_members'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:22:23.638359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for user 945ab557c0e24cfdbcab74684a5d5800 and project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_group_members'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:22:23.785702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-307c0f18-d8c5-499a-a83f-d3671a00c557 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:23.798367 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-307c0f18-d8c5-499a-a83f-d3671a00c557 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 200 len: 1279 microversion: 2.1 time: 0.300087 May 21 21:22:23.816566 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1497/3061] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:23 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 1279 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:23.824403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a7e19473-0835-415d-811c-8230c5ad4f0f tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:23.825207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a7e19473-0835-415d-811c-8230c5ad4f0f tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:23.833191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7e19473-0835-415d-811c-8230c5ad4f0f tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:23.834166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7e19473-0835-415d-811c-8230c5ad4f0f tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:23.836090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7e19473-0835-415d-811c-8230c5ad4f0f tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:23.836768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7e19473-0835-415d-811c-8230c5ad4f0f tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:23.846105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_group_members'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:22:23.860741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for user 945ab557c0e24cfdbcab74684a5d5800 and project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'server_group_members'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:22:23.887543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:23.937345 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ff3fef29-a4b4-435e-b193-ba082cc5dc11 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.449577 May 21 21:22:23.938217 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1565/3062] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:22:22 2022] POST /compute/v2.1/servers => generated 32 bytes in 1451 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 21 21:22:23.950613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-700eb83e-5c4e-4fec-8b39-ed3bc3e518f6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:23.958755 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-700eb83e-5c4e-4fec-8b39-ed3bc3e518f6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:23.966176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-700eb83e-5c4e-4fec-8b39-ed3bc3e518f6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Searching by: {'deleted': False, 'project_id': '00752ed7cdc0495dbf5533e82dccc017'} {{(pid=131277) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:22:24.025835 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-700eb83e-5c4e-4fec-8b39-ed3bc3e518f6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:24.026995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-700eb83e-5c4e-4fec-8b39-ed3bc3e518f6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:24.028010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-700eb83e-5c4e-4fec-8b39-ed3bc3e518f6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:24.028638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-700eb83e-5c4e-4fec-8b39-ed3bc3e518f6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:24.080101 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a7e19473-0835-415d-811c-8230c5ad4f0f tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c12cdb0dccf44b989a23724b1d87870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4473aa2ed54e1fafaf2f8b339bb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:24.086720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:24.093299 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a7e19473-0835-415d-811c-8230c5ad4f0f tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d" status: 200 len: 1599 microversion: 2.1 time: 0.275119 May 21 21:22:24.110326 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1498/3063] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:23 2022] GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d => generated 1599 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:24.172221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-8577b052-709e-48ba-8d87-401dbbaf4e29 req-b502e341-1ad5-4bcc-900f-5ee73d7d371d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fd11a9f-6f38-4281-bbb1-747ed176df6d", "name": "network-vif-deleted", "tag": "f5b2c3de-be0f-4b80-b734-600dc61538bd"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:24.200469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-8577b052-709e-48ba-8d87-401dbbaf4e29 req-b502e341-1ad5-4bcc-900f-5ee73d7d371d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:24.204114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-8577b052-709e-48ba-8d87-401dbbaf4e29 req-b502e341-1ad5-4bcc-900f-5ee73d7d371d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:24.260637 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-8577b052-709e-48ba-8d87-401dbbaf4e29 req-b502e341-1ad5-4bcc-900f-5ee73d7d371d service nova] Creating event network-vif-deleted:f5b2c3de-be0f-4b80-b734-600dc61538bd for instance 9fd11a9f-6f38-4281-bbb1-747ed176df6d on nch1-master-1 May 21 21:22:24.263537 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.multi_cell_list [None req-700eb83e-5c4e-4fec-8b39-ed3bc3e518f6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=131277) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:22:24.287192 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-8577b052-709e-48ba-8d87-401dbbaf4e29 req-b502e341-1ad5-4bcc-900f-5ee73d7d371d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121492 May 21 21:22:24.289738 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1499/3064] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 21 21:22:24.451780 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-700eb83e-5c4e-4fec-8b39-ed3bc3e518f6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.506096 May 21 21:22:24.454603 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1566/3065] 10.222.0.49 () {58 vars in 1124 bytes} [Sat May 21 21:22:23 2022] GET /compute/v2.1/servers => generated 1663 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:24.466828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c45fb974-072a-44a2-b945-5705822d170b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:24.467572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c45fb974-072a-44a2-b945-5705822d170b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:24.635026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c45fb974-072a-44a2-b945-5705822d170b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:24.644964 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c45fb974-072a-44a2-b945-5705822d170b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 200 len: 1218 microversion: 2.1 time: 0.182705 May 21 21:22:24.647630 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1500/3066] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:24 2022] GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 1218 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:24.827239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6c3ddafe-9218-4059-8382-66371acee8bc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:24.829798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6c3ddafe-9218-4059-8382-66371acee8bc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:24.852677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c3ddafe-9218-4059-8382-66371acee8bc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:24.853205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c3ddafe-9218-4059-8382-66371acee8bc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:24.854053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c3ddafe-9218-4059-8382-66371acee8bc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:24.857128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c3ddafe-9218-4059-8382-66371acee8bc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:24.872001 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1f2aacaf-1383-46f6-9542-ab321619f5dc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'create', calling method: .version_select at 0x7fc81b4b18b0>, body: {"keypair": {"name": "tempest-keypair-709836461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwVwWldVFaQA6MNBzJv9f3KqbOyF94l6WP8LGieaejQjKzRLIjBhRSSnhJfUS4TJhKO4iFDnqhfMpUhUAVRVWWpaaZBccUgijHMgxvJ7l+VdsjSutlnVYsf1zRvo1JEDw=="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:24.908731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-1f2aacaf-1383-46f6-9542-ab321619f5dc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Getting quotas for project 014ae80b3f434bcb9fa2629ccdf4aad7. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:22:24.936511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-1f2aacaf-1383-46f6-9542-ab321619f5dc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Getting quotas for user 1cafab0cbef64be59c7afef84d7888ff and project 014ae80b3f434bcb9fa2629ccdf4aad7. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:22:24.995458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6c3ddafe-9218-4059-8382-66371acee8bc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:25.018406 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6c3ddafe-9218-4059-8382-66371acee8bc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 200 len: 1279 microversion: 2.1 time: 0.200688 May 21 21:22:25.025357 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1501/3067] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:24 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 1279 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:25.052823 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1f2aacaf-1383-46f6-9542-ab321619f5dc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.465977 May 21 21:22:25.053836 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1567/3068] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:22:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:25.110842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6d83d464-fba5-4b29-a333-d7165aaf0b51 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:25.111477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6d83d464-fba5-4b29-a333-d7165aaf0b51 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:25.125695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d83d464-fba5-4b29-a333-d7165aaf0b51 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:25.126161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d83d464-fba5-4b29-a333-d7165aaf0b51 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:25.126974 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d83d464-fba5-4b29-a333-d7165aaf0b51 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:25.127423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d83d464-fba5-4b29-a333-d7165aaf0b51 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:25.202988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d83d464-fba5-4b29-a333-d7165aaf0b51 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:25.204470 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d83d464-fba5-4b29-a333-d7165aaf0b51 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:25.207533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-6d83d464-fba5-4b29-a333-d7165aaf0b51 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lazy-loading 'fault' on Instance uuid 9fd11a9f-6f38-4281-bbb1-747ed176df6d {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:22:25.395538 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6d83d464-fba5-4b29-a333-d7165aaf0b51 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c12cdb0dccf44b989a23724b1d87870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4473aa2ed54e1fafaf2f8b339bb065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:25.413854 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6d83d464-fba5-4b29-a333-d7165aaf0b51 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d" status: 200 len: 1316 microversion: 2.1 time: 0.306857 May 21 21:22:25.417079 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1502/3069] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:25 2022] GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:25.665910 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-82cb3c29-3e42-4852-809f-345f8241316a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:25.666828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-82cb3c29-3e42-4852-809f-345f8241316a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:25.784085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-82cb3c29-3e42-4852-809f-345f8241316a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:25.793865 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-82cb3c29-3e42-4852-809f-345f8241316a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 200 len: 1218 microversion: 2.1 time: 0.134378 May 21 21:22:25.810556 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1568/3070] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:25 2022] GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 1218 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:26.035988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0fcf4c55-3a1b-4beb-9097-cda82a025ee3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:26.036981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0fcf4c55-3a1b-4beb-9097-cda82a025ee3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:26.054397 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fcf4c55-3a1b-4beb-9097-cda82a025ee3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:26.060411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fcf4c55-3a1b-4beb-9097-cda82a025ee3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:26.061394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fcf4c55-3a1b-4beb-9097-cda82a025ee3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:26.061861 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fcf4c55-3a1b-4beb-9097-cda82a025ee3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:26.438066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-18deb893-ab21-43a1-ba33-d01813531c94 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:26.439232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-18deb893-ab21-43a1-ba33-d01813531c94 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] [instance: 9fd11a9f-6f38-4281-bbb1-747ed176df6d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:26.447087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-18deb893-ab21-43a1-ba33-d01813531c94 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:26.447474 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-18deb893-ab21-43a1-ba33-d01813531c94 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:26.448350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-18deb893-ab21-43a1-ba33-d01813531c94 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:26.448974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-18deb893-ab21-43a1-ba33-d01813531c94 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:26.470972 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-18deb893-ab21-43a1-ba33-d01813531c94 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] HTTP exception thrown: Instance 9fd11a9f-6f38-4281-bbb1-747ed176df6d could not be found. May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-18deb893-ab21-43a1-ba33-d01813531c94 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Request method failure captured: May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d HTTP/1.1 May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVfO6syIL0hWFRPfq9ygOlJGinxe3WHoprPEuW0LHhzzu4Xc11yMFWYho9xEOn-F0rLhc5D4Lq4AOlBAsyGQeNJTRX5Oz1nVxRUSpiz2zT9hs2HH-Pcm5VfYtXTpt3qjQUsIt89gz7as9VkVoggC8AL1tmmxoFj-SgditdmiFYf77EE May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 6e4473aa2ed54e1fafaf2f8b339bb065 May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersTestFqdnHostnames-124612156 May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6e4473aa2ed54e1fafaf2f8b339bb065"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6e4473aa2ed54e1fafaf2f8b339bb065"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6e4473aa2ed54e1fafaf2f8b339bb065", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6e4473aa2ed54e1fafaf2f8b339bb065"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersTestFqdnHostnames-124612156 May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 6e4473aa2ed54e1fafaf2f8b339bb065 May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-124612156 May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersTestFqdnHostnames-124612156-project May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 9c12cdb0dccf44b989a23724b1d87870 May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersTestFqdnHostnames-124612156-project May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 9fd11a9f-6f38-4281-bbb1-747ed176df6d could not be found. May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '9fd11a9f-6f38-4281-bbb1-747ed176df6d'} May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fd11a9f-6f38-4281-bbb1-747ed176df6d could not be found. May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fd11a9f-6f38-4281-bbb1-747ed176df6d could not be found. May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:22:26.473395 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:22:26.478494 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:22:26.478494 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:22:26.478494 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:22:26.478494 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:22:26.478494 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:22:26.478494 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fd11a9f-6f38-4281-bbb1-747ed176df6d could not be found. May 21 21:22:26.478494 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:22:26.480579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-18deb893-ab21-43a1-ba33-d01813531c94 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Returning 404 to user: Instance 9fd11a9f-6f38-4281-bbb1-747ed176df6d could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:22:26.481725 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-18deb893-ab21-43a1-ba33-d01813531c94 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d" status: 404 len: 111 microversion: 2.1 time: 0.051037 May 21 21:22:26.482875 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1569/3071] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:26 2022] GET /compute/v2.1/servers/9fd11a9f-6f38-4281-bbb1-747ed176df6d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:22:26.495051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c934886e-06a4-466a-b365-2017c7e81d98 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] Calling method '.version_select at 0x7fc81aad10d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:26.591456 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c934886e-06a4-466a-b365-2017c7e81d98 tempest-ServersTestFqdnHostnames-124612156 tempest-ServersTestFqdnHostnames-124612156-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1694979399" status: 202 len: 0 microversion: 2.1 time: 0.103800 May 21 21:22:26.593840 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1570/3072] 10.222.0.49 () {58 vars in 1220 bytes} [Sat May 21 21:22:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1694979399 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:22:26.671873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0fcf4c55-3a1b-4beb-9097-cda82a025ee3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:26.674876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:26.682486 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0fcf4c55-3a1b-4beb-9097-cda82a025ee3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 200 len: 1321 microversion: 2.1 time: 0.649862 May 21 21:22:26.683317 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1503/3073] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:26 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 1321 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:26.812382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c63ea6e6-93e9-4974-b3bb-fd7593ae2b62 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:26.813273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c63ea6e6-93e9-4974-b3bb-fd7593ae2b62 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:26.826135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c63ea6e6-93e9-4974-b3bb-fd7593ae2b62 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:26.828797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c63ea6e6-93e9-4974-b3bb-fd7593ae2b62 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:26.829721 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c63ea6e6-93e9-4974-b3bb-fd7593ae2b62 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:26.830243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c63ea6e6-93e9-4974-b3bb-fd7593ae2b62 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:26.949603 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c63ea6e6-93e9-4974-b3bb-fd7593ae2b62 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:26.966311 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c63ea6e6-93e9-4974-b3bb-fd7593ae2b62 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 200 len: 1222 microversion: 2.1 time: 0.158605 May 21 21:22:26.969750 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1571/3074] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:26 2022] GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 1222 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:27.701751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-59b43922-3e41-4687-aec6-c832e44a6404 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:27.703393 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-59b43922-3e41-4687-aec6-c832e44a6404 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:27.743934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59b43922-3e41-4687-aec6-c832e44a6404 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:27.744718 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59b43922-3e41-4687-aec6-c832e44a6404 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:27.746110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59b43922-3e41-4687-aec6-c832e44a6404 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:27.746886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59b43922-3e41-4687-aec6-c832e44a6404 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:27.987147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-65afac17-be45-4203-9d69-34ed6567280f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:27.987764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-65afac17-be45-4203-9d69-34ed6567280f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:27.996188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65afac17-be45-4203-9d69-34ed6567280f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:27.997592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65afac17-be45-4203-9d69-34ed6567280f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:27.999445 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65afac17-be45-4203-9d69-34ed6567280f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:28.000088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65afac17-be45-4203-9d69-34ed6567280f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:28.640229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-65afac17-be45-4203-9d69-34ed6567280f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:28.686539 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-65afac17-be45-4203-9d69-34ed6567280f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 200 len: 1270 microversion: 2.1 time: 0.699655 May 21 21:22:28.688059 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1572/3075] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:27 2022] GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 1270 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:28.702759 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-ee4d8f73-7d69-4a30-8083-a17dc23cebec req-33eef683-cab4-4f47-a4c7-552f858f6210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68c77575-86cb-40b7-806a-95040277083e", "tag": "613e338a-0cdd-4d81-ac2c-ef11254618ba"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:28.725698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ee4d8f73-7d69-4a30-8083-a17dc23cebec req-33eef683-cab4-4f47-a4c7-552f858f6210 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:28.726228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ee4d8f73-7d69-4a30-8083-a17dc23cebec req-33eef683-cab4-4f47-a4c7-552f858f6210 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:28.738419 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:28.741640 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-ee4d8f73-7d69-4a30-8083-a17dc23cebec req-33eef683-cab4-4f47-a4c7-552f858f6210 service nova] Creating event network-changed:613e338a-0cdd-4d81-ac2c-ef11254618ba for instance 68c77575-86cb-40b7-806a-95040277083e on nch2-master-1 May 21 21:22:28.746830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-59b43922-3e41-4687-aec6-c832e44a6404 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:28.748919 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-ee4d8f73-7d69-4a30-8083-a17dc23cebec req-33eef683-cab4-4f47-a4c7-552f858f6210 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058013 May 21 21:22:28.751331 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1573/3076] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:28.764625 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-59b43922-3e41-4687-aec6-c832e44a6404 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 200 len: 1321 microversion: 2.1 time: 1.061054 May 21 21:22:28.764625 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1504/3077] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:27 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 1321 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:29.708126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4a540914-7d10-4c45-b322-4e35a721e395 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:29.708984 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4a540914-7d10-4c45-b322-4e35a721e395 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:29.733233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a540914-7d10-4c45-b322-4e35a721e395 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:29.736408 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a540914-7d10-4c45-b322-4e35a721e395 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:29.737605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a540914-7d10-4c45-b322-4e35a721e395 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:29.740622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a540914-7d10-4c45-b322-4e35a721e395 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:29.779705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e4e1e1bb-9104-493a-8662-4851c489ab03 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:29.779705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e4e1e1bb-9104-493a-8662-4851c489ab03 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:29.794111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e4e1e1bb-9104-493a-8662-4851c489ab03 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:29.794912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e4e1e1bb-9104-493a-8662-4851c489ab03 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:29.796021 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e4e1e1bb-9104-493a-8662-4851c489ab03 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:29.797618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e4e1e1bb-9104-493a-8662-4851c489ab03 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:30.061238 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4a540914-7d10-4c45-b322-4e35a721e395 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:30.079210 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4a540914-7d10-4c45-b322-4e35a721e395 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 200 len: 1276 microversion: 2.1 time: 0.376721 May 21 21:22:30.084519 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1574/3078] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:29 2022] GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 1276 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:30.575291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e4e1e1bb-9104-493a-8662-4851c489ab03 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:30.588108 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e4e1e1bb-9104-493a-8662-4851c489ab03 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 200 len: 1321 microversion: 2.1 time: 0.810114 May 21 21:22:30.588108 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1505/3079] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:29 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 1321 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:30.853868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-ab286573-ea33-4b5c-9ad6-332afdfee726 req-d61942eb-bbde-4e78-b349-b95a1b968a65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4143810-5eb7-4f74-b8d7-26207617a6a6", "tag": "b2a5ce56-811a-45c9-b326-7daf516d5141"}, {"name": "network-changed", "server_uuid": "718c5e70-0e1a-4143-95e2-4741be1b87a0", "tag": "5b53c0fa-b4bf-4fc9-9315-4fe022a5be6d"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:30.870376 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ab286573-ea33-4b5c-9ad6-332afdfee726 req-d61942eb-bbde-4e78-b349-b95a1b968a65 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:30.875854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ab286573-ea33-4b5c-9ad6-332afdfee726 req-d61942eb-bbde-4e78-b349-b95a1b968a65 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:30.903876 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-ab286573-ea33-4b5c-9ad6-332afdfee726 req-d61942eb-bbde-4e78-b349-b95a1b968a65 service nova] Creating event network-changed:b2a5ce56-811a-45c9-b326-7daf516d5141 for instance e4143810-5eb7-4f74-b8d7-26207617a6a6 on nch2-master-1 May 21 21:22:30.913884 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-ab286573-ea33-4b5c-9ad6-332afdfee726 req-d61942eb-bbde-4e78-b349-b95a1b968a65 service nova] Creating event network-changed:5b53c0fa-b4bf-4fc9-9315-4fe022a5be6d for instance 718c5e70-0e1a-4143-95e2-4741be1b87a0 on nch2-master-1 May 21 21:22:30.933408 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-ab286573-ea33-4b5c-9ad6-332afdfee726 req-d61942eb-bbde-4e78-b349-b95a1b968a65 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.083280 May 21 21:22:30.934631 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1575/3080] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:22:31.149648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-73d9a66d-5aa6-4a1c-a886-0111ce922226 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:31.150223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-73d9a66d-5aa6-4a1c-a886-0111ce922226 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:31.168917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-73d9a66d-5aa6-4a1c-a886-0111ce922226 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:31.170017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-73d9a66d-5aa6-4a1c-a886-0111ce922226 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:31.171344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-73d9a66d-5aa6-4a1c-a886-0111ce922226 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:31.172549 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-73d9a66d-5aa6-4a1c-a886-0111ce922226 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:31.268469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-73d9a66d-5aa6-4a1c-a886-0111ce922226 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:31.275753 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-73d9a66d-5aa6-4a1c-a886-0111ce922226 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 200 len: 1276 microversion: 2.1 time: 0.130763 May 21 21:22:31.276538 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1506/3081] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:31 2022] GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 1276 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:31.601888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a29c7108-3d50-48d2-912b-9213e370ea15 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:31.602814 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a29c7108-3d50-48d2-912b-9213e370ea15 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:31.619976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a29c7108-3d50-48d2-912b-9213e370ea15 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:31.620895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a29c7108-3d50-48d2-912b-9213e370ea15 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:31.622103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a29c7108-3d50-48d2-912b-9213e370ea15 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:31.624820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a29c7108-3d50-48d2-912b-9213e370ea15 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:32.240907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a29c7108-3d50-48d2-912b-9213e370ea15 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:32.249857 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a29c7108-3d50-48d2-912b-9213e370ea15 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 200 len: 1321 microversion: 2.1 time: 0.652543 May 21 21:22:32.259615 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1576/3082] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:31 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 1321 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:32.293416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f97b28c8-29d1-4f29-bef2-b7ee0676b114 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:32.294097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f97b28c8-29d1-4f29-bef2-b7ee0676b114 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:32.301799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f97b28c8-29d1-4f29-bef2-b7ee0676b114 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:32.305268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f97b28c8-29d1-4f29-bef2-b7ee0676b114 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:32.305268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f97b28c8-29d1-4f29-bef2-b7ee0676b114 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:32.305268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f97b28c8-29d1-4f29-bef2-b7ee0676b114 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:32.359525 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ca163d88-8a18-42da-ad4f-130997f6adbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-145644355", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d4cf0c3-1319-4035-9b9a-7c7b54e6e093"}], "security_groups": [{"name": "tempest-securitygroup--1200697296"}], "key_name": "tempest-keypair-709836461", "user_data": "}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:32.546344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-ca163d88-8a18-42da-ad4f-130997f6adbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] validate_networks() for [('5d4cf0c3-1319-4035-9b9a-7c7b54e6e093', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:22:32.712102 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f97b28c8-29d1-4f29-bef2-b7ee0676b114 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:32.727320 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f97b28c8-29d1-4f29-bef2-b7ee0676b114 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 200 len: 1318 microversion: 2.1 time: 0.437636 May 21 21:22:32.747404 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1507/3083] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:32 2022] GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:33.269675 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9961865a-245d-4275-a4b7-f82a78fe2709 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:33.271668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9961865a-245d-4275-a4b7-f82a78fe2709 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:33.293190 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9961865a-245d-4275-a4b7-f82a78fe2709 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:33.295357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9961865a-245d-4275-a4b7-f82a78fe2709 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:33.305976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9961865a-245d-4275-a4b7-f82a78fe2709 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:33.306525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9961865a-245d-4275-a4b7-f82a78fe2709 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:34.098310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=10 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:34.341933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9961865a-245d-4275-a4b7-f82a78fe2709 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:34.352343 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9961865a-245d-4275-a4b7-f82a78fe2709 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 200 len: 1321 microversion: 2.1 time: 1.088126 May 21 21:22:34.362494 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1508/3084] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:33 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 1321 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:34.362494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f01bf1d2-6a89-4e7b-b745-89c1c0c76433 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:34.362494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f01bf1d2-6a89-4e7b-b745-89c1c0c76433 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:34.367626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f01bf1d2-6a89-4e7b-b745-89c1c0c76433 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:34.368434 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f01bf1d2-6a89-4e7b-b745-89c1c0c76433 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:34.369232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f01bf1d2-6a89-4e7b-b745-89c1c0c76433 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:34.369671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f01bf1d2-6a89-4e7b-b745-89c1c0c76433 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:34.452308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ca163d88-8a18-42da-ad4f-130997f6adbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:22:34.453137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ca163d88-8a18-42da-ad4f-130997f6adbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:22:34.459841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ca163d88-8a18-42da-ad4f-130997f6adbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:22:34.465895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ca163d88-8a18-42da-ad4f-130997f6adbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:22:34.465895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ca163d88-8a18-42da-ad4f-130997f6adbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:22:34.474235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca163d88-8a18-42da-ad4f-130997f6adbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:34.475240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca163d88-8a18-42da-ad4f-130997f6adbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:34.476932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca163d88-8a18-42da-ad4f-130997f6adbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:34.477614 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca163d88-8a18-42da-ad4f-130997f6adbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:34.502001 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ca163d88-8a18-42da-ad4f-130997f6adbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Getting quotas for project 014ae80b3f434bcb9fa2629ccdf4aad7. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:22:34.509528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ca163d88-8a18-42da-ad4f-130997f6adbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Getting quotas for user 1cafab0cbef64be59c7afef84d7888ff and project 014ae80b3f434bcb9fa2629ccdf4aad7. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:22:34.525668 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ca163d88-8a18-42da-ad4f-130997f6adbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:22:34.528912 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ca163d88-8a18-42da-ad4f-130997f6adbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:22:34.642214 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=8 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:34.703279 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ca163d88-8a18-42da-ad4f-130997f6adbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.346433 May 21 21:22:34.721114 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1577/3085] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:22:32 2022] POST /compute/v2.1/servers => generated 409 bytes in 2359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:22:34.730913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b9c9c137-fce0-40da-b20e-0cfe23026f22 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:34.731899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b9c9c137-fce0-40da-b20e-0cfe23026f22 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:34.811727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b9c9c137-fce0-40da-b20e-0cfe23026f22 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:34.821122 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b9c9c137-fce0-40da-b20e-0cfe23026f22 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1237 microversion: 2.1 time: 0.105477 May 21 21:22:34.831040 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1578/3086] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:34 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1237 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:34.831616 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f01bf1d2-6a89-4e7b-b745-89c1c0c76433 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:34.837013 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f01bf1d2-6a89-4e7b-b745-89c1c0c76433 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 200 len: 1318 microversion: 2.1 time: 0.482384 May 21 21:22:34.848426 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1509/3087] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:34 2022] GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:34.972233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-5a435ea0-b0f3-4914-8931-eaeb006015d0 req-af63b99d-1c8f-4609-aeca-9ad96bbe8328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca640d8e-17ec-4ff3-940f-39d6976115f7", "tag": "57aedb68-8786-41c1-bf7a-e68c09bd3910"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:34.989833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5a435ea0-b0f3-4914-8931-eaeb006015d0 req-af63b99d-1c8f-4609-aeca-9ad96bbe8328 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:34.989833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5a435ea0-b0f3-4914-8931-eaeb006015d0 req-af63b99d-1c8f-4609-aeca-9ad96bbe8328 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:35.020315 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-5a435ea0-b0f3-4914-8931-eaeb006015d0 req-af63b99d-1c8f-4609-aeca-9ad96bbe8328 service nova] Creating event network-changed:57aedb68-8786-41c1-bf7a-e68c09bd3910 for instance ca640d8e-17ec-4ff3-940f-39d6976115f7 on nch2-master-1 May 21 21:22:35.026782 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-5a435ea0-b0f3-4914-8931-eaeb006015d0 req-af63b99d-1c8f-4609-aeca-9ad96bbe8328 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059461 May 21 21:22:35.029158 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1579/3088] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:35.370391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4e3af324-fe18-4ad7-a174-e99837aa8457 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:35.372178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4e3af324-fe18-4ad7-a174-e99837aa8457 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:35.403211 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e3af324-fe18-4ad7-a174-e99837aa8457 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:35.404916 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e3af324-fe18-4ad7-a174-e99837aa8457 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:35.406976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e3af324-fe18-4ad7-a174-e99837aa8457 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:35.407521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e3af324-fe18-4ad7-a174-e99837aa8457 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:35.839159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d8bbda79-23f9-43f2-8343-c307c33adf2c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:35.839960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d8bbda79-23f9-43f2-8343-c307c33adf2c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:35.908679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d8bbda79-23f9-43f2-8343-c307c33adf2c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:35.917044 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d8bbda79-23f9-43f2-8343-c307c33adf2c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1237 microversion: 2.1 time: 0.081410 May 21 21:22:35.928182 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1580/3089] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:35 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1237 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:35.933579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-15b86959-e3f1-4944-b1ee-66e7895e715e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:35.934516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-15b86959-e3f1-4944-b1ee-66e7895e715e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:35.945599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15b86959-e3f1-4944-b1ee-66e7895e715e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:35.946492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15b86959-e3f1-4944-b1ee-66e7895e715e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:35.947612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15b86959-e3f1-4944-b1ee-66e7895e715e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:35.948537 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15b86959-e3f1-4944-b1ee-66e7895e715e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:36.136873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-15b86959-e3f1-4944-b1ee-66e7895e715e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:36.145808 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-15b86959-e3f1-4944-b1ee-66e7895e715e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 200 len: 1318 microversion: 2.1 time: 0.215965 May 21 21:22:36.146871 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1581/3090] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:35 2022] GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:36.152586 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-e6c29ebb-7322-48c9-a7d0-c243ce488714 req-615718c6-603f-4667-a63d-69208463e5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68c77575-86cb-40b7-806a-95040277083e", "name": "network-vif-plugged", "status": "completed", "tag": "613e338a-0cdd-4d81-ac2c-ef11254618ba"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:36.162737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-e6c29ebb-7322-48c9-a7d0-c243ce488714 req-615718c6-603f-4667-a63d-69208463e5b3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:36.163494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-e6c29ebb-7322-48c9-a7d0-c243ce488714 req-615718c6-603f-4667-a63d-69208463e5b3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:36.177151 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-e6c29ebb-7322-48c9-a7d0-c243ce488714 req-615718c6-603f-4667-a63d-69208463e5b3 service nova] Creating event network-vif-plugged:613e338a-0cdd-4d81-ac2c-ef11254618ba for instance 68c77575-86cb-40b7-806a-95040277083e on nch2-master-1 May 21 21:22:36.185728 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-e6c29ebb-7322-48c9-a7d0-c243ce488714 req-615718c6-603f-4667-a63d-69208463e5b3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035746 May 21 21:22:36.191226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4e3af324-fe18-4ad7-a174-e99837aa8457 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:36.200760 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4e3af324-fe18-4ad7-a174-e99837aa8457 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 200 len: 1321 microversion: 2.1 time: 0.834153 May 21 21:22:36.201370 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1582/3091] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:36.221506 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1510/3092] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:35 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 1321 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:36.221640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f9cc5b52-e976-45e3-8852-9883cfadb644 req-5bc6f04d-53ab-4ae0-95e6-58a1b06db72c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1266ea2-eb23-4de6-aec8-18d3fa3bf575", "tag": "a183580b-a33f-41bf-a265-a6c95d1b8b88"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:36.225884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f9cc5b52-e976-45e3-8852-9883cfadb644 req-5bc6f04d-53ab-4ae0-95e6-58a1b06db72c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:36.226452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f9cc5b52-e976-45e3-8852-9883cfadb644 req-5bc6f04d-53ab-4ae0-95e6-58a1b06db72c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:36.242325 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f9cc5b52-e976-45e3-8852-9883cfadb644 req-5bc6f04d-53ab-4ae0-95e6-58a1b06db72c service nova] Creating event network-changed:a183580b-a33f-41bf-a265-a6c95d1b8b88 for instance f1266ea2-eb23-4de6-aec8-18d3fa3bf575 on nch1-master-1 May 21 21:22:36.247639 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f9cc5b52-e976-45e3-8852-9883cfadb644 req-5bc6f04d-53ab-4ae0-95e6-58a1b06db72c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044372 May 21 21:22:36.248910 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1583/3093] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:36.934392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-825856b1-57e0-48c4-9355-63db0c4b1633 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:36.935028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-825856b1-57e0-48c4-9355-63db0c4b1633 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:36.946857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-825856b1-57e0-48c4-9355-63db0c4b1633 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:36.952452 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-825856b1-57e0-48c4-9355-63db0c4b1633 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:36.952452 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-825856b1-57e0-48c4-9355-63db0c4b1633 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:36.952452 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-825856b1-57e0-48c4-9355-63db0c4b1633 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:37.164483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5314150d-70dd-4afd-850f-564c11630f52 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:37.165867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5314150d-70dd-4afd-850f-564c11630f52 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:37.186016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5314150d-70dd-4afd-850f-564c11630f52 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:37.188328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5314150d-70dd-4afd-850f-564c11630f52 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:37.189052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5314150d-70dd-4afd-850f-564c11630f52 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:37.191011 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5314150d-70dd-4afd-850f-564c11630f52 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:37.406612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5314150d-70dd-4afd-850f-564c11630f52 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:37.415094 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5314150d-70dd-4afd-850f-564c11630f52 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 200 len: 1318 microversion: 2.1 time: 0.255754 May 21 21:22:37.417688 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1584/3094] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:37 2022] GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:37.428100 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-efa313ca-d832-4e0b-b944-1d09a9a0e8e2 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:37.429261 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-efa313ca-d832-4e0b-b944-1d09a9a0e8e2 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:37.436513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efa313ca-d832-4e0b-b944-1d09a9a0e8e2 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:37.436967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efa313ca-d832-4e0b-b944-1d09a9a0e8e2 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:37.437929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efa313ca-d832-4e0b-b944-1d09a9a0e8e2 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:37.438592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-efa313ca-d832-4e0b-b944-1d09a9a0e8e2 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:37.480141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-825856b1-57e0-48c4-9355-63db0c4b1633 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:37.493301 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-825856b1-57e0-48c4-9355-63db0c4b1633 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1289 microversion: 2.1 time: 0.563917 May 21 21:22:37.493902 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1511/3095] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:36 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1289 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:37.819611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-efa313ca-d832-4e0b-b944-1d09a9a0e8e2 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:37.854790 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-efa313ca-d832-4e0b-b944-1d09a9a0e8e2 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 200 len: 1321 microversion: 2.1 time: 0.429610 May 21 21:22:37.868544 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1585/3096] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:37 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 1321 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:38.438620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-56f3b43a-96fc-4a1b-b6fc-e7019c04cfa8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:38.439873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-56f3b43a-96fc-4a1b-b6fc-e7019c04cfa8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:38.448769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-56f3b43a-96fc-4a1b-b6fc-e7019c04cfa8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:38.449439 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-56f3b43a-96fc-4a1b-b6fc-e7019c04cfa8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:38.450419 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-56f3b43a-96fc-4a1b-b6fc-e7019c04cfa8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:38.451049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-56f3b43a-96fc-4a1b-b6fc-e7019c04cfa8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:38.512377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-868a92d4-f3a4-4914-bd1a-f26d991d6931 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:38.512993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-868a92d4-f3a4-4914-bd1a-f26d991d6931 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:38.522337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-868a92d4-f3a4-4914-bd1a-f26d991d6931 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:38.523065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-868a92d4-f3a4-4914-bd1a-f26d991d6931 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:38.524037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-868a92d4-f3a4-4914-bd1a-f26d991d6931 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:38.525836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-868a92d4-f3a4-4914-bd1a-f26d991d6931 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:38.668697 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-868a92d4-f3a4-4914-bd1a-f26d991d6931 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:38.679278 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-868a92d4-f3a4-4914-bd1a-f26d991d6931 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1295 microversion: 2.1 time: 0.170740 May 21 21:22:38.692522 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1586/3097] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:38 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1295 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:38.878686 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-36343301-bebc-49b3-86c9-18f6c665db00 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:38.879389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-36343301-bebc-49b3-86c9-18f6c665db00 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:38.886427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-36343301-bebc-49b3-86c9-18f6c665db00 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:38.886871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-36343301-bebc-49b3-86c9-18f6c665db00 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:38.887836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-36343301-bebc-49b3-86c9-18f6c665db00 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:38.888273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-36343301-bebc-49b3-86c9-18f6c665db00 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:38.943652 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-56f3b43a-96fc-4a1b-b6fc-e7019c04cfa8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:38.958784 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-56f3b43a-96fc-4a1b-b6fc-e7019c04cfa8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 200 len: 1318 microversion: 2.1 time: 0.528436 May 21 21:22:38.959664 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1512/3098] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:38 2022] GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 1318 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:39.227873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-36343301-bebc-49b3-86c9-18f6c665db00 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:39.236739 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-36343301-bebc-49b3-86c9-18f6c665db00 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 200 len: 1321 microversion: 2.1 time: 0.361448 May 21 21:22:39.249061 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1587/3099] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:38 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 1321 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:39.699674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3b791809-1fea-4a11-9779-ab326aa5f2c3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:39.703373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3b791809-1fea-4a11-9779-ab326aa5f2c3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:39.707704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:39.709710 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b791809-1fea-4a11-9779-ab326aa5f2c3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:39.710746 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b791809-1fea-4a11-9779-ab326aa5f2c3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:39.711757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b791809-1fea-4a11-9779-ab326aa5f2c3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:39.712435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b791809-1fea-4a11-9779-ab326aa5f2c3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:39.976536 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-333764d6-4d3b-4ec6-94c3-8d29c7bc9505 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:39.977170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-333764d6-4d3b-4ec6-94c3-8d29c7bc9505 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:39.985965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-333764d6-4d3b-4ec6-94c3-8d29c7bc9505 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:39.986650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-333764d6-4d3b-4ec6-94c3-8d29c7bc9505 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:39.987492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-333764d6-4d3b-4ec6-94c3-8d29c7bc9505 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:39.987940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-333764d6-4d3b-4ec6-94c3-8d29c7bc9505 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:39.992265 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3b791809-1fea-4a11-9779-ab326aa5f2c3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:40.003133 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3b791809-1fea-4a11-9779-ab326aa5f2c3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1363 microversion: 2.1 time: 0.307394 May 21 21:22:40.004507 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1513/3100] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:39 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1363 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:40.258665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f83acbcb-a4bd-465e-a109-14e4444af694 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:40.259905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f83acbcb-a4bd-465e-a109-14e4444af694 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:40.269067 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f83acbcb-a4bd-465e-a109-14e4444af694 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:40.269890 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f83acbcb-a4bd-465e-a109-14e4444af694 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:40.289957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f83acbcb-a4bd-465e-a109-14e4444af694 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:40.289957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f83acbcb-a4bd-465e-a109-14e4444af694 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:40.355961 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-333764d6-4d3b-4ec6-94c3-8d29c7bc9505 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:40.367044 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-333764d6-4d3b-4ec6-94c3-8d29c7bc9505 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 200 len: 1318 microversion: 2.1 time: 0.394425 May 21 21:22:40.368840 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1588/3101] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:39 2022] GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:40.531165 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f83acbcb-a4bd-465e-a109-14e4444af694 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:40.540824 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f83acbcb-a4bd-465e-a109-14e4444af694 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 200 len: 1321 microversion: 2.1 time: 0.290172 May 21 21:22:40.541404 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1514/3102] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:40 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:40.561082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-d48db8fc-f677-4c1c-95a7-4a7da1327f6d req-bbb22882-088a-44a0-9ea2-cd245eaec429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "718c5e70-0e1a-4143-95e2-4741be1b87a0", "name": "network-vif-plugged", "status": "completed", "tag": "5b53c0fa-b4bf-4fc9-9315-4fe022a5be6d"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:40.573030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d48db8fc-f677-4c1c-95a7-4a7da1327f6d req-bbb22882-088a-44a0-9ea2-cd245eaec429 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:40.574119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d48db8fc-f677-4c1c-95a7-4a7da1327f6d req-bbb22882-088a-44a0-9ea2-cd245eaec429 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:40.590313 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-d48db8fc-f677-4c1c-95a7-4a7da1327f6d req-bbb22882-088a-44a0-9ea2-cd245eaec429 service nova] Creating event network-vif-plugged:5b53c0fa-b4bf-4fc9-9315-4fe022a5be6d for instance 718c5e70-0e1a-4143-95e2-4741be1b87a0 on nch2-master-1 May 21 21:22:40.602551 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-d48db8fc-f677-4c1c-95a7-4a7da1327f6d req-bbb22882-088a-44a0-9ea2-cd245eaec429 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044789 May 21 21:22:40.604543 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1589/3103] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:41.019540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-78271503-8e61-48bf-90c0-16d10b905cef tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:41.021079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-78271503-8e61-48bf-90c0-16d10b905cef tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:41.034596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78271503-8e61-48bf-90c0-16d10b905cef tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:41.038503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78271503-8e61-48bf-90c0-16d10b905cef tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:41.038503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78271503-8e61-48bf-90c0-16d10b905cef tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:41.038503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78271503-8e61-48bf-90c0-16d10b905cef tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:41.114055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-a6143d61-c244-49b1-96ac-4b2e724026b7 req-8057a004-a3e4-48ec-8981-7c323b3c4996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "168c8024-2cb4-4135-be5d-7a5cfcc6e895", "tag": "fcc08185-a786-4b24-9deb-2bfaacaf7c9b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:41.125025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a6143d61-c244-49b1-96ac-4b2e724026b7 req-8057a004-a3e4-48ec-8981-7c323b3c4996 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:41.126361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a6143d61-c244-49b1-96ac-4b2e724026b7 req-8057a004-a3e4-48ec-8981-7c323b3c4996 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:41.142069 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a6143d61-c244-49b1-96ac-4b2e724026b7 req-8057a004-a3e4-48ec-8981-7c323b3c4996 service nova] Creating event network-changed:fcc08185-a786-4b24-9deb-2bfaacaf7c9b for instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 on nch1-master-1 May 21 21:22:41.148081 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-a6143d61-c244-49b1-96ac-4b2e724026b7 req-8057a004-a3e4-48ec-8981-7c323b3c4996 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039912 May 21 21:22:41.148966 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1590/3104] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:41.348457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-78271503-8e61-48bf-90c0-16d10b905cef tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:41.358557 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-78271503-8e61-48bf-90c0-16d10b905cef tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1363 microversion: 2.1 time: 0.342797 May 21 21:22:41.359150 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1515/3105] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:41 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1363 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:41.387705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5703689c-d695-4738-9db3-9f33ea2fb93c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:41.388457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5703689c-d695-4738-9db3-9f33ea2fb93c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:41.397580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5703689c-d695-4738-9db3-9f33ea2fb93c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:41.403129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5703689c-d695-4738-9db3-9f33ea2fb93c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:41.403129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5703689c-d695-4738-9db3-9f33ea2fb93c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:41.403129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5703689c-d695-4738-9db3-9f33ea2fb93c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:41.561705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1cd069ab-26b5-407f-ba28-0e95d500a7d9 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:41.562594 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1cd069ab-26b5-407f-ba28-0e95d500a7d9 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:41.573702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1cd069ab-26b5-407f-ba28-0e95d500a7d9 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:41.574516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1cd069ab-26b5-407f-ba28-0e95d500a7d9 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:41.576271 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1cd069ab-26b5-407f-ba28-0e95d500a7d9 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:41.576958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1cd069ab-26b5-407f-ba28-0e95d500a7d9 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:41.852253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1cd069ab-26b5-407f-ba28-0e95d500a7d9 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:41.856903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:41.865811 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1cd069ab-26b5-407f-ba28-0e95d500a7d9 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 200 len: 1321 microversion: 2.1 time: 0.310287 May 21 21:22:41.867439 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1516/3106] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:41 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 1321 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:42.024187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5703689c-d695-4738-9db3-9f33ea2fb93c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:42.037293 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5703689c-d695-4738-9db3-9f33ea2fb93c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 200 len: 1318 microversion: 2.1 time: 0.655237 May 21 21:22:42.038274 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1591/3107] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:41 2022] GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 1318 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:42.375125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3bbe09fe-63e2-40c6-8696-fd593cba254c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:42.375736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3bbe09fe-63e2-40c6-8696-fd593cba254c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:42.384707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3bbe09fe-63e2-40c6-8696-fd593cba254c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:42.385463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3bbe09fe-63e2-40c6-8696-fd593cba254c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:42.386245 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3bbe09fe-63e2-40c6-8696-fd593cba254c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:42.386854 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3bbe09fe-63e2-40c6-8696-fd593cba254c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:42.619369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3bbe09fe-63e2-40c6-8696-fd593cba254c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:42.628229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f319adf7-8a81-401f-ba8d-8487c1fb72c6 req-f534ed4a-d231-4c23-acd4-9e0d357beeb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4143810-5eb7-4f74-b8d7-26207617a6a6", "name": "network-vif-plugged", "status": "completed", "tag": "b2a5ce56-811a-45c9-b326-7daf516d5141"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:42.641695 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3bbe09fe-63e2-40c6-8696-fd593cba254c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1363 microversion: 2.1 time: 0.270277 May 21 21:22:42.653195 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1517/3108] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:42 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:42.656724 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f319adf7-8a81-401f-ba8d-8487c1fb72c6 req-f534ed4a-d231-4c23-acd4-9e0d357beeb1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:42.657237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f319adf7-8a81-401f-ba8d-8487c1fb72c6 req-f534ed4a-d231-4c23-acd4-9e0d357beeb1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:42.677204 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f319adf7-8a81-401f-ba8d-8487c1fb72c6 req-f534ed4a-d231-4c23-acd4-9e0d357beeb1 service nova] Creating event network-vif-plugged:b2a5ce56-811a-45c9-b326-7daf516d5141 for instance e4143810-5eb7-4f74-b8d7-26207617a6a6 on nch2-master-1 May 21 21:22:42.683151 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f319adf7-8a81-401f-ba8d-8487c1fb72c6 req-f534ed4a-d231-4c23-acd4-9e0d357beeb1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058450 May 21 21:22:42.684046 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1592/3109] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:22:42.884851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-237b3aee-60e9-44c7-8eb9-0b9cbfa0df8d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:42.885485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-237b3aee-60e9-44c7-8eb9-0b9cbfa0df8d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:42.895305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-237b3aee-60e9-44c7-8eb9-0b9cbfa0df8d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:42.895766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-237b3aee-60e9-44c7-8eb9-0b9cbfa0df8d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:42.896786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-237b3aee-60e9-44c7-8eb9-0b9cbfa0df8d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:42.897256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-237b3aee-60e9-44c7-8eb9-0b9cbfa0df8d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:43.056273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6554e9ed-db2c-4c7a-9beb-74225d7e4a2b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:43.057019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6554e9ed-db2c-4c7a-9beb-74225d7e4a2b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:43.057624 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-237b3aee-60e9-44c7-8eb9-0b9cbfa0df8d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:43.063803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6554e9ed-db2c-4c7a-9beb-74225d7e4a2b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:43.064266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6554e9ed-db2c-4c7a-9beb-74225d7e4a2b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:43.065127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6554e9ed-db2c-4c7a-9beb-74225d7e4a2b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:43.065758 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-237b3aee-60e9-44c7-8eb9-0b9cbfa0df8d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 200 len: 1511 microversion: 2.1 time: 0.184764 May 21 21:22:43.065891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6554e9ed-db2c-4c7a-9beb-74225d7e4a2b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:43.066726 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1518/3110] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:42 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 1511 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:43.084030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b858e890-0c31-496c-93c2-8986998c3a92 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:43.085111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b858e890-0c31-496c-93c2-8986998c3a92 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:43.091958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b858e890-0c31-496c-93c2-8986998c3a92 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:43.092722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b858e890-0c31-496c-93c2-8986998c3a92 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:43.093585 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b858e890-0c31-496c-93c2-8986998c3a92 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:43.094040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b858e890-0c31-496c-93c2-8986998c3a92 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:43.278115 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6554e9ed-db2c-4c7a-9beb-74225d7e4a2b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:43.312574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b858e890-0c31-496c-93c2-8986998c3a92 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:43.312908 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6554e9ed-db2c-4c7a-9beb-74225d7e4a2b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 200 len: 1318 microversion: 2.1 time: 0.241633 May 21 21:22:43.312908 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1593/3111] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:43 2022] GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:43.313072 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b858e890-0c31-496c-93c2-8986998c3a92 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1509 microversion: 2.1 time: 0.228464 May 21 21:22:43.313072 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1519/3112] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:43 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:43.331132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2475cac3-bbb0-4231-b876-ab51a5d6954a tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:43.331764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2475cac3-bbb0-4231-b876-ab51a5d6954a tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: e4143810-5eb7-4f74-b8d7-26207617a6a6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:43.338403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2475cac3-bbb0-4231-b876-ab51a5d6954a tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:43.338858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2475cac3-bbb0-4231-b876-ab51a5d6954a tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:43.339652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2475cac3-bbb0-4231-b876-ab51a5d6954a tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:43.340096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2475cac3-bbb0-4231-b876-ab51a5d6954a tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:43.510998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2475cac3-bbb0-4231-b876-ab51a5d6954a tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:43.518683 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2475cac3-bbb0-4231-b876-ab51a5d6954a tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/e4143810-5eb7-4f74-b8d7-26207617a6a6" status: 200 len: 1321 microversion: 2.1 time: 0.192209 May 21 21:22:43.519257 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1594/3113] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:43 2022] GET /compute/v2.1/servers/e4143810-5eb7-4f74-b8d7-26207617a6a6 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:43.662223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dbb7f72e-b819-41b8-94de-cee38566a4e1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:43.663177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dbb7f72e-b819-41b8-94de-cee38566a4e1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:43.671522 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbb7f72e-b819-41b8-94de-cee38566a4e1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:43.672036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbb7f72e-b819-41b8-94de-cee38566a4e1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:43.673031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbb7f72e-b819-41b8-94de-cee38566a4e1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:43.673539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbb7f72e-b819-41b8-94de-cee38566a4e1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:43.833937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dbb7f72e-b819-41b8-94de-cee38566a4e1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:43.842027 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dbb7f72e-b819-41b8-94de-cee38566a4e1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1363 microversion: 2.1 time: 0.184308 May 21 21:22:43.842612 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1520/3114] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:43 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:44.311478 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-027d6e62-0b4f-4b93-9417-468affc540aa tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:44.312462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-027d6e62-0b4f-4b93-9417-468affc540aa tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:44.320348 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-027d6e62-0b4f-4b93-9417-468affc540aa tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:44.321062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-027d6e62-0b4f-4b93-9417-468affc540aa tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:44.321902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-027d6e62-0b4f-4b93-9417-468affc540aa tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:44.322543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-027d6e62-0b4f-4b93-9417-468affc540aa tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:44.491576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:44.505592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-027d6e62-0b4f-4b93-9417-468affc540aa tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:44.513645 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-027d6e62-0b4f-4b93-9417-468affc540aa tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 200 len: 1318 microversion: 2.1 time: 0.205986 May 21 21:22:44.514345 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1595/3115] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:44 2022] GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:44.538240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b266c5f0-7997-42a6-bb1c-44bbf5a65a48 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:44.539043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b266c5f0-7997-42a6-bb1c-44bbf5a65a48 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: e4143810-5eb7-4f74-b8d7-26207617a6a6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:44.547339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b266c5f0-7997-42a6-bb1c-44bbf5a65a48 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:44.547856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b266c5f0-7997-42a6-bb1c-44bbf5a65a48 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:44.548752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b266c5f0-7997-42a6-bb1c-44bbf5a65a48 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:44.557116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b266c5f0-7997-42a6-bb1c-44bbf5a65a48 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:44.729633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b266c5f0-7997-42a6-bb1c-44bbf5a65a48 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:44.737923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-0483b5f6-885f-4027-86f6-cfc616930e61 req-236a774d-c2ae-4d2e-b714-70cd835470f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1266ea2-eb23-4de6-aec8-18d3fa3bf575", "name": "network-vif-plugged", "status": "completed", "tag": "a183580b-a33f-41bf-a265-a6c95d1b8b88"}, {"server_uuid": "ca640d8e-17ec-4ff3-940f-39d6976115f7", "name": "network-vif-plugged", "status": "completed", "tag": "57aedb68-8786-41c1-bf7a-e68c09bd3910"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:44.744262 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b266c5f0-7997-42a6-bb1c-44bbf5a65a48 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/e4143810-5eb7-4f74-b8d7-26207617a6a6" status: 200 len: 1512 microversion: 2.1 time: 0.206277 May 21 21:22:44.744262 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1521/3116] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:44 2022] GET /compute/v2.1/servers/e4143810-5eb7-4f74-b8d7-26207617a6a6 => generated 1512 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:44.750041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-0483b5f6-885f-4027-86f6-cfc616930e61 req-236a774d-c2ae-4d2e-b714-70cd835470f1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:44.750705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-0483b5f6-885f-4027-86f6-cfc616930e61 req-236a774d-c2ae-4d2e-b714-70cd835470f1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:44.772150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-61d9e156-2c4e-496e-9fe3-fa9c16b6943f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:44.773171 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-0483b5f6-885f-4027-86f6-cfc616930e61 req-236a774d-c2ae-4d2e-b714-70cd835470f1 service nova] Creating event network-vif-plugged:a183580b-a33f-41bf-a265-a6c95d1b8b88 for instance f1266ea2-eb23-4de6-aec8-18d3fa3bf575 on nch1-master-1 May 21 21:22:44.773961 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-0483b5f6-885f-4027-86f6-cfc616930e61 req-236a774d-c2ae-4d2e-b714-70cd835470f1 service nova] Creating event network-vif-plugged:57aedb68-8786-41c1-bf7a-e68c09bd3910 for instance ca640d8e-17ec-4ff3-940f-39d6976115f7 on nch2-master-1 May 21 21:22:44.777500 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-61d9e156-2c4e-496e-9fe3-fa9c16b6943f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:44.778456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-61d9e156-2c4e-496e-9fe3-fa9c16b6943f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:22:44.788162 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-0483b5f6-885f-4027-86f6-cfc616930e61 req-236a774d-c2ae-4d2e-b714-70cd835470f1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056431 May 21 21:22:44.793964 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61d9e156-2c4e-496e-9fe3-fa9c16b6943f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:44.794957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61d9e156-2c4e-496e-9fe3-fa9c16b6943f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:44.814184 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1596/3117] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:22:44.814962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61d9e156-2c4e-496e-9fe3-fa9c16b6943f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:44.814962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61d9e156-2c4e-496e-9fe3-fa9c16b6943f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:44.863645 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-86e84acb-96a6-46f8-a203-619ae16678e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:44.864380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-86e84acb-96a6-46f8-a203-619ae16678e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:44.884629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86e84acb-96a6-46f8-a203-619ae16678e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:44.885340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86e84acb-96a6-46f8-a203-619ae16678e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:44.887970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86e84acb-96a6-46f8-a203-619ae16678e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:44.888665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86e84acb-96a6-46f8-a203-619ae16678e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:44.955594 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-61d9e156-2c4e-496e-9fe3-fa9c16b6943f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:22:45.285004 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-61d9e156-2c4e-496e-9fe3-fa9c16b6943f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:45.292516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61d9e156-2c4e-496e-9fe3-fa9c16b6943f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:45.293209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61d9e156-2c4e-496e-9fe3-fa9c16b6943f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:45.364689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-86e84acb-96a6-46f8-a203-619ae16678e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:45.375980 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-86e84acb-96a6-46f8-a203-619ae16678e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1363 microversion: 2.1 time: 0.520547 May 21 21:22:45.378274 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1597/3118] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:44 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1363 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:45.489647 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-61d9e156-2c4e-496e-9fe3-fa9c16b6943f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.730791 May 21 21:22:45.490248 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1522/3119] 10.222.0.49 () {58 vars in 1166 bytes} [Sat May 21 21:22:44 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:45.509148 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-44adf933-c187-4549-ba2a-35da22656314 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:45.513711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-44adf933-c187-4549-ba2a-35da22656314 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:45.515959 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-44adf933-c187-4549-ba2a-35da22656314 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-24390212', 'deleted': False, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415'} {{(pid=131277) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:22:45.521789 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:45.533324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f20dbc8b-5b14-4cf7-8402-528548c21617 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:45.534027 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f20dbc8b-5b14-4cf7-8402-528548c21617 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:45.543989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f20dbc8b-5b14-4cf7-8402-528548c21617 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:45.544480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f20dbc8b-5b14-4cf7-8402-528548c21617 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:45.545317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f20dbc8b-5b14-4cf7-8402-528548c21617 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:45.545751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f20dbc8b-5b14-4cf7-8402-528548c21617 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:45.549652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44adf933-c187-4549-ba2a-35da22656314 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:45.551344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44adf933-c187-4549-ba2a-35da22656314 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:45.552806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44adf933-c187-4549-ba2a-35da22656314 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:45.553437 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44adf933-c187-4549-ba2a-35da22656314 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:45.675198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.multi_cell_list [None req-44adf933-c187-4549-ba2a-35da22656314 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131277) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:22:45.682185 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:45.755906 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f20dbc8b-5b14-4cf7-8402-528548c21617 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:45.756530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=63 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:45.760819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-44adf933-c187-4549-ba2a-35da22656314 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:45.766566 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f20dbc8b-5b14-4cf7-8402-528548c21617 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 200 len: 1318 microversion: 2.1 time: 0.239292 May 21 21:22:45.767790 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1523/3120] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:45 2022] GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:45.777143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44adf933-c187-4549-ba2a-35da22656314 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:45.782948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44adf933-c187-4549-ba2a-35da22656314 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:46.121987 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-44adf933-c187-4549-ba2a-35da22656314 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-24390212" status: 200 len: 1512 microversion: 2.1 time: 0.617955 May 21 21:22:46.122699 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1598/3121] 10.222.0.49 () {58 vars in 1258 bytes} [Sat May 21 21:22:45 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-24390212 => generated 1512 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:46.141760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a7af53de-6ffe-4cd4-bac9-3f8bd22c7224 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:46.148016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a7af53de-6ffe-4cd4-bac9-3f8bd22c7224 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:46.150111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a7af53de-6ffe-4cd4-bac9-3f8bd22c7224 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:22:46.156451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7af53de-6ffe-4cd4-bac9-3f8bd22c7224 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:46.157162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7af53de-6ffe-4cd4-bac9-3f8bd22c7224 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:46.159829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7af53de-6ffe-4cd4-bac9-3f8bd22c7224 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:46.161178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7af53de-6ffe-4cd4-bac9-3f8bd22c7224 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:46.286173 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-a7af53de-6ffe-4cd4-bac9-3f8bd22c7224 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:22:46.362327 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a7af53de-6ffe-4cd4-bac9-3f8bd22c7224 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:46.371116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7af53de-6ffe-4cd4-bac9-3f8bd22c7224 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:46.371711 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7af53de-6ffe-4cd4-bac9-3f8bd22c7224 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:46.402862 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9a226b82-8293-42dc-b792-016d8f3f28b2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:46.405108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9a226b82-8293-42dc-b792-016d8f3f28b2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:46.431874 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a226b82-8293-42dc-b792-016d8f3f28b2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:46.432402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a226b82-8293-42dc-b792-016d8f3f28b2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:46.433260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a226b82-8293-42dc-b792-016d8f3f28b2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:46.433714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a226b82-8293-42dc-b792-016d8f3f28b2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:46.569861 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a7af53de-6ffe-4cd4-bac9-3f8bd22c7224 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 0.432656 May 21 21:22:46.584321 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1524/3122] 10.222.0.49 () {58 vars in 1172 bytes} [Sat May 21 21:22:46 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:46.593398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-71c4966f-6ae6-41fc-b734-91cb2bfe52b7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:46.600142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-71c4966f-6ae6-41fc-b734-91cb2bfe52b7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:46.600651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.compute.servers [None req-71c4966f-6ae6-41fc-b734-91cb2bfe52b7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Removing options 'limit' from query {{(pid=131278) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 21 21:22:46.601622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-71c4966f-6ae6-41fc-b734-91cb2bfe52b7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Searching by: {'deleted': False, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:22:46.607705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71c4966f-6ae6-41fc-b734-91cb2bfe52b7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:46.608169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71c4966f-6ae6-41fc-b734-91cb2bfe52b7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:46.609792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71c4966f-6ae6-41fc-b734-91cb2bfe52b7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:46.610095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71c4966f-6ae6-41fc-b734-91cb2bfe52b7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:46.653852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-71c4966f-6ae6-41fc-b734-91cb2bfe52b7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:46.661917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71c4966f-6ae6-41fc-b734-91cb2bfe52b7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:46.662497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71c4966f-6ae6-41fc-b734-91cb2bfe52b7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:46.719595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9a226b82-8293-42dc-b792-016d8f3f28b2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:46.729196 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9a226b82-8293-42dc-b792-016d8f3f28b2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1363 microversion: 2.1 time: 0.338063 May 21 21:22:46.739654 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1599/3123] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:46 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1363 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:46.786783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dfa1bf24-1611-47d8-bb8f-7caf43fdc59b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:46.787656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dfa1bf24-1611-47d8-bb8f-7caf43fdc59b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:46.794366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dfa1bf24-1611-47d8-bb8f-7caf43fdc59b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:46.795054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dfa1bf24-1611-47d8-bb8f-7caf43fdc59b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:46.796173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dfa1bf24-1611-47d8-bb8f-7caf43fdc59b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:46.796861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dfa1bf24-1611-47d8-bb8f-7caf43fdc59b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:46.873657 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-71c4966f-6ae6-41fc-b734-91cb2bfe52b7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.285514 May 21 21:22:46.874706 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1525/3124] 10.222.0.49 () {58 vars in 1160 bytes} [Sat May 21 21:22:46 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:46.893634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-50b7a4ee-4064-4d39-afa3-f0268fd283a4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:46.899485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-50b7a4ee-4064-4d39-afa3-f0268fd283a4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:46.900495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-50b7a4ee-4064-4d39-afa3-f0268fd283a4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:22:46.907716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50b7a4ee-4064-4d39-afa3-f0268fd283a4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:46.908467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50b7a4ee-4064-4d39-afa3-f0268fd283a4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:46.909424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50b7a4ee-4064-4d39-afa3-f0268fd283a4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:46.910175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50b7a4ee-4064-4d39-afa3-f0268fd283a4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:46.944964 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-50b7a4ee-4064-4d39-afa3-f0268fd283a4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:22:46.980810 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-50b7a4ee-4064-4d39-afa3-f0268fd283a4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.091429 May 21 21:22:46.982002 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1526/3125] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:22:46 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:46.997160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5659b2f5-c5bd-4f75-bc4b-772eb8d476d5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:47.000900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5659b2f5-c5bd-4f75-bc4b-772eb8d476d5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:47.001352 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.compute.servers [None req-5659b2f5-c5bd-4f75-bc4b-772eb8d476d5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Removing options 'limit' from query {{(pid=131278) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 21 21:22:47.002024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5659b2f5-c5bd-4f75-bc4b-772eb8d476d5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Searching by: {'deleted': False, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:22:47.008625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5659b2f5-c5bd-4f75-bc4b-772eb8d476d5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:47.014747 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5659b2f5-c5bd-4f75-bc4b-772eb8d476d5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:47.014747 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5659b2f5-c5bd-4f75-bc4b-772eb8d476d5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:47.014747 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5659b2f5-c5bd-4f75-bc4b-772eb8d476d5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:47.060364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-dfa1bf24-1611-47d8-bb8f-7caf43fdc59b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:47.065748 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dfa1bf24-1611-47d8-bb8f-7caf43fdc59b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 200 len: 1318 microversion: 2.1 time: 0.283538 May 21 21:22:47.066932 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1600/3126] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:46 2022] GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:47.067752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-5659b2f5-c5bd-4f75-bc4b-772eb8d476d5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:22:47.103946 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5659b2f5-c5bd-4f75-bc4b-772eb8d476d5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.110159 May 21 21:22:47.105662 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1527/3127] 10.222.0.49 () {58 vars in 1149 bytes} [Sat May 21 21:22:46 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:47.119549 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7e021f30-0506-4a1e-8584-eab95553070c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:47.126101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7e021f30-0506-4a1e-8584-eab95553070c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:47.127619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7e021f30-0506-4a1e-8584-eab95553070c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Searching by: {'deleted': False, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415'} {{(pid=131277) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:22:47.135243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e021f30-0506-4a1e-8584-eab95553070c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:47.136143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e021f30-0506-4a1e-8584-eab95553070c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:47.137236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e021f30-0506-4a1e-8584-eab95553070c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:47.137864 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e021f30-0506-4a1e-8584-eab95553070c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:47.171248 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.multi_cell_list [None req-7e021f30-0506-4a1e-8584-eab95553070c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131277) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:22:47.205174 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7e021f30-0506-4a1e-8584-eab95553070c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.090762 May 21 21:22:47.206350 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1601/3128] 10.222.0.49 () {58 vars in 1124 bytes} [Sat May 21 21:22:47 2022] GET /compute/v2.1/servers => generated 1010 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:47.221154 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9ae4582d-0740-4917-b117-56bceffc2816 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:47.226252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9ae4582d-0740-4917-b117-56bceffc2816 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:47.229823 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9ae4582d-0740-4917-b117-56bceffc2816 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:22:47.254176 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ae4582d-0740-4917-b117-56bceffc2816 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:47.254176 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ae4582d-0740-4917-b117-56bceffc2816 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:47.255468 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ae4582d-0740-4917-b117-56bceffc2816 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:47.257129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ae4582d-0740-4917-b117-56bceffc2816 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:47.415018 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-9ae4582d-0740-4917-b117-56bceffc2816 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:22:47.560041 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9ae4582d-0740-4917-b117-56bceffc2816 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.345627 May 21 21:22:47.561216 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1528/3129] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:22:47 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:47.588614 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c8749563-8ced-4d23-a2b0-1d762629251b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:47.600998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c8749563-8ced-4d23-a2b0-1d762629251b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:47.604911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.compute.servers [None req-c8749563-8ced-4d23-a2b0-1d762629251b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Removing options 'limit' from query {{(pid=131277) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 21 21:22:47.607991 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c8749563-8ced-4d23-a2b0-1d762629251b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Searching by: {'deleted': False, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415'} {{(pid=131277) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:22:47.622484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c8749563-8ced-4d23-a2b0-1d762629251b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:47.623186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c8749563-8ced-4d23-a2b0-1d762629251b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:47.624251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c8749563-8ced-4d23-a2b0-1d762629251b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:47.628481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c8749563-8ced-4d23-a2b0-1d762629251b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:47.698264 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c8749563-8ced-4d23-a2b0-1d762629251b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.128712 May 21 21:22:47.710630 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1602/3130] 10.222.0.49 () {58 vars in 1139 bytes} [Sat May 21 21:22:47 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:47.713696 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-26a37727-d865-45ce-931f-e6be4f02c5fb tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:47.717928 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-26a37727-d865-45ce-931f-e6be4f02c5fb tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:47.721369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-26a37727-d865-45ce-931f-e6be4f02c5fb tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-24390212', 'deleted': False, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:22:47.741697 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-26a37727-d865-45ce-931f-e6be4f02c5fb tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:47.742229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-26a37727-d865-45ce-931f-e6be4f02c5fb tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:47.743037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-26a37727-d865-45ce-931f-e6be4f02c5fb tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:47.743476 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-26a37727-d865-45ce-931f-e6be4f02c5fb tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:47.759201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3e06e70a-6b4e-47a7-a4a9-a8897a60d949 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:47.759858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3e06e70a-6b4e-47a7-a4a9-a8897a60d949 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:47.776083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e06e70a-6b4e-47a7-a4a9-a8897a60d949 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:47.776632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e06e70a-6b4e-47a7-a4a9-a8897a60d949 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:47.777482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e06e70a-6b4e-47a7-a4a9-a8897a60d949 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:47.784099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e06e70a-6b4e-47a7-a4a9-a8897a60d949 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:47.921350 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-26a37727-d865-45ce-931f-e6be4f02c5fb tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:22:48.001890 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-26a37727-d865-45ce-931f-e6be4f02c5fb tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-24390212" status: 200 len: 344 microversion: 2.1 time: 0.291989 May 21 21:22:48.002986 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1529/3131] 10.222.0.49 () {58 vars in 1237 bytes} [Sat May 21 21:22:47 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-24390212 => generated 344 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:48.016336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3a0cce71-235d-4108-a99e-32594d02069c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:48.024176 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a0cce71-235d-4108-a99e-32594d02069c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:48.024643 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a0cce71-235d-4108-a99e-32594d02069c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:48.094000 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3a0cce71-235d-4108-a99e-32594d02069c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Going to try to stop instance {{(pid=131278) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 21 21:22:48.100536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:48.173549 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3e06e70a-6b4e-47a7-a4a9-a8897a60d949 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:48.183076 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3e06e70a-6b4e-47a7-a4a9-a8897a60d949 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1363 microversion: 2.1 time: 0.430768 May 21 21:22:48.183656 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1603/3132] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:47 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1363 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:48.203502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-587c4763-6427-46fe-9d9d-8a1b55091c13 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:48.204132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-587c4763-6427-46fe-9d9d-8a1b55091c13 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:48.217071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-587c4763-6427-46fe-9d9d-8a1b55091c13 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:48.217538 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-587c4763-6427-46fe-9d9d-8a1b55091c13 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:48.218324 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-587c4763-6427-46fe-9d9d-8a1b55091c13 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:48.218814 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-587c4763-6427-46fe-9d9d-8a1b55091c13 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:48.343553 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3a0cce71-235d-4108-a99e-32594d02069c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "POST /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e/action" status: 202 len: 0 microversion: 2.1 time: 0.330843 May 21 21:22:48.344865 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1530/3133] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:22:48 2022] POST /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:22:48.381303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-42b682dd-0129-45ba-9355-d45c87bc779b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:48.382441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-42b682dd-0129-45ba-9355-d45c87bc779b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:48.390581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42b682dd-0129-45ba-9355-d45c87bc779b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:48.391970 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42b682dd-0129-45ba-9355-d45c87bc779b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:48.392541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42b682dd-0129-45ba-9355-d45c87bc779b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:48.392820 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42b682dd-0129-45ba-9355-d45c87bc779b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:48.489841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-587c4763-6427-46fe-9d9d-8a1b55091c13 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:48.505413 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-587c4763-6427-46fe-9d9d-8a1b55091c13 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 200 len: 1468 microversion: 2.1 time: 0.320153 May 21 21:22:48.506577 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1604/3134] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:48 2022] GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 1468 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:48.523837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-66f2ba36-f37e-49a2-ac4c-e21ca3e6f413 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:48.524494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-66f2ba36-f37e-49a2-ac4c-e21ca3e6f413 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: ca640d8e-17ec-4ff3-940f-39d6976115f7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:48.531268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-66f2ba36-f37e-49a2-ac4c-e21ca3e6f413 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:48.531913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-66f2ba36-f37e-49a2-ac4c-e21ca3e6f413 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:48.532771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-66f2ba36-f37e-49a2-ac4c-e21ca3e6f413 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:48.533207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-66f2ba36-f37e-49a2-ac4c-e21ca3e6f413 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:48.601108 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-42b682dd-0129-45ba-9355-d45c87bc779b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:48.610042 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-42b682dd-0129-45ba-9355-d45c87bc779b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1519 microversion: 2.1 time: 0.258984 May 21 21:22:48.611645 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1531/3135] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:48 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1519 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:48.819901 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-66f2ba36-f37e-49a2-ac4c-e21ca3e6f413 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:48.829494 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-66f2ba36-f37e-49a2-ac4c-e21ca3e6f413 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/ca640d8e-17ec-4ff3-940f-39d6976115f7" status: 200 len: 1468 microversion: 2.1 time: 0.310574 May 21 21:22:48.830447 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1605/3136] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:48 2022] GET /compute/v2.1/servers/ca640d8e-17ec-4ff3-940f-39d6976115f7 => generated 1468 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:48.846979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c55350fa-0bfd-49e6-ad95-da770dc4b9c9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:48.851565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c55350fa-0bfd-49e6-ad95-da770dc4b9c9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:48.852753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c55350fa-0bfd-49e6-ad95-da770dc4b9c9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Searching by: {'reservation_id': 'r-ru76010v', 'deleted': False, 'project_id': '00752ed7cdc0495dbf5533e82dccc017'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:22:48.871726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c55350fa-0bfd-49e6-ad95-da770dc4b9c9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:48.872705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c55350fa-0bfd-49e6-ad95-da770dc4b9c9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:48.874217 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c55350fa-0bfd-49e6-ad95-da770dc4b9c9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:48.874893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c55350fa-0bfd-49e6-ad95-da770dc4b9c9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:49.021127 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-c55350fa-0bfd-49e6-ad95-da770dc4b9c9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:22:49.121076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c55350fa-0bfd-49e6-ad95-da770dc4b9c9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:49.129556 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c55350fa-0bfd-49e6-ad95-da770dc4b9c9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:49.130025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c55350fa-0bfd-49e6-ad95-da770dc4b9c9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:49.201930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-23739646-71ff-4ee0-8f32-6c1127e1c393 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:49.202820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-23739646-71ff-4ee0-8f32-6c1127e1c393 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:49.211094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23739646-71ff-4ee0-8f32-6c1127e1c393 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:49.211947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23739646-71ff-4ee0-8f32-6c1127e1c393 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:49.212779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23739646-71ff-4ee0-8f32-6c1127e1c393 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:49.213225 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23739646-71ff-4ee0-8f32-6c1127e1c393 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:49.356988 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c55350fa-0bfd-49e6-ad95-da770dc4b9c9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?reservation_id=r-ru76010v" status: 200 len: 2929 microversion: 2.1 time: 0.513622 May 21 21:22:49.357958 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1532/3137] 10.222.0.49 () {58 vars in 1196 bytes} [Sat May 21 21:22:48 2022] GET /compute/v2.1/servers/detail?reservation_id=r-ru76010v => generated 2929 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:49.375069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a4fb3e1a-5b9a-4295-98d7-2538a7995d4f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:49.428439 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.compute.server_groups [None req-a4fb3e1a-5b9a-4295-98d7-2538a7995d4f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Querying cell 4f046ce9-ac6c-44d8-b1fb-b7063eef06e7(cell1) for 2 instances {{(pid=131278) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 21 21:22:49.429269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4fb3e1a-5b9a-4295-98d7-2538a7995d4f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:49.429719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4fb3e1a-5b9a-4295-98d7-2538a7995d4f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:49.506122 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-23739646-71ff-4ee0-8f32-6c1127e1c393 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:49.512887 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a4fb3e1a-5b9a-4295-98d7-2538a7995d4f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups/4c2367df-271d-4b8f-a5dd-415602156def" status: 200 len: 270 microversion: 2.1 time: 0.141942 May 21 21:22:49.515294 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1533/3138] 10.222.0.49 () {58 vars in 1262 bytes} [Sat May 21 21:22:49 2022] GET /compute/v2.1/os-server-groups/4c2367df-271d-4b8f-a5dd-415602156def => generated 270 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:49.519216 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-23739646-71ff-4ee0-8f32-6c1127e1c393 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1363 microversion: 2.1 time: 0.321555 May 21 21:22:49.519954 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1606/3139] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:49 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:49.536385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b449222d-b8a0-4514-8f84-788ec3952135 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:49.537369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b449222d-b8a0-4514-8f84-788ec3952135 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] [instance: ca640d8e-17ec-4ff3-940f-39d6976115f7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:49.553567 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b449222d-b8a0-4514-8f84-788ec3952135 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:49.554804 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b449222d-b8a0-4514-8f84-788ec3952135 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:49.555603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b449222d-b8a0-4514-8f84-788ec3952135 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:49.556058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b449222d-b8a0-4514-8f84-788ec3952135 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:49.628571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8be259be-4892-4812-ba2a-e08cd886b440 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:49.629230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8be259be-4892-4812-ba2a-e08cd886b440 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:49.636432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8be259be-4892-4812-ba2a-e08cd886b440 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:49.637144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8be259be-4892-4812-ba2a-e08cd886b440 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:49.638088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8be259be-4892-4812-ba2a-e08cd886b440 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:49.638687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8be259be-4892-4812-ba2a-e08cd886b440 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:50.028302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8be259be-4892-4812-ba2a-e08cd886b440 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:50.030389 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8be259be-4892-4812-ba2a-e08cd886b440 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1519 microversion: 2.1 time: 0.406004 May 21 21:22:50.031899 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1607/3140] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:49 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1519 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:50.162519 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b449222d-b8a0-4514-8f84-788ec3952135 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ca640d8e-17ec-4ff3-940f-39d6976115f7" status: 200 len: 1619 microversion: 2.1 time: 0.641945 May 21 21:22:50.163740 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1534/3141] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:49 2022] GET /compute/v2.1/servers/ca640d8e-17ec-4ff3-940f-39d6976115f7 => generated 1619 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:50.181750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-90a35f34-8dad-41df-9aca-b4cf4d37b050 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:50.182850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-90a35f34-8dad-41df-9aca-b4cf4d37b050 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:50.194527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90a35f34-8dad-41df-9aca-b4cf4d37b050 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:50.195602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90a35f34-8dad-41df-9aca-b4cf4d37b050 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:50.201320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90a35f34-8dad-41df-9aca-b4cf4d37b050 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:50.201988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90a35f34-8dad-41df-9aca-b4cf4d37b050 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:50.537668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-daa34a25-b16e-441b-bd93-43bd163a191c req-9b63d2ae-9c29-4c8b-97f2-b61be3ddc50e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168c8024-2cb4-4135-be5d-7a5cfcc6e895", "name": "network-vif-plugged", "status": "completed", "tag": "fcc08185-a786-4b24-9deb-2bfaacaf7c9b"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:50.572363 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-daa34a25-b16e-441b-bd93-43bd163a191c req-9b63d2ae-9c29-4c8b-97f2-b61be3ddc50e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:50.572886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-daa34a25-b16e-441b-bd93-43bd163a191c req-9b63d2ae-9c29-4c8b-97f2-b61be3ddc50e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:50.587135 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-daa34a25-b16e-441b-bd93-43bd163a191c req-9b63d2ae-9c29-4c8b-97f2-b61be3ddc50e service nova] Creating event network-vif-plugged:fcc08185-a786-4b24-9deb-2bfaacaf7c9b for instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 on nch1-master-1 May 21 21:22:50.593847 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-daa34a25-b16e-441b-bd93-43bd163a191c req-9b63d2ae-9c29-4c8b-97f2-b61be3ddc50e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067544 May 21 21:22:50.594968 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1535/3142] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:50.600940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a73262ed-4ba5-47f9-9ffb-b539b60ef253 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:50.601953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a73262ed-4ba5-47f9-9ffb-b539b60ef253 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:50.626056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a73262ed-4ba5-47f9-9ffb-b539b60ef253 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:50.627622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a73262ed-4ba5-47f9-9ffb-b539b60ef253 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:50.629180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a73262ed-4ba5-47f9-9ffb-b539b60ef253 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:50.629874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a73262ed-4ba5-47f9-9ffb-b539b60ef253 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:51.151179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a73262ed-4ba5-47f9-9ffb-b539b60ef253 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:51.163927 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a73262ed-4ba5-47f9-9ffb-b539b60ef253 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1363 microversion: 2.1 time: 0.567296 May 21 21:22:51.167270 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1536/3143] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:50 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1363 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:51.172788 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-90a35f34-8dad-41df-9aca-b4cf4d37b050 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 200 len: 1619 microversion: 2.1 time: 0.996880 May 21 21:22:51.192640 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1608/3144] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:50 2022] GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 1619 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:51.192775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9f0b2b82-1e95-4084-a4af-569cba623fd4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:51.192775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9f0b2b82-1e95-4084-a4af-569cba623fd4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:51.215325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f0b2b82-1e95-4084-a4af-569cba623fd4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:51.215781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f0b2b82-1e95-4084-a4af-569cba623fd4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:51.216603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f0b2b82-1e95-4084-a4af-569cba623fd4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:51.217049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f0b2b82-1e95-4084-a4af-569cba623fd4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:51.366467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4995d29a-a673-4e5f-b22b-81fb5f9a15c4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1096049634", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "2402f588-3d04-418d-ac2d-d38d77c92205"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:51.460535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-4995d29a-a673-4e5f-b22b-81fb5f9a15c4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] validate_networks() for None {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:22:51.479248 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9f0b2b82-1e95-4084-a4af-569cba623fd4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:51.499360 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9f0b2b82-1e95-4084-a4af-569cba623fd4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1519 microversion: 2.1 time: 0.330089 May 21 21:22:51.503946 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1537/3145] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:51 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1519 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:51.944209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-4995d29a-a673-4e5f-b22b-81fb5f9a15c4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:22:51.944680 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-4995d29a-a673-4e5f-b22b-81fb5f9a15c4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:22:51.945160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-4995d29a-a673-4e5f-b22b-81fb5f9a15c4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:22:51.945570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-4995d29a-a673-4e5f-b22b-81fb5f9a15c4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:22:51.946071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-4995d29a-a673-4e5f-b22b-81fb5f9a15c4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:22:51.958184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4995d29a-a673-4e5f-b22b-81fb5f9a15c4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:51.958637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4995d29a-a673-4e5f-b22b-81fb5f9a15c4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:51.959444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4995d29a-a673-4e5f-b22b-81fb5f9a15c4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:51.959883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4995d29a-a673-4e5f-b22b-81fb5f9a15c4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:51.982221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-4995d29a-a673-4e5f-b22b-81fb5f9a15c4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:22:51.990519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-4995d29a-a673-4e5f-b22b-81fb5f9a15c4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for user 945ab557c0e24cfdbcab74684a5d5800 and project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:22:52.008855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4995d29a-a673-4e5f-b22b-81fb5f9a15c4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:22:52.011488 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4995d29a-a673-4e5f-b22b-81fb5f9a15c4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:22:52.181612 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4995d29a-a673-4e5f-b22b-81fb5f9a15c4 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.819729 May 21 21:22:52.184375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6f81e94f-7744-4332-8fd8-f9c4287cd1aa tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:52.185137 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6f81e94f-7744-4332-8fd8-f9c4287cd1aa tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:52.192677 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1609/3146] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:22:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:22:52.199120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f81e94f-7744-4332-8fd8-f9c4287cd1aa tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:52.200547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f81e94f-7744-4332-8fd8-f9c4287cd1aa tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:52.201933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f81e94f-7744-4332-8fd8-f9c4287cd1aa tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:52.202605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f81e94f-7744-4332-8fd8-f9c4287cd1aa tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:52.212499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-236faf1c-e21d-4a56-a700-0463b24ac20a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:52.212499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-236faf1c-e21d-4a56-a700-0463b24ac20a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:52.433245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-236faf1c-e21d-4a56-a700-0463b24ac20a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:52.440316 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-236faf1c-e21d-4a56-a700-0463b24ac20a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 200 len: 1217 microversion: 2.1 time: 0.244674 May 21 21:22:52.441140 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1610/3147] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:52 2022] GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 1217 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:52.520996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-69affba9-a6be-4f12-a742-9c578d68c758 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:52.521632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-69affba9-a6be-4f12-a742-9c578d68c758 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:52.534402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-69affba9-a6be-4f12-a742-9c578d68c758 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:52.540222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-69affba9-a6be-4f12-a742-9c578d68c758 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:52.541326 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-69affba9-a6be-4f12-a742-9c578d68c758 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:52.541941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-69affba9-a6be-4f12-a742-9c578d68c758 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:52.811824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6f81e94f-7744-4332-8fd8-f9c4287cd1aa tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:52.822254 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6f81e94f-7744-4332-8fd8-f9c4287cd1aa tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1363 microversion: 2.1 time: 0.644416 May 21 21:22:52.832406 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1538/3148] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:52 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1363 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:52.979009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-69affba9-a6be-4f12-a742-9c578d68c758 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:52.991854 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-69affba9-a6be-4f12-a742-9c578d68c758 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1519 microversion: 2.1 time: 0.476705 May 21 21:22:52.992504 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1611/3149] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:52 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1519 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:22:53.120460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1c9217ba-32a3-4ba8-816e-6faa6c1f4f66 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Action: 'create', calling method: .version_select at 0x7fc81b6fca60>, body: {"keypair": {"name": "tempest-keypair-869879107", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBonpoDoshHbx3WZQeMJOZBTH3NdyXj5E8dvjFGmUb1xerYTyxVlzc41n/9mpV+Myk0UamhKYBv3ZTkUhVT9Z2fDc/VfeagtVLApm9v3S9eIShb0rXqfnESDKOom9hJUKg=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:53.138459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-1c9217ba-32a3-4ba8-816e-6faa6c1f4f66 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Getting quotas for project d74d3bd7c77d4fff99f01a798b584643. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:22:53.144721 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-1c9217ba-32a3-4ba8-816e-6faa6c1f4f66 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Getting quotas for user 68bca59219d5408d923faab503dccb39 and project d74d3bd7c77d4fff99f01a798b584643. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:22:53.239903 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1c9217ba-32a3-4ba8-816e-6faa6c1f4f66 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.292390 May 21 21:22:53.244393 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1539/3150] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:22:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:53.459405 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a3cf2c3b-1fe6-4063-8744-4cea0671c412 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:53.460169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a3cf2c3b-1fe6-4063-8744-4cea0671c412 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:53.468609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a3cf2c3b-1fe6-4063-8744-4cea0671c412 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:53.473616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a3cf2c3b-1fe6-4063-8744-4cea0671c412 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:53.473616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a3cf2c3b-1fe6-4063-8744-4cea0671c412 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:53.474975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a3cf2c3b-1fe6-4063-8744-4cea0671c412 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:53.614893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a3cf2c3b-1fe6-4063-8744-4cea0671c412 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:53.624431 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a3cf2c3b-1fe6-4063-8744-4cea0671c412 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 200 len: 1221 microversion: 2.1 time: 0.170541 May 21 21:22:53.638067 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1612/3151] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:53 2022] GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 1221 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:53.841783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c3661bf7-2d74-4f5a-8fb7-b25a8b0d4297 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:53.842842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c3661bf7-2d74-4f5a-8fb7-b25a8b0d4297 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:53.851966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3661bf7-2d74-4f5a-8fb7-b25a8b0d4297 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:53.852472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3661bf7-2d74-4f5a-8fb7-b25a8b0d4297 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:53.853472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3661bf7-2d74-4f5a-8fb7-b25a8b0d4297 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:53.854157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3661bf7-2d74-4f5a-8fb7-b25a8b0d4297 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:54.011913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-736adbde-9f8e-4d62-ba9e-fe4a8c4be9ab tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:54.012900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-736adbde-9f8e-4d62-ba9e-fe4a8c4be9ab tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:54.024144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-736adbde-9f8e-4d62-ba9e-fe4a8c4be9ab tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:54.025458 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-736adbde-9f8e-4d62-ba9e-fe4a8c4be9ab tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:54.026542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-736adbde-9f8e-4d62-ba9e-fe4a8c4be9ab tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:54.027717 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-736adbde-9f8e-4d62-ba9e-fe4a8c4be9ab tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:54.155940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c3661bf7-2d74-4f5a-8fb7-b25a8b0d4297 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:54.177780 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c3661bf7-2d74-4f5a-8fb7-b25a8b0d4297 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1549 microversion: 2.1 time: 0.341194 May 21 21:22:54.191131 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1540/3152] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:53 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1549 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:54.197857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e7a40612-957d-415d-9745-d37d21984bfb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:54.201317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e7a40612-957d-415d-9745-d37d21984bfb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:54.212541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7a40612-957d-415d-9745-d37d21984bfb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:54.213124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7a40612-957d-415d-9745-d37d21984bfb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:54.213987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7a40612-957d-415d-9745-d37d21984bfb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:54.214493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7a40612-957d-415d-9745-d37d21984bfb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:54.321746 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e7a40612-957d-415d-9745-d37d21984bfb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128550 May 21 21:22:54.329715 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1541/3153] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 21:22:54 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:54.469336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-736adbde-9f8e-4d62-ba9e-fe4a8c4be9ab tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:54.479163 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-736adbde-9f8e-4d62-ba9e-fe4a8c4be9ab tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1519 microversion: 2.1 time: 0.473104 May 21 21:22:54.480362 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1613/3154] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:54 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1519 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:54.643664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0560bc5c-43d2-4a6d-8b7e-da15f7898554 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:54.649058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0560bc5c-43d2-4a6d-8b7e-da15f7898554 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:54.681479 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0560bc5c-43d2-4a6d-8b7e-da15f7898554 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:54.683187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0560bc5c-43d2-4a6d-8b7e-da15f7898554 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:54.684333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0560bc5c-43d2-4a6d-8b7e-da15f7898554 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:54.686420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0560bc5c-43d2-4a6d-8b7e-da15f7898554 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:54.912703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0560bc5c-43d2-4a6d-8b7e-da15f7898554 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:54.929594 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0560bc5c-43d2-4a6d-8b7e-da15f7898554 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 200 len: 1277 microversion: 2.1 time: 0.290059 May 21 21:22:54.933636 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1542/3155] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:54 2022] GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 1277 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:55.502724 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-03813e81-4241-467d-b5da-6fd7efc4ff76 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:55.511140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-03813e81-4241-467d-b5da-6fd7efc4ff76 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:55.520522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-03813e81-4241-467d-b5da-6fd7efc4ff76 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:55.521058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-03813e81-4241-467d-b5da-6fd7efc4ff76 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:55.522083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-03813e81-4241-467d-b5da-6fd7efc4ff76 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:55.522595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-03813e81-4241-467d-b5da-6fd7efc4ff76 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:55.790302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-03813e81-4241-467d-b5da-6fd7efc4ff76 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:55.798408 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-03813e81-4241-467d-b5da-6fd7efc4ff76 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1519 microversion: 2.1 time: 0.299852 May 21 21:22:55.810295 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1614/3156] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:55 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1519 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:55.951562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-35397efd-fedf-45fb-bd53-e968bb50a7b9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:55.953105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-35397efd-fedf-45fb-bd53-e968bb50a7b9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:55.966348 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35397efd-fedf-45fb-bd53-e968bb50a7b9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:55.966872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35397efd-fedf-45fb-bd53-e968bb50a7b9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:55.967826 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35397efd-fedf-45fb-bd53-e968bb50a7b9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:55.968273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35397efd-fedf-45fb-bd53-e968bb50a7b9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:56.162003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-35397efd-fedf-45fb-bd53-e968bb50a7b9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:56.191711 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-35397efd-fedf-45fb-bd53-e968bb50a7b9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 200 len: 1275 microversion: 2.1 time: 0.245304 May 21 21:22:56.193166 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1543/3157] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:55 2022] GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 1275 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:56.821299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cd7ffcd5-ce5b-41bc-8cf8-e44559209dae tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:56.822556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cd7ffcd5-ce5b-41bc-8cf8-e44559209dae tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:56.832902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd7ffcd5-ce5b-41bc-8cf8-e44559209dae tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:56.833760 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd7ffcd5-ce5b-41bc-8cf8-e44559209dae tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:56.834626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd7ffcd5-ce5b-41bc-8cf8-e44559209dae tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:56.835329 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd7ffcd5-ce5b-41bc-8cf8-e44559209dae tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:57.033222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cd7ffcd5-ce5b-41bc-8cf8-e44559209dae tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:57.042699 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cd7ffcd5-ce5b-41bc-8cf8-e44559209dae tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1519 microversion: 2.1 time: 0.227224 May 21 21:22:57.043282 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1615/3158] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:56 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1519 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:57.213326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8e1143a7-5ed7-442c-bf9f-64bd6db0c731 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:57.215075 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8e1143a7-5ed7-442c-bf9f-64bd6db0c731 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:57.225082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e1143a7-5ed7-442c-bf9f-64bd6db0c731 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:57.225555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e1143a7-5ed7-442c-bf9f-64bd6db0c731 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:57.227390 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e1143a7-5ed7-442c-bf9f-64bd6db0c731 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:57.228035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e1143a7-5ed7-442c-bf9f-64bd6db0c731 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:57.344033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8e1143a7-5ed7-442c-bf9f-64bd6db0c731 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:57.352212 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8e1143a7-5ed7-442c-bf9f-64bd6db0c731 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 200 len: 1275 microversion: 2.1 time: 0.145971 May 21 21:22:57.353424 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1544/3159] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:57 2022] GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 1275 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:57.690290 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-1295f764-28fb-4f6b-a4da-1c7b5c6aa46a req-19bbf619-b43c-4116-b687-c3203f2cd1ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "168c8024-2cb4-4135-be5d-7a5cfcc6e895", "tag": "fcc08185-a786-4b24-9deb-2bfaacaf7c9b"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:57.696161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-870f1516-ad92-44c8-b0a9-730e2d984b41 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:57.697103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-870f1516-ad92-44c8-b0a9-730e2d984b41 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:57.710578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-870f1516-ad92-44c8-b0a9-730e2d984b41 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:57.713519 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-1295f764-28fb-4f6b-a4da-1c7b5c6aa46a req-19bbf619-b43c-4116-b687-c3203f2cd1ae service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:57.714267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-870f1516-ad92-44c8-b0a9-730e2d984b41 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:57.715870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-870f1516-ad92-44c8-b0a9-730e2d984b41 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:57.716541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-1295f764-28fb-4f6b-a4da-1c7b5c6aa46a req-19bbf619-b43c-4116-b687-c3203f2cd1ae service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:57.721327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-870f1516-ad92-44c8-b0a9-730e2d984b41 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:57.776310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:57.776908 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-1295f764-28fb-4f6b-a4da-1c7b5c6aa46a req-19bbf619-b43c-4116-b687-c3203f2cd1ae service nova] Creating event network-changed:fcc08185-a786-4b24-9deb-2bfaacaf7c9b for instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 on nch1-master-1 May 21 21:22:57.783432 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-1295f764-28fb-4f6b-a4da-1c7b5c6aa46a req-19bbf619-b43c-4116-b687-c3203f2cd1ae service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099095 May 21 21:22:57.794249 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1545/3160] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:22:58.066957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f765af76-3ea4-4d2b-8897-a65b85ae7f00 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:58.068315 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f765af76-3ea4-4d2b-8897-a65b85ae7f00 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:58.099929 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f765af76-3ea4-4d2b-8897-a65b85ae7f00 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:58.122703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f765af76-3ea4-4d2b-8897-a65b85ae7f00 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:58.122703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f765af76-3ea4-4d2b-8897-a65b85ae7f00 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:58.123001 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f765af76-3ea4-4d2b-8897-a65b85ae7f00 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:58.420622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-870f1516-ad92-44c8-b0a9-730e2d984b41 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:58.430795 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-870f1516-ad92-44c8-b0a9-730e2d984b41 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1549 microversion: 2.1 time: 0.759262 May 21 21:22:58.435961 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1616/3161] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:57 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1549 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:58.453920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-73a4f924-adec-4fc8-b09b-249807382d7e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:58.455039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-73a4f924-adec-4fc8-b09b-249807382d7e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:58.469391 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-73a4f924-adec-4fc8-b09b-249807382d7e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:58.475494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-73a4f924-adec-4fc8-b09b-249807382d7e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:58.476427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-73a4f924-adec-4fc8-b09b-249807382d7e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:58.477092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-73a4f924-adec-4fc8-b09b-249807382d7e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:58.557420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f765af76-3ea4-4d2b-8897-a65b85ae7f00 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:58.576089 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f765af76-3ea4-4d2b-8897-a65b85ae7f00 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1519 microversion: 2.1 time: 0.515940 May 21 21:22:58.578806 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1546/3162] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:58 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1519 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:58.598193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d2b40162-1a41-451e-bb00-26b1c0c6f854 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:58.599330 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d2b40162-1a41-451e-bb00-26b1c0c6f854 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:58.625024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2b40162-1a41-451e-bb00-26b1c0c6f854 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:58.625544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2b40162-1a41-451e-bb00-26b1c0c6f854 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:58.631650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2b40162-1a41-451e-bb00-26b1c0c6f854 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:58.632534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2b40162-1a41-451e-bb00-26b1c0c6f854 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:58.773177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-73a4f924-adec-4fc8-b09b-249807382d7e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:58.782667 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-73a4f924-adec-4fc8-b09b-249807382d7e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 200 len: 1317 microversion: 2.1 time: 0.345013 May 21 21:22:58.800754 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1617/3163] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:58 2022] GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:58.931771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=16 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:59.224384 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d2b40162-1a41-451e-bb00-26b1c0c6f854 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:59.234804 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d2b40162-1a41-451e-bb00-26b1c0c6f854 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1549 microversion: 2.1 time: 0.654003 May 21 21:22:59.235753 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1547/3164] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:58 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1549 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:59.598925 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e645326c-8261-4945-96e2-53c2c94aabb4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:59.599536 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e645326c-8261-4945-96e2-53c2c94aabb4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:59.610898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e645326c-8261-4945-96e2-53c2c94aabb4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:59.611356 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e645326c-8261-4945-96e2-53c2c94aabb4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:59.612133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e645326c-8261-4945-96e2-53c2c94aabb4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:59.613206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e645326c-8261-4945-96e2-53c2c94aabb4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:59.770570 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ff0830d0-e219-4578-a545-d50f609befa4 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-2121864146", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7bc44a7b-6355-42e3-b269-e812f0286b54"}], "security_groups": [{"name": "tempest-securitygroup--960360162"}], "key_name": "tempest-keypair-869879107", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:22:59.899018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e645326c-8261-4945-96e2-53c2c94aabb4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:22:59.908456 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e645326c-8261-4945-96e2-53c2c94aabb4 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1519 microversion: 2.1 time: 0.313227 May 21 21:22:59.909144 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1618/3165] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:59 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1519 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:22:59.915412 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dd6ccdbd-fb10-411b-8b02-06aa0ab9f3bc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:22:59.916034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dd6ccdbd-fb10-411b-8b02-06aa0ab9f3bc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:22:59.922678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd6ccdbd-fb10-411b-8b02-06aa0ab9f3bc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:59.923159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd6ccdbd-fb10-411b-8b02-06aa0ab9f3bc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:59.923976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd6ccdbd-fb10-411b-8b02-06aa0ab9f3bc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:22:59.924402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd6ccdbd-fb10-411b-8b02-06aa0ab9f3bc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:22:59.982290 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-ff0830d0-e219-4578-a545-d50f609befa4 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] validate_networks() for [('7bc44a7b-6355-42e3-b269-e812f0286b54', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:23:00.078506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-dd6ccdbd-fb10-411b-8b02-06aa0ab9f3bc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:00.086926 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dd6ccdbd-fb10-411b-8b02-06aa0ab9f3bc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 200 len: 1317 microversion: 2.1 time: 0.175956 May 21 21:23:00.087882 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1619/3166] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:22:59 2022] GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:00.171129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-ac93450d-d23a-4a74-9ad4-f39f8b52e9db req-ea917710-f359-4650-ad34-cf27e0934de3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "766239c5-7dbe-4c3a-b071-6cf16b71200a", "tag": "5523c07a-ab85-45f5-a295-a288568115de"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:00.182058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ac93450d-d23a-4a74-9ad4-f39f8b52e9db req-ea917710-f359-4650-ad34-cf27e0934de3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:00.185718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ac93450d-d23a-4a74-9ad4-f39f8b52e9db req-ea917710-f359-4650-ad34-cf27e0934de3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:00.200993 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-ac93450d-d23a-4a74-9ad4-f39f8b52e9db req-ea917710-f359-4650-ad34-cf27e0934de3 service nova] Creating event network-changed:5523c07a-ab85-45f5-a295-a288568115de for instance 766239c5-7dbe-4c3a-b071-6cf16b71200a on nch2-master-1 May 21 21:23:00.219586 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-ac93450d-d23a-4a74-9ad4-f39f8b52e9db req-ea917710-f359-4650-ad34-cf27e0934de3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051500 May 21 21:23:00.220404 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1620/3167] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:00.257494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8f8f2d38-0709-46c8-8d9b-8175edbf6cbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:00.259024 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8f8f2d38-0709-46c8-8d9b-8175edbf6cbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:00.271128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f8f2d38-0709-46c8-8d9b-8175edbf6cbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:00.271590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f8f2d38-0709-46c8-8d9b-8175edbf6cbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:00.272798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f8f2d38-0709-46c8-8d9b-8175edbf6cbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:00.273252 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f8f2d38-0709-46c8-8d9b-8175edbf6cbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:00.449041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8f8f2d38-0709-46c8-8d9b-8175edbf6cbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:00.459683 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8f8f2d38-0709-46c8-8d9b-8175edbf6cbe tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.210077 May 21 21:23:00.460293 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1621/3168] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:00 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:00.477699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0ddb9477-3f66-436e-9a6f-b4bde391afae tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:00.481360 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0ddb9477-3f66-436e-9a6f-b4bde391afae tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:00.485521 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ddb9477-3f66-436e-9a6f-b4bde391afae tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:00.486159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ddb9477-3f66-436e-9a6f-b4bde391afae tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:00.487155 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ddb9477-3f66-436e-9a6f-b4bde391afae tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:00.487883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ddb9477-3f66-436e-9a6f-b4bde391afae tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:00.648045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0ddb9477-3f66-436e-9a6f-b4bde391afae tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:00.656669 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0ddb9477-3f66-436e-9a6f-b4bde391afae tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.183847 May 21 21:23:00.663861 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1622/3169] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:00 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:00.673740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b51a1525-d807-4970-8dae-73f36bdbd7ce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1607997351"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:00.675406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b51a1525-d807-4970-8dae-73f36bdbd7ce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:00.681889 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b51a1525-d807-4970-8dae-73f36bdbd7ce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:00.682386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b51a1525-d807-4970-8dae-73f36bdbd7ce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:00.683230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b51a1525-d807-4970-8dae-73f36bdbd7ce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:00.683682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b51a1525-d807-4970-8dae-73f36bdbd7ce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:00.920903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-ff0830d0-e219-4578-a545-d50f609befa4 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Getting quotas for project d74d3bd7c77d4fff99f01a798b584643. Resources: dict_keys(['metadata_items']) {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:23:00.924155 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:00.929370 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-ff0830d0-e219-4578-a545-d50f609befa4 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Getting quotas for user 68bca59219d5408d923faab503dccb39 and project d74d3bd7c77d4fff99f01a798b584643. Resources: dict_keys(['metadata_items']) {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:23:00.946966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-ff0830d0-e219-4578-a545-d50f609befa4 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:23:00.947910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-ff0830d0-e219-4578-a545-d50f609befa4 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:23:00.948647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-ff0830d0-e219-4578-a545-d50f609befa4 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:23:00.949194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-ff0830d0-e219-4578-a545-d50f609befa4 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:23:00.949714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-ff0830d0-e219-4578-a545-d50f609befa4 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:23:00.960482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff0830d0-e219-4578-a545-d50f609befa4 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:00.961016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff0830d0-e219-4578-a545-d50f609befa4 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:00.961916 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff0830d0-e219-4578-a545-d50f609befa4 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:00.962438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff0830d0-e219-4578-a545-d50f609befa4 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:00.983848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-ff0830d0-e219-4578-a545-d50f609befa4 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Getting quotas for project d74d3bd7c77d4fff99f01a798b584643. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:23:00.990621 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-ff0830d0-e219-4578-a545-d50f609befa4 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Getting quotas for user 68bca59219d5408d923faab503dccb39 and project d74d3bd7c77d4fff99f01a798b584643. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:23:01.005243 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ff0830d0-e219-4578-a545-d50f609befa4 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:23:01.007745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ff0830d0-e219-4578-a545-d50f609befa4 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:23:01.206999 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ff0830d0-e219-4578-a545-d50f609befa4 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.444024 May 21 21:23:01.217262 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1548/3170] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:22:59 2022] POST /compute/v2.1/servers => generated 408 bytes in 1455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:23:01.224065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-93da07e7-abf5-4681-9c71-c145d05ea142 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:01.224941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-93da07e7-abf5-4681-9c71-c145d05ea142 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:01.234186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-93da07e7-abf5-4681-9c71-c145d05ea142 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:01.234768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-93da07e7-abf5-4681-9c71-c145d05ea142 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:01.235698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-93da07e7-abf5-4681-9c71-c145d05ea142 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:01.236967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-93da07e7-abf5-4681-9c71-c145d05ea142 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:01.271271 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:01.359480 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b51a1525-d807-4970-8dae-73f36bdbd7ce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action" status: 202 len: 0 microversion: 2.1 time: 0.687338 May 21 21:23:01.361637 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1623/3171] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:23:00 2022] POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action => generated 0 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) May 21 21:23:01.368340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-33f9e56e-2521-44dc-a00b-b2f9470d3bb3 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:01.369308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-33f9e56e-2521-44dc-a00b-b2f9470d3bb3 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:01.377010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33f9e56e-2521-44dc-a00b-b2f9470d3bb3 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:01.377801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33f9e56e-2521-44dc-a00b-b2f9470d3bb3 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:01.378908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33f9e56e-2521-44dc-a00b-b2f9470d3bb3 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:01.379715 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33f9e56e-2521-44dc-a00b-b2f9470d3bb3 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:01.574657 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-33f9e56e-2521-44dc-a00b-b2f9470d3bb3 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:01.583587 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-33f9e56e-2521-44dc-a00b-b2f9470d3bb3 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 200 len: 1317 microversion: 2.1 time: 0.219909 May 21 21:23:01.584076 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1624/3172] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:01 2022] GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:01.589132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0fdfae84-b696-4caf-b42a-f9403455d51c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:01.591451 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0fdfae84-b696-4caf-b42a-f9403455d51c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:01.602885 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-93da07e7-abf5-4681-9c71-c145d05ea142 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:01.618858 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-93da07e7-abf5-4681-9c71-c145d05ea142 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1519 microversion: 2.1 time: 0.400088 May 21 21:23:01.619414 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1549/3173] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:01 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1519 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:01.672455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0fdfae84-b696-4caf-b42a-f9403455d51c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:01.680713 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0fdfae84-b696-4caf-b42a-f9403455d51c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c" status: 200 len: 1277 microversion: 2.1 time: 0.095275 May 21 21:23:01.683031 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1625/3174] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:01 2022] GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c => generated 1277 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:01.843760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fdbde5d1-ed06-4f5d-90e2-b1e90d273fd6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:01.844919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fdbde5d1-ed06-4f5d-90e2-b1e90d273fd6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:01.853569 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fdbde5d1-ed06-4f5d-90e2-b1e90d273fd6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:01.853569 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fdbde5d1-ed06-4f5d-90e2-b1e90d273fd6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:01.853569 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fdbde5d1-ed06-4f5d-90e2-b1e90d273fd6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:01.854021 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fdbde5d1-ed06-4f5d-90e2-b1e90d273fd6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:01.906341 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fdbde5d1-ed06-4f5d-90e2-b1e90d273fd6 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "POST /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941/action" status: 200 len: 24587 microversion: 2.32 time: 0.276124 May 21 21:23:01.906974 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1550/3175] 10.222.0.49 () {62 vars in 1318 bytes} [Sat May 21 21:23:01 2022] POST /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941/action => generated 24587 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 21 21:23:02.602534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2c326f2b-fb95-40e7-b85a-a96a0aed01fc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:02.603201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2c326f2b-fb95-40e7-b85a-a96a0aed01fc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:02.605381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=8 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:02.611146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c326f2b-fb95-40e7-b85a-a96a0aed01fc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:02.611602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c326f2b-fb95-40e7-b85a-a96a0aed01fc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:02.612470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c326f2b-fb95-40e7-b85a-a96a0aed01fc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:02.613093 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c326f2b-fb95-40e7-b85a-a96a0aed01fc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:02.637387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cb361c89-646d-4e81-acce-bea327c36504 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:02.638191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cb361c89-646d-4e81-acce-bea327c36504 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:02.648821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb361c89-646d-4e81-acce-bea327c36504 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:02.649282 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb361c89-646d-4e81-acce-bea327c36504 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:02.650115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb361c89-646d-4e81-acce-bea327c36504 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:02.650645 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb361c89-646d-4e81-acce-bea327c36504 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:02.774145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2c326f2b-fb95-40e7-b85a-a96a0aed01fc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:02.782572 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2c326f2b-fb95-40e7-b85a-a96a0aed01fc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 200 len: 1317 microversion: 2.1 time: 0.185039 May 21 21:23:02.783161 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1626/3176] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:02 2022] GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:02.788968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aa415417-f6f5-452a-b59a-4a2d00d2d9a0 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:02.791309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aa415417-f6f5-452a-b59a-4a2d00d2d9a0 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:02.796547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa415417-f6f5-452a-b59a-4a2d00d2d9a0 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:02.797011 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa415417-f6f5-452a-b59a-4a2d00d2d9a0 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:02.797793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa415417-f6f5-452a-b59a-4a2d00d2d9a0 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:02.798240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa415417-f6f5-452a-b59a-4a2d00d2d9a0 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:02.886521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cb361c89-646d-4e81-acce-bea327c36504 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:02.886719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aa415417-f6f5-452a-b59a-4a2d00d2d9a0 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:02.897765 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aa415417-f6f5-452a-b59a-4a2d00d2d9a0 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c" status: 200 len: 1281 microversion: 2.1 time: 0.112893 May 21 21:23:02.898517 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1627/3177] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:02 2022] GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c => generated 1281 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:02.899438 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cb361c89-646d-4e81-acce-bea327c36504 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1519 microversion: 2.1 time: 0.266305 May 21 21:23:02.900250 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1551/3178] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:02 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1519 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:03.801788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-335111fa-55ce-4dc7-b811-2bea82272a6f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:03.802474 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-335111fa-55ce-4dc7-b811-2bea82272a6f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:03.814636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-335111fa-55ce-4dc7-b811-2bea82272a6f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:03.817055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-335111fa-55ce-4dc7-b811-2bea82272a6f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:03.822266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-335111fa-55ce-4dc7-b811-2bea82272a6f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:03.822266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-335111fa-55ce-4dc7-b811-2bea82272a6f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:03.918360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-646fd61c-9c8a-4d58-97ee-1145d8574f35 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:03.918981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-646fd61c-9c8a-4d58-97ee-1145d8574f35 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:03.929486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-646fd61c-9c8a-4d58-97ee-1145d8574f35 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:03.929953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-646fd61c-9c8a-4d58-97ee-1145d8574f35 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:03.930805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-646fd61c-9c8a-4d58-97ee-1145d8574f35 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:03.931259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-646fd61c-9c8a-4d58-97ee-1145d8574f35 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:03.989432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-335111fa-55ce-4dc7-b811-2bea82272a6f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:03.997999 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-335111fa-55ce-4dc7-b811-2bea82272a6f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 200 len: 1317 microversion: 2.1 time: 0.201109 May 21 21:23:04.008818 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1628/3179] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:03 2022] GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:04.014420 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-acb76e2e-5bb3-482b-b6c2-e1feb421819d tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:04.015143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-acb76e2e-5bb3-482b-b6c2-e1feb421819d tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:04.025155 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-acb76e2e-5bb3-482b-b6c2-e1feb421819d tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:04.028983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-acb76e2e-5bb3-482b-b6c2-e1feb421819d tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:04.028983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-acb76e2e-5bb3-482b-b6c2-e1feb421819d tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:04.028983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-acb76e2e-5bb3-482b-b6c2-e1feb421819d tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:04.120385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-646fd61c-9c8a-4d58-97ee-1145d8574f35 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:04.129017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-acb76e2e-5bb3-482b-b6c2-e1feb421819d tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:04.131928 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-646fd61c-9c8a-4d58-97ee-1145d8574f35 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1519 microversion: 2.1 time: 0.219047 May 21 21:23:04.135456 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1552/3180] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:03 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1519 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:04.152355 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-acb76e2e-5bb3-482b-b6c2-e1feb421819d tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c" status: 200 len: 1329 microversion: 2.1 time: 0.138475 May 21 21:23:04.152355 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1629/3181] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:04 2022] GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c => generated 1329 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:05.017501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f2a1048a-aedf-4515-a3d5-dc65d5c912b2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:05.018850 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f2a1048a-aedf-4515-a3d5-dc65d5c912b2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:05.033211 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2a1048a-aedf-4515-a3d5-dc65d5c912b2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:05.033611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2a1048a-aedf-4515-a3d5-dc65d5c912b2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:05.036012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2a1048a-aedf-4515-a3d5-dc65d5c912b2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:05.037660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2a1048a-aedf-4515-a3d5-dc65d5c912b2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:05.155824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0936d7a7-cc68-410f-b279-f4893f84375d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:05.156609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0936d7a7-cc68-410f-b279-f4893f84375d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:05.178267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0936d7a7-cc68-410f-b279-f4893f84375d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:05.179158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0936d7a7-cc68-410f-b279-f4893f84375d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:05.180192 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0936d7a7-cc68-410f-b279-f4893f84375d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:05.184030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0936d7a7-cc68-410f-b279-f4893f84375d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:05.312143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f2a1048a-aedf-4515-a3d5-dc65d5c912b2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:05.321428 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f2a1048a-aedf-4515-a3d5-dc65d5c912b2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 200 len: 1317 microversion: 2.1 time: 0.309254 May 21 21:23:05.325986 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1553/3182] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:05 2022] GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:05.334379 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-efe5c07f-408d-456c-8dda-dc4b3d632817 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:05.335104 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-efe5c07f-408d-456c-8dda-dc4b3d632817 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:05.342303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efe5c07f-408d-456c-8dda-dc4b3d632817 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:05.343050 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efe5c07f-408d-456c-8dda-dc4b3d632817 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:05.347207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efe5c07f-408d-456c-8dda-dc4b3d632817 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:05.354283 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efe5c07f-408d-456c-8dda-dc4b3d632817 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:05.522895 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-efe5c07f-408d-456c-8dda-dc4b3d632817 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:05.558088 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-efe5c07f-408d-456c-8dda-dc4b3d632817 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c" status: 200 len: 1335 microversion: 2.1 time: 0.230829 May 21 21:23:05.559607 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1554/3183] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:05 2022] GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c => generated 1335 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:05.647002 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0936d7a7-cc68-410f-b279-f4893f84375d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:05.654879 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0936d7a7-cc68-410f-b279-f4893f84375d tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1519 microversion: 2.1 time: 0.505123 May 21 21:23:05.655478 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1630/3184] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:05 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1519 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:06.342509 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6966df2a-9b03-4d21-9478-2f3a60562cb7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:06.343133 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6966df2a-9b03-4d21-9478-2f3a60562cb7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:06.376788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6966df2a-9b03-4d21-9478-2f3a60562cb7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:06.377319 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6966df2a-9b03-4d21-9478-2f3a60562cb7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:06.394867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6966df2a-9b03-4d21-9478-2f3a60562cb7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:06.394867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6966df2a-9b03-4d21-9478-2f3a60562cb7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:06.546534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-3c59a32f-40ce-4499-bcf1-a02d3b33f9f9 req-16cce748-ce53-4ade-9d18-65a6fb89b058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168c8024-2cb4-4135-be5d-7a5cfcc6e895", "name": "network-vif-plugged", "status": "completed", "tag": "fcc08185-a786-4b24-9deb-2bfaacaf7c9b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:06.565023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-3c59a32f-40ce-4499-bcf1-a02d3b33f9f9 req-16cce748-ce53-4ade-9d18-65a6fb89b058 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:06.566678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-3c59a32f-40ce-4499-bcf1-a02d3b33f9f9 req-16cce748-ce53-4ade-9d18-65a6fb89b058 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:06.601611 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-3c59a32f-40ce-4499-bcf1-a02d3b33f9f9 req-16cce748-ce53-4ade-9d18-65a6fb89b058 service nova] Creating event network-vif-plugged:fcc08185-a786-4b24-9deb-2bfaacaf7c9b for instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 on nch1-master-1 May 21 21:23:06.623604 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-3c59a32f-40ce-4499-bcf1-a02d3b33f9f9 req-16cce748-ce53-4ade-9d18-65a6fb89b058 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081086 May 21 21:23:06.629362 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1631/3185] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:23:06.653051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0f6d98fb-84df-45af-849a-f969d190627d tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:06.654212 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0f6d98fb-84df-45af-849a-f969d190627d tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:06.680830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f6d98fb-84df-45af-849a-f969d190627d tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:06.681547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f6d98fb-84df-45af-849a-f969d190627d tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:06.685002 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f6d98fb-84df-45af-849a-f969d190627d tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:06.688109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f6d98fb-84df-45af-849a-f969d190627d tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:06.819467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6966df2a-9b03-4d21-9478-2f3a60562cb7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:06.834347 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6966df2a-9b03-4d21-9478-2f3a60562cb7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 200 len: 1317 microversion: 2.1 time: 0.497238 May 21 21:23:06.838361 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1555/3186] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:06 2022] GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:06.848904 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d730c0de-c145-4840-9217-4d6a32824b8c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:06.855416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d730c0de-c145-4840-9217-4d6a32824b8c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:06.876644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d730c0de-c145-4840-9217-4d6a32824b8c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:06.884752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d730c0de-c145-4840-9217-4d6a32824b8c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:06.888252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d730c0de-c145-4840-9217-4d6a32824b8c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:06.891541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d730c0de-c145-4840-9217-4d6a32824b8c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:07.214777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0f6d98fb-84df-45af-849a-f969d190627d tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:07.231944 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0f6d98fb-84df-45af-849a-f969d190627d tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c" status: 200 len: 1402 microversion: 2.1 time: 0.598843 May 21 21:23:07.245922 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1632/3187] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:06 2022] GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c => generated 1402 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:07.433058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d730c0de-c145-4840-9217-4d6a32824b8c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:07.458288 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d730c0de-c145-4840-9217-4d6a32824b8c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1519 microversion: 2.1 time: 0.613458 May 21 21:23:07.463289 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1556/3188] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:06 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1519 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:07.879227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-772c784f-7c8c-4ff4-ad69-54a1feadf1da tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:07.882315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-772c784f-7c8c-4ff4-ad69-54a1feadf1da tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:07.900664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-772c784f-7c8c-4ff4-ad69-54a1feadf1da tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:07.900664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-772c784f-7c8c-4ff4-ad69-54a1feadf1da tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:07.900664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-772c784f-7c8c-4ff4-ad69-54a1feadf1da tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:07.903890 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-772c784f-7c8c-4ff4-ad69-54a1feadf1da tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:07.973335 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-26100765-e07b-4166-9fcb-b7330a947697 req-6316cffd-bfe2-4f90-bb78-bfb355647710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35305bf8-3bec-4194-a7a3-73c1b559de0c", "tag": "70fc2489-6822-4979-aba0-c2fcf2ea6390"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:08.018221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-26100765-e07b-4166-9fcb-b7330a947697 req-6316cffd-bfe2-4f90-bb78-bfb355647710 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:08.019857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-26100765-e07b-4166-9fcb-b7330a947697 req-6316cffd-bfe2-4f90-bb78-bfb355647710 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:08.051844 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-26100765-e07b-4166-9fcb-b7330a947697 req-6316cffd-bfe2-4f90-bb78-bfb355647710 service nova] Creating event network-changed:70fc2489-6822-4979-aba0-c2fcf2ea6390 for instance 35305bf8-3bec-4194-a7a3-73c1b559de0c on nch2-master-1 May 21 21:23:08.097585 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-26100765-e07b-4166-9fcb-b7330a947697 req-6316cffd-bfe2-4f90-bb78-bfb355647710 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134002 May 21 21:23:08.113311 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1557/3189] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:08.254676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0ac7647d-ef1d-4617-b023-2a230c71d750 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:08.259159 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0ac7647d-ef1d-4617-b023-2a230c71d750 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:08.285377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ac7647d-ef1d-4617-b023-2a230c71d750 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:08.286109 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ac7647d-ef1d-4617-b023-2a230c71d750 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:08.287388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ac7647d-ef1d-4617-b023-2a230c71d750 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:08.288582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ac7647d-ef1d-4617-b023-2a230c71d750 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:08.490651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-772c784f-7c8c-4ff4-ad69-54a1feadf1da tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:08.505653 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-772c784f-7c8c-4ff4-ad69-54a1feadf1da tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 200 len: 1317 microversion: 2.1 time: 0.645197 May 21 21:23:08.506448 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1633/3190] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:07 2022] GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 1317 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:08.530302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1d02761e-4c74-44d1-8058-8bafb2352be7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:08.530302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1d02761e-4c74-44d1-8058-8bafb2352be7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:08.557283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d02761e-4c74-44d1-8058-8bafb2352be7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:08.557743 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d02761e-4c74-44d1-8058-8bafb2352be7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:08.558539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d02761e-4c74-44d1-8058-8bafb2352be7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:08.562494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d02761e-4c74-44d1-8058-8bafb2352be7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:08.567320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:08.841613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0ac7647d-ef1d-4617-b023-2a230c71d750 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:08.854481 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0ac7647d-ef1d-4617-b023-2a230c71d750 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c" status: 200 len: 1402 microversion: 2.1 time: 0.609109 May 21 21:23:08.855098 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1558/3191] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:08 2022] GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c => generated 1402 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:08.862916 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-22c26c1f-df25-4adb-8b31-9cc1b3439e50 req-c23d4343-cf11-4b2e-a16f-424ef8a4f5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766239c5-7dbe-4c3a-b071-6cf16b71200a", "name": "network-vif-plugged", "status": "completed", "tag": "5523c07a-ab85-45f5-a295-a288568115de"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:08.886772 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-22c26c1f-df25-4adb-8b31-9cc1b3439e50 req-c23d4343-cf11-4b2e-a16f-424ef8a4f5b0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:08.889139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-22c26c1f-df25-4adb-8b31-9cc1b3439e50 req-c23d4343-cf11-4b2e-a16f-424ef8a4f5b0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:08.918590 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-22c26c1f-df25-4adb-8b31-9cc1b3439e50 req-c23d4343-cf11-4b2e-a16f-424ef8a4f5b0 service nova] Creating event network-vif-plugged:5523c07a-ab85-45f5-a295-a288568115de for instance 766239c5-7dbe-4c3a-b071-6cf16b71200a on nch2-master-1 May 21 21:23:08.928608 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-22c26c1f-df25-4adb-8b31-9cc1b3439e50 req-c23d4343-cf11-4b2e-a16f-424ef8a4f5b0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072231 May 21 21:23:08.931627 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1559/3192] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:09.054744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1d02761e-4c74-44d1-8058-8bafb2352be7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:09.064267 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1d02761e-4c74-44d1-8058-8bafb2352be7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1519 microversion: 2.1 time: 0.554876 May 21 21:23:09.074998 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1634/3193] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:08 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1519 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:09.524693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b7798d96-f218-40fe-9378-31791d7cc711 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:09.525860 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b7798d96-f218-40fe-9378-31791d7cc711 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:09.550013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b7798d96-f218-40fe-9378-31791d7cc711 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:09.553224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b7798d96-f218-40fe-9378-31791d7cc711 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:09.553224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b7798d96-f218-40fe-9378-31791d7cc711 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:09.553224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b7798d96-f218-40fe-9378-31791d7cc711 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:09.769745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b7798d96-f218-40fe-9378-31791d7cc711 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:09.783700 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b7798d96-f218-40fe-9378-31791d7cc711 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 200 len: 1317 microversion: 2.1 time: 0.262294 May 21 21:23:09.783700 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1560/3194] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:09 2022] GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:09.872218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2c0bb30b-43bd-48ff-851b-c28c294ff1c2 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:09.872884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2c0bb30b-43bd-48ff-851b-c28c294ff1c2 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:09.881357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c0bb30b-43bd-48ff-851b-c28c294ff1c2 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:09.882072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c0bb30b-43bd-48ff-851b-c28c294ff1c2 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:09.883043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c0bb30b-43bd-48ff-851b-c28c294ff1c2 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:09.883854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c0bb30b-43bd-48ff-851b-c28c294ff1c2 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:10.082859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-228735b9-8196-418e-a02f-daa797287c20 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:10.083490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-228735b9-8196-418e-a02f-daa797287c20 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:10.103790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-228735b9-8196-418e-a02f-daa797287c20 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:10.104230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-228735b9-8196-418e-a02f-daa797287c20 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:10.105097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-228735b9-8196-418e-a02f-daa797287c20 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:10.105542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-228735b9-8196-418e-a02f-daa797287c20 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:10.305178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2c0bb30b-43bd-48ff-851b-c28c294ff1c2 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:10.341421 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2c0bb30b-43bd-48ff-851b-c28c294ff1c2 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c" status: 200 len: 1402 microversion: 2.1 time: 0.473244 May 21 21:23:10.348425 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1635/3195] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:09 2022] GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c => generated 1402 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:10.417270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-228735b9-8196-418e-a02f-daa797287c20 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:10.429524 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-228735b9-8196-418e-a02f-daa797287c20 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1496 microversion: 2.1 time: 0.351611 May 21 21:23:10.440870 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1561/3196] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:10 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1496 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:10.452231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ad4d06b5-615e-4d19-9b7d-6ece5a65d710 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:10.456981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ad4d06b5-615e-4d19-9b7d-6ece5a65d710 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:10.459580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ad4d06b5-615e-4d19-9b7d-6ece5a65d710 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415'} {{(pid=131277) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:23:10.473561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad4d06b5-615e-4d19-9b7d-6ece5a65d710 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:10.474106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad4d06b5-615e-4d19-9b7d-6ece5a65d710 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:10.475133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad4d06b5-615e-4d19-9b7d-6ece5a65d710 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:10.475833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad4d06b5-615e-4d19-9b7d-6ece5a65d710 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:10.662301 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.multi_cell_list [None req-ad4d06b5-615e-4d19-9b7d-6ece5a65d710 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131277) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:23:10.804937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4a87a16a-68af-4655-92a0-352d799169b9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:10.805933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4a87a16a-68af-4655-92a0-352d799169b9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:10.807657 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ad4d06b5-615e-4d19-9b7d-6ece5a65d710 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 344 microversion: 2.1 time: 0.359836 May 21 21:23:10.809801 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1636/3197] 10.222.0.49 () {58 vars in 1153 bytes} [Sat May 21 21:23:10 2022] GET /compute/v2.1/servers?status=shutoff => generated 344 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:10.817629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4a87a16a-68af-4655-92a0-352d799169b9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:10.818612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4a87a16a-68af-4655-92a0-352d799169b9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:10.819643 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4a87a16a-68af-4655-92a0-352d799169b9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:10.820188 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4a87a16a-68af-4655-92a0-352d799169b9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:10.861092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7f9f2502-b755-423c-b7ed-1965f357f651 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:10.882760 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f9f2502-b755-423c-b7ed-1965f357f651 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:10.884796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f9f2502-b755-423c-b7ed-1965f357f651 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:10.956372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7f9f2502-b755-423c-b7ed-1965f357f651 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Going to try to start instance {{(pid=131277) start /opt/stack/nova/nova/compute/api.py:2730}} May 21 21:23:10.972632 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:10.998039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=22 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:11.043505 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4a87a16a-68af-4655-92a0-352d799169b9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:11.052111 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4a87a16a-68af-4655-92a0-352d799169b9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 200 len: 1317 microversion: 2.1 time: 0.252680 May 21 21:23:11.052683 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1562/3198] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:10 2022] GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:11.366299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b4573502-4449-4d87-83ab-2dac0daf1065 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:11.366913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b4573502-4449-4d87-83ab-2dac0daf1065 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:11.374437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b4573502-4449-4d87-83ab-2dac0daf1065 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:11.374893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b4573502-4449-4d87-83ab-2dac0daf1065 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:11.375677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b4573502-4449-4d87-83ab-2dac0daf1065 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:11.376126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b4573502-4449-4d87-83ab-2dac0daf1065 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:11.513525 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7f9f2502-b755-423c-b7ed-1965f357f651 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "POST /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e/action" status: 202 len: 0 microversion: 2.1 time: 0.666034 May 21 21:23:11.514488 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1637/3199] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:23:10 2022] POST /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:23:11.528790 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f6c78969-8145-451e-b972-21b1ee9675d3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:11.533165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f6c78969-8145-451e-b972-21b1ee9675d3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:11.544032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:11.560518 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6c78969-8145-451e-b972-21b1ee9675d3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:11.562554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6c78969-8145-451e-b972-21b1ee9675d3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:11.565429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6c78969-8145-451e-b972-21b1ee9675d3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:11.569639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6c78969-8145-451e-b972-21b1ee9675d3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:11.686782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=11 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:11.726438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b4573502-4449-4d87-83ab-2dac0daf1065 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:11.751456 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b4573502-4449-4d87-83ab-2dac0daf1065 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c" status: 200 len: 1402 microversion: 2.1 time: 0.379816 May 21 21:23:11.752402 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1563/3200] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:11 2022] GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c => generated 1402 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:12.072323 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-be0cd821-0a28-4764-95cb-618e17252c2c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:12.072969 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-be0cd821-0a28-4764-95cb-618e17252c2c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:12.083886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be0cd821-0a28-4764-95cb-618e17252c2c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:12.090240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be0cd821-0a28-4764-95cb-618e17252c2c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:12.091121 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be0cd821-0a28-4764-95cb-618e17252c2c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:12.091576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be0cd821-0a28-4764-95cb-618e17252c2c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:12.204164 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f6c78969-8145-451e-b972-21b1ee9675d3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:12.221029 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f6c78969-8145-451e-b972-21b1ee9675d3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1505 microversion: 2.1 time: 0.702386 May 21 21:23:12.239990 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1638/3201] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:11 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1505 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:12.482809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-be0cd821-0a28-4764-95cb-618e17252c2c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:12.498283 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-be0cd821-0a28-4764-95cb-618e17252c2c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 200 len: 1466 microversion: 2.1 time: 0.422494 May 21 21:23:12.498283 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1564/3202] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:12 2022] GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 1466 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:12.511533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8e2226b4-781d-4af2-bc1a-861a69586e6b tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:12.512146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8e2226b4-781d-4af2-bc1a-861a69586e6b tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:12.521535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8e2226b4-781d-4af2-bc1a-861a69586e6b tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:12.522184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8e2226b4-781d-4af2-bc1a-861a69586e6b tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:12.522792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8e2226b4-781d-4af2-bc1a-861a69586e6b tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:12.523240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8e2226b4-781d-4af2-bc1a-861a69586e6b tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:12.769647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-324b2668-4d9d-412f-80f0-b96c7965fac6 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:12.770277 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-324b2668-4d9d-412f-80f0-b96c7965fac6 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:12.777465 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-324b2668-4d9d-412f-80f0-b96c7965fac6 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:12.778239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-324b2668-4d9d-412f-80f0-b96c7965fac6 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:12.779236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-324b2668-4d9d-412f-80f0-b96c7965fac6 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:12.781423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-324b2668-4d9d-412f-80f0-b96c7965fac6 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:12.975972 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8e2226b4-781d-4af2-bc1a-861a69586e6b tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 200 len: 1617 microversion: 2.1 time: 0.467940 May 21 21:23:12.977697 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1639/3203] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:12 2022] GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 1617 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:13.227899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c7811c36-c5c3-4e09-84db-8a40e7d0605a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-938182007", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["2402f588-3d04-418d-ac2d-d38d77c92205"]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:13.314268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-324b2668-4d9d-412f-80f0-b96c7965fac6 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:13.335958 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-324b2668-4d9d-412f-80f0-b96c7965fac6 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c" status: 200 len: 1402 microversion: 2.1 time: 0.569907 May 21 21:23:13.337415 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1565/3204] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:12 2022] GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c => generated 1402 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:13.355665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1a912593-f1a1-4d2a-833e-9a163e0aa5b3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:13.358359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1a912593-f1a1-4d2a-833e-9a163e0aa5b3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:13.360171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-c7811c36-c5c3-4e09-84db-8a40e7d0605a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] validate_networks() for None {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:23:13.368943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a912593-f1a1-4d2a-833e-9a163e0aa5b3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:13.369917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a912593-f1a1-4d2a-833e-9a163e0aa5b3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:13.371763 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a912593-f1a1-4d2a-833e-9a163e0aa5b3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:13.372678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a912593-f1a1-4d2a-833e-9a163e0aa5b3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:13.628383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1a912593-f1a1-4d2a-833e-9a163e0aa5b3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:13.643931 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1a912593-f1a1-4d2a-833e-9a163e0aa5b3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1505 microversion: 2.1 time: 0.300862 May 21 21:23:13.645494 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1566/3205] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:13 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1505 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:13.748263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c7811c36-c5c3-4e09-84db-8a40e7d0605a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:23:13.755021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c7811c36-c5c3-4e09-84db-8a40e7d0605a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:23:13.755021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c7811c36-c5c3-4e09-84db-8a40e7d0605a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:23:13.755021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c7811c36-c5c3-4e09-84db-8a40e7d0605a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:23:13.755021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c7811c36-c5c3-4e09-84db-8a40e7d0605a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:23:13.762865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7811c36-c5c3-4e09-84db-8a40e7d0605a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:13.764085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7811c36-c5c3-4e09-84db-8a40e7d0605a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:13.765903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7811c36-c5c3-4e09-84db-8a40e7d0605a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:13.766347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7811c36-c5c3-4e09-84db-8a40e7d0605a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:13.791768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-c7811c36-c5c3-4e09-84db-8a40e7d0605a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:23:13.798401 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-c7811c36-c5c3-4e09-84db-8a40e7d0605a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for user 945ab557c0e24cfdbcab74684a5d5800 and project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:23:13.815086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c7811c36-c5c3-4e09-84db-8a40e7d0605a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:23:13.818937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c7811c36-c5c3-4e09-84db-8a40e7d0605a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:23:14.044892 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c7811c36-c5c3-4e09-84db-8a40e7d0605a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820766 May 21 21:23:14.049076 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1640/3206] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:23:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 21 21:23:14.056435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6e189a8a-de58-4365-94b3-27bc80785966 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:14.063491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6e189a8a-de58-4365-94b3-27bc80785966 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:14.153994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6e189a8a-de58-4365-94b3-27bc80785966 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:14.162048 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6e189a8a-de58-4365-94b3-27bc80785966 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 200 len: 1216 microversion: 2.1 time: 0.109300 May 21 21:23:14.162636 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1567/3207] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:14 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 1216 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:14.353087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-72d18de7-8cda-4564-82ba-b5c4cfa15e8f tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:14.353911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-72d18de7-8cda-4564-82ba-b5c4cfa15e8f tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:14.362974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72d18de7-8cda-4564-82ba-b5c4cfa15e8f tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:14.364136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72d18de7-8cda-4564-82ba-b5c4cfa15e8f tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:14.364701 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72d18de7-8cda-4564-82ba-b5c4cfa15e8f tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:14.365632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72d18de7-8cda-4564-82ba-b5c4cfa15e8f tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:14.601040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-72d18de7-8cda-4564-82ba-b5c4cfa15e8f tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:14.609707 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-72d18de7-8cda-4564-82ba-b5c4cfa15e8f tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c" status: 200 len: 1402 microversion: 2.1 time: 0.260404 May 21 21:23:14.619727 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1641/3208] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:14 2022] GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c => generated 1402 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:14.669205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-344381a6-a0a5-4ba8-9379-a7e1e947b4cd tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:14.669892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-344381a6-a0a5-4ba8-9379-a7e1e947b4cd tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:14.687321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-344381a6-a0a5-4ba8-9379-a7e1e947b4cd tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:14.687783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-344381a6-a0a5-4ba8-9379-a7e1e947b4cd tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:14.688619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-344381a6-a0a5-4ba8-9379-a7e1e947b4cd tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:14.689066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-344381a6-a0a5-4ba8-9379-a7e1e947b4cd tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:14.927348 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-344381a6-a0a5-4ba8-9379-a7e1e947b4cd tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:14.934723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:14.942900 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-344381a6-a0a5-4ba8-9379-a7e1e947b4cd tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1509 microversion: 2.1 time: 0.284333 May 21 21:23:14.943575 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1568/3209] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:14 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1509 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:14.960869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f0fb429f-b1dc-429f-94d3-118a3508aa96 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:14.967054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f0fb429f-b1dc-429f-94d3-118a3508aa96 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:14.967054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.compute.servers [None req-f0fb429f-b1dc-429f-94d3-118a3508aa96 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Removing options 'limit' from query {{(pid=131277) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 21 21:23:14.967054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f0fb429f-b1dc-429f-94d3-118a3508aa96 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Searching by: {'deleted': False, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415'} {{(pid=131277) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:23:14.968080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0fb429f-b1dc-429f-94d3-118a3508aa96 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:14.968726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0fb429f-b1dc-429f-94d3-118a3508aa96 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:14.969692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0fb429f-b1dc-429f-94d3-118a3508aa96 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:14.970287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0fb429f-b1dc-429f-94d3-118a3508aa96 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:14.973300 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f0fb429f-b1dc-429f-94d3-118a3508aa96 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.016253 May 21 21:23:14.974425 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1642/3210] 10.222.0.49 () {58 vars in 1139 bytes} [Sat May 21 21:23:14 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 21 21:23:14.985631 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0ed767ae-7922-4f6c-be56-f0da3d6df811 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:14.986269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0ed767ae-7922-4f6c-be56-f0da3d6df811 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:14.994235 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ed767ae-7922-4f6c-be56-f0da3d6df811 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:14.994701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ed767ae-7922-4f6c-be56-f0da3d6df811 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:14.995492 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ed767ae-7922-4f6c-be56-f0da3d6df811 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:14.996180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ed767ae-7922-4f6c-be56-f0da3d6df811 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:15.170209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-08647c74-9f73-46c6-bc98-ba0daec7518e req-1a59168b-eced-4918-8b7f-1ae9f54243fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35305bf8-3bec-4194-a7a3-73c1b559de0c", "name": "network-vif-plugged", "status": "completed", "tag": "70fc2489-6822-4979-aba0-c2fcf2ea6390"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:15.203867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-08647c74-9f73-46c6-bc98-ba0daec7518e req-1a59168b-eced-4918-8b7f-1ae9f54243fa service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:15.204612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-08647c74-9f73-46c6-bc98-ba0daec7518e req-1a59168b-eced-4918-8b7f-1ae9f54243fa service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:15.214952 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0ed767ae-7922-4f6c-be56-f0da3d6df811 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:15.226919 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0ed767ae-7922-4f6c-be56-f0da3d6df811 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1509 microversion: 2.1 time: 0.244327 May 21 21:23:15.228949 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1569/3211] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:14 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1509 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:15.234670 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-08647c74-9f73-46c6-bc98-ba0daec7518e req-1a59168b-eced-4918-8b7f-1ae9f54243fa service nova] Creating event network-vif-plugged:70fc2489-6822-4979-aba0-c2fcf2ea6390 for instance 35305bf8-3bec-4194-a7a3-73c1b559de0c on nch2-master-1 May 21 21:23:15.243617 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b97b6e49-6b2f-4ad0-b359-c2f8a622a73d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:15.244543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b97b6e49-6b2f-4ad0-b359-c2f8a622a73d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:15.251644 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-08647c74-9f73-46c6-bc98-ba0daec7518e req-1a59168b-eced-4918-8b7f-1ae9f54243fa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085644 May 21 21:23:15.253692 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1643/3212] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:15.275417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b97b6e49-6b2f-4ad0-b359-c2f8a622a73d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:15.279281 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b97b6e49-6b2f-4ad0-b359-c2f8a622a73d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:15.280314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b97b6e49-6b2f-4ad0-b359-c2f8a622a73d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:15.281270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b97b6e49-6b2f-4ad0-b359-c2f8a622a73d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:15.282276 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c615c94d-31e3-4f8f-9218-a3c1a7ab90f1 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:15.285835 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c615c94d-31e3-4f8f-9218-a3c1a7ab90f1 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: e4143810-5eb7-4f74-b8d7-26207617a6a6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:15.321303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c615c94d-31e3-4f8f-9218-a3c1a7ab90f1 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:15.322093 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c615c94d-31e3-4f8f-9218-a3c1a7ab90f1 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:15.325758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c615c94d-31e3-4f8f-9218-a3c1a7ab90f1 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:15.327329 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c615c94d-31e3-4f8f-9218-a3c1a7ab90f1 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:15.483775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b97b6e49-6b2f-4ad0-b359-c2f8a622a73d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:15.528113 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b97b6e49-6b2f-4ad0-b359-c2f8a622a73d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 200 len: 1220 microversion: 2.1 time: 0.297449 May 21 21:23:15.529042 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1570/3213] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:15 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 1220 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:15.629619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-64eae7bd-6df2-45b4-a754-a42f29ddb86c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:15.630827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-64eae7bd-6df2-45b4-a754-a42f29ddb86c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:15.638867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-64eae7bd-6df2-45b4-a754-a42f29ddb86c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:15.642875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c615c94d-31e3-4f8f-9218-a3c1a7ab90f1 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:15.643039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-64eae7bd-6df2-45b4-a754-a42f29ddb86c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:15.643039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-64eae7bd-6df2-45b4-a754-a42f29ddb86c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:15.643039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-64eae7bd-6df2-45b4-a754-a42f29ddb86c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:15.648428 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c615c94d-31e3-4f8f-9218-a3c1a7ab90f1 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/e4143810-5eb7-4f74-b8d7-26207617a6a6" status: 200 len: 1512 microversion: 2.1 time: 0.378099 May 21 21:23:15.649024 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1644/3214] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:15 2022] GET /compute/v2.1/servers/e4143810-5eb7-4f74-b8d7-26207617a6a6 => generated 1512 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:15.693431 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9ef71e68-e974-4897-9400-b6d7af55d219 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:15.700886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9ef71e68-e974-4897-9400-b6d7af55d219 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:15.720728 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ef71e68-e974-4897-9400-b6d7af55d219 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:15.721540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ef71e68-e974-4897-9400-b6d7af55d219 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:15.725942 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ef71e68-e974-4897-9400-b6d7af55d219 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:15.726803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ef71e68-e974-4897-9400-b6d7af55d219 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:15.886638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-64eae7bd-6df2-45b4-a754-a42f29ddb86c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:15.903040 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-64eae7bd-6df2-45b4-a754-a42f29ddb86c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c" status: 200 len: 1402 microversion: 2.1 time: 0.279386 May 21 21:23:15.906397 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1571/3215] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:15 2022] GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c => generated 1402 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:16.046737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9ef71e68-e974-4897-9400-b6d7af55d219 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:16.058068 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9ef71e68-e974-4897-9400-b6d7af55d219 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 200 len: 1511 microversion: 2.1 time: 0.396379 May 21 21:23:16.058656 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1645/3216] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:15 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 1511 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:16.075946 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dba8d39d-f667-4306-9e40-1d9c6884d872 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:16.079657 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dba8d39d-f667-4306-9e40-1d9c6884d872 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:16.080782 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dba8d39d-f667-4306-9e40-1d9c6884d872 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:23:16.291541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dba8d39d-f667-4306-9e40-1d9c6884d872 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:16.291541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dba8d39d-f667-4306-9e40-1d9c6884d872 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:16.291541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dba8d39d-f667-4306-9e40-1d9c6884d872 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:16.291541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dba8d39d-f667-4306-9e40-1d9c6884d872 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:16.334278 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-dba8d39d-f667-4306-9e40-1d9c6884d872 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:23:16.396592 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dba8d39d-f667-4306-9e40-1d9c6884d872 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.324548 May 21 21:23:16.397196 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1572/3217] 10.222.0.49 () {58 vars in 1153 bytes} [Sat May 21 21:23:16 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:16.409566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9e38dfe2-ab9b-43b0-9ff5-68b91eafb2ad tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:16.410196 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9e38dfe2-ab9b-43b0-9ff5-68b91eafb2ad tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:16.416571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e38dfe2-ab9b-43b0-9ff5-68b91eafb2ad tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:16.417036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e38dfe2-ab9b-43b0-9ff5-68b91eafb2ad tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:16.417904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e38dfe2-ab9b-43b0-9ff5-68b91eafb2ad tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:16.418256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e38dfe2-ab9b-43b0-9ff5-68b91eafb2ad tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:16.552345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9c5b3ee2-1b01-4b61-b300-ba70ddd3ec4f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:16.553355 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9c5b3ee2-1b01-4b61-b300-ba70ddd3ec4f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:16.561939 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c5b3ee2-1b01-4b61-b300-ba70ddd3ec4f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:16.562647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c5b3ee2-1b01-4b61-b300-ba70ddd3ec4f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:16.563657 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c5b3ee2-1b01-4b61-b300-ba70ddd3ec4f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:16.564367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c5b3ee2-1b01-4b61-b300-ba70ddd3ec4f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:16.627886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9e38dfe2-ab9b-43b0-9ff5-68b91eafb2ad tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:16.637812 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9e38dfe2-ab9b-43b0-9ff5-68b91eafb2ad tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1509 microversion: 2.1 time: 0.232496 May 21 21:23:16.641538 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1646/3218] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:16 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:16.653733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9c5b3ee2-1b01-4b61-b300-ba70ddd3ec4f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:16.658933 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6d8efa3a-b850-4f87-84d7-d62a485334ad tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:16.659842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6d8efa3a-b850-4f87-84d7-d62a485334ad tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: e4143810-5eb7-4f74-b8d7-26207617a6a6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:16.670975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d8efa3a-b850-4f87-84d7-d62a485334ad tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:16.671336 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9c5b3ee2-1b01-4b61-b300-ba70ddd3ec4f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 200 len: 1268 microversion: 2.1 time: 0.128047 May 21 21:23:16.671460 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d8efa3a-b850-4f87-84d7-d62a485334ad tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:16.672106 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1573/3219] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:16 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 1268 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:16.672223 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d8efa3a-b850-4f87-84d7-d62a485334ad tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:16.672650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d8efa3a-b850-4f87-84d7-d62a485334ad tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:16.925923 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ef783114-094e-4129-83e4-db0472a1c08b tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:16.926567 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ef783114-094e-4129-83e4-db0472a1c08b tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:16.942637 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef783114-094e-4129-83e4-db0472a1c08b tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:16.943107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef783114-094e-4129-83e4-db0472a1c08b tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:16.944071 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef783114-094e-4129-83e4-db0472a1c08b tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:16.944550 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef783114-094e-4129-83e4-db0472a1c08b tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:16.949933 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6d8efa3a-b850-4f87-84d7-d62a485334ad tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:16.978226 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6d8efa3a-b850-4f87-84d7-d62a485334ad tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/e4143810-5eb7-4f74-b8d7-26207617a6a6" status: 200 len: 1512 microversion: 2.1 time: 0.323075 May 21 21:23:16.980617 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1647/3220] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:16 2022] GET /compute/v2.1/servers/e4143810-5eb7-4f74-b8d7-26207617a6a6 => generated 1512 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:16.994559 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-999c4036-ac24-490c-8e53-93f1adc50527 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:16.995809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-999c4036-ac24-490c-8e53-93f1adc50527 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:17.030148 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-999c4036-ac24-490c-8e53-93f1adc50527 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:17.031741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-999c4036-ac24-490c-8e53-93f1adc50527 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:17.040761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-999c4036-ac24-490c-8e53-93f1adc50527 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:17.041528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-999c4036-ac24-490c-8e53-93f1adc50527 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:17.434513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-999c4036-ac24-490c-8e53-93f1adc50527 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:17.454950 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-999c4036-ac24-490c-8e53-93f1adc50527 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 200 len: 1511 microversion: 2.1 time: 0.463684 May 21 21:23:17.457939 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1648/3221] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:16 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 1511 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:17.474187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a1c1643a-85cb-432f-a22c-7b4c24eaa50c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:17.477862 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a1c1643a-85cb-432f-a22c-7b4c24eaa50c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:17.478734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a1c1643a-85cb-432f-a22c-7b4c24eaa50c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Searching by: {'deleted': False, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415'} {{(pid=131277) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:23:17.506738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1c1643a-85cb-432f-a22c-7b4c24eaa50c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:17.507534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1c1643a-85cb-432f-a22c-7b4c24eaa50c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:17.509316 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1c1643a-85cb-432f-a22c-7b4c24eaa50c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:17.509984 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1c1643a-85cb-432f-a22c-7b4c24eaa50c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:17.550815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ef783114-094e-4129-83e4-db0472a1c08b tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:17.559362 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ef783114-094e-4129-83e4-db0472a1c08b tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c" status: 200 len: 1402 microversion: 2.1 time: 0.638481 May 21 21:23:17.560300 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1574/3222] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:16 2022] GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c => generated 1402 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:17.566592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.multi_cell_list [None req-a1c1643a-85cb-432f-a22c-7b4c24eaa50c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131277) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:23:17.626535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a1c1643a-85cb-432f-a22c-7b4c24eaa50c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:17.638426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1c1643a-85cb-432f-a22c-7b4c24eaa50c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:17.639205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1c1643a-85cb-432f-a22c-7b4c24eaa50c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:17.697254 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cf9ce785-a963-4da9-abfc-edf70ad0aa8d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:17.699570 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cf9ce785-a963-4da9-abfc-edf70ad0aa8d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:17.716691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf9ce785-a963-4da9-abfc-edf70ad0aa8d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:17.720773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf9ce785-a963-4da9-abfc-edf70ad0aa8d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:17.720773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf9ce785-a963-4da9-abfc-edf70ad0aa8d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:17.720773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf9ce785-a963-4da9-abfc-edf70ad0aa8d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:17.871171 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cf9ce785-a963-4da9-abfc-edf70ad0aa8d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:17.897882 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cf9ce785-a963-4da9-abfc-edf70ad0aa8d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 200 len: 1274 microversion: 2.1 time: 0.208524 May 21 21:23:17.904045 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1575/3223] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:17 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 1274 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:17.912455 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a1c1643a-85cb-432f-a22c-7b4c24eaa50c tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 0.442798 May 21 21:23:17.913685 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1649/3224] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:23:17 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:17.933043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-57174065-90cb-46ff-8add-4c48705c7ff3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:17.937340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-57174065-90cb-46ff-8add-4c48705c7ff3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:17.938236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-57174065-90cb-46ff-8add-4c48705c7ff3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:23:18.075639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-57174065-90cb-46ff-8add-4c48705c7ff3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:18.077146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-57174065-90cb-46ff-8add-4c48705c7ff3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:18.078222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-57174065-90cb-46ff-8add-4c48705c7ff3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:18.078684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-57174065-90cb-46ff-8add-4c48705c7ff3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:18.123659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-57174065-90cb-46ff-8add-4c48705c7ff3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:23:18.167098 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-57174065-90cb-46ff-8add-4c48705c7ff3 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.236394 May 21 21:23:18.180502 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1576/3225] 10.222.0.49 () {58 vars in 1149 bytes} [Sat May 21 21:23:17 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:18.186690 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e5dd3467-ff77-438f-846c-96ba13eb8f01 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:18.190768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e5dd3467-ff77-438f-846c-96ba13eb8f01 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:18.193847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e5dd3467-ff77-438f-846c-96ba13eb8f01 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415'} {{(pid=131277) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:23:18.201265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5dd3467-ff77-438f-846c-96ba13eb8f01 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:18.202016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5dd3467-ff77-438f-846c-96ba13eb8f01 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:18.203060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5dd3467-ff77-438f-846c-96ba13eb8f01 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:18.203801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5dd3467-ff77-438f-846c-96ba13eb8f01 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:18.324198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.multi_cell_list [None req-e5dd3467-ff77-438f-846c-96ba13eb8f01 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131277) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:23:18.353927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:18.415476 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e5dd3467-ff77-438f-846c-96ba13eb8f01 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.234018 May 21 21:23:18.416995 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1650/3226] 10.222.0.49 () {58 vars in 1211 bytes} [Sat May 21 21:23:18 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:18.430292 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ffb783ee-ce84-4af1-919a-cbbb35f491b0 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:18.436275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ffb783ee-ce84-4af1-919a-cbbb35f491b0 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:18.437372 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ffb783ee-ce84-4af1-919a-cbbb35f491b0 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:23:18.444468 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffb783ee-ce84-4af1-919a-cbbb35f491b0 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:18.445182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffb783ee-ce84-4af1-919a-cbbb35f491b0 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:18.447000 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffb783ee-ce84-4af1-919a-cbbb35f491b0 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:18.447633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffb783ee-ce84-4af1-919a-cbbb35f491b0 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:18.577951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-97836692-5a0b-450e-b200-954051bc50e9 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:18.579206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-97836692-5a0b-450e-b200-954051bc50e9 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:18.602747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-97836692-5a0b-450e-b200-954051bc50e9 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:18.603314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-97836692-5a0b-450e-b200-954051bc50e9 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:18.604104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-97836692-5a0b-450e-b200-954051bc50e9 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:18.604590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-97836692-5a0b-450e-b200-954051bc50e9 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:18.610662 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-ffb783ee-ce84-4af1-919a-cbbb35f491b0 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:23:18.715159 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ffb783ee-ce84-4af1-919a-cbbb35f491b0 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.289154 May 21 21:23:18.715769 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1577/3227] 10.222.0.49 () {58 vars in 1195 bytes} [Sat May 21 21:23:18 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:18.731304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bacb5468-46ae-4f0f-9357-bdad11c7aca2 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:18.746755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bacb5468-46ae-4f0f-9357-bdad11c7aca2 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:18.751213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bacb5468-46ae-4f0f-9357-bdad11c7aca2 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Searching by: {'name': 'e-24390212', 'deleted': False, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:23:18.765970 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bacb5468-46ae-4f0f-9357-bdad11c7aca2 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:18.766436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bacb5468-46ae-4f0f-9357-bdad11c7aca2 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:18.767251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bacb5468-46ae-4f0f-9357-bdad11c7aca2 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:18.767728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bacb5468-46ae-4f0f-9357-bdad11c7aca2 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:18.946959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-bacb5468-46ae-4f0f-9357-bdad11c7aca2 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:23:18.975946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-97836692-5a0b-450e-b200-954051bc50e9 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:18.993769 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-97836692-5a0b-450e-b200-954051bc50e9 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c" status: 200 len: 1590 microversion: 2.1 time: 0.420645 May 21 21:23:19.004686 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1651/3228] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:18 2022] GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c => generated 1590 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:19.008580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7d31bff6-9485-4819-8728-0c7dbd1e7a6e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:19.008580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7d31bff6-9485-4819-8728-0c7dbd1e7a6e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:19.030205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7d31bff6-9485-4819-8728-0c7dbd1e7a6e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:19.033218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7d31bff6-9485-4819-8728-0c7dbd1e7a6e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:19.037716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7d31bff6-9485-4819-8728-0c7dbd1e7a6e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:19.038627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7d31bff6-9485-4819-8728-0c7dbd1e7a6e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:19.106485 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bacb5468-46ae-4f0f-9357-bdad11c7aca2 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers?name=e-24390212" status: 200 len: 344 microversion: 2.1 time: 0.383449 May 21 21:23:19.116212 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1578/3229] 10.222.0.49 () {58 vars in 1155 bytes} [Sat May 21 21:23:18 2022] GET /compute/v2.1/servers?name=e-24390212 => generated 344 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:19.117558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d2c47138-bc07-4d4d-872f-03fb1e41b61a tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:19.119199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d2c47138-bc07-4d4d-872f-03fb1e41b61a tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:19.126021 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2c47138-bc07-4d4d-872f-03fb1e41b61a tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:19.127229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2c47138-bc07-4d4d-872f-03fb1e41b61a tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:19.127775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2c47138-bc07-4d4d-872f-03fb1e41b61a tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:19.128224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2c47138-bc07-4d4d-872f-03fb1e41b61a tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:19.924553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7d31bff6-9485-4819-8728-0c7dbd1e7a6e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:19.939276 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7d31bff6-9485-4819-8728-0c7dbd1e7a6e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 200 len: 1316 microversion: 2.1 time: 0.940287 May 21 21:23:19.943492 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1652/3230] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:18 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 1316 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:19.965386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-960f61b7-9596-46f3-a757-82a8c11b865b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:19.969327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-960f61b7-9596-46f3-a757-82a8c11b865b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:19.971365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-960f61b7-9596-46f3-a757-82a8c11b865b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415'} {{(pid=131277) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:23:19.995643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-960f61b7-9596-46f3-a757-82a8c11b865b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:19.996103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-960f61b7-9596-46f3-a757-82a8c11b865b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:19.997214 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-960f61b7-9596-46f3-a757-82a8c11b865b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:19.997660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-960f61b7-9596-46f3-a757-82a8c11b865b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:20.056244 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d2c47138-bc07-4d4d-872f-03fb1e41b61a tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.947893 May 21 21:23:20.056899 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1579/3231] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 21:23:19 2022] GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c/os-interface => generated 285 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:20.194440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.multi_cell_list [None req-960f61b7-9596-46f3-a757-82a8c11b865b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131277) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:23:20.328698 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-960f61b7-9596-46f3-a757-82a8c11b865b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.369509 May 21 21:23:20.342362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d16a91cf-f40b-4675-a184-cdf2b55f547b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:20.347127 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1653/3232] 10.222.0.49 () {58 vars in 1153 bytes} [Sat May 21 21:23:19 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:20.352659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d16a91cf-f40b-4675-a184-cdf2b55f547b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:20.353494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d16a91cf-f40b-4675-a184-cdf2b55f547b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-2439021', 'deleted': False, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:23:20.360575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d16a91cf-f40b-4675-a184-cdf2b55f547b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:20.360575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d16a91cf-f40b-4675-a184-cdf2b55f547b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:20.361548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d16a91cf-f40b-4675-a184-cdf2b55f547b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:20.362334 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d16a91cf-f40b-4675-a184-cdf2b55f547b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:20.493294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-d16a91cf-f40b-4675-a184-cdf2b55f547b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:23:20.618110 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d16a91cf-f40b-4675-a184-cdf2b55f547b tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-2439021" status: 200 len: 344 microversion: 2.1 time: 0.280423 May 21 21:23:20.618893 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1580/3233] 10.222.0.49 () {58 vars in 1223 bytes} [Sat May 21 21:23:20 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-2439021 => generated 344 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:20.631313 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-679ae9c4-6d3b-4f15-8575-3d3ecf07b061 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:20.632577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-679ae9c4-6d3b-4f15-8575-3d3ecf07b061 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:20.640498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-679ae9c4-6d3b-4f15-8575-3d3ecf07b061 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:20.646628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-679ae9c4-6d3b-4f15-8575-3d3ecf07b061 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:20.646628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-679ae9c4-6d3b-4f15-8575-3d3ecf07b061 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:20.646628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-679ae9c4-6d3b-4f15-8575-3d3ecf07b061 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:20.701394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-679ae9c4-6d3b-4f15-8575-3d3ecf07b061 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:23:20.959749 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-56a5b555-7f79-43bd-8843-ff60c1fdd76d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:20.962239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-56a5b555-7f79-43bd-8843-ff60c1fdd76d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:20.977945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-56a5b555-7f79-43bd-8843-ff60c1fdd76d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:20.979464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-56a5b555-7f79-43bd-8843-ff60c1fdd76d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:20.980598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-56a5b555-7f79-43bd-8843-ff60c1fdd76d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:20.981300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-56a5b555-7f79-43bd-8843-ff60c1fdd76d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:21.138607 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-679ae9c4-6d3b-4f15-8575-3d3ecf07b061 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "DELETE /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 204 len: 0 microversion: 2.1 time: 0.511093 May 21 21:23:21.144345 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1654/3234] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:23:20 2022] DELETE /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:23:21.151993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-87399e94-b256-431e-93be-45a8c18e812a req-c1159a33-00fe-492f-a755-0b9b7a6785d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04839e2c-b4fa-4be9-87b8-f4f1e659845c", "tag": "7b2d1ca3-2cd7-4434-a690-f053be2de6aa"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:21.179488 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-87399e94-b256-431e-93be-45a8c18e812a req-c1159a33-00fe-492f-a755-0b9b7a6785d2 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:21.180228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-87399e94-b256-431e-93be-45a8c18e812a req-c1159a33-00fe-492f-a755-0b9b7a6785d2 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:21.233112 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-87399e94-b256-431e-93be-45a8c18e812a req-c1159a33-00fe-492f-a755-0b9b7a6785d2 service nova] Creating event network-changed:7b2d1ca3-2cd7-4434-a690-f053be2de6aa for instance 04839e2c-b4fa-4be9-87b8-f4f1e659845c on nch2-master-1 May 21 21:23:21.244526 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-87399e94-b256-431e-93be-45a8c18e812a req-c1159a33-00fe-492f-a755-0b9b7a6785d2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098017 May 21 21:23:21.245147 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1655/3235] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:21.303397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4071b10b-f78f-4d05-a205-60d8f0b72343 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:21.303397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4071b10b-f78f-4d05-a205-60d8f0b72343 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:21.303397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4071b10b-f78f-4d05-a205-60d8f0b72343 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:21.303397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4071b10b-f78f-4d05-a205-60d8f0b72343 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:21.303397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4071b10b-f78f-4d05-a205-60d8f0b72343 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:21.303397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4071b10b-f78f-4d05-a205-60d8f0b72343 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:21.365445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-56a5b555-7f79-43bd-8843-ff60c1fdd76d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:21.374898 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-56a5b555-7f79-43bd-8843-ff60c1fdd76d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 200 len: 1316 microversion: 2.1 time: 0.419489 May 21 21:23:21.376039 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1581/3236] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:20 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:21.687927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4071b10b-f78f-4d05-a205-60d8f0b72343 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:21.696430 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4071b10b-f78f-4d05-a205-60d8f0b72343 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 200 len: 1517 microversion: 2.1 time: 0.450062 May 21 21:23:21.709777 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1656/3237] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:21 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 1517 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:22.394245 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c16966d9-df5d-4d8f-b10a-1253bdbe5a92 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:22.394872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c16966d9-df5d-4d8f-b10a-1253bdbe5a92 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:22.401623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c16966d9-df5d-4d8f-b10a-1253bdbe5a92 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:22.402075 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c16966d9-df5d-4d8f-b10a-1253bdbe5a92 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:22.402849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c16966d9-df5d-4d8f-b10a-1253bdbe5a92 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:22.403290 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c16966d9-df5d-4d8f-b10a-1253bdbe5a92 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:22.508269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8820b055-f9af-46c6-91ae-5cbe7a588aa8 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:22.516961 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8820b055-f9af-46c6-91ae-5cbe7a588aa8 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:22.517530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8820b055-f9af-46c6-91ae-5cbe7a588aa8 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:22.517975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8820b055-f9af-46c6-91ae-5cbe7a588aa8 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:22.518847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8820b055-f9af-46c6-91ae-5cbe7a588aa8 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:22.519367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8820b055-f9af-46c6-91ae-5cbe7a588aa8 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:22.727831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8820b055-f9af-46c6-91ae-5cbe7a588aa8 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:22.741033 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8820b055-f9af-46c6-91ae-5cbe7a588aa8 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c" status: 200 len: 1590 microversion: 2.1 time: 0.236878 May 21 21:23:22.742757 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1657/3238] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:22 2022] GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c => generated 1590 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:22.755785 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f3f72cbc-1cf2-456c-a9f2-fe629c023fc1 req-b9004955-b082-4c30-a0fd-3398240d8d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35305bf8-3bec-4194-a7a3-73c1b559de0c", "tag": "70fc2489-6822-4979-aba0-c2fcf2ea6390"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:22.761484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f3f72cbc-1cf2-456c-a9f2-fe629c023fc1 req-b9004955-b082-4c30-a0fd-3398240d8d14 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:22.762046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f3f72cbc-1cf2-456c-a9f2-fe629c023fc1 req-b9004955-b082-4c30-a0fd-3398240d8d14 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:22.766404 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c16966d9-df5d-4d8f-b10a-1253bdbe5a92 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:22.775568 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c16966d9-df5d-4d8f-b10a-1253bdbe5a92 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 200 len: 1316 microversion: 2.1 time: 0.385230 May 21 21:23:22.778336 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1582/3239] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:22 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 1316 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:22.778824 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f3f72cbc-1cf2-456c-a9f2-fe629c023fc1 req-b9004955-b082-4c30-a0fd-3398240d8d14 service nova] Creating event network-changed:70fc2489-6822-4979-aba0-c2fcf2ea6390 for instance 35305bf8-3bec-4194-a7a3-73c1b559de0c on nch2-master-1 May 21 21:23:22.792474 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f3f72cbc-1cf2-456c-a9f2-fe629c023fc1 req-b9004955-b082-4c30-a0fd-3398240d8d14 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040763 May 21 21:23:22.792474 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1658/3240] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:22.793837 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b7b4ce74-640b-4c36-815a-b300c65618df tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:22.794683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b7b4ce74-640b-4c36-815a-b300c65618df tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:22.812553 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b7b4ce74-640b-4c36-815a-b300c65618df tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:22.813936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b7b4ce74-640b-4c36-815a-b300c65618df tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:22.815344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b7b4ce74-640b-4c36-815a-b300c65618df tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:22.815855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b7b4ce74-640b-4c36-815a-b300c65618df tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:23.287565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e79f5cf4-3b62-4161-b145-b4c253f531cc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:23.288855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e79f5cf4-3b62-4161-b145-b4c253f531cc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:23.298416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e79f5cf4-3b62-4161-b145-b4c253f531cc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:23.302021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e79f5cf4-3b62-4161-b145-b4c253f531cc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:23.305289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e79f5cf4-3b62-4161-b145-b4c253f531cc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:23.305968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e79f5cf4-3b62-4161-b145-b4c253f531cc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:23.313648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b7b4ce74-640b-4c36-815a-b300c65618df tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:23.321994 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b7b4ce74-640b-4c36-815a-b300c65618df tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 200 len: 1517 microversion: 2.1 time: 0.542214 May 21 21:23:23.332535 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1583/3241] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:22 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 1517 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:23.535893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e79f5cf4-3b62-4161-b145-b4c253f531cc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:23.544009 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e79f5cf4-3b62-4161-b145-b4c253f531cc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.261819 May 21 21:23:23.544591 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1659/3242] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:23 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:23.565194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c9ab4cd3-5cac-46ad-9584-70edb29ebc7c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-18592472"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:23.567134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c9ab4cd3-5cac-46ad-9584-70edb29ebc7c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:23.575768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9ab4cd3-5cac-46ad-9584-70edb29ebc7c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:23.576430 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9ab4cd3-5cac-46ad-9584-70edb29ebc7c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:23.577728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9ab4cd3-5cac-46ad-9584-70edb29ebc7c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:23.578098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9ab4cd3-5cac-46ad-9584-70edb29ebc7c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:23.615270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:23.800721 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0a1a29ff-cb61-445b-b173-df449ad13a61 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:23.801378 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0a1a29ff-cb61-445b-b173-df449ad13a61 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:23.816931 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a1a29ff-cb61-445b-b173-df449ad13a61 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:23.819420 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a1a29ff-cb61-445b-b173-df449ad13a61 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:23.819420 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a1a29ff-cb61-445b-b173-df449ad13a61 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:23.819420 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a1a29ff-cb61-445b-b173-df449ad13a61 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:24.046905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0a1a29ff-cb61-445b-b173-df449ad13a61 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:24.056789 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0a1a29ff-cb61-445b-b173-df449ad13a61 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 200 len: 1316 microversion: 2.1 time: 0.260529 May 21 21:23:24.057462 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1660/3243] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:23 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 1316 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:24.159542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:24.275714 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c9ab4cd3-5cac-46ad-9584-70edb29ebc7c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action" status: 202 len: 0 microversion: 2.1 time: 0.716238 May 21 21:23:24.276520 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1584/3244] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:23:23 2022] POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action => generated 0 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 21 21:23:24.340455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d3b97206-05ec-480f-a9a2-258652ed0f29 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:24.341069 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d3b97206-05ec-480f-a9a2-258652ed0f29 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:24.350622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3b97206-05ec-480f-a9a2-258652ed0f29 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:24.351242 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3b97206-05ec-480f-a9a2-258652ed0f29 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:24.352381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3b97206-05ec-480f-a9a2-258652ed0f29 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:24.352974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3b97206-05ec-480f-a9a2-258652ed0f29 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:24.388190 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3b97206-05ec-480f-a9a2-258652ed0f29 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:24.388659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3b97206-05ec-480f-a9a2-258652ed0f29 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:24.389120 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-d3b97206-05ec-480f-a9a2-258652ed0f29 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lazy-loading 'fault' on Instance uuid 718c5e70-0e1a-4143-95e2-4741be1b87a0 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:23:24.438007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d3b97206-05ec-480f-a9a2-258652ed0f29 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:24.447586 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d3b97206-05ec-480f-a9a2-258652ed0f29 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 200 len: 1311 microversion: 2.1 time: 0.111976 May 21 21:23:24.448178 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1661/3245] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:24 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 1311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:24.802587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-aa01273f-3258-4d52-9718-ce618368671e req-29c1ecdd-9c4d-4bf3-8b53-f4dc07572e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "718c5e70-0e1a-4143-95e2-4741be1b87a0", "name": "network-vif-deleted", "tag": "5b53c0fa-b4bf-4fc9-9315-4fe022a5be6d"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:24.812113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-aa01273f-3258-4d52-9718-ce618368671e req-29c1ecdd-9c4d-4bf3-8b53-f4dc07572e47 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:24.812908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-aa01273f-3258-4d52-9718-ce618368671e req-29c1ecdd-9c4d-4bf3-8b53-f4dc07572e47 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:24.825095 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-aa01273f-3258-4d52-9718-ce618368671e req-29c1ecdd-9c4d-4bf3-8b53-f4dc07572e47 service nova] Creating event network-vif-deleted:5b53c0fa-b4bf-4fc9-9315-4fe022a5be6d for instance 718c5e70-0e1a-4143-95e2-4741be1b87a0 on nch2-master-1 May 21 21:23:24.830449 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-aa01273f-3258-4d52-9718-ce618368671e req-29c1ecdd-9c4d-4bf3-8b53-f4dc07572e47 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033464 May 21 21:23:24.831925 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1585/3246] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:25.074599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8153dfee-38a6-4e29-9174-72264ffba952 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:25.075740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8153dfee-38a6-4e29-9174-72264ffba952 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:25.084719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8153dfee-38a6-4e29-9174-72264ffba952 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:25.084719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8153dfee-38a6-4e29-9174-72264ffba952 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:25.085387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8153dfee-38a6-4e29-9174-72264ffba952 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:25.085837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8153dfee-38a6-4e29-9174-72264ffba952 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:25.246373 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8153dfee-38a6-4e29-9174-72264ffba952 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:25.255250 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8153dfee-38a6-4e29-9174-72264ffba952 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 200 len: 1316 microversion: 2.1 time: 0.184579 May 21 21:23:25.255827 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1662/3247] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:25 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:25.466204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5f68d2d4-0325-4513-9a84-f91f640867d5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:25.467032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5f68d2d4-0325-4513-9a84-f91f640867d5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 718c5e70-0e1a-4143-95e2-4741be1b87a0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:25.474150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5f68d2d4-0325-4513-9a84-f91f640867d5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:25.474610 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5f68d2d4-0325-4513-9a84-f91f640867d5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:25.475394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5f68d2d4-0325-4513-9a84-f91f640867d5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:25.475839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5f68d2d4-0325-4513-9a84-f91f640867d5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:25.490251 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-5f68d2d4-0325-4513-9a84-f91f640867d5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] HTTP exception thrown: Instance 718c5e70-0e1a-4143-95e2-4741be1b87a0 could not be found. May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5f68d2d4-0325-4513-9a84-f91f640867d5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Request method failure captured: May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 HTTP/1.1 May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVgGdb9GcsLGUQ9DGRl6MqBH1Nj_k1DWznkzQcqxhBYLMwsssmq-b-eQ09MWEPGa7Ya8k26Z3wvjfxT2AIVH9_V0cUFAqr5jpX39CFPt-PzIuoqaAv2rEDln6o6JzPhF9dvcC_x-YR9-RbSAZmcr0UaeTc_4arXa8JB_J2INlYbxOWM May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: c10e7136b9a5458f8370f7c4e4798415 May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ListServerFiltersTestJSON-116477851 May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c10e7136b9a5458f8370f7c4e4798415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c10e7136b9a5458f8370f7c4e4798415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c10e7136b9a5458f8370f7c4e4798415", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c10e7136b9a5458f8370f7c4e4798415"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ListServerFiltersTestJSON-116477851 May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: c10e7136b9a5458f8370f7c4e4798415 May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-116477851 May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ListServerFiltersTestJSON-116477851-project May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 043d150ebd3548cc9afb4064fc0f2520 May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ListServerFiltersTestJSON-116477851-project May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 718c5e70-0e1a-4143-95e2-4741be1b87a0 could not be found. May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '718c5e70-0e1a-4143-95e2-4741be1b87a0'} May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 718c5e70-0e1a-4143-95e2-4741be1b87a0 could not be found. May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 718c5e70-0e1a-4143-95e2-4741be1b87a0 could not be found. May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:23:25.491857 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:23:25.499982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:23:25.499982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:23:25.499982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:23:25.499982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:23:25.499982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:23:25.499982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 718c5e70-0e1a-4143-95e2-4741be1b87a0 could not be found. May 21 21:23:25.499982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:23:25.499982 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5f68d2d4-0325-4513-9a84-f91f640867d5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Returning 404 to user: Instance 718c5e70-0e1a-4143-95e2-4741be1b87a0 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:23:25.499982 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5f68d2d4-0325-4513-9a84-f91f640867d5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0" status: 404 len: 111 microversion: 2.1 time: 0.031831 May 21 21:23:25.499982 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1586/3248] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:25 2022] GET /compute/v2.1/servers/718c5e70-0e1a-4143-95e2-4741be1b87a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:23:25.506732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-404caaed-fb05-4bd2-be46-067c236037dc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:25.511710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-404caaed-fb05-4bd2-be46-067c236037dc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: e4143810-5eb7-4f74-b8d7-26207617a6a6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:25.513840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-404caaed-fb05-4bd2-be46-067c236037dc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:25.514291 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-404caaed-fb05-4bd2-be46-067c236037dc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:25.515067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-404caaed-fb05-4bd2-be46-067c236037dc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:25.515502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-404caaed-fb05-4bd2-be46-067c236037dc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:25.542557 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-404caaed-fb05-4bd2-be46-067c236037dc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: e4143810-5eb7-4f74-b8d7-26207617a6a6] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:23:25.985730 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-404caaed-fb05-4bd2-be46-067c236037dc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e4143810-5eb7-4f74-b8d7-26207617a6a6" status: 204 len: 0 microversion: 2.1 time: 0.482882 May 21 21:23:25.986916 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1663/3249] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:23:25 2022] DELETE /compute/v2.1/servers/e4143810-5eb7-4f74-b8d7-26207617a6a6 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:23:25.995202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-17e599d8-08ef-443a-a770-a408c3c26c76 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:25.995822 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-17e599d8-08ef-443a-a770-a408c3c26c76 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: e4143810-5eb7-4f74-b8d7-26207617a6a6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:26.003613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17e599d8-08ef-443a-a770-a408c3c26c76 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:26.004064 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17e599d8-08ef-443a-a770-a408c3c26c76 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:26.004865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17e599d8-08ef-443a-a770-a408c3c26c76 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:26.005310 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17e599d8-08ef-443a-a770-a408c3c26c76 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:26.157241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-17e599d8-08ef-443a-a770-a408c3c26c76 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:26.165681 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-17e599d8-08ef-443a-a770-a408c3c26c76 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/e4143810-5eb7-4f74-b8d7-26207617a6a6" status: 200 len: 1518 microversion: 2.1 time: 0.174571 May 21 21:23:26.166267 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1587/3250] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:25 2022] GET /compute/v2.1/servers/e4143810-5eb7-4f74-b8d7-26207617a6a6 => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:26.273667 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0e0d77d8-1a1f-47dc-98da-7615517ff0b1 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:26.274729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0e0d77d8-1a1f-47dc-98da-7615517ff0b1 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:26.284833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e0d77d8-1a1f-47dc-98da-7615517ff0b1 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:26.285290 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e0d77d8-1a1f-47dc-98da-7615517ff0b1 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:26.286075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e0d77d8-1a1f-47dc-98da-7615517ff0b1 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:26.286508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e0d77d8-1a1f-47dc-98da-7615517ff0b1 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:26.840127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0e0d77d8-1a1f-47dc-98da-7615517ff0b1 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:26.842517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:26.849045 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0e0d77d8-1a1f-47dc-98da-7615517ff0b1 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 200 len: 1316 microversion: 2.1 time: 0.580416 May 21 21:23:26.849632 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1664/3251] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:26 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 1316 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:27.183442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6d75176b-e03a-4be8-9d5f-676336f025fc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:27.184892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6d75176b-e03a-4be8-9d5f-676336f025fc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: e4143810-5eb7-4f74-b8d7-26207617a6a6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:27.192806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d75176b-e03a-4be8-9d5f-676336f025fc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:27.193490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d75176b-e03a-4be8-9d5f-676336f025fc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:27.194526 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d75176b-e03a-4be8-9d5f-676336f025fc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:27.195076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d75176b-e03a-4be8-9d5f-676336f025fc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:27.351558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-c38a5b94-53e2-49ae-9d56-feab150a2d27 req-dfb3ca8f-47fb-43c3-959d-aac27963f78f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168c8024-2cb4-4135-be5d-7a5cfcc6e895", "name": "network-vif-unplugged", "status": "completed", "tag": "fcc08185-a786-4b24-9deb-2bfaacaf7c9b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:27.366200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6d75176b-e03a-4be8-9d5f-676336f025fc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:27.373404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c38a5b94-53e2-49ae-9d56-feab150a2d27 req-dfb3ca8f-47fb-43c3-959d-aac27963f78f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:27.374701 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c38a5b94-53e2-49ae-9d56-feab150a2d27 req-dfb3ca8f-47fb-43c3-959d-aac27963f78f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:27.385008 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6d75176b-e03a-4be8-9d5f-676336f025fc tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/e4143810-5eb7-4f74-b8d7-26207617a6a6" status: 200 len: 1518 microversion: 2.1 time: 0.205670 May 21 21:23:27.387316 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1588/3252] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:27 2022] GET /compute/v2.1/servers/e4143810-5eb7-4f74-b8d7-26207617a6a6 => generated 1518 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:27.395770 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-c38a5b94-53e2-49ae-9d56-feab150a2d27 req-dfb3ca8f-47fb-43c3-959d-aac27963f78f service nova] Creating event network-vif-unplugged:fcc08185-a786-4b24-9deb-2bfaacaf7c9b for instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 on nch1-master-1 May 21 21:23:27.401877 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-c38a5b94-53e2-49ae-9d56-feab150a2d27 req-dfb3ca8f-47fb-43c3-959d-aac27963f78f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058317 May 21 21:23:27.402658 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1665/3253] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:27.865715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e20d78c4-98bb-4c4f-83d5-3e0f44edceea tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:27.866384 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e20d78c4-98bb-4c4f-83d5-3e0f44edceea tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:27.873162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e20d78c4-98bb-4c4f-83d5-3e0f44edceea tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:27.875592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e20d78c4-98bb-4c4f-83d5-3e0f44edceea tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:27.875592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e20d78c4-98bb-4c4f-83d5-3e0f44edceea tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:27.875592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e20d78c4-98bb-4c4f-83d5-3e0f44edceea tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:28.404375 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cca0554d-bd2e-4060-9560-0118e48783c5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:28.407598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cca0554d-bd2e-4060-9560-0118e48783c5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: e4143810-5eb7-4f74-b8d7-26207617a6a6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:28.408958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=8 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:28.418513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cca0554d-bd2e-4060-9560-0118e48783c5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:28.419195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cca0554d-bd2e-4060-9560-0118e48783c5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:28.420172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cca0554d-bd2e-4060-9560-0118e48783c5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:28.420788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cca0554d-bd2e-4060-9560-0118e48783c5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:28.428184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e20d78c4-98bb-4c4f-83d5-3e0f44edceea tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:28.448175 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e20d78c4-98bb-4c4f-83d5-3e0f44edceea tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 200 len: 1316 microversion: 2.1 time: 0.575850 May 21 21:23:28.448175 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1589/3254] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:27 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 1316 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:28.700440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cca0554d-bd2e-4060-9560-0118e48783c5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:28.708903 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cca0554d-bd2e-4060-9560-0118e48783c5 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/e4143810-5eb7-4f74-b8d7-26207617a6a6" status: 200 len: 1518 microversion: 2.1 time: 0.309669 May 21 21:23:28.709662 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1666/3255] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:28 2022] GET /compute/v2.1/servers/e4143810-5eb7-4f74-b8d7-26207617a6a6 => generated 1518 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:29.065003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-9fddfb81-ed21-4d98-a125-996b81279cf4 req-220d67d7-7905-4509-9424-3ef0ec7655a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4143810-5eb7-4f74-b8d7-26207617a6a6", "name": "network-vif-deleted", "tag": "b2a5ce56-811a-45c9-b326-7daf516d5141"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:29.081922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:29.085571 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9fddfb81-ed21-4d98-a125-996b81279cf4 req-220d67d7-7905-4509-9424-3ef0ec7655a5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:29.089281 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9fddfb81-ed21-4d98-a125-996b81279cf4 req-220d67d7-7905-4509-9424-3ef0ec7655a5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:29.130872 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-9fddfb81-ed21-4d98-a125-996b81279cf4 req-220d67d7-7905-4509-9424-3ef0ec7655a5 service nova] Creating event network-vif-deleted:b2a5ce56-811a-45c9-b326-7daf516d5141 for instance e4143810-5eb7-4f74-b8d7-26207617a6a6 on nch2-master-1 May 21 21:23:29.138078 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-9fddfb81-ed21-4d98-a125-996b81279cf4 req-220d67d7-7905-4509-9424-3ef0ec7655a5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086889 May 21 21:23:29.139296 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1590/3256] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:29.456904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-35fa24b1-5c87-4879-b318-e5904c823fc8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:29.458220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-35fa24b1-5c87-4879-b318-e5904c823fc8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:29.465825 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35fa24b1-5c87-4879-b318-e5904c823fc8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:29.466511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35fa24b1-5c87-4879-b318-e5904c823fc8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:29.467298 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35fa24b1-5c87-4879-b318-e5904c823fc8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:29.467736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35fa24b1-5c87-4879-b318-e5904c823fc8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:29.656946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-35fa24b1-5c87-4879-b318-e5904c823fc8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:29.666535 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-35fa24b1-5c87-4879-b318-e5904c823fc8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 200 len: 1316 microversion: 2.1 time: 0.215372 May 21 21:23:29.667137 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1667/3257] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:29 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:29.727440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-66fd3c60-02a4-4bd0-9565-672bc4f112c7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:29.728171 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-66fd3c60-02a4-4bd0-9565-672bc4f112c7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: e4143810-5eb7-4f74-b8d7-26207617a6a6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:29.735722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66fd3c60-02a4-4bd0-9565-672bc4f112c7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:29.737031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66fd3c60-02a4-4bd0-9565-672bc4f112c7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:29.737894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66fd3c60-02a4-4bd0-9565-672bc4f112c7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:29.738585 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66fd3c60-02a4-4bd0-9565-672bc4f112c7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:29.773762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66fd3c60-02a4-4bd0-9565-672bc4f112c7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:29.774217 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66fd3c60-02a4-4bd0-9565-672bc4f112c7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:29.774862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-66fd3c60-02a4-4bd0-9565-672bc4f112c7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lazy-loading 'fault' on Instance uuid e4143810-5eb7-4f74-b8d7-26207617a6a6 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:23:29.797046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-68788155-df5e-4daf-99bd-fb3aebef0629 req-34822869-6b45-45c7-b6b7-0c03a105cd12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168c8024-2cb4-4135-be5d-7a5cfcc6e895", "name": "network-vif-plugged", "status": "completed", "tag": "fcc08185-a786-4b24-9deb-2bfaacaf7c9b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:29.807169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-68788155-df5e-4daf-99bd-fb3aebef0629 req-34822869-6b45-45c7-b6b7-0c03a105cd12 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:29.807918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-68788155-df5e-4daf-99bd-fb3aebef0629 req-34822869-6b45-45c7-b6b7-0c03a105cd12 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:29.842720 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-68788155-df5e-4daf-99bd-fb3aebef0629 req-34822869-6b45-45c7-b6b7-0c03a105cd12 service nova] Creating event network-vif-plugged:fcc08185-a786-4b24-9deb-2bfaacaf7c9b for instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 on nch1-master-1 May 21 21:23:29.854959 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-68788155-df5e-4daf-99bd-fb3aebef0629 req-34822869-6b45-45c7-b6b7-0c03a105cd12 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061622 May 21 21:23:29.856260 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1668/3258] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:23:29.959338 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-66fd3c60-02a4-4bd0-9565-672bc4f112c7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:29.975037 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-66fd3c60-02a4-4bd0-9565-672bc4f112c7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/e4143810-5eb7-4f74-b8d7-26207617a6a6" status: 200 len: 1311 microversion: 2.1 time: 0.252128 May 21 21:23:29.976377 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1591/3259] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:29 2022] GET /compute/v2.1/servers/e4143810-5eb7-4f74-b8d7-26207617a6a6 => generated 1311 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:30.686099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=10 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:30.693264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-61ec1b6c-7036-45be-81f3-cf115b1b442f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:30.694215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-61ec1b6c-7036-45be-81f3-cf115b1b442f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:30.702342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61ec1b6c-7036-45be-81f3-cf115b1b442f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:30.702799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61ec1b6c-7036-45be-81f3-cf115b1b442f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:30.703572 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61ec1b6c-7036-45be-81f3-cf115b1b442f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:30.704171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61ec1b6c-7036-45be-81f3-cf115b1b442f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:30.995650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-20a24679-7b75-449f-a393-ecd536b0adf1 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:30.997438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-20a24679-7b75-449f-a393-ecd536b0adf1 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: e4143810-5eb7-4f74-b8d7-26207617a6a6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:31.000176 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=10 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:31.008592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20a24679-7b75-449f-a393-ecd536b0adf1 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:31.009280 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20a24679-7b75-449f-a393-ecd536b0adf1 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:31.010586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20a24679-7b75-449f-a393-ecd536b0adf1 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:31.011225 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20a24679-7b75-449f-a393-ecd536b0adf1 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:31.032927 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-20a24679-7b75-449f-a393-ecd536b0adf1 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] HTTP exception thrown: Instance e4143810-5eb7-4f74-b8d7-26207617a6a6 could not be found. May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-20a24679-7b75-449f-a393-ecd536b0adf1 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Request method failure captured: May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/e4143810-5eb7-4f74-b8d7-26207617a6a6 HTTP/1.1 May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVgGdb9GcsLGUQ9DGRl6MqBH1Nj_k1DWznkzQcqxhBYLMwsssmq-b-eQ09MWEPGa7Ya8k26Z3wvjfxT2AIVH9_V0cUFAqr5jpX39CFPt-PzIuoqaAv2rEDln6o6JzPhF9dvcC_x-YR9-RbSAZmcr0UaeTc_4arXa8JB_J2INlYbxOWM May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: c10e7136b9a5458f8370f7c4e4798415 May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ListServerFiltersTestJSON-116477851 May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c10e7136b9a5458f8370f7c4e4798415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c10e7136b9a5458f8370f7c4e4798415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c10e7136b9a5458f8370f7c4e4798415", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c10e7136b9a5458f8370f7c4e4798415"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ListServerFiltersTestJSON-116477851 May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: c10e7136b9a5458f8370f7c4e4798415 May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-116477851 May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ListServerFiltersTestJSON-116477851-project May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 043d150ebd3548cc9afb4064fc0f2520 May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ListServerFiltersTestJSON-116477851-project May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance e4143810-5eb7-4f74-b8d7-26207617a6a6 could not be found. May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'e4143810-5eb7-4f74-b8d7-26207617a6a6'} May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4143810-5eb7-4f74-b8d7-26207617a6a6 could not be found. May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4143810-5eb7-4f74-b8d7-26207617a6a6 could not be found. May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:23:31.034939 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:23:31.040248 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:23:31.040248 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:23:31.040248 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:23:31.040248 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:23:31.040248 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:23:31.040248 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4143810-5eb7-4f74-b8d7-26207617a6a6 could not be found. May 21 21:23:31.040248 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:23:31.040248 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-20a24679-7b75-449f-a393-ecd536b0adf1 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Returning 404 to user: Instance e4143810-5eb7-4f74-b8d7-26207617a6a6 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:23:31.040248 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-20a24679-7b75-449f-a393-ecd536b0adf1 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/e4143810-5eb7-4f74-b8d7-26207617a6a6" status: 404 len: 111 microversion: 2.1 time: 0.045964 May 21 21:23:31.044526 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1592/3260] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:30 2022] GET /compute/v2.1/servers/e4143810-5eb7-4f74-b8d7-26207617a6a6 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:23:31.050772 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3142d41a-155a-411b-af53-2e9840079100 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:31.051285 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3142d41a-155a-411b-af53-2e9840079100 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:31.058607 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3142d41a-155a-411b-af53-2e9840079100 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:31.059330 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3142d41a-155a-411b-af53-2e9840079100 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:31.060533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3142d41a-155a-411b-af53-2e9840079100 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:31.061144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3142d41a-155a-411b-af53-2e9840079100 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:31.105675 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3142d41a-155a-411b-af53-2e9840079100 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:23:31.222315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-61ec1b6c-7036-45be-81f3-cf115b1b442f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:31.234112 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-61ec1b6c-7036-45be-81f3-cf115b1b442f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 200 len: 1316 microversion: 2.1 time: 0.546834 May 21 21:23:31.235370 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1669/3261] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:30 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 1316 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:31.460119 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3142d41a-155a-411b-af53-2e9840079100 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "DELETE /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 204 len: 0 microversion: 2.1 time: 0.413658 May 21 21:23:31.461455 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1593/3262] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:23:31 2022] DELETE /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:23:31.473074 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-30e51f3b-8e8b-4b11-becd-b876427bd3c0 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:31.474103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-30e51f3b-8e8b-4b11-becd-b876427bd3c0 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:31.484036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-30e51f3b-8e8b-4b11-becd-b876427bd3c0 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:31.487277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-30e51f3b-8e8b-4b11-becd-b876427bd3c0 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:31.488530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-30e51f3b-8e8b-4b11-becd-b876427bd3c0 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:31.489280 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-30e51f3b-8e8b-4b11-becd-b876427bd3c0 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:31.831792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-30e51f3b-8e8b-4b11-becd-b876427bd3c0 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:31.842652 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-30e51f3b-8e8b-4b11-becd-b876427bd3c0 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1515 microversion: 2.1 time: 0.373991 May 21 21:23:31.847404 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1670/3263] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:31 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1515 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:31.880953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-0df5ed2b-4960-42a1-bda9-970cf3422858 req-9ddceb5b-d46a-4f25-aa77-faa5196c97ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04839e2c-b4fa-4be9-87b8-f4f1e659845c", "name": "network-vif-plugged", "status": "completed", "tag": "7b2d1ca3-2cd7-4434-a690-f053be2de6aa"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:31.896041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0df5ed2b-4960-42a1-bda9-970cf3422858 req-9ddceb5b-d46a-4f25-aa77-faa5196c97ae service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:31.898308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0df5ed2b-4960-42a1-bda9-970cf3422858 req-9ddceb5b-d46a-4f25-aa77-faa5196c97ae service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:31.919458 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-0df5ed2b-4960-42a1-bda9-970cf3422858 req-9ddceb5b-d46a-4f25-aa77-faa5196c97ae service nova] Creating event network-vif-plugged:7b2d1ca3-2cd7-4434-a690-f053be2de6aa for instance 04839e2c-b4fa-4be9-87b8-f4f1e659845c on nch2-master-1 May 21 21:23:31.926214 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-0df5ed2b-4960-42a1-bda9-970cf3422858 req-9ddceb5b-d46a-4f25-aa77-faa5196c97ae service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049791 May 21 21:23:31.927605 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1594/3264] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:32.255757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b1af6a27-3170-4eea-8e8e-735b5d9c6893 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:32.256439 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b1af6a27-3170-4eea-8e8e-735b5d9c6893 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:32.263327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1af6a27-3170-4eea-8e8e-735b5d9c6893 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:32.263782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1af6a27-3170-4eea-8e8e-735b5d9c6893 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:32.264585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1af6a27-3170-4eea-8e8e-735b5d9c6893 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:32.267746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1af6a27-3170-4eea-8e8e-735b5d9c6893 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:32.562569 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b1af6a27-3170-4eea-8e8e-735b5d9c6893 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:32.594223 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b1af6a27-3170-4eea-8e8e-735b5d9c6893 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 200 len: 1316 microversion: 2.1 time: 0.341713 May 21 21:23:32.596599 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1671/3265] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:32 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:32.862967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-39614261-ae27-4a25-9aba-2fe676feefc7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:32.864027 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-39614261-ae27-4a25-9aba-2fe676feefc7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:32.873984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39614261-ae27-4a25-9aba-2fe676feefc7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:32.874608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39614261-ae27-4a25-9aba-2fe676feefc7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:32.875550 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39614261-ae27-4a25-9aba-2fe676feefc7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:32.876110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39614261-ae27-4a25-9aba-2fe676feefc7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:33.197688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-39614261-ae27-4a25-9aba-2fe676feefc7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:33.207095 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-39614261-ae27-4a25-9aba-2fe676feefc7 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1515 microversion: 2.1 time: 0.349979 May 21 21:23:33.216891 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1595/3266] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:32 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1515 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:33.615254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-104f944d-624b-47f3-82de-f0f28b01fdd2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:33.617627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-104f944d-624b-47f3-82de-f0f28b01fdd2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:33.627495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-104f944d-624b-47f3-82de-f0f28b01fdd2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:33.628448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-104f944d-624b-47f3-82de-f0f28b01fdd2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:33.629756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-104f944d-624b-47f3-82de-f0f28b01fdd2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:33.630452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-104f944d-624b-47f3-82de-f0f28b01fdd2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:33.827712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-104f944d-624b-47f3-82de-f0f28b01fdd2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:33.840748 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-104f944d-624b-47f3-82de-f0f28b01fdd2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 200 len: 1316 microversion: 2.1 time: 0.230307 May 21 21:23:33.842934 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1672/3267] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:33 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 1316 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:34.229375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e731c48e-dc07-4052-a12f-601ae19c038f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:34.232698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e731c48e-dc07-4052-a12f-601ae19c038f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:34.265988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e731c48e-dc07-4052-a12f-601ae19c038f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:34.269043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e731c48e-dc07-4052-a12f-601ae19c038f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:34.273589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e731c48e-dc07-4052-a12f-601ae19c038f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:34.276937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e731c48e-dc07-4052-a12f-601ae19c038f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:34.870461 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3d7938d1-0868-4cb5-bb3d-49aefbb30e5d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:34.871313 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3d7938d1-0868-4cb5-bb3d-49aefbb30e5d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:34.882229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d7938d1-0868-4cb5-bb3d-49aefbb30e5d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:34.882959 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d7938d1-0868-4cb5-bb3d-49aefbb30e5d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:34.884015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d7938d1-0868-4cb5-bb3d-49aefbb30e5d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:34.884724 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d7938d1-0868-4cb5-bb3d-49aefbb30e5d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:35.131559 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3d7938d1-0868-4cb5-bb3d-49aefbb30e5d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:35.140621 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3d7938d1-0868-4cb5-bb3d-49aefbb30e5d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 200 len: 1466 microversion: 2.1 time: 0.283290 May 21 21:23:35.152388 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1673/3268] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:34 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 1466 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:35.152388 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-7c7225cc-8e77-4324-99e7-0374b9175afa req-1868c73e-7728-4e03-a704-07364d6a0436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68c77575-86cb-40b7-806a-95040277083e", "name": "network-vif-deleted", "tag": "613e338a-0cdd-4d81-ac2c-ef11254618ba"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:35.159324 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:35.161923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7c7225cc-8e77-4324-99e7-0374b9175afa req-1868c73e-7728-4e03-a704-07364d6a0436 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:35.162469 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7c7225cc-8e77-4324-99e7-0374b9175afa req-1868c73e-7728-4e03-a704-07364d6a0436 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:35.177630 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-7c7225cc-8e77-4324-99e7-0374b9175afa req-1868c73e-7728-4e03-a704-07364d6a0436 service nova] Creating event network-vif-deleted:613e338a-0cdd-4d81-ac2c-ef11254618ba for instance 68c77575-86cb-40b7-806a-95040277083e on nch2-master-1 May 21 21:23:35.183823 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e731c48e-dc07-4052-a12f-601ae19c038f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:35.186173 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-7c7225cc-8e77-4324-99e7-0374b9175afa req-1868c73e-7728-4e03-a704-07364d6a0436 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039992 May 21 21:23:35.186963 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1674/3269] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:35.196222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fd4a4c5a-4af7-4533-887b-2183ea65208d tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:35.196222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fd4a4c5a-4af7-4533-887b-2183ea65208d tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:35.196417 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e731c48e-dc07-4052-a12f-601ae19c038f tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1515 microversion: 2.1 time: 0.973424 May 21 21:23:35.196417 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1596/3270] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:34 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1515 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:35.203143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd4a4c5a-4af7-4533-887b-2183ea65208d tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:35.203707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd4a4c5a-4af7-4533-887b-2183ea65208d tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:35.204747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd4a4c5a-4af7-4533-887b-2183ea65208d tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:35.205287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd4a4c5a-4af7-4533-887b-2183ea65208d tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:35.417360 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fd4a4c5a-4af7-4533-887b-2183ea65208d tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 200 len: 1617 microversion: 2.1 time: 0.227828 May 21 21:23:35.429436 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1675/3271] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:35 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 1617 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:35.520544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-56e0521e-dbdb-48d0-9e06-1c75066f08dd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-465405626", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "2402f588-3d04-418d-ac2d-d38d77c92205"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:35.597429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-56e0521e-dbdb-48d0-9e06-1c75066f08dd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] validate_networks() for None {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:23:35.973892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-56e0521e-dbdb-48d0-9e06-1c75066f08dd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:23:35.974317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-56e0521e-dbdb-48d0-9e06-1c75066f08dd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:23:35.974796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-56e0521e-dbdb-48d0-9e06-1c75066f08dd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:23:35.975205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-56e0521e-dbdb-48d0-9e06-1c75066f08dd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:23:35.975623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-56e0521e-dbdb-48d0-9e06-1c75066f08dd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:23:35.986759 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-56e0521e-dbdb-48d0-9e06-1c75066f08dd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:35.987216 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-56e0521e-dbdb-48d0-9e06-1c75066f08dd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:35.988022 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-56e0521e-dbdb-48d0-9e06-1c75066f08dd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:35.988491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-56e0521e-dbdb-48d0-9e06-1c75066f08dd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:36.008508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-56e0521e-dbdb-48d0-9e06-1c75066f08dd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:23:36.014359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-56e0521e-dbdb-48d0-9e06-1c75066f08dd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Getting quotas for user 945ab557c0e24cfdbcab74684a5d5800 and project 00752ed7cdc0495dbf5533e82dccc017. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:23:36.030961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-56e0521e-dbdb-48d0-9e06-1c75066f08dd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:23:36.034353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-56e0521e-dbdb-48d0-9e06-1c75066f08dd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:23:36.173699 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-56e0521e-dbdb-48d0-9e06-1c75066f08dd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664391 May 21 21:23:36.177234 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1597/3272] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:23:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:23:36.187559 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bd80d622-27a9-4252-b06a-710349c900b7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:36.191243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bd80d622-27a9-4252-b06a-710349c900b7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:36.212311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3ba47424-8031-4bc5-8a92-bec3a0984f99 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:36.212982 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3ba47424-8031-4bc5-8a92-bec3a0984f99 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:36.227070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ba47424-8031-4bc5-8a92-bec3a0984f99 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:36.227531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ba47424-8031-4bc5-8a92-bec3a0984f99 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:36.228398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ba47424-8031-4bc5-8a92-bec3a0984f99 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:36.228848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ba47424-8031-4bc5-8a92-bec3a0984f99 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:36.325481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ba47424-8031-4bc5-8a92-bec3a0984f99 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:36.326093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ba47424-8031-4bc5-8a92-bec3a0984f99 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:36.326882 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-3ba47424-8031-4bc5-8a92-bec3a0984f99 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lazy-loading 'fault' on Instance uuid 68c77575-86cb-40b7-806a-95040277083e {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:23:36.410184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3ba47424-8031-4bc5-8a92-bec3a0984f99 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '043d150ebd3548cc9afb4064fc0f2520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10e7136b9a5458f8370f7c4e4798415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:36.413503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bd80d622-27a9-4252-b06a-710349c900b7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:36.420023 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3ba47424-8031-4bc5-8a92-bec3a0984f99 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 200 len: 1309 microversion: 2.1 time: 0.211973 May 21 21:23:36.421831 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1598/3273] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:36 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 1309 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:36.432455 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bd80d622-27a9-4252-b06a-710349c900b7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec" status: 200 len: 1216 microversion: 2.1 time: 0.248974 May 21 21:23:36.443075 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1676/3274] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:36 2022] GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec => generated 1216 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:37.437597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f07e0ffa-ff88-4436-b1ea-0481f0832548 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:37.438336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f07e0ffa-ff88-4436-b1ea-0481f0832548 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] [instance: 68c77575-86cb-40b7-806a-95040277083e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:37.446618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f07e0ffa-ff88-4436-b1ea-0481f0832548 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:37.447183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f07e0ffa-ff88-4436-b1ea-0481f0832548 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:37.448126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f07e0ffa-ff88-4436-b1ea-0481f0832548 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:37.448700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f07e0ffa-ff88-4436-b1ea-0481f0832548 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:37.450582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aeb5d66a-bbf8-4b1d-b9c9-6c376d88fc02 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:37.451207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aeb5d66a-bbf8-4b1d-b9c9-6c376d88fc02 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:37.465882 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-f07e0ffa-ff88-4436-b1ea-0481f0832548 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] HTTP exception thrown: Instance 68c77575-86cb-40b7-806a-95040277083e could not be found. May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f07e0ffa-ff88-4436-b1ea-0481f0832548 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Request method failure captured: May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e HTTP/1.1 May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVgGdb9GcsLGUQ9DGRl6MqBH1Nj_k1DWznkzQcqxhBYLMwsssmq-b-eQ09MWEPGa7Ya8k26Z3wvjfxT2AIVH9_V0cUFAqr5jpX39CFPt-PzIuoqaAv2rEDln6o6JzPhF9dvcC_x-YR9-RbSAZmcr0UaeTc_4arXa8JB_J2INlYbxOWM May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: c10e7136b9a5458f8370f7c4e4798415 May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ListServerFiltersTestJSON-116477851 May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c10e7136b9a5458f8370f7c4e4798415"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c10e7136b9a5458f8370f7c4e4798415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c10e7136b9a5458f8370f7c4e4798415", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c10e7136b9a5458f8370f7c4e4798415"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ListServerFiltersTestJSON-116477851 May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: c10e7136b9a5458f8370f7c4e4798415 May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-116477851 May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ListServerFiltersTestJSON-116477851-project May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 043d150ebd3548cc9afb4064fc0f2520 May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ListServerFiltersTestJSON-116477851-project May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 68c77575-86cb-40b7-806a-95040277083e could not be found. May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '68c77575-86cb-40b7-806a-95040277083e'} May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68c77575-86cb-40b7-806a-95040277083e could not be found. May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68c77575-86cb-40b7-806a-95040277083e could not be found. May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:23:37.468164 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:23:37.475887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:23:37.475887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:23:37.475887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:23:37.475887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:23:37.475887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:23:37.475887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68c77575-86cb-40b7-806a-95040277083e could not be found. May 21 21:23:37.475887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:23:37.475887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f07e0ffa-ff88-4436-b1ea-0481f0832548 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] Returning 404 to user: Instance 68c77575-86cb-40b7-806a-95040277083e could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:23:37.475887 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f07e0ffa-ff88-4436-b1ea-0481f0832548 tempest-ListServerFiltersTestJSON-116477851 tempest-ListServerFiltersTestJSON-116477851-project] 10.222.0.49 "GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e" status: 404 len: 111 microversion: 2.1 time: 0.036096 May 21 21:23:37.475887 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1599/3275] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:37 2022] GET /compute/v2.1/servers/68c77575-86cb-40b7-806a-95040277083e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:23:37.546817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aeb5d66a-bbf8-4b1d-b9c9-6c376d88fc02 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:37.554690 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aeb5d66a-bbf8-4b1d-b9c9-6c376d88fc02 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec" status: 200 len: 1216 microversion: 2.1 time: 0.107976 May 21 21:23:37.555672 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1677/3276] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:37 2022] GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec => generated 1216 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:38.576466 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-40eb633c-325a-434d-86e2-ce526439fe4f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:38.578109 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-40eb633c-325a-434d-86e2-ce526439fe4f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:38.606783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40eb633c-325a-434d-86e2-ce526439fe4f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:38.607243 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40eb633c-325a-434d-86e2-ce526439fe4f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:38.621324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40eb633c-325a-434d-86e2-ce526439fe4f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:38.623679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40eb633c-325a-434d-86e2-ce526439fe4f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:38.773689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-40eb633c-325a-434d-86e2-ce526439fe4f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:38.796831 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-40eb633c-325a-434d-86e2-ce526439fe4f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec" status: 200 len: 1212 microversion: 2.1 time: 0.227738 May 21 21:23:38.809287 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1600/3277] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:38 2022] GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec => generated 1212 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:39.819988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3b23c4ad-6a3e-4c25-a567-014822618d6e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:39.820843 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3b23c4ad-6a3e-4c25-a567-014822618d6e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:39.834793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b23c4ad-6a3e-4c25-a567-014822618d6e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:39.835530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b23c4ad-6a3e-4c25-a567-014822618d6e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:39.839055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b23c4ad-6a3e-4c25-a567-014822618d6e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:39.842435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b23c4ad-6a3e-4c25-a567-014822618d6e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:39.956777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3b23c4ad-6a3e-4c25-a567-014822618d6e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:39.966550 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3b23c4ad-6a3e-4c25-a567-014822618d6e tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec" status: 200 len: 1268 microversion: 2.1 time: 0.151697 May 21 21:23:39.967931 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1678/3278] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:39 2022] GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:40.984200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9863208b-44b8-4e60-8901-022e1014a68f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:40.990933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9863208b-44b8-4e60-8901-022e1014a68f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:40.995981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9863208b-44b8-4e60-8901-022e1014a68f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:40.998651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9863208b-44b8-4e60-8901-022e1014a68f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:40.999867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9863208b-44b8-4e60-8901-022e1014a68f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:41.001713 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9863208b-44b8-4e60-8901-022e1014a68f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:41.099831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9863208b-44b8-4e60-8901-022e1014a68f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:41.105473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:41.110674 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9863208b-44b8-4e60-8901-022e1014a68f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec" status: 200 len: 1274 microversion: 2.1 time: 0.130291 May 21 21:23:41.116262 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1601/3279] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:40 2022] GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec => generated 1274 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:42.148985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8ff6cd84-1e3e-4438-a816-e5e4299bfb45 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:42.148985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8ff6cd84-1e3e-4438-a816-e5e4299bfb45 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:42.148985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ff6cd84-1e3e-4438-a816-e5e4299bfb45 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:42.148985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ff6cd84-1e3e-4438-a816-e5e4299bfb45 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:42.148985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ff6cd84-1e3e-4438-a816-e5e4299bfb45 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:42.148985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ff6cd84-1e3e-4438-a816-e5e4299bfb45 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:42.486920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8ff6cd84-1e3e-4438-a816-e5e4299bfb45 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:42.498123 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8ff6cd84-1e3e-4438-a816-e5e4299bfb45 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec" status: 200 len: 1316 microversion: 2.1 time: 0.367292 May 21 21:23:42.501642 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1679/3280] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:42 2022] GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec => generated 1316 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:43.520128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0f70f700-f3a6-4118-98ea-af2c9cbb7665 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:43.521604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0f70f700-f3a6-4118-98ea-af2c9cbb7665 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:43.535099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f70f700-f3a6-4118-98ea-af2c9cbb7665 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:43.536156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f70f700-f3a6-4118-98ea-af2c9cbb7665 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:43.537273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f70f700-f3a6-4118-98ea-af2c9cbb7665 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:43.537941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f70f700-f3a6-4118-98ea-af2c9cbb7665 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:43.811862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0f70f700-f3a6-4118-98ea-af2c9cbb7665 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:43.820528 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0f70f700-f3a6-4118-98ea-af2c9cbb7665 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec" status: 200 len: 1316 microversion: 2.1 time: 0.305603 May 21 21:23:43.821619 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1602/3281] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:43 2022] GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec => generated 1316 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:43.866840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-6f8ab71d-6580-404b-8000-a0805da03fec req-f6a708f3-2e20-4f32-8e92-3d1c9da524c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6480b2f5-919f-437d-b854-4fa5a5bcdcec", "tag": "10158bf9-a114-40b6-9bbc-e4bb071f8e83"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:43.878707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6f8ab71d-6580-404b-8000-a0805da03fec req-f6a708f3-2e20-4f32-8e92-3d1c9da524c0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:43.879765 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6f8ab71d-6580-404b-8000-a0805da03fec req-f6a708f3-2e20-4f32-8e92-3d1c9da524c0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:43.894771 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-6f8ab71d-6580-404b-8000-a0805da03fec req-f6a708f3-2e20-4f32-8e92-3d1c9da524c0 service nova] Creating event network-changed:10158bf9-a114-40b6-9bbc-e4bb071f8e83 for instance 6480b2f5-919f-437d-b854-4fa5a5bcdcec on nch1-master-1 May 21 21:23:43.900635 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-6f8ab71d-6580-404b-8000-a0805da03fec req-f6a708f3-2e20-4f32-8e92-3d1c9da524c0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038363 May 21 21:23:43.901458 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1680/3282] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:44.086272 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-02ade831-562a-4f5b-9bb6-e3555555c350 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:44.087726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-02ade831-562a-4f5b-9bb6-e3555555c350 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:44.095449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02ade831-562a-4f5b-9bb6-e3555555c350 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:44.096224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02ade831-562a-4f5b-9bb6-e3555555c350 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:44.097712 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02ade831-562a-4f5b-9bb6-e3555555c350 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:44.098370 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02ade831-562a-4f5b-9bb6-e3555555c350 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:44.324683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-02ade831-562a-4f5b-9bb6-e3555555c350 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:44.335916 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-02ade831-562a-4f5b-9bb6-e3555555c350 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1681 microversion: 2.1 time: 0.252872 May 21 21:23:44.337196 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1603/3283] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:44 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1681 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:44.693444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-81d9adf5-fa3d-4eb7-9ca9-725cb0318545 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-144459580", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "766eec8c-7b7a-41e4-8c7a-e64d895359f0"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:44.758298 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-81d9adf5-fa3d-4eb7-9ca9-725cb0318545 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] validate_networks() for [('766eec8c-7b7a-41e4-8c7a-e64d895359f0', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:23:44.838001 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-34efc7b1-9502-4b43-b4bc-ffa0bc07697b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:44.838615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-34efc7b1-9502-4b43-b4bc-ffa0bc07697b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:44.849101 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34efc7b1-9502-4b43-b4bc-ffa0bc07697b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:44.849720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34efc7b1-9502-4b43-b4bc-ffa0bc07697b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:44.850661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34efc7b1-9502-4b43-b4bc-ffa0bc07697b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:44.851203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34efc7b1-9502-4b43-b4bc-ffa0bc07697b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:45.014298 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-34efc7b1-9502-4b43-b4bc-ffa0bc07697b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:45.022341 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-34efc7b1-9502-4b43-b4bc-ffa0bc07697b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec" status: 200 len: 1316 microversion: 2.1 time: 0.188683 May 21 21:23:45.023654 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1604/3284] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:44 2022] GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:45.252681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-81d9adf5-fa3d-4eb7-9ca9-725cb0318545 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:23:45.253162 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-81d9adf5-fa3d-4eb7-9ca9-725cb0318545 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:23:45.253727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-81d9adf5-fa3d-4eb7-9ca9-725cb0318545 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:23:45.254214 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-81d9adf5-fa3d-4eb7-9ca9-725cb0318545 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:23:45.254660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-81d9adf5-fa3d-4eb7-9ca9-725cb0318545 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:23:45.267769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81d9adf5-fa3d-4eb7-9ca9-725cb0318545 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:45.267769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81d9adf5-fa3d-4eb7-9ca9-725cb0318545 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:45.267769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81d9adf5-fa3d-4eb7-9ca9-725cb0318545 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:45.267769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81d9adf5-fa3d-4eb7-9ca9-725cb0318545 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:45.287358 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-81d9adf5-fa3d-4eb7-9ca9-725cb0318545 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Getting quotas for project 50415a6f12844d2fa1f5d11a9a4d0274. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:23:45.293020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-81d9adf5-fa3d-4eb7-9ca9-725cb0318545 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Getting quotas for user 00466c38ccc54d5b94db4003faedfc99 and project 50415a6f12844d2fa1f5d11a9a4d0274. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:23:45.306377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-81d9adf5-fa3d-4eb7-9ca9-725cb0318545 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Going to run 2 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:23:45.308968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-81d9adf5-fa3d-4eb7-9ca9-725cb0318545 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: f0972678-bb0f-4673-95d6-542f03f5b75e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:23:45.354702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cbdd7bad-84b7-4289-b25d-b61b15628483 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:45.355494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cbdd7bad-84b7-4289-b25d-b61b15628483 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:45.362474 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbdd7bad-84b7-4289-b25d-b61b15628483 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:45.362921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbdd7bad-84b7-4289-b25d-b61b15628483 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:45.363687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbdd7bad-84b7-4289-b25d-b61b15628483 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:45.364177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbdd7bad-84b7-4289-b25d-b61b15628483 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:45.437519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-81d9adf5-fa3d-4eb7-9ca9-725cb0318545 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: a9da510f-42d2-42c0-85fb-8152f40037be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=f0972678-bb0f-4673-95d6-542f03f5b75e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:23:45.522855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cbdd7bad-84b7-4289-b25d-b61b15628483 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:45.531936 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cbdd7bad-84b7-4289-b25d-b61b15628483 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.181220 May 21 21:23:45.533230 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1605/3285] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:45 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:45.549184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1470b56e-8705-4743-8870-a0eab5f5fe7d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1476972523"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:45.550329 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1470b56e-8705-4743-8870-a0eab5f5fe7d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:45.556700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1470b56e-8705-4743-8870-a0eab5f5fe7d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:45.557260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1470b56e-8705-4743-8870-a0eab5f5fe7d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:45.558132 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1470b56e-8705-4743-8870-a0eab5f5fe7d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:45.558640 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1470b56e-8705-4743-8870-a0eab5f5fe7d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:45.612119 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-81d9adf5-fa3d-4eb7-9ca9-725cb0318545 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.191980 May 21 21:23:45.613038 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1681/3286] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:23:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:23:45.622811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-40030fc4-351f-4729-801e-42f7daf8461b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:45.627702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-40030fc4-351f-4729-801e-42f7daf8461b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:45.628559 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-40030fc4-351f-4729-801e-42f7daf8461b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Searching by: {'deleted': False, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274'} {{(pid=131277) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:23:45.646912 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-40030fc4-351f-4729-801e-42f7daf8461b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:45.647706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-40030fc4-351f-4729-801e-42f7daf8461b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:45.654284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-40030fc4-351f-4729-801e-42f7daf8461b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:45.654284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-40030fc4-351f-4729-801e-42f7daf8461b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:45.693318 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-40030fc4-351f-4729-801e-42f7daf8461b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.074244 May 21 21:23:45.700491 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1682/3287] 10.222.0.49 () {58 vars in 1124 bytes} [Sat May 21 21:23:45 2022] GET /compute/v2.1/servers => generated 675 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:23:45.707487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c49014fb-08e2-4e1b-af81-7e0b8b888484 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:45.708368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c49014fb-08e2-4e1b-af81-7e0b8b888484 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: a9da510f-42d2-42c0-85fb-8152f40037be] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:45.774915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c49014fb-08e2-4e1b-af81-7e0b8b888484 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:45.784642 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c49014fb-08e2-4e1b-af81-7e0b8b888484 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be" status: 200 len: 1219 microversion: 2.1 time: 0.081212 May 21 21:23:45.784642 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1683/3288] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:45 2022] GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:45.996647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:46.022097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:46.040727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-93fe1bea-59c5-4039-a2e8-bf15b4d4b825 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:46.041349 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-93fe1bea-59c5-4039-a2e8-bf15b4d4b825 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:46.049939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-93fe1bea-59c5-4039-a2e8-bf15b4d4b825 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:46.050394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-93fe1bea-59c5-4039-a2e8-bf15b4d4b825 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:46.051211 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-93fe1bea-59c5-4039-a2e8-bf15b4d4b825 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:46.051647 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-93fe1bea-59c5-4039-a2e8-bf15b4d4b825 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:46.087766 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1470b56e-8705-4743-8870-a0eab5f5fe7d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action" status: 202 len: 0 microversion: 2.1 time: 0.542574 May 21 21:23:46.092641 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1606/3289] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:23:45 2022] POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 21 21:23:46.100584 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d6ba1d73-b66f-4a7c-9527-e13f48996fe5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:46.101622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d6ba1d73-b66f-4a7c-9527-e13f48996fe5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:46.111094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d6ba1d73-b66f-4a7c-9527-e13f48996fe5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:46.117925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d6ba1d73-b66f-4a7c-9527-e13f48996fe5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:46.117925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d6ba1d73-b66f-4a7c-9527-e13f48996fe5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:46.117925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d6ba1d73-b66f-4a7c-9527-e13f48996fe5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:46.211159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-93fe1bea-59c5-4039-a2e8-bf15b4d4b825 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:46.224113 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-93fe1bea-59c5-4039-a2e8-bf15b4d4b825 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec" status: 200 len: 1316 microversion: 2.1 time: 0.182931 May 21 21:23:46.232876 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1684/3290] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:46 2022] GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec => generated 1316 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:46.291832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d6ba1d73-b66f-4a7c-9527-e13f48996fe5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:46.301888 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d6ba1d73-b66f-4a7c-9527-e13f48996fe5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1678 microversion: 2.1 time: 0.207991 May 21 21:23:46.302644 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1607/3291] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:46 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:46.800941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b8aa2990-c2f3-42f8-8bf0-a9091efc0724 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:46.801607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b8aa2990-c2f3-42f8-8bf0-a9091efc0724 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: a9da510f-42d2-42c0-85fb-8152f40037be] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:46.898230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b8aa2990-c2f3-42f8-8bf0-a9091efc0724 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:46.913116 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b8aa2990-c2f3-42f8-8bf0-a9091efc0724 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be" status: 200 len: 1219 microversion: 2.1 time: 0.116821 May 21 21:23:46.924449 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1685/3292] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:46 2022] GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be => generated 1219 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:47.238867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d1880eb3-de96-4a6e-96a8-80278d93ded2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:47.240588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d1880eb3-de96-4a6e-96a8-80278d93ded2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:47.250263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d1880eb3-de96-4a6e-96a8-80278d93ded2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:47.252983 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d1880eb3-de96-4a6e-96a8-80278d93ded2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:47.257341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d1880eb3-de96-4a6e-96a8-80278d93ded2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:47.257341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d1880eb3-de96-4a6e-96a8-80278d93ded2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:47.321485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b9fc6aaa-320d-41dd-859f-2addc3030e86 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:47.322395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b9fc6aaa-320d-41dd-859f-2addc3030e86 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:47.332020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b9fc6aaa-320d-41dd-859f-2addc3030e86 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:47.332825 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b9fc6aaa-320d-41dd-859f-2addc3030e86 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:47.333764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b9fc6aaa-320d-41dd-859f-2addc3030e86 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:47.334357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b9fc6aaa-320d-41dd-859f-2addc3030e86 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:47.438185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d1880eb3-de96-4a6e-96a8-80278d93ded2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:47.447090 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d1880eb3-de96-4a6e-96a8-80278d93ded2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec" status: 200 len: 1316 microversion: 2.1 time: 0.214042 May 21 21:23:47.447669 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1608/3293] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:47 2022] GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:47.709149 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b9fc6aaa-320d-41dd-859f-2addc3030e86 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:47.718721 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b9fc6aaa-320d-41dd-859f-2addc3030e86 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1678 microversion: 2.1 time: 0.401664 May 21 21:23:47.729582 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1686/3294] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:47 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1678 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:47.931859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-51169fc7-b3bb-4472-861a-01944a83d13f tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:47.932652 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-51169fc7-b3bb-4472-861a-01944a83d13f tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: a9da510f-42d2-42c0-85fb-8152f40037be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:47.939978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-51169fc7-b3bb-4472-861a-01944a83d13f tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:47.940478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-51169fc7-b3bb-4472-861a-01944a83d13f tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:47.941333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-51169fc7-b3bb-4472-861a-01944a83d13f tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:47.941791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-51169fc7-b3bb-4472-861a-01944a83d13f tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:48.021932 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-51169fc7-b3bb-4472-861a-01944a83d13f tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:48.029891 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-51169fc7-b3bb-4472-861a-01944a83d13f tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be" status: 200 len: 1223 microversion: 2.1 time: 0.102749 May 21 21:23:48.030720 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1609/3295] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:47 2022] GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:48.465543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b3ebc1f8-b38a-4795-a80b-8eb7eae36fee tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:48.466234 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b3ebc1f8-b38a-4795-a80b-8eb7eae36fee tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:48.474407 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b3ebc1f8-b38a-4795-a80b-8eb7eae36fee tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:48.474794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b3ebc1f8-b38a-4795-a80b-8eb7eae36fee tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:48.475586 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b3ebc1f8-b38a-4795-a80b-8eb7eae36fee tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:48.476042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b3ebc1f8-b38a-4795-a80b-8eb7eae36fee tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:48.738016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b96f340b-77a6-4253-9639-6c04f7d57024 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:48.738727 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b96f340b-77a6-4253-9639-6c04f7d57024 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:48.748786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b3ebc1f8-b38a-4795-a80b-8eb7eae36fee tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:48.751236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b96f340b-77a6-4253-9639-6c04f7d57024 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:48.754234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b96f340b-77a6-4253-9639-6c04f7d57024 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:48.755341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b96f340b-77a6-4253-9639-6c04f7d57024 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:48.756023 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b96f340b-77a6-4253-9639-6c04f7d57024 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:48.761456 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b3ebc1f8-b38a-4795-a80b-8eb7eae36fee tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec" status: 200 len: 1316 microversion: 2.1 time: 0.299814 May 21 21:23:48.773550 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1687/3296] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:48 2022] GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:49.006151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-a41ded87-bb54-4c50-942b-7cc585ca9865 req-84678a35-6dbc-436c-8175-da81704479cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6480b2f5-919f-437d-b854-4fa5a5bcdcec", "name": "network-vif-plugged", "status": "completed", "tag": "10158bf9-a114-40b6-9bbc-e4bb071f8e83"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:49.025592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a41ded87-bb54-4c50-942b-7cc585ca9865 req-84678a35-6dbc-436c-8175-da81704479cb service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:49.028544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a41ded87-bb54-4c50-942b-7cc585ca9865 req-84678a35-6dbc-436c-8175-da81704479cb service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:49.054707 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a41ded87-bb54-4c50-942b-7cc585ca9865 req-84678a35-6dbc-436c-8175-da81704479cb service nova] Creating event network-vif-plugged:10158bf9-a114-40b6-9bbc-e4bb071f8e83 for instance 6480b2f5-919f-437d-b854-4fa5a5bcdcec on nch1-master-1 May 21 21:23:49.077529 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-a41ded87-bb54-4c50-942b-7cc585ca9865 req-84678a35-6dbc-436c-8175-da81704479cb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075882 May 21 21:23:49.078806 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1688/3297] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:23:49.085072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4f6d9f92-2df6-4f7f-8fe2-82bd68c703ce tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:49.085798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4f6d9f92-2df6-4f7f-8fe2-82bd68c703ce tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: a9da510f-42d2-42c0-85fb-8152f40037be] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:49.093722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f6d9f92-2df6-4f7f-8fe2-82bd68c703ce tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:49.103020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f6d9f92-2df6-4f7f-8fe2-82bd68c703ce tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:49.103020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f6d9f92-2df6-4f7f-8fe2-82bd68c703ce tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:49.103020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f6d9f92-2df6-4f7f-8fe2-82bd68c703ce tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:49.279123 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4f6d9f92-2df6-4f7f-8fe2-82bd68c703ce tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:49.291258 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4f6d9f92-2df6-4f7f-8fe2-82bd68c703ce tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be" status: 200 len: 1279 microversion: 2.1 time: 0.210353 May 21 21:23:49.292261 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1689/3298] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:49 2022] GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be => generated 1279 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:49.338311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b96f340b-77a6-4253-9639-6c04f7d57024 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:49.346935 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b96f340b-77a6-4253-9639-6c04f7d57024 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1686 microversion: 2.1 time: 0.614253 May 21 21:23:49.362564 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1610/3299] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:48 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1686 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:49.786607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0554c199-39e2-4c6b-be50-d60d5d3468fe tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:49.788094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0554c199-39e2-4c6b-be50-d60d5d3468fe tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:49.796083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0554c199-39e2-4c6b-be50-d60d5d3468fe tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:49.797208 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0554c199-39e2-4c6b-be50-d60d5d3468fe tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:49.798932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0554c199-39e2-4c6b-be50-d60d5d3468fe tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:49.799623 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0554c199-39e2-4c6b-be50-d60d5d3468fe tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:49.806232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:50.219465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0554c199-39e2-4c6b-be50-d60d5d3468fe tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:50.228250 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0554c199-39e2-4c6b-be50-d60d5d3468fe tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec" status: 200 len: 1316 microversion: 2.1 time: 0.447118 May 21 21:23:50.236506 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1690/3300] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:49 2022] GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec => generated 1316 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:50.312882 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8fa057f2-caa9-4b93-b720-d13193d9a636 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:50.313563 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8fa057f2-caa9-4b93-b720-d13193d9a636 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: a9da510f-42d2-42c0-85fb-8152f40037be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:50.321898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8fa057f2-caa9-4b93-b720-d13193d9a636 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:50.322611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8fa057f2-caa9-4b93-b720-d13193d9a636 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:50.323562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8fa057f2-caa9-4b93-b720-d13193d9a636 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:50.324214 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8fa057f2-caa9-4b93-b720-d13193d9a636 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:50.371571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bd51f481-49e6-4705-869a-7801266fc920 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:50.372542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bd51f481-49e6-4705-869a-7801266fc920 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:50.379188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd51f481-49e6-4705-869a-7801266fc920 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:50.379949 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd51f481-49e6-4705-869a-7801266fc920 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:50.381112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd51f481-49e6-4705-869a-7801266fc920 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:50.381561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd51f481-49e6-4705-869a-7801266fc920 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:50.416456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8fa057f2-caa9-4b93-b720-d13193d9a636 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:50.425916 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8fa057f2-caa9-4b93-b720-d13193d9a636 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be" status: 200 len: 1277 microversion: 2.1 time: 0.118847 May 21 21:23:50.428665 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1611/3301] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:50 2022] GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be => generated 1277 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:50.555194 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bd51f481-49e6-4705-869a-7801266fc920 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:50.563441 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bd51f481-49e6-4705-869a-7801266fc920 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1686 microversion: 2.1 time: 0.197323 May 21 21:23:50.564101 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1691/3302] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:50 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1686 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:51.146723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-f08f2888-6bc8-4f33-9b0c-c943fa3520e1 req-6a2f84cf-2241-49e1-9a19-60d54d521486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168c8024-2cb4-4135-be5d-7a5cfcc6e895", "name": "network-vif-unplugged", "status": "completed", "tag": "fcc08185-a786-4b24-9deb-2bfaacaf7c9b"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:51.172689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f08f2888-6bc8-4f33-9b0c-c943fa3520e1 req-6a2f84cf-2241-49e1-9a19-60d54d521486 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:51.174759 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f08f2888-6bc8-4f33-9b0c-c943fa3520e1 req-6a2f84cf-2241-49e1-9a19-60d54d521486 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:51.213137 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-f08f2888-6bc8-4f33-9b0c-c943fa3520e1 req-6a2f84cf-2241-49e1-9a19-60d54d521486 service nova] Creating event network-vif-unplugged:fcc08185-a786-4b24-9deb-2bfaacaf7c9b for instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 on nch1-master-1 May 21 21:23:51.220857 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-f08f2888-6bc8-4f33-9b0c-c943fa3520e1 req-6a2f84cf-2241-49e1-9a19-60d54d521486 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079956 May 21 21:23:51.226353 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1612/3303] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:51.246565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f0a97519-c02e-4dd9-ba03-30b0ab049bfc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:51.247462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f0a97519-c02e-4dd9-ba03-30b0ab049bfc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:51.258456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0a97519-c02e-4dd9-ba03-30b0ab049bfc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:51.259315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0a97519-c02e-4dd9-ba03-30b0ab049bfc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:51.260338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0a97519-c02e-4dd9-ba03-30b0ab049bfc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:51.260987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0a97519-c02e-4dd9-ba03-30b0ab049bfc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:51.443781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-32486889-a674-443f-a685-ba36d0589588 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:51.445491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-32486889-a674-443f-a685-ba36d0589588 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: a9da510f-42d2-42c0-85fb-8152f40037be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:51.453013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32486889-a674-443f-a685-ba36d0589588 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:51.454252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32486889-a674-443f-a685-ba36d0589588 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:51.456451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32486889-a674-443f-a685-ba36d0589588 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:51.457272 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32486889-a674-443f-a685-ba36d0589588 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:51.569331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f0a97519-c02e-4dd9-ba03-30b0ab049bfc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:51.579052 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f0a97519-c02e-4dd9-ba03-30b0ab049bfc tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec" status: 200 len: 1316 microversion: 2.1 time: 0.336612 May 21 21:23:51.580529 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1692/3304] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:51 2022] GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec => generated 1316 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:51.592923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f98a696e-24a9-49b9-a802-372efa30e5af tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:51.596178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f98a696e-24a9-49b9-a802-372efa30e5af tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:51.606035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f98a696e-24a9-49b9-a802-372efa30e5af tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:51.606496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f98a696e-24a9-49b9-a802-372efa30e5af tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:51.608712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f98a696e-24a9-49b9-a802-372efa30e5af tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:51.608712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f98a696e-24a9-49b9-a802-372efa30e5af tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:51.799933 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f98a696e-24a9-49b9-a802-372efa30e5af tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:51.807875 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f98a696e-24a9-49b9-a802-372efa30e5af tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1681 microversion: 2.1 time: 0.226573 May 21 21:23:51.808675 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1693/3305] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:51 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1681 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:52.062862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-32486889-a674-443f-a685-ba36d0589588 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:52.083763 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-32486889-a674-443f-a685-ba36d0589588 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be" status: 200 len: 1319 microversion: 2.1 time: 0.644133 May 21 21:23:52.095577 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1613/3306] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:51 2022] GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be => generated 1319 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:52.567648 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-5bcaa8aa-33f2-48e9-b68c-8a5bab2aaa56 req-583ba7ae-4eac-4430-af18-9b35443adfd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0972678-bb0f-4673-95d6-542f03f5b75e", "tag": "c2aabf04-339c-4ca8-991c-d7a62f7f6127"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:52.588251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5bcaa8aa-33f2-48e9-b68c-8a5bab2aaa56 req-583ba7ae-4eac-4430-af18-9b35443adfd3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:52.588976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5bcaa8aa-33f2-48e9-b68c-8a5bab2aaa56 req-583ba7ae-4eac-4430-af18-9b35443adfd3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:52.600847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ca66213d-b71d-47aa-be27-29b6bc784890 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:52.601395 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ca66213d-b71d-47aa-be27-29b6bc784890 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:52.603287 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-5bcaa8aa-33f2-48e9-b68c-8a5bab2aaa56 req-583ba7ae-4eac-4430-af18-9b35443adfd3 service nova] Creating event network-changed:c2aabf04-339c-4ca8-991c-d7a62f7f6127 for instance f0972678-bb0f-4673-95d6-542f03f5b75e on nch2-master-1 May 21 21:23:52.609031 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-5bcaa8aa-33f2-48e9-b68c-8a5bab2aaa56 req-583ba7ae-4eac-4430-af18-9b35443adfd3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050110 May 21 21:23:52.615250 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca66213d-b71d-47aa-be27-29b6bc784890 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:52.615363 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1694/3307] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:52.616218 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca66213d-b71d-47aa-be27-29b6bc784890 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:52.617333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca66213d-b71d-47aa-be27-29b6bc784890 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:52.617947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca66213d-b71d-47aa-be27-29b6bc784890 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:52.826611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fd48fa3e-00d2-4fdd-b0c8-3a70f7a15379 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:52.827534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fd48fa3e-00d2-4fdd-b0c8-3a70f7a15379 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:52.840063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd48fa3e-00d2-4fdd-b0c8-3a70f7a15379 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:52.845200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd48fa3e-00d2-4fdd-b0c8-3a70f7a15379 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:52.846394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd48fa3e-00d2-4fdd-b0c8-3a70f7a15379 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:52.846953 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd48fa3e-00d2-4fdd-b0c8-3a70f7a15379 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:53.158110 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fd48fa3e-00d2-4fdd-b0c8-3a70f7a15379 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:53.168537 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fd48fa3e-00d2-4fdd-b0c8-3a70f7a15379 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1681 microversion: 2.1 time: 0.346320 May 21 21:23:53.185429 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1695/3308] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:52 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1681 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:53.185429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3ce1e4b9-de8b-408f-94b5-2fb1135a95f6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:53.186171 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ca66213d-b71d-47aa-be27-29b6bc784890 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:53.188441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3ce1e4b9-de8b-408f-94b5-2fb1135a95f6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: a9da510f-42d2-42c0-85fb-8152f40037be] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:53.198226 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ca66213d-b71d-47aa-be27-29b6bc784890 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec" status: 200 len: 1466 microversion: 2.1 time: 0.601182 May 21 21:23:53.200969 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1614/3309] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:52 2022] GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec => generated 1466 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:53.204983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3ce1e4b9-de8b-408f-94b5-2fb1135a95f6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:53.209054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3ce1e4b9-de8b-408f-94b5-2fb1135a95f6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:53.210628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3ce1e4b9-de8b-408f-94b5-2fb1135a95f6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:53.211180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3ce1e4b9-de8b-408f-94b5-2fb1135a95f6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:53.226892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ff8edd8b-c907-412a-aec7-8e5b0248a217 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:53.226892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ff8edd8b-c907-412a-aec7-8e5b0248a217 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:53.234229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff8edd8b-c907-412a-aec7-8e5b0248a217 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:53.235064 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff8edd8b-c907-412a-aec7-8e5b0248a217 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:53.237700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff8edd8b-c907-412a-aec7-8e5b0248a217 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:53.239246 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff8edd8b-c907-412a-aec7-8e5b0248a217 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:53.607551 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3ce1e4b9-de8b-408f-94b5-2fb1135a95f6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:53.618743 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3ce1e4b9-de8b-408f-94b5-2fb1135a95f6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be" status: 200 len: 1319 microversion: 2.1 time: 0.440484 May 21 21:23:53.621378 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1696/3310] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:53 2022] GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:53.644631 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-923bef85-57d2-4d40-a5a9-ce70524527cb req-58ce5560-e1dc-4f05-84c9-72b315204be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168c8024-2cb4-4135-be5d-7a5cfcc6e895", "name": "network-vif-plugged", "status": "completed", "tag": "fcc08185-a786-4b24-9deb-2bfaacaf7c9b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:53.656970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-923bef85-57d2-4d40-a5a9-ce70524527cb req-58ce5560-e1dc-4f05-84c9-72b315204be0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:53.658248 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-923bef85-57d2-4d40-a5a9-ce70524527cb req-58ce5560-e1dc-4f05-84c9-72b315204be0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:53.676174 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-923bef85-57d2-4d40-a5a9-ce70524527cb req-58ce5560-e1dc-4f05-84c9-72b315204be0 service nova] Creating event network-vif-plugged:fcc08185-a786-4b24-9deb-2bfaacaf7c9b for instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 on nch1-master-1 May 21 21:23:53.685504 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-923bef85-57d2-4d40-a5a9-ce70524527cb req-58ce5560-e1dc-4f05-84c9-72b315204be0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059909 May 21 21:23:53.689091 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1697/3311] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:54.059035 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ff8edd8b-c907-412a-aec7-8e5b0248a217 tempest-ServersOnMultiNodesTest-370669061 tempest-ServersOnMultiNodesTest-370669061-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec" status: 200 len: 1617 microversion: 2.1 time: 0.843315 May 21 21:23:54.066578 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1615/3312] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:53 2022] GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec => generated 1617 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:54.092106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1f260d06-3ebd-4ec5-9a59-9981a31c2991 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:54.092721 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1f260d06-3ebd-4ec5-9a59-9981a31c2991 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:54.104956 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f260d06-3ebd-4ec5-9a59-9981a31c2991 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:54.105408 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f260d06-3ebd-4ec5-9a59-9981a31c2991 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:54.106183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f260d06-3ebd-4ec5-9a59-9981a31c2991 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:54.106621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f260d06-3ebd-4ec5-9a59-9981a31c2991 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:54.141529 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1f260d06-3ebd-4ec5-9a59-9981a31c2991 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:23:54.195270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cb7761cd-11b6-473a-a4f8-21d6c6e7bd38 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:54.196147 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cb7761cd-11b6-473a-a4f8-21d6c6e7bd38 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:54.205372 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb7761cd-11b6-473a-a4f8-21d6c6e7bd38 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:54.207205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb7761cd-11b6-473a-a4f8-21d6c6e7bd38 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:54.207205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb7761cd-11b6-473a-a4f8-21d6c6e7bd38 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:54.207205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb7761cd-11b6-473a-a4f8-21d6c6e7bd38 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:54.530814 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1f260d06-3ebd-4ec5-9a59-9981a31c2991 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec" status: 204 len: 0 microversion: 2.1 time: 0.442053 May 21 21:23:54.540319 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1698/3313] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:23:54 2022] DELETE /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:23:54.549260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-84aa555a-4924-4fe2-a5c2-3cdf10f03f6c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:54.560592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-84aa555a-4924-4fe2-a5c2-3cdf10f03f6c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:54.581872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84aa555a-4924-4fe2-a5c2-3cdf10f03f6c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:54.587266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84aa555a-4924-4fe2-a5c2-3cdf10f03f6c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:54.588118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84aa555a-4924-4fe2-a5c2-3cdf10f03f6c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:54.589006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84aa555a-4924-4fe2-a5c2-3cdf10f03f6c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:54.712466 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cb7761cd-11b6-473a-a4f8-21d6c6e7bd38 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:54.733635 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cb7761cd-11b6-473a-a4f8-21d6c6e7bd38 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1681 microversion: 2.1 time: 0.542594 May 21 21:23:54.736201 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1616/3314] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:54 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1681 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:54.747547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-818aab71-974a-493d-9284-6d65d77c4d61 req-778dc147-08cc-42ee-8586-95713e2763ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9da510f-42d2-42c0-85fb-8152f40037be", "tag": "a17670ea-360a-48aa-926b-8712c3363bea"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:54.760943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-818aab71-974a-493d-9284-6d65d77c4d61 req-778dc147-08cc-42ee-8586-95713e2763ff service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:54.761635 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-818aab71-974a-493d-9284-6d65d77c4d61 req-778dc147-08cc-42ee-8586-95713e2763ff service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:54.776779 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-818aab71-974a-493d-9284-6d65d77c4d61 req-778dc147-08cc-42ee-8586-95713e2763ff service nova] Creating event network-changed:a17670ea-360a-48aa-926b-8712c3363bea for instance a9da510f-42d2-42c0-85fb-8152f40037be on nch1-master-1 May 21 21:23:54.783563 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-818aab71-974a-493d-9284-6d65d77c4d61 req-778dc147-08cc-42ee-8586-95713e2763ff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041318 May 21 21:23:54.784550 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1617/3315] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:54.790751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4cdc73eb-ca4a-4a06-b8fb-6be066c5f7f7 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:54.791460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4cdc73eb-ca4a-4a06-b8fb-6be066c5f7f7 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: a9da510f-42d2-42c0-85fb-8152f40037be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:54.802915 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cdc73eb-ca4a-4a06-b8fb-6be066c5f7f7 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:54.804058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cdc73eb-ca4a-4a06-b8fb-6be066c5f7f7 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:54.805251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cdc73eb-ca4a-4a06-b8fb-6be066c5f7f7 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:54.812917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cdc73eb-ca4a-4a06-b8fb-6be066c5f7f7 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:54.860044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:54.913539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-84aa555a-4924-4fe2-a5c2-3cdf10f03f6c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:54.922396 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-84aa555a-4924-4fe2-a5c2-3cdf10f03f6c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec" status: 200 len: 1472 microversion: 2.1 time: 0.380433 May 21 21:23:54.923037 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1699/3316] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:54 2022] GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec => generated 1472 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:55.315752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4cdc73eb-ca4a-4a06-b8fb-6be066c5f7f7 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:55.324638 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4cdc73eb-ca4a-4a06-b8fb-6be066c5f7f7 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be" status: 200 len: 1319 microversion: 2.1 time: 0.538569 May 21 21:23:55.325600 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1618/3317] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:54 2022] GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be => generated 1319 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:55.752842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:55.757975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b87682e5-b1ab-43cd-8d29-dc8c3c03ec6e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:55.758758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b87682e5-b1ab-43cd-8d29-dc8c3c03ec6e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:55.765504 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b87682e5-b1ab-43cd-8d29-dc8c3c03ec6e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:55.765966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b87682e5-b1ab-43cd-8d29-dc8c3c03ec6e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:55.766928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b87682e5-b1ab-43cd-8d29-dc8c3c03ec6e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:55.767632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b87682e5-b1ab-43cd-8d29-dc8c3c03ec6e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:55.939456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e4468a30-a505-41b1-8210-ff619ece1495 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:55.940257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e4468a30-a505-41b1-8210-ff619ece1495 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:55.956393 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e4468a30-a505-41b1-8210-ff619ece1495 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:55.958210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e4468a30-a505-41b1-8210-ff619ece1495 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:55.959812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e4468a30-a505-41b1-8210-ff619ece1495 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:55.961497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e4468a30-a505-41b1-8210-ff619ece1495 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:56.188472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b87682e5-b1ab-43cd-8d29-dc8c3c03ec6e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:56.205968 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b87682e5-b1ab-43cd-8d29-dc8c3c03ec6e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1681 microversion: 2.1 time: 0.455429 May 21 21:23:56.206695 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1700/3318] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:55 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1681 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:56.278100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e4468a30-a505-41b1-8210-ff619ece1495 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:56.294476 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e4468a30-a505-41b1-8210-ff619ece1495 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec" status: 200 len: 1472 microversion: 2.1 time: 0.359229 May 21 21:23:56.295722 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1619/3319] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:55 2022] GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec => generated 1472 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:23:56.343576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0df1440f-72b8-49a7-a2a1-0966496f8af1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:56.344444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0df1440f-72b8-49a7-a2a1-0966496f8af1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: a9da510f-42d2-42c0-85fb-8152f40037be] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:56.352505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0df1440f-72b8-49a7-a2a1-0966496f8af1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:56.353346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0df1440f-72b8-49a7-a2a1-0966496f8af1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:56.354690 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0df1440f-72b8-49a7-a2a1-0966496f8af1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:56.355386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0df1440f-72b8-49a7-a2a1-0966496f8af1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:56.631860 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0df1440f-72b8-49a7-a2a1-0966496f8af1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:56.642730 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0df1440f-72b8-49a7-a2a1-0966496f8af1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be" status: 200 len: 1319 microversion: 2.1 time: 0.303210 May 21 21:23:56.643650 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1701/3320] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:56 2022] GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:57.143510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-0d9345f3-f8e0-421e-91b3-699020605d06 req-825e1e9a-6698-41c6-a938-583df38832a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6480b2f5-919f-437d-b854-4fa5a5bcdcec", "name": "network-vif-deleted", "tag": "10158bf9-a114-40b6-9bbc-e4bb071f8e83"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:23:57.160607 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0d9345f3-f8e0-421e-91b3-699020605d06 req-825e1e9a-6698-41c6-a938-583df38832a1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:57.161107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0d9345f3-f8e0-421e-91b3-699020605d06 req-825e1e9a-6698-41c6-a938-583df38832a1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:57.226396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-df8df17d-67d8-44a0-8496-d5908944bafb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:57.227249 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-df8df17d-67d8-44a0-8496-d5908944bafb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:57.240051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=14 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:57.243898 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-0d9345f3-f8e0-421e-91b3-699020605d06 req-825e1e9a-6698-41c6-a938-583df38832a1 service nova] Creating event network-vif-deleted:10158bf9-a114-40b6-9bbc-e4bb071f8e83 for instance 6480b2f5-919f-437d-b854-4fa5a5bcdcec on nch1-master-1 May 21 21:23:57.252939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-df8df17d-67d8-44a0-8496-d5908944bafb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:57.254504 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-df8df17d-67d8-44a0-8496-d5908944bafb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:57.255509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-df8df17d-67d8-44a0-8496-d5908944bafb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:57.256107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-df8df17d-67d8-44a0-8496-d5908944bafb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:57.267462 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-0d9345f3-f8e0-421e-91b3-699020605d06 req-825e1e9a-6698-41c6-a938-583df38832a1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120660 May 21 21:23:57.277052 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1620/3321] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:23:57.314957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5db1a672-6357-421c-bf97-4c75d9741a88 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:57.315703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5db1a672-6357-421c-bf97-4c75d9741a88 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:57.326892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5db1a672-6357-421c-bf97-4c75d9741a88 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:57.327613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5db1a672-6357-421c-bf97-4c75d9741a88 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:57.328842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5db1a672-6357-421c-bf97-4c75d9741a88 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:57.329523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5db1a672-6357-421c-bf97-4c75d9741a88 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:57.473165 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5db1a672-6357-421c-bf97-4c75d9741a88 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:57.488875 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5db1a672-6357-421c-bf97-4c75d9741a88 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec" status: 200 len: 1430 microversion: 2.1 time: 0.177982 May 21 21:23:57.495054 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1621/3322] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:57 2022] GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec => generated 1430 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:57.669147 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a72e2948-a8de-46f0-a5c0-a7b5ef94b8df tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:57.670376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a72e2948-a8de-46f0-a5c0-a7b5ef94b8df tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: a9da510f-42d2-42c0-85fb-8152f40037be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:57.686805 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-df8df17d-67d8-44a0-8496-d5908944bafb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:57.704667 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-df8df17d-67d8-44a0-8496-d5908944bafb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1681 microversion: 2.1 time: 0.474605 May 21 21:23:57.705452 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1702/3323] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:57 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1681 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:57.706672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a72e2948-a8de-46f0-a5c0-a7b5ef94b8df tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:57.709884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a72e2948-a8de-46f0-a5c0-a7b5ef94b8df tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:57.713281 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a72e2948-a8de-46f0-a5c0-a7b5ef94b8df tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:57.716315 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a72e2948-a8de-46f0-a5c0-a7b5ef94b8df tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:58.181268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a72e2948-a8de-46f0-a5c0-a7b5ef94b8df tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:58.191133 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a72e2948-a8de-46f0-a5c0-a7b5ef94b8df tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be" status: 200 len: 1319 microversion: 2.1 time: 0.535880 May 21 21:23:58.191984 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1622/3324] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:57 2022] GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be => generated 1319 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:58.513580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1d809a92-861f-4996-b7da-f5ced1f10ede tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:58.515618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1d809a92-861f-4996-b7da-f5ced1f10ede tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:58.525919 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d809a92-861f-4996-b7da-f5ced1f10ede tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:58.526695 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d809a92-861f-4996-b7da-f5ced1f10ede tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:58.544048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d809a92-861f-4996-b7da-f5ced1f10ede tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:58.548759 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d809a92-861f-4996-b7da-f5ced1f10ede tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:58.602227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d809a92-861f-4996-b7da-f5ced1f10ede tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:58.607671 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d809a92-861f-4996-b7da-f5ced1f10ede tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:58.607671 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-1d809a92-861f-4996-b7da-f5ced1f10ede tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lazy-loading 'fault' on Instance uuid 6480b2f5-919f-437d-b854-4fa5a5bcdcec {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:23:58.725706 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d0a44edb-5a91-43c0-9291-95a772ceb5a6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:58.726392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d0a44edb-5a91-43c0-9291-95a772ceb5a6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:58.753834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0a44edb-5a91-43c0-9291-95a772ceb5a6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:58.756928 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0a44edb-5a91-43c0-9291-95a772ceb5a6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:58.757840 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0a44edb-5a91-43c0-9291-95a772ceb5a6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:58.758295 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0a44edb-5a91-43c0-9291-95a772ceb5a6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:58.771182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1d809a92-861f-4996-b7da-f5ced1f10ede tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:58.780884 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1d809a92-861f-4996-b7da-f5ced1f10ede tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec" status: 200 len: 1306 microversion: 2.1 time: 0.272251 May 21 21:23:58.783209 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1703/3325] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:58 2022] GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec => generated 1306 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:59.110340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d0a44edb-5a91-43c0-9291-95a772ceb5a6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:59.119555 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d0a44edb-5a91-43c0-9291-95a772ceb5a6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1681 microversion: 2.1 time: 0.401007 May 21 21:23:59.123612 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1623/3326] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:58 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1681 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:59.211024 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a58e7239-2058-4ec8-abf6-00b8e0812952 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:59.212035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a58e7239-2058-4ec8-abf6-00b8e0812952 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: a9da510f-42d2-42c0-85fb-8152f40037be] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:59.229208 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a58e7239-2058-4ec8-abf6-00b8e0812952 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:59.235350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a58e7239-2058-4ec8-abf6-00b8e0812952 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:59.235350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a58e7239-2058-4ec8-abf6-00b8e0812952 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:59.235350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a58e7239-2058-4ec8-abf6-00b8e0812952 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:59.561583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a58e7239-2058-4ec8-abf6-00b8e0812952 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:23:59.571996 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a58e7239-2058-4ec8-abf6-00b8e0812952 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be" status: 200 len: 1319 microversion: 2.1 time: 0.366390 May 21 21:23:59.572631 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1704/3327] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:59 2022] GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:23:59.803852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9154b9ea-2f26-45c7-9eac-6ee93796c2e0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:59.804646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9154b9ea-2f26-45c7-9eac-6ee93796c2e0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 6480b2f5-919f-437d-b854-4fa5a5bcdcec] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:59.807681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:59.819463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9154b9ea-2f26-45c7-9eac-6ee93796c2e0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:59.820094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9154b9ea-2f26-45c7-9eac-6ee93796c2e0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:59.821688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9154b9ea-2f26-45c7-9eac-6ee93796c2e0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:59.823159 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9154b9ea-2f26-45c7-9eac-6ee93796c2e0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:59.849092 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-9154b9ea-2f26-45c7-9eac-6ee93796c2e0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] HTTP exception thrown: Instance 6480b2f5-919f-437d-b854-4fa5a5bcdcec could not be found. May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9154b9ea-2f26-45c7-9eac-6ee93796c2e0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Request method failure captured: May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec HTTP/1.1 May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVfeSY4PanwHWYM_Qqj37PIvqjgimb9f6eJUN2bYrvqv_D5vZtFPwax8yL4acL_cj0mYADfUVytBdBv8LWst7KOmg4kq3BRXBvS9zK8F4crRFLGGQD03QxF0xJhAqFR68TsjXkAi9W-0sot8Wol3kNmJZEySYdx8qhgarMjMzLq0D9o May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 00752ed7cdc0495dbf5533e82dccc017 May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_00752ed7cdc0495dbf5533e82dccc017", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 00752ed7cdc0495dbf5533e82dccc017 May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersOnMultiNodesTest-1845796292-project May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 945ab557c0e24cfdbcab74684a5d5800 May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersOnMultiNodesTest-1845796292-project May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 6480b2f5-919f-437d-b854-4fa5a5bcdcec could not be found. May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '6480b2f5-919f-437d-b854-4fa5a5bcdcec'} May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6480b2f5-919f-437d-b854-4fa5a5bcdcec could not be found. May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6480b2f5-919f-437d-b854-4fa5a5bcdcec could not be found. May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:23:59.851704 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:23:59.855999 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:23:59.855999 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:23:59.855999 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:23:59.855999 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:23:59.855999 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:23:59.855999 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6480b2f5-919f-437d-b854-4fa5a5bcdcec could not be found. May 21 21:23:59.855999 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:23:59.860204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9154b9ea-2f26-45c7-9eac-6ee93796c2e0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Returning 404 to user: Instance 6480b2f5-919f-437d-b854-4fa5a5bcdcec could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:23:59.861848 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9154b9ea-2f26-45c7-9eac-6ee93796c2e0 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec" status: 404 len: 111 microversion: 2.1 time: 0.062126 May 21 21:23:59.865863 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1624/3328] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:23:59 2022] GET /compute/v2.1/servers/6480b2f5-919f-437d-b854-4fa5a5bcdcec => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:23:59.874410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c1fc5adf-76db-4489-a1c1-3bfb99972271 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:23:59.875183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c1fc5adf-76db-4489-a1c1-3bfb99972271 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:23:59.886295 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1fc5adf-76db-4489-a1c1-3bfb99972271 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:59.887687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1fc5adf-76db-4489-a1c1-3bfb99972271 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:59.888570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1fc5adf-76db-4489-a1c1-3bfb99972271 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:23:59.889365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1fc5adf-76db-4489-a1c1-3bfb99972271 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:23:59.925092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c1fc5adf-76db-4489-a1c1-3bfb99972271 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:23:59.941058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:00.140444 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f87e6170-8af9-4360-a549-d94736982b12 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:00.141058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f87e6170-8af9-4360-a549-d94736982b12 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:00.151254 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f87e6170-8af9-4360-a549-d94736982b12 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:00.153490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f87e6170-8af9-4360-a549-d94736982b12 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:00.158497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f87e6170-8af9-4360-a549-d94736982b12 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:00.159018 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f87e6170-8af9-4360-a549-d94736982b12 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:00.194894 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:00.299357 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c1fc5adf-76db-4489-a1c1-3bfb99972271 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "DELETE /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 204 len: 0 microversion: 2.1 time: 0.431601 May 21 21:24:00.300547 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1705/3329] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:23:59 2022] DELETE /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:24:00.310293 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e172734f-18da-403f-8b79-606b9678cf89 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:00.311374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e172734f-18da-403f-8b79-606b9678cf89 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:00.322601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e172734f-18da-403f-8b79-606b9678cf89 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:00.325387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e172734f-18da-403f-8b79-606b9678cf89 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:00.326199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e172734f-18da-403f-8b79-606b9678cf89 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:00.326635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e172734f-18da-403f-8b79-606b9678cf89 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:00.490456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f87e6170-8af9-4360-a549-d94736982b12 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:00.499914 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f87e6170-8af9-4360-a549-d94736982b12 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1681 microversion: 2.1 time: 0.363108 May 21 21:24:00.501586 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1625/3330] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:00 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1681 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:00.589604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1f7d9e95-bb4c-4f21-81bf-275fed4d8dd5 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:00.590314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1f7d9e95-bb4c-4f21-81bf-275fed4d8dd5 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: a9da510f-42d2-42c0-85fb-8152f40037be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:00.604715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f7d9e95-bb4c-4f21-81bf-275fed4d8dd5 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:00.605123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f7d9e95-bb4c-4f21-81bf-275fed4d8dd5 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:00.605946 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f7d9e95-bb4c-4f21-81bf-275fed4d8dd5 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:00.606386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f7d9e95-bb4c-4f21-81bf-275fed4d8dd5 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:00.629796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e172734f-18da-403f-8b79-606b9678cf89 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:00.648856 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e172734f-18da-403f-8b79-606b9678cf89 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 200 len: 1472 microversion: 2.1 time: 0.344029 May 21 21:24:00.649760 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1706/3331] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:00 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 1472 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:00.900209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1f7d9e95-bb4c-4f21-81bf-275fed4d8dd5 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:00.922415 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1f7d9e95-bb4c-4f21-81bf-275fed4d8dd5 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be" status: 200 len: 1319 microversion: 2.1 time: 0.336756 May 21 21:24:00.924467 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1626/3332] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:00 2022] GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:01.088126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d436df05-66c9-425b-807c-d811f04af8f5 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:01.092385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d436df05-66c9-425b-807c-d811f04af8f5 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:01.093476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d436df05-66c9-425b-807c-d811f04af8f5 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Searching by: {'deleted': False, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643'} {{(pid=131277) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:24:01.100243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d436df05-66c9-425b-807c-d811f04af8f5 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:01.101149 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d436df05-66c9-425b-807c-d811f04af8f5 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:01.102023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d436df05-66c9-425b-807c-d811f04af8f5 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:01.102460 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d436df05-66c9-425b-807c-d811f04af8f5 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:01.132777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.multi_cell_list [None req-d436df05-66c9-425b-807c-d811f04af8f5 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131277) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:24:01.163614 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d436df05-66c9-425b-807c-d811f04af8f5 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.079328 May 21 21:24:01.164199 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1707/3333] 10.222.0.49 () {58 vars in 1124 bytes} [Sat May 21 21:24:01 2022] GET /compute/v2.1/servers => generated 340 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:01.175805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ab4ed292-e803-4eb3-a547-07f3b412fc04 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:01.179453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ab4ed292-e803-4eb3-a547-07f3b412fc04 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:01.180446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ab4ed292-e803-4eb3-a547-07f3b412fc04 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Searching by: {'deleted': False, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:24:01.186980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab4ed292-e803-4eb3-a547-07f3b412fc04 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:01.187433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab4ed292-e803-4eb3-a547-07f3b412fc04 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:01.189182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab4ed292-e803-4eb3-a547-07f3b412fc04 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:01.189708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab4ed292-e803-4eb3-a547-07f3b412fc04 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:01.217096 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-ab4ed292-e803-4eb3-a547-07f3b412fc04 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:24:01.261042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ab4ed292-e803-4eb3-a547-07f3b412fc04 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:01.270787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab4ed292-e803-4eb3-a547-07f3b412fc04 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:01.271535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab4ed292-e803-4eb3-a547-07f3b412fc04 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:01.413915 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ab4ed292-e803-4eb3-a547-07f3b412fc04 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.242201 May 21 21:24:01.414517 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1627/3334] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:24:01 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:01.432183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-610641e3-17a4-45e6-891b-83c60151075e tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:01.441527 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-610641e3-17a4-45e6-891b-83c60151075e tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013430 May 21 21:24:01.442091 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1708/3335] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:24:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:01.518730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b6bc90b1-bfe9-41f3-9efd-c4794f6a32ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:01.519981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b6bc90b1-bfe9-41f3-9efd-c4794f6a32ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:01.526356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6bc90b1-bfe9-41f3-9efd-c4794f6a32ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:01.526813 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6bc90b1-bfe9-41f3-9efd-c4794f6a32ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:01.527605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6bc90b1-bfe9-41f3-9efd-c4794f6a32ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:01.531627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6bc90b1-bfe9-41f3-9efd-c4794f6a32ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:01.668330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5d0da61a-c0ec-4007-938a-3d056c502887 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:01.669958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5d0da61a-c0ec-4007-938a-3d056c502887 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:01.686198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d0da61a-c0ec-4007-938a-3d056c502887 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:01.689629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d0da61a-c0ec-4007-938a-3d056c502887 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:01.690712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d0da61a-c0ec-4007-938a-3d056c502887 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:01.697770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d0da61a-c0ec-4007-938a-3d056c502887 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:01.884891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5d0da61a-c0ec-4007-938a-3d056c502887 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:01.897623 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5d0da61a-c0ec-4007-938a-3d056c502887 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 200 len: 1472 microversion: 2.1 time: 0.231998 May 21 21:24:01.900186 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1709/3336] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:01 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 1472 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:01.940093 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e52b4287-cde9-46e4-bd80-a4f36d1eb54a tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:01.940983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e52b4287-cde9-46e4-bd80-a4f36d1eb54a tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: a9da510f-42d2-42c0-85fb-8152f40037be] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:01.952191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e52b4287-cde9-46e4-bd80-a4f36d1eb54a tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:01.954005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e52b4287-cde9-46e4-bd80-a4f36d1eb54a tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:01.957611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e52b4287-cde9-46e4-bd80-a4f36d1eb54a tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:01.958400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e52b4287-cde9-46e4-bd80-a4f36d1eb54a tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:01.973043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b6bc90b1-bfe9-41f3-9efd-c4794f6a32ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:01.985833 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b6bc90b1-bfe9-41f3-9efd-c4794f6a32ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1681 microversion: 2.1 time: 0.471024 May 21 21:24:01.987304 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1628/3337] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:01 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1681 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:02.177770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e52b4287-cde9-46e4-bd80-a4f36d1eb54a tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:02.190656 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e52b4287-cde9-46e4-bd80-a4f36d1eb54a tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be" status: 200 len: 1319 microversion: 2.1 time: 0.251340 May 21 21:24:02.190656 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1710/3338] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:01 2022] GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:02.345548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0fc44083-90c6-4f1e-ada6-6d16baa931e5 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:02.346042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0fc44083-90c6-4f1e-ada6-6d16baa931e5 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:02.356779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fc44083-90c6-4f1e-ada6-6d16baa931e5 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:02.361005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fc44083-90c6-4f1e-ada6-6d16baa931e5 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:02.362700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fc44083-90c6-4f1e-ada6-6d16baa931e5 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:02.363399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fc44083-90c6-4f1e-ada6-6d16baa931e5 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:02.408549 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0fc44083-90c6-4f1e-ada6-6d16baa931e5 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:24:02.919726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c4e6cefd-d29d-4e0d-83d3-42ccdcb67da6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:02.933032 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0fc44083-90c6-4f1e-ada6-6d16baa931e5 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "DELETE /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c" status: 204 len: 0 microversion: 2.1 time: 0.592432 May 21 21:24:02.934684 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1629/3339] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:24:02 2022] DELETE /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:24:02.938726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c4e6cefd-d29d-4e0d-83d3-42ccdcb67da6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:02.942930 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-2780a1ad-9874-4031-bbd4-61ca5d3cbc1b req-188f9879-6f7a-4298-b5f8-1b341d99a0fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0972678-bb0f-4673-95d6-542f03f5b75e", "name": "network-vif-plugged", "status": "completed", "tag": "c2aabf04-339c-4ca8-991c-d7a62f7f6127"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:02.955511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2780a1ad-9874-4031-bbd4-61ca5d3cbc1b req-188f9879-6f7a-4298-b5f8-1b341d99a0fe service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:02.956669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2780a1ad-9874-4031-bbd4-61ca5d3cbc1b req-188f9879-6f7a-4298-b5f8-1b341d99a0fe service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:02.959659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4e6cefd-d29d-4e0d-83d3-42ccdcb67da6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:02.965838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4e6cefd-d29d-4e0d-83d3-42ccdcb67da6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:02.965838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4e6cefd-d29d-4e0d-83d3-42ccdcb67da6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:02.965838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4e6cefd-d29d-4e0d-83d3-42ccdcb67da6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:02.975609 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-2780a1ad-9874-4031-bbd4-61ca5d3cbc1b req-188f9879-6f7a-4298-b5f8-1b341d99a0fe service nova] Creating event network-vif-plugged:c2aabf04-339c-4ca8-991c-d7a62f7f6127 for instance f0972678-bb0f-4673-95d6-542f03f5b75e on nch2-master-1 May 21 21:24:02.984858 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-2780a1ad-9874-4031-bbd4-61ca5d3cbc1b req-188f9879-6f7a-4298-b5f8-1b341d99a0fe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047767 May 21 21:24:02.986756 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1630/3340] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:02.993990 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0f303c02-d8a2-4b3e-96d4-430c419bb983 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:02.994966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0f303c02-d8a2-4b3e-96d4-430c419bb983 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:03.007200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f303c02-d8a2-4b3e-96d4-430c419bb983 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:03.008089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f303c02-d8a2-4b3e-96d4-430c419bb983 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:03.009270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f303c02-d8a2-4b3e-96d4-430c419bb983 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:03.009960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f303c02-d8a2-4b3e-96d4-430c419bb983 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:03.237553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c4e6cefd-d29d-4e0d-83d3-42ccdcb67da6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:03.248853 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c4e6cefd-d29d-4e0d-83d3-42ccdcb67da6 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 200 len: 1472 microversion: 2.1 time: 0.332910 May 21 21:24:03.249445 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1711/3341] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:02 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 1472 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:03.263205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8f059630-fc16-4c06-acb7-9463219ec95f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:03.266733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8f059630-fc16-4c06-acb7-9463219ec95f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:03.275484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f059630-fc16-4c06-acb7-9463219ec95f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:03.276343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f059630-fc16-4c06-acb7-9463219ec95f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:03.276972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f059630-fc16-4c06-acb7-9463219ec95f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:03.277587 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f059630-fc16-4c06-acb7-9463219ec95f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:03.356978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0f303c02-d8a2-4b3e-96d4-430c419bb983 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:03.365865 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0f303c02-d8a2-4b3e-96d4-430c419bb983 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c" status: 200 len: 1715 microversion: 2.1 time: 0.377635 May 21 21:24:03.384016 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1631/3342] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:02 2022] GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c => generated 1715 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:03.384016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d1c0a8b5-e179-4f57-af7d-29caa7537b55 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:03.384016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d1c0a8b5-e179-4f57-af7d-29caa7537b55 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: a9da510f-42d2-42c0-85fb-8152f40037be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:03.401374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d1c0a8b5-e179-4f57-af7d-29caa7537b55 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:03.401967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d1c0a8b5-e179-4f57-af7d-29caa7537b55 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:03.403003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d1c0a8b5-e179-4f57-af7d-29caa7537b55 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:03.403668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d1c0a8b5-e179-4f57-af7d-29caa7537b55 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:03.500128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8f059630-fc16-4c06-acb7-9463219ec95f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:03.509174 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8f059630-fc16-4c06-acb7-9463219ec95f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1681 microversion: 2.1 time: 0.256009 May 21 21:24:03.511882 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1712/3343] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:03 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1681 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:03.765886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d1c0a8b5-e179-4f57-af7d-29caa7537b55 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:03.778755 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d1c0a8b5-e179-4f57-af7d-29caa7537b55 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be" status: 200 len: 1319 microversion: 2.1 time: 0.400613 May 21 21:24:03.779568 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1632/3344] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:03 2022] GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:03.821911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-607385f0-014d-461c-ae06-2230001bf12e req-70155fa9-5706-4d3d-84a0-917245d5659d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04839e2c-b4fa-4be9-87b8-f4f1e659845c", "name": "network-vif-deleted", "tag": "7b2d1ca3-2cd7-4434-a690-f053be2de6aa"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:03.872723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-607385f0-014d-461c-ae06-2230001bf12e req-70155fa9-5706-4d3d-84a0-917245d5659d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:03.873554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-607385f0-014d-461c-ae06-2230001bf12e req-70155fa9-5706-4d3d-84a0-917245d5659d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:03.904122 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-607385f0-014d-461c-ae06-2230001bf12e req-70155fa9-5706-4d3d-84a0-917245d5659d service nova] Creating event network-vif-deleted:7b2d1ca3-2cd7-4434-a690-f053be2de6aa for instance 04839e2c-b4fa-4be9-87b8-f4f1e659845c on nch2-master-1 May 21 21:24:03.911843 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-607385f0-014d-461c-ae06-2230001bf12e req-70155fa9-5706-4d3d-84a0-917245d5659d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101501 May 21 21:24:03.914393 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1713/3345] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:04.268844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-385586ea-707c-4898-b911-b1b8e6f32c03 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:04.269465 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-385586ea-707c-4898-b911-b1b8e6f32c03 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:04.282358 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-385586ea-707c-4898-b911-b1b8e6f32c03 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:04.282828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-385586ea-707c-4898-b911-b1b8e6f32c03 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:04.283612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-385586ea-707c-4898-b911-b1b8e6f32c03 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:04.284058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-385586ea-707c-4898-b911-b1b8e6f32c03 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:04.395511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-402f42c8-4bc2-4cf1-a6ca-d481abdc17ad tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:04.396240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-402f42c8-4bc2-4cf1-a6ca-d481abdc17ad tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:04.414244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-402f42c8-4bc2-4cf1-a6ca-d481abdc17ad tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:04.414670 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-402f42c8-4bc2-4cf1-a6ca-d481abdc17ad tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:04.415746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-402f42c8-4bc2-4cf1-a6ca-d481abdc17ad tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:04.417466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-402f42c8-4bc2-4cf1-a6ca-d481abdc17ad tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:04.704689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-402f42c8-4bc2-4cf1-a6ca-d481abdc17ad tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:04.717513 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-402f42c8-4bc2-4cf1-a6ca-d481abdc17ad tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c" status: 200 len: 1715 microversion: 2.1 time: 0.325154 May 21 21:24:04.718704 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1714/3346] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:04 2022] GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c => generated 1715 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:04.761694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-064ce5af-b006-485e-997f-1a124c1596bd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:04.763801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-064ce5af-b006-485e-997f-1a124c1596bd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:04.785451 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-064ce5af-b006-485e-997f-1a124c1596bd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:04.786105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-064ce5af-b006-485e-997f-1a124c1596bd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:04.799036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-064ce5af-b006-485e-997f-1a124c1596bd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:04.799036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-064ce5af-b006-485e-997f-1a124c1596bd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:04.804382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-385586ea-707c-4898-b911-b1b8e6f32c03 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:04.819257 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-385586ea-707c-4898-b911-b1b8e6f32c03 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 200 len: 1301 microversion: 2.1 time: 0.553684 May 21 21:24:04.821417 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1633/3347] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:04 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 1301 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:04.827382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-916cd3f0-c76f-4aa4-82ca-59e9802e2213 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:04.828010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-916cd3f0-c76f-4aa4-82ca-59e9802e2213 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: a9da510f-42d2-42c0-85fb-8152f40037be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:04.855143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-916cd3f0-c76f-4aa4-82ca-59e9802e2213 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:04.855612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-916cd3f0-c76f-4aa4-82ca-59e9802e2213 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:04.858534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-916cd3f0-c76f-4aa4-82ca-59e9802e2213 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:04.859596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-916cd3f0-c76f-4aa4-82ca-59e9802e2213 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:05.051399 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-064ce5af-b006-485e-997f-1a124c1596bd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:05.064163 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-064ce5af-b006-485e-997f-1a124c1596bd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1681 microversion: 2.1 time: 0.343761 May 21 21:24:05.064988 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1715/3348] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:04 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1681 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:05.069841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-7783070d-6079-4cdd-98a5-1350b6dace47 req-6df6c584-7ea7-464d-bc33-94df46b3b6a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9da510f-42d2-42c0-85fb-8152f40037be", "name": "network-vif-plugged", "status": "completed", "tag": "a17670ea-360a-48aa-926b-8712c3363bea"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:05.078299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7783070d-6079-4cdd-98a5-1350b6dace47 req-6df6c584-7ea7-464d-bc33-94df46b3b6a7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:05.079321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7783070d-6079-4cdd-98a5-1350b6dace47 req-6df6c584-7ea7-464d-bc33-94df46b3b6a7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:05.091273 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-7783070d-6079-4cdd-98a5-1350b6dace47 req-6df6c584-7ea7-464d-bc33-94df46b3b6a7 service nova] Creating event network-vif-plugged:a17670ea-360a-48aa-926b-8712c3363bea for instance a9da510f-42d2-42c0-85fb-8152f40037be on nch1-master-1 May 21 21:24:05.097413 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-7783070d-6079-4cdd-98a5-1350b6dace47 req-6df6c584-7ea7-464d-bc33-94df46b3b6a7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031385 May 21 21:24:05.098435 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1716/3349] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:05.499262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-916cd3f0-c76f-4aa4-82ca-59e9802e2213 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:05.503530 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:05.508235 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-916cd3f0-c76f-4aa4-82ca-59e9802e2213 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be" status: 200 len: 1319 microversion: 2.1 time: 0.685583 May 21 21:24:05.514447 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1634/3350] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:04 2022] GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be => generated 1319 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:05.744306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-93af90a2-eb0b-47a3-8467-01e942e59e6a tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:05.744306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-93af90a2-eb0b-47a3-8467-01e942e59e6a tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:05.745934 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-93af90a2-eb0b-47a3-8467-01e942e59e6a tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:05.745934 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-93af90a2-eb0b-47a3-8467-01e942e59e6a tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:05.746877 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-93af90a2-eb0b-47a3-8467-01e942e59e6a tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:05.754511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-93af90a2-eb0b-47a3-8467-01e942e59e6a tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:05.850281 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2741149e-feed-4aaf-973e-7e767c65fe49 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:05.852392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2741149e-feed-4aaf-973e-7e767c65fe49 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 04839e2c-b4fa-4be9-87b8-f4f1e659845c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:05.865386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2741149e-feed-4aaf-973e-7e767c65fe49 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:05.868690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2741149e-feed-4aaf-973e-7e767c65fe49 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:05.875597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2741149e-feed-4aaf-973e-7e767c65fe49 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:05.875597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2741149e-feed-4aaf-973e-7e767c65fe49 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:05.887463 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-2741149e-feed-4aaf-973e-7e767c65fe49 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] HTTP exception thrown: Instance 04839e2c-b4fa-4be9-87b8-f4f1e659845c could not be found. May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2741149e-feed-4aaf-973e-7e767c65fe49 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Request method failure captured: May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c HTTP/1.1 May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVfeSY4PanwHWYM_Qqj37PIvqjgimb9f6eJUN2bYrvqv_D5vZtFPwax8yL4acL_cj0mYADfUVytBdBv8LWst7KOmg4kq3BRXBvS9zK8F4crRFLGGQD03QxF0xJhAqFR68TsjXkAi9W-0sot8Wol3kNmJZEySYdx8qhgarMjMzLq0D9o May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 00752ed7cdc0495dbf5533e82dccc017 May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_00752ed7cdc0495dbf5533e82dccc017", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 00752ed7cdc0495dbf5533e82dccc017 May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersOnMultiNodesTest-1845796292-project May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 945ab557c0e24cfdbcab74684a5d5800 May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersOnMultiNodesTest-1845796292-project May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 04839e2c-b4fa-4be9-87b8-f4f1e659845c could not be found. May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '04839e2c-b4fa-4be9-87b8-f4f1e659845c'} May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04839e2c-b4fa-4be9-87b8-f4f1e659845c could not be found. May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04839e2c-b4fa-4be9-87b8-f4f1e659845c could not be found. May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:05.890128 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:05.899316 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:05.899316 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:05.899316 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:05.899316 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:24:05.899316 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:24:05.899316 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04839e2c-b4fa-4be9-87b8-f4f1e659845c could not be found. May 21 21:24:05.899316 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:05.899316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2741149e-feed-4aaf-973e-7e767c65fe49 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Returning 404 to user: Instance 04839e2c-b4fa-4be9-87b8-f4f1e659845c could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:24:05.899316 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2741149e-feed-4aaf-973e-7e767c65fe49 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c" status: 404 len: 111 microversion: 2.1 time: 0.058131 May 21 21:24:05.899316 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1635/3351] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:05 2022] GET /compute/v2.1/servers/04839e2c-b4fa-4be9-87b8-f4f1e659845c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:24:05.917506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-40225ac2-b2cf-49d1-9d4a-c0419870a0da tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:05.918316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-40225ac2-b2cf-49d1-9d4a-c0419870a0da tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:05.929045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40225ac2-b2cf-49d1-9d4a-c0419870a0da tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:05.929770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40225ac2-b2cf-49d1-9d4a-c0419870a0da tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:05.931289 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40225ac2-b2cf-49d1-9d4a-c0419870a0da tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:05.933853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40225ac2-b2cf-49d1-9d4a-c0419870a0da tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:05.983039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-40225ac2-b2cf-49d1-9d4a-c0419870a0da tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:24:05.983229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-93af90a2-eb0b-47a3-8467-01e942e59e6a tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:05.999908 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-93af90a2-eb0b-47a3-8467-01e942e59e6a tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c" status: 200 len: 1715 microversion: 2.1 time: 0.268451 May 21 21:24:06.014001 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1717/3352] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:05 2022] GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c => generated 1715 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:06.081760 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3c3a8ecf-ecab-4ac3-bd49-d387f0df9eb5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:06.082368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3c3a8ecf-ecab-4ac3-bd49-d387f0df9eb5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:06.089241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c3a8ecf-ecab-4ac3-bd49-d387f0df9eb5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:06.090471 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c3a8ecf-ecab-4ac3-bd49-d387f0df9eb5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:06.092037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c3a8ecf-ecab-4ac3-bd49-d387f0df9eb5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:06.092534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c3a8ecf-ecab-4ac3-bd49-d387f0df9eb5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:06.273661 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3c3a8ecf-ecab-4ac3-bd49-d387f0df9eb5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:06.274391 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3c3a8ecf-ecab-4ac3-bd49-d387f0df9eb5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1681 microversion: 2.1 time: 0.197503 May 21 21:24:06.274968 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1718/3353] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:06 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1681 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:06.527203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4d6f9a05-5b49-4093-90e6-9f8c3b35f980 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:06.527935 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4d6f9a05-5b49-4093-90e6-9f8c3b35f980 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: a9da510f-42d2-42c0-85fb-8152f40037be] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:06.535134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d6f9a05-5b49-4093-90e6-9f8c3b35f980 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:06.535749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d6f9a05-5b49-4093-90e6-9f8c3b35f980 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:06.536738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d6f9a05-5b49-4093-90e6-9f8c3b35f980 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:06.537284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d6f9a05-5b49-4093-90e6-9f8c3b35f980 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:06.843516 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-40225ac2-b2cf-49d1-9d4a-c0419870a0da tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "DELETE /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 204 len: 0 microversion: 2.1 time: 0.937018 May 21 21:24:06.848357 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1636/3354] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:24:05 2022] DELETE /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 0 bytes in 943 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:24:06.868879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-32320843-b0a0-46d7-a83a-a7c4877eadd7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:06.875226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-32320843-b0a0-46d7-a83a-a7c4877eadd7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:06.892802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32320843-b0a0-46d7-a83a-a7c4877eadd7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:06.894596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32320843-b0a0-46d7-a83a-a7c4877eadd7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:06.895588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32320843-b0a0-46d7-a83a-a7c4877eadd7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:06.896204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32320843-b0a0-46d7-a83a-a7c4877eadd7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:06.923401 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4d6f9a05-5b49-4093-90e6-9f8c3b35f980 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:06.936255 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4d6f9a05-5b49-4093-90e6-9f8c3b35f980 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be" status: 200 len: 1319 microversion: 2.1 time: 0.412102 May 21 21:24:06.938300 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1719/3355] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:06 2022] GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:07.022102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b4dc45c1-51e8-407a-9c50-650c12e315ca tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:07.022987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b4dc45c1-51e8-407a-9c50-650c12e315ca tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:07.044182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b4dc45c1-51e8-407a-9c50-650c12e315ca tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:07.044985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b4dc45c1-51e8-407a-9c50-650c12e315ca tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:07.045960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b4dc45c1-51e8-407a-9c50-650c12e315ca tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:07.046571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b4dc45c1-51e8-407a-9c50-650c12e315ca tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:07.187612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b4dc45c1-51e8-407a-9c50-650c12e315ca tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:07.197737 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b4dc45c1-51e8-407a-9c50-650c12e315ca tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c" status: 200 len: 1648 microversion: 2.1 time: 0.179694 May 21 21:24:07.200984 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1720/3356] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:07 2022] GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c => generated 1648 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:07.296142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ed7963f2-f773-46c6-88c1-9d679e79fc3f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:07.296142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ed7963f2-f773-46c6-88c1-9d679e79fc3f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:07.306536 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed7963f2-f773-46c6-88c1-9d679e79fc3f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:07.307033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed7963f2-f773-46c6-88c1-9d679e79fc3f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:07.310156 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed7963f2-f773-46c6-88c1-9d679e79fc3f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:07.310822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed7963f2-f773-46c6-88c1-9d679e79fc3f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:07.520930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ed7963f2-f773-46c6-88c1-9d679e79fc3f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:07.530595 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ed7963f2-f773-46c6-88c1-9d679e79fc3f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1681 microversion: 2.1 time: 0.240762 May 21 21:24:07.541587 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1721/3357] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:07 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1681 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:07.666816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-32320843-b0a0-46d7-a83a-a7c4877eadd7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:07.678036 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-32320843-b0a0-46d7-a83a-a7c4877eadd7 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 200 len: 1472 microversion: 2.1 time: 0.824268 May 21 21:24:07.683930 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1637/3358] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:06 2022] GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 1472 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:07.699609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-851268f0-fe44-450b-a35d-d7c247333442 req-fd42c5ad-ed7e-4ef3-a815-3b5dc79a7818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35305bf8-3bec-4194-a7a3-73c1b559de0c", "name": "network-vif-deleted", "tag": "70fc2489-6822-4979-aba0-c2fcf2ea6390"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:07.709376 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-851268f0-fe44-450b-a35d-d7c247333442 req-fd42c5ad-ed7e-4ef3-a815-3b5dc79a7818 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:07.710076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-851268f0-fe44-450b-a35d-d7c247333442 req-fd42c5ad-ed7e-4ef3-a815-3b5dc79a7818 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:07.723859 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-851268f0-fe44-450b-a35d-d7c247333442 req-fd42c5ad-ed7e-4ef3-a815-3b5dc79a7818 service nova] Creating event network-vif-deleted:70fc2489-6822-4979-aba0-c2fcf2ea6390 for instance 35305bf8-3bec-4194-a7a3-73c1b559de0c on nch2-master-1 May 21 21:24:07.730205 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-851268f0-fe44-450b-a35d-d7c247333442 req-fd42c5ad-ed7e-4ef3-a815-3b5dc79a7818 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034297 May 21 21:24:07.731138 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1722/3359] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:07.954995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-19614915-37b7-4e21-abd8-6b9e633dc175 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:07.956299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-19614915-37b7-4e21-abd8-6b9e633dc175 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: a9da510f-42d2-42c0-85fb-8152f40037be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:07.963229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19614915-37b7-4e21-abd8-6b9e633dc175 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:07.963690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19614915-37b7-4e21-abd8-6b9e633dc175 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:07.964575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19614915-37b7-4e21-abd8-6b9e633dc175 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:07.965187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19614915-37b7-4e21-abd8-6b9e633dc175 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:08.239775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1d69b5a2-dc9f-410d-841d-96932866d4e6 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:08.241797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1d69b5a2-dc9f-410d-841d-96932866d4e6 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:08.254160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d69b5a2-dc9f-410d-841d-96932866d4e6 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:08.261167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d69b5a2-dc9f-410d-841d-96932866d4e6 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:08.261167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d69b5a2-dc9f-410d-841d-96932866d4e6 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:08.261167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d69b5a2-dc9f-410d-841d-96932866d4e6 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:08.275166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-19614915-37b7-4e21-abd8-6b9e633dc175 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:08.297921 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-19614915-37b7-4e21-abd8-6b9e633dc175 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be" status: 200 len: 1507 microversion: 2.1 time: 0.346964 May 21 21:24:08.299746 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1638/3360] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:07 2022] GET /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be => generated 1507 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:08.316763 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6001a04e-e8d5-44b7-aee5-6104b021b89c tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:08.318196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6001a04e-e8d5-44b7-aee5-6104b021b89c tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: f0972678-bb0f-4673-95d6-542f03f5b75e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:08.337758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6001a04e-e8d5-44b7-aee5-6104b021b89c tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:08.338060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d69b5a2-dc9f-410d-841d-96932866d4e6 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:08.343162 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d69b5a2-dc9f-410d-841d-96932866d4e6 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:08.343162 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-1d69b5a2-dc9f-410d-841d-96932866d4e6 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lazy-loading 'fault' on Instance uuid 35305bf8-3bec-4194-a7a3-73c1b559de0c {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:24:08.343433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6001a04e-e8d5-44b7-aee5-6104b021b89c tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:08.343433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6001a04e-e8d5-44b7-aee5-6104b021b89c tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:08.343433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6001a04e-e8d5-44b7-aee5-6104b021b89c tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:08.344559 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:08.397569 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1d69b5a2-dc9f-410d-841d-96932866d4e6 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bca59219d5408d923faab503dccb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74d3bd7c77d4fff99f01a798b584643', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:08.407924 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1d69b5a2-dc9f-410d-841d-96932866d4e6 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c" status: 200 len: 1367 microversion: 2.1 time: 0.189686 May 21 21:24:08.409139 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1723/3361] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:08 2022] GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:08.548272 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f16ee112-4158-4787-992e-5a0de3724f08 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:08.549221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f16ee112-4158-4787-992e-5a0de3724f08 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:08.556032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f16ee112-4158-4787-992e-5a0de3724f08 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:08.556719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f16ee112-4158-4787-992e-5a0de3724f08 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:08.557656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f16ee112-4158-4787-992e-5a0de3724f08 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:08.558257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f16ee112-4158-4787-992e-5a0de3724f08 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:08.636438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6001a04e-e8d5-44b7-aee5-6104b021b89c tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:08.692228 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6001a04e-e8d5-44b7-aee5-6104b021b89c tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/f0972678-bb0f-4673-95d6-542f03f5b75e" status: 200 len: 1507 microversion: 2.1 time: 0.374126 May 21 21:24:08.692228 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1639/3362] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:08 2022] GET /compute/v2.1/servers/f0972678-bb0f-4673-95d6-542f03f5b75e => generated 1507 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:08.704889 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-88809e1e-9ff9-4cad-bac1-4addfa44ea1a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:08.708967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-88809e1e-9ff9-4cad-bac1-4addfa44ea1a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:08.721271 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-88809e1e-9ff9-4cad-bac1-4addfa44ea1a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:08.721722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-88809e1e-9ff9-4cad-bac1-4addfa44ea1a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:08.722504 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-88809e1e-9ff9-4cad-bac1-4addfa44ea1a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:08.722945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-88809e1e-9ff9-4cad-bac1-4addfa44ea1a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:08.864674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f16ee112-4158-4787-992e-5a0de3724f08 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:08.873656 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f16ee112-4158-4787-992e-5a0de3724f08 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1681 microversion: 2.1 time: 0.329125 May 21 21:24:08.874596 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1724/3363] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:08 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1681 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:08.891529 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cfa98b92-c536-4bc0-9eaf-f53b8428a50b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:08.892516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cfa98b92-c536-4bc0-9eaf-f53b8428a50b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: f0972678-bb0f-4673-95d6-542f03f5b75e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:08.908880 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cfa98b92-c536-4bc0-9eaf-f53b8428a50b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:08.908880 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cfa98b92-c536-4bc0-9eaf-f53b8428a50b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:08.908880 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cfa98b92-c536-4bc0-9eaf-f53b8428a50b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:08.908880 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cfa98b92-c536-4bc0-9eaf-f53b8428a50b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:08.937749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cfa98b92-c536-4bc0-9eaf-f53b8428a50b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: f0972678-bb0f-4673-95d6-542f03f5b75e] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:24:09.310359 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cfa98b92-c536-4bc0-9eaf-f53b8428a50b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f0972678-bb0f-4673-95d6-542f03f5b75e" status: 204 len: 0 microversion: 2.1 time: 0.422541 May 21 21:24:09.311878 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1725/3364] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:24:08 2022] DELETE /compute/v2.1/servers/f0972678-bb0f-4673-95d6-542f03f5b75e => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:24:09.322844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f0cc39ee-be66-4789-b054-65a07e55b7a2 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:09.323606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f0cc39ee-be66-4789-b054-65a07e55b7a2 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: a9da510f-42d2-42c0-85fb-8152f40037be] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:09.330678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0cc39ee-be66-4789-b054-65a07e55b7a2 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:09.336861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0cc39ee-be66-4789-b054-65a07e55b7a2 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:09.336861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0cc39ee-be66-4789-b054-65a07e55b7a2 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:09.336861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0cc39ee-be66-4789-b054-65a07e55b7a2 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:09.364770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f0cc39ee-be66-4789-b054-65a07e55b7a2 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: a9da510f-42d2-42c0-85fb-8152f40037be] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:24:09.405821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-88809e1e-9ff9-4cad-bac1-4addfa44ea1a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:09.417752 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-88809e1e-9ff9-4cad-bac1-4addfa44ea1a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 200 len: 1472 microversion: 2.1 time: 0.718785 May 21 21:24:09.418476 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1640/3365] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:08 2022] GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 1472 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:09.437311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a99a7e42-92ac-46f2-a35e-c8bfa532fa4c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:09.439807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a99a7e42-92ac-46f2-a35e-c8bfa532fa4c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] [instance: 35305bf8-3bec-4194-a7a3-73c1b559de0c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:09.447538 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a99a7e42-92ac-46f2-a35e-c8bfa532fa4c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:09.448342 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a99a7e42-92ac-46f2-a35e-c8bfa532fa4c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:09.449633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a99a7e42-92ac-46f2-a35e-c8bfa532fa4c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:09.450283 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a99a7e42-92ac-46f2-a35e-c8bfa532fa4c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:09.469271 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-a99a7e42-92ac-46f2-a35e-c8bfa532fa4c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] HTTP exception thrown: Instance 35305bf8-3bec-4194-a7a3-73c1b559de0c could not be found. May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a99a7e42-92ac-46f2-a35e-c8bfa532fa4c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Request method failure captured: May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c HTTP/1.1 May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVgszoTSlUWGUGu65Wa7rhctoVGhhJR_HsCK2skS-tdDTvgZebS7FLrVjWqQ7OzNtim54vtN6QAftz_Jqt5-XwYzuR-r1Z8PNxF3uBhuCMBIzGOPh2uh5ZZjNelsXGP1PF2Mg9vb6oXE0GPmiFfXMIypTRkqiRK7arDUzXd0h9rmGFY May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: d74d3bd7c77d4fff99f01a798b584643 May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersTestManualDisk-839383129 May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d74d3bd7c77d4fff99f01a798b584643"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d74d3bd7c77d4fff99f01a798b584643"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d74d3bd7c77d4fff99f01a798b584643", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d74d3bd7c77d4fff99f01a798b584643"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersTestManualDisk-839383129 May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: d74d3bd7c77d4fff99f01a798b584643 May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersTestManualDisk-839383129 May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersTestManualDisk-839383129-project May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 68bca59219d5408d923faab503dccb39 May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersTestManualDisk-839383129-project May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 35305bf8-3bec-4194-a7a3-73c1b559de0c could not be found. May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '35305bf8-3bec-4194-a7a3-73c1b559de0c'} May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35305bf8-3bec-4194-a7a3-73c1b559de0c could not be found. May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35305bf8-3bec-4194-a7a3-73c1b559de0c could not be found. May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:09.471853 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:09.477714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:09.477714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:09.477714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:09.477714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:24:09.477714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:24:09.477714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35305bf8-3bec-4194-a7a3-73c1b559de0c could not be found. May 21 21:24:09.477714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:09.477714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a99a7e42-92ac-46f2-a35e-c8bfa532fa4c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Returning 404 to user: Instance 35305bf8-3bec-4194-a7a3-73c1b559de0c could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:24:09.477714 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a99a7e42-92ac-46f2-a35e-c8bfa532fa4c tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c" status: 404 len: 111 microversion: 2.1 time: 0.054144 May 21 21:24:09.477714 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1641/3366] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:09 2022] GET /compute/v2.1/servers/35305bf8-3bec-4194-a7a3-73c1b559de0c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:24:09.486901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-47bc2327-52df-4624-8a9c-8e6c0710c9a0 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] Calling method '.version_select at 0x7fc81ad1a8b0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:09.599577 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-47bc2327-52df-4624-8a9c-8e6c0710c9a0 tempest-ServersTestManualDisk-839383129 tempest-ServersTestManualDisk-839383129-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-869879107" status: 202 len: 0 microversion: 2.1 time: 0.117217 May 21 21:24:09.600312 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1642/3367] 10.222.0.49 () {58 vars in 1217 bytes} [Sat May 21 21:24:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-869879107 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:24:09.660510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-ed539ad6-e318-4880-ae8e-c3ff327ba4c8 req-e686b1a6-712e-4360-b105-35126ecd4a89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766239c5-7dbe-4c3a-b071-6cf16b71200a", "name": "network-vif-unplugged", "status": "completed", "tag": "5523c07a-ab85-45f5-a295-a288568115de"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:09.681937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ed539ad6-e318-4880-ae8e-c3ff327ba4c8 req-e686b1a6-712e-4360-b105-35126ecd4a89 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:09.682740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ed539ad6-e318-4880-ae8e-c3ff327ba4c8 req-e686b1a6-712e-4360-b105-35126ecd4a89 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:09.716094 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-ed539ad6-e318-4880-ae8e-c3ff327ba4c8 req-e686b1a6-712e-4360-b105-35126ecd4a89 service nova] Creating event network-vif-unplugged:5523c07a-ab85-45f5-a295-a288568115de for instance 766239c5-7dbe-4c3a-b071-6cf16b71200a on nch2-master-1 May 21 21:24:09.716094 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-ed539ad6-e318-4880-ae8e-c3ff327ba4c8 req-e686b1a6-712e-4360-b105-35126ecd4a89 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053533 May 21 21:24:09.716094 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1643/3368] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:24:09.827027 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f0cc39ee-be66-4789-b054-65a07e55b7a2 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be" status: 204 len: 0 microversion: 2.1 time: 0.509461 May 21 21:24:09.828462 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1726/3369] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:24:09 2022] DELETE /compute/v2.1/servers/a9da510f-42d2-42c0-85fb-8152f40037be => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:24:09.892037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-95e06b8d-36ad-4595-b079-889c3ada7dfd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:09.892852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-95e06b8d-36ad-4595-b079-889c3ada7dfd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:09.902297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95e06b8d-36ad-4595-b079-889c3ada7dfd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:09.902297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95e06b8d-36ad-4595-b079-889c3ada7dfd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:09.903739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95e06b8d-36ad-4595-b079-889c3ada7dfd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:09.904511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95e06b8d-36ad-4595-b079-889c3ada7dfd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:10.000835 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c2731d34-2161-46be-9b94-099283bac876 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1651862976", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "766eec8c-7b7a-41e4-8c7a-e64d895359f0"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:10.096215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-c2731d34-2161-46be-9b94-099283bac876 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] validate_networks() for [('766eec8c-7b7a-41e4-8c7a-e64d895359f0', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:24:10.396432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-95e06b8d-36ad-4595-b079-889c3ada7dfd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:10.410304 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-95e06b8d-36ad-4595-b079-889c3ada7dfd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.519094 May 21 21:24:10.414610 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1644/3370] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:09 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:10.424352 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-4fd956ab-4f33-472c-b81c-6445f20474e7 req-2461d96b-2306-4d28-8bcc-1d6401f44af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766239c5-7dbe-4c3a-b071-6cf16b71200a", "name": "network-vif-deleted", "tag": "5523c07a-ab85-45f5-a295-a288568115de"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:10.452256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4fd956ab-4f33-472c-b81c-6445f20474e7 req-2461d96b-2306-4d28-8bcc-1d6401f44af4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:10.452825 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4fd956ab-4f33-472c-b81c-6445f20474e7 req-2461d96b-2306-4d28-8bcc-1d6401f44af4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:10.481788 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-4fd956ab-4f33-472c-b81c-6445f20474e7 req-2461d96b-2306-4d28-8bcc-1d6401f44af4 service nova] Creating event network-vif-deleted:5523c07a-ab85-45f5-a295-a288568115de for instance 766239c5-7dbe-4c3a-b071-6cf16b71200a on nch2-master-1 May 21 21:24:10.497212 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-4fd956ab-4f33-472c-b81c-6445f20474e7 req-2461d96b-2306-4d28-8bcc-1d6401f44af4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080449 May 21 21:24:10.498348 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1645/3371] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:10.511021 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b90b5bd8-8339-40f9-8a3a-e453d01cc03b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:10.512012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b90b5bd8-8339-40f9-8a3a-e453d01cc03b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:10.530784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b90b5bd8-8339-40f9-8a3a-e453d01cc03b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:10.531351 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b90b5bd8-8339-40f9-8a3a-e453d01cc03b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:10.541266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b90b5bd8-8339-40f9-8a3a-e453d01cc03b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:10.541848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b90b5bd8-8339-40f9-8a3a-e453d01cc03b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:10.813117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b90b5bd8-8339-40f9-8a3a-e453d01cc03b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:10.826523 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b90b5bd8-8339-40f9-8a3a-e453d01cc03b tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 200 len: 1430 microversion: 2.1 time: 0.326658 May 21 21:24:10.829465 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1646/3372] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:10 2022] GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 1430 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:11.108534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:11.225573 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c2731d34-2161-46be-9b94-099283bac876 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:24:11.225892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c2731d34-2161-46be-9b94-099283bac876 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:24:11.226534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c2731d34-2161-46be-9b94-099283bac876 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:24:11.226955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c2731d34-2161-46be-9b94-099283bac876 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:24:11.227366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c2731d34-2161-46be-9b94-099283bac876 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:24:11.241911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2731d34-2161-46be-9b94-099283bac876 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:11.242581 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2731d34-2161-46be-9b94-099283bac876 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:11.243660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2731d34-2161-46be-9b94-099283bac876 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:11.244307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2731d34-2161-46be-9b94-099283bac876 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:11.277023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-c2731d34-2161-46be-9b94-099283bac876 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Getting quotas for project 50415a6f12844d2fa1f5d11a9a4d0274. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:24:11.291739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-c2731d34-2161-46be-9b94-099283bac876 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Getting quotas for user 00466c38ccc54d5b94db4003faedfc99 and project 50415a6f12844d2fa1f5d11a9a4d0274. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:24:11.307277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c2731d34-2161-46be-9b94-099283bac876 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Going to run 2 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:24:11.311503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c2731d34-2161-46be-9b94-099283bac876 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: ea895b96-a96b-4720-bc93-1a4e1d50bac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:24:11.420908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c2731d34-2161-46be-9b94-099283bac876 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: 3352e598-ef65-4283-84cd-3e196542b17a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=ea895b96-a96b-4720-bc93-1a4e1d50bac0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:24:11.617946 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-11a274e0-4f38-475f-b878-856399f7ddc6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:11.618826 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-11a274e0-4f38-475f-b878-856399f7ddc6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:11.622202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:11.625591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:11.644365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11a274e0-4f38-475f-b878-856399f7ddc6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:11.644971 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11a274e0-4f38-475f-b878-856399f7ddc6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:11.645777 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11a274e0-4f38-475f-b878-856399f7ddc6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:11.646219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11a274e0-4f38-475f-b878-856399f7ddc6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:11.684220 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c2731d34-2161-46be-9b94-099283bac876 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.688727 May 21 21:24:11.688526 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1727/3373] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:24:09 2022] POST /compute/v2.1/servers => generated 32 bytes in 1693 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) May 21 21:24:11.701232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-62aec3d3-5f14-4023-b0c6-8d745db00def tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:11.728322 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-62aec3d3-5f14-4023-b0c6-8d745db00def tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:11.731056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-62aec3d3-5f14-4023-b0c6-8d745db00def tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Searching by: {'deleted': False, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274'} {{(pid=131277) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:24:11.804404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-62aec3d3-5f14-4023-b0c6-8d745db00def tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:11.809876 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-62aec3d3-5f14-4023-b0c6-8d745db00def tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:11.812126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-62aec3d3-5f14-4023-b0c6-8d745db00def tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:11.815591 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-62aec3d3-5f14-4023-b0c6-8d745db00def tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:11.885173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.multi_cell_list [None req-62aec3d3-5f14-4023-b0c6-8d745db00def tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=131277) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:24:11.929843 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-62aec3d3-5f14-4023-b0c6-8d745db00def tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.236864 May 21 21:24:11.936325 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1728/3374] 10.222.0.49 () {58 vars in 1124 bytes} [Sat May 21 21:24:11 2022] GET /compute/v2.1/servers => generated 1335 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:11.942297 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8dd16577-8fe4-4352-93c4-eb292dd29d02 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:11.944210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8dd16577-8fe4-4352-93c4-eb292dd29d02 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 766239c5-7dbe-4c3a-b071-6cf16b71200a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:11.963290 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8dd16577-8fe4-4352-93c4-eb292dd29d02 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:11.963543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8dd16577-8fe4-4352-93c4-eb292dd29d02 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:11.964480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8dd16577-8fe4-4352-93c4-eb292dd29d02 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:11.966160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8dd16577-8fe4-4352-93c4-eb292dd29d02 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:11.993488 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-8dd16577-8fe4-4352-93c4-eb292dd29d02 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] HTTP exception thrown: Instance 766239c5-7dbe-4c3a-b071-6cf16b71200a could not be found. May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8dd16577-8fe4-4352-93c4-eb292dd29d02 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Request method failure captured: May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a HTTP/1.1 May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVfeSY4PanwHWYM_Qqj37PIvqjgimb9f6eJUN2bYrvqv_D5vZtFPwax8yL4acL_cj0mYADfUVytBdBv8LWst7KOmg4kq3BRXBvS9zK8F4crRFLGGQD03QxF0xJhAqFR68TsjXkAi9W-0sot8Wol3kNmJZEySYdx8qhgarMjMzLq0D9o May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 00752ed7cdc0495dbf5533e82dccc017 May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_00752ed7cdc0495dbf5533e82dccc017", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 00752ed7cdc0495dbf5533e82dccc017 May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersOnMultiNodesTest-1845796292-project May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 945ab557c0e24cfdbcab74684a5d5800 May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersOnMultiNodesTest-1845796292-project May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 766239c5-7dbe-4c3a-b071-6cf16b71200a could not be found. May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '766239c5-7dbe-4c3a-b071-6cf16b71200a'} May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 766239c5-7dbe-4c3a-b071-6cf16b71200a could not be found. May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 766239c5-7dbe-4c3a-b071-6cf16b71200a could not be found. May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:11.995179 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:12.004646 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:12.004646 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:12.004646 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:12.004646 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:24:12.004646 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:24:12.004646 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 766239c5-7dbe-4c3a-b071-6cf16b71200a could not be found. May 21 21:24:12.004646 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:12.004646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8dd16577-8fe4-4352-93c4-eb292dd29d02 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Returning 404 to user: Instance 766239c5-7dbe-4c3a-b071-6cf16b71200a could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:24:12.004646 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8dd16577-8fe4-4352-93c4-eb292dd29d02 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a" status: 404 len: 111 microversion: 2.1 time: 0.064611 May 21 21:24:12.004646 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1729/3375] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:11 2022] GET /compute/v2.1/servers/766239c5-7dbe-4c3a-b071-6cf16b71200a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:24:12.016352 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-828bf03b-9c89-4f00-b7d0-0c9ba3af625a tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:12.019205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-828bf03b-9c89-4f00-b7d0-0c9ba3af625a tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: 3352e598-ef65-4283-84cd-3e196542b17a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:12.202021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-828bf03b-9c89-4f00-b7d0-0c9ba3af625a tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:12.210051 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-828bf03b-9c89-4f00-b7d0-0c9ba3af625a tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a" status: 200 len: 1218 microversion: 2.1 time: 0.211876 May 21 21:24:12.210826 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1730/3376] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:11 2022] GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a => generated 1218 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:12.225716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e0400ad9-928b-455c-9df6-359ba857865d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:12.226801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e0400ad9-928b-455c-9df6-359ba857865d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: ca640d8e-17ec-4ff3-940f-39d6976115f7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:12.235788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e0400ad9-928b-455c-9df6-359ba857865d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:12.236520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e0400ad9-928b-455c-9df6-359ba857865d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:12.237480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e0400ad9-928b-455c-9df6-359ba857865d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:12.238079 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e0400ad9-928b-455c-9df6-359ba857865d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:12.263635 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-11a274e0-4f38-475f-b878-856399f7ddc6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:12.267456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e0400ad9-928b-455c-9df6-359ba857865d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: ca640d8e-17ec-4ff3-940f-39d6976115f7] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:24:12.275108 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-11a274e0-4f38-475f-b878-856399f7ddc6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.660383 May 21 21:24:12.278779 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1647/3377] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:11 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:12.539196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-62657e7a-e58f-495f-a85c-c43955971702 req-ef3a32ab-d74c-4188-a8ea-37fb534a4b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0972678-bb0f-4673-95d6-542f03f5b75e", "name": "network-vif-deleted", "tag": "c2aabf04-339c-4ca8-991c-d7a62f7f6127"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:12.561047 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-62657e7a-e58f-495f-a85c-c43955971702 req-ef3a32ab-d74c-4188-a8ea-37fb534a4b4d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:12.564364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-62657e7a-e58f-495f-a85c-c43955971702 req-ef3a32ab-d74c-4188-a8ea-37fb534a4b4d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:12.600976 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-62657e7a-e58f-495f-a85c-c43955971702 req-ef3a32ab-d74c-4188-a8ea-37fb534a4b4d service nova] Creating event network-vif-deleted:c2aabf04-339c-4ca8-991c-d7a62f7f6127 for instance f0972678-bb0f-4673-95d6-542f03f5b75e on nch2-master-1 May 21 21:24:12.609278 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-62657e7a-e58f-495f-a85c-c43955971702 req-ef3a32ab-d74c-4188-a8ea-37fb534a4b4d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074953 May 21 21:24:12.611793 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1648/3378] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:12.660253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-803cc3b7-211c-46d1-958f-43173f41d264 req-ba02a737-c285-4b1c-9089-471b839ea0f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168c8024-2cb4-4135-be5d-7a5cfcc6e895", "name": "network-vif-unplugged", "status": "completed", "tag": "fcc08185-a786-4b24-9deb-2bfaacaf7c9b"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:12.690922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-803cc3b7-211c-46d1-958f-43173f41d264 req-ba02a737-c285-4b1c-9089-471b839ea0f8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:12.691550 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-803cc3b7-211c-46d1-958f-43173f41d264 req-ba02a737-c285-4b1c-9089-471b839ea0f8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:12.743786 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-803cc3b7-211c-46d1-958f-43173f41d264 req-ba02a737-c285-4b1c-9089-471b839ea0f8 service nova] Creating event network-vif-unplugged:fcc08185-a786-4b24-9deb-2bfaacaf7c9b for instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 on nch1-master-1 May 21 21:24:12.759690 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-803cc3b7-211c-46d1-958f-43173f41d264 req-ba02a737-c285-4b1c-9089-471b839ea0f8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106340 May 21 21:24:12.760619 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1649/3379] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:24:12.875750 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e0400ad9-928b-455c-9df6-359ba857865d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ca640d8e-17ec-4ff3-940f-39d6976115f7" status: 204 len: 0 microversion: 2.1 time: 0.663396 May 21 21:24:12.877362 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1731/3380] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:24:12 2022] DELETE /compute/v2.1/servers/ca640d8e-17ec-4ff3-940f-39d6976115f7 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:24:12.886293 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-595ef61f-b492-40b4-8795-d770ecf0f91a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:12.886991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-595ef61f-b492-40b4-8795-d770ecf0f91a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:12.898589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-595ef61f-b492-40b4-8795-d770ecf0f91a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:12.899060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-595ef61f-b492-40b4-8795-d770ecf0f91a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:12.901928 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-595ef61f-b492-40b4-8795-d770ecf0f91a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:12.902558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-595ef61f-b492-40b4-8795-d770ecf0f91a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:12.979309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-595ef61f-b492-40b4-8795-d770ecf0f91a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:24:13.013401 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-23d7332e-127a-4037-9939-bbf12193daaf req-215a1bb4-a7d4-4ce3-8741-1ef8b3f74055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9da510f-42d2-42c0-85fb-8152f40037be", "name": "network-vif-deleted", "tag": "a17670ea-360a-48aa-926b-8712c3363bea"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:13.023911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-23d7332e-127a-4037-9939-bbf12193daaf req-215a1bb4-a7d4-4ce3-8741-1ef8b3f74055 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:13.025245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-23d7332e-127a-4037-9939-bbf12193daaf req-215a1bb4-a7d4-4ce3-8741-1ef8b3f74055 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:13.040834 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-23d7332e-127a-4037-9939-bbf12193daaf req-215a1bb4-a7d4-4ce3-8741-1ef8b3f74055 service nova] Creating event network-vif-deleted:a17670ea-360a-48aa-926b-8712c3363bea for instance a9da510f-42d2-42c0-85fb-8152f40037be on nch1-master-1 May 21 21:24:13.047293 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-23d7332e-127a-4037-9939-bbf12193daaf req-215a1bb4-a7d4-4ce3-8741-1ef8b3f74055 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038696 May 21 21:24:13.049004 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1732/3381] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:24:13.228792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dcd4b048-5f70-4ea4-aeea-495c075eb98e tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:13.229851 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dcd4b048-5f70-4ea4-aeea-495c075eb98e tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: 3352e598-ef65-4283-84cd-3e196542b17a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:13.239619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:UPDATE=4,nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:13.340811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-dcd4b048-5f70-4ea4-aeea-495c075eb98e tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:13.350752 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dcd4b048-5f70-4ea4-aeea-495c075eb98e tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a" status: 200 len: 1218 microversion: 2.1 time: 0.126929 May 21 21:24:13.351688 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1733/3382] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:13 2022] GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a => generated 1218 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:13.389247 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-595ef61f-b492-40b4-8795-d770ecf0f91a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 204 len: 0 microversion: 2.1 time: 0.505726 May 21 21:24:13.394090 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1650/3383] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:24:12 2022] DELETE /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:24:13.399868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b1672117-155b-449a-bb6f-d84793e2068d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:13.400565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b1672117-155b-449a-bb6f-d84793e2068d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: ca640d8e-17ec-4ff3-940f-39d6976115f7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:13.408622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1672117-155b-449a-bb6f-d84793e2068d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:13.409105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1672117-155b-449a-bb6f-d84793e2068d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:13.409929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1672117-155b-449a-bb6f-d84793e2068d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:13.410444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1672117-155b-449a-bb6f-d84793e2068d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:13.701527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b1672117-155b-449a-bb6f-d84793e2068d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:13.710193 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b1672117-155b-449a-bb6f-d84793e2068d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/ca640d8e-17ec-4ff3-940f-39d6976115f7" status: 200 len: 1474 microversion: 2.1 time: 0.314566 May 21 21:24:13.710776 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1734/3384] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:13 2022] GET /compute/v2.1/servers/ca640d8e-17ec-4ff3-940f-39d6976115f7 => generated 1474 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:14.385244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-affe98e6-c940-4bf0-9194-1ae22d8e82b1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:14.388580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-affe98e6-c940-4bf0-9194-1ae22d8e82b1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: 3352e598-ef65-4283-84cd-3e196542b17a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:14.401201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-affe98e6-c940-4bf0-9194-1ae22d8e82b1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:14.402100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-affe98e6-c940-4bf0-9194-1ae22d8e82b1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:14.403209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-affe98e6-c940-4bf0-9194-1ae22d8e82b1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:14.404135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-affe98e6-c940-4bf0-9194-1ae22d8e82b1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:14.634574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-affe98e6-c940-4bf0-9194-1ae22d8e82b1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:14.642907 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-affe98e6-c940-4bf0-9194-1ae22d8e82b1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a" status: 200 len: 1222 microversion: 2.1 time: 0.279437 May 21 21:24:14.645443 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1651/3385] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:14 2022] GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a => generated 1222 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:14.729501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ed383b1a-bf37-4e41-87db-0df0a4a8311f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:14.730187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ed383b1a-bf37-4e41-87db-0df0a4a8311f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: ca640d8e-17ec-4ff3-940f-39d6976115f7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:14.737569 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed383b1a-bf37-4e41-87db-0df0a4a8311f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:14.738621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed383b1a-bf37-4e41-87db-0df0a4a8311f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:14.739665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed383b1a-bf37-4e41-87db-0df0a4a8311f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:14.740186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed383b1a-bf37-4e41-87db-0df0a4a8311f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:15.218392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ed383b1a-bf37-4e41-87db-0df0a4a8311f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:15.245602 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ed383b1a-bf37-4e41-87db-0df0a4a8311f tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/ca640d8e-17ec-4ff3-940f-39d6976115f7" status: 200 len: 1474 microversion: 2.1 time: 0.521288 May 21 21:24:15.248864 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1735/3386] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:14 2022] GET /compute/v2.1/servers/ca640d8e-17ec-4ff3-940f-39d6976115f7 => generated 1474 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:15.505594 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-2553c1af-4678-4562-919b-6fc60f330dfc req-eb6291e8-6c8f-4357-9411-3d54ea9de6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca640d8e-17ec-4ff3-940f-39d6976115f7", "name": "network-vif-deleted", "tag": "57aedb68-8786-41c1-bf7a-e68c09bd3910"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:15.545174 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2553c1af-4678-4562-919b-6fc60f330dfc req-eb6291e8-6c8f-4357-9411-3d54ea9de6c7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:15.546505 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2553c1af-4678-4562-919b-6fc60f330dfc req-eb6291e8-6c8f-4357-9411-3d54ea9de6c7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:15.589693 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-2553c1af-4678-4562-919b-6fc60f330dfc req-eb6291e8-6c8f-4357-9411-3d54ea9de6c7 service nova] Creating event network-vif-deleted:57aedb68-8786-41c1-bf7a-e68c09bd3910 for instance ca640d8e-17ec-4ff3-940f-39d6976115f7 on nch2-master-1 May 21 21:24:15.618517 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-2553c1af-4678-4562-919b-6fc60f330dfc req-eb6291e8-6c8f-4357-9411-3d54ea9de6c7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119109 May 21 21:24:15.622475 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1652/3387] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:15.665527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-97e15c1b-9918-45aa-83b8-2bfde4bfa9b1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:15.666588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-97e15c1b-9918-45aa-83b8-2bfde4bfa9b1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: 3352e598-ef65-4283-84cd-3e196542b17a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:15.678915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-97e15c1b-9918-45aa-83b8-2bfde4bfa9b1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:15.688783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-97e15c1b-9918-45aa-83b8-2bfde4bfa9b1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:15.693024 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-97e15c1b-9918-45aa-83b8-2bfde4bfa9b1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:15.695406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-97e15c1b-9918-45aa-83b8-2bfde4bfa9b1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:15.822981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-713ce26a-2987-4711-b0f7-4cfd240a3e2e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:15.832624 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-713ce26a-2987-4711-b0f7-4cfd240a3e2e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:15.856892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-713ce26a-2987-4711-b0f7-4cfd240a3e2e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:15.857735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-713ce26a-2987-4711-b0f7-4cfd240a3e2e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:15.858781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-713ce26a-2987-4711-b0f7-4cfd240a3e2e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:15.859403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-713ce26a-2987-4711-b0f7-4cfd240a3e2e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:15.920563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-97e15c1b-9918-45aa-83b8-2bfde4bfa9b1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:15.934671 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-97e15c1b-9918-45aa-83b8-2bfde4bfa9b1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a" status: 200 len: 1270 microversion: 2.1 time: 0.273537 May 21 21:24:15.940591 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1736/3388] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:15 2022] GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a => generated 1270 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:16.268008 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ede5fa77-3b68-43bf-a967-a327b932630a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:16.268673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ede5fa77-3b68-43bf-a967-a327b932630a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: ca640d8e-17ec-4ff3-940f-39d6976115f7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:16.275902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ede5fa77-3b68-43bf-a967-a327b932630a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:16.276566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ede5fa77-3b68-43bf-a967-a327b932630a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:16.277501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ede5fa77-3b68-43bf-a967-a327b932630a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:16.278107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ede5fa77-3b68-43bf-a967-a327b932630a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:16.334568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ede5fa77-3b68-43bf-a967-a327b932630a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:16.335337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ede5fa77-3b68-43bf-a967-a327b932630a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:16.336435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-ede5fa77-3b68-43bf-a967-a327b932630a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lazy-loading 'fault' on Instance uuid ca640d8e-17ec-4ff3-940f-39d6976115f7 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:24:16.438650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ede5fa77-3b68-43bf-a967-a327b932630a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:16.463100 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ede5fa77-3b68-43bf-a967-a327b932630a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/ca640d8e-17ec-4ff3-940f-39d6976115f7" status: 200 len: 1308 microversion: 2.1 time: 0.199707 May 21 21:24:16.483766 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1737/3389] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:16 2022] GET /compute/v2.1/servers/ca640d8e-17ec-4ff3-940f-39d6976115f7 => generated 1308 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:16.558645 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-560156fb-5c66-47c3-ac6a-6e9e97f7b582 req-3d83483a-bd95-4ab1-9c79-33829f1628e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1266ea2-eb23-4de6-aec8-18d3fa3bf575", "name": "network-vif-deleted", "tag": "a183580b-a33f-41bf-a265-a6c95d1b8b88"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:16.568673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-560156fb-5c66-47c3-ac6a-6e9e97f7b582 req-3d83483a-bd95-4ab1-9c79-33829f1628e7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:16.569417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-560156fb-5c66-47c3-ac6a-6e9e97f7b582 req-3d83483a-bd95-4ab1-9c79-33829f1628e7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:16.582638 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-560156fb-5c66-47c3-ac6a-6e9e97f7b582 req-3d83483a-bd95-4ab1-9c79-33829f1628e7 service nova] Creating event network-vif-deleted:a183580b-a33f-41bf-a265-a6c95d1b8b88 for instance f1266ea2-eb23-4de6-aec8-18d3fa3bf575 on nch1-master-1 May 21 21:24:16.588402 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-560156fb-5c66-47c3-ac6a-6e9e97f7b582 req-3d83483a-bd95-4ab1-9c79-33829f1628e7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033509 May 21 21:24:16.589768 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1738/3390] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:16.812629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-713ce26a-2987-4711-b0f7-4cfd240a3e2e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:16.830944 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:16.836789 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-713ce26a-2987-4711-b0f7-4cfd240a3e2e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 1.021044 May 21 21:24:16.852113 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1653/3391] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:15 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:16.857936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-eea7f13e-6899-4275-a4b7-6d745db594c7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:16.859372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-eea7f13e-6899-4275-a4b7-6d745db594c7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:16.878852 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eea7f13e-6899-4275-a4b7-6d745db594c7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:16.879827 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eea7f13e-6899-4275-a4b7-6d745db594c7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:16.880875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eea7f13e-6899-4275-a4b7-6d745db594c7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:16.883391 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eea7f13e-6899-4275-a4b7-6d745db594c7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:16.921966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:16.958853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c968092b-ce4f-4a81-a14d-12fb324a62f6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:16.959509 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c968092b-ce4f-4a81-a14d-12fb324a62f6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: 3352e598-ef65-4283-84cd-3e196542b17a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:16.976740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c968092b-ce4f-4a81-a14d-12fb324a62f6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:16.980980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c968092b-ce4f-4a81-a14d-12fb324a62f6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:16.982196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c968092b-ce4f-4a81-a14d-12fb324a62f6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:16.984615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c968092b-ce4f-4a81-a14d-12fb324a62f6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:17.158387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c968092b-ce4f-4a81-a14d-12fb324a62f6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:17.167021 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c968092b-ce4f-4a81-a14d-12fb324a62f6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a" status: 200 len: 1276 microversion: 2.1 time: 0.213645 May 21 21:24:17.168227 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1654/3392] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:16 2022] GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a => generated 1276 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:17.208942 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-eea7f13e-6899-4275-a4b7-6d745db594c7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:17.227491 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-eea7f13e-6899-4275-a4b7-6d745db594c7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.366116 May 21 21:24:17.228832 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1739/3393] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:16 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:17.246948 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-21dc066f-e8ec-41f3-98cf-67b00d225d8a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:17.247936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-21dc066f-e8ec-41f3-98cf-67b00d225d8a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:17.256349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21dc066f-e8ec-41f3-98cf-67b00d225d8a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:17.257289 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21dc066f-e8ec-41f3-98cf-67b00d225d8a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:17.258438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21dc066f-e8ec-41f3-98cf-67b00d225d8a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:17.259663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21dc066f-e8ec-41f3-98cf-67b00d225d8a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:17.487092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9704ebbe-79e4-4ffa-ba21-9227dc8ba600 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:17.488030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9704ebbe-79e4-4ffa-ba21-9227dc8ba600 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: ca640d8e-17ec-4ff3-940f-39d6976115f7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:17.494626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9704ebbe-79e4-4ffa-ba21-9227dc8ba600 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:17.495733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9704ebbe-79e4-4ffa-ba21-9227dc8ba600 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:17.496509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9704ebbe-79e4-4ffa-ba21-9227dc8ba600 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:17.497253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9704ebbe-79e4-4ffa-ba21-9227dc8ba600 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:17.512045 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-9704ebbe-79e4-4ffa-ba21-9227dc8ba600 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] HTTP exception thrown: Instance ca640d8e-17ec-4ff3-940f-39d6976115f7 could not be found. May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9704ebbe-79e4-4ffa-ba21-9227dc8ba600 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Request method failure captured: May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/ca640d8e-17ec-4ff3-940f-39d6976115f7 HTTP/1.1 May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVfeSY4PanwHWYM_Qqj37PIvqjgimb9f6eJUN2bYrvqv_D5vZtFPwax8yL4acL_cj0mYADfUVytBdBv8LWst7KOmg4kq3BRXBvS9zK8F4crRFLGGQD03QxF0xJhAqFR68TsjXkAi9W-0sot8Wol3kNmJZEySYdx8qhgarMjMzLq0D9o May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 00752ed7cdc0495dbf5533e82dccc017 May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_00752ed7cdc0495dbf5533e82dccc017", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 00752ed7cdc0495dbf5533e82dccc017 May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersOnMultiNodesTest-1845796292-project May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 945ab557c0e24cfdbcab74684a5d5800 May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersOnMultiNodesTest-1845796292-project May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance ca640d8e-17ec-4ff3-940f-39d6976115f7 could not be found. May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'ca640d8e-17ec-4ff3-940f-39d6976115f7'} May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca640d8e-17ec-4ff3-940f-39d6976115f7 could not be found. May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca640d8e-17ec-4ff3-940f-39d6976115f7 could not be found. May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:17.514077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:17.518470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:17.518470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:17.518470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:17.518470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:24:17.518470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:24:17.518470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca640d8e-17ec-4ff3-940f-39d6976115f7 could not be found. May 21 21:24:17.518470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:17.520070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9704ebbe-79e4-4ffa-ba21-9227dc8ba600 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Returning 404 to user: Instance ca640d8e-17ec-4ff3-940f-39d6976115f7 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:24:17.521207 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9704ebbe-79e4-4ffa-ba21-9227dc8ba600 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/ca640d8e-17ec-4ff3-940f-39d6976115f7" status: 404 len: 111 microversion: 2.1 time: 0.038997 May 21 21:24:17.521743 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1740/3394] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:17 2022] GET /compute/v2.1/servers/ca640d8e-17ec-4ff3-940f-39d6976115f7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:24:17.529629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-15eb7c65-d334-44bf-8afd-dd0458ff7a0a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:17.530757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-15eb7c65-d334-44bf-8afd-dd0458ff7a0a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:17.537872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15eb7c65-d334-44bf-8afd-dd0458ff7a0a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:17.538257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15eb7c65-d334-44bf-8afd-dd0458ff7a0a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:17.539817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15eb7c65-d334-44bf-8afd-dd0458ff7a0a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:17.540462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15eb7c65-d334-44bf-8afd-dd0458ff7a0a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:17.577317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15eb7c65-d334-44bf-8afd-dd0458ff7a0a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:17.578045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15eb7c65-d334-44bf-8afd-dd0458ff7a0a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:17.578794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-15eb7c65-d334-44bf-8afd-dd0458ff7a0a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lazy-loading 'fault' on Instance uuid f1266ea2-eb23-4de6-aec8-18d3fa3bf575 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:24:17.618365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-21dc066f-e8ec-41f3-98cf-67b00d225d8a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:17.650887 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-21dc066f-e8ec-41f3-98cf-67b00d225d8a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.408180 May 21 21:24:17.651498 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1655/3395] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:17 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:17.675581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-185af89d-6dbb-472a-87cd-449abec33f23 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:17.680597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-185af89d-6dbb-472a-87cd-449abec33f23 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:17.704653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-185af89d-6dbb-472a-87cd-449abec33f23 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:17.707481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-185af89d-6dbb-472a-87cd-449abec33f23 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:17.708540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-185af89d-6dbb-472a-87cd-449abec33f23 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:17.712854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-15eb7c65-d334-44bf-8afd-dd0458ff7a0a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:17.713383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-185af89d-6dbb-472a-87cd-449abec33f23 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:17.727527 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-15eb7c65-d334-44bf-8afd-dd0458ff7a0a tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 200 len: 1308 microversion: 2.1 time: 0.201502 May 21 21:24:17.733190 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1741/3396] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:17 2022] GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 1308 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:18.041770 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-185af89d-6dbb-472a-87cd-449abec33f23 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action" status: 202 len: 0 microversion: 2.1 time: 0.369258 May 21 21:24:18.042532 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1656/3397] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:24:17 2022] POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:24:18.052141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-23c62ced-891b-45b7-8d2a-45d06e093921 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:18.052930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-23c62ced-891b-45b7-8d2a-45d06e093921 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:18.061676 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23c62ced-891b-45b7-8d2a-45d06e093921 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:18.062100 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23c62ced-891b-45b7-8d2a-45d06e093921 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:18.062972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23c62ced-891b-45b7-8d2a-45d06e093921 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:18.063488 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23c62ced-891b-45b7-8d2a-45d06e093921 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:18.188261 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d5b0592e-d2d2-4109-bb7f-0833bfa61b9d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:18.189873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d5b0592e-d2d2-4109-bb7f-0833bfa61b9d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: 3352e598-ef65-4283-84cd-3e196542b17a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:18.210344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5b0592e-d2d2-4109-bb7f-0833bfa61b9d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:18.217663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5b0592e-d2d2-4109-bb7f-0833bfa61b9d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:18.218703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5b0592e-d2d2-4109-bb7f-0833bfa61b9d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:18.219888 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5b0592e-d2d2-4109-bb7f-0833bfa61b9d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:18.363498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d5b0592e-d2d2-4109-bb7f-0833bfa61b9d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:18.377839 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d5b0592e-d2d2-4109-bb7f-0833bfa61b9d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a" status: 200 len: 1276 microversion: 2.1 time: 0.195109 May 21 21:24:18.378831 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1657/3398] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:18 2022] GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a => generated 1276 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:18.481502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-23c62ced-891b-45b7-8d2a-45d06e093921 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:18.499995 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-23c62ced-891b-45b7-8d2a-45d06e093921 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1670 microversion: 2.1 time: 0.452794 May 21 21:24:18.501363 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1742/3399] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:18 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1670 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:18.750167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-70700f29-9571-4504-9058-0259ee250497 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:18.751089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-70700f29-9571-4504-9058-0259ee250497 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: f1266ea2-eb23-4de6-aec8-18d3fa3bf575] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:18.760687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-70700f29-9571-4504-9058-0259ee250497 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:18.761447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-70700f29-9571-4504-9058-0259ee250497 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:18.762466 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-70700f29-9571-4504-9058-0259ee250497 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:18.763048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-70700f29-9571-4504-9058-0259ee250497 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:18.779587 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-70700f29-9571-4504-9058-0259ee250497 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] HTTP exception thrown: Instance f1266ea2-eb23-4de6-aec8-18d3fa3bf575 could not be found. May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-70700f29-9571-4504-9058-0259ee250497 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Request method failure captured: May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 HTTP/1.1 May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVfeSY4PanwHWYM_Qqj37PIvqjgimb9f6eJUN2bYrvqv_D5vZtFPwax8yL4acL_cj0mYADfUVytBdBv8LWst7KOmg4kq3BRXBvS9zK8F4crRFLGGQD03QxF0xJhAqFR68TsjXkAi9W-0sot8Wol3kNmJZEySYdx8qhgarMjMzLq0D9o May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 00752ed7cdc0495dbf5533e82dccc017 May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_00752ed7cdc0495dbf5533e82dccc017", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 00752ed7cdc0495dbf5533e82dccc017 May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersOnMultiNodesTest-1845796292-project May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 945ab557c0e24cfdbcab74684a5d5800 May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersOnMultiNodesTest-1845796292-project May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance f1266ea2-eb23-4de6-aec8-18d3fa3bf575 could not be found. May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'f1266ea2-eb23-4de6-aec8-18d3fa3bf575'} May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1266ea2-eb23-4de6-aec8-18d3fa3bf575 could not be found. May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1266ea2-eb23-4de6-aec8-18d3fa3bf575 could not be found. May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:18.782731 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:18.787460 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:18.787460 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:18.787460 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:18.787460 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:24:18.787460 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:24:18.787460 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1266ea2-eb23-4de6-aec8-18d3fa3bf575 could not be found. May 21 21:24:18.787460 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:18.787460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-70700f29-9571-4504-9058-0259ee250497 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Returning 404 to user: Instance f1266ea2-eb23-4de6-aec8-18d3fa3bf575 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:24:18.788900 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-70700f29-9571-4504-9058-0259ee250497 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575" status: 404 len: 111 microversion: 2.1 time: 0.043013 May 21 21:24:18.789935 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1658/3400] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:18 2022] GET /compute/v2.1/servers/f1266ea2-eb23-4de6-aec8-18d3fa3bf575 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:24:18.798160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9276f32a-8007-4d79-b3ae-c8463770a481 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:18.902521 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9276f32a-8007-4d79-b3ae-c8463770a481 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/4c2367df-271d-4b8f-a5dd-415602156def" status: 204 len: 0 microversion: 2.1 time: 0.108262 May 21 21:24:18.903168 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1743/3401] 10.222.0.49 () {58 vars in 1265 bytes} [Sat May 21 21:24:18 2022] DELETE /compute/v2.1/os-server-groups/4c2367df-271d-4b8f-a5dd-415602156def => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:24:18.924008 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4082e6b0-42f2-428f-91f1-1f43fda5792d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:18.924687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4082e6b0-42f2-428f-91f1-1f43fda5792d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 97b22b0c-a0a1-48d7-96b0-448cbabe4fae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:18.931555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4082e6b0-42f2-428f-91f1-1f43fda5792d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:18.932314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4082e6b0-42f2-428f-91f1-1f43fda5792d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:18.933433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4082e6b0-42f2-428f-91f1-1f43fda5792d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:18.934150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4082e6b0-42f2-428f-91f1-1f43fda5792d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:18.965634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4082e6b0-42f2-428f-91f1-1f43fda5792d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 97b22b0c-a0a1-48d7-96b0-448cbabe4fae] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:24:19.258799 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4082e6b0-42f2-428f-91f1-1f43fda5792d tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "DELETE /compute/v2.1/servers/97b22b0c-a0a1-48d7-96b0-448cbabe4fae" status: 204 len: 0 microversion: 2.1 time: 0.346882 May 21 21:24:19.262513 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1659/3402] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:24:18 2022] DELETE /compute/v2.1/servers/97b22b0c-a0a1-48d7-96b0-448cbabe4fae => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:24:19.268515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3c5022b7-80a3-4b39-9c06-078206707f87 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:19.270194 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3c5022b7-80a3-4b39-9c06-078206707f87 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:19.286848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c5022b7-80a3-4b39-9c06-078206707f87 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:19.287568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c5022b7-80a3-4b39-9c06-078206707f87 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:19.288507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c5022b7-80a3-4b39-9c06-078206707f87 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:19.289057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c5022b7-80a3-4b39-9c06-078206707f87 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:19.320793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3c5022b7-80a3-4b39-9c06-078206707f87 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:24:19.396579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bf66f042-25f5-40d7-b2ad-d67516c2bcbb tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:19.397281 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bf66f042-25f5-40d7-b2ad-d67516c2bcbb tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: 3352e598-ef65-4283-84cd-3e196542b17a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:19.400259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:19.404224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf66f042-25f5-40d7-b2ad-d67516c2bcbb tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:19.404631 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf66f042-25f5-40d7-b2ad-d67516c2bcbb tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:19.410163 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf66f042-25f5-40d7-b2ad-d67516c2bcbb tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:19.410163 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf66f042-25f5-40d7-b2ad-d67516c2bcbb tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:19.658772 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3c5022b7-80a3-4b39-9c06-078206707f87 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb" status: 204 len: 0 microversion: 2.1 time: 0.394445 May 21 21:24:19.659368 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1744/3403] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:24:19 2022] DELETE /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:24:19.669445 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-476b1712-7306-4a9d-b177-3aba0f19ddd9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:19.670304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-476b1712-7306-4a9d-b177-3aba0f19ddd9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:19.677414 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-476b1712-7306-4a9d-b177-3aba0f19ddd9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:19.677874 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-476b1712-7306-4a9d-b177-3aba0f19ddd9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:19.678663 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-476b1712-7306-4a9d-b177-3aba0f19ddd9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:19.679094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-476b1712-7306-4a9d-b177-3aba0f19ddd9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:19.837687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-476b1712-7306-4a9d-b177-3aba0f19ddd9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:19.845723 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-476b1712-7306-4a9d-b177-3aba0f19ddd9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1670 microversion: 2.1 time: 0.185184 May 21 21:24:19.846307 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1745/3404] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:19 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1670 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:19.850763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e38ae850-bbaf-4180-bb72-043eb6d3f6e5 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:19.851545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e38ae850-bbaf-4180-bb72-043eb6d3f6e5 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 97b22b0c-a0a1-48d7-96b0-448cbabe4fae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:19.857830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e38ae850-bbaf-4180-bb72-043eb6d3f6e5 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:19.858280 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e38ae850-bbaf-4180-bb72-043eb6d3f6e5 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:19.859044 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e38ae850-bbaf-4180-bb72-043eb6d3f6e5 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:19.859481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e38ae850-bbaf-4180-bb72-043eb6d3f6e5 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:20.013872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e38ae850-bbaf-4180-bb72-043eb6d3f6e5 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:20.021919 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e38ae850-bbaf-4180-bb72-043eb6d3f6e5 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/97b22b0c-a0a1-48d7-96b0-448cbabe4fae" status: 200 len: 1475 microversion: 2.1 time: 0.174639 May 21 21:24:20.022569 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1746/3405] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:19 2022] GET /compute/v2.1/servers/97b22b0c-a0a1-48d7-96b0-448cbabe4fae => generated 1475 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:20.306482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bf66f042-25f5-40d7-b2ad-d67516c2bcbb tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:20.315118 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bf66f042-25f5-40d7-b2ad-d67516c2bcbb tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a" status: 200 len: 1318 microversion: 2.1 time: 0.923643 May 21 21:24:20.315698 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1660/3406] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:19 2022] GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a => generated 1318 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:20.864907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-56fdb9ee-7d69-4c8f-8f4e-2945f29358b5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:20.865506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-56fdb9ee-7d69-4c8f-8f4e-2945f29358b5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:20.872922 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56fdb9ee-7d69-4c8f-8f4e-2945f29358b5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:20.873371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56fdb9ee-7d69-4c8f-8f4e-2945f29358b5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:20.874151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56fdb9ee-7d69-4c8f-8f4e-2945f29358b5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:20.874590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56fdb9ee-7d69-4c8f-8f4e-2945f29358b5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:21.048485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b6ef415f-2f23-48dc-bc92-c3ab99417ef2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:21.051948 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b6ef415f-2f23-48dc-bc92-c3ab99417ef2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 97b22b0c-a0a1-48d7-96b0-448cbabe4fae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:21.073928 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6ef415f-2f23-48dc-bc92-c3ab99417ef2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:21.074421 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6ef415f-2f23-48dc-bc92-c3ab99417ef2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:21.075279 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6ef415f-2f23-48dc-bc92-c3ab99417ef2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:21.079012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6ef415f-2f23-48dc-bc92-c3ab99417ef2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:21.108090 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-56fdb9ee-7d69-4c8f-8f4e-2945f29358b5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:21.120835 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-56fdb9ee-7d69-4c8f-8f4e-2945f29358b5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1675 microversion: 2.1 time: 0.260711 May 21 21:24:21.122018 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1747/3407] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:20 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1675 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:21.335465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b6692e29-d105-428b-847c-9dc926da1955 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:21.336103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b6692e29-d105-428b-847c-9dc926da1955 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: 3352e598-ef65-4283-84cd-3e196542b17a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:21.349697 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6692e29-d105-428b-847c-9dc926da1955 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:21.350158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6692e29-d105-428b-847c-9dc926da1955 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:21.351748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6692e29-d105-428b-847c-9dc926da1955 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:21.352192 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6692e29-d105-428b-847c-9dc926da1955 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:21.557435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b6ef415f-2f23-48dc-bc92-c3ab99417ef2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:21.568215 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b6ef415f-2f23-48dc-bc92-c3ab99417ef2 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/97b22b0c-a0a1-48d7-96b0-448cbabe4fae" status: 200 len: 1475 microversion: 2.1 time: 0.531109 May 21 21:24:21.572933 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1661/3408] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:21 2022] GET /compute/v2.1/servers/97b22b0c-a0a1-48d7-96b0-448cbabe4fae => generated 1475 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:21.827822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:21.846043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b6692e29-d105-428b-847c-9dc926da1955 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:21.858586 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b6692e29-d105-428b-847c-9dc926da1955 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a" status: 200 len: 1318 microversion: 2.1 time: 0.528340 May 21 21:24:21.858586 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1748/3409] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:21 2022] GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a => generated 1318 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:22.128355 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-7d7b3398-1885-4606-8127-3cd9f56932cd req-2ab377fe-600c-4a44-8257-f21e426cf739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3352e598-ef65-4283-84cd-3e196542b17a", "tag": "18479ac1-1c1f-4d4a-bb62-4cd78ba39fac"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:22.149230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c6ec15fe-c410-458f-87ff-84d9ddcca9a7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:22.149230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c6ec15fe-c410-458f-87ff-84d9ddcca9a7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:22.190559 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6ec15fe-c410-458f-87ff-84d9ddcca9a7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:22.191023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6ec15fe-c410-458f-87ff-84d9ddcca9a7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:22.193973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6ec15fe-c410-458f-87ff-84d9ddcca9a7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:22.195495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6ec15fe-c410-458f-87ff-84d9ddcca9a7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:22.199316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-7d7b3398-1885-4606-8127-3cd9f56932cd req-2ab377fe-600c-4a44-8257-f21e426cf739 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:22.200734 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-7d7b3398-1885-4606-8127-3cd9f56932cd req-2ab377fe-600c-4a44-8257-f21e426cf739 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:22.243456 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-7d7b3398-1885-4606-8127-3cd9f56932cd req-2ab377fe-600c-4a44-8257-f21e426cf739 service nova] Creating event network-changed:18479ac1-1c1f-4d4a-bb62-4cd78ba39fac for instance 3352e598-ef65-4283-84cd-3e196542b17a on nch2-master-1 May 21 21:24:22.260241 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-7d7b3398-1885-4606-8127-3cd9f56932cd req-2ab377fe-600c-4a44-8257-f21e426cf739 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138493 May 21 21:24:22.262839 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1662/3410] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:22.554087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c6ec15fe-c410-458f-87ff-84d9ddcca9a7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:22.561945 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c6ec15fe-c410-458f-87ff-84d9ddcca9a7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.427102 May 21 21:24:22.563159 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1749/3411] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:22 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:22.584858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9d8d5bdd-53a0-4453-be7c-3591702cba6c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:22.585732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9d8d5bdd-53a0-4453-be7c-3591702cba6c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 97b22b0c-a0a1-48d7-96b0-448cbabe4fae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:22.588586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4275002e-1b1e-450d-83b0-3da64b2af6d8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:22.590291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4275002e-1b1e-450d-83b0-3da64b2af6d8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:22.598850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d8d5bdd-53a0-4453-be7c-3591702cba6c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:22.601777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d8d5bdd-53a0-4453-be7c-3591702cba6c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:22.603519 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4275002e-1b1e-450d-83b0-3da64b2af6d8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:22.604586 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d8d5bdd-53a0-4453-be7c-3591702cba6c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:22.605369 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d8d5bdd-53a0-4453-be7c-3591702cba6c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:22.605992 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4275002e-1b1e-450d-83b0-3da64b2af6d8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:22.611648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4275002e-1b1e-450d-83b0-3da64b2af6d8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:22.612347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4275002e-1b1e-450d-83b0-3da64b2af6d8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:22.725772 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4275002e-1b1e-450d-83b0-3da64b2af6d8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action" status: 200 len: 143 microversion: 2.1 time: 0.148961 May 21 21:24:22.728816 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1663/3412] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:24:22 2022] POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action => generated 143 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:22.749291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fe1ac508-2327-42f9-99dd-94946e5cd083 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:22.750985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fe1ac508-2327-42f9-99dd-94946e5cd083 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:22.781328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fe1ac508-2327-42f9-99dd-94946e5cd083 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:22.783356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fe1ac508-2327-42f9-99dd-94946e5cd083 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:22.785567 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fe1ac508-2327-42f9-99dd-94946e5cd083 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:22.788263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fe1ac508-2327-42f9-99dd-94946e5cd083 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:22.867480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9d8d5bdd-53a0-4453-be7c-3591702cba6c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:22.879170 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9d8d5bdd-53a0-4453-be7c-3591702cba6c tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/97b22b0c-a0a1-48d7-96b0-448cbabe4fae" status: 200 len: 1433 microversion: 2.1 time: 0.297928 May 21 21:24:22.882356 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1750/3413] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:22 2022] GET /compute/v2.1/servers/97b22b0c-a0a1-48d7-96b0-448cbabe4fae => generated 1433 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:22.892393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-4f05a47c-a362-437a-8136-44764ebb3f2d req-11960f0a-5783-421b-955f-eb7bca81e25e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b22b0c-a0a1-48d7-96b0-448cbabe4fae", "name": "network-vif-deleted", "tag": "a0c5cbf4-ae56-4f2d-a540-a0044b6063ac"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:22.910866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-4f05a47c-a362-437a-8136-44764ebb3f2d req-11960f0a-5783-421b-955f-eb7bca81e25e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:22.911319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-4f05a47c-a362-437a-8136-44764ebb3f2d req-11960f0a-5783-421b-955f-eb7bca81e25e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:22.931027 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-4f05a47c-a362-437a-8136-44764ebb3f2d req-11960f0a-5783-421b-955f-eb7bca81e25e service nova] Creating event network-vif-deleted:a0c5cbf4-ae56-4f2d-a540-a0044b6063ac for instance 97b22b0c-a0a1-48d7-96b0-448cbabe4fae on nch1-master-1 May 21 21:24:22.938194 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-4f05a47c-a362-437a-8136-44764ebb3f2d req-11960f0a-5783-421b-955f-eb7bca81e25e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054027 May 21 21:24:22.943534 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1751/3414] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:22.949558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1f976dfe-5c08-4813-a948-51969c221657 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:22.950487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1f976dfe-5c08-4813-a948-51969c221657 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: 3352e598-ef65-4283-84cd-3e196542b17a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:22.957557 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f976dfe-5c08-4813-a948-51969c221657 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:22.958007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f976dfe-5c08-4813-a948-51969c221657 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:22.958842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f976dfe-5c08-4813-a948-51969c221657 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:22.959287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f976dfe-5c08-4813-a948-51969c221657 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:23.280199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1f976dfe-5c08-4813-a948-51969c221657 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:23.291542 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1f976dfe-5c08-4813-a948-51969c221657 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a" status: 200 len: 1318 microversion: 2.1 time: 0.346137 May 21 21:24:23.293466 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1752/3415] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:22 2022] GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:23.476532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fe1ac508-2327-42f9-99dd-94946e5cd083 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:23.489061 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fe1ac508-2327-42f9-99dd-94946e5cd083 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.752523 May 21 21:24:23.489959 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1664/3416] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:22 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:23.509971 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-98357c4c-aeeb-4b5a-a0bf-1a0310405b87 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:23.510761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-98357c4c-aeeb-4b5a-a0bf-1a0310405b87 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:23.515188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=10 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:23.520250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98357c4c-aeeb-4b5a-a0bf-1a0310405b87 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:23.520901 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98357c4c-aeeb-4b5a-a0bf-1a0310405b87 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:23.521793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98357c4c-aeeb-4b5a-a0bf-1a0310405b87 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:23.522471 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98357c4c-aeeb-4b5a-a0bf-1a0310405b87 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:23.806111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-98357c4c-aeeb-4b5a-a0bf-1a0310405b87 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:23.816010 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-98357c4c-aeeb-4b5a-a0bf-1a0310405b87 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.310879 May 21 21:24:23.816776 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1753/3417] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:23 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:23.832621 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7f3edabe-bd8c-4c2f-93a3-74d4a87bc1c1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:23.833244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7f3edabe-bd8c-4c2f-93a3-74d4a87bc1c1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:23.841069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f3edabe-bd8c-4c2f-93a3-74d4a87bc1c1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:23.841532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f3edabe-bd8c-4c2f-93a3-74d4a87bc1c1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:23.842481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f3edabe-bd8c-4c2f-93a3-74d4a87bc1c1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:23.842935 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f3edabe-bd8c-4c2f-93a3-74d4a87bc1c1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:23.900544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3addeb8c-a1d6-4980-8616-8a979a9a41ea tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:23.901333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3addeb8c-a1d6-4980-8616-8a979a9a41ea tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 97b22b0c-a0a1-48d7-96b0-448cbabe4fae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:23.913639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3addeb8c-a1d6-4980-8616-8a979a9a41ea tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:23.914814 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3addeb8c-a1d6-4980-8616-8a979a9a41ea tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:23.915910 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3addeb8c-a1d6-4980-8616-8a979a9a41ea tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:23.916496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3addeb8c-a1d6-4980-8616-8a979a9a41ea tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:23.961004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3addeb8c-a1d6-4980-8616-8a979a9a41ea tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:23.961543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3addeb8c-a1d6-4980-8616-8a979a9a41ea tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:23.962077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-3addeb8c-a1d6-4980-8616-8a979a9a41ea tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lazy-loading 'fault' on Instance uuid 97b22b0c-a0a1-48d7-96b0-448cbabe4fae {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:24:24.016257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3addeb8c-a1d6-4980-8616-8a979a9a41ea tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:24.026385 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3addeb8c-a1d6-4980-8616-8a979a9a41ea tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/97b22b0c-a0a1-48d7-96b0-448cbabe4fae" status: 200 len: 1309 microversion: 2.1 time: 0.131223 May 21 21:24:24.027240 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1754/3418] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:23 2022] GET /compute/v2.1/servers/97b22b0c-a0a1-48d7-96b0-448cbabe4fae => generated 1309 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:24.246048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7f3edabe-bd8c-4c2f-93a3-74d4a87bc1c1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:24.256097 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7f3edabe-bd8c-4c2f-93a3-74d4a87bc1c1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.427465 May 21 21:24:24.256817 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1665/3419] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:23 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:24.272815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e598009c-24c7-4554-af3d-f28509c1e8ea tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:24.274111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e598009c-24c7-4554-af3d-f28509c1e8ea tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:24.285223 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e598009c-24c7-4554-af3d-f28509c1e8ea tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:24.286015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e598009c-24c7-4554-af3d-f28509c1e8ea tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:24.286397 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-db89b175-dfc9-424b-a2c4-aa26235699df req-5f7fff4f-3e22-42af-9802-072bd9162963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea895b96-a96b-4720-bc93-1a4e1d50bac0", "tag": "b97a1855-3c36-491b-a93a-ed87fc808537"}, {"server_uuid": "4a3e8eee-b681-4b0a-becf-41eb4d6b19fb", "name": "network-vif-deleted", "tag": "93ef5409-7b0f-46d9-afec-d432287a117d"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:24.286528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e598009c-24c7-4554-af3d-f28509c1e8ea tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:24.286879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e598009c-24c7-4554-af3d-f28509c1e8ea tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:24.295364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-db89b175-dfc9-424b-a2c4-aa26235699df req-5f7fff4f-3e22-42af-9802-072bd9162963 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:24.295804 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-db89b175-dfc9-424b-a2c4-aa26235699df req-5f7fff4f-3e22-42af-9802-072bd9162963 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:24.309558 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-db89b175-dfc9-424b-a2c4-aa26235699df req-5f7fff4f-3e22-42af-9802-072bd9162963 service nova] Creating event network-changed:b97a1855-3c36-491b-a93a-ed87fc808537 for instance ea895b96-a96b-4720-bc93-1a4e1d50bac0 on nch2-master-1 May 21 21:24:24.310063 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-db89b175-dfc9-424b-a2c4-aa26235699df req-5f7fff4f-3e22-42af-9802-072bd9162963 service nova] Creating event network-vif-deleted:93ef5409-7b0f-46d9-afec-d432287a117d for instance 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb on nch1-master-1 May 21 21:24:24.319621 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-db89b175-dfc9-424b-a2c4-aa26235699df req-5f7fff4f-3e22-42af-9802-072bd9162963 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.037798 May 21 21:24:24.320143 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1666/3420] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:24:24.325134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6c95115f-823d-4c2a-927e-3f3dfa76474d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:24.326041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6c95115f-823d-4c2a-927e-3f3dfa76474d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: 3352e598-ef65-4283-84cd-3e196542b17a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:24.333704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c95115f-823d-4c2a-927e-3f3dfa76474d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:24.334388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c95115f-823d-4c2a-927e-3f3dfa76474d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:24.335173 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c95115f-823d-4c2a-927e-3f3dfa76474d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:24.335653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c95115f-823d-4c2a-927e-3f3dfa76474d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:24.554218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e598009c-24c7-4554-af3d-f28509c1e8ea tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:24.561395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:24.569072 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e598009c-24c7-4554-af3d-f28509c1e8ea tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.300601 May 21 21:24:24.570042 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1755/3421] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:24 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:24.688049 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e4e1a2fe-8e46-475a-b247-499e223c2bf2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-707899654", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "5d4cf0c3-1319-4035-9b9a-7c7b54e6e093"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:24.748743 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-e4e1a2fe-8e46-475a-b247-499e223c2bf2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] validate_networks() for [('5d4cf0c3-1319-4035-9b9a-7c7b54e6e093', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:24:25.194966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6c95115f-823d-4c2a-927e-3f3dfa76474d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:25.205685 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6c95115f-823d-4c2a-927e-3f3dfa76474d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a" status: 200 len: 1318 microversion: 2.1 time: 0.884156 May 21 21:24:25.207759 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1667/3422] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:24 2022] GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a => generated 1318 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:25.213219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e39de982-4262-49ef-8405-9d6b066680cd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:25.214051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e39de982-4262-49ef-8405-9d6b066680cd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 97b22b0c-a0a1-48d7-96b0-448cbabe4fae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:25.229911 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e39de982-4262-49ef-8405-9d6b066680cd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:25.230572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e39de982-4262-49ef-8405-9d6b066680cd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:25.231510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e39de982-4262-49ef-8405-9d6b066680cd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:25.232831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e39de982-4262-49ef-8405-9d6b066680cd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:25.252122 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-e39de982-4262-49ef-8405-9d6b066680cd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] HTTP exception thrown: Instance 97b22b0c-a0a1-48d7-96b0-448cbabe4fae could not be found. May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e39de982-4262-49ef-8405-9d6b066680cd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Request method failure captured: May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/97b22b0c-a0a1-48d7-96b0-448cbabe4fae HTTP/1.1 May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVfeSY4PanwHWYM_Qqj37PIvqjgimb9f6eJUN2bYrvqv_D5vZtFPwax8yL4acL_cj0mYADfUVytBdBv8LWst7KOmg4kq3BRXBvS9zK8F4crRFLGGQD03QxF0xJhAqFR68TsjXkAi9W-0sot8Wol3kNmJZEySYdx8qhgarMjMzLq0D9o May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 00752ed7cdc0495dbf5533e82dccc017 May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_00752ed7cdc0495dbf5533e82dccc017", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 00752ed7cdc0495dbf5533e82dccc017 May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersOnMultiNodesTest-1845796292-project May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 945ab557c0e24cfdbcab74684a5d5800 May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersOnMultiNodesTest-1845796292-project May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 97b22b0c-a0a1-48d7-96b0-448cbabe4fae could not be found. May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '97b22b0c-a0a1-48d7-96b0-448cbabe4fae'} May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97b22b0c-a0a1-48d7-96b0-448cbabe4fae could not be found. May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97b22b0c-a0a1-48d7-96b0-448cbabe4fae could not be found. May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:25.254134 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:25.259599 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:25.259599 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:25.259599 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:25.259599 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:24:25.259599 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:24:25.259599 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97b22b0c-a0a1-48d7-96b0-448cbabe4fae could not be found. May 21 21:24:25.259599 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:25.263100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e39de982-4262-49ef-8405-9d6b066680cd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Returning 404 to user: Instance 97b22b0c-a0a1-48d7-96b0-448cbabe4fae could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:24:25.268527 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e39de982-4262-49ef-8405-9d6b066680cd tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/97b22b0c-a0a1-48d7-96b0-448cbabe4fae" status: 404 len: 111 microversion: 2.1 time: 0.055209 May 21 21:24:25.268527 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1668/3423] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:25 2022] GET /compute/v2.1/servers/97b22b0c-a0a1-48d7-96b0-448cbabe4fae => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:24:25.274944 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3882b443-ce5f-41c1-a178-966e272ceff9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:25.275565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3882b443-ce5f-41c1-a178-966e272ceff9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:25.287048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3882b443-ce5f-41c1-a178-966e272ceff9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:25.287666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3882b443-ce5f-41c1-a178-966e272ceff9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:25.289046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3882b443-ce5f-41c1-a178-966e272ceff9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:25.289489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3882b443-ce5f-41c1-a178-966e272ceff9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:25.310401 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-3882b443-ce5f-41c1-a178-966e272ceff9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] HTTP exception thrown: Instance 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb could not be found. May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3882b443-ce5f-41c1-a178-966e272ceff9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Request method failure captured: May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb HTTP/1.1 May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVfeSY4PanwHWYM_Qqj37PIvqjgimb9f6eJUN2bYrvqv_D5vZtFPwax8yL4acL_cj0mYADfUVytBdBv8LWst7KOmg4kq3BRXBvS9zK8F4crRFLGGQD03QxF0xJhAqFR68TsjXkAi9W-0sot8Wol3kNmJZEySYdx8qhgarMjMzLq0D9o May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 00752ed7cdc0495dbf5533e82dccc017 May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_00752ed7cdc0495dbf5533e82dccc017", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 00752ed7cdc0495dbf5533e82dccc017 May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersOnMultiNodesTest-1845796292-project May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 945ab557c0e24cfdbcab74684a5d5800 May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersOnMultiNodesTest-1845796292-project May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb could not be found. May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '4a3e8eee-b681-4b0a-becf-41eb4d6b19fb'} May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb could not be found. May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb could not be found. May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:25.313153 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:25.317935 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:25.317935 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:25.317935 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:25.317935 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:24:25.317935 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:24:25.317935 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb could not be found. May 21 21:24:25.317935 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:25.317935 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3882b443-ce5f-41c1-a178-966e272ceff9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Returning 404 to user: Instance 4a3e8eee-b681-4b0a-becf-41eb4d6b19fb could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:24:25.317935 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3882b443-ce5f-41c1-a178-966e272ceff9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb" status: 404 len: 111 microversion: 2.1 time: 0.044745 May 21 21:24:25.317935 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1669/3424] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:25 2022] GET /compute/v2.1/servers/4a3e8eee-b681-4b0a-becf-41eb4d6b19fb => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:24:25.324676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d9a0b9b2-7b5d-496d-a761-6f4f2cf31811 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:25.414161 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d9a0b9b2-7b5d-496d-a761-6f4f2cf31811 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/ef2f2b7c-8671-4cf6-ac5a-42662612f946" status: 204 len: 0 microversion: 2.1 time: 0.093614 May 21 21:24:25.414972 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1670/3425] 10.222.0.49 () {58 vars in 1265 bytes} [Sat May 21 21:24:25 2022] DELETE /compute/v2.1/os-server-groups/ef2f2b7c-8671-4cf6-ac5a-42662612f946 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:24:25.424444 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f48fc125-3cea-40f4-9616-aee6590fb066 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:25.425162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f48fc125-3cea-40f4-9616-aee6590fb066 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:25.426033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e4e1a2fe-8e46-475a-b247-499e223c2bf2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:24:25.426496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e4e1a2fe-8e46-475a-b247-499e223c2bf2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:24:25.426946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e4e1a2fe-8e46-475a-b247-499e223c2bf2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:24:25.428567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e4e1a2fe-8e46-475a-b247-499e223c2bf2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:24:25.429065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e4e1a2fe-8e46-475a-b247-499e223c2bf2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:24:25.435383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f48fc125-3cea-40f4-9616-aee6590fb066 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:25.437086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f48fc125-3cea-40f4-9616-aee6590fb066 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:25.437828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f48fc125-3cea-40f4-9616-aee6590fb066 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:25.438389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f48fc125-3cea-40f4-9616-aee6590fb066 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:25.439271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e4e1a2fe-8e46-475a-b247-499e223c2bf2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:25.439925 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e4e1a2fe-8e46-475a-b247-499e223c2bf2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:25.440809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e4e1a2fe-8e46-475a-b247-499e223c2bf2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:25.441249 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e4e1a2fe-8e46-475a-b247-499e223c2bf2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:25.463625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-e4e1a2fe-8e46-475a-b247-499e223c2bf2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Getting quotas for project 014ae80b3f434bcb9fa2629ccdf4aad7. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:24:25.469947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-e4e1a2fe-8e46-475a-b247-499e223c2bf2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Getting quotas for user 1cafab0cbef64be59c7afef84d7888ff and project 014ae80b3f434bcb9fa2629ccdf4aad7. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:24:25.470112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f48fc125-3cea-40f4-9616-aee6590fb066 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:24:25.484248 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e4e1a2fe-8e46-475a-b247-499e223c2bf2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:24:25.488053 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e4e1a2fe-8e46-475a-b247-499e223c2bf2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:24:25.516184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:25.649719 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e4e1a2fe-8e46-475a-b247-499e223c2bf2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.966442 May 21 21:24:25.650507 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1756/3426] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:24:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 21 21:24:25.661419 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-18e4e829-d393-4419-bb3f-15b89b78d23f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:25.662149 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-18e4e829-d393-4419-bb3f-15b89b78d23f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:25.744113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-18e4e829-d393-4419-bb3f-15b89b78d23f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:25.758086 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-18e4e829-d393-4419-bb3f-15b89b78d23f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1214 microversion: 2.1 time: 0.100531 May 21 21:24:25.759144 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1757/3427] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:25 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:25.836886 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f48fc125-3cea-40f4-9616-aee6590fb066 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 204 len: 0 microversion: 2.1 time: 0.410627 May 21 21:24:25.841181 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1671/3428] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:24:25 2022] DELETE /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 21:24:25.850377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-14d76f96-89de-4015-b632-fa10537454e8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:25.851201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-14d76f96-89de-4015-b632-fa10537454e8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:25.859677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14d76f96-89de-4015-b632-fa10537454e8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:25.860250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14d76f96-89de-4015-b632-fa10537454e8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:25.861565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14d76f96-89de-4015-b632-fa10537454e8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:25.862355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14d76f96-89de-4015-b632-fa10537454e8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:26.106345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-14d76f96-89de-4015-b632-fa10537454e8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:26.116825 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-14d76f96-89de-4015-b632-fa10537454e8 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1472 microversion: 2.1 time: 0.270511 May 21 21:24:26.118054 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1758/3429] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:25 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1472 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:26.224369 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d3b885d4-bacf-4634-a861-e9ab41c37f49 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:26.224998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d3b885d4-bacf-4634-a861-e9ab41c37f49 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: 3352e598-ef65-4283-84cd-3e196542b17a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:26.242989 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3b885d4-bacf-4634-a861-e9ab41c37f49 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:26.243474 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3b885d4-bacf-4634-a861-e9ab41c37f49 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:26.244811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3b885d4-bacf-4634-a861-e9ab41c37f49 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:26.245263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3b885d4-bacf-4634-a861-e9ab41c37f49 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:26.377289 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e037abb9-6806-462d-8046-11375bebfb2f tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1855475753", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "4b305730-55ee-464b-a8a0-a91cdbccbf26"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:26.448264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-e037abb9-6806-462d-8046-11375bebfb2f tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] validate_networks() for [('4b305730-55ee-464b-a8a0-a91cdbccbf26', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:24:26.455708 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d3b885d4-bacf-4634-a861-e9ab41c37f49 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:26.463683 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d3b885d4-bacf-4634-a861-e9ab41c37f49 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a" status: 200 len: 1318 microversion: 2.1 time: 0.243831 May 21 21:24:26.464416 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1759/3430] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:26 2022] GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:26.776930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aa668445-cb3c-4202-97d6-b4238e0edf0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:26.777585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aa668445-cb3c-4202-97d6-b4238e0edf0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:26.784743 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa668445-cb3c-4202-97d6-b4238e0edf0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:26.785465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa668445-cb3c-4202-97d6-b4238e0edf0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:26.787207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa668445-cb3c-4202-97d6-b4238e0edf0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:26.787722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa668445-cb3c-4202-97d6-b4238e0edf0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:26.857095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aa668445-cb3c-4202-97d6-b4238e0edf0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:26.870886 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aa668445-cb3c-4202-97d6-b4238e0edf0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1218 microversion: 2.1 time: 0.098802 May 21 21:24:26.871886 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1760/3431] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:26 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:27.134706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7edfb7a6-e6ce-4b03-9bd2-727c217c92d9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:27.135409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7edfb7a6-e6ce-4b03-9bd2-727c217c92d9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:27.145218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7edfb7a6-e6ce-4b03-9bd2-727c217c92d9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:27.145666 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7edfb7a6-e6ce-4b03-9bd2-727c217c92d9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:27.146615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7edfb7a6-e6ce-4b03-9bd2-727c217c92d9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:27.147399 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7edfb7a6-e6ce-4b03-9bd2-727c217c92d9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:27.311984 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7edfb7a6-e6ce-4b03-9bd2-727c217c92d9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:27.322154 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7edfb7a6-e6ce-4b03-9bd2-727c217c92d9 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1472 microversion: 2.1 time: 0.191301 May 21 21:24:27.332335 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1761/3432] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:27 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1472 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:27.356255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-e037abb9-6806-462d-8046-11375bebfb2f tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:24:27.356863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-e037abb9-6806-462d-8046-11375bebfb2f tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:24:27.357336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-e037abb9-6806-462d-8046-11375bebfb2f tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:24:27.357908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-e037abb9-6806-462d-8046-11375bebfb2f tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:24:27.360166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-e037abb9-6806-462d-8046-11375bebfb2f tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:24:27.368934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e037abb9-6806-462d-8046-11375bebfb2f tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:27.369395 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e037abb9-6806-462d-8046-11375bebfb2f tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:27.370307 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e037abb9-6806-462d-8046-11375bebfb2f tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:27.370920 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e037abb9-6806-462d-8046-11375bebfb2f tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:27.391227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-e037abb9-6806-462d-8046-11375bebfb2f tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Getting quotas for project 1361e32a370e47a9bd4121c5e8a1bbab. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:24:27.397497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-e037abb9-6806-462d-8046-11375bebfb2f tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Getting quotas for user 4c9c832b56ed4ec3a601ba39287dcc43 and project 1361e32a370e47a9bd4121c5e8a1bbab. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:24:27.411929 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e037abb9-6806-462d-8046-11375bebfb2f tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:24:27.414383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e037abb9-6806-462d-8046-11375bebfb2f tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:24:27.482083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f1f41dac-bccb-4f89-8f22-27520ebcf931 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:27.482705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f1f41dac-bccb-4f89-8f22-27520ebcf931 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: 3352e598-ef65-4283-84cd-3e196542b17a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:27.489780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1f41dac-bccb-4f89-8f22-27520ebcf931 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:27.490224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1f41dac-bccb-4f89-8f22-27520ebcf931 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:27.490997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1f41dac-bccb-4f89-8f22-27520ebcf931 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:27.491431 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1f41dac-bccb-4f89-8f22-27520ebcf931 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:27.651988 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e037abb9-6806-462d-8046-11375bebfb2f tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.454422 May 21 21:24:27.658114 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1672/3433] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:24:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:24:27.670654 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-156ecc7d-447f-4b5f-aa4b-a7c0ff48bf45 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:27.677879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-156ecc7d-447f-4b5f-aa4b-a7c0ff48bf45 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:27.683573 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f1f41dac-bccb-4f89-8f22-27520ebcf931 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:27.694796 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f1f41dac-bccb-4f89-8f22-27520ebcf931 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a" status: 200 len: 1318 microversion: 2.1 time: 0.216420 May 21 21:24:27.712761 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1762/3434] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:27 2022] GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:27.894414 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-081b2dc9-67e4-448f-bc8b-cedef9b01e4c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:27.896167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-081b2dc9-67e4-448f-bc8b-cedef9b01e4c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:27.912390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-081b2dc9-67e4-448f-bc8b-cedef9b01e4c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:27.912390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-081b2dc9-67e4-448f-bc8b-cedef9b01e4c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:27.912390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-081b2dc9-67e4-448f-bc8b-cedef9b01e4c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:27.912390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-081b2dc9-67e4-448f-bc8b-cedef9b01e4c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:27.940048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-156ecc7d-447f-4b5f-aa4b-a7c0ff48bf45 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c9c832b56ed4ec3a601ba39287dcc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1361e32a370e47a9bd4121c5e8a1bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:27.950531 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-156ecc7d-447f-4b5f-aa4b-a7c0ff48bf45 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 200 len: 1217 microversion: 2.1 time: 0.284455 May 21 21:24:27.951278 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1673/3435] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:27 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 1217 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:27.992513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-081b2dc9-67e4-448f-bc8b-cedef9b01e4c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:28.002008 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-081b2dc9-67e4-448f-bc8b-cedef9b01e4c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1266 microversion: 2.1 time: 0.112329 May 21 21:24:28.002866 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1763/3436] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:27 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:28.342021 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e68d71bb-af26-4e63-9a90-a12fa6cf77b1 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:28.345985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e68d71bb-af26-4e63-9a90-a12fa6cf77b1 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:28.357602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e68d71bb-af26-4e63-9a90-a12fa6cf77b1 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:28.358479 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e68d71bb-af26-4e63-9a90-a12fa6cf77b1 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:28.359675 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e68d71bb-af26-4e63-9a90-a12fa6cf77b1 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:28.360406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e68d71bb-af26-4e63-9a90-a12fa6cf77b1 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:28.543989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e68d71bb-af26-4e63-9a90-a12fa6cf77b1 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:28.554122 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e68d71bb-af26-4e63-9a90-a12fa6cf77b1 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1472 microversion: 2.1 time: 0.217427 May 21 21:24:28.554932 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1674/3437] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:28 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1472 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:28.666724 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-5e507410-8e1f-45ab-b2ed-fc944797bbfa req-88bd5074-00e9-4a39-b398-0c3e8ac02385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2402f588-3d04-418d-ac2d-d38d77c92205", "name": "network-vif-deleted", "tag": "07cc5127-42d1-43e3-bab2-5dd19189b67c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:28.688814 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5e507410-8e1f-45ab-b2ed-fc944797bbfa req-88bd5074-00e9-4a39-b398-0c3e8ac02385 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:28.690334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5e507410-8e1f-45ab-b2ed-fc944797bbfa req-88bd5074-00e9-4a39-b398-0c3e8ac02385 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:28.704941 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-5e507410-8e1f-45ab-b2ed-fc944797bbfa req-88bd5074-00e9-4a39-b398-0c3e8ac02385 service nova] Creating event network-vif-deleted:07cc5127-42d1-43e3-bab2-5dd19189b67c for instance 2402f588-3d04-418d-ac2d-d38d77c92205 on nch1-master-1 May 21 21:24:28.710929 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-5e507410-8e1f-45ab-b2ed-fc944797bbfa req-88bd5074-00e9-4a39-b398-0c3e8ac02385 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049448 May 21 21:24:28.712239 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1764/3438] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:28.722383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4abf026b-3f35-4b8d-8796-5c759e3c497d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:28.723287 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4abf026b-3f35-4b8d-8796-5c759e3c497d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: 3352e598-ef65-4283-84cd-3e196542b17a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:28.737541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4abf026b-3f35-4b8d-8796-5c759e3c497d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:28.738291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4abf026b-3f35-4b8d-8796-5c759e3c497d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:28.739778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4abf026b-3f35-4b8d-8796-5c759e3c497d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:28.740422 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4abf026b-3f35-4b8d-8796-5c759e3c497d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:28.956235 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4abf026b-3f35-4b8d-8796-5c759e3c497d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:28.967244 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4abf026b-3f35-4b8d-8796-5c759e3c497d tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a" status: 200 len: 1318 microversion: 2.1 time: 0.247195 May 21 21:24:28.969871 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1675/3439] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:28 2022] GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:28.972809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-22d031d9-5e66-4591-afb9-c6a29cdf6014 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:28.973527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-22d031d9-5e66-4591-afb9-c6a29cdf6014 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:28.984183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:29.020421 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-47ddc8f5-9167-4a64-af00-99075d031722 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:29.023367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-47ddc8f5-9167-4a64-af00-99075d031722 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:29.043208 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-47ddc8f5-9167-4a64-af00-99075d031722 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:29.043629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-47ddc8f5-9167-4a64-af00-99075d031722 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:29.045710 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-47ddc8f5-9167-4a64-af00-99075d031722 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:29.046162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-47ddc8f5-9167-4a64-af00-99075d031722 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:29.112012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-22d031d9-5e66-4591-afb9-c6a29cdf6014 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c9c832b56ed4ec3a601ba39287dcc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1361e32a370e47a9bd4121c5e8a1bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:29.122710 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-22d031d9-5e66-4591-afb9-c6a29cdf6014 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 200 len: 1217 microversion: 2.1 time: 0.151659 May 21 21:24:29.124374 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1765/3440] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:28 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:29.257428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-47ddc8f5-9167-4a64-af00-99075d031722 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:29.287139 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-47ddc8f5-9167-4a64-af00-99075d031722 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1272 microversion: 2.1 time: 0.267183 May 21 21:24:29.287139 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1676/3441] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:29 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1272 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:29.571965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8b5dcaec-937d-4046-b930-a1aa52abc651 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:29.572697 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8b5dcaec-937d-4046-b930-a1aa52abc651 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:29.584372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b5dcaec-937d-4046-b930-a1aa52abc651 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:29.586711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b5dcaec-937d-4046-b930-a1aa52abc651 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:29.587611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b5dcaec-937d-4046-b930-a1aa52abc651 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:29.588061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b5dcaec-937d-4046-b930-a1aa52abc651 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:29.645314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b5dcaec-937d-4046-b930-a1aa52abc651 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:29.645721 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b5dcaec-937d-4046-b930-a1aa52abc651 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:29.646289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-8b5dcaec-937d-4046-b930-a1aa52abc651 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lazy-loading 'fault' on Instance uuid 2402f588-3d04-418d-ac2d-d38d77c92205 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:24:29.732018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8b5dcaec-937d-4046-b930-a1aa52abc651 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945ab557c0e24cfdbcab74684a5d5800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00752ed7cdc0495dbf5533e82dccc017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:29.740526 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8b5dcaec-937d-4046-b930-a1aa52abc651 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 200 len: 1306 microversion: 2.1 time: 0.173021 May 21 21:24:29.751364 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1766/3442] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:29 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 1306 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:29.770156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-95c9989d-38d7-493c-8ae8-925f73e21155 req-c168319d-e2d3-4e09-9c09-5976f5d80fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3352e598-ef65-4283-84cd-3e196542b17a", "name": "network-vif-plugged", "status": "completed", "tag": "18479ac1-1c1f-4d4a-bb62-4cd78ba39fac"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:29.782371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-95c9989d-38d7-493c-8ae8-925f73e21155 req-c168319d-e2d3-4e09-9c09-5976f5d80fb5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:29.783514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-95c9989d-38d7-493c-8ae8-925f73e21155 req-c168319d-e2d3-4e09-9c09-5976f5d80fb5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:29.806782 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-95c9989d-38d7-493c-8ae8-925f73e21155 req-c168319d-e2d3-4e09-9c09-5976f5d80fb5 service nova] Creating event network-vif-plugged:18479ac1-1c1f-4d4a-bb62-4cd78ba39fac for instance 3352e598-ef65-4283-84cd-3e196542b17a on nch2-master-1 May 21 21:24:29.819336 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-95c9989d-38d7-493c-8ae8-925f73e21155 req-c168319d-e2d3-4e09-9c09-5976f5d80fb5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053305 May 21 21:24:29.825314 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1677/3443] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:29.987452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f2ce6b44-9876-4444-a487-277f9763decc tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:29.988329 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f2ce6b44-9876-4444-a487-277f9763decc tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: 3352e598-ef65-4283-84cd-3e196542b17a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:29.998099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2ce6b44-9876-4444-a487-277f9763decc tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:29.998841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2ce6b44-9876-4444-a487-277f9763decc tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:30.000545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2ce6b44-9876-4444-a487-277f9763decc tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:30.001156 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2ce6b44-9876-4444-a487-277f9763decc tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:30.143736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4b163ba3-df9b-40f7-a1e0-c11a8906b160 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:30.145253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4b163ba3-df9b-40f7-a1e0-c11a8906b160 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:30.168651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b163ba3-df9b-40f7-a1e0-c11a8906b160 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:30.170491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b163ba3-df9b-40f7-a1e0-c11a8906b160 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:30.171512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b163ba3-df9b-40f7-a1e0-c11a8906b160 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:30.174783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b163ba3-df9b-40f7-a1e0-c11a8906b160 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:30.257570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f2ce6b44-9876-4444-a487-277f9763decc tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:30.270817 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f2ce6b44-9876-4444-a487-277f9763decc tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a" status: 200 len: 1318 microversion: 2.1 time: 0.288108 May 21 21:24:30.271788 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1767/3444] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:29 2022] GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:30.302283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c06fff96-8bfc-4ed2-b080-b5e2788cdc0a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:30.303056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c06fff96-8bfc-4ed2-b080-b5e2788cdc0a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:30.305187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4b163ba3-df9b-40f7-a1e0-c11a8906b160 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c9c832b56ed4ec3a601ba39287dcc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1361e32a370e47a9bd4121c5e8a1bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:30.311948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c06fff96-8bfc-4ed2-b080-b5e2788cdc0a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:30.316066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c06fff96-8bfc-4ed2-b080-b5e2788cdc0a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:30.317278 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c06fff96-8bfc-4ed2-b080-b5e2788cdc0a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:30.320043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c06fff96-8bfc-4ed2-b080-b5e2788cdc0a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:30.330595 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4b163ba3-df9b-40f7-a1e0-c11a8906b160 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 200 len: 1269 microversion: 2.1 time: 0.189715 May 21 21:24:30.339634 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1678/3445] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:30 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 1269 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:30.761633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-24eedd8c-636d-49e3-963d-b9b91a24b905 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:30.762748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-24eedd8c-636d-49e3-963d-b9b91a24b905 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] [instance: 2402f588-3d04-418d-ac2d-d38d77c92205] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:30.771459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24eedd8c-636d-49e3-963d-b9b91a24b905 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:30.772822 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24eedd8c-636d-49e3-963d-b9b91a24b905 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:30.775288 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24eedd8c-636d-49e3-963d-b9b91a24b905 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:30.776201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24eedd8c-636d-49e3-963d-b9b91a24b905 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:30.815767 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-24eedd8c-636d-49e3-963d-b9b91a24b905 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] HTTP exception thrown: Instance 2402f588-3d04-418d-ac2d-d38d77c92205 could not be found. May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-24eedd8c-636d-49e3-963d-b9b91a24b905 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Request method failure captured: May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 HTTP/1.1 May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVfeSY4PanwHWYM_Qqj37PIvqjgimb9f6eJUN2bYrvqv_D5vZtFPwax8yL4acL_cj0mYADfUVytBdBv8LWst7KOmg4kq3BRXBvS9zK8F4crRFLGGQD03QxF0xJhAqFR68TsjXkAi9W-0sot8Wol3kNmJZEySYdx8qhgarMjMzLq0D9o May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 00752ed7cdc0495dbf5533e82dccc017 May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_00752ed7cdc0495dbf5533e82dccc017", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00752ed7cdc0495dbf5533e82dccc017"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 00752ed7cdc0495dbf5533e82dccc017 May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1845796292 May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersOnMultiNodesTest-1845796292-project May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 945ab557c0e24cfdbcab74684a5d5800 May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersOnMultiNodesTest-1845796292-project May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 2402f588-3d04-418d-ac2d-d38d77c92205 could not be found. May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '2402f588-3d04-418d-ac2d-d38d77c92205'} May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2402f588-3d04-418d-ac2d-d38d77c92205 could not be found. May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2402f588-3d04-418d-ac2d-d38d77c92205 could not be found. May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:30.820204 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:30.825594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:30.825594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:30.825594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:30.825594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:24:30.825594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:24:30.825594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2402f588-3d04-418d-ac2d-d38d77c92205 could not be found. May 21 21:24:30.825594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:30.829120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-24eedd8c-636d-49e3-963d-b9b91a24b905 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] Returning 404 to user: Instance 2402f588-3d04-418d-ac2d-d38d77c92205 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:24:30.831096 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-24eedd8c-636d-49e3-963d-b9b91a24b905 tempest-ServersOnMultiNodesTest-1845796292 tempest-ServersOnMultiNodesTest-1845796292-project] 10.222.0.49 "GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205" status: 404 len: 111 microversion: 2.1 time: 0.076768 May 21 21:24:30.833168 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1679/3446] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:30 2022] GET /compute/v2.1/servers/2402f588-3d04-418d-ac2d-d38d77c92205 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:24:30.927211 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c06fff96-8bfc-4ed2-b080-b5e2788cdc0a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:30.936496 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c06fff96-8bfc-4ed2-b080-b5e2788cdc0a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1314 microversion: 2.1 time: 0.638258 May 21 21:24:30.937654 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1768/3447] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:30 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:31.297180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-744e98d2-7d69-4ec5-b04d-7c8b5d2f2657 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:31.300917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-744e98d2-7d69-4ec5-b04d-7c8b5d2f2657 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: 3352e598-ef65-4283-84cd-3e196542b17a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:31.320565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-744e98d2-7d69-4ec5-b04d-7c8b5d2f2657 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:31.321954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-744e98d2-7d69-4ec5-b04d-7c8b5d2f2657 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:31.325304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-744e98d2-7d69-4ec5-b04d-7c8b5d2f2657 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:31.326002 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-744e98d2-7d69-4ec5-b04d-7c8b5d2f2657 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:31.345170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-29c35043-d81e-4d40-b790-ab3662517501 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:31.346743 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-29c35043-d81e-4d40-b790-ab3662517501 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:31.363296 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29c35043-d81e-4d40-b790-ab3662517501 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:31.364214 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29c35043-d81e-4d40-b790-ab3662517501 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:31.373242 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29c35043-d81e-4d40-b790-ab3662517501 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:31.373242 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29c35043-d81e-4d40-b790-ab3662517501 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:31.561152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-29c35043-d81e-4d40-b790-ab3662517501 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c9c832b56ed4ec3a601ba39287dcc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1361e32a370e47a9bd4121c5e8a1bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:31.572550 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-29c35043-d81e-4d40-b790-ab3662517501 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 200 len: 1275 microversion: 2.1 time: 0.230864 May 21 21:24:31.572550 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1769/3448] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:31 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 1275 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:31.868540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-d05eb28c-fe62-4603-a774-c6c9cb8d8828 req-e11623d0-7bd1-4aa4-a1c6-a22ce7348f32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b995447a-7335-44b9-b320-e69e0b367044", "tag": "e1aa3212-fbaf-44c0-9915-1e4383a32087"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:31.890397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d05eb28c-fe62-4603-a774-c6c9cb8d8828 req-e11623d0-7bd1-4aa4-a1c6-a22ce7348f32 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:31.891328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d05eb28c-fe62-4603-a774-c6c9cb8d8828 req-e11623d0-7bd1-4aa4-a1c6-a22ce7348f32 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:31.951712 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-d05eb28c-fe62-4603-a774-c6c9cb8d8828 req-e11623d0-7bd1-4aa4-a1c6-a22ce7348f32 service nova] Creating event network-changed:e1aa3212-fbaf-44c0-9915-1e4383a32087 for instance b995447a-7335-44b9-b320-e69e0b367044 on nch1-master-1 May 21 21:24:31.962648 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-d05eb28c-fe62-4603-a774-c6c9cb8d8828 req-e11623d0-7bd1-4aa4-a1c6-a22ce7348f32 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099782 May 21 21:24:31.963634 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1770/3449] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:31.978449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-813cfd9c-d87a-4411-9e2e-92b8131d2e4c req-15e47ff3-10c9-4576-858c-7b5dac516995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea895b96-a96b-4720-bc93-1a4e1d50bac0", "name": "network-vif-plugged", "status": "completed", "tag": "b97a1855-3c36-491b-a93a-ed87fc808537"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:31.992450 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-813cfd9c-d87a-4411-9e2e-92b8131d2e4c req-15e47ff3-10c9-4576-858c-7b5dac516995 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:31.993234 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-813cfd9c-d87a-4411-9e2e-92b8131d2e4c req-15e47ff3-10c9-4576-858c-7b5dac516995 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:32.008910 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-813cfd9c-d87a-4411-9e2e-92b8131d2e4c req-15e47ff3-10c9-4576-858c-7b5dac516995 service nova] Creating event network-vif-plugged:b97a1855-3c36-491b-a93a-ed87fc808537 for instance ea895b96-a96b-4720-bc93-1a4e1d50bac0 on nch2-master-1 May 21 21:24:32.016474 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-813cfd9c-d87a-4411-9e2e-92b8131d2e4c req-15e47ff3-10c9-4576-858c-7b5dac516995 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050018 May 21 21:24:32.017810 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1771/3450] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:32.025540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8b56f321-a7eb-4505-aa5d-f300b69d5d7d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:32.038778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8b56f321-a7eb-4505-aa5d-f300b69d5d7d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:32.061806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b56f321-a7eb-4505-aa5d-f300b69d5d7d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:32.070237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b56f321-a7eb-4505-aa5d-f300b69d5d7d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:32.071735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b56f321-a7eb-4505-aa5d-f300b69d5d7d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:32.075459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b56f321-a7eb-4505-aa5d-f300b69d5d7d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:32.233393 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-744e98d2-7d69-4ec5-b04d-7c8b5d2f2657 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:32.253491 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-744e98d2-7d69-4ec5-b04d-7c8b5d2f2657 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a" status: 200 len: 1318 microversion: 2.1 time: 0.962288 May 21 21:24:32.254787 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1680/3451] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:31 2022] GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a => generated 1318 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:32.574003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8b56f321-a7eb-4505-aa5d-f300b69d5d7d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:32.585413 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8b56f321-a7eb-4505-aa5d-f300b69d5d7d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1314 microversion: 2.1 time: 0.565345 May 21 21:24:32.588482 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1772/3452] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:32 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:32.596502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f441da8c-dd6c-490f-98ac-9c7affe9b405 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:32.597778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f441da8c-dd6c-490f-98ac-9c7affe9b405 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:32.605651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f441da8c-dd6c-490f-98ac-9c7affe9b405 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:32.606043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f441da8c-dd6c-490f-98ac-9c7affe9b405 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:32.606859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f441da8c-dd6c-490f-98ac-9c7affe9b405 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:32.607508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f441da8c-dd6c-490f-98ac-9c7affe9b405 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:32.768775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f441da8c-dd6c-490f-98ac-9c7affe9b405 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c9c832b56ed4ec3a601ba39287dcc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1361e32a370e47a9bd4121c5e8a1bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:32.777661 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f441da8c-dd6c-490f-98ac-9c7affe9b405 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 200 len: 1275 microversion: 2.1 time: 0.193742 May 21 21:24:32.778236 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1681/3453] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:32 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 1275 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:33.270861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-21733170-eb7f-4420-a918-3e693a2a2bd1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:33.272270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-21733170-eb7f-4420-a918-3e693a2a2bd1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: 3352e598-ef65-4283-84cd-3e196542b17a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:33.279503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21733170-eb7f-4420-a918-3e693a2a2bd1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:33.280220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21733170-eb7f-4420-a918-3e693a2a2bd1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:33.281684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21733170-eb7f-4420-a918-3e693a2a2bd1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:33.282088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21733170-eb7f-4420-a918-3e693a2a2bd1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:33.448813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-21733170-eb7f-4420-a918-3e693a2a2bd1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:33.463521 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-21733170-eb7f-4420-a918-3e693a2a2bd1 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a" status: 200 len: 1505 microversion: 2.1 time: 0.196290 May 21 21:24:33.466551 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1773/3454] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:33 2022] GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a => generated 1505 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:33.483198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7ce1fa55-08cd-4e3c-ada6-ffe4444eac6b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:33.484905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7ce1fa55-08cd-4e3c-ada6-ffe4444eac6b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: ea895b96-a96b-4720-bc93-1a4e1d50bac0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:33.492570 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7ce1fa55-08cd-4e3c-ada6-ffe4444eac6b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:33.493291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7ce1fa55-08cd-4e3c-ada6-ffe4444eac6b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:33.494139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7ce1fa55-08cd-4e3c-ada6-ffe4444eac6b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:33.494584 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7ce1fa55-08cd-4e3c-ada6-ffe4444eac6b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:33.603165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3c1a6fa8-3d21-4e82-9e14-bb3a05325d85 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:33.604239 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3c1a6fa8-3d21-4e82-9e14-bb3a05325d85 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:33.612611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c1a6fa8-3d21-4e82-9e14-bb3a05325d85 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:33.613368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c1a6fa8-3d21-4e82-9e14-bb3a05325d85 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:33.614537 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c1a6fa8-3d21-4e82-9e14-bb3a05325d85 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:33.615128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c1a6fa8-3d21-4e82-9e14-bb3a05325d85 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:33.752602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7ce1fa55-08cd-4e3c-ada6-ffe4444eac6b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:33.763451 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7ce1fa55-08cd-4e3c-ada6-ffe4444eac6b tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/ea895b96-a96b-4720-bc93-1a4e1d50bac0" status: 200 len: 1318 microversion: 2.1 time: 0.284045 May 21 21:24:33.764851 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1682/3455] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:33 2022] GET /compute/v2.1/servers/ea895b96-a96b-4720-bc93-1a4e1d50bac0 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:33.799406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-19847336-916e-44ce-9c3d-602bb59c97c7 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:33.800729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-19847336-916e-44ce-9c3d-602bb59c97c7 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:33.818972 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19847336-916e-44ce-9c3d-602bb59c97c7 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:33.820620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19847336-916e-44ce-9c3d-602bb59c97c7 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:33.823180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19847336-916e-44ce-9c3d-602bb59c97c7 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:33.824523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19847336-916e-44ce-9c3d-602bb59c97c7 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:33.893396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3c1a6fa8-3d21-4e82-9e14-bb3a05325d85 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:33.901852 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3c1a6fa8-3d21-4e82-9e14-bb3a05325d85 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1314 microversion: 2.1 time: 0.302717 May 21 21:24:33.902497 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1774/3456] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:33 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:34.234578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-19847336-916e-44ce-9c3d-602bb59c97c7 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c9c832b56ed4ec3a601ba39287dcc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1361e32a370e47a9bd4121c5e8a1bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:34.246810 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-19847336-916e-44ce-9c3d-602bb59c97c7 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 200 len: 1317 microversion: 2.1 time: 0.454311 May 21 21:24:34.248162 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1683/3457] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:33 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:34.782740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-210bcb81-6d8e-4186-9935-0007172c14d4 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:34.783654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-210bcb81-6d8e-4186-9935-0007172c14d4 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: ea895b96-a96b-4720-bc93-1a4e1d50bac0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:34.792735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-210bcb81-6d8e-4186-9935-0007172c14d4 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:34.793317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-210bcb81-6d8e-4186-9935-0007172c14d4 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:34.794344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-210bcb81-6d8e-4186-9935-0007172c14d4 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:34.795024 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-210bcb81-6d8e-4186-9935-0007172c14d4 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:34.921140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e6aa910c-3a68-46b5-a0e3-fe03ab127abf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:34.922098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e6aa910c-3a68-46b5-a0e3-fe03ab127abf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:34.933173 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e6aa910c-3a68-46b5-a0e3-fe03ab127abf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:34.934845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e6aa910c-3a68-46b5-a0e3-fe03ab127abf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:34.942771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e6aa910c-3a68-46b5-a0e3-fe03ab127abf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:34.942771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e6aa910c-3a68-46b5-a0e3-fe03ab127abf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:35.032895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-210bcb81-6d8e-4186-9935-0007172c14d4 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:35.041351 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-210bcb81-6d8e-4186-9935-0007172c14d4 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/ea895b96-a96b-4720-bc93-1a4e1d50bac0" status: 200 len: 1505 microversion: 2.1 time: 0.263276 May 21 21:24:35.041938 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1775/3458] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:34 2022] GET /compute/v2.1/servers/ea895b96-a96b-4720-bc93-1a4e1d50bac0 => generated 1505 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:35.060396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ee7f1c6f-2a3a-4c3f-a60c-81069227c875 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:35.061270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ee7f1c6f-2a3a-4c3f-a60c-81069227c875 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: ea895b96-a96b-4720-bc93-1a4e1d50bac0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:35.068582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee7f1c6f-2a3a-4c3f-a60c-81069227c875 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:35.069220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee7f1c6f-2a3a-4c3f-a60c-81069227c875 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:35.070112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee7f1c6f-2a3a-4c3f-a60c-81069227c875 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:35.070654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee7f1c6f-2a3a-4c3f-a60c-81069227c875 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:35.109624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ee7f1c6f-2a3a-4c3f-a60c-81069227c875 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: ea895b96-a96b-4720-bc93-1a4e1d50bac0] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:24:35.114335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:35.304980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e6aa910c-3a68-46b5-a0e3-fe03ab127abf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:35.321984 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e6aa910c-3a68-46b5-a0e3-fe03ab127abf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1314 microversion: 2.1 time: 0.405632 May 21 21:24:35.323207 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1684/3459] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:34 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:35.340028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ceccc074-ed00-4d73-9da2-69a6916e0ed8 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:35.341246 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ceccc074-ed00-4d73-9da2-69a6916e0ed8 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:35.351073 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ceccc074-ed00-4d73-9da2-69a6916e0ed8 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:35.351784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ceccc074-ed00-4d73-9da2-69a6916e0ed8 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:35.352966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ceccc074-ed00-4d73-9da2-69a6916e0ed8 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:35.354196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ceccc074-ed00-4d73-9da2-69a6916e0ed8 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:35.452674 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ee7f1c6f-2a3a-4c3f-a60c-81069227c875 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ea895b96-a96b-4720-bc93-1a4e1d50bac0" status: 204 len: 0 microversion: 2.1 time: 0.395633 May 21 21:24:35.453543 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1776/3460] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:24:35 2022] DELETE /compute/v2.1/servers/ea895b96-a96b-4720-bc93-1a4e1d50bac0 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 21:24:35.469443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-46af73ea-3bde-497d-bc86-a223382a5f6e tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:35.470255 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-46af73ea-3bde-497d-bc86-a223382a5f6e tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: 3352e598-ef65-4283-84cd-3e196542b17a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:35.472427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:35.481285 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46af73ea-3bde-497d-bc86-a223382a5f6e tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:35.482416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46af73ea-3bde-497d-bc86-a223382a5f6e tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:35.484564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46af73ea-3bde-497d-bc86-a223382a5f6e tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:35.485359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46af73ea-3bde-497d-bc86-a223382a5f6e tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:35.536836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-46af73ea-3bde-497d-bc86-a223382a5f6e tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: 3352e598-ef65-4283-84cd-3e196542b17a] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:24:35.752909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ceccc074-ed00-4d73-9da2-69a6916e0ed8 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c9c832b56ed4ec3a601ba39287dcc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1361e32a370e47a9bd4121c5e8a1bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:35.771210 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ceccc074-ed00-4d73-9da2-69a6916e0ed8 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 200 len: 1317 microversion: 2.1 time: 0.446574 May 21 21:24:35.773014 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1685/3461] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:35 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:35.780049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-428875d3-350e-462d-b8cf-a05cc5dd65b3 req-28d58dbf-77a9-4a35-81c9-e31809fa8560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab8466bc-22eb-4ffa-9dfc-f9b112576c18", "tag": "aba7536e-9e7f-41ec-b3b2-062ce12b3e3b"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:35.791684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-428875d3-350e-462d-b8cf-a05cc5dd65b3 req-28d58dbf-77a9-4a35-81c9-e31809fa8560 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:35.792442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-428875d3-350e-462d-b8cf-a05cc5dd65b3 req-28d58dbf-77a9-4a35-81c9-e31809fa8560 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:35.808071 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-428875d3-350e-462d-b8cf-a05cc5dd65b3 req-28d58dbf-77a9-4a35-81c9-e31809fa8560 service nova] Creating event network-changed:aba7536e-9e7f-41ec-b3b2-062ce12b3e3b for instance ab8466bc-22eb-4ffa-9dfc-f9b112576c18 on nch1-master-1 May 21 21:24:35.814037 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-428875d3-350e-462d-b8cf-a05cc5dd65b3 req-28d58dbf-77a9-4a35-81c9-e31809fa8560 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039415 May 21 21:24:35.814967 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1686/3462] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:35.938851 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-46af73ea-3bde-497d-bc86-a223382a5f6e tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a" status: 204 len: 0 microversion: 2.1 time: 0.474405 May 21 21:24:35.942491 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1777/3463] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:24:35 2022] DELETE /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:24:35.950593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-82afd2bb-0b4b-40fa-b1a0-4f3b23b15828 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:35.951871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-82afd2bb-0b4b-40fa-b1a0-4f3b23b15828 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: ea895b96-a96b-4720-bc93-1a4e1d50bac0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:35.960681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-82afd2bb-0b4b-40fa-b1a0-4f3b23b15828 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:35.965231 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-82afd2bb-0b4b-40fa-b1a0-4f3b23b15828 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:35.965231 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-82afd2bb-0b4b-40fa-b1a0-4f3b23b15828 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:35.965231 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-82afd2bb-0b4b-40fa-b1a0-4f3b23b15828 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:36.334033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-82afd2bb-0b4b-40fa-b1a0-4f3b23b15828 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:36.344599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f162daef-62f9-4715-a352-dd20bc8baec6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:36.345342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f162daef-62f9-4715-a352-dd20bc8baec6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:36.353588 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-82afd2bb-0b4b-40fa-b1a0-4f3b23b15828 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/ea895b96-a96b-4720-bc93-1a4e1d50bac0" status: 200 len: 1511 microversion: 2.1 time: 0.408219 May 21 21:24:36.359459 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1687/3464] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:35 2022] GET /compute/v2.1/servers/ea895b96-a96b-4720-bc93-1a4e1d50bac0 => generated 1511 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:36.371275 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f162daef-62f9-4715-a352-dd20bc8baec6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:36.377173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f162daef-62f9-4715-a352-dd20bc8baec6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:36.377747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f162daef-62f9-4715-a352-dd20bc8baec6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:36.381284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f162daef-62f9-4715-a352-dd20bc8baec6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:36.614414 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f162daef-62f9-4715-a352-dd20bc8baec6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:36.628797 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f162daef-62f9-4715-a352-dd20bc8baec6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1314 microversion: 2.1 time: 0.292114 May 21 21:24:36.630567 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1778/3465] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:36 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:36.791520 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-97cd44f1-0c13-4fad-b4eb-3d7f11d8fac3 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:36.792270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-97cd44f1-0c13-4fad-b4eb-3d7f11d8fac3 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:36.800999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-97cd44f1-0c13-4fad-b4eb-3d7f11d8fac3 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:36.801641 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-97cd44f1-0c13-4fad-b4eb-3d7f11d8fac3 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:36.802514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-97cd44f1-0c13-4fad-b4eb-3d7f11d8fac3 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:36.803057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-97cd44f1-0c13-4fad-b4eb-3d7f11d8fac3 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:36.998768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-97cd44f1-0c13-4fad-b4eb-3d7f11d8fac3 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c9c832b56ed4ec3a601ba39287dcc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1361e32a370e47a9bd4121c5e8a1bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:37.008075 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-97cd44f1-0c13-4fad-b4eb-3d7f11d8fac3 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 200 len: 1317 microversion: 2.1 time: 0.221374 May 21 21:24:37.008689 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1688/3466] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:36 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:37.336016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2a1cd87b-fc1d-4cf1-86bb-5a173f503cf6 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:37.337440 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:24:37.337440 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:24:37.338660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a1cd87b-fc1d-4cf1-86bb-5a173f503cf6 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:37.339108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a1cd87b-fc1d-4cf1-86bb-5a173f503cf6 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:37.341365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a1cd87b-fc1d-4cf1-86bb-5a173f503cf6 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:37.341497 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a1cd87b-fc1d-4cf1-86bb-5a173f503cf6 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:37.366986 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2a1cd87b-fc1d-4cf1-86bb-5a173f503cf6 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.165963 May 21 21:24:37.368322 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1779/3467] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:24:37 2022] GET /compute/v2.1/os-services => generated 947 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:37.378511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-30e93076-d0d9-4d0e-970f-8da3b8124ab5 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:37.378788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-30e93076-d0d9-4d0e-970f-8da3b8124ab5 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: ea895b96-a96b-4720-bc93-1a4e1d50bac0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:37.380222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ee99e334-d75a-42f0-baaa-5649f6a33179 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:37.381945 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:24:37.381945 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:24:37.383190 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee99e334-d75a-42f0-baaa-5649f6a33179 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:37.383642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee99e334-d75a-42f0-baaa-5649f6a33179 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:37.384481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee99e334-d75a-42f0-baaa-5649f6a33179 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:37.384915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee99e334-d75a-42f0-baaa-5649f6a33179 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:37.386528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:37.388947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30e93076-d0d9-4d0e-970f-8da3b8124ab5 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:37.389713 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30e93076-d0d9-4d0e-970f-8da3b8124ab5 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:37.391828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30e93076-d0d9-4d0e-970f-8da3b8124ab5 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:37.392703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30e93076-d0d9-4d0e-970f-8da3b8124ab5 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:37.414451 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ee99e334-d75a-42f0-baaa-5649f6a33179 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.039082 May 21 21:24:37.415401 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1780/3468] 10.222.0.49 () {58 vars in 1169 bytes} [Sat May 21 21:24:37 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:37.427412 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4af4f39b-ab46-49a7-a98c-74dfbfdadb86 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:37.428774 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:24:37.428774 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:24:37.430393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4af4f39b-ab46-49a7-a98c-74dfbfdadb86 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:37.430908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4af4f39b-ab46-49a7-a98c-74dfbfdadb86 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:37.431784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4af4f39b-ab46-49a7-a98c-74dfbfdadb86 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:37.432302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4af4f39b-ab46-49a7-a98c-74dfbfdadb86 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:37.465160 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4af4f39b-ab46-49a7-a98c-74dfbfdadb86 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.041731 May 21 21:24:37.465776 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1781/3469] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:24:37 2022] GET /compute/v2.1/os-services => generated 947 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:37.476199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-644217db-861b-46d8-bab8-5de6f0c35075 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:37.477528 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:24:37.477528 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:24:37.478735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-644217db-861b-46d8-bab8-5de6f0c35075 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:37.482026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-644217db-861b-46d8-bab8-5de6f0c35075 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:37.482026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-644217db-861b-46d8-bab8-5de6f0c35075 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:37.482026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-644217db-861b-46d8-bab8-5de6f0c35075 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:37.505556 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-644217db-861b-46d8-bab8-5de6f0c35075 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.032654 May 21 21:24:37.506095 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1782/3470] 10.222.0.49 () {58 vars in 1195 bytes} [Sat May 21 21:24:37 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 21 21:24:37.517697 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-03dab92f-7fa3-43f2-b81f-c536f714f2fb tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:37.519157 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:24:37.519157 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:24:37.520409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-03dab92f-7fa3-43f2-b81f-c536f714f2fb tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:37.520872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-03dab92f-7fa3-43f2-b81f-c536f714f2fb tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:37.521684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-03dab92f-7fa3-43f2-b81f-c536f714f2fb tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:37.522293 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-03dab92f-7fa3-43f2-b81f-c536f714f2fb tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:37.548706 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-03dab92f-7fa3-43f2-b81f-c536f714f2fb tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.034830 May 21 21:24:37.554599 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1783/3471] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:24:37 2022] GET /compute/v2.1/os-services => generated 947 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:37.559669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-68f10685-967a-42cb-8a8e-be9dc75359b9 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:37.561036 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:24:37.561036 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:24:37.562775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-68f10685-967a-42cb-8a8e-be9dc75359b9 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:37.563279 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-68f10685-967a-42cb-8a8e-be9dc75359b9 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:37.564161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-68f10685-967a-42cb-8a8e-be9dc75359b9 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:37.568259 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-68f10685-967a-42cb-8a8e-be9dc75359b9 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:37.594153 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-68f10685-967a-42cb-8a8e-be9dc75359b9 tempest-ServicesAdminNegativeTestJSON-145085427 tempest-ServicesAdminNegativeTestJSON-145085427-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.034265 May 21 21:24:37.594153 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1784/3472] 10.222.0.49 () {58 vars in 1197 bytes} [Sat May 21 21:24:37 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 21 21:24:37.599919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-30e93076-d0d9-4d0e-970f-8da3b8124ab5 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:37.608930 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-30e93076-d0d9-4d0e-970f-8da3b8124ab5 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/ea895b96-a96b-4720-bc93-1a4e1d50bac0" status: 200 len: 1511 microversion: 2.1 time: 0.237461 May 21 21:24:37.611933 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1689/3473] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:37 2022] GET /compute/v2.1/servers/ea895b96-a96b-4720-bc93-1a4e1d50bac0 => generated 1511 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:37.662856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1b0b63b6-a6f9-4b39-b1f4-5f4a21fcc055 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:37.664054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1b0b63b6-a6f9-4b39-b1f4-5f4a21fcc055 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:37.672758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b0b63b6-a6f9-4b39-b1f4-5f4a21fcc055 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:37.674776 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b0b63b6-a6f9-4b39-b1f4-5f4a21fcc055 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:37.675807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b0b63b6-a6f9-4b39-b1f4-5f4a21fcc055 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:37.677353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b0b63b6-a6f9-4b39-b1f4-5f4a21fcc055 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:37.755485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-abe9de25-736c-4583-b352-c22e385ae94d tempest-ServicesAdminNegativeTestJSON-1614635213 tempest-ServicesAdminNegativeTestJSON-1614635213-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:37.756729 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:24:37.756729 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:24:37.757853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-abe9de25-736c-4583-b352-c22e385ae94d tempest-ServicesAdminNegativeTestJSON-1614635213 tempest-ServicesAdminNegativeTestJSON-1614635213-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'e3d1709bfcb0490fb7597f903638dc64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ea744cdd2945eeb7d9c7813fa58a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-abe9de25-736c-4583-b352-c22e385ae94d tempest-ServicesAdminNegativeTestJSON-1614635213 tempest-ServicesAdminNegativeTestJSON-1614635213-project] Request method failure captured: May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/os-services HTTP/1.1 May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiViUusIeLawXje18ObVysZeJZPn3c3l-OBLyEYCKw43dpqBY7Gdq_RP-NksfS1l1dbXyrWXIZgI_PnP7Fn7fkS6kTTvWH0CcWyssmZwSf8eiaym1TI45f4gGGjPnU0s8Gf4rHoMNdS0d_kFFVCFCeTk5roOGssasDN6WieEZRG_7L_4 May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 75ea744cdd2945eeb7d9c7813fa58a44 May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1614635213 May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/75ea744cdd2945eeb7d9c7813fa58a44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/75ea744cdd2945eeb7d9c7813fa58a44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_75ea744cdd2945eeb7d9c7813fa58a44", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/75ea744cdd2945eeb7d9c7813fa58a44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1614635213 May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 75ea744cdd2945eeb7d9c7813fa58a44 May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1614635213 May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServicesAdminNegativeTestJSON-1614635213-project May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: e3d1709bfcb0490fb7597f903638dc64 May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1614635213-project May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: action_args: {} May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.force_reraise() May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise self.value May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.enforce( May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. May 21 21:24:37.764440 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:37.770220 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:37.770220 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:37.770220 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:37.770220 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:37.770220 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:37.770220 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 21 21:24:37.770220 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 21 21:24:37.770220 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. May 21 21:24:37.770220 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:37.770220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-abe9de25-736c-4583-b352-c22e385ae94d tempest-ServicesAdminNegativeTestJSON-1614635213 tempest-ServicesAdminNegativeTestJSON-1614635213-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:24:37.770220 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-abe9de25-736c-4583-b352-c22e385ae94d tempest-ServicesAdminNegativeTestJSON-1614635213 tempest-ServicesAdminNegativeTestJSON-1614635213-project] 10.222.0.49 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.162344 May 21 21:24:37.770220 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1785/3474] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:24:37 2022] GET /compute/v2.1/os-services => generated 112 bytes in 166 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 21 21:24:37.774172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-cdff8c3f-b382-45d1-a0f6-6579c417712b req-487494fe-a6b5-4937-ae00-dfacfe100b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b995447a-7335-44b9-b320-e69e0b367044", "name": "network-vif-plugged", "status": "completed", "tag": "e1aa3212-fbaf-44c0-9915-1e4383a32087"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:37.788072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cdff8c3f-b382-45d1-a0f6-6579c417712b req-487494fe-a6b5-4937-ae00-dfacfe100b43 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:37.788566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cdff8c3f-b382-45d1-a0f6-6579c417712b req-487494fe-a6b5-4937-ae00-dfacfe100b43 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:37.820444 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-cdff8c3f-b382-45d1-a0f6-6579c417712b req-487494fe-a6b5-4937-ae00-dfacfe100b43 service nova] Creating event network-vif-plugged:e1aa3212-fbaf-44c0-9915-1e4383a32087 for instance b995447a-7335-44b9-b320-e69e0b367044 on nch1-master-1 May 21 21:24:37.825915 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-cdff8c3f-b382-45d1-a0f6-6579c417712b req-487494fe-a6b5-4937-ae00-dfacfe100b43 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055496 May 21 21:24:37.826702 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1786/3475] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:37.946222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=8 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:38.028764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4e49f803-9a2d-4bb6-9deb-5146268d57bb tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:38.029388 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4e49f803-9a2d-4bb6-9deb-5146268d57bb tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:38.039930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e49f803-9a2d-4bb6-9deb-5146268d57bb tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:38.040419 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e49f803-9a2d-4bb6-9deb-5146268d57bb tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:38.041201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e49f803-9a2d-4bb6-9deb-5146268d57bb tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:38.041641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e49f803-9a2d-4bb6-9deb-5146268d57bb tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:38.386275 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4e49f803-9a2d-4bb6-9deb-5146268d57bb tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c9c832b56ed4ec3a601ba39287dcc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1361e32a370e47a9bd4121c5e8a1bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:38.395491 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4e49f803-9a2d-4bb6-9deb-5146268d57bb tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 200 len: 1317 microversion: 2.1 time: 0.373805 May 21 21:24:38.396747 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1787/3476] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:38 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:38.605851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1b0b63b6-a6f9-4b39-b1f4-5f4a21fcc055 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:38.616942 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1b0b63b6-a6f9-4b39-b1f4-5f4a21fcc055 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1314 microversion: 2.1 time: 0.963783 May 21 21:24:38.618053 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1690/3477] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:37 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1314 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:38.632468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-782c4e2e-6400-4f27-80ac-18129a3f0518 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:38.632468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-782c4e2e-6400-4f27-80ac-18129a3f0518 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: ea895b96-a96b-4720-bc93-1a4e1d50bac0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:38.637672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-782c4e2e-6400-4f27-80ac-18129a3f0518 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:38.638269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-782c4e2e-6400-4f27-80ac-18129a3f0518 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:38.639136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-782c4e2e-6400-4f27-80ac-18129a3f0518 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:38.639726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-782c4e2e-6400-4f27-80ac-18129a3f0518 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:38.942613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-782c4e2e-6400-4f27-80ac-18129a3f0518 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:38.951597 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-782c4e2e-6400-4f27-80ac-18129a3f0518 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/ea895b96-a96b-4720-bc93-1a4e1d50bac0" status: 200 len: 1511 microversion: 2.1 time: 0.325099 May 21 21:24:38.962119 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1788/3478] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:38 2022] GET /compute/v2.1/servers/ea895b96-a96b-4720-bc93-1a4e1d50bac0 => generated 1511 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:39.414053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4abb297a-b9f2-4ed8-b206-4ad0b55821a8 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:39.414981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4abb297a-b9f2-4ed8-b206-4ad0b55821a8 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:39.424954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4abb297a-b9f2-4ed8-b206-4ad0b55821a8 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:39.425677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4abb297a-b9f2-4ed8-b206-4ad0b55821a8 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:39.426724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4abb297a-b9f2-4ed8-b206-4ad0b55821a8 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:39.427392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4abb297a-b9f2-4ed8-b206-4ad0b55821a8 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:39.433112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:39.634711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d153211e-2418-4de8-b93b-822a76a6fc74 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:39.635351 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d153211e-2418-4de8-b93b-822a76a6fc74 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:39.637352 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=10 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:39.643746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d153211e-2418-4de8-b93b-822a76a6fc74 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:39.644305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4abb297a-b9f2-4ed8-b206-4ad0b55821a8 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c9c832b56ed4ec3a601ba39287dcc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1361e32a370e47a9bd4121c5e8a1bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:39.644796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d153211e-2418-4de8-b93b-822a76a6fc74 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:39.645106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d153211e-2418-4de8-b93b-822a76a6fc74 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:39.645550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d153211e-2418-4de8-b93b-822a76a6fc74 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:39.651805 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4abb297a-b9f2-4ed8-b206-4ad0b55821a8 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 200 len: 1317 microversion: 2.1 time: 0.242449 May 21 21:24:39.652420 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1691/3479] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:39 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:39.799623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-b0579cfa-637b-401d-82ab-e13d9c6e6ab5 req-f9d09e6e-a11d-47e7-a80b-c38312d3ae68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea895b96-a96b-4720-bc93-1a4e1d50bac0", "name": "network-vif-deleted", "tag": "b97a1855-3c36-491b-a93a-ed87fc808537"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:39.807923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d153211e-2418-4de8-b93b-822a76a6fc74 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:39.808653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b0579cfa-637b-401d-82ab-e13d9c6e6ab5 req-f9d09e6e-a11d-47e7-a80b-c38312d3ae68 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:39.809224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b0579cfa-637b-401d-82ab-e13d9c6e6ab5 req-f9d09e6e-a11d-47e7-a80b-c38312d3ae68 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:39.816662 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d153211e-2418-4de8-b93b-822a76a6fc74 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1314 microversion: 2.1 time: 0.185862 May 21 21:24:39.817823 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1789/3480] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:39 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:39.821325 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-b0579cfa-637b-401d-82ab-e13d9c6e6ab5 req-f9d09e6e-a11d-47e7-a80b-c38312d3ae68 service nova] Creating event network-vif-deleted:b97a1855-3c36-491b-a93a-ed87fc808537 for instance ea895b96-a96b-4720-bc93-1a4e1d50bac0 on nch2-master-1 May 21 21:24:39.826441 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-b0579cfa-637b-401d-82ab-e13d9c6e6ab5 req-f9d09e6e-a11d-47e7-a80b-c38312d3ae68 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030848 May 21 21:24:39.826672 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1692/3481] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:39.972856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e58c7800-014c-46d8-84e3-ce8e75ba7679 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:39.974447 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e58c7800-014c-46d8-84e3-ce8e75ba7679 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: ea895b96-a96b-4720-bc93-1a4e1d50bac0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:39.984823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e58c7800-014c-46d8-84e3-ce8e75ba7679 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:39.986784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e58c7800-014c-46d8-84e3-ce8e75ba7679 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:39.987859 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e58c7800-014c-46d8-84e3-ce8e75ba7679 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:39.991681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e58c7800-014c-46d8-84e3-ce8e75ba7679 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:40.082684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e58c7800-014c-46d8-84e3-ce8e75ba7679 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:40.092409 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e58c7800-014c-46d8-84e3-ce8e75ba7679 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/ea895b96-a96b-4720-bc93-1a4e1d50bac0" status: 200 len: 1303 microversion: 2.1 time: 0.126593 May 21 21:24:40.093677 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1790/3482] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:39 2022] GET /compute/v2.1/servers/ea895b96-a96b-4720-bc93-1a4e1d50bac0 => generated 1303 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:40.671694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e46f64e3-7de3-4c5d-a854-47540ebfe779 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:40.672566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e46f64e3-7de3-4c5d-a854-47540ebfe779 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:40.679723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e46f64e3-7de3-4c5d-a854-47540ebfe779 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:40.680182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e46f64e3-7de3-4c5d-a854-47540ebfe779 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:40.681010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e46f64e3-7de3-4c5d-a854-47540ebfe779 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:40.681457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e46f64e3-7de3-4c5d-a854-47540ebfe779 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:40.835460 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e1200287-35bf-4aca-80c9-ceea77db6a77 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:40.836737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e1200287-35bf-4aca-80c9-ceea77db6a77 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:40.845269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1200287-35bf-4aca-80c9-ceea77db6a77 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:40.848802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1200287-35bf-4aca-80c9-ceea77db6a77 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:40.848802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1200287-35bf-4aca-80c9-ceea77db6a77 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:40.848802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1200287-35bf-4aca-80c9-ceea77db6a77 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:40.925813 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e46f64e3-7de3-4c5d-a854-47540ebfe779 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c9c832b56ed4ec3a601ba39287dcc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1361e32a370e47a9bd4121c5e8a1bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:40.934050 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e46f64e3-7de3-4c5d-a854-47540ebfe779 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 200 len: 1317 microversion: 2.1 time: 0.268067 May 21 21:24:40.934630 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1693/3483] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:40 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:41.110948 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ffda1961-cc5e-45bc-b9fd-bfa744597fc6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:41.111733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ffda1961-cc5e-45bc-b9fd-bfa744597fc6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: ea895b96-a96b-4720-bc93-1a4e1d50bac0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:41.124878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e1200287-35bf-4aca-80c9-ceea77db6a77 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:41.126008 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffda1961-cc5e-45bc-b9fd-bfa744597fc6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:41.126691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffda1961-cc5e-45bc-b9fd-bfa744597fc6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:41.127479 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffda1961-cc5e-45bc-b9fd-bfa744597fc6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:41.128177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffda1961-cc5e-45bc-b9fd-bfa744597fc6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:41.137005 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e1200287-35bf-4aca-80c9-ceea77db6a77 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1501 microversion: 2.1 time: 0.306254 May 21 21:24:41.138197 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1791/3484] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:40 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1501 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:41.152372 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-ffda1961-cc5e-45bc-b9fd-bfa744597fc6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] HTTP exception thrown: Instance ea895b96-a96b-4720-bc93-1a4e1d50bac0 could not be found. May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ffda1961-cc5e-45bc-b9fd-bfa744597fc6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Request method failure captured: May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/ea895b96-a96b-4720-bc93-1a4e1d50bac0 HTTP/1.1 May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVhgHRoHZxny6fz7_1yZCmd6vobLSgJW277YaKZhx_wCSx-VK8X-ElabfVCLL2VDVDPCvowgRjSM28EzkpJWbDjtQAk7xvU-cMVPFhhShGTBSJ0ye1usNI8RPnyvdWG-kzRaH2lMKm8BmN_FFEtxDNs8ivB_JBZnoYfqBjVSHVMMpUQ May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 50415a6f12844d2fa1f5d11a9a4d0274 May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-MultipleCreateTestJSON-1563722476 May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/50415a6f12844d2fa1f5d11a9a4d0274"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/50415a6f12844d2fa1f5d11a9a4d0274"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_50415a6f12844d2fa1f5d11a9a4d0274", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/50415a6f12844d2fa1f5d11a9a4d0274"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-MultipleCreateTestJSON-1563722476 May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 50415a6f12844d2fa1f5d11a9a4d0274 May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1563722476 May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-MultipleCreateTestJSON-1563722476-project May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 00466c38ccc54d5b94db4003faedfc99 May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-MultipleCreateTestJSON-1563722476-project May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance ea895b96-a96b-4720-bc93-1a4e1d50bac0 could not be found. May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'ea895b96-a96b-4720-bc93-1a4e1d50bac0'} May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea895b96-a96b-4720-bc93-1a4e1d50bac0 could not be found. May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea895b96-a96b-4720-bc93-1a4e1d50bac0 could not be found. May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:41.156791 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:41.162135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:41.162135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:41.162135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:41.162135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:24:41.162135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:24:41.162135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea895b96-a96b-4720-bc93-1a4e1d50bac0 could not be found. May 21 21:24:41.162135 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:41.163061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1f983e1d-dd40-4f5a-880f-8550a7a73f92 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:41.164848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ffda1961-cc5e-45bc-b9fd-bfa744597fc6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Returning 404 to user: Instance ea895b96-a96b-4720-bc93-1a4e1d50bac0 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:24:41.165921 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ffda1961-cc5e-45bc-b9fd-bfa744597fc6 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/ea895b96-a96b-4720-bc93-1a4e1d50bac0" status: 404 len: 111 microversion: 2.1 time: 0.060205 May 21 21:24:41.167122 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1694/3485] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:41 2022] GET /compute/v2.1/servers/ea895b96-a96b-4720-bc93-1a4e1d50bac0 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:24:41.173250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f983e1d-dd40-4f5a-880f-8550a7a73f92 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:41.175016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1f983e1d-dd40-4f5a-880f-8550a7a73f92 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:41.177851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7ec4eb1c-fb2b-4f05-bf6e-47e63c0d1d65 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:41.178704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7ec4eb1c-fb2b-4f05-bf6e-47e63c0d1d65 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: 3352e598-ef65-4283-84cd-3e196542b17a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:41.185512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7ec4eb1c-fb2b-4f05-bf6e-47e63c0d1d65 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:41.186198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7ec4eb1c-fb2b-4f05-bf6e-47e63c0d1d65 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:41.187599 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7ec4eb1c-fb2b-4f05-bf6e-47e63c0d1d65 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:41.188209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7ec4eb1c-fb2b-4f05-bf6e-47e63c0d1d65 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:41.205029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1f983e1d-dd40-4f5a-880f-8550a7a73f92 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Going to try to stop instance {{(pid=131277) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 21 21:24:41.227796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:41.230511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7ec4eb1c-fb2b-4f05-bf6e-47e63c0d1d65 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:41.231153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7ec4eb1c-fb2b-4f05-bf6e-47e63c0d1d65 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:41.231780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-7ec4eb1c-fb2b-4f05-bf6e-47e63c0d1d65 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lazy-loading 'fault' on Instance uuid 3352e598-ef65-4283-84cd-3e196542b17a {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:24:41.317765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7ec4eb1c-fb2b-4f05-bf6e-47e63c0d1d65 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00466c38ccc54d5b94db4003faedfc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50415a6f12844d2fa1f5d11a9a4d0274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:41.327089 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7ec4eb1c-fb2b-4f05-bf6e-47e63c0d1d65 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a" status: 200 len: 1308 microversion: 2.1 time: 0.153613 May 21 21:24:41.329388 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1695/3486] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:41 2022] GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a => generated 1308 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:41.548188 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1f983e1d-dd40-4f5a-880f-8550a7a73f92 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044/action" status: 202 len: 0 microversion: 2.1 time: 0.396576 May 21 21:24:41.548883 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1792/3487] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:24:41 2022] POST /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:24:41.557141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b00bde49-baa8-4c4a-b282-283fb654b23d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:41.558122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b00bde49-baa8-4c4a-b282-283fb654b23d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:41.568422 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b00bde49-baa8-4c4a-b282-283fb654b23d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:41.569225 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b00bde49-baa8-4c4a-b282-283fb654b23d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:41.570122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b00bde49-baa8-4c4a-b282-283fb654b23d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:41.570670 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b00bde49-baa8-4c4a-b282-283fb654b23d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:41.750058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b00bde49-baa8-4c4a-b282-283fb654b23d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:41.761327 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b00bde49-baa8-4c4a-b282-283fb654b23d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1511 microversion: 2.1 time: 0.208021 May 21 21:24:41.765320 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1696/3488] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:41 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1511 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:41.809856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-4d13e3ee-407d-48a1-858b-c0e428728357 req-fe9d9961-609c-443f-9b84-cbc9e0c1c5db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab8466bc-22eb-4ffa-9dfc-f9b112576c18", "name": "network-vif-plugged", "status": "completed", "tag": "aba7536e-9e7f-41ec-b3b2-062ce12b3e3b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:41.818870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-4d13e3ee-407d-48a1-858b-c0e428728357 req-fe9d9961-609c-443f-9b84-cbc9e0c1c5db service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:41.819576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-4d13e3ee-407d-48a1-858b-c0e428728357 req-fe9d9961-609c-443f-9b84-cbc9e0c1c5db service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:41.837271 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-4d13e3ee-407d-48a1-858b-c0e428728357 req-fe9d9961-609c-443f-9b84-cbc9e0c1c5db service nova] Creating event network-vif-plugged:aba7536e-9e7f-41ec-b3b2-062ce12b3e3b for instance ab8466bc-22eb-4ffa-9dfc-f9b112576c18 on nch1-master-1 May 21 21:24:41.839919 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-4d13e3ee-407d-48a1-858b-c0e428728357 req-fe9d9961-609c-443f-9b84-cbc9e0c1c5db service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034252 May 21 21:24:41.840803 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1793/3489] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:41.845124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-33468bca-64b3-4dbd-a31b-c59cabe61f5e req-680d6dad-58e8-4833-9333-d7737ef7d1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3352e598-ef65-4283-84cd-3e196542b17a", "name": "network-vif-deleted", "tag": "18479ac1-1c1f-4d4a-bb62-4cd78ba39fac"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:41.869380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-33468bca-64b3-4dbd-a31b-c59cabe61f5e req-680d6dad-58e8-4833-9333-d7737ef7d1f8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:41.870122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-33468bca-64b3-4dbd-a31b-c59cabe61f5e req-680d6dad-58e8-4833-9333-d7737ef7d1f8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:41.897304 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-33468bca-64b3-4dbd-a31b-c59cabe61f5e req-680d6dad-58e8-4833-9333-d7737ef7d1f8 service nova] Creating event network-vif-deleted:18479ac1-1c1f-4d4a-bb62-4cd78ba39fac for instance 3352e598-ef65-4283-84cd-3e196542b17a on nch2-master-1 May 21 21:24:41.903895 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-33468bca-64b3-4dbd-a31b-c59cabe61f5e req-680d6dad-58e8-4833-9333-d7737ef7d1f8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063242 May 21 21:24:41.905024 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1697/3490] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:41.953650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-38ad49f9-02bc-4072-aef6-9ce8dc756fe0 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:41.954515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-38ad49f9-02bc-4072-aef6-9ce8dc756fe0 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:41.970029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38ad49f9-02bc-4072-aef6-9ce8dc756fe0 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:41.970906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38ad49f9-02bc-4072-aef6-9ce8dc756fe0 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:41.971792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38ad49f9-02bc-4072-aef6-9ce8dc756fe0 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:41.972499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38ad49f9-02bc-4072-aef6-9ce8dc756fe0 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:42.347871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f6aaf3ae-e542-4f24-bdf7-d51706b77cb3 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:42.349748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f6aaf3ae-e542-4f24-bdf7-d51706b77cb3 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] [instance: 3352e598-ef65-4283-84cd-3e196542b17a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:42.363292 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6aaf3ae-e542-4f24-bdf7-d51706b77cb3 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:42.365455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6aaf3ae-e542-4f24-bdf7-d51706b77cb3 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:42.365455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6aaf3ae-e542-4f24-bdf7-d51706b77cb3 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:42.365455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6aaf3ae-e542-4f24-bdf7-d51706b77cb3 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:42.379631 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-f6aaf3ae-e542-4f24-bdf7-d51706b77cb3 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] HTTP exception thrown: Instance 3352e598-ef65-4283-84cd-3e196542b17a could not be found. May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f6aaf3ae-e542-4f24-bdf7-d51706b77cb3 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Request method failure captured: May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a HTTP/1.1 May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVhgHRoHZxny6fz7_1yZCmd6vobLSgJW277YaKZhx_wCSx-VK8X-ElabfVCLL2VDVDPCvowgRjSM28EzkpJWbDjtQAk7xvU-cMVPFhhShGTBSJ0ye1usNI8RPnyvdWG-kzRaH2lMKm8BmN_FFEtxDNs8ivB_JBZnoYfqBjVSHVMMpUQ May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 50415a6f12844d2fa1f5d11a9a4d0274 May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-MultipleCreateTestJSON-1563722476 May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/50415a6f12844d2fa1f5d11a9a4d0274"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/50415a6f12844d2fa1f5d11a9a4d0274"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_50415a6f12844d2fa1f5d11a9a4d0274", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/50415a6f12844d2fa1f5d11a9a4d0274"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-MultipleCreateTestJSON-1563722476 May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 50415a6f12844d2fa1f5d11a9a4d0274 May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1563722476 May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-MultipleCreateTestJSON-1563722476-project May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 00466c38ccc54d5b94db4003faedfc99 May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-MultipleCreateTestJSON-1563722476-project May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 3352e598-ef65-4283-84cd-3e196542b17a could not be found. May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '3352e598-ef65-4283-84cd-3e196542b17a'} May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3352e598-ef65-4283-84cd-3e196542b17a could not be found. May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3352e598-ef65-4283-84cd-3e196542b17a could not be found. May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:42.381515 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:42.386677 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:42.386677 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:42.386677 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:42.386677 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:24:42.386677 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:24:42.386677 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3352e598-ef65-4283-84cd-3e196542b17a could not be found. May 21 21:24:42.386677 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:42.386677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f6aaf3ae-e542-4f24-bdf7-d51706b77cb3 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] Returning 404 to user: Instance 3352e598-ef65-4283-84cd-3e196542b17a could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:24:42.386677 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f6aaf3ae-e542-4f24-bdf7-d51706b77cb3 tempest-MultipleCreateTestJSON-1563722476 tempest-MultipleCreateTestJSON-1563722476-project] 10.222.0.49 "GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a" status: 404 len: 111 microversion: 2.1 time: 0.040435 May 21 21:24:42.387442 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1698/3491] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:42 2022] GET /compute/v2.1/servers/3352e598-ef65-4283-84cd-3e196542b17a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:24:42.605788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-38ad49f9-02bc-4072-aef6-9ce8dc756fe0 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c9c832b56ed4ec3a601ba39287dcc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1361e32a370e47a9bd4121c5e8a1bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:42.614473 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-38ad49f9-02bc-4072-aef6-9ce8dc756fe0 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 200 len: 1317 microversion: 2.1 time: 0.667130 May 21 21:24:42.615184 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1794/3492] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:41 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 1317 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:42.778830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1e22786f-5ad2-430d-bc92-f7fd417a1f19 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:42.784048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1e22786f-5ad2-430d-bc92-f7fd417a1f19 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:42.787052 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e22786f-5ad2-430d-bc92-f7fd417a1f19 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:42.787513 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e22786f-5ad2-430d-bc92-f7fd417a1f19 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:42.788309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e22786f-5ad2-430d-bc92-f7fd417a1f19 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:42.788751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e22786f-5ad2-430d-bc92-f7fd417a1f19 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:43.089312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1e22786f-5ad2-430d-bc92-f7fd417a1f19 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:43.101884 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1e22786f-5ad2-430d-bc92-f7fd417a1f19 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1511 microversion: 2.1 time: 0.326913 May 21 21:24:43.113949 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1699/3493] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:42 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1511 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:43.636815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e754a51d-e35e-45a0-9aa7-0c8cc500724e tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:43.638064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e754a51d-e35e-45a0-9aa7-0c8cc500724e tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:43.650616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e754a51d-e35e-45a0-9aa7-0c8cc500724e tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:43.651382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e754a51d-e35e-45a0-9aa7-0c8cc500724e tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:43.652917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e754a51d-e35e-45a0-9aa7-0c8cc500724e tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:43.654009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e754a51d-e35e-45a0-9aa7-0c8cc500724e tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:43.679375 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:43.941618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e754a51d-e35e-45a0-9aa7-0c8cc500724e tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c9c832b56ed4ec3a601ba39287dcc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1361e32a370e47a9bd4121c5e8a1bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:43.950997 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e754a51d-e35e-45a0-9aa7-0c8cc500724e tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 200 len: 1505 microversion: 2.1 time: 0.320649 May 21 21:24:43.951935 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1795/3494] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:43 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 1505 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:43.972381 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b56c74d8-1ee0-463e-8512-e393ab784d16 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:43.973585 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b56c74d8-1ee0-463e-8512-e393ab784d16 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:43.983858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b56c74d8-1ee0-463e-8512-e393ab784d16 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:43.984630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b56c74d8-1ee0-463e-8512-e393ab784d16 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:43.985699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b56c74d8-1ee0-463e-8512-e393ab784d16 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:43.986910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b56c74d8-1ee0-463e-8512-e393ab784d16 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:44.028706 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b56c74d8-1ee0-463e-8512-e393ab784d16 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '4c9c832b56ed4ec3a601ba39287dcc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1361e32a370e47a9bd4121c5e8a1bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:44.029978 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b56c74d8-1ee0-463e-8512-e393ab784d16 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18/os-instance-actions/req-e037abb9-6806-462d-8046-11375bebfb2f" status: 200 len: 313 microversion: 2.1 time: 0.064824 May 21 21:24:44.031208 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1700/3495] 10.222.0.49 () {58 vars in 1418 bytes} [Sat May 21 21:24:43 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18/os-instance-actions/req-e037abb9-6806-462d-8046-11375bebfb2f => generated 313 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:24:44.043741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a08f50b0-b882-412e-a4cf-4915ba7233bc tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:44.044867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a08f50b0-b882-412e-a4cf-4915ba7233bc tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:44.052245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a08f50b0-b882-412e-a4cf-4915ba7233bc tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:44.052732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a08f50b0-b882-412e-a4cf-4915ba7233bc tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:44.053559 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a08f50b0-b882-412e-a4cf-4915ba7233bc tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:44.054008 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a08f50b0-b882-412e-a4cf-4915ba7233bc tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:44.119437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bb21b023-f83a-4100-ad44-b90d0d9b1e82 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:44.120374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bb21b023-f83a-4100-ad44-b90d0d9b1e82 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:44.127649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb21b023-f83a-4100-ad44-b90d0d9b1e82 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:44.128360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb21b023-f83a-4100-ad44-b90d0d9b1e82 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:44.129169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb21b023-f83a-4100-ad44-b90d0d9b1e82 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:44.129584 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb21b023-f83a-4100-ad44-b90d0d9b1e82 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:44.308848 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a08f50b0-b882-412e-a4cf-4915ba7233bc tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "POST /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18/action" status: 202 len: 0 microversion: 2.1 time: 0.268739 May 21 21:24:44.309507 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1796/3496] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:24:44 2022] POST /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:24:44.319820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e274c516-6992-4ba3-988d-b688737b6574 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:44.325444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e274c516-6992-4ba3-988d-b688737b6574 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:44.334642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e274c516-6992-4ba3-988d-b688737b6574 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:44.335107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e274c516-6992-4ba3-988d-b688737b6574 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:44.336700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e274c516-6992-4ba3-988d-b688737b6574 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:44.337318 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e274c516-6992-4ba3-988d-b688737b6574 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:44.374565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bb21b023-f83a-4100-ad44-b90d0d9b1e82 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:44.386700 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bb21b023-f83a-4100-ad44-b90d0d9b1e82 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1511 microversion: 2.1 time: 0.271643 May 21 21:24:44.387283 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1701/3497] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:44 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1511 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:44.578286 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e274c516-6992-4ba3-988d-b688737b6574 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c9c832b56ed4ec3a601ba39287dcc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1361e32a370e47a9bd4121c5e8a1bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:44.586313 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e274c516-6992-4ba3-988d-b688737b6574 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 200 len: 1507 microversion: 2.1 time: 0.270749 May 21 21:24:44.589986 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1797/3498] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:44 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 1507 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:45.405538 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6e8d592e-e37e-4a01-a3de-09d4c8f60062 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:45.406213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6e8d592e-e37e-4a01-a3de-09d4c8f60062 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:45.414679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e8d592e-e37e-4a01-a3de-09d4c8f60062 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:45.415112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e8d592e-e37e-4a01-a3de-09d4c8f60062 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:45.415908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e8d592e-e37e-4a01-a3de-09d4c8f60062 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:45.416409 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e8d592e-e37e-4a01-a3de-09d4c8f60062 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:45.587501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6e8d592e-e37e-4a01-a3de-09d4c8f60062 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:45.600567 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6e8d592e-e37e-4a01-a3de-09d4c8f60062 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1511 microversion: 2.1 time: 0.199351 May 21 21:24:45.601386 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1702/3499] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:45 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1511 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:45.603517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bd500867-3cc1-4cbe-8034-f12075220dda tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:45.604099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bd500867-3cc1-4cbe-8034-f12075220dda tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:45.613615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd500867-3cc1-4cbe-8034-f12075220dda tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:45.613615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd500867-3cc1-4cbe-8034-f12075220dda tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:45.614312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd500867-3cc1-4cbe-8034-f12075220dda tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:45.615062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd500867-3cc1-4cbe-8034-f12075220dda tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:45.788666 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bd500867-3cc1-4cbe-8034-f12075220dda tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c9c832b56ed4ec3a601ba39287dcc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1361e32a370e47a9bd4121c5e8a1bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:45.799088 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bd500867-3cc1-4cbe-8034-f12075220dda tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 200 len: 1507 microversion: 2.1 time: 0.199928 May 21 21:24:45.800625 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1798/3500] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:45 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 1507 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:46.281403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-089b7e24-1999-40b9-9096-c23404117e56 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-676300709", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": "none"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:46.355961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-089b7e24-1999-40b9-9096-c23404117e56 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:24:46.358898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-089b7e24-1999-40b9-9096-c23404117e56 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:24:46.358898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-089b7e24-1999-40b9-9096-c23404117e56 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:24:46.358898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-089b7e24-1999-40b9-9096-c23404117e56 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:24:46.358898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-089b7e24-1999-40b9-9096-c23404117e56 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:24:46.370182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-089b7e24-1999-40b9-9096-c23404117e56 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:46.370637 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-089b7e24-1999-40b9-9096-c23404117e56 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:46.371525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-089b7e24-1999-40b9-9096-c23404117e56 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:46.372015 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-089b7e24-1999-40b9-9096-c23404117e56 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:46.393411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-089b7e24-1999-40b9-9096-c23404117e56 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Getting quotas for project 21f0418d760a46589f3608bf67301a6c. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:24:46.399121 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-089b7e24-1999-40b9-9096-c23404117e56 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Getting quotas for user 2536f74eff9243f9bc30bc0acaf2badb and project 21f0418d760a46589f3608bf67301a6c. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:24:46.414483 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-089b7e24-1999-40b9-9096-c23404117e56 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:24:46.422108 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-089b7e24-1999-40b9-9096-c23404117e56 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] [instance: 8d342970-e711-41ce-8cc5-8c8325b62e4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:24:46.622050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7711153c-05d3-4590-b4a8-7fbeaba4e5be tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:46.622707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7711153c-05d3-4590-b4a8-7fbeaba4e5be tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:46.631707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7711153c-05d3-4590-b4a8-7fbeaba4e5be tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:46.632274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7711153c-05d3-4590-b4a8-7fbeaba4e5be tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:46.633083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7711153c-05d3-4590-b4a8-7fbeaba4e5be tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:46.634336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7711153c-05d3-4590-b4a8-7fbeaba4e5be tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:46.635996 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-089b7e24-1999-40b9-9096-c23404117e56 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.619715 May 21 21:24:46.636692 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1703/3501] 10.222.0.49 () {62 vars in 1187 bytes} [Sat May 21 21:24:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 21 21:24:46.646980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-96b0b8a4-dcaa-4172-9ebf-be3557fd9ea7 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:46.647636 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-96b0b8a4-dcaa-4172-9ebf-be3557fd9ea7 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] [instance: 8d342970-e711-41ce-8cc5-8c8325b62e4d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:46.736736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-96b0b8a4-dcaa-4172-9ebf-be3557fd9ea7 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:46.745977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-96b0b8a4-dcaa-4172-9ebf-be3557fd9ea7 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:46.747754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-96b0b8a4-dcaa-4172-9ebf-be3557fd9ea7 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:46.749671 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-96b0b8a4-dcaa-4172-9ebf-be3557fd9ea7 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] 10.222.0.49 "GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d" status: 200 len: 1280 microversion: 2.47 time: 0.106095 May 21 21:24:46.752219 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1704/3502] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:24:46 2022] GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d => generated 1280 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:24:46.820576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8566ceeb-238c-427d-819d-35a791c14fff tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:46.821901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8566ceeb-238c-427d-819d-35a791c14fff tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:46.831189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8566ceeb-238c-427d-819d-35a791c14fff tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:46.831826 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8566ceeb-238c-427d-819d-35a791c14fff tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:46.832953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8566ceeb-238c-427d-819d-35a791c14fff tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:46.833547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8566ceeb-238c-427d-819d-35a791c14fff tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:46.963262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7711153c-05d3-4590-b4a8-7fbeaba4e5be tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:46.972565 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7711153c-05d3-4590-b4a8-7fbeaba4e5be tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1511 microversion: 2.1 time: 0.353796 May 21 21:24:46.972565 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1799/3503] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:46 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1511 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:47.177462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8566ceeb-238c-427d-819d-35a791c14fff tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c9c832b56ed4ec3a601ba39287dcc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1361e32a370e47a9bd4121c5e8a1bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:47.188475 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8566ceeb-238c-427d-819d-35a791c14fff tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 200 len: 1505 microversion: 2.1 time: 0.374394 May 21 21:24:47.200646 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1705/3504] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:46 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 1505 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:47.206223 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-830c7153-7cbf-4426-88c2-7715329c17ec tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '.version_select at 0x7fc82d115b80>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:47.207226 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-830c7153-7cbf-4426-88c2-7715329c17ec tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:47.213616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-830c7153-7cbf-4426-88c2-7715329c17ec tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:47.214189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-830c7153-7cbf-4426-88c2-7715329c17ec tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:47.215065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-830c7153-7cbf-4426-88c2-7715329c17ec tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:47.215931 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-830c7153-7cbf-4426-88c2-7715329c17ec tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:47.252015 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-830c7153-7cbf-4426-88c2-7715329c17ec tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.049703 May 21 21:24:47.252727 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1800/3505] 10.222.0.49 () {58 vars in 1295 bytes} [Sat May 21 21:24:47 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18/os-instance-actions => generated 611 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:24:47.272212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f5f769e1-e07a-4352-b0df-8b22239b1fab tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:47.272212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f5f769e1-e07a-4352-b0df-8b22239b1fab tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:47.273404 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5f769e1-e07a-4352-b0df-8b22239b1fab tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:47.273853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5f769e1-e07a-4352-b0df-8b22239b1fab tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:47.274792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5f769e1-e07a-4352-b0df-8b22239b1fab tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:47.275043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5f769e1-e07a-4352-b0df-8b22239b1fab tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:47.306678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f5f769e1-e07a-4352-b0df-8b22239b1fab tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:24:47.764328 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f5f769e1-e07a-4352-b0df-8b22239b1fab tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 204 len: 0 microversion: 2.1 time: 0.502412 May 21 21:24:47.770216 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1706/3506] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:24:47 2022] DELETE /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:24:47.776351 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-14e5e0fe-86a1-4871-b832-85ff5d18ad29 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:47.777091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-14e5e0fe-86a1-4871-b832-85ff5d18ad29 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] [instance: 8d342970-e711-41ce-8cc5-8c8325b62e4d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:47.780244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5aa5a3be-391f-44ed-bd6b-79b0064bade9 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:47.781253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5aa5a3be-391f-44ed-bd6b-79b0064bade9 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:47.783588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=12 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:47.791619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5aa5a3be-391f-44ed-bd6b-79b0064bade9 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:47.792173 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5aa5a3be-391f-44ed-bd6b-79b0064bade9 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:47.792984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5aa5a3be-391f-44ed-bd6b-79b0064bade9 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:47.793431 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5aa5a3be-391f-44ed-bd6b-79b0064bade9 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:47.841904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-14e5e0fe-86a1-4871-b832-85ff5d18ad29 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:47.855939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-14e5e0fe-86a1-4871-b832-85ff5d18ad29 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:47.855939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-14e5e0fe-86a1-4871-b832-85ff5d18ad29 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:47.856188 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-14e5e0fe-86a1-4871-b832-85ff5d18ad29 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] 10.222.0.49 "GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d" status: 200 len: 1280 microversion: 2.47 time: 0.086515 May 21 21:24:47.856703 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1801/3507] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:24:47 2022] GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:24:47.992691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6c3afdde-9769-42b9-bc45-ffc1e0c32e43 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:47.993617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6c3afdde-9769-42b9-bc45-ffc1e0c32e43 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:48.002022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:48.008487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6c3afdde-9769-42b9-bc45-ffc1e0c32e43 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:48.009254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6c3afdde-9769-42b9-bc45-ffc1e0c32e43 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:48.010753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6c3afdde-9769-42b9-bc45-ffc1e0c32e43 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:48.011383 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6c3afdde-9769-42b9-bc45-ffc1e0c32e43 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:48.080963 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5aa5a3be-391f-44ed-bd6b-79b0064bade9 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c9c832b56ed4ec3a601ba39287dcc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1361e32a370e47a9bd4121c5e8a1bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:48.093493 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5aa5a3be-391f-44ed-bd6b-79b0064bade9 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 200 len: 1511 microversion: 2.1 time: 0.321712 May 21 21:24:48.103258 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1707/3508] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:47 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 1511 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:48.175387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-335e0569-4dff-45fe-ad52-4fd93712089c tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1683063755", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "50f7f75d-3d92-4dcd-8f7c-62f31e7aefd9"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:48.229600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6c3afdde-9769-42b9-bc45-ffc1e0c32e43 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:48.242209 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6c3afdde-9769-42b9-bc45-ffc1e0c32e43 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1511 microversion: 2.1 time: 0.255463 May 21 21:24:48.248372 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1802/3509] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:47 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1511 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:48.248564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-335e0569-4dff-45fe-ad52-4fd93712089c tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] validate_networks() for [('50f7f75d-3d92-4dcd-8f7c-62f31e7aefd9', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:24:48.886058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cac0ca05-9b68-40ac-93d9-3625d0d6b496 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:48.886781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cac0ca05-9b68-40ac-93d9-3625d0d6b496 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] [instance: 8d342970-e711-41ce-8cc5-8c8325b62e4d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:48.896117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cac0ca05-9b68-40ac-93d9-3625d0d6b496 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:48.896690 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cac0ca05-9b68-40ac-93d9-3625d0d6b496 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:48.897563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cac0ca05-9b68-40ac-93d9-3625d0d6b496 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:48.898233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cac0ca05-9b68-40ac-93d9-3625d0d6b496 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:48.903266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-335e0569-4dff-45fe-ad52-4fd93712089c tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:24:48.903740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-335e0569-4dff-45fe-ad52-4fd93712089c tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:24:48.904160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-335e0569-4dff-45fe-ad52-4fd93712089c tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:24:48.904877 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-335e0569-4dff-45fe-ad52-4fd93712089c tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:24:48.905454 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-335e0569-4dff-45fe-ad52-4fd93712089c tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:24:48.916038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-335e0569-4dff-45fe-ad52-4fd93712089c tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:48.916935 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-335e0569-4dff-45fe-ad52-4fd93712089c tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:48.918030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-335e0569-4dff-45fe-ad52-4fd93712089c tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:48.918621 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-335e0569-4dff-45fe-ad52-4fd93712089c tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:48.938652 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-335e0569-4dff-45fe-ad52-4fd93712089c tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Getting quotas for project 960f5f98c8d64ac384c86350b29ee9ae. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:24:48.945074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-335e0569-4dff-45fe-ad52-4fd93712089c tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Getting quotas for user 1ec7dadaea104c4498cd8bf98ceea738 and project 960f5f98c8d64ac384c86350b29ee9ae. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:24:48.958973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-335e0569-4dff-45fe-ad52-4fd93712089c tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:24:48.961277 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-335e0569-4dff-45fe-ad52-4fd93712089c tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:24:48.994991 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cac0ca05-9b68-40ac-93d9-3625d0d6b496 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:49.005289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cac0ca05-9b68-40ac-93d9-3625d0d6b496 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:49.009393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cac0ca05-9b68-40ac-93d9-3625d0d6b496 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:49.009393 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cac0ca05-9b68-40ac-93d9-3625d0d6b496 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] 10.222.0.49 "GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d" status: 200 len: 1332 microversion: 2.47 time: 0.126667 May 21 21:24:49.009393 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1803/3510] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:24:48 2022] GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d => generated 1332 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:24:49.112501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-640363d2-ab2a-4b3d-b533-48842a4f37ac tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:49.113408 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-640363d2-ab2a-4b3d-b533-48842a4f37ac tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:49.113619 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-335e0569-4dff-45fe-ad52-4fd93712089c tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.009982 May 21 21:24:49.114282 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1708/3511] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:24:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:24:49.120822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-640363d2-ab2a-4b3d-b533-48842a4f37ac tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:49.121279 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-640363d2-ab2a-4b3d-b533-48842a4f37ac tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:49.122278 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-640363d2-ab2a-4b3d-b533-48842a4f37ac tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:49.122972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-640363d2-ab2a-4b3d-b533-48842a4f37ac tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:49.133705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b22f6af7-4a7a-42eb-9a91-7d06cf8d7a94 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:49.144576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b22f6af7-4a7a-42eb-9a91-7d06cf8d7a94 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:49.222391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b22f6af7-4a7a-42eb-9a91-7d06cf8d7a94 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec7dadaea104c4498cd8bf98ceea738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960f5f98c8d64ac384c86350b29ee9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:49.229221 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b22f6af7-4a7a-42eb-9a91-7d06cf8d7a94 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e" status: 200 len: 1218 microversion: 2.1 time: 0.099600 May 21 21:24:49.229791 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1709/3512] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:49 2022] GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:49.272481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d8edfd66-3c94-41b6-ab6a-0aefb02fe54c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:49.274256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d8edfd66-3c94-41b6-ab6a-0aefb02fe54c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:49.288024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8edfd66-3c94-41b6-ab6a-0aefb02fe54c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:49.293406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8edfd66-3c94-41b6-ab6a-0aefb02fe54c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:49.294245 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8edfd66-3c94-41b6-ab6a-0aefb02fe54c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:49.294742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8edfd66-3c94-41b6-ab6a-0aefb02fe54c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:49.420680 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-640363d2-ab2a-4b3d-b533-48842a4f37ac tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c9c832b56ed4ec3a601ba39287dcc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1361e32a370e47a9bd4121c5e8a1bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:49.438157 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-640363d2-ab2a-4b3d-b533-48842a4f37ac tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 200 len: 1511 microversion: 2.1 time: 0.329642 May 21 21:24:49.441491 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1804/3513] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:49 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 1511 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:49.497648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d8edfd66-3c94-41b6-ab6a-0aefb02fe54c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:49.506724 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d8edfd66-3c94-41b6-ab6a-0aefb02fe54c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1511 microversion: 2.1 time: 0.247750 May 21 21:24:49.511082 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1710/3514] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:49 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1511 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:50.028080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-05ed23a0-8ba1-4b24-9913-193562d85709 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:50.028924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-05ed23a0-8ba1-4b24-9913-193562d85709 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] [instance: 8d342970-e711-41ce-8cc5-8c8325b62e4d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:50.037576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-05ed23a0-8ba1-4b24-9913-193562d85709 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:50.038040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-05ed23a0-8ba1-4b24-9913-193562d85709 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:50.038881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-05ed23a0-8ba1-4b24-9913-193562d85709 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:50.039338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-05ed23a0-8ba1-4b24-9913-193562d85709 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:50.112907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-05ed23a0-8ba1-4b24-9913-193562d85709 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:50.121266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-05ed23a0-8ba1-4b24-9913-193562d85709 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:50.122774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-05ed23a0-8ba1-4b24-9913-193562d85709 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:50.124165 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-05ed23a0-8ba1-4b24-9913-193562d85709 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] 10.222.0.49 "GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d" status: 200 len: 1338 microversion: 2.47 time: 0.100235 May 21 21:24:50.125705 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1805/3515] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:24:50 2022] GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d => generated 1338 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:24:50.247266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8162ea15-6b3b-44b6-b968-042d344007b2 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:50.247895 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8162ea15-6b3b-44b6-b968-042d344007b2 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:50.317042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8162ea15-6b3b-44b6-b968-042d344007b2 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec7dadaea104c4498cd8bf98ceea738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960f5f98c8d64ac384c86350b29ee9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:50.325055 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8162ea15-6b3b-44b6-b968-042d344007b2 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e" status: 200 len: 1218 microversion: 2.1 time: 0.081906 May 21 21:24:50.325640 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1711/3516] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:50 2022] GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:50.457796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ffdecb90-6d64-47d5-a1d7-57992f1a291d tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:50.458623 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ffdecb90-6d64-47d5-a1d7-57992f1a291d tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:50.464804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffdecb90-6d64-47d5-a1d7-57992f1a291d tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:50.465317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffdecb90-6d64-47d5-a1d7-57992f1a291d tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:50.466107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffdecb90-6d64-47d5-a1d7-57992f1a291d tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:50.466530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffdecb90-6d64-47d5-a1d7-57992f1a291d tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:50.632681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e7dea76d-7244-4257-ad6e-daa20fbaf279 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:50.632822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ffdecb90-6d64-47d5-a1d7-57992f1a291d tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c9c832b56ed4ec3a601ba39287dcc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1361e32a370e47a9bd4121c5e8a1bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:50.633046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e7dea76d-7244-4257-ad6e-daa20fbaf279 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:50.641326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7dea76d-7244-4257-ad6e-daa20fbaf279 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:50.642047 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7dea76d-7244-4257-ad6e-daa20fbaf279 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:50.643056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7dea76d-7244-4257-ad6e-daa20fbaf279 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:50.643692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7dea76d-7244-4257-ad6e-daa20fbaf279 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:50.647072 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ffdecb90-6d64-47d5-a1d7-57992f1a291d tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 200 len: 1511 microversion: 2.1 time: 0.193366 May 21 21:24:50.647672 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1806/3517] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:50 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 1511 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:50.662878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-11e89730-0f21-4fc1-877a-5e42e223bbb2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:50.663502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-11e89730-0f21-4fc1-877a-5e42e223bbb2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:50.686417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-11e89730-0f21-4fc1-877a-5e42e223bbb2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:50.687913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-11e89730-0f21-4fc1-877a-5e42e223bbb2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:50.689073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-11e89730-0f21-4fc1-877a-5e42e223bbb2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:50.689994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-11e89730-0f21-4fc1-877a-5e42e223bbb2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:50.699346 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e7dea76d-7244-4257-ad6e-daa20fbaf279 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "POST /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10/action" status: 200 len: 24574 microversion: 2.1 time: 0.212052 May 21 21:24:50.700686 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1712/3518] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:24:50 2022] POST /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10/action => generated 24574 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:24:50.720208 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b8d894b7-395b-43f4-b250-e89f251bce3d tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:50.720826 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b8d894b7-395b-43f4-b250-e89f251bce3d tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:50.728843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b8d894b7-395b-43f4-b250-e89f251bce3d tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:50.729291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b8d894b7-395b-43f4-b250-e89f251bce3d tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:50.730068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b8d894b7-395b-43f4-b250-e89f251bce3d tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:50.730681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b8d894b7-395b-43f4-b250-e89f251bce3d tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:50.735976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:50.761872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b8d894b7-395b-43f4-b250-e89f251bce3d tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:24:50.880980 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-11e89730-0f21-4fc1-877a-5e42e223bbb2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:50.889021 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-11e89730-0f21-4fc1-877a-5e42e223bbb2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1511 microversion: 2.1 time: 0.230869 May 21 21:24:50.889641 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1807/3519] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:50 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1511 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:50.973335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-386437c7-a2d3-43b7-9007-03d50a8c6af7 req-e7204bcd-4322-434e-86f7-0e81d3354ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab8466bc-22eb-4ffa-9dfc-f9b112576c18", "name": "network-vif-deleted", "tag": "aba7536e-9e7f-41ec-b3b2-062ce12b3e3b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:50.982997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-386437c7-a2d3-43b7-9007-03d50a8c6af7 req-e7204bcd-4322-434e-86f7-0e81d3354ba1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:50.984476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-386437c7-a2d3-43b7-9007-03d50a8c6af7 req-e7204bcd-4322-434e-86f7-0e81d3354ba1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:50.998352 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-386437c7-a2d3-43b7-9007-03d50a8c6af7 req-e7204bcd-4322-434e-86f7-0e81d3354ba1 service nova] Creating event network-vif-deleted:aba7536e-9e7f-41ec-b3b2-062ce12b3e3b for instance ab8466bc-22eb-4ffa-9dfc-f9b112576c18 on nch1-master-1 May 21 21:24:51.004004 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-386437c7-a2d3-43b7-9007-03d50a8c6af7 req-e7204bcd-4322-434e-86f7-0e81d3354ba1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034423 May 21 21:24:51.004728 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1808/3520] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:51.051660 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b8d894b7-395b-43f4-b250-e89f251bce3d tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 204 len: 0 microversion: 2.1 time: 0.336300 May 21 21:24:51.052464 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1713/3521] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:24:50 2022] DELETE /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:24:51.063637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-faaf0049-b84c-46e5-99b8-8d66f66ba0aa tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:51.064671 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-faaf0049-b84c-46e5-99b8-8d66f66ba0aa tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:51.073317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-faaf0049-b84c-46e5-99b8-8d66f66ba0aa tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:51.074005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-faaf0049-b84c-46e5-99b8-8d66f66ba0aa tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:51.074984 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-faaf0049-b84c-46e5-99b8-8d66f66ba0aa tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:51.075579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-faaf0049-b84c-46e5-99b8-8d66f66ba0aa tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:51.147165 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-249d3704-4a20-47f9-893d-60724a3f7f27 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:51.148256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-249d3704-4a20-47f9-893d-60724a3f7f27 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] [instance: 8d342970-e711-41ce-8cc5-8c8325b62e4d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:51.158738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-249d3704-4a20-47f9-893d-60724a3f7f27 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:51.159193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-249d3704-4a20-47f9-893d-60724a3f7f27 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:51.165768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-249d3704-4a20-47f9-893d-60724a3f7f27 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:51.165768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-249d3704-4a20-47f9-893d-60724a3f7f27 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:51.254222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-faaf0049-b84c-46e5-99b8-8d66f66ba0aa tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:51.262274 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-faaf0049-b84c-46e5-99b8-8d66f66ba0aa tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 200 len: 1607 microversion: 2.1 time: 0.205510 May 21 21:24:51.262859 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1809/3522] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:51 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 1607 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:51.325723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-249d3704-4a20-47f9-893d-60724a3f7f27 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:51.336734 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-249d3704-4a20-47f9-893d-60724a3f7f27 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:51.339541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-249d3704-4a20-47f9-893d-60724a3f7f27 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:51.341014 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-249d3704-4a20-47f9-893d-60724a3f7f27 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] 10.222.0.49 "GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d" status: 200 len: 1338 microversion: 2.47 time: 0.198323 May 21 21:24:51.341519 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1714/3523] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:24:51 2022] GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d => generated 1338 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:24:51.342563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7980993c-e1fd-44fd-bd6c-2102174a89f1 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:51.344007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7980993c-e1fd-44fd-bd6c-2102174a89f1 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:51.350567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7980993c-e1fd-44fd-bd6c-2102174a89f1 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:51.351019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7980993c-e1fd-44fd-bd6c-2102174a89f1 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:51.351815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7980993c-e1fd-44fd-bd6c-2102174a89f1 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:51.352467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7980993c-e1fd-44fd-bd6c-2102174a89f1 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:51.421727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7980993c-e1fd-44fd-bd6c-2102174a89f1 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec7dadaea104c4498cd8bf98ceea738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960f5f98c8d64ac384c86350b29ee9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:51.429751 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7980993c-e1fd-44fd-bd6c-2102174a89f1 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e" status: 200 len: 1270 microversion: 2.1 time: 0.091046 May 21 21:24:51.430320 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1810/3524] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:51 2022] GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:51.665952 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e59b9aa2-115a-40eb-9b6d-8f6763d47066 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:51.667207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e59b9aa2-115a-40eb-9b6d-8f6763d47066 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:51.678590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e59b9aa2-115a-40eb-9b6d-8f6763d47066 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:51.679707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e59b9aa2-115a-40eb-9b6d-8f6763d47066 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:51.680463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e59b9aa2-115a-40eb-9b6d-8f6763d47066 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:51.680910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e59b9aa2-115a-40eb-9b6d-8f6763d47066 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:51.714295 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e59b9aa2-115a-40eb-9b6d-8f6763d47066 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:51.714747 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e59b9aa2-115a-40eb-9b6d-8f6763d47066 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:51.715305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-e59b9aa2-115a-40eb-9b6d-8f6763d47066 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lazy-loading 'fault' on Instance uuid ab8466bc-22eb-4ffa-9dfc-f9b112576c18 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:24:51.763493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e59b9aa2-115a-40eb-9b6d-8f6763d47066 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c9c832b56ed4ec3a601ba39287dcc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1361e32a370e47a9bd4121c5e8a1bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:51.772147 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e59b9aa2-115a-40eb-9b6d-8f6763d47066 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 200 len: 1307 microversion: 2.1 time: 0.110528 May 21 21:24:51.772748 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1715/3525] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:51 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:51.907329 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8f98b716-0f45-4255-98ac-7d3aceafeb93 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:51.908001 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8f98b716-0f45-4255-98ac-7d3aceafeb93 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:51.914357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f98b716-0f45-4255-98ac-7d3aceafeb93 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:51.914813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f98b716-0f45-4255-98ac-7d3aceafeb93 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:51.915745 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f98b716-0f45-4255-98ac-7d3aceafeb93 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:51.916188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f98b716-0f45-4255-98ac-7d3aceafeb93 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:52.074017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8f98b716-0f45-4255-98ac-7d3aceafeb93 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:52.082798 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8f98b716-0f45-4255-98ac-7d3aceafeb93 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1511 microversion: 2.1 time: 0.180163 May 21 21:24:52.083400 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1811/3526] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:51 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1511 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:52.282851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ed90ed32-0873-4133-8b7e-b16a3765c158 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:52.283471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ed90ed32-0873-4133-8b7e-b16a3765c158 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:52.289833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed90ed32-0873-4133-8b7e-b16a3765c158 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:52.290290 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed90ed32-0873-4133-8b7e-b16a3765c158 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:52.291086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed90ed32-0873-4133-8b7e-b16a3765c158 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:52.291525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed90ed32-0873-4133-8b7e-b16a3765c158 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:52.363650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-07101245-7e22-4bc7-b85e-6d97f718ec50 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:52.364532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-07101245-7e22-4bc7-b85e-6d97f718ec50 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] [instance: 8d342970-e711-41ce-8cc5-8c8325b62e4d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:52.371226 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07101245-7e22-4bc7-b85e-6d97f718ec50 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:52.371679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07101245-7e22-4bc7-b85e-6d97f718ec50 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:52.372484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07101245-7e22-4bc7-b85e-6d97f718ec50 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:52.372926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07101245-7e22-4bc7-b85e-6d97f718ec50 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:52.468933 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-07101245-7e22-4bc7-b85e-6d97f718ec50 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:52.471315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:52.478171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-07101245-7e22-4bc7-b85e-6d97f718ec50 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:52.479685 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-07101245-7e22-4bc7-b85e-6d97f718ec50 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:52.480925 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-07101245-7e22-4bc7-b85e-6d97f718ec50 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] 10.222.0.49 "GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d" status: 200 len: 1359 microversion: 2.47 time: 0.121683 May 21 21:24:52.481520 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1812/3527] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:24:52 2022] GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d => generated 1359 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:24:52.486842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c7b54096-81e6-41dc-b93e-eceeeb29f8d9 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:52.487691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c7b54096-81e6-41dc-b93e-eceeeb29f8d9 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:52.493964 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7b54096-81e6-41dc-b93e-eceeeb29f8d9 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:52.495592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7b54096-81e6-41dc-b93e-eceeeb29f8d9 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:52.496592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7b54096-81e6-41dc-b93e-eceeeb29f8d9 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:52.497768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7b54096-81e6-41dc-b93e-eceeeb29f8d9 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:52.575183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c7b54096-81e6-41dc-b93e-eceeeb29f8d9 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec7dadaea104c4498cd8bf98ceea738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960f5f98c8d64ac384c86350b29ee9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:52.583581 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c7b54096-81e6-41dc-b93e-eceeeb29f8d9 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e" status: 200 len: 1278 microversion: 2.1 time: 0.100845 May 21 21:24:52.584379 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1813/3528] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:52 2022] GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e => generated 1278 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:52.589370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8b11aeed-992c-4e4d-b547-c707f0cd80aa tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2110182333"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:52.590531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8b11aeed-992c-4e4d-b547-c707f0cd80aa tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] [instance: 8d342970-e711-41ce-8cc5-8c8325b62e4d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:52.598029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b11aeed-992c-4e4d-b547-c707f0cd80aa tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:52.598713 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b11aeed-992c-4e4d-b547-c707f0cd80aa tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:52.599499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b11aeed-992c-4e4d-b547-c707f0cd80aa tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:52.599938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b11aeed-992c-4e4d-b547-c707f0cd80aa tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:52.819264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ed90ed32-0873-4133-8b7e-b16a3765c158 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:52.828124 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ed90ed32-0873-4133-8b7e-b16a3765c158 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 200 len: 1607 microversion: 2.1 time: 0.549258 May 21 21:24:52.828748 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1716/3529] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:52 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 1607 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:52.833444 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-54612b9b-3320-4fb5-96a9-ee4dabd20354 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:52.834059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-54612b9b-3320-4fb5-96a9-ee4dabd20354 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] [instance: ab8466bc-22eb-4ffa-9dfc-f9b112576c18] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:52.841040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54612b9b-3320-4fb5-96a9-ee4dabd20354 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:52.841494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54612b9b-3320-4fb5-96a9-ee4dabd20354 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:52.842280 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54612b9b-3320-4fb5-96a9-ee4dabd20354 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:52.843524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54612b9b-3320-4fb5-96a9-ee4dabd20354 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:52.857874 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-54612b9b-3320-4fb5-96a9-ee4dabd20354 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] HTTP exception thrown: Instance ab8466bc-22eb-4ffa-9dfc-f9b112576c18 could not be found. May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-54612b9b-3320-4fb5-96a9-ee4dabd20354 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Request method failure captured: May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 HTTP/1.1 May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiViK_ZXqa6jYF-rV1YQ7ilDLewpjwKGg4Kbi04fTx1HuMXbUGrGTWvNNxiyYNwR2OM8fPD5DOT3vC1YnXk56arSQ9Cfeoky2ig5L0fihEWoZQulcPpLcXWdQIcU3sZ1zG58uGusdCtfayc-kj6zOOcy8ocxZSDWG6rk51qsO5a9xgEM May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 1361e32a370e47a9bd4121c5e8a1bbab May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-InstanceActionsTestJSON-338442876 May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1361e32a370e47a9bd4121c5e8a1bbab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1361e32a370e47a9bd4121c5e8a1bbab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1361e32a370e47a9bd4121c5e8a1bbab", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1361e32a370e47a9bd4121c5e8a1bbab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-InstanceActionsTestJSON-338442876 May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 1361e32a370e47a9bd4121c5e8a1bbab May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-InstanceActionsTestJSON-338442876 May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-InstanceActionsTestJSON-338442876-project May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 4c9c832b56ed4ec3a601ba39287dcc43 May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-InstanceActionsTestJSON-338442876-project May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance ab8466bc-22eb-4ffa-9dfc-f9b112576c18 could not be found. May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'ab8466bc-22eb-4ffa-9dfc-f9b112576c18'} May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab8466bc-22eb-4ffa-9dfc-f9b112576c18 could not be found. May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab8466bc-22eb-4ffa-9dfc-f9b112576c18 could not be found. May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:52.860033 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:52.864474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:52.864474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:52.864474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:52.864474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:24:52.864474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:24:52.864474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab8466bc-22eb-4ffa-9dfc-f9b112576c18 could not be found. May 21 21:24:52.864474 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:24:52.864474 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-54612b9b-3320-4fb5-96a9-ee4dabd20354 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] Returning 404 to user: Instance ab8466bc-22eb-4ffa-9dfc-f9b112576c18 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:24:52.864474 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-54612b9b-3320-4fb5-96a9-ee4dabd20354 tempest-InstanceActionsTestJSON-338442876 tempest-InstanceActionsTestJSON-338442876-project] 10.222.0.49 "GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18" status: 404 len: 111 microversion: 2.1 time: 0.031962 May 21 21:24:52.864474 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1717/3530] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:52 2022] GET /compute/v2.1/servers/ab8466bc-22eb-4ffa-9dfc-f9b112576c18 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:24:53.100989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fac3543e-6958-49c1-b13c-e8b31c033448 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:53.101623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fac3543e-6958-49c1-b13c-e8b31c033448 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:53.107802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fac3543e-6958-49c1-b13c-e8b31c033448 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:53.108258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fac3543e-6958-49c1-b13c-e8b31c033448 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:53.109315 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fac3543e-6958-49c1-b13c-e8b31c033448 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:53.109743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fac3543e-6958-49c1-b13c-e8b31c033448 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:53.147192 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8b11aeed-992c-4e4d-b547-c707f0cd80aa tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] 10.222.0.49 "POST /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d/action" status: 202 len: 52 microversion: 2.47 time: 0.561341 May 21 21:24:53.148746 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1814/3531] 10.222.0.49 () {62 vars in 1318 bytes} [Sat May 21 21:24:52 2022] POST /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d/action => generated 52 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) May 21 21:24:53.166946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-843aeace-e112-456d-a8c5-adb3c50ea048 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:53.167850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-843aeace-e112-456d-a8c5-adb3c50ea048 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] [instance: 8d342970-e711-41ce-8cc5-8c8325b62e4d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:53.175286 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-843aeace-e112-456d-a8c5-adb3c50ea048 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:53.175744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-843aeace-e112-456d-a8c5-adb3c50ea048 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:53.176557 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-843aeace-e112-456d-a8c5-adb3c50ea048 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:53.177003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-843aeace-e112-456d-a8c5-adb3c50ea048 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:53.210887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-843aeace-e112-456d-a8c5-adb3c50ea048 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] [instance: 8d342970-e711-41ce-8cc5-8c8325b62e4d] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:24:53.518789 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fac3543e-6958-49c1-b13c-e8b31c033448 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:53.556303 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fac3543e-6958-49c1-b13c-e8b31c033448 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1511 microversion: 2.1 time: 0.459151 May 21 21:24:53.560685 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1718/3532] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:53 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1511 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:53.612610 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6a7fe0ac-45a2-46af-b96a-1a0d94f49387 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:53.613436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6a7fe0ac-45a2-46af-b96a-1a0d94f49387 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:53.620521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6a7fe0ac-45a2-46af-b96a-1a0d94f49387 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:53.620967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6a7fe0ac-45a2-46af-b96a-1a0d94f49387 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:53.621968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6a7fe0ac-45a2-46af-b96a-1a0d94f49387 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:53.622406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6a7fe0ac-45a2-46af-b96a-1a0d94f49387 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:53.652107 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-843aeace-e112-456d-a8c5-adb3c50ea048 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d" status: 204 len: 0 microversion: 2.47 time: 0.496501 May 21 21:24:53.652802 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1815/3533] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:24:53 2022] DELETE /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:24:53.662555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e761e8ad-3992-4110-8569-8eb225babe12 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:53.663268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e761e8ad-3992-4110-8569-8eb225babe12 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] [instance: 8d342970-e711-41ce-8cc5-8c8325b62e4d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:53.669803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e761e8ad-3992-4110-8569-8eb225babe12 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:53.670263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e761e8ad-3992-4110-8569-8eb225babe12 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:53.671924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e761e8ad-3992-4110-8569-8eb225babe12 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:53.672976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e761e8ad-3992-4110-8569-8eb225babe12 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:53.747638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e761e8ad-3992-4110-8569-8eb225babe12 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:53.756917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e761e8ad-3992-4110-8569-8eb225babe12 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:53.758483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e761e8ad-3992-4110-8569-8eb225babe12 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:53.759609 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e761e8ad-3992-4110-8569-8eb225babe12 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] 10.222.0.49 "GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d" status: 200 len: 1365 microversion: 2.47 time: 0.101503 May 21 21:24:53.771980 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1816/3534] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:24:53 2022] GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d => generated 1365 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:24:53.849198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-196fd8df-400d-4162-b16a-334d429431f8 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:53.850059 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-196fd8df-400d-4162-b16a-334d429431f8 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:53.857784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-196fd8df-400d-4162-b16a-334d429431f8 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:53.858246 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-196fd8df-400d-4162-b16a-334d429431f8 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:53.859871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-196fd8df-400d-4162-b16a-334d429431f8 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:53.860367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-196fd8df-400d-4162-b16a-334d429431f8 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:54.130651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6a7fe0ac-45a2-46af-b96a-1a0d94f49387 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec7dadaea104c4498cd8bf98ceea738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960f5f98c8d64ac384c86350b29ee9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:54.142055 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6a7fe0ac-45a2-46af-b96a-1a0d94f49387 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e" status: 200 len: 1276 microversion: 2.1 time: 0.534421 May 21 21:24:54.145041 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1719/3535] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:53 2022] GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e => generated 1276 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:54.463706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-196fd8df-400d-4162-b16a-334d429431f8 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:54.477996 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-196fd8df-400d-4162-b16a-334d429431f8 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 200 len: 1607 microversion: 2.1 time: 0.636722 May 21 21:24:54.478574 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1817/3536] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:53 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 1607 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:54.578609 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1ac7dd58-ac5f-4f13-9a82-a6f8e0b2d0ea tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:54.579233 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1ac7dd58-ac5f-4f13-9a82-a6f8e0b2d0ea tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:54.587102 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ac7dd58-ac5f-4f13-9a82-a6f8e0b2d0ea tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:54.587588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ac7dd58-ac5f-4f13-9a82-a6f8e0b2d0ea tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:54.589077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ac7dd58-ac5f-4f13-9a82-a6f8e0b2d0ea tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:54.589767 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ac7dd58-ac5f-4f13-9a82-a6f8e0b2d0ea tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:54.779642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a71d7ddc-e163-4ad7-8101-8566610db027 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:54.781613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a71d7ddc-e163-4ad7-8101-8566610db027 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] [instance: 8d342970-e711-41ce-8cc5-8c8325b62e4d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:54.788038 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a71d7ddc-e163-4ad7-8101-8566610db027 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:54.788538 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a71d7ddc-e163-4ad7-8101-8566610db027 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:54.789324 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a71d7ddc-e163-4ad7-8101-8566610db027 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:54.789784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a71d7ddc-e163-4ad7-8101-8566610db027 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:54.865413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a71d7ddc-e163-4ad7-8101-8566610db027 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:54.873910 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a71d7ddc-e163-4ad7-8101-8566610db027 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:54.875732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a71d7ddc-e163-4ad7-8101-8566610db027 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:54.876947 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a71d7ddc-e163-4ad7-8101-8566610db027 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] 10.222.0.49 "GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d" status: 200 len: 1365 microversion: 2.47 time: 0.101584 May 21 21:24:54.877864 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1818/3537] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:24:54 2022] GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d => generated 1365 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:24:55.121174 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1ac7dd58-ac5f-4f13-9a82-a6f8e0b2d0ea tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:55.130209 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1ac7dd58-ac5f-4f13-9a82-a6f8e0b2d0ea tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1511 microversion: 2.1 time: 0.556001 May 21 21:24:55.131023 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1720/3538] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:54 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1511 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:55.164299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8596a755-58b2-4921-af79-827413f9ec99 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:55.164954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8596a755-58b2-4921-af79-827413f9ec99 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:55.172207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8596a755-58b2-4921-af79-827413f9ec99 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:55.172796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8596a755-58b2-4921-af79-827413f9ec99 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:55.173568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8596a755-58b2-4921-af79-827413f9ec99 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:55.174003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8596a755-58b2-4921-af79-827413f9ec99 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:55.355499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8596a755-58b2-4921-af79-827413f9ec99 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec7dadaea104c4498cd8bf98ceea738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960f5f98c8d64ac384c86350b29ee9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:55.366115 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8596a755-58b2-4921-af79-827413f9ec99 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e" status: 200 len: 1318 microversion: 2.1 time: 0.210606 May 21 21:24:55.367211 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1819/3539] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:55 2022] GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:55.496789 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4d09be1d-8ab1-455e-bfc5-e17c48f01054 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:55.497660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4d09be1d-8ab1-455e-bfc5-e17c48f01054 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:55.502069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:55.512720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d09be1d-8ab1-455e-bfc5-e17c48f01054 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:55.517459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d09be1d-8ab1-455e-bfc5-e17c48f01054 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:55.517459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d09be1d-8ab1-455e-bfc5-e17c48f01054 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:55.517459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d09be1d-8ab1-455e-bfc5-e17c48f01054 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:55.634332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4d09be1d-8ab1-455e-bfc5-e17c48f01054 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:55.643101 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4d09be1d-8ab1-455e-bfc5-e17c48f01054 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 200 len: 1540 microversion: 2.1 time: 0.151545 May 21 21:24:55.644101 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1721/3540] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:55 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 1540 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:55.895073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-d3a1fbb0-cb47-40d8-a6b9-85e6c0a486bf req-bc05e820-2d93-4aed-a045-2a7fdb0b657b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bd22b39-b6ee-4fbd-a518-98285883af10", "name": "network-vif-deleted", "tag": "e6e7b9ba-54d7-426f-b099-2697c07707f7"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:55.900581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-436a60f5-5fe4-4318-9a7e-5d0e6bc040aa tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:55.901220 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-436a60f5-5fe4-4318-9a7e-5d0e6bc040aa tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] [instance: 8d342970-e711-41ce-8cc5-8c8325b62e4d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:55.913009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d3a1fbb0-cb47-40d8-a6b9-85e6c0a486bf req-bc05e820-2d93-4aed-a045-2a7fdb0b657b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:55.914184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d3a1fbb0-cb47-40d8-a6b9-85e6c0a486bf req-bc05e820-2d93-4aed-a045-2a7fdb0b657b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:55.915263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-436a60f5-5fe4-4318-9a7e-5d0e6bc040aa tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:55.916413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-436a60f5-5fe4-4318-9a7e-5d0e6bc040aa tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:55.919333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-436a60f5-5fe4-4318-9a7e-5d0e6bc040aa tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:55.920166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-436a60f5-5fe4-4318-9a7e-5d0e6bc040aa tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:55.958329 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-d3a1fbb0-cb47-40d8-a6b9-85e6c0a486bf req-bc05e820-2d93-4aed-a045-2a7fdb0b657b service nova] Creating event network-vif-deleted:e6e7b9ba-54d7-426f-b099-2697c07707f7 for instance 0bd22b39-b6ee-4fbd-a518-98285883af10 on nch2-master-1 May 21 21:24:55.970948 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-d3a1fbb0-cb47-40d8-a6b9-85e6c0a486bf req-bc05e820-2d93-4aed-a045-2a7fdb0b657b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082864 May 21 21:24:55.972371 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1820/3541] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:56.059138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-436a60f5-5fe4-4318-9a7e-5d0e6bc040aa tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:56.070284 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-436a60f5-5fe4-4318-9a7e-5d0e6bc040aa tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:56.072035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-436a60f5-5fe4-4318-9a7e-5d0e6bc040aa tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:56.073334 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-436a60f5-5fe4-4318-9a7e-5d0e6bc040aa tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] 10.222.0.49 "GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d" status: 200 len: 1365 microversion: 2.47 time: 0.178418 May 21 21:24:56.073976 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1722/3542] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:24:55 2022] GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:24:56.152720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-48178c50-31e7-4428-9003-a77ad1eb9874 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:56.154218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-48178c50-31e7-4428-9003-a77ad1eb9874 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:56.164753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48178c50-31e7-4428-9003-a77ad1eb9874 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:56.165407 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48178c50-31e7-4428-9003-a77ad1eb9874 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:56.166784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48178c50-31e7-4428-9003-a77ad1eb9874 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:56.167616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48178c50-31e7-4428-9003-a77ad1eb9874 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:56.384982 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0a7dcb6f-d038-4dba-9a45-e66ab3e93b4d tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:56.385940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0a7dcb6f-d038-4dba-9a45-e66ab3e93b4d tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:56.397712 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a7dcb6f-d038-4dba-9a45-e66ab3e93b4d tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:56.398251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a7dcb6f-d038-4dba-9a45-e66ab3e93b4d tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:56.398963 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a7dcb6f-d038-4dba-9a45-e66ab3e93b4d tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:56.399403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a7dcb6f-d038-4dba-9a45-e66ab3e93b4d tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:56.462163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-48178c50-31e7-4428-9003-a77ad1eb9874 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:56.474002 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-48178c50-31e7-4428-9003-a77ad1eb9874 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1511 microversion: 2.1 time: 0.329357 May 21 21:24:56.475084 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1821/3543] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:56 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1511 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:56.672104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fb9711de-4556-4933-98a6-5056ac312c53 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:56.672871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fb9711de-4556-4933-98a6-5056ac312c53 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:56.679882 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb9711de-4556-4933-98a6-5056ac312c53 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:56.680942 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb9711de-4556-4933-98a6-5056ac312c53 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:56.681303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb9711de-4556-4933-98a6-5056ac312c53 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:56.681735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb9711de-4556-4933-98a6-5056ac312c53 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:56.761457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0a7dcb6f-d038-4dba-9a45-e66ab3e93b4d tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec7dadaea104c4498cd8bf98ceea738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960f5f98c8d64ac384c86350b29ee9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:56.771898 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0a7dcb6f-d038-4dba-9a45-e66ab3e93b4d tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e" status: 200 len: 1318 microversion: 2.1 time: 0.392597 May 21 21:24:56.774609 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1723/3544] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:56 2022] GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:24:56.821076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fb9711de-4556-4933-98a6-5056ac312c53 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:56.830690 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fb9711de-4556-4933-98a6-5056ac312c53 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 200 len: 1251 microversion: 2.1 time: 0.171416 May 21 21:24:56.834116 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1822/3545] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:56 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 1251 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:57.095302 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8528af77-3970-4cfd-8b2b-12fb763c5324 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:57.103368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8528af77-3970-4cfd-8b2b-12fb763c5324 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] [instance: 8d342970-e711-41ce-8cc5-8c8325b62e4d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:57.103368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8528af77-3970-4cfd-8b2b-12fb763c5324 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:57.103654 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8528af77-3970-4cfd-8b2b-12fb763c5324 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:57.104461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8528af77-3970-4cfd-8b2b-12fb763c5324 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:57.104909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8528af77-3970-4cfd-8b2b-12fb763c5324 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:57.154174 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8528af77-3970-4cfd-8b2b-12fb763c5324 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:57.155910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8528af77-3970-4cfd-8b2b-12fb763c5324 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:57.157261 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-8528af77-3970-4cfd-8b2b-12fb763c5324 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lazy-loading 'fault' on Instance uuid 8d342970-e711-41ce-8cc5-8c8325b62e4d {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:24:57.373688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8528af77-3970-4cfd-8b2b-12fb763c5324 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:57.388909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8528af77-3970-4cfd-8b2b-12fb763c5324 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:57.391046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8528af77-3970-4cfd-8b2b-12fb763c5324 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2536f74eff9243f9bc30bc0acaf2badb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f0418d760a46589f3608bf67301a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:57.392352 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8528af77-3970-4cfd-8b2b-12fb763c5324 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] 10.222.0.49 "GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d" status: 200 len: 1370 microversion: 2.47 time: 0.303593 May 21 21:24:57.392961 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1724/3546] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:24:57 2022] GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d => generated 1370 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:24:57.491952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9cc3cb6b-93a8-4752-a540-d1f3c4d2546b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:57.493098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9cc3cb6b-93a8-4752-a540-d1f3c4d2546b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:57.506132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cc3cb6b-93a8-4752-a540-d1f3c4d2546b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:57.507000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cc3cb6b-93a8-4752-a540-d1f3c4d2546b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:57.508349 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cc3cb6b-93a8-4752-a540-d1f3c4d2546b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:57.509438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cc3cb6b-93a8-4752-a540-d1f3c4d2546b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:57.794766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-67146292-31af-4d60-9883-5810c1d00eb8 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:57.794766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-67146292-31af-4d60-9883-5810c1d00eb8 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:57.798723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-67146292-31af-4d60-9883-5810c1d00eb8 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:57.799176 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-67146292-31af-4d60-9883-5810c1d00eb8 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:57.799955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-67146292-31af-4d60-9883-5810c1d00eb8 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:57.800416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-67146292-31af-4d60-9883-5810c1d00eb8 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:57.832734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9cc3cb6b-93a8-4752-a540-d1f3c4d2546b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:57.841027 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9cc3cb6b-93a8-4752-a540-d1f3c4d2546b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1511 microversion: 2.1 time: 0.353274 May 21 21:24:57.841618 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1823/3547] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:57 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1511 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:57.849550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:57.857259 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8f027514-0547-4ecd-aeb1-10a586a112ab tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:57.858760 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8f027514-0547-4ecd-aeb1-10a586a112ab tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:57.869959 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f027514-0547-4ecd-aeb1-10a586a112ab tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:57.870839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f027514-0547-4ecd-aeb1-10a586a112ab tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:57.871869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f027514-0547-4ecd-aeb1-10a586a112ab tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:57.872537 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f027514-0547-4ecd-aeb1-10a586a112ab tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:57.915381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f027514-0547-4ecd-aeb1-10a586a112ab tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:57.916004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8f027514-0547-4ecd-aeb1-10a586a112ab tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:57.916586 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-8f027514-0547-4ecd-aeb1-10a586a112ab tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lazy-loading 'fault' on Instance uuid 0bd22b39-b6ee-4fbd-a518-98285883af10 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:24:58.003602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8f027514-0547-4ecd-aeb1-10a586a112ab tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2cc0075e654fe2b9ac0fbad3a7c239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28107ae255f24328bcce84129cec62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:58.015666 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8f027514-0547-4ecd-aeb1-10a586a112ab tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 200 len: 1256 microversion: 2.1 time: 0.165717 May 21 21:24:58.016844 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1824/3548] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:57 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 1256 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:58.022187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-913927f4-f04b-48e1-b0eb-3621d4ad898c req-4a2be759-c6ae-4937-9d65-9588b7647e7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c113a19-4007-4621-b04f-ae6c9f36e09e", "tag": "949baf9a-fc71-48fc-962b-9011db8747a9"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:58.038684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-913927f4-f04b-48e1-b0eb-3621d4ad898c req-4a2be759-c6ae-4937-9d65-9588b7647e7a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:58.039387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-913927f4-f04b-48e1-b0eb-3621d4ad898c req-4a2be759-c6ae-4937-9d65-9588b7647e7a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:58.055685 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-913927f4-f04b-48e1-b0eb-3621d4ad898c req-4a2be759-c6ae-4937-9d65-9588b7647e7a service nova] Creating event network-changed:949baf9a-fc71-48fc-962b-9011db8747a9 for instance 5c113a19-4007-4621-b04f-ae6c9f36e09e on nch2-master-1 May 21 21:24:58.060868 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-913927f4-f04b-48e1-b0eb-3621d4ad898c req-4a2be759-c6ae-4937-9d65-9588b7647e7a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042351 May 21 21:24:58.062165 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1825/3549] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:24:58.208167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-67146292-31af-4d60-9883-5810c1d00eb8 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec7dadaea104c4498cd8bf98ceea738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960f5f98c8d64ac384c86350b29ee9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:58.218669 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-67146292-31af-4d60-9883-5810c1d00eb8 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e" status: 200 len: 1318 microversion: 2.1 time: 0.432304 May 21 21:24:58.219334 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1725/3550] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:57 2022] GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:58.417546 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-195851d3-e042-48cf-b54e-77596a098aa2 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:58.418744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-195851d3-e042-48cf-b54e-77596a098aa2 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] [instance: 8d342970-e711-41ce-8cc5-8c8325b62e4d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:58.429208 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-195851d3-e042-48cf-b54e-77596a098aa2 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:58.429888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-195851d3-e042-48cf-b54e-77596a098aa2 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:58.430787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-195851d3-e042-48cf-b54e-77596a098aa2 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:58.431499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-195851d3-e042-48cf-b54e-77596a098aa2 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:58.447402 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-195851d3-e042-48cf-b54e-77596a098aa2 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] HTTP exception thrown: Instance 8d342970-e711-41ce-8cc5-8c8325b62e4d could not be found. May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-195851d3-e042-48cf-b54e-77596a098aa2 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Request method failure captured: May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d HTTP/1.1 May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVidxHjjxAvuaGGIpk2ROvXatvM6ga1MJ88ivpORxyKj6u2Kq7H_mwG4-rJGCSlNW6TzR6YOrlVDFafOhy2mlXNu6fYnyxxH86NalNbqHarJx_n_6m-Zwh7lXUU5VM1TbWwgpuBqU68FSc1g2mxcmuGhHCNKhwLLHohZXmh2ysndNO8 May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: X-Openstack-Nova-Api-Version: 2.47 May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 21f0418d760a46589f3608bf67301a6c May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersAaction247Test-750252738 May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/21f0418d760a46589f3608bf67301a6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/21f0418d760a46589f3608bf67301a6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_21f0418d760a46589f3608bf67301a6c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/21f0418d760a46589f3608bf67301a6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersAaction247Test-750252738 May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 21f0418d760a46589f3608bf67301a6c May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersAaction247Test-750252738 May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersAaction247Test-750252738-project May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 2536f74eff9243f9bc30bc0acaf2badb May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersAaction247Test-750252738-project May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 8d342970-e711-41ce-8cc5-8c8325b62e4d could not be found. May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '8d342970-e711-41ce-8cc5-8c8325b62e4d'} May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d342970-e711-41ce-8cc5-8c8325b62e4d could not be found. May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d342970-e711-41ce-8cc5-8c8325b62e4d could not be found. May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:58.454618 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:58.464989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:58.464989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:58.464989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:58.464989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:24:58.464989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:24:58.464989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d342970-e711-41ce-8cc5-8c8325b62e4d could not be found. May 21 21:24:58.464989 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:58.464989 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-195851d3-e042-48cf-b54e-77596a098aa2 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] Returning 404 to user: Instance 8d342970-e711-41ce-8cc5-8c8325b62e4d could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:24:58.464989 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-195851d3-e042-48cf-b54e-77596a098aa2 tempest-ServersAaction247Test-750252738 tempest-ServersAaction247Test-750252738-project] 10.222.0.49 "GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d" status: 404 len: 111 microversion: 2.47 time: 0.039112 May 21 21:24:58.464989 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1826/3551] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:24:58 2022] GET /compute/v2.1/servers/8d342970-e711-41ce-8cc5-8c8325b62e4d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:24:58.861249 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6e832867-352b-40c7-9df0-4ccfe7f330a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:58.862336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6e832867-352b-40c7-9df0-4ccfe7f330a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:58.871336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e832867-352b-40c7-9df0-4ccfe7f330a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:58.872185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e832867-352b-40c7-9df0-4ccfe7f330a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:58.875012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e832867-352b-40c7-9df0-4ccfe7f330a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:58.875564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e832867-352b-40c7-9df0-4ccfe7f330a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:58.927767 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:59.037675 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cd2c4eb7-20f8-4103-9234-6586f5f8a8ae tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:59.039077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cd2c4eb7-20f8-4103-9234-6586f5f8a8ae tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] [instance: 0bd22b39-b6ee-4fbd-a518-98285883af10] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:59.057943 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd2c4eb7-20f8-4103-9234-6586f5f8a8ae tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:59.058618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd2c4eb7-20f8-4103-9234-6586f5f8a8ae tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:59.059729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd2c4eb7-20f8-4103-9234-6586f5f8a8ae tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:59.060518 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd2c4eb7-20f8-4103-9234-6586f5f8a8ae tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:59.079250 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-cd2c4eb7-20f8-4103-9234-6586f5f8a8ae tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] HTTP exception thrown: Instance 0bd22b39-b6ee-4fbd-a518-98285883af10 could not be found. May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cd2c4eb7-20f8-4103-9234-6586f5f8a8ae tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Request method failure captured: May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 HTTP/1.1 May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVbQEim-bfYUgiaA2V_VaRXvrazt-M8SVKaNcA3-GBoW9l80lIGJWJK6Vnj-lp6PYdktg9JChms_NpyiUmuq-pnQAimIWcca_8KXNhTijpil-6e_4A1URBjHoKWxE--ObQY3STtiaxj29JSF9j0ovDMqnAOoMDLfLhLd2Fj0Cxqnb94 May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 28107ae255f24328bcce84129cec62d4 May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersTestBootFromVolume-614856547 May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/28107ae255f24328bcce84129cec62d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/28107ae255f24328bcce84129cec62d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_28107ae255f24328bcce84129cec62d4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/28107ae255f24328bcce84129cec62d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersTestBootFromVolume-614856547 May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 28107ae255f24328bcce84129cec62d4 May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersTestBootFromVolume-614856547 May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersTestBootFromVolume-614856547-project May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: ac2cc0075e654fe2b9ac0fbad3a7c239 May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersTestBootFromVolume-614856547-project May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 0bd22b39-b6ee-4fbd-a518-98285883af10 could not be found. May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '0bd22b39-b6ee-4fbd-a518-98285883af10'} May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bd22b39-b6ee-4fbd-a518-98285883af10 could not be found. May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bd22b39-b6ee-4fbd-a518-98285883af10 could not be found. May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:24:59.081257 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:59.085526 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:24:59.085526 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:24:59.085526 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:24:59.085526 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:24:59.085526 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:24:59.085526 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bd22b39-b6ee-4fbd-a518-98285883af10 could not be found. May 21 21:24:59.085526 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:24:59.088513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cd2c4eb7-20f8-4103-9234-6586f5f8a8ae tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Returning 404 to user: Instance 0bd22b39-b6ee-4fbd-a518-98285883af10 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:24:59.089650 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cd2c4eb7-20f8-4103-9234-6586f5f8a8ae tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10" status: 404 len: 111 microversion: 2.1 time: 0.060494 May 21 21:24:59.091332 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1827/3552] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:59 2022] GET /compute/v2.1/servers/0bd22b39-b6ee-4fbd-a518-98285883af10 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:24:59.099415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-de97e70b-426b-421b-9673-ba1bad73fc74 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] Calling method '.version_select at 0x7fc82d0cc700>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:59.103150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6e832867-352b-40c7-9df0-4ccfe7f330a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:59.112709 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6e832867-352b-40c7-9df0-4ccfe7f330a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1511 microversion: 2.1 time: 0.256003 May 21 21:24:59.113535 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1726/3553] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:58 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:59.207335 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-de97e70b-426b-421b-9673-ba1bad73fc74 tempest-ServersTestBootFromVolume-614856547 tempest-ServersTestBootFromVolume-614856547-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-231693768" status: 202 len: 0 microversion: 2.1 time: 0.111544 May 21 21:24:59.210982 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1828/3554] 10.222.0.49 () {58 vars in 1217 bytes} [Sat May 21 21:24:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-231693768 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:24:59.238988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0f288c18-6587-49b7-9ae6-152fc4f12ed8 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:24:59.242024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0f288c18-6587-49b7-9ae6-152fc4f12ed8 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:24:59.250416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f288c18-6587-49b7-9ae6-152fc4f12ed8 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:59.251934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f288c18-6587-49b7-9ae6-152fc4f12ed8 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:59.253953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f288c18-6587-49b7-9ae6-152fc4f12ed8 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:24:59.255141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f288c18-6587-49b7-9ae6-152fc4f12ed8 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:24:59.527596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0f288c18-6587-49b7-9ae6-152fc4f12ed8 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec7dadaea104c4498cd8bf98ceea738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960f5f98c8d64ac384c86350b29ee9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:24:59.533876 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0f288c18-6587-49b7-9ae6-152fc4f12ed8 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e" status: 200 len: 1318 microversion: 2.1 time: 0.302186 May 21 21:24:59.537613 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1727/3555] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:24:59 2022] GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:24:59.745267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5cb7a053-a5d3-4695-bfa6-8169370fe26e tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-732623234", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "b89dbae9-aa45-473b-b94c-93ee40f503b4"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:24:59.799749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-5cb7a053-a5d3-4695-bfa6-8169370fe26e tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] validate_networks() for [('b89dbae9-aa45-473b-b94c-93ee40f503b4', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:25:00.133892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-303daaec-c6d7-438d-b493-986e5652e6ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:00.134515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-303daaec-c6d7-438d-b493-986e5652e6ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:00.143595 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-303daaec-c6d7-438d-b493-986e5652e6ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:00.144531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-303daaec-c6d7-438d-b493-986e5652e6ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:00.144881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-303daaec-c6d7-438d-b493-986e5652e6ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:00.148137 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-303daaec-c6d7-438d-b493-986e5652e6ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:00.150369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:00.321927 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=18 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:00.409252 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-5cb7a053-a5d3-4695-bfa6-8169370fe26e tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:25:00.409689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-5cb7a053-a5d3-4695-bfa6-8169370fe26e tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:25:00.410524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-5cb7a053-a5d3-4695-bfa6-8169370fe26e tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:25:00.410944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-5cb7a053-a5d3-4695-bfa6-8169370fe26e tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:25:00.411356 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-5cb7a053-a5d3-4695-bfa6-8169370fe26e tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:25:00.421256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5cb7a053-a5d3-4695-bfa6-8169370fe26e tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:00.421810 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5cb7a053-a5d3-4695-bfa6-8169370fe26e tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:00.422633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5cb7a053-a5d3-4695-bfa6-8169370fe26e tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:00.423067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5cb7a053-a5d3-4695-bfa6-8169370fe26e tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:00.443367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-5cb7a053-a5d3-4695-bfa6-8169370fe26e tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Getting quotas for project 706a488689e241468fa53273beb2b806. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:25:00.448805 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-5cb7a053-a5d3-4695-bfa6-8169370fe26e tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Getting quotas for user 6a7daba5b4d4435abf1df0efb30079a4 and project 706a488689e241468fa53273beb2b806. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:25:00.462111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5cb7a053-a5d3-4695-bfa6-8169370fe26e tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:25:00.464418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5cb7a053-a5d3-4695-bfa6-8169370fe26e tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] [instance: 253ae0a9-f88c-45d1-a627-a2de39674b56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:25:00.493612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-303daaec-c6d7-438d-b493-986e5652e6ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:00.502108 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-303daaec-c6d7-438d-b493-986e5652e6ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1511 microversion: 2.1 time: 0.373150 May 21 21:25:00.502889 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1728/3556] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:00 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1511 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:00.559270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b5ca564f-e0bf-47da-9a81-e556bb936d80 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:00.559981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b5ca564f-e0bf-47da-9a81-e556bb936d80 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:00.569957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5ca564f-e0bf-47da-9a81-e556bb936d80 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:00.570731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5ca564f-e0bf-47da-9a81-e556bb936d80 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:00.571766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5ca564f-e0bf-47da-9a81-e556bb936d80 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:00.572335 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5ca564f-e0bf-47da-9a81-e556bb936d80 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:00.609104 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5cb7a053-a5d3-4695-bfa6-8169370fe26e tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.011662 May 21 21:25:00.616537 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1829/3557] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:24:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:25:00.628241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6c8139e2-babb-4fe0-a38b-0d50e08e751b tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:00.629134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6c8139e2-babb-4fe0-a38b-0d50e08e751b tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] [instance: 253ae0a9-f88c-45d1-a627-a2de39674b56] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:00.714111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6c8139e2-babb-4fe0-a38b-0d50e08e751b tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7daba5b4d4435abf1df0efb30079a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '706a488689e241468fa53273beb2b806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:00.722959 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6c8139e2-babb-4fe0-a38b-0d50e08e751b tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] 10.222.0.49 "GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56" status: 200 len: 1224 microversion: 2.1 time: 0.104675 May 21 21:25:00.723998 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1830/3558] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:00 2022] GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:00.885284 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b5ca564f-e0bf-47da-9a81-e556bb936d80 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec7dadaea104c4498cd8bf98ceea738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960f5f98c8d64ac384c86350b29ee9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:00.894924 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b5ca564f-e0bf-47da-9a81-e556bb936d80 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e" status: 200 len: 1318 microversion: 2.1 time: 0.343552 May 21 21:25:00.896118 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1729/3559] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:00 2022] GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:01.521199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d6745ba4-168b-418c-8406-8012f614e04f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:01.523289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d6745ba4-168b-418c-8406-8012f614e04f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:01.533346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6745ba4-168b-418c-8406-8012f614e04f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:01.534420 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6745ba4-168b-418c-8406-8012f614e04f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:01.540822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6745ba4-168b-418c-8406-8012f614e04f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:01.540822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6745ba4-168b-418c-8406-8012f614e04f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:01.562513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:01.742499 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1df7ccba-2929-4fa4-bee0-bca2c236bb4d tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:01.744031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1df7ccba-2929-4fa4-bee0-bca2c236bb4d tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] [instance: 253ae0a9-f88c-45d1-a627-a2de39674b56] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:01.857270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1df7ccba-2929-4fa4-bee0-bca2c236bb4d tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7daba5b4d4435abf1df0efb30079a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '706a488689e241468fa53273beb2b806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:01.865644 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1df7ccba-2929-4fa4-bee0-bca2c236bb4d tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] 10.222.0.49 "GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56" status: 200 len: 1224 microversion: 2.1 time: 0.129064 May 21 21:25:01.866233 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1730/3560] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:01 2022] GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56 => generated 1224 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:01.889636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d6745ba4-168b-418c-8406-8012f614e04f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:01.897125 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d6745ba4-168b-418c-8406-8012f614e04f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1511 microversion: 2.1 time: 0.381253 May 21 21:25:01.897734 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1831/3561] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:01 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1511 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:01.914055 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-059ef372-1997-41ba-ac70-5ae1b50196c7 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:01.914793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-059ef372-1997-41ba-ac70-5ae1b50196c7 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:01.922978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-059ef372-1997-41ba-ac70-5ae1b50196c7 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:01.923431 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-059ef372-1997-41ba-ac70-5ae1b50196c7 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:01.924230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-059ef372-1997-41ba-ac70-5ae1b50196c7 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:01.924689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-059ef372-1997-41ba-ac70-5ae1b50196c7 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:02.204646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-059ef372-1997-41ba-ac70-5ae1b50196c7 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec7dadaea104c4498cd8bf98ceea738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960f5f98c8d64ac384c86350b29ee9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:02.217829 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-059ef372-1997-41ba-ac70-5ae1b50196c7 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e" status: 200 len: 1318 microversion: 2.1 time: 0.307080 May 21 21:25:02.218570 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1731/3562] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:01 2022] GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:02.882749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f7840f37-2104-4dbf-873c-8c4fa158666a tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:02.883359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f7840f37-2104-4dbf-873c-8c4fa158666a tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] [instance: 253ae0a9-f88c-45d1-a627-a2de39674b56] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:02.892878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7840f37-2104-4dbf-873c-8c4fa158666a tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:02.893338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7840f37-2104-4dbf-873c-8c4fa158666a tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:02.894187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7840f37-2104-4dbf-873c-8c4fa158666a tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:02.895600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7840f37-2104-4dbf-873c-8c4fa158666a tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:02.916464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b384be4c-b897-47d5-b26f-af882532f057 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:02.917782 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b384be4c-b897-47d5-b26f-af882532f057 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:02.926247 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b384be4c-b897-47d5-b26f-af882532f057 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:02.926981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b384be4c-b897-47d5-b26f-af882532f057 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:02.927968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b384be4c-b897-47d5-b26f-af882532f057 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:02.928655 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b384be4c-b897-47d5-b26f-af882532f057 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:03.025373 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f7840f37-2104-4dbf-873c-8c4fa158666a tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7daba5b4d4435abf1df0efb30079a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '706a488689e241468fa53273beb2b806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:03.039159 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f7840f37-2104-4dbf-873c-8c4fa158666a tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] 10.222.0.49 "GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56" status: 200 len: 1276 microversion: 2.1 time: 0.160036 May 21 21:25:03.040250 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1832/3563] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:02 2022] GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56 => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:03.236129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9d23acdf-db36-4bc0-b314-19a429f14183 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:03.238391 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9d23acdf-db36-4bc0-b314-19a429f14183 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:03.251210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d23acdf-db36-4bc0-b314-19a429f14183 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:03.252215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d23acdf-db36-4bc0-b314-19a429f14183 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:03.253579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d23acdf-db36-4bc0-b314-19a429f14183 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:03.254593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d23acdf-db36-4bc0-b314-19a429f14183 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:03.667811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b384be4c-b897-47d5-b26f-af882532f057 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:03.677596 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b384be4c-b897-47d5-b26f-af882532f057 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1511 microversion: 2.1 time: 0.763227 May 21 21:25:03.678917 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1732/3564] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:02 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1511 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:03.692564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-a735bafc-2078-461f-ad6f-e91ddfd2d10b req-9d1be034-50d1-48ba-9f5e-c50aca335fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c113a19-4007-4621-b04f-ae6c9f36e09e", "name": "network-vif-plugged", "status": "completed", "tag": "949baf9a-fc71-48fc-962b-9011db8747a9"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:03.701747 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a735bafc-2078-461f-ad6f-e91ddfd2d10b req-9d1be034-50d1-48ba-9f5e-c50aca335fa4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:03.702432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a735bafc-2078-461f-ad6f-e91ddfd2d10b req-9d1be034-50d1-48ba-9f5e-c50aca335fa4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:03.719399 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-a735bafc-2078-461f-ad6f-e91ddfd2d10b req-9d1be034-50d1-48ba-9f5e-c50aca335fa4 service nova] Creating event network-vif-plugged:949baf9a-fc71-48fc-962b-9011db8747a9 for instance 5c113a19-4007-4621-b04f-ae6c9f36e09e on nch2-master-1 May 21 21:25:03.726624 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-a735bafc-2078-461f-ad6f-e91ddfd2d10b req-9d1be034-50d1-48ba-9f5e-c50aca335fa4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043811 May 21 21:25:03.728480 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1733/3565] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:03.948871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9d23acdf-db36-4bc0-b314-19a429f14183 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec7dadaea104c4498cd8bf98ceea738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960f5f98c8d64ac384c86350b29ee9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:03.962666 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9d23acdf-db36-4bc0-b314-19a429f14183 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e" status: 200 len: 1318 microversion: 2.1 time: 0.730061 May 21 21:25:03.962666 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1833/3566] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:03 2022] GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e => generated 1318 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:04.057754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6b5d1871-00c4-4ecb-a0f2-8496bc45b6b5 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:04.058463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6b5d1871-00c4-4ecb-a0f2-8496bc45b6b5 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] [instance: 253ae0a9-f88c-45d1-a627-a2de39674b56] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:04.070929 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b5d1871-00c4-4ecb-a0f2-8496bc45b6b5 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:04.070929 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b5d1871-00c4-4ecb-a0f2-8496bc45b6b5 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:04.070929 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b5d1871-00c4-4ecb-a0f2-8496bc45b6b5 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:04.070929 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b5d1871-00c4-4ecb-a0f2-8496bc45b6b5 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:04.191381 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6b5d1871-00c4-4ecb-a0f2-8496bc45b6b5 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7daba5b4d4435abf1df0efb30079a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '706a488689e241468fa53273beb2b806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:04.209713 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6b5d1871-00c4-4ecb-a0f2-8496bc45b6b5 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] 10.222.0.49 "GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56" status: 200 len: 1282 microversion: 2.1 time: 0.154216 May 21 21:25:04.219765 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1734/3567] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:04 2022] GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56 => generated 1282 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:04.649770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7668a01d-0edf-4fb2-99b4-9eb7ee2a6ddb tempest-ServerGroup264TestJSON-1320699961 tempest-ServerGroup264TestJSON-1320699961-project] Action: 'create', calling method: .version_select at 0x7fc81a53f160>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:04.673950 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-7668a01d-0edf-4fb2-99b4-9eb7ee2a6ddb tempest-ServerGroup264TestJSON-1320699961 tempest-ServerGroup264TestJSON-1320699961-project] Getting quotas for project 7f6aca3a049143719a59b88915162948. Resources: {'server_groups'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:25:04.683287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-7668a01d-0edf-4fb2-99b4-9eb7ee2a6ddb tempest-ServerGroup264TestJSON-1320699961 tempest-ServerGroup264TestJSON-1320699961-project] Getting quotas for user 3912f27cea8b40508f5897342ac46921 and project 7f6aca3a049143719a59b88915162948. Resources: {'server_groups'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:25:04.696773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0c93352b-2f74-471e-ba6f-b2f246569e03 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:04.697390 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0c93352b-2f74-471e-ba6f-b2f246569e03 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:04.706907 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c93352b-2f74-471e-ba6f-b2f246569e03 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:04.708457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c93352b-2f74-471e-ba6f-b2f246569e03 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:04.713170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c93352b-2f74-471e-ba6f-b2f246569e03 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:04.713791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c93352b-2f74-471e-ba6f-b2f246569e03 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:04.717966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:04.835190 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-7668a01d-0edf-4fb2-99b4-9eb7ee2a6ddb tempest-ServerGroup264TestJSON-1320699961 tempest-ServerGroup264TestJSON-1320699961-project] Getting quotas for project 7f6aca3a049143719a59b88915162948. Resources: {'server_groups'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:25:04.843917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-7668a01d-0edf-4fb2-99b4-9eb7ee2a6ddb tempest-ServerGroup264TestJSON-1320699961 tempest-ServerGroup264TestJSON-1320699961-project] Getting quotas for user 3912f27cea8b40508f5897342ac46921 and project 7f6aca3a049143719a59b88915162948. Resources: {'server_groups'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:25:04.866370 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7668a01d-0edf-4fb2-99b4-9eb7ee2a6ddb tempest-ServerGroup264TestJSON-1320699961 tempest-ServerGroup264TestJSON-1320699961-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.381797 May 21 21:25:04.868959 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1834/3568] 10.222.0.49 () {62 vars in 1213 bytes} [Sat May 21 21:25:04 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:25:04.882873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-850b1037-9abd-44de-b852-6d0bd5f1c87d tempest-ServerGroup264TestJSON-1320699961 tempest-ServerGroup264TestJSON-1320699961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:04.930359 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-850b1037-9abd-44de-b852-6d0bd5f1c87d tempest-ServerGroup264TestJSON-1320699961 tempest-ServerGroup264TestJSON-1320699961-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.051607 May 21 21:25:04.936172 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1835/3569] 10.222.0.49 () {60 vars in 1192 bytes} [Sat May 21 21:25:04 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:25:04.947280 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6f0146d9-0853-4dc2-a2ec-04a3b7715eb8 tempest-ServerGroup264TestJSON-1320699961 tempest-ServerGroup264TestJSON-1320699961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:04.957076 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6f0146d9-0853-4dc2-a2ec-04a3b7715eb8 tempest-ServerGroup264TestJSON-1320699961 tempest-ServerGroup264TestJSON-1320699961-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups/893ec79c-3fc0-4f61-b1e0-00c4c1004dc2" status: 200 len: 235 microversion: 2.64 time: 0.014184 May 21 21:25:04.967706 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1836/3570] 10.222.0.49 () {60 vars in 1303 bytes} [Sat May 21 21:25:04 2022] GET /compute/v2.1/os-server-groups/893ec79c-3fc0-4f61-b1e0-00c4c1004dc2 => generated 235 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:25:04.983668 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9ed77bcb-0484-40d7-88bb-26df0d7eabe2 tempest-ServerGroup264TestJSON-1320699961 tempest-ServerGroup264TestJSON-1320699961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:05.140758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0c93352b-2f74-471e-ba6f-b2f246569e03 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:05.150553 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0c93352b-2f74-471e-ba6f-b2f246569e03 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1511 microversion: 2.1 time: 0.456694 May 21 21:25:05.150553 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1735/3571] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:04 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1511 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:05.156633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7bbd84b0-8140-4614-b3cf-de447db9f398 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:05.157543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7bbd84b0-8140-4614-b3cf-de447db9f398 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:05.163897 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7bbd84b0-8140-4614-b3cf-de447db9f398 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:05.164576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7bbd84b0-8140-4614-b3cf-de447db9f398 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:05.165739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7bbd84b0-8140-4614-b3cf-de447db9f398 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:05.166225 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7bbd84b0-8140-4614-b3cf-de447db9f398 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:05.175392 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9ed77bcb-0484-40d7-88bb-26df0d7eabe2 tempest-ServerGroup264TestJSON-1320699961 tempest-ServerGroup264TestJSON-1320699961-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/893ec79c-3fc0-4f61-b1e0-00c4c1004dc2" status: 204 len: 0 microversion: 2.64 time: 0.201741 May 21 21:25:05.176535 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1837/3572] 10.222.0.49 () {60 vars in 1306 bytes} [Sat May 21 21:25:04 2022] DELETE /compute/v2.1/os-server-groups/893ec79c-3fc0-4f61-b1e0-00c4c1004dc2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:25:05.187475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1a75a953-ca1b-4fdf-8ca5-e109b48eee47 tempest-ServerGroup264TestJSON-1320699961 tempest-ServerGroup264TestJSON-1320699961-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:05.203115 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-1a75a953-ca1b-4fdf-8ca5-e109b48eee47 tempest-ServerGroup264TestJSON-1320699961 tempest-ServerGroup264TestJSON-1320699961-project] HTTP exception thrown: Instance group 893ec79c-3fc0-4f61-b1e0-00c4c1004dc2 could not be found. May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1a75a953-ca1b-4fdf-8ca5-e109b48eee47 tempest-ServerGroup264TestJSON-1320699961 tempest-ServerGroup264TestJSON-1320699961-project] Request method failure captured: May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/os-server-groups/893ec79c-3fc0-4f61-b1e0-00c4c1004dc2 HTTP/1.1 May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiViwo-QITFRsh5jHkOJHvjvMxHvJwPJJeUJPFT0hbfFN_gwpBEfcC6_TT7uOdk0V7xz4wxm_mBK-hzh---cLLH_ieVFJCVaAZnWGS-naBvMQDBIst4RjPGEBWzdefDgIQa2NvY5V7lILeliaoph9lnWRRS_DGWuytXHy65PGwGVwyjM May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: X-Openstack-Nova-Api-Version: 2.64 May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 7f6aca3a049143719a59b88915162948 May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerGroup264TestJSON-1320699961 May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7f6aca3a049143719a59b88915162948"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7f6aca3a049143719a59b88915162948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7f6aca3a049143719a59b88915162948", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7f6aca3a049143719a59b88915162948"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerGroup264TestJSON-1320699961 May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 7f6aca3a049143719a59b88915162948 May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1320699961 May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerGroup264TestJSON-1320699961-project May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 3912f27cea8b40508f5897342ac46921 May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerGroup264TestJSON-1320699961-project May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance group 893ec79c-3fc0-4f61-b1e0-00c4c1004dc2 could not be found. May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '893ec79c-3fc0-4f61-b1e0-00c4c1004dc2'} May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 893ec79c-3fc0-4f61-b1e0-00c4c1004dc2 could not be found. May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 893ec79c-3fc0-4f61-b1e0-00c4c1004dc2 could not be found. May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:05.213543 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:05.218919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:05.218919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:05.218919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:25:05.218919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:25:05.218919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 893ec79c-3fc0-4f61-b1e0-00c4c1004dc2 could not be found. May 21 21:25:05.218919 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:05.218919 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1a75a953-ca1b-4fdf-8ca5-e109b48eee47 tempest-ServerGroup264TestJSON-1320699961 tempest-ServerGroup264TestJSON-1320699961-project] Returning 404 to user: Instance group 893ec79c-3fc0-4f61-b1e0-00c4c1004dc2 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:25:05.218919 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1a75a953-ca1b-4fdf-8ca5-e109b48eee47 tempest-ServerGroup264TestJSON-1320699961 tempest-ServerGroup264TestJSON-1320699961-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/893ec79c-3fc0-4f61-b1e0-00c4c1004dc2" status: 404 len: 117 microversion: 2.64 time: 0.033577 May 21 21:25:05.221667 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1838/3573] 10.222.0.49 () {60 vars in 1306 bytes} [Sat May 21 21:25:05 2022] DELETE /compute/v2.1/os-server-groups/893ec79c-3fc0-4f61-b1e0-00c4c1004dc2 => generated 117 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:25:05.230713 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-21fd8ce1-d092-4a47-9e20-029d27db88bb tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:05.234386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-21fd8ce1-d092-4a47-9e20-029d27db88bb tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] [instance: 253ae0a9-f88c-45d1-a627-a2de39674b56] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:05.251757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21fd8ce1-d092-4a47-9e20-029d27db88bb tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:05.253609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21fd8ce1-d092-4a47-9e20-029d27db88bb tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:05.257549 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21fd8ce1-d092-4a47-9e20-029d27db88bb tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:05.258162 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21fd8ce1-d092-4a47-9e20-029d27db88bb tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:05.603003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-21fd8ce1-d092-4a47-9e20-029d27db88bb tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7daba5b4d4435abf1df0efb30079a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '706a488689e241468fa53273beb2b806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:05.613045 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-21fd8ce1-d092-4a47-9e20-029d27db88bb tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] 10.222.0.49 "GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56" status: 200 len: 1324 microversion: 2.1 time: 0.389548 May 21 21:25:05.614017 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1839/3574] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:05 2022] GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56 => generated 1324 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:05.705667 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7bbd84b0-8140-4614-b3cf-de447db9f398 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec7dadaea104c4498cd8bf98ceea738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960f5f98c8d64ac384c86350b29ee9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:05.717599 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7bbd84b0-8140-4614-b3cf-de447db9f398 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e" status: 200 len: 1318 microversion: 2.1 time: 0.565580 May 21 21:25:05.718593 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1736/3575] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:05 2022] GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:06.171017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7e7302ea-780c-4c98-ab72-47637255eabb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:06.174826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7e7302ea-780c-4c98-ab72-47637255eabb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:06.184595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e7302ea-780c-4c98-ab72-47637255eabb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:06.185046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e7302ea-780c-4c98-ab72-47637255eabb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:06.186085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e7302ea-780c-4c98-ab72-47637255eabb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:06.194036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e7302ea-780c-4c98-ab72-47637255eabb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:06.634657 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2c1f7a2b-12be-4158-b4ff-b551819e935f tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:06.636040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2c1f7a2b-12be-4158-b4ff-b551819e935f tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] [instance: 253ae0a9-f88c-45d1-a627-a2de39674b56] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:06.644245 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c1f7a2b-12be-4158-b4ff-b551819e935f tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:06.645060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c1f7a2b-12be-4158-b4ff-b551819e935f tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:06.647697 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c1f7a2b-12be-4158-b4ff-b551819e935f tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:06.648966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c1f7a2b-12be-4158-b4ff-b551819e935f tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:06.804670 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7e7302ea-780c-4c98-ab72-47637255eabb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:06.819695 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7e7302ea-780c-4c98-ab72-47637255eabb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1511 microversion: 2.1 time: 0.655986 May 21 21:25:06.820737 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1840/3576] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:06 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1511 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:06.834385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-470ec47e-d063-4103-b23c-b8f40015675d tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:06.837585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-470ec47e-d063-4103-b23c-b8f40015675d tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:06.859025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-470ec47e-d063-4103-b23c-b8f40015675d tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:06.860251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-470ec47e-d063-4103-b23c-b8f40015675d tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:06.861420 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-470ec47e-d063-4103-b23c-b8f40015675d tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:06.862244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-470ec47e-d063-4103-b23c-b8f40015675d tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:06.988033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2c1f7a2b-12be-4158-b4ff-b551819e935f tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7daba5b4d4435abf1df0efb30079a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '706a488689e241468fa53273beb2b806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:07.000773 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2c1f7a2b-12be-4158-b4ff-b551819e935f tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] 10.222.0.49 "GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56" status: 200 len: 1324 microversion: 2.1 time: 0.373232 May 21 21:25:07.005184 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1737/3577] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:06 2022] GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56 => generated 1324 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:07.524973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-91bf154b-3793-4dfd-9440-08f725ca42fd req-57015499-d096-4bd9-81b1-a7f24c877dbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "253ae0a9-f88c-45d1-a627-a2de39674b56", "tag": "b42d5e9d-6da0-42e7-89ef-fd31306028ee"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:07.534952 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-91bf154b-3793-4dfd-9440-08f725ca42fd req-57015499-d096-4bd9-81b1-a7f24c877dbc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:07.535398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-91bf154b-3793-4dfd-9440-08f725ca42fd req-57015499-d096-4bd9-81b1-a7f24c877dbc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:07.548330 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-91bf154b-3793-4dfd-9440-08f725ca42fd req-57015499-d096-4bd9-81b1-a7f24c877dbc service nova] Creating event network-changed:b42d5e9d-6da0-42e7-89ef-fd31306028ee for instance 253ae0a9-f88c-45d1-a627-a2de39674b56 on nch1-master-1 May 21 21:25:07.553298 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-91bf154b-3793-4dfd-9440-08f725ca42fd req-57015499-d096-4bd9-81b1-a7f24c877dbc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031964 May 21 21:25:07.554213 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1738/3578] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:07.620739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-470ec47e-d063-4103-b23c-b8f40015675d tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec7dadaea104c4498cd8bf98ceea738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960f5f98c8d64ac384c86350b29ee9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:07.630645 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-470ec47e-d063-4103-b23c-b8f40015675d tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e" status: 200 len: 1508 microversion: 2.1 time: 0.807035 May 21 21:25:07.631746 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1841/3579] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:06 2022] GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e => generated 1508 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:07.840660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6cddb00b-2d8e-47f1-b2f6-5f4c6bfc848e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:07.841620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6cddb00b-2d8e-47f1-b2f6-5f4c6bfc848e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:07.850306 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6cddb00b-2d8e-47f1-b2f6-5f4c6bfc848e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:07.851889 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6cddb00b-2d8e-47f1-b2f6-5f4c6bfc848e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:07.853076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6cddb00b-2d8e-47f1-b2f6-5f4c6bfc848e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:07.853757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6cddb00b-2d8e-47f1-b2f6-5f4c6bfc848e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:08.017594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f16134f3-779c-4842-9fb3-f61acab1df64 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:08.018577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f16134f3-779c-4842-9fb3-f61acab1df64 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] [instance: 253ae0a9-f88c-45d1-a627-a2de39674b56] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:08.030564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f16134f3-779c-4842-9fb3-f61acab1df64 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:08.032492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f16134f3-779c-4842-9fb3-f61acab1df64 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:08.035033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f16134f3-779c-4842-9fb3-f61acab1df64 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:08.037163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f16134f3-779c-4842-9fb3-f61acab1df64 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:08.239618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6cddb00b-2d8e-47f1-b2f6-5f4c6bfc848e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:08.254070 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6cddb00b-2d8e-47f1-b2f6-5f4c6bfc848e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1488 microversion: 2.1 time: 0.418504 May 21 21:25:08.255037 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1739/3580] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:07 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1488 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:08.273526 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1a2bb349-5e09-4cfe-8bf0-461cf4aa8c7f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:08.274519 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1a2bb349-5e09-4cfe-8bf0-461cf4aa8c7f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:08.281487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a2bb349-5e09-4cfe-8bf0-461cf4aa8c7f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:08.282222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a2bb349-5e09-4cfe-8bf0-461cf4aa8c7f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:08.283270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a2bb349-5e09-4cfe-8bf0-461cf4aa8c7f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:08.283979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a2bb349-5e09-4cfe-8bf0-461cf4aa8c7f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:08.336270 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1a2bb349-5e09-4cfe-8bf0-461cf4aa8c7f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action" status: 200 len: 164 microversion: 2.1 time: 0.066087 May 21 21:25:08.337612 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1740/3581] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:25:08 2022] POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action => generated 164 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:08.347543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6143d68b-e52a-472b-9b1a-71a61f51bb1c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:08.348417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6143d68b-e52a-472b-9b1a-71a61f51bb1c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:08.356703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6143d68b-e52a-472b-9b1a-71a61f51bb1c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:08.363093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6143d68b-e52a-472b-9b1a-71a61f51bb1c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:08.363093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6143d68b-e52a-472b-9b1a-71a61f51bb1c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:08.363093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6143d68b-e52a-472b-9b1a-71a61f51bb1c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:08.403203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f16134f3-779c-4842-9fb3-f61acab1df64 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7daba5b4d4435abf1df0efb30079a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '706a488689e241468fa53273beb2b806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:08.412069 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f16134f3-779c-4842-9fb3-f61acab1df64 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] 10.222.0.49 "GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56" status: 200 len: 1324 microversion: 2.1 time: 0.398410 May 21 21:25:08.413004 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1842/3582] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:08 2022] GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56 => generated 1324 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:08.961469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6143d68b-e52a-472b-9b1a-71a61f51bb1c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:08.987139 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6143d68b-e52a-472b-9b1a-71a61f51bb1c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.630670 May 21 21:25:08.987139 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1741/3583] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:08 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:08.995593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4d2f75d6-67b2-41f1-980c-5ed28f0bce07 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:08.996220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4d2f75d6-67b2-41f1-980c-5ed28f0bce07 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:09.006045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d2f75d6-67b2-41f1-980c-5ed28f0bce07 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:09.006446 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d2f75d6-67b2-41f1-980c-5ed28f0bce07 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:09.007231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d2f75d6-67b2-41f1-980c-5ed28f0bce07 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:09.007672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d2f75d6-67b2-41f1-980c-5ed28f0bce07 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:09.238984 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4d2f75d6-67b2-41f1-980c-5ed28f0bce07 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:09.246842 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4d2f75d6-67b2-41f1-980c-5ed28f0bce07 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.255161 May 21 21:25:09.247825 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1843/3584] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:08 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:09.263938 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1b60dc04-6219-4a44-a649-cedd485cd849 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:09.264855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1b60dc04-6219-4a44-a649-cedd485cd849 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:09.271128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b60dc04-6219-4a44-a649-cedd485cd849 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:09.271717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b60dc04-6219-4a44-a649-cedd485cd849 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:09.272457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b60dc04-6219-4a44-a649-cedd485cd849 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:09.272900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b60dc04-6219-4a44-a649-cedd485cd849 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:09.426724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1b60dc04-6219-4a44-a649-cedd485cd849 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:09.430592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c5a91ca6-86c9-4303-bc91-1528bcae5140 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:09.431479 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c5a91ca6-86c9-4303-bc91-1528bcae5140 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] [instance: 253ae0a9-f88c-45d1-a627-a2de39674b56] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:09.438629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c5a91ca6-86c9-4303-bc91-1528bcae5140 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:09.443916 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c5a91ca6-86c9-4303-bc91-1528bcae5140 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:09.443916 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c5a91ca6-86c9-4303-bc91-1528bcae5140 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:09.443916 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c5a91ca6-86c9-4303-bc91-1528bcae5140 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:09.444269 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1b60dc04-6219-4a44-a649-cedd485cd849 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.180050 May 21 21:25:09.444269 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1742/3585] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:09 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:09.461568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3a748a80-21a4-43db-9a07-3806299257dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:09.463629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3a748a80-21a4-43db-9a07-3806299257dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:09.474817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a748a80-21a4-43db-9a07-3806299257dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:09.475826 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a748a80-21a4-43db-9a07-3806299257dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:09.479761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a748a80-21a4-43db-9a07-3806299257dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:09.480533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a748a80-21a4-43db-9a07-3806299257dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:09.975438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3a748a80-21a4-43db-9a07-3806299257dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:09.985289 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3a748a80-21a4-43db-9a07-3806299257dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.531603 May 21 21:25:09.986633 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1743/3586] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:09 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:10.065444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c5a91ca6-86c9-4303-bc91-1528bcae5140 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7daba5b4d4435abf1df0efb30079a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '706a488689e241468fa53273beb2b806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:10.073499 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c5a91ca6-86c9-4303-bc91-1528bcae5140 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] 10.222.0.49 "GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56" status: 200 len: 1324 microversion: 2.1 time: 0.646792 May 21 21:25:10.074071 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1844/3587] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:09 2022] GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56 => generated 1324 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:10.220219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0279a8c8-20bc-4b62-87fa-50e396e3664b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-801107806", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "5d4cf0c3-1319-4035-9b9a-7c7b54e6e093"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:10.277475 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-0279a8c8-20bc-4b62-87fa-50e396e3664b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] validate_networks() for [('5d4cf0c3-1319-4035-9b9a-7c7b54e6e093', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:25:10.981533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0279a8c8-20bc-4b62-87fa-50e396e3664b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:25:10.982175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0279a8c8-20bc-4b62-87fa-50e396e3664b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:25:10.983037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0279a8c8-20bc-4b62-87fa-50e396e3664b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:25:10.983695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0279a8c8-20bc-4b62-87fa-50e396e3664b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:25:10.984318 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0279a8c8-20bc-4b62-87fa-50e396e3664b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:25:10.994268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0279a8c8-20bc-4b62-87fa-50e396e3664b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:10.995919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0279a8c8-20bc-4b62-87fa-50e396e3664b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:10.996834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0279a8c8-20bc-4b62-87fa-50e396e3664b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:10.997537 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0279a8c8-20bc-4b62-87fa-50e396e3664b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:11.018260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-0279a8c8-20bc-4b62-87fa-50e396e3664b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Getting quotas for project 014ae80b3f434bcb9fa2629ccdf4aad7. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:25:11.024054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-0279a8c8-20bc-4b62-87fa-50e396e3664b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Getting quotas for user 1cafab0cbef64be59c7afef84d7888ff and project 014ae80b3f434bcb9fa2629ccdf4aad7. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:25:11.040973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0279a8c8-20bc-4b62-87fa-50e396e3664b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:25:11.043325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0279a8c8-20bc-4b62-87fa-50e396e3664b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:25:11.091640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7d8bfc91-70f5-4d4d-973e-2a74ac95fd8b tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:11.093107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7d8bfc91-70f5-4d4d-973e-2a74ac95fd8b tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] [instance: 253ae0a9-f88c-45d1-a627-a2de39674b56] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:11.095869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:11.103798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7d8bfc91-70f5-4d4d-973e-2a74ac95fd8b tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:11.119083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7d8bfc91-70f5-4d4d-973e-2a74ac95fd8b tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:11.119083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7d8bfc91-70f5-4d4d-973e-2a74ac95fd8b tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:11.119083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7d8bfc91-70f5-4d4d-973e-2a74ac95fd8b tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:11.211630 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0279a8c8-20bc-4b62-87fa-50e396e3664b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.995948 May 21 21:25:11.213311 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1744/3588] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:25:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:25:11.225049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-484e4dc3-07f7-43ea-bdfc-c1f58c1da294 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:11.225977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-484e4dc3-07f7-43ea-bdfc-c1f58c1da294 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:11.314901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-484e4dc3-07f7-43ea-bdfc-c1f58c1da294 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:11.333891 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-484e4dc3-07f7-43ea-bdfc-c1f58c1da294 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245" status: 200 len: 1214 microversion: 2.1 time: 0.103433 May 21 21:25:11.333891 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1745/3589] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:11 2022] GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245 => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:11.575021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7d8bfc91-70f5-4d4d-973e-2a74ac95fd8b tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7daba5b4d4435abf1df0efb30079a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '706a488689e241468fa53273beb2b806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:11.596581 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7d8bfc91-70f5-4d4d-973e-2a74ac95fd8b tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] 10.222.0.49 "GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56" status: 200 len: 1324 microversion: 2.1 time: 0.508496 May 21 21:25:11.599673 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1845/3590] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:11 2022] GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56 => generated 1324 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:12.341207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f9963a02-e933-492f-909e-8a96ea99bd13 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:12.342496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f9963a02-e933-492f-909e-8a96ea99bd13 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:12.360454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f9963a02-e933-492f-909e-8a96ea99bd13 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:12.362978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f9963a02-e933-492f-909e-8a96ea99bd13 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:12.362978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f9963a02-e933-492f-909e-8a96ea99bd13 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:12.362978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f9963a02-e933-492f-909e-8a96ea99bd13 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:12.466974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f9963a02-e933-492f-909e-8a96ea99bd13 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:12.479306 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f9963a02-e933-492f-909e-8a96ea99bd13 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245" status: 200 len: 1218 microversion: 2.1 time: 0.142092 May 21 21:25:12.480698 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1846/3591] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:12 2022] GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245 => generated 1218 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:12.557070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b7e90db9-d455-4a5a-aad1-d99f00d1e780 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Action: 'create', calling method: .version_select at 0x7fc82d0ff670>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1871362908", "policies": ["affinity"]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:12.581400 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-b7e90db9-d455-4a5a-aad1-d99f00d1e780 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_groups'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:25:12.587129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-b7e90db9-d455-4a5a-aad1-d99f00d1e780 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for user a9bb488c761c49c7911109b3c6be27c2 and project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_groups'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:25:12.615913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-70ed7597-d71a-4e42-9f9f-2f20fd61ba9b tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:12.616843 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-70ed7597-d71a-4e42-9f9f-2f20fd61ba9b tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] [instance: 253ae0a9-f88c-45d1-a627-a2de39674b56] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:12.623800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-70ed7597-d71a-4e42-9f9f-2f20fd61ba9b tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:12.624656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-70ed7597-d71a-4e42-9f9f-2f20fd61ba9b tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:12.625566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-70ed7597-d71a-4e42-9f9f-2f20fd61ba9b tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:12.626337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-70ed7597-d71a-4e42-9f9f-2f20fd61ba9b tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:12.736528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-b7e90db9-d455-4a5a-aad1-d99f00d1e780 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_groups'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:25:12.742896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-b7e90db9-d455-4a5a-aad1-d99f00d1e780 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for user a9bb488c761c49c7911109b3c6be27c2 and project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_groups'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:25:12.759945 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b7e90db9-d455-4a5a-aad1-d99f00d1e780 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.428533 May 21 21:25:12.760642 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1746/3592] 10.222.0.49 () {60 vars in 1173 bytes} [Sat May 21 21:25:12 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:12.771611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d8b0c587-4021-4e62-97eb-e32d1fc40d72 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Action: 'create', calling method: .version_select at 0x7fc81a1bf160>, body: {"server_group": {"name": "tempest-server-group-16780558", "policies": ["affinity"]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:12.784897 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:12.790912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-d8b0c587-4021-4e62-97eb-e32d1fc40d72 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_groups'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:25:12.796938 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-d8b0c587-4021-4e62-97eb-e32d1fc40d72 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for user a9bb488c761c49c7911109b3c6be27c2 and project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_groups'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:25:12.972686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-d8b0c587-4021-4e62-97eb-e32d1fc40d72 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_groups'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:25:12.978209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-d8b0c587-4021-4e62-97eb-e32d1fc40d72 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for user a9bb488c761c49c7911109b3c6be27c2 and project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_groups'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:25:12.980433 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-70ed7597-d71a-4e42-9f9f-2f20fd61ba9b tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7daba5b4d4435abf1df0efb30079a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '706a488689e241468fa53273beb2b806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:12.989618 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-70ed7597-d71a-4e42-9f9f-2f20fd61ba9b tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] 10.222.0.49 "GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56" status: 200 len: 1324 microversion: 2.1 time: 0.378846 May 21 21:25:12.990466 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1847/3593] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:12 2022] GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56 => generated 1324 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:12.993811 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d8b0c587-4021-4e62-97eb-e32d1fc40d72 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.226294 May 21 21:25:12.999485 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1747/3594] 10.222.0.49 () {60 vars in 1172 bytes} [Sat May 21 21:25:12 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:25:13.004661 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d38e9edf-e63f-442e-9fab-42c3b436efaa tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Action: 'create', calling method: .version_select at 0x7fc81a581040>, body: {"server_group": {"name": "tempest-server-group-16780558", "policies": ["affinity"]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:13.021065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-d38e9edf-e63f-442e-9fab-42c3b436efaa tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_groups'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:25:13.026277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-d38e9edf-e63f-442e-9fab-42c3b436efaa tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for user a9bb488c761c49c7911109b3c6be27c2 and project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_groups'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:25:13.254617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-d38e9edf-e63f-442e-9fab-42c3b436efaa tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_groups'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:25:13.259800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-d38e9edf-e63f-442e-9fab-42c3b436efaa tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for user a9bb488c761c49c7911109b3c6be27c2 and project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_groups'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:25:13.272979 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d38e9edf-e63f-442e-9fab-42c3b436efaa tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.272240 May 21 21:25:13.273585 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1848/3595] 10.222.0.49 () {60 vars in 1172 bytes} [Sat May 21 21:25:12 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:13.287959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3adf0b14-c3ca-442f-9383-8b4299779169 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:13.476116 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3adf0b14-c3ca-442f-9383-8b4299779169 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/f4bf4105-5e45-49ce-b70f-ff37971c5839" status: 204 len: 0 microversion: 2.1 time: 0.196622 May 21 21:25:13.477054 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1748/3596] 10.222.0.49 () {58 vars in 1265 bytes} [Sat May 21 21:25:13 2022] DELETE /compute/v2.1/os-server-groups/f4bf4105-5e45-49ce-b70f-ff37971c5839 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:25:13.489595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2e3150c5-e80f-4698-bddb-7c88bd3187c3 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:13.498169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2ca6cf1f-cc40-40a8-9cef-419e2f78f6cf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:13.500698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2ca6cf1f-cc40-40a8-9cef-419e2f78f6cf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:13.510839 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2e3150c5-e80f-4698-bddb-7c88bd3187c3 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.029460 May 21 21:25:13.512607 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2ca6cf1f-cc40-40a8-9cef-419e2f78f6cf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:13.515731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2ca6cf1f-cc40-40a8-9cef-419e2f78f6cf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:13.516993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2ca6cf1f-cc40-40a8-9cef-419e2f78f6cf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:13.517605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2ca6cf1f-cc40-40a8-9cef-419e2f78f6cf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:13.519652 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1849/3597] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:25:13 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:13.524991 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2a79e852-7e1b-4152-86d2-28797dfd6ee8 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:13.652922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2ca6cf1f-cc40-40a8-9cef-419e2f78f6cf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:13.670251 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2ca6cf1f-cc40-40a8-9cef-419e2f78f6cf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245" status: 200 len: 1266 microversion: 2.1 time: 0.175623 May 21 21:25:13.671775 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1749/3598] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:13 2022] GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:13.712338 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2a79e852-7e1b-4152-86d2-28797dfd6ee8 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/6cefe813-8fa6-4b10-828f-f37e362e56c3" status: 204 len: 0 microversion: 2.1 time: 0.190077 May 21 21:25:13.713350 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1850/3599] 10.222.0.49 () {58 vars in 1265 bytes} [Sat May 21 21:25:13 2022] DELETE /compute/v2.1/os-server-groups/6cefe813-8fa6-4b10-828f-f37e362e56c3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:25:13.720995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6cbf20ca-d8aa-4464-ade7-e21466294d0a tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:13.753645 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6cbf20ca-d8aa-4464-ade7-e21466294d0a tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.036382 May 21 21:25:13.754230 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1750/3600] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:25:13 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:13.768236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ae139dfb-211b-4636-9f79-d747650f832a tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Action: 'create', calling method: .version_select at 0x7fc81b3fc670>, body: {"server_group": {"name": "tempest-server-group-398782964", "policies": ["affinity"]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:13.789437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-ae139dfb-211b-4636-9f79-d747650f832a tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_groups'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:25:13.798874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-ae139dfb-211b-4636-9f79-d747650f832a tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for user a9bb488c761c49c7911109b3c6be27c2 and project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_groups'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:25:13.826727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8d2001d7-4aca-4574-8060-6a0ca28d5966 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-860440449", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "5b2cfbac-42dc-43ec-aa10-cc8413ff8370"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:13.887522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-8d2001d7-4aca-4574-8060-6a0ca28d5966 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] validate_networks() for [('5b2cfbac-42dc-43ec-aa10-cc8413ff8370', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:25:13.937779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-ae139dfb-211b-4636-9f79-d747650f832a tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_groups'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:25:13.944148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-ae139dfb-211b-4636-9f79-d747650f832a tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for user a9bb488c761c49c7911109b3c6be27c2 and project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_groups'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:25:13.975560 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ae139dfb-211b-4636-9f79-d747650f832a tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.211761 May 21 21:25:13.987772 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1751/3601] 10.222.0.49 () {60 vars in 1172 bytes} [Sat May 21 21:25:13 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:25:13.997762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7c8a3d45-13da-4b04-950c-c8ba740f90f0 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d57ce02-37f5-4d5e-b99e-ce11caefd4c6"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:13.999106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7c8a3d45-13da-4b04-950c-c8ba740f90f0 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:14.007431 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c8a3d45-13da-4b04-950c-c8ba740f90f0 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:14.007905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c8a3d45-13da-4b04-950c-c8ba740f90f0 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:14.008891 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c8a3d45-13da-4b04-950c-c8ba740f90f0 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:14.009485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c8a3d45-13da-4b04-950c-c8ba740f90f0 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:14.726942 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-8d2001d7-4aca-4574-8060-6a0ca28d5966 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:25:14.727456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-8d2001d7-4aca-4574-8060-6a0ca28d5966 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:25:14.728511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-8d2001d7-4aca-4574-8060-6a0ca28d5966 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:25:14.729158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-8d2001d7-4aca-4574-8060-6a0ca28d5966 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:25:14.733332 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-8d2001d7-4aca-4574-8060-6a0ca28d5966 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:25:14.740783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8d2001d7-4aca-4574-8060-6a0ca28d5966 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:14.741242 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8d2001d7-4aca-4574-8060-6a0ca28d5966 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:14.742257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8d2001d7-4aca-4574-8060-6a0ca28d5966 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:14.742705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8d2001d7-4aca-4574-8060-6a0ca28d5966 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:14.778962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-8d2001d7-4aca-4574-8060-6a0ca28d5966 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Getting quotas for project 7afab171ffbf4c199ccf15f7487c6a63. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:25:14.788620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-8d2001d7-4aca-4574-8060-6a0ca28d5966 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Getting quotas for user 746f8aecab064d1092c76c6b798bd750 and project 7afab171ffbf4c199ccf15f7487c6a63. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:25:14.805117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8d2001d7-4aca-4574-8060-6a0ca28d5966 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:25:14.806502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8d2001d7-4aca-4574-8060-6a0ca28d5966 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:25:14.836716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=87,nova_api:DELETE=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:15.033158 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:15.071031 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8d2001d7-4aca-4574-8060-6a0ca28d5966 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.325154 May 21 21:25:15.077201 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1851/3602] 10.222.0.49 () {62 vars in 1187 bytes} [Sat May 21 21:25:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 21 21:25:15.087902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2bb4c3db-ac1d-4fb3-b9ed-d99e1a1e2f76 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:15.125498 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7c8a3d45-13da-4b04-950c-c8ba740f90f0 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "POST /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.131681 May 21 21:25:15.131384 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1752/3603] 10.222.0.49 () {60 vars in 1322 bytes} [Sat May 21 21:25:13 2022] POST /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e/os-volume_attachments => generated 194 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:15.149558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-962dd16b-4ab2-4e30-88b2-c4b9b4c187fe tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:15.150343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-962dd16b-4ab2-4e30-88b2-c4b9b4c187fe tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] [instance: 253ae0a9-f88c-45d1-a627-a2de39674b56] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:15.179320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-962dd16b-4ab2-4e30-88b2-c4b9b4c187fe tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:15.179812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-962dd16b-4ab2-4e30-88b2-c4b9b4c187fe tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:15.180633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-962dd16b-4ab2-4e30-88b2-c4b9b4c187fe tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:15.181080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-962dd16b-4ab2-4e30-88b2-c4b9b4c187fe tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:15.219380 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2bb4c3db-ac1d-4fb3-b9ed-d99e1a1e2f76 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/6f0003e0-1510-415c-bdc6-cfcf12fbb281" status: 204 len: 0 microversion: 2.1 time: 0.140559 May 21 21:25:15.220021 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1852/3604] 10.222.0.49 () {58 vars in 1265 bytes} [Sat May 21 21:25:15 2022] DELETE /compute/v2.1/os-server-groups/6f0003e0-1510-415c-bdc6-cfcf12fbb281 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:25:15.230855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f2fb3e2c-e6a0-4d7f-8eeb-5b5228bc86ec req-df8fb5f1-ced1-4b36-933e-177c87925bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "253ae0a9-f88c-45d1-a627-a2de39674b56", "name": "network-vif-plugged", "status": "completed", "tag": "b42d5e9d-6da0-42e7-89ef-fd31306028ee"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:15.241254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f2fb3e2c-e6a0-4d7f-8eeb-5b5228bc86ec req-df8fb5f1-ced1-4b36-933e-177c87925bbf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:15.241871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f2fb3e2c-e6a0-4d7f-8eeb-5b5228bc86ec req-df8fb5f1-ced1-4b36-933e-177c87925bbf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:15.273550 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f2fb3e2c-e6a0-4d7f-8eeb-5b5228bc86ec req-df8fb5f1-ced1-4b36-933e-177c87925bbf service nova] Creating event network-vif-plugged:b42d5e9d-6da0-42e7-89ef-fd31306028ee for instance 253ae0a9-f88c-45d1-a627-a2de39674b56 on nch1-master-1 May 21 21:25:15.289357 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f2fb3e2c-e6a0-4d7f-8eeb-5b5228bc86ec req-df8fb5f1-ced1-4b36-933e-177c87925bbf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063545 May 21 21:25:15.290868 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1853/3605] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:15.300818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-39ff9713-2dcb-4e4a-8a41-4478a9dff330 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:15.305568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-39ff9713-2dcb-4e4a-8a41-4478a9dff330 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:15.310078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39ff9713-2dcb-4e4a-8a41-4478a9dff330 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:15.311699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39ff9713-2dcb-4e4a-8a41-4478a9dff330 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:15.312755 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39ff9713-2dcb-4e4a-8a41-4478a9dff330 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:15.313500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39ff9713-2dcb-4e4a-8a41-4478a9dff330 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:15.559935 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-39ff9713-2dcb-4e4a-8a41-4478a9dff330 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:15.571072 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-39ff9713-2dcb-4e4a-8a41-4478a9dff330 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245" status: 200 len: 1314 microversion: 2.1 time: 0.278311 May 21 21:25:15.582521 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1854/3606] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:15 2022] GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:15.588899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-51d8ddc9-e019-49f1-984f-2ed39463d55f tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:15.589784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-51d8ddc9-e019-49f1-984f-2ed39463d55f tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:15.678883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-51d8ddc9-e019-49f1-984f-2ed39463d55f tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:15.692590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-51d8ddc9-e019-49f1-984f-2ed39463d55f tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:15.695193 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-51d8ddc9-e019-49f1-984f-2ed39463d55f tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:15.697084 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-51d8ddc9-e019-49f1-984f-2ed39463d55f tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] 10.222.0.49 "GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803" status: 200 len: 1258 microversion: 2.21 time: 0.112930 May 21 21:25:15.697857 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1855/3607] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:25:15 2022] GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 => generated 1258 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:25:15.723618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-962dd16b-4ab2-4e30-88b2-c4b9b4c187fe tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7daba5b4d4435abf1df0efb30079a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '706a488689e241468fa53273beb2b806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:15.732248 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-962dd16b-4ab2-4e30-88b2-c4b9b4c187fe tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] 10.222.0.49 "GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56" status: 200 len: 1324 microversion: 2.1 time: 0.599432 May 21 21:25:15.732982 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1753/3608] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:15 2022] GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56 => generated 1324 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:15.744739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c280b3b1-0e7a-4c37-a5e1-6216f861990f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:15.765381 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c280b3b1-0e7a-4c37-a5e1-6216f861990f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.031442 May 21 21:25:15.770103 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1754/3609] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:25:15 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:15.788088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9bdf0d47-77fd-49a7-8a72-438fcbfbcd89 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Action: 'create', calling method: .version_select at 0x7fc81acf6310>, body: {"server_group": {"name": "tempest-server-group-2140705685", "policies": ["anti-affinity"]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:15.825435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-9bdf0d47-77fd-49a7-8a72-438fcbfbcd89 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_groups'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:25:15.837462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-9bdf0d47-77fd-49a7-8a72-438fcbfbcd89 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for user a9bb488c761c49c7911109b3c6be27c2 and project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_groups'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:25:15.966319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b4e03443-6dcc-45b1-9ab1-107838e710bc tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:15.975151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b4e03443-6dcc-45b1-9ab1-107838e710bc tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:15.992346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b4e03443-6dcc-45b1-9ab1-107838e710bc tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:15.993072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b4e03443-6dcc-45b1-9ab1-107838e710bc tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:15.994087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b4e03443-6dcc-45b1-9ab1-107838e710bc tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:15.994727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b4e03443-6dcc-45b1-9ab1-107838e710bc tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:16.005214 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-9bdf0d47-77fd-49a7-8a72-438fcbfbcd89 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_groups'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:25:16.019324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-9bdf0d47-77fd-49a7-8a72-438fcbfbcd89 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for user a9bb488c761c49c7911109b3c6be27c2 and project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_groups'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:25:16.052541 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b4e03443-6dcc-45b1-9ab1-107838e710bc tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "POST /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac/action" status: 200 len: 24591 microversion: 2.42 time: 0.341208 May 21 21:25:16.054572 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1856/3610] 10.222.0.49 () {62 vars in 1318 bytes} [Sat May 21 21:25:15 2022] POST /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac/action => generated 24591 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 21 21:25:16.056046 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9bdf0d47-77fd-49a7-8a72-438fcbfbcd89 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.277527 May 21 21:25:16.057837 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1755/3611] 10.222.0.49 () {60 vars in 1172 bytes} [Sat May 21 21:25:15 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:16.068892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f621fcd3-4494-43dd-b09f-97ef43703d50 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:16.202714 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f621fcd3-4494-43dd-b09f-97ef43703d50 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/c5437ee8-226d-473e-b2ab-0e20b92e8296" status: 204 len: 0 microversion: 2.1 time: 0.138295 May 21 21:25:16.203888 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1857/3612] 10.222.0.49 () {58 vars in 1265 bytes} [Sat May 21 21:25:16 2022] DELETE /compute/v2.1/os-server-groups/c5437ee8-226d-473e-b2ab-0e20b92e8296 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:25:16.214327 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3c66729c-efaf-45be-a790-7e26b3d81bb3 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:16.226522 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3c66729c-efaf-45be-a790-7e26b3d81bb3 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.016050 May 21 21:25:16.242677 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1756/3613] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:25:16 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:16.384162 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ce09675c-08a0-4b8b-935b-70417ce295e4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1078474813", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "08ab0fd6-0b67-44cd-8dfb-0b8803ff23b2"}]}, "os:scheduler_hints": {"group": "e3444781-eae6-4962-a000-7da74e8b2b31"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:16.441263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-ce09675c-08a0-4b8b-935b-70417ce295e4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] validate_networks() for [('08ab0fd6-0b67-44cd-8dfb-0b8803ff23b2', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:25:16.589036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-606be09f-9779-4da7-a1de-91a9053190ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:16.589656 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-606be09f-9779-4da7-a1de-91a9053190ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:16.610826 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-606be09f-9779-4da7-a1de-91a9053190ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:16.612435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-606be09f-9779-4da7-a1de-91a9053190ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:16.613666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-606be09f-9779-4da7-a1de-91a9053190ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:16.614429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-606be09f-9779-4da7-a1de-91a9053190ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:16.980201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-606be09f-9779-4da7-a1de-91a9053190ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:16.989394 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-606be09f-9779-4da7-a1de-91a9053190ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245" status: 200 len: 1314 microversion: 2.1 time: 0.404257 May 21 21:25:16.999208 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1757/3614] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:16 2022] GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:16.999208 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8559f22e-7709-4444-9b2b-c8260c47db3b tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:16.999208 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8559f22e-7709-4444-9b2b-c8260c47db3b tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:16.999208 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:17.005717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8559f22e-7709-4444-9b2b-c8260c47db3b tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:17.008194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8559f22e-7709-4444-9b2b-c8260c47db3b tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:17.008194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8559f22e-7709-4444-9b2b-c8260c47db3b tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:17.008194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8559f22e-7709-4444-9b2b-c8260c47db3b tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:17.036991 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ce09675c-08a0-4b8b-935b-70417ce295e4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:25:17.036991 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ce09675c-08a0-4b8b-935b-70417ce295e4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:25:17.036991 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ce09675c-08a0-4b8b-935b-70417ce295e4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:25:17.036991 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ce09675c-08a0-4b8b-935b-70417ce295e4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:25:17.036991 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ce09675c-08a0-4b8b-935b-70417ce295e4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:25:17.051710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce09675c-08a0-4b8b-935b-70417ce295e4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:17.052255 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce09675c-08a0-4b8b-935b-70417ce295e4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:17.053166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce09675c-08a0-4b8b-935b-70417ce295e4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:17.053692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce09675c-08a0-4b8b-935b-70417ce295e4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:17.079541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ce09675c-08a0-4b8b-935b-70417ce295e4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:25:17.085680 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ce09675c-08a0-4b8b-935b-70417ce295e4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for user a9bb488c761c49c7911109b3c6be27c2 and project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:25:17.094533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8559f22e-7709-4444-9b2b-c8260c47db3b tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:17.101535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ce09675c-08a0-4b8b-935b-70417ce295e4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:25:17.106365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8559f22e-7709-4444-9b2b-c8260c47db3b tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:17.106365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8559f22e-7709-4444-9b2b-c8260c47db3b tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:17.106365 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8559f22e-7709-4444-9b2b-c8260c47db3b tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] 10.222.0.49 "GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803" status: 200 len: 1262 microversion: 2.21 time: 0.113969 May 21 21:25:17.106365 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1758/3615] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:25:16 2022] GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 => generated 1262 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:25:17.111552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8457755c-7f39-4765-b1ba-247dbc591403 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:17.112522 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8457755c-7f39-4765-b1ba-247dbc591403 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] [instance: 253ae0a9-f88c-45d1-a627-a2de39674b56] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:17.119352 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8457755c-7f39-4765-b1ba-247dbc591403 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:17.120019 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8457755c-7f39-4765-b1ba-247dbc591403 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:17.120304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ce09675c-08a0-4b8b-935b-70417ce295e4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:25:17.121204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8457755c-7f39-4765-b1ba-247dbc591403 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:17.121851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8457755c-7f39-4765-b1ba-247dbc591403 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:17.363620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ce09675c-08a0-4b8b-935b-70417ce295e4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_group_members'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:25:17.375975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ce09675c-08a0-4b8b-935b-70417ce295e4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for user a9bb488c761c49c7911109b3c6be27c2 and project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_group_members'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:25:17.424754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8457755c-7f39-4765-b1ba-247dbc591403 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7daba5b4d4435abf1df0efb30079a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '706a488689e241468fa53273beb2b806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:17.432643 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8457755c-7f39-4765-b1ba-247dbc591403 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] 10.222.0.49 "GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56" status: 200 len: 1324 microversion: 2.1 time: 0.325122 May 21 21:25:17.433504 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1759/3616] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:17 2022] GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56 => generated 1324 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:17.449172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-62ea5b1b-438f-4e11-b07a-c892673c814f req-6a572002-69ba-4f6b-8336-a76ae119f48d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2be17b7-988e-4845-9959-5fa04cbed245", "tag": "f31dbee2-256e-43df-8541-a6196710f62e"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:17.460023 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-62ea5b1b-438f-4e11-b07a-c892673c814f req-6a572002-69ba-4f6b-8336-a76ae119f48d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:17.460766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-62ea5b1b-438f-4e11-b07a-c892673c814f req-6a572002-69ba-4f6b-8336-a76ae119f48d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:17.474115 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-62ea5b1b-438f-4e11-b07a-c892673c814f req-6a572002-69ba-4f6b-8336-a76ae119f48d service nova] Creating event network-changed:f31dbee2-256e-43df-8541-a6196710f62e for instance e2be17b7-988e-4845-9959-5fa04cbed245 on nch2-master-1 May 21 21:25:17.480021 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-62ea5b1b-438f-4e11-b07a-c892673c814f req-6a572002-69ba-4f6b-8336-a76ae119f48d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045267 May 21 21:25:17.480706 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1760/3617] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:17.491032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ce09675c-08a0-4b8b-935b-70417ce295e4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_group_members'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:25:17.497079 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ce09675c-08a0-4b8b-935b-70417ce295e4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Getting quotas for user a9bb488c761c49c7911109b3c6be27c2 and project cceb9bec54e04b0ab4201d6acf82c4df. Resources: {'server_group_members'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:25:17.525718 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ce09675c-08a0-4b8b-935b-70417ce295e4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.145202 May 21 21:25:17.526384 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1858/3618] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:25:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:25:17.538188 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c43f6d26-b278-4c05-8848-830a264c7ad5 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:17.538982 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c43f6d26-b278-4c05-8848-830a264c7ad5 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:17.625050 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c43f6d26-b278-4c05-8848-830a264c7ad5 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9bb488c761c49c7911109b3c6be27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb9bec54e04b0ab4201d6acf82c4df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:17.640789 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c43f6d26-b278-4c05-8848-830a264c7ad5 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 200 len: 1213 microversion: 2.1 time: 0.106632 May 21 21:25:17.641530 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1761/3619] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:17 2022] GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:18.007688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-53a00a4f-aac9-4c36-aaff-35ebb9b448c9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:18.008586 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-53a00a4f-aac9-4c36-aaff-35ebb9b448c9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:18.020136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53a00a4f-aac9-4c36-aaff-35ebb9b448c9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:18.020621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53a00a4f-aac9-4c36-aaff-35ebb9b448c9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:18.022917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53a00a4f-aac9-4c36-aaff-35ebb9b448c9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:18.023370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53a00a4f-aac9-4c36-aaff-35ebb9b448c9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:18.129894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-37d0fcd7-5cf2-49fb-b078-cc0275854ffe tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:18.130586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-37d0fcd7-5cf2-49fb-b078-cc0275854ffe tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:18.142547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-37d0fcd7-5cf2-49fb-b078-cc0275854ffe tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:18.143010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-37d0fcd7-5cf2-49fb-b078-cc0275854ffe tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:18.145595 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-37d0fcd7-5cf2-49fb-b078-cc0275854ffe tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:18.146215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-37d0fcd7-5cf2-49fb-b078-cc0275854ffe tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:18.189070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-53a00a4f-aac9-4c36-aaff-35ebb9b448c9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:18.205638 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-53a00a4f-aac9-4c36-aaff-35ebb9b448c9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245" status: 200 len: 1314 microversion: 2.1 time: 0.202664 May 21 21:25:18.206407 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1859/3620] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:18 2022] GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:18.273408 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-37d0fcd7-5cf2-49fb-b078-cc0275854ffe tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:18.282557 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-37d0fcd7-5cf2-49fb-b078-cc0275854ffe tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:18.284065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-37d0fcd7-5cf2-49fb-b078-cc0275854ffe tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:18.285236 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-37d0fcd7-5cf2-49fb-b078-cc0275854ffe tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] 10.222.0.49 "GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803" status: 200 len: 1318 microversion: 2.21 time: 0.161448 May 21 21:25:18.285802 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1762/3621] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:25:18 2022] GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:25:18.451643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-03e0ae06-a043-435a-93c1-c37a023666df tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:18.452502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-03e0ae06-a043-435a-93c1-c37a023666df tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] [instance: 253ae0a9-f88c-45d1-a627-a2de39674b56] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:18.464396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-03e0ae06-a043-435a-93c1-c37a023666df tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:18.465077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-03e0ae06-a043-435a-93c1-c37a023666df tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:18.470545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-03e0ae06-a043-435a-93c1-c37a023666df tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:18.471285 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-03e0ae06-a043-435a-93c1-c37a023666df tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:18.643762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-03e0ae06-a043-435a-93c1-c37a023666df tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7daba5b4d4435abf1df0efb30079a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '706a488689e241468fa53273beb2b806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:18.657022 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-03e0ae06-a043-435a-93c1-c37a023666df tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] 10.222.0.49 "GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56" status: 200 len: 1520 microversion: 2.1 time: 0.206824 May 21 21:25:18.666973 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1860/3622] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:18 2022] GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:18.667169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c2c8e755-6978-4d21-a6b4-5bd46a482342 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:18.667169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c2c8e755-6978-4d21-a6b4-5bd46a482342 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:18.678462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4a8633e5-42a0-4d23-aeb9-3d701bea61cf tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:18.678744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4a8633e5-42a0-4d23-aeb9-3d701bea61cf tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] [instance: 253ae0a9-f88c-45d1-a627-a2de39674b56] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:18.686578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a8633e5-42a0-4d23-aeb9-3d701bea61cf tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:18.687401 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a8633e5-42a0-4d23-aeb9-3d701bea61cf tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:18.689000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a8633e5-42a0-4d23-aeb9-3d701bea61cf tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:18.689368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a8633e5-42a0-4d23-aeb9-3d701bea61cf tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:18.714454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:18.721058 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-4a8633e5-42a0-4d23-aeb9-3d701bea61cf tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] HTTP exception thrown: Instance is not a member of specified network May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4a8633e5-42a0-4d23-aeb9-3d701bea61cf tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Request method failure captured: May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56/ips/invalid HTTP/1.1 May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVirXKPgn9abj56ba3-qkrB3ZhVrts6LSEkBOqMGphB6kOBJ2huXjLuvbCuTlsMEKODTwfnELJkdiLpguTq8m0GKTZmlbp6kk5xHtAYcZs3sytMmKkWWgczXGlG4vA2knvqxB9-z5VwqCL0ROn5DY8DzKNPQSohRnGl-Xs_oEPU0BTI May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 706a488689e241468fa53273beb2b806 May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1664069515 May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/706a488689e241468fa53273beb2b806"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/706a488689e241468fa53273beb2b806"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_706a488689e241468fa53273beb2b806", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/706a488689e241468fa53273beb2b806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1664069515 May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 706a488689e241468fa53273beb2b806 May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1664069515 May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerAddressesNegativeTestJSON-1664069515-project May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 6a7daba5b4d4435abf1df0efb30079a4 May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1664069515-project May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance is not a member of specified network May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'server_id': '253ae0a9-f88c-45d1-a627-a2de39674b56', 'id': 'invalid'} May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network May 21 21:25:18.729771 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:18.734644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4a8633e5-42a0-4d23-aeb9-3d701bea61cf tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Returning 404 to user: Instance is not a member of specified network {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:25:18.734644 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4a8633e5-42a0-4d23-aeb9-3d701bea61cf tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] 10.222.0.49 "GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.057845 May 21 21:25:18.734644 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1861/3623] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:25:18 2022] GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56/ips/invalid => generated 91 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 21 21:25:18.742322 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b868b6b2-4f47-4b2b-a607-680a19327301 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b868b6b2-4f47-4b2b-a607-680a19327301 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Failed to fetch instance by id 999 {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2926}} May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-b868b6b2-4f47-4b2b-a607-680a19327301 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] HTTP exception thrown: Instance 999 could not be found. May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b868b6b2-4f47-4b2b-a607-680a19327301 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Request method failure captured: May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVirXKPgn9abj56ba3-qkrB3ZhVrts6LSEkBOqMGphB6kOBJ2huXjLuvbCuTlsMEKODTwfnELJkdiLpguTq8m0GKTZmlbp6kk5xHtAYcZs3sytMmKkWWgczXGlG4vA2knvqxB9-z5VwqCL0ROn5DY8DzKNPQSohRnGl-Xs_oEPU0BTI May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 706a488689e241468fa53273beb2b806 May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1664069515 May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/706a488689e241468fa53273beb2b806"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/706a488689e241468fa53273beb2b806"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_706a488689e241468fa53273beb2b806", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/706a488689e241468fa53273beb2b806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1664069515 May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 706a488689e241468fa53273beb2b806 May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1664069515 May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerAddressesNegativeTestJSON-1664069515-project May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 6a7daba5b4d4435abf1df0efb30079a4 May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1664069515-project May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 999 could not be found. May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'server_id': '999'} May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:18.745904 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:18.750094 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:18.750094 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:18.750094 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:25:18.750094 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:25:18.750094 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. May 21 21:25:18.750094 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:18.750094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b868b6b2-4f47-4b2b-a607-680a19327301 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Returning 404 to user: Instance 999 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:25:18.750094 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b868b6b2-4f47-4b2b-a607-680a19327301 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] 10.222.0.49 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.007832 May 21 21:25:18.750094 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1862/3624] 10.222.0.49 () {58 vars in 1148 bytes} [Sat May 21 21:25:18 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:25:18.755325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fa1ac910-8782-449d-a3d2-537b2de8b4cb tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:18.755843 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fa1ac910-8782-449d-a3d2-537b2de8b4cb tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] [instance: 253ae0a9-f88c-45d1-a627-a2de39674b56] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:18.757072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c2c8e755-6978-4d21-a6b4-5bd46a482342 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9bb488c761c49c7911109b3c6be27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb9bec54e04b0ab4201d6acf82c4df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:18.765509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fa1ac910-8782-449d-a3d2-537b2de8b4cb tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:18.771132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fa1ac910-8782-449d-a3d2-537b2de8b4cb tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:18.771358 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c2c8e755-6978-4d21-a6b4-5bd46a482342 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 200 len: 1213 microversion: 2.1 time: 0.112069 May 21 21:25:18.771470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fa1ac910-8782-449d-a3d2-537b2de8b4cb tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:18.771470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fa1ac910-8782-449d-a3d2-537b2de8b4cb tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:18.771655 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1763/3625] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:18 2022] GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 1213 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:18.805320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fa1ac910-8782-449d-a3d2-537b2de8b4cb tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] [instance: 253ae0a9-f88c-45d1-a627-a2de39674b56] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:25:19.223568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5ed71682-28a2-44d4-b8b4-08a6c316441e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:19.224227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5ed71682-28a2-44d4-b8b4-08a6c316441e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:19.231035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ed71682-28a2-44d4-b8b4-08a6c316441e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:19.231494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ed71682-28a2-44d4-b8b4-08a6c316441e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:19.232628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ed71682-28a2-44d4-b8b4-08a6c316441e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:19.233079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ed71682-28a2-44d4-b8b4-08a6c316441e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:19.302892 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fa1ac910-8782-449d-a3d2-537b2de8b4cb tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] 10.222.0.49 "DELETE /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56" status: 204 len: 0 microversion: 2.1 time: 0.550822 May 21 21:25:19.311268 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1863/3626] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:25:18 2022] DELETE /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 21:25:19.318343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e37a0665-9d65-4803-a0f9-a9112a4f2810 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:19.319099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e37a0665-9d65-4803-a0f9-a9112a4f2810 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:19.327041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e37a0665-9d65-4803-a0f9-a9112a4f2810 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:19.327547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e37a0665-9d65-4803-a0f9-a9112a4f2810 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:19.328582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e37a0665-9d65-4803-a0f9-a9112a4f2810 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:19.329045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e37a0665-9d65-4803-a0f9-a9112a4f2810 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:19.501893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e37a0665-9d65-4803-a0f9-a9112a4f2810 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:19.511216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e37a0665-9d65-4803-a0f9-a9112a4f2810 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:19.512922 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e37a0665-9d65-4803-a0f9-a9112a4f2810 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:19.514580 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e37a0665-9d65-4803-a0f9-a9112a4f2810 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] 10.222.0.49 "GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803" status: 200 len: 1358 microversion: 2.21 time: 0.201759 May 21 21:25:19.515137 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1864/3627] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:25:19 2022] GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:25:19.520820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8a984ba5-45c5-4db7-90c2-6733895151ec tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:19.521727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8a984ba5-45c5-4db7-90c2-6733895151ec tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] [instance: 253ae0a9-f88c-45d1-a627-a2de39674b56] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:19.528704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5ed71682-28a2-44d4-b8b4-08a6c316441e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:19.528920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a984ba5-45c5-4db7-90c2-6733895151ec tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:19.529679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a984ba5-45c5-4db7-90c2-6733895151ec tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:19.530674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a984ba5-45c5-4db7-90c2-6733895151ec tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:19.531116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a984ba5-45c5-4db7-90c2-6733895151ec tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:19.537277 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5ed71682-28a2-44d4-b8b4-08a6c316441e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245" status: 200 len: 1314 microversion: 2.1 time: 0.317486 May 21 21:25:19.537873 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1764/3628] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:19 2022] GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:19.699265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8a984ba5-45c5-4db7-90c2-6733895151ec tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7daba5b4d4435abf1df0efb30079a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '706a488689e241468fa53273beb2b806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:19.707489 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8a984ba5-45c5-4db7-90c2-6733895151ec tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] 10.222.0.49 "GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56" status: 200 len: 1526 microversion: 2.1 time: 0.191192 May 21 21:25:19.708057 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1865/3629] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:19 2022] GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56 => generated 1526 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:19.786555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6389cfb8-e120-4ecc-86a0-e5a35710902e tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:19.787169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6389cfb8-e120-4ecc-86a0-e5a35710902e tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:19.793829 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6389cfb8-e120-4ecc-86a0-e5a35710902e tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:19.794685 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6389cfb8-e120-4ecc-86a0-e5a35710902e tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:19.795864 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6389cfb8-e120-4ecc-86a0-e5a35710902e tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:19.796570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6389cfb8-e120-4ecc-86a0-e5a35710902e tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:19.850985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4e14ffe8-ee5c-4736-b9b1-6c8d8080547b tempest-VolumesAdminNegativeTest-1945049214 tempest-VolumesAdminNegativeTest-1945049214-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "bb55436a-c7b0-40ef-9f3e-3429d89e3540"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:19.852115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4e14ffe8-ee5c-4736-b9b1-6c8d8080547b tempest-VolumesAdminNegativeTest-1945049214 tempest-VolumesAdminNegativeTest-1945049214-project-admin] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:19.864211 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e14ffe8-ee5c-4736-b9b1-6c8d8080547b tempest-VolumesAdminNegativeTest-1945049214 tempest-VolumesAdminNegativeTest-1945049214-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:19.864716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e14ffe8-ee5c-4736-b9b1-6c8d8080547b tempest-VolumesAdminNegativeTest-1945049214 tempest-VolumesAdminNegativeTest-1945049214-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:19.865511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e14ffe8-ee5c-4736-b9b1-6c8d8080547b tempest-VolumesAdminNegativeTest-1945049214 tempest-VolumesAdminNegativeTest-1945049214-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:19.865954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e14ffe8-ee5c-4736-b9b1-6c8d8080547b tempest-VolumesAdminNegativeTest-1945049214 tempest-VolumesAdminNegativeTest-1945049214-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:19.896989 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6389cfb8-e120-4ecc-86a0-e5a35710902e tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9bb488c761c49c7911109b3c6be27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb9bec54e04b0ab4201d6acf82c4df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:19.909589 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6389cfb8-e120-4ecc-86a0-e5a35710902e tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 200 len: 1217 microversion: 2.1 time: 0.126758 May 21 21:25:19.911908 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1866/3630] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:19 2022] GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 1217 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:20.005429 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-4e14ffe8-ee5c-4736-b9b1-6c8d8080547b tempest-VolumesAdminNegativeTest-1945049214 tempest-VolumesAdminNegativeTest-1945049214-project-admin] HTTP exception thrown: Volume bb55436a-c7b0-40ef-9f3e-3429d89e3540 could not be found. May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4e14ffe8-ee5c-4736-b9b1-6c8d8080547b tempest-VolumesAdminNegativeTest-1945049214 tempest-VolumesAdminNegativeTest-1945049214-project-admin] Request method failure captured: May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: request: PUT /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e/os-volume_attachments/5d57ce02-37f5-4d5e-b99e-ce11caefd4c6 HTTP/1.1 May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 74 May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVif2BycWnxKLWxsFsTBfIJLxl_e2wq2cpnDKGvitHNqol6g-B83dFCqeECDzoHQGxNodWHSrC3RpobNCPc3zSBLGtsdgK6eqIrYfpnF1TAJ9-6fGPmSEVjaVQvh97V51MzTHaFBOOj0J05fNm4FXjF7zaF1hdKgyx1rJgmZMLqfp5M May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: e556ce1bfb1343668e758b29e8fd313a May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-VolumesAdminNegativeTest-1945049214 May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,admin,member May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,admin,member May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e556ce1bfb1343668e758b29e8fd313a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e556ce1bfb1343668e758b29e8fd313a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e556ce1bfb1343668e758b29e8fd313a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e556ce1bfb1343668e758b29e8fd313a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-VolumesAdminNegativeTest-1945049214 May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: e556ce1bfb1343668e758b29e8fd313a May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1945049214 May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-VolumesAdminNegativeTest-1945049214-project-admin May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: beb419b2fe754145b9dd11a8cc6039a8 May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-VolumesAdminNegativeTest-1945049214-project-admin May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: {"volumeAttachment": {"volumeId": "bb55436a-c7b0-40ef-9f3e-3429d89e3540"}} May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: exception: Volume bb55436a-c7b0-40ef-9f3e-3429d89e3540 could not be found. May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'server_id': '5c113a19-4007-4621-b04f-ae6c9f36e09e', 'id': '5d57ce02-37f5-4d5e-b99e-ce11caefd4c6', 'body': {'volumeAttachment': {'volumeId': 'bb55436a-c7b0-40ef-9f3e-3429d89e3540'}}} May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi item = cinderclient( May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bb55436a-c7b0-40ef-9f3e-3429d89e3540 could not be found. (HTTP 404) (Request-ID: req-08848082-3a7b-47bb-b6e6-fe2e87d80a58) May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 21 21:25:20.036508 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi item = cinderclient( May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bb55436a-c7b0-40ef-9f3e-3429d89e3540 could not be found. May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume bb55436a-c7b0-40ef-9f3e-3429d89e3540 could not be found. May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bb55436a-c7b0-40ef-9f3e-3429d89e3540 could not be found. May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4e14ffe8-ee5c-4736-b9b1-6c8d8080547b tempest-VolumesAdminNegativeTest-1945049214 tempest-VolumesAdminNegativeTest-1945049214-project-admin] Returning 400 to user: Volume bb55436a-c7b0-40ef-9f3e-3429d89e3540 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4e14ffe8-ee5c-4736-b9b1-6c8d8080547b tempest-VolumesAdminNegativeTest-1945049214 tempest-VolumesAdminNegativeTest-1945049214-project-admin] 10.222.0.49 "PUT /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e/os-volume_attachments/5d57ce02-37f5-4d5e-b99e-ce11caefd4c6" status: 400 len: 107 microversion: 2.1 time: 0.397769 May 21 21:25:20.042031 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1765/3631] 10.222.0.49 () {60 vars in 1432 bytes} [Sat May 21 21:25:19 2022] PUT /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e/os-volume_attachments/5d57ce02-37f5-4d5e-b99e-ce11caefd4c6 => generated 107 bytes in 399 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 21 21:25:20.110978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-00794f53-0aea-4e9c-80e7-b0c97e816224 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:20.111504 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-00794f53-0aea-4e9c-80e7-b0c97e816224 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:20.118189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00794f53-0aea-4e9c-80e7-b0c97e816224 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:20.118649 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00794f53-0aea-4e9c-80e7-b0c97e816224 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:20.119450 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00794f53-0aea-4e9c-80e7-b0c97e816224 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:20.119933 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00794f53-0aea-4e9c-80e7-b0c97e816224 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:20.215230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-00794f53-0aea-4e9c-80e7-b0c97e816224 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lazy-loading 'services' on Instance uuid 5c113a19-4007-4621-b04f-ae6c9f36e09e {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:25:20.491145 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-00794f53-0aea-4e9c-80e7-b0c97e816224 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e/os-volume_attachments/5d57ce02-37f5-4d5e-b99e-ce11caefd4c6" status: 202 len: 0 microversion: 2.1 time: 0.384123 May 21 21:25:20.492586 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1867/3632] 10.222.0.49 () {58 vars in 1415 bytes} [Sat May 21 21:25:20 2022] DELETE /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e/os-volume_attachments/5d57ce02-37f5-4d5e-b99e-ce11caefd4c6 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:25:20.503361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3d1a0ab9-6a40-4053-81b6-8a6f7993ecee tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:20.504574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3d1a0ab9-6a40-4053-81b6-8a6f7993ecee tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:20.513757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d1a0ab9-6a40-4053-81b6-8a6f7993ecee tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:20.514628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d1a0ab9-6a40-4053-81b6-8a6f7993ecee tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:20.515520 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d1a0ab9-6a40-4053-81b6-8a6f7993ecee tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:20.516069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d1a0ab9-6a40-4053-81b6-8a6f7993ecee tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:20.540017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0dc43be2-93a4-4632-b734-e22a4aae06fe tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:20.542461 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0dc43be2-93a4-4632-b734-e22a4aae06fe tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:20.549727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0dc43be2-93a4-4632-b734-e22a4aae06fe tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:20.564708 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0dc43be2-93a4-4632-b734-e22a4aae06fe tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:20.565996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0dc43be2-93a4-4632-b734-e22a4aae06fe tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:20.566616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0dc43be2-93a4-4632-b734-e22a4aae06fe tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:20.568189 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3d1a0ab9-6a40-4053-81b6-8a6f7993ecee tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070818 May 21 21:25:20.573216 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1766/3633] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:25:20 2022] GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:20.579486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-43e9fc5f-a515-4d55-a923-aec6493fc6dc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:20.580120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-43e9fc5f-a515-4d55-a923-aec6493fc6dc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:20.588406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-43e9fc5f-a515-4d55-a923-aec6493fc6dc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:20.589110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-43e9fc5f-a515-4d55-a923-aec6493fc6dc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:20.590099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-43e9fc5f-a515-4d55-a923-aec6493fc6dc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:20.590553 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-43e9fc5f-a515-4d55-a923-aec6493fc6dc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:20.945663 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0dc43be2-93a4-4632-b734-e22a4aae06fe tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:20.960409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0dc43be2-93a4-4632-b734-e22a4aae06fe tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:20.966723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0dc43be2-93a4-4632-b734-e22a4aae06fe tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:20.966723 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0dc43be2-93a4-4632-b734-e22a4aae06fe tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] 10.222.0.49 "GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803" status: 200 len: 1358 microversion: 2.21 time: 0.427620 May 21 21:25:20.966723 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1868/3634] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:25:20 2022] GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 => generated 1358 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:25:20.970598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ff52ec9c-cd6c-4361-84a7-3198193803b2 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:20.971520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ff52ec9c-cd6c-4361-84a7-3198193803b2 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] [instance: 253ae0a9-f88c-45d1-a627-a2de39674b56] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:20.987967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff52ec9c-cd6c-4361-84a7-3198193803b2 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:20.989357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff52ec9c-cd6c-4361-84a7-3198193803b2 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:21.001401 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff52ec9c-cd6c-4361-84a7-3198193803b2 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:21.001863 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff52ec9c-cd6c-4361-84a7-3198193803b2 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:21.006687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:21.060539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-43e9fc5f-a515-4d55-a923-aec6493fc6dc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:21.075001 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-43e9fc5f-a515-4d55-a923-aec6493fc6dc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245" status: 200 len: 1314 microversion: 2.1 time: 0.500406 May 21 21:25:21.076496 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1767/3635] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:20 2022] GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245 => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:21.081278 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-98283773-b81c-4ede-9b24-7c1af787dd8f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:21.083663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-98283773-b81c-4ede-9b24-7c1af787dd8f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:21.088413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98283773-b81c-4ede-9b24-7c1af787dd8f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:21.089175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98283773-b81c-4ede-9b24-7c1af787dd8f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:21.090437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98283773-b81c-4ede-9b24-7c1af787dd8f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:21.091085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98283773-b81c-4ede-9b24-7c1af787dd8f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:21.204994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-98283773-b81c-4ede-9b24-7c1af787dd8f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9bb488c761c49c7911109b3c6be27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb9bec54e04b0ab4201d6acf82c4df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:21.213832 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-98283773-b81c-4ede-9b24-7c1af787dd8f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 200 len: 1265 microversion: 2.1 time: 0.136175 May 21 21:25:21.214732 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1768/3636] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:21 2022] GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:21.271085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ff52ec9c-cd6c-4361-84a7-3198193803b2 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7daba5b4d4435abf1df0efb30079a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '706a488689e241468fa53273beb2b806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:21.280524 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ff52ec9c-cd6c-4361-84a7-3198193803b2 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] 10.222.0.49 "GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56" status: 200 len: 1526 microversion: 2.1 time: 0.314187 May 21 21:25:21.281429 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1869/3637] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:20 2022] GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56 => generated 1526 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:21.582469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a572f426-ebdd-4d72-8486-494788a3fdca tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:21.583447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a572f426-ebdd-4d72-8486-494788a3fdca tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:21.593359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a572f426-ebdd-4d72-8486-494788a3fdca tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:21.597432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a572f426-ebdd-4d72-8486-494788a3fdca tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:21.598462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a572f426-ebdd-4d72-8486-494788a3fdca tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:21.601637 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a572f426-ebdd-4d72-8486-494788a3fdca tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:21.617726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-be9eef1c-46bb-4ef9-83bc-7ef5ef09cef4 req-10167a0f-4000-4c41-b660-72abf048fffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "253ae0a9-f88c-45d1-a627-a2de39674b56", "name": "network-vif-deleted", "tag": "b42d5e9d-6da0-42e7-89ef-fd31306028ee"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:21.633803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-be9eef1c-46bb-4ef9-83bc-7ef5ef09cef4 req-10167a0f-4000-4c41-b660-72abf048fffc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:21.635071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-be9eef1c-46bb-4ef9-83bc-7ef5ef09cef4 req-10167a0f-4000-4c41-b660-72abf048fffc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:21.651148 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-be9eef1c-46bb-4ef9-83bc-7ef5ef09cef4 req-10167a0f-4000-4c41-b660-72abf048fffc service nova] Creating event network-vif-deleted:b42d5e9d-6da0-42e7-89ef-fd31306028ee for instance 253ae0a9-f88c-45d1-a627-a2de39674b56 on nch1-master-1 May 21 21:25:21.658049 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-be9eef1c-46bb-4ef9-83bc-7ef5ef09cef4 req-10167a0f-4000-4c41-b660-72abf048fffc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047905 May 21 21:25:21.664961 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1870/3638] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:25:21.694426 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a572f426-ebdd-4d72-8486-494788a3fdca tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114019 May 21 21:25:21.695889 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1769/3639] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:25:21 2022] GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:21.982697 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8d769d8a-a5bd-4f11-a4b1-7c93ac482e88 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:21.983421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8d769d8a-a5bd-4f11-a4b1-7c93ac482e88 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:21.992025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8d769d8a-a5bd-4f11-a4b1-7c93ac482e88 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:21.992523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8d769d8a-a5bd-4f11-a4b1-7c93ac482e88 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:21.993330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8d769d8a-a5bd-4f11-a4b1-7c93ac482e88 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:21.993774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8d769d8a-a5bd-4f11-a4b1-7c93ac482e88 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:22.027355 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-c6a14807-509e-4caa-96de-09c3a8e161b7 req-62b5fc82-3039-4dd9-8b40-1277af478cec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "550a690c-b49c-4396-a624-f5601b8b0803", "tag": "0b7e87c4-efa1-4e13-b765-07243f98293a"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:22.053918 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c6a14807-509e-4caa-96de-09c3a8e161b7 req-62b5fc82-3039-4dd9-8b40-1277af478cec service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:22.054700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c6a14807-509e-4caa-96de-09c3a8e161b7 req-62b5fc82-3039-4dd9-8b40-1277af478cec service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:22.078549 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-c6a14807-509e-4caa-96de-09c3a8e161b7 req-62b5fc82-3039-4dd9-8b40-1277af478cec service nova] Creating event network-changed:0b7e87c4-efa1-4e13-b765-07243f98293a for instance 550a690c-b49c-4396-a624-f5601b8b0803 on nch1-master-1 May 21 21:25:22.085255 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-c6a14807-509e-4caa-96de-09c3a8e161b7 req-62b5fc82-3039-4dd9-8b40-1277af478cec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062415 May 21 21:25:22.094738 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1770/3640] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:22.096446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3cd7a69f-0c40-4ac9-9138-49f32da92af1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:22.097172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3cd7a69f-0c40-4ac9-9138-49f32da92af1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:22.103706 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cd7a69f-0c40-4ac9-9138-49f32da92af1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:22.104099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cd7a69f-0c40-4ac9-9138-49f32da92af1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:22.105382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cd7a69f-0c40-4ac9-9138-49f32da92af1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:22.105905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cd7a69f-0c40-4ac9-9138-49f32da92af1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:22.150213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8d769d8a-a5bd-4f11-a4b1-7c93ac482e88 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:22.160200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8d769d8a-a5bd-4f11-a4b1-7c93ac482e88 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:22.161793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8d769d8a-a5bd-4f11-a4b1-7c93ac482e88 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:22.165319 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8d769d8a-a5bd-4f11-a4b1-7c93ac482e88 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] 10.222.0.49 "GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803" status: 200 len: 1358 microversion: 2.21 time: 0.184906 May 21 21:25:22.165319 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1871/3641] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:25:21 2022] GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:25:22.243901 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9c2177d4-ac93-4ef5-a15a-efb133ee86b4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:22.244676 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9c2177d4-ac93-4ef5-a15a-efb133ee86b4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:22.250236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:22.254786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c2177d4-ac93-4ef5-a15a-efb133ee86b4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:22.255319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c2177d4-ac93-4ef5-a15a-efb133ee86b4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:22.256181 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c2177d4-ac93-4ef5-a15a-efb133ee86b4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:22.256753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c2177d4-ac93-4ef5-a15a-efb133ee86b4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:22.336234 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9c2177d4-ac93-4ef5-a15a-efb133ee86b4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9bb488c761c49c7911109b3c6be27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb9bec54e04b0ab4201d6acf82c4df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:22.346502 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9c2177d4-ac93-4ef5-a15a-efb133ee86b4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 200 len: 1271 microversion: 2.1 time: 0.116677 May 21 21:25:22.347084 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1872/3642] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:22 2022] GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 1271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:22.351950 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b2196ef9-948d-4fa2-8eb3-d51013624f68 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:22.352985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b2196ef9-948d-4fa2-8eb3-d51013624f68 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] [instance: 253ae0a9-f88c-45d1-a627-a2de39674b56] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:22.360894 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2196ef9-948d-4fa2-8eb3-d51013624f68 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:22.360894 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2196ef9-948d-4fa2-8eb3-d51013624f68 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:22.362087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2196ef9-948d-4fa2-8eb3-d51013624f68 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:22.362536 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2196ef9-948d-4fa2-8eb3-d51013624f68 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:22.397313 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2196ef9-948d-4fa2-8eb3-d51013624f68 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:22.398033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2196ef9-948d-4fa2-8eb3-d51013624f68 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:22.398658 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-b2196ef9-948d-4fa2-8eb3-d51013624f68 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lazy-loading 'fault' on Instance uuid 253ae0a9-f88c-45d1-a627-a2de39674b56 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:25:22.448670 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3cd7a69f-0c40-4ac9-9138-49f32da92af1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:22.451896 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b2196ef9-948d-4fa2-8eb3-d51013624f68 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7daba5b4d4435abf1df0efb30079a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '706a488689e241468fa53273beb2b806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:22.457103 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3cd7a69f-0c40-4ac9-9138-49f32da92af1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245" status: 200 len: 1314 microversion: 2.1 time: 0.367306 May 21 21:25:22.458201 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1771/3643] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:22 2022] GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:22.460627 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b2196ef9-948d-4fa2-8eb3-d51013624f68 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] 10.222.0.49 "GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56" status: 200 len: 1314 microversion: 2.1 time: 0.112130 May 21 21:25:22.461366 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1873/3644] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:22 2022] GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56 => generated 1314 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:22.708126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9fe97a73-5241-4e3b-a113-d3f1d04da928 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:22.709113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9fe97a73-5241-4e3b-a113-d3f1d04da928 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:22.722166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9fe97a73-5241-4e3b-a113-d3f1d04da928 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:22.722634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9fe97a73-5241-4e3b-a113-d3f1d04da928 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:22.724140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9fe97a73-5241-4e3b-a113-d3f1d04da928 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:22.724645 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9fe97a73-5241-4e3b-a113-d3f1d04da928 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:22.762024 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9fe97a73-5241-4e3b-a113-d3f1d04da928 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058319 May 21 21:25:22.762622 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1772/3645] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:25:22 2022] GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:25:23.181975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5c416399-603d-404a-878c-78d722a8f43f tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:23.183480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5c416399-603d-404a-878c-78d722a8f43f tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:23.196965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c416399-603d-404a-878c-78d722a8f43f tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:23.198370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c416399-603d-404a-878c-78d722a8f43f tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:23.199429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c416399-603d-404a-878c-78d722a8f43f tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:23.200143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c416399-603d-404a-878c-78d722a8f43f tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:23.363995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1513451c-321b-447b-a73f-62e77d6e753f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:23.364932 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1513451c-321b-447b-a73f-62e77d6e753f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:23.372001 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1513451c-321b-447b-a73f-62e77d6e753f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:23.373372 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1513451c-321b-447b-a73f-62e77d6e753f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:23.374364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1513451c-321b-447b-a73f-62e77d6e753f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:23.374814 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1513451c-321b-447b-a73f-62e77d6e753f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:23.561158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5c416399-603d-404a-878c-78d722a8f43f tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:23.570668 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5c416399-603d-404a-878c-78d722a8f43f tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:23.572697 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5c416399-603d-404a-878c-78d722a8f43f tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:23.573990 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5c416399-603d-404a-878c-78d722a8f43f tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] 10.222.0.49 "GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803" status: 200 len: 1358 microversion: 2.21 time: 0.396381 May 21 21:25:23.574563 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1874/3646] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:25:23 2022] GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 => generated 1358 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:25:23.594815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-53976b40-62c9-444e-8677-7ca98e2ea897 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:23.595585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-53976b40-62c9-444e-8677-7ca98e2ea897 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] [instance: 253ae0a9-f88c-45d1-a627-a2de39674b56] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:23.596172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1513451c-321b-447b-a73f-62e77d6e753f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9bb488c761c49c7911109b3c6be27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb9bec54e04b0ab4201d6acf82c4df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:23.602573 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53976b40-62c9-444e-8677-7ca98e2ea897 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:23.603627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53976b40-62c9-444e-8677-7ca98e2ea897 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:23.605188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53976b40-62c9-444e-8677-7ca98e2ea897 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:23.605991 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53976b40-62c9-444e-8677-7ca98e2ea897 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:23.624877 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-53976b40-62c9-444e-8677-7ca98e2ea897 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] HTTP exception thrown: Instance 253ae0a9-f88c-45d1-a627-a2de39674b56 could not be found. May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-53976b40-62c9-444e-8677-7ca98e2ea897 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Request method failure captured: May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56 HTTP/1.1 May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVirXKPgn9abj56ba3-qkrB3ZhVrts6LSEkBOqMGphB6kOBJ2huXjLuvbCuTlsMEKODTwfnELJkdiLpguTq8m0GKTZmlbp6kk5xHtAYcZs3sytMmKkWWgczXGlG4vA2knvqxB9-z5VwqCL0ROn5DY8DzKNPQSohRnGl-Xs_oEPU0BTI May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 706a488689e241468fa53273beb2b806 May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1664069515 May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/706a488689e241468fa53273beb2b806"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/706a488689e241468fa53273beb2b806"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_706a488689e241468fa53273beb2b806", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/706a488689e241468fa53273beb2b806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1664069515 May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 706a488689e241468fa53273beb2b806 May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1664069515 May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerAddressesNegativeTestJSON-1664069515-project May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 6a7daba5b4d4435abf1df0efb30079a4 May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1664069515-project May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 253ae0a9-f88c-45d1-a627-a2de39674b56 could not be found. May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '253ae0a9-f88c-45d1-a627-a2de39674b56'} May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 253ae0a9-f88c-45d1-a627-a2de39674b56 could not be found. May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 253ae0a9-f88c-45d1-a627-a2de39674b56 could not be found. May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:23.626749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:23.634740 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:23.634740 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:23.634740 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:23.634740 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:23.634740 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:25:23.634740 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:25:23.634740 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 253ae0a9-f88c-45d1-a627-a2de39674b56 could not be found. May 21 21:25:23.634740 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:23.634740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-53976b40-62c9-444e-8677-7ca98e2ea897 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] Returning 404 to user: Instance 253ae0a9-f88c-45d1-a627-a2de39674b56 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:25:23.636153 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1513451c-321b-447b-a73f-62e77d6e753f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 200 len: 1313 microversion: 2.1 time: 0.267045 May 21 21:25:23.636254 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-53976b40-62c9-444e-8677-7ca98e2ea897 tempest-ServerAddressesNegativeTestJSON-1664069515 tempest-ServerAddressesNegativeTestJSON-1664069515-project] 10.222.0.49 "GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56" status: 404 len: 111 microversion: 2.1 time: 0.038959 May 21 21:25:23.636254 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1875/3647] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:23 2022] GET /compute/v2.1/servers/253ae0a9-f88c-45d1-a627-a2de39674b56 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:25:23.636254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2e641b75-df6a-4869-ba0b-7e92e411d68d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:23.636254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2e641b75-df6a-4869-ba0b-7e92e411d68d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:23.641950 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2e641b75-df6a-4869-ba0b-7e92e411d68d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:23.642375 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2e641b75-df6a-4869-ba0b-7e92e411d68d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:23.644090 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2e641b75-df6a-4869-ba0b-7e92e411d68d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:23.644379 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1773/3648] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:23 2022] GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:23.644485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2e641b75-df6a-4869-ba0b-7e92e411d68d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:23.909915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2e641b75-df6a-4869-ba0b-7e92e411d68d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:23.928790 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2e641b75-df6a-4869-ba0b-7e92e411d68d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245" status: 200 len: 1314 microversion: 2.1 time: 0.288999 May 21 21:25:23.928790 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1876/3649] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:23 2022] GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:23.957322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-3dbfeb6b-900b-463d-b258-f14fe5152c24 req-64d91d38-1b53-4619-a277-522bb6150513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2be17b7-988e-4845-9959-5fa04cbed245", "name": "network-vif-plugged", "status": "completed", "tag": "f31dbee2-256e-43df-8541-a6196710f62e"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:23.970195 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3dbfeb6b-900b-463d-b258-f14fe5152c24 req-64d91d38-1b53-4619-a277-522bb6150513 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:23.970936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3dbfeb6b-900b-463d-b258-f14fe5152c24 req-64d91d38-1b53-4619-a277-522bb6150513 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:23.986102 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-3dbfeb6b-900b-463d-b258-f14fe5152c24 req-64d91d38-1b53-4619-a277-522bb6150513 service nova] Creating event network-vif-plugged:f31dbee2-256e-43df-8541-a6196710f62e for instance e2be17b7-988e-4845-9959-5fa04cbed245 on nch2-master-1 May 21 21:25:23.993611 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-3dbfeb6b-900b-463d-b258-f14fe5152c24 req-64d91d38-1b53-4619-a277-522bb6150513 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039857 May 21 21:25:23.995140 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1774/3650] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:24.538150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-7fa64ae9-921f-48fa-8e4e-1e3b18cb9665 req-6ebf36f9-7a45-4b89-bb65-fb2aaff6688b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a345038-c1e0-46dd-89f2-6f2319e93d79", "tag": "008072f8-d29d-4ed7-9c3c-668d9de1c0c9"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:24.549483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7fa64ae9-921f-48fa-8e4e-1e3b18cb9665 req-6ebf36f9-7a45-4b89-bb65-fb2aaff6688b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:24.549933 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7fa64ae9-921f-48fa-8e4e-1e3b18cb9665 req-6ebf36f9-7a45-4b89-bb65-fb2aaff6688b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:24.563485 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-7fa64ae9-921f-48fa-8e4e-1e3b18cb9665 req-6ebf36f9-7a45-4b89-bb65-fb2aaff6688b service nova] Creating event network-changed:008072f8-d29d-4ed7-9c3c-668d9de1c0c9 for instance 8a345038-c1e0-46dd-89f2-6f2319e93d79 on nch2-master-1 May 21 21:25:24.568502 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-7fa64ae9-921f-48fa-8e4e-1e3b18cb9665 req-6ebf36f9-7a45-4b89-bb65-fb2aaff6688b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034710 May 21 21:25:24.569555 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1877/3651] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:25:24.597329 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9c9a228f-d47b-406f-803c-3ce91dc426c2 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:24.598795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9c9a228f-d47b-406f-803c-3ce91dc426c2 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:24.614274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c9a228f-d47b-406f-803c-3ce91dc426c2 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:24.616806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c9a228f-d47b-406f-803c-3ce91dc426c2 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:24.616806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c9a228f-d47b-406f-803c-3ce91dc426c2 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:24.616806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c9a228f-d47b-406f-803c-3ce91dc426c2 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:24.674708 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9542901e-5a1d-4c00-ad2c-4e513f051c2f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:24.675599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9542901e-5a1d-4c00-ad2c-4e513f051c2f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:24.692476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9542901e-5a1d-4c00-ad2c-4e513f051c2f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:24.692938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9542901e-5a1d-4c00-ad2c-4e513f051c2f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:24.693744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9542901e-5a1d-4c00-ad2c-4e513f051c2f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:24.694189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9542901e-5a1d-4c00-ad2c-4e513f051c2f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:24.863175 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9542901e-5a1d-4c00-ad2c-4e513f051c2f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9bb488c761c49c7911109b3c6be27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb9bec54e04b0ab4201d6acf82c4df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:24.866677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:24.873534 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9542901e-5a1d-4c00-ad2c-4e513f051c2f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 200 len: 1313 microversion: 2.1 time: 0.213733 May 21 21:25:24.874113 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1878/3652] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:24 2022] GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:24.929215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9c9a228f-d47b-406f-803c-3ce91dc426c2 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:24.940937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9c9a228f-d47b-406f-803c-3ce91dc426c2 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:24.943881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9c9a228f-d47b-406f-803c-3ce91dc426c2 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:24.945583 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9c9a228f-d47b-406f-803c-3ce91dc426c2 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] 10.222.0.49 "GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803" status: 200 len: 1358 microversion: 2.21 time: 0.354876 May 21 21:25:24.947223 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-384c9e9c-89f3-4585-9259-e9d18ddbdbee tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:24.951373 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-384c9e9c-89f3-4585-9259-e9d18ddbdbee tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:24.951518 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1775/3653] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:25:24 2022] GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 => generated 1358 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:25:24.956502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-384c9e9c-89f3-4585-9259-e9d18ddbdbee tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:24.957105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-384c9e9c-89f3-4585-9259-e9d18ddbdbee tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:24.957997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-384c9e9c-89f3-4585-9259-e9d18ddbdbee tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:24.958511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-384c9e9c-89f3-4585-9259-e9d18ddbdbee tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:25.118515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-384c9e9c-89f3-4585-9259-e9d18ddbdbee tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:25.127256 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-384c9e9c-89f3-4585-9259-e9d18ddbdbee tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245" status: 200 len: 1314 microversion: 2.1 time: 0.185991 May 21 21:25:25.129698 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1879/3654] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:24 2022] GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:25.742787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9566e0ad-87ef-4cab-a30d-b34b83aeb518 tempest-VolumesAdminNegativeTest-1945049214 tempest-VolumesAdminNegativeTest-1945049214-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0b9f4fb4-d73a-45d0-851e-6cf568466b6a"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:25.745707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9566e0ad-87ef-4cab-a30d-b34b83aeb518 tempest-VolumesAdminNegativeTest-1945049214 tempest-VolumesAdminNegativeTest-1945049214-project-admin] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:25.755832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9566e0ad-87ef-4cab-a30d-b34b83aeb518 tempest-VolumesAdminNegativeTest-1945049214 tempest-VolumesAdminNegativeTest-1945049214-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:25.756543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9566e0ad-87ef-4cab-a30d-b34b83aeb518 tempest-VolumesAdminNegativeTest-1945049214 tempest-VolumesAdminNegativeTest-1945049214-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:25.757673 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9566e0ad-87ef-4cab-a30d-b34b83aeb518 tempest-VolumesAdminNegativeTest-1945049214 tempest-VolumesAdminNegativeTest-1945049214-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:25.758734 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9566e0ad-87ef-4cab-a30d-b34b83aeb518 tempest-VolumesAdminNegativeTest-1945049214 tempest-VolumesAdminNegativeTest-1945049214-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:25.823306 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-9566e0ad-87ef-4cab-a30d-b34b83aeb518 tempest-VolumesAdminNegativeTest-1945049214 tempest-VolumesAdminNegativeTest-1945049214-project-admin] HTTP exception thrown: Volume fa5606ed-eb01-4ef5-a504-7d229202fb60 could not be found. May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9566e0ad-87ef-4cab-a30d-b34b83aeb518 tempest-VolumesAdminNegativeTest-1945049214 tempest-VolumesAdminNegativeTest-1945049214-project-admin] Request method failure captured: May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: request: PUT /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e/os-volume_attachments/fa5606ed-eb01-4ef5-a504-7d229202fb60 HTTP/1.1 May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 74 May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVif2BycWnxKLWxsFsTBfIJLxl_e2wq2cpnDKGvitHNqol6g-B83dFCqeECDzoHQGxNodWHSrC3RpobNCPc3zSBLGtsdgK6eqIrYfpnF1TAJ9-6fGPmSEVjaVQvh97V51MzTHaFBOOj0J05fNm4FXjF7zaF1hdKgyx1rJgmZMLqfp5M May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: e556ce1bfb1343668e758b29e8fd313a May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-VolumesAdminNegativeTest-1945049214 May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,admin,member May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,admin,member May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e556ce1bfb1343668e758b29e8fd313a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e556ce1bfb1343668e758b29e8fd313a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e556ce1bfb1343668e758b29e8fd313a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e556ce1bfb1343668e758b29e8fd313a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-VolumesAdminNegativeTest-1945049214 May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: e556ce1bfb1343668e758b29e8fd313a May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1945049214 May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-VolumesAdminNegativeTest-1945049214-project-admin May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: beb419b2fe754145b9dd11a8cc6039a8 May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-VolumesAdminNegativeTest-1945049214-project-admin May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: {"volumeAttachment": {"volumeId": "0b9f4fb4-d73a-45d0-851e-6cf568466b6a"}} May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: exception: Volume fa5606ed-eb01-4ef5-a504-7d229202fb60 could not be found. May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'server_id': '5c113a19-4007-4621-b04f-ae6c9f36e09e', 'id': 'fa5606ed-eb01-4ef5-a504-7d229202fb60', 'body': {'volumeAttachment': {'volumeId': '0b9f4fb4-d73a-45d0-851e-6cf568466b6a'}}} May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi item = cinderclient( May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fa5606ed-eb01-4ef5-a504-7d229202fb60 could not be found. (HTTP 404) (Request-ID: req-f5327967-e6d0-44e0-96e4-6f4de3ba5534) May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 21 21:25:25.826130 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi item = cinderclient( May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fa5606ed-eb01-4ef5-a504-7d229202fb60 could not be found. May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fa5606ed-eb01-4ef5-a504-7d229202fb60 could not be found. May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fa5606ed-eb01-4ef5-a504-7d229202fb60 could not be found. May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9566e0ad-87ef-4cab-a30d-b34b83aeb518 tempest-VolumesAdminNegativeTest-1945049214 tempest-VolumesAdminNegativeTest-1945049214-project-admin] Returning 404 to user: Volume fa5606ed-eb01-4ef5-a504-7d229202fb60 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9566e0ad-87ef-4cab-a30d-b34b83aeb518 tempest-VolumesAdminNegativeTest-1945049214 tempest-VolumesAdminNegativeTest-1945049214-project-admin] 10.222.0.49 "PUT /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e/os-volume_attachments/fa5606ed-eb01-4ef5-a504-7d229202fb60" status: 404 len: 109 microversion: 2.1 time: 0.091720 May 21 21:25:25.830742 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1776/3655] 10.222.0.49 () {60 vars in 1432 bytes} [Sat May 21 21:25:25 2022] PUT /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e/os-volume_attachments/fa5606ed-eb01-4ef5-a504-7d229202fb60 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:25:25.892500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e9bf4928-004e-43d5-bba3-fd3c0c1e09b9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:25.893153 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e9bf4928-004e-43d5-bba3-fd3c0c1e09b9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:25.901432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9bf4928-004e-43d5-bba3-fd3c0c1e09b9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:25.901887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9bf4928-004e-43d5-bba3-fd3c0c1e09b9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:25.902674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9bf4928-004e-43d5-bba3-fd3c0c1e09b9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:25.903116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9bf4928-004e-43d5-bba3-fd3c0c1e09b9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:25.968244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3e631009-e486-41c7-80fb-835cc6d449b7 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:25.969410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3e631009-e486-41c7-80fb-835cc6d449b7 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:25.977409 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e631009-e486-41c7-80fb-835cc6d449b7 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:25.977986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e631009-e486-41c7-80fb-835cc6d449b7 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:25.979270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e631009-e486-41c7-80fb-835cc6d449b7 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:25.979722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e631009-e486-41c7-80fb-835cc6d449b7 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:25.988039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:26.111747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e9bf4928-004e-43d5-bba3-fd3c0c1e09b9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9bb488c761c49c7911109b3c6be27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb9bec54e04b0ab4201d6acf82c4df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:26.120340 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e9bf4928-004e-43d5-bba3-fd3c0c1e09b9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 200 len: 1313 microversion: 2.1 time: 0.232578 May 21 21:25:26.121365 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1880/3656] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:25 2022] GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:26.148835 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c1aa761e-9f90-4b8b-a1d2-8ff81ec6fe24 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:26.149462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c1aa761e-9f90-4b8b-a1d2-8ff81ec6fe24 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:26.158073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1aa761e-9f90-4b8b-a1d2-8ff81ec6fe24 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:26.158844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1aa761e-9f90-4b8b-a1d2-8ff81ec6fe24 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:26.160438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1aa761e-9f90-4b8b-a1d2-8ff81ec6fe24 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:26.161105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1aa761e-9f90-4b8b-a1d2-8ff81ec6fe24 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:26.385173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c1aa761e-9f90-4b8b-a1d2-8ff81ec6fe24 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:26.395295 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c1aa761e-9f90-4b8b-a1d2-8ff81ec6fe24 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245" status: 200 len: 1500 microversion: 2.1 time: 0.250499 May 21 21:25:26.414191 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1881/3657] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:26 2022] GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245 => generated 1500 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:26.415309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-161fbdd5-a799-4b15-9ef9-ab78013fa86b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:26.416451 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-161fbdd5-a799-4b15-9ef9-ab78013fa86b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:26.465639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-161fbdd5-a799-4b15-9ef9-ab78013fa86b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:26.465639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-161fbdd5-a799-4b15-9ef9-ab78013fa86b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:26.466162 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-161fbdd5-a799-4b15-9ef9-ab78013fa86b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:26.466527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-161fbdd5-a799-4b15-9ef9-ab78013fa86b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:26.518087 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3e631009-e486-41c7-80fb-835cc6d449b7 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:26.519852 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-161fbdd5-a799-4b15-9ef9-ab78013fa86b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action" status: 200 len: 14 microversion: 2.1 time: 0.109623 May 21 21:25:26.520549 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1882/3658] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:25:26 2022] POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:25:26.529656 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3e631009-e486-41c7-80fb-835cc6d449b7 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:26.531296 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3e631009-e486-41c7-80fb-835cc6d449b7 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:26.532901 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3e631009-e486-41c7-80fb-835cc6d449b7 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] 10.222.0.49 "GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803" status: 200 len: 1358 microversion: 2.21 time: 0.569231 May 21 21:25:26.533324 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1777/3659] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:25:25 2022] GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 => generated 1358 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:25:27.140199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-83f4212f-cf73-474f-919c-1f67acc47f76 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:27.140963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-83f4212f-cf73-474f-919c-1f67acc47f76 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:27.143979 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:27.150018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-83f4212f-cf73-474f-919c-1f67acc47f76 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:27.150478 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-83f4212f-cf73-474f-919c-1f67acc47f76 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:27.152575 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-83f4212f-cf73-474f-919c-1f67acc47f76 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:27.153034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-83f4212f-cf73-474f-919c-1f67acc47f76 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:27.312472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-83f4212f-cf73-474f-919c-1f67acc47f76 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9bb488c761c49c7911109b3c6be27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb9bec54e04b0ab4201d6acf82c4df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:27.320571 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-83f4212f-cf73-474f-919c-1f67acc47f76 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 200 len: 1313 microversion: 2.1 time: 0.185737 May 21 21:25:27.321205 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1883/3660] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:27 2022] GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:27.533901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bb256bdd-2244-4d3e-b035-916f1c863734 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:27.535603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bb256bdd-2244-4d3e-b035-916f1c863734 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:27.547533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb256bdd-2244-4d3e-b035-916f1c863734 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:27.548728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb256bdd-2244-4d3e-b035-916f1c863734 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:27.550262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb256bdd-2244-4d3e-b035-916f1c863734 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:27.550913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb256bdd-2244-4d3e-b035-916f1c863734 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:27.561458 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-21e1ce23-9abe-4e54-b9c2-e97435f4ee30 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:27.563448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-21e1ce23-9abe-4e54-b9c2-e97435f4ee30 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:27.565944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=46 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:27.578099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21e1ce23-9abe-4e54-b9c2-e97435f4ee30 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:27.579404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21e1ce23-9abe-4e54-b9c2-e97435f4ee30 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:27.583883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21e1ce23-9abe-4e54-b9c2-e97435f4ee30 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:27.583883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21e1ce23-9abe-4e54-b9c2-e97435f4ee30 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:27.757350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-21e1ce23-9abe-4e54-b9c2-e97435f4ee30 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:27.770343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-21e1ce23-9abe-4e54-b9c2-e97435f4ee30 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:27.772142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-21e1ce23-9abe-4e54-b9c2-e97435f4ee30 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:27.773571 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-21e1ce23-9abe-4e54-b9c2-e97435f4ee30 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] 10.222.0.49 "GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803" status: 200 len: 1358 microversion: 2.21 time: 0.226688 May 21 21:25:27.775352 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1884/3661] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:25:27 2022] GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:25:27.806303 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bb256bdd-2244-4d3e-b035-916f1c863734 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action" status: 200 len: 14 microversion: 2.1 time: 0.278372 May 21 21:25:27.807248 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1778/3662] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:25:27 2022] POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action => generated 14 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:25:27.883149 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-a73cf515-946a-4f68-b61f-246bbc9dd9dd req-cabe5256-290f-40da-8d74-c9cb707f9c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550a690c-b49c-4396-a624-f5601b8b0803", "name": "network-vif-plugged", "status": "completed", "tag": "0b7e87c4-efa1-4e13-b765-07243f98293a"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:27.893453 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a73cf515-946a-4f68-b61f-246bbc9dd9dd req-cabe5256-290f-40da-8d74-c9cb707f9c95 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:27.893918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a73cf515-946a-4f68-b61f-246bbc9dd9dd req-cabe5256-290f-40da-8d74-c9cb707f9c95 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:27.917618 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a73cf515-946a-4f68-b61f-246bbc9dd9dd req-cabe5256-290f-40da-8d74-c9cb707f9c95 service nova] Creating event network-vif-plugged:0b7e87c4-efa1-4e13-b765-07243f98293a for instance 550a690c-b49c-4396-a624-f5601b8b0803 on nch1-master-1 May 21 21:25:27.924274 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-a73cf515-946a-4f68-b61f-246bbc9dd9dd req-cabe5256-290f-40da-8d74-c9cb707f9c95 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044684 May 21 21:25:27.924922 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1885/3663] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:28.338561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c83b9380-59c7-41fc-9e5b-b991ce767c88 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:28.339275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c83b9380-59c7-41fc-9e5b-b991ce767c88 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:28.348624 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c83b9380-59c7-41fc-9e5b-b991ce767c88 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:28.349078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c83b9380-59c7-41fc-9e5b-b991ce767c88 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:28.350023 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c83b9380-59c7-41fc-9e5b-b991ce767c88 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:28.350619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c83b9380-59c7-41fc-9e5b-b991ce767c88 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:28.550908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c83b9380-59c7-41fc-9e5b-b991ce767c88 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9bb488c761c49c7911109b3c6be27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb9bec54e04b0ab4201d6acf82c4df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:28.558613 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c83b9380-59c7-41fc-9e5b-b991ce767c88 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 200 len: 1313 microversion: 2.1 time: 0.224357 May 21 21:25:28.559190 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1779/3664] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:28 2022] GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:28.795093 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f335249d-2f89-4547-b328-358d08da89cd tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:28.795854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f335249d-2f89-4547-b328-358d08da89cd tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:28.809067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f335249d-2f89-4547-b328-358d08da89cd tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:28.810116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f335249d-2f89-4547-b328-358d08da89cd tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:28.811078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f335249d-2f89-4547-b328-358d08da89cd tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:28.811680 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f335249d-2f89-4547-b328-358d08da89cd tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:28.818382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-67dcb444-137d-4463-aab3-7ff5e1f15e89 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:28.819386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-67dcb444-137d-4463-aab3-7ff5e1f15e89 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:28.822966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=46 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:28.829953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-67dcb444-137d-4463-aab3-7ff5e1f15e89 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:28.830691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-67dcb444-137d-4463-aab3-7ff5e1f15e89 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:28.831663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-67dcb444-137d-4463-aab3-7ff5e1f15e89 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:28.832372 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-67dcb444-137d-4463-aab3-7ff5e1f15e89 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:28.876349 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-67dcb444-137d-4463-aab3-7ff5e1f15e89 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action" status: 200 len: 14 microversion: 2.1 time: 0.060964 May 21 21:25:28.883544 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1780/3665] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:25:28 2022] POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 21 21:25:29.357344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f335249d-2f89-4547-b328-358d08da89cd tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:29.367218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f335249d-2f89-4547-b328-358d08da89cd tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:29.368970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f335249d-2f89-4547-b328-358d08da89cd tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:29.370203 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f335249d-2f89-4547-b328-358d08da89cd tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] 10.222.0.49 "GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803" status: 200 len: 1358 microversion: 2.21 time: 0.580890 May 21 21:25:29.370846 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1886/3666] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:25:28 2022] GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 => generated 1358 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:25:29.578191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4a08c36f-fc2a-41eb-b8d7-529090374a60 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:29.579620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4a08c36f-fc2a-41eb-b8d7-529090374a60 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:29.587572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4a08c36f-fc2a-41eb-b8d7-529090374a60 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:29.588098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4a08c36f-fc2a-41eb-b8d7-529090374a60 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:29.589224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4a08c36f-fc2a-41eb-b8d7-529090374a60 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:29.590488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4a08c36f-fc2a-41eb-b8d7-529090374a60 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:29.879559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4a08c36f-fc2a-41eb-b8d7-529090374a60 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9bb488c761c49c7911109b3c6be27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb9bec54e04b0ab4201d6acf82c4df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:29.893655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-99cd4828-6c47-419a-9bac-0acb8e748487 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:29.894608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-99cd4828-6c47-419a-9bac-0acb8e748487 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:29.910412 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4a08c36f-fc2a-41eb-b8d7-529090374a60 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 200 len: 1313 microversion: 2.1 time: 0.337745 May 21 21:25:29.910997 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1781/3667] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:29 2022] GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:29.919785 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-99cd4828-6c47-419a-9bac-0acb8e748487 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:29.920540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-99cd4828-6c47-419a-9bac-0acb8e748487 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:29.921520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-99cd4828-6c47-419a-9bac-0acb8e748487 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:29.921982 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-99cd4828-6c47-419a-9bac-0acb8e748487 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:29.961673 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-99cd4828-6c47-419a-9bac-0acb8e748487 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action" status: 200 len: 14 microversion: 2.1 time: 0.078110 May 21 21:25:29.962467 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1887/3668] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:25:29 2022] POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:25:30.389311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c4598be8-0343-4d27-8932-df7cb8dfcce3 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:30.390047 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c4598be8-0343-4d27-8932-df7cb8dfcce3 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:30.397028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4598be8-0343-4d27-8932-df7cb8dfcce3 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:30.397559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4598be8-0343-4d27-8932-df7cb8dfcce3 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:30.398445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4598be8-0343-4d27-8932-df7cb8dfcce3 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:30.398992 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4598be8-0343-4d27-8932-df7cb8dfcce3 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:30.586160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c4598be8-0343-4d27-8932-df7cb8dfcce3 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:30.595525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c4598be8-0343-4d27-8932-df7cb8dfcce3 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:30.597095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c4598be8-0343-4d27-8932-df7cb8dfcce3 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:30.598264 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c4598be8-0343-4d27-8932-df7cb8dfcce3 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] 10.222.0.49 "GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803" status: 200 len: 1552 microversion: 2.21 time: 0.213674 May 21 21:25:30.598856 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1782/3669] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:25:30 2022] GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 => generated 1552 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:25:30.616496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-577c9f3d-83c9-48c7-b0e4-cf7589425317 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:30.617088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-577c9f3d-83c9-48c7-b0e4-cf7589425317 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:30.625453 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-577c9f3d-83c9-48c7-b0e4-cf7589425317 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:30.625702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-577c9f3d-83c9-48c7-b0e4-cf7589425317 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:30.626494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-577c9f3d-83c9-48c7-b0e4-cf7589425317 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:30.626944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-577c9f3d-83c9-48c7-b0e4-cf7589425317 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:30.655333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-577c9f3d-83c9-48c7-b0e4-cf7589425317 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:25:30.927484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-88834929-2c80-4511-b020-92ead9322d01 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:30.928558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-88834929-2c80-4511-b020-92ead9322d01 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:30.937663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-88834929-2c80-4511-b020-92ead9322d01 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:30.938867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-88834929-2c80-4511-b020-92ead9322d01 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:30.941277 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-88834929-2c80-4511-b020-92ead9322d01 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:30.942152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-88834929-2c80-4511-b020-92ead9322d01 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:31.100940 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-577c9f3d-83c9-48c7-b0e4-cf7589425317 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] 10.222.0.49 "DELETE /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803" status: 204 len: 0 microversion: 2.21 time: 0.488319 May 21 21:25:31.105149 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1888/3670] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:25:30 2022] DELETE /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:25:31.107145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c08e9e15-4552-4173-bee2-bb3f1d7b30e1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:31.108347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c08e9e15-4552-4173-bee2-bb3f1d7b30e1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:31.114993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c08e9e15-4552-4173-bee2-bb3f1d7b30e1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:31.115475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c08e9e15-4552-4173-bee2-bb3f1d7b30e1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:31.116294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c08e9e15-4552-4173-bee2-bb3f1d7b30e1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:31.116812 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c08e9e15-4552-4173-bee2-bb3f1d7b30e1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:31.157262 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c08e9e15-4552-4173-bee2-bb3f1d7b30e1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action" status: 200 len: 14 microversion: 2.1 time: 0.054084 May 21 21:25:31.157894 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1889/3671] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:25:31 2022] POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:25:31.163100 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bdebad15-bcfe-4c47-a6e1-62d234a163a2 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:31.163817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bdebad15-bcfe-4c47-a6e1-62d234a163a2 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:31.171930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bdebad15-bcfe-4c47-a6e1-62d234a163a2 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:31.172427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bdebad15-bcfe-4c47-a6e1-62d234a163a2 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:31.173329 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bdebad15-bcfe-4c47-a6e1-62d234a163a2 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:31.173782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bdebad15-bcfe-4c47-a6e1-62d234a163a2 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:31.218301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-88834929-2c80-4511-b020-92ead9322d01 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9bb488c761c49c7911109b3c6be27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb9bec54e04b0ab4201d6acf82c4df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:31.227175 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-88834929-2c80-4511-b020-92ead9322d01 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 200 len: 1313 microversion: 2.1 time: 0.304035 May 21 21:25:31.228262 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1783/3672] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:30 2022] GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:31.335006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bdebad15-bcfe-4c47-a6e1-62d234a163a2 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:31.353320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bdebad15-bcfe-4c47-a6e1-62d234a163a2 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:31.355421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bdebad15-bcfe-4c47-a6e1-62d234a163a2 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:31.358120 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bdebad15-bcfe-4c47-a6e1-62d234a163a2 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] 10.222.0.49 "GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803" status: 200 len: 1558 microversion: 2.21 time: 0.198763 May 21 21:25:31.358951 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1890/3673] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:25:31 2022] GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 => generated 1558 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:25:31.900342 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-a7a02356-d0f5-4ed2-8804-99c9dbf04c5d req-fa149601-c5ea-4567-8eb0-33379b2b9e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a345038-c1e0-46dd-89f2-6f2319e93d79", "name": "network-vif-plugged", "status": "completed", "tag": "008072f8-d29d-4ed7-9c3c-668d9de1c0c9"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:31.918429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a7a02356-d0f5-4ed2-8804-99c9dbf04c5d req-fa149601-c5ea-4567-8eb0-33379b2b9e64 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:31.919388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a7a02356-d0f5-4ed2-8804-99c9dbf04c5d req-fa149601-c5ea-4567-8eb0-33379b2b9e64 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:31.931246 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-a7a02356-d0f5-4ed2-8804-99c9dbf04c5d req-fa149601-c5ea-4567-8eb0-33379b2b9e64 service nova] Creating event network-vif-plugged:008072f8-d29d-4ed7-9c3c-668d9de1c0c9 for instance 8a345038-c1e0-46dd-89f2-6f2319e93d79 on nch2-master-1 May 21 21:25:31.937087 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-a7a02356-d0f5-4ed2-8804-99c9dbf04c5d req-fa149601-c5ea-4567-8eb0-33379b2b9e64 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041661 May 21 21:25:31.937892 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1784/3674] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:25:32.168950 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0c49973e-0d38-458f-a969-5162f24f5b79 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:32.170573 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0c49973e-0d38-458f-a969-5162f24f5b79 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:32.183856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0c49973e-0d38-458f-a969-5162f24f5b79 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:32.184948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0c49973e-0d38-458f-a969-5162f24f5b79 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:32.186075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0c49973e-0d38-458f-a969-5162f24f5b79 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:32.186522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0c49973e-0d38-458f-a969-5162f24f5b79 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:32.251150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-faaa8932-2aa3-48c0-bc64-1c362c212d97 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:32.253718 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-faaa8932-2aa3-48c0-bc64-1c362c212d97 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:32.266084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-faaa8932-2aa3-48c0-bc64-1c362c212d97 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:32.267239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-faaa8932-2aa3-48c0-bc64-1c362c212d97 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:32.268556 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-faaa8932-2aa3-48c0-bc64-1c362c212d97 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:32.272901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-faaa8932-2aa3-48c0-bc64-1c362c212d97 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:32.377917 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0c49973e-0d38-458f-a969-5162f24f5b79 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action" status: 200 len: 14 microversion: 2.1 time: 0.213149 May 21 21:25:32.379052 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1891/3675] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:25:32 2022] POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action => generated 14 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:25:32.391958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-852d7df2-0881-4388-8ddb-d0109bf07efa tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:32.393319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-852d7df2-0881-4388-8ddb-d0109bf07efa tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:32.402118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-852d7df2-0881-4388-8ddb-d0109bf07efa tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:32.403205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-852d7df2-0881-4388-8ddb-d0109bf07efa tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:32.404857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-852d7df2-0881-4388-8ddb-d0109bf07efa tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:32.405545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-852d7df2-0881-4388-8ddb-d0109bf07efa tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:32.598686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-faaa8932-2aa3-48c0-bc64-1c362c212d97 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9bb488c761c49c7911109b3c6be27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb9bec54e04b0ab4201d6acf82c4df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:32.614294 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-faaa8932-2aa3-48c0-bc64-1c362c212d97 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 200 len: 1313 microversion: 2.1 time: 0.371495 May 21 21:25:32.627177 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1785/3676] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:32 2022] GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:32.742651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-852d7df2-0881-4388-8ddb-d0109bf07efa tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:32.757110 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-852d7df2-0881-4388-8ddb-d0109bf07efa tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:32.758561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-852d7df2-0881-4388-8ddb-d0109bf07efa tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:32.759752 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-852d7df2-0881-4388-8ddb-d0109bf07efa tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] 10.222.0.49 "GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803" status: 200 len: 1558 microversion: 2.21 time: 0.375121 May 21 21:25:32.764631 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1892/3677] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:25:32 2022] GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 => generated 1558 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:25:33.259071 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-b953c02a-4b73-40d8-957a-e9f693a55ad2 req-036881b9-d58c-4ffc-9f91-63a559505c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550a690c-b49c-4396-a624-f5601b8b0803", "name": "network-vif-deleted", "tag": "0b7e87c4-efa1-4e13-b765-07243f98293a"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:33.269414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b953c02a-4b73-40d8-957a-e9f693a55ad2 req-036881b9-d58c-4ffc-9f91-63a559505c27 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:33.269868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b953c02a-4b73-40d8-957a-e9f693a55ad2 req-036881b9-d58c-4ffc-9f91-63a559505c27 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:33.282698 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-b953c02a-4b73-40d8-957a-e9f693a55ad2 req-036881b9-d58c-4ffc-9f91-63a559505c27 service nova] Creating event network-vif-deleted:0b7e87c4-efa1-4e13-b765-07243f98293a for instance 550a690c-b49c-4396-a624-f5601b8b0803 on nch1-master-1 May 21 21:25:33.287669 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-b953c02a-4b73-40d8-957a-e9f693a55ad2 req-036881b9-d58c-4ffc-9f91-63a559505c27 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033154 May 21 21:25:33.288304 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1786/3678] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:33.390207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9f2e369e-9072-41b1-8858-a289db6f1739 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:33.391173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9f2e369e-9072-41b1-8858-a289db6f1739 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:33.405387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f2e369e-9072-41b1-8858-a289db6f1739 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:33.406113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f2e369e-9072-41b1-8858-a289db6f1739 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:33.407095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f2e369e-9072-41b1-8858-a289db6f1739 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:33.408136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f2e369e-9072-41b1-8858-a289db6f1739 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:33.457823 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9f2e369e-9072-41b1-8858-a289db6f1739 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action" status: 200 len: 14 microversion: 2.1 time: 0.071992 May 21 21:25:33.458688 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1893/3679] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:25:33 2022] POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:25:33.637226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-640d1b4a-0595-47fb-9586-13a6f008b653 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:33.639198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-640d1b4a-0595-47fb-9586-13a6f008b653 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:33.648738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-640d1b4a-0595-47fb-9586-13a6f008b653 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:33.649203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-640d1b4a-0595-47fb-9586-13a6f008b653 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:33.650000 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-640d1b4a-0595-47fb-9586-13a6f008b653 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:33.650482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-640d1b4a-0595-47fb-9586-13a6f008b653 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:33.789270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e3a17f33-fa13-4a48-817b-32d5221c8941 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:33.790525 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e3a17f33-fa13-4a48-817b-32d5221c8941 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:33.802764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3a17f33-fa13-4a48-817b-32d5221c8941 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:33.803364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3a17f33-fa13-4a48-817b-32d5221c8941 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:33.804250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3a17f33-fa13-4a48-817b-32d5221c8941 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:33.804864 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3a17f33-fa13-4a48-817b-32d5221c8941 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:33.846824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3a17f33-fa13-4a48-817b-32d5221c8941 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:33.850711 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-640d1b4a-0595-47fb-9586-13a6f008b653 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9bb488c761c49c7911109b3c6be27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb9bec54e04b0ab4201d6acf82c4df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:33.854397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3a17f33-fa13-4a48-817b-32d5221c8941 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:33.857817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-e3a17f33-fa13-4a48-817b-32d5221c8941 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lazy-loading 'fault' on Instance uuid 550a690c-b49c-4396-a624-f5601b8b0803 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:25:33.860410 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-640d1b4a-0595-47fb-9586-13a6f008b653 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 200 len: 1313 microversion: 2.1 time: 0.230359 May 21 21:25:33.863756 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1787/3680] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:33 2022] GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:33.955823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e3a17f33-fa13-4a48-817b-32d5221c8941 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:33.979050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e3a17f33-fa13-4a48-817b-32d5221c8941 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:33.981252 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e3a17f33-fa13-4a48-817b-32d5221c8941 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746f8aecab064d1092c76c6b798bd750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afab171ffbf4c199ccf15f7487c6a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:33.982692 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e3a17f33-fa13-4a48-817b-32d5221c8941 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] 10.222.0.49 "GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803" status: 200 len: 1348 microversion: 2.21 time: 0.204412 May 21 21:25:33.992341 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1894/3681] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:25:33 2022] GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 => generated 1348 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:25:34.470032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2f7c82ec-ad42-4a0b-8901-6f79cf7d8710 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:34.472013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2f7c82ec-ad42-4a0b-8901-6f79cf7d8710 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:34.480652 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f7c82ec-ad42-4a0b-8901-6f79cf7d8710 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:34.481776 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f7c82ec-ad42-4a0b-8901-6f79cf7d8710 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:34.484442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f7c82ec-ad42-4a0b-8901-6f79cf7d8710 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:34.484442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f7c82ec-ad42-4a0b-8901-6f79cf7d8710 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:34.535372 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2f7c82ec-ad42-4a0b-8901-6f79cf7d8710 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action" status: 200 len: 14 microversion: 2.1 time: 0.069837 May 21 21:25:34.537910 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1788/3682] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:25:34 2022] POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:25:34.757026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e0368f13-be36-4b5e-9e40-34c4e0fb40f6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1088080515", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:34.810338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-e0368f13-be36-4b5e-9e40-34c4e0fb40f6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] validate_networks() for [('b0d29e2a-4338-409a-824e-8e0e576a94df', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:25:34.879495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6c50d586-7304-4b77-9888-dbc13359ff99 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:34.880254 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6c50d586-7304-4b77-9888-dbc13359ff99 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:34.887944 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c50d586-7304-4b77-9888-dbc13359ff99 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:34.888435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c50d586-7304-4b77-9888-dbc13359ff99 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:34.889234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c50d586-7304-4b77-9888-dbc13359ff99 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:34.889683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c50d586-7304-4b77-9888-dbc13359ff99 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:35.087659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6c50d586-7304-4b77-9888-dbc13359ff99 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9bb488c761c49c7911109b3c6be27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb9bec54e04b0ab4201d6acf82c4df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:35.097435 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6c50d586-7304-4b77-9888-dbc13359ff99 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 200 len: 1496 microversion: 2.1 time: 0.222256 May 21 21:25:35.108428 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1789/3683] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:34 2022] GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 1496 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:35.108428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-02bb6b57-a0f1-48ab-9043-b68a2ca1bbd8 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:35.108428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-02bb6b57-a0f1-48ab-9043-b68a2ca1bbd8 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:35.110849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02bb6b57-a0f1-48ab-9043-b68a2ca1bbd8 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:35.111300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02bb6b57-a0f1-48ab-9043-b68a2ca1bbd8 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:35.112074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02bb6b57-a0f1-48ab-9043-b68a2ca1bbd8 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:35.112630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02bb6b57-a0f1-48ab-9043-b68a2ca1bbd8 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:35.129981 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-02bb6b57-a0f1-48ab-9043-b68a2ca1bbd8 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] HTTP exception thrown: Instance 550a690c-b49c-4396-a624-f5601b8b0803 could not be found. May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-02bb6b57-a0f1-48ab-9043-b68a2ca1bbd8 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Request method failure captured: May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 HTTP/1.1 May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVi5yDMV4yzRdBaVJRPm2K6d8NqH8WMMRInNV9r5u0ivHS7IzCeX4XDz8AeVDCYTJSIPTZW6EbVVDpa5XdB8tMcsUoWdrh6zqAz95aM5p2BJTZVKiGmeQhX8pnVcH4Nw_0fCSV1E8Qw5xr0CEz4xnAcYcibO1f3utQHnmGC2X-P2BNw May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: X-Openstack-Nova-Api-Version: 2.21 May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 7afab171ffbf4c199ccf15f7487c6a63 May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1519642409 May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7afab171ffbf4c199ccf15f7487c6a63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7afab171ffbf4c199ccf15f7487c6a63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7afab171ffbf4c199ccf15f7487c6a63", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7afab171ffbf4c199ccf15f7487c6a63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-InstanceActionsV221TestJSON-1519642409 May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 7afab171ffbf4c199ccf15f7487c6a63 May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1519642409 May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-InstanceActionsV221TestJSON-1519642409-project May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 746f8aecab064d1092c76c6b798bd750 May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-InstanceActionsV221TestJSON-1519642409-project May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 550a690c-b49c-4396-a624-f5601b8b0803 could not be found. May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '550a690c-b49c-4396-a624-f5601b8b0803'} May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 550a690c-b49c-4396-a624-f5601b8b0803 could not be found. May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 550a690c-b49c-4396-a624-f5601b8b0803 could not be found. May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:35.131693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:35.136746 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:35.136746 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:35.136746 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:35.136746 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:35.136746 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:25:35.136746 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:25:35.136746 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 550a690c-b49c-4396-a624-f5601b8b0803 could not be found. May 21 21:25:35.136746 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:35.141204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-02bb6b57-a0f1-48ab-9043-b68a2ca1bbd8 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Returning 404 to user: Instance 550a690c-b49c-4396-a624-f5601b8b0803 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:25:35.142102 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-02bb6b57-a0f1-48ab-9043-b68a2ca1bbd8 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] 10.222.0.49 "GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803" status: 404 len: 111 microversion: 2.21 time: 0.042474 May 21 21:25:35.142895 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1790/3684] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:25:35 2022] GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:25:35.148368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dd5f77cf-f555-4fc3-bfc2-f33af269c9c2 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:35.163181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.compute.server_groups [None req-dd5f77cf-f555-4fc3-bfc2-f33af269c9c2 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Querying cell 4f046ce9-ac6c-44d8-b1fb-b7063eef06e7(cell1) for 1 instances {{(pid=131278) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 21 21:25:35.163999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd5f77cf-f555-4fc3-bfc2-f33af269c9c2 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:35.164625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd5f77cf-f555-4fc3-bfc2-f33af269c9c2 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:35.183522 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dd5f77cf-f555-4fc3-bfc2-f33af269c9c2 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups/e3444781-eae6-4962-a000-7da74e8b2b31" status: 200 len: 222 microversion: 2.1 time: 0.039757 May 21 21:25:35.184162 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1791/3685] 10.222.0.49 () {58 vars in 1262 bytes} [Sat May 21 21:25:35 2022] GET /compute/v2.1/os-server-groups/e3444781-eae6-4962-a000-7da74e8b2b31 => generated 222 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:35.189267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-44ca65c4-f72d-4171-9a0c-d72fc2cb657a tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Calling method '.version_select at 0x7fc82d0ff550>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:35.190068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-44ca65c4-f72d-4171-9a0c-d72fc2cb657a tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:35.196308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44ca65c4-f72d-4171-9a0c-d72fc2cb657a tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:35.196765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44ca65c4-f72d-4171-9a0c-d72fc2cb657a tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:35.197545 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44ca65c4-f72d-4171-9a0c-d72fc2cb657a tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:35.198018 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44ca65c4-f72d-4171-9a0c-d72fc2cb657a tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:35.268595 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-44ca65c4-f72d-4171-9a0c-d72fc2cb657a tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] 10.222.0.49 "GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.083235 May 21 21:25:35.269192 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1792/3686] 10.222.0.49 () {60 vars in 1336 bytes} [Sat May 21 21:25:35 2022] GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803/os-instance-actions => generated 611 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:25:35.277726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-07437cfc-c352-4d5d-80c2-a69118d97cb0 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:35.278831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-07437cfc-c352-4d5d-80c2-a69118d97cb0 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:35.285530 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-07437cfc-c352-4d5d-80c2-a69118d97cb0 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:35.285988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-07437cfc-c352-4d5d-80c2-a69118d97cb0 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:35.286767 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-07437cfc-c352-4d5d-80c2-a69118d97cb0 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:35.287197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-07437cfc-c352-4d5d-80c2-a69118d97cb0 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:35.314936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-07437cfc-c352-4d5d-80c2-a69118d97cb0 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:25:35.361673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e0368f13-be36-4b5e-9e40-34c4e0fb40f6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:25:35.361673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e0368f13-be36-4b5e-9e40-34c4e0fb40f6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:25:35.361673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e0368f13-be36-4b5e-9e40-34c4e0fb40f6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:25:35.362132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e0368f13-be36-4b5e-9e40-34c4e0fb40f6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:25:35.362253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e0368f13-be36-4b5e-9e40-34c4e0fb40f6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:25:35.371659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e0368f13-be36-4b5e-9e40-34c4e0fb40f6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:35.372251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e0368f13-be36-4b5e-9e40-34c4e0fb40f6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:35.373311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e0368f13-be36-4b5e-9e40-34c4e0fb40f6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:35.373765 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e0368f13-be36-4b5e-9e40-34c4e0fb40f6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:35.394336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-e0368f13-be36-4b5e-9e40-34c4e0fb40f6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Getting quotas for project a4da9d7db0c74b55908d44fd7bc7d4ff. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:25:35.400174 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-e0368f13-be36-4b5e-9e40-34c4e0fb40f6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Getting quotas for user 12adb7ad474b4361812cd1f6ad70ef59 and project a4da9d7db0c74b55908d44fd7bc7d4ff. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:25:35.414665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e0368f13-be36-4b5e-9e40-34c4e0fb40f6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:25:35.417050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e0368f13-be36-4b5e-9e40-34c4e0fb40f6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:25:35.549062 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e0368f13-be36-4b5e-9e40-34c4e0fb40f6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.927564 May 21 21:25:35.550331 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1895/3687] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:25:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:25:35.557063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-620eeaf2-1df3-406a-8950-07b23e674eed tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:35.557803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-620eeaf2-1df3-406a-8950-07b23e674eed tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:35.567465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-620eeaf2-1df3-406a-8950-07b23e674eed tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:35.568160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-620eeaf2-1df3-406a-8950-07b23e674eed tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:35.569224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-620eeaf2-1df3-406a-8950-07b23e674eed tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:35.569847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-620eeaf2-1df3-406a-8950-07b23e674eed tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:35.592961 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-620eeaf2-1df3-406a-8950-07b23e674eed tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] HTTP exception thrown: Instance 550a690c-b49c-4396-a624-f5601b8b0803 could not be found. May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-620eeaf2-1df3-406a-8950-07b23e674eed tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Request method failure captured: May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 HTTP/1.1 May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVi5yDMV4yzRdBaVJRPm2K6d8NqH8WMMRInNV9r5u0ivHS7IzCeX4XDz8AeVDCYTJSIPTZW6EbVVDpa5XdB8tMcsUoWdrh6zqAz95aM5p2BJTZVKiGmeQhX8pnVcH4Nw_0fCSV1E8Qw5xr0CEz4xnAcYcibO1f3utQHnmGC2X-P2BNw May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: X-Openstack-Nova-Api-Version: 2.21 May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 7afab171ffbf4c199ccf15f7487c6a63 May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1519642409 May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7afab171ffbf4c199ccf15f7487c6a63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7afab171ffbf4c199ccf15f7487c6a63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7afab171ffbf4c199ccf15f7487c6a63", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7afab171ffbf4c199ccf15f7487c6a63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-InstanceActionsV221TestJSON-1519642409 May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 7afab171ffbf4c199ccf15f7487c6a63 May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1519642409 May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-InstanceActionsV221TestJSON-1519642409-project May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 746f8aecab064d1092c76c6b798bd750 May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-InstanceActionsV221TestJSON-1519642409-project May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 550a690c-b49c-4396-a624-f5601b8b0803 could not be found. May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '550a690c-b49c-4396-a624-f5601b8b0803'} May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 550a690c-b49c-4396-a624-f5601b8b0803 could not be found. May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:25:35.595140 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:25:35.601346 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 550a690c-b49c-4396-a624-f5601b8b0803 could not be found. May 21 21:25:35.601346 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:35.601346 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:35.601346 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:35.601346 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:35.601346 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:35.601346 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:35.601346 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:25:35.601346 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:25:35.601346 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 550a690c-b49c-4396-a624-f5601b8b0803 could not be found. May 21 21:25:35.601346 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:35.601346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-620eeaf2-1df3-406a-8950-07b23e674eed tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Returning 404 to user: Instance 550a690c-b49c-4396-a624-f5601b8b0803 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:25:35.601346 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-620eeaf2-1df3-406a-8950-07b23e674eed tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] 10.222.0.49 "DELETE /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803" status: 404 len: 111 microversion: 2.21 time: 0.046406 May 21 21:25:35.603028 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1896/3688] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:25:35 2022] DELETE /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:25:35.609483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-053544be-5c19-45b4-a2ba-3cde2256fecc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:35.610938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-053544be-5c19-45b4-a2ba-3cde2256fecc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:35.618326 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-053544be-5c19-45b4-a2ba-3cde2256fecc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:35.618895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-053544be-5c19-45b4-a2ba-3cde2256fecc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:35.619761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-053544be-5c19-45b4-a2ba-3cde2256fecc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:35.620270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-053544be-5c19-45b4-a2ba-3cde2256fecc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:35.627777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:35.718235 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-053544be-5c19-45b4-a2ba-3cde2256fecc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action" status: 200 len: 14 microversion: 2.1 time: 0.113868 May 21 21:25:35.719218 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1897/3689] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:25:35 2022] POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:25:35.726112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0ad04bd6-79e9-42cf-b0ef-33cd8be9bb1e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:35.727856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0ad04bd6-79e9-42cf-b0ef-33cd8be9bb1e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:35.787104 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-07437cfc-c352-4d5d-80c2-a69118d97cb0 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 204 len: 0 microversion: 2.1 time: 0.516637 May 21 21:25:35.787731 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1793/3690] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:25:35 2022] DELETE /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:25:35.796677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dab3e0ac-25cb-48c3-af99-fd8106353f58 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:35.796677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dab3e0ac-25cb-48c3-af99-fd8106353f58 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] [instance: 550a690c-b49c-4396-a624-f5601b8b0803] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:35.800632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0ad04bd6-79e9-42cf-b0ef-33cd8be9bb1e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:35.806249 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dab3e0ac-25cb-48c3-af99-fd8106353f58 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:35.806955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dab3e0ac-25cb-48c3-af99-fd8106353f58 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:35.807827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dab3e0ac-25cb-48c3-af99-fd8106353f58 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:35.808407 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dab3e0ac-25cb-48c3-af99-fd8106353f58 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:35.813647 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0ad04bd6-79e9-42cf-b0ef-33cd8be9bb1e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1214 microversion: 2.1 time: 0.092553 May 21 21:25:35.814510 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1898/3691] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:35 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:35.824743 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-48b4a5db-1572-4315-bdbf-2d52b199ad54 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:35.826102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-48b4a5db-1572-4315-bdbf-2d52b199ad54 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:35.834885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48b4a5db-1572-4315-bdbf-2d52b199ad54 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:35.835547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48b4a5db-1572-4315-bdbf-2d52b199ad54 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:35.837448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48b4a5db-1572-4315-bdbf-2d52b199ad54 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:35.838070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48b4a5db-1572-4315-bdbf-2d52b199ad54 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:35.849742 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-dab3e0ac-25cb-48c3-af99-fd8106353f58 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] HTTP exception thrown: Instance 550a690c-b49c-4396-a624-f5601b8b0803 could not be found. May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dab3e0ac-25cb-48c3-af99-fd8106353f58 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Request method failure captured: May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 HTTP/1.1 May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVi5yDMV4yzRdBaVJRPm2K6d8NqH8WMMRInNV9r5u0ivHS7IzCeX4XDz8AeVDCYTJSIPTZW6EbVVDpa5XdB8tMcsUoWdrh6zqAz95aM5p2BJTZVKiGmeQhX8pnVcH4Nw_0fCSV1E8Qw5xr0CEz4xnAcYcibO1f3utQHnmGC2X-P2BNw May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: X-Openstack-Nova-Api-Version: 2.21 May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 7afab171ffbf4c199ccf15f7487c6a63 May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1519642409 May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7afab171ffbf4c199ccf15f7487c6a63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7afab171ffbf4c199ccf15f7487c6a63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7afab171ffbf4c199ccf15f7487c6a63", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7afab171ffbf4c199ccf15f7487c6a63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-InstanceActionsV221TestJSON-1519642409 May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 7afab171ffbf4c199ccf15f7487c6a63 May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1519642409 May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-InstanceActionsV221TestJSON-1519642409-project May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 746f8aecab064d1092c76c6b798bd750 May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-InstanceActionsV221TestJSON-1519642409-project May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 550a690c-b49c-4396-a624-f5601b8b0803 could not be found. May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '550a690c-b49c-4396-a624-f5601b8b0803'} May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 550a690c-b49c-4396-a624-f5601b8b0803 could not be found. May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 550a690c-b49c-4396-a624-f5601b8b0803 could not be found. May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:35.856740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:35.862410 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:35.862410 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:35.862410 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:35.862410 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:35.862410 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:25:35.862410 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:25:35.862410 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 550a690c-b49c-4396-a624-f5601b8b0803 could not be found. May 21 21:25:35.862410 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:35.862410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dab3e0ac-25cb-48c3-af99-fd8106353f58 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] Returning 404 to user: Instance 550a690c-b49c-4396-a624-f5601b8b0803 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:25:35.862410 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dab3e0ac-25cb-48c3-af99-fd8106353f58 tempest-InstanceActionsV221TestJSON-1519642409 tempest-InstanceActionsV221TestJSON-1519642409-project] 10.222.0.49 "GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803" status: 404 len: 111 microversion: 2.21 time: 0.064591 May 21 21:25:35.862410 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1794/3692] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:25:35 2022] GET /compute/v2.1/servers/550a690c-b49c-4396-a624-f5601b8b0803 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:25:36.112478 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-48b4a5db-1572-4315-bdbf-2d52b199ad54 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9bb488c761c49c7911109b3c6be27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb9bec54e04b0ab4201d6acf82c4df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:36.124013 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-48b4a5db-1572-4315-bdbf-2d52b199ad54 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 200 len: 1502 microversion: 2.1 time: 0.308284 May 21 21:25:36.136059 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1899/3693] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:35 2022] GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 1502 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:36.731690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d99094dc-2bb0-4987-aedd-9dfa78266905 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:36.732958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d99094dc-2bb0-4987-aedd-9dfa78266905 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:36.747161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d99094dc-2bb0-4987-aedd-9dfa78266905 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:36.747161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d99094dc-2bb0-4987-aedd-9dfa78266905 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:36.748203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d99094dc-2bb0-4987-aedd-9dfa78266905 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:36.748678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d99094dc-2bb0-4987-aedd-9dfa78266905 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:36.832163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-87a65f35-a2c9-45b2-aa0c-6327604b0295 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:36.833368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-87a65f35-a2c9-45b2-aa0c-6327604b0295 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:36.900702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-87a65f35-a2c9-45b2-aa0c-6327604b0295 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:36.908532 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-87a65f35-a2c9-45b2-aa0c-6327604b0295 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1214 microversion: 2.1 time: 0.082101 May 21 21:25:36.909096 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1900/3694] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:36 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:36.952476 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d99094dc-2bb0-4987-aedd-9dfa78266905 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action" status: 200 len: 14 microversion: 2.1 time: 0.226106 May 21 21:25:36.953118 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1795/3695] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:25:36 2022] POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action => generated 14 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:25:37.143939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-79537d67-f798-4f1e-9bd3-159d1d5698a9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:37.145514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-79537d67-f798-4f1e-9bd3-159d1d5698a9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:37.159629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-79537d67-f798-4f1e-9bd3-159d1d5698a9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:37.160180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-79537d67-f798-4f1e-9bd3-159d1d5698a9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:37.161250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-79537d67-f798-4f1e-9bd3-159d1d5698a9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:37.162025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-79537d67-f798-4f1e-9bd3-159d1d5698a9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:37.403332 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-79537d67-f798-4f1e-9bd3-159d1d5698a9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9bb488c761c49c7911109b3c6be27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb9bec54e04b0ab4201d6acf82c4df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:37.413155 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-79537d67-f798-4f1e-9bd3-159d1d5698a9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 200 len: 1502 microversion: 2.1 time: 0.274362 May 21 21:25:37.413922 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1901/3696] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:37 2022] GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 1502 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:37.926510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d28ea09b-e50e-423a-9e49-099b4bee0307 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:37.930362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d28ea09b-e50e-423a-9e49-099b4bee0307 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:37.936861 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d28ea09b-e50e-423a-9e49-099b4bee0307 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:37.937686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d28ea09b-e50e-423a-9e49-099b4bee0307 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:37.938693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d28ea09b-e50e-423a-9e49-099b4bee0307 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:37.939303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d28ea09b-e50e-423a-9e49-099b4bee0307 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:37.965730 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8b0ed5d9-2cc9-4a8e-8de8-7328fc302d90 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:37.966979 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8b0ed5d9-2cc9-4a8e-8de8-7328fc302d90 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:37.979422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b0ed5d9-2cc9-4a8e-8de8-7328fc302d90 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:37.979883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b0ed5d9-2cc9-4a8e-8de8-7328fc302d90 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:37.985995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b0ed5d9-2cc9-4a8e-8de8-7328fc302d90 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:37.986978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b0ed5d9-2cc9-4a8e-8de8-7328fc302d90 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:37.994212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:38.068204 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8b0ed5d9-2cc9-4a8e-8de8-7328fc302d90 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action" status: 200 len: 14 microversion: 2.1 time: 0.102968 May 21 21:25:38.068204 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1902/3697] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:25:37 2022] POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:25:38.135346 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d28ea09b-e50e-423a-9e49-099b4bee0307 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:38.142111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-c59cf11d-d195-4830-953e-9d2ea3188b35 req-ccefaa8b-610c-4b9c-aff8-3520dd851434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a345038-c1e0-46dd-89f2-6f2319e93d79", "name": "network-vif-deleted", "tag": "008072f8-d29d-4ed7-9c3c-668d9de1c0c9"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:38.145399 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d28ea09b-e50e-423a-9e49-099b4bee0307 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1266 microversion: 2.1 time: 0.223611 May 21 21:25:38.147418 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1796/3698] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:37 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:38.182267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c59cf11d-d195-4830-953e-9d2ea3188b35 req-ccefaa8b-610c-4b9c-aff8-3520dd851434 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:38.182730 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c59cf11d-d195-4830-953e-9d2ea3188b35 req-ccefaa8b-610c-4b9c-aff8-3520dd851434 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:38.200336 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-c59cf11d-d195-4830-953e-9d2ea3188b35 req-ccefaa8b-610c-4b9c-aff8-3520dd851434 service nova] Creating event network-vif-deleted:008072f8-d29d-4ed7-9c3c-668d9de1c0c9 for instance 8a345038-c1e0-46dd-89f2-6f2319e93d79 on nch2-master-1 May 21 21:25:38.207129 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-c59cf11d-d195-4830-953e-9d2ea3188b35 req-ccefaa8b-610c-4b9c-aff8-3520dd851434 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074416 May 21 21:25:38.208383 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1903/3699] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:38.431935 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b2d18577-fe0c-40d4-b39e-aab400bb4c45 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:38.432736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b2d18577-fe0c-40d4-b39e-aab400bb4c45 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:38.440759 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2d18577-fe0c-40d4-b39e-aab400bb4c45 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:38.443612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2d18577-fe0c-40d4-b39e-aab400bb4c45 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:38.444499 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2d18577-fe0c-40d4-b39e-aab400bb4c45 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:38.444960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2d18577-fe0c-40d4-b39e-aab400bb4c45 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:38.551919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b2d18577-fe0c-40d4-b39e-aab400bb4c45 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9bb488c761c49c7911109b3c6be27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceb9bec54e04b0ab4201d6acf82c4df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:38.568531 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b2d18577-fe0c-40d4-b39e-aab400bb4c45 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 200 len: 1298 microversion: 2.1 time: 0.138023 May 21 21:25:38.572560 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1797/3700] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:38 2022] GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 1298 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:39.075514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c133d8b6-d005-40aa-a8ba-baa2b0f97fbd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:39.076575 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c133d8b6-d005-40aa-a8ba-baa2b0f97fbd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:39.089676 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c133d8b6-d005-40aa-a8ba-baa2b0f97fbd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:39.090406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c133d8b6-d005-40aa-a8ba-baa2b0f97fbd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:39.091361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c133d8b6-d005-40aa-a8ba-baa2b0f97fbd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:39.091960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c133d8b6-d005-40aa-a8ba-baa2b0f97fbd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:39.148108 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c133d8b6-d005-40aa-a8ba-baa2b0f97fbd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action" status: 200 len: 8207 microversion: 2.1 time: 0.077628 May 21 21:25:39.148833 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1904/3701] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:25:39 2022] POST /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245/action => generated 8207 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:39.162817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ecaa800a-bb70-4082-b69d-b66683770339 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:39.163798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ecaa800a-bb70-4082-b69d-b66683770339 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:39.167409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f928b7a7-9e74-46cd-a44f-b2ef4535bb80 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:39.168944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f928b7a7-9e74-46cd-a44f-b2ef4535bb80 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:39.172442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ecaa800a-bb70-4082-b69d-b66683770339 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:39.172912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ecaa800a-bb70-4082-b69d-b66683770339 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:39.173883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ecaa800a-bb70-4082-b69d-b66683770339 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:39.174333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ecaa800a-bb70-4082-b69d-b66683770339 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:39.179639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f928b7a7-9e74-46cd-a44f-b2ef4535bb80 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:39.180263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f928b7a7-9e74-46cd-a44f-b2ef4535bb80 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:39.181068 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f928b7a7-9e74-46cd-a44f-b2ef4535bb80 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:39.181506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f928b7a7-9e74-46cd-a44f-b2ef4535bb80 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:39.258666 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f928b7a7-9e74-46cd-a44f-b2ef4535bb80 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:39.267072 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f928b7a7-9e74-46cd-a44f-b2ef4535bb80 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1272 microversion: 2.1 time: 0.104882 May 21 21:25:39.267783 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1905/3702] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:39 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1272 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:39.406336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f928b7a7-9e74-46cd-a44f-b2ef4535bb80 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:39.407656 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f928b7a7-9e74-46cd-a44f-b2ef4535bb80 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001711 May 21 21:25:39.407987 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1906/3703] 10.222.0.49 () {56 vars in 885 bytes} [Sat May 21 21:25:39 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) May 21 21:25:39.586000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-87d47213-c0f0-44d7-8c4b-951bd3c95b9f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:39.586628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-87d47213-c0f0-44d7-8c4b-951bd3c95b9f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:39.594138 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87d47213-c0f0-44d7-8c4b-951bd3c95b9f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:39.594596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87d47213-c0f0-44d7-8c4b-951bd3c95b9f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:39.595374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87d47213-c0f0-44d7-8c4b-951bd3c95b9f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:39.595821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87d47213-c0f0-44d7-8c4b-951bd3c95b9f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:39.613443 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-87d47213-c0f0-44d7-8c4b-951bd3c95b9f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] HTTP exception thrown: Instance 8a345038-c1e0-46dd-89f2-6f2319e93d79 could not be found. May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-87d47213-c0f0-44d7-8c4b-951bd3c95b9f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Request method failure captured: May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 HTTP/1.1 May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVi4qzwyJGqDrU6CyO4zrxT9rCvc5RhfhBGJEWNYMsY7gzfVAO1A6MRkuSeftvzE1ojG7ZytTp2NrJxtNkpxmvwxpMq3OjGlAEXciXFgX9vBAcjS39kbOzZ2Sog0wBc_86KudZ4mGzbK7PpVWg28Oea7NP4Z0JOCVIzt-aLF4Ygxtd0 May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: cceb9bec54e04b0ab4201d6acf82c4df May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerGroupTestJSON-1952970066 May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cceb9bec54e04b0ab4201d6acf82c4df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cceb9bec54e04b0ab4201d6acf82c4df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cceb9bec54e04b0ab4201d6acf82c4df", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cceb9bec54e04b0ab4201d6acf82c4df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerGroupTestJSON-1952970066 May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: cceb9bec54e04b0ab4201d6acf82c4df May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerGroupTestJSON-1952970066 May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerGroupTestJSON-1952970066-project May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a9bb488c761c49c7911109b3c6be27c2 May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerGroupTestJSON-1952970066-project May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 8a345038-c1e0-46dd-89f2-6f2319e93d79 could not be found. May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '8a345038-c1e0-46dd-89f2-6f2319e93d79'} May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a345038-c1e0-46dd-89f2-6f2319e93d79 could not be found. May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a345038-c1e0-46dd-89f2-6f2319e93d79 could not be found. May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:39.615376 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.621028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:39.621028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:39.621028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:39.621028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:25:39.621028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:25:39.621028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a345038-c1e0-46dd-89f2-6f2319e93d79 could not be found. May 21 21:25:39.621028 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.621028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-87d47213-c0f0-44d7-8c4b-951bd3c95b9f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Returning 404 to user: Instance 8a345038-c1e0-46dd-89f2-6f2319e93d79 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:25:39.621028 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-87d47213-c0f0-44d7-8c4b-951bd3c95b9f tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 404 len: 111 microversion: 2.1 time: 0.034775 May 21 21:25:39.621028 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1907/3704] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:39 2022] GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:25:39.628830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-30fe47bc-302a-40b2-85ef-02496c381468 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:39.642803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:39.646609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.compute.server_groups [None req-30fe47bc-302a-40b2-85ef-02496c381468 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Querying cell 4f046ce9-ac6c-44d8-b1fb-b7063eef06e7(cell1) for 1 instances {{(pid=131277) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 21 21:25:39.647431 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-30fe47bc-302a-40b2-85ef-02496c381468 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:39.648077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-30fe47bc-302a-40b2-85ef-02496c381468 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:39.659787 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-30fe47bc-302a-40b2-85ef-02496c381468 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.035229 May 21 21:25:39.660543 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1908/3705] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:25:39 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:39.672972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ccdb56d4-7667-43c0-9f74-37704dc023d9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:39.703094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.compute.server_groups [None req-ccdb56d4-7667-43c0-9f74-37704dc023d9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Querying cell 4f046ce9-ac6c-44d8-b1fb-b7063eef06e7(cell1) for 1 instances {{(pid=131277) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 21 21:25:39.704232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ccdb56d4-7667-43c0-9f74-37704dc023d9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:39.704918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ccdb56d4-7667-43c0-9f74-37704dc023d9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:39.715904 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ecaa800a-bb70-4082-b69d-b66683770339 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:39.718458 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ccdb56d4-7667-43c0-9f74-37704dc023d9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups/e3444781-eae6-4962-a000-7da74e8b2b31" status: 200 len: 184 microversion: 2.1 time: 0.050673 May 21 21:25:39.719029 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1909/3706] 10.222.0.49 () {58 vars in 1262 bytes} [Sat May 21 21:25:39 2022] GET /compute/v2.1/os-server-groups/e3444781-eae6-4962-a000-7da74e8b2b31 => generated 184 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:39.729525 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ddfc87a9-1706-4cf8-be1b-628972443adc tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:39.730360 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ddfc87a9-1706-4cf8-be1b-628972443adc tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:39.732040 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ecaa800a-bb70-4082-b69d-b66683770339 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.576611 May 21 21:25:39.732674 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1798/3707] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:39 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:39.741630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ddfc87a9-1706-4cf8-be1b-628972443adc tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:39.742979 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ddfc87a9-1706-4cf8-be1b-628972443adc tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:39.745754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ddfc87a9-1706-4cf8-be1b-628972443adc tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:39.746703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ddfc87a9-1706-4cf8-be1b-628972443adc tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:39.751734 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-11229a7d-5e41-4246-8662-1a7a5d7fd45f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:39.752462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-11229a7d-5e41-4246-8662-1a7a5d7fd45f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:39.758978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11229a7d-5e41-4246-8662-1a7a5d7fd45f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:39.759683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11229a7d-5e41-4246-8662-1a7a5d7fd45f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:39.760755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11229a7d-5e41-4246-8662-1a7a5d7fd45f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:39.761427 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11229a7d-5e41-4246-8662-1a7a5d7fd45f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:39.765685 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-ddfc87a9-1706-4cf8-be1b-628972443adc tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] HTTP exception thrown: Instance 8a345038-c1e0-46dd-89f2-6f2319e93d79 could not be found. May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ddfc87a9-1706-4cf8-be1b-628972443adc tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Request method failure captured: May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 HTTP/1.1 May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVi4qzwyJGqDrU6CyO4zrxT9rCvc5RhfhBGJEWNYMsY7gzfVAO1A6MRkuSeftvzE1ojG7ZytTp2NrJxtNkpxmvwxpMq3OjGlAEXciXFgX9vBAcjS39kbOzZ2Sog0wBc_86KudZ4mGzbK7PpVWg28Oea7NP4Z0JOCVIzt-aLF4Ygxtd0 May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: cceb9bec54e04b0ab4201d6acf82c4df May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerGroupTestJSON-1952970066 May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cceb9bec54e04b0ab4201d6acf82c4df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cceb9bec54e04b0ab4201d6acf82c4df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cceb9bec54e04b0ab4201d6acf82c4df", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cceb9bec54e04b0ab4201d6acf82c4df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerGroupTestJSON-1952970066 May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: cceb9bec54e04b0ab4201d6acf82c4df May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerGroupTestJSON-1952970066 May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerGroupTestJSON-1952970066-project May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a9bb488c761c49c7911109b3c6be27c2 May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerGroupTestJSON-1952970066-project May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 8a345038-c1e0-46dd-89f2-6f2319e93d79 could not be found. May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '8a345038-c1e0-46dd-89f2-6f2319e93d79'} May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a345038-c1e0-46dd-89f2-6f2319e93d79 could not be found. May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:25:39.767366 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:25:39.775141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a345038-c1e0-46dd-89f2-6f2319e93d79 could not be found. May 21 21:25:39.775141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.775141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:39.775141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.775141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:39.775141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:39.775141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:39.775141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:25:39.775141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:25:39.775141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a345038-c1e0-46dd-89f2-6f2319e93d79 could not be found. May 21 21:25:39.775141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.775141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ddfc87a9-1706-4cf8-be1b-628972443adc tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Returning 404 to user: Instance 8a345038-c1e0-46dd-89f2-6f2319e93d79 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:25:39.775141 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ddfc87a9-1706-4cf8-be1b-628972443adc tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 404 len: 111 microversion: 2.1 time: 0.043250 May 21 21:25:39.775141 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1910/3708] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:25:39 2022] DELETE /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:25:39.781829 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ad40248b-806b-4614-b59a-33d4fcf5a3c6 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:39.782442 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ad40248b-806b-4614-b59a-33d4fcf5a3c6 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] [instance: 8a345038-c1e0-46dd-89f2-6f2319e93d79] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:39.788518 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad40248b-806b-4614-b59a-33d4fcf5a3c6 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:39.789125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad40248b-806b-4614-b59a-33d4fcf5a3c6 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:39.789975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad40248b-806b-4614-b59a-33d4fcf5a3c6 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:39.790435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad40248b-806b-4614-b59a-33d4fcf5a3c6 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:39.805108 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-ad40248b-806b-4614-b59a-33d4fcf5a3c6 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] HTTP exception thrown: Instance 8a345038-c1e0-46dd-89f2-6f2319e93d79 could not be found. May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ad40248b-806b-4614-b59a-33d4fcf5a3c6 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Request method failure captured: May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 HTTP/1.1 May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVi4qzwyJGqDrU6CyO4zrxT9rCvc5RhfhBGJEWNYMsY7gzfVAO1A6MRkuSeftvzE1ojG7ZytTp2NrJxtNkpxmvwxpMq3OjGlAEXciXFgX9vBAcjS39kbOzZ2Sog0wBc_86KudZ4mGzbK7PpVWg28Oea7NP4Z0JOCVIzt-aLF4Ygxtd0 May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: cceb9bec54e04b0ab4201d6acf82c4df May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerGroupTestJSON-1952970066 May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cceb9bec54e04b0ab4201d6acf82c4df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cceb9bec54e04b0ab4201d6acf82c4df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cceb9bec54e04b0ab4201d6acf82c4df", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cceb9bec54e04b0ab4201d6acf82c4df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerGroupTestJSON-1952970066 May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: cceb9bec54e04b0ab4201d6acf82c4df May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerGroupTestJSON-1952970066 May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerGroupTestJSON-1952970066-project May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a9bb488c761c49c7911109b3c6be27c2 May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerGroupTestJSON-1952970066-project May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 8a345038-c1e0-46dd-89f2-6f2319e93d79 could not be found. May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '8a345038-c1e0-46dd-89f2-6f2319e93d79'} May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a345038-c1e0-46dd-89f2-6f2319e93d79 could not be found. May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a345038-c1e0-46dd-89f2-6f2319e93d79 could not be found. May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:39.806700 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.811915 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:39.811915 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:39.811915 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:39.811915 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:25:39.811915 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:25:39.811915 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a345038-c1e0-46dd-89f2-6f2319e93d79 could not be found. May 21 21:25:39.811915 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.811915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ad40248b-806b-4614-b59a-33d4fcf5a3c6 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Returning 404 to user: Instance 8a345038-c1e0-46dd-89f2-6f2319e93d79 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:25:39.811915 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ad40248b-806b-4614-b59a-33d4fcf5a3c6 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79" status: 404 len: 111 microversion: 2.1 time: 0.030814 May 21 21:25:39.811915 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1911/3709] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:39 2022] GET /compute/v2.1/servers/8a345038-c1e0-46dd-89f2-6f2319e93d79 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:25:39.818553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-23df8d59-a0d4-49f2-bf5b-d1fc26a7e5a9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:39.823325 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-23df8d59-a0d4-49f2-bf5b-d1fc26a7e5a9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] HTTP exception thrown: Instance group c5437ee8-226d-473e-b2ab-0e20b92e8296 could not be found. May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-23df8d59-a0d4-49f2-bf5b-d1fc26a7e5a9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Request method failure captured: May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/os-server-groups/c5437ee8-226d-473e-b2ab-0e20b92e8296 HTTP/1.1 May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVi4qzwyJGqDrU6CyO4zrxT9rCvc5RhfhBGJEWNYMsY7gzfVAO1A6MRkuSeftvzE1ojG7ZytTp2NrJxtNkpxmvwxpMq3OjGlAEXciXFgX9vBAcjS39kbOzZ2Sog0wBc_86KudZ4mGzbK7PpVWg28Oea7NP4Z0JOCVIzt-aLF4Ygxtd0 May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: cceb9bec54e04b0ab4201d6acf82c4df May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerGroupTestJSON-1952970066 May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cceb9bec54e04b0ab4201d6acf82c4df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cceb9bec54e04b0ab4201d6acf82c4df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cceb9bec54e04b0ab4201d6acf82c4df", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cceb9bec54e04b0ab4201d6acf82c4df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerGroupTestJSON-1952970066 May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: cceb9bec54e04b0ab4201d6acf82c4df May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerGroupTestJSON-1952970066 May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerGroupTestJSON-1952970066-project May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a9bb488c761c49c7911109b3c6be27c2 May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerGroupTestJSON-1952970066-project May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance group c5437ee8-226d-473e-b2ab-0e20b92e8296 could not be found. May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'c5437ee8-226d-473e-b2ab-0e20b92e8296'} May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c5437ee8-226d-473e-b2ab-0e20b92e8296 could not be found. May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c5437ee8-226d-473e-b2ab-0e20b92e8296 could not be found. May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.824977 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:39.829590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:39.829590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:39.829590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:25:39.829590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:25:39.829590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c5437ee8-226d-473e-b2ab-0e20b92e8296 could not be found. May 21 21:25:39.829590 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.829590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-23df8d59-a0d4-49f2-bf5b-d1fc26a7e5a9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Returning 404 to user: Instance group c5437ee8-226d-473e-b2ab-0e20b92e8296 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:25:39.829590 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-23df8d59-a0d4-49f2-bf5b-d1fc26a7e5a9 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/c5437ee8-226d-473e-b2ab-0e20b92e8296" status: 404 len: 117 microversion: 2.1 time: 0.013580 May 21 21:25:39.829590 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1912/3710] 10.222.0.49 () {58 vars in 1265 bytes} [Sat May 21 21:25:39 2022] DELETE /compute/v2.1/os-server-groups/c5437ee8-226d-473e-b2ab-0e20b92e8296 => generated 117 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:25:39.837802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b58afa24-d762-4be8-b032-dac99ab091c2 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:39.847222 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-b58afa24-d762-4be8-b032-dac99ab091c2 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] HTTP exception thrown: Instance group 6f0003e0-1510-415c-bdc6-cfcf12fbb281 could not be found. May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b58afa24-d762-4be8-b032-dac99ab091c2 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Request method failure captured: May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/os-server-groups/6f0003e0-1510-415c-bdc6-cfcf12fbb281 HTTP/1.1 May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVi4qzwyJGqDrU6CyO4zrxT9rCvc5RhfhBGJEWNYMsY7gzfVAO1A6MRkuSeftvzE1ojG7ZytTp2NrJxtNkpxmvwxpMq3OjGlAEXciXFgX9vBAcjS39kbOzZ2Sog0wBc_86KudZ4mGzbK7PpVWg28Oea7NP4Z0JOCVIzt-aLF4Ygxtd0 May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: cceb9bec54e04b0ab4201d6acf82c4df May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerGroupTestJSON-1952970066 May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cceb9bec54e04b0ab4201d6acf82c4df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cceb9bec54e04b0ab4201d6acf82c4df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cceb9bec54e04b0ab4201d6acf82c4df", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cceb9bec54e04b0ab4201d6acf82c4df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerGroupTestJSON-1952970066 May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: cceb9bec54e04b0ab4201d6acf82c4df May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerGroupTestJSON-1952970066 May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerGroupTestJSON-1952970066-project May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a9bb488c761c49c7911109b3c6be27c2 May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerGroupTestJSON-1952970066-project May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance group 6f0003e0-1510-415c-bdc6-cfcf12fbb281 could not be found. May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '6f0003e0-1510-415c-bdc6-cfcf12fbb281'} May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6f0003e0-1510-415c-bdc6-cfcf12fbb281 could not be found. May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6f0003e0-1510-415c-bdc6-cfcf12fbb281 could not be found. May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.848851 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:39.855498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:39.855498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:39.855498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:25:39.855498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:25:39.855498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6f0003e0-1510-415c-bdc6-cfcf12fbb281 could not be found. May 21 21:25:39.855498 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.855498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b58afa24-d762-4be8-b032-dac99ab091c2 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Returning 404 to user: Instance group 6f0003e0-1510-415c-bdc6-cfcf12fbb281 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:25:39.855498 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b58afa24-d762-4be8-b032-dac99ab091c2 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/6f0003e0-1510-415c-bdc6-cfcf12fbb281" status: 404 len: 117 microversion: 2.1 time: 0.018665 May 21 21:25:39.855498 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1913/3711] 10.222.0.49 () {58 vars in 1265 bytes} [Sat May 21 21:25:39 2022] DELETE /compute/v2.1/os-server-groups/6f0003e0-1510-415c-bdc6-cfcf12fbb281 => generated 117 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:25:39.862990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dfed6e56-b661-487d-8be6-ff6015c08a79 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:39.870237 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-dfed6e56-b661-487d-8be6-ff6015c08a79 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] HTTP exception thrown: Instance group 6cefe813-8fa6-4b10-828f-f37e362e56c3 could not be found. May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dfed6e56-b661-487d-8be6-ff6015c08a79 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Request method failure captured: May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/os-server-groups/6cefe813-8fa6-4b10-828f-f37e362e56c3 HTTP/1.1 May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVi4qzwyJGqDrU6CyO4zrxT9rCvc5RhfhBGJEWNYMsY7gzfVAO1A6MRkuSeftvzE1ojG7ZytTp2NrJxtNkpxmvwxpMq3OjGlAEXciXFgX9vBAcjS39kbOzZ2Sog0wBc_86KudZ4mGzbK7PpVWg28Oea7NP4Z0JOCVIzt-aLF4Ygxtd0 May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: cceb9bec54e04b0ab4201d6acf82c4df May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerGroupTestJSON-1952970066 May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cceb9bec54e04b0ab4201d6acf82c4df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cceb9bec54e04b0ab4201d6acf82c4df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cceb9bec54e04b0ab4201d6acf82c4df", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cceb9bec54e04b0ab4201d6acf82c4df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerGroupTestJSON-1952970066 May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: cceb9bec54e04b0ab4201d6acf82c4df May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerGroupTestJSON-1952970066 May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerGroupTestJSON-1952970066-project May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a9bb488c761c49c7911109b3c6be27c2 May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerGroupTestJSON-1952970066-project May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance group 6cefe813-8fa6-4b10-828f-f37e362e56c3 could not be found. May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '6cefe813-8fa6-4b10-828f-f37e362e56c3'} May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6cefe813-8fa6-4b10-828f-f37e362e56c3 could not be found. May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6cefe813-8fa6-4b10-828f-f37e362e56c3 could not be found. May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.872693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:39.878836 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:39.878836 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:39.878836 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:25:39.878836 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:25:39.878836 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6cefe813-8fa6-4b10-828f-f37e362e56c3 could not be found. May 21 21:25:39.878836 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.878836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dfed6e56-b661-487d-8be6-ff6015c08a79 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Returning 404 to user: Instance group 6cefe813-8fa6-4b10-828f-f37e362e56c3 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:25:39.878836 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dfed6e56-b661-487d-8be6-ff6015c08a79 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/6cefe813-8fa6-4b10-828f-f37e362e56c3" status: 404 len: 117 microversion: 2.1 time: 0.014949 May 21 21:25:39.878836 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1914/3712] 10.222.0.49 () {58 vars in 1265 bytes} [Sat May 21 21:25:39 2022] DELETE /compute/v2.1/os-server-groups/6cefe813-8fa6-4b10-828f-f37e362e56c3 => generated 117 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:25:39.885798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-91037f5d-9b0c-4aca-a0b7-8c51f03cd0a4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:39.893229 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-91037f5d-9b0c-4aca-a0b7-8c51f03cd0a4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] HTTP exception thrown: Instance group f4bf4105-5e45-49ce-b70f-ff37971c5839 could not be found. May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-91037f5d-9b0c-4aca-a0b7-8c51f03cd0a4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Request method failure captured: May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/os-server-groups/f4bf4105-5e45-49ce-b70f-ff37971c5839 HTTP/1.1 May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVi4qzwyJGqDrU6CyO4zrxT9rCvc5RhfhBGJEWNYMsY7gzfVAO1A6MRkuSeftvzE1ojG7ZytTp2NrJxtNkpxmvwxpMq3OjGlAEXciXFgX9vBAcjS39kbOzZ2Sog0wBc_86KudZ4mGzbK7PpVWg28Oea7NP4Z0JOCVIzt-aLF4Ygxtd0 May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: cceb9bec54e04b0ab4201d6acf82c4df May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerGroupTestJSON-1952970066 May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cceb9bec54e04b0ab4201d6acf82c4df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cceb9bec54e04b0ab4201d6acf82c4df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cceb9bec54e04b0ab4201d6acf82c4df", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cceb9bec54e04b0ab4201d6acf82c4df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerGroupTestJSON-1952970066 May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: cceb9bec54e04b0ab4201d6acf82c4df May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerGroupTestJSON-1952970066 May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerGroupTestJSON-1952970066-project May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a9bb488c761c49c7911109b3c6be27c2 May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerGroupTestJSON-1952970066-project May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance group f4bf4105-5e45-49ce-b70f-ff37971c5839 could not be found. May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'f4bf4105-5e45-49ce-b70f-ff37971c5839'} May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f4bf4105-5e45-49ce-b70f-ff37971c5839 could not be found. May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f4bf4105-5e45-49ce-b70f-ff37971c5839 could not be found. May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.895000 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:39.902186 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:39.902186 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:39.902186 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:25:39.902186 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:25:39.902186 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f4bf4105-5e45-49ce-b70f-ff37971c5839 could not be found. May 21 21:25:39.902186 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:39.902186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-91037f5d-9b0c-4aca-a0b7-8c51f03cd0a4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Returning 404 to user: Instance group f4bf4105-5e45-49ce-b70f-ff37971c5839 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:25:39.902186 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-91037f5d-9b0c-4aca-a0b7-8c51f03cd0a4 tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/f4bf4105-5e45-49ce-b70f-ff37971c5839" status: 404 len: 117 microversion: 2.1 time: 0.017133 May 21 21:25:39.902186 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1915/3713] 10.222.0.49 () {58 vars in 1265 bytes} [Sat May 21 21:25:39 2022] DELETE /compute/v2.1/os-server-groups/f4bf4105-5e45-49ce-b70f-ff37971c5839 => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:25:39.906967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5edc50c7-bc12-4d19-9d01-b732424cc6cd tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:40.035665 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5edc50c7-bc12-4d19-9d01-b732424cc6cd tempest-ServerGroupTestJSON-1952970066 tempest-ServerGroupTestJSON-1952970066-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/e3444781-eae6-4962-a000-7da74e8b2b31" status: 204 len: 0 microversion: 2.1 time: 0.133428 May 21 21:25:40.036598 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1916/3714] 10.222.0.49 () {58 vars in 1265 bytes} [Sat May 21 21:25:39 2022] DELETE /compute/v2.1/os-server-groups/e3444781-eae6-4962-a000-7da74e8b2b31 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:25:40.063948 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-11229a7d-5e41-4246-8662-1a7a5d7fd45f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:40.073780 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-11229a7d-5e41-4246-8662-1a7a5d7fd45f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.325981 May 21 21:25:40.075577 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1799/3715] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:39 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:40.090361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c24e4881-3356-4f27-972f-c762509d9bb1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:40.090978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c24e4881-3356-4f27-972f-c762509d9bb1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:40.098754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c24e4881-3356-4f27-972f-c762509d9bb1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:40.099475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c24e4881-3356-4f27-972f-c762509d9bb1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:40.100259 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c24e4881-3356-4f27-972f-c762509d9bb1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:40.100734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c24e4881-3356-4f27-972f-c762509d9bb1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:40.300081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-11a2bb56-91aa-4506-b553-3dbd4d24baa6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:40.301777 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-11a2bb56-91aa-4506-b553-3dbd4d24baa6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:40.313328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11a2bb56-91aa-4506-b553-3dbd4d24baa6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:40.314087 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11a2bb56-91aa-4506-b553-3dbd4d24baa6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:40.315662 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11a2bb56-91aa-4506-b553-3dbd4d24baa6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:40.316374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11a2bb56-91aa-4506-b553-3dbd4d24baa6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:40.379082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c24e4881-3356-4f27-972f-c762509d9bb1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:40.389298 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c24e4881-3356-4f27-972f-c762509d9bb1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.302828 May 21 21:25:40.392385 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1917/3716] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:40 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:40.410739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ec10eb13-b0a2-4f26-b8dd-f453790f1a7b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:40.411378 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ec10eb13-b0a2-4f26-b8dd-f453790f1a7b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:40.420061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ec10eb13-b0a2-4f26-b8dd-f453790f1a7b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:40.420564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ec10eb13-b0a2-4f26-b8dd-f453790f1a7b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:40.421356 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ec10eb13-b0a2-4f26-b8dd-f453790f1a7b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:40.421808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ec10eb13-b0a2-4f26-b8dd-f453790f1a7b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:40.616170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ec10eb13-b0a2-4f26-b8dd-f453790f1a7b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:40.624109 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ec10eb13-b0a2-4f26-b8dd-f453790f1a7b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.220407 May 21 21:25:40.625093 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1918/3717] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:40 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:40.642019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-097ef12d-756d-4f75-9a21-ea8e1582e8a6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:40.642704 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-097ef12d-756d-4f75-9a21-ea8e1582e8a6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:40.649182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-097ef12d-756d-4f75-9a21-ea8e1582e8a6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:40.649651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-097ef12d-756d-4f75-9a21-ea8e1582e8a6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:40.650439 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-097ef12d-756d-4f75-9a21-ea8e1582e8a6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:40.650883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-097ef12d-756d-4f75-9a21-ea8e1582e8a6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:40.812830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-11a2bb56-91aa-4506-b553-3dbd4d24baa6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:40.826602 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-11a2bb56-91aa-4506-b553-3dbd4d24baa6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1314 microversion: 2.1 time: 0.533483 May 21 21:25:40.827201 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1800/3718] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:40 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:40.911553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-097ef12d-756d-4f75-9a21-ea8e1582e8a6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Locking {{(pid=131277) lock /opt/stack/nova/nova/compute/api.py:4700}} May 21 21:25:41.146440 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-097ef12d-756d-4f75-9a21-ea8e1582e8a6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action" status: 202 len: 0 microversion: 2.1 time: 0.509504 May 21 21:25:41.150598 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1919/3719] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:25:40 2022] POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 21 21:25:41.156045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-61cddee1-7b3b-40e9-9c19-c9a1ae79d7d2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:41.156794 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-61cddee1-7b3b-40e9-9c19-c9a1ae79d7d2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:41.163500 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61cddee1-7b3b-40e9-9c19-c9a1ae79d7d2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:41.163700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61cddee1-7b3b-40e9-9c19-c9a1ae79d7d2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:41.164552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61cddee1-7b3b-40e9-9c19-c9a1ae79d7d2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:41.164994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61cddee1-7b3b-40e9-9c19-c9a1ae79d7d2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:41.474884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-61cddee1-7b3b-40e9-9c19-c9a1ae79d7d2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:41.483578 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-61cddee1-7b3b-40e9-9c19-c9a1ae79d7d2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.332260 May 21 21:25:41.484160 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1801/3720] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:41 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:41.505105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9b28e76d-a4ca-46c3-983d-5d77e6c986c2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:41.515616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b28e76d-a4ca-46c3-983d-5d77e6c986c2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:41.516263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b28e76d-a4ca-46c3-983d-5d77e6c986c2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:41.544078 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-9b28e76d-a4ca-46c3-983d-5d77e6c986c2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] HTTP exception thrown: Instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 is locked May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9b28e76d-a4ca-46c3-983d-5d77e6c986c2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Request method failure captured: May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action HTTP/1.1 May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 15 May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVgQv9k80egN_Z5oxm6zD7gV_sf1gMqqxBRx1iY9MeJj0DeNsoKLr8-8NIWiLDly20rLKVCAE8Xz0N5MgNbJYqnUGb2g2Kh6fJPvfPYKD1-lSj4wpNCcDbjlxj4-dXOUNAfghSaWJ8EAEG0fA3XOci0JYwtRE0jKJ3nFNlo1G7Keylg May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 014ae80b3f434bcb9fa2629ccdf4aad7 May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerActionsTestJSON-643676444 May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/014ae80b3f434bcb9fa2629ccdf4aad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/014ae80b3f434bcb9fa2629ccdf4aad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_014ae80b3f434bcb9fa2629ccdf4aad7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/014ae80b3f434bcb9fa2629ccdf4aad7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerActionsTestJSON-643676444 May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 014ae80b3f434bcb9fa2629ccdf4aad7 May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerActionsTestJSON-643676444 May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerActionsTestJSON-643676444-project May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 1cafab0cbef64be59c7afef84d7888ff May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerActionsTestJSON-643676444-project May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: {"os-stop": {}} May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 is locked May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '168c8024-2cb4-4135-be5d-7a5cfcc6e895', 'body': {'os-stop': {}}} May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 is locked May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 is locked May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 is locked May 21 21:25:41.545798 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:25:41.550800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9b28e76d-a4ca-46c3-983d-5d77e6c986c2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Returning 409 to user: Instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 is locked {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:25:41.550800 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9b28e76d-a4ca-46c3-983d-5d77e6c986c2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action" status: 409 len: 107 microversion: 2.1 time: 0.049735 May 21 21:25:41.550800 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1920/3721] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:25:41 2022] POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action => generated 107 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 21 21:25:41.557956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4f5cfb42-fd7b-483a-a92e-f4c90efe5ac4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:41.558507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4f5cfb42-fd7b-483a-a92e-f4c90efe5ac4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:41.560700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:41.573755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f5cfb42-fd7b-483a-a92e-f4c90efe5ac4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:41.573755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f5cfb42-fd7b-483a-a92e-f4c90efe5ac4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:41.573755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f5cfb42-fd7b-483a-a92e-f4c90efe5ac4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:41.573755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f5cfb42-fd7b-483a-a92e-f4c90efe5ac4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:41.842764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0ae7c9c2-967f-4a43-8749-33a125afcfb0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:41.843704 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0ae7c9c2-967f-4a43-8749-33a125afcfb0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:41.850517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ae7c9c2-967f-4a43-8749-33a125afcfb0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:41.852740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ae7c9c2-967f-4a43-8749-33a125afcfb0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:41.852740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ae7c9c2-967f-4a43-8749-33a125afcfb0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:41.852740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ae7c9c2-967f-4a43-8749-33a125afcfb0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:41.917854 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4f5cfb42-fd7b-483a-a92e-f4c90efe5ac4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Unlocking {{(pid=131278) unlock /opt/stack/nova/nova/compute/api.py:4729}} May 21 21:25:42.013924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0ae7c9c2-967f-4a43-8749-33a125afcfb0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:42.022010 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0ae7c9c2-967f-4a43-8749-33a125afcfb0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1314 microversion: 2.1 time: 0.183132 May 21 21:25:42.022869 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1921/3722] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:41 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:42.028227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-6c41237e-dbee-4a88-9a76-cec4d1c862eb req-a9f07b5e-2cc8-4e9d-94d2-514bf52bee67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59762e62-5267-4d7a-a18d-ebf1b0530184", "tag": "55a19002-8c35-4744-bcc4-6b7c33adcbd6"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:42.036731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6c41237e-dbee-4a88-9a76-cec4d1c862eb req-a9f07b5e-2cc8-4e9d-94d2-514bf52bee67 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:42.037272 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6c41237e-dbee-4a88-9a76-cec4d1c862eb req-a9f07b5e-2cc8-4e9d-94d2-514bf52bee67 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:42.048733 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-6c41237e-dbee-4a88-9a76-cec4d1c862eb req-a9f07b5e-2cc8-4e9d-94d2-514bf52bee67 service nova] Creating event network-changed:55a19002-8c35-4744-bcc4-6b7c33adcbd6 for instance 59762e62-5267-4d7a-a18d-ebf1b0530184 on nch1-master-1 May 21 21:25:42.053704 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-6c41237e-dbee-4a88-9a76-cec4d1c862eb req-a9f07b5e-2cc8-4e9d-94d2-514bf52bee67 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029680 May 21 21:25:42.054339 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1922/3723] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:42.220372 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4f5cfb42-fd7b-483a-a92e-f4c90efe5ac4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action" status: 202 len: 0 microversion: 2.1 time: 0.662122 May 21 21:25:42.220372 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1802/3724] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:25:41 2022] POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:25:42.226385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ffa95b69-f45b-43e0-a6de-37cdb200efe8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:42.235210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffa95b69-f45b-43e0-a6de-37cdb200efe8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:42.235776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffa95b69-f45b-43e0-a6de-37cdb200efe8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:42.262377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ffa95b69-f45b-43e0-a6de-37cdb200efe8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Going to try to stop instance {{(pid=131277) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 21 21:25:42.442610 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ffa95b69-f45b-43e0-a6de-37cdb200efe8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action" status: 202 len: 0 microversion: 2.1 time: 0.220241 May 21 21:25:42.446722 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1923/3725] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:25:42 2022] POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 21 21:25:42.454032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5edfd7a8-1da2-4af3-9df7-173940fd7aab tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:42.455063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5edfd7a8-1da2-4af3-9df7-173940fd7aab tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:42.463104 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5edfd7a8-1da2-4af3-9df7-173940fd7aab tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:42.464531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5edfd7a8-1da2-4af3-9df7-173940fd7aab tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:42.467600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5edfd7a8-1da2-4af3-9df7-173940fd7aab tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:42.468066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5edfd7a8-1da2-4af3-9df7-173940fd7aab tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:42.625405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5edfd7a8-1da2-4af3-9df7-173940fd7aab tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:42.633261 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5edfd7a8-1da2-4af3-9df7-173940fd7aab tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1678 microversion: 2.1 time: 0.184989 May 21 21:25:42.633858 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1803/3726] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:42 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:43.040868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a95115b9-869e-4fe8-b3a4-024e39497842 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:43.041574 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a95115b9-869e-4fe8-b3a4-024e39497842 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:43.048659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a95115b9-869e-4fe8-b3a4-024e39497842 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:43.049322 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a95115b9-869e-4fe8-b3a4-024e39497842 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:43.050279 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a95115b9-869e-4fe8-b3a4-024e39497842 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:43.050714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a95115b9-869e-4fe8-b3a4-024e39497842 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:43.057424 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:43.223381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a95115b9-869e-4fe8-b3a4-024e39497842 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:43.237684 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a95115b9-869e-4fe8-b3a4-024e39497842 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1314 microversion: 2.1 time: 0.195747 May 21 21:25:43.237684 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1924/3727] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:43 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:43.651709 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dc92d382-fcab-451b-b637-530817b27fe6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:43.652601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dc92d382-fcab-451b-b637-530817b27fe6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:43.670710 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc92d382-fcab-451b-b637-530817b27fe6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:43.671450 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc92d382-fcab-451b-b637-530817b27fe6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:43.672622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc92d382-fcab-451b-b637-530817b27fe6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:43.673232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc92d382-fcab-451b-b637-530817b27fe6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:43.951948 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dc92d382-fcab-451b-b637-530817b27fe6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:43.965448 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dc92d382-fcab-451b-b637-530817b27fe6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1678 microversion: 2.1 time: 0.314965 May 21 21:25:43.966085 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1804/3728] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:43 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1678 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:44.248656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-418736bb-cdaa-410e-a859-de7d7dc2edc1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:44.249283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-418736bb-cdaa-410e-a859-de7d7dc2edc1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:44.260028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-418736bb-cdaa-410e-a859-de7d7dc2edc1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:44.260028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-418736bb-cdaa-410e-a859-de7d7dc2edc1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:44.260028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-418736bb-cdaa-410e-a859-de7d7dc2edc1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:44.260028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-418736bb-cdaa-410e-a859-de7d7dc2edc1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:44.482558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-418736bb-cdaa-410e-a859-de7d7dc2edc1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:44.498398 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-418736bb-cdaa-410e-a859-de7d7dc2edc1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1314 microversion: 2.1 time: 0.254251 May 21 21:25:44.500123 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1925/3729] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:44 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:44.983422 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f900f3c6-83db-4229-afa5-7d0c55c653de tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:44.984053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f900f3c6-83db-4229-afa5-7d0c55c653de tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:44.992802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f900f3c6-83db-4229-afa5-7d0c55c653de tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:44.993769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f900f3c6-83db-4229-afa5-7d0c55c653de tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:44.994432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f900f3c6-83db-4229-afa5-7d0c55c653de tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:44.994880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f900f3c6-83db-4229-afa5-7d0c55c653de tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:45.161597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f900f3c6-83db-4229-afa5-7d0c55c653de tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:45.174480 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f900f3c6-83db-4229-afa5-7d0c55c653de tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1678 microversion: 2.1 time: 0.194716 May 21 21:25:45.175023 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1805/3730] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:44 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1678 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:45.517429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c0d301e4-fef9-4f73-85e2-fd1d496e9c96 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:45.517974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c0d301e4-fef9-4f73-85e2-fd1d496e9c96 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:45.521693 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:45.529699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c0d301e4-fef9-4f73-85e2-fd1d496e9c96 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:45.535636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c0d301e4-fef9-4f73-85e2-fd1d496e9c96 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:45.535636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c0d301e4-fef9-4f73-85e2-fd1d496e9c96 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:45.535636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c0d301e4-fef9-4f73-85e2-fd1d496e9c96 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:45.721157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c0d301e4-fef9-4f73-85e2-fd1d496e9c96 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:45.731475 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c0d301e4-fef9-4f73-85e2-fd1d496e9c96 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1314 microversion: 2.1 time: 0.217123 May 21 21:25:45.741732 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1926/3731] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:45 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:46.192859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b2da85b6-2749-4f39-86e6-d8dd7e649f78 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:46.194104 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b2da85b6-2749-4f39-86e6-d8dd7e649f78 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:46.205149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2da85b6-2749-4f39-86e6-d8dd7e649f78 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:46.205781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2da85b6-2749-4f39-86e6-d8dd7e649f78 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:46.206625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2da85b6-2749-4f39-86e6-d8dd7e649f78 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:46.207271 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2da85b6-2749-4f39-86e6-d8dd7e649f78 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:46.280487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-989b9944-d4b2-45f7-9c10-2d230bcfe7cf req-847ad9f1-4b3d-4dd7-995d-47f9f983281f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59762e62-5267-4d7a-a18d-ebf1b0530184", "name": "network-vif-plugged", "status": "completed", "tag": "55a19002-8c35-4744-bcc4-6b7c33adcbd6"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:46.299710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-989b9944-d4b2-45f7-9c10-2d230bcfe7cf req-847ad9f1-4b3d-4dd7-995d-47f9f983281f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:46.301420 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-989b9944-d4b2-45f7-9c10-2d230bcfe7cf req-847ad9f1-4b3d-4dd7-995d-47f9f983281f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:46.318880 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-989b9944-d4b2-45f7-9c10-2d230bcfe7cf req-847ad9f1-4b3d-4dd7-995d-47f9f983281f service nova] Creating event network-vif-plugged:55a19002-8c35-4744-bcc4-6b7c33adcbd6 for instance 59762e62-5267-4d7a-a18d-ebf1b0530184 on nch1-master-1 May 21 21:25:46.326346 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-989b9944-d4b2-45f7-9c10-2d230bcfe7cf req-847ad9f1-4b3d-4dd7-995d-47f9f983281f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053832 May 21 21:25:46.326998 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1927/3732] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:25:46.395315 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b2da85b6-2749-4f39-86e6-d8dd7e649f78 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:46.405796 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b2da85b6-2749-4f39-86e6-d8dd7e649f78 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1678 microversion: 2.1 time: 0.218005 May 21 21:25:46.416178 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1806/3733] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:46 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:46.749817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a8eb43c4-40d8-4f09-a298-9520e7f53f07 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:46.750574 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a8eb43c4-40d8-4f09-a298-9520e7f53f07 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:46.757292 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8eb43c4-40d8-4f09-a298-9520e7f53f07 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:46.757760 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8eb43c4-40d8-4f09-a298-9520e7f53f07 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:46.758589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8eb43c4-40d8-4f09-a298-9520e7f53f07 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:46.759039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8eb43c4-40d8-4f09-a298-9520e7f53f07 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:46.905846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=10 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:47.087458 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a8eb43c4-40d8-4f09-a298-9520e7f53f07 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:47.095756 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a8eb43c4-40d8-4f09-a298-9520e7f53f07 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1314 microversion: 2.1 time: 0.351346 May 21 21:25:47.096499 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1928/3734] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:46 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:47.423909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d5915984-6566-4e4a-865f-d16265b0a337 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:47.431015 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d5915984-6566-4e4a-865f-d16265b0a337 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:47.437267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5915984-6566-4e4a-865f-d16265b0a337 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:47.438099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5915984-6566-4e4a-865f-d16265b0a337 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:47.439270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5915984-6566-4e4a-865f-d16265b0a337 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:47.441219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5915984-6566-4e4a-865f-d16265b0a337 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:47.626991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d5915984-6566-4e4a-865f-d16265b0a337 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:47.634048 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d5915984-6566-4e4a-865f-d16265b0a337 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1678 microversion: 2.1 time: 0.214065 May 21 21:25:47.634693 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1807/3735] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:47 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1678 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:48.118064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-720b8c4c-6f91-4e99-9f56-75f5dcf2297e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:48.118712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-720b8c4c-6f91-4e99-9f56-75f5dcf2297e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:48.127817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-720b8c4c-6f91-4e99-9f56-75f5dcf2297e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:48.128134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-720b8c4c-6f91-4e99-9f56-75f5dcf2297e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:48.132470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-720b8c4c-6f91-4e99-9f56-75f5dcf2297e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:48.132470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-720b8c4c-6f91-4e99-9f56-75f5dcf2297e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:48.296993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-720b8c4c-6f91-4e99-9f56-75f5dcf2297e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:48.307911 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-720b8c4c-6f91-4e99-9f56-75f5dcf2297e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1500 microversion: 2.1 time: 0.198814 May 21 21:25:48.309595 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1929/3736] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:48 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1500 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:48.328017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a0b1cb4f-a116-443e-a832-72eb561fa622 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:48.329043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a0b1cb4f-a116-443e-a832-72eb561fa622 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:48.335666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a0b1cb4f-a116-443e-a832-72eb561fa622 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:48.339626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a0b1cb4f-a116-443e-a832-72eb561fa622 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:48.339626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a0b1cb4f-a116-443e-a832-72eb561fa622 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:48.339626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a0b1cb4f-a116-443e-a832-72eb561fa622 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:48.366514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-a0b1cb4f-a116-443e-a832-72eb561fa622 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lazy-loading 'flavor' on Instance uuid 59762e62-5267-4d7a-a18d-ebf1b0530184 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:25:48.587924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:48.651904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-801618ad-6c2d-4953-8c6c-597f7703ca03 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:48.655215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-801618ad-6c2d-4953-8c6c-597f7703ca03 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:48.666265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-801618ad-6c2d-4953-8c6c-597f7703ca03 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:48.666900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-801618ad-6c2d-4953-8c6c-597f7703ca03 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:48.676722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-801618ad-6c2d-4953-8c6c-597f7703ca03 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:48.678033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-801618ad-6c2d-4953-8c6c-597f7703ca03 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:48.696173 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a0b1cb4f-a116-443e-a832-72eb561fa622 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "POST /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184/action" status: 200 len: 32 microversion: 2.1 time: 0.373318 May 21 21:25:48.698428 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1808/3737] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:25:48 2022] POST /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184/action => generated 32 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:25:48.726984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1bffb8ea-621b-41e5-8b2f-00ceaec819ac tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:48.727775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1bffb8ea-621b-41e5-8b2f-00ceaec819ac tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:48.736718 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1bffb8ea-621b-41e5-8b2f-00ceaec819ac tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:48.737407 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1bffb8ea-621b-41e5-8b2f-00ceaec819ac tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:48.740848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1bffb8ea-621b-41e5-8b2f-00ceaec819ac tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:48.740848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1bffb8ea-621b-41e5-8b2f-00ceaec819ac tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:48.779768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1bffb8ea-621b-41e5-8b2f-00ceaec819ac tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:25:48.877243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-801618ad-6c2d-4953-8c6c-597f7703ca03 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:48.886860 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-801618ad-6c2d-4953-8c6c-597f7703ca03 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1678 microversion: 2.1 time: 0.239047 May 21 21:25:48.887483 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1930/3738] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:48 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:48.901975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ca9844eb-d806-4ea3-b605-73c7e8aad73b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:48.903209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ca9844eb-d806-4ea3-b605-73c7e8aad73b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:48.909725 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca9844eb-d806-4ea3-b605-73c7e8aad73b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:48.910183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca9844eb-d806-4ea3-b605-73c7e8aad73b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:48.911064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca9844eb-d806-4ea3-b605-73c7e8aad73b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:48.911464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca9844eb-d806-4ea3-b605-73c7e8aad73b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:49.112725 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ca9844eb-d806-4ea3-b605-73c7e8aad73b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:49.123523 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ca9844eb-d806-4ea3-b605-73c7e8aad73b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.225176 May 21 21:25:49.124373 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1931/3739] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:48 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:49.220756 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1bffb8ea-621b-41e5-8b2f-00ceaec819ac tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e" status: 204 len: 0 microversion: 2.1 time: 0.516406 May 21 21:25:49.221362 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1809/3740] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:25:48 2022] DELETE /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:25:49.231201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-62cafce3-9be3-4d1e-a1c9-9ccddb89262a tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:49.232146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-62cafce3-9be3-4d1e-a1c9-9ccddb89262a tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:49.238685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62cafce3-9be3-4d1e-a1c9-9ccddb89262a tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:49.239305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62cafce3-9be3-4d1e-a1c9-9ccddb89262a tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:49.240189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62cafce3-9be3-4d1e-a1c9-9ccddb89262a tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:49.240675 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62cafce3-9be3-4d1e-a1c9-9ccddb89262a tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:49.251741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-745bf1c4-99fb-4558-8475-3387bd47f4f3 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-319094909", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "bdcd4ca8-dc85-47de-8372-23d8824beb75"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:49.317793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-745bf1c4-99fb-4558-8475-3387bd47f4f3 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] validate_networks() for [('bdcd4ca8-dc85-47de-8372-23d8824beb75', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:25:49.515065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-62cafce3-9be3-4d1e-a1c9-9ccddb89262a tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec7dadaea104c4498cd8bf98ceea738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960f5f98c8d64ac384c86350b29ee9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:49.523640 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-62cafce3-9be3-4d1e-a1c9-9ccddb89262a tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e" status: 200 len: 1514 microversion: 2.1 time: 0.297690 May 21 21:25:49.524884 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1810/3741] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:49 2022] GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e => generated 1514 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:49.782193 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-745bf1c4-99fb-4558-8475-3387bd47f4f3 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:25:49.782707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-745bf1c4-99fb-4558-8475-3387bd47f4f3 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:25:49.783402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-745bf1c4-99fb-4558-8475-3387bd47f4f3 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:25:49.783849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-745bf1c4-99fb-4558-8475-3387bd47f4f3 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:25:49.784466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-745bf1c4-99fb-4558-8475-3387bd47f4f3 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:25:49.794346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-745bf1c4-99fb-4558-8475-3387bd47f4f3 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:49.794800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-745bf1c4-99fb-4558-8475-3387bd47f4f3 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:49.795616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-745bf1c4-99fb-4558-8475-3387bd47f4f3 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:49.796057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-745bf1c4-99fb-4558-8475-3387bd47f4f3 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:49.821783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-745bf1c4-99fb-4558-8475-3387bd47f4f3 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Getting quotas for project e93a615f09094a15a92e2a4076887db0. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:25:49.827309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-745bf1c4-99fb-4558-8475-3387bd47f4f3 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Getting quotas for user ce68832a0abe4e44ba8750073b682fdc and project e93a615f09094a15a92e2a4076887db0. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:25:49.841997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-745bf1c4-99fb-4558-8475-3387bd47f4f3 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:25:49.844365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-745bf1c4-99fb-4558-8475-3387bd47f4f3 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:25:49.905051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-86bd6375-fa25-47ef-8b2e-4770c1d79290 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:49.905682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-86bd6375-fa25-47ef-8b2e-4770c1d79290 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:49.914509 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86bd6375-fa25-47ef-8b2e-4770c1d79290 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:49.914975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86bd6375-fa25-47ef-8b2e-4770c1d79290 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:49.915770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86bd6375-fa25-47ef-8b2e-4770c1d79290 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:49.916411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86bd6375-fa25-47ef-8b2e-4770c1d79290 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:50.065440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-86bd6375-fa25-47ef-8b2e-4770c1d79290 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:50.073592 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-86bd6375-fa25-47ef-8b2e-4770c1d79290 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1678 microversion: 2.1 time: 0.173263 May 21 21:25:50.083793 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1811/3742] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:49 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:50.084270 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-745bf1c4-99fb-4558-8475-3387bd47f4f3 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.954590 May 21 21:25:50.085053 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1932/3743] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:25:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:25:50.112515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-46a8a3b0-4495-4afc-863d-d20e27d47259 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:50.113407 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-46a8a3b0-4495-4afc-863d-d20e27d47259 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:50.142158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-842bf136-4673-4680-9441-5147d43666c0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:50.143324 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-842bf136-4673-4680-9441-5147d43666c0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:50.155253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-842bf136-4673-4680-9441-5147d43666c0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:50.155970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-842bf136-4673-4680-9441-5147d43666c0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:50.156861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-842bf136-4673-4680-9441-5147d43666c0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:50.157344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-842bf136-4673-4680-9441-5147d43666c0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:50.202505 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-46a8a3b0-4495-4afc-863d-d20e27d47259 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68832a0abe4e44ba8750073b682fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93a615f09094a15a92e2a4076887db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:50.210506 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-46a8a3b0-4495-4afc-863d-d20e27d47259 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 200 len: 1227 microversion: 2.1 time: 0.108132 May 21 21:25:50.211105 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1812/3744] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:50 2022] GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 1227 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:50.320878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-842bf136-4673-4680-9441-5147d43666c0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:50.329365 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-842bf136-4673-4680-9441-5147d43666c0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.192842 May 21 21:25:50.330402 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1933/3745] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:50 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:50.541931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6ee5d262-fe23-4449-8c5d-1e7a21aca022 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:50.542565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6ee5d262-fe23-4449-8c5d-1e7a21aca022 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:50.553374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6ee5d262-fe23-4449-8c5d-1e7a21aca022 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:50.553834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6ee5d262-fe23-4449-8c5d-1e7a21aca022 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:50.554619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6ee5d262-fe23-4449-8c5d-1e7a21aca022 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:50.555130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6ee5d262-fe23-4449-8c5d-1e7a21aca022 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:50.713027 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6ee5d262-fe23-4449-8c5d-1e7a21aca022 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec7dadaea104c4498cd8bf98ceea738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960f5f98c8d64ac384c86350b29ee9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:50.724154 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6ee5d262-fe23-4449-8c5d-1e7a21aca022 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e" status: 200 len: 1514 microversion: 2.1 time: 0.185972 May 21 21:25:50.724849 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1813/3746] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:50 2022] GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:51.095439 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a34dd386-c7da-4347-a2b3-2b27c71aee8b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:51.096736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a34dd386-c7da-4347-a2b3-2b27c71aee8b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:51.106283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a34dd386-c7da-4347-a2b3-2b27c71aee8b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:51.106951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a34dd386-c7da-4347-a2b3-2b27c71aee8b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:51.108067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a34dd386-c7da-4347-a2b3-2b27c71aee8b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:51.108704 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a34dd386-c7da-4347-a2b3-2b27c71aee8b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:51.231353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d16e7bbe-32ab-46c1-ba55-4dac658eb195 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:51.233546 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d16e7bbe-32ab-46c1-ba55-4dac658eb195 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:51.307258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a34dd386-c7da-4347-a2b3-2b27c71aee8b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:51.313578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d16e7bbe-32ab-46c1-ba55-4dac658eb195 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68832a0abe4e44ba8750073b682fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93a615f09094a15a92e2a4076887db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:51.316036 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a34dd386-c7da-4347-a2b3-2b27c71aee8b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1678 microversion: 2.1 time: 0.228848 May 21 21:25:51.317346 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1934/3747] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:51 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1678 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:51.328233 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d16e7bbe-32ab-46c1-ba55-4dac658eb195 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 200 len: 1227 microversion: 2.1 time: 0.103676 May 21 21:25:51.328881 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1814/3748] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:51 2022] GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 1227 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:51.347200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3d07ac8f-096c-41c9-86bd-a40444b0c599 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:51.347817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3d07ac8f-096c-41c9-86bd-a40444b0c599 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:51.354290 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d07ac8f-096c-41c9-86bd-a40444b0c599 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:51.354769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d07ac8f-096c-41c9-86bd-a40444b0c599 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:51.356063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d07ac8f-096c-41c9-86bd-a40444b0c599 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:51.356593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d07ac8f-096c-41c9-86bd-a40444b0c599 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:51.563244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3d07ac8f-096c-41c9-86bd-a40444b0c599 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:51.572364 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3d07ac8f-096c-41c9-86bd-a40444b0c599 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.229051 May 21 21:25:51.572940 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1935/3749] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:51 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:51.772631 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2e279f5a-c7c9-444b-9694-bbf2a33811d1 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:51.781007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2e279f5a-c7c9-444b-9694-bbf2a33811d1 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:51.797537 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2e279f5a-c7c9-444b-9694-bbf2a33811d1 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:51.799151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2e279f5a-c7c9-444b-9694-bbf2a33811d1 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:51.803824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-bd12f85d-8ad0-4eaa-96b3-6b0ed92241f6 req-a3bea815-8b3a-4345-8007-d500c57c6ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c113a19-4007-4621-b04f-ae6c9f36e09e", "name": "network-vif-deleted", "tag": "949baf9a-fc71-48fc-962b-9011db8747a9"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:51.809481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2e279f5a-c7c9-444b-9694-bbf2a33811d1 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:51.810453 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2e279f5a-c7c9-444b-9694-bbf2a33811d1 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:51.832677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-bd12f85d-8ad0-4eaa-96b3-6b0ed92241f6 req-a3bea815-8b3a-4345-8007-d500c57c6ca1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:51.837064 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-bd12f85d-8ad0-4eaa-96b3-6b0ed92241f6 req-a3bea815-8b3a-4345-8007-d500c57c6ca1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:51.849615 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-bd12f85d-8ad0-4eaa-96b3-6b0ed92241f6 req-a3bea815-8b3a-4345-8007-d500c57c6ca1 service nova] Creating event network-vif-deleted:949baf9a-fc71-48fc-962b-9011db8747a9 for instance 5c113a19-4007-4621-b04f-ae6c9f36e09e on nch2-master-1 May 21 21:25:51.855167 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-bd12f85d-8ad0-4eaa-96b3-6b0ed92241f6 req-a3bea815-8b3a-4345-8007-d500c57c6ca1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.370959 May 21 21:25:51.856985 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1815/3750] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:25:51.906040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2e279f5a-c7c9-444b-9694-bbf2a33811d1 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ec7dadaea104c4498cd8bf98ceea738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960f5f98c8d64ac384c86350b29ee9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:51.930369 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2e279f5a-c7c9-444b-9694-bbf2a33811d1 tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e" status: 200 len: 1303 microversion: 2.1 time: 0.189433 May 21 21:25:51.939845 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1936/3751] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:51 2022] GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e => generated 1303 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:52.334409 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-abc3199c-0735-40d3-8049-caede1e3ce75 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:52.335246 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-abc3199c-0735-40d3-8049-caede1e3ce75 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:52.342689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-abc3199c-0735-40d3-8049-caede1e3ce75 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:52.343148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-abc3199c-0735-40d3-8049-caede1e3ce75 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:52.348530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1611492e-5026-4e89-bceb-adadaecfe083 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:52.351596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1611492e-5026-4e89-bceb-adadaecfe083 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:52.352320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-abc3199c-0735-40d3-8049-caede1e3ce75 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:52.352794 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-abc3199c-0735-40d3-8049-caede1e3ce75 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:52.360313 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1611492e-5026-4e89-bceb-adadaecfe083 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:52.361794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1611492e-5026-4e89-bceb-adadaecfe083 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:52.362347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1611492e-5026-4e89-bceb-adadaecfe083 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:52.363005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1611492e-5026-4e89-bceb-adadaecfe083 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:52.478511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1611492e-5026-4e89-bceb-adadaecfe083 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68832a0abe4e44ba8750073b682fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93a615f09094a15a92e2a4076887db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:52.489487 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1611492e-5026-4e89-bceb-adadaecfe083 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 200 len: 1279 microversion: 2.1 time: 0.148136 May 21 21:25:52.490786 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1937/3752] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:52 2022] GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 1279 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:52.562829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-abc3199c-0735-40d3-8049-caede1e3ce75 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:52.575065 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-abc3199c-0735-40d3-8049-caede1e3ce75 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1678 microversion: 2.1 time: 0.245260 May 21 21:25:52.577060 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1816/3753] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:52 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1678 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:52.592547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c3889338-03a5-4101-9807-b9cf5d9f66fa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:52.593370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c3889338-03a5-4101-9807-b9cf5d9f66fa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:52.601879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c3889338-03a5-4101-9807-b9cf5d9f66fa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:52.602508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c3889338-03a5-4101-9807-b9cf5d9f66fa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:52.610094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c3889338-03a5-4101-9807-b9cf5d9f66fa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:52.610094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c3889338-03a5-4101-9807-b9cf5d9f66fa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:52.862591 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c3889338-03a5-4101-9807-b9cf5d9f66fa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:52.873038 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c3889338-03a5-4101-9807-b9cf5d9f66fa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.285414 May 21 21:25:52.874076 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1938/3754] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:52 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:52.949016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d6367b82-3320-478e-90c4-f56486498def tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:52.950139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d6367b82-3320-478e-90c4-f56486498def tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] [instance: 5c113a19-4007-4621-b04f-ae6c9f36e09e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:52.960653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d6367b82-3320-478e-90c4-f56486498def tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:52.961506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d6367b82-3320-478e-90c4-f56486498def tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:52.962488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d6367b82-3320-478e-90c4-f56486498def tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:52.963085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d6367b82-3320-478e-90c4-f56486498def tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:52.981349 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-d6367b82-3320-478e-90c4-f56486498def tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] HTTP exception thrown: Instance 5c113a19-4007-4621-b04f-ae6c9f36e09e could not be found. May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d6367b82-3320-478e-90c4-f56486498def tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Request method failure captured: May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e HTTP/1.1 May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVidoYpYRPdLuVO7ANUNtoocK50M7XiptB8BUmfRr3Zdf5wNswOEBbYZf-VuaUk3BJvM0pVtDAgHeyKm3cnWE_8aVn9szrDJ-ya9HxurboVTspUNWFs50sdTaARmWxhCOnerMXhGMt7PZhLISbEJSG1dcsbLcflgyUDmyttSMyuAB98 May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 960f5f98c8d64ac384c86350b29ee9ae May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-VolumesAdminNegativeTest-1430965486 May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/960f5f98c8d64ac384c86350b29ee9ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/960f5f98c8d64ac384c86350b29ee9ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_960f5f98c8d64ac384c86350b29ee9ae", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/960f5f98c8d64ac384c86350b29ee9ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-VolumesAdminNegativeTest-1430965486 May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 960f5f98c8d64ac384c86350b29ee9ae May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1430965486 May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-VolumesAdminNegativeTest-1430965486-project May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1ec7dadaea104c4498cd8bf98ceea738 May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-VolumesAdminNegativeTest-1430965486-project May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 5c113a19-4007-4621-b04f-ae6c9f36e09e could not be found. May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '5c113a19-4007-4621-b04f-ae6c9f36e09e'} May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c113a19-4007-4621-b04f-ae6c9f36e09e could not be found. May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c113a19-4007-4621-b04f-ae6c9f36e09e could not be found. May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:25:52.983447 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:52.989225 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:25:52.989225 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:25:52.989225 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:25:52.989225 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:25:52.989225 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:25:52.989225 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c113a19-4007-4621-b04f-ae6c9f36e09e could not be found. May 21 21:25:52.989225 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:25:52.998007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d6367b82-3320-478e-90c4-f56486498def tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] Returning 404 to user: Instance 5c113a19-4007-4621-b04f-ae6c9f36e09e could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:25:52.998007 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d6367b82-3320-478e-90c4-f56486498def tempest-VolumesAdminNegativeTest-1430965486 tempest-VolumesAdminNegativeTest-1430965486-project] 10.222.0.49 "GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e" status: 404 len: 111 microversion: 2.1 time: 0.051368 May 21 21:25:52.998007 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1817/3755] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:52 2022] GET /compute/v2.1/servers/5c113a19-4007-4621-b04f-ae6c9f36e09e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:25:53.508440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e3e9b194-d15f-45bb-9c8b-0c52c7b55d62 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:53.509073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e3e9b194-d15f-45bb-9c8b-0c52c7b55d62 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:53.523618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3e9b194-d15f-45bb-9c8b-0c52c7b55d62 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:53.524081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3e9b194-d15f-45bb-9c8b-0c52c7b55d62 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:53.529568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3e9b194-d15f-45bb-9c8b-0c52c7b55d62 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:53.530136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3e9b194-d15f-45bb-9c8b-0c52c7b55d62 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:53.594027 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-150cd8a6-8338-44e4-af4e-ce220c9a0461 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:53.594655 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-150cd8a6-8338-44e4-af4e-ce220c9a0461 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:53.608253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-150cd8a6-8338-44e4-af4e-ce220c9a0461 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:53.608878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-150cd8a6-8338-44e4-af4e-ce220c9a0461 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:53.612039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-150cd8a6-8338-44e4-af4e-ce220c9a0461 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:53.614036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-150cd8a6-8338-44e4-af4e-ce220c9a0461 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:53.707127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e3e9b194-d15f-45bb-9c8b-0c52c7b55d62 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68832a0abe4e44ba8750073b682fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93a615f09094a15a92e2a4076887db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:53.716621 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e3e9b194-d15f-45bb-9c8b-0c52c7b55d62 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 200 len: 1285 microversion: 2.1 time: 0.212146 May 21 21:25:53.727605 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1939/3756] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:53 2022] GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 1285 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:53.889987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f448b70e-f265-49d6-b304-6fd27d3745a3 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:53.890606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f448b70e-f265-49d6-b304-6fd27d3745a3 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:53.897107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f448b70e-f265-49d6-b304-6fd27d3745a3 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:53.897782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f448b70e-f265-49d6-b304-6fd27d3745a3 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:53.898737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f448b70e-f265-49d6-b304-6fd27d3745a3 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:53.899339 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f448b70e-f265-49d6-b304-6fd27d3745a3 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:54.506546 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-150cd8a6-8338-44e4-af4e-ce220c9a0461 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:54.513005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f448b70e-f265-49d6-b304-6fd27d3745a3 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:54.517980 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-150cd8a6-8338-44e4-af4e-ce220c9a0461 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1678 microversion: 2.1 time: 0.927953 May 21 21:25:54.529774 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f448b70e-f265-49d6-b304-6fd27d3745a3 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.644058 May 21 21:25:54.531620 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1940/3757] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:53 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:54.533738 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1818/3758] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:53 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1678 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:25:54.737710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9394a4a0-06dc-485d-9e23-d65b378c9283 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:54.739214 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9394a4a0-06dc-485d-9e23-d65b378c9283 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:54.750481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9394a4a0-06dc-485d-9e23-d65b378c9283 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:54.752149 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9394a4a0-06dc-485d-9e23-d65b378c9283 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:54.755095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9394a4a0-06dc-485d-9e23-d65b378c9283 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:54.757803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9394a4a0-06dc-485d-9e23-d65b378c9283 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:54.854118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9394a4a0-06dc-485d-9e23-d65b378c9283 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68832a0abe4e44ba8750073b682fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93a615f09094a15a92e2a4076887db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:54.863169 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9394a4a0-06dc-485d-9e23-d65b378c9283 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 200 len: 1285 microversion: 2.1 time: 0.133423 May 21 21:25:54.863992 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1941/3759] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:54 2022] GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 1285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:55.537367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f42ab645-249c-45e2-96ba-741213b882ce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:55.538045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f42ab645-249c-45e2-96ba-741213b882ce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:55.548167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f42ab645-249c-45e2-96ba-741213b882ce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:55.548676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f42ab645-249c-45e2-96ba-741213b882ce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:55.549498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f42ab645-249c-45e2-96ba-741213b882ce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:55.550117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f42ab645-249c-45e2-96ba-741213b882ce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:55.556146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-af3843c8-75aa-4ae1-936a-d6cde3ddac13 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:55.556146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-af3843c8-75aa-4ae1-936a-d6cde3ddac13 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:55.561630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af3843c8-75aa-4ae1-936a-d6cde3ddac13 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:55.562365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af3843c8-75aa-4ae1-936a-d6cde3ddac13 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:55.563692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af3843c8-75aa-4ae1-936a-d6cde3ddac13 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:55.564315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af3843c8-75aa-4ae1-936a-d6cde3ddac13 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:55.593826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:55.894815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-af3843c8-75aa-4ae1-936a-d6cde3ddac13 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:55.905253 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-af3843c8-75aa-4ae1-936a-d6cde3ddac13 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.356132 May 21 21:25:55.914885 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1942/3760] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:55 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:55.919719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2948baa8-da28-425b-b46d-b42b411b18d0 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:55.920881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2948baa8-da28-425b-b46d-b42b411b18d0 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:55.927762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2948baa8-da28-425b-b46d-b42b411b18d0 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:55.928347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2948baa8-da28-425b-b46d-b42b411b18d0 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:55.929210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2948baa8-da28-425b-b46d-b42b411b18d0 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:55.929740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2948baa8-da28-425b-b46d-b42b411b18d0 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:56.068991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f42ab645-249c-45e2-96ba-741213b882ce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:56.083230 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f42ab645-249c-45e2-96ba-741213b882ce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1655 microversion: 2.1 time: 0.549734 May 21 21:25:56.084830 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1819/3761] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:55 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1655 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:56.106960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dc935143-3ba6-40e7-a057-9a34c97f1ed7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:56.113816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc935143-3ba6-40e7-a057-9a34c97f1ed7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:56.114275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc935143-3ba6-40e7-a057-9a34c97f1ed7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:56.141782 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dc935143-3ba6-40e7-a057-9a34c97f1ed7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Going to try to start instance {{(pid=131278) start /opt/stack/nova/nova/compute/api.py:2730}} May 21 21:25:56.220100 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2948baa8-da28-425b-b46d-b42b411b18d0 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68832a0abe4e44ba8750073b682fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93a615f09094a15a92e2a4076887db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:56.234947 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2948baa8-da28-425b-b46d-b42b411b18d0 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 200 len: 1327 microversion: 2.1 time: 0.323232 May 21 21:25:56.235688 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1943/3762] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:55 2022] GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 1327 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:56.442161 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dc935143-3ba6-40e7-a057-9a34c97f1ed7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action" status: 202 len: 0 microversion: 2.1 time: 0.340382 May 21 21:25:56.443034 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1820/3763] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:25:56 2022] POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:25:56.454601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-306726f0-23c2-43e3-a9c5-b16ff4c11b66 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:56.456141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-306726f0-23c2-43e3-a9c5-b16ff4c11b66 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:56.466350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-306726f0-23c2-43e3-a9c5-b16ff4c11b66 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:56.467154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-306726f0-23c2-43e3-a9c5-b16ff4c11b66 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:56.468612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-306726f0-23c2-43e3-a9c5-b16ff4c11b66 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:56.469742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-306726f0-23c2-43e3-a9c5-b16ff4c11b66 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:56.905310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-306726f0-23c2-43e3-a9c5-b16ff4c11b66 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:56.915122 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-306726f0-23c2-43e3-a9c5-b16ff4c11b66 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1664 microversion: 2.1 time: 0.467325 May 21 21:25:56.915635 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1944/3764] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:56 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1664 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:56.933437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9dc6cf8f-224e-4822-9df5-6634bd0e9b92 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:56.933437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9dc6cf8f-224e-4822-9df5-6634bd0e9b92 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:56.933437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9dc6cf8f-224e-4822-9df5-6634bd0e9b92 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:56.934366 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9dc6cf8f-224e-4822-9df5-6634bd0e9b92 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:56.934737 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9dc6cf8f-224e-4822-9df5-6634bd0e9b92 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:56.935397 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9dc6cf8f-224e-4822-9df5-6634bd0e9b92 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:57.251932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-22ce7e61-f84e-4148-973a-bf2b90eb49d8 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:57.252593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-22ce7e61-f84e-4148-973a-bf2b90eb49d8 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:57.259350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-22ce7e61-f84e-4148-973a-bf2b90eb49d8 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:57.259804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-22ce7e61-f84e-4148-973a-bf2b90eb49d8 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:57.260627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-22ce7e61-f84e-4148-973a-bf2b90eb49d8 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:57.261655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-22ce7e61-f84e-4148-973a-bf2b90eb49d8 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:57.593950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9dc6cf8f-224e-4822-9df5-6634bd0e9b92 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:57.611007 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9dc6cf8f-224e-4822-9df5-6634bd0e9b92 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.690801 May 21 21:25:57.617456 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1821/3765] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:56 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:57.701036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-22ce7e61-f84e-4148-973a-bf2b90eb49d8 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68832a0abe4e44ba8750073b682fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93a615f09094a15a92e2a4076887db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:57.712220 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-22ce7e61-f84e-4148-973a-bf2b90eb49d8 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 200 len: 1327 microversion: 2.1 time: 0.464056 May 21 21:25:57.717388 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1945/3766] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:57 2022] GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 1327 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:57.935288 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1586b876-c34e-4215-9fe2-93e733c5a1fd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:57.935834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1586b876-c34e-4215-9fe2-93e733c5a1fd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:57.943780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1586b876-c34e-4215-9fe2-93e733c5a1fd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:57.944560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1586b876-c34e-4215-9fe2-93e733c5a1fd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:57.946081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1586b876-c34e-4215-9fe2-93e733c5a1fd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:57.946536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1586b876-c34e-4215-9fe2-93e733c5a1fd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:58.327338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-67ed63c9-ef6b-450e-8433-7c52adeeea8e req-894593fc-8014-4408-9b9a-61a1a5dae665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef08298a-064e-49b6-9e59-54aaa7ae7b20", "tag": "224930ff-635a-47b0-b1d3-7d94c18bd581"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:25:58.339736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-67ed63c9-ef6b-450e-8433-7c52adeeea8e req-894593fc-8014-4408-9b9a-61a1a5dae665 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:58.342918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-67ed63c9-ef6b-450e-8433-7c52adeeea8e req-894593fc-8014-4408-9b9a-61a1a5dae665 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:58.354440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1586b876-c34e-4215-9fe2-93e733c5a1fd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:58.357286 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-67ed63c9-ef6b-450e-8433-7c52adeeea8e req-894593fc-8014-4408-9b9a-61a1a5dae665 service nova] Creating event network-changed:224930ff-635a-47b0-b1d3-7d94c18bd581 for instance ef08298a-064e-49b6-9e59-54aaa7ae7b20 on nch1-master-1 May 21 21:25:58.371253 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-67ed63c9-ef6b-450e-8433-7c52adeeea8e req-894593fc-8014-4408-9b9a-61a1a5dae665 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045614 May 21 21:25:58.372231 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1946/3767] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:25:58.376569 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1586b876-c34e-4215-9fe2-93e733c5a1fd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1664 microversion: 2.1 time: 0.445665 May 21 21:25:58.387071 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1822/3768] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:57 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1664 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:58.631658 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-01a690cf-6493-4054-8011-adc88abdfa3a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:58.633314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-01a690cf-6493-4054-8011-adc88abdfa3a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:58.645686 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:58.649336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-01a690cf-6493-4054-8011-adc88abdfa3a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:58.650579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-01a690cf-6493-4054-8011-adc88abdfa3a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:58.651554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-01a690cf-6493-4054-8011-adc88abdfa3a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:58.652749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-01a690cf-6493-4054-8011-adc88abdfa3a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:58.735313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fc6e602e-1ca3-4f83-af35-81ab934a2723 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:58.736070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fc6e602e-1ca3-4f83-af35-81ab934a2723 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:58.742443 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc6e602e-1ca3-4f83-af35-81ab934a2723 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:58.743130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc6e602e-1ca3-4f83-af35-81ab934a2723 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:58.743916 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc6e602e-1ca3-4f83-af35-81ab934a2723 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:58.744374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc6e602e-1ca3-4f83-af35-81ab934a2723 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:58.853904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-01a690cf-6493-4054-8011-adc88abdfa3a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:58.863217 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-01a690cf-6493-4054-8011-adc88abdfa3a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.237339 May 21 21:25:58.863805 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1947/3769] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:58 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:59.117119 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fc6e602e-1ca3-4f83-af35-81ab934a2723 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68832a0abe4e44ba8750073b682fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93a615f09094a15a92e2a4076887db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:59.127998 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fc6e602e-1ca3-4f83-af35-81ab934a2723 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 200 len: 1327 microversion: 2.1 time: 0.396846 May 21 21:25:59.139431 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1823/3770] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:58 2022] GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 1327 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:59.399623 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0a3cd730-1a38-40bc-862d-0e731088c634 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:59.402262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0a3cd730-1a38-40bc-862d-0e731088c634 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:59.410084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a3cd730-1a38-40bc-862d-0e731088c634 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:59.410791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a3cd730-1a38-40bc-862d-0e731088c634 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:59.411909 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a3cd730-1a38-40bc-862d-0e731088c634 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:59.412802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a3cd730-1a38-40bc-862d-0e731088c634 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:59.664079 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0a3cd730-1a38-40bc-862d-0e731088c634 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:25:59.676569 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0a3cd730-1a38-40bc-862d-0e731088c634 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.284446 May 21 21:25:59.690695 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1948/3771] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:59 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:25:59.699117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2c5e9e92-ef09-462c-8981-c5fd4a211e96 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:59.699975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2c5e9e92-ef09-462c-8981-c5fd4a211e96 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:59.707398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c5e9e92-ef09-462c-8981-c5fd4a211e96 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:59.707857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c5e9e92-ef09-462c-8981-c5fd4a211e96 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:59.709002 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c5e9e92-ef09-462c-8981-c5fd4a211e96 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:59.711405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c5e9e92-ef09-462c-8981-c5fd4a211e96 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:59.881747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e70b9d08-686a-4439-a295-a0b9f469ac55 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:25:59.882411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e70b9d08-686a-4439-a295-a0b9f469ac55 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:25:59.884328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:59.884994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:59.892175 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e70b9d08-686a-4439-a295-a0b9f469ac55 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:59.893288 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e70b9d08-686a-4439-a295-a0b9f469ac55 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:25:59.894161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e70b9d08-686a-4439-a295-a0b9f469ac55 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:25:59.894594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e70b9d08-686a-4439-a295-a0b9f469ac55 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:00.069210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e70b9d08-686a-4439-a295-a0b9f469ac55 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:00.079304 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e70b9d08-686a-4439-a295-a0b9f469ac55 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.201772 May 21 21:26:00.080604 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1949/3772] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:59 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:00.125827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2c5e9e92-ef09-462c-8981-c5fd4a211e96 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:00.135424 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2c5e9e92-ef09-462c-8981-c5fd4a211e96 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.441274 May 21 21:26:00.136151 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1824/3773] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:25:59 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:00.149103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-915d0815-3c16-4c75-94b2-9594f56aba14 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:00.149930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-915d0815-3c16-4c75-94b2-9594f56aba14 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:00.168490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-915d0815-3c16-4c75-94b2-9594f56aba14 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:00.171230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-51939952-e37f-4cdc-b624-665105e391f8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:00.171524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-51939952-e37f-4cdc-b624-665105e391f8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:00.173027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-915d0815-3c16-4c75-94b2-9594f56aba14 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:00.173939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-915d0815-3c16-4c75-94b2-9594f56aba14 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:00.174455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-915d0815-3c16-4c75-94b2-9594f56aba14 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:00.181078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-51939952-e37f-4cdc-b624-665105e391f8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:00.181376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-51939952-e37f-4cdc-b624-665105e391f8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:00.182172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-51939952-e37f-4cdc-b624-665105e391f8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:00.182696 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-51939952-e37f-4cdc-b624-665105e391f8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:00.341899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=94,nova_cell1:UPDATE=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:00.358831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-915d0815-3c16-4c75-94b2-9594f56aba14 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68832a0abe4e44ba8750073b682fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93a615f09094a15a92e2a4076887db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:00.368179 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-915d0815-3c16-4c75-94b2-9594f56aba14 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 200 len: 1327 microversion: 2.1 time: 0.223858 May 21 21:26:00.368179 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1950/3774] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:00 2022] GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 1327 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:00.465974 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-51939952-e37f-4cdc-b624-665105e391f8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Unlocking {{(pid=131278) unlock /opt/stack/nova/nova/compute/api.py:4729}} May 21 21:26:00.660179 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-51939952-e37f-4cdc-b624-665105e391f8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action" status: 202 len: 0 microversion: 2.1 time: 0.502500 May 21 21:26:00.661096 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1825/3775] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:26:00 2022] POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:26:00.674336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6407c90e-ab17-4f78-a108-750c4d0b6862 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:00.674955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6407c90e-ab17-4f78-a108-750c4d0b6862 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:00.684716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6407c90e-ab17-4f78-a108-750c4d0b6862 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:00.685177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6407c90e-ab17-4f78-a108-750c4d0b6862 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:00.685975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6407c90e-ab17-4f78-a108-750c4d0b6862 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:00.686421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6407c90e-ab17-4f78-a108-750c4d0b6862 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:00.856396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6407c90e-ab17-4f78-a108-750c4d0b6862 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:00.864356 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6407c90e-ab17-4f78-a108-750c4d0b6862 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.193842 May 21 21:26:00.864863 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1951/3776] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:00 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:00.885018 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-59398b3b-d1bf-4eaf-a344-85f5b295a238 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:00.886275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-59398b3b-d1bf-4eaf-a344-85f5b295a238 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:00.893429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59398b3b-d1bf-4eaf-a344-85f5b295a238 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:00.893917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59398b3b-d1bf-4eaf-a344-85f5b295a238 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:00.894695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59398b3b-d1bf-4eaf-a344-85f5b295a238 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:00.895131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59398b3b-d1bf-4eaf-a344-85f5b295a238 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:01.053755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-59398b3b-d1bf-4eaf-a344-85f5b295a238 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:01.063573 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-59398b3b-d1bf-4eaf-a344-85f5b295a238 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.182415 May 21 21:26:01.064549 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1826/3777] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:00 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:26:01.081174 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-67516cfe-7be6-49f5-b7c4-46f270af60b3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:01.086095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-67516cfe-7be6-49f5-b7c4-46f270af60b3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:01.088632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67516cfe-7be6-49f5-b7c4-46f270af60b3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:01.089739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67516cfe-7be6-49f5-b7c4-46f270af60b3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:01.090543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67516cfe-7be6-49f5-b7c4-46f270af60b3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:01.091299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67516cfe-7be6-49f5-b7c4-46f270af60b3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:01.099079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4cff71ea-292e-41f7-94c1-908de151e6ee tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:01.099922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4cff71ea-292e-41f7-94c1-908de151e6ee tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:01.114859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cff71ea-292e-41f7-94c1-908de151e6ee tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:01.114859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cff71ea-292e-41f7-94c1-908de151e6ee tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:01.114859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cff71ea-292e-41f7-94c1-908de151e6ee tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:01.115842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cff71ea-292e-41f7-94c1-908de151e6ee tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:01.263861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-67516cfe-7be6-49f5-b7c4-46f270af60b3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:01.272253 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-67516cfe-7be6-49f5-b7c4-46f270af60b3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.195085 May 21 21:26:01.272873 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1952/3778] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:01 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:01.303105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4cff71ea-292e-41f7-94c1-908de151e6ee tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:01.311670 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4cff71ea-292e-41f7-94c1-908de151e6ee tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.218211 May 21 21:26:01.312258 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1827/3779] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:01 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:01.316980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1ae356dd-ef9d-45db-a237-ff5abef89016 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:01.320800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1ae356dd-ef9d-45db-a237-ff5abef89016 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:01.320800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:01.324517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ae356dd-ef9d-45db-a237-ff5abef89016 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:01.324991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ae356dd-ef9d-45db-a237-ff5abef89016 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:01.325783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ae356dd-ef9d-45db-a237-ff5abef89016 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:01.326235 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ae356dd-ef9d-45db-a237-ff5abef89016 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:01.464841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d3c956bb-c0fd-4a62-8598-b8b3b5d23f5e tempest-FlavorsV2NegativeTest-639762676 tempest-FlavorsV2NegativeTest-639762676-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:01.473336 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d3c956bb-c0fd-4a62-8598-b8b3b5d23f5e tempest-FlavorsV2NegativeTest-639762676 tempest-FlavorsV2NegativeTest-639762676-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.198724 May 21 21:26:01.473909 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1953/3780] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:26:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:26:01.479010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a3c7fd41-dce2-4ed1-a17b-8b7adb1404cf tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:01.480452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a3c7fd41-dce2-4ed1-a17b-8b7adb1404cf tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:01.486904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a3c7fd41-dce2-4ed1-a17b-8b7adb1404cf tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:01.487363 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a3c7fd41-dce2-4ed1-a17b-8b7adb1404cf tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:01.488141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a3c7fd41-dce2-4ed1-a17b-8b7adb1404cf tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:01.488615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a3c7fd41-dce2-4ed1-a17b-8b7adb1404cf tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:01.562738 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1ae356dd-ef9d-45db-a237-ff5abef89016 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action" status: 202 len: 0 microversion: 2.1 time: 0.248217 May 21 21:26:01.562989 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1828/3781] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:26:01 2022] POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:26:01.575097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-158c3c99-be5d-45fa-af06-a2242bd9a77d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:01.576418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-158c3c99-be5d-45fa-af06-a2242bd9a77d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:01.584303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-158c3c99-be5d-45fa-af06-a2242bd9a77d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:01.585046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-158c3c99-be5d-45fa-af06-a2242bd9a77d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:01.585846 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-158c3c99-be5d-45fa-af06-a2242bd9a77d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:01.586434 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-158c3c99-be5d-45fa-af06-a2242bd9a77d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:01.665083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a3c7fd41-dce2-4ed1-a17b-8b7adb1404cf tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68832a0abe4e44ba8750073b682fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93a615f09094a15a92e2a4076887db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:01.674831 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a3c7fd41-dce2-4ed1-a17b-8b7adb1404cf tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 200 len: 1327 microversion: 2.1 time: 0.199183 May 21 21:26:01.675554 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1954/3782] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:01 2022] GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 1327 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:01.770134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-158c3c99-be5d-45fa-af06-a2242bd9a77d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:01.780564 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-158c3c99-be5d-45fa-af06-a2242bd9a77d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1673 microversion: 2.1 time: 0.210964 May 21 21:26:01.781344 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1829/3783] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:01 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1673 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:02.328967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4c41a727-3d78-4a2d-ab3c-009a292cf96b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:02.329591 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4c41a727-3d78-4a2d-ab3c-009a292cf96b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:02.337021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4c41a727-3d78-4a2d-ab3c-009a292cf96b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:02.337390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4c41a727-3d78-4a2d-ab3c-009a292cf96b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:02.338126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4c41a727-3d78-4a2d-ab3c-009a292cf96b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:02.338533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4c41a727-3d78-4a2d-ab3c-009a292cf96b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:02.506966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4c41a727-3d78-4a2d-ab3c-009a292cf96b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:02.517368 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4c41a727-3d78-4a2d-ab3c-009a292cf96b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.191975 May 21 21:26:02.518144 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1955/3784] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:02 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:02.692974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-60c7c4dc-1b5a-41e9-baf3-ed856dfd7a1d tempest-FlavorsV2NegativeTest-639762676 tempest-FlavorsV2NegativeTest-639762676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2024239962", "imageRef": "722e02da-a0da-4ea8-8b8b-4e2e849a6ebe", "flavorRef": "452"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:02.693500 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bb875dbd-21b7-40c4-b7c5-40f95d22b619 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:02.694291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bb875dbd-21b7-40c4-b7c5-40f95d22b619 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:02.704317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb875dbd-21b7-40c4-b7c5-40f95d22b619 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:02.704870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb875dbd-21b7-40c4-b7c5-40f95d22b619 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:02.705736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb875dbd-21b7-40c4-b7c5-40f95d22b619 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:02.706186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb875dbd-21b7-40c4-b7c5-40f95d22b619 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:02.757654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-60c7c4dc-1b5a-41e9-baf3-ed856dfd7a1d tempest-FlavorsV2NegativeTest-639762676 tempest-FlavorsV2NegativeTest-639762676-project] validate_networks() for None {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:26:02.866907 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bb875dbd-21b7-40c4-b7c5-40f95d22b619 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68832a0abe4e44ba8750073b682fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93a615f09094a15a92e2a4076887db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:02.876660 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bb875dbd-21b7-40c4-b7c5-40f95d22b619 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 200 len: 1327 microversion: 2.1 time: 0.188443 May 21 21:26:02.877259 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1830/3785] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:02 2022] GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 1327 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:02.882635 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e4b9feac-74b4-46d5-b232-7fed589eef0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:02.883470 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e4b9feac-74b4-46d5-b232-7fed589eef0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:02.890619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e4b9feac-74b4-46d5-b232-7fed589eef0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:02.891351 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e4b9feac-74b4-46d5-b232-7fed589eef0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:02.892169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e4b9feac-74b4-46d5-b232-7fed589eef0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:02.892642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e4b9feac-74b4-46d5-b232-7fed589eef0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:03.009888 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-60c7c4dc-1b5a-41e9-baf3-ed856dfd7a1d tempest-FlavorsV2NegativeTest-639762676 tempest-FlavorsV2NegativeTest-639762676-project] HTTP exception thrown: Flavor's memory is too small for requested image. May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-60c7c4dc-1b5a-41e9-baf3-ed856dfd7a1d tempest-FlavorsV2NegativeTest-639762676 tempest-FlavorsV2NegativeTest-639762676-project] Request method failure captured: May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 143 May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVjpFMQmSZ2gvKiswbL4quKSjy0JXlp6PDSM71muXn65YsTbYDuddIl73UphAM1EZY7Y3wsFmGdxWGZrNTK2S_mtHDKjMnQ8f46ZkcwMZURH7LlxUWstzFL1GyvhnOYH164-IGdutSzQQRxqNnQcVMX9r3gnDiDa_NMlSbccyx9hoxU May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 8f5cff682a5040f0b56819bb908b6038 May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-FlavorsV2NegativeTest-639762676 May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8f5cff682a5040f0b56819bb908b6038"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f5cff682a5040f0b56819bb908b6038"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8f5cff682a5040f0b56819bb908b6038", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f5cff682a5040f0b56819bb908b6038"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-FlavorsV2NegativeTest-639762676 May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 8f5cff682a5040f0b56819bb908b6038 May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-639762676 May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-FlavorsV2NegativeTest-639762676-project May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: fafae06bc8fb4f5288227832659f86ca May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-FlavorsV2NegativeTest-639762676-project May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2024239962", "imageRef": "722e02da-a0da-4ea8-8b8b-4e2e849a6ebe", "flavorRef": "452"}} May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: exception: Flavor's memory is too small for requested image. May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-2024239962', 'imageRef': '722e02da-a0da-4ea8-8b8b-4e2e849a6ebe', 'flavorRef': '452'}}} May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._create_instance( May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:26:03.013061 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:26:03.017169 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:26:03.017169 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:26:03.017169 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 21 21:26:03.017169 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create May 21 21:26:03.017169 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 21 21:26:03.017169 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. May 21 21:26:03.017169 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:03.017169 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:03.017169 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:03.017169 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:03.017169 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:26:03.017169 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:26:03.017169 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:26:03.017169 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:26:03.017169 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. May 21 21:26:03.017169 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:03.017169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-60c7c4dc-1b5a-41e9-baf3-ed856dfd7a1d tempest-FlavorsV2NegativeTest-639762676 tempest-FlavorsV2NegativeTest-639762676-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:26:03.017169 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-60c7c4dc-1b5a-41e9-baf3-ed856dfd7a1d tempest-FlavorsV2NegativeTest-639762676 tempest-FlavorsV2NegativeTest-639762676-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.326253 May 21 21:26:03.017169 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1956/3786] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:26:02 2022] POST /compute/v2.1/servers => generated 93 bytes in 327 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 21 21:26:03.053410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e4b9feac-74b4-46d5-b232-7fed589eef0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:03.063970 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e4b9feac-74b4-46d5-b232-7fed589eef0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1653 microversion: 2.1 time: 0.185485 May 21 21:26:03.066325 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1831/3787] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:02 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1653 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:03.082258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1a65d4ad-7fa2-450a-b464-858b89a62d23 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:03.084009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1a65d4ad-7fa2-450a-b464-858b89a62d23 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:03.091246 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a65d4ad-7fa2-450a-b464-858b89a62d23 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:03.091718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a65d4ad-7fa2-450a-b464-858b89a62d23 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:03.092554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a65d4ad-7fa2-450a-b464-858b89a62d23 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:03.093450 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a65d4ad-7fa2-450a-b464-858b89a62d23 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:03.361422 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1a65d4ad-7fa2-450a-b464-858b89a62d23 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action" status: 202 len: 0 microversion: 2.1 time: 0.282963 May 21 21:26:03.365255 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1957/3788] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:26:03 2022] POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:26:03.372067 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4d4323e2-b57a-4719-82b5-3559f8653b0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:03.372794 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4d4323e2-b57a-4719-82b5-3559f8653b0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:03.379516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d4323e2-b57a-4719-82b5-3559f8653b0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:03.382449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d4323e2-b57a-4719-82b5-3559f8653b0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:03.382449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d4323e2-b57a-4719-82b5-3559f8653b0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:03.382449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d4323e2-b57a-4719-82b5-3559f8653b0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:03.526737 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4d4323e2-b57a-4719-82b5-3559f8653b0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:03.536132 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4d4323e2-b57a-4719-82b5-3559f8653b0b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1660 microversion: 2.1 time: 0.168494 May 21 21:26:03.537641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ea6b23c1-ce28-4025-9623-03dd26755130 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:03.538190 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1832/3789] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:03 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1660 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:03.538767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ea6b23c1-ce28-4025-9623-03dd26755130 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:03.561970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea6b23c1-ce28-4025-9623-03dd26755130 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:03.565207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea6b23c1-ce28-4025-9623-03dd26755130 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:03.566147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea6b23c1-ce28-4025-9623-03dd26755130 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:03.566612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea6b23c1-ce28-4025-9623-03dd26755130 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:03.806243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ea6b23c1-ce28-4025-9623-03dd26755130 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:03.814756 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ea6b23c1-ce28-4025-9623-03dd26755130 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.282442 May 21 21:26:03.815338 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1958/3790] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:03 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:26:03.894912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-24d62540-c651-4c28-b4cf-4d99f2369c8e tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:03.895666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-24d62540-c651-4c28-b4cf-4d99f2369c8e tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:03.904865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24d62540-c651-4c28-b4cf-4d99f2369c8e tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:03.905450 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24d62540-c651-4c28-b4cf-4d99f2369c8e tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:03.906327 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24d62540-c651-4c28-b4cf-4d99f2369c8e tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:03.906872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24d62540-c651-4c28-b4cf-4d99f2369c8e tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:04.071937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-24d62540-c651-4c28-b4cf-4d99f2369c8e tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68832a0abe4e44ba8750073b682fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93a615f09094a15a92e2a4076887db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:04.077405 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-24d62540-c651-4c28-b4cf-4d99f2369c8e tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 200 len: 1327 microversion: 2.1 time: 0.187101 May 21 21:26:04.077957 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1833/3791] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:03 2022] GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 1327 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:04.359283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-a4884968-6ddd-4be9-b52b-9fa6452f05da req-b7664c14-acf1-4860-a641-e5425ea9ad8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef08298a-064e-49b6-9e59-54aaa7ae7b20", "name": "network-vif-plugged", "status": "completed", "tag": "224930ff-635a-47b0-b1d3-7d94c18bd581"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:04.375329 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a4884968-6ddd-4be9-b52b-9fa6452f05da req-b7664c14-acf1-4860-a641-e5425ea9ad8c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:04.376299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a4884968-6ddd-4be9-b52b-9fa6452f05da req-b7664c14-acf1-4860-a641-e5425ea9ad8c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:04.389367 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a4884968-6ddd-4be9-b52b-9fa6452f05da req-b7664c14-acf1-4860-a641-e5425ea9ad8c service nova] Creating event network-vif-plugged:224930ff-635a-47b0-b1d3-7d94c18bd581 for instance ef08298a-064e-49b6-9e59-54aaa7ae7b20 on nch1-master-1 May 21 21:26:04.395360 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-a4884968-6ddd-4be9-b52b-9fa6452f05da req-b7664c14-acf1-4860-a641-e5425ea9ad8c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.340968 May 21 21:26:04.396952 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1959/3792] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:26:04.557803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-14ddefb4-6537-4b28-8549-2dd8a665bc18 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:04.559057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-14ddefb4-6537-4b28-8549-2dd8a665bc18 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:04.566029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14ddefb4-6537-4b28-8549-2dd8a665bc18 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:04.566819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14ddefb4-6537-4b28-8549-2dd8a665bc18 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:04.567792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14ddefb4-6537-4b28-8549-2dd8a665bc18 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:04.568213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14ddefb4-6537-4b28-8549-2dd8a665bc18 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:04.832899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d8d98faa-3584-47b7-ba6f-18724c74252b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:04.833678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d8d98faa-3584-47b7-ba6f-18724c74252b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:04.845061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8d98faa-3584-47b7-ba6f-18724c74252b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:04.846309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8d98faa-3584-47b7-ba6f-18724c74252b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:04.847180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8d98faa-3584-47b7-ba6f-18724c74252b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:04.847736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8d98faa-3584-47b7-ba6f-18724c74252b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:05.050206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-14ddefb4-6537-4b28-8549-2dd8a665bc18 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:05.067716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d8d98faa-3584-47b7-ba6f-18724c74252b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:05.067935 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-14ddefb4-6537-4b28-8549-2dd8a665bc18 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.514223 May 21 21:26:05.068661 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1834/3793] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:04 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:05.081807 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d8d98faa-3584-47b7-ba6f-18724c74252b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.253494 May 21 21:26:05.082586 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1960/3794] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:04 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:26:05.095291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-845755b6-43a9-4ad6-91a9-17622dc06a08 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:05.095765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-845755b6-43a9-4ad6-91a9-17622dc06a08 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:05.103874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-845755b6-43a9-4ad6-91a9-17622dc06a08 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:05.110934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-845755b6-43a9-4ad6-91a9-17622dc06a08 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:05.111812 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-98c76fbf-5533-4f84-afe7-fa6cca9ee6fc tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:05.112772 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-845755b6-43a9-4ad6-91a9-17622dc06a08 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:05.112963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-98c76fbf-5533-4f84-afe7-fa6cca9ee6fc tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:05.113046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-845755b6-43a9-4ad6-91a9-17622dc06a08 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:05.117904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98c76fbf-5533-4f84-afe7-fa6cca9ee6fc tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:05.118379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98c76fbf-5533-4f84-afe7-fa6cca9ee6fc tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:05.119189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98c76fbf-5533-4f84-afe7-fa6cca9ee6fc tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:05.119616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98c76fbf-5533-4f84-afe7-fa6cca9ee6fc tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:05.126180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:05.294456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-845755b6-43a9-4ad6-91a9-17622dc06a08 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:05.305480 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-845755b6-43a9-4ad6-91a9-17622dc06a08 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.219245 May 21 21:26:05.314994 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1835/3795] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:05 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:05.329682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cbea96c9-a99c-4a1f-83b7-580d103225ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:05.329682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cbea96c9-a99c-4a1f-83b7-580d103225ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:05.338313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbea96c9-a99c-4a1f-83b7-580d103225ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:05.338965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbea96c9-a99c-4a1f-83b7-580d103225ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:05.339960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbea96c9-a99c-4a1f-83b7-580d103225ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:05.340572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbea96c9-a99c-4a1f-83b7-580d103225ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:05.414165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-98c76fbf-5533-4f84-afe7-fa6cca9ee6fc tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68832a0abe4e44ba8750073b682fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93a615f09094a15a92e2a4076887db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:05.426273 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-98c76fbf-5533-4f84-afe7-fa6cca9ee6fc tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 200 len: 1327 microversion: 2.1 time: 0.325360 May 21 21:26:05.426879 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1961/3796] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:05 2022] GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 1327 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:05.540868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cbea96c9-a99c-4a1f-83b7-580d103225ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:05.549982 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cbea96c9-a99c-4a1f-83b7-580d103225ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.229696 May 21 21:26:05.550726 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1836/3797] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:05 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:26:05.577325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cb3f814a-9b13-4c98-80f2-dc1f716b7648 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:05.579210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cb3f814a-9b13-4c98-80f2-dc1f716b7648 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:05.586673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb3f814a-9b13-4c98-80f2-dc1f716b7648 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:05.587206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb3f814a-9b13-4c98-80f2-dc1f716b7648 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:05.588144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb3f814a-9b13-4c98-80f2-dc1f716b7648 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:05.590906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb3f814a-9b13-4c98-80f2-dc1f716b7648 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:05.765571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cb3f814a-9b13-4c98-80f2-dc1f716b7648 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:05.774121 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cb3f814a-9b13-4c98-80f2-dc1f716b7648 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.203129 May 21 21:26:05.775017 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1962/3798] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:05 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:05.791614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-35cc3883-013b-4874-af9c-e0539ded25d2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:05.793191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-35cc3883-013b-4874-af9c-e0539ded25d2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:05.801045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35cc3883-013b-4874-af9c-e0539ded25d2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:05.801729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35cc3883-013b-4874-af9c-e0539ded25d2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:05.802513 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35cc3883-013b-4874-af9c-e0539ded25d2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:05.803114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35cc3883-013b-4874-af9c-e0539ded25d2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:05.981807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-35cc3883-013b-4874-af9c-e0539ded25d2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:05.992963 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-35cc3883-013b-4874-af9c-e0539ded25d2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.205348 May 21 21:26:05.993649 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1837/3799] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:05 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:06.010354 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a7f0a9f7-1db1-4d83-a092-a6b60f6767e0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:06.011214 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a7f0a9f7-1db1-4d83-a092-a6b60f6767e0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:06.018140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7f0a9f7-1db1-4d83-a092-a6b60f6767e0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:06.018733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7f0a9f7-1db1-4d83-a092-a6b60f6767e0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:06.019528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7f0a9f7-1db1-4d83-a092-a6b60f6767e0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:06.021479 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7f0a9f7-1db1-4d83-a092-a6b60f6767e0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:06.100570 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-366150db-6089-42e3-98dd-7b2210df4f99 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:06.101280 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-366150db-6089-42e3-98dd-7b2210df4f99 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:06.108692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-366150db-6089-42e3-98dd-7b2210df4f99 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:06.109452 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-366150db-6089-42e3-98dd-7b2210df4f99 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:06.110346 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-366150db-6089-42e3-98dd-7b2210df4f99 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:06.111007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-366150db-6089-42e3-98dd-7b2210df4f99 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:06.231861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a7f0a9f7-1db1-4d83-a092-a6b60f6767e0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:06.242216 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a7f0a9f7-1db1-4d83-a092-a6b60f6767e0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.236258 May 21 21:26:06.253288 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1963/3800] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:06 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:06.351848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-366150db-6089-42e3-98dd-7b2210df4f99 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:06.360263 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-366150db-6089-42e3-98dd-7b2210df4f99 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.265069 May 21 21:26:06.360864 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1838/3801] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:06 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:26:06.442786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e4fa14da-496c-4bcc-94bc-592499ef9992 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:06.443499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e4fa14da-496c-4bcc-94bc-592499ef9992 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:06.450725 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e4fa14da-496c-4bcc-94bc-592499ef9992 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:06.451261 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e4fa14da-496c-4bcc-94bc-592499ef9992 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:06.452693 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e4fa14da-496c-4bcc-94bc-592499ef9992 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:06.453151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e4fa14da-496c-4bcc-94bc-592499ef9992 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:06.665021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e4fa14da-496c-4bcc-94bc-592499ef9992 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68832a0abe4e44ba8750073b682fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93a615f09094a15a92e2a4076887db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:06.677425 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e4fa14da-496c-4bcc-94bc-592499ef9992 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 200 len: 1526 microversion: 2.1 time: 0.238421 May 21 21:26:06.678595 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1964/3802] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:06 2022] GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 1526 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:06.694258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2e262150-dd26-45df-9ef0-0872f3a01607 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:06.701848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2e262150-dd26-45df-9ef0-0872f3a01607 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:06.701848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e262150-dd26-45df-9ef0-0872f3a01607 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:06.701848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e262150-dd26-45df-9ef0-0872f3a01607 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:06.702606 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e262150-dd26-45df-9ef0-0872f3a01607 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:06.703047 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e262150-dd26-45df-9ef0-0872f3a01607 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:06.708942 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:06.884628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2e262150-dd26-45df-9ef0-0872f3a01607 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68832a0abe4e44ba8750073b682fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93a615f09094a15a92e2a4076887db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:06.892584 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2e262150-dd26-45df-9ef0-0872f3a01607 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 200 len: 1526 microversion: 2.1 time: 0.201992 May 21 21:26:06.896245 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1839/3803] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:06 2022] GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 1526 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:26:07.150730 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fc009f15-baec-4fb0-86ea-03c1376ee1e4 tempest-ServersNegativeTestMultiTenantJSON-592655590 tempest-ServersNegativeTestMultiTenantJSON-592655590-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:07.151902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fc009f15-baec-4fb0-86ea-03c1376ee1e4 tempest-ServersNegativeTestMultiTenantJSON-592655590 tempest-ServersNegativeTestMultiTenantJSON-592655590-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:07.159249 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc009f15-baec-4fb0-86ea-03c1376ee1e4 tempest-ServersNegativeTestMultiTenantJSON-592655590 tempest-ServersNegativeTestMultiTenantJSON-592655590-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:07.159716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc009f15-baec-4fb0-86ea-03c1376ee1e4 tempest-ServersNegativeTestMultiTenantJSON-592655590 tempest-ServersNegativeTestMultiTenantJSON-592655590-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:07.160686 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc009f15-baec-4fb0-86ea-03c1376ee1e4 tempest-ServersNegativeTestMultiTenantJSON-592655590 tempest-ServersNegativeTestMultiTenantJSON-592655590-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:07.161167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc009f15-baec-4fb0-86ea-03c1376ee1e4 tempest-ServersNegativeTestMultiTenantJSON-592655590 tempest-ServersNegativeTestMultiTenantJSON-592655590-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:07.177901 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-fc009f15-baec-4fb0-86ea-03c1376ee1e4 tempest-ServersNegativeTestMultiTenantJSON-592655590 tempest-ServersNegativeTestMultiTenantJSON-592655590-project] HTTP exception thrown: Instance ef08298a-064e-49b6-9e59-54aaa7ae7b20 could not be found. May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fc009f15-baec-4fb0-86ea-03c1376ee1e4 tempest-ServersNegativeTestMultiTenantJSON-592655590 tempest-ServersNegativeTestMultiTenantJSON-592655590-project] Request method failure captured: May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 HTTP/1.1 May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVjcQ4FFy7kJ6t8_M8HD9A0ZEDP22Upsx75aU3hh-cbyXLlYYlUvHWONEQMd5gorsmKNTNgX1fkugPSciMo9mbtQYzZBNNIU3CGo4hEff3TZa3Rd5ozHcyXOP8F9bpDAR3ay9JzAUXbEwi-k-UMZS_YxjANz1a7K9fttSrFvWNu8kGU May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 6b69a974605b42e9bd4d03017563e921 May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-592655590 May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6b69a974605b42e9bd4d03017563e921"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6b69a974605b42e9bd4d03017563e921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6b69a974605b42e9bd4d03017563e921", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6b69a974605b42e9bd4d03017563e921"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-592655590 May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 6b69a974605b42e9bd4d03017563e921 May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-592655590 May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestMultiTenantJSON-592655590-project May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: dfce996e38054ce19cd3f35929354448 May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-592655590-project May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance ef08298a-064e-49b6-9e59-54aaa7ae7b20 could not be found. May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'ef08298a-064e-49b6-9e59-54aaa7ae7b20'} May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef08298a-064e-49b6-9e59-54aaa7ae7b20 could not be found. May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:26:07.181012 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:26:07.189677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef08298a-064e-49b6-9e59-54aaa7ae7b20 could not be found. May 21 21:26:07.189677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.189677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:07.189677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.189677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.189677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:26:07.189677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:26:07.189677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:26:07.189677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:26:07.189677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef08298a-064e-49b6-9e59-54aaa7ae7b20 could not be found. May 21 21:26:07.189677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.189677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fc009f15-baec-4fb0-86ea-03c1376ee1e4 tempest-ServersNegativeTestMultiTenantJSON-592655590 tempest-ServersNegativeTestMultiTenantJSON-592655590-project] Returning 404 to user: Instance ef08298a-064e-49b6-9e59-54aaa7ae7b20 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:26:07.189677 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fc009f15-baec-4fb0-86ea-03c1376ee1e4 tempest-ServersNegativeTestMultiTenantJSON-592655590 tempest-ServersNegativeTestMultiTenantJSON-592655590-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 404 len: 111 microversion: 2.1 time: 0.276917 May 21 21:26:07.189677 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1965/3804] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:26:06 2022] DELETE /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 111 bytes in 278 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:26:07.192615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6e074f38-68b5-4302-841d-a351e6e853ad tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:07.193238 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6e074f38-68b5-4302-841d-a351e6e853ad tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:07.199549 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6e074f38-68b5-4302-841d-a351e6e853ad tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:07.199994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6e074f38-68b5-4302-841d-a351e6e853ad tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:07.200861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6e074f38-68b5-4302-841d-a351e6e853ad tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:07.201412 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6e074f38-68b5-4302-841d-a351e6e853ad tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:07.335521 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ba3d1d61-a44d-4201-91eb-a6c00e7c3b8e tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] 10.222.0.49 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.353377 May 21 21:26:07.336656 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1840/3805] 10.222.0.49 () {58 vars in 1127 bytes} [Sat May 21 21:26:06 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 21 21:26:07.345464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4f256ff3-6e59-4950-8ffc-be900f77cad2 tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] Calling method '.version_select at 0x7fc81b65e3a0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:07.365746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6e074f38-68b5-4302-841d-a351e6e853ad tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68832a0abe4e44ba8750073b682fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93a615f09094a15a92e2a4076887db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:07.374420 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-4f256ff3-6e59-4950-8ffc-be900f77cad2 tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] HTTP exception thrown: Image not found. May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4f256ff3-6e59-4950-8ffc-be900f77cad2 tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] Request method failure captured: May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVjuzBnJfII03pUaiVVWGLMH15dsVVfFX9sUDDOHZStxmxoSGGv_2V1svnX_F1CNDiGjON0orDiMgsKbHxjNkKlk63TqjsPFqigx6KipiEDBdwEcQMzCX33o7uVdnMUsZQ2kgv5dU_pwRYADkqO6eptnX4vdIlDxsVzk9RcsNSqTpeg May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 95d6254368d54b788a3cfb195b4d79a2 May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1692550200 May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/95d6254368d54b788a3cfb195b4d79a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/95d6254368d54b788a3cfb195b4d79a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_95d6254368d54b788a3cfb195b4d79a2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/95d6254368d54b788a3cfb195b4d79a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1692550200 May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 95d6254368d54b788a3cfb195b4d79a2 May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1692550200 May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesDeleteNegativeTestJSON-1692550200-project May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: a736bfeb91424f5f8cbc4c4978a000c1 May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1692550200-project May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: exception: Image not found. May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '-1'} May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:07.376458 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:07.380685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4f256ff3-6e59-4950-8ffc-be900f77cad2 tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] Returning 404 to user: Image not found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:26:07.382455 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6e074f38-68b5-4302-841d-a351e6e853ad tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 200 len: 1526 microversion: 2.1 time: 0.189468 May 21 21:26:07.382559 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4f256ff3-6e59-4950-8ffc-be900f77cad2 tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] 10.222.0.49 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.036761 May 21 21:26:07.382652 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1966/3806] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:07 2022] GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 1526 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:07.386014 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1841/3807] 10.222.0.49 () {58 vars in 1133 bytes} [Sat May 21 21:26:07 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 21 21:26:07.393323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-407d595b-2b4b-40e2-9920-73dd4e731a9e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:07.393495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-407d595b-2b4b-40e2-9920-73dd4e731a9e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:07.400712 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8b91886c-bad4-48f2-a0ee-5b5683ebbab3 tempest-ServersNegativeTestMultiTenantJSON-592655590 tempest-ServersNegativeTestMultiTenantJSON-592655590-project] Action: 'update', calling method: >, body: {"server": {"name": "ef08298a-064e-49b6-9e59-54aaa7ae7b20_new"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:07.402034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-407d595b-2b4b-40e2-9920-73dd4e731a9e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:07.402577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8b91886c-bad4-48f2-a0ee-5b5683ebbab3 tempest-ServersNegativeTestMultiTenantJSON-592655590 tempest-ServersNegativeTestMultiTenantJSON-592655590-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:07.402709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-407d595b-2b4b-40e2-9920-73dd4e731a9e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:07.403822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-407d595b-2b4b-40e2-9920-73dd4e731a9e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:07.404353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-407d595b-2b4b-40e2-9920-73dd4e731a9e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:07.410525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b91886c-bad4-48f2-a0ee-5b5683ebbab3 tempest-ServersNegativeTestMultiTenantJSON-592655590 tempest-ServersNegativeTestMultiTenantJSON-592655590-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:07.416650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b91886c-bad4-48f2-a0ee-5b5683ebbab3 tempest-ServersNegativeTestMultiTenantJSON-592655590 tempest-ServersNegativeTestMultiTenantJSON-592655590-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:07.416650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b91886c-bad4-48f2-a0ee-5b5683ebbab3 tempest-ServersNegativeTestMultiTenantJSON-592655590 tempest-ServersNegativeTestMultiTenantJSON-592655590-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:07.416650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b91886c-bad4-48f2-a0ee-5b5683ebbab3 tempest-ServersNegativeTestMultiTenantJSON-592655590 tempest-ServersNegativeTestMultiTenantJSON-592655590-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:07.428313 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-8b91886c-bad4-48f2-a0ee-5b5683ebbab3 tempest-ServersNegativeTestMultiTenantJSON-592655590 tempest-ServersNegativeTestMultiTenantJSON-592655590-project] HTTP exception thrown: Instance ef08298a-064e-49b6-9e59-54aaa7ae7b20 could not be found. May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8b91886c-bad4-48f2-a0ee-5b5683ebbab3 tempest-ServersNegativeTestMultiTenantJSON-592655590 tempest-ServersNegativeTestMultiTenantJSON-592655590-project] Request method failure captured: May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: request: PUT /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 HTTP/1.1 May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 64 May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVjcQ4FFy7kJ6t8_M8HD9A0ZEDP22Upsx75aU3hh-cbyXLlYYlUvHWONEQMd5gorsmKNTNgX1fkugPSciMo9mbtQYzZBNNIU3CGo4hEff3TZa3Rd5ozHcyXOP8F9bpDAR3ay9JzAUXbEwi-k-UMZS_YxjANz1a7K9fttSrFvWNu8kGU May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 6b69a974605b42e9bd4d03017563e921 May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-592655590 May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6b69a974605b42e9bd4d03017563e921"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6b69a974605b42e9bd4d03017563e921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6b69a974605b42e9bd4d03017563e921", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6b69a974605b42e9bd4d03017563e921"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-592655590 May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 6b69a974605b42e9bd4d03017563e921 May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-592655590 May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestMultiTenantJSON-592655590-project May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: dfce996e38054ce19cd3f35929354448 May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-592655590-project May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: {"server": {"name": "ef08298a-064e-49b6-9e59-54aaa7ae7b20_new"}} May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance ef08298a-064e-49b6-9e59-54aaa7ae7b20 could not be found. May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'ef08298a-064e-49b6-9e59-54aaa7ae7b20', 'body': {'server': {'name': 'ef08298a-064e-49b6-9e59-54aaa7ae7b20_new'}}} May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef08298a-064e-49b6-9e59-54aaa7ae7b20 could not be found. May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 21 21:26:07.430544 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update May 21 21:26:07.436129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) May 21 21:26:07.436129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:26:07.436129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:26:07.436129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:26:07.436129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:26:07.436129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef08298a-064e-49b6-9e59-54aaa7ae7b20 could not be found. May 21 21:26:07.436129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:07.436129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:07.436129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:07.436129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.436129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:26:07.436129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:26:07.436129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:26:07.436129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:26:07.436129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef08298a-064e-49b6-9e59-54aaa7ae7b20 could not be found. May 21 21:26:07.436129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:07.438143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8b91886c-bad4-48f2-a0ee-5b5683ebbab3 tempest-ServersNegativeTestMultiTenantJSON-592655590 tempest-ServersNegativeTestMultiTenantJSON-592655590-project] Returning 404 to user: Instance ef08298a-064e-49b6-9e59-54aaa7ae7b20 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:26:07.439046 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8b91886c-bad4-48f2-a0ee-5b5683ebbab3 tempest-ServersNegativeTestMultiTenantJSON-592655590 tempest-ServersNegativeTestMultiTenantJSON-592655590-project] 10.222.0.49 "PUT /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 404 len: 111 microversion: 2.1 time: 0.047325 May 21 21:26:07.439650 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1842/3808] 10.222.0.49 () {60 vars in 1255 bytes} [Sat May 21 21:26:07 2022] PUT /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:26:07.455562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-af714369-0979-42fb-bfe4-6bd91035e7c6 tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] Calling method '.version_select at 0x7fc81b5754c0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:07.481536 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-af714369-0979-42fb-bfe4-6bd91035e7c6 tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] HTTP exception thrown: Image not found. May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-af714369-0979-42fb-bfe4-6bd91035e7c6 tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] Request method failure captured: May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/images/8f267e75-485c-4e6e-ae8e-aec91b11575j HTTP/1.1 May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVjuzBnJfII03pUaiVVWGLMH15dsVVfFX9sUDDOHZStxmxoSGGv_2V1svnX_F1CNDiGjON0orDiMgsKbHxjNkKlk63TqjsPFqigx6KipiEDBdwEcQMzCX33o7uVdnMUsZQ2kgv5dU_pwRYADkqO6eptnX4vdIlDxsVzk9RcsNSqTpeg May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 95d6254368d54b788a3cfb195b4d79a2 May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1692550200 May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/95d6254368d54b788a3cfb195b4d79a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/95d6254368d54b788a3cfb195b4d79a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_95d6254368d54b788a3cfb195b4d79a2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/95d6254368d54b788a3cfb195b4d79a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1692550200 May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 95d6254368d54b788a3cfb195b4d79a2 May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1692550200 May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ImagesDeleteNegativeTestJSON-1692550200-project May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: a736bfeb91424f5f8cbc4c4978a000c1 May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1692550200-project May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: exception: Image not found. May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '8f267e75-485c-4e6e-ae8e-aec91b11575j'} May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8f267e75-485c-4e6e-ae8e-aec91b11575j to delete May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8f267e75-485c-4e6e-ae8e-aec91b11575j could not be found. May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:07.483511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-af714369-0979-42fb-bfe4-6bd91035e7c6 tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] Returning 404 to user: Image not found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-af714369-0979-42fb-bfe4-6bd91035e7c6 tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] 10.222.0.49 "DELETE /compute/v2.1/images/8f267e75-485c-4e6e-ae8e-aec91b11575j" status: 404 len: 62 microversion: 2.1 time: 0.044446 May 21 21:26:07.488843 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1843/3809] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:07 2022] DELETE /compute/v2.1/images/8f267e75-485c-4e6e-ae8e-aec91b11575j => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:26:07.499185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ce8f3dae-bc1d-4fed-8442-d6ae5edbc8f1 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:07.499185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ce8f3dae-bc1d-4fed-8442-d6ae5edbc8f1 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:07.510137 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ce8f3dae-bc1d-4fed-8442-d6ae5edbc8f1 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:07.510137 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ce8f3dae-bc1d-4fed-8442-d6ae5edbc8f1 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:07.510137 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ce8f3dae-bc1d-4fed-8442-d6ae5edbc8f1 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:07.510137 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ce8f3dae-bc1d-4fed-8442-d6ae5edbc8f1 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:07.539502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ce8f3dae-bc1d-4fed-8442-d6ae5edbc8f1 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:26:07.607241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-407d595b-2b4b-40e2-9920-73dd4e731a9e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:07.614887 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-407d595b-2b4b-40e2-9920-73dd4e731a9e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.234972 May 21 21:26:07.615446 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1967/3810] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:07 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:07.620798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a14f2f97-79e1-4ff6-8b7b-8727445ca0bf tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] Calling method '.version_select at 0x7fc81a53fb80>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-a14f2f97-79e1-4ff6-8b7b-8727445ca0bf tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] HTTP exception thrown: Image not found. May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a14f2f97-79e1-4ff6-8b7b-8727445ca0bf tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] Request method failure captured: May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/images/a8d6c8fe-645c-47c7-b495-2c30f72969b61 HTTP/1.1 May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVjuzBnJfII03pUaiVVWGLMH15dsVVfFX9sUDDOHZStxmxoSGGv_2V1svnX_F1CNDiGjON0orDiMgsKbHxjNkKlk63TqjsPFqigx6KipiEDBdwEcQMzCX33o7uVdnMUsZQ2kgv5dU_pwRYADkqO6eptnX4vdIlDxsVzk9RcsNSqTpeg May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 95d6254368d54b788a3cfb195b4d79a2 May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1692550200 May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/95d6254368d54b788a3cfb195b4d79a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/95d6254368d54b788a3cfb195b4d79a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_95d6254368d54b788a3cfb195b4d79a2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/95d6254368d54b788a3cfb195b4d79a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1692550200 May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 95d6254368d54b788a3cfb195b4d79a2 May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1692550200 May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesDeleteNegativeTestJSON-1692550200-project May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a736bfeb91424f5f8cbc4c4978a000c1 May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1692550200-project May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: exception: Image not found. May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'a8d6c8fe-645c-47c7-b495-2c30f72969b61'} May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a8d6c8fe-645c-47c7-b495-2c30f72969b61 to delete May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 21 21:26:07.640507 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a8d6c8fe-645c-47c7-b495-2c30f72969b61 could not be found. May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a14f2f97-79e1-4ff6-8b7b-8727445ca0bf tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] Returning 404 to user: Image not found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a14f2f97-79e1-4ff6-8b7b-8727445ca0bf tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] 10.222.0.49 "DELETE /compute/v2.1/images/a8d6c8fe-645c-47c7-b495-2c30f72969b61" status: 404 len: 62 microversion: 2.1 time: 0.024876 May 21 21:26:07.644783 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1968/3811] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:26:07 2022] DELETE /compute/v2.1/images/a8d6c8fe-645c-47c7-b495-2c30f72969b61 => generated 62 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:26:07.650623 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7cdce6a5-fd1b-4804-b002-9ddca3aa8bb4 tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] Calling method '.version_select at 0x7fc81bb45940>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:07.677091 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-7cdce6a5-fd1b-4804-b002-9ddca3aa8bb4 tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] HTTP exception thrown: Image not found. May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7cdce6a5-fd1b-4804-b002-9ddca3aa8bb4 tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] Request method failure captured: May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/images/tempest-invalid-1734053163 HTTP/1.1 May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVjuzBnJfII03pUaiVVWGLMH15dsVVfFX9sUDDOHZStxmxoSGGv_2V1svnX_F1CNDiGjON0orDiMgsKbHxjNkKlk63TqjsPFqigx6KipiEDBdwEcQMzCX33o7uVdnMUsZQ2kgv5dU_pwRYADkqO6eptnX4vdIlDxsVzk9RcsNSqTpeg May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 95d6254368d54b788a3cfb195b4d79a2 May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1692550200 May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/95d6254368d54b788a3cfb195b4d79a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/95d6254368d54b788a3cfb195b4d79a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_95d6254368d54b788a3cfb195b4d79a2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/95d6254368d54b788a3cfb195b4d79a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1692550200 May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 95d6254368d54b788a3cfb195b4d79a2 May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1692550200 May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesDeleteNegativeTestJSON-1692550200-project May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a736bfeb91424f5f8cbc4c4978a000c1 May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1692550200-project May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: exception: Image not found. May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'tempest-invalid-1734053163'} May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1734053163 to delete May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1734053163 could not be found. May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.679087 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7cdce6a5-fd1b-4804-b002-9ddca3aa8bb4 tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] Returning 404 to user: Image not found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7cdce6a5-fd1b-4804-b002-9ddca3aa8bb4 tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] 10.222.0.49 "DELETE /compute/v2.1/images/tempest-invalid-1734053163" status: 404 len: 62 microversion: 2.1 time: 0.033675 May 21 21:26:07.684147 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1969/3812] 10.222.0.49 () {58 vars in 1205 bytes} [Sat May 21 21:26:07 2022] DELETE /compute/v2.1/images/tempest-invalid-1734053163 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:26:07.691780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e030871f-6575-4b63-8356-fcb7cf3f26ed tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] Calling method '.version_select at 0x7fc81a53f550>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:07.714396 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-e030871f-6575-4b63-8356-fcb7cf3f26ed tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] HTTP exception thrown: Image not found. May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e030871f-6575-4b63-8356-fcb7cf3f26ed tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] Request method failure captured: May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/images/580cce4c-bfbe-4aa0-a8b0-ff7b1e0359b4 HTTP/1.1 May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVjuzBnJfII03pUaiVVWGLMH15dsVVfFX9sUDDOHZStxmxoSGGv_2V1svnX_F1CNDiGjON0orDiMgsKbHxjNkKlk63TqjsPFqigx6KipiEDBdwEcQMzCX33o7uVdnMUsZQ2kgv5dU_pwRYADkqO6eptnX4vdIlDxsVzk9RcsNSqTpeg May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 95d6254368d54b788a3cfb195b4d79a2 May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1692550200 May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/95d6254368d54b788a3cfb195b4d79a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/95d6254368d54b788a3cfb195b4d79a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_95d6254368d54b788a3cfb195b4d79a2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/95d6254368d54b788a3cfb195b4d79a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1692550200 May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 95d6254368d54b788a3cfb195b4d79a2 May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1692550200 May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ImagesDeleteNegativeTestJSON-1692550200-project May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a736bfeb91424f5f8cbc4c4978a000c1 May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1692550200-project May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: exception: Image not found. May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '580cce4c-bfbe-4aa0-a8b0-ff7b1e0359b4'} May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 580cce4c-bfbe-4aa0-a8b0-ff7b1e0359b4 to delete May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 580cce4c-bfbe-4aa0-a8b0-ff7b1e0359b4 could not be found. May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:07.717985 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e030871f-6575-4b63-8356-fcb7cf3f26ed tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] Returning 404 to user: Image not found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e030871f-6575-4b63-8356-fcb7cf3f26ed tempest-ImagesDeleteNegativeTestJSON-1692550200 tempest-ImagesDeleteNegativeTestJSON-1692550200-project] 10.222.0.49 "DELETE /compute/v2.1/images/580cce4c-bfbe-4aa0-a8b0-ff7b1e0359b4" status: 404 len: 62 microversion: 2.1 time: 0.032120 May 21 21:26:07.722514 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1970/3813] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:07 2022] DELETE /compute/v2.1/images/580cce4c-bfbe-4aa0-a8b0-ff7b1e0359b4 => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:26:07.957852 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ce8f3dae-bc1d-4fed-8442-d6ae5edbc8f1 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 204 len: 0 microversion: 2.1 time: 0.471001 May 21 21:26:07.959096 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1844/3814] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:26:07 2022] DELETE /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:26:07.969001 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ee5a62b7-eb95-42ed-8e8c-ffdb642e0c22 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:07.969635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ee5a62b7-eb95-42ed-8e8c-ffdb642e0c22 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:07.980354 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee5a62b7-eb95-42ed-8e8c-ffdb642e0c22 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:07.980820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee5a62b7-eb95-42ed-8e8c-ffdb642e0c22 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:07.981613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee5a62b7-eb95-42ed-8e8c-ffdb642e0c22 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:07.982059 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee5a62b7-eb95-42ed-8e8c-ffdb642e0c22 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:08.164011 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ee5a62b7-eb95-42ed-8e8c-ffdb642e0c22 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68832a0abe4e44ba8750073b682fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93a615f09094a15a92e2a4076887db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:08.173296 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ee5a62b7-eb95-42ed-8e8c-ffdb642e0c22 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 200 len: 1532 microversion: 2.1 time: 0.209586 May 21 21:26:08.173917 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1971/3815] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:07 2022] GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 1532 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:08.633166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5fdea3e7-596c-48c8-8776-21d33f46c0aa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:08.633821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5fdea3e7-596c-48c8-8776-21d33f46c0aa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:08.641572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5fdea3e7-596c-48c8-8776-21d33f46c0aa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:08.642016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5fdea3e7-596c-48c8-8776-21d33f46c0aa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:08.642800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5fdea3e7-596c-48c8-8776-21d33f46c0aa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:08.643240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5fdea3e7-596c-48c8-8776-21d33f46c0aa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:08.857299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5fdea3e7-596c-48c8-8776-21d33f46c0aa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:08.866133 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5fdea3e7-596c-48c8-8776-21d33f46c0aa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.237266 May 21 21:26:08.866945 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1845/3816] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:08 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:09.191121 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-85cb030a-d192-4e67-8c24-1c50bb2394a2 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:09.191855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-85cb030a-d192-4e67-8c24-1c50bb2394a2 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:09.200036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85cb030a-d192-4e67-8c24-1c50bb2394a2 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:09.205309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85cb030a-d192-4e67-8c24-1c50bb2394a2 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:09.205933 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85cb030a-d192-4e67-8c24-1c50bb2394a2 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:09.206720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85cb030a-d192-4e67-8c24-1c50bb2394a2 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:09.377122 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-85cb030a-d192-4e67-8c24-1c50bb2394a2 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68832a0abe4e44ba8750073b682fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93a615f09094a15a92e2a4076887db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:09.385767 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-85cb030a-d192-4e67-8c24-1c50bb2394a2 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 200 len: 1532 microversion: 2.1 time: 0.198468 May 21 21:26:09.386362 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1972/3817] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:09 2022] GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 1532 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:09.884388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-24a6779f-0a20-4901-bf4c-7c84e3c56cde tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:09.885756 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-24a6779f-0a20-4901-bf4c-7c84e3c56cde tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:09.894110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24a6779f-0a20-4901-bf4c-7c84e3c56cde tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:09.894588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24a6779f-0a20-4901-bf4c-7c84e3c56cde tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:09.896793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24a6779f-0a20-4901-bf4c-7c84e3c56cde tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:09.897340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24a6779f-0a20-4901-bf4c-7c84e3c56cde tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:10.069484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-24a6779f-0a20-4901-bf4c-7c84e3c56cde tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:10.078142 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-24a6779f-0a20-4901-bf4c-7c84e3c56cde tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.197874 May 21 21:26:10.078722 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1846/3818] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:09 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:10.217605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-b26a4447-4c5d-48e6-979e-f0e56cae9dbf req-df6028de-dbe7-4535-baaf-37251f73e74c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef08298a-064e-49b6-9e59-54aaa7ae7b20", "name": "network-vif-deleted", "tag": "224930ff-635a-47b0-b1d3-7d94c18bd581"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:10.228542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b26a4447-4c5d-48e6-979e-f0e56cae9dbf req-df6028de-dbe7-4535-baaf-37251f73e74c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:10.229113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b26a4447-4c5d-48e6-979e-f0e56cae9dbf req-df6028de-dbe7-4535-baaf-37251f73e74c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:10.247986 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-b26a4447-4c5d-48e6-979e-f0e56cae9dbf req-df6028de-dbe7-4535-baaf-37251f73e74c service nova] Creating event network-vif-deleted:224930ff-635a-47b0-b1d3-7d94c18bd581 for instance ef08298a-064e-49b6-9e59-54aaa7ae7b20 on nch1-master-1 May 21 21:26:10.248703 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-b26a4447-4c5d-48e6-979e-f0e56cae9dbf req-df6028de-dbe7-4535-baaf-37251f73e74c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037355 May 21 21:26:10.249629 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1973/3819] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:26:10.411868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1215e664-2044-48f4-86ee-2a6b5978fed2 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:10.411868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1215e664-2044-48f4-86ee-2a6b5978fed2 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:10.411868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:10.415120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1215e664-2044-48f4-86ee-2a6b5978fed2 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:10.415247 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1215e664-2044-48f4-86ee-2a6b5978fed2 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:10.415946 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1215e664-2044-48f4-86ee-2a6b5978fed2 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:10.417059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1215e664-2044-48f4-86ee-2a6b5978fed2 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:10.502299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1215e664-2044-48f4-86ee-2a6b5978fed2 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68832a0abe4e44ba8750073b682fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93a615f09094a15a92e2a4076887db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:10.511748 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1215e664-2044-48f4-86ee-2a6b5978fed2 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 200 len: 1312 microversion: 2.1 time: 0.113646 May 21 21:26:10.512364 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1847/3820] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:10 2022] GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 1312 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:11.098396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-863dd303-74b6-47c9-b586-c0057d77b36a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:11.099110 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-863dd303-74b6-47c9-b586-c0057d77b36a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:11.108208 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-863dd303-74b6-47c9-b586-c0057d77b36a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:11.108912 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-863dd303-74b6-47c9-b586-c0057d77b36a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:11.109926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-863dd303-74b6-47c9-b586-c0057d77b36a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:11.110563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-863dd303-74b6-47c9-b586-c0057d77b36a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:11.295242 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-863dd303-74b6-47c9-b586-c0057d77b36a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:11.303249 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-863dd303-74b6-47c9-b586-c0057d77b36a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.209939 May 21 21:26:11.303820 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1974/3821] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:11 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:11.531188 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-71f89c18-2637-4bcf-bb90-9083db57d744 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:11.532055 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-71f89c18-2637-4bcf-bb90-9083db57d744 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] [instance: ef08298a-064e-49b6-9e59-54aaa7ae7b20] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:11.540260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71f89c18-2637-4bcf-bb90-9083db57d744 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:11.540943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71f89c18-2637-4bcf-bb90-9083db57d744 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:11.543529 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71f89c18-2637-4bcf-bb90-9083db57d744 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:11.544260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71f89c18-2637-4bcf-bb90-9083db57d744 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:11.559436 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-71f89c18-2637-4bcf-bb90-9083db57d744 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] HTTP exception thrown: Instance ef08298a-064e-49b6-9e59-54aaa7ae7b20 could not be found. May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-71f89c18-2637-4bcf-bb90-9083db57d744 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Request method failure captured: May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 HTTP/1.1 May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVjZN2bvFTKJ1hN5YKhSE2aKec8WGRw8yA3-WDZwNVmSFHQOwqiArj12D2X7NB17gX5tzoGJDN4dwX3L3KF_HfSkYjVV7uvvlMnOfSlRbVnoJ1LLpXomBK7VBYn2z_3ch745IgFgjToLJbaxQZQkT5Zeia9Nzto8_BWIuoz0Tc4PzPs May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: e93a615f09094a15a92e2a4076887db0 May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1342761167 May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e93a615f09094a15a92e2a4076887db0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e93a615f09094a15a92e2a4076887db0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e93a615f09094a15a92e2a4076887db0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e93a615f09094a15a92e2a4076887db0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1342761167 May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: e93a615f09094a15a92e2a4076887db0 May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1342761167 May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1342761167-project May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: ce68832a0abe4e44ba8750073b682fdc May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1342761167-project May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance ef08298a-064e-49b6-9e59-54aaa7ae7b20 could not be found. May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'ef08298a-064e-49b6-9e59-54aaa7ae7b20'} May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef08298a-064e-49b6-9e59-54aaa7ae7b20 could not be found. May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef08298a-064e-49b6-9e59-54aaa7ae7b20 could not be found. May 21 21:26:11.565376 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:11.571690 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:11.571690 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:11.571690 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:11.571690 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:26:11.571690 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:26:11.571690 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:26:11.571690 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:26:11.571690 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef08298a-064e-49b6-9e59-54aaa7ae7b20 could not be found. May 21 21:26:11.571690 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:11.571690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-71f89c18-2637-4bcf-bb90-9083db57d744 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] Returning 404 to user: Instance ef08298a-064e-49b6-9e59-54aaa7ae7b20 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:26:11.571690 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-71f89c18-2637-4bcf-bb90-9083db57d744 tempest-ServersNegativeTestMultiTenantJSON-1342761167 tempest-ServersNegativeTestMultiTenantJSON-1342761167-project] 10.222.0.49 "GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20" status: 404 len: 111 microversion: 2.1 time: 0.040057 May 21 21:26:11.571690 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1848/3822] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:11 2022] GET /compute/v2.1/servers/ef08298a-064e-49b6-9e59-54aaa7ae7b20 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:26:12.320945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d887b7f6-a1d1-4374-8505-e5226d912cfa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:12.321673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d887b7f6-a1d1-4374-8505-e5226d912cfa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:12.329827 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d887b7f6-a1d1-4374-8505-e5226d912cfa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:12.330286 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d887b7f6-a1d1-4374-8505-e5226d912cfa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:12.331095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d887b7f6-a1d1-4374-8505-e5226d912cfa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:12.331548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d887b7f6-a1d1-4374-8505-e5226d912cfa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:12.836064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d887b7f6-a1d1-4374-8505-e5226d912cfa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:12.857176 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d887b7f6-a1d1-4374-8505-e5226d912cfa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.540768 May 21 21:26:12.858170 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1975/3823] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:12 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:13.453114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-adb6771f-af39-4eab-ae1e-d1193bd709a7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-792809645", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "8fb93757-9e97-46e8-8606-ce5e5b5ae334"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:13.517344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-adb6771f-af39-4eab-ae1e-d1193bd709a7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] validate_networks() for [('8fb93757-9e97-46e8-8606-ce5e5b5ae334', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:26:13.878229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-04c875ee-a9e8-48df-9999-2d3def534a4b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:13.880423 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-04c875ee-a9e8-48df-9999-2d3def534a4b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:13.892663 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-04c875ee-a9e8-48df-9999-2d3def534a4b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:13.893537 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-04c875ee-a9e8-48df-9999-2d3def534a4b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:13.894575 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-04c875ee-a9e8-48df-9999-2d3def534a4b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:13.895644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-04c875ee-a9e8-48df-9999-2d3def534a4b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:14.058807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-adb6771f-af39-4eab-ae1e-d1193bd709a7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:26:14.059260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-adb6771f-af39-4eab-ae1e-d1193bd709a7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:26:14.059981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-adb6771f-af39-4eab-ae1e-d1193bd709a7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:26:14.060429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-adb6771f-af39-4eab-ae1e-d1193bd709a7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:26:14.060852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-adb6771f-af39-4eab-ae1e-d1193bd709a7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:26:14.070619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-adb6771f-af39-4eab-ae1e-d1193bd709a7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:14.071076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-adb6771f-af39-4eab-ae1e-d1193bd709a7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:14.071887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-adb6771f-af39-4eab-ae1e-d1193bd709a7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:14.072353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-adb6771f-af39-4eab-ae1e-d1193bd709a7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:14.092345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-adb6771f-af39-4eab-ae1e-d1193bd709a7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Getting quotas for project a853a089c08b4fb288c1eb5ddcc30bbf. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:26:14.097891 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-adb6771f-af39-4eab-ae1e-d1193bd709a7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Getting quotas for user cc14047fba5947198634f831b653fbad and project a853a089c08b4fb288c1eb5ddcc30bbf. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:26:14.112502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-adb6771f-af39-4eab-ae1e-d1193bd709a7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:26:14.115083 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-adb6771f-af39-4eab-ae1e-d1193bd709a7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:26:14.139520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-04c875ee-a9e8-48df-9999-2d3def534a4b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:14.147727 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-04c875ee-a9e8-48df-9999-2d3def534a4b tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.275148 May 21 21:26:14.148409 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1976/3824] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:13 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:14.270319 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-adb6771f-af39-4eab-ae1e-d1193bd709a7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.008619 May 21 21:26:14.271784 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1849/3825] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:26:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:26:14.282957 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ce165993-d76f-481c-bf27-ea4b900d54d9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:14.292624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ce165993-d76f-481c-bf27-ea4b900d54d9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:14.351341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ce165993-d76f-481c-bf27-ea4b900d54d9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:14.358688 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ce165993-d76f-481c-bf27-ea4b900d54d9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1217 microversion: 2.1 time: 0.080985 May 21 21:26:14.359348 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1977/3826] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:14 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:15.165527 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-72670231-5827-4baf-9e5a-0313a72f9b6f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:15.166247 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-72670231-5827-4baf-9e5a-0313a72f9b6f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:15.174451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72670231-5827-4baf-9e5a-0313a72f9b6f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:15.174918 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72670231-5827-4baf-9e5a-0313a72f9b6f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:15.175695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72670231-5827-4baf-9e5a-0313a72f9b6f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:15.176144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72670231-5827-4baf-9e5a-0313a72f9b6f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:15.332948 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-72670231-5827-4baf-9e5a-0313a72f9b6f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:15.341467 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-72670231-5827-4baf-9e5a-0313a72f9b6f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.180166 May 21 21:26:15.342046 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1850/3827] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:15 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:15.375950 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-80452ca0-e50b-4fac-b5bf-2bcaa1bda8d9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:15.376750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-80452ca0-e50b-4fac-b5bf-2bcaa1bda8d9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:15.438392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-80452ca0-e50b-4fac-b5bf-2bcaa1bda8d9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:15.445262 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-80452ca0-e50b-4fac-b5bf-2bcaa1bda8d9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1217 microversion: 2.1 time: 0.073286 May 21 21:26:15.445945 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1978/3828] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:15 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:26:16.359947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aabd9bb9-b9cd-48f4-9087-bc315c1a523c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:16.361255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-aabd9bb9-b9cd-48f4-9087-bc315c1a523c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:16.368608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aabd9bb9-b9cd-48f4-9087-bc315c1a523c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:16.369222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aabd9bb9-b9cd-48f4-9087-bc315c1a523c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:16.370025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aabd9bb9-b9cd-48f4-9087-bc315c1a523c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:16.370709 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aabd9bb9-b9cd-48f4-9087-bc315c1a523c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:16.463988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c777c8b9-0219-4613-bac7-43bd6138e5e4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:16.464705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c777c8b9-0219-4613-bac7-43bd6138e5e4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:16.471868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c777c8b9-0219-4613-bac7-43bd6138e5e4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:16.472502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c777c8b9-0219-4613-bac7-43bd6138e5e4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:16.473298 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c777c8b9-0219-4613-bac7-43bd6138e5e4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:16.473752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c777c8b9-0219-4613-bac7-43bd6138e5e4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:16.544026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-aabd9bb9-b9cd-48f4-9087-bc315c1a523c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:16.548426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c777c8b9-0219-4613-bac7-43bd6138e5e4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:16.553272 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-aabd9bb9-b9cd-48f4-9087-bc315c1a523c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.197349 May 21 21:26:16.553940 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1851/3829] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:16 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:16.567844 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c777c8b9-0219-4613-bac7-43bd6138e5e4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1269 microversion: 2.1 time: 0.108445 May 21 21:26:16.568453 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1979/3830] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:16 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1269 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:26:17.570704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e3c5032a-5db3-4c3b-af29-92135b51d91c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:17.571321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e3c5032a-5db3-4c3b-af29-92135b51d91c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:17.579524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3c5032a-5db3-4c3b-af29-92135b51d91c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:17.579640 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3c5032a-5db3-4c3b-af29-92135b51d91c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:17.580418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3c5032a-5db3-4c3b-af29-92135b51d91c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:17.580867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3c5032a-5db3-4c3b-af29-92135b51d91c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:17.588773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7e4e5f3e-8ebb-455d-94bd-b2e8cd058f75 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:17.589456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7e4e5f3e-8ebb-455d-94bd-b2e8cd058f75 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:17.597268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e4e5f3e-8ebb-455d-94bd-b2e8cd058f75 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:17.597730 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e4e5f3e-8ebb-455d-94bd-b2e8cd058f75 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:17.598695 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e4e5f3e-8ebb-455d-94bd-b2e8cd058f75 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:17.599145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e4e5f3e-8ebb-455d-94bd-b2e8cd058f75 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:17.703837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7e4e5f3e-8ebb-455d-94bd-b2e8cd058f75 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:17.712259 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7e4e5f3e-8ebb-455d-94bd-b2e8cd058f75 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1287 microversion: 2.1 time: 0.126993 May 21 21:26:17.712707 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1980/3831] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:17 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1287 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:17.795307 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e3c5032a-5db3-4c3b-af29-92135b51d91c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:17.804589 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e3c5032a-5db3-4c3b-af29-92135b51d91c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1506 microversion: 2.1 time: 0.238057 May 21 21:26:17.815355 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1852/3832] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:17 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:26:18.731597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-202e6005-1861-4eed-9fbe-85e29ef47a14 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:18.732351 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-202e6005-1861-4eed-9fbe-85e29ef47a14 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:18.741544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-202e6005-1861-4eed-9fbe-85e29ef47a14 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:18.742409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-202e6005-1861-4eed-9fbe-85e29ef47a14 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:18.743456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-202e6005-1861-4eed-9fbe-85e29ef47a14 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:18.744206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-202e6005-1861-4eed-9fbe-85e29ef47a14 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:18.823612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d8bdf76c-a60c-40e5-9a57-632eb94e6a7a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:18.824896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d8bdf76c-a60c-40e5-9a57-632eb94e6a7a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:18.841887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8bdf76c-a60c-40e5-9a57-632eb94e6a7a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:18.842873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8bdf76c-a60c-40e5-9a57-632eb94e6a7a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:18.847048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8bdf76c-a60c-40e5-9a57-632eb94e6a7a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:18.847598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8bdf76c-a60c-40e5-9a57-632eb94e6a7a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:18.960206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-202e6005-1861-4eed-9fbe-85e29ef47a14 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:19.004271 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-202e6005-1861-4eed-9fbe-85e29ef47a14 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1317 microversion: 2.1 time: 0.278058 May 21 21:26:19.008498 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1981/3833] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:18 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:19.230686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d8bdf76c-a60c-40e5-9a57-632eb94e6a7a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:19.240647 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d8bdf76c-a60c-40e5-9a57-632eb94e6a7a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1486 microversion: 2.1 time: 0.422277 May 21 21:26:19.241996 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1853/3834] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:18 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1486 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:19.547453 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e3c4038b-a1d2-4fd0-9361-ab1e9fa78d41 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-554956086", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:19.642667 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-e3c4038b-a1d2-4fd0-9361-ab1e9fa78d41 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] validate_networks() for [('b0d29e2a-4338-409a-824e-8e0e576a94df', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:26:19.942092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-37830c99-8f1f-4683-b8da-c2c74d13ffe7 req-25a99de9-fecc-46a1-bbd0-96f4ad46db19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e0e0ad6-f09c-4c9f-8b87-a913053bf054", "tag": "d22060ad-f6ce-43cb-a43c-58ef612be0d7"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:19.958117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-37830c99-8f1f-4683-b8da-c2c74d13ffe7 req-25a99de9-fecc-46a1-bbd0-96f4ad46db19 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:19.958603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-37830c99-8f1f-4683-b8da-c2c74d13ffe7 req-25a99de9-fecc-46a1-bbd0-96f4ad46db19 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:19.972683 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-37830c99-8f1f-4683-b8da-c2c74d13ffe7 req-25a99de9-fecc-46a1-bbd0-96f4ad46db19 service nova] Creating event network-changed:d22060ad-f6ce-43cb-a43c-58ef612be0d7 for instance 8e0e0ad6-f09c-4c9f-8b87-a913053bf054 on nch2-master-1 May 21 21:26:19.977917 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-37830c99-8f1f-4683-b8da-c2c74d13ffe7 req-25a99de9-fecc-46a1-bbd0-96f4ad46db19 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039643 May 21 21:26:19.983604 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1854/3835] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:26:20.028645 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-24ed1a7f-bdee-449e-9f63-ca2fe9af3b53 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:20.033084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-24ed1a7f-bdee-449e-9f63-ca2fe9af3b53 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:20.042635 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24ed1a7f-bdee-449e-9f63-ca2fe9af3b53 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:20.043499 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24ed1a7f-bdee-449e-9f63-ca2fe9af3b53 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:20.045698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24ed1a7f-bdee-449e-9f63-ca2fe9af3b53 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:20.046252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24ed1a7f-bdee-449e-9f63-ca2fe9af3b53 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:20.236125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e3c4038b-a1d2-4fd0-9361-ab1e9fa78d41 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:26:20.236712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e3c4038b-a1d2-4fd0-9361-ab1e9fa78d41 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:26:20.237045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e3c4038b-a1d2-4fd0-9361-ab1e9fa78d41 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:26:20.237457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e3c4038b-a1d2-4fd0-9361-ab1e9fa78d41 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:26:20.237868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e3c4038b-a1d2-4fd0-9361-ab1e9fa78d41 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:26:20.259657 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3c4038b-a1d2-4fd0-9361-ab1e9fa78d41 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:20.260118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3c4038b-a1d2-4fd0-9361-ab1e9fa78d41 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:20.261027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3c4038b-a1d2-4fd0-9361-ab1e9fa78d41 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:20.261651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3c4038b-a1d2-4fd0-9361-ab1e9fa78d41 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:20.304981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-e3c4038b-a1d2-4fd0-9361-ab1e9fa78d41 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Getting quotas for project a4da9d7db0c74b55908d44fd7bc7d4ff. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:26:20.317268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-e3c4038b-a1d2-4fd0-9361-ab1e9fa78d41 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Getting quotas for user 12adb7ad474b4361812cd1f6ad70ef59 and project a4da9d7db0c74b55908d44fd7bc7d4ff. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:26:20.333961 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e3c4038b-a1d2-4fd0-9361-ab1e9fa78d41 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:26:20.336353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e3c4038b-a1d2-4fd0-9361-ab1e9fa78d41 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:26:20.476060 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e3c4038b-a1d2-4fd0-9361-ab1e9fa78d41 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.935139 May 21 21:26:20.477007 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1982/3836] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:26:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:26:20.504553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c71cef1f-eb27-48a3-9cee-122efa62d201 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:20.504981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-24ed1a7f-bdee-449e-9f63-ca2fe9af3b53 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:20.505202 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c71cef1f-eb27-48a3-9cee-122efa62d201 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:20.526867 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-24ed1a7f-bdee-449e-9f63-ca2fe9af3b53 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1317 microversion: 2.1 time: 0.507610 May 21 21:26:20.531301 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1855/3837] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:20 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1317 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:20.573581 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c71cef1f-eb27-48a3-9cee-122efa62d201 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:20.581108 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c71cef1f-eb27-48a3-9cee-122efa62d201 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1213 microversion: 2.1 time: 0.093380 May 21 21:26:20.581689 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1983/3838] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:20 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:26:21.543879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f8923a4e-be45-41d9-a204-c6654ea1e559 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:21.544540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f8923a4e-be45-41d9-a204-c6654ea1e559 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:21.551543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f8923a4e-be45-41d9-a204-c6654ea1e559 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:21.552033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f8923a4e-be45-41d9-a204-c6654ea1e559 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:21.552843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f8923a4e-be45-41d9-a204-c6654ea1e559 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:21.553291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f8923a4e-be45-41d9-a204-c6654ea1e559 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:21.597960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-21f9dca9-be51-4040-9a3b-2e8285719f82 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:21.598702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-21f9dca9-be51-4040-9a3b-2e8285719f82 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:21.607390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21f9dca9-be51-4040-9a3b-2e8285719f82 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:21.607850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21f9dca9-be51-4040-9a3b-2e8285719f82 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:21.608700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21f9dca9-be51-4040-9a3b-2e8285719f82 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:21.609146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21f9dca9-be51-4040-9a3b-2e8285719f82 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:21.694060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-21f9dca9-be51-4040-9a3b-2e8285719f82 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:21.705207 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-21f9dca9-be51-4040-9a3b-2e8285719f82 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1217 microversion: 2.1 time: 0.111063 May 21 21:26:21.706085 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1984/3839] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:21 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:21.721234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f8923a4e-be45-41d9-a204-c6654ea1e559 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:21.730581 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f8923a4e-be45-41d9-a204-c6654ea1e559 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1317 microversion: 2.1 time: 0.190686 May 21 21:26:21.731508 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1856/3840] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:21 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:22.139748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8be2c75d-0bc1-4961-aef1-6e041f778de3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:22.140787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8be2c75d-0bc1-4961-aef1-6e041f778de3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:22.146964 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8be2c75d-0bc1-4961-aef1-6e041f778de3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:22.147415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8be2c75d-0bc1-4961-aef1-6e041f778de3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:22.148216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8be2c75d-0bc1-4961-aef1-6e041f778de3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:22.148687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8be2c75d-0bc1-4961-aef1-6e041f778de3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:22.202935 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8be2c75d-0bc1-4961-aef1-6e041f778de3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "POST /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941/action" status: 200 len: 40212 microversion: 2.32 time: 0.067924 May 21 21:26:22.208810 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1985/3841] 10.222.0.49 () {62 vars in 1318 bytes} [Sat May 21 21:26:22 2022] POST /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941/action => generated 40212 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 21 21:26:22.216074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a3b3178d-c3e7-4130-a1bb-f7e45e7e11a0 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:22.216808 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a3b3178d-c3e7-4130-a1bb-f7e45e7e11a0 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:22.223299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3b3178d-c3e7-4130-a1bb-f7e45e7e11a0 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:22.223758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3b3178d-c3e7-4130-a1bb-f7e45e7e11a0 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:22.224573 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3b3178d-c3e7-4130-a1bb-f7e45e7e11a0 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:22.225334 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3b3178d-c3e7-4130-a1bb-f7e45e7e11a0 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:22.253878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a3b3178d-c3e7-4130-a1bb-f7e45e7e11a0 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:26:22.711311 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a3b3178d-c3e7-4130-a1bb-f7e45e7e11a0 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 204 len: 0 microversion: 2.32 time: 0.499680 May 21 21:26:22.712124 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1857/3842] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:26:22 2022] DELETE /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:26:22.721747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b59c87b8-8ccf-478a-8575-9c3f18f7b67e tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:22.722524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b59c87b8-8ccf-478a-8575-9c3f18f7b67e tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:22.723511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-961c97a9-49c2-4c37-a9a7-05ceaa3ca926 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:22.727051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-961c97a9-49c2-4c37-a9a7-05ceaa3ca926 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:22.731063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b59c87b8-8ccf-478a-8575-9c3f18f7b67e tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:22.731522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b59c87b8-8ccf-478a-8575-9c3f18f7b67e tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:22.732336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b59c87b8-8ccf-478a-8575-9c3f18f7b67e tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:22.732787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b59c87b8-8ccf-478a-8575-9c3f18f7b67e tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:22.732918 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-961c97a9-49c2-4c37-a9a7-05ceaa3ca926 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:22.733311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-961c97a9-49c2-4c37-a9a7-05ceaa3ca926 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:22.734083 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-961c97a9-49c2-4c37-a9a7-05ceaa3ca926 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:22.734526 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-961c97a9-49c2-4c37-a9a7-05ceaa3ca926 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:22.738542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:22.738836 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:22.834038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-961c97a9-49c2-4c37-a9a7-05ceaa3ca926 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:22.845070 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-961c97a9-49c2-4c37-a9a7-05ceaa3ca926 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1265 microversion: 2.1 time: 0.125861 May 21 21:26:22.848588 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1858/3843] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:22 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:26:22.858890 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2de7762c-c5ba-4a02-9ba1-4ce7f4981095 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:22.859562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2de7762c-c5ba-4a02-9ba1-4ce7f4981095 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:22.866239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2de7762c-c5ba-4a02-9ba1-4ce7f4981095 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:22.867333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2de7762c-c5ba-4a02-9ba1-4ce7f4981095 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:22.868273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2de7762c-c5ba-4a02-9ba1-4ce7f4981095 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:22.869502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2de7762c-c5ba-4a02-9ba1-4ce7f4981095 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:22.994834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b59c87b8-8ccf-478a-8575-9c3f18f7b67e tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:23.001148 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b59c87b8-8ccf-478a-8575-9c3f18f7b67e tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:23.002661 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b59c87b8-8ccf-478a-8575-9c3f18f7b67e tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:23.003923 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b59c87b8-8ccf-478a-8575-9c3f18f7b67e tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 2955 microversion: 2.32 time: 0.287366 May 21 21:26:23.004538 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1986/3844] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:26:22 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 2955 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:26:23.082672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2de7762c-c5ba-4a02-9ba1-4ce7f4981095 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:23.090401 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2de7762c-c5ba-4a02-9ba1-4ce7f4981095 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1317 microversion: 2.1 time: 0.240071 May 21 21:26:23.098642 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1859/3845] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:22 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:23.862859 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-34a7bc00-a3de-40a9-b600-7dff9e91ad0f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:23.865108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-34a7bc00-a3de-40a9-b600-7dff9e91ad0f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:23.874829 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34a7bc00-a3de-40a9-b600-7dff9e91ad0f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:23.875670 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34a7bc00-a3de-40a9-b600-7dff9e91ad0f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:23.876657 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34a7bc00-a3de-40a9-b600-7dff9e91ad0f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:23.877508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34a7bc00-a3de-40a9-b600-7dff9e91ad0f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:23.974714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-34a7bc00-a3de-40a9-b600-7dff9e91ad0f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:23.984947 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-34a7bc00-a3de-40a9-b600-7dff9e91ad0f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1271 microversion: 2.1 time: 0.126366 May 21 21:26:23.985739 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1987/3846] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:23 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1271 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:24.026962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e84d2b63-5c4e-4bb3-98e5-47f5e62ccad3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:24.027669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e84d2b63-5c4e-4bb3-98e5-47f5e62ccad3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:24.035752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e84d2b63-5c4e-4bb3-98e5-47f5e62ccad3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:24.036206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e84d2b63-5c4e-4bb3-98e5-47f5e62ccad3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:24.037019 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e84d2b63-5c4e-4bb3-98e5-47f5e62ccad3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:24.037460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e84d2b63-5c4e-4bb3-98e5-47f5e62ccad3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:24.081343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:24.115236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-54415fbf-0261-41fc-aaff-2665babe52a1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:24.115236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-54415fbf-0261-41fc-aaff-2665babe52a1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:24.115423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:24.125149 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54415fbf-0261-41fc-aaff-2665babe52a1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:24.126009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54415fbf-0261-41fc-aaff-2665babe52a1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:24.127248 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54415fbf-0261-41fc-aaff-2665babe52a1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:24.128018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54415fbf-0261-41fc-aaff-2665babe52a1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:24.392328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-54415fbf-0261-41fc-aaff-2665babe52a1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:24.408372 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-54415fbf-0261-41fc-aaff-2665babe52a1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1317 microversion: 2.1 time: 0.302282 May 21 21:26:24.424203 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1988/3847] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:24 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:24.765347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e84d2b63-5c4e-4bb3-98e5-47f5e62ccad3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:24.774279 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e84d2b63-5c4e-4bb3-98e5-47f5e62ccad3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:24.776650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e84d2b63-5c4e-4bb3-98e5-47f5e62ccad3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:24.778169 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e84d2b63-5c4e-4bb3-98e5-47f5e62ccad3 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 2955 microversion: 2.32 time: 0.755697 May 21 21:26:24.779014 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1860/3848] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:26:24 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 2955 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:26:25.002936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6572752b-1019-4456-af1b-cd336d7be0a6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:25.003665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6572752b-1019-4456-af1b-cd336d7be0a6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:25.018865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6572752b-1019-4456-af1b-cd336d7be0a6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:25.019400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6572752b-1019-4456-af1b-cd336d7be0a6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:25.020269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6572752b-1019-4456-af1b-cd336d7be0a6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:25.020816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6572752b-1019-4456-af1b-cd336d7be0a6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:25.202528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6572752b-1019-4456-af1b-cd336d7be0a6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:25.213521 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6572752b-1019-4456-af1b-cd336d7be0a6 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1313 microversion: 2.1 time: 0.214433 May 21 21:26:25.223417 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1989/3849] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:24 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:25.430758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5d211134-0cfc-4f12-8d8c-038e2393a1e0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:25.432061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5d211134-0cfc-4f12-8d8c-038e2393a1e0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:25.440364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d211134-0cfc-4f12-8d8c-038e2393a1e0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:25.440882 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d211134-0cfc-4f12-8d8c-038e2393a1e0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:25.441714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d211134-0cfc-4f12-8d8c-038e2393a1e0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:25.442327 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d211134-0cfc-4f12-8d8c-038e2393a1e0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:25.800331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5a8dd15a-865f-4a61-bf7e-990925057d56 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:25.805848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5a8dd15a-865f-4a61-bf7e-990925057d56 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:25.820456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:25.827314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5a8dd15a-865f-4a61-bf7e-990925057d56 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:25.834928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5a8dd15a-865f-4a61-bf7e-990925057d56 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:25.834928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5a8dd15a-865f-4a61-bf7e-990925057d56 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:25.834928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5a8dd15a-865f-4a61-bf7e-990925057d56 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:25.916751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5d211134-0cfc-4f12-8d8c-038e2393a1e0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:25.927599 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5d211134-0cfc-4f12-8d8c-038e2393a1e0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1317 microversion: 2.1 time: 0.501222 May 21 21:26:25.929086 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1861/3850] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:25 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:26.149702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5a8dd15a-865f-4a61-bf7e-990925057d56 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:26.164937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5a8dd15a-865f-4a61-bf7e-990925057d56 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:26.164937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5a8dd15a-865f-4a61-bf7e-990925057d56 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:26.165821 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5a8dd15a-865f-4a61-bf7e-990925057d56 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 2934 microversion: 2.32 time: 0.370584 May 21 21:26:26.166690 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1990/3851] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:26:25 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 2934 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:26:26.236622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d0c6b225-d76f-47e4-8865-e0078e59af4a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:26.237320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d0c6b225-d76f-47e4-8865-e0078e59af4a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:26.245706 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0c6b225-d76f-47e4-8865-e0078e59af4a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:26.246146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0c6b225-d76f-47e4-8865-e0078e59af4a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:26.246969 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0c6b225-d76f-47e4-8865-e0078e59af4a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:26.247411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0c6b225-d76f-47e4-8865-e0078e59af4a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:26.349540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-08f536f1-1876-47a1-895d-95a36b6ba82b req-3baf5589-e5b4-4048-8583-4787e7b63bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0e0ad6-f09c-4c9f-8b87-a913053bf054", "name": "network-vif-plugged", "status": "completed", "tag": "d22060ad-f6ce-43cb-a43c-58ef612be0d7"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:26.363155 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-08f536f1-1876-47a1-895d-95a36b6ba82b req-3baf5589-e5b4-4048-8583-4787e7b63bb3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:26.363734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-08f536f1-1876-47a1-895d-95a36b6ba82b req-3baf5589-e5b4-4048-8583-4787e7b63bb3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:26.378770 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-08f536f1-1876-47a1-895d-95a36b6ba82b req-3baf5589-e5b4-4048-8583-4787e7b63bb3 service nova] Creating event network-vif-plugged:d22060ad-f6ce-43cb-a43c-58ef612be0d7 for instance 8e0e0ad6-f09c-4c9f-8b87-a913053bf054 on nch2-master-1 May 21 21:26:26.386093 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-08f536f1-1876-47a1-895d-95a36b6ba82b req-3baf5589-e5b4-4048-8583-4787e7b63bb3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040920 May 21 21:26:26.387608 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1991/3852] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:26:26.750385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d0c6b225-d76f-47e4-8865-e0078e59af4a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:26.758114 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d0c6b225-d76f-47e4-8865-e0078e59af4a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1313 microversion: 2.1 time: 0.530113 May 21 21:26:26.767860 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1862/3853] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:26 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1313 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:26.949542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5ab35969-431e-490d-a1f7-dbd34caef922 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:26.950628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5ab35969-431e-490d-a1f7-dbd34caef922 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:26.963417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ab35969-431e-490d-a1f7-dbd34caef922 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:26.964182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ab35969-431e-490d-a1f7-dbd34caef922 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:26.965249 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ab35969-431e-490d-a1f7-dbd34caef922 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:26.966478 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ab35969-431e-490d-a1f7-dbd34caef922 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:27.151696 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5ab35969-431e-490d-a1f7-dbd34caef922 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:27.162988 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5ab35969-431e-490d-a1f7-dbd34caef922 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1317 microversion: 2.1 time: 0.220733 May 21 21:26:27.163407 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1992/3854] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:26 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:27.195775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dd86128f-bf95-4fa2-b36b-e944e7cc8e83 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:27.196419 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dd86128f-bf95-4fa2-b36b-e944e7cc8e83 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:27.206802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd86128f-bf95-4fa2-b36b-e944e7cc8e83 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:27.207100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd86128f-bf95-4fa2-b36b-e944e7cc8e83 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:27.208249 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd86128f-bf95-4fa2-b36b-e944e7cc8e83 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:27.208726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd86128f-bf95-4fa2-b36b-e944e7cc8e83 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:27.336762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-0022ec91-bed4-49fd-b498-4c7da95b90f5 req-3ef8947f-748a-4dcb-a839-5ec1df67a13d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "453d2270-109d-4b11-9eae-01fadd67a6cb", "tag": "aa5d2d0b-b2ef-482d-a3cf-2881c7beccc4"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:27.348058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-0022ec91-bed4-49fd-b498-4c7da95b90f5 req-3ef8947f-748a-4dcb-a839-5ec1df67a13d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:27.349073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-0022ec91-bed4-49fd-b498-4c7da95b90f5 req-3ef8947f-748a-4dcb-a839-5ec1df67a13d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:27.362985 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-0022ec91-bed4-49fd-b498-4c7da95b90f5 req-3ef8947f-748a-4dcb-a839-5ec1df67a13d service nova] Creating event network-changed:aa5d2d0b-b2ef-482d-a3cf-2881c7beccc4 for instance 453d2270-109d-4b11-9eae-01fadd67a6cb on nch2-master-1 May 21 21:26:27.369441 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-0022ec91-bed4-49fd-b498-4c7da95b90f5 req-3ef8947f-748a-4dcb-a839-5ec1df67a13d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036482 May 21 21:26:27.371838 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1993/3855] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:26:27.746007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dd86128f-bf95-4fa2-b36b-e944e7cc8e83 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:27.756316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dd86128f-bf95-4fa2-b36b-e944e7cc8e83 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:27.758592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dd86128f-bf95-4fa2-b36b-e944e7cc8e83 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:27.771208 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dd86128f-bf95-4fa2-b36b-e944e7cc8e83 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 2913 microversion: 2.32 time: 0.568669 May 21 21:26:27.771208 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1863/3856] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:26:27 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 2913 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:26:27.779333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3da17e5c-0f61-4fb4-a32e-63fc6324b271 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:27.780636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3da17e5c-0f61-4fb4-a32e-63fc6324b271 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:27.792595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3da17e5c-0f61-4fb4-a32e-63fc6324b271 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:27.793649 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3da17e5c-0f61-4fb4-a32e-63fc6324b271 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:27.795973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3da17e5c-0f61-4fb4-a32e-63fc6324b271 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:27.796412 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3da17e5c-0f61-4fb4-a32e-63fc6324b271 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:28.006651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3da17e5c-0f61-4fb4-a32e-63fc6324b271 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:28.017842 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3da17e5c-0f61-4fb4-a32e-63fc6324b271 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1313 microversion: 2.1 time: 0.246443 May 21 21:26:28.019307 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1994/3857] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:27 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:28.179436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c9042628-fa2c-48fd-aee5-15127e57bdf8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:28.181544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c9042628-fa2c-48fd-aee5-15127e57bdf8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:28.195645 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9042628-fa2c-48fd-aee5-15127e57bdf8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:28.197662 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9042628-fa2c-48fd-aee5-15127e57bdf8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:28.198930 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9042628-fa2c-48fd-aee5-15127e57bdf8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:28.199958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9042628-fa2c-48fd-aee5-15127e57bdf8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:28.507148 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-c8827bb0-039e-4c0a-b71d-bf5f83f4c39a req-3a63b8bf-2c26-40de-9543-7683ca060a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "name": "network-vif-unplugged", "status": "completed", "tag": "47e2d024-64c4-4e87-9d61-1a91c3bdd681"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:28.518415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c8827bb0-039e-4c0a-b71d-bf5f83f4c39a req-3a63b8bf-2c26-40de-9543-7683ca060a7d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:28.518975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c8827bb0-039e-4c0a-b71d-bf5f83f4c39a req-3a63b8bf-2c26-40de-9543-7683ca060a7d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:28.537721 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-c8827bb0-039e-4c0a-b71d-bf5f83f4c39a req-3a63b8bf-2c26-40de-9543-7683ca060a7d service nova] Creating event network-vif-unplugged:47e2d024-64c4-4e87-9d61-1a91c3bdd681 for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:26:28.543657 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-c8827bb0-039e-4c0a-b71d-bf5f83f4c39a req-3a63b8bf-2c26-40de-9543-7683ca060a7d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040928 May 21 21:26:28.544660 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1995/3858] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:26:28.558197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c9042628-fa2c-48fd-aee5-15127e57bdf8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:28.566584 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c9042628-fa2c-48fd-aee5-15127e57bdf8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1507 microversion: 2.1 time: 0.391465 May 21 21:26:28.568667 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1864/3859] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:28 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1507 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:28.589117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aa893982-3c7b-4f68-9754-de1ba11f55b5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:28.589940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aa893982-3c7b-4f68-9754-de1ba11f55b5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:28.598912 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa893982-3c7b-4f68-9754-de1ba11f55b5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:28.605016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa893982-3c7b-4f68-9754-de1ba11f55b5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:28.605016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa893982-3c7b-4f68-9754-de1ba11f55b5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:28.605016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa893982-3c7b-4f68-9754-de1ba11f55b5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:28.784093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-34ec192d-465f-407e-a1c1-62b00bc5fa69 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:28.784744 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-34ec192d-465f-407e-a1c1-62b00bc5fa69 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:28.796164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34ec192d-465f-407e-a1c1-62b00bc5fa69 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:28.797033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34ec192d-465f-407e-a1c1-62b00bc5fa69 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:28.798160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34ec192d-465f-407e-a1c1-62b00bc5fa69 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:28.803193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34ec192d-465f-407e-a1c1-62b00bc5fa69 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:28.907025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aa893982-3c7b-4f68-9754-de1ba11f55b5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:28.917990 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aa893982-3c7b-4f68-9754-de1ba11f55b5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1507 microversion: 2.1 time: 0.335937 May 21 21:26:28.918618 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1996/3860] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:28 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1507 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:28.936045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-06aa6591-db5b-497f-8458-9d69e6b425f0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "OS-DCF:diskConfig": "AUTO"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:28.938184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-06aa6591-db5b-497f-8458-9d69e6b425f0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:28.952004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06aa6591-db5b-497f-8458-9d69e6b425f0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:28.952750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06aa6591-db5b-497f-8458-9d69e6b425f0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:28.954836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06aa6591-db5b-497f-8458-9d69e6b425f0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:28.955458 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06aa6591-db5b-497f-8458-9d69e6b425f0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:29.061980 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-06aa6591-db5b-497f-8458-9d69e6b425f0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:26:29.062600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-06aa6591-db5b-497f-8458-9d69e6b425f0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:26:29.063262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-06aa6591-db5b-497f-8458-9d69e6b425f0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:26:29.063689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-06aa6591-db5b-497f-8458-9d69e6b425f0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:26:29.064102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-06aa6591-db5b-497f-8458-9d69e6b425f0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:26:29.258257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-34ec192d-465f-407e-a1c1-62b00bc5fa69 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:29.270532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-34ec192d-465f-407e-a1c1-62b00bc5fa69 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:29.272460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-34ec192d-465f-407e-a1c1-62b00bc5fa69 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:29.273873 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-34ec192d-465f-407e-a1c1-62b00bc5fa69 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 2866 microversion: 2.32 time: 0.493659 May 21 21:26:29.275365 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1865/3861] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:26:28 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 2866 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:26:29.281697 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b95144cd-7705-490f-991f-628f66fd8401 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:29.286587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b95144cd-7705-490f-991f-628f66fd8401 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:29.291415 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b95144cd-7705-490f-991f-628f66fd8401 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:29.292359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b95144cd-7705-490f-991f-628f66fd8401 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:29.294123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b95144cd-7705-490f-991f-628f66fd8401 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:29.295321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b95144cd-7705-490f-991f-628f66fd8401 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:29.377045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-06aa6591-db5b-497f-8458-9d69e6b425f0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:29.392577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06aa6591-db5b-497f-8458-9d69e6b425f0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:29.393476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06aa6591-db5b-497f-8458-9d69e6b425f0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:29.394478 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06aa6591-db5b-497f-8458-9d69e6b425f0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:29.395089 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06aa6591-db5b-497f-8458-9d69e6b425f0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:29.443762 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-06aa6591-db5b-497f-8458-9d69e6b425f0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "POST /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054/action" status: 202 len: 1109 microversion: 2.1 time: 0.513140 May 21 21:26:29.462990 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1997/3862] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:26:28 2022] POST /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054/action => generated 1109 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 21 21:26:29.472228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-fd6d4164-5599-4e6d-a0fc-c01e35703277 req-a83fc519-c282-49d1-90c4-2ea03a2f8ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "name": "network-vif-deleted", "tag": "3d35e5b8-e654-4f4c-91c1-813a3bf3bedf"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:29.483363 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-fd6d4164-5599-4e6d-a0fc-c01e35703277 req-a83fc519-c282-49d1-90c4-2ea03a2f8ab4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:29.484103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-fd6d4164-5599-4e6d-a0fc-c01e35703277 req-a83fc519-c282-49d1-90c4-2ea03a2f8ab4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:29.506774 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-fd6d4164-5599-4e6d-a0fc-c01e35703277 req-a83fc519-c282-49d1-90c4-2ea03a2f8ab4 service nova] Creating event network-vif-deleted:3d35e5b8-e654-4f4c-91c1-813a3bf3bedf for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:26:29.533119 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-fd6d4164-5599-4e6d-a0fc-c01e35703277 req-a83fc519-c282-49d1-90c4-2ea03a2f8ab4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067540 May 21 21:26:29.534119 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1998/3863] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:26:29.542786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cd5b3515-fbe2-4e04-874f-c1635d070ba5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:29.547449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cd5b3515-fbe2-4e04-874f-c1635d070ba5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:29.554465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd5b3515-fbe2-4e04-874f-c1635d070ba5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:29.555250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd5b3515-fbe2-4e04-874f-c1635d070ba5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:29.556330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd5b3515-fbe2-4e04-874f-c1635d070ba5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:29.557080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd5b3515-fbe2-4e04-874f-c1635d070ba5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:29.747364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b95144cd-7705-490f-991f-628f66fd8401 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:29.761618 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b95144cd-7705-490f-991f-628f66fd8401 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1313 microversion: 2.1 time: 0.484734 May 21 21:26:29.764454 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1866/3864] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:29 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1313 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:29.832671 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cd5b3515-fbe2-4e04-874f-c1635d070ba5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:29.845274 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cd5b3515-fbe2-4e04-874f-c1635d070ba5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.309822 May 21 21:26:29.848789 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 1999/3865] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:29 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:30.298368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c6f1bf0b-f0ef-4895-b43b-6cc7858cf67c tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:30.300663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c6f1bf0b-f0ef-4895-b43b-6cc7858cf67c tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:30.307945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c6f1bf0b-f0ef-4895-b43b-6cc7858cf67c tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:30.308698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c6f1bf0b-f0ef-4895-b43b-6cc7858cf67c tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:30.309693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c6f1bf0b-f0ef-4895-b43b-6cc7858cf67c tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:30.310369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c6f1bf0b-f0ef-4895-b43b-6cc7858cf67c tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:30.564220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-edbfa62d-7cbc-4105-97f5-87a18cd60f1e req-3485eb0d-03fd-4fba-ae43-a4d2db668714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "name": "network-vif-unplugged", "status": "completed", "tag": "48dd9dc9-3303-40c5-903b-4f36c5908e91"}, {"server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "name": "network-vif-unplugged", "status": "completed", "tag": "e9977234-a2ec-4c9f-a0fe-3e3caa959f0c"}, {"server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "name": "network-vif-unplugged", "status": "completed", "tag": "372fb508-d9ed-4893-bad7-003dffcb0ca7"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:30.575671 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:30.578837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=12 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:30.585972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-edbfa62d-7cbc-4105-97f5-87a18cd60f1e req-3485eb0d-03fd-4fba-ae43-a4d2db668714 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:30.587131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-edbfa62d-7cbc-4105-97f5-87a18cd60f1e req-3485eb0d-03fd-4fba-ae43-a4d2db668714 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:30.608832 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-edbfa62d-7cbc-4105-97f5-87a18cd60f1e req-3485eb0d-03fd-4fba-ae43-a4d2db668714 service nova] Creating event network-vif-unplugged:48dd9dc9-3303-40c5-903b-4f36c5908e91 for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:26:30.609679 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-edbfa62d-7cbc-4105-97f5-87a18cd60f1e req-3485eb0d-03fd-4fba-ae43-a4d2db668714 service nova] Creating event network-vif-unplugged:e9977234-a2ec-4c9f-a0fe-3e3caa959f0c for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:26:30.610529 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-edbfa62d-7cbc-4105-97f5-87a18cd60f1e req-3485eb0d-03fd-4fba-ae43-a4d2db668714 service nova] Creating event network-vif-unplugged:372fb508-d9ed-4893-bad7-003dffcb0ca7 for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:26:30.620407 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-edbfa62d-7cbc-4105-97f5-87a18cd60f1e req-3485eb0d-03fd-4fba-ae43-a4d2db668714 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.061972 May 21 21:26:30.621031 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2000/3866] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:26:30.644456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c6f1bf0b-f0ef-4895-b43b-6cc7858cf67c tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:30.657119 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c6f1bf0b-f0ef-4895-b43b-6cc7858cf67c tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:30.658286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c6f1bf0b-f0ef-4895-b43b-6cc7858cf67c tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:30.663839 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c6f1bf0b-f0ef-4895-b43b-6cc7858cf67c tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 2705 microversion: 2.32 time: 0.365295 May 21 21:26:30.663839 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1867/3867] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:26:30 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 2705 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:26:30.785872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-34f05cff-c3c7-43b0-b06d-20ea7817ad43 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:30.786913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-34f05cff-c3c7-43b0-b06d-20ea7817ad43 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:30.796051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34f05cff-c3c7-43b0-b06d-20ea7817ad43 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:30.796559 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34f05cff-c3c7-43b0-b06d-20ea7817ad43 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:30.797362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34f05cff-c3c7-43b0-b06d-20ea7817ad43 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:30.797834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34f05cff-c3c7-43b0-b06d-20ea7817ad43 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:30.868769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1f192fde-d2e4-4f41-b5ec-25e420b19033 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:30.873872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1f192fde-d2e4-4f41-b5ec-25e420b19033 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:30.901743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f192fde-d2e4-4f41-b5ec-25e420b19033 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:30.902239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f192fde-d2e4-4f41-b5ec-25e420b19033 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:30.907736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f192fde-d2e4-4f41-b5ec-25e420b19033 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:30.908647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f192fde-d2e4-4f41-b5ec-25e420b19033 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:31.033002 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-34f05cff-c3c7-43b0-b06d-20ea7817ad43 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:31.041690 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-34f05cff-c3c7-43b0-b06d-20ea7817ad43 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1313 microversion: 2.1 time: 0.263452 May 21 21:26:31.042282 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2001/3868] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:30 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:31.131240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1f192fde-d2e4-4f41-b5ec-25e420b19033 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:31.147805 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1f192fde-d2e4-4f41-b5ec-25e420b19033 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.285504 May 21 21:26:31.150408 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1868/3869] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:30 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:31.553977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-b47dd3f0-c1a1-4544-9008-e97001d559f9 req-1a43aa70-c4cc-47d2-906d-6ee3d331a03d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "name": "network-vif-deleted", "tag": "372fb508-d9ed-4893-bad7-003dffcb0ca7"}, {"server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "name": "network-vif-deleted", "tag": "e9977234-a2ec-4c9f-a0fe-3e3caa959f0c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:31.563265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b47dd3f0-c1a1-4544-9008-e97001d559f9 req-1a43aa70-c4cc-47d2-906d-6ee3d331a03d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:31.563717 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b47dd3f0-c1a1-4544-9008-e97001d559f9 req-1a43aa70-c4cc-47d2-906d-6ee3d331a03d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:31.577323 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-b47dd3f0-c1a1-4544-9008-e97001d559f9 req-1a43aa70-c4cc-47d2-906d-6ee3d331a03d service nova] Creating event network-vif-deleted:372fb508-d9ed-4893-bad7-003dffcb0ca7 for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:26:31.578809 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-b47dd3f0-c1a1-4544-9008-e97001d559f9 req-1a43aa70-c4cc-47d2-906d-6ee3d331a03d service nova] Creating event network-vif-deleted:e9977234-a2ec-4c9f-a0fe-3e3caa959f0c for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:26:31.589863 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-b47dd3f0-c1a1-4544-9008-e97001d559f9 req-1a43aa70-c4cc-47d2-906d-6ee3d331a03d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034648 May 21 21:26:31.589863 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2002/3870] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:26:31.681226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-16efbd8f-75c3-4eab-8818-45f7e4684361 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:31.683364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-16efbd8f-75c3-4eab-8818-45f7e4684361 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:31.695455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-16efbd8f-75c3-4eab-8818-45f7e4684361 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:31.695917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-16efbd8f-75c3-4eab-8818-45f7e4684361 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:31.699533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-16efbd8f-75c3-4eab-8818-45f7e4684361 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:31.699984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-16efbd8f-75c3-4eab-8818-45f7e4684361 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:32.063774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-00fa4cae-a3cb-42ba-b6d5-3cf89f32fb49 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:32.065037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-00fa4cae-a3cb-42ba-b6d5-3cf89f32fb49 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:32.089720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00fa4cae-a3cb-42ba-b6d5-3cf89f32fb49 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:32.091389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00fa4cae-a3cb-42ba-b6d5-3cf89f32fb49 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:32.093628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00fa4cae-a3cb-42ba-b6d5-3cf89f32fb49 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:32.095990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00fa4cae-a3cb-42ba-b6d5-3cf89f32fb49 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:32.185474 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-16efbd8f-75c3-4eab-8818-45f7e4684361 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:32.200025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-16efbd8f-75c3-4eab-8818-45f7e4684361 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:32.203874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-16efbd8f-75c3-4eab-8818-45f7e4684361 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:32.208014 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-16efbd8f-75c3-4eab-8818-45f7e4684361 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 2611 microversion: 2.32 time: 0.531385 May 21 21:26:32.223149 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1869/3871] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:26:31 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 2611 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:26:32.223149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b1fca5d9-f450-4658-85cd-45d99c6782a4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:32.223149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b1fca5d9-f450-4658-85cd-45d99c6782a4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:32.247931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b1fca5d9-f450-4658-85cd-45d99c6782a4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:32.248977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b1fca5d9-f450-4658-85cd-45d99c6782a4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:32.250530 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b1fca5d9-f450-4658-85cd-45d99c6782a4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:32.251245 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b1fca5d9-f450-4658-85cd-45d99c6782a4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:32.378076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-00fa4cae-a3cb-42ba-b6d5-3cf89f32fb49 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:32.393030 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-00fa4cae-a3cb-42ba-b6d5-3cf89f32fb49 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1313 microversion: 2.1 time: 0.337489 May 21 21:26:32.405161 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2003/3872] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:32 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:26:32.625067 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b1fca5d9-f450-4658-85cd-45d99c6782a4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:32.632625 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b1fca5d9-f450-4658-85cd-45d99c6782a4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.420113 May 21 21:26:32.633213 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1870/3873] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:32 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:33.231257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4894c1d2-150d-4f30-bc93-e61406e62d95 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:33.233542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4894c1d2-150d-4f30-bc93-e61406e62d95 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:33.241863 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4894c1d2-150d-4f30-bc93-e61406e62d95 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:33.242141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4894c1d2-150d-4f30-bc93-e61406e62d95 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:33.244111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4894c1d2-150d-4f30-bc93-e61406e62d95 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:33.244840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4894c1d2-150d-4f30-bc93-e61406e62d95 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:33.325002 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4894c1d2-150d-4f30-bc93-e61406e62d95 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:33.328954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:33.334996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4894c1d2-150d-4f30-bc93-e61406e62d95 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:33.336651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4894c1d2-150d-4f30-bc93-e61406e62d95 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:33.337972 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4894c1d2-150d-4f30-bc93-e61406e62d95 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 2273 microversion: 2.32 time: 0.111676 May 21 21:26:33.338564 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2004/3874] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:26:33 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 2273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:26:33.412508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dbd2ca9c-7a15-448b-be2d-e9ba732ca5d2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:33.413265 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dbd2ca9c-7a15-448b-be2d-e9ba732ca5d2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:33.422722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbd2ca9c-7a15-448b-be2d-e9ba732ca5d2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:33.423905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbd2ca9c-7a15-448b-be2d-e9ba732ca5d2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:33.424141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbd2ca9c-7a15-448b-be2d-e9ba732ca5d2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:33.424842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbd2ca9c-7a15-448b-be2d-e9ba732ca5d2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:33.611029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-65ca4986-691d-4a99-b3fc-83e2296b2865 req-1f08c80c-7648-47c5-a2ec-230c8e307bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "name": "network-vif-deleted", "tag": "48dd9dc9-3303-40c5-903b-4f36c5908e91"}, {"server_uuid": "8e0e86cc-36f0-4330-8251-6ff17fd22941", "name": "network-vif-deleted", "tag": "47e2d024-64c4-4e87-9d61-1a91c3bdd681"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:33.628927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-65ca4986-691d-4a99-b3fc-83e2296b2865 req-1f08c80c-7648-47c5-a2ec-230c8e307bfc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:33.633946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-65ca4986-691d-4a99-b3fc-83e2296b2865 req-1f08c80c-7648-47c5-a2ec-230c8e307bfc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:33.661417 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-65ca4986-691d-4a99-b3fc-83e2296b2865 req-1f08c80c-7648-47c5-a2ec-230c8e307bfc service nova] Creating event network-vif-deleted:48dd9dc9-3303-40c5-903b-4f36c5908e91 for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:26:33.662718 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-65ca4986-691d-4a99-b3fc-83e2296b2865 req-1f08c80c-7648-47c5-a2ec-230c8e307bfc service nova] Creating event network-vif-deleted:47e2d024-64c4-4e87-9d61-1a91c3bdd681 for instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 on nch1-master-1 May 21 21:26:33.673364 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-65ca4986-691d-4a99-b3fc-83e2296b2865 req-1f08c80c-7648-47c5-a2ec-230c8e307bfc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067055 May 21 21:26:33.674012 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2005/3875] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:26:33.684676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dbd2ca9c-7a15-448b-be2d-e9ba732ca5d2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:33.705245 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dbd2ca9c-7a15-448b-be2d-e9ba732ca5d2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1313 microversion: 2.1 time: 0.294855 May 21 21:26:33.706542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3b373c26-cd09-42a8-ad46-66cc2d10ca62 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:33.707517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3b373c26-cd09-42a8-ad46-66cc2d10ca62 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:33.717571 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1871/3876] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:33 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:33.729052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b373c26-cd09-42a8-ad46-66cc2d10ca62 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:33.729650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b373c26-cd09-42a8-ad46-66cc2d10ca62 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:33.730788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b373c26-cd09-42a8-ad46-66cc2d10ca62 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:33.731238 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b373c26-cd09-42a8-ad46-66cc2d10ca62 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:33.922651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3b373c26-cd09-42a8-ad46-66cc2d10ca62 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:33.930705 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3b373c26-cd09-42a8-ad46-66cc2d10ca62 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.255371 May 21 21:26:33.931293 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2006/3877] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:33 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:34.205219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-e299d44c-f55f-4200-90d1-4babb4fd68b3 req-8f072482-25ab-4fa7-8f28-e5aa2996b07a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "453d2270-109d-4b11-9eae-01fadd67a6cb", "name": "network-vif-plugged", "status": "completed", "tag": "aa5d2d0b-b2ef-482d-a3cf-2881c7beccc4"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:34.215993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e299d44c-f55f-4200-90d1-4babb4fd68b3 req-8f072482-25ab-4fa7-8f28-e5aa2996b07a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:34.216647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e299d44c-f55f-4200-90d1-4babb4fd68b3 req-8f072482-25ab-4fa7-8f28-e5aa2996b07a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:34.248931 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-e299d44c-f55f-4200-90d1-4babb4fd68b3 req-8f072482-25ab-4fa7-8f28-e5aa2996b07a service nova] Creating event network-vif-plugged:aa5d2d0b-b2ef-482d-a3cf-2881c7beccc4 for instance 453d2270-109d-4b11-9eae-01fadd67a6cb on nch2-master-1 May 21 21:26:34.267561 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-e299d44c-f55f-4200-90d1-4babb4fd68b3 req-8f072482-25ab-4fa7-8f28-e5aa2996b07a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065905 May 21 21:26:34.268178 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1872/3878] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:26:34.358150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4f7e3090-acb3-4ef8-8a4e-af2df2784e32 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:34.359072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4f7e3090-acb3-4ef8-8a4e-af2df2784e32 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:34.374483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f7e3090-acb3-4ef8-8a4e-af2df2784e32 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:34.375386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f7e3090-acb3-4ef8-8a4e-af2df2784e32 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:34.377486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f7e3090-acb3-4ef8-8a4e-af2df2784e32 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:34.381761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f7e3090-acb3-4ef8-8a4e-af2df2784e32 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:34.436088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3f61a194-add6-4e6b-b095-a16b3139c6d6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:34.437408 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3f61a194-add6-4e6b-b095-a16b3139c6d6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:34.475301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f61a194-add6-4e6b-b095-a16b3139c6d6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:34.475791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f61a194-add6-4e6b-b095-a16b3139c6d6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:34.476636 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f61a194-add6-4e6b-b095-a16b3139c6d6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:34.477091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f61a194-add6-4e6b-b095-a16b3139c6d6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:34.654997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4f7e3090-acb3-4ef8-8a4e-af2df2784e32 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:34.663757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4f7e3090-acb3-4ef8-8a4e-af2df2784e32 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:34.667620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4f7e3090-acb3-4ef8-8a4e-af2df2784e32 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c07dc02a0f494ff99b010cf0447c8338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e409e3743001461b9dee85d7db50f6a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:34.670503 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4f7e3090-acb3-4ef8-8a4e-af2df2784e32 tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 200 len: 1873 microversion: 2.32 time: 0.316772 May 21 21:26:34.671419 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2007/3879] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:26:34 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 1873 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:26:34.725268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2b0ce793-0fb9-414d-9bf8-e50f7002129a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:34.729619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2b0ce793-0fb9-414d-9bf8-e50f7002129a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:34.735330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b0ce793-0fb9-414d-9bf8-e50f7002129a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:34.736056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b0ce793-0fb9-414d-9bf8-e50f7002129a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:34.737166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b0ce793-0fb9-414d-9bf8-e50f7002129a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:34.737768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b0ce793-0fb9-414d-9bf8-e50f7002129a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:34.917628 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3f61a194-add6-4e6b-b095-a16b3139c6d6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action" status: 202 len: 0 microversion: 2.1 time: 0.489071 May 21 21:26:34.921613 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1873/3880] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:26:34 2022] POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:26:34.930405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ba80f231-27ba-4fa2-8d0c-c328d28efacb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:34.932969 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ba80f231-27ba-4fa2-8d0c-c328d28efacb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:34.940623 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2b0ce793-0fb9-414d-9bf8-e50f7002129a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:34.948152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba80f231-27ba-4fa2-8d0c-c328d28efacb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:34.948893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba80f231-27ba-4fa2-8d0c-c328d28efacb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:34.949836 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba80f231-27ba-4fa2-8d0c-c328d28efacb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:34.950590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba80f231-27ba-4fa2-8d0c-c328d28efacb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:34.954184 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2b0ce793-0fb9-414d-9bf8-e50f7002129a tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1313 microversion: 2.1 time: 0.233679 May 21 21:26:34.970427 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2008/3881] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:34 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:34.970427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b032692f-6f31-42c8-a099-1442922ccd6b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:34.970427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b032692f-6f31-42c8-a099-1442922ccd6b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:34.970427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b032692f-6f31-42c8-a099-1442922ccd6b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:34.970427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b032692f-6f31-42c8-a099-1442922ccd6b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:34.971522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b032692f-6f31-42c8-a099-1442922ccd6b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:34.972268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b032692f-6f31-42c8-a099-1442922ccd6b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:34.996412 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:35.181344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ba80f231-27ba-4fa2-8d0c-c328d28efacb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:35.183353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b032692f-6f31-42c8-a099-1442922ccd6b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:35.193725 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ba80f231-27ba-4fa2-8d0c-c328d28efacb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1670 microversion: 2.1 time: 0.268228 May 21 21:26:35.194921 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1874/3882] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:34 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1670 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:35.198859 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b032692f-6f31-42c8-a099-1442922ccd6b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.241612 May 21 21:26:35.199533 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2009/3883] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:34 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:35.697452 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-56cd7237-cba9-48b1-9777-45c1a532475f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:35.697452 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-56cd7237-cba9-48b1-9777-45c1a532475f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] [instance: 8e0e86cc-36f0-4330-8251-6ff17fd22941] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:35.709544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-56cd7237-cba9-48b1-9777-45c1a532475f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:35.710317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-56cd7237-cba9-48b1-9777-45c1a532475f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:35.711506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-56cd7237-cba9-48b1-9777-45c1a532475f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:35.712572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-56cd7237-cba9-48b1-9777-45c1a532475f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:35.753154 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-56cd7237-cba9-48b1-9777-45c1a532475f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] HTTP exception thrown: Instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 could not be found. May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-56cd7237-cba9-48b1-9777-45c1a532475f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Request method failure captured: May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 HTTP/1.1 May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVbLKaaYtaVeYPi59kbmb6iM55oJj7CZYIScGsj0c7WJpkZf0IZ3VRjA8XBc4peGIqMKIavM25Eh0rGSeRuD0quuZJU3xJ1wo3j5WwebWYgQ5vozU_2cqHFvEKAJDbdv16DCWZ3sMxMvcZyGVwu5eAtFYmHDhdNV0wLMuqWBohlQ-28 May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: X-Openstack-Nova-Api-Version: 2.32 May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: e409e3743001461b9dee85d7db50f6a0 May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TaggedBootDevicesTest-674948933 May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e409e3743001461b9dee85d7db50f6a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e409e3743001461b9dee85d7db50f6a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e409e3743001461b9dee85d7db50f6a0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e409e3743001461b9dee85d7db50f6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TaggedBootDevicesTest-674948933 May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: e409e3743001461b9dee85d7db50f6a0 May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TaggedBootDevicesTest-674948933 May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TaggedBootDevicesTest-674948933-project May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c07dc02a0f494ff99b010cf0447c8338 May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TaggedBootDevicesTest-674948933-project May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 could not be found. May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '8e0e86cc-36f0-4330-8251-6ff17fd22941'} May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 could not be found. May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 could not be found. May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:26:35.755156 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:35.763983 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:26:35.763983 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:26:35.763983 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:26:35.763983 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:26:35.763983 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:26:35.763983 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 could not be found. May 21 21:26:35.763983 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:26:35.763983 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-56cd7237-cba9-48b1-9777-45c1a532475f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Returning 404 to user: Instance 8e0e86cc-36f0-4330-8251-6ff17fd22941 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:26:35.763983 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-56cd7237-cba9-48b1-9777-45c1a532475f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941" status: 404 len: 111 microversion: 2.32 time: 0.076361 May 21 21:26:35.767080 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1875/3884] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:26:35 2022] GET /compute/v2.1/servers/8e0e86cc-36f0-4330-8251-6ff17fd22941 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:26:35.813346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-da090708-fd3c-4944-8a4c-bf877eb8e90f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] Calling method '.version_select at 0x7fc81b57a9d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:35.978784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e025a52f-100a-40f1-87da-d8fcdb565f71 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:35.979601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e025a52f-100a-40f1-87da-d8fcdb565f71 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:35.985774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e025a52f-100a-40f1-87da-d8fcdb565f71 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:35.986230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e025a52f-100a-40f1-87da-d8fcdb565f71 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:35.986993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e025a52f-100a-40f1-87da-d8fcdb565f71 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:35.987430 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e025a52f-100a-40f1-87da-d8fcdb565f71 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:36.015728 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-da090708-fd3c-4944-8a4c-bf877eb8e90f tempest-TaggedBootDevicesTest-674948933 tempest-TaggedBootDevicesTest-674948933-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-551607892" status: 204 len: 0 microversion: 2.32 time: 0.206551 May 21 21:26:36.017065 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2010/3885] 10.222.0.49 () {60 vars in 1258 bytes} [Sat May 21 21:26:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-551607892 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:26:36.166620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e025a52f-100a-40f1-87da-d8fcdb565f71 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:36.176991 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e025a52f-100a-40f1-87da-d8fcdb565f71 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1500 microversion: 2.1 time: 0.203000 May 21 21:26:36.180606 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1876/3886] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:35 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1500 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:26:36.194352 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8b0ab403-4357-4ab1-b9bb-73dddeb99d00 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:26:36.195283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8b0ab403-4357-4ab1-b9bb-73dddeb99d00 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:36.213979 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b0ab403-4357-4ab1-b9bb-73dddeb99d00 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:36.215735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b0ab403-4357-4ab1-b9bb-73dddeb99d00 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:36.222388 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b0ab403-4357-4ab1-b9bb-73dddeb99d00 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:36.222899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b0ab403-4357-4ab1-b9bb-73dddeb99d00 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:36.227042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-05433298-179c-4268-a99d-cd8e8222e547 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:36.227186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-05433298-179c-4268-a99d-cd8e8222e547 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:36.240349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05433298-179c-4268-a99d-cd8e8222e547 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:36.242332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05433298-179c-4268-a99d-cd8e8222e547 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:36.242332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05433298-179c-4268-a99d-cd8e8222e547 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:36.242332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05433298-179c-4268-a99d-cd8e8222e547 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:36.257867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-8b0ab403-4357-4ab1-b9bb-73dddeb99d00 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lazy-loading 'flavor' on Instance uuid 453d2270-109d-4b11-9eae-01fadd67a6cb {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:26:36.440612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-05433298-179c-4268-a99d-cd8e8222e547 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:36.453040 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-05433298-179c-4268-a99d-cd8e8222e547 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1675 microversion: 2.1 time: 0.237231 May 21 21:26:36.456599 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1877/3887] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:36 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1675 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:36.463382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6166d8d0-fe02-4173-b80f-f79bd09ab4ac tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:36.464361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6166d8d0-fe02-4173-b80f-f79bd09ab4ac tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:36.471937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6166d8d0-fe02-4173-b80f-f79bd09ab4ac tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:36.472418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6166d8d0-fe02-4173-b80f-f79bd09ab4ac tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:36.473258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6166d8d0-fe02-4173-b80f-f79bd09ab4ac tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:36.473697 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6166d8d0-fe02-4173-b80f-f79bd09ab4ac tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:36.566487 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8b0ab403-4357-4ab1-b9bb-73dddeb99d00 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "POST /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb/action" status: 200 len: 32 microversion: 2.1 time: 0.375895 May 21 21:26:36.567806 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2011/3888] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:26:36 2022] POST /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb/action => generated 32 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:26:36.582887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-23daa286-a61e-42bd-a4c6-6b6d7e0b1e70 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:36.587660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-23daa286-a61e-42bd-a4c6-6b6d7e0b1e70 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:36.604620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23daa286-a61e-42bd-a4c6-6b6d7e0b1e70 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:36.605384 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23daa286-a61e-42bd-a4c6-6b6d7e0b1e70 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:36.607846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23daa286-a61e-42bd-a4c6-6b6d7e0b1e70 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:36.608581 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23daa286-a61e-42bd-a4c6-6b6d7e0b1e70 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:36.741912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6166d8d0-fe02-4173-b80f-f79bd09ab4ac tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:36.752247 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6166d8d0-fe02-4173-b80f-f79bd09ab4ac tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.296692 May 21 21:26:36.755365 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1878/3889] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:36 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:36.894568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-23daa286-a61e-42bd-a4c6-6b6d7e0b1e70 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:36.916928 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-23daa286-a61e-42bd-a4c6-6b6d7e0b1e70 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.343063 May 21 21:26:36.922251 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2012/3890] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:36 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:26:37.476744 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-14013a87-3a63-4ba1-9f3b-5f1f134c024f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:37.478481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-14013a87-3a63-4ba1-9f3b-5f1f134c024f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:37.487016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14013a87-3a63-4ba1-9f3b-5f1f134c024f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:37.487760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14013a87-3a63-4ba1-9f3b-5f1f134c024f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:37.488798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14013a87-3a63-4ba1-9f3b-5f1f134c024f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:37.489238 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14013a87-3a63-4ba1-9f3b-5f1f134c024f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:37.674575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-14013a87-3a63-4ba1-9f3b-5f1f134c024f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:37.695442 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-14013a87-3a63-4ba1-9f3b-5f1f134c024f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.223107 May 21 21:26:37.696970 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1879/3891] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:37 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:37.771766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-648c98db-42a2-43d5-89b8-01a8861e5dc0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:37.772450 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-648c98db-42a2-43d5-89b8-01a8861e5dc0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:37.779049 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-648c98db-42a2-43d5-89b8-01a8861e5dc0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:37.779509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-648c98db-42a2-43d5-89b8-01a8861e5dc0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:37.780314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-648c98db-42a2-43d5-89b8-01a8861e5dc0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:37.780756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-648c98db-42a2-43d5-89b8-01a8861e5dc0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:37.939220 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-79432344-1f52-4369-90bd-371021469177 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:37.940054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-79432344-1f52-4369-90bd-371021469177 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:37.951238 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-79432344-1f52-4369-90bd-371021469177 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:37.952304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-79432344-1f52-4369-90bd-371021469177 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:37.962815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-79432344-1f52-4369-90bd-371021469177 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:37.962815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-79432344-1f52-4369-90bd-371021469177 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:38.048874 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-648c98db-42a2-43d5-89b8-01a8861e5dc0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:38.060509 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-648c98db-42a2-43d5-89b8-01a8861e5dc0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.292593 May 21 21:26:38.061339 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2013/3892] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:37 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:38.244460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-79432344-1f52-4369-90bd-371021469177 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:38.259289 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-79432344-1f52-4369-90bd-371021469177 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.322846 May 21 21:26:38.261169 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1880/3893] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:37 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:39.081678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2e4379ef-b9ae-445e-b0b6-117f93ad6f4e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:39.083015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2e4379ef-b9ae-445e-b0b6-117f93ad6f4e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:39.097118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2e4379ef-b9ae-445e-b0b6-117f93ad6f4e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:39.097761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2e4379ef-b9ae-445e-b0b6-117f93ad6f4e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:39.103318 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2e4379ef-b9ae-445e-b0b6-117f93ad6f4e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:39.103318 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2e4379ef-b9ae-445e-b0b6-117f93ad6f4e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:39.279401 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7493b761-54a8-4086-b4d6-db1e98d1c966 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:39.280254 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7493b761-54a8-4086-b4d6-db1e98d1c966 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:39.297644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7493b761-54a8-4086-b4d6-db1e98d1c966 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:39.298111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7493b761-54a8-4086-b4d6-db1e98d1c966 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:39.298900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7493b761-54a8-4086-b4d6-db1e98d1c966 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:39.299346 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7493b761-54a8-4086-b4d6-db1e98d1c966 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:39.383725 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2e4379ef-b9ae-445e-b0b6-117f93ad6f4e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:39.393414 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2e4379ef-b9ae-445e-b0b6-117f93ad6f4e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.315329 May 21 21:26:39.394442 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2014/3894] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:39 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:39.636572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7493b761-54a8-4086-b4d6-db1e98d1c966 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:39.646067 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7493b761-54a8-4086-b4d6-db1e98d1c966 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.371062 May 21 21:26:39.647203 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1881/3895] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:39 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:26:40.411889 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ca569cef-14a8-4b2c-b729-d6eaca596002 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:40.412676 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ca569cef-14a8-4b2c-b729-d6eaca596002 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:40.421603 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca569cef-14a8-4b2c-b729-d6eaca596002 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:40.422129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca569cef-14a8-4b2c-b729-d6eaca596002 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:40.422931 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca569cef-14a8-4b2c-b729-d6eaca596002 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:40.423556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca569cef-14a8-4b2c-b729-d6eaca596002 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:40.661826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ca569cef-14a8-4b2c-b729-d6eaca596002 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:40.673557 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ca569cef-14a8-4b2c-b729-d6eaca596002 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.264951 May 21 21:26:40.673557 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2015/3896] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:40 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:40.681579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2dde572b-395f-48c2-869f-7460f7e13038 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:40.682278 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2dde572b-395f-48c2-869f-7460f7e13038 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:40.691741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2dde572b-395f-48c2-869f-7460f7e13038 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:40.692259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2dde572b-395f-48c2-869f-7460f7e13038 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:40.693300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2dde572b-395f-48c2-869f-7460f7e13038 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:40.693574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2dde572b-395f-48c2-869f-7460f7e13038 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:41.221689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2dde572b-395f-48c2-869f-7460f7e13038 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:41.236203 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2dde572b-395f-48c2-869f-7460f7e13038 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.563907 May 21 21:26:41.249629 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1882/3897] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:40 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:26:41.689425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4386b550-7ee3-4d53-ba52-0d8ecdac31af tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:41.690047 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4386b550-7ee3-4d53-ba52-0d8ecdac31af tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:41.697438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4386b550-7ee3-4d53-ba52-0d8ecdac31af tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:41.697829 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4386b550-7ee3-4d53-ba52-0d8ecdac31af tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:41.698596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4386b550-7ee3-4d53-ba52-0d8ecdac31af tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:41.699035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4386b550-7ee3-4d53-ba52-0d8ecdac31af tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:41.892938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4386b550-7ee3-4d53-ba52-0d8ecdac31af tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:41.901486 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4386b550-7ee3-4d53-ba52-0d8ecdac31af tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.215934 May 21 21:26:41.902104 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2016/3898] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:41 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:42.253954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9522afc0-5888-475f-b72c-fbf74dd86806 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:42.254657 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9522afc0-5888-475f-b72c-fbf74dd86806 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:42.262573 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9522afc0-5888-475f-b72c-fbf74dd86806 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:42.263074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9522afc0-5888-475f-b72c-fbf74dd86806 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:42.263861 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9522afc0-5888-475f-b72c-fbf74dd86806 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:42.264332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9522afc0-5888-475f-b72c-fbf74dd86806 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:42.462255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9522afc0-5888-475f-b72c-fbf74dd86806 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:42.470063 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9522afc0-5888-475f-b72c-fbf74dd86806 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.220050 May 21 21:26:42.470626 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1883/3899] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:42 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:42.920490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-16911301-169c-461c-ac8c-05dc756a007b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:42.923203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-16911301-169c-461c-ac8c-05dc756a007b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:42.929655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-16911301-169c-461c-ac8c-05dc756a007b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:42.931025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-16911301-169c-461c-ac8c-05dc756a007b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:42.931616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-16911301-169c-461c-ac8c-05dc756a007b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:42.932691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-16911301-169c-461c-ac8c-05dc756a007b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:43.101352 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-16911301-169c-461c-ac8c-05dc756a007b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:43.110139 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-16911301-169c-461c-ac8c-05dc756a007b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.194565 May 21 21:26:43.110714 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2017/3900] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:42 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:43.488248 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0d985f2d-992c-4c43-8ae9-8a0adc8785ff tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:43.489029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0d985f2d-992c-4c43-8ae9-8a0adc8785ff tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:43.491775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:43.496931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d985f2d-992c-4c43-8ae9-8a0adc8785ff tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:43.497378 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d985f2d-992c-4c43-8ae9-8a0adc8785ff tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:43.498145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d985f2d-992c-4c43-8ae9-8a0adc8785ff tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:43.498583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d985f2d-992c-4c43-8ae9-8a0adc8785ff tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:43.658792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0d985f2d-992c-4c43-8ae9-8a0adc8785ff tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:43.666916 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0d985f2d-992c-4c43-8ae9-8a0adc8785ff tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.182531 May 21 21:26:43.667516 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1884/3901] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:43 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:44.130004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1cbc3c59-6524-49cb-8f09-aacbe358e086 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:44.132171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1cbc3c59-6524-49cb-8f09-aacbe358e086 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:44.141197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1cbc3c59-6524-49cb-8f09-aacbe358e086 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:44.142160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1cbc3c59-6524-49cb-8f09-aacbe358e086 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:44.143209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1cbc3c59-6524-49cb-8f09-aacbe358e086 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:44.143860 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1cbc3c59-6524-49cb-8f09-aacbe358e086 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:44.347835 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1cbc3c59-6524-49cb-8f09-aacbe358e086 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:44.356616 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1cbc3c59-6524-49cb-8f09-aacbe358e086 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.231626 May 21 21:26:44.357287 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2018/3902] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:44 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:44.685952 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-666e0b55-5f23-408f-991f-38e91bff9f5e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:44.685952 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-666e0b55-5f23-408f-991f-38e91bff9f5e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:44.693938 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-666e0b55-5f23-408f-991f-38e91bff9f5e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:44.694389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-666e0b55-5f23-408f-991f-38e91bff9f5e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:44.695166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-666e0b55-5f23-408f-991f-38e91bff9f5e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:44.695667 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-666e0b55-5f23-408f-991f-38e91bff9f5e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:44.864083 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-666e0b55-5f23-408f-991f-38e91bff9f5e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:44.868134 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-666e0b55-5f23-408f-991f-38e91bff9f5e tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.187811 May 21 21:26:44.868834 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1885/3903] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:44 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:45.373204 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c0dd537e-601c-47f6-aab3-a8f6b46b4380 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:45.373821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c0dd537e-601c-47f6-aab3-a8f6b46b4380 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:45.381819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c0dd537e-601c-47f6-aab3-a8f6b46b4380 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:45.382271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c0dd537e-601c-47f6-aab3-a8f6b46b4380 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:45.383304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c0dd537e-601c-47f6-aab3-a8f6b46b4380 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:45.383859 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c0dd537e-601c-47f6-aab3-a8f6b46b4380 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:45.540766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c0dd537e-601c-47f6-aab3-a8f6b46b4380 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:45.549194 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c0dd537e-601c-47f6-aab3-a8f6b46b4380 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.180081 May 21 21:26:45.549779 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2019/3904] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:45 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:45.885741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-350f14ef-b829-4186-9dea-4bcbf04ad8e8 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:45.886679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-350f14ef-b829-4186-9dea-4bcbf04ad8e8 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:45.894321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-350f14ef-b829-4186-9dea-4bcbf04ad8e8 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:45.894784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-350f14ef-b829-4186-9dea-4bcbf04ad8e8 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:45.895559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-350f14ef-b829-4186-9dea-4bcbf04ad8e8 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:45.896001 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-350f14ef-b829-4186-9dea-4bcbf04ad8e8 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:46.085653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-350f14ef-b829-4186-9dea-4bcbf04ad8e8 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:46.087041 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-350f14ef-b829-4186-9dea-4bcbf04ad8e8 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.205099 May 21 21:26:46.087966 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1886/3905] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:45 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:46.570654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7708e72d-9ac4-45e5-988c-6dfcb3df04b8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:46.571359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7708e72d-9ac4-45e5-988c-6dfcb3df04b8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:46.578811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7708e72d-9ac4-45e5-988c-6dfcb3df04b8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:46.579272 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7708e72d-9ac4-45e5-988c-6dfcb3df04b8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:46.580154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7708e72d-9ac4-45e5-988c-6dfcb3df04b8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:46.580503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7708e72d-9ac4-45e5-988c-6dfcb3df04b8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:46.730777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7708e72d-9ac4-45e5-988c-6dfcb3df04b8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:46.738562 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7708e72d-9ac4-45e5-988c-6dfcb3df04b8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.175141 May 21 21:26:46.741751 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2020/3906] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:46 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:47.104591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2be957f6-4de2-455b-86c3-d536c59d8cb0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:47.106077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2be957f6-4de2-455b-86c3-d536c59d8cb0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:47.116041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2be957f6-4de2-455b-86c3-d536c59d8cb0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:47.116041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2be957f6-4de2-455b-86c3-d536c59d8cb0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:47.116041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2be957f6-4de2-455b-86c3-d536c59d8cb0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:47.116041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2be957f6-4de2-455b-86c3-d536c59d8cb0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:47.281810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2be957f6-4de2-455b-86c3-d536c59d8cb0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:47.289651 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2be957f6-4de2-455b-86c3-d536c59d8cb0 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.189446 May 21 21:26:47.291124 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1887/3907] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:47 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:47.756554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3aed25cc-4ea7-4026-82c2-ec1650869648 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:47.757170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3aed25cc-4ea7-4026-82c2-ec1650869648 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:47.764391 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3aed25cc-4ea7-4026-82c2-ec1650869648 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:47.764849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3aed25cc-4ea7-4026-82c2-ec1650869648 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:47.765618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3aed25cc-4ea7-4026-82c2-ec1650869648 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:47.766174 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3aed25cc-4ea7-4026-82c2-ec1650869648 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:47.770385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:47.928868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3aed25cc-4ea7-4026-82c2-ec1650869648 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:47.937518 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3aed25cc-4ea7-4026-82c2-ec1650869648 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.184824 May 21 21:26:47.938151 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2021/3908] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:47 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:48.306664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8474b059-bfd6-443c-adcc-568622f6aaf5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:48.307297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8474b059-bfd6-443c-adcc-568622f6aaf5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:48.314820 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8474b059-bfd6-443c-adcc-568622f6aaf5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:48.319230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8474b059-bfd6-443c-adcc-568622f6aaf5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:48.319230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8474b059-bfd6-443c-adcc-568622f6aaf5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:48.319230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8474b059-bfd6-443c-adcc-568622f6aaf5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:48.488003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8474b059-bfd6-443c-adcc-568622f6aaf5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:48.495999 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8474b059-bfd6-443c-adcc-568622f6aaf5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.193287 May 21 21:26:48.497144 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1888/3909] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:48 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:48.954534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8ade0331-175a-4f82-9105-bb223be65775 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:48.955342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8ade0331-175a-4f82-9105-bb223be65775 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:48.963738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ade0331-175a-4f82-9105-bb223be65775 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:48.964199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ade0331-175a-4f82-9105-bb223be65775 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:48.965970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ade0331-175a-4f82-9105-bb223be65775 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:48.966433 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ade0331-175a-4f82-9105-bb223be65775 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:49.119620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8ade0331-175a-4f82-9105-bb223be65775 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:49.128262 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8ade0331-175a-4f82-9105-bb223be65775 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.177738 May 21 21:26:49.130648 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2022/3910] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:48 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:49.514577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3e4f3609-f9bb-4510-953e-4fde751cb6b2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:49.515362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3e4f3609-f9bb-4510-953e-4fde751cb6b2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:49.522508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e4f3609-f9bb-4510-953e-4fde751cb6b2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:49.523210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e4f3609-f9bb-4510-953e-4fde751cb6b2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:49.524389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e4f3609-f9bb-4510-953e-4fde751cb6b2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:49.525167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e4f3609-f9bb-4510-953e-4fde751cb6b2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:49.696260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3e4f3609-f9bb-4510-953e-4fde751cb6b2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:49.704833 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3e4f3609-f9bb-4510-953e-4fde751cb6b2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.195116 May 21 21:26:49.705627 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1889/3911] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:49 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:50.148930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6b99220a-33d9-4e0b-8991-1d0097b09711 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:50.149567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6b99220a-33d9-4e0b-8991-1d0097b09711 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:50.158154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6b99220a-33d9-4e0b-8991-1d0097b09711 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:50.159166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6b99220a-33d9-4e0b-8991-1d0097b09711 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:50.160866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6b99220a-33d9-4e0b-8991-1d0097b09711 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:50.161502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6b99220a-33d9-4e0b-8991-1d0097b09711 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:50.336471 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6b99220a-33d9-4e0b-8991-1d0097b09711 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:50.343235 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6b99220a-33d9-4e0b-8991-1d0097b09711 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.201684 May 21 21:26:50.344714 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2023/3912] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:50 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:50.724384 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-779d91a5-cd62-4cb6-a6bf-584de4d1937d tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:50.724384 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-779d91a5-cd62-4cb6-a6bf-584de4d1937d tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:50.730111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-779d91a5-cd62-4cb6-a6bf-584de4d1937d tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:50.731241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-779d91a5-cd62-4cb6-a6bf-584de4d1937d tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:50.731722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-779d91a5-cd62-4cb6-a6bf-584de4d1937d tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:50.732162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-779d91a5-cd62-4cb6-a6bf-584de4d1937d tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:50.912665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-779d91a5-cd62-4cb6-a6bf-584de4d1937d tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:50.921435 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-779d91a5-cd62-4cb6-a6bf-584de4d1937d tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.203348 May 21 21:26:50.922024 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1890/3913] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:50 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:51.360745 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-326176d2-89c8-48dd-8475-63860ecd86bc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:51.361473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-326176d2-89c8-48dd-8475-63860ecd86bc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:51.369130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-326176d2-89c8-48dd-8475-63860ecd86bc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:51.374821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-326176d2-89c8-48dd-8475-63860ecd86bc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:51.374821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-326176d2-89c8-48dd-8475-63860ecd86bc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:51.374821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-326176d2-89c8-48dd-8475-63860ecd86bc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:51.516796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-326176d2-89c8-48dd-8475-63860ecd86bc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:51.535842 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-326176d2-89c8-48dd-8475-63860ecd86bc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.168049 May 21 21:26:51.535842 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2024/3914] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:51 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:51.938721 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b2fb6664-81e8-4eac-812c-ffe11bcf85c1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:51.939343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b2fb6664-81e8-4eac-812c-ffe11bcf85c1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:51.946312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2fb6664-81e8-4eac-812c-ffe11bcf85c1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:51.946771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2fb6664-81e8-4eac-812c-ffe11bcf85c1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:51.947546 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2fb6664-81e8-4eac-812c-ffe11bcf85c1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:51.948148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2fb6664-81e8-4eac-812c-ffe11bcf85c1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:52.117232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b2fb6664-81e8-4eac-812c-ffe11bcf85c1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:52.121736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:52.132426 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b2fb6664-81e8-4eac-812c-ffe11bcf85c1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.193029 May 21 21:26:52.132426 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1891/3915] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:51 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:52.544789 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a5e3c4ee-2e4a-44a5-838e-4529498b4ee8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:52.545573 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a5e3c4ee-2e4a-44a5-838e-4529498b4ee8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:52.557494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5e3c4ee-2e4a-44a5-838e-4529498b4ee8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:52.557961 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5e3c4ee-2e4a-44a5-838e-4529498b4ee8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:52.558965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5e3c4ee-2e4a-44a5-838e-4529498b4ee8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:52.559683 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5e3c4ee-2e4a-44a5-838e-4529498b4ee8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:52.763844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a5e3c4ee-2e4a-44a5-838e-4529498b4ee8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:52.774260 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a5e3c4ee-2e4a-44a5-838e-4529498b4ee8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.234449 May 21 21:26:52.776206 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2025/3916] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:52 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:53.148381 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-164ffa64-c087-496e-a69d-e2c81971cfd1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:53.149254 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-164ffa64-c087-496e-a69d-e2c81971cfd1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:53.158323 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-164ffa64-c087-496e-a69d-e2c81971cfd1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:53.159016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-164ffa64-c087-496e-a69d-e2c81971cfd1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:53.160000 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-164ffa64-c087-496e-a69d-e2c81971cfd1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:53.160494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-164ffa64-c087-496e-a69d-e2c81971cfd1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:53.420637 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-164ffa64-c087-496e-a69d-e2c81971cfd1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:53.428100 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-164ffa64-c087-496e-a69d-e2c81971cfd1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.283582 May 21 21:26:53.428717 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1892/3917] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:53 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:53.793727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1a22523f-5ad2-4400-bb2a-f320cb0b66d9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:53.797218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1a22523f-5ad2-4400-bb2a-f320cb0b66d9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:53.804079 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a22523f-5ad2-4400-bb2a-f320cb0b66d9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:53.805979 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a22523f-5ad2-4400-bb2a-f320cb0b66d9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:53.807039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a22523f-5ad2-4400-bb2a-f320cb0b66d9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:53.807710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a22523f-5ad2-4400-bb2a-f320cb0b66d9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:53.971438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1a22523f-5ad2-4400-bb2a-f320cb0b66d9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:53.979908 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1a22523f-5ad2-4400-bb2a-f320cb0b66d9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.190226 May 21 21:26:53.980573 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2026/3918] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:53 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:54.446068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-33b5c24a-eb4f-4295-acda-fe82367d3ee2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:54.446793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-33b5c24a-eb4f-4295-acda-fe82367d3ee2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:54.455406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33b5c24a-eb4f-4295-acda-fe82367d3ee2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:54.455949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33b5c24a-eb4f-4295-acda-fe82367d3ee2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:54.456833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33b5c24a-eb4f-4295-acda-fe82367d3ee2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:54.457365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33b5c24a-eb4f-4295-acda-fe82367d3ee2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:54.611810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-33b5c24a-eb4f-4295-acda-fe82367d3ee2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:54.625370 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-33b5c24a-eb4f-4295-acda-fe82367d3ee2 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.183672 May 21 21:26:54.634218 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1893/3919] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:54 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:54.999582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-14739252-df70-4188-b6e8-4fc95c8ce13e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:55.000637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-14739252-df70-4188-b6e8-4fc95c8ce13e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:55.008566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14739252-df70-4188-b6e8-4fc95c8ce13e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:55.009926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14739252-df70-4188-b6e8-4fc95c8ce13e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:55.010218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14739252-df70-4188-b6e8-4fc95c8ce13e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:55.010823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14739252-df70-4188-b6e8-4fc95c8ce13e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:55.178688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-14739252-df70-4188-b6e8-4fc95c8ce13e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:55.187870 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-14739252-df70-4188-b6e8-4fc95c8ce13e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.194647 May 21 21:26:55.188741 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2027/3920] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:54 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:55.651003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3f98a33e-505c-46a7-9b9e-955e1f2a0fc1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:55.651669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3f98a33e-505c-46a7-9b9e-955e1f2a0fc1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:55.660206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f98a33e-505c-46a7-9b9e-955e1f2a0fc1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:55.660745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f98a33e-505c-46a7-9b9e-955e1f2a0fc1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:55.661542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f98a33e-505c-46a7-9b9e-955e1f2a0fc1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:55.662201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f98a33e-505c-46a7-9b9e-955e1f2a0fc1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:55.833919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3f98a33e-505c-46a7-9b9e-955e1f2a0fc1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:55.842404 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3f98a33e-505c-46a7-9b9e-955e1f2a0fc1 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.195896 May 21 21:26:55.842992 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1894/3921] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:55 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:56.207024 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-27342112-e3d7-4c09-ad33-248cdde53fd5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:56.207660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-27342112-e3d7-4c09-ad33-248cdde53fd5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:56.218102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27342112-e3d7-4c09-ad33-248cdde53fd5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:56.218632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27342112-e3d7-4c09-ad33-248cdde53fd5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:56.226068 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27342112-e3d7-4c09-ad33-248cdde53fd5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:56.226068 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27342112-e3d7-4c09-ad33-248cdde53fd5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:56.385864 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-27342112-e3d7-4c09-ad33-248cdde53fd5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:56.400556 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-27342112-e3d7-4c09-ad33-248cdde53fd5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.193776 May 21 21:26:56.400556 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2028/3922] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:56 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:56.859012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7f7c0bf7-ab03-4128-96e9-2439360112c5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:56.860216 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7f7c0bf7-ab03-4128-96e9-2439360112c5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:56.867799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f7c0bf7-ab03-4128-96e9-2439360112c5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:56.868463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f7c0bf7-ab03-4128-96e9-2439360112c5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:56.869478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f7c0bf7-ab03-4128-96e9-2439360112c5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:56.869995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f7c0bf7-ab03-4128-96e9-2439360112c5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:57.022801 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7f7c0bf7-ab03-4128-96e9-2439360112c5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:57.031748 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7f7c0bf7-ab03-4128-96e9-2439360112c5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.176939 May 21 21:26:57.032375 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1895/3923] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:56 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:57.416119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d387dbb9-5c1d-4308-b1af-cabd6ee3db57 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:57.416831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d387dbb9-5c1d-4308-b1af-cabd6ee3db57 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:57.444665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d387dbb9-5c1d-4308-b1af-cabd6ee3db57 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:57.445216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d387dbb9-5c1d-4308-b1af-cabd6ee3db57 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:57.451913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d387dbb9-5c1d-4308-b1af-cabd6ee3db57 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:57.452398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d387dbb9-5c1d-4308-b1af-cabd6ee3db57 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:57.644433 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d387dbb9-5c1d-4308-b1af-cabd6ee3db57 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:57.673662 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d387dbb9-5c1d-4308-b1af-cabd6ee3db57 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1514 microversion: 2.1 time: 0.262148 May 21 21:26:57.674272 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2029/3924] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:57 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1514 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:58.050587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9feaf126-744d-4dd9-b355-7dc5de8c0386 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:58.051480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9feaf126-744d-4dd9-b355-7dc5de8c0386 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:58.060041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9feaf126-744d-4dd9-b355-7dc5de8c0386 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:58.060815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9feaf126-744d-4dd9-b355-7dc5de8c0386 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:58.061666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9feaf126-744d-4dd9-b355-7dc5de8c0386 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:58.062111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9feaf126-744d-4dd9-b355-7dc5de8c0386 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:58.242762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9feaf126-744d-4dd9-b355-7dc5de8c0386 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:58.254272 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9feaf126-744d-4dd9-b355-7dc5de8c0386 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.208958 May 21 21:26:58.265075 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1896/3925] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:58 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:58.690900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a25c987d-88b7-45f7-add3-a33797c89925 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:58.691527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a25c987d-88b7-45f7-add3-a33797c89925 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:58.695694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:58.700520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a25c987d-88b7-45f7-add3-a33797c89925 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:58.701237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a25c987d-88b7-45f7-add3-a33797c89925 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:58.703311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a25c987d-88b7-45f7-add3-a33797c89925 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:58.703311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a25c987d-88b7-45f7-add3-a33797c89925 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:58.876673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a25c987d-88b7-45f7-add3-a33797c89925 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:58.884708 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a25c987d-88b7-45f7-add3-a33797c89925 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1520 microversion: 2.1 time: 0.197644 May 21 21:26:58.886846 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2030/3926] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:58 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:26:59.272900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-48f49603-4c43-4308-b546-422091ffe79c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:59.273521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-48f49603-4c43-4308-b546-422091ffe79c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:59.281577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-48f49603-4c43-4308-b546-422091ffe79c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:59.285581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-48f49603-4c43-4308-b546-422091ffe79c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:59.285581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-48f49603-4c43-4308-b546-422091ffe79c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:59.285581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-48f49603-4c43-4308-b546-422091ffe79c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:59.450609 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-48f49603-4c43-4308-b546-422091ffe79c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:26:59.458342 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-48f49603-4c43-4308-b546-422091ffe79c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.189638 May 21 21:26:59.458923 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1897/3927] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:59 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:26:59.903674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dd1b9e65-d987-4b81-9469-de4a800bbd5f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:26:59.904335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dd1b9e65-d987-4b81-9469-de4a800bbd5f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:26:59.911817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd1b9e65-d987-4b81-9469-de4a800bbd5f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:59.912294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd1b9e65-d987-4b81-9469-de4a800bbd5f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:26:59.913100 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd1b9e65-d987-4b81-9469-de4a800bbd5f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:26:59.913544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd1b9e65-d987-4b81-9469-de4a800bbd5f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:00.071807 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-dd1b9e65-d987-4b81-9469-de4a800bbd5f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:00.080676 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dd1b9e65-d987-4b81-9469-de4a800bbd5f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1520 microversion: 2.1 time: 0.182134 May 21 21:27:00.081731 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2031/3928] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:26:59 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:00.404695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-7e4b4429-d5d6-4b13-9e29-d2cb9b252486 req-456a2734-1dec-4200-b1f9-b4573115822a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0e0ad6-f09c-4c9f-8b87-a913053bf054", "name": "network-vif-unplugged", "status": "completed", "tag": "d22060ad-f6ce-43cb-a43c-58ef612be0d7"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:00.414701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-7e4b4429-d5d6-4b13-9e29-d2cb9b252486 req-456a2734-1dec-4200-b1f9-b4573115822a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:00.415483 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-7e4b4429-d5d6-4b13-9e29-d2cb9b252486 req-456a2734-1dec-4200-b1f9-b4573115822a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:00.430216 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-7e4b4429-d5d6-4b13-9e29-d2cb9b252486 req-456a2734-1dec-4200-b1f9-b4573115822a service nova] Creating event network-vif-unplugged:d22060ad-f6ce-43cb-a43c-58ef612be0d7 for instance 8e0e0ad6-f09c-4c9f-8b87-a913053bf054 on nch2-master-1 May 21 21:27:00.437038 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-7e4b4429-d5d6-4b13-9e29-d2cb9b252486 req-456a2734-1dec-4200-b1f9-b4573115822a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037026 May 21 21:27:00.438146 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1898/3929] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:27:00.476185 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-44f297c6-5f1e-4bb9-af91-b70448efce89 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:00.477249 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-44f297c6-5f1e-4bb9-af91-b70448efce89 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:00.485018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44f297c6-5f1e-4bb9-af91-b70448efce89 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:00.485558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44f297c6-5f1e-4bb9-af91-b70448efce89 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:00.486430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44f297c6-5f1e-4bb9-af91-b70448efce89 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:00.486951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44f297c6-5f1e-4bb9-af91-b70448efce89 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:00.651236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-44f297c6-5f1e-4bb9-af91-b70448efce89 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:00.662365 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-44f297c6-5f1e-4bb9-af91-b70448efce89 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.190967 May 21 21:27:00.663019 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2032/3930] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:00 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:01.101027 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-40f77c4b-143e-420b-96ee-5c4ffd7175d5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:01.102774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-40f77c4b-143e-420b-96ee-5c4ffd7175d5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:01.112416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40f77c4b-143e-420b-96ee-5c4ffd7175d5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:01.113245 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40f77c4b-143e-420b-96ee-5c4ffd7175d5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:01.114097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40f77c4b-143e-420b-96ee-5c4ffd7175d5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:01.114560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40f77c4b-143e-420b-96ee-5c4ffd7175d5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:01.289571 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-40f77c4b-143e-420b-96ee-5c4ffd7175d5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:01.299613 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-40f77c4b-143e-420b-96ee-5c4ffd7175d5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1520 microversion: 2.1 time: 0.202507 May 21 21:27:01.301098 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1899/3931] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:01 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:01.686861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-548823ca-7db6-4265-acff-fc4e9abc3895 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:01.688051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-548823ca-7db6-4265-acff-fc4e9abc3895 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:01.695172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-548823ca-7db6-4265-acff-fc4e9abc3895 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:01.695865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-548823ca-7db6-4265-acff-fc4e9abc3895 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:01.696819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-548823ca-7db6-4265-acff-fc4e9abc3895 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:01.697431 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-548823ca-7db6-4265-acff-fc4e9abc3895 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:01.877590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-548823ca-7db6-4265-acff-fc4e9abc3895 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:01.885969 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-548823ca-7db6-4265-acff-fc4e9abc3895 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.208995 May 21 21:27:01.887938 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2033/3932] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:01 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:02.318583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a25f2342-8772-4b62-bb15-bc35f650046a tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:02.319031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a25f2342-8772-4b62-bb15-bc35f650046a tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:02.326669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a25f2342-8772-4b62-bb15-bc35f650046a tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:02.327120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a25f2342-8772-4b62-bb15-bc35f650046a tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:02.327931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a25f2342-8772-4b62-bb15-bc35f650046a tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:02.328458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a25f2342-8772-4b62-bb15-bc35f650046a tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:02.483955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a25f2342-8772-4b62-bb15-bc35f650046a tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:02.493691 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a25f2342-8772-4b62-bb15-bc35f650046a tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1520 microversion: 2.1 time: 0.177772 May 21 21:27:02.493691 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1900/3933] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:02 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:02.824341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-d20b45b2-6f3a-4fe2-b782-c3723c460acd req-ad489610-f6d7-4096-8764-4cc6d2293963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0e0ad6-f09c-4c9f-8b87-a913053bf054", "name": "network-vif-plugged", "status": "completed", "tag": "d22060ad-f6ce-43cb-a43c-58ef612be0d7"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:02.837011 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d20b45b2-6f3a-4fe2-b782-c3723c460acd req-ad489610-f6d7-4096-8764-4cc6d2293963 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:02.837454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d20b45b2-6f3a-4fe2-b782-c3723c460acd req-ad489610-f6d7-4096-8764-4cc6d2293963 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:02.861224 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-d20b45b2-6f3a-4fe2-b782-c3723c460acd req-ad489610-f6d7-4096-8764-4cc6d2293963 service nova] Creating event network-vif-plugged:d22060ad-f6ce-43cb-a43c-58ef612be0d7 for instance 8e0e0ad6-f09c-4c9f-8b87-a913053bf054 on nch2-master-1 May 21 21:27:02.867874 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-d20b45b2-6f3a-4fe2-b782-c3723c460acd req-ad489610-f6d7-4096-8764-4cc6d2293963 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055686 May 21 21:27:02.868869 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2034/3934] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:27:02.905109 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-30aeb8bf-946e-439d-9d2f-55e1d98e1373 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:02.905729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-30aeb8bf-946e-439d-9d2f-55e1d98e1373 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:02.920219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30aeb8bf-946e-439d-9d2f-55e1d98e1373 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:02.920899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30aeb8bf-946e-439d-9d2f-55e1d98e1373 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:02.921719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30aeb8bf-946e-439d-9d2f-55e1d98e1373 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:02.922167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30aeb8bf-946e-439d-9d2f-55e1d98e1373 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:03.100949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-30aeb8bf-946e-439d-9d2f-55e1d98e1373 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:03.110222 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-30aeb8bf-946e-439d-9d2f-55e1d98e1373 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.210334 May 21 21:27:03.111041 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1901/3935] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:02 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:03.510285 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2be48a1e-1203-4a37-bbed-416e9a093793 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:03.511072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2be48a1e-1203-4a37-bbed-416e9a093793 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:03.518484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2be48a1e-1203-4a37-bbed-416e9a093793 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:03.519798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2be48a1e-1203-4a37-bbed-416e9a093793 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:03.520617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2be48a1e-1203-4a37-bbed-416e9a093793 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:03.521064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2be48a1e-1203-4a37-bbed-416e9a093793 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:03.672737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2be48a1e-1203-4a37-bbed-416e9a093793 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:03.684149 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2be48a1e-1203-4a37-bbed-416e9a093793 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1520 microversion: 2.1 time: 0.176051 May 21 21:27:03.684149 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2035/3936] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:03 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:04.128482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9096684b-eec2-42db-b723-0f5cbbf67f2c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:04.129165 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9096684b-eec2-42db-b723-0f5cbbf67f2c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:04.137548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9096684b-eec2-42db-b723-0f5cbbf67f2c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:04.138011 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9096684b-eec2-42db-b723-0f5cbbf67f2c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:04.138807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9096684b-eec2-42db-b723-0f5cbbf67f2c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:04.139257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9096684b-eec2-42db-b723-0f5cbbf67f2c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:04.296125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9096684b-eec2-42db-b723-0f5cbbf67f2c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:04.303971 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9096684b-eec2-42db-b723-0f5cbbf67f2c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.180263 May 21 21:27:04.304594 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1902/3937] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:04 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:04.700821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d936de1f-f830-4876-9dfe-0d9f198d2a2d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:04.701444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d936de1f-f830-4876-9dfe-0d9f198d2a2d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:04.708883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d936de1f-f830-4876-9dfe-0d9f198d2a2d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:04.709336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d936de1f-f830-4876-9dfe-0d9f198d2a2d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:04.710472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d936de1f-f830-4876-9dfe-0d9f198d2a2d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:04.710917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d936de1f-f830-4876-9dfe-0d9f198d2a2d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:04.868107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d936de1f-f830-4876-9dfe-0d9f198d2a2d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:04.876618 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d936de1f-f830-4876-9dfe-0d9f198d2a2d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1520 microversion: 2.1 time: 0.180040 May 21 21:27:04.877144 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2036/3938] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:04 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:05.321198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-76b53bb8-f307-40a7-8b85-3f566d6e3b54 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:05.321819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-76b53bb8-f307-40a7-8b85-3f566d6e3b54 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:05.333072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-76b53bb8-f307-40a7-8b85-3f566d6e3b54 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:05.333531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-76b53bb8-f307-40a7-8b85-3f566d6e3b54 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:05.334349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-76b53bb8-f307-40a7-8b85-3f566d6e3b54 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:05.334794 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-76b53bb8-f307-40a7-8b85-3f566d6e3b54 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:05.524791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-76b53bb8-f307-40a7-8b85-3f566d6e3b54 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:05.546106 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-76b53bb8-f307-40a7-8b85-3f566d6e3b54 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.228882 May 21 21:27:05.548765 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1903/3939] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:05 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:05.893539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2c13447e-8484-4c87-a425-33ad441f6c2e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:05.894088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2c13447e-8484-4c87-a425-33ad441f6c2e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:05.901098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c13447e-8484-4c87-a425-33ad441f6c2e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:05.901554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c13447e-8484-4c87-a425-33ad441f6c2e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:05.903822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c13447e-8484-4c87-a425-33ad441f6c2e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:05.904268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c13447e-8484-4c87-a425-33ad441f6c2e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:06.074090 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2c13447e-8484-4c87-a425-33ad441f6c2e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:06.081981 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2c13447e-8484-4c87-a425-33ad441f6c2e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1505 microversion: 2.1 time: 0.192322 May 21 21:27:06.082872 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2037/3940] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:05 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1505 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:06.102045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0e4b4820-27f9-4f75-98a0-c96fba61b6ba tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:06.102766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0e4b4820-27f9-4f75-98a0-c96fba61b6ba tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:06.111954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e4b4820-27f9-4f75-98a0-c96fba61b6ba tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:06.112555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e4b4820-27f9-4f75-98a0-c96fba61b6ba tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:06.113751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e4b4820-27f9-4f75-98a0-c96fba61b6ba tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:06.114206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e4b4820-27f9-4f75-98a0-c96fba61b6ba tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:06.271401 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0e4b4820-27f9-4f75-98a0-c96fba61b6ba tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:06.280545 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0e4b4820-27f9-4f75-98a0-c96fba61b6ba tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 200 len: 1505 microversion: 2.1 time: 0.184031 May 21 21:27:06.281135 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1904/3941] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:06 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 1505 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:06.302067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1afca243-0c8c-4a36-9e6d-2e0e95d26775 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:06.302067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1afca243-0c8c-4a36-9e6d-2e0e95d26775 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:06.306273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1afca243-0c8c-4a36-9e6d-2e0e95d26775 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:06.306495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1afca243-0c8c-4a36-9e6d-2e0e95d26775 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:06.307307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1afca243-0c8c-4a36-9e6d-2e0e95d26775 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:06.307761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1afca243-0c8c-4a36-9e6d-2e0e95d26775 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:06.330541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:06.337530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1afca243-0c8c-4a36-9e6d-2e0e95d26775 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:27:06.565266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bd051755-da10-46dd-8946-84618afac30c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:06.565888 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bd051755-da10-46dd-8946-84618afac30c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:06.573076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bd051755-da10-46dd-8946-84618afac30c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:06.573602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bd051755-da10-46dd-8946-84618afac30c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:06.574490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bd051755-da10-46dd-8946-84618afac30c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:06.575107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bd051755-da10-46dd-8946-84618afac30c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:06.647614 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1afca243-0c8c-4a36-9e6d-2e0e95d26775 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 204 len: 0 microversion: 2.1 time: 0.353008 May 21 21:27:06.649825 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2038/3942] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:27:06 2022] DELETE /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:27:06.741443 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bd051755-da10-46dd-8946-84618afac30c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:06.750008 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bd051755-da10-46dd-8946-84618afac30c tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1486 microversion: 2.1 time: 0.188871 May 21 21:27:06.750576 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1905/3943] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:06 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1486 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:06.767435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-01221c79-7874-4dda-83af-52de78860757 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:06.768136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-01221c79-7874-4dda-83af-52de78860757 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:06.775177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-01221c79-7874-4dda-83af-52de78860757 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:06.775712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-01221c79-7874-4dda-83af-52de78860757 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:06.776634 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-01221c79-7874-4dda-83af-52de78860757 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:06.777717 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-01221c79-7874-4dda-83af-52de78860757 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:06.868843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0661a8b9-3a13-43e7-b8de-cf2e2210ce00 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-264967581", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "8fb93757-9e97-46e8-8606-ce5e5b5ae334"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:06.932543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-0661a8b9-3a13-43e7-b8de-cf2e2210ce00 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] validate_networks() for [('8fb93757-9e97-46e8-8606-ce5e5b5ae334', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:27:07.010657 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-01221c79-7874-4dda-83af-52de78860757 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "POST /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb/action" status: 202 len: 0 microversion: 2.1 time: 0.247577 May 21 21:27:07.013380 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2039/3944] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:27:06 2022] POST /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:27:07.020258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ae1da8be-39ef-464d-a6f9-a94e4cc62aa4 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:07.020995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ae1da8be-39ef-464d-a6f9-a94e4cc62aa4 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:07.028362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ae1da8be-39ef-464d-a6f9-a94e4cc62aa4 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:07.028821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ae1da8be-39ef-464d-a6f9-a94e4cc62aa4 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:07.029605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ae1da8be-39ef-464d-a6f9-a94e4cc62aa4 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:07.030050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ae1da8be-39ef-464d-a6f9-a94e4cc62aa4 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:07.191978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ae1da8be-39ef-464d-a6f9-a94e4cc62aa4 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:07.200382 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ae1da8be-39ef-464d-a6f9-a94e4cc62aa4 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1494 microversion: 2.1 time: 0.184354 May 21 21:27:07.200968 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2040/3945] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:07 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1494 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:07.505389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0661a8b9-3a13-43e7-b8de-cf2e2210ce00 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:27:07.505389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0661a8b9-3a13-43e7-b8de-cf2e2210ce00 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:27:07.505389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0661a8b9-3a13-43e7-b8de-cf2e2210ce00 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:27:07.505389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0661a8b9-3a13-43e7-b8de-cf2e2210ce00 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:27:07.505389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0661a8b9-3a13-43e7-b8de-cf2e2210ce00 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:27:07.513281 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0661a8b9-3a13-43e7-b8de-cf2e2210ce00 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:07.513735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0661a8b9-3a13-43e7-b8de-cf2e2210ce00 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:07.514834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0661a8b9-3a13-43e7-b8de-cf2e2210ce00 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:07.515296 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0661a8b9-3a13-43e7-b8de-cf2e2210ce00 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:07.533901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-0661a8b9-3a13-43e7-b8de-cf2e2210ce00 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Getting quotas for project a853a089c08b4fb288c1eb5ddcc30bbf. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:27:07.539294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-0661a8b9-3a13-43e7-b8de-cf2e2210ce00 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Getting quotas for user cc14047fba5947198634f831b653fbad and project a853a089c08b4fb288c1eb5ddcc30bbf. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:27:07.552837 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0661a8b9-3a13-43e7-b8de-cf2e2210ce00 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:27:07.555268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0661a8b9-3a13-43e7-b8de-cf2e2210ce00 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:27:07.726102 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0661a8b9-3a13-43e7-b8de-cf2e2210ce00 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.861701 May 21 21:27:07.732662 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1906/3946] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:27:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 21 21:27:07.737560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4d02f2d2-bfd6-48e2-8d11-c4974cd80d95 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:07.738186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4d02f2d2-bfd6-48e2-8d11-c4974cd80d95 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:07.809331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4d02f2d2-bfd6-48e2-8d11-c4974cd80d95 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:07.817371 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4d02f2d2-bfd6-48e2-8d11-c4974cd80d95 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1217 microversion: 2.1 time: 0.083528 May 21 21:27:07.817936 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2041/3947] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:07 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:08.224768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e6a0b127-a5bb-4641-a26d-2b215f4b43d5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:08.226081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e6a0b127-a5bb-4641-a26d-2b215f4b43d5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:08.265697 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e6a0b127-a5bb-4641-a26d-2b215f4b43d5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:08.266278 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e6a0b127-a5bb-4641-a26d-2b215f4b43d5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:08.267368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e6a0b127-a5bb-4641-a26d-2b215f4b43d5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:08.267987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e6a0b127-a5bb-4641-a26d-2b215f4b43d5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:08.684774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e6a0b127-a5bb-4641-a26d-2b215f4b43d5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:08.692957 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e6a0b127-a5bb-4641-a26d-2b215f4b43d5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1494 microversion: 2.1 time: 0.479026 May 21 21:27:08.693546 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1907/3948] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:08 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1494 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:08.843973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8a16c082-58a3-477d-8a00-4ea818a9bf08 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:08.846070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8a16c082-58a3-477d-8a00-4ea818a9bf08 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:08.865588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a16c082-58a3-477d-8a00-4ea818a9bf08 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:08.897467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a16c082-58a3-477d-8a00-4ea818a9bf08 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:08.898714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a16c082-58a3-477d-8a00-4ea818a9bf08 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:08.906052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a16c082-58a3-477d-8a00-4ea818a9bf08 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:08.993426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8a16c082-58a3-477d-8a00-4ea818a9bf08 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:09.001724 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8a16c082-58a3-477d-8a00-4ea818a9bf08 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1221 microversion: 2.1 time: 0.168558 May 21 21:27:09.002313 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2042/3949] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:08 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1221 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:09.185898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-a8fb4449-7b7c-4c58-ae0f-1f3812f2ed03 req-a799a7b7-23dd-4f9a-84ca-589c20d717b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0e0ad6-f09c-4c9f-8b87-a913053bf054", "name": "network-vif-deleted", "tag": "d22060ad-f6ce-43cb-a43c-58ef612be0d7"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:09.195375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a8fb4449-7b7c-4c58-ae0f-1f3812f2ed03 req-a799a7b7-23dd-4f9a-84ca-589c20d717b2 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:09.195956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a8fb4449-7b7c-4c58-ae0f-1f3812f2ed03 req-a799a7b7-23dd-4f9a-84ca-589c20d717b2 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:09.213420 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-a8fb4449-7b7c-4c58-ae0f-1f3812f2ed03 req-a799a7b7-23dd-4f9a-84ca-589c20d717b2 service nova] Creating event network-vif-deleted:d22060ad-f6ce-43cb-a43c-58ef612be0d7 for instance 8e0e0ad6-f09c-4c9f-8b87-a913053bf054 on nch2-master-1 May 21 21:27:09.225264 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-a8fb4449-7b7c-4c58-ae0f-1f3812f2ed03 req-a799a7b7-23dd-4f9a-84ca-589c20d717b2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042717 May 21 21:27:09.226988 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1908/3950] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:27:09.716132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-78832ae6-0af3-4b30-90ea-f9f72a387443 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:09.720607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-78832ae6-0af3-4b30-90ea-f9f72a387443 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:09.728644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78832ae6-0af3-4b30-90ea-f9f72a387443 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:09.729452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78832ae6-0af3-4b30-90ea-f9f72a387443 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:09.731559 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78832ae6-0af3-4b30-90ea-f9f72a387443 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:09.732159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78832ae6-0af3-4b30-90ea-f9f72a387443 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:09.836205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d7710c48-e93c-4e5c-ae25-4aa5c6c20c55 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:09.837171 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d7710c48-e93c-4e5c-ae25-4aa5c6c20c55 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:09.845088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7710c48-e93c-4e5c-ae25-4aa5c6c20c55 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:09.848887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7710c48-e93c-4e5c-ae25-4aa5c6c20c55 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:09.848887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7710c48-e93c-4e5c-ae25-4aa5c6c20c55 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:09.848887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7710c48-e93c-4e5c-ae25-4aa5c6c20c55 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:10.046977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d7710c48-e93c-4e5c-ae25-4aa5c6c20c55 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:10.054837 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d7710c48-e93c-4e5c-ae25-4aa5c6c20c55 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.224135 May 21 21:27:10.055425 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1909/3951] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:09 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:10.060903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-655c334b-813d-459e-8133-469b222b0d07 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:10.061532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-655c334b-813d-459e-8133-469b222b0d07 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:10.070572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-655c334b-813d-459e-8133-469b222b0d07 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:10.071051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-655c334b-813d-459e-8133-469b222b0d07 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:10.071849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-655c334b-813d-459e-8133-469b222b0d07 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:10.072349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-655c334b-813d-459e-8133-469b222b0d07 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:10.094380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:10.199245 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-655c334b-813d-459e-8133-469b222b0d07 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:10.216859 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-655c334b-813d-459e-8133-469b222b0d07 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1269 microversion: 2.1 time: 0.159554 May 21 21:27:10.230376 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1910/3952] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:10 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1269 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:10.244852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-610f918b-7358-4b54-ad13-76d435e6c188 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:10.251315 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-610f918b-7358-4b54-ad13-76d435e6c188 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:10.270598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-610f918b-7358-4b54-ad13-76d435e6c188 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:10.274258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-610f918b-7358-4b54-ad13-76d435e6c188 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:10.275932 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-610f918b-7358-4b54-ad13-76d435e6c188 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:10.279649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-610f918b-7358-4b54-ad13-76d435e6c188 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:10.374604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-78832ae6-0af3-4b30-90ea-f9f72a387443 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:10.390331 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-78832ae6-0af3-4b30-90ea-f9f72a387443 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1494 microversion: 2.1 time: 0.682729 May 21 21:27:10.390954 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2043/3953] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:09 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1494 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:10.644780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-610f918b-7358-4b54-ad13-76d435e6c188 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:10.656554 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-610f918b-7358-4b54-ad13-76d435e6c188 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.424540 May 21 21:27:10.673263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ab70d012-171a-448d-a57e-82bf3777df45 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:10.673907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ab70d012-171a-448d-a57e-82bf3777df45 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:10.685922 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab70d012-171a-448d-a57e-82bf3777df45 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:10.686195 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1911/3954] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:10 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:10.687451 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab70d012-171a-448d-a57e-82bf3777df45 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:10.688273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab70d012-171a-448d-a57e-82bf3777df45 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:10.688776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab70d012-171a-448d-a57e-82bf3777df45 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:10.933928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ab70d012-171a-448d-a57e-82bf3777df45 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:10.943229 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ab70d012-171a-448d-a57e-82bf3777df45 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.273950 May 21 21:27:10.944591 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2044/3955] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:10 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:10.960371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-751076ba-87b7-495e-864b-5247ba7be74a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:10.961809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-751076ba-87b7-495e-864b-5247ba7be74a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:10.972542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-751076ba-87b7-495e-864b-5247ba7be74a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:10.972542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-751076ba-87b7-495e-864b-5247ba7be74a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:10.972542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-751076ba-87b7-495e-864b-5247ba7be74a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:10.972542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-751076ba-87b7-495e-864b-5247ba7be74a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:11.238422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6ac7b74f-4a30-4a09-bde6-d70040a408aa tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:11.239234 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6ac7b74f-4a30-4a09-bde6-d70040a408aa tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:11.248019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ac7b74f-4a30-4a09-bde6-d70040a408aa tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:11.248525 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ac7b74f-4a30-4a09-bde6-d70040a408aa tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:11.249438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ac7b74f-4a30-4a09-bde6-d70040a408aa tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:11.249888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ac7b74f-4a30-4a09-bde6-d70040a408aa tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:11.298482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-751076ba-87b7-495e-864b-5247ba7be74a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:11.309129 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-751076ba-87b7-495e-864b-5247ba7be74a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.352908 May 21 21:27:11.310090 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1912/3956] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:10 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:11.328041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6ac7b74f-4a30-4a09-bde6-d70040a408aa tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:11.337691 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6ac7b74f-4a30-4a09-bde6-d70040a408aa tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1275 microversion: 2.1 time: 0.102954 May 21 21:27:11.339148 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2045/3957] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:11 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1275 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:11.408035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-79c971e6-3dd5-4bdc-95bc-cfe723089cb5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:11.408894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-79c971e6-3dd5-4bdc-95bc-cfe723089cb5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:11.430159 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-79c971e6-3dd5-4bdc-95bc-cfe723089cb5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:11.431140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-79c971e6-3dd5-4bdc-95bc-cfe723089cb5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:11.432068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-79c971e6-3dd5-4bdc-95bc-cfe723089cb5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:11.436190 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-79c971e6-3dd5-4bdc-95bc-cfe723089cb5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:11.516075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-87b9482d-f165-4277-a21c-c2d05271a1dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1375556695", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "5d4cf0c3-1319-4035-9b9a-7c7b54e6e093"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:11.590387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-87b9482d-f165-4277-a21c-c2d05271a1dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] validate_networks() for [('5d4cf0c3-1319-4035-9b9a-7c7b54e6e093', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:27:11.725270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-79c971e6-3dd5-4bdc-95bc-cfe723089cb5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:11.735398 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-79c971e6-3dd5-4bdc-95bc-cfe723089cb5 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1500 microversion: 2.1 time: 0.331676 May 21 21:27:11.748053 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1913/3958] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:11 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1500 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:11.757325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-30a3cdb0-da20-406a-9a5c-3b0a039cbd33 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:11.757502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-30a3cdb0-da20-406a-9a5c-3b0a039cbd33 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:11.764581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30a3cdb0-da20-406a-9a5c-3b0a039cbd33 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:11.765141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30a3cdb0-da20-406a-9a5c-3b0a039cbd33 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:11.766036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30a3cdb0-da20-406a-9a5c-3b0a039cbd33 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:11.766757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30a3cdb0-da20-406a-9a5c-3b0a039cbd33 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:11.795870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-30a3cdb0-da20-406a-9a5c-3b0a039cbd33 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:27:12.222676 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-30a3cdb0-da20-406a-9a5c-3b0a039cbd33 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "DELETE /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 204 len: 0 microversion: 2.1 time: 0.469471 May 21 21:27:12.229291 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1914/3959] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:27:11 2022] DELETE /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:27:12.236598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-28b48183-72c0-4bc7-8bfa-f0f2a3e4bf83 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:12.237555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-28b48183-72c0-4bc7-8bfa-f0f2a3e4bf83 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:12.249515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28b48183-72c0-4bc7-8bfa-f0f2a3e4bf83 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:12.250218 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28b48183-72c0-4bc7-8bfa-f0f2a3e4bf83 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:12.251035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28b48183-72c0-4bc7-8bfa-f0f2a3e4bf83 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:12.251493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28b48183-72c0-4bc7-8bfa-f0f2a3e4bf83 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:12.738664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-87b9482d-f165-4277-a21c-c2d05271a1dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:27:12.739946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-87b9482d-f165-4277-a21c-c2d05271a1dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:27:12.740571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-87b9482d-f165-4277-a21c-c2d05271a1dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:27:12.741294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-87b9482d-f165-4277-a21c-c2d05271a1dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:27:12.741882 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-87b9482d-f165-4277-a21c-c2d05271a1dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:27:12.761923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87b9482d-f165-4277-a21c-c2d05271a1dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:12.762387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87b9482d-f165-4277-a21c-c2d05271a1dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:12.763708 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87b9482d-f165-4277-a21c-c2d05271a1dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:12.766215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87b9482d-f165-4277-a21c-c2d05271a1dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:12.813291 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-87b9482d-f165-4277-a21c-c2d05271a1dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Getting quotas for project 014ae80b3f434bcb9fa2629ccdf4aad7. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:27:12.822613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-87b9482d-f165-4277-a21c-c2d05271a1dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Getting quotas for user 1cafab0cbef64be59c7afef84d7888ff and project 014ae80b3f434bcb9fa2629ccdf4aad7. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:27:12.852892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-87b9482d-f165-4277-a21c-c2d05271a1dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:27:12.853739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-87b9482d-f165-4277-a21c-c2d05271a1dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:27:13.040157 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-87b9482d-f165-4277-a21c-c2d05271a1dd tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.529840 May 21 21:27:13.053039 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2046/3960] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:27:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:27:13.060149 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3fb15546-7924-45ae-979c-d0548c2bf255 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:13.060795 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3fb15546-7924-45ae-979c-d0548c2bf255 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:13.083926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3fb15546-7924-45ae-979c-d0548c2bf255 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:13.086081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3fb15546-7924-45ae-979c-d0548c2bf255 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:13.086908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3fb15546-7924-45ae-979c-d0548c2bf255 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:13.089517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3fb15546-7924-45ae-979c-d0548c2bf255 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:13.140112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-28b48183-72c0-4bc7-8bfa-f0f2a3e4bf83 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:13.150400 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-28b48183-72c0-4bc7-8bfa-f0f2a3e4bf83 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.918497 May 21 21:27:13.168517 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1915/3961] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:12 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:13.181920 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1f0ea7b9-a002-47e3-abf6-af641622f24c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:13.184855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1f0ea7b9-a002-47e3-abf6-af641622f24c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:13.354831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3fb15546-7924-45ae-979c-d0548c2bf255 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:13.366312 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3fb15546-7924-45ae-979c-d0548c2bf255 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1317 microversion: 2.1 time: 0.310062 May 21 21:27:13.367999 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2047/3962] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:13 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:13.424108 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1f0ea7b9-a002-47e3-abf6-af641622f24c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:13.433724 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1f0ea7b9-a002-47e3-abf6-af641622f24c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0" status: 200 len: 1215 microversion: 2.1 time: 0.263453 May 21 21:27:13.434676 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1916/3963] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:13 2022] GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0 => generated 1215 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:14.173072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9c3ee518-4956-47bc-84e3-f51fa85ce95f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:14.173859 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9c3ee518-4956-47bc-84e3-f51fa85ce95f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:14.183018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c3ee518-4956-47bc-84e3-f51fa85ce95f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:14.185189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c3ee518-4956-47bc-84e3-f51fa85ce95f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:14.185189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c3ee518-4956-47bc-84e3-f51fa85ce95f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:14.185189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c3ee518-4956-47bc-84e3-f51fa85ce95f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:14.386900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ea2f54bf-b230-4cdb-a389-b252a74f8288 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:14.387536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ea2f54bf-b230-4cdb-a389-b252a74f8288 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:14.403630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ea2f54bf-b230-4cdb-a389-b252a74f8288 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:14.403895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9c3ee518-4956-47bc-84e3-f51fa85ce95f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:14.405994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ea2f54bf-b230-4cdb-a389-b252a74f8288 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:14.405994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ea2f54bf-b230-4cdb-a389-b252a74f8288 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:14.405994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ea2f54bf-b230-4cdb-a389-b252a74f8288 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:14.414812 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9c3ee518-4956-47bc-84e3-f51fa85ce95f tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.246165 May 21 21:27:14.417533 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2048/3964] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:14 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:14.453757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5de944c1-88f7-4e0f-9c20-523b3111a767 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:14.454912 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5de944c1-88f7-4e0f-9c20-523b3111a767 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:14.463751 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5de944c1-88f7-4e0f-9c20-523b3111a767 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:14.464320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5de944c1-88f7-4e0f-9c20-523b3111a767 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:14.465382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5de944c1-88f7-4e0f-9c20-523b3111a767 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:14.465838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5de944c1-88f7-4e0f-9c20-523b3111a767 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:14.564918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5de944c1-88f7-4e0f-9c20-523b3111a767 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:14.572883 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5de944c1-88f7-4e0f-9c20-523b3111a767 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0" status: 200 len: 1219 microversion: 2.1 time: 0.125660 May 21 21:27:14.573493 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2049/3965] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:14 2022] GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0 => generated 1219 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:14.578597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-0222ae94-d34f-4ebc-bd6f-15f2dfc51507 req-f7888094-1771-4901-aa07-2dcc7bf912f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec44cb55-6eb8-4fa8-a028-81cebb81784b", "tag": "82d3aaa4-7f3a-4649-9287-1aad4999a90c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:14.588484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-0222ae94-d34f-4ebc-bd6f-15f2dfc51507 req-f7888094-1771-4901-aa07-2dcc7bf912f4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:14.589650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-0222ae94-d34f-4ebc-bd6f-15f2dfc51507 req-f7888094-1771-4901-aa07-2dcc7bf912f4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:14.602561 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-0222ae94-d34f-4ebc-bd6f-15f2dfc51507 req-f7888094-1771-4901-aa07-2dcc7bf912f4 service nova] Creating event network-changed:82d3aaa4-7f3a-4649-9287-1aad4999a90c for instance ec44cb55-6eb8-4fa8-a028-81cebb81784b on nch1-master-1 May 21 21:27:14.608654 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-0222ae94-d34f-4ebc-bd6f-15f2dfc51507 req-f7888094-1771-4901-aa07-2dcc7bf912f4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033514 May 21 21:27:14.609280 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2050/3966] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:27:14.731453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ea2f54bf-b230-4cdb-a389-b252a74f8288 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:14.740625 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ea2f54bf-b230-4cdb-a389-b252a74f8288 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1317 microversion: 2.1 time: 0.359420 May 21 21:27:14.741355 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1917/3967] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:14 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:15.436535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-016bb387-7045-4457-ac69-0c680ede04f3 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:15.437924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-016bb387-7045-4457-ac69-0c680ede04f3 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:15.447800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-016bb387-7045-4457-ac69-0c680ede04f3 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:15.449712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-016bb387-7045-4457-ac69-0c680ede04f3 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:15.450109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-016bb387-7045-4457-ac69-0c680ede04f3 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:15.450882 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-016bb387-7045-4457-ac69-0c680ede04f3 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:15.598714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a139bde9-2fda-4c93-a948-e56a50cef21a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:15.600389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a139bde9-2fda-4c93-a948-e56a50cef21a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:15.617200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a139bde9-2fda-4c93-a948-e56a50cef21a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:15.618881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a139bde9-2fda-4c93-a948-e56a50cef21a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:15.620682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a139bde9-2fda-4c93-a948-e56a50cef21a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:15.621743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a139bde9-2fda-4c93-a948-e56a50cef21a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:15.634417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-016bb387-7045-4457-ac69-0c680ede04f3 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:15.656315 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-016bb387-7045-4457-ac69-0c680ede04f3 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1506 microversion: 2.1 time: 0.226587 May 21 21:27:15.666625 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2051/3968] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:15 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:15.758944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3ae4d87f-671f-4283-b79f-c37a45ef4e29 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:15.759872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3ae4d87f-671f-4283-b79f-c37a45ef4e29 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:15.770511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3ae4d87f-671f-4283-b79f-c37a45ef4e29 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:15.771261 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3ae4d87f-671f-4283-b79f-c37a45ef4e29 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:15.772233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3ae4d87f-671f-4283-b79f-c37a45ef4e29 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:15.772861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3ae4d87f-671f-4283-b79f-c37a45ef4e29 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:15.821919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a139bde9-2fda-4c93-a948-e56a50cef21a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:15.840680 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a139bde9-2fda-4c93-a948-e56a50cef21a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0" status: 200 len: 1267 microversion: 2.1 time: 0.253324 May 21 21:27:15.841420 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1918/3969] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:15 2022] GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0 => generated 1267 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:15.937409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3ae4d87f-671f-4283-b79f-c37a45ef4e29 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:15.949340 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3ae4d87f-671f-4283-b79f-c37a45ef4e29 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1317 microversion: 2.1 time: 0.195249 May 21 21:27:15.950028 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2052/3970] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:15 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:16.689925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-40fc3c02-6d0c-497e-b6ea-4c557af79e01 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:16.690663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-40fc3c02-6d0c-497e-b6ea-4c557af79e01 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:16.697332 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-48e7a2da-3f61-4e1e-b7f3-9eca257296c9 req-7124d28f-386c-4ea7-a436-9d59b80dff2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "453d2270-109d-4b11-9eae-01fadd67a6cb", "name": "network-vif-deleted", "tag": "aa5d2d0b-b2ef-482d-a3cf-2881c7beccc4"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:16.723062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40fc3c02-6d0c-497e-b6ea-4c557af79e01 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:16.723793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40fc3c02-6d0c-497e-b6ea-4c557af79e01 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:16.730275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40fc3c02-6d0c-497e-b6ea-4c557af79e01 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:16.731552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-48e7a2da-3f61-4e1e-b7f3-9eca257296c9 req-7124d28f-386c-4ea7-a436-9d59b80dff2f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:16.732142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40fc3c02-6d0c-497e-b6ea-4c557af79e01 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:16.732794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-48e7a2da-3f61-4e1e-b7f3-9eca257296c9 req-7124d28f-386c-4ea7-a436-9d59b80dff2f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:16.797478 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-48e7a2da-3f61-4e1e-b7f3-9eca257296c9 req-7124d28f-386c-4ea7-a436-9d59b80dff2f service nova] Creating event network-vif-deleted:aa5d2d0b-b2ef-482d-a3cf-2881c7beccc4 for instance 453d2270-109d-4b11-9eae-01fadd67a6cb on nch2-master-1 May 21 21:27:16.811388 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-48e7a2da-3f61-4e1e-b7f3-9eca257296c9 req-7124d28f-386c-4ea7-a436-9d59b80dff2f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128490 May 21 21:27:16.812261 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2053/3971] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:27:16.861906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-677a0135-aab8-46e1-832a-7f3df8acbc72 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:16.862926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-677a0135-aab8-46e1-832a-7f3df8acbc72 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:16.886365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-677a0135-aab8-46e1-832a-7f3df8acbc72 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:16.887376 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-677a0135-aab8-46e1-832a-7f3df8acbc72 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:16.889699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-677a0135-aab8-46e1-832a-7f3df8acbc72 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:16.890411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-677a0135-aab8-46e1-832a-7f3df8acbc72 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:17.122783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-677a0135-aab8-46e1-832a-7f3df8acbc72 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:17.137594 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-677a0135-aab8-46e1-832a-7f3df8acbc72 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0" status: 200 len: 1273 microversion: 2.1 time: 0.282999 May 21 21:27:17.145076 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2054/3972] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:16 2022] GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0 => generated 1273 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:17.154096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-61dd4c91-f9a6-4966-a927-7a8387f82299 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:17.155045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-61dd4c91-f9a6-4966-a927-7a8387f82299 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:17.162719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61dd4c91-f9a6-4966-a927-7a8387f82299 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:17.163430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61dd4c91-f9a6-4966-a927-7a8387f82299 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:17.164481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61dd4c91-f9a6-4966-a927-7a8387f82299 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:17.165099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61dd4c91-f9a6-4966-a927-7a8387f82299 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:17.198583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:17.311419 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-40fc3c02-6d0c-497e-b6ea-4c557af79e01 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:17.330235 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-40fc3c02-6d0c-497e-b6ea-4c557af79e01 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 200 len: 1464 microversion: 2.1 time: 0.654971 May 21 21:27:17.330235 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1919/3973] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:16 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 1464 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:17.691191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-61dd4c91-f9a6-4966-a927-7a8387f82299 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:17.702012 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-61dd4c91-f9a6-4966-a927-7a8387f82299 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1317 microversion: 2.1 time: 0.554159 May 21 21:27:17.703475 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2055/3974] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:17 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1317 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:18.180384 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-471b9f0b-084b-49ee-af53-daa9604a2dcb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:18.181822 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-471b9f0b-084b-49ee-af53-daa9604a2dcb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:18.196710 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:18.205418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:18.209003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-471b9f0b-084b-49ee-af53-daa9604a2dcb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:18.212118 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-471b9f0b-084b-49ee-af53-daa9604a2dcb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:18.221989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-471b9f0b-084b-49ee-af53-daa9604a2dcb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:18.221989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-471b9f0b-084b-49ee-af53-daa9604a2dcb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:18.346558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-06345332-15e2-47d1-8fbd-7e548bf41a58 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:18.347932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-06345332-15e2-47d1-8fbd-7e548bf41a58 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 453d2270-109d-4b11-9eae-01fadd67a6cb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:18.373764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06345332-15e2-47d1-8fbd-7e548bf41a58 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:18.374244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06345332-15e2-47d1-8fbd-7e548bf41a58 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:18.378906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06345332-15e2-47d1-8fbd-7e548bf41a58 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:18.379647 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06345332-15e2-47d1-8fbd-7e548bf41a58 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:18.454037 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-06345332-15e2-47d1-8fbd-7e548bf41a58 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] HTTP exception thrown: Instance 453d2270-109d-4b11-9eae-01fadd67a6cb could not be found. May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-06345332-15e2-47d1-8fbd-7e548bf41a58 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Request method failure captured: May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb HTTP/1.1 May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVjOntuK6HQeT-Ks5II3JLdwCqqMYVxpcssCeDu0W_M-HjBYerESi5FVsmwyoT700NU09EEOScZ5YjOXuZnA74k_RPKMtefP0xi4s2cORvlpk8EerrXpPd0C1SzGO8j7rV9RhJmgyl__UfwTv0XnGfUwmGIvu12g2_rFyi4Hb6JHA9A May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: a4da9d7db0c74b55908d44fd7bc7d4ff May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerRescueTestJSON-1121393746 May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a4da9d7db0c74b55908d44fd7bc7d4ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a4da9d7db0c74b55908d44fd7bc7d4ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a4da9d7db0c74b55908d44fd7bc7d4ff", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a4da9d7db0c74b55908d44fd7bc7d4ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerRescueTestJSON-1121393746 May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: a4da9d7db0c74b55908d44fd7bc7d4ff May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerRescueTestJSON-1121393746 May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerRescueTestJSON-1121393746-project May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 12adb7ad474b4361812cd1f6ad70ef59 May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerRescueTestJSON-1121393746-project May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 453d2270-109d-4b11-9eae-01fadd67a6cb could not be found. May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '453d2270-109d-4b11-9eae-01fadd67a6cb'} May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 453d2270-109d-4b11-9eae-01fadd67a6cb could not be found. May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 453d2270-109d-4b11-9eae-01fadd67a6cb could not be found. May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:27:18.456694 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:27:18.462599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:27:18.462599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:27:18.462599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:27:18.462599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:27:18.462599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:27:18.462599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 453d2270-109d-4b11-9eae-01fadd67a6cb could not be found. May 21 21:27:18.462599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:27:18.464223 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-06345332-15e2-47d1-8fbd-7e548bf41a58 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Returning 404 to user: Instance 453d2270-109d-4b11-9eae-01fadd67a6cb could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:27:18.466101 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-06345332-15e2-47d1-8fbd-7e548bf41a58 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb" status: 404 len: 111 microversion: 2.1 time: 0.124686 May 21 21:27:18.466994 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2056/3975] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:18 2022] GET /compute/v2.1/servers/453d2270-109d-4b11-9eae-01fadd67a6cb => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:27:18.478777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-026d408b-e887-4d85-851b-8b5eeebcb9a7 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:18.479831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-026d408b-e887-4d85-851b-8b5eeebcb9a7 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:18.491469 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-026d408b-e887-4d85-851b-8b5eeebcb9a7 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:18.492296 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-026d408b-e887-4d85-851b-8b5eeebcb9a7 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:18.493402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-026d408b-e887-4d85-851b-8b5eeebcb9a7 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:18.494054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-026d408b-e887-4d85-851b-8b5eeebcb9a7 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:18.537340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-471b9f0b-084b-49ee-af53-daa9604a2dcb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:18.547401 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-471b9f0b-084b-49ee-af53-daa9604a2dcb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0" status: 200 len: 1315 microversion: 2.1 time: 0.380364 May 21 21:27:18.560119 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1920/3976] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:18 2022] GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:18.566804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-026d408b-e887-4d85-851b-8b5eeebcb9a7 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:27:18.719736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-da59d648-ec02-4488-bbfe-6006c0fb46d7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:18.720709 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-da59d648-ec02-4488-bbfe-6006c0fb46d7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:18.736401 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da59d648-ec02-4488-bbfe-6006c0fb46d7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:18.737170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da59d648-ec02-4488-bbfe-6006c0fb46d7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:18.738564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da59d648-ec02-4488-bbfe-6006c0fb46d7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:18.742884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da59d648-ec02-4488-bbfe-6006c0fb46d7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:19.035406 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-026d408b-e887-4d85-851b-8b5eeebcb9a7 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "DELETE /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 204 len: 0 microversion: 2.1 time: 0.562504 May 21 21:27:19.037098 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2057/3977] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:27:18 2022] DELETE /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:27:19.049765 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e12cf1e5-5b66-4d53-bff1-0bf0236c73ff tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:19.050747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e12cf1e5-5b66-4d53-bff1-0bf0236c73ff tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:19.059179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e12cf1e5-5b66-4d53-bff1-0bf0236c73ff tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:19.060815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e12cf1e5-5b66-4d53-bff1-0bf0236c73ff tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:19.071231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e12cf1e5-5b66-4d53-bff1-0bf0236c73ff tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:19.071978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e12cf1e5-5b66-4d53-bff1-0bf0236c73ff tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:19.252425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-da59d648-ec02-4488-bbfe-6006c0fb46d7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:19.265417 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-da59d648-ec02-4488-bbfe-6006c0fb46d7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1317 microversion: 2.1 time: 0.550069 May 21 21:27:19.271251 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1921/3978] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:18 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1317 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:19.397639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e12cf1e5-5b66-4d53-bff1-0bf0236c73ff tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:19.407645 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e12cf1e5-5b66-4d53-bff1-0bf0236c73ff tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1492 microversion: 2.1 time: 0.364007 May 21 21:27:19.408575 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2058/3979] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:19 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1492 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:19.566669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8b62f523-0c0a-4f12-9d73-4e768af8f3e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:19.567299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8b62f523-0c0a-4f12-9d73-4e768af8f3e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:19.579006 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b62f523-0c0a-4f12-9d73-4e768af8f3e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:19.579486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b62f523-0c0a-4f12-9d73-4e768af8f3e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:19.582297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b62f523-0c0a-4f12-9d73-4e768af8f3e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:19.584004 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b62f523-0c0a-4f12-9d73-4e768af8f3e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:19.976162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8b62f523-0c0a-4f12-9d73-4e768af8f3e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:19.984314 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8b62f523-0c0a-4f12-9d73-4e768af8f3e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0" status: 200 len: 1315 microversion: 2.1 time: 0.422213 May 21 21:27:19.985081 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1922/3980] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:19 2022] GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:20.290737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-72416ee7-094f-4196-91e1-d494555794e5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:20.290737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-72416ee7-094f-4196-91e1-d494555794e5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:20.303004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72416ee7-094f-4196-91e1-d494555794e5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:20.304449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72416ee7-094f-4196-91e1-d494555794e5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:20.305868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72416ee7-094f-4196-91e1-d494555794e5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:20.306467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72416ee7-094f-4196-91e1-d494555794e5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:20.427505 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-78bc8d6a-7199-4e18-92e6-a37316f54197 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:20.430054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-78bc8d6a-7199-4e18-92e6-a37316f54197 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:20.445221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78bc8d6a-7199-4e18-92e6-a37316f54197 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:20.449003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78bc8d6a-7199-4e18-92e6-a37316f54197 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:20.450418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78bc8d6a-7199-4e18-92e6-a37316f54197 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:20.451416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78bc8d6a-7199-4e18-92e6-a37316f54197 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:20.887722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-78bc8d6a-7199-4e18-92e6-a37316f54197 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:20.908375 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-78bc8d6a-7199-4e18-92e6-a37316f54197 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1492 microversion: 2.1 time: 0.477373 May 21 21:27:20.909136 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1923/3981] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:20 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1492 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:20.914171 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-3fabccb9-bf60-4d11-9f31-1e7783d2acf3 req-f6e91901-daa4-4a48-9baf-36acd06da96f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2820cc-216b-43d8-b0d5-54f85539f3e0", "tag": "bf13d8ee-782a-43ad-8555-f1b13fa22ec5"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:20.927385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3fabccb9-bf60-4d11-9f31-1e7783d2acf3 req-f6e91901-daa4-4a48-9baf-36acd06da96f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:20.927695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3fabccb9-bf60-4d11-9f31-1e7783d2acf3 req-f6e91901-daa4-4a48-9baf-36acd06da96f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:20.943370 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-3fabccb9-bf60-4d11-9f31-1e7783d2acf3 req-f6e91901-daa4-4a48-9baf-36acd06da96f service nova] Creating event network-changed:bf13d8ee-782a-43ad-8555-f1b13fa22ec5 for instance 5b2820cc-216b-43d8-b0d5-54f85539f3e0 on nch2-master-1 May 21 21:27:20.953646 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-3fabccb9-bf60-4d11-9f31-1e7783d2acf3 req-f6e91901-daa4-4a48-9baf-36acd06da96f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042860 May 21 21:27:20.956327 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1924/3982] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:27:21.003442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c37d967b-c155-4896-ab30-b2f6688a5f6b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:21.004567 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c37d967b-c155-4896-ab30-b2f6688a5f6b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:21.013216 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c37d967b-c155-4896-ab30-b2f6688a5f6b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:21.013905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c37d967b-c155-4896-ab30-b2f6688a5f6b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:21.015765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c37d967b-c155-4896-ab30-b2f6688a5f6b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:21.016434 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c37d967b-c155-4896-ab30-b2f6688a5f6b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:21.134558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-72416ee7-094f-4196-91e1-d494555794e5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:21.154014 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-72416ee7-094f-4196-91e1-d494555794e5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1317 microversion: 2.1 time: 0.869514 May 21 21:27:21.154638 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2059/3983] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:20 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1317 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:21.433678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c37d967b-c155-4896-ab30-b2f6688a5f6b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:21.447940 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c37d967b-c155-4896-ab30-b2f6688a5f6b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0" status: 200 len: 1315 microversion: 2.1 time: 0.448619 May 21 21:27:21.458335 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1925/3984] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:20 2022] GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:21.930957 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d0197a84-a93a-4503-b1d7-d28808b10b75 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:21.932832 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d0197a84-a93a-4503-b1d7-d28808b10b75 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:21.942946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d0197a84-a93a-4503-b1d7-d28808b10b75 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:21.943738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d0197a84-a93a-4503-b1d7-d28808b10b75 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:21.944831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d0197a84-a93a-4503-b1d7-d28808b10b75 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:21.945508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d0197a84-a93a-4503-b1d7-d28808b10b75 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:22.171910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4c6cdd2b-c1ab-49e6-a745-a9bd0a385a58 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:22.172631 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4c6cdd2b-c1ab-49e6-a745-a9bd0a385a58 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:22.182952 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4c6cdd2b-c1ab-49e6-a745-a9bd0a385a58 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:22.183083 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4c6cdd2b-c1ab-49e6-a745-a9bd0a385a58 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:22.183992 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4c6cdd2b-c1ab-49e6-a745-a9bd0a385a58 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:22.189290 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4c6cdd2b-c1ab-49e6-a745-a9bd0a385a58 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:22.304175 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d0197a84-a93a-4503-b1d7-d28808b10b75 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:22.314617 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d0197a84-a93a-4503-b1d7-d28808b10b75 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1492 microversion: 2.1 time: 0.391186 May 21 21:27:22.315312 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2060/3985] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:21 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1492 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:22.465671 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1d5fdddf-8f26-40cc-b85f-fe5b25ac4a69 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:22.466543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1d5fdddf-8f26-40cc-b85f-fe5b25ac4a69 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:22.473149 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d5fdddf-8f26-40cc-b85f-fe5b25ac4a69 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:22.473609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d5fdddf-8f26-40cc-b85f-fe5b25ac4a69 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:22.474398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d5fdddf-8f26-40cc-b85f-fe5b25ac4a69 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:22.474850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d5fdddf-8f26-40cc-b85f-fe5b25ac4a69 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:22.551863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4c6cdd2b-c1ab-49e6-a745-a9bd0a385a58 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:22.566825 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4c6cdd2b-c1ab-49e6-a745-a9bd0a385a58 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1317 microversion: 2.1 time: 0.399167 May 21 21:27:22.567432 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1926/3986] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:22 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:22.574423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-99299c4c-2a2a-402e-95ed-65c68cf05450 req-59b118e6-3282-4034-b406-d3393f1a98a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec44cb55-6eb8-4fa8-a028-81cebb81784b", "name": "network-vif-plugged", "status": "completed", "tag": "82d3aaa4-7f3a-4649-9287-1aad4999a90c"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:22.592868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-99299c4c-2a2a-402e-95ed-65c68cf05450 req-59b118e6-3282-4034-b406-d3393f1a98a5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:22.596868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-99299c4c-2a2a-402e-95ed-65c68cf05450 req-59b118e6-3282-4034-b406-d3393f1a98a5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:22.600786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:22.610163 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-99299c4c-2a2a-402e-95ed-65c68cf05450 req-59b118e6-3282-4034-b406-d3393f1a98a5 service nova] Creating event network-vif-plugged:82d3aaa4-7f3a-4649-9287-1aad4999a90c for instance ec44cb55-6eb8-4fa8-a028-81cebb81784b on nch1-master-1 May 21 21:27:22.615554 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-99299c4c-2a2a-402e-95ed-65c68cf05450 req-59b118e6-3282-4034-b406-d3393f1a98a5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045251 May 21 21:27:22.620245 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1927/3987] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:27:22.790853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:22.835769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=8 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:22.974116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-5a532dfd-6183-4f77-a8b4-f7915e95bf07 req-f2f820eb-3c53-44db-acde-a68984bea1ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59762e62-5267-4d7a-a18d-ebf1b0530184", "name": "network-vif-deleted", "tag": "55a19002-8c35-4744-bcc4-6b7c33adcbd6"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:22.988712 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-5a532dfd-6183-4f77-a8b4-f7915e95bf07 req-f2f820eb-3c53-44db-acde-a68984bea1ac service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:22.989278 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-5a532dfd-6183-4f77-a8b4-f7915e95bf07 req-f2f820eb-3c53-44db-acde-a68984bea1ac service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:23.004795 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-5a532dfd-6183-4f77-a8b4-f7915e95bf07 req-f2f820eb-3c53-44db-acde-a68984bea1ac service nova] Creating event network-vif-deleted:55a19002-8c35-4744-bcc4-6b7c33adcbd6 for instance 59762e62-5267-4d7a-a18d-ebf1b0530184 on nch1-master-1 May 21 21:27:23.012702 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-5a532dfd-6183-4f77-a8b4-f7915e95bf07 req-f2f820eb-3c53-44db-acde-a68984bea1ac service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042966 May 21 21:27:23.014290 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1928/3988] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:27:23.024967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1d5fdddf-8f26-40cc-b85f-fe5b25ac4a69 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:23.038203 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1d5fdddf-8f26-40cc-b85f-fe5b25ac4a69 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0" status: 200 len: 1315 microversion: 2.1 time: 0.577080 May 21 21:27:23.039172 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2061/3989] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:22 2022] GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0 => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:23.331885 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-67b95817-dde9-4cde-99bb-6a14d2340b88 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:23.332856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-67b95817-dde9-4cde-99bb-6a14d2340b88 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:23.339975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-67b95817-dde9-4cde-99bb-6a14d2340b88 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:23.340749 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-67b95817-dde9-4cde-99bb-6a14d2340b88 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:23.341539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-67b95817-dde9-4cde-99bb-6a14d2340b88 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:23.341980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-67b95817-dde9-4cde-99bb-6a14d2340b88 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:23.393205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-67b95817-dde9-4cde-99bb-6a14d2340b88 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:23.394152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-67b95817-dde9-4cde-99bb-6a14d2340b88 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:23.394833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-67b95817-dde9-4cde-99bb-6a14d2340b88 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lazy-loading 'fault' on Instance uuid 59762e62-5267-4d7a-a18d-ebf1b0530184 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:27:23.430075 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=8 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:23.469609 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-67b95817-dde9-4cde-99bb-6a14d2340b88 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12adb7ad474b4361812cd1f6ad70ef59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4da9d7db0c74b55908d44fd7bc7d4ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:23.509052 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-67b95817-dde9-4cde-99bb-6a14d2340b88 tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 200 len: 1304 microversion: 2.1 time: 0.175828 May 21 21:27:23.509052 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1929/3990] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:23 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 1304 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:23.590390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e613d029-fa9b-4b9d-9b04-60439ced662b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:23.591092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e613d029-fa9b-4b9d-9b04-60439ced662b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:23.597986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e613d029-fa9b-4b9d-9b04-60439ced662b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:23.613110 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e613d029-fa9b-4b9d-9b04-60439ced662b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:23.613110 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e613d029-fa9b-4b9d-9b04-60439ced662b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:23.613110 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e613d029-fa9b-4b9d-9b04-60439ced662b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:23.925154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e613d029-fa9b-4b9d-9b04-60439ced662b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:23.935832 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e613d029-fa9b-4b9d-9b04-60439ced662b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1317 microversion: 2.1 time: 0.350562 May 21 21:27:23.948115 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2062/3991] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:23 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:24.056446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9a864e55-35b7-42b8-a2a3-c947bc677501 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:24.057209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9a864e55-35b7-42b8-a2a3-c947bc677501 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:24.067074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a864e55-35b7-42b8-a2a3-c947bc677501 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:24.067537 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a864e55-35b7-42b8-a2a3-c947bc677501 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:24.068369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a864e55-35b7-42b8-a2a3-c947bc677501 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:24.074600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a864e55-35b7-42b8-a2a3-c947bc677501 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:24.367558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9a864e55-35b7-42b8-a2a3-c947bc677501 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:24.377741 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9a864e55-35b7-42b8-a2a3-c947bc677501 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0" status: 200 len: 1315 microversion: 2.1 time: 0.326440 May 21 21:27:24.382145 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1930/3992] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:24 2022] GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:24.527189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d8438c49-cca8-4c93-99ae-b0b7b5ab33fa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:24.528133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d8438c49-cca8-4c93-99ae-b0b7b5ab33fa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] [instance: 59762e62-5267-4d7a-a18d-ebf1b0530184] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:24.543109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8438c49-cca8-4c93-99ae-b0b7b5ab33fa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:24.543896 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8438c49-cca8-4c93-99ae-b0b7b5ab33fa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:24.547395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8438c49-cca8-4c93-99ae-b0b7b5ab33fa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:24.547395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8438c49-cca8-4c93-99ae-b0b7b5ab33fa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:24.576314 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-d8438c49-cca8-4c93-99ae-b0b7b5ab33fa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] HTTP exception thrown: Instance 59762e62-5267-4d7a-a18d-ebf1b0530184 could not be found. May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d8438c49-cca8-4c93-99ae-b0b7b5ab33fa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Request method failure captured: May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 HTTP/1.1 May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVjOntuK6HQeT-Ks5II3JLdwCqqMYVxpcssCeDu0W_M-HjBYerESi5FVsmwyoT700NU09EEOScZ5YjOXuZnA74k_RPKMtefP0xi4s2cORvlpk8EerrXpPd0C1SzGO8j7rV9RhJmgyl__UfwTv0XnGfUwmGIvu12g2_rFyi4Hb6JHA9A May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: a4da9d7db0c74b55908d44fd7bc7d4ff May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerRescueTestJSON-1121393746 May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a4da9d7db0c74b55908d44fd7bc7d4ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a4da9d7db0c74b55908d44fd7bc7d4ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a4da9d7db0c74b55908d44fd7bc7d4ff", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a4da9d7db0c74b55908d44fd7bc7d4ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerRescueTestJSON-1121393746 May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: a4da9d7db0c74b55908d44fd7bc7d4ff May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerRescueTestJSON-1121393746 May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerRescueTestJSON-1121393746-project May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 12adb7ad474b4361812cd1f6ad70ef59 May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerRescueTestJSON-1121393746-project May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 59762e62-5267-4d7a-a18d-ebf1b0530184 could not be found. May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '59762e62-5267-4d7a-a18d-ebf1b0530184'} May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59762e62-5267-4d7a-a18d-ebf1b0530184 could not be found. May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59762e62-5267-4d7a-a18d-ebf1b0530184 could not be found. May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:27:24.578684 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:27:24.584850 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:27:24.584850 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:27:24.584850 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:27:24.584850 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:27:24.584850 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:27:24.584850 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59762e62-5267-4d7a-a18d-ebf1b0530184 could not be found. May 21 21:27:24.584850 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:27:24.588797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d8438c49-cca8-4c93-99ae-b0b7b5ab33fa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] Returning 404 to user: Instance 59762e62-5267-4d7a-a18d-ebf1b0530184 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:27:24.592578 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d8438c49-cca8-4c93-99ae-b0b7b5ab33fa tempest-ServerRescueTestJSON-1121393746 tempest-ServerRescueTestJSON-1121393746-project] 10.222.0.49 "GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184" status: 404 len: 111 microversion: 2.1 time: 0.068511 May 21 21:27:24.592578 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2063/3993] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:24 2022] GET /compute/v2.1/servers/59762e62-5267-4d7a-a18d-ebf1b0530184 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:27:24.957105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eb175fa8-ce3c-450a-b0ba-132d8560f093 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:24.957755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-eb175fa8-ce3c-450a-b0ba-132d8560f093 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:24.968235 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb175fa8-ce3c-450a-b0ba-132d8560f093 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:24.969035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb175fa8-ce3c-450a-b0ba-132d8560f093 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:24.970144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb175fa8-ce3c-450a-b0ba-132d8560f093 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:24.970854 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb175fa8-ce3c-450a-b0ba-132d8560f093 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:25.219313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-eb175fa8-ce3c-450a-b0ba-132d8560f093 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:25.242274 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-eb175fa8-ce3c-450a-b0ba-132d8560f093 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1508 microversion: 2.1 time: 0.284502 May 21 21:27:25.243673 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1931/3994] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:24 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1508 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:25.260375 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-82697e22-84b0-431d-aca9-15e38b0f8bb1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:25.261227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-82697e22-84b0-431d-aca9-15e38b0f8bb1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:25.268185 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82697e22-84b0-431d-aca9-15e38b0f8bb1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:25.268676 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82697e22-84b0-431d-aca9-15e38b0f8bb1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:25.269470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82697e22-84b0-431d-aca9-15e38b0f8bb1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:25.269921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82697e22-84b0-431d-aca9-15e38b0f8bb1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:25.595591 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-82697e22-84b0-431d-aca9-15e38b0f8bb1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:25.604594 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-82697e22-84b0-431d-aca9-15e38b0f8bb1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1508 microversion: 2.1 time: 0.348968 May 21 21:27:25.606066 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2064/3995] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:25 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1508 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:25.622187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cdaf7fc8-8b73-4bc8-a3f1-a72198e2efcb tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:25.623539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cdaf7fc8-8b73-4bc8-a3f1-a72198e2efcb tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:25.630289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdaf7fc8-8b73-4bc8-a3f1-a72198e2efcb tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:25.630810 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdaf7fc8-8b73-4bc8-a3f1-a72198e2efcb tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:25.631829 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdaf7fc8-8b73-4bc8-a3f1-a72198e2efcb tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:25.632578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdaf7fc8-8b73-4bc8-a3f1-a72198e2efcb tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:25.676354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8770caea-8182-4dad-b8d7-765d6d398f14 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:25.677275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8770caea-8182-4dad-b8d7-765d6d398f14 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:25.693940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8770caea-8182-4dad-b8d7-765d6d398f14 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:25.694281 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8770caea-8182-4dad-b8d7-765d6d398f14 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:25.695090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8770caea-8182-4dad-b8d7-765d6d398f14 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:25.695542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8770caea-8182-4dad-b8d7-765d6d398f14 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:25.886545 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cdaf7fc8-8b73-4bc8-a3f1-a72198e2efcb tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "PUT /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1080 microversion: 2.1 time: 0.268949 May 21 21:27:25.887338 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2065/3996] 10.222.0.49 () {60 vars in 1255 bytes} [Sat May 21 21:27:25 2022] PUT /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1080 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:25.905783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-86e64db7-7d5c-41db-aa65-866eb79a2639 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:25.911299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-86e64db7-7d5c-41db-aa65-866eb79a2639 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:25.911299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:25.914806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86e64db7-7d5c-41db-aa65-866eb79a2639 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:25.915298 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86e64db7-7d5c-41db-aa65-866eb79a2639 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:25.916133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86e64db7-7d5c-41db-aa65-866eb79a2639 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:25.917145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86e64db7-7d5c-41db-aa65-866eb79a2639 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:25.980364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8770caea-8182-4dad-b8d7-765d6d398f14 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:25.988572 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8770caea-8182-4dad-b8d7-765d6d398f14 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0" status: 200 len: 1315 microversion: 2.1 time: 0.593306 May 21 21:27:25.989152 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1932/3997] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:25 2022] GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0 => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:26.257519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-86e64db7-7d5c-41db-aa65-866eb79a2639 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:26.266813 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-86e64db7-7d5c-41db-aa65-866eb79a2639 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1506 microversion: 2.1 time: 0.368212 May 21 21:27:26.267868 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2066/3998] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:25 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:26.285998 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dcf91cba-b973-49ee-b11b-1defde50984b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:26.286624 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dcf91cba-b973-49ee-b11b-1defde50984b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:26.307463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dcf91cba-b973-49ee-b11b-1defde50984b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:26.308012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dcf91cba-b973-49ee-b11b-1defde50984b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:26.309146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dcf91cba-b973-49ee-b11b-1defde50984b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:26.309755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dcf91cba-b973-49ee-b11b-1defde50984b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:26.505076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dcf91cba-b973-49ee-b11b-1defde50984b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:26.513145 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dcf91cba-b973-49ee-b11b-1defde50984b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1506 microversion: 2.1 time: 0.231005 May 21 21:27:26.513730 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1933/3999] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:26 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1506 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:26.531170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1dfd38dc-6d9b-41a7-a5fc-907044c64543 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:26.532750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1dfd38dc-6d9b-41a7-a5fc-907044c64543 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:26.546207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dfd38dc-6d9b-41a7-a5fc-907044c64543 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:26.546207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dfd38dc-6d9b-41a7-a5fc-907044c64543 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:26.546207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dfd38dc-6d9b-41a7-a5fc-907044c64543 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:26.546207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dfd38dc-6d9b-41a7-a5fc-907044c64543 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:26.651390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-1dfd38dc-6d9b-41a7-a5fc-907044c64543 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:27:26.652010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-1dfd38dc-6d9b-41a7-a5fc-907044c64543 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:27:26.652291 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-1dfd38dc-6d9b-41a7-a5fc-907044c64543 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:27:26.653082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-1dfd38dc-6d9b-41a7-a5fc-907044c64543 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:27:26.653498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-1dfd38dc-6d9b-41a7-a5fc-907044c64543 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:27:26.987548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1dfd38dc-6d9b-41a7-a5fc-907044c64543 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:27.003897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dfd38dc-6d9b-41a7-a5fc-907044c64543 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:27.004915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dfd38dc-6d9b-41a7-a5fc-907044c64543 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:27.005961 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dfd38dc-6d9b-41a7-a5fc-907044c64543 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:27.010654 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-887d299d-c715-40d5-bcda-1863adaf479b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:27.010765 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dfd38dc-6d9b-41a7-a5fc-907044c64543 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:27.010857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-887d299d-c715-40d5-bcda-1863adaf479b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:27.021978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-887d299d-c715-40d5-bcda-1863adaf479b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:27.027067 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-887d299d-c715-40d5-bcda-1863adaf479b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:27.033776 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-887d299d-c715-40d5-bcda-1863adaf479b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:27.034528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-887d299d-c715-40d5-bcda-1863adaf479b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:27.054150 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1dfd38dc-6d9b-41a7-a5fc-907044c64543 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "POST /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b/action" status: 202 len: 1112 microversion: 2.1 time: 0.527009 May 21 21:27:27.062470 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2067/4000] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:27:26 2022] POST /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b/action => generated 1112 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 21 21:27:27.071372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dfd57208-8e62-4d1a-b8eb-24963df7814d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:27.072114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dfd57208-8e62-4d1a-b8eb-24963df7814d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:27.079896 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dfd57208-8e62-4d1a-b8eb-24963df7814d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:27.080502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dfd57208-8e62-4d1a-b8eb-24963df7814d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:27.081381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dfd57208-8e62-4d1a-b8eb-24963df7814d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:27.081909 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dfd57208-8e62-4d1a-b8eb-24963df7814d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:27.341395 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-887d299d-c715-40d5-bcda-1863adaf479b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:27.349742 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-887d299d-c715-40d5-bcda-1863adaf479b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0" status: 200 len: 1315 microversion: 2.1 time: 0.347538 May 21 21:27:27.350528 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1934/4001] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:27 2022] GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:27.363796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-5d63649c-86c1-472c-82cd-c0589f5c41a1 req-ea165c0d-63f0-427d-bc40-970f738700a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2820cc-216b-43d8-b0d5-54f85539f3e0", "name": "network-vif-plugged", "status": "completed", "tag": "bf13d8ee-782a-43ad-8555-f1b13fa22ec5"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:27.375282 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-5d63649c-86c1-472c-82cd-c0589f5c41a1 req-ea165c0d-63f0-427d-bc40-970f738700a6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:27.375817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-5d63649c-86c1-472c-82cd-c0589f5c41a1 req-ea165c0d-63f0-427d-bc40-970f738700a6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:27.389238 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-5d63649c-86c1-472c-82cd-c0589f5c41a1 req-ea165c0d-63f0-427d-bc40-970f738700a6 service nova] Creating event network-vif-plugged:bf13d8ee-782a-43ad-8555-f1b13fa22ec5 for instance 5b2820cc-216b-43d8-b0d5-54f85539f3e0 on nch2-master-1 May 21 21:27:27.394628 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-5d63649c-86c1-472c-82cd-c0589f5c41a1 req-ea165c0d-63f0-427d-bc40-970f738700a6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042666 May 21 21:27:27.395342 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1935/4002] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:27:27.833521 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-dfd57208-8e62-4d1a-b8eb-24963df7814d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:27.841665 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dfd57208-8e62-4d1a-b8eb-24963df7814d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1517 microversion: 2.1 time: 0.776273 May 21 21:27:27.842271 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2068/4003] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:27 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1517 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:28.368770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1618712d-900c-428c-b9d9-105149ae48ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:28.371283 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1618712d-900c-428c-b9d9-105149ae48ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:28.404118 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1618712d-900c-428c-b9d9-105149ae48ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:28.407174 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1618712d-900c-428c-b9d9-105149ae48ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:28.410336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1618712d-900c-428c-b9d9-105149ae48ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:28.411912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1618712d-900c-428c-b9d9-105149ae48ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:28.865345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-72df7a24-0a7f-4b7c-a726-65284e933988 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:28.865345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-72df7a24-0a7f-4b7c-a726-65284e933988 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:28.882204 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72df7a24-0a7f-4b7c-a726-65284e933988 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:28.882204 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72df7a24-0a7f-4b7c-a726-65284e933988 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:28.884021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72df7a24-0a7f-4b7c-a726-65284e933988 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:28.885295 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72df7a24-0a7f-4b7c-a726-65284e933988 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:28.890873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:29.062839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1618712d-900c-428c-b9d9-105149ae48ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:29.071600 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1618712d-900c-428c-b9d9-105149ae48ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0" status: 200 len: 1315 microversion: 2.1 time: 0.707953 May 21 21:27:29.080462 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1936/4004] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:28 2022] GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0 => generated 1315 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:29.254770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-72df7a24-0a7f-4b7c-a726-65284e933988 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:29.275948 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-72df7a24-0a7f-4b7c-a726-65284e933988 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1517 microversion: 2.1 time: 0.417258 May 21 21:27:29.276601 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2069/4005] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:28 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1517 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:30.095284 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9cd6e529-2649-45c5-be1e-3b3087da8916 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:30.095916 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9cd6e529-2649-45c5-be1e-3b3087da8916 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:30.105733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9cd6e529-2649-45c5-be1e-3b3087da8916 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:30.106201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9cd6e529-2649-45c5-be1e-3b3087da8916 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:30.107031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9cd6e529-2649-45c5-be1e-3b3087da8916 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:30.107475 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9cd6e529-2649-45c5-be1e-3b3087da8916 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:30.299775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ba6d5875-c8bf-4dcf-817d-8a849011b60f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:30.303312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ba6d5875-c8bf-4dcf-817d-8a849011b60f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:30.336063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba6d5875-c8bf-4dcf-817d-8a849011b60f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:30.336063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba6d5875-c8bf-4dcf-817d-8a849011b60f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:30.336063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba6d5875-c8bf-4dcf-817d-8a849011b60f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:30.336063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba6d5875-c8bf-4dcf-817d-8a849011b60f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:30.393136 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9cd6e529-2649-45c5-be1e-3b3087da8916 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:30.426194 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9cd6e529-2649-45c5-be1e-3b3087da8916 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0" status: 200 len: 1501 microversion: 2.1 time: 0.329597 May 21 21:27:30.426947 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1937/4006] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:30 2022] GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0 => generated 1501 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:30.459097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-574ca84c-c686-454e-a557-4e1fbd052cca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:30.460568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-574ca84c-c686-454e-a557-4e1fbd052cca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:30.489876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-574ca84c-c686-454e-a557-4e1fbd052cca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:30.492094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-574ca84c-c686-454e-a557-4e1fbd052cca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:30.493652 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-574ca84c-c686-454e-a557-4e1fbd052cca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:30.495748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-574ca84c-c686-454e-a557-4e1fbd052cca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:30.701060 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.network.security_group_api [None req-574ca84c-c686-454e-a557-4e1fbd052cca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Removing security group 4c97c8ee-195c-41a5-a8e9-b9f161cac00d from port bf13d8ee-782a-43ad-8555-f1b13fa22ec5 May 21 21:27:30.759650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ba6d5875-c8bf-4dcf-817d-8a849011b60f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:30.783754 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ba6d5875-c8bf-4dcf-817d-8a849011b60f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1517 microversion: 2.1 time: 0.494189 May 21 21:27:30.784756 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2070/4007] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:30 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1517 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:31.617333 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-574ca84c-c686-454e-a557-4e1fbd052cca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0/action" status: 202 len: 0 microversion: 2.1 time: 1.167382 May 21 21:27:31.619290 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1938/4008] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:27:30 2022] POST /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0/action => generated 0 bytes in 1170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:27:31.628681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3c95ee08-aeaa-4d2b-af94-957f56484ec4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:31.632509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3c95ee08-aeaa-4d2b-af94-957f56484ec4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:31.632639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-9fd4954e-6ed1-427e-826f-425e24405df9 req-6ac48a83-988b-48df-a889-000069babc97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2820cc-216b-43d8-b0d5-54f85539f3e0", "tag": "bf13d8ee-782a-43ad-8555-f1b13fa22ec5"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:31.643069 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c95ee08-aeaa-4d2b-af94-957f56484ec4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:31.645591 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c95ee08-aeaa-4d2b-af94-957f56484ec4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:31.646674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c95ee08-aeaa-4d2b-af94-957f56484ec4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:31.647496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c95ee08-aeaa-4d2b-af94-957f56484ec4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:31.695520 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9fd4954e-6ed1-427e-826f-425e24405df9 req-6ac48a83-988b-48df-a889-000069babc97 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:31.696183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9fd4954e-6ed1-427e-826f-425e24405df9 req-6ac48a83-988b-48df-a889-000069babc97 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:31.711749 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-9fd4954e-6ed1-427e-826f-425e24405df9 req-6ac48a83-988b-48df-a889-000069babc97 service nova] Creating event network-changed:bf13d8ee-782a-43ad-8555-f1b13fa22ec5 for instance 5b2820cc-216b-43d8-b0d5-54f85539f3e0 on nch2-master-1 May 21 21:27:31.718486 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-9fd4954e-6ed1-427e-826f-425e24405df9 req-6ac48a83-988b-48df-a889-000069babc97 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091058 May 21 21:27:31.719627 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1939/4009] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:27:31.809807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c91e842f-5206-427f-a107-b611beb87aed tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:31.813800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c91e842f-5206-427f-a107-b611beb87aed tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:31.840061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c91e842f-5206-427f-a107-b611beb87aed tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:31.841088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c91e842f-5206-427f-a107-b611beb87aed tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:31.844960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c91e842f-5206-427f-a107-b611beb87aed tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:31.844960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c91e842f-5206-427f-a107-b611beb87aed tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:31.922343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3c95ee08-aeaa-4d2b-af94-957f56484ec4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:31.936552 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3c95ee08-aeaa-4d2b-af94-957f56484ec4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0" status: 200 len: 1459 microversion: 2.1 time: 0.312697 May 21 21:27:31.939922 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2071/4010] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:31 2022] GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0 => generated 1459 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:31.967314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-36e90226-5cd2-4cad-9c55-81fde2e03260 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:31.968241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-36e90226-5cd2-4cad-9c55-81fde2e03260 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:31.980038 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-36e90226-5cd2-4cad-9c55-81fde2e03260 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:31.980632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-36e90226-5cd2-4cad-9c55-81fde2e03260 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:31.984412 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-36e90226-5cd2-4cad-9c55-81fde2e03260 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:31.985010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-36e90226-5cd2-4cad-9c55-81fde2e03260 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:32.177957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c91e842f-5206-427f-a107-b611beb87aed tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:32.195949 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c91e842f-5206-427f-a107-b611beb87aed tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1517 microversion: 2.1 time: 0.396129 May 21 21:27:32.197834 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1940/4011] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:31 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1517 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:32.500056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-36e90226-5cd2-4cad-9c55-81fde2e03260 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:32.508034 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-36e90226-5cd2-4cad-9c55-81fde2e03260 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.545427 May 21 21:27:32.509125 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2072/4012] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:31 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:32.529635 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-22a06404-6fe1-4937-92f0-ac63e7a6aaf5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:32.530271 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-22a06404-6fe1-4937-92f0-ac63e7a6aaf5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:32.537592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22a06404-6fe1-4937-92f0-ac63e7a6aaf5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:32.538068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22a06404-6fe1-4937-92f0-ac63e7a6aaf5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:32.539056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22a06404-6fe1-4937-92f0-ac63e7a6aaf5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:32.543919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22a06404-6fe1-4937-92f0-ac63e7a6aaf5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:32.880781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-22a06404-6fe1-4937-92f0-ac63e7a6aaf5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:32.889565 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-22a06404-6fe1-4937-92f0-ac63e7a6aaf5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.364146 May 21 21:27:32.890165 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1941/4013] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:32 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:32.919544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d2873b4d-0e6e-434b-89a6-1e64d78cc25c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:32.920179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d2873b4d-0e6e-434b-89a6-1e64d78cc25c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:32.940709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d2873b4d-0e6e-434b-89a6-1e64d78cc25c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:32.941332 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d2873b4d-0e6e-434b-89a6-1e64d78cc25c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:32.942430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d2873b4d-0e6e-434b-89a6-1e64d78cc25c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:32.943379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d2873b4d-0e6e-434b-89a6-1e64d78cc25c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:33.215648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3ad35ad6-7030-45fa-a1fe-dad959657e15 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:33.216675 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3ad35ad6-7030-45fa-a1fe-dad959657e15 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:33.224824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ad35ad6-7030-45fa-a1fe-dad959657e15 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:33.225280 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ad35ad6-7030-45fa-a1fe-dad959657e15 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:33.226067 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ad35ad6-7030-45fa-a1fe-dad959657e15 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:33.226693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ad35ad6-7030-45fa-a1fe-dad959657e15 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:33.291548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d2873b4d-0e6e-434b-89a6-1e64d78cc25c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:33.323852 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d2873b4d-0e6e-434b-89a6-1e64d78cc25c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.418258 May 21 21:27:33.328441 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2073/4014] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:32 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:33.483336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3ad35ad6-7030-45fa-a1fe-dad959657e15 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:33.493458 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3ad35ad6-7030-45fa-a1fe-dad959657e15 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1517 microversion: 2.1 time: 0.282493 May 21 21:27:33.495243 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1942/4015] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:33 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1517 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:33.507924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-42b88b70-c14a-4ddf-ac4b-8c192b37a4bb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:33.513554 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-42b88b70-c14a-4ddf-ac4b-8c192b37a4bb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:33.520946 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42b88b70-c14a-4ddf-ac4b-8c192b37a4bb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:33.521425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42b88b70-c14a-4ddf-ac4b-8c192b37a4bb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:33.522217 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42b88b70-c14a-4ddf-ac4b-8c192b37a4bb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:33.522691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42b88b70-c14a-4ddf-ac4b-8c192b37a4bb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:33.630864 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-67bc3f32-0e83-4f02-9393-3524a417501f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-2024172492", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "c9523685-11fa-4ce3-981e-bb25beeaa64b"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:33.691179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-67bc3f32-0e83-4f02-9393-3524a417501f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] validate_networks() for [('c9523685-11fa-4ce3-981e-bb25beeaa64b', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:27:33.695236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-42b88b70-c14a-4ddf-ac4b-8c192b37a4bb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:33.704679 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-42b88b70-c14a-4ddf-ac4b-8c192b37a4bb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.208258 May 21 21:27:33.705380 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1943/4016] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:33 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:33.823909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4eb37857-f8d7-4206-a777-afa3f427533d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-253894718", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "5d4cf0c3-1319-4035-9b9a-7c7b54e6e093"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:33.899705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-4eb37857-f8d7-4206-a777-afa3f427533d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] validate_networks() for [('5d4cf0c3-1319-4035-9b9a-7c7b54e6e093', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:27:34.387664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-67bc3f32-0e83-4f02-9393-3524a417501f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:27:34.388273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-67bc3f32-0e83-4f02-9393-3524a417501f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:27:34.388784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-67bc3f32-0e83-4f02-9393-3524a417501f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:27:34.389216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-67bc3f32-0e83-4f02-9393-3524a417501f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:27:34.389991 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-67bc3f32-0e83-4f02-9393-3524a417501f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:27:34.411946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67bc3f32-0e83-4f02-9393-3524a417501f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:34.412436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67bc3f32-0e83-4f02-9393-3524a417501f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:34.413253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67bc3f32-0e83-4f02-9393-3524a417501f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:34.413693 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67bc3f32-0e83-4f02-9393-3524a417501f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:34.439361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-67bc3f32-0e83-4f02-9393-3524a417501f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Getting quotas for project 761c7e1ce4c04f1c88f5d770024ec589. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:27:34.445580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-67bc3f32-0e83-4f02-9393-3524a417501f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Getting quotas for user a1c11eb375684c7f99d6b0fe06d35f7d and project 761c7e1ce4c04f1c88f5d770024ec589. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:27:34.466407 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-67bc3f32-0e83-4f02-9393-3524a417501f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Going to run 3 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:27:34.469497 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-67bc3f32-0e83-4f02-9393-3524a417501f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: ba344601-c421-4d34-875e-70d22ffa8cc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:27:34.589330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-67bc3f32-0e83-4f02-9393-3524a417501f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: 8542f670-5b21-4fda-abd5-6951efd387ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=ba344601-c421-4d34-875e-70d22ffa8cc2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:27:34.727514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-67bc3f32-0e83-4f02-9393-3524a417501f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: cfb31362-6254-457f-8612-86eeff56ddc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=8542f670-5b21-4fda-abd5-6951efd387ed,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:27:34.872688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-4eb37857-f8d7-4206-a777-afa3f427533d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:27:34.873175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-4eb37857-f8d7-4206-a777-afa3f427533d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:27:34.873672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-4eb37857-f8d7-4206-a777-afa3f427533d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:27:34.874088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-4eb37857-f8d7-4206-a777-afa3f427533d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:27:34.874590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-4eb37857-f8d7-4206-a777-afa3f427533d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:27:34.887498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4eb37857-f8d7-4206-a777-afa3f427533d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:34.888339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4eb37857-f8d7-4206-a777-afa3f427533d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:34.889328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4eb37857-f8d7-4206-a777-afa3f427533d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:34.890321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4eb37857-f8d7-4206-a777-afa3f427533d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:34.938696 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-4eb37857-f8d7-4206-a777-afa3f427533d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Getting quotas for project 014ae80b3f434bcb9fa2629ccdf4aad7. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:27:34.948466 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-4eb37857-f8d7-4206-a777-afa3f427533d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Getting quotas for user 1cafab0cbef64be59c7afef84d7888ff and project 014ae80b3f434bcb9fa2629ccdf4aad7. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:27:34.971451 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-67bc3f32-0e83-4f02-9393-3524a417501f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.641828 May 21 21:27:34.972904 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2074/4017] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:27:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:27:34.977204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4eb37857-f8d7-4206-a777-afa3f427533d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:27:34.978312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8c2d2ce4-52d7-4c49-948a-54d44739c8f3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:34.979176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8c2d2ce4-52d7-4c49-948a-54d44739c8f3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:34.986322 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c2d2ce4-52d7-4c49-948a-54d44739c8f3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:34.987077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c2d2ce4-52d7-4c49-948a-54d44739c8f3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:34.988137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c2d2ce4-52d7-4c49-948a-54d44739c8f3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:34.988833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c2d2ce4-52d7-4c49-948a-54d44739c8f3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:34.989206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4eb37857-f8d7-4206-a777-afa3f427533d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:27:35.225017 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4eb37857-f8d7-4206-a777-afa3f427533d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.402150 May 21 21:27:35.231165 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1944/4018] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:27:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 21 21:27:35.239297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a8dae92a-44c2-4ba7-8040-7324c47fa56d tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:35.244328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a8dae92a-44c2-4ba7-8040-7324c47fa56d tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:35.248322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a8dae92a-44c2-4ba7-8040-7324c47fa56d tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Searching by: {'deleted': False, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:27:35.316376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a8dae92a-44c2-4ba7-8040-7324c47fa56d tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:35.318225 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a8dae92a-44c2-4ba7-8040-7324c47fa56d tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:35.320648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a8dae92a-44c2-4ba7-8040-7324c47fa56d tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:35.321124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a8dae92a-44c2-4ba7-8040-7324c47fa56d tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:35.340028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8c2d2ce4-52d7-4c49-948a-54d44739c8f3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:35.349419 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8c2d2ce4-52d7-4c49-948a-54d44739c8f3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1517 microversion: 2.1 time: 0.375206 May 21 21:27:35.350030 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2075/4019] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:34 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1517 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:35.368782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e3061af3-79bb-4c39-bdf7-1c9f168c7c50 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:35.368782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e3061af3-79bb-4c39-bdf7-1c9f168c7c50 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:35.379577 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a8dae92a-44c2-4ba7-8040-7324c47fa56d tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.147184 May 21 21:27:35.380214 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1945/4020] 10.222.0.49 () {58 vars in 1124 bytes} [Sat May 21 21:27:35 2022] GET /compute/v2.1/servers => generated 1018 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:35.391544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-990bae5d-9495-4ffa-a6a8-7ffb477d0311 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:35.392515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-990bae5d-9495-4ffa-a6a8-7ffb477d0311 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: cfb31362-6254-457f-8612-86eeff56ddc9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:35.456737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e3061af3-79bb-4c39-bdf7-1c9f168c7c50 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:35.469131 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e3061af3-79bb-4c39-bdf7-1c9f168c7c50 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1214 microversion: 2.1 time: 0.117141 May 21 21:27:35.470252 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2076/4021] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:35 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:35.500997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-990bae5d-9495-4ffa-a6a8-7ffb477d0311 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:35.504070 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-990bae5d-9495-4ffa-a6a8-7ffb477d0311 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9" status: 200 len: 1223 microversion: 2.1 time: 0.116200 May 21 21:27:35.504702 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1946/4022] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:35 2022] GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9 => generated 1223 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:36.376795 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-72b33d93-c9d9-4b8a-91be-3d448684f682 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:36.376795 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-72b33d93-c9d9-4b8a-91be-3d448684f682 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:36.393183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72b33d93-c9d9-4b8a-91be-3d448684f682 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:36.393822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72b33d93-c9d9-4b8a-91be-3d448684f682 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:36.394972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72b33d93-c9d9-4b8a-91be-3d448684f682 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:36.396370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72b33d93-c9d9-4b8a-91be-3d448684f682 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:36.488125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-46aa6b40-ce17-4e7f-8f41-46acee1874b3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:36.491930 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-46aa6b40-ce17-4e7f-8f41-46acee1874b3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:36.508009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-46aa6b40-ce17-4e7f-8f41-46acee1874b3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:36.510285 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-46aa6b40-ce17-4e7f-8f41-46acee1874b3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:36.513181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-46aa6b40-ce17-4e7f-8f41-46acee1874b3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:36.515361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-46aa6b40-ce17-4e7f-8f41-46acee1874b3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:36.654008 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-46aa6b40-ce17-4e7f-8f41-46acee1874b3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:36.686404 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-46aa6b40-ce17-4e7f-8f41-46acee1874b3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1218 microversion: 2.1 time: 0.201236 May 21 21:27:36.689554 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1947/4023] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:36 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1218 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:36.706568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-72b33d93-c9d9-4b8a-91be-3d448684f682 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:36.714742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-26bcd1de-ea5b-44c8-9d94-078ef1058f01 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:36.715494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-26bcd1de-ea5b-44c8-9d94-078ef1058f01 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: cfb31362-6254-457f-8612-86eeff56ddc9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:36.716810 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-72b33d93-c9d9-4b8a-91be-3d448684f682 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1517 microversion: 2.1 time: 0.354699 May 21 21:27:36.719243 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2077/4024] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:36 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1517 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:36.794077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-26bcd1de-ea5b-44c8-9d94-078ef1058f01 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:36.801134 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-26bcd1de-ea5b-44c8-9d94-078ef1058f01 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9" status: 200 len: 1223 microversion: 2.1 time: 0.109696 May 21 21:27:36.801922 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1948/4025] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:36 2022] GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9 => generated 1223 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:37.675190 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-78bd4316-a26e-4d64-8078-669e2b69f965 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-538812362", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "88d40858-d8e8-4c97-8084-13382fa527f6"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:37.704007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-83379b56-342d-48af-90cb-a4599ca51703 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:37.705132 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-83379b56-342d-48af-90cb-a4599ca51703 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:37.726186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-83379b56-342d-48af-90cb-a4599ca51703 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:37.726576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-83379b56-342d-48af-90cb-a4599ca51703 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:37.727415 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-83379b56-342d-48af-90cb-a4599ca51703 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:37.728464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-83379b56-342d-48af-90cb-a4599ca51703 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:37.746734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-78bd4316-a26e-4d64-8078-669e2b69f965 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] validate_networks() for [('88d40858-d8e8-4c97-8084-13382fa527f6', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:27:37.839130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-83379b56-342d-48af-90cb-a4599ca51703 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:37.845901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:37.857638 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-83379b56-342d-48af-90cb-a4599ca51703 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1266 microversion: 2.1 time: 0.157421 May 21 21:27:37.859203 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1949/4026] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:37 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:37.864581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5c544b35-f686-44e7-9143-0b40b5d935f8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:37.865874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5c544b35-f686-44e7-9143-0b40b5d935f8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:37.873205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c544b35-f686-44e7-9143-0b40b5d935f8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:37.873660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c544b35-f686-44e7-9143-0b40b5d935f8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:37.874678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c544b35-f686-44e7-9143-0b40b5d935f8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:37.875301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c544b35-f686-44e7-9143-0b40b5d935f8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:38.189192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5c544b35-f686-44e7-9143-0b40b5d935f8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:38.201063 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5c544b35-f686-44e7-9143-0b40b5d935f8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1517 microversion: 2.1 time: 0.340293 May 21 21:27:38.201670 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1950/4027] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:37 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1517 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:38.207350 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f6f006f6-0104-445f-b2bf-49fbf7442d44 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:38.207969 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f6f006f6-0104-445f-b2bf-49fbf7442d44 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: cfb31362-6254-457f-8612-86eeff56ddc9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:38.305609 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f6f006f6-0104-445f-b2bf-49fbf7442d44 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:38.320437 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f6f006f6-0104-445f-b2bf-49fbf7442d44 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9" status: 200 len: 1223 microversion: 2.1 time: 0.116419 May 21 21:27:38.320437 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1951/4028] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:38 2022] GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9 => generated 1223 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:38.876889 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-42872d33-c511-4fcd-a4c3-6da7572565ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:38.878255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-42872d33-c511-4fcd-a4c3-6da7572565ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:38.886614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42872d33-c511-4fcd-a4c3-6da7572565ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:38.887416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42872d33-c511-4fcd-a4c3-6da7572565ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:38.889100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42872d33-c511-4fcd-a4c3-6da7572565ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:38.889665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42872d33-c511-4fcd-a4c3-6da7572565ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:39.020182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-78bd4316-a26e-4d64-8078-669e2b69f965 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:27:39.020841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-78bd4316-a26e-4d64-8078-669e2b69f965 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:27:39.021259 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-78bd4316-a26e-4d64-8078-669e2b69f965 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:27:39.021935 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-78bd4316-a26e-4d64-8078-669e2b69f965 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:27:39.022430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-78bd4316-a26e-4d64-8078-669e2b69f965 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:27:39.051827 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78bd4316-a26e-4d64-8078-669e2b69f965 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:39.052592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78bd4316-a26e-4d64-8078-669e2b69f965 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:39.053428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78bd4316-a26e-4d64-8078-669e2b69f965 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:39.053878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78bd4316-a26e-4d64-8078-669e2b69f965 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:39.069965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-42872d33-c511-4fcd-a4c3-6da7572565ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:39.079731 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-42872d33-c511-4fcd-a4c3-6da7572565ca tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1272 microversion: 2.1 time: 0.208165 May 21 21:27:39.080695 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1952/4029] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:38 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:39.096181 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-78bd4316-a26e-4d64-8078-669e2b69f965 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Getting quotas for project 4dbb4bbc88f84520885c00a376ba0f7c. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:27:39.105640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-78bd4316-a26e-4d64-8078-669e2b69f965 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Getting quotas for user c67dc8226610413a8bb889d6055a75d2 and project 4dbb4bbc88f84520885c00a376ba0f7c. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:27:39.119192 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-78bd4316-a26e-4d64-8078-669e2b69f965 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:27:39.121816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-78bd4316-a26e-4d64-8078-669e2b69f965 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:27:39.217848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6c6462a6-e649-459e-ae65-103dc03aafc8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:39.218477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6c6462a6-e649-459e-ae65-103dc03aafc8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:39.224643 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c6462a6-e649-459e-ae65-103dc03aafc8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:39.225100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c6462a6-e649-459e-ae65-103dc03aafc8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:39.225875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c6462a6-e649-459e-ae65-103dc03aafc8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:39.226321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c6462a6-e649-459e-ae65-103dc03aafc8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:39.366799 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-78bd4316-a26e-4d64-8078-669e2b69f965 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.850190 May 21 21:27:39.370946 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2078/4030] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:27:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:27:39.393373 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3d216628-bd37-4a68-9021-0c1c9ed1438a tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:39.395928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3d216628-bd37-4a68-9021-0c1c9ed1438a tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: cfb31362-6254-457f-8612-86eeff56ddc9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:39.430734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d216628-bd37-4a68-9021-0c1c9ed1438a tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:39.433767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d216628-bd37-4a68-9021-0c1c9ed1438a tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:39.438953 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d216628-bd37-4a68-9021-0c1c9ed1438a tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:39.440635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d216628-bd37-4a68-9021-0c1c9ed1438a tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:39.642612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6c6462a6-e649-459e-ae65-103dc03aafc8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:39.672585 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6c6462a6-e649-459e-ae65-103dc03aafc8 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1517 microversion: 2.1 time: 0.444732 May 21 21:27:39.678096 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1953/4031] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:39 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1517 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:39.717514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3d216628-bd37-4a68-9021-0c1c9ed1438a tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:39.724012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-591f5311-01e6-45cd-a6ad-82bbb7b361d9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:39.724012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-591f5311-01e6-45cd-a6ad-82bbb7b361d9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:39.741816 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3d216628-bd37-4a68-9021-0c1c9ed1438a tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9" status: 200 len: 1227 microversion: 2.1 time: 0.368629 May 21 21:27:39.747172 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2079/4032] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:39 2022] GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9 => generated 1227 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:40.059871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-591f5311-01e6-45cd-a6ad-82bbb7b361d9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:40.068050 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-591f5311-01e6-45cd-a6ad-82bbb7b361d9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6" status: 200 len: 1192 microversion: 2.1 time: 0.386991 May 21 21:27:40.069770 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1954/4033] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:39 2022] GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 => generated 1192 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:40.097628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-471fae30-0650-4bb2-b5b4-7fc3b6ac217d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:40.098942 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-471fae30-0650-4bb2-b5b4-7fc3b6ac217d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:40.107855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-471fae30-0650-4bb2-b5b4-7fc3b6ac217d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:40.108820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-471fae30-0650-4bb2-b5b4-7fc3b6ac217d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:40.109858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-471fae30-0650-4bb2-b5b4-7fc3b6ac217d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:40.110642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-471fae30-0650-4bb2-b5b4-7fc3b6ac217d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:40.691412 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-471fae30-0650-4bb2-b5b4-7fc3b6ac217d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:40.694417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-de7b8dcb-d00a-4483-9ddd-64130e7ec6a1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:40.703646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-de7b8dcb-d00a-4483-9ddd-64130e7ec6a1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:40.703812 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-471fae30-0650-4bb2-b5b4-7fc3b6ac217d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1314 microversion: 2.1 time: 0.607665 May 21 21:27:40.703812 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2080/4034] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:40 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1314 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:40.704651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de7b8dcb-d00a-4483-9ddd-64130e7ec6a1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:40.705763 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de7b8dcb-d00a-4483-9ddd-64130e7ec6a1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:40.706944 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de7b8dcb-d00a-4483-9ddd-64130e7ec6a1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:40.707603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de7b8dcb-d00a-4483-9ddd-64130e7ec6a1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:40.759545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7d5cc2ae-19f3-41e8-bda7-47a2ec014b06 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:40.760186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7d5cc2ae-19f3-41e8-bda7-47a2ec014b06 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: cfb31362-6254-457f-8612-86eeff56ddc9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:40.772617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7d5cc2ae-19f3-41e8-bda7-47a2ec014b06 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:40.773081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7d5cc2ae-19f3-41e8-bda7-47a2ec014b06 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:40.773881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7d5cc2ae-19f3-41e8-bda7-47a2ec014b06 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:40.774331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7d5cc2ae-19f3-41e8-bda7-47a2ec014b06 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:40.968261 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7d5cc2ae-19f3-41e8-bda7-47a2ec014b06 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:40.982631 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7d5cc2ae-19f3-41e8-bda7-47a2ec014b06 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9" status: 200 len: 1275 microversion: 2.1 time: 0.228047 May 21 21:27:40.996649 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2081/4035] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:40 2022] GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9 => generated 1275 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:41.088321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7c50bd15-8cff-4a19-9ddb-65622c283546 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:41.088972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7c50bd15-8cff-4a19-9ddb-65622c283546 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:41.194312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7c50bd15-8cff-4a19-9ddb-65622c283546 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:41.204234 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7c50bd15-8cff-4a19-9ddb-65622c283546 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6" status: 200 len: 1192 microversion: 2.1 time: 0.123281 May 21 21:27:41.205481 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2082/4036] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:41 2022] GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 => generated 1192 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:41.222479 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-de7b8dcb-d00a-4483-9ddd-64130e7ec6a1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:41.231171 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-de7b8dcb-d00a-4483-9ddd-64130e7ec6a1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1517 microversion: 2.1 time: 0.541181 May 21 21:27:41.236793 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1955/4037] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:40 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1517 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:41.719856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-56f5917d-cbb8-4cdf-9438-60c926d758a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:41.721045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-56f5917d-cbb8-4cdf-9438-60c926d758a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:41.735863 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56f5917d-cbb8-4cdf-9438-60c926d758a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:41.737733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56f5917d-cbb8-4cdf-9438-60c926d758a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:41.738856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56f5917d-cbb8-4cdf-9438-60c926d758a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:41.739550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56f5917d-cbb8-4cdf-9438-60c926d758a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:42.012797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f5d0023b-6262-4ca4-97f4-f46ffb2922ce tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:42.014730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f5d0023b-6262-4ca4-97f4-f46ffb2922ce tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: cfb31362-6254-457f-8612-86eeff56ddc9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:42.028865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5d0023b-6262-4ca4-97f4-f46ffb2922ce tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:42.030607 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5d0023b-6262-4ca4-97f4-f46ffb2922ce tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:42.031712 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5d0023b-6262-4ca4-97f4-f46ffb2922ce tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:42.032432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5d0023b-6262-4ca4-97f4-f46ffb2922ce tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:42.244783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f5d0023b-6262-4ca4-97f4-f46ffb2922ce tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:42.253887 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f5d0023b-6262-4ca4-97f4-f46ffb2922ce tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9" status: 200 len: 1281 microversion: 2.1 time: 0.245443 May 21 21:27:42.256469 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1956/4038] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:42 2022] GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9 => generated 1281 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:42.261398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b2c865c4-da51-4c6a-ad7a-75d9110cb922 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:42.262204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b2c865c4-da51-4c6a-ad7a-75d9110cb922 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:42.277866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2c865c4-da51-4c6a-ad7a-75d9110cb922 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:42.278582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2c865c4-da51-4c6a-ad7a-75d9110cb922 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:42.279549 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2c865c4-da51-4c6a-ad7a-75d9110cb922 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:42.280197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2c865c4-da51-4c6a-ad7a-75d9110cb922 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:42.352830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-56f5917d-cbb8-4cdf-9438-60c926d758a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:42.363255 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-56f5917d-cbb8-4cdf-9438-60c926d758a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1314 microversion: 2.1 time: 0.647468 May 21 21:27:42.374499 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2083/4039] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:41 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:42.384481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8edfa8f0-53be-4b44-9e9b-da81958fb99f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:42.385362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8edfa8f0-53be-4b44-9e9b-da81958fb99f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:42.397566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8edfa8f0-53be-4b44-9e9b-da81958fb99f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:42.398371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8edfa8f0-53be-4b44-9e9b-da81958fb99f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:42.400823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8edfa8f0-53be-4b44-9e9b-da81958fb99f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:42.401627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8edfa8f0-53be-4b44-9e9b-da81958fb99f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:42.495887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b2c865c4-da51-4c6a-ad7a-75d9110cb922 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:42.507978 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b2c865c4-da51-4c6a-ad7a-75d9110cb922 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6" status: 200 len: 1188 microversion: 2.1 time: 0.250239 May 21 21:27:42.508882 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1957/4040] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:42 2022] GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 => generated 1188 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:42.722507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-2fa9c8e3-c1e0-484e-91c0-7e5e1aeaee6f req-127dd66d-add0-489a-962e-3b3c970c93ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "392d9064-09d6-4c79-819b-042ba6d6f70b", "tag": "d2f57a10-249a-4c02-a14e-b9efad557114"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:42.741443 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:42.746599 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2fa9c8e3-c1e0-484e-91c0-7e5e1aeaee6f req-127dd66d-add0-489a-962e-3b3c970c93ae service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:42.747316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2fa9c8e3-c1e0-484e-91c0-7e5e1aeaee6f req-127dd66d-add0-489a-962e-3b3c970c93ae service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:42.774351 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-2fa9c8e3-c1e0-484e-91c0-7e5e1aeaee6f req-127dd66d-add0-489a-962e-3b3c970c93ae service nova] Creating event network-changed:d2f57a10-249a-4c02-a14e-b9efad557114 for instance 392d9064-09d6-4c79-819b-042ba6d6f70b on nch1-master-1 May 21 21:27:42.781936 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-2fa9c8e3-c1e0-484e-91c0-7e5e1aeaee6f req-127dd66d-add0-489a-962e-3b3c970c93ae service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064920 May 21 21:27:42.783387 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1958/4041] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:27:42.784922 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8edfa8f0-53be-4b44-9e9b-da81958fb99f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:42.797575 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8edfa8f0-53be-4b44-9e9b-da81958fb99f tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1517 microversion: 2.1 time: 0.421853 May 21 21:27:42.798196 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2084/4042] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:42 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1517 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:43.291558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c2f9cf25-2825-44be-8c03-6a29044ce3b4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:43.293304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c2f9cf25-2825-44be-8c03-6a29044ce3b4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: cfb31362-6254-457f-8612-86eeff56ddc9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:43.313897 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2f9cf25-2825-44be-8c03-6a29044ce3b4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:43.314728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2f9cf25-2825-44be-8c03-6a29044ce3b4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:43.317147 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2f9cf25-2825-44be-8c03-6a29044ce3b4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:43.317890 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2f9cf25-2825-44be-8c03-6a29044ce3b4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:43.387117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e433347f-cb55-46c9-b724-9eb485fb99da tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:43.387960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e433347f-cb55-46c9-b724-9eb485fb99da tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:43.396905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e433347f-cb55-46c9-b724-9eb485fb99da tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:43.397477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e433347f-cb55-46c9-b724-9eb485fb99da tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:43.398475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e433347f-cb55-46c9-b724-9eb485fb99da tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:43.398874 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e433347f-cb55-46c9-b724-9eb485fb99da tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:43.490151 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c2f9cf25-2825-44be-8c03-6a29044ce3b4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:43.498644 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c2f9cf25-2825-44be-8c03-6a29044ce3b4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9" status: 200 len: 1281 microversion: 2.1 time: 0.220213 May 21 21:27:43.499574 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1959/4043] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:43 2022] GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9 => generated 1281 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:43.528633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c75aadba-492b-4e26-af56-67df7f59f51f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:43.531035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c75aadba-492b-4e26-af56-67df7f59f51f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:43.538481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c75aadba-492b-4e26-af56-67df7f59f51f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:43.539190 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c75aadba-492b-4e26-af56-67df7f59f51f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:43.540508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c75aadba-492b-4e26-af56-67df7f59f51f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:43.541139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c75aadba-492b-4e26-af56-67df7f59f51f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:43.708720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e433347f-cb55-46c9-b724-9eb485fb99da tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:43.718094 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e433347f-cb55-46c9-b724-9eb485fb99da tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1314 microversion: 2.1 time: 0.338453 May 21 21:27:43.718699 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2085/4044] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:43 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:43.818804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-00132381-ff9d-4b65-9481-e6877ea34ab2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:43.820807 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-00132381-ff9d-4b65-9481-e6877ea34ab2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:43.830015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00132381-ff9d-4b65-9481-e6877ea34ab2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:43.832929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00132381-ff9d-4b65-9481-e6877ea34ab2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:43.835630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00132381-ff9d-4b65-9481-e6877ea34ab2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:43.836196 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00132381-ff9d-4b65-9481-e6877ea34ab2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:43.983113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c75aadba-492b-4e26-af56-67df7f59f51f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:43.996512 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c75aadba-492b-4e26-af56-67df7f59f51f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6" status: 200 len: 1262 microversion: 2.1 time: 0.473525 May 21 21:27:44.010227 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1960/4045] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:43 2022] GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 => generated 1262 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:44.289191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-00132381-ff9d-4b65-9481-e6877ea34ab2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:44.298800 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-00132381-ff9d-4b65-9481-e6877ea34ab2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1517 microversion: 2.1 time: 0.484404 May 21 21:27:44.299930 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2086/4046] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:43 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1517 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:44.517500 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-99a46771-6ee2-4de5-937b-3941c7f2c8d4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:44.518131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-99a46771-6ee2-4de5-937b-3941c7f2c8d4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: cfb31362-6254-457f-8612-86eeff56ddc9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:44.531044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99a46771-6ee2-4de5-937b-3941c7f2c8d4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:44.531729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99a46771-6ee2-4de5-937b-3941c7f2c8d4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:44.532795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99a46771-6ee2-4de5-937b-3941c7f2c8d4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:44.533340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99a46771-6ee2-4de5-937b-3941c7f2c8d4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:44.735042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c249b86e-3739-41ca-95cc-370888876d0c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:44.736520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c249b86e-3739-41ca-95cc-370888876d0c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:44.744170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c249b86e-3739-41ca-95cc-370888876d0c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:44.744876 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c249b86e-3739-41ca-95cc-370888876d0c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:44.746089 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c249b86e-3739-41ca-95cc-370888876d0c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:44.746786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c249b86e-3739-41ca-95cc-370888876d0c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:45.063333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c249b86e-3739-41ca-95cc-370888876d0c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:45.073871 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c249b86e-3739-41ca-95cc-370888876d0c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1314 microversion: 2.1 time: 0.342513 May 21 21:27:45.080669 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2087/4047] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:44 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:45.088776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ba4e9dfd-4c5a-4784-864c-cf0c52a76b44 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:45.090297 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ba4e9dfd-4c5a-4784-864c-cf0c52a76b44 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:45.097331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba4e9dfd-4c5a-4784-864c-cf0c52a76b44 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:45.098593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba4e9dfd-4c5a-4784-864c-cf0c52a76b44 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:45.099872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba4e9dfd-4c5a-4784-864c-cf0c52a76b44 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:45.100631 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba4e9dfd-4c5a-4784-864c-cf0c52a76b44 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:45.212818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ba4e9dfd-4c5a-4784-864c-cf0c52a76b44 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:45.223140 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ba4e9dfd-4c5a-4784-864c-cf0c52a76b44 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6" status: 200 len: 1250 microversion: 2.1 time: 0.147217 May 21 21:27:45.223740 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2088/4048] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:45 2022] GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 => generated 1250 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:45.244966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-99a46771-6ee2-4de5-937b-3941c7f2c8d4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:45.252855 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-99a46771-6ee2-4de5-937b-3941c7f2c8d4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9" status: 200 len: 1323 microversion: 2.1 time: 0.740710 May 21 21:27:45.253435 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1961/4049] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:44 2022] GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9 => generated 1323 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:45.341722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-055213c3-6172-46c4-b9f0-0a6416ae1342 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:45.342871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-055213c3-6172-46c4-b9f0-0a6416ae1342 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:45.354490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:45.368547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-055213c3-6172-46c4-b9f0-0a6416ae1342 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:45.369642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-055213c3-6172-46c4-b9f0-0a6416ae1342 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:45.370447 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-055213c3-6172-46c4-b9f0-0a6416ae1342 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:45.370892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-055213c3-6172-46c4-b9f0-0a6416ae1342 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:45.375643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:45.565010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-055213c3-6172-46c4-b9f0-0a6416ae1342 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:45.574281 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-055213c3-6172-46c4-b9f0-0a6416ae1342 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1517 microversion: 2.1 time: 0.255348 May 21 21:27:45.584015 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2089/4050] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:45 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1517 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:45.594184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-b5fbec93-c1dc-45c8-9a77-14f7ba4c0a6b req-fe3d873d-4875-4203-8d4c-ebb0b5d6efe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba344601-c421-4d34-875e-70d22ffa8cc2", "tag": "32980dfe-e248-4fec-b2d3-815145c153fc"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:45.606407 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b5fbec93-c1dc-45c8-9a77-14f7ba4c0a6b req-fe3d873d-4875-4203-8d4c-ebb0b5d6efe1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:45.606876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b5fbec93-c1dc-45c8-9a77-14f7ba4c0a6b req-fe3d873d-4875-4203-8d4c-ebb0b5d6efe1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:45.617815 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-b5fbec93-c1dc-45c8-9a77-14f7ba4c0a6b req-fe3d873d-4875-4203-8d4c-ebb0b5d6efe1 service nova] Creating event network-changed:32980dfe-e248-4fec-b2d3-815145c153fc for instance ba344601-c421-4d34-875e-70d22ffa8cc2 on nch1-master-1 May 21 21:27:45.623338 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-b5fbec93-c1dc-45c8-9a77-14f7ba4c0a6b req-fe3d873d-4875-4203-8d4c-ebb0b5d6efe1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.304629 May 21 21:27:45.624132 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1962/4051] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:27:46.101468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f97f6d86-69b6-4d00-8fd6-8b9939f31b76 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:46.104675 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f97f6d86-69b6-4d00-8fd6-8b9939f31b76 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:46.115244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f97f6d86-69b6-4d00-8fd6-8b9939f31b76 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:46.115244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f97f6d86-69b6-4d00-8fd6-8b9939f31b76 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:46.117114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f97f6d86-69b6-4d00-8fd6-8b9939f31b76 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:46.117911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f97f6d86-69b6-4d00-8fd6-8b9939f31b76 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:46.246143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b990d66b-824a-4774-9f94-b84e0de1a3c6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:46.246867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b990d66b-824a-4774-9f94-b84e0de1a3c6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:46.266233 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b990d66b-824a-4774-9f94-b84e0de1a3c6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:46.266684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b990d66b-824a-4774-9f94-b84e0de1a3c6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:46.267472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b990d66b-824a-4774-9f94-b84e0de1a3c6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:46.268096 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b990d66b-824a-4774-9f94-b84e0de1a3c6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:46.488061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f97f6d86-69b6-4d00-8fd6-8b9939f31b76 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:46.499853 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f97f6d86-69b6-4d00-8fd6-8b9939f31b76 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1314 microversion: 2.1 time: 0.406498 May 21 21:27:46.500790 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2090/4052] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:46 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:46.506101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c82d7527-ce90-4680-9b63-5e441a33d2e8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:46.507012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c82d7527-ce90-4680-9b63-5e441a33d2e8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: cfb31362-6254-457f-8612-86eeff56ddc9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:46.516100 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c82d7527-ce90-4680-9b63-5e441a33d2e8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:46.516865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c82d7527-ce90-4680-9b63-5e441a33d2e8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:46.517916 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c82d7527-ce90-4680-9b63-5e441a33d2e8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:46.518447 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c82d7527-ce90-4680-9b63-5e441a33d2e8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:46.686743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b990d66b-824a-4774-9f94-b84e0de1a3c6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:46.697995 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b990d66b-824a-4774-9f94-b84e0de1a3c6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6" status: 200 len: 1292 microversion: 2.1 time: 0.457532 May 21 21:27:46.708111 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1963/4053] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:46 2022] GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 => generated 1292 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:46.716579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-ba794202-efe0-41fb-b143-a555b1dbe67c req-1010706b-0967-4dba-945d-5d161da53a4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8542f670-5b21-4fda-abd5-6951efd387ed", "tag": "ca346eef-6b59-4751-a9fe-482d287bd3d7"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:46.729449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ba794202-efe0-41fb-b143-a555b1dbe67c req-1010706b-0967-4dba-945d-5d161da53a4b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:46.734244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ba794202-efe0-41fb-b143-a555b1dbe67c req-1010706b-0967-4dba-945d-5d161da53a4b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:46.746900 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-ba794202-efe0-41fb-b143-a555b1dbe67c req-1010706b-0967-4dba-945d-5d161da53a4b service nova] Creating event network-changed:ca346eef-6b59-4751-a9fe-482d287bd3d7 for instance 8542f670-5b21-4fda-abd5-6951efd387ed on nch2-master-1 May 21 21:27:46.756230 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-ba794202-efe0-41fb-b143-a555b1dbe67c req-1010706b-0967-4dba-945d-5d161da53a4b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049343 May 21 21:27:46.759406 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1964/4054] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:27:46.772997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f5967044-f09b-4a87-bb01-0f5672f118e6 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:46.773732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f5967044-f09b-4a87-bb01-0f5672f118e6 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:46.791182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5967044-f09b-4a87-bb01-0f5672f118e6 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:46.792459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5967044-f09b-4a87-bb01-0f5672f118e6 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:46.793329 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5967044-f09b-4a87-bb01-0f5672f118e6 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:46.793964 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5967044-f09b-4a87-bb01-0f5672f118e6 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:46.848609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c82d7527-ce90-4680-9b63-5e441a33d2e8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:46.859333 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c82d7527-ce90-4680-9b63-5e441a33d2e8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9" status: 200 len: 1323 microversion: 2.1 time: 0.357209 May 21 21:27:46.875009 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2091/4055] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:46 2022] GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9 => generated 1323 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:47.505198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f5967044-f09b-4a87-bb01-0f5672f118e6 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:47.518393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9e938313-e60d-4e29-b6fa-02852fb11461 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:47.519403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9e938313-e60d-4e29-b6fa-02852fb11461 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:47.539102 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f5967044-f09b-4a87-bb01-0f5672f118e6 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1517 microversion: 2.1 time: 0.776887 May 21 21:27:47.543374 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1965/4056] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:46 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1517 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:47.547793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e938313-e60d-4e29-b6fa-02852fb11461 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:47.553558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e938313-e60d-4e29-b6fa-02852fb11461 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:47.557169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e938313-e60d-4e29-b6fa-02852fb11461 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:47.557870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e938313-e60d-4e29-b6fa-02852fb11461 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:47.716356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f37076bd-bda8-41dc-9706-cb2fb0bbce6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:47.717245 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f37076bd-bda8-41dc-9706-cb2fb0bbce6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:47.732531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f37076bd-bda8-41dc-9706-cb2fb0bbce6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:47.732896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f37076bd-bda8-41dc-9706-cb2fb0bbce6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:47.733700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f37076bd-bda8-41dc-9706-cb2fb0bbce6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:47.734215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f37076bd-bda8-41dc-9706-cb2fb0bbce6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:48.153638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9e938313-e60d-4e29-b6fa-02852fb11461 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:48.174843 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9e938313-e60d-4e29-b6fa-02852fb11461 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1314 microversion: 2.1 time: 0.660612 May 21 21:27:48.176319 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2092/4057] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:47 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1314 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:48.202362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4901e5d0-2c18-4e0c-bb47-7765bc397ecd tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:48.203565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4901e5d0-2c18-4e0c-bb47-7765bc397ecd tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: cfb31362-6254-457f-8612-86eeff56ddc9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:48.221943 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4901e5d0-2c18-4e0c-bb47-7765bc397ecd tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:48.223348 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4901e5d0-2c18-4e0c-bb47-7765bc397ecd tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:48.228409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4901e5d0-2c18-4e0c-bb47-7765bc397ecd tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:48.229877 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4901e5d0-2c18-4e0c-bb47-7765bc397ecd tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:48.533994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4901e5d0-2c18-4e0c-bb47-7765bc397ecd tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:48.545458 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4901e5d0-2c18-4e0c-bb47-7765bc397ecd tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9" status: 200 len: 1323 microversion: 2.1 time: 0.355996 May 21 21:27:48.546344 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2093/4058] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:48 2022] GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9 => generated 1323 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:48.560309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-46e2eb85-461e-49a9-9149-32d5e9f1abff req-f852e7bb-291e-4f67-8061-22d0a0ea0e2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfb31362-6254-457f-8612-86eeff56ddc9", "tag": "486d9633-d9e9-4d01-a755-68d6b4b2236b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:48.566653 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:48.572545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-46e2eb85-461e-49a9-9149-32d5e9f1abff req-f852e7bb-291e-4f67-8061-22d0a0ea0e2a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:48.573031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-46e2eb85-461e-49a9-9149-32d5e9f1abff req-f852e7bb-291e-4f67-8061-22d0a0ea0e2a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:48.586445 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-46e2eb85-461e-49a9-9149-32d5e9f1abff req-f852e7bb-291e-4f67-8061-22d0a0ea0e2a service nova] Creating event network-changed:486d9633-d9e9-4d01-a755-68d6b4b2236b for instance cfb31362-6254-457f-8612-86eeff56ddc9 on nch1-master-1 May 21 21:27:48.593901 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-46e2eb85-461e-49a9-9149-32d5e9f1abff req-f852e7bb-291e-4f67-8061-22d0a0ea0e2a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036992 May 21 21:27:48.595215 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2094/4059] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:27:48.600544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c48a7965-aa51-43f1-a520-eed4090bcae9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:48.601342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c48a7965-aa51-43f1-a520-eed4090bcae9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:48.609354 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c48a7965-aa51-43f1-a520-eed4090bcae9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:48.610130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c48a7965-aa51-43f1-a520-eed4090bcae9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:48.611314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c48a7965-aa51-43f1-a520-eed4090bcae9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:48.612464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c48a7965-aa51-43f1-a520-eed4090bcae9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:48.856081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c48a7965-aa51-43f1-a520-eed4090bcae9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:48.871252 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c48a7965-aa51-43f1-a520-eed4090bcae9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1517 microversion: 2.1 time: 0.274594 May 21 21:27:48.872762 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2095/4060] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:48 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1517 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:48.991155 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f37076bd-bda8-41dc-9706-cb2fb0bbce6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:49.006349 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f37076bd-bda8-41dc-9706-cb2fb0bbce6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6" status: 200 len: 1292 microversion: 2.1 time: 1.291372 May 21 21:27:49.017815 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1966/4061] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:47 2022] GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 => generated 1292 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:49.190205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:49.195506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2f7d1b1d-dd48-47ad-9e2d-5e9f96c46476 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:49.196224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2f7d1b1d-dd48-47ad-9e2d-5e9f96c46476 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:49.205984 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f7d1b1d-dd48-47ad-9e2d-5e9f96c46476 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:49.207060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f7d1b1d-dd48-47ad-9e2d-5e9f96c46476 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:49.207937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f7d1b1d-dd48-47ad-9e2d-5e9f96c46476 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:49.208476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f7d1b1d-dd48-47ad-9e2d-5e9f96c46476 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:49.414684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2f7d1b1d-dd48-47ad-9e2d-5e9f96c46476 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:49.426416 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2f7d1b1d-dd48-47ad-9e2d-5e9f96c46476 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1314 microversion: 2.1 time: 0.235978 May 21 21:27:49.427227 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2096/4062] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:49 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:49.562910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-89d870cb-d5d3-46fe-a534-0f36e9b712d8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:49.563569 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-89d870cb-d5d3-46fe-a534-0f36e9b712d8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: cfb31362-6254-457f-8612-86eeff56ddc9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:49.571778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-89d870cb-d5d3-46fe-a534-0f36e9b712d8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:49.573145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-89d870cb-d5d3-46fe-a534-0f36e9b712d8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:49.574212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-89d870cb-d5d3-46fe-a534-0f36e9b712d8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:49.574930 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-89d870cb-d5d3-46fe-a534-0f36e9b712d8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:49.787704 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-0e2400b9-ffa0-4d26-a1a6-eebda72f7921 req-62cb1a48-e95e-4be5-93bf-acc81c93a014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de7a52b3-ff9e-4281-b9d8-78ad66dd33d6", "tag": "9634c849-608d-4b8f-aee2-40d7512be721"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:49.801049 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-0e2400b9-ffa0-4d26-a1a6-eebda72f7921 req-62cb1a48-e95e-4be5-93bf-acc81c93a014 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:49.804622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-0e2400b9-ffa0-4d26-a1a6-eebda72f7921 req-62cb1a48-e95e-4be5-93bf-acc81c93a014 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:49.822233 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-0e2400b9-ffa0-4d26-a1a6-eebda72f7921 req-62cb1a48-e95e-4be5-93bf-acc81c93a014 service nova] Creating event network-changed:9634c849-608d-4b8f-aee2-40d7512be721 for instance de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 on nch2-master-1 May 21 21:27:49.822233 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-0e2400b9-ffa0-4d26-a1a6-eebda72f7921 req-62cb1a48-e95e-4be5-93bf-acc81c93a014 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042579 May 21 21:27:49.822233 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2097/4063] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:27:49.898202 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bd11ff5d-fbf8-427a-8097-1502117f4e21 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:49.898973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bd11ff5d-fbf8-427a-8097-1502117f4e21 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:49.918327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd11ff5d-fbf8-427a-8097-1502117f4e21 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:49.920146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd11ff5d-fbf8-427a-8097-1502117f4e21 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:49.923042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd11ff5d-fbf8-427a-8097-1502117f4e21 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:49.924119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd11ff5d-fbf8-427a-8097-1502117f4e21 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:50.068242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=14 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:50.105442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-89d870cb-d5d3-46fe-a534-0f36e9b712d8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:50.117394 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-89d870cb-d5d3-46fe-a534-0f36e9b712d8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9" status: 200 len: 1323 microversion: 2.1 time: 0.558417 May 21 21:27:50.131596 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1967/4064] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:49 2022] GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9 => generated 1323 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:50.156214 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-770b3d36-f495-4866-9bba-2e603ac1a08f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:50.158369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-770b3d36-f495-4866-9bba-2e603ac1a08f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:50.180182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-770b3d36-f495-4866-9bba-2e603ac1a08f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:50.181821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-770b3d36-f495-4866-9bba-2e603ac1a08f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:50.183286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-770b3d36-f495-4866-9bba-2e603ac1a08f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:50.188943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-770b3d36-f495-4866-9bba-2e603ac1a08f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:50.257597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bd11ff5d-fbf8-427a-8097-1502117f4e21 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:50.278560 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bd11ff5d-fbf8-427a-8097-1502117f4e21 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1517 microversion: 2.1 time: 0.392804 May 21 21:27:50.281717 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2098/4065] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:49 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1517 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:50.449925 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2b1cd098-9267-4553-a074-28a8fb00732c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:50.450709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2b1cd098-9267-4553-a074-28a8fb00732c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:50.464804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b1cd098-9267-4553-a074-28a8fb00732c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:50.468905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b1cd098-9267-4553-a074-28a8fb00732c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:50.470330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b1cd098-9267-4553-a074-28a8fb00732c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:50.473269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b1cd098-9267-4553-a074-28a8fb00732c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:50.714732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2b1cd098-9267-4553-a074-28a8fb00732c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:50.719247 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2b1cd098-9267-4553-a074-28a8fb00732c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1314 microversion: 2.1 time: 0.274432 May 21 21:27:50.720306 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2099/4066] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:50 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:50.840486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-770b3d36-f495-4866-9bba-2e603ac1a08f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:50.858625 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-770b3d36-f495-4866-9bba-2e603ac1a08f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6" status: 200 len: 1292 microversion: 2.1 time: 0.712113 May 21 21:27:50.866808 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1968/4067] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:50 2022] GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 => generated 1292 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:51.139775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1ee987e6-158e-4f4f-8cbc-7d1e6cc4e60f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:51.141022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1ee987e6-158e-4f4f-8cbc-7d1e6cc4e60f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: cfb31362-6254-457f-8612-86eeff56ddc9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:51.150105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ee987e6-158e-4f4f-8cbc-7d1e6cc4e60f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:51.156644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ee987e6-158e-4f4f-8cbc-7d1e6cc4e60f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:51.156644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ee987e6-158e-4f4f-8cbc-7d1e6cc4e60f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:51.156644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ee987e6-158e-4f4f-8cbc-7d1e6cc4e60f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:51.204046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=16 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:51.298558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f2ec1687-7300-4297-81c4-1c6d72c7729b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:51.299163 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f2ec1687-7300-4297-81c4-1c6d72c7729b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:51.306443 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2ec1687-7300-4297-81c4-1c6d72c7729b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:51.307006 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2ec1687-7300-4297-81c4-1c6d72c7729b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:51.307858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2ec1687-7300-4297-81c4-1c6d72c7729b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:51.308569 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2ec1687-7300-4297-81c4-1c6d72c7729b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:51.314235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1ee987e6-158e-4f4f-8cbc-7d1e6cc4e60f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:51.322747 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1ee987e6-158e-4f4f-8cbc-7d1e6cc4e60f tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9" status: 200 len: 1323 microversion: 2.1 time: 0.186817 May 21 21:27:51.323605 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2100/4068] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:51 2022] GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9 => generated 1323 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:51.739203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e1b59114-f7e2-494f-8cfd-8c40b3db3cd4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:51.740253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e1b59114-f7e2-494f-8cfd-8c40b3db3cd4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:51.747693 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1b59114-f7e2-494f-8cfd-8c40b3db3cd4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:51.748305 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1b59114-f7e2-494f-8cfd-8c40b3db3cd4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:51.749478 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1b59114-f7e2-494f-8cfd-8c40b3db3cd4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:51.750023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1b59114-f7e2-494f-8cfd-8c40b3db3cd4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:51.955604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f2ec1687-7300-4297-81c4-1c6d72c7729b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:51.970358 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f2ec1687-7300-4297-81c4-1c6d72c7729b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1517 microversion: 2.1 time: 0.675041 May 21 21:27:51.975030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e1b59114-f7e2-494f-8cfd-8c40b3db3cd4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:51.978607 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1969/4069] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:51 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1517 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:51.986627 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e1b59114-f7e2-494f-8cfd-8c40b3db3cd4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1314 microversion: 2.1 time: 0.251720 May 21 21:27:51.991941 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2101/4070] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:51 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:51.992116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-81034a33-963c-4687-b029-bd5d3de3a790 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:51.992318 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-81034a33-963c-4687-b029-bd5d3de3a790 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:52.016954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81034a33-963c-4687-b029-bd5d3de3a790 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:52.020028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81034a33-963c-4687-b029-bd5d3de3a790 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:52.020028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81034a33-963c-4687-b029-bd5d3de3a790 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:52.020028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81034a33-963c-4687-b029-bd5d3de3a790 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:52.049616 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:52.353810 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ed415bad-9304-47bf-908d-69caf4ab6711 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:52.355286 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ed415bad-9304-47bf-908d-69caf4ab6711 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: cfb31362-6254-457f-8612-86eeff56ddc9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:52.368185 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed415bad-9304-47bf-908d-69caf4ab6711 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:52.372155 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed415bad-9304-47bf-908d-69caf4ab6711 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:52.373013 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed415bad-9304-47bf-908d-69caf4ab6711 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:52.373899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed415bad-9304-47bf-908d-69caf4ab6711 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:52.409159 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-81034a33-963c-4687-b029-bd5d3de3a790 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:52.417736 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-81034a33-963c-4687-b029-bd5d3de3a790 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6" status: 200 len: 1292 microversion: 2.1 time: 0.437961 May 21 21:27:52.421847 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1970/4071] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:51 2022] GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 => generated 1292 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:52.692679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ed415bad-9304-47bf-908d-69caf4ab6711 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:52.704878 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ed415bad-9304-47bf-908d-69caf4ab6711 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9" status: 200 len: 1323 microversion: 2.1 time: 0.365455 May 21 21:27:52.705780 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2102/4072] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:52 2022] GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9 => generated 1323 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:52.987842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-590499f4-0e2d-4fed-9116-ca2014c906ba tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:52.988505 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-590499f4-0e2d-4fed-9116-ca2014c906ba tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:52.998619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-590499f4-0e2d-4fed-9116-ca2014c906ba tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:52.999167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-590499f4-0e2d-4fed-9116-ca2014c906ba tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:53.000343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-590499f4-0e2d-4fed-9116-ca2014c906ba tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:53.000948 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-590499f4-0e2d-4fed-9116-ca2014c906ba tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:53.011476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-25e68243-972a-4ee0-a78b-a42bfc338947 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:53.012758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-25e68243-972a-4ee0-a78b-a42bfc338947 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:53.020641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-25e68243-972a-4ee0-a78b-a42bfc338947 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:53.021283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-25e68243-972a-4ee0-a78b-a42bfc338947 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:53.022602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-25e68243-972a-4ee0-a78b-a42bfc338947 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:53.023217 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-25e68243-972a-4ee0-a78b-a42bfc338947 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:53.219016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-25e68243-972a-4ee0-a78b-a42bfc338947 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:53.228472 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-25e68243-972a-4ee0-a78b-a42bfc338947 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1314 microversion: 2.1 time: 0.223301 May 21 21:27:53.230019 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2103/4073] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:53 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:53.238775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-77c67aa9-c4eb-43b9-b466-a4ae6ebd0235 req-500d66ec-3304-4657-a74b-dc51df78e214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392d9064-09d6-4c79-819b-042ba6d6f70b", "name": "network-vif-plugged", "status": "completed", "tag": "d2f57a10-249a-4c02-a14e-b9efad557114"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:53.249151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-77c67aa9-c4eb-43b9-b466-a4ae6ebd0235 req-500d66ec-3304-4657-a74b-dc51df78e214 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:53.251127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-77c67aa9-c4eb-43b9-b466-a4ae6ebd0235 req-500d66ec-3304-4657-a74b-dc51df78e214 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:53.252610 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-590499f4-0e2d-4fed-9116-ca2014c906ba tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:53.263459 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-590499f4-0e2d-4fed-9116-ca2014c906ba tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1517 microversion: 2.1 time: 0.279660 May 21 21:27:53.265268 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1971/4074] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:52 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1517 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:53.269622 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-77c67aa9-c4eb-43b9-b466-a4ae6ebd0235 req-500d66ec-3304-4657-a74b-dc51df78e214 service nova] Creating event network-vif-plugged:d2f57a10-249a-4c02-a14e-b9efad557114 for instance 392d9064-09d6-4c79-819b-042ba6d6f70b on nch1-master-1 May 21 21:27:53.285295 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-77c67aa9-c4eb-43b9-b466-a4ae6ebd0235 req-500d66ec-3304-4657-a74b-dc51df78e214 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051870 May 21 21:27:53.286236 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2104/4075] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:27:53.435295 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-caa6a4bc-afc9-48b4-bf62-d635e4ebc085 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:53.435957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-caa6a4bc-afc9-48b4-bf62-d635e4ebc085 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:53.443697 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-caa6a4bc-afc9-48b4-bf62-d635e4ebc085 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:53.448481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-caa6a4bc-afc9-48b4-bf62-d635e4ebc085 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:53.448481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-caa6a4bc-afc9-48b4-bf62-d635e4ebc085 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:53.448481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-caa6a4bc-afc9-48b4-bf62-d635e4ebc085 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:53.630954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-caa6a4bc-afc9-48b4-bf62-d635e4ebc085 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:53.645793 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-caa6a4bc-afc9-48b4-bf62-d635e4ebc085 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6" status: 200 len: 1292 microversion: 2.1 time: 0.211107 May 21 21:27:53.651929 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1972/4076] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:53 2022] GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 => generated 1292 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:53.725642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4333d866-4c81-4f72-9e72-83261ede63f8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:53.727738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4333d866-4c81-4f72-9e72-83261ede63f8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: cfb31362-6254-457f-8612-86eeff56ddc9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:53.734937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4333d866-4c81-4f72-9e72-83261ede63f8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:53.735475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4333d866-4c81-4f72-9e72-83261ede63f8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:53.736584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4333d866-4c81-4f72-9e72-83261ede63f8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:53.737111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4333d866-4c81-4f72-9e72-83261ede63f8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:54.078179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4333d866-4c81-4f72-9e72-83261ede63f8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:54.087179 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4333d866-4c81-4f72-9e72-83261ede63f8 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9" status: 200 len: 1323 microversion: 2.1 time: 0.367188 May 21 21:27:54.087778 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2105/4077] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:53 2022] GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9 => generated 1323 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:54.246729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6d4a03e4-8e07-4689-b0fa-aedb9689d4eb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:54.247231 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6d4a03e4-8e07-4689-b0fa-aedb9689d4eb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:54.254001 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d4a03e4-8e07-4689-b0fa-aedb9689d4eb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:54.254867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d4a03e4-8e07-4689-b0fa-aedb9689d4eb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:54.255421 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d4a03e4-8e07-4689-b0fa-aedb9689d4eb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:54.255864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d4a03e4-8e07-4689-b0fa-aedb9689d4eb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:54.288865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1fed8997-554b-475d-8fca-2ab14ca1286b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:54.290230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1fed8997-554b-475d-8fca-2ab14ca1286b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:54.320633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1fed8997-554b-475d-8fca-2ab14ca1286b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:54.322260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1fed8997-554b-475d-8fca-2ab14ca1286b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:54.323098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1fed8997-554b-475d-8fca-2ab14ca1286b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:54.323551 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1fed8997-554b-475d-8fca-2ab14ca1286b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:54.561334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1fed8997-554b-475d-8fca-2ab14ca1286b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:54.573723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6d4a03e4-8e07-4689-b0fa-aedb9689d4eb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:54.575566 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1fed8997-554b-475d-8fca-2ab14ca1286b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1517 microversion: 2.1 time: 0.290517 May 21 21:27:54.576561 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2106/4078] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:54 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1517 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:54.585217 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6d4a03e4-8e07-4689-b0fa-aedb9689d4eb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1314 microversion: 2.1 time: 0.343048 May 21 21:27:54.592819 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1973/4079] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:54 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:54.665850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6856a384-1576-448e-a238-c0cbbae9933f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:54.665850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6856a384-1576-448e-a238-c0cbbae9933f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:54.675973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6856a384-1576-448e-a238-c0cbbae9933f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:54.676201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6856a384-1576-448e-a238-c0cbbae9933f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:54.677028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6856a384-1576-448e-a238-c0cbbae9933f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:54.680847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6856a384-1576-448e-a238-c0cbbae9933f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:55.015863 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6856a384-1576-448e-a238-c0cbbae9933f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:55.021453 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:55.030844 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6856a384-1576-448e-a238-c0cbbae9933f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6" status: 200 len: 1292 microversion: 2.1 time: 0.372910 May 21 21:27:55.032056 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2107/4080] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:54 2022] GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 => generated 1292 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:55.103060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6c73c223-4729-45a8-bb68-e020fa4b3292 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:55.103691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6c73c223-4729-45a8-bb68-e020fa4b3292 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: cfb31362-6254-457f-8612-86eeff56ddc9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:55.110683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c73c223-4729-45a8-bb68-e020fa4b3292 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:55.113316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c73c223-4729-45a8-bb68-e020fa4b3292 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:55.113316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c73c223-4729-45a8-bb68-e020fa4b3292 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:55.113316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c73c223-4729-45a8-bb68-e020fa4b3292 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:55.293066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6c73c223-4729-45a8-bb68-e020fa4b3292 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:55.301924 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6c73c223-4729-45a8-bb68-e020fa4b3292 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9" status: 200 len: 1323 microversion: 2.1 time: 0.202674 May 21 21:27:55.302833 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1974/4081] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:55 2022] GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9 => generated 1323 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:55.347743 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-c7cdd187-25cb-4184-9abd-d75ee34d25e7 req-f02b9a0f-d540-47a4-9048-ce2ca35c0918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8542f670-5b21-4fda-abd5-6951efd387ed", "name": "network-vif-plugged", "status": "completed", "tag": "ca346eef-6b59-4751-a9fe-482d287bd3d7"}, {"server_uuid": "cfb31362-6254-457f-8612-86eeff56ddc9", "name": "network-vif-plugged", "status": "completed", "tag": "486d9633-d9e9-4d01-a755-68d6b4b2236b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:55.367096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c7cdd187-25cb-4184-9abd-d75ee34d25e7 req-f02b9a0f-d540-47a4-9048-ce2ca35c0918 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:55.367096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c7cdd187-25cb-4184-9abd-d75ee34d25e7 req-f02b9a0f-d540-47a4-9048-ce2ca35c0918 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:55.388233 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-c7cdd187-25cb-4184-9abd-d75ee34d25e7 req-f02b9a0f-d540-47a4-9048-ce2ca35c0918 service nova] Creating event network-vif-plugged:ca346eef-6b59-4751-a9fe-482d287bd3d7 for instance 8542f670-5b21-4fda-abd5-6951efd387ed on nch2-master-1 May 21 21:27:55.389109 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-c7cdd187-25cb-4184-9abd-d75ee34d25e7 req-f02b9a0f-d540-47a4-9048-ce2ca35c0918 service nova] Creating event network-vif-plugged:486d9633-d9e9-4d01-a755-68d6b4b2236b for instance cfb31362-6254-457f-8612-86eeff56ddc9 on nch1-master-1 May 21 21:27:55.399559 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-c7cdd187-25cb-4184-9abd-d75ee34d25e7 req-f02b9a0f-d540-47a4-9048-ce2ca35c0918 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055319 May 21 21:27:55.400504 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2108/4082] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:27:55.604255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1d240908-e63d-4be0-a080-b6fb3d5d809c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:55.606232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1d240908-e63d-4be0-a080-b6fb3d5d809c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:55.607637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1624eb06-d9a4-44de-8e06-28905e0659a4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:55.608630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1624eb06-d9a4-44de-8e06-28905e0659a4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:55.615722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1624eb06-d9a4-44de-8e06-28905e0659a4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:55.621013 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1624eb06-d9a4-44de-8e06-28905e0659a4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:55.627962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1624eb06-d9a4-44de-8e06-28905e0659a4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:55.627962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1624eb06-d9a4-44de-8e06-28905e0659a4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:55.628255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d240908-e63d-4be0-a080-b6fb3d5d809c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:55.628255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d240908-e63d-4be0-a080-b6fb3d5d809c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:55.628255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d240908-e63d-4be0-a080-b6fb3d5d809c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:55.628255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d240908-e63d-4be0-a080-b6fb3d5d809c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:55.823070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1d240908-e63d-4be0-a080-b6fb3d5d809c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:55.831966 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1d240908-e63d-4be0-a080-b6fb3d5d809c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1523 microversion: 2.1 time: 0.238707 May 21 21:27:55.834216 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1975/4083] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:55 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:56.052738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-df331d73-4cd1-426b-99f1-e3e72844805a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:56.053372 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-df331d73-4cd1-426b-99f1-e3e72844805a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:56.060928 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df331d73-4cd1-426b-99f1-e3e72844805a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:56.062052 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df331d73-4cd1-426b-99f1-e3e72844805a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:56.062883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df331d73-4cd1-426b-99f1-e3e72844805a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:56.063357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df331d73-4cd1-426b-99f1-e3e72844805a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:56.155492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1624eb06-d9a4-44de-8e06-28905e0659a4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:56.170369 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1624eb06-d9a4-44de-8e06-28905e0659a4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1314 microversion: 2.1 time: 0.568680 May 21 21:27:56.182054 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2109/4084] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:55 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:56.315384 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-df331d73-4cd1-426b-99f1-e3e72844805a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:56.320327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5688f786-35a3-478a-971f-efccfe0ae43c tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:56.323178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5688f786-35a3-478a-971f-efccfe0ae43c tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: cfb31362-6254-457f-8612-86eeff56ddc9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:56.327380 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-df331d73-4cd1-426b-99f1-e3e72844805a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6" status: 200 len: 1292 microversion: 2.1 time: 0.278552 May 21 21:27:56.333079 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5688f786-35a3-478a-971f-efccfe0ae43c tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:56.343856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5688f786-35a3-478a-971f-efccfe0ae43c tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:56.344202 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1976/4085] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:56 2022] GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 => generated 1292 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:56.344357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5688f786-35a3-478a-971f-efccfe0ae43c tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:56.344357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5688f786-35a3-478a-971f-efccfe0ae43c tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:56.812833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5688f786-35a3-478a-971f-efccfe0ae43c tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:56.823717 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5688f786-35a3-478a-971f-efccfe0ae43c tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9" status: 200 len: 1323 microversion: 2.1 time: 0.508173 May 21 21:27:56.824259 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2110/4086] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:56 2022] GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9 => generated 1323 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:56.858925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6e10d35b-93b9-467d-9dab-0aea234f7126 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:56.861401 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6e10d35b-93b9-467d-9dab-0aea234f7126 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:56.870656 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e10d35b-93b9-467d-9dab-0aea234f7126 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:56.871115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e10d35b-93b9-467d-9dab-0aea234f7126 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:56.871910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e10d35b-93b9-467d-9dab-0aea234f7126 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:56.872388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e10d35b-93b9-467d-9dab-0aea234f7126 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:57.191858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9f754c43-5ca4-48fe-84d8-c4f08717a420 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:57.193258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9f754c43-5ca4-48fe-84d8-c4f08717a420 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:57.203146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f754c43-5ca4-48fe-84d8-c4f08717a420 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:57.203926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f754c43-5ca4-48fe-84d8-c4f08717a420 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:57.204952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f754c43-5ca4-48fe-84d8-c4f08717a420 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:57.205565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f754c43-5ca4-48fe-84d8-c4f08717a420 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:57.508671 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9f754c43-5ca4-48fe-84d8-c4f08717a420 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:57.520077 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9f754c43-5ca4-48fe-84d8-c4f08717a420 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1501 microversion: 2.1 time: 0.333111 May 21 21:27:57.520794 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2111/4087] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:57 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1501 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:57.526292 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f4b7c474-c415-49ce-94be-f619deb81826 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:57.540148 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f4b7c474-c415-49ce-94be-f619deb81826 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:57.552685 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4b7c474-c415-49ce-94be-f619deb81826 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:57.553522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4b7c474-c415-49ce-94be-f619deb81826 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:57.556025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4b7c474-c415-49ce-94be-f619deb81826 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:57.556842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4b7c474-c415-49ce-94be-f619deb81826 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:57.608607 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6e10d35b-93b9-467d-9dab-0aea234f7126 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:57.630104 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6e10d35b-93b9-467d-9dab-0aea234f7126 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1523 microversion: 2.1 time: 0.770928 May 21 21:27:57.630104 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1977/4088] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:56 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1523 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:57.630104 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-5034cb56-df3e-4e75-9cc4-43e4a5e172c7 req-7f54318f-d776-453f-992a-84b7492165e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba344601-c421-4d34-875e-70d22ffa8cc2", "name": "network-vif-plugged", "status": "completed", "tag": "32980dfe-e248-4fec-b2d3-815145c153fc"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:57.657264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-5034cb56-df3e-4e75-9cc4-43e4a5e172c7 req-7f54318f-d776-453f-992a-84b7492165e4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:57.657733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-5034cb56-df3e-4e75-9cc4-43e4a5e172c7 req-7f54318f-d776-453f-992a-84b7492165e4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:57.672431 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-5034cb56-df3e-4e75-9cc4-43e4a5e172c7 req-7f54318f-d776-453f-992a-84b7492165e4 service nova] Creating event network-vif-plugged:32980dfe-e248-4fec-b2d3-815145c153fc for instance ba344601-c421-4d34-875e-70d22ffa8cc2 on nch1-master-1 May 21 21:27:57.690171 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-5034cb56-df3e-4e75-9cc4-43e4a5e172c7 req-7f54318f-d776-453f-992a-84b7492165e4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067720 May 21 21:27:57.690799 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1978/4089] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:27:57.699011 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-40933698-5467-4356-9cc4-55f86424d8b1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:57.713512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-40933698-5467-4356-9cc4-55f86424d8b1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:57.720832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40933698-5467-4356-9cc4-55f86424d8b1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:57.721677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40933698-5467-4356-9cc4-55f86424d8b1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:57.725591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40933698-5467-4356-9cc4-55f86424d8b1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:57.726267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40933698-5467-4356-9cc4-55f86424d8b1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:58.028974 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-40933698-5467-4356-9cc4-55f86424d8b1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b/action" status: 202 len: 0 microversion: 2.1 time: 0.336375 May 21 21:27:58.029826 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1979/4090] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:27:57 2022] POST /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:27:58.065478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e99eb11b-393e-4cdd-8210-35d3be19bfd7 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:58.065478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e99eb11b-393e-4cdd-8210-35d3be19bfd7 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: cfb31362-6254-457f-8612-86eeff56ddc9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:58.076016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e99eb11b-393e-4cdd-8210-35d3be19bfd7 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:58.077128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e99eb11b-393e-4cdd-8210-35d3be19bfd7 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:58.077938 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e99eb11b-393e-4cdd-8210-35d3be19bfd7 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:58.078382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e99eb11b-393e-4cdd-8210-35d3be19bfd7 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:58.135309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f4b7c474-c415-49ce-94be-f619deb81826 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:58.149484 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f4b7c474-c415-49ce-94be-f619deb81826 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6" status: 200 len: 1292 microversion: 2.1 time: 0.625875 May 21 21:27:58.153850 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2112/4091] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:57 2022] GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 => generated 1292 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:58.167113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-be1eb6a6-d2af-46b0-b32f-d9e5ae640996 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:58.168310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-be1eb6a6-d2af-46b0-b32f-d9e5ae640996 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:58.179151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be1eb6a6-d2af-46b0-b32f-d9e5ae640996 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:58.179626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be1eb6a6-d2af-46b0-b32f-d9e5ae640996 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:58.181445 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be1eb6a6-d2af-46b0-b32f-d9e5ae640996 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:58.182256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be1eb6a6-d2af-46b0-b32f-d9e5ae640996 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:58.545559 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-be1eb6a6-d2af-46b0-b32f-d9e5ae640996 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:58.563925 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-be1eb6a6-d2af-46b0-b32f-d9e5ae640996 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1506 microversion: 2.1 time: 0.408589 May 21 21:27:58.564947 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2113/4092] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:58 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1506 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:58.614844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e99eb11b-393e-4cdd-8210-35d3be19bfd7 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:58.631151 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e99eb11b-393e-4cdd-8210-35d3be19bfd7 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9" status: 200 len: 1517 microversion: 2.1 time: 0.594855 May 21 21:27:58.653669 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1980/4093] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:58 2022] GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9 => generated 1517 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:58.654022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-705e83d5-fc51-4336-9ca1-6fe28066e291 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:58.654022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-705e83d5-fc51-4336-9ca1-6fe28066e291 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:58.654352 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-189d47f4-76df-4254-b9e5-c1c433f9eccf tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:58.655182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-189d47f4-76df-4254-b9e5-c1c433f9eccf tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: 8542f670-5b21-4fda-abd5-6951efd387ed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:58.657155 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-705e83d5-fc51-4336-9ca1-6fe28066e291 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:58.657645 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-705e83d5-fc51-4336-9ca1-6fe28066e291 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:58.658709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-705e83d5-fc51-4336-9ca1-6fe28066e291 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:58.661913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-705e83d5-fc51-4336-9ca1-6fe28066e291 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:58.669251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-189d47f4-76df-4254-b9e5-c1c433f9eccf tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:58.669717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-189d47f4-76df-4254-b9e5-c1c433f9eccf tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:58.670522 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-189d47f4-76df-4254-b9e5-c1c433f9eccf tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:58.671958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-189d47f4-76df-4254-b9e5-c1c433f9eccf tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:59.051524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-705e83d5-fc51-4336-9ca1-6fe28066e291 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:59.064936 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-705e83d5-fc51-4336-9ca1-6fe28066e291 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1523 microversion: 2.1 time: 0.430027 May 21 21:27:59.066764 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2114/4094] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:58 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1523 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:59.077452 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-189d47f4-76df-4254-b9e5-c1c433f9eccf tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:59.094122 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-189d47f4-76df-4254-b9e5-c1c433f9eccf tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/8542f670-5b21-4fda-abd5-6951efd387ed" status: 200 len: 1516 microversion: 2.1 time: 0.449578 May 21 21:27:59.096072 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1981/4095] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:58 2022] GET /compute/v2.1/servers/8542f670-5b21-4fda-abd5-6951efd387ed => generated 1516 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:59.115288 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b03b03b3-1f3c-4506-9c4e-75280f013f17 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:59.116028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b03b03b3-1f3c-4506-9c4e-75280f013f17 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: ba344601-c421-4d34-875e-70d22ffa8cc2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:59.132510 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b03b03b3-1f3c-4506-9c4e-75280f013f17 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:59.134731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b03b03b3-1f3c-4506-9c4e-75280f013f17 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:59.137624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b03b03b3-1f3c-4506-9c4e-75280f013f17 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:59.139334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b03b03b3-1f3c-4506-9c4e-75280f013f17 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:59.171764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8fbe16e4-f9ca-4d7b-8c74-ea762706f4ad tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:59.173253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8fbe16e4-f9ca-4d7b-8c74-ea762706f4ad tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:59.194439 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8fbe16e4-f9ca-4d7b-8c74-ea762706f4ad tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:59.195294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8fbe16e4-f9ca-4d7b-8c74-ea762706f4ad tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:59.196918 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8fbe16e4-f9ca-4d7b-8c74-ea762706f4ad tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:59.197602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8fbe16e4-f9ca-4d7b-8c74-ea762706f4ad tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:59.651670 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8fbe16e4-f9ca-4d7b-8c74-ea762706f4ad tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:59.667027 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8fbe16e4-f9ca-4d7b-8c74-ea762706f4ad tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6" status: 200 len: 1292 microversion: 2.1 time: 0.500001 May 21 21:27:59.671388 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1982/4096] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:59 2022] GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 => generated 1292 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:27:59.683402 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-89ffd3e1-073a-4c0c-a991-fdce0861a734 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:27:59.688499 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-89ffd3e1-073a-4c0c-a991-fdce0861a734 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:27:59.703742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-89ffd3e1-073a-4c0c-a991-fdce0861a734 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:59.705198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-89ffd3e1-073a-4c0c-a991-fdce0861a734 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:59.708457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-89ffd3e1-073a-4c0c-a991-fdce0861a734 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:59.709144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-89ffd3e1-073a-4c0c-a991-fdce0861a734 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:59.885209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b03b03b3-1f3c-4506-9c4e-75280f013f17 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:27:59.894707 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b03b03b3-1f3c-4506-9c4e-75280f013f17 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/ba344601-c421-4d34-875e-70d22ffa8cc2" status: 200 len: 1323 microversion: 2.1 time: 0.784852 May 21 21:27:59.895390 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2115/4097] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:59 2022] GET /compute/v2.1/servers/ba344601-c421-4d34-875e-70d22ffa8cc2 => generated 1323 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:27:59.901308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-890c575d-943b-4bb5-9acc-7b25c6f54a6c req-d14c02ef-ad49-43b7-9698-7474b9d8de7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec44cb55-6eb8-4fa8-a028-81cebb81784b", "name": "network-vif-unplugged", "status": "completed", "tag": "82d3aaa4-7f3a-4649-9287-1aad4999a90c"}, {"server_uuid": "de7a52b3-ff9e-4281-b9d8-78ad66dd33d6", "name": "network-vif-plugged", "status": "completed", "tag": "9634c849-608d-4b8f-aee2-40d7512be721"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:27:59.915212 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-890c575d-943b-4bb5-9acc-7b25c6f54a6c req-d14c02ef-ad49-43b7-9698-7474b9d8de7d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:27:59.915947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-890c575d-943b-4bb5-9acc-7b25c6f54a6c req-d14c02ef-ad49-43b7-9698-7474b9d8de7d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:27:59.933049 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-890c575d-943b-4bb5-9acc-7b25c6f54a6c req-d14c02ef-ad49-43b7-9698-7474b9d8de7d service nova] Creating event network-vif-unplugged:82d3aaa4-7f3a-4649-9287-1aad4999a90c for instance ec44cb55-6eb8-4fa8-a028-81cebb81784b on nch1-master-1 May 21 21:27:59.934260 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-890c575d-943b-4bb5-9acc-7b25c6f54a6c req-d14c02ef-ad49-43b7-9698-7474b9d8de7d service nova] Creating event network-vif-plugged:9634c849-608d-4b8f-aee2-40d7512be721 for instance de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 on nch2-master-1 May 21 21:27:59.947675 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-890c575d-943b-4bb5-9acc-7b25c6f54a6c req-d14c02ef-ad49-43b7-9698-7474b9d8de7d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.047702 May 21 21:27:59.947675 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2116/4098] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:00.084071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6916c3dc-77a3-449e-8e67-7733765ed8dd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:00.085380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6916c3dc-77a3-449e-8e67-7733765ed8dd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:00.099940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6916c3dc-77a3-449e-8e67-7733765ed8dd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:00.099940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6916c3dc-77a3-449e-8e67-7733765ed8dd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:00.099940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6916c3dc-77a3-449e-8e67-7733765ed8dd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:00.099940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6916c3dc-77a3-449e-8e67-7733765ed8dd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:00.302512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-89ffd3e1-073a-4c0c-a991-fdce0861a734 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:00.316423 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-89ffd3e1-073a-4c0c-a991-fdce0861a734 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1486 microversion: 2.1 time: 0.643580 May 21 21:28:00.325486 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1983/4099] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:27:59 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1486 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:00.336606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6916c3dc-77a3-449e-8e67-7733765ed8dd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:00.344341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f873be99-70b6-4c48-9e24-61479817113e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:00.349252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f873be99-70b6-4c48-9e24-61479817113e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:00.361221 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6916c3dc-77a3-449e-8e67-7733765ed8dd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1523 microversion: 2.1 time: 0.281783 May 21 21:28:00.370245 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f873be99-70b6-4c48-9e24-61479817113e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:00.370245 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f873be99-70b6-4c48-9e24-61479817113e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:00.370777 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2117/4100] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:00 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1523 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:00.371120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f873be99-70b6-4c48-9e24-61479817113e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:00.371120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f873be99-70b6-4c48-9e24-61479817113e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:00.394903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-f873be99-70b6-4c48-9e24-61479817113e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lazy-loading 'flavor' on Instance uuid 392d9064-09d6-4c79-819b-042ba6d6f70b {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:28:00.688966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b112cc2f-716b-444d-affe-464c67694581 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:00.689567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b112cc2f-716b-444d-affe-464c67694581 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:00.696637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b112cc2f-716b-444d-affe-464c67694581 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:00.697092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b112cc2f-716b-444d-affe-464c67694581 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:00.697870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b112cc2f-716b-444d-affe-464c67694581 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:00.698325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b112cc2f-716b-444d-affe-464c67694581 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:00.808924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:00.931267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b112cc2f-716b-444d-affe-464c67694581 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:00.940617 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b112cc2f-716b-444d-affe-464c67694581 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6" status: 200 len: 1292 microversion: 2.1 time: 0.256255 May 21 21:28:00.941732 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2118/4101] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:00 2022] GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 => generated 1292 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:00.947359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7950ff27-f5ed-4b7f-9902-5584638a760c tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:00.947975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7950ff27-f5ed-4b7f-9902-5584638a760c tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: ba344601-c421-4d34-875e-70d22ffa8cc2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:00.954265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7950ff27-f5ed-4b7f-9902-5584638a760c tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:00.956114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7950ff27-f5ed-4b7f-9902-5584638a760c tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:00.956114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7950ff27-f5ed-4b7f-9902-5584638a760c tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:00.956114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7950ff27-f5ed-4b7f-9902-5584638a760c tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:01.190071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7950ff27-f5ed-4b7f-9902-5584638a760c tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:01.199879 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7950ff27-f5ed-4b7f-9902-5584638a760c tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/ba344601-c421-4d34-875e-70d22ffa8cc2" status: 200 len: 1517 microversion: 2.1 time: 0.256483 May 21 21:28:01.200512 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2119/4102] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:00 2022] GET /compute/v2.1/servers/ba344601-c421-4d34-875e-70d22ffa8cc2 => generated 1517 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:01.223831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c7ffcf67-c752-4c6e-b3e7-cb9edcb79461 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:01.224416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c7ffcf67-c752-4c6e-b3e7-cb9edcb79461 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: ba344601-c421-4d34-875e-70d22ffa8cc2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:01.238296 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7ffcf67-c752-4c6e-b3e7-cb9edcb79461 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:01.238801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7ffcf67-c752-4c6e-b3e7-cb9edcb79461 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:01.239598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7ffcf67-c752-4c6e-b3e7-cb9edcb79461 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:01.240046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7ffcf67-c752-4c6e-b3e7-cb9edcb79461 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:01.274315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c7ffcf67-c752-4c6e-b3e7-cb9edcb79461 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: ba344601-c421-4d34-875e-70d22ffa8cc2] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:28:01.307166 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f873be99-70b6-4c48-9e24-61479817113e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b/action" status: 202 len: 0 microversion: 2.1 time: 0.968618 May 21 21:28:01.311191 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1984/4103] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:28:00 2022] POST /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b/action => generated 0 bytes in 974 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:28:01.322380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-abb604e6-e987-468b-be69-3dfbcabae268 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:01.323214 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-abb604e6-e987-468b-be69-3dfbcabae268 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:01.352807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-abb604e6-e987-468b-be69-3dfbcabae268 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:01.353321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-abb604e6-e987-468b-be69-3dfbcabae268 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:01.356619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-abb604e6-e987-468b-be69-3dfbcabae268 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:01.357075 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-abb604e6-e987-468b-be69-3dfbcabae268 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:01.708358 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-abb604e6-e987-468b-be69-3dfbcabae268 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:01.732466 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-abb604e6-e987-468b-be69-3dfbcabae268 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1492 microversion: 2.1 time: 0.419928 May 21 21:28:01.733506 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1985/4104] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:01 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1492 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:01.738607 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cb69bd65-f7b9-44a7-bf29-ec9e4dc24733 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:01.740307 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cb69bd65-f7b9-44a7-bf29-ec9e4dc24733 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:01.748074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb69bd65-f7b9-44a7-bf29-ec9e4dc24733 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:01.748985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb69bd65-f7b9-44a7-bf29-ec9e4dc24733 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:01.750056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb69bd65-f7b9-44a7-bf29-ec9e4dc24733 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:01.750713 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb69bd65-f7b9-44a7-bf29-ec9e4dc24733 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:01.845837 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c7ffcf67-c752-4c6e-b3e7-cb9edcb79461 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ba344601-c421-4d34-875e-70d22ffa8cc2" status: 204 len: 0 microversion: 2.1 time: 0.625282 May 21 21:28:01.846543 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2120/4105] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:28:01 2022] DELETE /compute/v2.1/servers/ba344601-c421-4d34-875e-70d22ffa8cc2 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:28:01.864775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f143dd10-a255-4d4a-9fed-88045622c0d6 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:01.872239 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f143dd10-a255-4d4a-9fed-88045622c0d6 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: ba344601-c421-4d34-875e-70d22ffa8cc2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:01.882136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f143dd10-a255-4d4a-9fed-88045622c0d6 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:01.883336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f143dd10-a255-4d4a-9fed-88045622c0d6 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:01.885014 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f143dd10-a255-4d4a-9fed-88045622c0d6 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:01.885699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f143dd10-a255-4d4a-9fed-88045622c0d6 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:02.120957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cb69bd65-f7b9-44a7-bf29-ec9e4dc24733 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:02.141761 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cb69bd65-f7b9-44a7-bf29-ec9e4dc24733 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1523 microversion: 2.1 time: 0.406870 May 21 21:28:02.142372 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1986/4106] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:01 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1523 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:02.155910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0148341e-8dbd-4945-8dd6-d9a29f6e5a1b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:02.156821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0148341e-8dbd-4945-8dd6-d9a29f6e5a1b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:02.165808 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0148341e-8dbd-4945-8dd6-d9a29f6e5a1b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:02.166515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0148341e-8dbd-4945-8dd6-d9a29f6e5a1b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:02.172768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0148341e-8dbd-4945-8dd6-d9a29f6e5a1b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:02.173259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0148341e-8dbd-4945-8dd6-d9a29f6e5a1b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:02.234993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f143dd10-a255-4d4a-9fed-88045622c0d6 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:02.246179 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f143dd10-a255-4d4a-9fed-88045622c0d6 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/ba344601-c421-4d34-875e-70d22ffa8cc2" status: 200 len: 1523 microversion: 2.1 time: 0.395119 May 21 21:28:02.247889 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2121/4107] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:01 2022] GET /compute/v2.1/servers/ba344601-c421-4d34-875e-70d22ffa8cc2 => generated 1523 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:02.268623 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-ee5fba99-63af-43ae-b122-1a2d0625f1a5 req-3090e54f-8d74-47a8-9607-d803683266ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec44cb55-6eb8-4fa8-a028-81cebb81784b", "name": "network-vif-plugged", "status": "completed", "tag": "82d3aaa4-7f3a-4649-9287-1aad4999a90c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:02.306897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ee5fba99-63af-43ae-b122-1a2d0625f1a5 req-3090e54f-8d74-47a8-9607-d803683266ee service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:02.306897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ee5fba99-63af-43ae-b122-1a2d0625f1a5 req-3090e54f-8d74-47a8-9607-d803683266ee service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:02.336828 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-ee5fba99-63af-43ae-b122-1a2d0625f1a5 req-3090e54f-8d74-47a8-9607-d803683266ee service nova] Creating event network-vif-plugged:82d3aaa4-7f3a-4649-9287-1aad4999a90c for instance ec44cb55-6eb8-4fa8-a028-81cebb81784b on nch1-master-1 May 21 21:28:02.365419 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-ee5fba99-63af-43ae-b122-1a2d0625f1a5 req-3090e54f-8d74-47a8-9607-d803683266ee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105964 May 21 21:28:02.366067 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2122/4108] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:02.513241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0148341e-8dbd-4945-8dd6-d9a29f6e5a1b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:02.525779 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0148341e-8dbd-4945-8dd6-d9a29f6e5a1b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6" status: 200 len: 1474 microversion: 2.1 time: 0.382147 May 21 21:28:02.526384 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1987/4109] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:02 2022] GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 => generated 1474 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:02.710093 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3469f92b-dfd0-496f-b8f7-54bb565c9ed7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-550392383", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:02.750990 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6b202b21-35e8-4d3b-8c3b-af0a8848b9e8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:02.751632 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6b202b21-35e8-4d3b-8c3b-af0a8848b9e8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:02.759975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b202b21-35e8-4d3b-8c3b-af0a8848b9e8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:02.760564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b202b21-35e8-4d3b-8c3b-af0a8848b9e8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:02.765100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b202b21-35e8-4d3b-8c3b-af0a8848b9e8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:02.765100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b202b21-35e8-4d3b-8c3b-af0a8848b9e8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:02.788134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-3469f92b-dfd0-496f-b8f7-54bb565c9ed7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] validate_networks() for [('88d40858-d8e8-4c97-8084-13382fa527f6', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:28:03.068769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6b202b21-35e8-4d3b-8c3b-af0a8848b9e8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:03.079576 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6b202b21-35e8-4d3b-8c3b-af0a8848b9e8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1513 microversion: 2.1 time: 0.332804 May 21 21:28:03.081064 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1988/4110] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:02 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1513 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:03.158908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8f940fce-8f65-4f43-881a-62b9b054ff4e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:03.159700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8f940fce-8f65-4f43-881a-62b9b054ff4e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:03.169587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f940fce-8f65-4f43-881a-62b9b054ff4e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:03.170223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f940fce-8f65-4f43-881a-62b9b054ff4e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:03.172841 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f940fce-8f65-4f43-881a-62b9b054ff4e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:03.172841 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f940fce-8f65-4f43-881a-62b9b054ff4e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:03.675135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-3469f92b-dfd0-496f-b8f7-54bb565c9ed7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:28:03.675666 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-3469f92b-dfd0-496f-b8f7-54bb565c9ed7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:28:03.676050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-3469f92b-dfd0-496f-b8f7-54bb565c9ed7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:28:03.676537 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-3469f92b-dfd0-496f-b8f7-54bb565c9ed7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:28:03.678561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-3469f92b-dfd0-496f-b8f7-54bb565c9ed7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:28:03.690188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3469f92b-dfd0-496f-b8f7-54bb565c9ed7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:03.690656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3469f92b-dfd0-496f-b8f7-54bb565c9ed7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:03.691689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3469f92b-dfd0-496f-b8f7-54bb565c9ed7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:03.692842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3469f92b-dfd0-496f-b8f7-54bb565c9ed7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:03.713299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-3469f92b-dfd0-496f-b8f7-54bb565c9ed7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Getting quotas for project 4dbb4bbc88f84520885c00a376ba0f7c. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:28:03.719491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-3469f92b-dfd0-496f-b8f7-54bb565c9ed7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Getting quotas for user c67dc8226610413a8bb889d6055a75d2 and project 4dbb4bbc88f84520885c00a376ba0f7c. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:28:03.734015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3469f92b-dfd0-496f-b8f7-54bb565c9ed7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:28:03.736507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3469f92b-dfd0-496f-b8f7-54bb565c9ed7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: bd0952e5-db2c-45ed-ac68-e59b37512d12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:28:03.921666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8f940fce-8f65-4f43-881a-62b9b054ff4e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:03.934482 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8f940fce-8f65-4f43-881a-62b9b054ff4e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1523 microversion: 2.1 time: 0.779108 May 21 21:28:03.935599 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1989/4111] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:03 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1523 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:03.940601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4cecac51-1fa3-4760-af9f-7e4160613b52 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:03.941369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4cecac51-1fa3-4760-af9f-7e4160613b52 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: ba344601-c421-4d34-875e-70d22ffa8cc2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:03.948301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cecac51-1fa3-4760-af9f-7e4160613b52 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:03.949271 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cecac51-1fa3-4760-af9f-7e4160613b52 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:03.950379 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cecac51-1fa3-4760-af9f-7e4160613b52 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:03.951331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cecac51-1fa3-4760-af9f-7e4160613b52 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:03.979130 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3469f92b-dfd0-496f-b8f7-54bb565c9ed7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.271027 May 21 21:28:03.980583 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2123/4112] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:28:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:28:03.992874 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3316c60f-2a16-4ab1-98a3-d715a4696c52 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:03.993379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3316c60f-2a16-4ab1-98a3-d715a4696c52 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: bd0952e5-db2c-45ed-ac68-e59b37512d12] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:04.017283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3316c60f-2a16-4ab1-98a3-d715a4696c52 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: bd0952e5-db2c-45ed-ac68-e59b37512d12] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:28:04.378127 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4cecac51-1fa3-4760-af9f-7e4160613b52 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:04.389996 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4cecac51-1fa3-4760-af9f-7e4160613b52 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/ba344601-c421-4d34-875e-70d22ffa8cc2" status: 200 len: 1523 microversion: 2.1 time: 0.452815 May 21 21:28:04.390349 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1990/4113] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:03 2022] GET /compute/v2.1/servers/ba344601-c421-4d34-875e-70d22ffa8cc2 => generated 1523 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:04.403724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f504e484-88c7-4e9b-94c2-88e0b84693f0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:04.404619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f504e484-88c7-4e9b-94c2-88e0b84693f0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:04.418364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f504e484-88c7-4e9b-94c2-88e0b84693f0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:04.421284 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f504e484-88c7-4e9b-94c2-88e0b84693f0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:04.422212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f504e484-88c7-4e9b-94c2-88e0b84693f0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:04.422735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f504e484-88c7-4e9b-94c2-88e0b84693f0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:04.547901 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3316c60f-2a16-4ab1-98a3-d715a4696c52 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bd0952e5-db2c-45ed-ac68-e59b37512d12" status: 204 len: 0 microversion: 2.1 time: 0.558254 May 21 21:28:04.553294 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2124/4114] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:28:03 2022] DELETE /compute/v2.1/servers/bd0952e5-db2c-45ed-ac68-e59b37512d12 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:28:04.560643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-8bccff30-ab97-4c8f-861a-5b31366bfff3 req-d91b7e50-12cf-4ad8-804f-e274d2a5aa40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba344601-c421-4d34-875e-70d22ffa8cc2", "name": "network-vif-deleted", "tag": "32980dfe-e248-4fec-b2d3-815145c153fc"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:04.583859 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8bccff30-ab97-4c8f-861a-5b31366bfff3 req-d91b7e50-12cf-4ad8-804f-e274d2a5aa40 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:04.584986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8bccff30-ab97-4c8f-861a-5b31366bfff3 req-d91b7e50-12cf-4ad8-804f-e274d2a5aa40 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:04.602918 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-8bccff30-ab97-4c8f-861a-5b31366bfff3 req-d91b7e50-12cf-4ad8-804f-e274d2a5aa40 service nova] Creating event network-vif-deleted:32980dfe-e248-4fec-b2d3-815145c153fc for instance ba344601-c421-4d34-875e-70d22ffa8cc2 on nch1-master-1 May 21 21:28:04.609033 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-8bccff30-ab97-4c8f-861a-5b31366bfff3 req-d91b7e50-12cf-4ad8-804f-e274d2a5aa40 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054277 May 21 21:28:04.609947 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2125/4115] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:04.616059 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5ed6c7c8-682f-42bb-9018-7799fe68fd86 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:04.617303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5ed6c7c8-682f-42bb-9018-7799fe68fd86 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: bd0952e5-db2c-45ed-ac68-e59b37512d12] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:04.625229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:04.633428 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-5ed6c7c8-682f-42bb-9018-7799fe68fd86 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance bd0952e5-db2c-45ed-ac68-e59b37512d12 could not be found. May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5ed6c7c8-682f-42bb-9018-7799fe68fd86 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/bd0952e5-db2c-45ed-ac68-e59b37512d12 HTTP/1.1 May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance bd0952e5-db2c-45ed-ac68-e59b37512d12 could not be found. May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'bd0952e5-db2c-45ed-ac68-e59b37512d12'} May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2877, in _get_instance May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance bd0952e5-db2c-45ed-ac68-e59b37512d12 May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2889, in _get_instance May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd0952e5-db2c-45ed-ac68-e59b37512d12 could not be found. May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:04.639243 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd0952e5-db2c-45ed-ac68-e59b37512d12 could not be found. May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd0952e5-db2c-45ed-ac68-e59b37512d12 could not be found. May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5ed6c7c8-682f-42bb-9018-7799fe68fd86 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance bd0952e5-db2c-45ed-ac68-e59b37512d12 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5ed6c7c8-682f-42bb-9018-7799fe68fd86 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/bd0952e5-db2c-45ed-ac68-e59b37512d12" status: 404 len: 111 microversion: 2.1 time: 0.029431 May 21 21:28:04.644403 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2126/4116] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:04 2022] GET /compute/v2.1/servers/bd0952e5-db2c-45ed-ac68-e59b37512d12 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:28:04.806476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f660ea1b-5cb6-44be-87f2-250ddef14de2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1396500255", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "88d40858-d8e8-4c97-8084-13382fa527f6"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:04.863171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-f660ea1b-5cb6-44be-87f2-250ddef14de2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] validate_networks() for [('88d40858-d8e8-4c97-8084-13382fa527f6', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:28:04.874972 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f504e484-88c7-4e9b-94c2-88e0b84693f0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:04.886000 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f504e484-88c7-4e9b-94c2-88e0b84693f0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1513 microversion: 2.1 time: 0.490124 May 21 21:28:04.889423 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1991/4117] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:04 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1513 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:04.952931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c1e8daac-f03d-4b3b-b77f-f6cc03ca68f6 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:04.953588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c1e8daac-f03d-4b3b-b77f-f6cc03ca68f6 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:04.962460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1e8daac-f03d-4b3b-b77f-f6cc03ca68f6 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:04.962925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1e8daac-f03d-4b3b-b77f-f6cc03ca68f6 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:04.963730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1e8daac-f03d-4b3b-b77f-f6cc03ca68f6 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:04.964184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1e8daac-f03d-4b3b-b77f-f6cc03ca68f6 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:05.415939 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c1e8daac-f03d-4b3b-b77f-f6cc03ca68f6 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:05.425042 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c1e8daac-f03d-4b3b-b77f-f6cc03ca68f6 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1523 microversion: 2.1 time: 0.476752 May 21 21:28:05.425947 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1992/4118] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:04 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1523 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:05.430833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-19b9d3fc-24ca-4457-ba0d-1d4cb183fbc2 req-0dcb6d5c-def6-4c15-874f-bd74f979c966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392d9064-09d6-4c79-819b-042ba6d6f70b", "name": "network-vif-plugged", "status": "completed", "tag": "d2f57a10-249a-4c02-a14e-b9efad557114"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:05.441896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-19b9d3fc-24ca-4457-ba0d-1d4cb183fbc2 req-0dcb6d5c-def6-4c15-874f-bd74f979c966 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:05.442586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-19b9d3fc-24ca-4457-ba0d-1d4cb183fbc2 req-0dcb6d5c-def6-4c15-874f-bd74f979c966 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:05.459752 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-19b9d3fc-24ca-4457-ba0d-1d4cb183fbc2 req-0dcb6d5c-def6-4c15-874f-bd74f979c966 service nova] Creating event network-vif-plugged:d2f57a10-249a-4c02-a14e-b9efad557114 for instance 392d9064-09d6-4c79-819b-042ba6d6f70b on nch1-master-1 May 21 21:28:05.469744 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-19b9d3fc-24ca-4457-ba0d-1d4cb183fbc2 req-0dcb6d5c-def6-4c15-874f-bd74f979c966 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042360 May 21 21:28:05.470377 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1993/4119] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:05.475514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-110dde17-0e57-41d0-9fee-f996279e9c76 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:05.476805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-110dde17-0e57-41d0-9fee-f996279e9c76 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: ba344601-c421-4d34-875e-70d22ffa8cc2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:05.497033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-110dde17-0e57-41d0-9fee-f996279e9c76 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:05.497732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-110dde17-0e57-41d0-9fee-f996279e9c76 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:05.500599 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-110dde17-0e57-41d0-9fee-f996279e9c76 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:05.501276 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-110dde17-0e57-41d0-9fee-f996279e9c76 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:05.560128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-110dde17-0e57-41d0-9fee-f996279e9c76 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:05.565501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-110dde17-0e57-41d0-9fee-f996279e9c76 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:05.565501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-110dde17-0e57-41d0-9fee-f996279e9c76 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lazy-loading 'fault' on Instance uuid ba344601-c421-4d34-875e-70d22ffa8cc2 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:28:05.621491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-110dde17-0e57-41d0-9fee-f996279e9c76 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:05.629472 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-110dde17-0e57-41d0-9fee-f996279e9c76 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/ba344601-c421-4d34-875e-70d22ffa8cc2" status: 200 len: 1313 microversion: 2.1 time: 0.157955 May 21 21:28:05.630157 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1994/4120] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:05 2022] GET /compute/v2.1/servers/ba344601-c421-4d34-875e-70d22ffa8cc2 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:05.905985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-00b8f45d-97f2-4ba9-b24e-c96f6444ba7a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:05.906651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-00b8f45d-97f2-4ba9-b24e-c96f6444ba7a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:05.913038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00b8f45d-97f2-4ba9-b24e-c96f6444ba7a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:05.913491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00b8f45d-97f2-4ba9-b24e-c96f6444ba7a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:05.915058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00b8f45d-97f2-4ba9-b24e-c96f6444ba7a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:05.915518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00b8f45d-97f2-4ba9-b24e-c96f6444ba7a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:05.990438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-f660ea1b-5cb6-44be-87f2-250ddef14de2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:28:05.997334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-f660ea1b-5cb6-44be-87f2-250ddef14de2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:28:05.998707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-f660ea1b-5cb6-44be-87f2-250ddef14de2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:28:06.000119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-f660ea1b-5cb6-44be-87f2-250ddef14de2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:28:06.000670 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-f660ea1b-5cb6-44be-87f2-250ddef14de2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:28:06.029198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f660ea1b-5cb6-44be-87f2-250ddef14de2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:06.030312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f660ea1b-5cb6-44be-87f2-250ddef14de2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:06.032876 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f660ea1b-5cb6-44be-87f2-250ddef14de2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:06.033460 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f660ea1b-5cb6-44be-87f2-250ddef14de2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:06.079838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-f660ea1b-5cb6-44be-87f2-250ddef14de2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Getting quotas for project 4dbb4bbc88f84520885c00a376ba0f7c. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:28:06.093842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-f660ea1b-5cb6-44be-87f2-250ddef14de2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Getting quotas for user c67dc8226610413a8bb889d6055a75d2 and project 4dbb4bbc88f84520885c00a376ba0f7c. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:28:06.123613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f660ea1b-5cb6-44be-87f2-250ddef14de2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:28:06.126080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f660ea1b-5cb6-44be-87f2-250ddef14de2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:28:06.148629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-00b8f45d-97f2-4ba9-b24e-c96f6444ba7a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:06.158559 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-00b8f45d-97f2-4ba9-b24e-c96f6444ba7a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1508 microversion: 2.1 time: 0.256643 May 21 21:28:06.159510 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1995/4121] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:05 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:06.323514 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f660ea1b-5cb6-44be-87f2-250ddef14de2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.522202 May 21 21:28:06.329611 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2127/4122] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:28:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:28:06.341558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-689b90ea-aeaf-4271-92d8-05cd931848f9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:06.342291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-689b90ea-aeaf-4271-92d8-05cd931848f9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:06.452583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a6d7a22d-58e6-4a4d-ae3f-e75a649c5eae tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:06.453210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a6d7a22d-58e6-4a4d-ae3f-e75a649c5eae tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:06.463906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a6d7a22d-58e6-4a4d-ae3f-e75a649c5eae tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:06.464389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a6d7a22d-58e6-4a4d-ae3f-e75a649c5eae tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:06.468687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a6d7a22d-58e6-4a4d-ae3f-e75a649c5eae tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:06.468687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a6d7a22d-58e6-4a4d-ae3f-e75a649c5eae tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:06.482106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-689b90ea-aeaf-4271-92d8-05cd931848f9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:06.489488 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-689b90ea-aeaf-4271-92d8-05cd931848f9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1221 microversion: 2.1 time: 0.158543 May 21 21:28:06.501473 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1996/4123] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:06 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1221 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:06.647942 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1d1a47ff-a8aa-4085-a180-1ff54414fa91 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:06.648844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1d1a47ff-a8aa-4085-a180-1ff54414fa91 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: ba344601-c421-4d34-875e-70d22ffa8cc2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:06.657100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d1a47ff-a8aa-4085-a180-1ff54414fa91 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:06.658936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d1a47ff-a8aa-4085-a180-1ff54414fa91 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:06.661896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d1a47ff-a8aa-4085-a180-1ff54414fa91 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:06.662289 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d1a47ff-a8aa-4085-a180-1ff54414fa91 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:06.702967 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-1d1a47ff-a8aa-4085-a180-1ff54414fa91 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] HTTP exception thrown: Instance ba344601-c421-4d34-875e-70d22ffa8cc2 could not be found. May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1d1a47ff-a8aa-4085-a180-1ff54414fa91 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Request method failure captured: May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/ba344601-c421-4d34-875e-70d22ffa8cc2 HTTP/1.1 May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVlEmThi0akAWQKQccOJ2ym3yaLUnaIxzvp1h5f15BLZGCEgpNqFjHVNt6oorNEFvLurh5_EXmECIR9yx98ybJSgeh2IqYOs3MYqh20IKDfTzb4_u-wFr8sZBfmtVnL_s7LLPm5JrIExmQVes6PRZnrwS3LjgnOe9o0TG2gmXmbbCV4 May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 761c7e1ce4c04f1c88f5d770024ec589 May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_761c7e1ce4c04f1c88f5d770024ec589", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 761c7e1ce4c04f1c88f5d770024ec589 May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ListServersNegativeTestJSON-1740265434-project May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: a1c11eb375684c7f99d6b0fe06d35f7d May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ListServersNegativeTestJSON-1740265434-project May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance ba344601-c421-4d34-875e-70d22ffa8cc2 could not be found. May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'ba344601-c421-4d34-875e-70d22ffa8cc2'} May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba344601-c421-4d34-875e-70d22ffa8cc2 could not be found. May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba344601-c421-4d34-875e-70d22ffa8cc2 could not be found. May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:06.705768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:06.712869 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:06.712869 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:06.712869 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:06.712869 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:28:06.712869 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:28:06.712869 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba344601-c421-4d34-875e-70d22ffa8cc2 could not be found. May 21 21:28:06.712869 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:06.719505 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1d1a47ff-a8aa-4085-a180-1ff54414fa91 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Returning 404 to user: Instance ba344601-c421-4d34-875e-70d22ffa8cc2 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:06.723852 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1d1a47ff-a8aa-4085-a180-1ff54414fa91 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/ba344601-c421-4d34-875e-70d22ffa8cc2" status: 404 len: 111 microversion: 2.1 time: 0.080749 May 21 21:28:06.725350 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1997/4124] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:06 2022] GET /compute/v2.1/servers/ba344601-c421-4d34-875e-70d22ffa8cc2 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:28:06.751043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a6d7a22d-58e6-4a4d-ae3f-e75a649c5eae tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:06.755188 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3d6f7fa3-0a18-4f58-8d9f-c40a067bf006 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:06.760108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:06.763179 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a6d7a22d-58e6-4a4d-ae3f-e75a649c5eae tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1508 microversion: 2.1 time: 0.316180 May 21 21:28:06.766469 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2128/4125] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:06 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1508 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:06.775086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3d6f7fa3-0a18-4f58-8d9f-c40a067bf006 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:06.777568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3d6f7fa3-0a18-4f58-8d9f-c40a067bf006 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '761c7e1ce4c04f1c88f5d770024ec589'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:28:06.785658 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2ad5847e-502a-41d0-be47-64386f46cb8c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:06.789427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2ad5847e-502a-41d0-be47-64386f46cb8c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:06.790336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d6f7fa3-0a18-4f58-8d9f-c40a067bf006 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:06.791435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d6f7fa3-0a18-4f58-8d9f-c40a067bf006 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:06.792401 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d6f7fa3-0a18-4f58-8d9f-c40a067bf006 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:06.792951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d6f7fa3-0a18-4f58-8d9f-c40a067bf006 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:06.795005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2ad5847e-502a-41d0-be47-64386f46cb8c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:06.797274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2ad5847e-502a-41d0-be47-64386f46cb8c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:06.799575 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2ad5847e-502a-41d0-be47-64386f46cb8c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:06.800218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2ad5847e-502a-41d0-be47-64386f46cb8c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:06.885142 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3d6f7fa3-0a18-4f58-8d9f-c40a067bf006 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.151930 May 21 21:28:06.895486 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1998/4126] 10.222.0.49 () {58 vars in 1229 bytes} [Sat May 21 21:28:06 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:28:06.901740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f022a2fe-7bda-4f7b-be35-68d2430df3ab tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f022a2fe-7bda-4f7b-be35-68d2430df3ab tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Request method failure captured: May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVlEmThi0akAWQKQccOJ2ym3yaLUnaIxzvp1h5f15BLZGCEgpNqFjHVNt6oorNEFvLurh5_EXmECIR9yx98ybJSgeh2IqYOs3MYqh20IKDfTzb4_u-wFr8sZBfmtVnL_s7LLPm5JrIExmQVes6PRZnrwS3LjgnOe9o0TG2gmXmbbCV4 May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 761c7e1ce4c04f1c88f5d770024ec589 May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_761c7e1ce4c04f1c88f5d770024ec589", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 761c7e1ce4c04f1c88f5d770024ec589 May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ListServersNegativeTestJSON-1740265434-project May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: a1c11eb375684c7f99d6b0fe06d35f7d May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ListServersNegativeTestJSON-1740265434-project May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: action_args: {} May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise error May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi On instance[0]: May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi '2011/01/01' May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 21 21:28:06.905150 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:28:06.922363 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:28:06.922363 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:28:06.922363 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:28:06.922363 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 21 21:28:06.922363 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:06.922363 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:06.922363 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:06.922363 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:06.922363 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:06.922363 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:06.922363 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:28:06.922363 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:28:06.922363 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 21 21:28:06.922363 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:06.922363 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f022a2fe-7bda-4f7b-be35-68d2430df3ab tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:06.922363 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f022a2fe-7bda-4f7b-be35-68d2430df3ab tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.009919 May 21 21:28:06.922363 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 1999/4127] 10.222.0.49 () {58 vars in 1181 bytes} [Sat May 21 21:28:06 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:28:06.922363 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-95cfa487-64eb-46f5-97bf-e4aabfac1a9d tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:06.927462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-95cfa487-64eb-46f5-97bf-e4aabfac1a9d tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:06.927462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-95cfa487-64eb-46f5-97bf-e4aabfac1a9d tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Searching by: {'deleted': False, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:28:06.950828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95cfa487-64eb-46f5-97bf-e4aabfac1a9d tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:06.951574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95cfa487-64eb-46f5-97bf-e4aabfac1a9d tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:06.952700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95cfa487-64eb-46f5-97bf-e4aabfac1a9d tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:06.953458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95cfa487-64eb-46f5-97bf-e4aabfac1a9d tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:06.992471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-95cfa487-64eb-46f5-97bf-e4aabfac1a9d tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:28:07.049314 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-95cfa487-64eb-46f5-97bf-e4aabfac1a9d tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.135938 May 21 21:28:07.050825 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2000/4128] 10.222.0.49 () {58 vars in 1124 bytes} [Sat May 21 21:28:06 2022] GET /compute/v2.1/servers => generated 683 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:07.061909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-87a9cdad-0b5c-4cc6-9e38-f358f43d82c4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:07.065743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-87a9cdad-0b5c-4cc6-9e38-f358f43d82c4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:07.066425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.compute.servers [None req-87a9cdad-0b5c-4cc6-9e38-f358f43d82c4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Removing options 'limit' from query {{(pid=131278) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 21 21:28:07.067513 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-87a9cdad-0b5c-4cc6-9e38-f358f43d82c4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Searching by: {'deleted': False, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:28:07.078674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87a9cdad-0b5c-4cc6-9e38-f358f43d82c4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:07.081126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87a9cdad-0b5c-4cc6-9e38-f358f43d82c4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:07.082044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87a9cdad-0b5c-4cc6-9e38-f358f43d82c4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:07.082489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87a9cdad-0b5c-4cc6-9e38-f358f43d82c4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:07.102239 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2ad5847e-502a-41d0-be47-64386f46cb8c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:07.116861 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-87a9cdad-0b5c-4cc6-9e38-f358f43d82c4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:28:07.118961 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2ad5847e-502a-41d0-be47-64386f46cb8c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 200 len: 1508 microversion: 2.1 time: 0.338866 May 21 21:28:07.119669 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2129/4129] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:06 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 1508 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:07.136410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-09a244f9-1da8-4442-b849-bac7e63af1d0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:07.137420 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-09a244f9-1da8-4442-b849-bac7e63af1d0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:07.151562 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-87a9cdad-0b5c-4cc6-9e38-f358f43d82c4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.093460 May 21 21:28:07.159953 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2001/4130] 10.222.0.49 () {58 vars in 1143 bytes} [Sat May 21 21:28:07 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:07.166073 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-95f7ac5e-4119-4591-b8f4-0dcce6b2e0ac tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:07.170304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-09a244f9-1da8-4442-b849-bac7e63af1d0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-95f7ac5e-4119-4591-b8f4-0dcce6b2e0ac tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Request method failure captured: May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVlEmThi0akAWQKQccOJ2ym3yaLUnaIxzvp1h5f15BLZGCEgpNqFjHVNt6oorNEFvLurh5_EXmECIR9yx98ybJSgeh2IqYOs3MYqh20IKDfTzb4_u-wFr8sZBfmtVnL_s7LLPm5JrIExmQVes6PRZnrwS3LjgnOe9o0TG2gmXmbbCV4 May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 761c7e1ce4c04f1c88f5d770024ec589 May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_761c7e1ce4c04f1c88f5d770024ec589", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 761c7e1ce4c04f1c88f5d770024ec589 May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ListServersNegativeTestJSON-1740265434-project May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: a1c11eb375684c7f99d6b0fe06d35f7d May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ListServersNegativeTestJSON-1740265434-project May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: action_args: {} May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise error May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'minimum': 0, May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi On instance[0]: May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi '-1' May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 21 21:28:07.171072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 21 21:28:07.176237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:28:07.176237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:28:07.176237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:28:07.176237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:28:07.176237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 21 21:28:07.176237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:07.176237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:07.176237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:07.176237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:07.176237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:07.176237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:07.176237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:28:07.176237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:28:07.176237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 21 21:28:07.176237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:07.177299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-09a244f9-1da8-4442-b849-bac7e63af1d0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:07.177392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-95f7ac5e-4119-4591-b8f4-0dcce6b2e0ac tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:07.178061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-09a244f9-1da8-4442-b849-bac7e63af1d0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:07.178440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-09a244f9-1da8-4442-b849-bac7e63af1d0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:07.178854 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-95f7ac5e-4119-4591-b8f4-0dcce6b2e0ac tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.017598 May 21 21:28:07.183835 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2002/4131] 10.222.0.49 () {58 vars in 1141 bytes} [Sat May 21 21:28:07 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:28:07.185591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-74457ee4-2c52-486f-888e-704427f4dd28 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:07.186488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-74457ee4-2c52-486f-888e-704427f4dd28 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:07.199369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-74457ee4-2c52-486f-888e-704427f4dd28 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:07.199872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-74457ee4-2c52-486f-888e-704427f4dd28 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:07.200726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-74457ee4-2c52-486f-888e-704427f4dd28 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:07.201174 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-74457ee4-2c52-486f-888e-704427f4dd28 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:07.244633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-09a244f9-1da8-4442-b849-bac7e63af1d0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:28:07.492819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-74457ee4-2c52-486f-888e-704427f4dd28 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:07.502160 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-74457ee4-2c52-486f-888e-704427f4dd28 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1508 microversion: 2.1 time: 0.321223 May 21 21:28:07.517966 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2003/4132] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:07 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1508 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:07.525223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-25418a41-c4bf-47ed-bc67-d872cc741d1b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-25418a41-c4bf-47ed-bc67-d872cc741d1b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Request method failure captured: May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVlEmThi0akAWQKQccOJ2ym3yaLUnaIxzvp1h5f15BLZGCEgpNqFjHVNt6oorNEFvLurh5_EXmECIR9yx98ybJSgeh2IqYOs3MYqh20IKDfTzb4_u-wFr8sZBfmtVnL_s7LLPm5JrIExmQVes6PRZnrwS3LjgnOe9o0TG2gmXmbbCV4 May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 761c7e1ce4c04f1c88f5d770024ec589 May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_761c7e1ce4c04f1c88f5d770024ec589", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 761c7e1ce4c04f1c88f5d770024ec589 May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ListServersNegativeTestJSON-1740265434-project May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: a1c11eb375684c7f99d6b0fe06d35f7d May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ListServersNegativeTestJSON-1740265434-project May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: action_args: {} May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise error May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'minimum': 0, May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi On instance[0]: May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'testing' May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 21 21:28:07.528549 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 21 21:28:07.536086 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:28:07.536086 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:28:07.536086 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:28:07.536086 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:28:07.536086 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 21 21:28:07.536086 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:07.536086 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:07.536086 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:07.536086 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:07.536086 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:07.536086 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:07.536086 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:28:07.536086 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:28:07.536086 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 21 21:28:07.536086 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:07.536086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-25418a41-c4bf-47ed-bc67-d872cc741d1b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:07.536086 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-25418a41-c4bf-47ed-bc67-d872cc741d1b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.010117 May 21 21:28:07.536086 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2004/4133] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:28:07 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:28:07.539005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a5f8f9bb-ed4f-4832-8033-0c1990544849 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:07.539005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a5f8f9bb-ed4f-4832-8033-0c1990544849 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:07.693090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a5f8f9bb-ed4f-4832-8033-0c1990544849 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:07.693090 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a5f8f9bb-ed4f-4832-8033-0c1990544849 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1221 microversion: 2.1 time: 0.092450 May 21 21:28:07.693090 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2005/4134] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:07 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:07.693090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9a232e90-eb76-49f7-bc97-e080bce8dd83 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:07.693090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9a232e90-eb76-49f7-bc97-e080bce8dd83 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:07.693090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9a232e90-eb76-49f7-bc97-e080bce8dd83 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:28:07.693090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.compute.servers [None req-9a232e90-eb76-49f7-bc97-e080bce8dd83 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Flavor 'non_existing_flavor' could not be found {{(pid=131278) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} May 21 21:28:07.693090 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9a232e90-eb76-49f7-bc97-e080bce8dd83 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.023569 May 21 21:28:07.693090 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2006/4135] 10.222.0.49 () {58 vars in 1177 bytes} [Sat May 21 21:28:07 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:28:07.700804 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-11c4654d-a3be-4a95-8501-d76da8f2bfef tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:07.704534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-11c4654d-a3be-4a95-8501-d76da8f2bfef tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:07.705330 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-11c4654d-a3be-4a95-8501-d76da8f2bfef tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:28:07.711717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11c4654d-a3be-4a95-8501-d76da8f2bfef tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:07.712175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11c4654d-a3be-4a95-8501-d76da8f2bfef tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:07.713132 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11c4654d-a3be-4a95-8501-d76da8f2bfef tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:07.713665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11c4654d-a3be-4a95-8501-d76da8f2bfef tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:07.817379 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-11c4654d-a3be-4a95-8501-d76da8f2bfef tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.121039 May 21 21:28:07.818019 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2007/4136] 10.222.0.49 () {58 vars in 1173 bytes} [Sat May 21 21:28:07 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:28:07.831215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f41fb3ff-4d7d-494c-ab1b-38593b3f185b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:07.835890 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f41fb3ff-4d7d-494c-ab1b-38593b3f185b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:07.842503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f41fb3ff-4d7d-494c-ab1b-38593b3f185b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:28:07.842503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:07.853046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f41fb3ff-4d7d-494c-ab1b-38593b3f185b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:07.853772 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f41fb3ff-4d7d-494c-ab1b-38593b3f185b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:07.854792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f41fb3ff-4d7d-494c-ab1b-38593b3f185b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:07.855442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f41fb3ff-4d7d-494c-ab1b-38593b3f185b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:07.959555 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f41fb3ff-4d7d-494c-ab1b-38593b3f185b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.131154 May 21 21:28:07.959555 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2008/4137] 10.222.0.49 () {58 vars in 1183 bytes} [Sat May 21 21:28:07 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 21 21:28:07.974768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8b85aaa8-f32f-49a0-81c1-25d818802ecf tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:07.979445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8b85aaa8-f32f-49a0-81c1-25d818802ecf tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:07.980866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8b85aaa8-f32f-49a0-81c1-25d818802ecf tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Searching by: {'deleted': False, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:28:07.987727 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b85aaa8-f32f-49a0-81c1-25d818802ecf tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:07.988176 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b85aaa8-f32f-49a0-81c1-25d818802ecf tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:07.989030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b85aaa8-f32f-49a0-81c1-25d818802ecf tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:07.989464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b85aaa8-f32f-49a0-81c1-25d818802ecf tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:08.031511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-8b85aaa8-f32f-49a0-81c1-25d818802ecf tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:28:08.060098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:08.093139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8b85aaa8-f32f-49a0-81c1-25d818802ecf tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:08.101677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b85aaa8-f32f-49a0-81c1-25d818802ecf tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:08.102574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b85aaa8-f32f-49a0-81c1-25d818802ecf tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:08.273679 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-09a244f9-1da8-4442-b849-bac7e63af1d0 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 204 len: 0 microversion: 2.1 time: 1.139619 May 21 21:28:08.274250 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2130/4138] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:28:07 2022] DELETE /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 0 bytes in 1142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 21:28:08.417521 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8b85aaa8-f32f-49a0-81c1-25d818802ecf tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.444570 May 21 21:28:08.421293 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2009/4139] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:28:07 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:08.442712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-19ebe605-2a6f-4dce-965c-c6cd34831da4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:08.456656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-19ebe605-2a6f-4dce-965c-c6cd34831da4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:08.461037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-22c15c9c-b52d-42f9-aab1-641e6fff4ebd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1569214298", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "8fb93757-9e97-46e8-8606-ce5e5b5ae334"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:08.466145 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-19ebe605-2a6f-4dce-965c-c6cd34831da4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.027699 May 21 21:28:08.470241 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2131/4140] 10.222.0.49 () {58 vars in 1177 bytes} [Sat May 21 21:28:08 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:28:08.485338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e87444f8-c76b-4294-a93f-f8bf2fea405e tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:08.489300 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e87444f8-c76b-4294-a93f-f8bf2fea405e tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:08.490306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e87444f8-c76b-4294-a93f-f8bf2fea405e tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Searching by: {'deleted': False, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589'} {{(pid=131277) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:28:08.497012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e87444f8-c76b-4294-a93f-f8bf2fea405e tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:08.497732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e87444f8-c76b-4294-a93f-f8bf2fea405e tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:08.498751 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e87444f8-c76b-4294-a93f-f8bf2fea405e tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:08.499479 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e87444f8-c76b-4294-a93f-f8bf2fea405e tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:08.539588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.multi_cell_list [None req-e87444f8-c76b-4294-a93f-f8bf2fea405e tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131277) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:28:08.555415 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-22c15c9c-b52d-42f9-aab1-641e6fff4ebd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] validate_networks() for [('8fb93757-9e97-46e8-8606-ce5e5b5ae334', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:28:08.577497 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e87444f8-c76b-4294-a93f-f8bf2fea405e tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.096879 May 21 21:28:08.584785 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2132/4141] 10.222.0.49 () {58 vars in 1124 bytes} [Sat May 21 21:28:08 2022] GET /compute/v2.1/servers => generated 683 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:08.592054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5eabb6e7-f51c-440e-8532-8eae24d5b197 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:08.593124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5eabb6e7-f51c-440e-8532-8eae24d5b197 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:08.600108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5eabb6e7-f51c-440e-8532-8eae24d5b197 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:08.601393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5eabb6e7-f51c-440e-8532-8eae24d5b197 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:08.603084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5eabb6e7-f51c-440e-8532-8eae24d5b197 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:08.604142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5eabb6e7-f51c-440e-8532-8eae24d5b197 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:08.911446 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5eabb6e7-f51c-440e-8532-8eae24d5b197 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:08.932402 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5eabb6e7-f51c-440e-8532-8eae24d5b197 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1508 microversion: 2.1 time: 0.342705 May 21 21:28:08.934999 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2133/4142] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:08 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1508 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:08.946403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cdeb9f6a-40f8-4094-8cd3-d70ed0324ece tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:08.947047 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cdeb9f6a-40f8-4094-8cd3-d70ed0324ece tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: ba344601-c421-4d34-875e-70d22ffa8cc2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:08.959714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdeb9f6a-40f8-4094-8cd3-d70ed0324ece tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:08.960177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdeb9f6a-40f8-4094-8cd3-d70ed0324ece tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:08.962418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdeb9f6a-40f8-4094-8cd3-d70ed0324ece tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:08.962903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdeb9f6a-40f8-4094-8cd3-d70ed0324ece tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:08.994317 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-cdeb9f6a-40f8-4094-8cd3-d70ed0324ece tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] HTTP exception thrown: Instance ba344601-c421-4d34-875e-70d22ffa8cc2 could not be found. May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cdeb9f6a-40f8-4094-8cd3-d70ed0324ece tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Request method failure captured: May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/ba344601-c421-4d34-875e-70d22ffa8cc2 HTTP/1.1 May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVlEmThi0akAWQKQccOJ2ym3yaLUnaIxzvp1h5f15BLZGCEgpNqFjHVNt6oorNEFvLurh5_EXmECIR9yx98ybJSgeh2IqYOs3MYqh20IKDfTzb4_u-wFr8sZBfmtVnL_s7LLPm5JrIExmQVes6PRZnrwS3LjgnOe9o0TG2gmXmbbCV4 May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 761c7e1ce4c04f1c88f5d770024ec589 May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_761c7e1ce4c04f1c88f5d770024ec589", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 761c7e1ce4c04f1c88f5d770024ec589 May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ListServersNegativeTestJSON-1740265434-project May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a1c11eb375684c7f99d6b0fe06d35f7d May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ListServersNegativeTestJSON-1740265434-project May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance ba344601-c421-4d34-875e-70d22ffa8cc2 could not be found. May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'ba344601-c421-4d34-875e-70d22ffa8cc2'} May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba344601-c421-4d34-875e-70d22ffa8cc2 could not be found. May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:28:08.996986 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:28:09.006016 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba344601-c421-4d34-875e-70d22ffa8cc2 could not be found. May 21 21:28:09.006016 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:09.006016 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:09.006016 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:09.006016 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:09.006016 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:09.006016 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:09.006016 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:28:09.006016 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:28:09.006016 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba344601-c421-4d34-875e-70d22ffa8cc2 could not be found. May 21 21:28:09.006016 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:09.006016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cdeb9f6a-40f8-4094-8cd3-d70ed0324ece tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Returning 404 to user: Instance ba344601-c421-4d34-875e-70d22ffa8cc2 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:09.006016 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cdeb9f6a-40f8-4094-8cd3-d70ed0324ece tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ba344601-c421-4d34-875e-70d22ffa8cc2" status: 404 len: 111 microversion: 2.1 time: 0.061445 May 21 21:28:09.006016 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2134/4143] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:28:08 2022] DELETE /compute/v2.1/servers/ba344601-c421-4d34-875e-70d22ffa8cc2 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:28:09.010065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-85b5f907-ae15-4bbb-9c12-806a31ee6dcb tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:09.010904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-85b5f907-ae15-4bbb-9c12-806a31ee6dcb tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:09.017320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85b5f907-ae15-4bbb-9c12-806a31ee6dcb tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:09.017758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85b5f907-ae15-4bbb-9c12-806a31ee6dcb tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:09.018754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85b5f907-ae15-4bbb-9c12-806a31ee6dcb tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:09.019084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85b5f907-ae15-4bbb-9c12-806a31ee6dcb tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:09.205742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-85b5f907-ae15-4bbb-9c12-806a31ee6dcb tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:09.215456 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-85b5f907-ae15-4bbb-9c12-806a31ee6dcb tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1217 microversion: 2.1 time: 0.214665 May 21 21:28:09.230742 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2135/4144] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:08 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1217 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:09.233375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-22c15c9c-b52d-42f9-aab1-641e6fff4ebd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:28:09.237536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-22c15c9c-b52d-42f9-aab1-641e6fff4ebd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:28:09.237536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-22c15c9c-b52d-42f9-aab1-641e6fff4ebd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:28:09.237536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-22c15c9c-b52d-42f9-aab1-641e6fff4ebd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:28:09.237536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-22c15c9c-b52d-42f9-aab1-641e6fff4ebd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:28:09.237919 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f7ccc206-57ba-415e-b660-66d253ff59e4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:09.237919 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f7ccc206-57ba-415e-b660-66d253ff59e4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: 8542f670-5b21-4fda-abd5-6951efd387ed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:09.261077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7ccc206-57ba-415e-b660-66d253ff59e4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:09.261856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7ccc206-57ba-415e-b660-66d253ff59e4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:09.262895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7ccc206-57ba-415e-b660-66d253ff59e4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:09.264817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f7ccc206-57ba-415e-b660-66d253ff59e4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:09.273697 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22c15c9c-b52d-42f9-aab1-641e6fff4ebd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:09.277246 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22c15c9c-b52d-42f9-aab1-641e6fff4ebd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:09.279096 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22c15c9c-b52d-42f9-aab1-641e6fff4ebd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:09.281097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22c15c9c-b52d-42f9-aab1-641e6fff4ebd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:09.308899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-22c15c9c-b52d-42f9-aab1-641e6fff4ebd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Getting quotas for project a853a089c08b4fb288c1eb5ddcc30bbf. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:28:09.321054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-22c15c9c-b52d-42f9-aab1-641e6fff4ebd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Getting quotas for user cc14047fba5947198634f831b653fbad and project a853a089c08b4fb288c1eb5ddcc30bbf. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:28:09.337853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f7ccc206-57ba-415e-b660-66d253ff59e4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: 8542f670-5b21-4fda-abd5-6951efd387ed] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:28:09.359997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-22c15c9c-b52d-42f9-aab1-641e6fff4ebd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:28:09.370863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-22c15c9c-b52d-42f9-aab1-641e6fff4ebd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:28:09.650798 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-22c15c9c-b52d-42f9-aab1-641e6fff4ebd tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.204406 May 21 21:28:09.652897 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2010/4145] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:28:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 21 21:28:09.665898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-df991ca4-7e1d-4827-90e6-8f1c39b851d2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:09.666829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-df991ca4-7e1d-4827-90e6-8f1c39b851d2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:09.816972 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f7ccc206-57ba-415e-b660-66d253ff59e4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8542f670-5b21-4fda-abd5-6951efd387ed" status: 204 len: 0 microversion: 2.1 time: 0.584928 May 21 21:28:09.817737 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2136/4146] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:28:09 2022] DELETE /compute/v2.1/servers/8542f670-5b21-4fda-abd5-6951efd387ed => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:28:09.837773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6ab73f40-a1b4-4e0a-8131-24e31f39c3f4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:09.838642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6ab73f40-a1b4-4e0a-8131-24e31f39c3f4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: cfb31362-6254-457f-8612-86eeff56ddc9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:09.853670 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ab73f40-a1b4-4e0a-8131-24e31f39c3f4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:09.854307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ab73f40-a1b4-4e0a-8131-24e31f39c3f4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:09.855199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ab73f40-a1b4-4e0a-8131-24e31f39c3f4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:09.856777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ab73f40-a1b4-4e0a-8131-24e31f39c3f4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:09.877131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-df991ca4-7e1d-4827-90e6-8f1c39b851d2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:09.889836 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-df991ca4-7e1d-4827-90e6-8f1c39b851d2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1218 microversion: 2.1 time: 0.229307 May 21 21:28:09.895189 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2011/4147] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:09 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1218 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:09.940370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6ab73f40-a1b4-4e0a-8131-24e31f39c3f4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: cfb31362-6254-457f-8612-86eeff56ddc9] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:28:09.951523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f2d3250f-9341-4c1c-a170-78a1bd2dca9e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:09.952435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f2d3250f-9341-4c1c-a170-78a1bd2dca9e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:09.959251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2d3250f-9341-4c1c-a170-78a1bd2dca9e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:09.959708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2d3250f-9341-4c1c-a170-78a1bd2dca9e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:09.963499 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2d3250f-9341-4c1c-a170-78a1bd2dca9e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:09.964197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2d3250f-9341-4c1c-a170-78a1bd2dca9e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:10.175437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f2d3250f-9341-4c1c-a170-78a1bd2dca9e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:10.188886 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f2d3250f-9341-4c1c-a170-78a1bd2dca9e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1508 microversion: 2.1 time: 0.241590 May 21 21:28:10.191854 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2012/4148] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:09 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1508 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:10.246850 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9f8c9274-0b30-430a-b39f-0ee03c6c9598 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:10.248971 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9f8c9274-0b30-430a-b39f-0ee03c6c9598 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:10.262037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f8c9274-0b30-430a-b39f-0ee03c6c9598 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:10.264494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f8c9274-0b30-430a-b39f-0ee03c6c9598 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:10.265344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f8c9274-0b30-430a-b39f-0ee03c6c9598 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:10.266389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f8c9274-0b30-430a-b39f-0ee03c6c9598 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:10.327150 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6ab73f40-a1b4-4e0a-8131-24e31f39c3f4 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9" status: 204 len: 0 microversion: 2.1 time: 0.493940 May 21 21:28:10.328220 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2137/4149] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:28:09 2022] DELETE /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 21:28:10.337974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7c602b21-7c97-444d-8460-59834ba32a62 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:10.338692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7c602b21-7c97-444d-8460-59834ba32a62 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: ba344601-c421-4d34-875e-70d22ffa8cc2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:10.349536 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c602b21-7c97-444d-8460-59834ba32a62 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:10.350384 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c602b21-7c97-444d-8460-59834ba32a62 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:10.352352 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c602b21-7c97-444d-8460-59834ba32a62 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:10.352970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c602b21-7c97-444d-8460-59834ba32a62 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:10.370949 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-7c602b21-7c97-444d-8460-59834ba32a62 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] HTTP exception thrown: Instance ba344601-c421-4d34-875e-70d22ffa8cc2 could not be found. May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7c602b21-7c97-444d-8460-59834ba32a62 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Request method failure captured: May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/ba344601-c421-4d34-875e-70d22ffa8cc2 HTTP/1.1 May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVlEmThi0akAWQKQccOJ2ym3yaLUnaIxzvp1h5f15BLZGCEgpNqFjHVNt6oorNEFvLurh5_EXmECIR9yx98ybJSgeh2IqYOs3MYqh20IKDfTzb4_u-wFr8sZBfmtVnL_s7LLPm5JrIExmQVes6PRZnrwS3LjgnOe9o0TG2gmXmbbCV4 May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 761c7e1ce4c04f1c88f5d770024ec589 May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_761c7e1ce4c04f1c88f5d770024ec589", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 761c7e1ce4c04f1c88f5d770024ec589 May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ListServersNegativeTestJSON-1740265434-project May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a1c11eb375684c7f99d6b0fe06d35f7d May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ListServersNegativeTestJSON-1740265434-project May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance ba344601-c421-4d34-875e-70d22ffa8cc2 could not be found. May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'ba344601-c421-4d34-875e-70d22ffa8cc2'} May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba344601-c421-4d34-875e-70d22ffa8cc2 could not be found. May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba344601-c421-4d34-875e-70d22ffa8cc2 could not be found. May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:10.373177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:10.380807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:10.380807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:10.380807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:10.380807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:28:10.380807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:28:10.380807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba344601-c421-4d34-875e-70d22ffa8cc2 could not be found. May 21 21:28:10.380807 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:10.383068 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7c602b21-7c97-444d-8460-59834ba32a62 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Returning 404 to user: Instance ba344601-c421-4d34-875e-70d22ffa8cc2 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:10.389017 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7c602b21-7c97-444d-8460-59834ba32a62 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/ba344601-c421-4d34-875e-70d22ffa8cc2" status: 404 len: 111 microversion: 2.1 time: 0.051813 May 21 21:28:10.389017 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2138/4150] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:10 2022] GET /compute/v2.1/servers/ba344601-c421-4d34-875e-70d22ffa8cc2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:28:10.394018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-78a51c99-ebd9-4d01-bf98-912a0d976084 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:10.394638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-78a51c99-ebd9-4d01-bf98-912a0d976084 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: 8542f670-5b21-4fda-abd5-6951efd387ed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:10.403569 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78a51c99-ebd9-4d01-bf98-912a0d976084 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:10.405630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78a51c99-ebd9-4d01-bf98-912a0d976084 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:10.407461 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78a51c99-ebd9-4d01-bf98-912a0d976084 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:10.408593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78a51c99-ebd9-4d01-bf98-912a0d976084 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:10.442466 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9f8c9274-0b30-430a-b39f-0ee03c6c9598 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:10.454503 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9f8c9274-0b30-430a-b39f-0ee03c6c9598 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1281 microversion: 2.1 time: 0.220536 May 21 21:28:10.468668 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2013/4151] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:10 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1281 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:10.846554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-78a51c99-ebd9-4d01-bf98-912a0d976084 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:10.859558 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-78a51c99-ebd9-4d01-bf98-912a0d976084 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/8542f670-5b21-4fda-abd5-6951efd387ed" status: 200 len: 1522 microversion: 2.1 time: 0.466553 May 21 21:28:10.860497 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2139/4152] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:10 2022] GET /compute/v2.1/servers/8542f670-5b21-4fda-abd5-6951efd387ed => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:10.912215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e35804e5-f9f7-4fa7-a7f7-ddd450d6073b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:10.914088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e35804e5-f9f7-4fa7-a7f7-ddd450d6073b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:11.207900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a9b671ed-dae2-48b3-86e7-cebd28916d48 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:11.209355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a9b671ed-dae2-48b3-86e7-cebd28916d48 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:11.237091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9b671ed-dae2-48b3-86e7-cebd28916d48 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:11.238102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9b671ed-dae2-48b3-86e7-cebd28916d48 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:11.238873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9b671ed-dae2-48b3-86e7-cebd28916d48 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:11.239522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9b671ed-dae2-48b3-86e7-cebd28916d48 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:11.337309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e35804e5-f9f7-4fa7-a7f7-ddd450d6073b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:11.362404 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e35804e5-f9f7-4fa7-a7f7-ddd450d6073b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1218 microversion: 2.1 time: 0.453991 May 21 21:28:11.375118 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2014/4153] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:10 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1218 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:11.390802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-6bc684fb-3097-40ae-b0d0-eafff72bc0ba req-f8a54497-75d2-4372-a727-b61bbe41dfeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec44cb55-6eb8-4fa8-a028-81cebb81784b", "name": "network-vif-deleted", "tag": "82d3aaa4-7f3a-4649-9287-1aad4999a90c"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:11.410771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6bc684fb-3097-40ae-b0d0-eafff72bc0ba req-f8a54497-75d2-4372-a727-b61bbe41dfeb service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:11.416219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6bc684fb-3097-40ae-b0d0-eafff72bc0ba req-f8a54497-75d2-4372-a727-b61bbe41dfeb service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:11.443183 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-6bc684fb-3097-40ae-b0d0-eafff72bc0ba req-f8a54497-75d2-4372-a727-b61bbe41dfeb service nova] Creating event network-vif-deleted:82d3aaa4-7f3a-4649-9287-1aad4999a90c for instance ec44cb55-6eb8-4fa8-a028-81cebb81784b on nch1-master-1 May 21 21:28:11.451203 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-6bc684fb-3097-40ae-b0d0-eafff72bc0ba req-f8a54497-75d2-4372-a727-b61bbe41dfeb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069479 May 21 21:28:11.452455 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2015/4154] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:11.489008 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a12c0881-4e17-4c90-b5d7-556ce5503067 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:11.492453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a12c0881-4e17-4c90-b5d7-556ce5503067 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:11.501416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a12c0881-4e17-4c90-b5d7-556ce5503067 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:11.502134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a12c0881-4e17-4c90-b5d7-556ce5503067 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:11.503210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a12c0881-4e17-4c90-b5d7-556ce5503067 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:11.505873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a12c0881-4e17-4c90-b5d7-556ce5503067 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:11.817905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a9b671ed-dae2-48b3-86e7-cebd28916d48 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:11.833385 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a9b671ed-dae2-48b3-86e7-cebd28916d48 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1508 microversion: 2.1 time: 0.630205 May 21 21:28:11.838819 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2140/4155] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:11 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1508 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:11.842438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a12c0881-4e17-4c90-b5d7-556ce5503067 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:11.855943 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a12c0881-4e17-4c90-b5d7-556ce5503067 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1291 microversion: 2.1 time: 0.376999 May 21 21:28:11.876406 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2016/4156] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:11 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1291 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:11.882860 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fc9ca340-ddc4-475c-948f-0a8068b7ae97 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:11.884029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fc9ca340-ddc4-475c-948f-0a8068b7ae97 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: 8542f670-5b21-4fda-abd5-6951efd387ed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:11.905705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc9ca340-ddc4-475c-948f-0a8068b7ae97 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:11.906513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc9ca340-ddc4-475c-948f-0a8068b7ae97 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:11.907792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc9ca340-ddc4-475c-948f-0a8068b7ae97 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:11.908648 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc9ca340-ddc4-475c-948f-0a8068b7ae97 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:12.392559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b961b4fe-0db4-468a-bfac-df1ad3fd9af4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:12.396497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b961b4fe-0db4-468a-bfac-df1ad3fd9af4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:12.440947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b961b4fe-0db4-468a-bfac-df1ad3fd9af4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:12.445692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b961b4fe-0db4-468a-bfac-df1ad3fd9af4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:12.449888 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b961b4fe-0db4-468a-bfac-df1ad3fd9af4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:12.453944 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b961b4fe-0db4-468a-bfac-df1ad3fd9af4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:12.801063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b961b4fe-0db4-468a-bfac-df1ad3fd9af4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:12.821304 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b961b4fe-0db4-468a-bfac-df1ad3fd9af4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1214 microversion: 2.1 time: 0.434043 May 21 21:28:12.822012 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2017/4157] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:12 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1214 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:12.856067 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f6b7e0da-5961-4416-8342-089f2912f9ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:12.856807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f6b7e0da-5961-4416-8342-089f2912f9ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:12.870090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6b7e0da-5961-4416-8342-089f2912f9ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:12.870090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6b7e0da-5961-4416-8342-089f2912f9ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:12.870320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fc9ca340-ddc4-475c-948f-0a8068b7ae97 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:12.870815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6b7e0da-5961-4416-8342-089f2912f9ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:12.870815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6b7e0da-5961-4416-8342-089f2912f9ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:12.893405 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fc9ca340-ddc4-475c-948f-0a8068b7ae97 tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/8542f670-5b21-4fda-abd5-6951efd387ed" status: 200 len: 1522 microversion: 2.1 time: 1.019753 May 21 21:28:12.906724 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2141/4158] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:11 2022] GET /compute/v2.1/servers/8542f670-5b21-4fda-abd5-6951efd387ed => generated 1522 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:12.915380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-38dc8e6a-8259-4c8b-a97c-9381a47f9d04 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:12.916118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-38dc8e6a-8259-4c8b-a97c-9381a47f9d04 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:12.948356 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38dc8e6a-8259-4c8b-a97c-9381a47f9d04 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:12.949176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38dc8e6a-8259-4c8b-a97c-9381a47f9d04 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:12.950901 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38dc8e6a-8259-4c8b-a97c-9381a47f9d04 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:12.952688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38dc8e6a-8259-4c8b-a97c-9381a47f9d04 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:13.004405 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:13.176419 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-38dc8e6a-8259-4c8b-a97c-9381a47f9d04 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:13.189023 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-38dc8e6a-8259-4c8b-a97c-9381a47f9d04 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1279 microversion: 2.1 time: 0.290263 May 21 21:28:13.195476 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2142/4159] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:12 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1279 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:13.753576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-dedc1761-3bb8-4991-8862-5a190e20d2d3 req-8650e6a7-e558-4a6a-9420-cee8792d808c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfb31362-6254-457f-8612-86eeff56ddc9", "name": "network-vif-deleted", "tag": "486d9633-d9e9-4d01-a755-68d6b4b2236b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:13.775000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-dedc1761-3bb8-4991-8862-5a190e20d2d3 req-8650e6a7-e558-4a6a-9420-cee8792d808c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:13.775718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-dedc1761-3bb8-4991-8862-5a190e20d2d3 req-8650e6a7-e558-4a6a-9420-cee8792d808c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:13.802474 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-dedc1761-3bb8-4991-8862-5a190e20d2d3 req-8650e6a7-e558-4a6a-9420-cee8792d808c service nova] Creating event network-vif-deleted:486d9633-d9e9-4d01-a755-68d6b4b2236b for instance cfb31362-6254-457f-8612-86eeff56ddc9 on nch1-master-1 May 21 21:28:13.822201 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-dedc1761-3bb8-4991-8862-5a190e20d2d3 req-8650e6a7-e558-4a6a-9420-cee8792d808c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072616 May 21 21:28:13.823251 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2143/4160] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:28:13.845486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1a851e46-44d1-4405-b55a-7036aab2f8b3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:13.846422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1a851e46-44d1-4405-b55a-7036aab2f8b3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:13.861072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a851e46-44d1-4405-b55a-7036aab2f8b3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:13.861796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a851e46-44d1-4405-b55a-7036aab2f8b3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:13.865452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a851e46-44d1-4405-b55a-7036aab2f8b3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:13.865452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a851e46-44d1-4405-b55a-7036aab2f8b3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:14.029402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1a851e46-44d1-4405-b55a-7036aab2f8b3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:14.051164 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1a851e46-44d1-4405-b55a-7036aab2f8b3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1288 microversion: 2.1 time: 0.210085 May 21 21:28:14.065020 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2144/4161] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:13 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1288 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:14.069537 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f425bb40-ec29-4157-ac20-92444b8c4d6a tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:14.070724 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f425bb40-ec29-4157-ac20-92444b8c4d6a tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: 8542f670-5b21-4fda-abd5-6951efd387ed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:14.080874 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f425bb40-ec29-4157-ac20-92444b8c4d6a tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:14.082393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f425bb40-ec29-4157-ac20-92444b8c4d6a tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:14.084231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f425bb40-ec29-4157-ac20-92444b8c4d6a tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:14.085995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f425bb40-ec29-4157-ac20-92444b8c4d6a tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:14.468232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f425bb40-ec29-4157-ac20-92444b8c4d6a tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:14.483632 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f425bb40-ec29-4157-ac20-92444b8c4d6a tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/8542f670-5b21-4fda-abd5-6951efd387ed" status: 200 len: 1522 microversion: 2.1 time: 0.426450 May 21 21:28:14.484736 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2145/4162] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:14 2022] GET /compute/v2.1/servers/8542f670-5b21-4fda-abd5-6951efd387ed => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:14.498210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-09e425e3-75c8-4c56-a97f-81a46601ce22 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:14.500164 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-09e425e3-75c8-4c56-a97f-81a46601ce22 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:14.526699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-09e425e3-75c8-4c56-a97f-81a46601ce22 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:14.528395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-09e425e3-75c8-4c56-a97f-81a46601ce22 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:14.529675 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-09e425e3-75c8-4c56-a97f-81a46601ce22 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:14.530527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-09e425e3-75c8-4c56-a97f-81a46601ce22 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:14.587316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f6b7e0da-5961-4416-8342-089f2912f9ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:14.604961 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f6b7e0da-5961-4416-8342-089f2912f9ba tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1508 microversion: 2.1 time: 1.753863 May 21 21:28:14.606634 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2018/4163] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:12 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1508 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:14.726973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-09e425e3-75c8-4c56-a97f-81a46601ce22 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:14.740341 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-09e425e3-75c8-4c56-a97f-81a46601ce22 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1279 microversion: 2.1 time: 0.252142 May 21 21:28:14.740341 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2146/4164] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:14 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1279 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:15.074859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d5061eee-c3d1-423f-8581-a84de3c455d2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:15.075877 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d5061eee-c3d1-423f-8581-a84de3c455d2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:15.089725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5061eee-c3d1-423f-8581-a84de3c455d2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:15.091710 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5061eee-c3d1-423f-8581-a84de3c455d2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:15.093828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5061eee-c3d1-423f-8581-a84de3c455d2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:15.095494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5061eee-c3d1-423f-8581-a84de3c455d2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:15.270596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d5061eee-c3d1-423f-8581-a84de3c455d2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:15.312774 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d5061eee-c3d1-423f-8581-a84de3c455d2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1276 microversion: 2.1 time: 0.242708 May 21 21:28:15.332606 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2019/4165] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:15 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1276 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:15.493672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-0a70eee4-cc67-4601-a09e-c5a9c891481f req-86ac4ebc-7bd6-47d4-9d57-2e322ed76513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8542f670-5b21-4fda-abd5-6951efd387ed", "name": "network-vif-deleted", "tag": "ca346eef-6b59-4751-a9fe-482d287bd3d7"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:15.504922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b9c0290a-54ec-4f00-a040-f19de6119ddb tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:15.506655 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b9c0290a-54ec-4f00-a040-f19de6119ddb tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: 8542f670-5b21-4fda-abd5-6951efd387ed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:15.515128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-0a70eee4-cc67-4601-a09e-c5a9c891481f req-86ac4ebc-7bd6-47d4-9d57-2e322ed76513 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:15.515569 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-0a70eee4-cc67-4601-a09e-c5a9c891481f req-86ac4ebc-7bd6-47d4-9d57-2e322ed76513 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:15.522140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9c0290a-54ec-4f00-a040-f19de6119ddb tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:15.525122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9c0290a-54ec-4f00-a040-f19de6119ddb tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:15.526790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9c0290a-54ec-4f00-a040-f19de6119ddb tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:15.529088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9c0290a-54ec-4f00-a040-f19de6119ddb tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:15.538579 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-0a70eee4-cc67-4601-a09e-c5a9c891481f req-86ac4ebc-7bd6-47d4-9d57-2e322ed76513 service nova] Creating event network-vif-deleted:ca346eef-6b59-4751-a9fe-482d287bd3d7 for instance 8542f670-5b21-4fda-abd5-6951efd387ed on nch2-master-1 May 21 21:28:15.548987 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-0a70eee4-cc67-4601-a09e-c5a9c891481f req-86ac4ebc-7bd6-47d4-9d57-2e322ed76513 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060045 May 21 21:28:15.549616 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2147/4166] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:15.630265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e61931dd-84f1-4db2-b145-bbe68df21d8e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:15.632377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e61931dd-84f1-4db2-b145-bbe68df21d8e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:15.641278 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e61931dd-84f1-4db2-b145-bbe68df21d8e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:15.645904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e61931dd-84f1-4db2-b145-bbe68df21d8e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:15.645904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e61931dd-84f1-4db2-b145-bbe68df21d8e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:15.645904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e61931dd-84f1-4db2-b145-bbe68df21d8e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:15.738193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b9c0290a-54ec-4f00-a040-f19de6119ddb tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:15.764951 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b9c0290a-54ec-4f00-a040-f19de6119ddb tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/8542f670-5b21-4fda-abd5-6951efd387ed" status: 200 len: 1480 microversion: 2.1 time: 0.266508 May 21 21:28:15.769564 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2020/4167] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:15 2022] GET /compute/v2.1/servers/8542f670-5b21-4fda-abd5-6951efd387ed => generated 1480 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:15.781435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a9bc723a-0ece-480d-a972-a978a1dfaec6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:15.786088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a9bc723a-0ece-480d-a972-a978a1dfaec6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:15.814565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a9bc723a-0ece-480d-a972-a978a1dfaec6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:15.820590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a9bc723a-0ece-480d-a972-a978a1dfaec6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:15.829123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a9bc723a-0ece-480d-a972-a978a1dfaec6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:15.829123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a9bc723a-0ece-480d-a972-a978a1dfaec6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:15.957393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e61931dd-84f1-4db2-b145-bbe68df21d8e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:15.967237 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e61931dd-84f1-4db2-b145-bbe68df21d8e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1508 microversion: 2.1 time: 0.341352 May 21 21:28:15.977019 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2148/4168] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:15 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1508 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:16.337387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5dc6f2f6-0500-4d34-8b0b-a11e888da395 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:16.338338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5dc6f2f6-0500-4d34-8b0b-a11e888da395 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:16.374815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=14 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:16.380157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5dc6f2f6-0500-4d34-8b0b-a11e888da395 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:16.385542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5dc6f2f6-0500-4d34-8b0b-a11e888da395 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:16.385542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5dc6f2f6-0500-4d34-8b0b-a11e888da395 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:16.385542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5dc6f2f6-0500-4d34-8b0b-a11e888da395 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:16.646291 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5dc6f2f6-0500-4d34-8b0b-a11e888da395 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:16.692377 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5dc6f2f6-0500-4d34-8b0b-a11e888da395 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1276 microversion: 2.1 time: 0.360002 May 21 21:28:16.701963 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2149/4169] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:16 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1276 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:16.786384 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1a7a752b-74a7-44fd-85af-347752cab24b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:16.787820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1a7a752b-74a7-44fd-85af-347752cab24b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: 8542f670-5b21-4fda-abd5-6951efd387ed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:16.807485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a7a752b-74a7-44fd-85af-347752cab24b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:16.808171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a7a752b-74a7-44fd-85af-347752cab24b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:16.809318 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a7a752b-74a7-44fd-85af-347752cab24b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:16.809759 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a7a752b-74a7-44fd-85af-347752cab24b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:16.854653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a9bc723a-0ece-480d-a972-a978a1dfaec6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:16.874654 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a9bc723a-0ece-480d-a972-a978a1dfaec6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1321 microversion: 2.1 time: 1.103175 May 21 21:28:16.879630 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2021/4170] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:15 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1321 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:16.911741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a7a752b-74a7-44fd-85af-347752cab24b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:16.912506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a7a752b-74a7-44fd-85af-347752cab24b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:16.914407 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-1a7a752b-74a7-44fd-85af-347752cab24b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lazy-loading 'fault' on Instance uuid 8542f670-5b21-4fda-abd5-6951efd387ed {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:28:16.984641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1a7a752b-74a7-44fd-85af-347752cab24b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c11eb375684c7f99d6b0fe06d35f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761c7e1ce4c04f1c88f5d770024ec589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:16.985965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ca058737-be38-44f9-8e4b-0492f70457ac tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:16.986780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ca058737-be38-44f9-8e4b-0492f70457ac tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:16.995393 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1a7a752b-74a7-44fd-85af-347752cab24b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/8542f670-5b21-4fda-abd5-6951efd387ed" status: 200 len: 1313 microversion: 2.1 time: 0.212759 May 21 21:28:16.996324 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2150/4171] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:16 2022] GET /compute/v2.1/servers/8542f670-5b21-4fda-abd5-6951efd387ed => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:16.997966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca058737-be38-44f9-8e4b-0492f70457ac tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:16.998628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca058737-be38-44f9-8e4b-0492f70457ac tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:16.999422 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca058737-be38-44f9-8e4b-0492f70457ac tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:16.999867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca058737-be38-44f9-8e4b-0492f70457ac tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:17.495876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ca058737-be38-44f9-8e4b-0492f70457ac tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:17.507503 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ca058737-be38-44f9-8e4b-0492f70457ac tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1508 microversion: 2.1 time: 0.526038 May 21 21:28:17.534939 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2022/4172] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:16 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1508 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:17.719354 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ddd79285-4cea-415f-866d-951e1df6e32b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:17.719984 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ddd79285-4cea-415f-866d-951e1df6e32b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:17.730904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ddd79285-4cea-415f-866d-951e1df6e32b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:17.731368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ddd79285-4cea-415f-866d-951e1df6e32b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:17.732188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ddd79285-4cea-415f-866d-951e1df6e32b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:17.732654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ddd79285-4cea-415f-866d-951e1df6e32b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:17.902825 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-895bbde6-f4ef-46ec-9bb3-b0e9c2aa584d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:17.904456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-895bbde6-f4ef-46ec-9bb3-b0e9c2aa584d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:17.916394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-895bbde6-f4ef-46ec-9bb3-b0e9c2aa584d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:17.917991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-895bbde6-f4ef-46ec-9bb3-b0e9c2aa584d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:17.919750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-895bbde6-f4ef-46ec-9bb3-b0e9c2aa584d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:17.920730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-895bbde6-f4ef-46ec-9bb3-b0e9c2aa584d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:17.950813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ddd79285-4cea-415f-866d-951e1df6e32b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:17.959169 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ddd79285-4cea-415f-866d-951e1df6e32b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1318 microversion: 2.1 time: 0.244191 May 21 21:28:17.959767 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2151/4173] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:17 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:18.017201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7ef3fe14-0651-45e2-880c-b06231f83bfe tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:18.018108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7ef3fe14-0651-45e2-880c-b06231f83bfe tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: 8542f670-5b21-4fda-abd5-6951efd387ed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:18.040124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ef3fe14-0651-45e2-880c-b06231f83bfe tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:18.040737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ef3fe14-0651-45e2-880c-b06231f83bfe tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:18.041438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ef3fe14-0651-45e2-880c-b06231f83bfe tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:18.042068 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ef3fe14-0651-45e2-880c-b06231f83bfe tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:18.066823 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-7ef3fe14-0651-45e2-880c-b06231f83bfe tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] HTTP exception thrown: Instance 8542f670-5b21-4fda-abd5-6951efd387ed could not be found. May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7ef3fe14-0651-45e2-880c-b06231f83bfe tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Request method failure captured: May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/8542f670-5b21-4fda-abd5-6951efd387ed HTTP/1.1 May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVlEmThi0akAWQKQccOJ2ym3yaLUnaIxzvp1h5f15BLZGCEgpNqFjHVNt6oorNEFvLurh5_EXmECIR9yx98ybJSgeh2IqYOs3MYqh20IKDfTzb4_u-wFr8sZBfmtVnL_s7LLPm5JrIExmQVes6PRZnrwS3LjgnOe9o0TG2gmXmbbCV4 May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 761c7e1ce4c04f1c88f5d770024ec589 May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_761c7e1ce4c04f1c88f5d770024ec589", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 761c7e1ce4c04f1c88f5d770024ec589 May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ListServersNegativeTestJSON-1740265434-project May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a1c11eb375684c7f99d6b0fe06d35f7d May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ListServersNegativeTestJSON-1740265434-project May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 8542f670-5b21-4fda-abd5-6951efd387ed could not be found. May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '8542f670-5b21-4fda-abd5-6951efd387ed'} May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8542f670-5b21-4fda-abd5-6951efd387ed could not be found. May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8542f670-5b21-4fda-abd5-6951efd387ed could not be found. May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:18.068563 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:18.076825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:18.076825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:18.076825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:18.076825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:28:18.076825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:28:18.076825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8542f670-5b21-4fda-abd5-6951efd387ed could not be found. May 21 21:28:18.076825 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:18.076825 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7ef3fe14-0651-45e2-880c-b06231f83bfe tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Returning 404 to user: Instance 8542f670-5b21-4fda-abd5-6951efd387ed could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:18.076825 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7ef3fe14-0651-45e2-880c-b06231f83bfe tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/8542f670-5b21-4fda-abd5-6951efd387ed" status: 404 len: 111 microversion: 2.1 time: 0.057221 May 21 21:28:18.076825 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2152/4174] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:18 2022] GET /compute/v2.1/servers/8542f670-5b21-4fda-abd5-6951efd387ed => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:28:18.081510 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9cc83ee3-7bb9-40c5-b343-1c85c588288b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:18.082117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9cc83ee3-7bb9-40c5-b343-1c85c588288b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] [instance: cfb31362-6254-457f-8612-86eeff56ddc9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:18.089748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cc83ee3-7bb9-40c5-b343-1c85c588288b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:18.090209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cc83ee3-7bb9-40c5-b343-1c85c588288b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:18.091454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cc83ee3-7bb9-40c5-b343-1c85c588288b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:18.092124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cc83ee3-7bb9-40c5-b343-1c85c588288b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:18.109512 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-9cc83ee3-7bb9-40c5-b343-1c85c588288b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] HTTP exception thrown: Instance cfb31362-6254-457f-8612-86eeff56ddc9 could not be found. May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9cc83ee3-7bb9-40c5-b343-1c85c588288b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Request method failure captured: May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9 HTTP/1.1 May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVlEmThi0akAWQKQccOJ2ym3yaLUnaIxzvp1h5f15BLZGCEgpNqFjHVNt6oorNEFvLurh5_EXmECIR9yx98ybJSgeh2IqYOs3MYqh20IKDfTzb4_u-wFr8sZBfmtVnL_s7LLPm5JrIExmQVes6PRZnrwS3LjgnOe9o0TG2gmXmbbCV4 May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 761c7e1ce4c04f1c88f5d770024ec589 May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_761c7e1ce4c04f1c88f5d770024ec589", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/761c7e1ce4c04f1c88f5d770024ec589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 761c7e1ce4c04f1c88f5d770024ec589 May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1740265434 May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ListServersNegativeTestJSON-1740265434-project May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: a1c11eb375684c7f99d6b0fe06d35f7d May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ListServersNegativeTestJSON-1740265434-project May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance cfb31362-6254-457f-8612-86eeff56ddc9 could not be found. May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'cfb31362-6254-457f-8612-86eeff56ddc9'} May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfb31362-6254-457f-8612-86eeff56ddc9 could not be found. May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfb31362-6254-457f-8612-86eeff56ddc9 could not be found. May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:18.111392 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:18.116591 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:18.116591 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:18.116591 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:18.116591 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:28:18.116591 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:28:18.116591 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfb31362-6254-457f-8612-86eeff56ddc9 could not be found. May 21 21:28:18.116591 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:18.119155 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9cc83ee3-7bb9-40c5-b343-1c85c588288b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] Returning 404 to user: Instance cfb31362-6254-457f-8612-86eeff56ddc9 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:18.120232 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9cc83ee3-7bb9-40c5-b343-1c85c588288b tempest-ListServersNegativeTestJSON-1740265434 tempest-ListServersNegativeTestJSON-1740265434-project] 10.222.0.49 "GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9" status: 404 len: 111 microversion: 2.1 time: 0.044563 May 21 21:28:18.121458 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2153/4175] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:18 2022] GET /compute/v2.1/servers/cfb31362-6254-457f-8612-86eeff56ddc9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:28:18.433481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-895bbde6-f4ef-46ec-9bb3-b0e9c2aa584d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:18.444068 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-895bbde6-f4ef-46ec-9bb3-b0e9c2aa584d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1321 microversion: 2.1 time: 0.549651 May 21 21:28:18.455367 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2023/4176] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:17 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1321 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:18.539606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:18.543966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1b5e0972-ca44-49c6-b480-f2b38201280f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:18.544707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1b5e0972-ca44-49c6-b480-f2b38201280f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:18.562954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1b5e0972-ca44-49c6-b480-f2b38201280f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:18.562954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1b5e0972-ca44-49c6-b480-f2b38201280f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:18.562954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1b5e0972-ca44-49c6-b480-f2b38201280f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:18.562954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1b5e0972-ca44-49c6-b480-f2b38201280f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:18.923946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1b5e0972-ca44-49c6-b480-f2b38201280f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:18.943815 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1b5e0972-ca44-49c6-b480-f2b38201280f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1508 microversion: 2.1 time: 0.404242 May 21 21:28:18.947160 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2154/4177] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:18 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1508 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:18.977845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-63b31161-85db-4b49-8ac7-b3eae48ff9b4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:18.978467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-63b31161-85db-4b49-8ac7-b3eae48ff9b4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:18.993405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63b31161-85db-4b49-8ac7-b3eae48ff9b4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:18.994128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63b31161-85db-4b49-8ac7-b3eae48ff9b4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:18.995161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63b31161-85db-4b49-8ac7-b3eae48ff9b4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:18.996601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63b31161-85db-4b49-8ac7-b3eae48ff9b4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:19.299745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=14 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:19.390727 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-63b31161-85db-4b49-8ac7-b3eae48ff9b4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:19.415968 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-63b31161-85db-4b49-8ac7-b3eae48ff9b4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1318 microversion: 2.1 time: 0.440068 May 21 21:28:19.420515 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2024/4178] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:18 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:19.469653 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-984450cd-86fd-4627-b634-a160628c480b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:19.470596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-984450cd-86fd-4627-b634-a160628c480b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:19.481008 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-984450cd-86fd-4627-b634-a160628c480b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:19.481579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-984450cd-86fd-4627-b634-a160628c480b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:19.482579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-984450cd-86fd-4627-b634-a160628c480b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:19.483023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-984450cd-86fd-4627-b634-a160628c480b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:19.934023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-984450cd-86fd-4627-b634-a160628c480b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:19.934678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-2a293859-e47f-4ac7-8feb-c44df6594ead req-48fc971e-a95e-490e-9bc4-30e5a270a8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f75bc144-8ec2-4751-a77e-6c7c7fedaec9", "tag": "0f8ec84d-abf5-4980-bbd0-218e47cbcd38"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:19.955192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2a293859-e47f-4ac7-8feb-c44df6594ead req-48fc971e-a95e-490e-9bc4-30e5a270a8a6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:19.955886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2a293859-e47f-4ac7-8feb-c44df6594ead req-48fc971e-a95e-490e-9bc4-30e5a270a8a6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:19.957227 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-984450cd-86fd-4627-b634-a160628c480b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1321 microversion: 2.1 time: 0.499002 May 21 21:28:19.966891 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2155/4179] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:19 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1321 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:19.992770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-464a1f86-8979-4848-a0c8-34264b50afa9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:19.995489 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-2a293859-e47f-4ac7-8feb-c44df6594ead req-48fc971e-a95e-490e-9bc4-30e5a270a8a6 service nova] Creating event network-changed:0f8ec84d-abf5-4980-bbd0-218e47cbcd38 for instance f75bc144-8ec2-4751-a77e-6c7c7fedaec9 on nch2-master-1 May 21 21:28:20.001098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-464a1f86-8979-4848-a0c8-34264b50afa9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:20.010123 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-2a293859-e47f-4ac7-8feb-c44df6594ead req-48fc971e-a95e-490e-9bc4-30e5a270a8a6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079374 May 21 21:28:20.015673 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2025/4180] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:28:20.024110 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-464a1f86-8979-4848-a0c8-34264b50afa9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:20.024711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-464a1f86-8979-4848-a0c8-34264b50afa9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:20.027022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-464a1f86-8979-4848-a0c8-34264b50afa9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:20.030311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-464a1f86-8979-4848-a0c8-34264b50afa9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:20.308327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-464a1f86-8979-4848-a0c8-34264b50afa9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:20.321417 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-464a1f86-8979-4848-a0c8-34264b50afa9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1508 microversion: 2.1 time: 0.352784 May 21 21:28:20.322724 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2156/4181] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:19 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1508 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:20.437263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2faaeb46-7a61-4129-aa75-ef720c36f4c5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:20.438220 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2faaeb46-7a61-4129-aa75-ef720c36f4c5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:20.454168 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2faaeb46-7a61-4129-aa75-ef720c36f4c5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:20.462832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2faaeb46-7a61-4129-aa75-ef720c36f4c5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:20.464437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2faaeb46-7a61-4129-aa75-ef720c36f4c5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:20.465303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2faaeb46-7a61-4129-aa75-ef720c36f4c5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:20.984491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3a7c0a6f-2d68-477b-a130-cb23135b502c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:20.985227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3a7c0a6f-2d68-477b-a130-cb23135b502c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:20.994976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a7c0a6f-2d68-477b-a130-cb23135b502c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:21.004871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a7c0a6f-2d68-477b-a130-cb23135b502c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:21.008726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a7c0a6f-2d68-477b-a130-cb23135b502c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:21.009271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a7c0a6f-2d68-477b-a130-cb23135b502c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:21.357866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=16 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:21.403593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2faaeb46-7a61-4129-aa75-ef720c36f4c5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:21.419155 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2faaeb46-7a61-4129-aa75-ef720c36f4c5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1318 microversion: 2.1 time: 0.987538 May 21 21:28:21.431716 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2026/4182] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:20 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1318 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:21.437329 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d2314ca4-e9f8-43ac-ab49-776addcc51a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:21.438260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d2314ca4-e9f8-43ac-ab49-776addcc51a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:21.449186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2314ca4-e9f8-43ac-ab49-776addcc51a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:21.449945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2314ca4-e9f8-43ac-ab49-776addcc51a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:21.450968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2314ca4-e9f8-43ac-ab49-776addcc51a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:21.452562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2314ca4-e9f8-43ac-ab49-776addcc51a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:21.599673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3a7c0a6f-2d68-477b-a130-cb23135b502c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:21.611431 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3a7c0a6f-2d68-477b-a130-cb23135b502c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1321 microversion: 2.1 time: 0.631765 May 21 21:28:21.618476 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2157/4183] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:20 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1321 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:22.105844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-ffa3e881-a7b4-4e86-b769-d243746d7729 req-0fb75630-c98d-4fac-95f1-3d328e24223a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f4f714d-1397-4fc3-b48a-be38e5b921e5", "tag": "07cd555b-9a5e-4e33-b2a6-bef9f52b2628"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:22.132627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ffa3e881-a7b4-4e86-b769-d243746d7729 req-0fb75630-c98d-4fac-95f1-3d328e24223a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:22.133602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ffa3e881-a7b4-4e86-b769-d243746d7729 req-0fb75630-c98d-4fac-95f1-3d328e24223a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:22.154299 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-ffa3e881-a7b4-4e86-b769-d243746d7729 req-0fb75630-c98d-4fac-95f1-3d328e24223a service nova] Creating event network-changed:07cd555b-9a5e-4e33-b2a6-bef9f52b2628 for instance 3f4f714d-1397-4fc3-b48a-be38e5b921e5 on nch1-master-1 May 21 21:28:22.164719 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-ffa3e881-a7b4-4e86-b769-d243746d7729 req-0fb75630-c98d-4fac-95f1-3d328e24223a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062485 May 21 21:28:22.167779 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2158/4184] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:22.181361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d2314ca4-e9f8-43ac-ab49-776addcc51a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:22.199721 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d2314ca4-e9f8-43ac-ab49-776addcc51a1 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1508 microversion: 2.1 time: 0.765222 May 21 21:28:22.210095 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2027/4185] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:21 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1508 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:22.439080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a9ad3cd3-72d6-4142-a404-cd0a2715b43e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:22.440013 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a9ad3cd3-72d6-4142-a404-cd0a2715b43e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:22.448960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:22.455518 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9ad3cd3-72d6-4142-a404-cd0a2715b43e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:22.457967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9ad3cd3-72d6-4142-a404-cd0a2715b43e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:22.458855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9ad3cd3-72d6-4142-a404-cd0a2715b43e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:22.463114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9ad3cd3-72d6-4142-a404-cd0a2715b43e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:22.635072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d61fcc9b-4711-4e91-b2c0-dc1c8d0ee4aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:22.635663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d61fcc9b-4711-4e91-b2c0-dc1c8d0ee4aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:22.652352 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d61fcc9b-4711-4e91-b2c0-dc1c8d0ee4aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:22.653310 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d61fcc9b-4711-4e91-b2c0-dc1c8d0ee4aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:22.654312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d61fcc9b-4711-4e91-b2c0-dc1c8d0ee4aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:22.654933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d61fcc9b-4711-4e91-b2c0-dc1c8d0ee4aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:22.747086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a9ad3cd3-72d6-4142-a404-cd0a2715b43e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:22.756252 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a9ad3cd3-72d6-4142-a404-cd0a2715b43e tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1318 microversion: 2.1 time: 0.322319 May 21 21:28:22.767705 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2159/4186] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:22 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:23.206306 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d61fcc9b-4711-4e91-b2c0-dc1c8d0ee4aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:23.217796 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d61fcc9b-4711-4e91-b2c0-dc1c8d0ee4aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1321 microversion: 2.1 time: 0.586478 May 21 21:28:23.218022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e5a5fcf0-804a-4110-8ba1-03f44e04e309 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:23.218667 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e5a5fcf0-804a-4110-8ba1-03f44e04e309 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:23.238023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5a5fcf0-804a-4110-8ba1-03f44e04e309 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:23.238023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5a5fcf0-804a-4110-8ba1-03f44e04e309 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:23.241675 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2028/4187] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:22 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1321 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:23.242654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5a5fcf0-804a-4110-8ba1-03f44e04e309 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:23.244327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5a5fcf0-804a-4110-8ba1-03f44e04e309 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:23.494192 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e5a5fcf0-804a-4110-8ba1-03f44e04e309 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:23.504064 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e5a5fcf0-804a-4110-8ba1-03f44e04e309 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1508 microversion: 2.1 time: 0.290185 May 21 21:28:23.504821 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2160/4188] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:23 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1508 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:23.773650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d796389a-219d-4e50-81b1-9cebdfcb5e54 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:23.774274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d796389a-219d-4e50-81b1-9cebdfcb5e54 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:23.781577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d796389a-219d-4e50-81b1-9cebdfcb5e54 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:23.782329 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d796389a-219d-4e50-81b1-9cebdfcb5e54 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:23.783362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d796389a-219d-4e50-81b1-9cebdfcb5e54 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:23.784498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d796389a-219d-4e50-81b1-9cebdfcb5e54 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:24.242266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d1c0addc-882f-488e-a2ef-0c2e52a81027 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:24.244435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d1c0addc-882f-488e-a2ef-0c2e52a81027 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:24.250801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d1c0addc-882f-488e-a2ef-0c2e52a81027 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:24.251604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d1c0addc-882f-488e-a2ef-0c2e52a81027 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:24.252697 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d1c0addc-882f-488e-a2ef-0c2e52a81027 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:24.253377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d1c0addc-882f-488e-a2ef-0c2e52a81027 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:24.507264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d796389a-219d-4e50-81b1-9cebdfcb5e54 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:24.511682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d1c0addc-882f-488e-a2ef-0c2e52a81027 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:24.521126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:24.525428 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d1c0addc-882f-488e-a2ef-0c2e52a81027 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1321 microversion: 2.1 time: 0.287375 May 21 21:28:24.526099 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2161/4189] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:24 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:24.526257 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d796389a-219d-4e50-81b1-9cebdfcb5e54 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1318 microversion: 2.1 time: 0.756290 May 21 21:28:24.529972 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2029/4190] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:23 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1318 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:24.531826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3cf4da34-f45e-4d91-914d-b5eb05caf8f8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:24.532726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3cf4da34-f45e-4d91-914d-b5eb05caf8f8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:24.545312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3cf4da34-f45e-4d91-914d-b5eb05caf8f8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:24.545312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3cf4da34-f45e-4d91-914d-b5eb05caf8f8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:24.545312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3cf4da34-f45e-4d91-914d-b5eb05caf8f8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:24.545312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3cf4da34-f45e-4d91-914d-b5eb05caf8f8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:24.547092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:24.793298 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3cf4da34-f45e-4d91-914d-b5eb05caf8f8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:24.801599 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3cf4da34-f45e-4d91-914d-b5eb05caf8f8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1508 microversion: 2.1 time: 0.273539 May 21 21:28:24.802262 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2162/4191] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:24 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1508 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:25.544313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ea86a407-5195-47bf-afd6-89a7a4dcb3a1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:25.545138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ea86a407-5195-47bf-afd6-89a7a4dcb3a1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:25.545403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1a925da2-a78a-4e38-87d7-b75db815ddad tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:25.546344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1a925da2-a78a-4e38-87d7-b75db815ddad tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:25.555365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ea86a407-5195-47bf-afd6-89a7a4dcb3a1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:25.555828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ea86a407-5195-47bf-afd6-89a7a4dcb3a1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:25.556865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ea86a407-5195-47bf-afd6-89a7a4dcb3a1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:25.557307 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ea86a407-5195-47bf-afd6-89a7a4dcb3a1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:25.558594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a925da2-a78a-4e38-87d7-b75db815ddad tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:25.559057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a925da2-a78a-4e38-87d7-b75db815ddad tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:25.559839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a925da2-a78a-4e38-87d7-b75db815ddad tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:25.566528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a925da2-a78a-4e38-87d7-b75db815ddad tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:25.971735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1a925da2-a78a-4e38-87d7-b75db815ddad tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:25.987200 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1a925da2-a78a-4e38-87d7-b75db815ddad tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1318 microversion: 2.1 time: 0.445344 May 21 21:28:25.989215 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2163/4192] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:25 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:25.998684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-51a23c63-d392-438b-9a92-ef9e39d868d7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:26.000422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-51a23c63-d392-438b-9a92-ef9e39d868d7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:26.011065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-51a23c63-d392-438b-9a92-ef9e39d868d7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:26.013065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-51a23c63-d392-438b-9a92-ef9e39d868d7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:26.014904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-51a23c63-d392-438b-9a92-ef9e39d868d7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:26.016549 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-51a23c63-d392-438b-9a92-ef9e39d868d7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:26.026454 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ea86a407-5195-47bf-afd6-89a7a4dcb3a1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:26.052618 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ea86a407-5195-47bf-afd6-89a7a4dcb3a1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1321 microversion: 2.1 time: 0.511632 May 21 21:28:26.056251 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2030/4193] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:25 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1321 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:26.225533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-51a23c63-d392-438b-9a92-ef9e39d868d7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:26.236986 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-51a23c63-d392-438b-9a92-ef9e39d868d7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1505 microversion: 2.1 time: 0.245080 May 21 21:28:26.248531 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2164/4194] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:25 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:26.455189 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 21:28:26.455717 ncdv-master-1 devstack@n-api.service[131278]: Sat May 21 21:28:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 21:28:27.011308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c8a58716-6210-4222-b7a1-644b1f790ac2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:27.012782 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c8a58716-6210-4222-b7a1-644b1f790ac2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:27.020128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8a58716-6210-4222-b7a1-644b1f790ac2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:27.020891 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8a58716-6210-4222-b7a1-644b1f790ac2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:27.022444 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8a58716-6210-4222-b7a1-644b1f790ac2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:27.023164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8a58716-6210-4222-b7a1-644b1f790ac2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:27.074302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-853f692d-7e98-493b-9c8a-77a8bc54e5ba tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:27.075069 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-853f692d-7e98-493b-9c8a-77a8bc54e5ba tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:27.083452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-853f692d-7e98-493b-9c8a-77a8bc54e5ba tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:27.085337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-853f692d-7e98-493b-9c8a-77a8bc54e5ba tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:27.086673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-853f692d-7e98-493b-9c8a-77a8bc54e5ba tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:27.087739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-853f692d-7e98-493b-9c8a-77a8bc54e5ba tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:27.227864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c8a58716-6210-4222-b7a1-644b1f790ac2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:27.236367 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c8a58716-6210-4222-b7a1-644b1f790ac2 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1318 microversion: 2.1 time: 0.228924 May 21 21:28:27.237144 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2031/4195] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:27 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:27.258835 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2c6f1d8e-4ba6-488d-a6b4-c5288e9dc83a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:27.259837 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2c6f1d8e-4ba6-488d-a6b4-c5288e9dc83a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:27.273479 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c6f1d8e-4ba6-488d-a6b4-c5288e9dc83a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:27.273983 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c6f1d8e-4ba6-488d-a6b4-c5288e9dc83a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:27.275182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c6f1d8e-4ba6-488d-a6b4-c5288e9dc83a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:27.275402 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c6f1d8e-4ba6-488d-a6b4-c5288e9dc83a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:27.277204 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-853f692d-7e98-493b-9c8a-77a8bc54e5ba tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:27.285681 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-853f692d-7e98-493b-9c8a-77a8bc54e5ba tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1321 microversion: 2.1 time: 0.217002 May 21 21:28:27.286811 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2165/4196] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:27 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:27.455530 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2c6f1d8e-4ba6-488d-a6b4-c5288e9dc83a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:27.466553 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2c6f1d8e-4ba6-488d-a6b4-c5288e9dc83a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1505 microversion: 2.1 time: 0.213278 May 21 21:28:27.477331 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2032/4197] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:27 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:27.739802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b0ea7885-5027-48ff-82ce-8fa214cb8aab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-720775463", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "11fe2e39-92d6-489a-b328-14ade7fb9530"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:27.797379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-b0ea7885-5027-48ff-82ce-8fa214cb8aab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] validate_networks() for [('11fe2e39-92d6-489a-b328-14ade7fb9530', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:28:28.175937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-0da24705-065d-4bac-8754-b78938d8f642 req-81640c20-3198-48d3-87c2-b56ef919acf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f4f714d-1397-4fc3-b48a-be38e5b921e5", "name": "network-vif-plugged", "status": "completed", "tag": "07cd555b-9a5e-4e33-b2a6-bef9f52b2628"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:28.188965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0da24705-065d-4bac-8754-b78938d8f642 req-81640c20-3198-48d3-87c2-b56ef919acf7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:28.189633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0da24705-065d-4bac-8754-b78938d8f642 req-81640c20-3198-48d3-87c2-b56ef919acf7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:28.204667 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-0da24705-065d-4bac-8754-b78938d8f642 req-81640c20-3198-48d3-87c2-b56ef919acf7 service nova] Creating event network-vif-plugged:07cd555b-9a5e-4e33-b2a6-bef9f52b2628 for instance 3f4f714d-1397-4fc3-b48a-be38e5b921e5 on nch1-master-1 May 21 21:28:28.210102 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-0da24705-065d-4bac-8754-b78938d8f642 req-81640c20-3198-48d3-87c2-b56ef919acf7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037297 May 21 21:28:28.210720 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2033/4198] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:28:28.263847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0c69edb9-fb69-4626-9138-cefcdc74907c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:28.266042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0c69edb9-fb69-4626-9138-cefcdc74907c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:28.279741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c69edb9-fb69-4626-9138-cefcdc74907c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:28.283065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c69edb9-fb69-4626-9138-cefcdc74907c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:28.283967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c69edb9-fb69-4626-9138-cefcdc74907c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:28.284450 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c69edb9-fb69-4626-9138-cefcdc74907c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:28.506640 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0c69edb9-fb69-4626-9138-cefcdc74907c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:28.531769 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0c69edb9-fb69-4626-9138-cefcdc74907c tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1318 microversion: 2.1 time: 0.277492 May 21 21:28:28.545225 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2034/4199] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:28 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:28.553120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d04960f7-174b-4b16-a262-fc65e6d0865d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:28.556431 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d04960f7-174b-4b16-a262-fc65e6d0865d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:28.565787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d04960f7-174b-4b16-a262-fc65e6d0865d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:28.566683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d04960f7-174b-4b16-a262-fc65e6d0865d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:28.567947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d04960f7-174b-4b16-a262-fc65e6d0865d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:28.569185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d04960f7-174b-4b16-a262-fc65e6d0865d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:28.926650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d04960f7-174b-4b16-a262-fc65e6d0865d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:28.948550 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d04960f7-174b-4b16-a262-fc65e6d0865d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1321 microversion: 2.1 time: 0.401361 May 21 21:28:28.953892 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2035/4200] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:28 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1321 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:28.959495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-598bfbcc-e173-48e3-92b5-3663cd0a586f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:28.964826 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-598bfbcc-e173-48e3-92b5-3663cd0a586f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:28.971731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-598bfbcc-e173-48e3-92b5-3663cd0a586f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:28.972553 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-598bfbcc-e173-48e3-92b5-3663cd0a586f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:28.973613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-598bfbcc-e173-48e3-92b5-3663cd0a586f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:28.974366 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-598bfbcc-e173-48e3-92b5-3663cd0a586f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:29.074101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-b0ea7885-5027-48ff-82ce-8fa214cb8aab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:28:29.074564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-b0ea7885-5027-48ff-82ce-8fa214cb8aab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:28:29.074979 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-b0ea7885-5027-48ff-82ce-8fa214cb8aab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:28:29.075371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-b0ea7885-5027-48ff-82ce-8fa214cb8aab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:28:29.075997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-b0ea7885-5027-48ff-82ce-8fa214cb8aab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:28:29.116446 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0ea7885-5027-48ff-82ce-8fa214cb8aab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:29.116972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0ea7885-5027-48ff-82ce-8fa214cb8aab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:29.118095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0ea7885-5027-48ff-82ce-8fa214cb8aab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:29.118990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0ea7885-5027-48ff-82ce-8fa214cb8aab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:29.150046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-b0ea7885-5027-48ff-82ce-8fa214cb8aab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Getting quotas for project 4583f3b0962e47e7b7b73243db3b0d4a. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:28:29.157619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-b0ea7885-5027-48ff-82ce-8fa214cb8aab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Getting quotas for user 00c7728397914d8cbcba42d295d4c265 and project 4583f3b0962e47e7b7b73243db3b0d4a. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:28:29.173200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b0ea7885-5027-48ff-82ce-8fa214cb8aab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:28:29.175525 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b0ea7885-5027-48ff-82ce-8fa214cb8aab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:28:29.375870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-598bfbcc-e173-48e3-92b5-3663cd0a586f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:29.384594 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b0ea7885-5027-48ff-82ce-8fa214cb8aab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.828418 May 21 21:28:29.386286 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2166/4201] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:28:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:28:29.390331 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-598bfbcc-e173-48e3-92b5-3663cd0a586f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1505 microversion: 2.1 time: 0.435216 May 21 21:28:29.390931 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2036/4202] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:28 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1505 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:29.404838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-32065c27-5678-490e-ba8c-e717378135ed tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:29.405763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-32065c27-5678-490e-ba8c-e717378135ed tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:29.520369 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-32065c27-5678-490e-ba8c-e717378135ed tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c7728397914d8cbcba42d295d4c265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4583f3b0962e47e7b7b73243db3b0d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:29.534758 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-32065c27-5678-490e-ba8c-e717378135ed tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221" status: 200 len: 1216 microversion: 2.1 time: 0.141381 May 21 21:28:29.535826 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2167/4203] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:29 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221 => generated 1216 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:29.553803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8e6fbe8d-851c-421f-9e85-25c41bc37820 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:29.558884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8e6fbe8d-851c-421f-9e85-25c41bc37820 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:29.576853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e6fbe8d-851c-421f-9e85-25c41bc37820 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:29.577579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e6fbe8d-851c-421f-9e85-25c41bc37820 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:29.579620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e6fbe8d-851c-421f-9e85-25c41bc37820 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:29.585437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e6fbe8d-851c-421f-9e85-25c41bc37820 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:29.973630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-58677650-82f6-460f-a658-0ce3a5b7c3e7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:29.974565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-58677650-82f6-460f-a658-0ce3a5b7c3e7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:29.990271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-58677650-82f6-460f-a658-0ce3a5b7c3e7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:29.990733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-58677650-82f6-460f-a658-0ce3a5b7c3e7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:29.996346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-58677650-82f6-460f-a658-0ce3a5b7c3e7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:29.997460 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-58677650-82f6-460f-a658-0ce3a5b7c3e7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:30.079617 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8e6fbe8d-851c-421f-9e85-25c41bc37820 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:30.088715 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8e6fbe8d-851c-421f-9e85-25c41bc37820 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1318 microversion: 2.1 time: 0.539296 May 21 21:28:30.089563 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2037/4204] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:29 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:30.239910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-fd625ed4-0bcc-4ddd-90b8-d524bdfd651b req-143bdd70-dff4-4fbb-8e7b-9984d7dfd657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f75bc144-8ec2-4751-a77e-6c7c7fedaec9", "name": "network-vif-plugged", "status": "completed", "tag": "0f8ec84d-abf5-4980-bbd0-218e47cbcd38"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:30.260522 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-fd625ed4-0bcc-4ddd-90b8-d524bdfd651b req-143bdd70-dff4-4fbb-8e7b-9984d7dfd657 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:30.261271 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-fd625ed4-0bcc-4ddd-90b8-d524bdfd651b req-143bdd70-dff4-4fbb-8e7b-9984d7dfd657 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:30.291097 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-fd625ed4-0bcc-4ddd-90b8-d524bdfd651b req-143bdd70-dff4-4fbb-8e7b-9984d7dfd657 service nova] Creating event network-vif-plugged:0f8ec84d-abf5-4980-bbd0-218e47cbcd38 for instance f75bc144-8ec2-4751-a77e-6c7c7fedaec9 on nch2-master-1 May 21 21:28:30.303961 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-fd625ed4-0bcc-4ddd-90b8-d524bdfd651b req-143bdd70-dff4-4fbb-8e7b-9984d7dfd657 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067890 May 21 21:28:30.306404 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2038/4205] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:28:30.421639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-43efea72-a429-4d75-807f-3ab9011f4f5d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:30.425714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-43efea72-a429-4d75-807f-3ab9011f4f5d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:30.433571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-58677650-82f6-460f-a658-0ce3a5b7c3e7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:30.436333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-43efea72-a429-4d75-807f-3ab9011f4f5d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:30.437054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-43efea72-a429-4d75-807f-3ab9011f4f5d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:30.439164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-43efea72-a429-4d75-807f-3ab9011f4f5d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:30.439842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-43efea72-a429-4d75-807f-3ab9011f4f5d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:30.444341 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-58677650-82f6-460f-a658-0ce3a5b7c3e7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1321 microversion: 2.1 time: 0.476797 May 21 21:28:30.445200 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2168/4206] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:29 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1321 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:30.552131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cd90bda2-890d-4b3d-b6b3-4b11914fefbe tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:30.552885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cd90bda2-890d-4b3d-b6b3-4b11914fefbe tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:30.666788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cd90bda2-890d-4b3d-b6b3-4b11914fefbe tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c7728397914d8cbcba42d295d4c265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4583f3b0962e47e7b7b73243db3b0d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:30.676610 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cd90bda2-890d-4b3d-b6b3-4b11914fefbe tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221" status: 200 len: 1216 microversion: 2.1 time: 0.129158 May 21 21:28:30.678909 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2169/4207] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:30 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221 => generated 1216 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:30.796754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-43efea72-a429-4d75-807f-3ab9011f4f5d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:30.806793 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-43efea72-a429-4d75-807f-3ab9011f4f5d tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 200 len: 1448 microversion: 2.1 time: 0.402944 May 21 21:28:30.807393 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2039/4208] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:30 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 1448 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:30.831309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6069306d-090a-413f-990f-62580142ba61 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:30.831944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6069306d-090a-413f-990f-62580142ba61 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:30.856851 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6069306d-090a-413f-990f-62580142ba61 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:30.858904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6069306d-090a-413f-990f-62580142ba61 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:30.860041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6069306d-090a-413f-990f-62580142ba61 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:30.860799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6069306d-090a-413f-990f-62580142ba61 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:31.107719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-99e78e21-1cc4-4199-bcee-d062b6901398 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:31.108464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-99e78e21-1cc4-4199-bcee-d062b6901398 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:31.114885 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99e78e21-1cc4-4199-bcee-d062b6901398 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:31.116274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99e78e21-1cc4-4199-bcee-d062b6901398 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:31.117175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99e78e21-1cc4-4199-bcee-d062b6901398 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:31.117626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99e78e21-1cc4-4199-bcee-d062b6901398 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:31.135544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6069306d-090a-413f-990f-62580142ba61 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:31.144593 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6069306d-090a-413f-990f-62580142ba61 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.319546 May 21 21:28:31.145100 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2170/4209] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:30 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:31.167485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ee3e5443-1d17-4966-bd49-26207d49e9ef tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:31.168490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ee3e5443-1d17-4966-bd49-26207d49e9ef tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:31.184257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee3e5443-1d17-4966-bd49-26207d49e9ef tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:31.185090 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee3e5443-1d17-4966-bd49-26207d49e9ef tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:31.186344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee3e5443-1d17-4966-bd49-26207d49e9ef tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:31.187031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee3e5443-1d17-4966-bd49-26207d49e9ef tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:31.328662 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-99e78e21-1cc4-4199-bcee-d062b6901398 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:31.337432 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-99e78e21-1cc4-4199-bcee-d062b6901398 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1509 microversion: 2.1 time: 0.234381 May 21 21:28:31.338015 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2040/4210] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:31 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1509 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:31.354099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5e9d9949-e225-48db-aba1-15d6fe16b722 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:31.354834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5e9d9949-e225-48db-aba1-15d6fe16b722 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:31.363531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e9d9949-e225-48db-aba1-15d6fe16b722 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:31.364054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e9d9949-e225-48db-aba1-15d6fe16b722 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:31.365117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e9d9949-e225-48db-aba1-15d6fe16b722 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:31.365826 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e9d9949-e225-48db-aba1-15d6fe16b722 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:31.526434 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5e9d9949-e225-48db-aba1-15d6fe16b722 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:31.538325 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5e9d9949-e225-48db-aba1-15d6fe16b722 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1509 microversion: 2.1 time: 0.188663 May 21 21:28:31.538937 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2041/4211] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:31 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:31.543573 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8574729f-25c3-48d3-8271-dbb3b975ecb3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:31.544181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8574729f-25c3-48d3-8271-dbb3b975ecb3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:31.550595 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8574729f-25c3-48d3-8271-dbb3b975ecb3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:31.551140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8574729f-25c3-48d3-8271-dbb3b975ecb3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:31.558143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8574729f-25c3-48d3-8271-dbb3b975ecb3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:31.558143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8574729f-25c3-48d3-8271-dbb3b975ecb3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:31.704058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ee3e5443-1d17-4966-bd49-26207d49e9ef tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:31.714159 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ee3e5443-1d17-4966-bd49-26207d49e9ef tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.552014 May 21 21:28:31.717906 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2171/4212] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:31 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:31.723559 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-89a164f0-c93b-40e8-8fff-d60518d80ac5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:31.725988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-89a164f0-c93b-40e8-8fff-d60518d80ac5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:31.733465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89a164f0-c93b-40e8-8fff-d60518d80ac5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:31.734244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89a164f0-c93b-40e8-8fff-d60518d80ac5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:31.735379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89a164f0-c93b-40e8-8fff-d60518d80ac5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:31.736230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89a164f0-c93b-40e8-8fff-d60518d80ac5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:31.743996 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8574729f-25c3-48d3-8271-dbb3b975ecb3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:31.752202 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8574729f-25c3-48d3-8271-dbb3b975ecb3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1321 microversion: 2.1 time: 0.212231 May 21 21:28:31.752794 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2042/4213] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:31 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:31.758560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-af8b608a-cf9e-4b8f-a73b-8edac132c985 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:31.759593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-af8b608a-cf9e-4b8f-a73b-8edac132c985 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:31.766186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-af8b608a-cf9e-4b8f-a73b-8edac132c985 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:31.770117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-af8b608a-cf9e-4b8f-a73b-8edac132c985 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:31.770117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-af8b608a-cf9e-4b8f-a73b-8edac132c985 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:31.770117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-af8b608a-cf9e-4b8f-a73b-8edac132c985 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:31.872253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-af8b608a-cf9e-4b8f-a73b-8edac132c985 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c7728397914d8cbcba42d295d4c265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4583f3b0962e47e7b7b73243db3b0d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:31.884689 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-af8b608a-cf9e-4b8f-a73b-8edac132c985 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221" status: 200 len: 1212 microversion: 2.1 time: 0.130562 May 21 21:28:31.885681 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2043/4214] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:31 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221 => generated 1212 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:31.890751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c9761a45-7c1f-4022-8c9e-e6cbf8142cdf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:31.891663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c9761a45-7c1f-4022-8c9e-e6cbf8142cdf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:31.899059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9761a45-7c1f-4022-8c9e-e6cbf8142cdf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:31.907184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9761a45-7c1f-4022-8c9e-e6cbf8142cdf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:31.907184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9761a45-7c1f-4022-8c9e-e6cbf8142cdf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:31.907184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9761a45-7c1f-4022-8c9e-e6cbf8142cdf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:31.968724 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-89a164f0-c93b-40e8-8fff-d60518d80ac5 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "PUT /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1081 microversion: 2.1 time: 0.249110 May 21 21:28:31.978653 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2172/4215] 10.222.0.49 () {60 vars in 1255 bytes} [Sat May 21 21:28:31 2022] PUT /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1081 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:31.985979 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fbfdd930-cd6c-4aa4-8ba2-1ea5e6e1f638 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:31.986601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fbfdd930-cd6c-4aa4-8ba2-1ea5e6e1f638 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:31.992920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbfdd930-cd6c-4aa4-8ba2-1ea5e6e1f638 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:31.993370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbfdd930-cd6c-4aa4-8ba2-1ea5e6e1f638 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:31.994371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbfdd930-cd6c-4aa4-8ba2-1ea5e6e1f638 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:31.994810 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbfdd930-cd6c-4aa4-8ba2-1ea5e6e1f638 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:32.156428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fbfdd930-cd6c-4aa4-8ba2-1ea5e6e1f638 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:32.164665 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fbfdd930-cd6c-4aa4-8ba2-1ea5e6e1f638 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1507 microversion: 2.1 time: 0.184592 May 21 21:28:32.165246 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2173/4216] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:31 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:32.180857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-106d28c0-e2b2-4704-a4af-0ac20a561a6d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:32.181557 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-106d28c0-e2b2-4704-a4af-0ac20a561a6d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:32.183808 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c9761a45-7c1f-4022-8c9e-e6cbf8142cdf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:32.188128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-106d28c0-e2b2-4704-a4af-0ac20a561a6d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:32.188700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-106d28c0-e2b2-4704-a4af-0ac20a561a6d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:32.189577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-106d28c0-e2b2-4704-a4af-0ac20a561a6d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:32.190066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-106d28c0-e2b2-4704-a4af-0ac20a561a6d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:32.192665 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c9761a45-7c1f-4022-8c9e-e6cbf8142cdf tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.305690 May 21 21:28:32.194085 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2044/4217] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:31 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:32.210138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-04829a17-b2b7-40c7-9c53-4db368cbcec8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:32.211274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-04829a17-b2b7-40c7-9c53-4db368cbcec8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:32.217303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04829a17-b2b7-40c7-9c53-4db368cbcec8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:32.217692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04829a17-b2b7-40c7-9c53-4db368cbcec8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:32.218880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04829a17-b2b7-40c7-9c53-4db368cbcec8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:32.219332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04829a17-b2b7-40c7-9c53-4db368cbcec8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:32.375311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-106d28c0-e2b2-4704-a4af-0ac20a561a6d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:32.390861 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-106d28c0-e2b2-4704-a4af-0ac20a561a6d tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1507 microversion: 2.1 time: 0.213821 May 21 21:28:32.402266 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2174/4218] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:32 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1507 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:32.402266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-ea27b41f-b6a8-463b-946c-2e7995fea040 req-ade63c30-69b9-46e2-ad5d-d14299b30fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392d9064-09d6-4c79-819b-042ba6d6f70b", "name": "network-vif-unplugged", "status": "completed", "tag": "d2f57a10-249a-4c02-a14e-b9efad557114"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:32.425503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ea27b41f-b6a8-463b-946c-2e7995fea040 req-ade63c30-69b9-46e2-ad5d-d14299b30fc8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:32.425503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ea27b41f-b6a8-463b-946c-2e7995fea040 req-ade63c30-69b9-46e2-ad5d-d14299b30fc8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:32.439024 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.compute.server_external_events [req-ea27b41f-b6a8-463b-946c-2e7995fea040 req-ade63c30-69b9-46e2-ad5d-d14299b30fc8 service nova] Unable to find a host for instance 392d9064-09d6-4c79-819b-042ba6d6f70b. Dropping event network-vif-unplugged {{(pid=131277) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 21 21:28:32.440104 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-ea27b41f-b6a8-463b-946c-2e7995fea040 req-ade63c30-69b9-46e2-ad5d-d14299b30fc8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.046606 May 21 21:28:32.441728 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2175/4219] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 21 21:28:32.447947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bba6b8ef-7b37-43a0-940b-70a98c9be6fc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:32.454243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bba6b8ef-7b37-43a0-940b-70a98c9be6fc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:32.458226 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bba6b8ef-7b37-43a0-940b-70a98c9be6fc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:32.460645 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bba6b8ef-7b37-43a0-940b-70a98c9be6fc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:32.461570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bba6b8ef-7b37-43a0-940b-70a98c9be6fc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:32.462159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bba6b8ef-7b37-43a0-940b-70a98c9be6fc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:32.641277 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bba6b8ef-7b37-43a0-940b-70a98c9be6fc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "PUT /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1083 microversion: 2.1 time: 0.198117 May 21 21:28:32.652194 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2176/4220] 10.222.0.49 () {60 vars in 1255 bytes} [Sat May 21 21:28:32 2022] PUT /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1083 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:32.658920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d7a60d88-fdcb-430e-aa5e-8d41815bf196 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:32.659669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d7a60d88-fdcb-430e-aa5e-8d41815bf196 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:32.671428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7a60d88-fdcb-430e-aa5e-8d41815bf196 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:32.672007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7a60d88-fdcb-430e-aa5e-8d41815bf196 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:32.672948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7a60d88-fdcb-430e-aa5e-8d41815bf196 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:32.673706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7a60d88-fdcb-430e-aa5e-8d41815bf196 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:32.735600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-04829a17-b2b7-40c7-9c53-4db368cbcec8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:32.746654 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-04829a17-b2b7-40c7-9c53-4db368cbcec8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.539786 May 21 21:28:32.747884 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2045/4221] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:32 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:32.768178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b87526bf-3b07-4117-8595-0e512431d6e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:32.777646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b87526bf-3b07-4117-8595-0e512431d6e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:32.778729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b87526bf-3b07-4117-8595-0e512431d6e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:32.814507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b87526bf-3b07-4117-8595-0e512431d6e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Going to try to stop instance {{(pid=131278) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 21 21:28:32.937279 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d7a60d88-fdcb-430e-aa5e-8d41815bf196 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:32.948494 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d7a60d88-fdcb-430e-aa5e-8d41815bf196 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1509 microversion: 2.1 time: 0.294177 May 21 21:28:32.949278 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2177/4222] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:32 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1509 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:32.958726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b3ba57c2-b588-41db-839f-07c8675c9d90 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:32.963317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b3ba57c2-b588-41db-839f-07c8675c9d90 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:32.963476 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:32.967891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b3ba57c2-b588-41db-839f-07c8675c9d90 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:32.968389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b3ba57c2-b588-41db-839f-07c8675c9d90 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:32.969184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b3ba57c2-b588-41db-839f-07c8675c9d90 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:32.969681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b3ba57c2-b588-41db-839f-07c8675c9d90 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:33.087031 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b87526bf-3b07-4117-8595-0e512431d6e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action" status: 202 len: 0 microversion: 2.1 time: 0.326869 May 21 21:28:33.087597 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2046/4223] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:28:32 2022] POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:28:33.094010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-69918a31-52d9-425b-879e-c85e0c65e850 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:33.094726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-69918a31-52d9-425b-879e-c85e0c65e850 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:33.102195 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69918a31-52d9-425b-879e-c85e0c65e850 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:33.102663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69918a31-52d9-425b-879e-c85e0c65e850 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:33.104336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69918a31-52d9-425b-879e-c85e0c65e850 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:33.104336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69918a31-52d9-425b-879e-c85e0c65e850 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:33.266927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b3ba57c2-b588-41db-839f-07c8675c9d90 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:33.282521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-69918a31-52d9-425b-879e-c85e0c65e850 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c7728397914d8cbcba42d295d4c265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4583f3b0962e47e7b7b73243db3b0d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:33.285056 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b3ba57c2-b588-41db-839f-07c8675c9d90 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1502 microversion: 2.1 time: 0.334694 May 21 21:28:33.285656 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2178/4224] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:32 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1502 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:33.298321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9acfd1d0-dc04-4a32-b950-dcb7368f3db4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:33.299223 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9acfd1d0-dc04-4a32-b950-dcb7368f3db4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:33.309093 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-69918a31-52d9-425b-879e-c85e0c65e850 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221" status: 200 len: 1274 microversion: 2.1 time: 0.219154 May 21 21:28:33.310156 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2047/4225] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:33 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221 => generated 1274 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:33.313125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9acfd1d0-dc04-4a32-b950-dcb7368f3db4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:33.313125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9acfd1d0-dc04-4a32-b950-dcb7368f3db4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:33.313125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9acfd1d0-dc04-4a32-b950-dcb7368f3db4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:33.313620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9acfd1d0-dc04-4a32-b950-dcb7368f3db4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:33.331591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-db2b95ce-78c6-4914-9963-6e3ca265aac3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:33.334486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-db2b95ce-78c6-4914-9963-6e3ca265aac3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:33.341079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:33.343629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-db2b95ce-78c6-4914-9963-6e3ca265aac3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:33.344369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-db2b95ce-78c6-4914-9963-6e3ca265aac3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:33.345551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-db2b95ce-78c6-4914-9963-6e3ca265aac3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:33.346191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-db2b95ce-78c6-4914-9963-6e3ca265aac3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:33.576517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9acfd1d0-dc04-4a32-b950-dcb7368f3db4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:33.585614 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9acfd1d0-dc04-4a32-b950-dcb7368f3db4 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1509 microversion: 2.1 time: 0.298386 May 21 21:28:33.586944 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2179/4226] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:33 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1509 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:33.591150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3094ee2a-3e34-4712-be96-1c6a1ee6cb65 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:33.591846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3094ee2a-3e34-4712-be96-1c6a1ee6cb65 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:33.598992 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3094ee2a-3e34-4712-be96-1c6a1ee6cb65 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:33.600235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3094ee2a-3e34-4712-be96-1c6a1ee6cb65 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:33.601328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3094ee2a-3e34-4712-be96-1c6a1ee6cb65 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:33.602101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3094ee2a-3e34-4712-be96-1c6a1ee6cb65 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:33.916103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3094ee2a-3e34-4712-be96-1c6a1ee6cb65 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:33.920622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:33.925922 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3094ee2a-3e34-4712-be96-1c6a1ee6cb65 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1502 microversion: 2.1 time: 0.338255 May 21 21:28:33.926622 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2180/4227] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:33 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1502 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:33.933108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-da34ab3c-38df-47d4-acaf-8257acc596d3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:33.933882 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-da34ab3c-38df-47d4-acaf-8257acc596d3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:33.943968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da34ab3c-38df-47d4-acaf-8257acc596d3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:33.943968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da34ab3c-38df-47d4-acaf-8257acc596d3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:33.945646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da34ab3c-38df-47d4-acaf-8257acc596d3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:33.946241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da34ab3c-38df-47d4-acaf-8257acc596d3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:33.987638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-da34ab3c-38df-47d4-acaf-8257acc596d3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:28:34.009948 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-db2b95ce-78c6-4914-9963-6e3ca265aac3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:34.023413 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-db2b95ce-78c6-4914-9963-6e3ca265aac3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1678 microversion: 2.1 time: 0.710847 May 21 21:28:34.024534 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2048/4228] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:33 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1678 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:34.040219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a53c9c60-346d-4b25-b7ad-5bb05564b5de tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:34.041413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a53c9c60-346d-4b25-b7ad-5bb05564b5de tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:34.050221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a53c9c60-346d-4b25-b7ad-5bb05564b5de tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:34.051611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a53c9c60-346d-4b25-b7ad-5bb05564b5de tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:34.054404 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a53c9c60-346d-4b25-b7ad-5bb05564b5de tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:34.055499 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a53c9c60-346d-4b25-b7ad-5bb05564b5de tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:34.091632 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a53c9c60-346d-4b25-b7ad-5bb05564b5de tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:28:34.441195 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-da34ab3c-38df-47d4-acaf-8257acc596d3 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 204 len: 0 microversion: 2.1 time: 0.510860 May 21 21:28:34.442983 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2181/4229] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:28:33 2022] DELETE /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:28:34.455341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fb5965b7-3fae-41e6-acdf-65bf883290eb tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:34.456059 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fb5965b7-3fae-41e6-acdf-65bf883290eb tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:34.464686 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb5965b7-3fae-41e6-acdf-65bf883290eb tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:34.465383 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb5965b7-3fae-41e6-acdf-65bf883290eb tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:34.466393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb5965b7-3fae-41e6-acdf-65bf883290eb tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:34.467206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb5965b7-3fae-41e6-acdf-65bf883290eb tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:34.512762 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a53c9c60-346d-4b25-b7ad-5bb05564b5de tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 204 len: 0 microversion: 2.1 time: 0.482557 May 21 21:28:34.517289 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2049/4230] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:28:34 2022] DELETE /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:28:34.524865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-243ffe97-d648-4354-93c6-a0c18b41b580 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:34.525471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-243ffe97-d648-4354-93c6-a0c18b41b580 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:34.532072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-243ffe97-d648-4354-93c6-a0c18b41b580 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:34.533014 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-243ffe97-d648-4354-93c6-a0c18b41b580 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:34.533826 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-243ffe97-d648-4354-93c6-a0c18b41b580 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:34.534270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-243ffe97-d648-4354-93c6-a0c18b41b580 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:34.590663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-243ffe97-d648-4354-93c6-a0c18b41b580 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:28:34.716424 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fb5965b7-3fae-41e6-acdf-65bf883290eb tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c7728397914d8cbcba42d295d4c265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4583f3b0962e47e7b7b73243db3b0d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:34.724344 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fb5965b7-3fae-41e6-acdf-65bf883290eb tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221" status: 200 len: 1316 microversion: 2.1 time: 0.279190 May 21 21:28:34.725198 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2182/4231] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:34 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221 => generated 1316 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:34.729680 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-585494aa-efb6-48a0-b790-1fa5d778f5d3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:34.730282 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-585494aa-efb6-48a0-b790-1fa5d778f5d3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:34.736253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-585494aa-efb6-48a0-b790-1fa5d778f5d3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:34.736738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-585494aa-efb6-48a0-b790-1fa5d778f5d3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:34.737504 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-585494aa-efb6-48a0-b790-1fa5d778f5d3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:34.737941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-585494aa-efb6-48a0-b790-1fa5d778f5d3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:34.754612 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.compute.api [None req-243ffe97-d648-4354-93c6-a0c18b41b580 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Instance is already in deleting state, ignoring this request May 21 21:28:34.755703 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-243ffe97-d648-4354-93c6-a0c18b41b580 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 204 len: 0 microversion: 2.1 time: 0.237135 May 21 21:28:34.756993 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2050/4232] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:28:34 2022] DELETE /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:28:34.764874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-afcf5a2a-08d6-4379-9c5d-dd1b0ba5c070 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:34.765732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-afcf5a2a-08d6-4379-9c5d-dd1b0ba5c070 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:34.772493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-afcf5a2a-08d6-4379-9c5d-dd1b0ba5c070 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:34.776495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-afcf5a2a-08d6-4379-9c5d-dd1b0ba5c070 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:34.776495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-afcf5a2a-08d6-4379-9c5d-dd1b0ba5c070 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:34.776495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-afcf5a2a-08d6-4379-9c5d-dd1b0ba5c070 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:34.961477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-afcf5a2a-08d6-4379-9c5d-dd1b0ba5c070 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:34.972091 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-afcf5a2a-08d6-4379-9c5d-dd1b0ba5c070 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1515 microversion: 2.1 time: 0.210693 May 21 21:28:34.973653 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2051/4233] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:34 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1515 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:34.977677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-585494aa-efb6-48a0-b790-1fa5d778f5d3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:34.989496 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-585494aa-efb6-48a0-b790-1fa5d778f5d3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1508 microversion: 2.1 time: 0.263170 May 21 21:28:34.990140 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2183/4234] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:34 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1508 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:35.048091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fc8f7714-051a-4448-bf68-263c394931e7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:35.048091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fc8f7714-051a-4448-bf68-263c394931e7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:35.056150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc8f7714-051a-4448-bf68-263c394931e7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:35.056650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc8f7714-051a-4448-bf68-263c394931e7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:35.057439 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc8f7714-051a-4448-bf68-263c394931e7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:35.058051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc8f7714-051a-4448-bf68-263c394931e7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:35.210272 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fc8f7714-051a-4448-bf68-263c394931e7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:35.217817 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fc8f7714-051a-4448-bf68-263c394931e7 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1678 microversion: 2.1 time: 0.178586 May 21 21:28:35.218465 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2052/4235] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:35 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:35.742597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5c1ee9f1-bf83-4154-8d2b-387a5b0ed2c6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:35.743561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5c1ee9f1-bf83-4154-8d2b-387a5b0ed2c6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:35.751424 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c1ee9f1-bf83-4154-8d2b-387a5b0ed2c6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:35.752411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c1ee9f1-bf83-4154-8d2b-387a5b0ed2c6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:35.753453 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c1ee9f1-bf83-4154-8d2b-387a5b0ed2c6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:35.754108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c1ee9f1-bf83-4154-8d2b-387a5b0ed2c6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:35.992591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8d559a8c-21fc-4a24-85a5-e6d7135a0b15 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:35.993277 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8d559a8c-21fc-4a24-85a5-e6d7135a0b15 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:36.002481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d559a8c-21fc-4a24-85a5-e6d7135a0b15 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:36.003415 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d559a8c-21fc-4a24-85a5-e6d7135a0b15 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:36.004489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d559a8c-21fc-4a24-85a5-e6d7135a0b15 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:36.005102 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d559a8c-21fc-4a24-85a5-e6d7135a0b15 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:36.090951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5c1ee9f1-bf83-4154-8d2b-387a5b0ed2c6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c7728397914d8cbcba42d295d4c265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4583f3b0962e47e7b7b73243db3b0d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:36.106581 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5c1ee9f1-bf83-4154-8d2b-387a5b0ed2c6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221" status: 200 len: 1316 microversion: 2.1 time: 0.365252 May 21 21:28:36.117471 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2184/4236] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:35 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221 => generated 1316 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:36.133094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f3e1e4f2-a346-4900-866f-f6b8ac0a140c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:36.133094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f3e1e4f2-a346-4900-866f-f6b8ac0a140c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:36.143603 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3e1e4f2-a346-4900-866f-f6b8ac0a140c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:36.144036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3e1e4f2-a346-4900-866f-f6b8ac0a140c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:36.145135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3e1e4f2-a346-4900-866f-f6b8ac0a140c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:36.146320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3e1e4f2-a346-4900-866f-f6b8ac0a140c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:36.429929 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8d559a8c-21fc-4a24-85a5-e6d7135a0b15 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:36.442300 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8d559a8c-21fc-4a24-85a5-e6d7135a0b15 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1515 microversion: 2.1 time: 0.454884 May 21 21:28:36.447511 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2053/4237] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:35 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1515 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:36.452976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b77b6327-c4e2-433e-bc02-fccab5c64a24 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:36.455234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b77b6327-c4e2-433e-bc02-fccab5c64a24 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:36.467185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b77b6327-c4e2-433e-bc02-fccab5c64a24 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:36.467902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b77b6327-c4e2-433e-bc02-fccab5c64a24 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:36.481603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b77b6327-c4e2-433e-bc02-fccab5c64a24 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:36.481603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b77b6327-c4e2-433e-bc02-fccab5c64a24 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:36.521194 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f3e1e4f2-a346-4900-866f-f6b8ac0a140c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:36.529466 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f3e1e4f2-a346-4900-866f-f6b8ac0a140c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1508 microversion: 2.1 time: 0.414363 May 21 21:28:36.530432 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2185/4238] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:36 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1508 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:36.536535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9f8df9cc-14ee-45e7-8365-d0c88cf5ffcf tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:36.537861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9f8df9cc-14ee-45e7-8365-d0c88cf5ffcf tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:36.544487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f8df9cc-14ee-45e7-8365-d0c88cf5ffcf tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:36.545274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f8df9cc-14ee-45e7-8365-d0c88cf5ffcf tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:36.546890 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f8df9cc-14ee-45e7-8365-d0c88cf5ffcf tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:36.547620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f8df9cc-14ee-45e7-8365-d0c88cf5ffcf tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:36.617203 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9f8df9cc-14ee-45e7-8365-d0c88cf5ffcf tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "POST /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac/action" status: 200 len: 32498 microversion: 2.42 time: 0.085036 May 21 21:28:36.619528 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2186/4239] 10.222.0.49 () {62 vars in 1318 bytes} [Sat May 21 21:28:36 2022] POST /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac/action => generated 32498 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 21 21:28:36.637749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-800a5194-e511-478a-829d-fa1ed42f832f tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:36.638432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-800a5194-e511-478a-829d-fa1ed42f832f tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:36.647057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-800a5194-e511-478a-829d-fa1ed42f832f tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:36.647598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-800a5194-e511-478a-829d-fa1ed42f832f tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:36.650858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-800a5194-e511-478a-829d-fa1ed42f832f tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:36.650858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-800a5194-e511-478a-829d-fa1ed42f832f tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:36.691158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-800a5194-e511-478a-829d-fa1ed42f832f tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:28:36.864142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b77b6327-c4e2-433e-bc02-fccab5c64a24 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:36.872810 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b77b6327-c4e2-433e-bc02-fccab5c64a24 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1678 microversion: 2.1 time: 0.428607 May 21 21:28:36.873712 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2054/4240] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:36 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1678 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:37.026943 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-800a5194-e511-478a-829d-fa1ed42f832f tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "DELETE /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 204 len: 0 microversion: 2.42 time: 0.394823 May 21 21:28:37.027724 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2187/4241] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:28:36 2022] DELETE /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 21 21:28:37.036780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dd656250-6b47-4221-912a-1dd0c0b21512 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:37.039164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dd656250-6b47-4221-912a-1dd0c0b21512 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:37.047032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd656250-6b47-4221-912a-1dd0c0b21512 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:37.047612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd656250-6b47-4221-912a-1dd0c0b21512 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:37.048676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd656250-6b47-4221-912a-1dd0c0b21512 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:37.049431 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd656250-6b47-4221-912a-1dd0c0b21512 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:37.094871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-d546c4ca-bb68-4816-b922-e834f966a7bb req-17ec0c91-b4b8-48ce-9613-3a1cd506db0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f4f714d-1397-4fc3-b48a-be38e5b921e5", "name": "network-vif-deleted", "tag": "07cd555b-9a5e-4e33-b2a6-bef9f52b2628"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:37.111127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d546c4ca-bb68-4816-b922-e834f966a7bb req-17ec0c91-b4b8-48ce-9613-3a1cd506db0a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:37.112172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d546c4ca-bb68-4816-b922-e834f966a7bb req-17ec0c91-b4b8-48ce-9613-3a1cd506db0a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:37.132379 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-d546c4ca-bb68-4816-b922-e834f966a7bb req-17ec0c91-b4b8-48ce-9613-3a1cd506db0a service nova] Creating event network-vif-deleted:07cd555b-9a5e-4e33-b2a6-bef9f52b2628 for instance 3f4f714d-1397-4fc3-b48a-be38e5b921e5 on nch1-master-1 May 21 21:28:37.137883 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-d546c4ca-bb68-4816-b922-e834f966a7bb req-17ec0c91-b4b8-48ce-9613-3a1cd506db0a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050013 May 21 21:28:37.143292 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2188/4242] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:28:37.149686 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-148e33d6-98a2-40f1-b28c-c670d9d8eb81 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:37.160821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-148e33d6-98a2-40f1-b28c-c670d9d8eb81 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:37.170210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-148e33d6-98a2-40f1-b28c-c670d9d8eb81 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:37.170937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-148e33d6-98a2-40f1-b28c-c670d9d8eb81 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:37.171927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-148e33d6-98a2-40f1-b28c-c670d9d8eb81 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:37.172562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-148e33d6-98a2-40f1-b28c-c670d9d8eb81 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:37.473498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-148e33d6-98a2-40f1-b28c-c670d9d8eb81 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c7728397914d8cbcba42d295d4c265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4583f3b0962e47e7b7b73243db3b0d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:37.482673 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-148e33d6-98a2-40f1-b28c-c670d9d8eb81 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221" status: 200 len: 1316 microversion: 2.1 time: 0.338073 May 21 21:28:37.487108 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2189/4243] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:37 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221 => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:37.492144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-91266f08-dc6e-4404-a3c4-67e61a557a8a req-d8085036-047e-4200-a4f7-548bc6c72e08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6a45a12-08af-442d-b526-cf5f30594221", "tag": "eba143c2-fb38-49dc-acaf-06425d78f15c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:37.502386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-91266f08-dc6e-4404-a3c4-67e61a557a8a req-d8085036-047e-4200-a4f7-548bc6c72e08 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:37.503109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-91266f08-dc6e-4404-a3c4-67e61a557a8a req-d8085036-047e-4200-a4f7-548bc6c72e08 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:37.515512 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-91266f08-dc6e-4404-a3c4-67e61a557a8a req-d8085036-047e-4200-a4f7-548bc6c72e08 service nova] Creating event network-changed:eba143c2-fb38-49dc-acaf-06425d78f15c for instance f6a45a12-08af-442d-b526-cf5f30594221 on nch1-master-1 May 21 21:28:37.522099 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-91266f08-dc6e-4404-a3c4-67e61a557a8a req-d8085036-047e-4200-a4f7-548bc6c72e08 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032527 May 21 21:28:37.523164 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2190/4244] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:37.530928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f4996d2d-7b6c-450e-8391-d06f6c5395fc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:37.531800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f4996d2d-7b6c-450e-8391-d06f6c5395fc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:37.540182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4996d2d-7b6c-450e-8391-d06f6c5395fc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:37.540964 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4996d2d-7b6c-450e-8391-d06f6c5395fc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:37.542032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4996d2d-7b6c-450e-8391-d06f6c5395fc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:37.545862 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4996d2d-7b6c-450e-8391-d06f6c5395fc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:37.586065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4996d2d-7b6c-450e-8391-d06f6c5395fc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:37.586530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4996d2d-7b6c-450e-8391-d06f6c5395fc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:37.587027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-f4996d2d-7b6c-450e-8391-d06f6c5395fc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lazy-loading 'fault' on Instance uuid 3f4f714d-1397-4fc3-b48a-be38e5b921e5 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:28:37.597576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dd656250-6b47-4221-912a-1dd0c0b21512 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:37.608929 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dd656250-6b47-4221-912a-1dd0c0b21512 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:37.610779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dd656250-6b47-4221-912a-1dd0c0b21512 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:37.612340 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dd656250-6b47-4221-912a-1dd0c0b21512 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 2960 microversion: 2.42 time: 0.580180 May 21 21:28:37.613757 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2055/4245] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:28:37 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 2960 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:28:37.620819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f573d010-fc76-4a23-9751-ac00c280bece tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:37.622566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f573d010-fc76-4a23-9751-ac00c280bece tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:37.639921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f573d010-fc76-4a23-9751-ac00c280bece tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:37.639921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f573d010-fc76-4a23-9751-ac00c280bece tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:37.639921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f573d010-fc76-4a23-9751-ac00c280bece tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:37.639921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f573d010-fc76-4a23-9751-ac00c280bece tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:37.697758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f4996d2d-7b6c-450e-8391-d06f6c5395fc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14047fba5947198634f831b653fbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a853a089c08b4fb288c1eb5ddcc30bbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:37.706060 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f4996d2d-7b6c-450e-8391-d06f6c5395fc tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 200 len: 1308 microversion: 2.1 time: 0.180513 May 21 21:28:37.706878 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2191/4246] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:37 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 1308 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:37.714672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f573d010-fc76-4a23-9751-ac00c280bece tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:37.721980 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f573d010-fc76-4a23-9751-ac00c280bece tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 200 len: 1466 microversion: 2.1 time: 0.105414 May 21 21:28:37.722556 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2056/4247] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:37 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 1466 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:37.890196 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7b538d18-1eae-4f7d-852c-fe081eefd123 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:37.891105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7b538d18-1eae-4f7d-852c-fe081eefd123 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:37.898462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7b538d18-1eae-4f7d-852c-fe081eefd123 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:37.899169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7b538d18-1eae-4f7d-852c-fe081eefd123 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:37.899946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7b538d18-1eae-4f7d-852c-fe081eefd123 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:37.900420 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7b538d18-1eae-4f7d-852c-fe081eefd123 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:38.138733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7b538d18-1eae-4f7d-852c-fe081eefd123 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:38.151283 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7b538d18-1eae-4f7d-852c-fe081eefd123 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1678 microversion: 2.1 time: 0.264982 May 21 21:28:38.153719 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2192/4248] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:37 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1678 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:38.500064 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1f822c05-014d-469a-9f25-ad6df8c494ab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:38.500721 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1f822c05-014d-469a-9f25-ad6df8c494ab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:38.509463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f822c05-014d-469a-9f25-ad6df8c494ab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:38.510045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f822c05-014d-469a-9f25-ad6df8c494ab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:38.511057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f822c05-014d-469a-9f25-ad6df8c494ab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:38.511590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f822c05-014d-469a-9f25-ad6df8c494ab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:38.633806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ffc7d7b4-6fbd-4c03-97e7-5ee5eaafed15 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:38.634644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ffc7d7b4-6fbd-4c03-97e7-5ee5eaafed15 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:38.638458 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:38.646767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffc7d7b4-6fbd-4c03-97e7-5ee5eaafed15 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:38.648616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffc7d7b4-6fbd-4c03-97e7-5ee5eaafed15 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:38.652904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffc7d7b4-6fbd-4c03-97e7-5ee5eaafed15 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:38.653744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffc7d7b4-6fbd-4c03-97e7-5ee5eaafed15 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:38.938072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1f822c05-014d-469a-9f25-ad6df8c494ab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c7728397914d8cbcba42d295d4c265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4583f3b0962e47e7b7b73243db3b0d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:38.946751 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1f822c05-014d-469a-9f25-ad6df8c494ab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221" status: 200 len: 1316 microversion: 2.1 time: 0.450637 May 21 21:28:38.954218 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2057/4249] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:38 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221 => generated 1316 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:38.964237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ca7d41c0-a7ca-4f68-aaec-bd53ab6b260b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:38.964895 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ca7d41c0-a7ca-4f68-aaec-bd53ab6b260b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 3f4f714d-1397-4fc3-b48a-be38e5b921e5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:38.971781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca7d41c0-a7ca-4f68-aaec-bd53ab6b260b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:38.972491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca7d41c0-a7ca-4f68-aaec-bd53ab6b260b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:38.973587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca7d41c0-a7ca-4f68-aaec-bd53ab6b260b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:38.974323 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca7d41c0-a7ca-4f68-aaec-bd53ab6b260b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:38.981289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ffc7d7b4-6fbd-4c03-97e7-5ee5eaafed15 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:38.989333 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-ca7d41c0-a7ca-4f68-aaec-bd53ab6b260b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] HTTP exception thrown: Instance 3f4f714d-1397-4fc3-b48a-be38e5b921e5 could not be found. May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ca7d41c0-a7ca-4f68-aaec-bd53ab6b260b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Request method failure captured: May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 HTTP/1.1 May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVj1ZRvbW22tj9pVQuVcr0Qsv3R2SbzdssnrMQ0kPDXxGXFmwTHjy_Btr0UmtAPpx0mvRM0z5I3ACYXfKo1p-P4X3AzjuCcoC5YHTVH9uj2NaALEcpbrplJUN_DA4HKnDVbnz9K2-LcVirf9RKNZ6rqyho6wEzKIr_bZjnAcxHf2QTo May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: a853a089c08b4fb288c1eb5ddcc30bbf May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerDiskConfigTestJSON-260565806 May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a853a089c08b4fb288c1eb5ddcc30bbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a853a089c08b4fb288c1eb5ddcc30bbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a853a089c08b4fb288c1eb5ddcc30bbf", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a853a089c08b4fb288c1eb5ddcc30bbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerDiskConfigTestJSON-260565806 May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: a853a089c08b4fb288c1eb5ddcc30bbf May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-260565806 May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerDiskConfigTestJSON-260565806-project May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: cc14047fba5947198634f831b653fbad May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerDiskConfigTestJSON-260565806-project May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 3f4f714d-1397-4fc3-b48a-be38e5b921e5 could not be found. May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '3f4f714d-1397-4fc3-b48a-be38e5b921e5'} May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f4f714d-1397-4fc3-b48a-be38e5b921e5 could not be found. May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f4f714d-1397-4fc3-b48a-be38e5b921e5 could not be found. May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:38.991057 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:39.002085 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:39.002085 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:39.002085 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:39.002085 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:28:39.002085 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:28:39.002085 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f4f714d-1397-4fc3-b48a-be38e5b921e5 could not be found. May 21 21:28:39.002085 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:39.002085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ca7d41c0-a7ca-4f68-aaec-bd53ab6b260b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Returning 404 to user: Instance 3f4f714d-1397-4fc3-b48a-be38e5b921e5 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:39.002085 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ca7d41c0-a7ca-4f68-aaec-bd53ab6b260b tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5" status: 404 len: 111 microversion: 2.1 time: 0.032251 May 21 21:28:39.002085 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2058/4250] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:38 2022] GET /compute/v2.1/servers/3f4f714d-1397-4fc3-b48a-be38e5b921e5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:28:39.002085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-beed9486-2827-4ad8-a614-bcdd7012b8ab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:39.002085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-beed9486-2827-4ad8-a614-bcdd7012b8ab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:39.004747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ffc7d7b4-6fbd-4c03-97e7-5ee5eaafed15 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:39.004978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-beed9486-2827-4ad8-a614-bcdd7012b8ab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:39.006182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-beed9486-2827-4ad8-a614-bcdd7012b8ab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:39.006725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-beed9486-2827-4ad8-a614-bcdd7012b8ab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:39.007183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-beed9486-2827-4ad8-a614-bcdd7012b8ab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:39.009302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ffc7d7b4-6fbd-4c03-97e7-5ee5eaafed15 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:39.011072 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ffc7d7b4-6fbd-4c03-97e7-5ee5eaafed15 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 2960 microversion: 2.42 time: 0.381766 May 21 21:28:39.013384 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2193/4251] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:28:38 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 2960 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:28:39.024684 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-beed9486-2827-4ad8-a614-bcdd7012b8ab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance f75bc144-8ec2-4751-a77e-6c7c7fedaec9 could not be found. May 21 21:28:39.026009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-08950fd6-c286-4743-94d4-33b03a0e91f9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-beed9486-2827-4ad8-a614-bcdd7012b8ab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 HTTP/1.1 May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance f75bc144-8ec2-4751-a77e-6c7c7fedaec9 could not be found. May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'f75bc144-8ec2-4751-a77e-6c7c7fedaec9'} May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f75bc144-8ec2-4751-a77e-6c7c7fedaec9 could not be found. May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f75bc144-8ec2-4751-a77e-6c7c7fedaec9 could not be found. May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:39.026273 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:39.031425 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:39.031425 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:39.031425 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:28:39.031425 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:28:39.031425 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f75bc144-8ec2-4751-a77e-6c7c7fedaec9 could not be found. May 21 21:28:39.031425 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:39.031425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-beed9486-2827-4ad8-a614-bcdd7012b8ab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance f75bc144-8ec2-4751-a77e-6c7c7fedaec9 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:39.031953 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-08950fd6-c286-4743-94d4-33b03a0e91f9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:39.032055 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-beed9486-2827-4ad8-a614-bcdd7012b8ab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 404 len: 111 microversion: 2.1 time: 0.033823 May 21 21:28:39.032055 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2059/4252] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:38 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:28:39.046227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08950fd6-c286-4743-94d4-33b03a0e91f9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:39.046839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08950fd6-c286-4743-94d4-33b03a0e91f9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:39.047729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08950fd6-c286-4743-94d4-33b03a0e91f9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:39.048409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08950fd6-c286-4743-94d4-33b03a0e91f9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:39.059403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-881a7099-6873-4563-aabe-17663a094b9e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Action: 'create', calling method: .version_select at 0x7fc81a018550>, body: {"keypair": {"name": "tempest-key-1227629703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHALVp/WdWvVDj6nfv116EigzOPyt3ft2KmeukaNX6E49aSGiQ/xjJ+ACmagO1ma+kAESfDTryC1GYD7RqsDzF+uXPjxzkNcXOGWgwLCB2kGu2FxIfJuI3cTAKp2LH8MvQ=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-08950fd6-c286-4743-94d4-33b03a0e91f9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] HTTP exception thrown: Instance ec44cb55-6eb8-4fa8-a028-81cebb81784b could not be found. May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-08950fd6-c286-4743-94d4-33b03a0e91f9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Request method failure captured: May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b HTTP/1.1 May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVj1ZRvbW22tj9pVQuVcr0Qsv3R2SbzdssnrMQ0kPDXxGXFmwTHjy_Btr0UmtAPpx0mvRM0z5I3ACYXfKo1p-P4X3AzjuCcoC5YHTVH9uj2NaALEcpbrplJUN_DA4HKnDVbnz9K2-LcVirf9RKNZ6rqyho6wEzKIr_bZjnAcxHf2QTo May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: a853a089c08b4fb288c1eb5ddcc30bbf May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerDiskConfigTestJSON-260565806 May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a853a089c08b4fb288c1eb5ddcc30bbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a853a089c08b4fb288c1eb5ddcc30bbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a853a089c08b4fb288c1eb5ddcc30bbf", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a853a089c08b4fb288c1eb5ddcc30bbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerDiskConfigTestJSON-260565806 May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: a853a089c08b4fb288c1eb5ddcc30bbf May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-260565806 May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerDiskConfigTestJSON-260565806-project May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: cc14047fba5947198634f831b653fbad May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerDiskConfigTestJSON-260565806-project May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance ec44cb55-6eb8-4fa8-a028-81cebb81784b could not be found. May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'ec44cb55-6eb8-4fa8-a028-81cebb81784b'} May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec44cb55-6eb8-4fa8-a028-81cebb81784b could not be found. May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:28:39.079678 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:28:39.085060 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:28:39.085060 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:28:39.085060 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec44cb55-6eb8-4fa8-a028-81cebb81784b could not be found. May 21 21:28:39.085060 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:39.085060 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:39.085060 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:39.085060 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:39.085060 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:39.085060 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:39.085060 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:28:39.085060 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:28:39.085060 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec44cb55-6eb8-4fa8-a028-81cebb81784b could not be found. May 21 21:28:39.085060 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:39.086215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-881a7099-6873-4563-aabe-17663a094b9e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Getting quotas for project 4dbb4bbc88f84520885c00a376ba0f7c. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:28:39.086336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-08950fd6-c286-4743-94d4-33b03a0e91f9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Returning 404 to user: Instance ec44cb55-6eb8-4fa8-a028-81cebb81784b could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:39.086336 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-08950fd6-c286-4743-94d4-33b03a0e91f9 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 404 len: 111 microversion: 2.1 time: 0.064450 May 21 21:28:39.086336 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2194/4253] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:28:39 2022] DELETE /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:28:39.090215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e9693abd-7ee1-49a7-bbb3-7482ba2cb82a tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:39.091010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e9693abd-7ee1-49a7-bbb3-7482ba2cb82a tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: ec44cb55-6eb8-4fa8-a028-81cebb81784b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:39.092445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-881a7099-6873-4563-aabe-17663a094b9e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Getting quotas for user c67dc8226610413a8bb889d6055a75d2 and project 4dbb4bbc88f84520885c00a376ba0f7c. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:28:39.098144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9693abd-7ee1-49a7-bbb3-7482ba2cb82a tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:39.098713 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9693abd-7ee1-49a7-bbb3-7482ba2cb82a tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:39.100347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9693abd-7ee1-49a7-bbb3-7482ba2cb82a tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:39.100820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9693abd-7ee1-49a7-bbb3-7482ba2cb82a tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:39.116592 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-e9693abd-7ee1-49a7-bbb3-7482ba2cb82a tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] HTTP exception thrown: Instance ec44cb55-6eb8-4fa8-a028-81cebb81784b could not be found. May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e9693abd-7ee1-49a7-bbb3-7482ba2cb82a tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Request method failure captured: May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b HTTP/1.1 May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVj1ZRvbW22tj9pVQuVcr0Qsv3R2SbzdssnrMQ0kPDXxGXFmwTHjy_Btr0UmtAPpx0mvRM0z5I3ACYXfKo1p-P4X3AzjuCcoC5YHTVH9uj2NaALEcpbrplJUN_DA4HKnDVbnz9K2-LcVirf9RKNZ6rqyho6wEzKIr_bZjnAcxHf2QTo May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: a853a089c08b4fb288c1eb5ddcc30bbf May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerDiskConfigTestJSON-260565806 May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a853a089c08b4fb288c1eb5ddcc30bbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a853a089c08b4fb288c1eb5ddcc30bbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a853a089c08b4fb288c1eb5ddcc30bbf", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a853a089c08b4fb288c1eb5ddcc30bbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerDiskConfigTestJSON-260565806 May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: a853a089c08b4fb288c1eb5ddcc30bbf May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-260565806 May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerDiskConfigTestJSON-260565806-project May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: cc14047fba5947198634f831b653fbad May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerDiskConfigTestJSON-260565806-project May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance ec44cb55-6eb8-4fa8-a028-81cebb81784b could not be found. May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'ec44cb55-6eb8-4fa8-a028-81cebb81784b'} May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec44cb55-6eb8-4fa8-a028-81cebb81784b could not be found. May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec44cb55-6eb8-4fa8-a028-81cebb81784b could not be found. May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:39.120104 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:39.126177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:39.126177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:39.126177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:39.126177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:28:39.126177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:28:39.126177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec44cb55-6eb8-4fa8-a028-81cebb81784b could not be found. May 21 21:28:39.126177 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:39.126177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e9693abd-7ee1-49a7-bbb3-7482ba2cb82a tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Returning 404 to user: Instance ec44cb55-6eb8-4fa8-a028-81cebb81784b could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:39.133910 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e9693abd-7ee1-49a7-bbb3-7482ba2cb82a tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b" status: 404 len: 111 microversion: 2.1 time: 0.042214 May 21 21:28:39.133910 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2195/4254] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:39 2022] GET /compute/v2.1/servers/ec44cb55-6eb8-4fa8-a028-81cebb81784b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:28:39.143557 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-65a3a241-9d38-4f89-b2e3-25d1b942cfb7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:39.144998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-65a3a241-9d38-4f89-b2e3-25d1b942cfb7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:39.151863 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:39.159106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65a3a241-9d38-4f89-b2e3-25d1b942cfb7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:39.159801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65a3a241-9d38-4f89-b2e3-25d1b942cfb7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:39.161060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65a3a241-9d38-4f89-b2e3-25d1b942cfb7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:39.161526 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65a3a241-9d38-4f89-b2e3-25d1b942cfb7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:39.187773 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-65a3a241-9d38-4f89-b2e3-25d1b942cfb7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] HTTP exception thrown: Instance 8e0e0ad6-f09c-4c9f-8b87-a913053bf054 could not be found. May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-65a3a241-9d38-4f89-b2e3-25d1b942cfb7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Request method failure captured: May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 HTTP/1.1 May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVj1ZRvbW22tj9pVQuVcr0Qsv3R2SbzdssnrMQ0kPDXxGXFmwTHjy_Btr0UmtAPpx0mvRM0z5I3ACYXfKo1p-P4X3AzjuCcoC5YHTVH9uj2NaALEcpbrplJUN_DA4HKnDVbnz9K2-LcVirf9RKNZ6rqyho6wEzKIr_bZjnAcxHf2QTo May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: a853a089c08b4fb288c1eb5ddcc30bbf May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerDiskConfigTestJSON-260565806 May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a853a089c08b4fb288c1eb5ddcc30bbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a853a089c08b4fb288c1eb5ddcc30bbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a853a089c08b4fb288c1eb5ddcc30bbf", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a853a089c08b4fb288c1eb5ddcc30bbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerDiskConfigTestJSON-260565806 May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: a853a089c08b4fb288c1eb5ddcc30bbf May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-260565806 May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerDiskConfigTestJSON-260565806-project May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: cc14047fba5947198634f831b653fbad May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerDiskConfigTestJSON-260565806-project May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 8e0e0ad6-f09c-4c9f-8b87-a913053bf054 could not be found. May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '8e0e0ad6-f09c-4c9f-8b87-a913053bf054'} May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e0e0ad6-f09c-4c9f-8b87-a913053bf054 could not be found. May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:28:39.190014 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:28:39.195725 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e0e0ad6-f09c-4c9f-8b87-a913053bf054 could not be found. May 21 21:28:39.195725 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:39.195725 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:39.195725 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:39.195725 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:39.195725 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:39.195725 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:39.195725 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:28:39.195725 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:28:39.195725 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e0e0ad6-f09c-4c9f-8b87-a913053bf054 could not be found. May 21 21:28:39.195725 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:39.198594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-65a3a241-9d38-4f89-b2e3-25d1b942cfb7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Returning 404 to user: Instance 8e0e0ad6-f09c-4c9f-8b87-a913053bf054 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:39.202289 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-881a7099-6873-4563-aabe-17663a094b9e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.146445 May 21 21:28:39.202431 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-65a3a241-9d38-4f89-b2e3-25d1b942cfb7 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 404 len: 111 microversion: 2.1 time: 0.067424 May 21 21:28:39.202567 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2060/4255] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:28:39 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:39.202672 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2196/4256] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:28:39 2022] DELETE /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:28:39.205966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2189ecc7-4537-48ac-a8e8-3c3c7a21e2fb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:39.206790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2189ecc7-4537-48ac-a8e8-3c3c7a21e2fb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:39.215799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fb12018d-98fa-4849-91e0-f967150974b1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:39.216019 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2189ecc7-4537-48ac-a8e8-3c3c7a21e2fb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:39.216741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2189ecc7-4537-48ac-a8e8-3c3c7a21e2fb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:39.219558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fb12018d-98fa-4849-91e0-f967150974b1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] [instance: 8e0e0ad6-f09c-4c9f-8b87-a913053bf054] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:39.219711 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2189ecc7-4537-48ac-a8e8-3c3c7a21e2fb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:39.220981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2189ecc7-4537-48ac-a8e8-3c3c7a21e2fb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:39.246064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb12018d-98fa-4849-91e0-f967150974b1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:39.246531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb12018d-98fa-4849-91e0-f967150974b1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:39.253576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb12018d-98fa-4849-91e0-f967150974b1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:39.254178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb12018d-98fa-4849-91e0-f967150974b1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:39.273716 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-fb12018d-98fa-4849-91e0-f967150974b1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] HTTP exception thrown: Instance 8e0e0ad6-f09c-4c9f-8b87-a913053bf054 could not be found. May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fb12018d-98fa-4849-91e0-f967150974b1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Request method failure captured: May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 HTTP/1.1 May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVj1ZRvbW22tj9pVQuVcr0Qsv3R2SbzdssnrMQ0kPDXxGXFmwTHjy_Btr0UmtAPpx0mvRM0z5I3ACYXfKo1p-P4X3AzjuCcoC5YHTVH9uj2NaALEcpbrplJUN_DA4HKnDVbnz9K2-LcVirf9RKNZ6rqyho6wEzKIr_bZjnAcxHf2QTo May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: a853a089c08b4fb288c1eb5ddcc30bbf May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerDiskConfigTestJSON-260565806 May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a853a089c08b4fb288c1eb5ddcc30bbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a853a089c08b4fb288c1eb5ddcc30bbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a853a089c08b4fb288c1eb5ddcc30bbf", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a853a089c08b4fb288c1eb5ddcc30bbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerDiskConfigTestJSON-260565806 May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: a853a089c08b4fb288c1eb5ddcc30bbf May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-260565806 May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerDiskConfigTestJSON-260565806-project May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: cc14047fba5947198634f831b653fbad May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerDiskConfigTestJSON-260565806-project May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 8e0e0ad6-f09c-4c9f-8b87-a913053bf054 could not be found. May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '8e0e0ad6-f09c-4c9f-8b87-a913053bf054'} May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e0e0ad6-f09c-4c9f-8b87-a913053bf054 could not be found. May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e0e0ad6-f09c-4c9f-8b87-a913053bf054 could not be found. May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:39.276426 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:39.282351 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:39.282351 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:39.282351 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:39.282351 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:28:39.282351 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:28:39.282351 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e0e0ad6-f09c-4c9f-8b87-a913053bf054 could not be found. May 21 21:28:39.282351 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:39.282351 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fb12018d-98fa-4849-91e0-f967150974b1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] Returning 404 to user: Instance 8e0e0ad6-f09c-4c9f-8b87-a913053bf054 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:39.282351 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fb12018d-98fa-4849-91e0-f967150974b1 tempest-ServerDiskConfigTestJSON-260565806 tempest-ServerDiskConfigTestJSON-260565806-project] 10.222.0.49 "GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054" status: 404 len: 111 microversion: 2.1 time: 0.069607 May 21 21:28:39.282351 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2197/4257] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:39 2022] GET /compute/v2.1/servers/8e0e0ad6-f09c-4c9f-8b87-a913053bf054 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:28:39.291581 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c2a59bcf-da20-4f82-980d-bb05431150cf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '.version_select at 0x7fc81a51f430>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:39.297700 ncdv-master-1 devstack@n-api.service[131277]: WARNING oslo_db.sqlalchemy.utils [None req-c2a59bcf-da20-4f82-980d-bb05431150cf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Unique keys not in sort_keys. The sorting order may be unstable. May 21 21:28:39.300733 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c2a59bcf-da20-4f82-980d-bb05431150cf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.020842 May 21 21:28:39.301503 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2198/4258] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:28:39 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:39.434291 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c67ace10-bc5b-4442-a0e1-320c5c12ed60 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1464533305", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "key_name": "tempest-key-1227629703", "networks": [{"uuid": "88d40858-d8e8-4c97-8084-13382fa527f6"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:39.514080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-c67ace10-bc5b-4442-a0e1-320c5c12ed60 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] validate_networks() for [('88d40858-d8e8-4c97-8084-13382fa527f6', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:28:39.673799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2189ecc7-4537-48ac-a8e8-3c3c7a21e2fb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:39.715734 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2189ecc7-4537-48ac-a8e8-3c3c7a21e2fb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1678 microversion: 2.1 time: 0.514316 May 21 21:28:39.716379 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2061/4259] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:39 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1678 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:39.751585 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-b6788bf0-bcd0-46f8-8857-6ef7daef26c3 req-a9530314-01f1-4de8-b166-e2e0f90ee5fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f75bc144-8ec2-4751-a77e-6c7c7fedaec9", "name": "network-vif-deleted", "tag": "0f8ec84d-abf5-4980-bbd0-218e47cbcd38"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:39.791194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b6788bf0-bcd0-46f8-8857-6ef7daef26c3 req-a9530314-01f1-4de8-b166-e2e0f90ee5fc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:39.791901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b6788bf0-bcd0-46f8-8857-6ef7daef26c3 req-a9530314-01f1-4de8-b166-e2e0f90ee5fc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:39.835240 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-b6788bf0-bcd0-46f8-8857-6ef7daef26c3 req-a9530314-01f1-4de8-b166-e2e0f90ee5fc service nova] Creating event network-vif-deleted:0f8ec84d-abf5-4980-bbd0-218e47cbcd38 for instance f75bc144-8ec2-4751-a77e-6c7c7fedaec9 on nch2-master-1 May 21 21:28:39.851593 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-b6788bf0-bcd0-46f8-8857-6ef7daef26c3 req-a9530314-01f1-4de8-b166-e2e0f90ee5fc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116741 May 21 21:28:39.860001 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2062/4260] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:39.968047 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c296b52b-5777-4ca1-b4c9-d6edcb373a81 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:39.968780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c296b52b-5777-4ca1-b4c9-d6edcb373a81 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:39.983610 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c296b52b-5777-4ca1-b4c9-d6edcb373a81 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:39.987084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c296b52b-5777-4ca1-b4c9-d6edcb373a81 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:39.989051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c296b52b-5777-4ca1-b4c9-d6edcb373a81 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:39.993586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c296b52b-5777-4ca1-b4c9-d6edcb373a81 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:40.024038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:40.474032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c296b52b-5777-4ca1-b4c9-d6edcb373a81 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c7728397914d8cbcba42d295d4c265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4583f3b0962e47e7b7b73243db3b0d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:40.491956 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c296b52b-5777-4ca1-b4c9-d6edcb373a81 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221" status: 200 len: 1316 microversion: 2.1 time: 0.529717 May 21 21:28:40.493650 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2063/4261] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:39 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221 => generated 1316 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:40.514396 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-68c6a61d-4cd8-4891-a96a-167849eed32b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:40.516634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-68c6a61d-4cd8-4891-a96a-167849eed32b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:40.539073 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-68c6a61d-4cd8-4891-a96a-167849eed32b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:40.539532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-68c6a61d-4cd8-4891-a96a-167849eed32b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:40.540800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-68c6a61d-4cd8-4891-a96a-167849eed32b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:40.541251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-68c6a61d-4cd8-4891-a96a-167849eed32b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:40.599773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c67ace10-bc5b-4442-a0e1-320c5c12ed60 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:28:40.600600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c67ace10-bc5b-4442-a0e1-320c5c12ed60 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:28:40.600600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c67ace10-bc5b-4442-a0e1-320c5c12ed60 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:28:40.600977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c67ace10-bc5b-4442-a0e1-320c5c12ed60 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:28:40.601599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c67ace10-bc5b-4442-a0e1-320c5c12ed60 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:28:40.612475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c67ace10-bc5b-4442-a0e1-320c5c12ed60 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:40.613182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c67ace10-bc5b-4442-a0e1-320c5c12ed60 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:40.614184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c67ace10-bc5b-4442-a0e1-320c5c12ed60 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:40.615082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c67ace10-bc5b-4442-a0e1-320c5c12ed60 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:40.624565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:40.636765 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-c67ace10-bc5b-4442-a0e1-320c5c12ed60 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Getting quotas for project 4dbb4bbc88f84520885c00a376ba0f7c. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:28:40.642401 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-c67ace10-bc5b-4442-a0e1-320c5c12ed60 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Getting quotas for user c67dc8226610413a8bb889d6055a75d2 and project 4dbb4bbc88f84520885c00a376ba0f7c. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:28:40.657047 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c67ace10-bc5b-4442-a0e1-320c5c12ed60 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:28:40.659589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c67ace10-bc5b-4442-a0e1-320c5c12ed60 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:28:40.822473 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c67ace10-bc5b-4442-a0e1-320c5c12ed60 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.392066 May 21 21:28:40.829884 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2199/4262] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:28:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:28:40.841034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-089e5313-78a0-4d00-99c7-bbc48fc443aa tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:40.848046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-089e5313-78a0-4d00-99c7-bbc48fc443aa tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:40.859413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-089e5313-78a0-4d00-99c7-bbc48fc443aa tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:40.860109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-089e5313-78a0-4d00-99c7-bbc48fc443aa tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:40.862124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-089e5313-78a0-4d00-99c7-bbc48fc443aa tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:40.862747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-089e5313-78a0-4d00-99c7-bbc48fc443aa tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:40.908258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-68c6a61d-4cd8-4891-a96a-167849eed32b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:40.920226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-68c6a61d-4cd8-4891-a96a-167849eed32b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:40.925998 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-68c6a61d-4cd8-4891-a96a-167849eed32b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:40.928066 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-68c6a61d-4cd8-4891-a96a-167849eed32b tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 2939 microversion: 2.42 time: 0.432668 May 21 21:28:40.929896 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2064/4263] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:28:40 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 2939 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:28:40.939800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-926a67d7-2517-4d95-bca0-434656a21649 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:40.940757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-926a67d7-2517-4d95-bca0-434656a21649 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:41.041974 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-926a67d7-2517-4d95-bca0-434656a21649 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:41.051752 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-926a67d7-2517-4d95-bca0-434656a21649 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 200 len: 1229 microversion: 2.1 time: 0.120519 May 21 21:28:41.053210 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2065/4264] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:40 2022] GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 1229 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:41.520843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-668c1ec1-3b48-40b2-8c48-4ba33e5c63e6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:41.522615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-668c1ec1-3b48-40b2-8c48-4ba33e5c63e6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:41.550519 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-668c1ec1-3b48-40b2-8c48-4ba33e5c63e6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:41.555574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-668c1ec1-3b48-40b2-8c48-4ba33e5c63e6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:41.556760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-668c1ec1-3b48-40b2-8c48-4ba33e5c63e6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:41.557363 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-668c1ec1-3b48-40b2-8c48-4ba33e5c63e6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:41.735646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-089e5313-78a0-4d00-99c7-bbc48fc443aa tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:41.755998 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-089e5313-78a0-4d00-99c7-bbc48fc443aa tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1678 microversion: 2.1 time: 0.923373 May 21 21:28:41.766139 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2200/4265] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:40 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1678 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:41.963873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2b930483-1d5b-4408-bd3d-6478af4c5d17 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:41.965298 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2b930483-1d5b-4408-bd3d-6478af4c5d17 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:41.973081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-668c1ec1-3b48-40b2-8c48-4ba33e5c63e6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c7728397914d8cbcba42d295d4c265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4583f3b0962e47e7b7b73243db3b0d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:41.986357 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-668c1ec1-3b48-40b2-8c48-4ba33e5c63e6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221" status: 200 len: 1316 microversion: 2.1 time: 0.479856 May 21 21:28:41.987617 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2066/4266] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:41 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221 => generated 1316 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:42.003869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b930483-1d5b-4408-bd3d-6478af4c5d17 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:42.004378 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b930483-1d5b-4408-bd3d-6478af4c5d17 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:42.005780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b930483-1d5b-4408-bd3d-6478af4c5d17 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:42.006221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b930483-1d5b-4408-bd3d-6478af4c5d17 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:42.077262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e9aad893-8d45-4c07-9ad9-acc2de4da466 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:42.078731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e9aad893-8d45-4c07-9ad9-acc2de4da466 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:42.148799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e9aad893-8d45-4c07-9ad9-acc2de4da466 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:42.162082 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e9aad893-8d45-4c07-9ad9-acc2de4da466 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 200 len: 1229 microversion: 2.1 time: 0.087792 May 21 21:28:42.163521 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2067/4267] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:42 2022] GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 1229 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:42.287075 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-c2be65c9-7575-4fa2-adbf-f583b2b775fc req-d3bfae17-1cc2-414e-bb3f-cf171a05736e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "name": "network-vif-unplugged", "status": "completed", "tag": "5b797786-d747-4356-b9a8-cebf01987ee4"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:42.310766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c2be65c9-7575-4fa2-adbf-f583b2b775fc req-d3bfae17-1cc2-414e-bb3f-cf171a05736e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:42.311473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c2be65c9-7575-4fa2-adbf-f583b2b775fc req-d3bfae17-1cc2-414e-bb3f-cf171a05736e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:42.341654 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-c2be65c9-7575-4fa2-adbf-f583b2b775fc req-d3bfae17-1cc2-414e-bb3f-cf171a05736e service nova] Creating event network-vif-unplugged:5b797786-d747-4356-b9a8-cebf01987ee4 for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:28:42.348269 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-c2be65c9-7575-4fa2-adbf-f583b2b775fc req-d3bfae17-1cc2-414e-bb3f-cf171a05736e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065928 May 21 21:28:42.351128 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2068/4268] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:28:42.466560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2b930483-1d5b-4408-bd3d-6478af4c5d17 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:42.484505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2b930483-1d5b-4408-bd3d-6478af4c5d17 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:42.484505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2b930483-1d5b-4408-bd3d-6478af4c5d17 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:42.484505 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2b930483-1d5b-4408-bd3d-6478af4c5d17 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 2918 microversion: 2.42 time: 0.527547 May 21 21:28:42.484874 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2201/4269] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:28:41 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 2918 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:28:42.775589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0903d982-0185-4b9b-83e0-f100e6686d63 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:42.776404 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0903d982-0185-4b9b-83e0-f100e6686d63 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:42.792227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0903d982-0185-4b9b-83e0-f100e6686d63 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:42.792746 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0903d982-0185-4b9b-83e0-f100e6686d63 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:42.793747 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0903d982-0185-4b9b-83e0-f100e6686d63 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:42.794203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0903d982-0185-4b9b-83e0-f100e6686d63 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:42.858369 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-089ccf15-3012-422e-b77c-07bf25096a1a req-1f9c4632-6e11-4618-9e7d-b11926184652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "name": "network-vif-deleted", "tag": "5b797786-d747-4356-b9a8-cebf01987ee4"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:42.874102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-089ccf15-3012-422e-b77c-07bf25096a1a req-1f9c4632-6e11-4618-9e7d-b11926184652 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:42.875282 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-089ccf15-3012-422e-b77c-07bf25096a1a req-1f9c4632-6e11-4618-9e7d-b11926184652 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:42.903963 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-089ccf15-3012-422e-b77c-07bf25096a1a req-1f9c4632-6e11-4618-9e7d-b11926184652 service nova] Creating event network-vif-deleted:5b797786-d747-4356-b9a8-cebf01987ee4 for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:28:42.916517 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-089ccf15-3012-422e-b77c-07bf25096a1a req-1f9c4632-6e11-4618-9e7d-b11926184652 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060554 May 21 21:28:42.918500 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2202/4270] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:28:43.006100 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-54e31a85-328d-4a7d-b2eb-024b71e553ae tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:43.007062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-54e31a85-328d-4a7d-b2eb-024b71e553ae tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:43.013790 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54e31a85-328d-4a7d-b2eb-024b71e553ae tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:43.014503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54e31a85-328d-4a7d-b2eb-024b71e553ae tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:43.015292 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54e31a85-328d-4a7d-b2eb-024b71e553ae tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:43.015737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54e31a85-328d-4a7d-b2eb-024b71e553ae tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:43.064869 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0903d982-0185-4b9b-83e0-f100e6686d63 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:43.073180 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0903d982-0185-4b9b-83e0-f100e6686d63 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1678 microversion: 2.1 time: 0.301784 May 21 21:28:43.073769 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2069/4271] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:42 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1678 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:43.180107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5c6ff934-c61b-4de3-bc58-c744ad47ce8d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:43.180990 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5c6ff934-c61b-4de3-bc58-c744ad47ce8d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:43.208865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c6ff934-c61b-4de3-bc58-c744ad47ce8d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:43.209905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c6ff934-c61b-4de3-bc58-c744ad47ce8d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:43.210977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c6ff934-c61b-4de3-bc58-c744ad47ce8d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:43.212837 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c6ff934-c61b-4de3-bc58-c744ad47ce8d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:43.381484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5c6ff934-c61b-4de3-bc58-c744ad47ce8d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:43.395266 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5c6ff934-c61b-4de3-bc58-c744ad47ce8d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 200 len: 1225 microversion: 2.1 time: 0.220047 May 21 21:28:43.396896 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2070/4272] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:43 2022] GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 1225 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:43.506927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-54e31a85-328d-4a7d-b2eb-024b71e553ae tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c7728397914d8cbcba42d295d4c265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4583f3b0962e47e7b7b73243db3b0d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:43.510718 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aa833fd5-4d08-4b23-85b8-8de75b9d5cd5 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:43.511966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-aa833fd5-4d08-4b23-85b8-8de75b9d5cd5 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:43.524582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aa833fd5-4d08-4b23-85b8-8de75b9d5cd5 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:43.526982 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aa833fd5-4d08-4b23-85b8-8de75b9d5cd5 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:43.528439 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aa833fd5-4d08-4b23-85b8-8de75b9d5cd5 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:43.530652 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aa833fd5-4d08-4b23-85b8-8de75b9d5cd5 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:43.535622 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-54e31a85-328d-4a7d-b2eb-024b71e553ae tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221" status: 200 len: 1316 microversion: 2.1 time: 0.532381 May 21 21:28:43.547708 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2203/4273] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:42 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221 => generated 1316 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:44.092779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0eb1e568-c795-427b-b725-0f7da74c65e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:44.094973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0eb1e568-c795-427b-b725-0f7da74c65e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:44.110111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0eb1e568-c795-427b-b725-0f7da74c65e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:44.111254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0eb1e568-c795-427b-b725-0f7da74c65e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:44.112338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0eb1e568-c795-427b-b725-0f7da74c65e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:44.113216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0eb1e568-c795-427b-b725-0f7da74c65e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:44.233286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-aa833fd5-4d08-4b23-85b8-8de75b9d5cd5 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:44.248838 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-aa833fd5-4d08-4b23-85b8-8de75b9d5cd5 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:44.251570 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-aa833fd5-4d08-4b23-85b8-8de75b9d5cd5 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:44.253934 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-aa833fd5-4d08-4b23-85b8-8de75b9d5cd5 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 2757 microversion: 2.42 time: 0.750761 May 21 21:28:44.256013 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2071/4274] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:28:43 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 2757 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:28:44.413050 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-94cd90ea-50b7-40cc-a9a3-233776607d2d req-319b6a44-c696-474d-8f44-e55cc88fa217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "name": "network-vif-unplugged", "status": "completed", "tag": "fb6fdb78-778e-40f4-b501-95a96aca53fe"}, {"server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "name": "network-vif-unplugged", "status": "completed", "tag": "412a55b1-ca87-468e-871f-1a2e9ad7520f"}, {"server_uuid": "f6a45a12-08af-442d-b526-cf5f30594221", "name": "network-vif-plugged", "status": "completed", "tag": "eba143c2-fb38-49dc-acaf-06425d78f15c"}, {"server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "name": "network-vif-unplugged", "status": "completed", "tag": "259477b1-cfd2-4e6b-a20e-7bab0eec7c14"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:44.426444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0eb1e568-c795-427b-b725-0f7da74c65e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:44.436515 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0eb1e568-c795-427b-b725-0f7da74c65e2 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1655 microversion: 2.1 time: 0.349466 May 21 21:28:44.437659 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2204/4275] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:44 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1655 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:44.440564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-94cd90ea-50b7-40cc-a9a3-233776607d2d req-319b6a44-c696-474d-8f44-e55cc88fa217 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:44.449467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-94cd90ea-50b7-40cc-a9a3-233776607d2d req-319b6a44-c696-474d-8f44-e55cc88fa217 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:44.461799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fd434af0-58c4-4914-bc54-d75e6562beec tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:44.464055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fd434af0-58c4-4914-bc54-d75e6562beec tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:44.471601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd434af0-58c4-4914-bc54-d75e6562beec tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:44.473859 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd434af0-58c4-4914-bc54-d75e6562beec tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:44.475615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd434af0-58c4-4914-bc54-d75e6562beec tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:44.476430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd434af0-58c4-4914-bc54-d75e6562beec tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:44.480451 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-94cd90ea-50b7-40cc-a9a3-233776607d2d req-319b6a44-c696-474d-8f44-e55cc88fa217 service nova] Creating event network-vif-unplugged:fb6fdb78-778e-40f4-b501-95a96aca53fe for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:28:44.481116 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-94cd90ea-50b7-40cc-a9a3-233776607d2d req-319b6a44-c696-474d-8f44-e55cc88fa217 service nova] Creating event network-vif-unplugged:412a55b1-ca87-468e-871f-1a2e9ad7520f for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:28:44.481905 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-94cd90ea-50b7-40cc-a9a3-233776607d2d req-319b6a44-c696-474d-8f44-e55cc88fa217 service nova] Creating event network-vif-plugged:eba143c2-fb38-49dc-acaf-06425d78f15c for instance f6a45a12-08af-442d-b526-cf5f30594221 on nch1-master-1 May 21 21:28:44.486817 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-94cd90ea-50b7-40cc-a9a3-233776607d2d req-319b6a44-c696-474d-8f44-e55cc88fa217 service nova] Creating event network-vif-unplugged:259477b1-cfd2-4e6b-a20e-7bab0eec7c14 for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:28:44.501670 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-94cd90ea-50b7-40cc-a9a3-233776607d2d req-319b6a44-c696-474d-8f44-e55cc88fa217 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 702 microversion: 2.1 time: 0.094018 May 21 21:28:44.511224 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2072/4276] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 702 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:44.518103 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-718bfc03-47ee-491a-b98d-10f081758f7b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:44.535860 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-718bfc03-47ee-491a-b98d-10f081758f7b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:44.536756 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-718bfc03-47ee-491a-b98d-10f081758f7b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:44.593306 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-718bfc03-47ee-491a-b98d-10f081758f7b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Going to try to start instance {{(pid=131278) start /opt/stack/nova/nova/compute/api.py:2730}} May 21 21:28:44.731465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fd434af0-58c4-4914-bc54-d75e6562beec tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:44.750796 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fd434af0-58c4-4914-bc54-d75e6562beec tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 200 len: 1289 microversion: 2.1 time: 0.311288 May 21 21:28:44.761477 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2205/4277] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:44 2022] GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 1289 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:44.768637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-48703e75-4042-4a0d-b913-f6b3a063698a tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:44.771462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-48703e75-4042-4a0d-b913-f6b3a063698a tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:44.778829 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48703e75-4042-4a0d-b913-f6b3a063698a tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:44.779666 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48703e75-4042-4a0d-b913-f6b3a063698a tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:44.780903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48703e75-4042-4a0d-b913-f6b3a063698a tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:44.782334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48703e75-4042-4a0d-b913-f6b3a063698a tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:44.834212 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-718bfc03-47ee-491a-b98d-10f081758f7b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action" status: 202 len: 0 microversion: 2.1 time: 0.315840 May 21 21:28:44.834212 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2073/4278] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:28:44 2022] POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:28:45.078617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-48703e75-4042-4a0d-b913-f6b3a063698a tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c7728397914d8cbcba42d295d4c265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4583f3b0962e47e7b7b73243db3b0d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:45.088926 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-48703e75-4042-4a0d-b913-f6b3a063698a tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221" status: 200 len: 1316 microversion: 2.1 time: 0.325127 May 21 21:28:45.090288 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2206/4279] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:44 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221 => generated 1316 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:45.091887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-77665fdb-d7f1-40ed-8f47-ba45c01dfe20 tempest-MultipleCreateNegativeTestJSON-2045787515 tempest-MultipleCreateNegativeTestJSON-2045787515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-846364491", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:45.094591 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-77665fdb-d7f1-40ed-8f47-ba45c01dfe20 tempest-MultipleCreateNegativeTestJSON-2045787515 tempest-MultipleCreateNegativeTestJSON-2045787515-project] HTTP exception thrown: min_count must be <= max_count May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-77665fdb-d7f1-40ed-8f47-ba45c01dfe20 tempest-MultipleCreateNegativeTestJSON-2045787515 tempest-MultipleCreateNegativeTestJSON-2045787515-project] Request method failure captured: May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 183 May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVmMLkRfAd2Y4OVOlG7YRob52QqLLSOuYjFB_y6TaVj6p5BB8cRCA02rFnj7PZ7CZn-TvTmWvtRP1eDiMwmMK0_N0cFRI-XdNC4T6Fpujj2-KmXp97lcFXhfW6shZhV9hPZcRfJL2M31H61GEh60dK5MBMebbo6gYNLOkcwVLHfVZq8 May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: c0a9201020d44c77ae0329432d6e8b4c May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2045787515 May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c0a9201020d44c77ae0329432d6e8b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a9201020d44c77ae0329432d6e8b4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c0a9201020d44c77ae0329432d6e8b4c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a9201020d44c77ae0329432d6e8b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2045787515 May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: c0a9201020d44c77ae0329432d6e8b4c May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2045787515 May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-MultipleCreateNegativeTestJSON-2045787515-project May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 0ec41560760d43cd8f79bb70e3fa69fc May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2045787515-project May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-846364491", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "min_count": 3, "max_count": 2}} May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: exception: min_count must be <= max_count May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-846364491', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count May 21 21:28:45.096758 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:45.103367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-af0f35c5-648c-4532-aee9-de862a58fbb6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:45.106472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-af0f35c5-648c-4532-aee9-de862a58fbb6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:45.106604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-77665fdb-d7f1-40ed-8f47-ba45c01dfe20 tempest-MultipleCreateNegativeTestJSON-2045787515 tempest-MultipleCreateNegativeTestJSON-2045787515-project] Returning 400 to user: min_count must be <= max_count {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:45.106604 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-77665fdb-d7f1-40ed-8f47-ba45c01dfe20 tempest-MultipleCreateNegativeTestJSON-2045787515 tempest-MultipleCreateNegativeTestJSON-2045787515-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.275079 May 21 21:28:45.107531 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2074/4280] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:28:44 2022] POST /compute/v2.1/servers => generated 74 bytes in 277 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 21 21:28:45.111981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af0f35c5-648c-4532-aee9-de862a58fbb6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:45.112463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af0f35c5-648c-4532-aee9-de862a58fbb6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:45.113407 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af0f35c5-648c-4532-aee9-de862a58fbb6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:45.115253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af0f35c5-648c-4532-aee9-de862a58fbb6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:45.129900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-81b99911-7613-44f0-aebd-1a2560745ef9 req-3e855bd8-893a-4f72-ad73-9cf39750a7dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "name": "network-vif-deleted", "tag": "412a55b1-ca87-468e-871f-1a2e9ad7520f"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:45.156256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-81b99911-7613-44f0-aebd-1a2560745ef9 req-3e855bd8-893a-4f72-ad73-9cf39750a7dd service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:45.156815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-81b99911-7613-44f0-aebd-1a2560745ef9 req-3e855bd8-893a-4f72-ad73-9cf39750a7dd service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:45.194713 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-81b99911-7613-44f0-aebd-1a2560745ef9 req-3e855bd8-893a-4f72-ad73-9cf39750a7dd service nova] Creating event network-vif-deleted:412a55b1-ca87-468e-871f-1a2e9ad7520f for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:28:45.206752 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-81b99911-7613-44f0-aebd-1a2560745ef9 req-3e855bd8-893a-4f72-ad73-9cf39750a7dd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097866 May 21 21:28:45.207363 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2075/4281] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:45.222862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0614e36f-15ce-4b44-926c-6f9d26f036c5 tempest-MultipleCreateNegativeTestJSON-2045787515 tempest-MultipleCreateNegativeTestJSON-2045787515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-466750947", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "max_count": 0}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0614e36f-15ce-4b44-926c-6f9d26f036c5 tempest-MultipleCreateNegativeTestJSON-2045787515 tempest-MultipleCreateNegativeTestJSON-2045787515-project] Request method failure captured: May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 167 May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVmMLkRfAd2Y4OVOlG7YRob52QqLLSOuYjFB_y6TaVj6p5BB8cRCA02rFnj7PZ7CZn-TvTmWvtRP1eDiMwmMK0_N0cFRI-XdNC4T6Fpujj2-KmXp97lcFXhfW6shZhV9hPZcRfJL2M31H61GEh60dK5MBMebbo6gYNLOkcwVLHfVZq8 May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: c0a9201020d44c77ae0329432d6e8b4c May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2045787515 May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c0a9201020d44c77ae0329432d6e8b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a9201020d44c77ae0329432d6e8b4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c0a9201020d44c77ae0329432d6e8b4c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a9201020d44c77ae0329432d6e8b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2045787515 May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: c0a9201020d44c77ae0329432d6e8b4c May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2045787515 May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-MultipleCreateNegativeTestJSON-2045787515-project May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 0ec41560760d43cd8f79bb70e3fa69fc May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2045787515-project May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-466750947", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "max_count": 0}} May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-466750947', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452', 'max_count': 0}}} May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise error May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi On instance['server']: May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 0 May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:28:45.227473 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:28:45.236534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:28:45.236534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:28:45.236534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:28:45.236534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 21 21:28:45.236534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:45.236534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:45.236534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:45.236534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:45.236534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:45.236534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:45.236534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:28:45.236534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:28:45.236534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 21 21:28:45.236534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:45.236534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0614e36f-15ce-4b44-926c-6f9d26f036c5 tempest-MultipleCreateNegativeTestJSON-2045787515 tempest-MultipleCreateNegativeTestJSON-2045787515-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:45.236534 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0614e36f-15ce-4b44-926c-6f9d26f036c5 tempest-MultipleCreateNegativeTestJSON-2045787515 tempest-MultipleCreateNegativeTestJSON-2045787515-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.020484 May 21 21:28:45.236534 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2076/4282] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:28:45 2022] POST /compute/v2.1/servers => generated 130 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:28:45.277554 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-be47135e-5b58-4798-bd8a-ec663c253e46 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:45.277922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-be47135e-5b58-4798-bd8a-ec663c253e46 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:45.292208 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be47135e-5b58-4798-bd8a-ec663c253e46 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:45.294140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be47135e-5b58-4798-bd8a-ec663c253e46 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:45.294140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be47135e-5b58-4798-bd8a-ec663c253e46 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:45.294140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be47135e-5b58-4798-bd8a-ec663c253e46 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:45.445463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-af0f35c5-648c-4532-aee9-de862a58fbb6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:45.456854 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-af0f35c5-648c-4532-aee9-de862a58fbb6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1664 microversion: 2.1 time: 0.365288 May 21 21:28:45.465780 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2207/4283] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:45 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1664 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:45.474131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1255290e-3593-4b63-a24e-6e2503a0d458 tempest-MultipleCreateNegativeTestJSON-2045787515 tempest-MultipleCreateNegativeTestJSON-2045787515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-930080371", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "max_count": 2.5}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1255290e-3593-4b63-a24e-6e2503a0d458 tempest-MultipleCreateNegativeTestJSON-2045787515 tempest-MultipleCreateNegativeTestJSON-2045787515-project] Request method failure captured: May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 169 May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVmMLkRfAd2Y4OVOlG7YRob52QqLLSOuYjFB_y6TaVj6p5BB8cRCA02rFnj7PZ7CZn-TvTmWvtRP1eDiMwmMK0_N0cFRI-XdNC4T6Fpujj2-KmXp97lcFXhfW6shZhV9hPZcRfJL2M31H61GEh60dK5MBMebbo6gYNLOkcwVLHfVZq8 May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: c0a9201020d44c77ae0329432d6e8b4c May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2045787515 May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c0a9201020d44c77ae0329432d6e8b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a9201020d44c77ae0329432d6e8b4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c0a9201020d44c77ae0329432d6e8b4c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a9201020d44c77ae0329432d6e8b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2045787515 May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: c0a9201020d44c77ae0329432d6e8b4c May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2045787515 May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-MultipleCreateNegativeTestJSON-2045787515-project May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 0ec41560760d43cd8f79bb70e3fa69fc May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2045787515-project May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-930080371", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "max_count": 2.5}} May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-930080371', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452', 'max_count': 2.5}}} May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise error May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi On instance['server']: May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 2.5 May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:28:45.479374 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:28:45.485258 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:28:45.485258 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:28:45.485258 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:28:45.485258 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:28:45.485258 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 21 21:28:45.485258 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:45.485258 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:45.485258 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:45.485258 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:45.485258 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:45.485258 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:45.485258 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:28:45.485258 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:28:45.485258 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 21 21:28:45.485258 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:45.485258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1255290e-3593-4b63-a24e-6e2503a0d458 tempest-MultipleCreateNegativeTestJSON-2045787515 tempest-MultipleCreateNegativeTestJSON-2045787515-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:45.485258 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1255290e-3593-4b63-a24e-6e2503a0d458 tempest-MultipleCreateNegativeTestJSON-2045787515 tempest-MultipleCreateNegativeTestJSON-2045787515-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.022473 May 21 21:28:45.485258 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2208/4284] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:28:45 2022] POST /compute/v2.1/servers => generated 139 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:28:45.574144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-39a4b62c-efea-44a5-97f5-1090fde630d7 tempest-MultipleCreateNegativeTestJSON-2045787515 tempest-MultipleCreateNegativeTestJSON-2045787515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1448928910", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "min_count": 0}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-39a4b62c-efea-44a5-97f5-1090fde630d7 tempest-MultipleCreateNegativeTestJSON-2045787515 tempest-MultipleCreateNegativeTestJSON-2045787515-project] Request method failure captured: May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 168 May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVmMLkRfAd2Y4OVOlG7YRob52QqLLSOuYjFB_y6TaVj6p5BB8cRCA02rFnj7PZ7CZn-TvTmWvtRP1eDiMwmMK0_N0cFRI-XdNC4T6Fpujj2-KmXp97lcFXhfW6shZhV9hPZcRfJL2M31H61GEh60dK5MBMebbo6gYNLOkcwVLHfVZq8 May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: c0a9201020d44c77ae0329432d6e8b4c May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2045787515 May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c0a9201020d44c77ae0329432d6e8b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a9201020d44c77ae0329432d6e8b4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c0a9201020d44c77ae0329432d6e8b4c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a9201020d44c77ae0329432d6e8b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2045787515 May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: c0a9201020d44c77ae0329432d6e8b4c May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2045787515 May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-MultipleCreateNegativeTestJSON-2045787515-project May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 0ec41560760d43cd8f79bb70e3fa69fc May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2045787515-project May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1448928910", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "min_count": 0}} May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1448928910', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452', 'min_count': 0}}} May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise error May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi On instance['server']: May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 0 May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:28:45.577875 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:28:45.583427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:28:45.583427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:28:45.583427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:28:45.583427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:28:45.583427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 21 21:28:45.583427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:45.583427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:45.583427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:45.583427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:45.583427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:45.583427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:45.583427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:28:45.583427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:28:45.583427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 21 21:28:45.583427 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:45.583427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-39a4b62c-efea-44a5-97f5-1090fde630d7 tempest-MultipleCreateNegativeTestJSON-2045787515 tempest-MultipleCreateNegativeTestJSON-2045787515-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:45.583427 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-39a4b62c-efea-44a5-97f5-1090fde630d7 tempest-MultipleCreateNegativeTestJSON-2045787515 tempest-MultipleCreateNegativeTestJSON-2045787515-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016150 May 21 21:28:45.586189 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2209/4285] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:28:45 2022] POST /compute/v2.1/servers => generated 130 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 21 21:28:45.643573 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3e869704-d2a4-445c-a3ea-58b5d16f606d tempest-MultipleCreateNegativeTestJSON-2045787515 tempest-MultipleCreateNegativeTestJSON-2045787515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1350208987", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "min_count": 2.5}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3e869704-d2a4-445c-a3ea-58b5d16f606d tempest-MultipleCreateNegativeTestJSON-2045787515 tempest-MultipleCreateNegativeTestJSON-2045787515-project] Request method failure captured: May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 170 May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVmMLkRfAd2Y4OVOlG7YRob52QqLLSOuYjFB_y6TaVj6p5BB8cRCA02rFnj7PZ7CZn-TvTmWvtRP1eDiMwmMK0_N0cFRI-XdNC4T6Fpujj2-KmXp97lcFXhfW6shZhV9hPZcRfJL2M31H61GEh60dK5MBMebbo6gYNLOkcwVLHfVZq8 May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: c0a9201020d44c77ae0329432d6e8b4c May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2045787515 May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c0a9201020d44c77ae0329432d6e8b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a9201020d44c77ae0329432d6e8b4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c0a9201020d44c77ae0329432d6e8b4c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a9201020d44c77ae0329432d6e8b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2045787515 May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: c0a9201020d44c77ae0329432d6e8b4c May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2045787515 May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-MultipleCreateNegativeTestJSON-2045787515-project May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 0ec41560760d43cd8f79bb70e3fa69fc May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2045787515-project May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1350208987", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "min_count": 2.5}} May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1350208987', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452', 'min_count': 2.5}}} May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise error May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi On instance['server']: May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 2.5 May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:28:45.647682 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:28:45.662672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:28:45.662672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:28:45.662672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:28:45.662672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:28:45.662672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 21 21:28:45.662672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:45.662672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:45.662672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:45.662672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:45.662672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:45.662672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:45.662672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:28:45.662672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:28:45.662672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 21 21:28:45.662672 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:45.662672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3e869704-d2a4-445c-a3ea-58b5d16f606d tempest-MultipleCreateNegativeTestJSON-2045787515 tempest-MultipleCreateNegativeTestJSON-2045787515-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:45.662672 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3e869704-d2a4-445c-a3ea-58b5d16f606d tempest-MultipleCreateNegativeTestJSON-2045787515 tempest-MultipleCreateNegativeTestJSON-2045787515-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.016781 May 21 21:28:45.662672 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2210/4286] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:28:45 2022] POST /compute/v2.1/servers => generated 139 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:28:45.705171 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-be47135e-5b58-4798-bd8a-ec663c253e46 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:45.714649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-be47135e-5b58-4798-bd8a-ec663c253e46 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:45.716312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-be47135e-5b58-4798-bd8a-ec663c253e46 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:45.717600 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-be47135e-5b58-4798-bd8a-ec663c253e46 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 2710 microversion: 2.42 time: 0.445489 May 21 21:28:45.718165 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2077/4287] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:28:45 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 2710 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:28:45.771556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2d220292-e7c0-4996-b1e5-bc314fb3cbdf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:45.772363 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2d220292-e7c0-4996-b1e5-bc314fb3cbdf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:45.794545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2d220292-e7c0-4996-b1e5-bc314fb3cbdf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:45.795083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2d220292-e7c0-4996-b1e5-bc314fb3cbdf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:45.796180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2d220292-e7c0-4996-b1e5-bc314fb3cbdf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:45.798032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2d220292-e7c0-4996-b1e5-bc314fb3cbdf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:45.942049 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2d220292-e7c0-4996-b1e5-bc314fb3cbdf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:45.952754 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2d220292-e7c0-4996-b1e5-bc314fb3cbdf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 200 len: 1287 microversion: 2.1 time: 0.184932 May 21 21:28:45.954158 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2211/4288] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:45 2022] GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 1287 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:46.107627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b22cfe6a-3c43-4b57-8467-63e83141aaca tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:46.109003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b22cfe6a-3c43-4b57-8467-63e83141aaca tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:46.144227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b22cfe6a-3c43-4b57-8467-63e83141aaca tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:46.144227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b22cfe6a-3c43-4b57-8467-63e83141aaca tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:46.144752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b22cfe6a-3c43-4b57-8467-63e83141aaca tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:46.145427 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b22cfe6a-3c43-4b57-8467-63e83141aaca tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:46.477801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cda2f014-2ded-4c3f-b026-117cbe4684b6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:46.480448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cda2f014-2ded-4c3f-b026-117cbe4684b6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:46.492230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cda2f014-2ded-4c3f-b026-117cbe4684b6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:46.493172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cda2f014-2ded-4c3f-b026-117cbe4684b6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:46.494335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cda2f014-2ded-4c3f-b026-117cbe4684b6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:46.495042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cda2f014-2ded-4c3f-b026-117cbe4684b6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:46.876574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b22cfe6a-3c43-4b57-8467-63e83141aaca tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c7728397914d8cbcba42d295d4c265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4583f3b0962e47e7b7b73243db3b0d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:46.886963 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b22cfe6a-3c43-4b57-8467-63e83141aaca tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221" status: 200 len: 1316 microversion: 2.1 time: 0.784423 May 21 21:28:46.898488 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2078/4289] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:46 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221 => generated 1316 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:46.904662 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d8f22824-0167-4592-97e6-8d82e4b0a5ab tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:46.905642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d8f22824-0167-4592-97e6-8d82e4b0a5ab tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:46.917099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8f22824-0167-4592-97e6-8d82e4b0a5ab tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:46.917864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8f22824-0167-4592-97e6-8d82e4b0a5ab tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:46.918953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8f22824-0167-4592-97e6-8d82e4b0a5ab tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:46.919611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8f22824-0167-4592-97e6-8d82e4b0a5ab tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:46.972728 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cda2f014-2ded-4c3f-b026-117cbe4684b6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:46.981251 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cda2f014-2ded-4c3f-b026-117cbe4684b6 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1664 microversion: 2.1 time: 0.510182 May 21 21:28:46.982000 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2212/4290] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:46 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1664 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:46.988536 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fb7cf18d-1a34-4325-b823-bad26b5275b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:46.988536 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fb7cf18d-1a34-4325-b823-bad26b5275b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:46.994331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb7cf18d-1a34-4325-b823-bad26b5275b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:46.995048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb7cf18d-1a34-4325-b823-bad26b5275b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:46.996017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb7cf18d-1a34-4325-b823-bad26b5275b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:46.996681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb7cf18d-1a34-4325-b823-bad26b5275b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:47.089649 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fb7cf18d-1a34-4325-b823-bad26b5275b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:47.110679 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fb7cf18d-1a34-4325-b823-bad26b5275b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 200 len: 1287 microversion: 2.1 time: 0.127368 May 21 21:28:47.111612 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2213/4291] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:46 2022] GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 1287 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:47.235204 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-a3de24a2-5f03-4170-8866-d9093e9b4b4f req-f21ef192-4db5-4fc3-94c2-f307ee2a0a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "name": "network-vif-deleted", "tag": "1a250478-2823-459d-8b34-27d5cf96fda6"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:47.251548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a3de24a2-5f03-4170-8866-d9093e9b4b4f req-f21ef192-4db5-4fc3-94c2-f307ee2a0a43 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:47.252490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a3de24a2-5f03-4170-8866-d9093e9b4b4f req-f21ef192-4db5-4fc3-94c2-f307ee2a0a43 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:47.289380 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a3de24a2-5f03-4170-8866-d9093e9b4b4f req-f21ef192-4db5-4fc3-94c2-f307ee2a0a43 service nova] Creating event network-vif-deleted:1a250478-2823-459d-8b34-27d5cf96fda6 for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:28:47.299779 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-a3de24a2-5f03-4170-8866-d9093e9b4b4f req-f21ef192-4db5-4fc3-94c2-f307ee2a0a43 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068767 May 21 21:28:47.304175 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2214/4292] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:47.316901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d8f22824-0167-4592-97e6-8d82e4b0a5ab tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:47.336104 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d8f22824-0167-4592-97e6-8d82e4b0a5ab tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:47.343161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d8f22824-0167-4592-97e6-8d82e4b0a5ab tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:47.346224 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d8f22824-0167-4592-97e6-8d82e4b0a5ab tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 2506 microversion: 2.42 time: 0.446232 May 21 21:28:47.348714 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2079/4293] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:28:46 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 2506 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:28:47.906697 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-982fb699-d237-41fc-9b25-7ad5c808ba0e tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:47.908052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-982fb699-d237-41fc-9b25-7ad5c808ba0e tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:47.916397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-982fb699-d237-41fc-9b25-7ad5c808ba0e tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:47.917089 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-982fb699-d237-41fc-9b25-7ad5c808ba0e tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:47.918074 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-982fb699-d237-41fc-9b25-7ad5c808ba0e tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:47.918578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-982fb699-d237-41fc-9b25-7ad5c808ba0e tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:47.999147 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b675731e-b3ab-4c87-a7cd-6cf4d30552cb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:48.000809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b675731e-b3ab-4c87-a7cd-6cf4d30552cb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:48.009815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b675731e-b3ab-4c87-a7cd-6cf4d30552cb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:48.011769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b675731e-b3ab-4c87-a7cd-6cf4d30552cb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:48.011769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b675731e-b3ab-4c87-a7cd-6cf4d30552cb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:48.012564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b675731e-b3ab-4c87-a7cd-6cf4d30552cb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:48.259145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-982fb699-d237-41fc-9b25-7ad5c808ba0e tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c7728397914d8cbcba42d295d4c265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4583f3b0962e47e7b7b73243db3b0d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:48.277965 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-982fb699-d237-41fc-9b25-7ad5c808ba0e tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221" status: 200 len: 1506 microversion: 2.1 time: 0.376512 May 21 21:28:48.279219 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2215/4294] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:47 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221 => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:48.284983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5a60ae95-1bbe-4c07-947a-396a5f0263ac tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:48.285916 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5a60ae95-1bbe-4c07-947a-396a5f0263ac tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:48.294268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5a60ae95-1bbe-4c07-947a-396a5f0263ac tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:48.295035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5a60ae95-1bbe-4c07-947a-396a5f0263ac tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:48.296365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5a60ae95-1bbe-4c07-947a-396a5f0263ac tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:48.296997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5a60ae95-1bbe-4c07-947a-396a5f0263ac tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:48.688547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b675731e-b3ab-4c87-a7cd-6cf4d30552cb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:48.702168 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b675731e-b3ab-4c87-a7cd-6cf4d30552cb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.706568 May 21 21:28:48.712318 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2080/4295] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:47 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:48.715290 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dd28a025-3977-4adc-b69b-a0628421d3c6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:48.719056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dd28a025-3977-4adc-b69b-a0628421d3c6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:48.726258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5a60ae95-1bbe-4c07-947a-396a5f0263ac tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:48.736376 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5a60ae95-1bbe-4c07-947a-396a5f0263ac tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 200 len: 1329 microversion: 2.1 time: 0.455150 May 21 21:28:48.738242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd28a025-3977-4adc-b69b-a0628421d3c6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:48.744235 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2216/4296] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:48 2022] GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 1329 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:48.744441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd28a025-3977-4adc-b69b-a0628421d3c6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:48.746738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd28a025-3977-4adc-b69b-a0628421d3c6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:48.747523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd28a025-3977-4adc-b69b-a0628421d3c6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:48.758692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-25110db6-be93-4635-8306-02e103f25f8d tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:48.759325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-25110db6-be93-4635-8306-02e103f25f8d tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:48.778438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-25110db6-be93-4635-8306-02e103f25f8d tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:48.779006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-25110db6-be93-4635-8306-02e103f25f8d tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:48.783178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-25110db6-be93-4635-8306-02e103f25f8d tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:48.783736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-25110db6-be93-4635-8306-02e103f25f8d tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:48.812393 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dd28a025-3977-4adc-b69b-a0628421d3c6 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221/ips" status: 200 len: 110 microversion: 2.1 time: 0.107745 May 21 21:28:48.824794 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2081/4297] 10.222.0.49 () {58 vars in 1247 bytes} [Sat May 21 21:28:48 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221/ips => generated 110 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:48.826511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f449768d-444d-4db0-b2a1-754ad7aea741 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:48.831212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f449768d-444d-4db0-b2a1-754ad7aea741 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:48.844319 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f449768d-444d-4db0-b2a1-754ad7aea741 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:48.850581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f449768d-444d-4db0-b2a1-754ad7aea741 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:48.853510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f449768d-444d-4db0-b2a1-754ad7aea741 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:48.854113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f449768d-444d-4db0-b2a1-754ad7aea741 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:49.130827 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-25110db6-be93-4635-8306-02e103f25f8d tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:49.141883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-25110db6-be93-4635-8306-02e103f25f8d tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:49.143423 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-25110db6-be93-4635-8306-02e103f25f8d tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:49.160008 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-25110db6-be93-4635-8306-02e103f25f8d tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 2345 microversion: 2.42 time: 0.401060 May 21 21:28:49.161414 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2217/4298] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:28:48 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 2345 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:28:49.189392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d35d5f81-3101-409d-b862-3f9a70a6bc41 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:49.190194 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d35d5f81-3101-409d-b862-3f9a70a6bc41 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:49.198342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d35d5f81-3101-409d-b862-3f9a70a6bc41 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:49.198916 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d35d5f81-3101-409d-b862-3f9a70a6bc41 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:49.199839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d35d5f81-3101-409d-b862-3f9a70a6bc41 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:49.200370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d35d5f81-3101-409d-b862-3f9a70a6bc41 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:49.243164 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d35d5f81-3101-409d-b862-3f9a70a6bc41 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221/ips" status: 200 len: 110 microversion: 2.1 time: 0.071522 May 21 21:28:49.248959 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2218/4299] 10.222.0.49 () {58 vars in 1247 bytes} [Sat May 21 21:28:49 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221/ips => generated 110 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:49.254075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6dc61a35-7a64-445e-8331-c0ae6708786b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:49.254564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6dc61a35-7a64-445e-8331-c0ae6708786b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:49.262574 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6dc61a35-7a64-445e-8331-c0ae6708786b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:49.263043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6dc61a35-7a64-445e-8331-c0ae6708786b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:49.264490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6dc61a35-7a64-445e-8331-c0ae6708786b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:49.264952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6dc61a35-7a64-445e-8331-c0ae6708786b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:49.296095 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6dc61a35-7a64-445e-8331-c0ae6708786b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221/ips/tempest-ServerAddressesTestJSON-1024915096-network" status: 200 len: 95 microversion: 2.1 time: 0.045955 May 21 21:28:49.303386 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2219/4300] 10.222.0.49 () {58 vars in 1400 bytes} [Sat May 21 21:28:49 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221/ips/tempest-ServerAddressesTestJSON-1024915096-network => generated 95 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:28:49.322076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c1eac35e-3563-49a7-8677-e95ca79252b9 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:49.322629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c1eac35e-3563-49a7-8677-e95ca79252b9 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:49.334797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1eac35e-3563-49a7-8677-e95ca79252b9 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:49.336382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1eac35e-3563-49a7-8677-e95ca79252b9 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:49.338368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1eac35e-3563-49a7-8677-e95ca79252b9 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:49.339076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1eac35e-3563-49a7-8677-e95ca79252b9 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:49.381763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c1eac35e-3563-49a7-8677-e95ca79252b9 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:28:49.436974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:49.817361 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c1eac35e-3563-49a7-8677-e95ca79252b9 tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221" status: 204 len: 0 microversion: 2.1 time: 0.503238 May 21 21:28:49.819277 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2220/4301] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:28:49 2022] DELETE /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:28:49.826481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-6d206c51-15a3-40ea-91a2-7b5f7d4d2975 req-1aa6d5b5-e2cf-4b0a-93dc-925384a95a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "name": "network-vif-deleted", "tag": "259477b1-cfd2-4e6b-a20e-7bab0eec7c14"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:49.838632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6d206c51-15a3-40ea-91a2-7b5f7d4d2975 req-1aa6d5b5-e2cf-4b0a-93dc-925384a95a1b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:49.839448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6d206c51-15a3-40ea-91a2-7b5f7d4d2975 req-1aa6d5b5-e2cf-4b0a-93dc-925384a95a1b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:49.853838 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-6d206c51-15a3-40ea-91a2-7b5f7d4d2975 req-1aa6d5b5-e2cf-4b0a-93dc-925384a95a1b service nova] Creating event network-vif-deleted:259477b1-cfd2-4e6b-a20e-7bab0eec7c14 for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:28:49.859795 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-6d206c51-15a3-40ea-91a2-7b5f7d4d2975 req-1aa6d5b5-e2cf-4b0a-93dc-925384a95a1b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038538 May 21 21:28:49.861380 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2221/4302] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:49.867481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bdc262f1-18a7-402d-8dfa-2bb711f5ae32 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:49.868612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bdc262f1-18a7-402d-8dfa-2bb711f5ae32 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:49.876918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bdc262f1-18a7-402d-8dfa-2bb711f5ae32 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:49.882618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bdc262f1-18a7-402d-8dfa-2bb711f5ae32 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:49.882618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bdc262f1-18a7-402d-8dfa-2bb711f5ae32 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:49.882618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bdc262f1-18a7-402d-8dfa-2bb711f5ae32 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:50.150555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bdc262f1-18a7-402d-8dfa-2bb711f5ae32 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:50.165785 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bdc262f1-18a7-402d-8dfa-2bb711f5ae32 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 200 len: 1329 microversion: 2.1 time: 0.302912 May 21 21:28:50.166714 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2222/4303] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:49 2022] GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 1329 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:50.171373 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3c1bf888-cb7d-492b-8a91-13ee801c546b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:50.171992 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3c1bf888-cb7d-492b-8a91-13ee801c546b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:50.184379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c1bf888-cb7d-492b-8a91-13ee801c546b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:50.184913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c1bf888-cb7d-492b-8a91-13ee801c546b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:50.185778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c1bf888-cb7d-492b-8a91-13ee801c546b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:50.186327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c1bf888-cb7d-492b-8a91-13ee801c546b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:50.279003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f449768d-444d-4db0-b2a1-754ad7aea741 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:50.293230 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f449768d-444d-4db0-b2a1-754ad7aea741 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 1.472419 May 21 21:28:50.294261 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2082/4304] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:48 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:50.315037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ace9bf93-f38e-40ce-9ff1-d76529d86e99 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:50.316003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ace9bf93-f38e-40ce-9ff1-d76529d86e99 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:50.323937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ace9bf93-f38e-40ce-9ff1-d76529d86e99 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:50.324754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ace9bf93-f38e-40ce-9ff1-d76529d86e99 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:50.325774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ace9bf93-f38e-40ce-9ff1-d76529d86e99 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:50.326436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ace9bf93-f38e-40ce-9ff1-d76529d86e99 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:50.519343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3c1bf888-cb7d-492b-8a91-13ee801c546b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c7728397914d8cbcba42d295d4c265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4583f3b0962e47e7b7b73243db3b0d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:50.535250 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3c1bf888-cb7d-492b-8a91-13ee801c546b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221" status: 200 len: 1512 microversion: 2.1 time: 0.367378 May 21 21:28:50.536441 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2223/4305] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:50 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221 => generated 1512 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:50.557199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6ff3b3b4-c83f-4d6f-a18f-742137f0b524 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:50.557199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6ff3b3b4-c83f-4d6f-a18f-742137f0b524 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:50.563791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ff3b3b4-c83f-4d6f-a18f-742137f0b524 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:50.565228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ff3b3b4-c83f-4d6f-a18f-742137f0b524 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:50.573148 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ff3b3b4-c83f-4d6f-a18f-742137f0b524 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:50.573620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ff3b3b4-c83f-4d6f-a18f-742137f0b524 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:50.625669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:50.662191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=16 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:50.804978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ace9bf93-f38e-40ce-9ff1-d76529d86e99 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:50.813045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6ff3b3b4-c83f-4d6f-a18f-742137f0b524 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:50.829469 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6ff3b3b4-c83f-4d6f-a18f-742137f0b524 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.291307 May 21 21:28:50.840336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ace9bf93-f38e-40ce-9ff1-d76529d86e99 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:50.842360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ace9bf93-f38e-40ce-9ff1-d76529d86e99 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:50.843966 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ace9bf93-f38e-40ce-9ff1-d76529d86e99 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 2231 microversion: 2.42 time: 0.534373 May 21 21:28:50.844101 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2224/4306] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:50 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:50.849917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fc7c023b-af8e-4975-9df9-9f6322f2bfff tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:50.852266 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2083/4307] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:28:50 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 2231 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:28:50.857624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fc7c023b-af8e-4975-9df9-9f6322f2bfff tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:50.873756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc7c023b-af8e-4975-9df9-9f6322f2bfff tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:50.874729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc7c023b-af8e-4975-9df9-9f6322f2bfff tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:50.875618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc7c023b-af8e-4975-9df9-9f6322f2bfff tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:50.876142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc7c023b-af8e-4975-9df9-9f6322f2bfff tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:51.169928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fc7c023b-af8e-4975-9df9-9f6322f2bfff tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:51.180411 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fc7c023b-af8e-4975-9df9-9f6322f2bfff tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.335183 May 21 21:28:51.181678 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2225/4308] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:50 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:51.193862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-98f9e3c5-8f0c-43f8-a816-a88d7027b622 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:51.194510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-98f9e3c5-8f0c-43f8-a816-a88d7027b622 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:51.203143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98f9e3c5-8f0c-43f8-a816-a88d7027b622 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:51.203357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b97c06e3-5fe8-4761-bf49-ff39fbcf199f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:51.204390 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98f9e3c5-8f0c-43f8-a816-a88d7027b622 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:51.204949 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b97c06e3-5fe8-4761-bf49-ff39fbcf199f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:51.205834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98f9e3c5-8f0c-43f8-a816-a88d7027b622 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:51.206497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98f9e3c5-8f0c-43f8-a816-a88d7027b622 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:51.213024 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b97c06e3-5fe8-4761-bf49-ff39fbcf199f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:51.216719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b97c06e3-5fe8-4761-bf49-ff39fbcf199f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:51.216719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b97c06e3-5fe8-4761-bf49-ff39fbcf199f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:51.216719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b97c06e3-5fe8-4761-bf49-ff39fbcf199f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:51.572677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b97c06e3-5fe8-4761-bf49-ff39fbcf199f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:51.584456 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b97c06e3-5fe8-4761-bf49-ff39fbcf199f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.386927 May 21 21:28:51.585058 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2226/4309] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:51 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:51.595684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-95fc4c45-a575-4386-829d-cc19341760ed tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:51.595684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-95fc4c45-a575-4386-829d-cc19341760ed tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:51.601609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-95fc4c45-a575-4386-829d-cc19341760ed tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:51.602490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-95fc4c45-a575-4386-829d-cc19341760ed tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:51.604237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-95fc4c45-a575-4386-829d-cc19341760ed tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:51.605528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-95fc4c45-a575-4386-829d-cc19341760ed tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:51.756803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-98f9e3c5-8f0c-43f8-a816-a88d7027b622 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:51.765908 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-98f9e3c5-8f0c-43f8-a816-a88d7027b622 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 200 len: 1329 microversion: 2.1 time: 0.587133 May 21 21:28:51.772529 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2084/4310] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:51 2022] GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 1329 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:51.778046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cf6a29c9-6bc7-4062-b62e-d44674f1e710 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:51.778814 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cf6a29c9-6bc7-4062-b62e-d44674f1e710 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:51.785084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf6a29c9-6bc7-4062-b62e-d44674f1e710 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:51.785541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf6a29c9-6bc7-4062-b62e-d44674f1e710 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:51.795373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf6a29c9-6bc7-4062-b62e-d44674f1e710 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:51.795373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf6a29c9-6bc7-4062-b62e-d44674f1e710 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:51.819170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:51.825927 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-cf6a29c9-6bc7-4062-b62e-d44674f1e710 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lazy-loading 'flavor' on Instance uuid 168c8024-2cb4-4135-be5d-7a5cfcc6e895 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:28:52.054596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-95fc4c45-a575-4386-829d-cc19341760ed tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c7728397914d8cbcba42d295d4c265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4583f3b0962e47e7b7b73243db3b0d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:52.063216 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-95fc4c45-a575-4386-829d-cc19341760ed tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221" status: 200 len: 1512 microversion: 2.1 time: 0.477065 May 21 21:28:52.069897 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2227/4311] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:51 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221 => generated 1512 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:52.078114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0bb8f894-e5d9-466c-9806-2049e1831860 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:52.078815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0bb8f894-e5d9-466c-9806-2049e1831860 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:52.097416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0bb8f894-e5d9-466c-9806-2049e1831860 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:52.104088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0bb8f894-e5d9-466c-9806-2049e1831860 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:52.104088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0bb8f894-e5d9-466c-9806-2049e1831860 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:52.104088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0bb8f894-e5d9-466c-9806-2049e1831860 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:52.154080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=8 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:52.249677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0bb8f894-e5d9-466c-9806-2049e1831860 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:52.259514 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cf6a29c9-6bc7-4062-b62e-d44674f1e710 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action" status: 202 len: 0 microversion: 2.1 time: 0.485088 May 21 21:28:52.260205 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2085/4312] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:28:51 2022] POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:28:52.262763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0bb8f894-e5d9-466c-9806-2049e1831860 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:52.270016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0bb8f894-e5d9-466c-9806-2049e1831860 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:52.274095 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0bb8f894-e5d9-466c-9806-2049e1831860 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 2163 microversion: 2.42 time: 0.201186 May 21 21:28:52.281932 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2228/4313] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:28:52 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 2163 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:28:52.301273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-a3c909c7-cf48-4035-aceb-bda47712540a req-859cfd8d-7f9c-482d-b5f0-51e58c602ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "638b4559-bdb5-4b51-9b1a-7ce960d0b5ac", "name": "network-vif-deleted", "tag": "fb6fdb78-778e-40f4-b501-95a96aca53fe"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:52.302738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-114be043-6e24-406e-86d7-b42ae6f5afd0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:52.302738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-114be043-6e24-406e-86d7-b42ae6f5afd0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:52.319270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-114be043-6e24-406e-86d7-b42ae6f5afd0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:52.320755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a3c909c7-cf48-4035-aceb-bda47712540a req-859cfd8d-7f9c-482d-b5f0-51e58c602ef4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:52.321236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a3c909c7-cf48-4035-aceb-bda47712540a req-859cfd8d-7f9c-482d-b5f0-51e58c602ef4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:52.322120 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-114be043-6e24-406e-86d7-b42ae6f5afd0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:52.322973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-114be043-6e24-406e-86d7-b42ae6f5afd0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:52.331536 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-114be043-6e24-406e-86d7-b42ae6f5afd0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:52.350755 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-a3c909c7-cf48-4035-aceb-bda47712540a req-859cfd8d-7f9c-482d-b5f0-51e58c602ef4 service nova] Creating event network-vif-deleted:fb6fdb78-778e-40f4-b501-95a96aca53fe for instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac on nch2-master-1 May 21 21:28:52.366093 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-a3c909c7-cf48-4035-aceb-bda47712540a req-859cfd8d-7f9c-482d-b5f0-51e58c602ef4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101370 May 21 21:28:52.368769 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2086/4314] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:52.645498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-894b1829-b5df-4fe8-b818-a934a5d043d0 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1256327954", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "08176959-0fa9-4876-913f-80c4220d484c"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:52.709842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-894b1829-b5df-4fe8-b818-a934a5d043d0 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] validate_networks() for [('08176959-0fa9-4876-913f-80c4220d484c', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:28:53.103929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-114be043-6e24-406e-86d7-b42ae6f5afd0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:53.131877 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-114be043-6e24-406e-86d7-b42ae6f5afd0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1676 microversion: 2.1 time: 0.832026 May 21 21:28:53.131877 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2229/4315] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:52 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1676 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:53.149884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aa4afa45-34ee-4e89-81f2-8ed043b50012 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:53.160494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aa4afa45-34ee-4e89-81f2-8ed043b50012 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:53.182236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa4afa45-34ee-4e89-81f2-8ed043b50012 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:53.183468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa4afa45-34ee-4e89-81f2-8ed043b50012 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:53.185911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa4afa45-34ee-4e89-81f2-8ed043b50012 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:53.186368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa4afa45-34ee-4e89-81f2-8ed043b50012 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:53.672942 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-894b1829-b5df-4fe8-b818-a934a5d043d0 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:28:53.674124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-894b1829-b5df-4fe8-b818-a934a5d043d0 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:28:53.674848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-894b1829-b5df-4fe8-b818-a934a5d043d0 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:28:53.676239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-894b1829-b5df-4fe8-b818-a934a5d043d0 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:28:53.677411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-894b1829-b5df-4fe8-b818-a934a5d043d0 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:28:53.691230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-894b1829-b5df-4fe8-b818-a934a5d043d0 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:53.695089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-894b1829-b5df-4fe8-b818-a934a5d043d0 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:53.695995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-894b1829-b5df-4fe8-b818-a934a5d043d0 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:53.696482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-894b1829-b5df-4fe8-b818-a934a5d043d0 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:53.718563 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-894b1829-b5df-4fe8-b818-a934a5d043d0 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Getting quotas for project 54936b67ff8842008c37ef8588add58f. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:28:53.720079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:53.725377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-894b1829-b5df-4fe8-b818-a934a5d043d0 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Getting quotas for user 8b1346a00d2f4c6898144f51eca037f0 and project 54936b67ff8842008c37ef8588add58f. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:28:53.742074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-894b1829-b5df-4fe8-b818-a934a5d043d0 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:28:53.744602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-894b1829-b5df-4fe8-b818-a934a5d043d0 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:28:53.908468 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-894b1829-b5df-4fe8-b818-a934a5d043d0 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.538453 May 21 21:28:53.909771 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2087/4316] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:28:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:28:53.915145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a8eea0ec-7139-4863-bc79-77da85f779ab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:53.915980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a8eea0ec-7139-4863-bc79-77da85f779ab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:53.924046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a8eea0ec-7139-4863-bc79-77da85f779ab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:53.924529 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a8eea0ec-7139-4863-bc79-77da85f779ab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:53.925325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a8eea0ec-7139-4863-bc79-77da85f779ab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:53.925773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a8eea0ec-7139-4863-bc79-77da85f779ab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:53.976426 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a8eea0ec-7139-4863-bc79-77da85f779ab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:53.977598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a8eea0ec-7139-4863-bc79-77da85f779ab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:53.978167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-a8eea0ec-7139-4863-bc79-77da85f779ab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lazy-loading 'fault' on Instance uuid f6a45a12-08af-442d-b526-cf5f30594221 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:28:54.012938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aa4afa45-34ee-4e89-81f2-8ed043b50012 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:54.024491 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aa4afa45-34ee-4e89-81f2-8ed043b50012 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 200 len: 1329 microversion: 2.1 time: 0.890989 May 21 21:28:54.033882 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2230/4317] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:53 2022] GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 1329 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:54.033882 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-cc611595-66aa-4078-ad34-77754d4aab51 req-57fe6bdc-f239-4b24-acff-f8dbf4cb3c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a45a12-08af-442d-b526-cf5f30594221", "name": "network-vif-deleted", "tag": "eba143c2-fb38-49dc-acaf-06425d78f15c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:54.049181 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cc611595-66aa-4078-ad34-77754d4aab51 req-57fe6bdc-f239-4b24-acff-f8dbf4cb3c3a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:54.050523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cc611595-66aa-4078-ad34-77754d4aab51 req-57fe6bdc-f239-4b24-acff-f8dbf4cb3c3a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:54.055561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a8eea0ec-7139-4863-bc79-77da85f779ab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c7728397914d8cbcba42d295d4c265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4583f3b0962e47e7b7b73243db3b0d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:54.063908 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a8eea0ec-7139-4863-bc79-77da85f779ab tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221" status: 200 len: 1306 microversion: 2.1 time: 0.152797 May 21 21:28:54.065130 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2088/4318] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:53 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221 => generated 1306 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:54.067626 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-cc611595-66aa-4078-ad34-77754d4aab51 req-57fe6bdc-f239-4b24-acff-f8dbf4cb3c3a service nova] Creating event network-vif-deleted:eba143c2-fb38-49dc-acaf-06425d78f15c for instance f6a45a12-08af-442d-b526-cf5f30594221 on nch1-master-1 May 21 21:28:54.070888 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-06e429e7-0423-4a30-8581-dcf49748b1d4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:54.071771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-06e429e7-0423-4a30-8581-dcf49748b1d4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:54.074179 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-cc611595-66aa-4078-ad34-77754d4aab51 req-57fe6bdc-f239-4b24-acff-f8dbf4cb3c3a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045576 May 21 21:28:54.075270 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2231/4319] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:54.078233 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06e429e7-0423-4a30-8581-dcf49748b1d4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:54.078924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06e429e7-0423-4a30-8581-dcf49748b1d4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:54.079999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06e429e7-0423-4a30-8581-dcf49748b1d4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:54.080692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06e429e7-0423-4a30-8581-dcf49748b1d4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:54.081627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7a14c13b-4cf1-4da1-9f95-9a79fe3172f7 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:54.083457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7a14c13b-4cf1-4da1-9f95-9a79fe3172f7 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:54.125837 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06e429e7-0423-4a30-8581-dcf49748b1d4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:54.125837 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06e429e7-0423-4a30-8581-dcf49748b1d4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:54.125837 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-06e429e7-0423-4a30-8581-dcf49748b1d4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lazy-loading 'fault' on Instance uuid 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:28:54.189793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-06e429e7-0423-4a30-8581-dcf49748b1d4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:54.204011 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-06e429e7-0423-4a30-8581-dcf49748b1d4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:54.208888 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-06e429e7-0423-4a30-8581-dcf49748b1d4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4f720a68014a829929d6586cd9154d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dca17b0239494f9e8effb6d535311f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:54.211846 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-06e429e7-0423-4a30-8581-dcf49748b1d4 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 200 len: 1371 microversion: 2.42 time: 0.143874 May 21 21:28:54.211846 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2089/4320] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:28:54 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:28:54.225418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7a14c13b-4cf1-4da1-9f95-9a79fe3172f7 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1346a00d2f4c6898144f51eca037f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54936b67ff8842008c37ef8588add58f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:54.225592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-71863587-bcb4-4cd1-9069-ccb1f43d3b6f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:54.226156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-71863587-bcb4-4cd1-9069-ccb1f43d3b6f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:54.233167 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7a14c13b-4cf1-4da1-9f95-9a79fe3172f7 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] 10.222.0.49 "GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701" status: 200 len: 1216 microversion: 2.1 time: 0.156258 May 21 21:28:54.234287 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2232/4321] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:54 2022] GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701 => generated 1216 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:54.245124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71863587-bcb4-4cd1-9069-ccb1f43d3b6f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:54.248893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71863587-bcb4-4cd1-9069-ccb1f43d3b6f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:54.249751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71863587-bcb4-4cd1-9069-ccb1f43d3b6f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:54.250202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71863587-bcb4-4cd1-9069-ccb1f43d3b6f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:54.386878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-ec006058-c3ab-4cbc-9d43-8c138ef6c5d8 req-1e237480-e9ea-4422-91af-96567bc2254b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dff940b-adb6-40c4-a7a0-e6088b0a20be", "tag": "66860b02-36d2-4968-b58a-061a84f4d1eb"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:54.406541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ec006058-c3ab-4cbc-9d43-8c138ef6c5d8 req-1e237480-e9ea-4422-91af-96567bc2254b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:54.407000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ec006058-c3ab-4cbc-9d43-8c138ef6c5d8 req-1e237480-e9ea-4422-91af-96567bc2254b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:54.429371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-71863587-bcb4-4cd1-9069-ccb1f43d3b6f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:54.429501 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-ec006058-c3ab-4cbc-9d43-8c138ef6c5d8 req-1e237480-e9ea-4422-91af-96567bc2254b service nova] Creating event network-changed:66860b02-36d2-4968-b58a-061a84f4d1eb for instance 7dff940b-adb6-40c4-a7a0-e6088b0a20be on nch1-master-1 May 21 21:28:54.429604 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-71863587-bcb4-4cd1-9069-ccb1f43d3b6f tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1659 microversion: 2.1 time: 0.216282 May 21 21:28:54.429604 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2090/4322] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:54 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1659 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:54.432311 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-ec006058-c3ab-4cbc-9d43-8c138ef6c5d8 req-1e237480-e9ea-4422-91af-96567bc2254b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048933 May 21 21:28:54.433160 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2233/4323] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:28:54.446407 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-17299b2d-9bba-42b1-a09c-f7e7ee3f5a5c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:54.446961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-17299b2d-9bba-42b1-a09c-f7e7ee3f5a5c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:54.454865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17299b2d-9bba-42b1-a09c-f7e7ee3f5a5c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:54.455326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17299b2d-9bba-42b1-a09c-f7e7ee3f5a5c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:54.460601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17299b2d-9bba-42b1-a09c-f7e7ee3f5a5c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:54.460601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17299b2d-9bba-42b1-a09c-f7e7ee3f5a5c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:54.920186 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-17299b2d-9bba-42b1-a09c-f7e7ee3f5a5c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action" status: 202 len: 0 microversion: 2.1 time: 0.478592 May 21 21:28:54.924796 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2091/4324] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:28:54 2022] POST /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:28:54.934464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-57cf496e-caf1-4877-9e49-348599c06740 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:54.934960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-57cf496e-caf1-4877-9e49-348599c06740 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:54.945699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:54.950631 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57cf496e-caf1-4877-9e49-348599c06740 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:54.951087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57cf496e-caf1-4877-9e49-348599c06740 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:54.951935 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57cf496e-caf1-4877-9e49-348599c06740 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:54.952396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57cf496e-caf1-4877-9e49-348599c06740 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:55.051788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f7997890-5f59-41b0-bb51-b1122cce64d7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:55.055987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f7997890-5f59-41b0-bb51-b1122cce64d7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:55.090037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f7997890-5f59-41b0-bb51-b1122cce64d7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:55.092642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f7997890-5f59-41b0-bb51-b1122cce64d7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:55.093521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f7997890-5f59-41b0-bb51-b1122cce64d7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:55.094716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f7997890-5f59-41b0-bb51-b1122cce64d7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:55.175319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-57cf496e-caf1-4877-9e49-348599c06740 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:55.190977 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-57cf496e-caf1-4877-9e49-348599c06740 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1665 microversion: 2.1 time: 0.264757 May 21 21:28:55.202723 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2234/4325] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:54 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1665 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:55.210912 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f2ae91e9-2c8c-41b8-b432-85f36db2240b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:55.213634 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f2ae91e9-2c8c-41b8-b432-85f36db2240b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:55.231785 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2ae91e9-2c8c-41b8-b432-85f36db2240b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:55.235921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2ae91e9-2c8c-41b8-b432-85f36db2240b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:55.235921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2ae91e9-2c8c-41b8-b432-85f36db2240b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:55.235921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2ae91e9-2c8c-41b8-b432-85f36db2240b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:55.293479 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2ae91e9-2c8c-41b8-b432-85f36db2240b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:55.293647 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2ae91e9-2c8c-41b8-b432-85f36db2240b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:55.294100 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-f2ae91e9-2c8c-41b8-b432-85f36db2240b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lazy-loading 'fault' on Instance uuid f6a45a12-08af-442d-b526-cf5f30594221 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:28:55.440655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f2ae91e9-2c8c-41b8-b432-85f36db2240b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c7728397914d8cbcba42d295d4c265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4583f3b0962e47e7b7b73243db3b0d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:55.449065 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f2ae91e9-2c8c-41b8-b432-85f36db2240b tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221" status: 200 len: 1306 microversion: 2.1 time: 0.245102 May 21 21:28:55.450273 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2235/4326] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:55 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221 => generated 1306 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:55.461944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fcc961e2-df52-4888-bbb8-40ab26b3d2e7 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:55.462803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fcc961e2-df52-4888-bbb8-40ab26b3d2e7 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] [instance: 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:55.475682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fcc961e2-df52-4888-bbb8-40ab26b3d2e7 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:55.475682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fcc961e2-df52-4888-bbb8-40ab26b3d2e7 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:55.475682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fcc961e2-df52-4888-bbb8-40ab26b3d2e7 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:55.475682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fcc961e2-df52-4888-bbb8-40ab26b3d2e7 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:55.479444 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f7997890-5f59-41b0-bb51-b1122cce64d7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:55.489931 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-fcc961e2-df52-4888-bbb8-40ab26b3d2e7 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] HTTP exception thrown: Instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac could not be found. May 21 21:28:55.490810 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f7997890-5f59-41b0-bb51-b1122cce64d7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 200 len: 1329 microversion: 2.1 time: 0.452847 May 21 21:28:55.491506 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2092/4327] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:55 2022] GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 1329 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fcc961e2-df52-4888-bbb8-40ab26b3d2e7 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Request method failure captured: May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac HTTP/1.1 May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVdpeKhtxZE2bhTF4TRnutnO6dJIR4MiJzkpMORPZknib6BqZby0IvoITOGGoU1OKY84502LCF0eQa8Qif3J6w13RimiFcsVqzkq9-5fcycoRr9t8eJnLf8CPkumincF3p8fdGNzxOZ8gro6w20HpGzfjpjEZyw7KIair0jUIzPeOGg May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: X-Openstack-Nova-Api-Version: 2.42 May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 60dca17b0239494f9e8effb6d535311f May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-392404299 May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/60dca17b0239494f9e8effb6d535311f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/60dca17b0239494f9e8effb6d535311f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_60dca17b0239494f9e8effb6d535311f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/60dca17b0239494f9e8effb6d535311f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-TaggedBootDevicesTest_v242-392404299 May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 60dca17b0239494f9e8effb6d535311f May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-392404299 May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-TaggedBootDevicesTest_v242-392404299-project May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 3d4f720a68014a829929d6586cd9154d May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-TaggedBootDevicesTest_v242-392404299-project May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac could not be found. May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '638b4559-bdb5-4b51-9b1a-7ce960d0b5ac'} May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac could not be found. May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac could not be found. May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:55.492717 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:55.498435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:55.498435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:55.498435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:55.498435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:55.498435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:28:55.498435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:28:55.498435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac could not be found. May 21 21:28:55.498435 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:28:55.500015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fcc961e2-df52-4888-bbb8-40ab26b3d2e7 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Returning 404 to user: Instance 638b4559-bdb5-4b51-9b1a-7ce960d0b5ac could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:55.501364 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fcc961e2-df52-4888-bbb8-40ab26b3d2e7 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac" status: 404 len: 111 microversion: 2.42 time: 0.049838 May 21 21:28:55.503691 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2236/4328] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:28:55 2022] GET /compute/v2.1/servers/638b4559-bdb5-4b51-9b1a-7ce960d0b5ac => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:28:55.506412 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d62ed05e-83a3-48a1-a48d-57e2dae552c8 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:55.528943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d62ed05e-83a3-48a1-a48d-57e2dae552c8 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:55.534947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e94432c2-9319-4b50-8a78-6894dbbbfb74 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] Calling method '.version_select at 0x7fc81a4e1310>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:55.649558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d62ed05e-83a3-48a1-a48d-57e2dae552c8 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1346a00d2f4c6898144f51eca037f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54936b67ff8842008c37ef8588add58f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:55.655606 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e94432c2-9319-4b50-8a78-6894dbbbfb74 tempest-TaggedBootDevicesTest_v242-392404299 tempest-TaggedBootDevicesTest_v242-392404299-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-973765525" status: 204 len: 0 microversion: 2.42 time: 0.125264 May 21 21:28:55.656245 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2237/4329] 10.222.0.49 () {60 vars in 1258 bytes} [Sat May 21 21:28:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-973765525 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 21 21:28:55.671675 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d62ed05e-83a3-48a1-a48d-57e2dae552c8 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] 10.222.0.49 "GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701" status: 200 len: 1216 microversion: 2.1 time: 0.172091 May 21 21:28:55.671675 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2093/4330] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:55 2022] GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701 => generated 1216 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:56.212629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ebe96d35-ba78-477e-9bb3-d2837e7f6bce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:56.213254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ebe96d35-ba78-477e-9bb3-d2837e7f6bce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:56.243675 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebe96d35-ba78-477e-9bb3-d2837e7f6bce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:56.244853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebe96d35-ba78-477e-9bb3-d2837e7f6bce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:56.247077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebe96d35-ba78-477e-9bb3-d2837e7f6bce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:56.248829 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebe96d35-ba78-477e-9bb3-d2837e7f6bce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:56.469237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5633da7b-a460-495d-a2e8-175247aa15ec tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:56.477636 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5633da7b-a460-495d-a2e8-175247aa15ec tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] [instance: f6a45a12-08af-442d-b526-cf5f30594221] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:56.482345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5633da7b-a460-495d-a2e8-175247aa15ec tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:56.483790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5633da7b-a460-495d-a2e8-175247aa15ec tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:56.485150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5633da7b-a460-495d-a2e8-175247aa15ec tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:56.485835 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5633da7b-a460-495d-a2e8-175247aa15ec tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:56.503302 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-5633da7b-a460-495d-a2e8-175247aa15ec tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] HTTP exception thrown: Instance f6a45a12-08af-442d-b526-cf5f30594221 could not be found. May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5633da7b-a460-495d-a2e8-175247aa15ec tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Request method failure captured: May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221 HTTP/1.1 May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVl79gefJttBMr3EcbHgTuBdRRHT3_NiWIxd9ZgquslPbxCeAAnRZUnWaufhGXC3W-iJJkmRtUHPbhEKQqYe19Rh6dyUpDJtg74_7U9psoJXIhifkQALKhpJT_rh41QVoo8RAHU2FojgbLeEPkrRK8kGik63BIlNVqE1QjXtw0Ynzqo May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 4583f3b0962e47e7b7b73243db3b0d4a May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerAddressesTestJSON-594246847 May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4583f3b0962e47e7b7b73243db3b0d4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4583f3b0962e47e7b7b73243db3b0d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4583f3b0962e47e7b7b73243db3b0d4a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4583f3b0962e47e7b7b73243db3b0d4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerAddressesTestJSON-594246847 May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 4583f3b0962e47e7b7b73243db3b0d4a May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerAddressesTestJSON-594246847 May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerAddressesTestJSON-594246847-project May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 00c7728397914d8cbcba42d295d4c265 May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerAddressesTestJSON-594246847-project May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance f6a45a12-08af-442d-b526-cf5f30594221 could not be found. May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'f6a45a12-08af-442d-b526-cf5f30594221'} May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6a45a12-08af-442d-b526-cf5f30594221 could not be found. May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6a45a12-08af-442d-b526-cf5f30594221 could not be found. May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:28:56.505855 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:56.511348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:28:56.511348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:28:56.511348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:28:56.511348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:28:56.511348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:28:56.511348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6a45a12-08af-442d-b526-cf5f30594221 could not be found. May 21 21:28:56.511348 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:28:56.511348 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5633da7b-a460-495d-a2e8-175247aa15ec tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] Returning 404 to user: Instance f6a45a12-08af-442d-b526-cf5f30594221 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:28:56.512358 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5633da7b-a460-495d-a2e8-175247aa15ec tempest-ServerAddressesTestJSON-594246847 tempest-ServerAddressesTestJSON-594246847-project] 10.222.0.49 "GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221" status: 404 len: 111 microversion: 2.1 time: 0.048460 May 21 21:28:56.513523 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2094/4331] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:56 2022] GET /compute/v2.1/servers/f6a45a12-08af-442d-b526-cf5f30594221 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:28:56.521475 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8c54a241-3191-4765-a0a9-57a0859eb6f5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:56.524244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8c54a241-3191-4765-a0a9-57a0859eb6f5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:56.530033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c54a241-3191-4765-a0a9-57a0859eb6f5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:56.530728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c54a241-3191-4765-a0a9-57a0859eb6f5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:56.531699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c54a241-3191-4765-a0a9-57a0859eb6f5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:56.532331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c54a241-3191-4765-a0a9-57a0859eb6f5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:56.584057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ebe96d35-ba78-477e-9bb3-d2837e7f6bce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:56.601616 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ebe96d35-ba78-477e-9bb3-d2837e7f6bce tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1665 microversion: 2.1 time: 0.394873 May 21 21:28:56.604663 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2238/4332] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:56 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1665 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:56.685768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-454a26dc-d4f7-47a6-b7e3-7f3db7bcc283 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:56.686571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-454a26dc-d4f7-47a6-b7e3-7f3db7bcc283 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:56.696446 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-454a26dc-d4f7-47a6-b7e3-7f3db7bcc283 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:56.697137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-454a26dc-d4f7-47a6-b7e3-7f3db7bcc283 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:56.698092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-454a26dc-d4f7-47a6-b7e3-7f3db7bcc283 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:56.698669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-454a26dc-d4f7-47a6-b7e3-7f3db7bcc283 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:56.795162 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-454a26dc-d4f7-47a6-b7e3-7f3db7bcc283 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1346a00d2f4c6898144f51eca037f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54936b67ff8842008c37ef8588add58f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:56.816467 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-454a26dc-d4f7-47a6-b7e3-7f3db7bcc283 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] 10.222.0.49 "GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701" status: 200 len: 1268 microversion: 2.1 time: 0.135332 May 21 21:28:56.817798 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2239/4333] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:56 2022] GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701 => generated 1268 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:56.838793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8c54a241-3191-4765-a0a9-57a0859eb6f5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:56.846393 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8c54a241-3191-4765-a0a9-57a0859eb6f5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 200 len: 1329 microversion: 2.1 time: 0.331350 May 21 21:28:56.847492 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2095/4334] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:56 2022] GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 1329 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:57.549641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-fcba5dd9-558f-4af7-8db0-46551fd750d0 req-456cd365-1f50-4e3a-ba86-b4f29a045672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dff940b-adb6-40c4-a7a0-e6088b0a20be", "name": "network-vif-plugged", "status": "completed", "tag": "66860b02-36d2-4968-b58a-061a84f4d1eb"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:28:57.569804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-fcba5dd9-558f-4af7-8db0-46551fd750d0 req-456cd365-1f50-4e3a-ba86-b4f29a045672 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:57.569804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-fcba5dd9-558f-4af7-8db0-46551fd750d0 req-456cd365-1f50-4e3a-ba86-b4f29a045672 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:57.585300 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-fcba5dd9-558f-4af7-8db0-46551fd750d0 req-456cd365-1f50-4e3a-ba86-b4f29a045672 service nova] Creating event network-vif-plugged:66860b02-36d2-4968-b58a-061a84f4d1eb for instance 7dff940b-adb6-40c4-a7a0-e6088b0a20be on nch1-master-1 May 21 21:28:57.590921 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-fcba5dd9-558f-4af7-8db0-46551fd750d0 req-456cd365-1f50-4e3a-ba86-b4f29a045672 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047730 May 21 21:28:57.591923 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2240/4335] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:28:57.620226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d84f80fe-346f-4c25-a460-a334e8e59d6c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:57.621032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d84f80fe-346f-4c25-a460-a334e8e59d6c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:57.631059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d84f80fe-346f-4c25-a460-a334e8e59d6c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:57.631572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d84f80fe-346f-4c25-a460-a334e8e59d6c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:57.632886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d84f80fe-346f-4c25-a460-a334e8e59d6c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:57.635289 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d84f80fe-346f-4c25-a460-a334e8e59d6c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:57.835028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-87e6a7ef-0407-4be0-96e2-59d296b6772e tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:57.835736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-87e6a7ef-0407-4be0-96e2-59d296b6772e tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:57.853096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87e6a7ef-0407-4be0-96e2-59d296b6772e tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:57.853904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87e6a7ef-0407-4be0-96e2-59d296b6772e tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:57.854905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87e6a7ef-0407-4be0-96e2-59d296b6772e tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:57.855534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87e6a7ef-0407-4be0-96e2-59d296b6772e tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:57.888196 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:57.964423 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-87e6a7ef-0407-4be0-96e2-59d296b6772e tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1346a00d2f4c6898144f51eca037f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54936b67ff8842008c37ef8588add58f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:57.973504 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d84f80fe-346f-4c25-a460-a334e8e59d6c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:57.973679 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-87e6a7ef-0407-4be0-96e2-59d296b6772e tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] 10.222.0.49 "GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701" status: 200 len: 1274 microversion: 2.1 time: 0.142585 May 21 21:28:57.974762 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2241/4336] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:57 2022] GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701 => generated 1274 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:57.987553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7c45f124-7f46-48ca-8327-64acb30fb82b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:57.988106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7c45f124-7f46-48ca-8327-64acb30fb82b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:57.993957 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d84f80fe-346f-4c25-a460-a334e8e59d6c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.378030 May 21 21:28:57.995707 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2096/4337] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:57 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:58.003861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c45f124-7f46-48ca-8327-64acb30fb82b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:58.004611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c45f124-7f46-48ca-8327-64acb30fb82b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:58.007152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c45f124-7f46-48ca-8327-64acb30fb82b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:58.007873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c45f124-7f46-48ca-8327-64acb30fb82b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:58.019718 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-66fc3b7c-e75c-4042-9777-a9b98d028fad tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:58.034926 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-66fc3b7c-e75c-4042-9777-a9b98d028fad tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:58.054849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66fc3b7c-e75c-4042-9777-a9b98d028fad tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:58.055313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66fc3b7c-e75c-4042-9777-a9b98d028fad tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:58.056105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66fc3b7c-e75c-4042-9777-a9b98d028fad tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:58.056581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66fc3b7c-e75c-4042-9777-a9b98d028fad tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:58.267300 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7c45f124-7f46-48ca-8327-64acb30fb82b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:58.284507 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7c45f124-7f46-48ca-8327-64acb30fb82b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 200 len: 1329 microversion: 2.1 time: 0.308941 May 21 21:28:58.285831 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2242/4338] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:57 2022] GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 1329 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:58.806371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-66fc3b7c-e75c-4042-9777-a9b98d028fad tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:58.818967 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-66fc3b7c-e75c-4042-9777-a9b98d028fad tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1668 microversion: 2.1 time: 0.809783 May 21 21:28:58.821883 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2097/4339] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:58 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1668 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:28:58.873515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5c92e1e3-760a-4065-9622-9a57fa01d757 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:58.874596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5c92e1e3-760a-4065-9622-9a57fa01d757 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:58.884884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c92e1e3-760a-4065-9622-9a57fa01d757 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:58.886728 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c92e1e3-760a-4065-9622-9a57fa01d757 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:58.888739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c92e1e3-760a-4065-9622-9a57fa01d757 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:58.890581 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c92e1e3-760a-4065-9622-9a57fa01d757 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:58.960119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5c92e1e3-760a-4065-9622-9a57fa01d757 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:28:58.967208 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.compute.api [None req-5c92e1e3-760a-4065-9622-9a57fa01d757 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Working on deleting snapshot 1e5c3237-fd0c-49f4-a6da-b2e9d304c04f from shelved instance... May 21 21:28:58.991662 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c8260a51-4a41-49ef-b24b-261a18d40b3f tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:58.992720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c8260a51-4a41-49ef-b24b-261a18d40b3f tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:59.000752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8260a51-4a41-49ef-b24b-261a18d40b3f tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:59.001213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8260a51-4a41-49ef-b24b-261a18d40b3f tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:59.002334 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8260a51-4a41-49ef-b24b-261a18d40b3f tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:59.005088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8260a51-4a41-49ef-b24b-261a18d40b3f tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:59.367483 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c8260a51-4a41-49ef-b24b-261a18d40b3f tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1346a00d2f4c6898144f51eca037f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54936b67ff8842008c37ef8588add58f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:59.375685 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c8260a51-4a41-49ef-b24b-261a18d40b3f tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] 10.222.0.49 "GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701" status: 200 len: 1274 microversion: 2.1 time: 0.388264 May 21 21:28:59.377161 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2098/4340] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:58 2022] GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701 => generated 1274 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:28:59.390506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a6c947dd-0f9e-4c73-a1bb-db8b2826bbfd tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:28:59.391257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a6c947dd-0f9e-4c73-a1bb-db8b2826bbfd tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:28:59.403856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a6c947dd-0f9e-4c73-a1bb-db8b2826bbfd tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:59.409884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a6c947dd-0f9e-4c73-a1bb-db8b2826bbfd tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:59.409884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a6c947dd-0f9e-4c73-a1bb-db8b2826bbfd tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:28:59.409884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a6c947dd-0f9e-4c73-a1bb-db8b2826bbfd tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:28:59.577954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a6c947dd-0f9e-4c73-a1bb-db8b2826bbfd tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:28:59.592780 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a6c947dd-0f9e-4c73-a1bb-db8b2826bbfd tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 200 len: 1329 microversion: 2.1 time: 0.207849 May 21 21:28:59.595820 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2099/4341] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:28:59 2022] GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 1329 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:00.410602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aae483cc-381f-4077-9e9a-525d69f70570 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:00.410602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-aae483cc-381f-4077-9e9a-525d69f70570 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:00.414805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aae483cc-381f-4077-9e9a-525d69f70570 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:00.415605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aae483cc-381f-4077-9e9a-525d69f70570 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:00.417587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aae483cc-381f-4077-9e9a-525d69f70570 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:00.418285 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aae483cc-381f-4077-9e9a-525d69f70570 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:00.728418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-aae483cc-381f-4077-9e9a-525d69f70570 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1346a00d2f4c6898144f51eca037f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54936b67ff8842008c37ef8588add58f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:00.735576 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-aae483cc-381f-4077-9e9a-525d69f70570 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] 10.222.0.49 "GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701" status: 200 len: 1316 microversion: 2.1 time: 0.346382 May 21 21:29:00.736165 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2100/4342] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:00 2022] GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701 => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:29:00.757362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dc06c2dc-238f-4c43-8555-5b217706c6bf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:00.757994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dc06c2dc-238f-4c43-8555-5b217706c6bf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:00.774539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc06c2dc-238f-4c43-8555-5b217706c6bf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:00.774818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc06c2dc-238f-4c43-8555-5b217706c6bf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:00.775584 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc06c2dc-238f-4c43-8555-5b217706c6bf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:00.781209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc06c2dc-238f-4c43-8555-5b217706c6bf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:00.908131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5c92e1e3-760a-4065-9622-9a57fa01d757 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Doing local delete in cell 4f046ce9-ac6c-44d8-b1fb-b7063eef06e7(cell1) {{(pid=131277) _delete /opt/stack/nova/nova/compute/api.py:2489}} May 21 21:29:00.912560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c92e1e3-760a-4065-9622-9a57fa01d757 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:00.913753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c92e1e3-760a-4065-9622-9a57fa01d757 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:00.914606 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.compute.api [None req-5c92e1e3-760a-4065-9622-9a57fa01d757 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. May 21 21:29:00.928204 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-5c92e1e3-760a-4065-9622-9a57fa01d757 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] deallocate_for_instance() {{(pid=131277) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} May 21 21:29:01.140794 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dc06c2dc-238f-4c43-8555-5b217706c6bf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:01.145688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:01.154594 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dc06c2dc-238f-4c43-8555-5b217706c6bf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 200 len: 1510 microversion: 2.1 time: 0.417374 May 21 21:29:01.156061 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2101/4343] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:00 2022] GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 1510 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:01.180964 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-268a119f-6191-4ae8-a593-807b3f287151 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:01.202145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-268a119f-6191-4ae8-a593-807b3f287151 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:01.226164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-268a119f-6191-4ae8-a593-807b3f287151 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:01.226761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-268a119f-6191-4ae8-a593-807b3f287151 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:01.240925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-268a119f-6191-4ae8-a593-807b3f287151 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:01.241811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-268a119f-6191-4ae8-a593-807b3f287151 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:01.623198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-268a119f-6191-4ae8-a593-807b3f287151 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:01.631260 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-268a119f-6191-4ae8-a593-807b3f287151 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 200 len: 1510 microversion: 2.1 time: 0.459786 May 21 21:29:01.635021 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2102/4344] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:01 2022] GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 1510 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:29:01.644431 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-495b3d05-22e2-499d-b49d-0b12d6f2579e req-2d8815ec-5eb7-4683-be28-8c1218927afa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95283bb8-0420-4ecf-bff1-b15ae04db701", "tag": "82353255-b2e8-4550-a4d1-d2cb6151862f"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:01.663898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-495b3d05-22e2-499d-b49d-0b12d6f2579e req-2d8815ec-5eb7-4683-be28-8c1218927afa service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:01.664889 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-495b3d05-22e2-499d-b49d-0b12d6f2579e req-2d8815ec-5eb7-4683-be28-8c1218927afa service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:01.682130 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-495b3d05-22e2-499d-b49d-0b12d6f2579e req-2d8815ec-5eb7-4683-be28-8c1218927afa service nova] Creating event network-changed:82353255-b2e8-4550-a4d1-d2cb6151862f for instance 95283bb8-0420-4ecf-bff1-b15ae04db701 on nch2-master-1 May 21 21:29:01.688516 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-495b3d05-22e2-499d-b49d-0b12d6f2579e req-2d8815ec-5eb7-4683-be28-8c1218927afa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051761 May 21 21:29:01.695456 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2103/4345] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:29:01.701775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7366ef23-f6e3-4481-86e3-2e325cc49ba2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:01.702377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7366ef23-f6e3-4481-86e3-2e325cc49ba2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:01.748763 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7366ef23-f6e3-4481-86e3-2e325cc49ba2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:01.749530 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7366ef23-f6e3-4481-86e3-2e325cc49ba2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:01.750944 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7366ef23-f6e3-4481-86e3-2e325cc49ba2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:01.751843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7366ef23-f6e3-4481-86e3-2e325cc49ba2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:01.797077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7366ef23-f6e3-4481-86e3-2e325cc49ba2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:29:02.165382 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7366ef23-f6e3-4481-86e3-2e325cc49ba2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 204 len: 0 microversion: 2.1 time: 0.467904 May 21 21:29:02.166191 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2104/4346] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:29:01 2022] DELETE /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:29:02.174382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-996f5a3c-7f89-4f76-8a02-8f105da2e6b9 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:02.177348 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-996f5a3c-7f89-4f76-8a02-8f105da2e6b9 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:02.188181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-996f5a3c-7f89-4f76-8a02-8f105da2e6b9 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:02.189506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-996f5a3c-7f89-4f76-8a02-8f105da2e6b9 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:02.192361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-996f5a3c-7f89-4f76-8a02-8f105da2e6b9 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:02.194499 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-996f5a3c-7f89-4f76-8a02-8f105da2e6b9 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:02.558978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-996f5a3c-7f89-4f76-8a02-8f105da2e6b9 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1346a00d2f4c6898144f51eca037f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54936b67ff8842008c37ef8588add58f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:02.563299 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-996f5a3c-7f89-4f76-8a02-8f105da2e6b9 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] 10.222.0.49 "GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701" status: 200 len: 1316 microversion: 2.1 time: 0.395207 May 21 21:29:02.563888 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2105/4347] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:02 2022] GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701 => generated 1316 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:02.592028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-881ed7a0-fe6e-4322-b6e2-bdd7d04f5930 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:02.594305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-881ed7a0-fe6e-4322-b6e2-bdd7d04f5930 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:02.607715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-881ed7a0-fe6e-4322-b6e2-bdd7d04f5930 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:02.608461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-881ed7a0-fe6e-4322-b6e2-bdd7d04f5930 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:02.609473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-881ed7a0-fe6e-4322-b6e2-bdd7d04f5930 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:02.612902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-881ed7a0-fe6e-4322-b6e2-bdd7d04f5930 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:03.077130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-881ed7a0-fe6e-4322-b6e2-bdd7d04f5930 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:03.089876 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-881ed7a0-fe6e-4322-b6e2-bdd7d04f5930 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 200 len: 1516 microversion: 2.1 time: 0.514192 May 21 21:29:03.091689 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2106/4348] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:02 2022] GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 1516 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:03.104009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-f92a8a90-d842-4cc0-9a1e-3242cf79c083 req-06ccff64-fdfb-4631-936c-e205042a433c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392d9064-09d6-4c79-819b-042ba6d6f70b", "name": "network-vif-deleted", "tag": "d2f57a10-249a-4c02-a14e-b9efad557114"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:03.122845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f92a8a90-d842-4cc0-9a1e-3242cf79c083 req-06ccff64-fdfb-4631-936c-e205042a433c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:03.123487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f92a8a90-d842-4cc0-9a1e-3242cf79c083 req-06ccff64-fdfb-4631-936c-e205042a433c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:03.145083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-5c92e1e3-760a-4065-9622-9a57fa01d757 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Updating instance_info_cache with network_info: [] {{(pid=131277) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 21 21:29:03.166772 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.compute.server_external_events [req-f92a8a90-d842-4cc0-9a1e-3242cf79c083 req-06ccff64-fdfb-4631-936c-e205042a433c service nova] Unable to find a host for instance 392d9064-09d6-4c79-819b-042ba6d6f70b. Dropping event network-vif-deleted {{(pid=131278) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 21 21:29:03.167826 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-f92a8a90-d842-4cc0-9a1e-3242cf79c083 req-06ccff64-fdfb-4631-936c-e205042a433c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.074865 May 21 21:29:03.168888 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2107/4349] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 76 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 21 21:29:03.580922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5bf650c8-397b-4d69-8a6b-071df66dac11 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:03.581464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5bf650c8-397b-4d69-8a6b-071df66dac11 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:03.595111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5bf650c8-397b-4d69-8a6b-071df66dac11 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:03.595111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5bf650c8-397b-4d69-8a6b-071df66dac11 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:03.595111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5bf650c8-397b-4d69-8a6b-071df66dac11 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:03.595111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5bf650c8-397b-4d69-8a6b-071df66dac11 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:03.704451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:03.884727 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5bf650c8-397b-4d69-8a6b-071df66dac11 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1346a00d2f4c6898144f51eca037f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54936b67ff8842008c37ef8588add58f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:03.893540 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5bf650c8-397b-4d69-8a6b-071df66dac11 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] 10.222.0.49 "GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701" status: 200 len: 1316 microversion: 2.1 time: 0.317072 May 21 21:29:03.896228 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2108/4350] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:03 2022] GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701 => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:29:03.922680 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5c92e1e3-760a-4065-9622-9a57fa01d757 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "DELETE /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 204 len: 0 microversion: 2.1 time: 5.072816 May 21 21:29:03.929006 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2243/4351] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:28:58 2022] DELETE /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 0 bytes in 5075 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:29:03.937928 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f69f3901-ff9d-4e21-9876-af77d0c604e3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:03.939312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f69f3901-ff9d-4e21-9876-af77d0c604e3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 392d9064-09d6-4c79-819b-042ba6d6f70b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:03.947210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f69f3901-ff9d-4e21-9876-af77d0c604e3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:03.948129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f69f3901-ff9d-4e21-9876-af77d0c604e3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:03.949446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f69f3901-ff9d-4e21-9876-af77d0c604e3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:03.950099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f69f3901-ff9d-4e21-9876-af77d0c604e3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:03.969468 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-f69f3901-ff9d-4e21-9876-af77d0c604e3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] HTTP exception thrown: Instance 392d9064-09d6-4c79-819b-042ba6d6f70b could not be found. May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f69f3901-ff9d-4e21-9876-af77d0c604e3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Request method failure captured: May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b HTTP/1.1 May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVgQv9k80egN_Z5oxm6zD7gV_sf1gMqqxBRx1iY9MeJj0DeNsoKLr8-8NIWiLDly20rLKVCAE8Xz0N5MgNbJYqnUGb2g2Kh6fJPvfPYKD1-lSj4wpNCcDbjlxj4-dXOUNAfghSaWJ8EAEG0fA3XOci0JYwtRE0jKJ3nFNlo1G7Keylg May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 014ae80b3f434bcb9fa2629ccdf4aad7 May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerActionsTestJSON-643676444 May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/014ae80b3f434bcb9fa2629ccdf4aad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/014ae80b3f434bcb9fa2629ccdf4aad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_014ae80b3f434bcb9fa2629ccdf4aad7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/014ae80b3f434bcb9fa2629ccdf4aad7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerActionsTestJSON-643676444 May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 014ae80b3f434bcb9fa2629ccdf4aad7 May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerActionsTestJSON-643676444 May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerActionsTestJSON-643676444-project May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1cafab0cbef64be59c7afef84d7888ff May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerActionsTestJSON-643676444-project May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 392d9064-09d6-4c79-819b-042ba6d6f70b could not be found. May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '392d9064-09d6-4c79-819b-042ba6d6f70b'} May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 392d9064-09d6-4c79-819b-042ba6d6f70b could not be found. May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 392d9064-09d6-4c79-819b-042ba6d6f70b could not be found. May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:29:03.971455 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:03.976904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:03.976904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:29:03.976904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:29:03.976904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:29:03.976904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:29:03.976904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 392d9064-09d6-4c79-819b-042ba6d6f70b could not be found. May 21 21:29:03.976904 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:03.979547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f69f3901-ff9d-4e21-9876-af77d0c604e3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Returning 404 to user: Instance 392d9064-09d6-4c79-819b-042ba6d6f70b could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:29:03.980703 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f69f3901-ff9d-4e21-9876-af77d0c604e3 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b" status: 404 len: 111 microversion: 2.1 time: 0.048648 May 21 21:29:03.984786 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2109/4352] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:03 2022] GET /compute/v2.1/servers/392d9064-09d6-4c79-819b-042ba6d6f70b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:29:03.990565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d35e0424-6b20-4839-8365-636f41f7b31b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:03.991088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d35e0424-6b20-4839-8365-636f41f7b31b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:03.999309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d35e0424-6b20-4839-8365-636f41f7b31b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:04.000629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d35e0424-6b20-4839-8365-636f41f7b31b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:04.001448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d35e0424-6b20-4839-8365-636f41f7b31b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:04.001901 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d35e0424-6b20-4839-8365-636f41f7b31b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:04.032927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d35e0424-6b20-4839-8365-636f41f7b31b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:29:04.111500 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-267fe0f2-450b-4ae7-93a0-3f56a988339b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:04.117031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-267fe0f2-450b-4ae7-93a0-3f56a988339b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:04.126621 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-267fe0f2-450b-4ae7-93a0-3f56a988339b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:04.128314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-267fe0f2-450b-4ae7-93a0-3f56a988339b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:04.130300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-267fe0f2-450b-4ae7-93a0-3f56a988339b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:04.130990 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-267fe0f2-450b-4ae7-93a0-3f56a988339b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:04.231806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:04.410738 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d35e0424-6b20-4839-8365-636f41f7b31b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0" status: 204 len: 0 microversion: 2.1 time: 0.423384 May 21 21:29:04.414149 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2244/4353] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:29:03 2022] DELETE /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:29:04.420203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5ec5ac75-f2c7-4712-a45c-a4493c49f2a4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:04.425342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5ec5ac75-f2c7-4712-a45c-a4493c49f2a4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:04.449208 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ec5ac75-f2c7-4712-a45c-a4493c49f2a4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:04.456671 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ec5ac75-f2c7-4712-a45c-a4493c49f2a4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:04.459348 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ec5ac75-f2c7-4712-a45c-a4493c49f2a4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:04.460088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ec5ac75-f2c7-4712-a45c-a4493c49f2a4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:04.475520 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-267fe0f2-450b-4ae7-93a0-3f56a988339b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:04.483666 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-267fe0f2-450b-4ae7-93a0-3f56a988339b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 200 len: 1516 microversion: 2.1 time: 0.378355 May 21 21:29:04.484243 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2110/4354] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:04 2022] GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 1516 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:29:04.668897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5ec5ac75-f2c7-4712-a45c-a4493c49f2a4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:04.683033 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5ec5ac75-f2c7-4712-a45c-a4493c49f2a4 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0" status: 200 len: 1465 microversion: 2.1 time: 0.267374 May 21 21:29:04.684241 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2245/4355] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:04 2022] GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0 => generated 1465 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:04.913730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-694fbaa9-cceb-4d2f-892f-97628eba1e78 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:04.914662 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-694fbaa9-cceb-4d2f-892f-97628eba1e78 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:04.930479 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-694fbaa9-cceb-4d2f-892f-97628eba1e78 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:04.931559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-694fbaa9-cceb-4d2f-892f-97628eba1e78 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:04.932980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-694fbaa9-cceb-4d2f-892f-97628eba1e78 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:04.933435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-694fbaa9-cceb-4d2f-892f-97628eba1e78 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:05.196952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-36f53ba0-c346-45a1-b50f-7815d20546e3 req-d990aac8-d770-4ed2-b5f9-3bdaaa9db747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dff940b-adb6-40c4-a7a0-e6088b0a20be", "name": "network-vif-deleted", "tag": "66860b02-36d2-4968-b58a-061a84f4d1eb"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:05.221083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-36f53ba0-c346-45a1-b50f-7815d20546e3 req-d990aac8-d770-4ed2-b5f9-3bdaaa9db747 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:05.221509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-36f53ba0-c346-45a1-b50f-7815d20546e3 req-d990aac8-d770-4ed2-b5f9-3bdaaa9db747 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:05.237911 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-36f53ba0-c346-45a1-b50f-7815d20546e3 req-d990aac8-d770-4ed2-b5f9-3bdaaa9db747 service nova] Creating event network-vif-deleted:66860b02-36d2-4968-b58a-061a84f4d1eb for instance 7dff940b-adb6-40c4-a7a0-e6088b0a20be on nch1-master-1 May 21 21:29:05.263104 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-36f53ba0-c346-45a1-b50f-7815d20546e3 req-d990aac8-d770-4ed2-b5f9-3bdaaa9db747 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069800 May 21 21:29:05.264344 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2246/4356] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:29:05.334482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-694fbaa9-cceb-4d2f-892f-97628eba1e78 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1346a00d2f4c6898144f51eca037f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54936b67ff8842008c37ef8588add58f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:05.344827 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-694fbaa9-cceb-4d2f-892f-97628eba1e78 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] 10.222.0.49 "GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701" status: 200 len: 1316 microversion: 2.1 time: 0.435937 May 21 21:29:05.345426 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2111/4357] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:04 2022] GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701 => generated 1316 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:05.502068 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-94823321-3b4c-4f53-9dda-223b5106a819 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:05.503210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-94823321-3b4c-4f53-9dda-223b5106a819 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:05.511186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94823321-3b4c-4f53-9dda-223b5106a819 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:05.511811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94823321-3b4c-4f53-9dda-223b5106a819 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:05.512645 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94823321-3b4c-4f53-9dda-223b5106a819 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:05.513093 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94823321-3b4c-4f53-9dda-223b5106a819 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:05.560891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94823321-3b4c-4f53-9dda-223b5106a819 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:05.561689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94823321-3b4c-4f53-9dda-223b5106a819 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:05.562161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-94823321-3b4c-4f53-9dda-223b5106a819 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lazy-loading 'fault' on Instance uuid 7dff940b-adb6-40c4-a7a0-e6088b0a20be {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:29:05.626735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-94823321-3b4c-4f53-9dda-223b5106a819 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:05.648590 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-94823321-3b4c-4f53-9dda-223b5106a819 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 200 len: 1319 microversion: 2.1 time: 0.150966 May 21 21:29:05.649557 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2247/4358] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:05 2022] GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:05.701273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ffe082d0-d577-4bc4-8748-9e85a7b1e0f0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:05.702180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ffe082d0-d577-4bc4-8748-9e85a7b1e0f0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:05.704430 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=8 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:05.710068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffe082d0-d577-4bc4-8748-9e85a7b1e0f0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:05.710746 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffe082d0-d577-4bc4-8748-9e85a7b1e0f0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:05.711532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffe082d0-d577-4bc4-8748-9e85a7b1e0f0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:05.712174 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffe082d0-d577-4bc4-8748-9e85a7b1e0f0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:06.200580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ffe082d0-d577-4bc4-8748-9e85a7b1e0f0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:06.214629 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ffe082d0-d577-4bc4-8748-9e85a7b1e0f0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0" status: 200 len: 1465 microversion: 2.1 time: 0.517211 May 21 21:29:06.216097 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2112/4359] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:05 2022] GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0 => generated 1465 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:06.367855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f605a3b1-98cf-4765-83d2-84f2c601ff09 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:06.368753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f605a3b1-98cf-4765-83d2-84f2c601ff09 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:06.379867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f605a3b1-98cf-4765-83d2-84f2c601ff09 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:06.380864 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f605a3b1-98cf-4765-83d2-84f2c601ff09 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:06.382239 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f605a3b1-98cf-4765-83d2-84f2c601ff09 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:06.382700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f605a3b1-98cf-4765-83d2-84f2c601ff09 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:06.586093 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f605a3b1-98cf-4765-83d2-84f2c601ff09 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1346a00d2f4c6898144f51eca037f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54936b67ff8842008c37ef8588add58f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:06.599272 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f605a3b1-98cf-4765-83d2-84f2c601ff09 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] 10.222.0.49 "GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701" status: 200 len: 1316 microversion: 2.1 time: 0.238048 May 21 21:29:06.601379 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2248/4360] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:06 2022] GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701 => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:06.666982 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a027c4e8-cded-4b74-9539-6980b7951c38 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:06.670977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a027c4e8-cded-4b74-9539-6980b7951c38 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:06.679815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a027c4e8-cded-4b74-9539-6980b7951c38 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:06.686313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a027c4e8-cded-4b74-9539-6980b7951c38 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:06.686313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a027c4e8-cded-4b74-9539-6980b7951c38 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:06.686313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a027c4e8-cded-4b74-9539-6980b7951c38 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:06.701819 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-a027c4e8-cded-4b74-9539-6980b7951c38 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance 7dff940b-adb6-40c4-a7a0-e6088b0a20be could not be found. May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a027c4e8-cded-4b74-9539-6980b7951c38 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be HTTP/1.1 May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 7dff940b-adb6-40c4-a7a0-e6088b0a20be could not be found. May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '7dff940b-adb6-40c4-a7a0-e6088b0a20be'} May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dff940b-adb6-40c4-a7a0-e6088b0a20be could not be found. May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dff940b-adb6-40c4-a7a0-e6088b0a20be could not be found. May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:06.705202 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:06.712707 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:29:06.712707 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:29:06.712707 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:29:06.712707 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:29:06.712707 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dff940b-adb6-40c4-a7a0-e6088b0a20be could not be found. May 21 21:29:06.712707 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:06.712707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a027c4e8-cded-4b74-9539-6980b7951c38 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance 7dff940b-adb6-40c4-a7a0-e6088b0a20be could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:29:06.712707 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a027c4e8-cded-4b74-9539-6980b7951c38 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 404 len: 111 microversion: 2.1 time: 0.043998 May 21 21:29:06.712707 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2113/4361] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:06 2022] GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:29:06.718608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4ec010a2-2889-4108-839a-a41a73113ea9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '.version_select at 0x7fc81a4a0790>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:06.793127 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4ec010a2-2889-4108-839a-a41a73113ea9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-key-1227629703" status: 202 len: 0 microversion: 2.1 time: 0.078165 May 21 21:29:06.794692 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2249/4362] 10.222.0.49 () {58 vars in 1208 bytes} [Sat May 21 21:29:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1227629703 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:29:06.922921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-85e80db9-e7e3-4c12-b5b2-f48c61b3af26 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-689566251", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "88d40858-d8e8-4c97-8084-13382fa527f6"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:07.024341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-85e80db9-e7e3-4c12-b5b2-f48c61b3af26 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] validate_networks() for [('88d40858-d8e8-4c97-8084-13382fa527f6', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:29:07.233828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-08872c58-fd54-4c0c-a2fd-b5f87bbdcc37 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:07.234908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-08872c58-fd54-4c0c-a2fd-b5f87bbdcc37 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:07.261450 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08872c58-fd54-4c0c-a2fd-b5f87bbdcc37 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:07.262863 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08872c58-fd54-4c0c-a2fd-b5f87bbdcc37 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:07.264405 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08872c58-fd54-4c0c-a2fd-b5f87bbdcc37 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:07.265051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08872c58-fd54-4c0c-a2fd-b5f87bbdcc37 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:07.405379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-08872c58-fd54-4c0c-a2fd-b5f87bbdcc37 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:07.427330 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-08872c58-fd54-4c0c-a2fd-b5f87bbdcc37 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0" status: 200 len: 1465 microversion: 2.1 time: 0.196871 May 21 21:29:07.437141 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2250/4363] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:07 2022] GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0 => generated 1465 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:07.612969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-0df8486c-7ede-41e0-95ba-3ba0ddfd118c req-bad6427e-6c04-4e26-9e3a-750df35f570c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2820cc-216b-43d8-b0d5-54f85539f3e0", "name": "network-vif-deleted", "tag": "bf13d8ee-782a-43ad-8555-f1b13fa22ec5"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:07.633962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-0df8486c-7ede-41e0-95ba-3ba0ddfd118c req-bad6427e-6c04-4e26-9e3a-750df35f570c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:07.635358 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-0df8486c-7ede-41e0-95ba-3ba0ddfd118c req-bad6427e-6c04-4e26-9e3a-750df35f570c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:07.656225 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-0df8486c-7ede-41e0-95ba-3ba0ddfd118c req-bad6427e-6c04-4e26-9e3a-750df35f570c service nova] Creating event network-vif-deleted:bf13d8ee-782a-43ad-8555-f1b13fa22ec5 for instance 5b2820cc-216b-43d8-b0d5-54f85539f3e0 on nch2-master-1 May 21 21:29:07.678664 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-0df8486c-7ede-41e0-95ba-3ba0ddfd118c req-bad6427e-6c04-4e26-9e3a-750df35f570c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076551 May 21 21:29:07.680033 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2251/4364] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:29:07.687403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bac9e948-a953-45de-8b3b-90a47e582ad3 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:07.689923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bac9e948-a953-45de-8b3b-90a47e582ad3 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:07.707945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bac9e948-a953-45de-8b3b-90a47e582ad3 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:07.708858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bac9e948-a953-45de-8b3b-90a47e582ad3 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:07.721017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bac9e948-a953-45de-8b3b-90a47e582ad3 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:07.721764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bac9e948-a953-45de-8b3b-90a47e582ad3 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:07.728488 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:07.947104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bac9e948-a953-45de-8b3b-90a47e582ad3 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1346a00d2f4c6898144f51eca037f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54936b67ff8842008c37ef8588add58f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:07.955695 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bac9e948-a953-45de-8b3b-90a47e582ad3 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] 10.222.0.49 "GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701" status: 200 len: 1316 microversion: 2.1 time: 0.273646 May 21 21:29:07.966268 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2252/4365] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:07 2022] GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701 => generated 1316 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:08.054764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-85e80db9-e7e3-4c12-b5b2-f48c61b3af26 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:29:08.055294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-85e80db9-e7e3-4c12-b5b2-f48c61b3af26 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:29:08.056331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-85e80db9-e7e3-4c12-b5b2-f48c61b3af26 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:29:08.056764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-85e80db9-e7e3-4c12-b5b2-f48c61b3af26 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:29:08.057190 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-85e80db9-e7e3-4c12-b5b2-f48c61b3af26 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:29:08.069770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-85e80db9-e7e3-4c12-b5b2-f48c61b3af26 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:08.070518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-85e80db9-e7e3-4c12-b5b2-f48c61b3af26 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:08.072184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-85e80db9-e7e3-4c12-b5b2-f48c61b3af26 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:08.072665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-85e80db9-e7e3-4c12-b5b2-f48c61b3af26 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:08.092709 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-85e80db9-e7e3-4c12-b5b2-f48c61b3af26 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Getting quotas for project 4dbb4bbc88f84520885c00a376ba0f7c. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:29:08.098377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-85e80db9-e7e3-4c12-b5b2-f48c61b3af26 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Getting quotas for user c67dc8226610413a8bb889d6055a75d2 and project 4dbb4bbc88f84520885c00a376ba0f7c. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:29:08.111310 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-85e80db9-e7e3-4c12-b5b2-f48c61b3af26 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:29:08.114629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-85e80db9-e7e3-4c12-b5b2-f48c61b3af26 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:29:08.260076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-1c735662-9ad1-46e2-b60b-e81c925553fe req-d21f1597-1516-47bf-8ff1-bad693260236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95283bb8-0420-4ecf-bff1-b15ae04db701", "name": "network-vif-plugged", "status": "completed", "tag": "82353255-b2e8-4550-a4d1-d2cb6151862f"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:08.272844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-1c735662-9ad1-46e2-b60b-e81c925553fe req-d21f1597-1516-47bf-8ff1-bad693260236 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:08.273503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-1c735662-9ad1-46e2-b60b-e81c925553fe req-d21f1597-1516-47bf-8ff1-bad693260236 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:08.289090 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-1c735662-9ad1-46e2-b60b-e81c925553fe req-d21f1597-1516-47bf-8ff1-bad693260236 service nova] Creating event network-vif-plugged:82353255-b2e8-4550-a4d1-d2cb6151862f for instance 95283bb8-0420-4ecf-bff1-b15ae04db701 on nch2-master-1 May 21 21:29:08.294387 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-1c735662-9ad1-46e2-b60b-e81c925553fe req-d21f1597-1516-47bf-8ff1-bad693260236 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041548 May 21 21:29:08.295421 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2253/4366] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:29:08.319081 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-85e80db9-e7e3-4c12-b5b2-f48c61b3af26 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.406463 May 21 21:29:08.320191 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2114/4367] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:29:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:29:08.330368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4a321d75-50bd-4b9d-b926-a44e864ea773 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:08.331784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4a321d75-50bd-4b9d-b926-a44e864ea773 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:08.451260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c368a425-a00a-4b17-943d-c9b5b54b9f22 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:08.451904 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c368a425-a00a-4b17-943d-c9b5b54b9f22 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:08.454020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4a321d75-50bd-4b9d-b926-a44e864ea773 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:08.465889 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4a321d75-50bd-4b9d-b926-a44e864ea773 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 200 len: 1208 microversion: 2.1 time: 0.139595 May 21 21:29:08.466895 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2254/4368] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:08 2022] GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 1208 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:08.469968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c368a425-a00a-4b17-943d-c9b5b54b9f22 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:08.470448 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c368a425-a00a-4b17-943d-c9b5b54b9f22 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:08.471273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c368a425-a00a-4b17-943d-c9b5b54b9f22 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:08.471729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c368a425-a00a-4b17-943d-c9b5b54b9f22 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:08.547807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c368a425-a00a-4b17-943d-c9b5b54b9f22 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:08.548364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c368a425-a00a-4b17-943d-c9b5b54b9f22 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:08.548744 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-c368a425-a00a-4b17-943d-c9b5b54b9f22 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lazy-loading 'fault' on Instance uuid 5b2820cc-216b-43d8-b0d5-54f85539f3e0 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:29:08.725940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c368a425-a00a-4b17-943d-c9b5b54b9f22 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:08.738293 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c368a425-a00a-4b17-943d-c9b5b54b9f22 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0" status: 200 len: 1305 microversion: 2.1 time: 0.296900 May 21 21:29:08.741162 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2115/4369] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:08 2022] GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0 => generated 1305 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:08.976587 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b8a46623-5e90-4371-8c23-086e915dc364 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:08.977522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b8a46623-5e90-4371-8c23-086e915dc364 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:08.986026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8a46623-5e90-4371-8c23-086e915dc364 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:08.986997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8a46623-5e90-4371-8c23-086e915dc364 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:08.988042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8a46623-5e90-4371-8c23-086e915dc364 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:08.989690 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8a46623-5e90-4371-8c23-086e915dc364 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:09.158168 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b8a46623-5e90-4371-8c23-086e915dc364 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1346a00d2f4c6898144f51eca037f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54936b67ff8842008c37ef8588add58f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:09.166992 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b8a46623-5e90-4371-8c23-086e915dc364 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] 10.222.0.49 "GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701" status: 200 len: 1316 microversion: 2.1 time: 0.195382 May 21 21:29:09.177804 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2255/4370] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:08 2022] GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701 => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:09.486086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e9b566ed-6722-44d1-9e43-53e4f6925cb1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:09.491086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e9b566ed-6722-44d1-9e43-53e4f6925cb1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:09.574206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e9b566ed-6722-44d1-9e43-53e4f6925cb1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:09.581927 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e9b566ed-6722-44d1-9e43-53e4f6925cb1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 200 len: 1208 microversion: 2.1 time: 0.100320 May 21 21:29:09.582850 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2116/4371] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:09 2022] GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 1208 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:09.759523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7f0a78fd-00c9-401a-8994-44b763167e16 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:09.760140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7f0a78fd-00c9-401a-8994-44b763167e16 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 5b2820cc-216b-43d8-b0d5-54f85539f3e0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:09.782117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f0a78fd-00c9-401a-8994-44b763167e16 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:09.782579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f0a78fd-00c9-401a-8994-44b763167e16 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:09.783366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f0a78fd-00c9-401a-8994-44b763167e16 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:09.784049 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f0a78fd-00c9-401a-8994-44b763167e16 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:09.804758 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-7f0a78fd-00c9-401a-8994-44b763167e16 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] HTTP exception thrown: Instance 5b2820cc-216b-43d8-b0d5-54f85539f3e0 could not be found. May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7f0a78fd-00c9-401a-8994-44b763167e16 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Request method failure captured: May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0 HTTP/1.1 May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVgQv9k80egN_Z5oxm6zD7gV_sf1gMqqxBRx1iY9MeJj0DeNsoKLr8-8NIWiLDly20rLKVCAE8Xz0N5MgNbJYqnUGb2g2Kh6fJPvfPYKD1-lSj4wpNCcDbjlxj4-dXOUNAfghSaWJ8EAEG0fA3XOci0JYwtRE0jKJ3nFNlo1G7Keylg May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 014ae80b3f434bcb9fa2629ccdf4aad7 May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerActionsTestJSON-643676444 May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/014ae80b3f434bcb9fa2629ccdf4aad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/014ae80b3f434bcb9fa2629ccdf4aad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_014ae80b3f434bcb9fa2629ccdf4aad7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/014ae80b3f434bcb9fa2629ccdf4aad7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerActionsTestJSON-643676444 May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 014ae80b3f434bcb9fa2629ccdf4aad7 May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerActionsTestJSON-643676444 May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerActionsTestJSON-643676444-project May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 1cafab0cbef64be59c7afef84d7888ff May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerActionsTestJSON-643676444-project May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 5b2820cc-216b-43d8-b0d5-54f85539f3e0 could not be found. May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '5b2820cc-216b-43d8-b0d5-54f85539f3e0'} May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b2820cc-216b-43d8-b0d5-54f85539f3e0 could not be found. May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b2820cc-216b-43d8-b0d5-54f85539f3e0 could not be found. May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:29:09.806821 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:29:09.812111 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:09.812111 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:29:09.812111 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:29:09.812111 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:29:09.812111 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:29:09.812111 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b2820cc-216b-43d8-b0d5-54f85539f3e0 could not be found. May 21 21:29:09.812111 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:29:09.817508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7f0a78fd-00c9-401a-8994-44b763167e16 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Returning 404 to user: Instance 5b2820cc-216b-43d8-b0d5-54f85539f3e0 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:29:09.817508 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7f0a78fd-00c9-401a-8994-44b763167e16 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0" status: 404 len: 111 microversion: 2.1 time: 0.059800 May 21 21:29:09.817508 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2256/4372] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:09 2022] GET /compute/v2.1/servers/5b2820cc-216b-43d8-b0d5-54f85539f3e0 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:29:09.825249 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-885503bb-c02a-4cf6-bed5-d103e74a48d0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:09.826456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-885503bb-c02a-4cf6-bed5-d103e74a48d0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:09.834788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-885503bb-c02a-4cf6-bed5-d103e74a48d0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:09.835533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-885503bb-c02a-4cf6-bed5-d103e74a48d0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:09.836481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-885503bb-c02a-4cf6-bed5-d103e74a48d0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:09.837052 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-885503bb-c02a-4cf6-bed5-d103e74a48d0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:09.873344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-885503bb-c02a-4cf6-bed5-d103e74a48d0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:29:10.185493 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4a6f894a-071f-4e03-9e44-95c665261aef tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:10.186146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4a6f894a-071f-4e03-9e44-95c665261aef tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:10.193013 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a6f894a-071f-4e03-9e44-95c665261aef tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:10.193545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a6f894a-071f-4e03-9e44-95c665261aef tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:10.194349 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a6f894a-071f-4e03-9e44-95c665261aef tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:10.195606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a6f894a-071f-4e03-9e44-95c665261aef tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:10.211005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:10.334865 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-885503bb-c02a-4cf6-bed5-d103e74a48d0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245" status: 204 len: 0 microversion: 2.1 time: 0.513470 May 21 21:29:10.336010 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2117/4373] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:29:09 2022] DELETE /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:29:10.344568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-00f04d9a-c374-4160-8e29-4f8c771efbee tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:10.345344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-00f04d9a-c374-4160-8e29-4f8c771efbee tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:10.352547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00f04d9a-c374-4160-8e29-4f8c771efbee tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:10.353010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00f04d9a-c374-4160-8e29-4f8c771efbee tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:10.354009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00f04d9a-c374-4160-8e29-4f8c771efbee tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:10.354805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00f04d9a-c374-4160-8e29-4f8c771efbee tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:10.567881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-00f04d9a-c374-4160-8e29-4f8c771efbee tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:10.578766 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-00f04d9a-c374-4160-8e29-4f8c771efbee tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245" status: 200 len: 1506 microversion: 2.1 time: 0.238662 May 21 21:29:10.579931 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2118/4374] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:10 2022] GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:29:10.604539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-04c05d45-5c00-45d7-9491-37c4dcf8b084 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:10.607140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-04c05d45-5c00-45d7-9491-37c4dcf8b084 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:10.615419 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04c05d45-5c00-45d7-9491-37c4dcf8b084 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:10.616239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04c05d45-5c00-45d7-9491-37c4dcf8b084 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:10.624605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04c05d45-5c00-45d7-9491-37c4dcf8b084 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:10.624605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04c05d45-5c00-45d7-9491-37c4dcf8b084 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:10.624605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:10.705253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-04c05d45-5c00-45d7-9491-37c4dcf8b084 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:10.710354 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-04c05d45-5c00-45d7-9491-37c4dcf8b084 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 200 len: 1260 microversion: 2.1 time: 0.110051 May 21 21:29:10.711040 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2119/4375] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:10 2022] GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 1260 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:29:10.861694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4a6f894a-071f-4e03-9e44-95c665261aef tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1346a00d2f4c6898144f51eca037f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54936b67ff8842008c37ef8588add58f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:10.871531 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4a6f894a-071f-4e03-9e44-95c665261aef tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] 10.222.0.49 "GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701" status: 200 len: 1505 microversion: 2.1 time: 0.688416 May 21 21:29:10.871531 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2257/4376] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:10 2022] GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701 => generated 1505 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:29:10.887813 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ed1a0a50-1ba9-4f55-a82d-e88b6d93c12c tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:10.888346 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ed1a0a50-1ba9-4f55-a82d-e88b6d93c12c tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:10.902963 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed1a0a50-1ba9-4f55-a82d-e88b6d93c12c tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:10.903416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed1a0a50-1ba9-4f55-a82d-e88b6d93c12c tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:10.904456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed1a0a50-1ba9-4f55-a82d-e88b6d93c12c tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:10.905071 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed1a0a50-1ba9-4f55-a82d-e88b6d93c12c tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:11.058360 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ed1a0a50-1ba9-4f55-a82d-e88b6d93c12c tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] 10.222.0.49 "DELETE /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.174408 May 21 21:29:11.064100 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2120/4377] 10.222.0.49 () {58 vars in 1295 bytes} [Sat May 21 21:29:10 2022] DELETE /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701/os-server-password => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:29:11.068667 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9de4914f-27f6-4d0a-87ac-1e6abc86196b tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:11.069173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9de4914f-27f6-4d0a-87ac-1e6abc86196b tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:11.077872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9de4914f-27f6-4d0a-87ac-1e6abc86196b tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:11.078587 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9de4914f-27f6-4d0a-87ac-1e6abc86196b tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:11.079594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9de4914f-27f6-4d0a-87ac-1e6abc86196b tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:11.080202 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9de4914f-27f6-4d0a-87ac-1e6abc86196b tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:11.108505 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9de4914f-27f6-4d0a-87ac-1e6abc86196b tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] 10.222.0.49 "GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.043788 May 21 21:29:11.109360 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2258/4378] 10.222.0.49 () {58 vars in 1292 bytes} [Sat May 21 21:29:11 2022] GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701/os-server-password => generated 16 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:29:11.124047 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8e130c4f-3409-4f0d-93b2-f491fa1419c1 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:11.126357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8e130c4f-3409-4f0d-93b2-f491fa1419c1 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:11.155650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e130c4f-3409-4f0d-93b2-f491fa1419c1 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:11.156852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e130c4f-3409-4f0d-93b2-f491fa1419c1 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:11.158265 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e130c4f-3409-4f0d-93b2-f491fa1419c1 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:11.162175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e130c4f-3409-4f0d-93b2-f491fa1419c1 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:11.234489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8e130c4f-3409-4f0d-93b2-f491fa1419c1 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:29:11.597192 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b1be5cea-4943-4fef-b198-e9ee0eb8a7c8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:11.598698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b1be5cea-4943-4fef-b198-e9ee0eb8a7c8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:11.609033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1be5cea-4943-4fef-b198-e9ee0eb8a7c8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:11.609492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1be5cea-4943-4fef-b198-e9ee0eb8a7c8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:11.611033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1be5cea-4943-4fef-b198-e9ee0eb8a7c8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:11.611472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1be5cea-4943-4fef-b198-e9ee0eb8a7c8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:11.699671 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8e130c4f-3409-4f0d-93b2-f491fa1419c1 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] 10.222.0.49 "DELETE /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701" status: 204 len: 0 microversion: 2.1 time: 0.583552 May 21 21:29:11.703244 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2121/4379] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:29:11 2022] DELETE /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:29:11.714584 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-72c40c24-2a1e-4315-b270-c52e8af711a4 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:11.715287 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-72c40c24-2a1e-4315-b270-c52e8af711a4 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:11.731239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72c40c24-2a1e-4315-b270-c52e8af711a4 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:11.732103 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72c40c24-2a1e-4315-b270-c52e8af711a4 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:11.733330 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72c40c24-2a1e-4315-b270-c52e8af711a4 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:11.734212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72c40c24-2a1e-4315-b270-c52e8af711a4 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:12.017195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b1be5cea-4943-4fef-b198-e9ee0eb8a7c8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:12.031724 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b1be5cea-4943-4fef-b198-e9ee0eb8a7c8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245" status: 200 len: 1506 microversion: 2.1 time: 0.435508 May 21 21:29:12.033469 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2259/4380] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:11 2022] GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245 => generated 1506 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:29:12.047432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3d95b5c3-7104-428f-8423-1cb5854b1439 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:12.049621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3d95b5c3-7104-428f-8423-1cb5854b1439 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:12.071095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d95b5c3-7104-428f-8423-1cb5854b1439 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:12.072746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d95b5c3-7104-428f-8423-1cb5854b1439 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:12.077384 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d95b5c3-7104-428f-8423-1cb5854b1439 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:12.078018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d95b5c3-7104-428f-8423-1cb5854b1439 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:12.078691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-72c40c24-2a1e-4315-b270-c52e8af711a4 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1346a00d2f4c6898144f51eca037f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54936b67ff8842008c37ef8588add58f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:12.092761 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-72c40c24-2a1e-4315-b270-c52e8af711a4 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] 10.222.0.49 "GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701" status: 200 len: 1511 microversion: 2.1 time: 0.388027 May 21 21:29:12.100318 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2122/4381] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:11 2022] GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701 => generated 1511 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:12.278499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3d95b5c3-7104-428f-8423-1cb5854b1439 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:12.288339 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3d95b5c3-7104-428f-8423-1cb5854b1439 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 200 len: 1266 microversion: 2.1 time: 0.250757 May 21 21:29:12.289655 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2260/4382] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:12 2022] GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:12.685657 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-3d6af54e-b906-48f4-90e3-8537a3589f97 req-c659cd66-9793-45b6-8fa6-074ae97fa2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2be17b7-988e-4845-9959-5fa04cbed245", "name": "network-vif-deleted", "tag": "f31dbee2-256e-43df-8541-a6196710f62e"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:12.707025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3d6af54e-b906-48f4-90e3-8537a3589f97 req-c659cd66-9793-45b6-8fa6-074ae97fa2a6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:12.707687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3d6af54e-b906-48f4-90e3-8537a3589f97 req-c659cd66-9793-45b6-8fa6-074ae97fa2a6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:12.727294 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-3d6af54e-b906-48f4-90e3-8537a3589f97 req-c659cd66-9793-45b6-8fa6-074ae97fa2a6 service nova] Creating event network-vif-deleted:f31dbee2-256e-43df-8541-a6196710f62e for instance e2be17b7-988e-4845-9959-5fa04cbed245 on nch2-master-1 May 21 21:29:12.737554 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-3d6af54e-b906-48f4-90e3-8537a3589f97 req-c659cd66-9793-45b6-8fa6-074ae97fa2a6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055566 May 21 21:29:12.740302 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2123/4383] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:29:13.051651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f46f92af-dfe4-4598-902f-6098e61372c8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:13.052324 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f46f92af-dfe4-4598-902f-6098e61372c8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:13.063903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f46f92af-dfe4-4598-902f-6098e61372c8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:13.064382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f46f92af-dfe4-4598-902f-6098e61372c8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:13.065171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f46f92af-dfe4-4598-902f-6098e61372c8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:13.065610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f46f92af-dfe4-4598-902f-6098e61372c8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:13.115932 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f6dae67c-aef9-4f68-90ac-4947e4b60a6e tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:13.118287 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f6dae67c-aef9-4f68-90ac-4947e4b60a6e tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:13.135674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6dae67c-aef9-4f68-90ac-4947e4b60a6e tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:13.136632 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6dae67c-aef9-4f68-90ac-4947e4b60a6e tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:13.139273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6dae67c-aef9-4f68-90ac-4947e4b60a6e tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:13.139811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6dae67c-aef9-4f68-90ac-4947e4b60a6e tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:13.160399 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f46f92af-dfe4-4598-902f-6098e61372c8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:13.161163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f46f92af-dfe4-4598-902f-6098e61372c8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:13.161640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-f46f92af-dfe4-4598-902f-6098e61372c8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lazy-loading 'fault' on Instance uuid e2be17b7-988e-4845-9959-5fa04cbed245 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:29:13.223749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f46f92af-dfe4-4598-902f-6098e61372c8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:13.232666 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f46f92af-dfe4-4598-902f-6098e61372c8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245" status: 200 len: 1304 microversion: 2.1 time: 0.186121 May 21 21:29:13.233335 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2261/4384] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:13 2022] GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245 => generated 1304 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:13.313901 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fac940ac-0e65-47cf-a03e-15163a345d32 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:13.314635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fac940ac-0e65-47cf-a03e-15163a345d32 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:13.325348 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fac940ac-0e65-47cf-a03e-15163a345d32 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:13.326126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fac940ac-0e65-47cf-a03e-15163a345d32 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:13.327067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fac940ac-0e65-47cf-a03e-15163a345d32 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:13.327611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fac940ac-0e65-47cf-a03e-15163a345d32 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:13.482297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f6dae67c-aef9-4f68-90ac-4947e4b60a6e tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1346a00d2f4c6898144f51eca037f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54936b67ff8842008c37ef8588add58f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:13.496910 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f6dae67c-aef9-4f68-90ac-4947e4b60a6e tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] 10.222.0.49 "GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701" status: 200 len: 1511 microversion: 2.1 time: 0.386508 May 21 21:29:13.503368 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2124/4385] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:13 2022] GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701 => generated 1511 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:13.842390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fac940ac-0e65-47cf-a03e-15163a345d32 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:13.860854 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fac940ac-0e65-47cf-a03e-15163a345d32 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 200 len: 1308 microversion: 2.1 time: 0.552327 May 21 21:29:13.861829 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2262/4386] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:13 2022] GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 1308 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:14.250636 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-29fa279a-a216-4cdd-8769-fc5ea87df0ec tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:14.251240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-29fa279a-a216-4cdd-8769-fc5ea87df0ec tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: e2be17b7-988e-4845-9959-5fa04cbed245] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:14.259204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-29fa279a-a216-4cdd-8769-fc5ea87df0ec tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:14.259663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-29fa279a-a216-4cdd-8769-fc5ea87df0ec tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:14.260717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-29fa279a-a216-4cdd-8769-fc5ea87df0ec tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:14.261145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-29fa279a-a216-4cdd-8769-fc5ea87df0ec tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:14.276604 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-29fa279a-a216-4cdd-8769-fc5ea87df0ec tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] HTTP exception thrown: Instance e2be17b7-988e-4845-9959-5fa04cbed245 could not be found. May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-29fa279a-a216-4cdd-8769-fc5ea87df0ec tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Request method failure captured: May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245 HTTP/1.1 May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVgQv9k80egN_Z5oxm6zD7gV_sf1gMqqxBRx1iY9MeJj0DeNsoKLr8-8NIWiLDly20rLKVCAE8Xz0N5MgNbJYqnUGb2g2Kh6fJPvfPYKD1-lSj4wpNCcDbjlxj4-dXOUNAfghSaWJ8EAEG0fA3XOci0JYwtRE0jKJ3nFNlo1G7Keylg May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 014ae80b3f434bcb9fa2629ccdf4aad7 May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerActionsTestJSON-643676444 May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/014ae80b3f434bcb9fa2629ccdf4aad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/014ae80b3f434bcb9fa2629ccdf4aad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_014ae80b3f434bcb9fa2629ccdf4aad7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/014ae80b3f434bcb9fa2629ccdf4aad7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerActionsTestJSON-643676444 May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 014ae80b3f434bcb9fa2629ccdf4aad7 May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerActionsTestJSON-643676444 May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerActionsTestJSON-643676444-project May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1cafab0cbef64be59c7afef84d7888ff May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerActionsTestJSON-643676444-project May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance e2be17b7-988e-4845-9959-5fa04cbed245 could not be found. May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'e2be17b7-988e-4845-9959-5fa04cbed245'} May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2be17b7-988e-4845-9959-5fa04cbed245 could not be found. May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2be17b7-988e-4845-9959-5fa04cbed245 could not be found. May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:29:14.278294 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:14.282925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:14.282925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:29:14.282925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:29:14.282925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:29:14.282925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:29:14.282925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2be17b7-988e-4845-9959-5fa04cbed245 could not be found. May 21 21:29:14.282925 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:14.282925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-29fa279a-a216-4cdd-8769-fc5ea87df0ec tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Returning 404 to user: Instance e2be17b7-988e-4845-9959-5fa04cbed245 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:29:14.282925 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-29fa279a-a216-4cdd-8769-fc5ea87df0ec tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245" status: 404 len: 111 microversion: 2.1 time: 0.033734 May 21 21:29:14.289625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b31d7981-a252-428d-822f-9a414f75271b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:14.290239 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b31d7981-a252-428d-822f-9a414f75271b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:14.293829 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2125/4387] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:14 2022] GET /compute/v2.1/servers/e2be17b7-988e-4845-9959-5fa04cbed245 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:29:14.298823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b31d7981-a252-428d-822f-9a414f75271b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:14.299303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b31d7981-a252-428d-822f-9a414f75271b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:14.300792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b31d7981-a252-428d-822f-9a414f75271b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:14.301449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b31d7981-a252-428d-822f-9a414f75271b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:14.333071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b31d7981-a252-428d-822f-9a414f75271b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:29:14.514593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2c4e499d-4a91-40bd-a30c-4cd3beb029db tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:14.515566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2c4e499d-4a91-40bd-a30c-4cd3beb029db tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:14.522709 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c4e499d-4a91-40bd-a30c-4cd3beb029db tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:14.523494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c4e499d-4a91-40bd-a30c-4cd3beb029db tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:14.524532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c4e499d-4a91-40bd-a30c-4cd3beb029db tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:14.525204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c4e499d-4a91-40bd-a30c-4cd3beb029db tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:14.566657 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c4e499d-4a91-40bd-a30c-4cd3beb029db tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:14.567445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c4e499d-4a91-40bd-a30c-4cd3beb029db tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:14.568102 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-2c4e499d-4a91-40bd-a30c-4cd3beb029db tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lazy-loading 'fault' on Instance uuid 95283bb8-0420-4ecf-bff1-b15ae04db701 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:29:14.622145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2c4e499d-4a91-40bd-a30c-4cd3beb029db tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1346a00d2f4c6898144f51eca037f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54936b67ff8842008c37ef8588add58f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:14.631929 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2c4e499d-4a91-40bd-a30c-4cd3beb029db tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] 10.222.0.49 "GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701" status: 200 len: 1306 microversion: 2.1 time: 0.121063 May 21 21:29:14.632837 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2126/4388] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:14 2022] GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701 => generated 1306 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:29:14.760007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-5e7d1c3e-a9df-40b3-bb40-55400e43f4a7 req-08b12617-c35a-4c73-a23b-70adcc21d8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95283bb8-0420-4ecf-bff1-b15ae04db701", "name": "network-vif-deleted", "tag": "82353255-b2e8-4550-a4d1-d2cb6151862f"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:14.779797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-5e7d1c3e-a9df-40b3-bb40-55400e43f4a7 req-08b12617-c35a-4c73-a23b-70adcc21d8d4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:14.781336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-5e7d1c3e-a9df-40b3-bb40-55400e43f4a7 req-08b12617-c35a-4c73-a23b-70adcc21d8d4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:14.811797 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b31d7981-a252-428d-822f-9a414f75271b tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 204 len: 0 microversion: 2.1 time: 0.524551 May 21 21:29:14.813509 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2263/4389] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:29:14 2022] DELETE /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:29:14.815097 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-5e7d1c3e-a9df-40b3-bb40-55400e43f4a7 req-08b12617-c35a-4c73-a23b-70adcc21d8d4 service nova] Creating event network-vif-deleted:82353255-b2e8-4550-a4d1-d2cb6151862f for instance 95283bb8-0420-4ecf-bff1-b15ae04db701 on nch2-master-1 May 21 21:29:14.823750 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-5e7d1c3e-a9df-40b3-bb40-55400e43f4a7 req-08b12617-c35a-4c73-a23b-70adcc21d8d4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067647 May 21 21:29:14.824877 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2127/4390] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:29:14.827875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7b1ed6d8-1c49-4eed-8a9a-95244e9ee9c5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:14.829283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7b1ed6d8-1c49-4eed-8a9a-95244e9ee9c5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:14.839986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7b1ed6d8-1c49-4eed-8a9a-95244e9ee9c5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:14.840714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7b1ed6d8-1c49-4eed-8a9a-95244e9ee9c5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:14.841715 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7b1ed6d8-1c49-4eed-8a9a-95244e9ee9c5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:14.843260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7b1ed6d8-1c49-4eed-8a9a-95244e9ee9c5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:14.880983 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c59c5a6c-8b2f-490c-8717-218df7af0360 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:14.882213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c59c5a6c-8b2f-490c-8717-218df7af0360 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:14.897541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c59c5a6c-8b2f-490c-8717-218df7af0360 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:14.898011 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c59c5a6c-8b2f-490c-8717-218df7af0360 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:14.898828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c59c5a6c-8b2f-490c-8717-218df7af0360 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:14.899339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c59c5a6c-8b2f-490c-8717-218df7af0360 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:15.257371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c59c5a6c-8b2f-490c-8717-218df7af0360 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:15.267378 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c59c5a6c-8b2f-490c-8717-218df7af0360 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 200 len: 1308 microversion: 2.1 time: 0.392393 May 21 21:29:15.269240 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2128/4391] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:14 2022] GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 1308 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:29:15.571134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7b1ed6d8-1c49-4eed-8a9a-95244e9ee9c5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:15.588983 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7b1ed6d8-1c49-4eed-8a9a-95244e9ee9c5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1494 microversion: 2.1 time: 0.768018 May 21 21:29:15.589674 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2264/4392] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:14 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1494 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:15.655483 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e0d74ce6-a0ca-4f40-9f83-e1a99a2f8ce8 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:15.656042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e0d74ce6-a0ca-4f40-9f83-e1a99a2f8ce8 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] [instance: 95283bb8-0420-4ecf-bff1-b15ae04db701] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:15.677898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0d74ce6-a0ca-4f40-9f83-e1a99a2f8ce8 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:15.678653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0d74ce6-a0ca-4f40-9f83-e1a99a2f8ce8 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:15.679522 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0d74ce6-a0ca-4f40-9f83-e1a99a2f8ce8 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:15.680242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0d74ce6-a0ca-4f40-9f83-e1a99a2f8ce8 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:15.730886 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-e0d74ce6-a0ca-4f40-9f83-e1a99a2f8ce8 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] HTTP exception thrown: Instance 95283bb8-0420-4ecf-bff1-b15ae04db701 could not be found. May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e0d74ce6-a0ca-4f40-9f83-e1a99a2f8ce8 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Request method failure captured: May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701 HTTP/1.1 May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVmUC_GNQlmnoW87G7eRLcvdh1mXMOrkKwIJ6ny1FyFqVgf8SEU8-tIG2M-2GXeUWp13lDAkGAVB5T41pMm9o8Vqdp2XdwJrZl5gvNCE6WpfVRbHGsHRspHO1fJHrvf9QcUIZ2EsJbwEg5rntpJAq8X2aH-4KGEMOLnUdmBQgPrfC6U May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 54936b67ff8842008c37ef8588add58f May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerPasswordTestJSON-1310576611 May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/54936b67ff8842008c37ef8588add58f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/54936b67ff8842008c37ef8588add58f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_54936b67ff8842008c37ef8588add58f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/54936b67ff8842008c37ef8588add58f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerPasswordTestJSON-1310576611 May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 54936b67ff8842008c37ef8588add58f May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1310576611 May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerPasswordTestJSON-1310576611-project May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 8b1346a00d2f4c6898144f51eca037f0 May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerPasswordTestJSON-1310576611-project May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 95283bb8-0420-4ecf-bff1-b15ae04db701 could not be found. May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '95283bb8-0420-4ecf-bff1-b15ae04db701'} May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95283bb8-0420-4ecf-bff1-b15ae04db701 could not be found. May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95283bb8-0420-4ecf-bff1-b15ae04db701 could not be found. May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:29:15.733938 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:15.740485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:15.740485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:29:15.740485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:29:15.740485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:29:15.740485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:29:15.740485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95283bb8-0420-4ecf-bff1-b15ae04db701 could not be found. May 21 21:29:15.740485 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:15.744318 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e0d74ce6-a0ca-4f40-9f83-e1a99a2f8ce8 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] Returning 404 to user: Instance 95283bb8-0420-4ecf-bff1-b15ae04db701 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:29:15.745615 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e0d74ce6-a0ca-4f40-9f83-e1a99a2f8ce8 tempest-ServerPasswordTestJSON-1310576611 tempest-ServerPasswordTestJSON-1310576611-project] 10.222.0.49 "GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701" status: 404 len: 111 microversion: 2.1 time: 0.096914 May 21 21:29:15.763668 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2129/4393] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:15 2022] GET /compute/v2.1/servers/95283bb8-0420-4ecf-bff1-b15ae04db701 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:29:16.028717 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-607c12a1-70b4-4baf-91c1-e647fe6b85d2 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-298355580", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:16.112216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-607c12a1-70b4-4baf-91c1-e647fe6b85d2 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] validate_networks() for [('2322dac3-cc4b-44d6-acd1-757c77fbeee8', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:29:16.287853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-18e0762c-c4e8-47ca-a9cf-11c256a11346 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:16.289309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-18e0762c-c4e8-47ca-a9cf-11c256a11346 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:16.317205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-18e0762c-c4e8-47ca-a9cf-11c256a11346 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:16.317880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-18e0762c-c4e8-47ca-a9cf-11c256a11346 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:16.318967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-18e0762c-c4e8-47ca-a9cf-11c256a11346 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:16.320455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-18e0762c-c4e8-47ca-a9cf-11c256a11346 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:17.012612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-18e0762c-c4e8-47ca-a9cf-11c256a11346 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:17.029632 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-18e0762c-c4e8-47ca-a9cf-11c256a11346 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 200 len: 1308 microversion: 2.1 time: 0.742439 May 21 21:29:17.040430 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2130/4394] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:16 2022] GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 1308 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:29:17.040996 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cc58ac14-e42a-4124-9f3f-3399e16f1c5a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:17.041317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cc58ac14-e42a-4124-9f3f-3399e16f1c5a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:17.063306 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cc58ac14-e42a-4124-9f3f-3399e16f1c5a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:17.064070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cc58ac14-e42a-4124-9f3f-3399e16f1c5a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:17.065067 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cc58ac14-e42a-4124-9f3f-3399e16f1c5a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:17.065779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cc58ac14-e42a-4124-9f3f-3399e16f1c5a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:17.591156 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-607c12a1-70b4-4baf-91c1-e647fe6b85d2 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:29:17.592475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-607c12a1-70b4-4baf-91c1-e647fe6b85d2 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:29:17.593225 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-607c12a1-70b4-4baf-91c1-e647fe6b85d2 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:29:17.594018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-607c12a1-70b4-4baf-91c1-e647fe6b85d2 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:29:17.594613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-607c12a1-70b4-4baf-91c1-e647fe6b85d2 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:29:17.606991 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-607c12a1-70b4-4baf-91c1-e647fe6b85d2 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:17.607587 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-607c12a1-70b4-4baf-91c1-e647fe6b85d2 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:17.608581 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-607c12a1-70b4-4baf-91c1-e647fe6b85d2 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:17.609124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-607c12a1-70b4-4baf-91c1-e647fe6b85d2 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:17.619435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cc58ac14-e42a-4124-9f3f-3399e16f1c5a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:17.631444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-607c12a1-70b4-4baf-91c1-e647fe6b85d2 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Getting quotas for project a426b85d93724b898ba8ce8c68dcead6. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:29:17.632166 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cc58ac14-e42a-4124-9f3f-3399e16f1c5a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1494 microversion: 2.1 time: 0.599046 May 21 21:29:17.632812 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2131/4395] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:17 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1494 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:17.637982 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:UPDATE=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:17.642397 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-1868218d-4731-4e43-bc8f-80a41b4054f3 req-bf606f44-c22a-40ec-8923-b51b8bdf0555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00f49c4e-7f9e-48b8-a1db-6be0456b1ebd", "tag": "02b48e5c-26c2-4eec-8630-4c7efb77ac9b"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:17.644571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-607c12a1-70b4-4baf-91c1-e647fe6b85d2 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Getting quotas for user cbbbb5240ae944cdb9797e78dce65978 and project a426b85d93724b898ba8ce8c68dcead6. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:29:17.661641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-607c12a1-70b4-4baf-91c1-e647fe6b85d2 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:29:17.665139 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-607c12a1-70b4-4baf-91c1-e647fe6b85d2 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:29:17.692129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-1868218d-4731-4e43-bc8f-80a41b4054f3 req-bf606f44-c22a-40ec-8923-b51b8bdf0555 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:17.692947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-1868218d-4731-4e43-bc8f-80a41b4054f3 req-bf606f44-c22a-40ec-8923-b51b8bdf0555 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:17.733339 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-1868218d-4731-4e43-bc8f-80a41b4054f3 req-bf606f44-c22a-40ec-8923-b51b8bdf0555 service nova] Creating event network-changed:02b48e5c-26c2-4eec-8630-4c7efb77ac9b for instance 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd on nch1-master-1 May 21 21:29:17.767429 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-1868218d-4731-4e43-bc8f-80a41b4054f3 req-bf606f44-c22a-40ec-8923-b51b8bdf0555 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131855 May 21 21:29:17.773682 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2132/4396] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:29:17.838641 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-607c12a1-70b4-4baf-91c1-e647fe6b85d2 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.038615 May 21 21:29:17.839635 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2265/4397] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:29:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 2041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:29:17.851528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-652a1b6f-50d4-462f-8d65-4e8b6fc77868 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:17.852676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-652a1b6f-50d4-462f-8d65-4e8b6fc77868 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:18.048333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-61ca6241-0781-4a9f-bdcc-52288d401e6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:18.049320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-61ca6241-0781-4a9f-bdcc-52288d401e6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:18.061191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61ca6241-0781-4a9f-bdcc-52288d401e6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:18.064020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61ca6241-0781-4a9f-bdcc-52288d401e6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:18.065072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61ca6241-0781-4a9f-bdcc-52288d401e6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:18.067771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61ca6241-0781-4a9f-bdcc-52288d401e6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:18.081558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:18.124608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-652a1b6f-50d4-462f-8d65-4e8b6fc77868 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:18.133153 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-652a1b6f-50d4-462f-8d65-4e8b6fc77868 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1222 microversion: 2.1 time: 0.287143 May 21 21:29:18.145765 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2133/4398] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:17 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1222 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:18.591444 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-9c173a5f-2546-4cc7-a24f-9b0698166d90 req-f2dbf4d9-c5de-4c2c-a75e-a0b0f8b5f5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b995447a-7335-44b9-b320-e69e0b367044", "name": "network-vif-deleted", "tag": "e1aa3212-fbaf-44c0-9915-1e4383a32087"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:18.615687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9c173a5f-2546-4cc7-a24f-9b0698166d90 req-f2dbf4d9-c5de-4c2c-a75e-a0b0f8b5f5b0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:18.617300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9c173a5f-2546-4cc7-a24f-9b0698166d90 req-f2dbf4d9-c5de-4c2c-a75e-a0b0f8b5f5b0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:18.634494 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-9c173a5f-2546-4cc7-a24f-9b0698166d90 req-f2dbf4d9-c5de-4c2c-a75e-a0b0f8b5f5b0 service nova] Creating event network-vif-deleted:e1aa3212-fbaf-44c0-9915-1e4383a32087 for instance b995447a-7335-44b9-b320-e69e0b367044 on nch1-master-1 May 21 21:29:18.650093 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-9c173a5f-2546-4cc7-a24f-9b0698166d90 req-f2dbf4d9-c5de-4c2c-a75e-a0b0f8b5f5b0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072160 May 21 21:29:18.691316 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2134/4399] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:29:18.699216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-61ca6241-0781-4a9f-bdcc-52288d401e6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:18.711455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fbc607d5-cebd-4333-a45e-90aee62640bb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:18.713883 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-61ca6241-0781-4a9f-bdcc-52288d401e6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 200 len: 1308 microversion: 2.1 time: 0.668274 May 21 21:29:18.715572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fbc607d5-cebd-4333-a45e-90aee62640bb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:18.716754 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2266/4400] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:18 2022] GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 1308 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:18.744883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fbc607d5-cebd-4333-a45e-90aee62640bb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:18.764463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fbc607d5-cebd-4333-a45e-90aee62640bb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:18.770047 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fbc607d5-cebd-4333-a45e-90aee62640bb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:18.773956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fbc607d5-cebd-4333-a45e-90aee62640bb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:18.924468 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fbc607d5-cebd-4333-a45e-90aee62640bb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:18.947960 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fbc607d5-cebd-4333-a45e-90aee62640bb tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1452 microversion: 2.1 time: 0.243448 May 21 21:29:18.947960 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2135/4401] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:18 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1452 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:19.155328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0e6ce06f-7e88-4174-8967-77942b4f0d60 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:19.155965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0e6ce06f-7e88-4174-8967-77942b4f0d60 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:19.270258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0e6ce06f-7e88-4174-8967-77942b4f0d60 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:19.284888 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0e6ce06f-7e88-4174-8967-77942b4f0d60 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1222 microversion: 2.1 time: 0.132246 May 21 21:29:19.285899 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2267/4402] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:19 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1222 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:19.734684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5c4779ac-2eef-4697-8638-086038e65d15 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:19.735906 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5c4779ac-2eef-4697-8638-086038e65d15 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:19.745629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c4779ac-2eef-4697-8638-086038e65d15 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:19.746368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c4779ac-2eef-4697-8638-086038e65d15 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:19.747402 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c4779ac-2eef-4697-8638-086038e65d15 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:19.748107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c4779ac-2eef-4697-8638-086038e65d15 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:19.957853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e1083251-717a-4b6a-829b-f1298897c2d9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:19.958547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e1083251-717a-4b6a-829b-f1298897c2d9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:19.974902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1083251-717a-4b6a-829b-f1298897c2d9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:19.975470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1083251-717a-4b6a-829b-f1298897c2d9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:19.976266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1083251-717a-4b6a-829b-f1298897c2d9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:19.976749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1083251-717a-4b6a-829b-f1298897c2d9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:20.055011 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1083251-717a-4b6a-829b-f1298897c2d9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:20.055743 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1083251-717a-4b6a-829b-f1298897c2d9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:20.057778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-e1083251-717a-4b6a-829b-f1298897c2d9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lazy-loading 'fault' on Instance uuid b995447a-7335-44b9-b320-e69e0b367044 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:29:20.150784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5c4779ac-2eef-4697-8638-086038e65d15 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:20.158792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e1083251-717a-4b6a-829b-f1298897c2d9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:20.169288 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5c4779ac-2eef-4697-8638-086038e65d15 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 200 len: 1308 microversion: 2.1 time: 0.438360 May 21 21:29:20.180130 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e1083251-717a-4b6a-829b-f1298897c2d9 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 200 len: 1304 microversion: 2.1 time: 0.228921 May 21 21:29:20.180446 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2136/4403] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:19 2022] GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 1308 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:20.180995 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2268/4404] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:19 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 1304 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:20.303451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4f6d36b1-fddc-40a7-8a71-36251a15124f tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:20.304088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4f6d36b1-fddc-40a7-8a71-36251a15124f tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:20.319007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f6d36b1-fddc-40a7-8a71-36251a15124f tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:20.320009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f6d36b1-fddc-40a7-8a71-36251a15124f tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:20.321169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f6d36b1-fddc-40a7-8a71-36251a15124f tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:20.321862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f6d36b1-fddc-40a7-8a71-36251a15124f tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:20.384951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:20.560359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4f6d36b1-fddc-40a7-8a71-36251a15124f tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:20.571289 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4f6d36b1-fddc-40a7-8a71-36251a15124f tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1226 microversion: 2.1 time: 0.272865 May 21 21:29:20.571892 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2137/4405] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:20 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1226 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:21.187592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f34e0f99-9a68-49e5-8681-5492f0ac4d01 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:21.189315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f34e0f99-9a68-49e5-8681-5492f0ac4d01 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:21.197880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ade0d641-ce92-4db7-84ee-5fb729542e5e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:21.200031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ade0d641-ce92-4db7-84ee-5fb729542e5e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: b995447a-7335-44b9-b320-e69e0b367044] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:21.205883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f34e0f99-9a68-49e5-8681-5492f0ac4d01 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:21.206352 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f34e0f99-9a68-49e5-8681-5492f0ac4d01 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:21.207156 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f34e0f99-9a68-49e5-8681-5492f0ac4d01 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:21.207600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f34e0f99-9a68-49e5-8681-5492f0ac4d01 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:21.225625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ade0d641-ce92-4db7-84ee-5fb729542e5e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:21.227253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ade0d641-ce92-4db7-84ee-5fb729542e5e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:21.228698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ade0d641-ce92-4db7-84ee-5fb729542e5e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:21.229870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ade0d641-ce92-4db7-84ee-5fb729542e5e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:21.271009 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-ade0d641-ce92-4db7-84ee-5fb729542e5e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] HTTP exception thrown: Instance b995447a-7335-44b9-b320-e69e0b367044 could not be found. May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ade0d641-ce92-4db7-84ee-5fb729542e5e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Request method failure captured: May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 HTTP/1.1 May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVgQv9k80egN_Z5oxm6zD7gV_sf1gMqqxBRx1iY9MeJj0DeNsoKLr8-8NIWiLDly20rLKVCAE8Xz0N5MgNbJYqnUGb2g2Kh6fJPvfPYKD1-lSj4wpNCcDbjlxj4-dXOUNAfghSaWJ8EAEG0fA3XOci0JYwtRE0jKJ3nFNlo1G7Keylg May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 014ae80b3f434bcb9fa2629ccdf4aad7 May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerActionsTestJSON-643676444 May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/014ae80b3f434bcb9fa2629ccdf4aad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/014ae80b3f434bcb9fa2629ccdf4aad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_014ae80b3f434bcb9fa2629ccdf4aad7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/014ae80b3f434bcb9fa2629ccdf4aad7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerActionsTestJSON-643676444 May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 014ae80b3f434bcb9fa2629ccdf4aad7 May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerActionsTestJSON-643676444 May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerActionsTestJSON-643676444-project May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1cafab0cbef64be59c7afef84d7888ff May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerActionsTestJSON-643676444-project May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance b995447a-7335-44b9-b320-e69e0b367044 could not be found. May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'b995447a-7335-44b9-b320-e69e0b367044'} May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b995447a-7335-44b9-b320-e69e0b367044 could not be found. May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b995447a-7335-44b9-b320-e69e0b367044 could not be found. May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:29:21.279607 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:21.285252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:21.285252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:29:21.285252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:29:21.285252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:29:21.285252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:29:21.285252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b995447a-7335-44b9-b320-e69e0b367044 could not be found. May 21 21:29:21.285252 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:21.285252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ade0d641-ce92-4db7-84ee-5fb729542e5e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Returning 404 to user: Instance b995447a-7335-44b9-b320-e69e0b367044 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:29:21.285252 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ade0d641-ce92-4db7-84ee-5fb729542e5e tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044" status: 404 len: 111 microversion: 2.1 time: 0.088302 May 21 21:29:21.285252 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2138/4406] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:21 2022] GET /compute/v2.1/servers/b995447a-7335-44b9-b320-e69e0b367044 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:29:21.295909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-11947475-034c-4502-ba6f-d96309cb91b0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:21.296477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-11947475-034c-4502-ba6f-d96309cb91b0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:21.305015 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11947475-034c-4502-ba6f-d96309cb91b0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:21.305720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11947475-034c-4502-ba6f-d96309cb91b0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:21.306810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11947475-034c-4502-ba6f-d96309cb91b0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:21.307591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11947475-034c-4502-ba6f-d96309cb91b0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:21.370212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-11947475-034c-4502-ba6f-d96309cb91b0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:29:21.777380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f34e0f99-9a68-49e5-8681-5492f0ac4d01 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:21.792367 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f34e0f99-9a68-49e5-8681-5492f0ac4d01 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 200 len: 1308 microversion: 2.1 time: 0.606839 May 21 21:29:21.794220 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2269/4407] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:21 2022] GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 1308 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:21.800191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1bc58676-24d7-4b64-99bf-68308584e05e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:21.801384 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1bc58676-24d7-4b64-99bf-68308584e05e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:21.810129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1bc58676-24d7-4b64-99bf-68308584e05e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:21.811407 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1bc58676-24d7-4b64-99bf-68308584e05e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:21.812425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1bc58676-24d7-4b64-99bf-68308584e05e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:21.813041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1bc58676-24d7-4b64-99bf-68308584e05e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:21.845360 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-11947475-034c-4502-ba6f-d96309cb91b0 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "DELETE /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 204 len: 0 microversion: 2.1 time: 0.558126 May 21 21:29:21.851135 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2139/4408] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:29:21 2022] DELETE /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:29:21.951407 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1bc58676-24d7-4b64-99bf-68308584e05e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:21.959880 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:21.974671 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1bc58676-24d7-4b64-99bf-68308584e05e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1282 microversion: 2.1 time: 0.174595 May 21 21:29:21.975696 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2270/4409] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:21 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1282 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:21.984997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-286781cc-37ae-4b52-8e5d-ab7e883f049a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:21.997351 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-286781cc-37ae-4b52-8e5d-ab7e883f049a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:22.007426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-286781cc-37ae-4b52-8e5d-ab7e883f049a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:22.008166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-286781cc-37ae-4b52-8e5d-ab7e883f049a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:22.009387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-286781cc-37ae-4b52-8e5d-ab7e883f049a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:22.010017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-286781cc-37ae-4b52-8e5d-ab7e883f049a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:22.122466 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f0975faf-a5bc-47a6-8508-17b5f2cf0867 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-926252299", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": "none"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:22.186691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f0975faf-a5bc-47a6-8508-17b5f2cf0867 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:29:22.187131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f0975faf-a5bc-47a6-8508-17b5f2cf0867 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:29:22.187668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f0975faf-a5bc-47a6-8508-17b5f2cf0867 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:29:22.188605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f0975faf-a5bc-47a6-8508-17b5f2cf0867 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:29:22.189062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f0975faf-a5bc-47a6-8508-17b5f2cf0867 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:29:22.198843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0975faf-a5bc-47a6-8508-17b5f2cf0867 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:22.199483 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0975faf-a5bc-47a6-8508-17b5f2cf0867 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:22.200352 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0975faf-a5bc-47a6-8508-17b5f2cf0867 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:22.200799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0975faf-a5bc-47a6-8508-17b5f2cf0867 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:22.218811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-f0975faf-a5bc-47a6-8508-17b5f2cf0867 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Getting quotas for project 9dbdb88e011245faab8a76a2d05f445c. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:29:22.225377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-f0975faf-a5bc-47a6-8508-17b5f2cf0867 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Getting quotas for user d3197c70ce304c79a952555606b9b4d2 and project 9dbdb88e011245faab8a76a2d05f445c. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:29:22.239527 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f0975faf-a5bc-47a6-8508-17b5f2cf0867 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:29:22.242194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f0975faf-a5bc-47a6-8508-17b5f2cf0867 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:29:22.242608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-286781cc-37ae-4b52-8e5d-ab7e883f049a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:22.251046 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-286781cc-37ae-4b52-8e5d-ab7e883f049a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1674 microversion: 2.1 time: 0.273696 May 21 21:29:22.252053 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2271/4410] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:21 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1674 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:22.491745 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f0975faf-a5bc-47a6-8508-17b5f2cf0867 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.634732 May 21 21:29:22.497978 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2140/4411] 10.222.0.49 () {62 vars in 1187 bytes} [Sat May 21 21:29:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 21 21:29:22.508300 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8b2a59e3-3ff9-4edb-b5f8-60b2c06c15bd tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:22.508932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8b2a59e3-3ff9-4edb-b5f8-60b2c06c15bd tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:22.682188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8b2a59e3-3ff9-4edb-b5f8-60b2c06c15bd tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:22.691235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8b2a59e3-3ff9-4edb-b5f8-60b2c06c15bd tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:22.693011 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8b2a59e3-3ff9-4edb-b5f8-60b2c06c15bd tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:22.694176 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8b2a59e3-3ff9-4edb-b5f8-60b2c06c15bd tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1277 microversion: 2.54 time: 0.189882 May 21 21:29:22.712670 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2272/4412] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:22 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1277 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:22.810949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d76aa5c8-8e56-49c9-a35c-4e9afff5c83e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:22.812169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d76aa5c8-8e56-49c9-a35c-4e9afff5c83e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:22.819140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d76aa5c8-8e56-49c9-a35c-4e9afff5c83e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:22.820489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d76aa5c8-8e56-49c9-a35c-4e9afff5c83e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:22.821689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d76aa5c8-8e56-49c9-a35c-4e9afff5c83e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:22.822329 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d76aa5c8-8e56-49c9-a35c-4e9afff5c83e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:22.997602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-92b90bae-5f7e-4031-b3d0-32c14df319c0 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:22.997602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-92b90bae-5f7e-4031-b3d0-32c14df319c0 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:23.003484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-92b90bae-5f7e-4031-b3d0-32c14df319c0 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:23.003969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-92b90bae-5f7e-4031-b3d0-32c14df319c0 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:23.004790 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-92b90bae-5f7e-4031-b3d0-32c14df319c0 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:23.006364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-92b90bae-5f7e-4031-b3d0-32c14df319c0 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:23.016449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d76aa5c8-8e56-49c9-a35c-4e9afff5c83e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:23.026355 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d76aa5c8-8e56-49c9-a35c-4e9afff5c83e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 200 len: 1308 microversion: 2.1 time: 0.218723 May 21 21:29:23.026931 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2141/4413] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:22 2022] GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 1308 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:23.096640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-92b90bae-5f7e-4031-b3d0-32c14df319c0 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:23.110501 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-92b90bae-5f7e-4031-b3d0-32c14df319c0 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1280 microversion: 2.1 time: 0.122285 May 21 21:29:23.111860 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2273/4414] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:22 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1280 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:23.269939 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b8c01807-9b9b-4c9d-8edc-2624f1527e9a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:23.270700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b8c01807-9b9b-4c9d-8edc-2624f1527e9a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:23.282983 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b8c01807-9b9b-4c9d-8edc-2624f1527e9a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:23.283454 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b8c01807-9b9b-4c9d-8edc-2624f1527e9a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:23.284326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b8c01807-9b9b-4c9d-8edc-2624f1527e9a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:23.284831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b8c01807-9b9b-4c9d-8edc-2624f1527e9a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:23.573394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b8c01807-9b9b-4c9d-8edc-2624f1527e9a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:23.584678 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b8c01807-9b9b-4c9d-8edc-2624f1527e9a tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1674 microversion: 2.1 time: 0.320027 May 21 21:29:23.588192 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2142/4415] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:23 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1674 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:23.665543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-e8bd5cf9-d241-4661-adb9-4faba633b837 req-5faf7496-2ff3-413d-abc9-3d22a54a7587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00f49c4e-7f9e-48b8-a1db-6be0456b1ebd", "name": "network-vif-plugged", "status": "completed", "tag": "02b48e5c-26c2-4eec-8630-4c7efb77ac9b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:23.682071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-e8bd5cf9-d241-4661-adb9-4faba633b837 req-5faf7496-2ff3-413d-abc9-3d22a54a7587 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:23.682811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-e8bd5cf9-d241-4661-adb9-4faba633b837 req-5faf7496-2ff3-413d-abc9-3d22a54a7587 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:23.700687 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-e8bd5cf9-d241-4661-adb9-4faba633b837 req-5faf7496-2ff3-413d-abc9-3d22a54a7587 service nova] Creating event network-vif-plugged:02b48e5c-26c2-4eec-8630-4c7efb77ac9b for instance 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd on nch1-master-1 May 21 21:29:23.707920 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-e8bd5cf9-d241-4661-adb9-4faba633b837 req-5faf7496-2ff3-413d-abc9-3d22a54a7587 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048384 May 21 21:29:23.709328 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2274/4416] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:29:23.720859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7770a6d6-f7d0-4b0f-adad-2a71d5469bdb tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:23.725824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7770a6d6-f7d0-4b0f-adad-2a71d5469bdb tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:24.045511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a21de148-6d38-4a21-aa54-7c5fd6b16a7d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:24.046278 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a21de148-6d38-4a21-aa54-7c5fd6b16a7d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:24.054616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a21de148-6d38-4a21-aa54-7c5fd6b16a7d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:24.055407 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a21de148-6d38-4a21-aa54-7c5fd6b16a7d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:24.056227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a21de148-6d38-4a21-aa54-7c5fd6b16a7d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:24.056701 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a21de148-6d38-4a21-aa54-7c5fd6b16a7d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:24.065284 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7770a6d6-f7d0-4b0f-adad-2a71d5469bdb tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:24.075967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7770a6d6-f7d0-4b0f-adad-2a71d5469bdb tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:24.078152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7770a6d6-f7d0-4b0f-adad-2a71d5469bdb tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:24.079367 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7770a6d6-f7d0-4b0f-adad-2a71d5469bdb tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1277 microversion: 2.54 time: 0.362462 May 21 21:29:24.080327 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2143/4417] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:23 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1277 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:24.129620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0357fdf6-f117-41b5-80e3-a38d6a3c1625 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:24.130660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0357fdf6-f117-41b5-80e3-a38d6a3c1625 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:24.137139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0357fdf6-f117-41b5-80e3-a38d6a3c1625 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:24.137737 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0357fdf6-f117-41b5-80e3-a38d6a3c1625 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:24.138711 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0357fdf6-f117-41b5-80e3-a38d6a3c1625 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:24.139149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0357fdf6-f117-41b5-80e3-a38d6a3c1625 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:24.363953 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a21de148-6d38-4a21-aa54-7c5fd6b16a7d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:24.373756 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a21de148-6d38-4a21-aa54-7c5fd6b16a7d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 200 len: 1308 microversion: 2.1 time: 0.333079 May 21 21:29:24.377671 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2275/4418] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:24 2022] GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 1308 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:29:24.558350 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0357fdf6-f117-41b5-80e3-a38d6a3c1625 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:24.566873 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0357fdf6-f117-41b5-80e3-a38d6a3c1625 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1322 microversion: 2.1 time: 0.442446 May 21 21:29:24.569227 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2144/4419] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:24 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1322 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:24.603802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f83f1a98-4f57-4adc-a844-cb2bee457fd8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:24.605497 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f83f1a98-4f57-4adc-a844-cb2bee457fd8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:24.618405 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f83f1a98-4f57-4adc-a844-cb2bee457fd8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:24.619217 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f83f1a98-4f57-4adc-a844-cb2bee457fd8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:24.620268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f83f1a98-4f57-4adc-a844-cb2bee457fd8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:24.621444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f83f1a98-4f57-4adc-a844-cb2bee457fd8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:25.090849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f83f1a98-4f57-4adc-a844-cb2bee457fd8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:25.100400 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3819afa4-23c4-47c0-afe3-6a26ffadee48 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:25.103483 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3819afa4-23c4-47c0-afe3-6a26ffadee48 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:25.106172 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f83f1a98-4f57-4adc-a844-cb2bee457fd8 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1674 microversion: 2.1 time: 0.506409 May 21 21:29:25.107599 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2276/4420] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:24 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1674 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:25.111092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3819afa4-23c4-47c0-afe3-6a26ffadee48 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:25.112200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3819afa4-23c4-47c0-afe3-6a26ffadee48 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:25.113447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3819afa4-23c4-47c0-afe3-6a26ffadee48 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:25.114081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3819afa4-23c4-47c0-afe3-6a26ffadee48 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:25.215571 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3819afa4-23c4-47c0-afe3-6a26ffadee48 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:25.225198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3819afa4-23c4-47c0-afe3-6a26ffadee48 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:25.227230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3819afa4-23c4-47c0-afe3-6a26ffadee48 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:25.228609 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3819afa4-23c4-47c0-afe3-6a26ffadee48 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1329 microversion: 2.54 time: 0.133762 May 21 21:29:25.231628 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2145/4421] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:25 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1329 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:25.402616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b8842b12-1b89-420a-86b7-a4f17520d3e0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:25.405068 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b8842b12-1b89-420a-86b7-a4f17520d3e0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:25.420485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-3d5343d7-e558-45c8-8fc0-b6c77316cd24 req-c6aa53de-7ff7-4a7e-a38c-af03a71c032b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b507bdf-67be-44d6-be35-c2b41d16f48f", "tag": "f1e3e151-e89e-4972-b253-8b889eef1d77"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:25.438134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3d5343d7-e558-45c8-8fc0-b6c77316cd24 req-c6aa53de-7ff7-4a7e-a38c-af03a71c032b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:25.438582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3d5343d7-e558-45c8-8fc0-b6c77316cd24 req-c6aa53de-7ff7-4a7e-a38c-af03a71c032b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:25.442643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8842b12-1b89-420a-86b7-a4f17520d3e0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:25.443856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8842b12-1b89-420a-86b7-a4f17520d3e0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:25.444722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8842b12-1b89-420a-86b7-a4f17520d3e0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:25.447837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8842b12-1b89-420a-86b7-a4f17520d3e0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:25.468935 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-3d5343d7-e558-45c8-8fc0-b6c77316cd24 req-c6aa53de-7ff7-4a7e-a38c-af03a71c032b service nova] Creating event network-changed:f1e3e151-e89e-4972-b253-8b889eef1d77 for instance 2b507bdf-67be-44d6-be35-c2b41d16f48f on nch2-master-1 May 21 21:29:25.505734 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-3d5343d7-e558-45c8-8fc0-b6c77316cd24 req-c6aa53de-7ff7-4a7e-a38c-af03a71c032b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096783 May 21 21:29:25.509576 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2146/4422] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:29:25.587539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-20a384e7-3cc5-459a-8a27-f1730ef489bd tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:25.588783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-20a384e7-3cc5-459a-8a27-f1730ef489bd tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:25.598615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20a384e7-3cc5-459a-8a27-f1730ef489bd tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:25.599067 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20a384e7-3cc5-459a-8a27-f1730ef489bd tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:25.607346 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20a384e7-3cc5-459a-8a27-f1730ef489bd tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:25.607862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20a384e7-3cc5-459a-8a27-f1730ef489bd tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:25.978462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b8842b12-1b89-420a-86b7-a4f17520d3e0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:25.986820 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b8842b12-1b89-420a-86b7-a4f17520d3e0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 200 len: 1308 microversion: 2.1 time: 0.595579 May 21 21:29:25.991252 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2277/4423] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:25 2022] GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 1308 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:25.998415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-1fe61896-5886-4775-a41a-cfd4bf624a06 req-030f28bf-c268-4e74-988f-1af75b9482c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168c8024-2cb4-4135-be5d-7a5cfcc6e895", "name": "network-vif-deleted", "tag": "fcc08185-a786-4b24-9deb-2bfaacaf7c9b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:26.024205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-1fe61896-5886-4775-a41a-cfd4bf624a06 req-030f28bf-c268-4e74-988f-1af75b9482c0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:26.025270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-1fe61896-5886-4775-a41a-cfd4bf624a06 req-030f28bf-c268-4e74-988f-1af75b9482c0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:26.057180 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-1fe61896-5886-4775-a41a-cfd4bf624a06 req-030f28bf-c268-4e74-988f-1af75b9482c0 service nova] Creating event network-vif-deleted:fcc08185-a786-4b24-9deb-2bfaacaf7c9b for instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 on nch1-master-1 May 21 21:29:26.074595 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-1fe61896-5886-4775-a41a-cfd4bf624a06 req-030f28bf-c268-4e74-988f-1af75b9482c0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081699 May 21 21:29:26.075563 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2278/4424] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:29:26.125904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-69c15ec8-1637-4830-a23d-cb11bd9798dc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:26.130139 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-69c15ec8-1637-4830-a23d-cb11bd9798dc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:26.136206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-69c15ec8-1637-4830-a23d-cb11bd9798dc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:26.137203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-69c15ec8-1637-4830-a23d-cb11bd9798dc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:26.138202 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-69c15ec8-1637-4830-a23d-cb11bd9798dc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:26.138821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-69c15ec8-1637-4830-a23d-cb11bd9798dc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:26.449081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-69c15ec8-1637-4830-a23d-cb11bd9798dc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:26.461184 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-69c15ec8-1637-4830-a23d-cb11bd9798dc tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1606 microversion: 2.1 time: 0.338286 May 21 21:29:26.464501 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2279/4425] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:26 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1606 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:29:26.480621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7663c7c3-968c-4476-b708-194d583f4170 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:26.481716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7663c7c3-968c-4476-b708-194d583f4170 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:26.496586 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7663c7c3-968c-4476-b708-194d583f4170 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:26.497604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7663c7c3-968c-4476-b708-194d583f4170 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:26.498590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7663c7c3-968c-4476-b708-194d583f4170 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:26.500444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7663c7c3-968c-4476-b708-194d583f4170 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:26.536872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-20a384e7-3cc5-459a-8a27-f1730ef489bd tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:26.545525 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-20a384e7-3cc5-459a-8a27-f1730ef489bd tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1322 microversion: 2.1 time: 0.963117 May 21 21:29:26.555205 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2147/4426] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:25 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1322 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:26.626029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7663c7c3-968c-4476-b708-194d583f4170 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:26.640220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7663c7c3-968c-4476-b708-194d583f4170 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:26.642296 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7663c7c3-968c-4476-b708-194d583f4170 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:26.644258 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7663c7c3-968c-4476-b708-194d583f4170 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1337 microversion: 2.54 time: 0.178502 May 21 21:29:26.687231 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2280/4427] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:26 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1337 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:27.008256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1178d97f-15f0-4355-9f72-13a0f37ce407 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:27.008888 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1178d97f-15f0-4355-9f72-13a0f37ce407 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:27.015501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1178d97f-15f0-4355-9f72-13a0f37ce407 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:27.016200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1178d97f-15f0-4355-9f72-13a0f37ce407 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:27.017352 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1178d97f-15f0-4355-9f72-13a0f37ce407 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:27.018003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1178d97f-15f0-4355-9f72-13a0f37ce407 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:27.198437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1178d97f-15f0-4355-9f72-13a0f37ce407 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:27.213728 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1178d97f-15f0-4355-9f72-13a0f37ce407 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 200 len: 1489 microversion: 2.1 time: 0.209677 May 21 21:29:27.214980 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2148/4428] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:27 2022] GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 1489 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:27.424675 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6e5e9edd-a8e7-4314-ad7c-88c5a2ba6dc5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-689566251", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "88d40858-d8e8-4c97-8084-13382fa527f6"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:27.482976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1e9c2037-6d70-430a-9d67-ef57ce10acc5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:27.484024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1e9c2037-6d70-430a-9d67-ef57ce10acc5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:27.487448 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:27.497396 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e9c2037-6d70-430a-9d67-ef57ce10acc5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:27.497900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e9c2037-6d70-430a-9d67-ef57ce10acc5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:27.498968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e9c2037-6d70-430a-9d67-ef57ce10acc5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:27.499411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e9c2037-6d70-430a-9d67-ef57ce10acc5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:27.510861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-6e5e9edd-a8e7-4314-ad7c-88c5a2ba6dc5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] validate_networks() for [('88d40858-d8e8-4c97-8084-13382fa527f6', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:29:27.560060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e9c2037-6d70-430a-9d67-ef57ce10acc5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:27.560060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e9c2037-6d70-430a-9d67-ef57ce10acc5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:27.560060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-1e9c2037-6d70-430a-9d67-ef57ce10acc5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lazy-loading 'fault' on Instance uuid 168c8024-2cb4-4135-be5d-7a5cfcc6e895 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:29:27.622150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:27.634237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1e9c2037-6d70-430a-9d67-ef57ce10acc5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cafab0cbef64be59c7afef84d7888ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014ae80b3f434bcb9fa2629ccdf4aad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:27.649224 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1e9c2037-6d70-430a-9d67-ef57ce10acc5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 200 len: 1327 microversion: 2.1 time: 0.170672 May 21 21:29:27.661674 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2149/4429] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:27 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 1327 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:27.668459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3f9662f4-405f-4c76-9412-032ad14f45fd tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:27.669390 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3f9662f4-405f-4c76-9412-032ad14f45fd tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:27.677129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f9662f4-405f-4c76-9412-032ad14f45fd tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:27.677985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f9662f4-405f-4c76-9412-032ad14f45fd tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:27.679090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f9662f4-405f-4c76-9412-032ad14f45fd tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:27.679808 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f9662f4-405f-4c76-9412-032ad14f45fd tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:27.883438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3f9662f4-405f-4c76-9412-032ad14f45fd tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:27.895097 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3f9662f4-405f-4c76-9412-032ad14f45fd tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1322 microversion: 2.1 time: 0.229544 May 21 21:29:27.916794 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2150/4430] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:27 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:27.916934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c400ca22-a6d9-417a-98ee-295a1a1c4166 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:27.917673 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c400ca22-a6d9-417a-98ee-295a1a1c4166 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:27.933576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c400ca22-a6d9-417a-98ee-295a1a1c4166 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:27.934048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c400ca22-a6d9-417a-98ee-295a1a1c4166 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:27.934870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c400ca22-a6d9-417a-98ee-295a1a1c4166 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:27.941760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c400ca22-a6d9-417a-98ee-295a1a1c4166 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:28.078256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c400ca22-a6d9-417a-98ee-295a1a1c4166 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:28.091616 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c400ca22-a6d9-417a-98ee-295a1a1c4166 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:28.093124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c400ca22-a6d9-417a-98ee-295a1a1c4166 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:28.097676 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c400ca22-a6d9-417a-98ee-295a1a1c4166 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1335 microversion: 2.54 time: 0.189672 May 21 21:29:28.107323 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2151/4431] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:27 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1335 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:28.506628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6e5e9edd-a8e7-4314-ad7c-88c5a2ba6dc5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:29:28.507126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6e5e9edd-a8e7-4314-ad7c-88c5a2ba6dc5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:29:28.507676 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6e5e9edd-a8e7-4314-ad7c-88c5a2ba6dc5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:29:28.508094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6e5e9edd-a8e7-4314-ad7c-88c5a2ba6dc5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:29:28.508590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6e5e9edd-a8e7-4314-ad7c-88c5a2ba6dc5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:29:28.539320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6e5e9edd-a8e7-4314-ad7c-88c5a2ba6dc5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:28.539320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6e5e9edd-a8e7-4314-ad7c-88c5a2ba6dc5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:28.541517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6e5e9edd-a8e7-4314-ad7c-88c5a2ba6dc5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:28.542216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6e5e9edd-a8e7-4314-ad7c-88c5a2ba6dc5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:28.583188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-6e5e9edd-a8e7-4314-ad7c-88c5a2ba6dc5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Getting quotas for project 4dbb4bbc88f84520885c00a376ba0f7c. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:29:28.602543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-6e5e9edd-a8e7-4314-ad7c-88c5a2ba6dc5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Getting quotas for user c67dc8226610413a8bb889d6055a75d2 and project 4dbb4bbc88f84520885c00a376ba0f7c. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:29:28.629617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6e5e9edd-a8e7-4314-ad7c-88c5a2ba6dc5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:29:28.632492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6e5e9edd-a8e7-4314-ad7c-88c5a2ba6dc5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:29:28.671386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c9871a04-b341-47c3-b17d-5e81ae0ac87c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:28.672257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c9871a04-b341-47c3-b17d-5e81ae0ac87c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] [instance: 168c8024-2cb4-4135-be5d-7a5cfcc6e895] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:28.687840 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9871a04-b341-47c3-b17d-5e81ae0ac87c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:28.688336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9871a04-b341-47c3-b17d-5e81ae0ac87c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:28.697404 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9871a04-b341-47c3-b17d-5e81ae0ac87c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:28.702159 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9871a04-b341-47c3-b17d-5e81ae0ac87c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:28.734762 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-c9871a04-b341-47c3-b17d-5e81ae0ac87c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] HTTP exception thrown: Instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 could not be found. May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c9871a04-b341-47c3-b17d-5e81ae0ac87c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Request method failure captured: May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 HTTP/1.1 May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVgQv9k80egN_Z5oxm6zD7gV_sf1gMqqxBRx1iY9MeJj0DeNsoKLr8-8NIWiLDly20rLKVCAE8Xz0N5MgNbJYqnUGb2g2Kh6fJPvfPYKD1-lSj4wpNCcDbjlxj4-dXOUNAfghSaWJ8EAEG0fA3XOci0JYwtRE0jKJ3nFNlo1G7Keylg May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 014ae80b3f434bcb9fa2629ccdf4aad7 May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerActionsTestJSON-643676444 May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/014ae80b3f434bcb9fa2629ccdf4aad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/014ae80b3f434bcb9fa2629ccdf4aad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_014ae80b3f434bcb9fa2629ccdf4aad7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/014ae80b3f434bcb9fa2629ccdf4aad7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerActionsTestJSON-643676444 May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 014ae80b3f434bcb9fa2629ccdf4aad7 May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerActionsTestJSON-643676444 May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerActionsTestJSON-643676444-project May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1cafab0cbef64be59c7afef84d7888ff May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerActionsTestJSON-643676444-project May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 could not be found. May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '168c8024-2cb4-4135-be5d-7a5cfcc6e895'} May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 could not be found. May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 could not be found. May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:29:28.742680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:28.750243 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:28.750243 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:29:28.750243 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:29:28.750243 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:29:28.750243 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:29:28.750243 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 could not be found. May 21 21:29:28.750243 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:28.753453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c9871a04-b341-47c3-b17d-5e81ae0ac87c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Returning 404 to user: Instance 168c8024-2cb4-4135-be5d-7a5cfcc6e895 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:29:28.756602 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c9871a04-b341-47c3-b17d-5e81ae0ac87c tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895" status: 404 len: 111 microversion: 2.1 time: 0.087295 May 21 21:29:28.756602 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2152/4432] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:28 2022] GET /compute/v2.1/servers/168c8024-2cb4-4135-be5d-7a5cfcc6e895 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:29:28.770748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d1a4fbce-b404-49a4-a728-cdb6f1a44ae5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] Calling method '.version_select at 0x7fc81a03e430>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:28.774132 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6e5e9edd-a8e7-4314-ad7c-88c5a2ba6dc5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.353366 May 21 21:29:28.782239 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2281/4433] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:29:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:29:28.789541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-eadff410-3bf7-4d19-ad4f-3e0c6c1f4c82 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:28.791135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-eadff410-3bf7-4d19-ad4f-3e0c6c1f4c82 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:28.898122 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d1a4fbce-b404-49a4-a728-cdb6f1a44ae5 tempest-ServerActionsTestJSON-643676444 tempest-ServerActionsTestJSON-643676444-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-709836461" status: 202 len: 0 microversion: 2.1 time: 0.125679 May 21 21:29:28.898122 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2153/4434] 10.222.0.49 () {58 vars in 1217 bytes} [Sat May 21 21:29:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-709836461 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:29:28.913563 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ba19a6ed-dfb6-4faa-a39a-b90def717b26 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:28.914277 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ba19a6ed-dfb6-4faa-a39a-b90def717b26 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:28.920707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba19a6ed-dfb6-4faa-a39a-b90def717b26 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:28.929189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba19a6ed-dfb6-4faa-a39a-b90def717b26 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:28.932453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba19a6ed-dfb6-4faa-a39a-b90def717b26 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:28.933105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba19a6ed-dfb6-4faa-a39a-b90def717b26 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:28.960568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-eadff410-3bf7-4d19-ad4f-3e0c6c1f4c82 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:28.976019 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-eadff410-3bf7-4d19-ad4f-3e0c6c1f4c82 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 200 len: 1208 microversion: 2.1 time: 0.187263 May 21 21:29:28.985742 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2282/4435] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:28 2022] GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 1208 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:29.134338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-96fce36f-a67b-4b6d-b737-fefcf62b6fd9 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:29.135161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-96fce36f-a67b-4b6d-b737-fefcf62b6fd9 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:29.143053 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96fce36f-a67b-4b6d-b737-fefcf62b6fd9 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:29.145176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96fce36f-a67b-4b6d-b737-fefcf62b6fd9 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:29.145176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96fce36f-a67b-4b6d-b737-fefcf62b6fd9 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:29.145840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96fce36f-a67b-4b6d-b737-fefcf62b6fd9 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:29.301957 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-96fce36f-a67b-4b6d-b737-fefcf62b6fd9 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:29.315466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-96fce36f-a67b-4b6d-b737-fefcf62b6fd9 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:29.317619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-96fce36f-a67b-4b6d-b737-fefcf62b6fd9 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:29.319893 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-96fce36f-a67b-4b6d-b737-fefcf62b6fd9 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1335 microversion: 2.54 time: 0.191357 May 21 21:29:29.321685 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2283/4436] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:29 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1335 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:29.487414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ba19a6ed-dfb6-4faa-a39a-b90def717b26 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:29.512889 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ba19a6ed-dfb6-4faa-a39a-b90def717b26 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1322 microversion: 2.1 time: 0.602456 May 21 21:29:29.516829 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2154/4437] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:28 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1322 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:29:29.996998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3189f7cc-b309-4c0f-a67b-bcd2ae104031 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:30.008379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3189f7cc-b309-4c0f-a67b-bcd2ae104031 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:30.030794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3189f7cc-b309-4c0f-a67b-bcd2ae104031 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:30.031419 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3189f7cc-b309-4c0f-a67b-bcd2ae104031 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:30.032598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3189f7cc-b309-4c0f-a67b-bcd2ae104031 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:30.033680 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3189f7cc-b309-4c0f-a67b-bcd2ae104031 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:30.176540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3189f7cc-b309-4c0f-a67b-bcd2ae104031 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:30.190265 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3189f7cc-b309-4c0f-a67b-bcd2ae104031 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 200 len: 1212 microversion: 2.1 time: 0.198020 May 21 21:29:30.190265 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2284/4438] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:29 2022] GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 1212 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:30.342301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2763baf8-f779-4b5e-9394-e8ab61e11770 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:30.343203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2763baf8-f779-4b5e-9394-e8ab61e11770 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:30.352628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2763baf8-f779-4b5e-9394-e8ab61e11770 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:30.353312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2763baf8-f779-4b5e-9394-e8ab61e11770 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:30.354274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2763baf8-f779-4b5e-9394-e8ab61e11770 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:30.355010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2763baf8-f779-4b5e-9394-e8ab61e11770 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:30.512354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2763baf8-f779-4b5e-9394-e8ab61e11770 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:30.522761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2763baf8-f779-4b5e-9394-e8ab61e11770 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:30.534248 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-eff1d4ec-22f7-41e3-9923-ed617b529f10 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:30.535173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-eff1d4ec-22f7-41e3-9923-ed617b529f10 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:30.535793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2763baf8-f779-4b5e-9394-e8ab61e11770 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:30.538205 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2763baf8-f779-4b5e-9394-e8ab61e11770 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1356 microversion: 2.54 time: 0.199913 May 21 21:29:30.542811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eff1d4ec-22f7-41e3-9923-ed617b529f10 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:30.550310 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2155/4439] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:30 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1356 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:30.560084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eff1d4ec-22f7-41e3-9923-ed617b529f10 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:30.566597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eff1d4ec-22f7-41e3-9923-ed617b529f10 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:30.567247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eff1d4ec-22f7-41e3-9923-ed617b529f10 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:30.575259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-de3e0707-3a92-4dd2-8493-a928694a81de tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Action: 'create', calling method: .version_select at 0x7fc819fa24c0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1555623721", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJ1QCiQaJg5uBbBX/sAx3vO5NxBi3cjXSa4ZxdfiXqPtmcRJiZ7x10aNQ1J76OeTcIy6gOHZqHo152vdEhlre+jRKeDrPkMpujaR3jtZrTE9nLxIG4uBmDPZR/W3MbCGQ=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:30.607243 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-de3e0707-3a92-4dd2-8493-a928694a81de tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Getting quotas for project 9dbdb88e011245faab8a76a2d05f445c. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:29:30.615541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-de3e0707-3a92-4dd2-8493-a928694a81de tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Getting quotas for user d3197c70ce304c79a952555606b9b4d2 and project 9dbdb88e011245faab8a76a2d05f445c. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:29:30.724939 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-de3e0707-3a92-4dd2-8493-a928694a81de tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.156796 May 21 21:29:30.726055 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2156/4440] 10.222.0.49 () {62 vars in 1199 bytes} [Sat May 21 21:29:30 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 159 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 21 21:29:30.736181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3f5c262d-7495-4468-b064-f22337132704 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1555623721", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:30.737890 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3f5c262d-7495-4468-b064-f22337132704 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:30.744242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f5c262d-7495-4468-b064-f22337132704 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:30.744726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f5c262d-7495-4468-b064-f22337132704 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:30.745608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f5c262d-7495-4468-b064-f22337132704 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:30.746045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f5c262d-7495-4468-b064-f22337132704 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:30.848242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:30.866371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-3f5c262d-7495-4468-b064-f22337132704 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:29:30.866808 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-3f5c262d-7495-4468-b064-f22337132704 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:29:30.867297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-3f5c262d-7495-4468-b064-f22337132704 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:29:30.868715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-3f5c262d-7495-4468-b064-f22337132704 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:29:30.870041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-3f5c262d-7495-4468-b064-f22337132704 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:29:31.281677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3f5c262d-7495-4468-b064-f22337132704 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:31.290931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f5c262d-7495-4468-b064-f22337132704 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:31.291651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f5c262d-7495-4468-b064-f22337132704 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:31.292711 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f5c262d-7495-4468-b064-f22337132704 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:31.293741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f5c262d-7495-4468-b064-f22337132704 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:31.328112 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3f5c262d-7495-4468-b064-f22337132704 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "POST /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7/action" status: 202 len: 1139 microversion: 2.54 time: 0.595777 May 21 21:29:31.341915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-eff1d4ec-22f7-41e3-9923-ed617b529f10 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:31.349816 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2157/4441] 10.222.0.49 () {62 vars in 1319 bytes} [Sat May 21 21:29:30 2022] POST /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7/action => generated 1139 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) May 21 21:29:31.356550 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-eff1d4ec-22f7-41e3-9923-ed617b529f10 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1322 microversion: 2.1 time: 0.826639 May 21 21:29:31.357157 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2285/4442] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:30 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1322 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:31.368857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-72dea495-c812-48f4-8dca-799044d4d0d4 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:31.370909 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-72dea495-c812-48f4-8dca-799044d4d0d4 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:31.372918 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4372930b-a9ca-4c2b-bb49-a8001669a3c5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:31.374659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4372930b-a9ca-4c2b-bb49-a8001669a3c5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:31.385231 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4372930b-a9ca-4c2b-bb49-a8001669a3c5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:31.395592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4372930b-a9ca-4c2b-bb49-a8001669a3c5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:31.395592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4372930b-a9ca-4c2b-bb49-a8001669a3c5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:31.395592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4372930b-a9ca-4c2b-bb49-a8001669a3c5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:31.396054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72dea495-c812-48f4-8dca-799044d4d0d4 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:31.396054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72dea495-c812-48f4-8dca-799044d4d0d4 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:31.396054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72dea495-c812-48f4-8dca-799044d4d0d4 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:31.396054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-72dea495-c812-48f4-8dca-799044d4d0d4 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:31.518525 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-72dea495-c812-48f4-8dca-799044d4d0d4 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:31.520418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4372930b-a9ca-4c2b-bb49-a8001669a3c5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:31.528741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-72dea495-c812-48f4-8dca-799044d4d0d4 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:31.539268 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4372930b-a9ca-4c2b-bb49-a8001669a3c5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 200 len: 1268 microversion: 2.1 time: 0.188209 May 21 21:29:31.540070 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2158/4443] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:31 2022] GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 1268 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:31.542434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-72dea495-c812-48f4-8dca-799044d4d0d4 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:31.542434 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-72dea495-c812-48f4-8dca-799044d4d0d4 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.181168 May 21 21:29:31.552227 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2286/4444] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:31 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:32.384309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-45d0e441-db21-4d12-aa24-8f712056b82e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:32.384930 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-45d0e441-db21-4d12-aa24-8f712056b82e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:32.397351 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:32.412419 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-45d0e441-db21-4d12-aa24-8f712056b82e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:32.413518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-45d0e441-db21-4d12-aa24-8f712056b82e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:32.415107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-45d0e441-db21-4d12-aa24-8f712056b82e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:32.415770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-45d0e441-db21-4d12-aa24-8f712056b82e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:32.449349 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-a349ab16-93fb-4cf7-b317-eab347b6eacd req-670af66d-2d0b-4861-b6af-0452c69a8cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b507bdf-67be-44d6-be35-c2b41d16f48f", "name": "network-vif-plugged", "status": "completed", "tag": "f1e3e151-e89e-4972-b253-8b889eef1d77"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:32.464712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a349ab16-93fb-4cf7-b317-eab347b6eacd req-670af66d-2d0b-4861-b6af-0452c69a8cd4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:32.465040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a349ab16-93fb-4cf7-b317-eab347b6eacd req-670af66d-2d0b-4861-b6af-0452c69a8cd4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:32.532176 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a349ab16-93fb-4cf7-b317-eab347b6eacd req-670af66d-2d0b-4861-b6af-0452c69a8cd4 service nova] Creating event network-vif-plugged:f1e3e151-e89e-4972-b253-8b889eef1d77 for instance 2b507bdf-67be-44d6-be35-c2b41d16f48f on nch2-master-1 May 21 21:29:32.537198 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-a349ab16-93fb-4cf7-b317-eab347b6eacd req-670af66d-2d0b-4861-b6af-0452c69a8cd4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093015 May 21 21:29:32.540490 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2287/4445] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:29:32.569330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ed52174b-5b05-4ddb-963c-34875b549032 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:32.571206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ed52174b-5b05-4ddb-963c-34875b549032 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:32.584748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed52174b-5b05-4ddb-963c-34875b549032 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:32.585577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed52174b-5b05-4ddb-963c-34875b549032 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:32.587180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed52174b-5b05-4ddb-963c-34875b549032 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:32.587700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed52174b-5b05-4ddb-963c-34875b549032 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:32.715458 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ed52174b-5b05-4ddb-963c-34875b549032 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:32.728358 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ed52174b-5b05-4ddb-963c-34875b549032 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 200 len: 1266 microversion: 2.1 time: 0.168008 May 21 21:29:32.731992 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2288/4446] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:32 2022] GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:32.747587 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-496b1b32-d66f-4eac-9ab3-fe238bd9415d tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:32.749718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-496b1b32-d66f-4eac-9ab3-fe238bd9415d tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:32.765530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-496b1b32-d66f-4eac-9ab3-fe238bd9415d tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:32.765987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-496b1b32-d66f-4eac-9ab3-fe238bd9415d tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:32.769180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-496b1b32-d66f-4eac-9ab3-fe238bd9415d tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:32.770327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-496b1b32-d66f-4eac-9ab3-fe238bd9415d tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:32.900005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-496b1b32-d66f-4eac-9ab3-fe238bd9415d tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:32.917899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-496b1b32-d66f-4eac-9ab3-fe238bd9415d tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:32.919637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-496b1b32-d66f-4eac-9ab3-fe238bd9415d tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:32.921279 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-496b1b32-d66f-4eac-9ab3-fe238bd9415d tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.187082 May 21 21:29:32.922167 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2289/4447] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:32 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:32.985728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-45d0e441-db21-4d12-aa24-8f712056b82e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:32.998992 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-45d0e441-db21-4d12-aa24-8f712056b82e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1322 microversion: 2.1 time: 0.623955 May 21 21:29:33.002825 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2159/4448] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:32 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1322 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:33.747090 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a5c3ea56-1566-470c-90ea-36af5519dce0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:33.748572 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a5c3ea56-1566-470c-90ea-36af5519dce0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:33.758732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5c3ea56-1566-470c-90ea-36af5519dce0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:33.759455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5c3ea56-1566-470c-90ea-36af5519dce0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:33.760708 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5c3ea56-1566-470c-90ea-36af5519dce0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:33.763316 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5c3ea56-1566-470c-90ea-36af5519dce0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:33.944541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b2b3ce5f-e59b-4c8e-8252-f2a9d0f4e904 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:33.945473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b2b3ce5f-e59b-4c8e-8252-f2a9d0f4e904 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:33.959396 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2b3ce5f-e59b-4c8e-8252-f2a9d0f4e904 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:33.960094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2b3ce5f-e59b-4c8e-8252-f2a9d0f4e904 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:33.961226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2b3ce5f-e59b-4c8e-8252-f2a9d0f4e904 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:33.961844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2b3ce5f-e59b-4c8e-8252-f2a9d0f4e904 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:34.099416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b2b3ce5f-e59b-4c8e-8252-f2a9d0f4e904 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:34.126368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b2b3ce5f-e59b-4c8e-8252-f2a9d0f4e904 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:34.134759 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b2b3ce5f-e59b-4c8e-8252-f2a9d0f4e904 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:34.135838 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b2b3ce5f-e59b-4c8e-8252-f2a9d0f4e904 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.196055 May 21 21:29:34.137418 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2160/4449] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:33 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:34.153398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f933ea4e-b09a-4f5f-85c3-6b8afdd7b18d tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:34.165169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f933ea4e-b09a-4f5f-85c3-6b8afdd7b18d tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:34.169405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f933ea4e-b09a-4f5f-85c3-6b8afdd7b18d tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:34.170283 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f933ea4e-b09a-4f5f-85c3-6b8afdd7b18d tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:34.171180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f933ea4e-b09a-4f5f-85c3-6b8afdd7b18d tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:34.171739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f933ea4e-b09a-4f5f-85c3-6b8afdd7b18d tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:34.459650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f933ea4e-b09a-4f5f-85c3-6b8afdd7b18d tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:34.472493 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f933ea4e-b09a-4f5f-85c3-6b8afdd7b18d tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1322 microversion: 2.1 time: 0.333529 May 21 21:29:34.473403 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2161/4450] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:34 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:34.553801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a5c3ea56-1566-470c-90ea-36af5519dce0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:34.568899 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a5c3ea56-1566-470c-90ea-36af5519dce0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 200 len: 1308 microversion: 2.1 time: 0.825581 May 21 21:29:34.582502 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2290/4451] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:33 2022] GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 1308 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:35.157442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-24504812-1972-4ece-b3eb-b1a6b7ac5d69 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:35.158325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-24504812-1972-4ece-b3eb-b1a6b7ac5d69 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:35.183149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24504812-1972-4ece-b3eb-b1a6b7ac5d69 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:35.183149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24504812-1972-4ece-b3eb-b1a6b7ac5d69 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:35.183149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24504812-1972-4ece-b3eb-b1a6b7ac5d69 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:35.183149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24504812-1972-4ece-b3eb-b1a6b7ac5d69 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:35.492200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-88981aed-74c7-46f8-a2fb-8dfd2d2be8aa tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:35.493716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-88981aed-74c7-46f8-a2fb-8dfd2d2be8aa tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:35.503398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88981aed-74c7-46f8-a2fb-8dfd2d2be8aa tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:35.503867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88981aed-74c7-46f8-a2fb-8dfd2d2be8aa tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:35.505144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88981aed-74c7-46f8-a2fb-8dfd2d2be8aa tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:35.505593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88981aed-74c7-46f8-a2fb-8dfd2d2be8aa tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:35.646966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-24504812-1972-4ece-b3eb-b1a6b7ac5d69 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:35.657150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-24504812-1972-4ece-b3eb-b1a6b7ac5d69 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:35.672955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-24504812-1972-4ece-b3eb-b1a6b7ac5d69 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:35.672955 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-24504812-1972-4ece-b3eb-b1a6b7ac5d69 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.509001 May 21 21:29:35.672955 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2162/4452] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:35 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:35.672955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-025a04b8-644a-4c80-89ad-04f7e7870aaa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:35.672955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-025a04b8-644a-4c80-89ad-04f7e7870aaa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:35.689321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-025a04b8-644a-4c80-89ad-04f7e7870aaa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:35.690126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-025a04b8-644a-4c80-89ad-04f7e7870aaa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:35.690925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-025a04b8-644a-4c80-89ad-04f7e7870aaa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:35.692642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-025a04b8-644a-4c80-89ad-04f7e7870aaa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:35.919280 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-88981aed-74c7-46f8-a2fb-8dfd2d2be8aa tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:35.933957 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-88981aed-74c7-46f8-a2fb-8dfd2d2be8aa tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1516 microversion: 2.1 time: 0.443383 May 21 21:29:35.941131 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2291/4453] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:35 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1516 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:35.961046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-80552325-105c-4114-b12c-3e38927f1a11 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:35.964105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-80552325-105c-4114-b12c-3e38927f1a11 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:35.978299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80552325-105c-4114-b12c-3e38927f1a11 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:35.979013 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80552325-105c-4114-b12c-3e38927f1a11 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:35.980102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80552325-105c-4114-b12c-3e38927f1a11 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:35.981145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80552325-105c-4114-b12c-3e38927f1a11 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:36.003565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:36.023234 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-80552325-105c-4114-b12c-3e38927f1a11 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lazy-loading 'flavor' on Instance uuid 2b507bdf-67be-44d6-be35-c2b41d16f48f {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:29:36.130783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-025a04b8-644a-4c80-89ad-04f7e7870aaa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:36.138941 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-025a04b8-644a-4c80-89ad-04f7e7870aaa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 200 len: 1308 microversion: 2.1 time: 0.474447 May 21 21:29:36.140407 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2163/4454] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:35 2022] GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 1308 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:36.383076 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-80552325-105c-4114-b12c-3e38927f1a11 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "POST /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f/action" status: 200 len: 32 microversion: 2.1 time: 0.428905 May 21 21:29:36.387521 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2292/4455] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:29:35 2022] POST /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f/action => generated 32 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:29:36.404308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-86a6c68a-b181-4ab8-9d1c-9773c2d1dff7 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:36.404981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-86a6c68a-b181-4ab8-9d1c-9773c2d1dff7 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:36.415066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86a6c68a-b181-4ab8-9d1c-9773c2d1dff7 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:36.424507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86a6c68a-b181-4ab8-9d1c-9773c2d1dff7 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:36.424507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86a6c68a-b181-4ab8-9d1c-9773c2d1dff7 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:36.424507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86a6c68a-b181-4ab8-9d1c-9773c2d1dff7 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:36.602087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-7fc7d629-30d9-447c-8766-8e77794f51c7 req-843267f4-99af-4ec7-bfbd-97d9b61d0816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbe5a17b-6c84-492c-a252-a561e3920278", "tag": "51042650-7b85-4f27-bdad-7c58dbfbfbea"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:36.622124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7fc7d629-30d9-447c-8766-8e77794f51c7 req-843267f4-99af-4ec7-bfbd-97d9b61d0816 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:36.626164 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7fc7d629-30d9-447c-8766-8e77794f51c7 req-843267f4-99af-4ec7-bfbd-97d9b61d0816 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:36.664547 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-7fc7d629-30d9-447c-8766-8e77794f51c7 req-843267f4-99af-4ec7-bfbd-97d9b61d0816 service nova] Creating event network-changed:51042650-7b85-4f27-bdad-7c58dbfbfbea for instance cbe5a17b-6c84-492c-a252-a561e3920278 on nch2-master-1 May 21 21:29:36.676654 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-7fc7d629-30d9-447c-8766-8e77794f51c7 req-843267f4-99af-4ec7-bfbd-97d9b61d0816 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076637 May 21 21:29:36.676654 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2293/4456] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:29:36.682341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-61b1104f-0929-46fa-aeb8-cdd7d18ad69d tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:36.683224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-61b1104f-0929-46fa-aeb8-cdd7d18ad69d tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:36.691046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61b1104f-0929-46fa-aeb8-cdd7d18ad69d tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:36.691779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61b1104f-0929-46fa-aeb8-cdd7d18ad69d tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:36.693298 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61b1104f-0929-46fa-aeb8-cdd7d18ad69d tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:36.694080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61b1104f-0929-46fa-aeb8-cdd7d18ad69d tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:36.920091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-61b1104f-0929-46fa-aeb8-cdd7d18ad69d tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:36.935002 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-61b1104f-0929-46fa-aeb8-cdd7d18ad69d tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:36.940505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-61b1104f-0929-46fa-aeb8-cdd7d18ad69d tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:36.942164 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-61b1104f-0929-46fa-aeb8-cdd7d18ad69d tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.264276 May 21 21:29:36.943224 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2294/4457] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:36 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:37.161906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cedf3a5a-bd41-4798-90db-a5ca60f9d9a3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:37.162667 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cedf3a5a-bd41-4798-90db-a5ca60f9d9a3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:37.169924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cedf3a5a-bd41-4798-90db-a5ca60f9d9a3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:37.170636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cedf3a5a-bd41-4798-90db-a5ca60f9d9a3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:37.171666 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cedf3a5a-bd41-4798-90db-a5ca60f9d9a3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:37.172206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cedf3a5a-bd41-4798-90db-a5ca60f9d9a3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:37.297060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-86a6c68a-b181-4ab8-9d1c-9773c2d1dff7 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:37.300575 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-86a6c68a-b181-4ab8-9d1c-9773c2d1dff7 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1522 microversion: 2.1 time: 0.900982 May 21 21:29:37.301165 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2164/4458] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:36 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1522 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:37.449835 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cedf3a5a-bd41-4798-90db-a5ca60f9d9a3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:37.458900 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cedf3a5a-bd41-4798-90db-a5ca60f9d9a3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 200 len: 1308 microversion: 2.1 time: 0.303641 May 21 21:29:37.469722 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2295/4459] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:37 2022] GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 1308 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:29:37.961901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9b0eba87-371a-4732-8177-4c12246f712b tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:37.962957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9b0eba87-371a-4732-8177-4c12246f712b tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:37.971831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9b0eba87-371a-4732-8177-4c12246f712b tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:37.972803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9b0eba87-371a-4732-8177-4c12246f712b tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:37.973886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9b0eba87-371a-4732-8177-4c12246f712b tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:37.974762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9b0eba87-371a-4732-8177-4c12246f712b tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:38.147870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9b0eba87-371a-4732-8177-4c12246f712b tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:38.163874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9b0eba87-371a-4732-8177-4c12246f712b tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:38.166219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9b0eba87-371a-4732-8177-4c12246f712b tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:38.167448 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9b0eba87-371a-4732-8177-4c12246f712b tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.209582 May 21 21:29:38.180706 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2165/4460] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:37 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:29:38.322998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c738661e-f1f9-4098-8165-303067127a91 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:38.324788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c738661e-f1f9-4098-8165-303067127a91 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:38.333940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c738661e-f1f9-4098-8165-303067127a91 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:38.333940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c738661e-f1f9-4098-8165-303067127a91 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:38.335366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c738661e-f1f9-4098-8165-303067127a91 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:38.336326 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c738661e-f1f9-4098-8165-303067127a91 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:38.480170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9d271bc9-16e5-4fba-8946-ab5bcf52537f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:38.480170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9d271bc9-16e5-4fba-8946-ab5bcf52537f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:38.488729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9d271bc9-16e5-4fba-8946-ab5bcf52537f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:38.489162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9d271bc9-16e5-4fba-8946-ab5bcf52537f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:38.489968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9d271bc9-16e5-4fba-8946-ab5bcf52537f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:38.490408 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9d271bc9-16e5-4fba-8946-ab5bcf52537f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:38.680528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c738661e-f1f9-4098-8165-303067127a91 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:38.692743 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c738661e-f1f9-4098-8165-303067127a91 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1522 microversion: 2.1 time: 0.376925 May 21 21:29:38.693593 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2296/4461] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:38 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:39.039410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9d271bc9-16e5-4fba-8946-ab5bcf52537f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:39.047616 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9d271bc9-16e5-4fba-8946-ab5bcf52537f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 200 len: 1308 microversion: 2.1 time: 0.575289 May 21 21:29:39.048225 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2166/4462] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:38 2022] GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 1308 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:39.188862 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f4583616-5b65-44b8-ba43-1df6f6e3eec6 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:39.191415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f4583616-5b65-44b8-ba43-1df6f6e3eec6 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:39.198041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=20 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:39.199387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:39.201033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4583616-5b65-44b8-ba43-1df6f6e3eec6 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:39.202018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4583616-5b65-44b8-ba43-1df6f6e3eec6 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:39.203359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4583616-5b65-44b8-ba43-1df6f6e3eec6 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:39.203967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4583616-5b65-44b8-ba43-1df6f6e3eec6 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:39.291861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f4583616-5b65-44b8-ba43-1df6f6e3eec6 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:39.305137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f4583616-5b65-44b8-ba43-1df6f6e3eec6 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:39.307171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f4583616-5b65-44b8-ba43-1df6f6e3eec6 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:39.309163 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f4583616-5b65-44b8-ba43-1df6f6e3eec6 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.126291 May 21 21:29:39.310271 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2297/4463] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:39 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:39.711246 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-51d8e06c-442d-4b27-909c-cba3607be887 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:39.712109 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-51d8e06c-442d-4b27-909c-cba3607be887 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:39.718422 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-51d8e06c-442d-4b27-909c-cba3607be887 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:39.719277 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-51d8e06c-442d-4b27-909c-cba3607be887 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:39.720334 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-51d8e06c-442d-4b27-909c-cba3607be887 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:39.721708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-51d8e06c-442d-4b27-909c-cba3607be887 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:40.079474 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ddc1c8a2-2704-48be-9ad7-058a810536d5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:40.081245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ddc1c8a2-2704-48be-9ad7-058a810536d5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:40.098804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ddc1c8a2-2704-48be-9ad7-058a810536d5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:40.099263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ddc1c8a2-2704-48be-9ad7-058a810536d5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:40.100051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ddc1c8a2-2704-48be-9ad7-058a810536d5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:40.101407 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ddc1c8a2-2704-48be-9ad7-058a810536d5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:40.291995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ddc1c8a2-2704-48be-9ad7-058a810536d5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:40.304402 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ddc1c8a2-2704-48be-9ad7-058a810536d5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 200 len: 1308 microversion: 2.1 time: 0.237778 May 21 21:29:40.304402 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2298/4464] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:40 2022] GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 1308 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:40.315353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-51d8e06c-442d-4b27-909c-cba3607be887 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:40.327412 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-51d8e06c-442d-4b27-909c-cba3607be887 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1522 microversion: 2.1 time: 0.620156 May 21 21:29:40.329570 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2167/4465] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:39 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1522 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:40.340335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-eb497385-d303-4afe-84a4-4b3fb5845e57 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:40.340335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-eb497385-d303-4afe-84a4-4b3fb5845e57 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:40.351613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eb497385-d303-4afe-84a4-4b3fb5845e57 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:40.352643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eb497385-d303-4afe-84a4-4b3fb5845e57 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:40.353893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eb497385-d303-4afe-84a4-4b3fb5845e57 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:40.354481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eb497385-d303-4afe-84a4-4b3fb5845e57 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:40.497787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-eb497385-d303-4afe-84a4-4b3fb5845e57 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:40.512596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-eb497385-d303-4afe-84a4-4b3fb5845e57 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:40.515246 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-eb497385-d303-4afe-84a4-4b3fb5845e57 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:40.518171 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-eb497385-d303-4afe-84a4-4b3fb5845e57 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.189460 May 21 21:29:40.519715 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2299/4466] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:40 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:41.325986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8fab259c-0307-442d-b233-3812a9babf10 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:41.327422 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8fab259c-0307-442d-b233-3812a9babf10 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:41.330975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=22 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:41.337293 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8fab259c-0307-442d-b233-3812a9babf10 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:41.338012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8fab259c-0307-442d-b233-3812a9babf10 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:41.338903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8fab259c-0307-442d-b233-3812a9babf10 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:41.339604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8fab259c-0307-442d-b233-3812a9babf10 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:41.350129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-19ffa50f-5d1a-4432-a587-1859ef570b91 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:41.350770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-19ffa50f-5d1a-4432-a587-1859ef570b91 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:41.355267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:41.366441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19ffa50f-5d1a-4432-a587-1859ef570b91 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:41.366908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19ffa50f-5d1a-4432-a587-1859ef570b91 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:41.371222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19ffa50f-5d1a-4432-a587-1859ef570b91 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:41.371781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19ffa50f-5d1a-4432-a587-1859ef570b91 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:41.595485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8fab259c-0307-442d-b233-3812a9babf10 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:41.607972 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8fab259c-0307-442d-b233-3812a9babf10 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 200 len: 1308 microversion: 2.1 time: 0.291246 May 21 21:29:41.614294 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2168/4467] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:41 2022] GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 1308 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:41.624618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-266a800a-fd54-4203-b6cc-756093f289cf tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:41.625417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-266a800a-fd54-4203-b6cc-756093f289cf tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:41.647460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-266a800a-fd54-4203-b6cc-756093f289cf tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:41.651117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-266a800a-fd54-4203-b6cc-756093f289cf tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:41.654113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-266a800a-fd54-4203-b6cc-756093f289cf tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:41.658815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-266a800a-fd54-4203-b6cc-756093f289cf tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:41.689858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-19ffa50f-5d1a-4432-a587-1859ef570b91 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:41.699118 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-19ffa50f-5d1a-4432-a587-1859ef570b91 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1522 microversion: 2.1 time: 0.355018 May 21 21:29:41.703290 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2300/4468] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:41 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:29:41.792955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-266a800a-fd54-4203-b6cc-756093f289cf tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:41.804322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-266a800a-fd54-4203-b6cc-756093f289cf tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:41.808417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-266a800a-fd54-4203-b6cc-756093f289cf tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:41.814543 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-266a800a-fd54-4203-b6cc-756093f289cf tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.203957 May 21 21:29:41.816583 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2169/4469] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:41 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:42.258572 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-08a540b4-6868-440b-a4f8-a493f3a20ab4 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1887211504", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": "none"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:42.309617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-08a540b4-6868-440b-a4f8-a493f3a20ab4 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:29:42.312806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-08a540b4-6868-440b-a4f8-a493f3a20ab4 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:29:42.312806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-08a540b4-6868-440b-a4f8-a493f3a20ab4 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:29:42.312806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-08a540b4-6868-440b-a4f8-a493f3a20ab4 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:29:42.312806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-08a540b4-6868-440b-a4f8-a493f3a20ab4 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:29:42.327366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08a540b4-6868-440b-a4f8-a493f3a20ab4 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:42.328875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08a540b4-6868-440b-a4f8-a493f3a20ab4 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:42.330517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08a540b4-6868-440b-a4f8-a493f3a20ab4 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:42.331289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08a540b4-6868-440b-a4f8-a493f3a20ab4 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:42.362738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-08a540b4-6868-440b-a4f8-a493f3a20ab4 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Getting quotas for project 6d5915d8919d4922a53ce132ec597c0b. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:29:42.368819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-08a540b4-6868-440b-a4f8-a493f3a20ab4 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Getting quotas for user 60e14a6b163049cb8349ccdcee74ddaf and project 6d5915d8919d4922a53ce132ec597c0b. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:29:42.383915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-08a540b4-6868-440b-a4f8-a493f3a20ab4 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:29:42.386349 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-08a540b4-6868-440b-a4f8-a493f3a20ab4 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:29:42.626338 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-08a540b4-6868-440b-a4f8-a493f3a20ab4 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.603753 May 21 21:29:42.635677 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2301/4470] 10.222.0.49 () {62 vars in 1187 bytes} [Sat May 21 21:29:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 21 21:29:42.635898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-129a72ba-cf63-482d-a73e-5324db32e5c2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:42.635898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-129a72ba-cf63-482d-a73e-5324db32e5c2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:42.641928 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-129a72ba-cf63-482d-a73e-5324db32e5c2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:42.642474 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-129a72ba-cf63-482d-a73e-5324db32e5c2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:42.644090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-129a72ba-cf63-482d-a73e-5324db32e5c2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:42.644561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-129a72ba-cf63-482d-a73e-5324db32e5c2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:42.649803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2f7fdf47-521c-43e3-bb48-00e54fa03342 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:42.671147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2f7fdf47-521c-43e3-bb48-00e54fa03342 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:42.827004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2f7fdf47-521c-43e3-bb48-00e54fa03342 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:42.841557 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2f7fdf47-521c-43e3-bb48-00e54fa03342 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:42.848361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2f7fdf47-521c-43e3-bb48-00e54fa03342 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:42.849657 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2f7fdf47-521c-43e3-bb48-00e54fa03342 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1278 microversion: 2.57 time: 0.211177 May 21 21:29:42.861805 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2302/4471] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:42 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1278 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:42.861805 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-82837e74-c0f1-4e52-a854-a184de055b71 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:42.861805 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-82837e74-c0f1-4e52-a854-a184de055b71 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:42.879378 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82837e74-c0f1-4e52-a854-a184de055b71 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:42.883169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82837e74-c0f1-4e52-a854-a184de055b71 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:42.886413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82837e74-c0f1-4e52-a854-a184de055b71 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:42.886869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82837e74-c0f1-4e52-a854-a184de055b71 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:42.990224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-129a72ba-cf63-482d-a73e-5324db32e5c2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:43.012115 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-129a72ba-cf63-482d-a73e-5324db32e5c2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 200 len: 1308 microversion: 2.1 time: 0.381502 May 21 21:29:43.022775 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2170/4472] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:42 2022] GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 1308 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:43.037048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ce7f20a9-30f4-49d5-8773-56b6d5055003 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:43.037877 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ce7f20a9-30f4-49d5-8773-56b6d5055003 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:43.065686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ce7f20a9-30f4-49d5-8773-56b6d5055003 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:43.066461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ce7f20a9-30f4-49d5-8773-56b6d5055003 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:43.067809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ce7f20a9-30f4-49d5-8773-56b6d5055003 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:43.068521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ce7f20a9-30f4-49d5-8773-56b6d5055003 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:43.164990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-82837e74-c0f1-4e52-a854-a184de055b71 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:43.177949 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-82837e74-c0f1-4e52-a854-a184de055b71 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1522 microversion: 2.1 time: 0.325188 May 21 21:29:43.178553 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2303/4473] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:42 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:43.189492 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ce7f20a9-30f4-49d5-8773-56b6d5055003 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:43.218425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ce7f20a9-30f4-49d5-8773-56b6d5055003 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:43.225318 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ce7f20a9-30f4-49d5-8773-56b6d5055003 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:43.226853 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ce7f20a9-30f4-49d5-8773-56b6d5055003 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.202412 May 21 21:29:43.227745 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2171/4474] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:43 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:43.869292 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-188ba997-e327-410d-8f4a-f1d9c754377e tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:43.870831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-188ba997-e327-410d-8f4a-f1d9c754377e tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:44.002627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-188ba997-e327-410d-8f4a-f1d9c754377e tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:44.012992 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-188ba997-e327-410d-8f4a-f1d9c754377e tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:44.014974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-188ba997-e327-410d-8f4a-f1d9c754377e tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:44.016580 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-188ba997-e327-410d-8f4a-f1d9c754377e tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1278 microversion: 2.57 time: 0.152356 May 21 21:29:44.030129 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2304/4475] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:43 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:44.040129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a2ac8742-5851-44d7-bcea-6fca084637db tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:44.040941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a2ac8742-5851-44d7-bcea-6fca084637db tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:44.056607 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2ac8742-5851-44d7-bcea-6fca084637db tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:44.057627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2ac8742-5851-44d7-bcea-6fca084637db tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:44.060893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2ac8742-5851-44d7-bcea-6fca084637db tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:44.063770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2ac8742-5851-44d7-bcea-6fca084637db tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:44.083860 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:44.195411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4d26c27b-05ec-4e03-b194-8caeec35d406 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:44.196231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4d26c27b-05ec-4e03-b194-8caeec35d406 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:44.210798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d26c27b-05ec-4e03-b194-8caeec35d406 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:44.210798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d26c27b-05ec-4e03-b194-8caeec35d406 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:44.211450 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d26c27b-05ec-4e03-b194-8caeec35d406 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:44.212241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d26c27b-05ec-4e03-b194-8caeec35d406 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:44.549938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4d26c27b-05ec-4e03-b194-8caeec35d406 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:44.551274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a2ac8742-5851-44d7-bcea-6fca084637db tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:44.576696 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4d26c27b-05ec-4e03-b194-8caeec35d406 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1522 microversion: 2.1 time: 0.384969 May 21 21:29:44.578103 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2305/4476] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:44 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:44.583852 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c6a23322-f439-4c38-8d85-0522d39c9a6b tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:44.584847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c6a23322-f439-4c38-8d85-0522d39c9a6b tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:44.595949 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a2ac8742-5851-44d7-bcea-6fca084637db tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 200 len: 1308 microversion: 2.1 time: 0.559306 May 21 21:29:44.598383 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2172/4477] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:44 2022] GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 1308 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:44.614434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6a23322-f439-4c38-8d85-0522d39c9a6b tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:44.617317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6a23322-f439-4c38-8d85-0522d39c9a6b tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:44.622897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6a23322-f439-4c38-8d85-0522d39c9a6b tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:44.623561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6a23322-f439-4c38-8d85-0522d39c9a6b tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:44.778772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c6a23322-f439-4c38-8d85-0522d39c9a6b tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:44.793429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c6a23322-f439-4c38-8d85-0522d39c9a6b tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:44.809513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c6a23322-f439-4c38-8d85-0522d39c9a6b tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:44.813613 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c6a23322-f439-4c38-8d85-0522d39c9a6b tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.234213 May 21 21:29:44.816517 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2306/4478] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:44 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:45.042866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fb1c7d91-34c5-4441-8be9-4b8f6224f18c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:45.044192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fb1c7d91-34c5-4441-8be9-4b8f6224f18c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:45.072325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fb1c7d91-34c5-4441-8be9-4b8f6224f18c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:45.075639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fb1c7d91-34c5-4441-8be9-4b8f6224f18c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:45.075639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fb1c7d91-34c5-4441-8be9-4b8f6224f18c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:45.075639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fb1c7d91-34c5-4441-8be9-4b8f6224f18c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:45.509461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fb1c7d91-34c5-4441-8be9-4b8f6224f18c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:45.521272 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fb1c7d91-34c5-4441-8be9-4b8f6224f18c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:45.522880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fb1c7d91-34c5-4441-8be9-4b8f6224f18c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:45.528233 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fb1c7d91-34c5-4441-8be9-4b8f6224f18c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1274 microversion: 2.57 time: 0.495590 May 21 21:29:45.529475 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2173/4479] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:45 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1274 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:45.595089 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7bccfdb0-1331-4860-a85a-e0792177319d tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:45.596768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7bccfdb0-1331-4860-a85a-e0792177319d tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:45.605249 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7bccfdb0-1331-4860-a85a-e0792177319d tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:45.605928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7bccfdb0-1331-4860-a85a-e0792177319d tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:45.606751 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7bccfdb0-1331-4860-a85a-e0792177319d tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:45.608013 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7bccfdb0-1331-4860-a85a-e0792177319d tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:45.616937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fea84b85-5a0f-45a7-bdab-b0dd08cb008c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:45.617722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fea84b85-5a0f-45a7-bdab-b0dd08cb008c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:45.632485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fea84b85-5a0f-45a7-bdab-b0dd08cb008c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:45.635043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fea84b85-5a0f-45a7-bdab-b0dd08cb008c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:45.637837 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fea84b85-5a0f-45a7-bdab-b0dd08cb008c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:45.638400 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fea84b85-5a0f-45a7-bdab-b0dd08cb008c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:45.801075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7bccfdb0-1331-4860-a85a-e0792177319d tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:45.809873 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7bccfdb0-1331-4860-a85a-e0792177319d tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1522 microversion: 2.1 time: 0.218979 May 21 21:29:45.810660 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2307/4480] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:45 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:45.840515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-98bbbebc-3abd-433b-ab67-7042e10d2ae8 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:45.842433 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-98bbbebc-3abd-433b-ab67-7042e10d2ae8 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:45.859279 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98bbbebc-3abd-433b-ab67-7042e10d2ae8 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:45.859279 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98bbbebc-3abd-433b-ab67-7042e10d2ae8 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:45.859279 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98bbbebc-3abd-433b-ab67-7042e10d2ae8 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:45.859764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98bbbebc-3abd-433b-ab67-7042e10d2ae8 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:45.951652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-98bbbebc-3abd-433b-ab67-7042e10d2ae8 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:45.962321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-98bbbebc-3abd-433b-ab67-7042e10d2ae8 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:45.967160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-98bbbebc-3abd-433b-ab67-7042e10d2ae8 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:45.968642 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-98bbbebc-3abd-433b-ab67-7042e10d2ae8 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.136943 May 21 21:29:45.969693 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2308/4481] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:45 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:46.015489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fea84b85-5a0f-45a7-bdab-b0dd08cb008c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:46.026905 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fea84b85-5a0f-45a7-bdab-b0dd08cb008c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 200 len: 1308 microversion: 2.1 time: 0.417164 May 21 21:29:46.031015 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2174/4482] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:45 2022] GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 1308 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:29:46.547798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3e6acf58-ac21-44cf-a75d-5792acbe7bdb tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:46.549153 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3e6acf58-ac21-44cf-a75d-5792acbe7bdb tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:46.555643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e6acf58-ac21-44cf-a75d-5792acbe7bdb tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:46.556313 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e6acf58-ac21-44cf-a75d-5792acbe7bdb tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:46.557132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e6acf58-ac21-44cf-a75d-5792acbe7bdb tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:46.557659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e6acf58-ac21-44cf-a75d-5792acbe7bdb tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:46.607993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-a9710654-9f8f-4d96-af3a-afbb06220007 req-b63f4904-4e67-4e57-9e2c-9fbce8a7a80d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbe5a17b-6c84-492c-a252-a561e3920278", "name": "network-vif-plugged", "status": "completed", "tag": "51042650-7b85-4f27-bdad-7c58dbfbfbea"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:46.624007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a9710654-9f8f-4d96-af3a-afbb06220007 req-b63f4904-4e67-4e57-9e2c-9fbce8a7a80d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:46.624704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a9710654-9f8f-4d96-af3a-afbb06220007 req-b63f4904-4e67-4e57-9e2c-9fbce8a7a80d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:46.633845 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3e6acf58-ac21-44cf-a75d-5792acbe7bdb tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:46.639342 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-a9710654-9f8f-4d96-af3a-afbb06220007 req-b63f4904-4e67-4e57-9e2c-9fbce8a7a80d service nova] Creating event network-vif-plugged:51042650-7b85-4f27-bdad-7c58dbfbfbea for instance cbe5a17b-6c84-492c-a252-a561e3920278 on nch2-master-1 May 21 21:29:46.643474 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3e6acf58-ac21-44cf-a75d-5792acbe7bdb tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:46.645247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3e6acf58-ac21-44cf-a75d-5792acbe7bdb tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:46.645374 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-a9710654-9f8f-4d96-af3a-afbb06220007 req-b63f4904-4e67-4e57-9e2c-9fbce8a7a80d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043080 May 21 21:29:46.646295 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2175/4483] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:29:46.649145 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3e6acf58-ac21-44cf-a75d-5792acbe7bdb tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1336 microversion: 2.57 time: 0.103528 May 21 21:29:46.649145 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2309/4484] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:46 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1336 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:46.830961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f03c728b-6c5c-4905-af9a-037e8abd645e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:46.832007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f03c728b-6c5c-4905-af9a-037e8abd645e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:46.841730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f03c728b-6c5c-4905-af9a-037e8abd645e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:46.842426 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f03c728b-6c5c-4905-af9a-037e8abd645e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:46.843999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f03c728b-6c5c-4905-af9a-037e8abd645e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:46.844629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f03c728b-6c5c-4905-af9a-037e8abd645e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:46.988312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-628c8bd7-0302-4254-922a-7327eb7cf719 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:46.988935 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-628c8bd7-0302-4254-922a-7327eb7cf719 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:46.995589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-628c8bd7-0302-4254-922a-7327eb7cf719 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:46.996043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-628c8bd7-0302-4254-922a-7327eb7cf719 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:46.996852 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-628c8bd7-0302-4254-922a-7327eb7cf719 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:46.997438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-628c8bd7-0302-4254-922a-7327eb7cf719 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:47.014347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:47.072138 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-628c8bd7-0302-4254-922a-7327eb7cf719 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:47.081195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-628c8bd7-0302-4254-922a-7327eb7cf719 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:47.082816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-628c8bd7-0302-4254-922a-7327eb7cf719 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:47.084088 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-628c8bd7-0302-4254-922a-7327eb7cf719 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.101007 May 21 21:29:47.084754 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2310/4485] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:46 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:29:47.089338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3822ae6d-baca-4454-ab2b-92e55da5f19c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:47.089944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3822ae6d-baca-4454-ab2b-92e55da5f19c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:47.101592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3822ae6d-baca-4454-ab2b-92e55da5f19c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:47.102611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3822ae6d-baca-4454-ab2b-92e55da5f19c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:47.103713 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3822ae6d-baca-4454-ab2b-92e55da5f19c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:47.114146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3822ae6d-baca-4454-ab2b-92e55da5f19c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:47.183869 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f03c728b-6c5c-4905-af9a-037e8abd645e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:47.197346 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f03c728b-6c5c-4905-af9a-037e8abd645e tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1522 microversion: 2.1 time: 0.373028 May 21 21:29:47.199592 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2176/4486] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:46 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:47.307768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3822ae6d-baca-4454-ab2b-92e55da5f19c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:47.321242 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3822ae6d-baca-4454-ab2b-92e55da5f19c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 200 len: 1308 microversion: 2.1 time: 0.232910 May 21 21:29:47.321242 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2311/4487] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:47 2022] GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 1308 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:47.671266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d004daea-339e-407f-9e2d-3258281cf818 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:47.671892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d004daea-339e-407f-9e2d-3258281cf818 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:47.683352 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d004daea-339e-407f-9e2d-3258281cf818 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:47.683352 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d004daea-339e-407f-9e2d-3258281cf818 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:47.683352 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d004daea-339e-407f-9e2d-3258281cf818 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:47.683352 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d004daea-339e-407f-9e2d-3258281cf818 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:47.767472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d004daea-339e-407f-9e2d-3258281cf818 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:47.776600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d004daea-339e-407f-9e2d-3258281cf818 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:47.780324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d004daea-339e-407f-9e2d-3258281cf818 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:47.780324 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d004daea-339e-407f-9e2d-3258281cf818 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1336 microversion: 2.57 time: 0.114470 May 21 21:29:47.780324 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2177/4488] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:47 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1336 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:48.106032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b9988402-7cdd-437f-9c5e-66460a2b8b73 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:48.106687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b9988402-7cdd-437f-9c5e-66460a2b8b73 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:48.114706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b9988402-7cdd-437f-9c5e-66460a2b8b73 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:48.115160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b9988402-7cdd-437f-9c5e-66460a2b8b73 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:48.115928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b9988402-7cdd-437f-9c5e-66460a2b8b73 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:48.116389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b9988402-7cdd-437f-9c5e-66460a2b8b73 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:48.195314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b9988402-7cdd-437f-9c5e-66460a2b8b73 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:48.211507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b9988402-7cdd-437f-9c5e-66460a2b8b73 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:48.213181 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b9988402-7cdd-437f-9c5e-66460a2b8b73 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:48.214513 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b9988402-7cdd-437f-9c5e-66460a2b8b73 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.112674 May 21 21:29:48.216330 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-937f6353-36fd-4a66-8d95-0e83a6cf2923 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:48.217256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-937f6353-36fd-4a66-8d95-0e83a6cf2923 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:48.219864 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2312/4489] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:48 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:48.227590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-937f6353-36fd-4a66-8d95-0e83a6cf2923 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:48.228126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-937f6353-36fd-4a66-8d95-0e83a6cf2923 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:48.229022 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-937f6353-36fd-4a66-8d95-0e83a6cf2923 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:48.229595 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-937f6353-36fd-4a66-8d95-0e83a6cf2923 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:48.339696 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-232b0eed-3da8-425d-892c-a0e155a878c4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:48.340701 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-232b0eed-3da8-425d-892c-a0e155a878c4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:48.350294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-232b0eed-3da8-425d-892c-a0e155a878c4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:48.351822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-232b0eed-3da8-425d-892c-a0e155a878c4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:48.357160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-232b0eed-3da8-425d-892c-a0e155a878c4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:48.357647 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-232b0eed-3da8-425d-892c-a0e155a878c4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:48.432948 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-937f6353-36fd-4a66-8d95-0e83a6cf2923 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:48.451806 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-937f6353-36fd-4a66-8d95-0e83a6cf2923 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1522 microversion: 2.1 time: 0.237543 May 21 21:29:48.454751 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2178/4490] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:48 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:29:48.706495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-232b0eed-3da8-425d-892c-a0e155a878c4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:48.717493 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-232b0eed-3da8-425d-892c-a0e155a878c4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 200 len: 1489 microversion: 2.1 time: 0.384576 May 21 21:29:48.719680 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2313/4491] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:48 2022] GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 1489 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:29:48.749844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-39bed595-baca-40b0-8aa5-82f2ad3e129e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:48.751139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-39bed595-baca-40b0-8aa5-82f2ad3e129e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:48.765959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39bed595-baca-40b0-8aa5-82f2ad3e129e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:48.766649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39bed595-baca-40b0-8aa5-82f2ad3e129e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:48.767534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39bed595-baca-40b0-8aa5-82f2ad3e129e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:48.767989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39bed595-baca-40b0-8aa5-82f2ad3e129e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:48.799785 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-38568469-5f2e-4ffa-a571-ba1280f060f9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:48.802287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-38568469-5f2e-4ffa-a571-ba1280f060f9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:48.814145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38568469-5f2e-4ffa-a571-ba1280f060f9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:48.814911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38568469-5f2e-4ffa-a571-ba1280f060f9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:48.819206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38568469-5f2e-4ffa-a571-ba1280f060f9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:48.819774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38568469-5f2e-4ffa-a571-ba1280f060f9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:48.952431 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-38568469-5f2e-4ffa-a571-ba1280f060f9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:48.963175 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-38568469-5f2e-4ffa-a571-ba1280f060f9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:48.963915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-38568469-5f2e-4ffa-a571-ba1280f060f9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:48.965377 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-38568469-5f2e-4ffa-a571-ba1280f060f9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1357 microversion: 2.57 time: 0.170176 May 21 21:29:48.965952 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2314/4492] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:48 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:29:48.986199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-653e6d1b-f490-47d8-a150-484b6f8e51c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:48.986199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-653e6d1b-f490-47d8-a150-484b6f8e51c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:48.992394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-653e6d1b-f490-47d8-a150-484b6f8e51c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:48.992867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-653e6d1b-f490-47d8-a150-484b6f8e51c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:48.993652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-653e6d1b-f490-47d8-a150-484b6f8e51c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:48.994095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-653e6d1b-f490-47d8-a150-484b6f8e51c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:49.002059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-39bed595-baca-40b0-8aa5-82f2ad3e129e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:49.010155 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-39bed595-baca-40b0-8aa5-82f2ad3e129e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 200 len: 1489 microversion: 2.1 time: 0.266580 May 21 21:29:49.010753 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2179/4493] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:48 2022] GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 1489 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:49.027262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cef852a1-ee06-482f-8be0-1bdf710a69a4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:49.028324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cef852a1-ee06-482f-8be0-1bdf710a69a4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:49.035213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cef852a1-ee06-482f-8be0-1bdf710a69a4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:49.035701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cef852a1-ee06-482f-8be0-1bdf710a69a4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:49.037957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cef852a1-ee06-482f-8be0-1bdf710a69a4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:49.037957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cef852a1-ee06-482f-8be0-1bdf710a69a4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:49.075417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-653e6d1b-f490-47d8-a150-484b6f8e51c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:29:49.075850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-653e6d1b-f490-47d8-a150-484b6f8e51c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:29:49.076392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-653e6d1b-f490-47d8-a150-484b6f8e51c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:29:49.076849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-653e6d1b-f490-47d8-a150-484b6f8e51c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:29:49.077284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-653e6d1b-f490-47d8-a150-484b6f8e51c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:29:49.327694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cef852a1-ee06-482f-8be0-1bdf710a69a4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:49.335529 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cef852a1-ee06-482f-8be0-1bdf710a69a4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 200 len: 1489 microversion: 2.1 time: 0.312557 May 21 21:29:49.336039 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2180/4494] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:49 2022] GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 1489 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:29:49.340557 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-484cab93-8f59-4481-9cfd-e89d52f92010 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:49.341168 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-484cab93-8f59-4481-9cfd-e89d52f92010 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:49.348092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-484cab93-8f59-4481-9cfd-e89d52f92010 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:49.348569 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-484cab93-8f59-4481-9cfd-e89d52f92010 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:49.349364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-484cab93-8f59-4481-9cfd-e89d52f92010 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:49.349805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-484cab93-8f59-4481-9cfd-e89d52f92010 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:49.363752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-653e6d1b-f490-47d8-a150-484b6f8e51c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:49.377083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-653e6d1b-f490-47d8-a150-484b6f8e51c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:49.378313 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-653e6d1b-f490-47d8-a150-484b6f8e51c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:49.379703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-653e6d1b-f490-47d8-a150-484b6f8e51c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:49.380335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-653e6d1b-f490-47d8-a150-484b6f8e51c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:49.412728 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-653e6d1b-f490-47d8-a150-484b6f8e51c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "POST /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e/action" status: 202 len: 1138 microversion: 2.57 time: 0.432807 May 21 21:29:49.413438 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2315/4495] 10.222.0.49 () {62 vars in 1319 bytes} [Sat May 21 21:29:48 2022] POST /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e/action => generated 1138 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) May 21 21:29:49.420404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ee1fee85-65aa-4721-b16b-a25380382b6f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:49.421260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ee1fee85-65aa-4721-b16b-a25380382b6f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:49.428778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee1fee85-65aa-4721-b16b-a25380382b6f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:49.429225 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee1fee85-65aa-4721-b16b-a25380382b6f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:49.430013 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee1fee85-65aa-4721-b16b-a25380382b6f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:49.430430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee1fee85-65aa-4721-b16b-a25380382b6f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:49.458929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ee1fee85-65aa-4721-b16b-a25380382b6f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:29:49.473992 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-484cab93-8f59-4481-9cfd-e89d52f92010 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:49.482698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-484cab93-8f59-4481-9cfd-e89d52f92010 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:49.484595 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-484cab93-8f59-4481-9cfd-e89d52f92010 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:49.485845 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-484cab93-8f59-4481-9cfd-e89d52f92010 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.148841 May 21 21:29:49.486411 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2181/4496] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:49 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:49.491687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-adb69ee1-6dc4-4431-a385-fccffde2ade9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:49.492413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-adb69ee1-6dc4-4431-a385-fccffde2ade9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:49.499613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-adb69ee1-6dc4-4431-a385-fccffde2ade9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:49.500114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-adb69ee1-6dc4-4431-a385-fccffde2ade9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:49.500971 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-adb69ee1-6dc4-4431-a385-fccffde2ade9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:49.501417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-adb69ee1-6dc4-4431-a385-fccffde2ade9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:49.624665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-adb69ee1-6dc4-4431-a385-fccffde2ade9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:49.634190 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-adb69ee1-6dc4-4431-a385-fccffde2ade9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:49.635717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-adb69ee1-6dc4-4431-a385-fccffde2ade9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:49.636933 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-adb69ee1-6dc4-4431-a385-fccffde2ade9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1366 microversion: 2.57 time: 0.149441 May 21 21:29:49.637502 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2182/4497] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:49 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:49.644901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-82fd61f4-6eb2-41f2-971f-6ce4e4b75ccf tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:49.645521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-82fd61f4-6eb2-41f2-971f-6ce4e4b75ccf tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:49.652327 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-82fd61f4-6eb2-41f2-971f-6ce4e4b75ccf tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:49.653312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-82fd61f4-6eb2-41f2-971f-6ce4e4b75ccf tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:49.654397 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-82fd61f4-6eb2-41f2-971f-6ce4e4b75ccf tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:49.654843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-82fd61f4-6eb2-41f2-971f-6ce4e4b75ccf tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:49.795012 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ee1fee85-65aa-4721-b16b-a25380382b6f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 204 len: 0 microversion: 2.1 time: 0.378002 May 21 21:29:49.804011 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2316/4498] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:29:49 2022] DELETE /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:29:49.819442 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-78b8e002-d490-4875-b40f-52720c529bb6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:49.821816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-78b8e002-d490-4875-b40f-52720c529bb6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:49.835775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78b8e002-d490-4875-b40f-52720c529bb6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:49.837334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78b8e002-d490-4875-b40f-52720c529bb6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:49.838677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78b8e002-d490-4875-b40f-52720c529bb6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:49.839439 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78b8e002-d490-4875-b40f-52720c529bb6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:49.918851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-82fd61f4-6eb2-41f2-971f-6ce4e4b75ccf tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:49.928028 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-82fd61f4-6eb2-41f2-971f-6ce4e4b75ccf tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1522 microversion: 2.1 time: 0.287979 May 21 21:29:49.928873 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2183/4499] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:49 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:50.194118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-78b8e002-d490-4875-b40f-52720c529bb6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:50.201691 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-78b8e002-d490-4875-b40f-52720c529bb6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 200 len: 1495 microversion: 2.1 time: 0.396304 May 21 21:29:50.211418 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2317/4500] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:49 2022] GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 1495 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:50.505442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cac0ed50-56c1-439c-bdd6-18d0445a5c89 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:50.506057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cac0ed50-56c1-439c-bdd6-18d0445a5c89 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:50.512516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cac0ed50-56c1-439c-bdd6-18d0445a5c89 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:50.512968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cac0ed50-56c1-439c-bdd6-18d0445a5c89 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:50.513746 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cac0ed50-56c1-439c-bdd6-18d0445a5c89 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:50.514187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cac0ed50-56c1-439c-bdd6-18d0445a5c89 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:50.607578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cac0ed50-56c1-439c-bdd6-18d0445a5c89 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:50.616033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cac0ed50-56c1-439c-bdd6-18d0445a5c89 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:50.617602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cac0ed50-56c1-439c-bdd6-18d0445a5c89 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:50.619437 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cac0ed50-56c1-439c-bdd6-18d0445a5c89 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.117571 May 21 21:29:50.630529 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2184/4501] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:50 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:50.657714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-be5934c1-15c5-48b3-a809-e4587dbf62b5 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:50.658348 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-be5934c1-15c5-48b3-a809-e4587dbf62b5 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:50.665513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be5934c1-15c5-48b3-a809-e4587dbf62b5 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:50.665976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be5934c1-15c5-48b3-a809-e4587dbf62b5 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:50.666767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be5934c1-15c5-48b3-a809-e4587dbf62b5 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:50.667209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be5934c1-15c5-48b3-a809-e4587dbf62b5 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:50.795125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-be5934c1-15c5-48b3-a809-e4587dbf62b5 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:50.806682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-be5934c1-15c5-48b3-a809-e4587dbf62b5 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:50.808523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-be5934c1-15c5-48b3-a809-e4587dbf62b5 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:50.810150 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-be5934c1-15c5-48b3-a809-e4587dbf62b5 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1366 microversion: 2.57 time: 0.156378 May 21 21:29:50.810995 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2318/4502] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:50 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:50.945764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f9462f47-3e20-4825-bb50-01f94a2b0be9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:50.946658 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f9462f47-3e20-4825-bb50-01f94a2b0be9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:50.953834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f9462f47-3e20-4825-bb50-01f94a2b0be9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:50.954528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f9462f47-3e20-4825-bb50-01f94a2b0be9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:50.955458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f9462f47-3e20-4825-bb50-01f94a2b0be9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:50.956720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f9462f47-3e20-4825-bb50-01f94a2b0be9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:51.116458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f9462f47-3e20-4825-bb50-01f94a2b0be9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:51.124476 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f9462f47-3e20-4825-bb50-01f94a2b0be9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1522 microversion: 2.1 time: 0.182718 May 21 21:29:51.125056 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2185/4503] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:50 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:51.223813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-89d06430-3fc9-42c9-9655-9e73566c5678 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:51.228694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-89d06430-3fc9-42c9-9655-9e73566c5678 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:51.248560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89d06430-3fc9-42c9-9655-9e73566c5678 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:51.255430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89d06430-3fc9-42c9-9655-9e73566c5678 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:51.256878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89d06430-3fc9-42c9-9655-9e73566c5678 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:51.257603 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89d06430-3fc9-42c9-9655-9e73566c5678 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:51.638169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-afa2461c-f3f9-454c-b945-0346f88216bb tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:51.638804 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-afa2461c-f3f9-454c-b945-0346f88216bb tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:51.646323 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-afa2461c-f3f9-454c-b945-0346f88216bb tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:51.646777 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-afa2461c-f3f9-454c-b945-0346f88216bb tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:51.647567 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-afa2461c-f3f9-454c-b945-0346f88216bb tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:51.648007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-afa2461c-f3f9-454c-b945-0346f88216bb tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:51.731523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-afa2461c-f3f9-454c-b945-0346f88216bb tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:51.743406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-afa2461c-f3f9-454c-b945-0346f88216bb tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:51.745224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-afa2461c-f3f9-454c-b945-0346f88216bb tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:51.748684 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-afa2461c-f3f9-454c-b945-0346f88216bb tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.112543 May 21 21:29:51.753343 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2186/4504] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:51 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:29:51.837791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a4a60d1a-b710-4f59-acb1-364de345681a tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:51.839092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a4a60d1a-b710-4f59-acb1-364de345681a tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:51.847293 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4a60d1a-b710-4f59-acb1-364de345681a tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:51.848078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4a60d1a-b710-4f59-acb1-364de345681a tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:51.849442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4a60d1a-b710-4f59-acb1-364de345681a tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:51.850206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4a60d1a-b710-4f59-acb1-364de345681a tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:51.980774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a4a60d1a-b710-4f59-acb1-364de345681a tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:51.992141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a4a60d1a-b710-4f59-acb1-364de345681a tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:51.994137 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a4a60d1a-b710-4f59-acb1-364de345681a tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:51.995819 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a4a60d1a-b710-4f59-acb1-364de345681a tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1366 microversion: 2.57 time: 0.165840 May 21 21:29:51.996997 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2187/4505] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:51 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:52.014738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-89d06430-3fc9-42c9-9655-9e73566c5678 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:52.028747 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-89d06430-3fc9-42c9-9655-9e73566c5678 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 200 len: 1495 microversion: 2.1 time: 0.811321 May 21 21:29:52.030787 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2319/4506] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:51 2022] GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 1495 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:52.035255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-6af9e759-9509-4ae4-a95a-f1407becb7fe req-319975ad-7237-48ac-b930-8ced28a33ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbe5a17b-6c84-492c-a252-a561e3920278", "name": "network-vif-deleted", "tag": "51042650-7b85-4f27-bdad-7c58dbfbfbea"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:52.066069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6af9e759-9509-4ae4-a95a-f1407becb7fe req-319975ad-7237-48ac-b930-8ced28a33ee8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:52.067379 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6af9e759-9509-4ae4-a95a-f1407becb7fe req-319975ad-7237-48ac-b930-8ced28a33ee8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:52.106167 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-6af9e759-9509-4ae4-a95a-f1407becb7fe req-319975ad-7237-48ac-b930-8ced28a33ee8 service nova] Creating event network-vif-deleted:51042650-7b85-4f27-bdad-7c58dbfbfbea for instance cbe5a17b-6c84-492c-a252-a561e3920278 on nch2-master-1 May 21 21:29:52.113858 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-6af9e759-9509-4ae4-a95a-f1407becb7fe req-319975ad-7237-48ac-b930-8ced28a33ee8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115143 May 21 21:29:52.116196 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2188/4507] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:29:52.146609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-660404c0-90b8-4fe6-94d5-cee54788af67 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:52.146609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-660404c0-90b8-4fe6-94d5-cee54788af67 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:52.152617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-660404c0-90b8-4fe6-94d5-cee54788af67 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:52.153466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-660404c0-90b8-4fe6-94d5-cee54788af67 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:52.154553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-660404c0-90b8-4fe6-94d5-cee54788af67 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:52.155177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-660404c0-90b8-4fe6-94d5-cee54788af67 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:52.350156 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:52.448683 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-660404c0-90b8-4fe6-94d5-cee54788af67 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:52.460631 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-660404c0-90b8-4fe6-94d5-cee54788af67 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1522 microversion: 2.1 time: 0.319436 May 21 21:29:52.461981 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2320/4508] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:52 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:52.771102 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c9eeeca8-c116-4d5b-b842-b55140eea0f9 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:52.772506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c9eeeca8-c116-4d5b-b842-b55140eea0f9 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:52.778946 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:52.781222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9eeeca8-c116-4d5b-b842-b55140eea0f9 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:52.786637 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9eeeca8-c116-4d5b-b842-b55140eea0f9 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:52.787588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9eeeca8-c116-4d5b-b842-b55140eea0f9 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:52.788117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9eeeca8-c116-4d5b-b842-b55140eea0f9 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:52.868815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c9eeeca8-c116-4d5b-b842-b55140eea0f9 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:52.877669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c9eeeca8-c116-4d5b-b842-b55140eea0f9 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:52.879390 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c9eeeca8-c116-4d5b-b842-b55140eea0f9 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:52.880618 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c9eeeca8-c116-4d5b-b842-b55140eea0f9 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.115986 May 21 21:29:52.881296 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2189/4509] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:52 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:53.014190 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3969ca7b-5840-4350-ad24-178ee7d4f646 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:53.014808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3969ca7b-5840-4350-ad24-178ee7d4f646 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:53.021715 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3969ca7b-5840-4350-ad24-178ee7d4f646 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:53.022164 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3969ca7b-5840-4350-ad24-178ee7d4f646 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:53.022942 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3969ca7b-5840-4350-ad24-178ee7d4f646 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:53.023382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3969ca7b-5840-4350-ad24-178ee7d4f646 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:53.050202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ff00b3fa-3b16-4225-b842-cbdbdbb274aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:53.055946 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ff00b3fa-3b16-4225-b842-cbdbdbb274aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:53.057758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff00b3fa-3b16-4225-b842-cbdbdbb274aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:53.058220 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff00b3fa-3b16-4225-b842-cbdbdbb274aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:53.059006 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff00b3fa-3b16-4225-b842-cbdbdbb274aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:53.059453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff00b3fa-3b16-4225-b842-cbdbdbb274aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:53.063732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:53.074116 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-ff00b3fa-3b16-4225-b842-cbdbdbb274aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance cbe5a17b-6c84-492c-a252-a561e3920278 could not be found. May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ff00b3fa-3b16-4225-b842-cbdbdbb274aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 HTTP/1.1 May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance cbe5a17b-6c84-492c-a252-a561e3920278 could not be found. May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'cbe5a17b-6c84-492c-a252-a561e3920278'} May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbe5a17b-6c84-492c-a252-a561e3920278 could not be found. May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbe5a17b-6c84-492c-a252-a561e3920278 could not be found. May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:53.075777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:53.080091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:29:53.080091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:29:53.080091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:29:53.080091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:29:53.080091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbe5a17b-6c84-492c-a252-a561e3920278 could not be found. May 21 21:29:53.080091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:53.080091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ff00b3fa-3b16-4225-b842-cbdbdbb274aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance cbe5a17b-6c84-492c-a252-a561e3920278 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:29:53.080091 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ff00b3fa-3b16-4225-b842-cbdbdbb274aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 404 len: 111 microversion: 2.1 time: 0.031621 May 21 21:29:53.080091 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2190/4510] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:53 2022] GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:29:53.090921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2835e2b0-737f-4635-9891-08ff06e0cbfe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:53.090921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2835e2b0-737f-4635-9891-08ff06e0cbfe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:53.092694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2835e2b0-737f-4635-9891-08ff06e0cbfe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:53.093153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2835e2b0-737f-4635-9891-08ff06e0cbfe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:53.093926 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2835e2b0-737f-4635-9891-08ff06e0cbfe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:53.094367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2835e2b0-737f-4635-9891-08ff06e0cbfe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:53.121662 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3969ca7b-5840-4350-ad24-178ee7d4f646 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:53.122729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2835e2b0-737f-4635-9891-08ff06e0cbfe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:29:53.133444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3969ca7b-5840-4350-ad24-178ee7d4f646 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:53.135001 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3969ca7b-5840-4350-ad24-178ee7d4f646 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:53.140311 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3969ca7b-5840-4350-ad24-178ee7d4f646 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1366 microversion: 2.57 time: 0.129678 May 21 21:29:53.141735 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2321/4511] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:53 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1366 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:53.480161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6c3d1cc9-7483-451e-9ccd-2a01f72b96fa tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:53.481219 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6c3d1cc9-7483-451e-9ccd-2a01f72b96fa tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:53.492062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6c3d1cc9-7483-451e-9ccd-2a01f72b96fa tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:53.492848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6c3d1cc9-7483-451e-9ccd-2a01f72b96fa tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:53.493793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6c3d1cc9-7483-451e-9ccd-2a01f72b96fa tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:53.494530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6c3d1cc9-7483-451e-9ccd-2a01f72b96fa tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:53.520945 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2835e2b0-737f-4635-9891-08ff06e0cbfe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "DELETE /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 204 len: 0 microversion: 2.1 time: 0.438213 May 21 21:29:53.526842 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2191/4512] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:29:53 2022] DELETE /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 21:29:53.555398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c8eb55fd-3084-4074-a3b9-d5cf1c063573 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:53.557394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c8eb55fd-3084-4074-a3b9-d5cf1c063573 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:53.588688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8eb55fd-3084-4074-a3b9-d5cf1c063573 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:53.589573 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8eb55fd-3084-4074-a3b9-d5cf1c063573 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:53.592098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8eb55fd-3084-4074-a3b9-d5cf1c063573 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:53.604160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8eb55fd-3084-4074-a3b9-d5cf1c063573 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:53.813673 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c8eb55fd-3084-4074-a3b9-d5cf1c063573 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:53.825632 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c8eb55fd-3084-4074-a3b9-d5cf1c063573 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 200 len: 1495 microversion: 2.1 time: 0.283705 May 21 21:29:53.826790 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2192/4513] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:53 2022] GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 1495 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:53.900859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a2d149f5-2dbf-45c5-9c36-c2344b6b7e01 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:53.901495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a2d149f5-2dbf-45c5-9c36-c2344b6b7e01 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:53.908571 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2d149f5-2dbf-45c5-9c36-c2344b6b7e01 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:53.909742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2d149f5-2dbf-45c5-9c36-c2344b6b7e01 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:53.917967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2d149f5-2dbf-45c5-9c36-c2344b6b7e01 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:53.918450 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2d149f5-2dbf-45c5-9c36-c2344b6b7e01 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:53.998249 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a2d149f5-2dbf-45c5-9c36-c2344b6b7e01 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:54.008139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a2d149f5-2dbf-45c5-9c36-c2344b6b7e01 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:54.009710 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a2d149f5-2dbf-45c5-9c36-c2344b6b7e01 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:54.010893 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a2d149f5-2dbf-45c5-9c36-c2344b6b7e01 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.115120 May 21 21:29:54.011819 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2193/4514] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:53 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:54.012192 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=10 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:54.038798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6c3d1cc9-7483-451e-9ccd-2a01f72b96fa tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:54.046877 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6c3d1cc9-7483-451e-9ccd-2a01f72b96fa tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1522 microversion: 2.1 time: 0.572192 May 21 21:29:54.047451 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2322/4515] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:53 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1522 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:29:54.161832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b158f748-b5ff-4432-8877-d6697445b1c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:54.162448 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b158f748-b5ff-4432-8877-d6697445b1c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:54.173639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b158f748-b5ff-4432-8877-d6697445b1c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:54.174557 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b158f748-b5ff-4432-8877-d6697445b1c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:54.176617 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b158f748-b5ff-4432-8877-d6697445b1c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:54.177265 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b158f748-b5ff-4432-8877-d6697445b1c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:54.260702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b158f748-b5ff-4432-8877-d6697445b1c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:54.270754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b158f748-b5ff-4432-8877-d6697445b1c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:54.276192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b158f748-b5ff-4432-8877-d6697445b1c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:54.277481 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b158f748-b5ff-4432-8877-d6697445b1c3 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1366 microversion: 2.57 time: 0.120728 May 21 21:29:54.285375 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2194/4516] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:54 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1366 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:54.845656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c35b23b2-aabd-4fff-942c-cf11d7fd4e49 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:54.846483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c35b23b2-aabd-4fff-942c-cf11d7fd4e49 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:54.858291 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c35b23b2-aabd-4fff-942c-cf11d7fd4e49 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:54.858804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c35b23b2-aabd-4fff-942c-cf11d7fd4e49 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:54.860264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c35b23b2-aabd-4fff-942c-cf11d7fd4e49 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:54.860745 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c35b23b2-aabd-4fff-942c-cf11d7fd4e49 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:54.865992 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:55.037908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-975474b0-a4a6-4014-aad2-bfbb6339dc0a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:55.038786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-975474b0-a4a6-4014-aad2-bfbb6339dc0a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:55.061584 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-975474b0-a4a6-4014-aad2-bfbb6339dc0a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:55.062523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-975474b0-a4a6-4014-aad2-bfbb6339dc0a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:55.064464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-975474b0-a4a6-4014-aad2-bfbb6339dc0a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:55.067357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-975474b0-a4a6-4014-aad2-bfbb6339dc0a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:55.183748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-975474b0-a4a6-4014-aad2-bfbb6339dc0a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:55.196139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-975474b0-a4a6-4014-aad2-bfbb6339dc0a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:55.200003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-975474b0-a4a6-4014-aad2-bfbb6339dc0a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:55.203104 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-975474b0-a4a6-4014-aad2-bfbb6339dc0a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.172354 May 21 21:29:55.213708 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2195/4517] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:55 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:55.228508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5170df1f-7e47-4fab-b3e5-4ee7015227e1 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:55.229348 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5170df1f-7e47-4fab-b3e5-4ee7015227e1 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:55.236697 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5170df1f-7e47-4fab-b3e5-4ee7015227e1 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:55.238019 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5170df1f-7e47-4fab-b3e5-4ee7015227e1 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:55.239048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5170df1f-7e47-4fab-b3e5-4ee7015227e1 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:55.239717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5170df1f-7e47-4fab-b3e5-4ee7015227e1 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:55.537233 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5170df1f-7e47-4fab-b3e5-4ee7015227e1 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:55.547482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c35b23b2-aabd-4fff-942c-cf11d7fd4e49 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:55.564185 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c35b23b2-aabd-4fff-942c-cf11d7fd4e49 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 200 len: 1495 microversion: 2.1 time: 0.723773 May 21 21:29:55.573153 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5170df1f-7e47-4fab-b3e5-4ee7015227e1 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1522 microversion: 2.1 time: 0.358169 May 21 21:29:55.573750 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2196/4518] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:55 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:55.574149 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2323/4519] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:54 2022] GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 1495 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:55.584684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7e85bc51-8ac0-4f8a-89a6-65f188e19292 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:55.586362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7e85bc51-8ac0-4f8a-89a6-65f188e19292 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:55.604434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e85bc51-8ac0-4f8a-89a6-65f188e19292 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:55.604910 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e85bc51-8ac0-4f8a-89a6-65f188e19292 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:55.608033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e85bc51-8ac0-4f8a-89a6-65f188e19292 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:55.608501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e85bc51-8ac0-4f8a-89a6-65f188e19292 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:55.747406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7e85bc51-8ac0-4f8a-89a6-65f188e19292 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:55.759570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7e85bc51-8ac0-4f8a-89a6-65f188e19292 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:55.764613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7e85bc51-8ac0-4f8a-89a6-65f188e19292 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:55.765884 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7e85bc51-8ac0-4f8a-89a6-65f188e19292 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1366 microversion: 2.57 time: 0.190585 May 21 21:29:55.779692 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2324/4520] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:55 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:56.228630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-79dc32cb-8e4b-44b4-80f6-394191975e74 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:56.230105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-79dc32cb-8e4b-44b4-80f6-394191975e74 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:56.243847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-79dc32cb-8e4b-44b4-80f6-394191975e74 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:56.245566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-79dc32cb-8e4b-44b4-80f6-394191975e74 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:56.246509 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-79dc32cb-8e4b-44b4-80f6-394191975e74 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:56.256014 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-79dc32cb-8e4b-44b4-80f6-394191975e74 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:56.316763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-fdd97a30-cc8b-4c4c-9ab9-13cc3d10d61f req-398a9057-cca5-4e15-9352-e0c51236a054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00f49c4e-7f9e-48b8-a1db-6be0456b1ebd", "name": "network-vif-deleted", "tag": "02b48e5c-26c2-4eec-8630-4c7efb77ac9b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:56.334763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-fdd97a30-cc8b-4c4c-9ab9-13cc3d10d61f req-398a9057-cca5-4e15-9352-e0c51236a054 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:56.335540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-fdd97a30-cc8b-4c4c-9ab9-13cc3d10d61f req-398a9057-cca5-4e15-9352-e0c51236a054 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:56.350067 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-fdd97a30-cc8b-4c4c-9ab9-13cc3d10d61f req-398a9057-cca5-4e15-9352-e0c51236a054 service nova] Creating event network-vif-deleted:02b48e5c-26c2-4eec-8630-4c7efb77ac9b for instance 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd on nch1-master-1 May 21 21:29:56.356710 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-fdd97a30-cc8b-4c4c-9ab9-13cc3d10d61f req-398a9057-cca5-4e15-9352-e0c51236a054 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044227 May 21 21:29:56.359213 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2325/4521] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:29:56.439154 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-79dc32cb-8e4b-44b4-80f6-394191975e74 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:56.454679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-79dc32cb-8e4b-44b4-80f6-394191975e74 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:56.457122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-79dc32cb-8e4b-44b4-80f6-394191975e74 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:56.461761 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-79dc32cb-8e4b-44b4-80f6-394191975e74 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.234401 May 21 21:29:56.463628 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2197/4522] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:56 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:56.595723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-27f4e76f-492c-4937-b82e-28ab59d37ca1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:56.597104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-27f4e76f-492c-4937-b82e-28ab59d37ca1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:56.606581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-86df73bf-bd81-4e7d-89ce-c251413e677f tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:56.607424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-86df73bf-bd81-4e7d-89ce-c251413e677f tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:56.614928 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86df73bf-bd81-4e7d-89ce-c251413e677f tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:56.617232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86df73bf-bd81-4e7d-89ce-c251413e677f tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:56.618276 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86df73bf-bd81-4e7d-89ce-c251413e677f tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:56.619076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86df73bf-bd81-4e7d-89ce-c251413e677f tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:56.623151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27f4e76f-492c-4937-b82e-28ab59d37ca1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:56.623781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27f4e76f-492c-4937-b82e-28ab59d37ca1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:56.629847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27f4e76f-492c-4937-b82e-28ab59d37ca1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:56.630499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27f4e76f-492c-4937-b82e-28ab59d37ca1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:56.746078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-27f4e76f-492c-4937-b82e-28ab59d37ca1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:56.755158 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-27f4e76f-492c-4937-b82e-28ab59d37ca1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 200 len: 1293 microversion: 2.1 time: 0.163679 May 21 21:29:56.755743 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2326/4523] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:56 2022] GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 1293 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:56.787543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8ea7e51a-a797-4830-a993-b00c2ff00816 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:56.789082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8ea7e51a-a797-4830-a993-b00c2ff00816 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:56.796163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ea7e51a-a797-4830-a993-b00c2ff00816 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:56.796844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ea7e51a-a797-4830-a993-b00c2ff00816 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:56.797634 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ea7e51a-a797-4830-a993-b00c2ff00816 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:56.798762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ea7e51a-a797-4830-a993-b00c2ff00816 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:56.876327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8ea7e51a-a797-4830-a993-b00c2ff00816 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:56.882833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8ea7e51a-a797-4830-a993-b00c2ff00816 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:56.888787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8ea7e51a-a797-4830-a993-b00c2ff00816 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:56.890252 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8ea7e51a-a797-4830-a993-b00c2ff00816 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1366 microversion: 2.57 time: 0.107171 May 21 21:29:56.891789 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2327/4524] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:56 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1366 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:29:57.123500 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-86df73bf-bd81-4e7d-89ce-c251413e677f tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:57.131363 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-86df73bf-bd81-4e7d-89ce-c251413e677f tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1522 microversion: 2.1 time: 0.528615 May 21 21:29:57.138634 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2198/4525] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:56 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1522 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:57.483348 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aea894e1-a8b6-454a-b59c-577a6597fd78 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:57.483987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aea894e1-a8b6-454a-b59c-577a6597fd78 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:57.494190 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aea894e1-a8b6-454a-b59c-577a6597fd78 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:57.494643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aea894e1-a8b6-454a-b59c-577a6597fd78 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:57.495592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aea894e1-a8b6-454a-b59c-577a6597fd78 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:57.496206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aea894e1-a8b6-454a-b59c-577a6597fd78 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:57.571406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aea894e1-a8b6-454a-b59c-577a6597fd78 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:57.585078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aea894e1-a8b6-454a-b59c-577a6597fd78 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:57.586941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aea894e1-a8b6-454a-b59c-577a6597fd78 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:57.588311 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aea894e1-a8b6-454a-b59c-577a6597fd78 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.108865 May 21 21:29:57.599470 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2328/4526] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:57 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:57.773368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-18926b9e-dae6-4af3-849e-90fb3b8543b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:57.775275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-18926b9e-dae6-4af3-849e-90fb3b8543b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:57.797299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-18926b9e-dae6-4af3-849e-90fb3b8543b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:57.801389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-18926b9e-dae6-4af3-849e-90fb3b8543b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:57.802559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-18926b9e-dae6-4af3-849e-90fb3b8543b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:57.803628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-18926b9e-dae6-4af3-849e-90fb3b8543b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:57.830075 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-18926b9e-dae6-4af3-849e-90fb3b8543b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd could not be found. May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-18926b9e-dae6-4af3-849e-90fb3b8543b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd HTTP/1.1 May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd could not be found. May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '00f49c4e-7f9e-48b8-a1db-6be0456b1ebd'} May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd could not be found. May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd could not be found. May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:57.836692 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:29:57.840528 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:29:57.840528 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:29:57.840528 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:29:57.840528 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:29:57.840528 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd could not be found. May 21 21:29:57.840528 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:29:57.841914 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-18926b9e-dae6-4af3-849e-90fb3b8543b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:29:57.842959 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-18926b9e-dae6-4af3-849e-90fb3b8543b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 404 len: 111 microversion: 2.1 time: 0.073633 May 21 21:29:57.843677 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2199/4527] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:57 2022] GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:29:57.913899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4ecf164f-6fdb-4636-b327-fc952874f24c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:57.914786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4ecf164f-6fdb-4636-b327-fc952874f24c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:57.938115 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ecf164f-6fdb-4636-b327-fc952874f24c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:57.938629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ecf164f-6fdb-4636-b327-fc952874f24c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:57.939428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ecf164f-6fdb-4636-b327-fc952874f24c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:57.940381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ecf164f-6fdb-4636-b327-fc952874f24c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:58.055365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4ecf164f-6fdb-4636-b327-fc952874f24c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:58.066737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4ecf164f-6fdb-4636-b327-fc952874f24c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:58.068966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4ecf164f-6fdb-4636-b327-fc952874f24c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:58.073595 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4ecf164f-6fdb-4636-b327-fc952874f24c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1366 microversion: 2.57 time: 0.166109 May 21 21:29:58.075256 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2329/4528] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:57 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:29:58.147847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2d99c14d-cfa9-4a55-9270-3f45d47204c0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1308930281", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "88d40858-d8e8-4c97-8084-13382fa527f6"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:58.149153 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-851c608d-e430-48b4-b7a5-36ec4df1d0eb tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:58.149923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-851c608d-e430-48b4-b7a5-36ec4df1d0eb tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:58.173837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-851c608d-e430-48b4-b7a5-36ec4df1d0eb tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:58.175087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-851c608d-e430-48b4-b7a5-36ec4df1d0eb tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:58.176026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-851c608d-e430-48b4-b7a5-36ec4df1d0eb tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:58.176627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-851c608d-e430-48b4-b7a5-36ec4df1d0eb tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:58.220827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-2d99c14d-cfa9-4a55-9270-3f45d47204c0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] validate_networks() for [('88d40858-d8e8-4c97-8084-13382fa527f6', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:29:58.366962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-851c608d-e430-48b4-b7a5-36ec4df1d0eb tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:58.382033 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-851c608d-e430-48b4-b7a5-36ec4df1d0eb tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1522 microversion: 2.1 time: 0.237308 May 21 21:29:58.382616 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2330/4529] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:58 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:58.609648 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4c84e8f0-457c-46dc-aa17-aa662fe3290a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:58.611051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4c84e8f0-457c-46dc-aa17-aa662fe3290a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:58.622253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4c84e8f0-457c-46dc-aa17-aa662fe3290a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:58.623881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4c84e8f0-457c-46dc-aa17-aa662fe3290a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:58.656996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4c84e8f0-457c-46dc-aa17-aa662fe3290a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:58.657563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4c84e8f0-457c-46dc-aa17-aa662fe3290a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:58.818937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4c84e8f0-457c-46dc-aa17-aa662fe3290a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:58.828028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4c84e8f0-457c-46dc-aa17-aa662fe3290a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:58.829580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4c84e8f0-457c-46dc-aa17-aa662fe3290a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:58.831186 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4c84e8f0-457c-46dc-aa17-aa662fe3290a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1408 microversion: 2.54 time: 0.227158 May 21 21:29:58.831750 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2331/4530] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:58 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:29:59.094852 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3d006af3-bde7-44c8-87fc-f7df7aba03dc tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:59.096682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3d006af3-bde7-44c8-87fc-f7df7aba03dc tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:59.106514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d006af3-bde7-44c8-87fc-f7df7aba03dc tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:59.107020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d006af3-bde7-44c8-87fc-f7df7aba03dc tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:59.107812 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d006af3-bde7-44c8-87fc-f7df7aba03dc tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:59.108512 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d006af3-bde7-44c8-87fc-f7df7aba03dc tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:59.253767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3d006af3-bde7-44c8-87fc-f7df7aba03dc tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:59.262467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3d006af3-bde7-44c8-87fc-f7df7aba03dc tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:59.263995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3d006af3-bde7-44c8-87fc-f7df7aba03dc tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:59.265127 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3d006af3-bde7-44c8-87fc-f7df7aba03dc tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1366 microversion: 2.57 time: 0.175087 May 21 21:29:59.265954 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2332/4531] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:59 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:29:59.406237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-114f920e-5bcc-40fc-82dc-a7f6e0343148 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:59.407075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-114f920e-5bcc-40fc-82dc-a7f6e0343148 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:59.414851 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-114f920e-5bcc-40fc-82dc-a7f6e0343148 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:59.415314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-114f920e-5bcc-40fc-82dc-a7f6e0343148 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:59.416210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-114f920e-5bcc-40fc-82dc-a7f6e0343148 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:59.416750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-114f920e-5bcc-40fc-82dc-a7f6e0343148 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:59.514251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-2d99c14d-cfa9-4a55-9270-3f45d47204c0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:29:59.514853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-2d99c14d-cfa9-4a55-9270-3f45d47204c0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:29:59.515540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-2d99c14d-cfa9-4a55-9270-3f45d47204c0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:29:59.516145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-2d99c14d-cfa9-4a55-9270-3f45d47204c0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:29:59.516813 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-2d99c14d-cfa9-4a55-9270-3f45d47204c0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:29:59.537094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2d99c14d-cfa9-4a55-9270-3f45d47204c0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:59.537865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2d99c14d-cfa9-4a55-9270-3f45d47204c0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:59.539334 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2d99c14d-cfa9-4a55-9270-3f45d47204c0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:29:59.539973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2d99c14d-cfa9-4a55-9270-3f45d47204c0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:29:59.566436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-2d99c14d-cfa9-4a55-9270-3f45d47204c0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Getting quotas for project 4dbb4bbc88f84520885c00a376ba0f7c. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:29:59.572911 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-2d99c14d-cfa9-4a55-9270-3f45d47204c0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Getting quotas for user c67dc8226610413a8bb889d6055a75d2 and project 4dbb4bbc88f84520885c00a376ba0f7c. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:29:59.588523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2d99c14d-cfa9-4a55-9270-3f45d47204c0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:29:59.590895 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2d99c14d-cfa9-4a55-9270-3f45d47204c0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:29:59.664184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-114f920e-5bcc-40fc-82dc-a7f6e0343148 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:59.675214 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-114f920e-5bcc-40fc-82dc-a7f6e0343148 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1502 microversion: 2.1 time: 0.277882 May 21 21:29:59.675830 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2333/4532] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:59 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1502 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:59.693736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1b1cacf7-929e-4e2c-bfc3-15479c4b1574 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Action: 'create', calling method: .version_select at 0x7fc81a41e670>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-871136184", "description": "tempest-description-2059349828"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:29:59.785591 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2d99c14d-cfa9-4a55-9270-3f45d47204c0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.646602 May 21 21:29:59.791839 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2200/4533] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:29:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:29:59.800065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-be16aebd-8b22-4b4d-aa55-9b040b113d59 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:59.800065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-be16aebd-8b22-4b4d-aa55-9b040b113d59 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:29:59.952822 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-be16aebd-8b22-4b4d-aa55-9b040b113d59 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:29:59.964922 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-be16aebd-8b22-4b4d-aa55-9b040b113d59 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 200 len: 1209 microversion: 2.1 time: 0.171721 May 21 21:29:59.966029 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2201/4534] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:29:59 2022] GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 1209 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:29:59.982801 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-35f25578-23ea-4191-be0d-6da9c65117e5 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:29:59.983701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-35f25578-23ea-4191-be0d-6da9c65117e5 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:00.000404 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35f25578-23ea-4191-be0d-6da9c65117e5 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:00.001412 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35f25578-23ea-4191-be0d-6da9c65117e5 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:00.003056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35f25578-23ea-4191-be0d-6da9c65117e5 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:00.003689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35f25578-23ea-4191-be0d-6da9c65117e5 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:00.158400 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-35f25578-23ea-4191-be0d-6da9c65117e5 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:00.177117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-35f25578-23ea-4191-be0d-6da9c65117e5 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:00.184092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-35f25578-23ea-4191-be0d-6da9c65117e5 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:00.188516 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-35f25578-23ea-4191-be0d-6da9c65117e5 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1414 microversion: 2.54 time: 0.220542 May 21 21:30:00.193367 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2202/4535] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:29:59 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1414 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:30:00.292013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-afca7c84-716c-4693-86cf-727869d175a8 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:00.293006 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-afca7c84-716c-4693-86cf-727869d175a8 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:00.302692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-afca7c84-716c-4693-86cf-727869d175a8 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:00.303316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-afca7c84-716c-4693-86cf-727869d175a8 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:00.304902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-afca7c84-716c-4693-86cf-727869d175a8 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:00.305478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-afca7c84-716c-4693-86cf-727869d175a8 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:00.472254 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-afca7c84-716c-4693-86cf-727869d175a8 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:00.487998 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-afca7c84-716c-4693-86cf-727869d175a8 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:00.497658 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-afca7c84-716c-4693-86cf-727869d175a8 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:00.500385 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-afca7c84-716c-4693-86cf-727869d175a8 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1366 microversion: 2.57 time: 0.218744 May 21 21:30:00.509520 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2203/4536] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:30:00 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:30:00.704328 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1b1cacf7-929e-4e2c-bfc3-15479c4b1574 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 1.015116 May 21 21:30:00.704962 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2334/4537] 10.222.0.49 () {60 vars in 1179 bytes} [Sat May 21 21:29:59 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:30:00.721564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eeb264e6-26d1-4a7b-9d83-4451aa86182b tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-871136184"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:00.722728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-eeb264e6-26d1-4a7b-9d83-4451aa86182b tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:00.730842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eeb264e6-26d1-4a7b-9d83-4451aa86182b tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:00.731527 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eeb264e6-26d1-4a7b-9d83-4451aa86182b tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:00.732750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eeb264e6-26d1-4a7b-9d83-4451aa86182b tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:00.733329 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eeb264e6-26d1-4a7b-9d83-4451aa86182b tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:01.091156 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.network.security_group_api [None req-eeb264e6-26d1-4a7b-9d83-4451aa86182b tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Adding security group f11e7c2a-f276-479f-abdb-aa1e60a1af63 to port f1e3e151-e89e-4972-b253-8b889eef1d77 May 21 21:30:01.097947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6c535f89-0639-4b1c-84ad-dc3d4c5c0e5e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-899917511", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:01.274920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-6c535f89-0639-4b1c-84ad-dc3d4c5c0e5e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] validate_networks() for [('803f67e8-d424-4079-9484-4c9fb1a3b195', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:30:01.849096 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-eeb264e6-26d1-4a7b-9d83-4451aa86182b tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "POST /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f/action" status: 202 len: 0 microversion: 2.1 time: 1.132650 May 21 21:30:01.851784 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2204/4538] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:30:00 2022] POST /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f/action => generated 0 bytes in 1136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:30:01.859682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-177c63d5-abd4-4dbb-8866-7d88e694f721 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:01.861783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-177c63d5-abd4-4dbb-8866-7d88e694f721 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:01.875116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-177c63d5-abd4-4dbb-8866-7d88e694f721 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:01.892071 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-177c63d5-abd4-4dbb-8866-7d88e694f721 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:01.894318 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-177c63d5-abd4-4dbb-8866-7d88e694f721 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:01.897651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-177c63d5-abd4-4dbb-8866-7d88e694f721 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:02.042743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-177c63d5-abd4-4dbb-8866-7d88e694f721 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:02.059019 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-177c63d5-abd4-4dbb-8866-7d88e694f721 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 200 len: 1205 microversion: 2.1 time: 0.205492 May 21 21:30:02.060972 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2205/4539] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:01 2022] GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 1205 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:02.067556 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3a0c1a01-aea6-404c-ad34-0853330ad19c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:02.068421 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3a0c1a01-aea6-404c-ad34-0853330ad19c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:02.078472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a0c1a01-aea6-404c-ad34-0853330ad19c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:02.078910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a0c1a01-aea6-404c-ad34-0853330ad19c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:02.079691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a0c1a01-aea6-404c-ad34-0853330ad19c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:02.080331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a0c1a01-aea6-404c-ad34-0853330ad19c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:02.187847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3a0c1a01-aea6-404c-ad34-0853330ad19c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:02.200630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3a0c1a01-aea6-404c-ad34-0853330ad19c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:02.202498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3a0c1a01-aea6-404c-ad34-0853330ad19c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:02.203923 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3a0c1a01-aea6-404c-ad34-0853330ad19c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1399 microversion: 2.54 time: 0.141428 May 21 21:30:02.204878 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2206/4540] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:30:02 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1399 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:30:02.210376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-511920a5-d4c7-4b20-b8d1-bc9fe68fd544 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:02.211081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-511920a5-d4c7-4b20-b8d1-bc9fe68fd544 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:02.219565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-511920a5-d4c7-4b20-b8d1-bc9fe68fd544 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:02.220810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-511920a5-d4c7-4b20-b8d1-bc9fe68fd544 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:02.221902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-511920a5-d4c7-4b20-b8d1-bc9fe68fd544 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:02.226901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-511920a5-d4c7-4b20-b8d1-bc9fe68fd544 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:02.306277 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-511920a5-d4c7-4b20-b8d1-bc9fe68fd544 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:02.315884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-511920a5-d4c7-4b20-b8d1-bc9fe68fd544 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:02.317406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-511920a5-d4c7-4b20-b8d1-bc9fe68fd544 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:02.318640 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-511920a5-d4c7-4b20-b8d1-bc9fe68fd544 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1366 microversion: 2.57 time: 0.112525 May 21 21:30:02.319488 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2207/4541] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:30:02 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1366 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:30:02.324456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4b51790c-0884-48fd-902d-5c412f5f40c9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-871136184"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:02.328107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4b51790c-0884-48fd-902d-5c412f5f40c9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:02.331844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b51790c-0884-48fd-902d-5c412f5f40c9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:02.332574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b51790c-0884-48fd-902d-5c412f5f40c9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:02.333518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b51790c-0884-48fd-902d-5c412f5f40c9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:02.333954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b51790c-0884-48fd-902d-5c412f5f40c9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:02.356676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:02.385037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6c535f89-0639-4b1c-84ad-dc3d4c5c0e5e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:30:02.386797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6c535f89-0639-4b1c-84ad-dc3d4c5c0e5e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:30:02.387577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6c535f89-0639-4b1c-84ad-dc3d4c5c0e5e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:30:02.388228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6c535f89-0639-4b1c-84ad-dc3d4c5c0e5e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:30:02.389047 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6c535f89-0639-4b1c-84ad-dc3d4c5c0e5e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:30:02.401307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6c535f89-0639-4b1c-84ad-dc3d4c5c0e5e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:02.402031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6c535f89-0639-4b1c-84ad-dc3d4c5c0e5e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:02.403174 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6c535f89-0639-4b1c-84ad-dc3d4c5c0e5e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:02.403827 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6c535f89-0639-4b1c-84ad-dc3d4c5c0e5e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:02.421384 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:02.433995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-6c535f89-0639-4b1c-84ad-dc3d4c5c0e5e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Getting quotas for project 2e6d59483dc54fe4a558186055068419. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:30:02.440979 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-6c535f89-0639-4b1c-84ad-dc3d4c5c0e5e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Getting quotas for user 9a0ccfb5c9a04ec0831a0bfe987bb659 and project 2e6d59483dc54fe4a558186055068419. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:30:02.471521 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6c535f89-0639-4b1c-84ad-dc3d4c5c0e5e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:30:02.472844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6c535f89-0639-4b1c-84ad-dc3d4c5c0e5e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:30:02.500471 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.network.security_group_api [None req-4b51790c-0884-48fd-902d-5c412f5f40c9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Removing security group f11e7c2a-f276-479f-abdb-aa1e60a1af63 from port f1e3e151-e89e-4972-b253-8b889eef1d77 May 21 21:30:02.688055 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6c535f89-0639-4b1c-84ad-dc3d4c5c0e5e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.863122 May 21 21:30:02.694263 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2335/4542] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:30:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 1870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 21 21:30:02.700882 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-a5f76238-5a33-4cca-933e-a611c9ddf7ab req-30c848a3-fd69-4093-9350-a67c43dfc0bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b507bdf-67be-44d6-be35-c2b41d16f48f", "tag": "f1e3e151-e89e-4972-b253-8b889eef1d77"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:02.719470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a5f76238-5a33-4cca-933e-a611c9ddf7ab req-30c848a3-fd69-4093-9350-a67c43dfc0bc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:02.719937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a5f76238-5a33-4cca-933e-a611c9ddf7ab req-30c848a3-fd69-4093-9350-a67c43dfc0bc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:02.764578 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a5f76238-5a33-4cca-933e-a611c9ddf7ab req-30c848a3-fd69-4093-9350-a67c43dfc0bc service nova] Creating event network-changed:f1e3e151-e89e-4972-b253-8b889eef1d77 for instance 2b507bdf-67be-44d6-be35-c2b41d16f48f on nch2-master-1 May 21 21:30:02.773701 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-a5f76238-5a33-4cca-933e-a611c9ddf7ab req-30c848a3-fd69-4093-9350-a67c43dfc0bc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078035 May 21 21:30:02.774773 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2336/4543] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:30:02.785970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0daef5fa-be6f-4ed4-8817-341a4e5e0b8a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '.version_select at 0x7fc81a3e81f0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:02.944111 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0daef5fa-be6f-4ed4-8817-341a4e5e0b8a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1555623721" status: 204 len: 0 microversion: 2.54 time: 0.162618 May 21 21:30:02.944111 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2337/4544] 10.222.0.49 () {60 vars in 1318 bytes} [Sat May 21 21:30:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1555623721 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:30:02.954974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0325c0e7-4884-4970-9480-bd7d5ade6203 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:02.956974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0325c0e7-4884-4970-9480-bd7d5ade6203 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:03.061785 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0325c0e7-4884-4970-9480-bd7d5ade6203 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:03.090659 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0325c0e7-4884-4970-9480-bd7d5ade6203 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1221 microversion: 2.1 time: 0.135621 May 21 21:30:03.091337 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2338/4545] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:02 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1221 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:03.112941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fb1ac244-4a4f-4cbb-a24d-c8fc0e0bfb30 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:03.113450 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fb1ac244-4a4f-4cbb-a24d-c8fc0e0bfb30 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:03.152009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb1ac244-4a4f-4cbb-a24d-c8fc0e0bfb30 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:03.154991 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb1ac244-4a4f-4cbb-a24d-c8fc0e0bfb30 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:03.156887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb1ac244-4a4f-4cbb-a24d-c8fc0e0bfb30 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:03.157360 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb1ac244-4a4f-4cbb-a24d-c8fc0e0bfb30 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:03.218682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fb1ac244-4a4f-4cbb-a24d-c8fc0e0bfb30 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:30:03.788715 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fb1ac244-4a4f-4cbb-a24d-c8fc0e0bfb30 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 204 len: 0 microversion: 2.54 time: 0.690993 May 21 21:30:03.790054 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2339/4546] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:30:03 2022] DELETE /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:30:03.796128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4ea92d6f-5ef7-48c2-b9da-33d461da25d4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:03.798281 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4ea92d6f-5ef7-48c2-b9da-33d461da25d4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:03.806197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ea92d6f-5ef7-48c2-b9da-33d461da25d4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:03.806940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ea92d6f-5ef7-48c2-b9da-33d461da25d4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:03.808322 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ea92d6f-5ef7-48c2-b9da-33d461da25d4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:03.809149 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ea92d6f-5ef7-48c2-b9da-33d461da25d4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:03.855229 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4b51790c-0884-48fd-902d-5c412f5f40c9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "POST /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f/action" status: 202 len: 0 microversion: 2.1 time: 1.534484 May 21 21:30:03.860580 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2208/4547] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:30:02 2022] POST /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f/action => generated 0 bytes in 1536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:30:03.865163 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-446dd246-bd7d-4cdb-b372-0ade2499a4c0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1116647080", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:03.946887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-446dd246-bd7d-4cdb-b372-0ade2499a4c0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] validate_networks() for [('803f67e8-d424-4079-9484-4c9fb1a3b195', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:30:03.979873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4ea92d6f-5ef7-48c2-b9da-33d461da25d4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:04.000498 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4ea92d6f-5ef7-48c2-b9da-33d461da25d4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 200 len: 1267 microversion: 2.1 time: 0.205314 May 21 21:30:04.000498 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2340/4548] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:03 2022] GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:04.025224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-57e650a0-faf0-4daf-ba1c-e35d2beb649c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:04.026292 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-57e650a0-faf0-4daf-ba1c-e35d2beb649c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:04.054738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57e650a0-faf0-4daf-ba1c-e35d2beb649c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:04.055355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57e650a0-faf0-4daf-ba1c-e35d2beb649c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:04.056425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57e650a0-faf0-4daf-ba1c-e35d2beb649c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:04.056985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57e650a0-faf0-4daf-ba1c-e35d2beb649c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:04.194983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-57e650a0-faf0-4daf-ba1c-e35d2beb649c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:04.211494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-57e650a0-faf0-4daf-ba1c-e35d2beb649c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:04.214643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-57e650a0-faf0-4daf-ba1c-e35d2beb649c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:04.219151 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-57e650a0-faf0-4daf-ba1c-e35d2beb649c tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1366 microversion: 2.57 time: 0.205270 May 21 21:30:04.233658 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2341/4549] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:30:03 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:30:04.243232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a7382db2-d9d7-45a4-a661-008786f5716a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:04.246477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a7382db2-d9d7-45a4-a661-008786f5716a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:04.260126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7382db2-d9d7-45a4-a661-008786f5716a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:04.260599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7382db2-d9d7-45a4-a661-008786f5716a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:04.267201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7382db2-d9d7-45a4-a661-008786f5716a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:04.268737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7382db2-d9d7-45a4-a661-008786f5716a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:04.794950 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a7382db2-d9d7-45a4-a661-008786f5716a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:04.810818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a7382db2-d9d7-45a4-a661-008786f5716a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:04.812558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a7382db2-d9d7-45a4-a661-008786f5716a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:04.815031 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a7382db2-d9d7-45a4-a661-008786f5716a tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1405 microversion: 2.54 time: 0.581529 May 21 21:30:04.815997 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2342/4550] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:30:04 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1405 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:30:04.821529 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-703a61c2-0255-4064-92fe-eb2d01db34de tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Action: 'create', calling method: .version_select at 0x7fc81a4cfe50>, body: {"pool": null} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:05.326263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-446dd246-bd7d-4cdb-b372-0ade2499a4c0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:30:05.326763 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-446dd246-bd7d-4cdb-b372-0ade2499a4c0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:30:05.327612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-446dd246-bd7d-4cdb-b372-0ade2499a4c0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:30:05.328196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-446dd246-bd7d-4cdb-b372-0ade2499a4c0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:30:05.328836 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-446dd246-bd7d-4cdb-b372-0ade2499a4c0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:30:05.350351 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-446dd246-bd7d-4cdb-b372-0ade2499a4c0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:05.350821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-446dd246-bd7d-4cdb-b372-0ade2499a4c0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:05.352159 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-446dd246-bd7d-4cdb-b372-0ade2499a4c0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:05.352652 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-446dd246-bd7d-4cdb-b372-0ade2499a4c0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:05.383633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-446dd246-bd7d-4cdb-b372-0ade2499a4c0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Getting quotas for project 2e6d59483dc54fe4a558186055068419. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:30:05.391116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-446dd246-bd7d-4cdb-b372-0ade2499a4c0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Getting quotas for user 9a0ccfb5c9a04ec0831a0bfe987bb659 and project 2e6d59483dc54fe4a558186055068419. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:30:05.406091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-446dd246-bd7d-4cdb-b372-0ade2499a4c0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:30:05.409054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-446dd246-bd7d-4cdb-b372-0ade2499a4c0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:30:05.590817 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-446dd246-bd7d-4cdb-b372-0ade2499a4c0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.733321 May 21 21:30:05.599447 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2209/4551] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:30:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 1743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:30:05.605921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9f5e9ae3-ecdd-4bcf-99c8-fd2c77c5ea5e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:05.606740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9f5e9ae3-ecdd-4bcf-99c8-fd2c77c5ea5e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:05.621185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f5e9ae3-ecdd-4bcf-99c8-fd2c77c5ea5e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:05.621809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f5e9ae3-ecdd-4bcf-99c8-fd2c77c5ea5e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:05.622746 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f5e9ae3-ecdd-4bcf-99c8-fd2c77c5ea5e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:05.623341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f5e9ae3-ecdd-4bcf-99c8-fd2c77c5ea5e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:06.105318 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9f5e9ae3-ecdd-4bcf-99c8-fd2c77c5ea5e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:06.118924 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9f5e9ae3-ecdd-4bcf-99c8-fd2c77c5ea5e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 200 len: 1309 microversion: 2.1 time: 0.517905 May 21 21:30:06.119919 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2210/4552] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:05 2022] GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 1309 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:06.126593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-c07412d7-edc3-4390-adae-db95fb336479 req-576d85a4-eb3c-443a-92d4-5a4a02f01e04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b507bdf-67be-44d6-be35-c2b41d16f48f", "tag": "f1e3e151-e89e-4972-b253-8b889eef1d77"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:06.136171 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c07412d7-edc3-4390-adae-db95fb336479 req-576d85a4-eb3c-443a-92d4-5a4a02f01e04 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:06.149567 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c07412d7-edc3-4390-adae-db95fb336479 req-576d85a4-eb3c-443a-92d4-5a4a02f01e04 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:06.152173 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-c07412d7-edc3-4390-adae-db95fb336479 req-576d85a4-eb3c-443a-92d4-5a4a02f01e04 service nova] Creating event network-changed:f1e3e151-e89e-4972-b253-8b889eef1d77 for instance 2b507bdf-67be-44d6-be35-c2b41d16f48f on nch2-master-1 May 21 21:30:06.158031 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-c07412d7-edc3-4390-adae-db95fb336479 req-576d85a4-eb3c-443a-92d4-5a4a02f01e04 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036307 May 21 21:30:06.159156 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2211/4553] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:30:06.165722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e88b4af4-e2a6-4f5b-83b4-1cd22840b94d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:06.166636 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e88b4af4-e2a6-4f5b-83b4-1cd22840b94d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:06.174900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e88b4af4-e2a6-4f5b-83b4-1cd22840b94d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:06.175668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e88b4af4-e2a6-4f5b-83b4-1cd22840b94d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:06.176750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e88b4af4-e2a6-4f5b-83b4-1cd22840b94d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:06.177393 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e88b4af4-e2a6-4f5b-83b4-1cd22840b94d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:06.366730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e88b4af4-e2a6-4f5b-83b4-1cd22840b94d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:06.385562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e88b4af4-e2a6-4f5b-83b4-1cd22840b94d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:06.390343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e88b4af4-e2a6-4f5b-83b4-1cd22840b94d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:06.396266 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e88b4af4-e2a6-4f5b-83b4-1cd22840b94d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1366 microversion: 2.57 time: 0.231862 May 21 21:30:06.397167 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2212/4554] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:30:06 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:30:06.401976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d7d72ebd-6016-4af6-b8b8-8ac16dad43c4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:06.409314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d7d72ebd-6016-4af6-b8b8-8ac16dad43c4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:06.614489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d7d72ebd-6016-4af6-b8b8-8ac16dad43c4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:06.629966 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d7d72ebd-6016-4af6-b8b8-8ac16dad43c4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1222 microversion: 2.1 time: 0.231850 May 21 21:30:06.633532 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2213/4555] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:06 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1222 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:06.644111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5553cb63-b3dd-4c53-9147-939e32a2376c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:06.646702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5553cb63-b3dd-4c53-9147-939e32a2376c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:06.672406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5553cb63-b3dd-4c53-9147-939e32a2376c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:06.672879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5553cb63-b3dd-4c53-9147-939e32a2376c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:06.686676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5553cb63-b3dd-4c53-9147-939e32a2376c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:06.686676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5553cb63-b3dd-4c53-9147-939e32a2376c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:06.735592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5553cb63-b3dd-4c53-9147-939e32a2376c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:06.736868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5553cb63-b3dd-4c53-9147-939e32a2376c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:06.738271 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-5553cb63-b3dd-4c53-9147-939e32a2376c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lazy-loading 'fault' on Instance uuid e1107a02-4533-4692-8ad8-e42e1f2f12a7 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:30:06.950057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5553cb63-b3dd-4c53-9147-939e32a2376c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:06.964100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5553cb63-b3dd-4c53-9147-939e32a2376c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:06.966354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5553cb63-b3dd-4c53-9147-939e32a2376c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3197c70ce304c79a952555606b9b4d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbdb88e011245faab8a76a2d05f445c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:06.967790 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5553cb63-b3dd-4c53-9147-939e32a2376c tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 200 len: 1410 microversion: 2.54 time: 0.332777 May 21 21:30:06.981812 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2214/4556] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:30:06 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 1410 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:30:07.151965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5f4729ab-d8ff-417a-b1ee-67da258745d0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:07.154423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5f4729ab-d8ff-417a-b1ee-67da258745d0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:07.174627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5f4729ab-d8ff-417a-b1ee-67da258745d0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:07.177779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5f4729ab-d8ff-417a-b1ee-67da258745d0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:07.180051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5f4729ab-d8ff-417a-b1ee-67da258745d0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:07.181841 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5f4729ab-d8ff-417a-b1ee-67da258745d0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:07.666295 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5f4729ab-d8ff-417a-b1ee-67da258745d0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:07.675728 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5f4729ab-d8ff-417a-b1ee-67da258745d0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 200 len: 1309 microversion: 2.1 time: 0.541870 May 21 21:30:07.678974 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2215/4557] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:07 2022] GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 1309 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:30:07.693252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-33a28c55-e3e3-47a9-9593-28939da3f6d5 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:07.696141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-33a28c55-e3e3-47a9-9593-28939da3f6d5 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:07.710052 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33a28c55-e3e3-47a9-9593-28939da3f6d5 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:07.710682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33a28c55-e3e3-47a9-9593-28939da3f6d5 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:07.711592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33a28c55-e3e3-47a9-9593-28939da3f6d5 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:07.712165 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33a28c55-e3e3-47a9-9593-28939da3f6d5 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:07.886052 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-33a28c55-e3e3-47a9-9593-28939da3f6d5 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:07.910949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-33a28c55-e3e3-47a9-9593-28939da3f6d5 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:07.910949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-33a28c55-e3e3-47a9-9593-28939da3f6d5 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:07.910949 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-33a28c55-e3e3-47a9-9593-28939da3f6d5 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1366 microversion: 2.57 time: 0.222342 May 21 21:30:07.910949 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2216/4558] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:30:07 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:30:07.910949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a3abc0ec-2f45-4015-ba12-b3ea98c22e06 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:07.912070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a3abc0ec-2f45-4015-ba12-b3ea98c22e06 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:07.922842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3abc0ec-2f45-4015-ba12-b3ea98c22e06 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:07.928335 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3abc0ec-2f45-4015-ba12-b3ea98c22e06 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:07.929275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3abc0ec-2f45-4015-ba12-b3ea98c22e06 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:07.929727 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3abc0ec-2f45-4015-ba12-b3ea98c22e06 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:08.070369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a3abc0ec-2f45-4015-ba12-b3ea98c22e06 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:08.081274 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a3abc0ec-2f45-4015-ba12-b3ea98c22e06 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1218 microversion: 2.1 time: 0.176657 May 21 21:30:08.090547 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2217/4559] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:07 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1218 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:08.095425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bacacf38-1502-4573-bc8c-7f2e05c828f2 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:08.102162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bacacf38-1502-4573-bc8c-7f2e05c828f2 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] [instance: e1107a02-4533-4692-8ad8-e42e1f2f12a7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:08.115906 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bacacf38-1502-4573-bc8c-7f2e05c828f2 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:08.116426 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bacacf38-1502-4573-bc8c-7f2e05c828f2 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:08.117351 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bacacf38-1502-4573-bc8c-7f2e05c828f2 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:08.117830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bacacf38-1502-4573-bc8c-7f2e05c828f2 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:08.134054 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-bacacf38-1502-4573-bc8c-7f2e05c828f2 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] HTTP exception thrown: Instance e1107a02-4533-4692-8ad8-e42e1f2f12a7 could not be found. May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bacacf38-1502-4573-bc8c-7f2e05c828f2 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Request method failure captured: May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 HTTP/1.1 May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVmxI-ffiETSYPwfoo5AsbLcQ-WJZVkr7Pnjapvn3jgareAvStCFNauSVTVe9bOcFpIXhLetsCjRRYPLzAzO0qMNB0WqDZ59HSwz099UWu9DewZk2YuZqUd4HFtJiePOJXXcsQjKO2qhUFg5qAY5IUkJXnANpNSEvjA9b23NDGqDLDM May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: X-Openstack-Nova-Api-Version: 2.54 May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 9dbdb88e011245faab8a76a2d05f445c May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerShowV254Test-722451994 May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9dbdb88e011245faab8a76a2d05f445c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9dbdb88e011245faab8a76a2d05f445c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9dbdb88e011245faab8a76a2d05f445c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9dbdb88e011245faab8a76a2d05f445c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerShowV254Test-722451994 May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 9dbdb88e011245faab8a76a2d05f445c May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerShowV254Test-722451994 May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerShowV254Test-722451994-project May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: d3197c70ce304c79a952555606b9b4d2 May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerShowV254Test-722451994-project May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance e1107a02-4533-4692-8ad8-e42e1f2f12a7 could not be found. May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'e1107a02-4533-4692-8ad8-e42e1f2f12a7'} May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1107a02-4533-4692-8ad8-e42e1f2f12a7 could not be found. May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1107a02-4533-4692-8ad8-e42e1f2f12a7 could not be found. May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:08.141052 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:08.145828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:08.145828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:08.145828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:08.145828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:30:08.145828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:30:08.145828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1107a02-4533-4692-8ad8-e42e1f2f12a7 could not be found. May 21 21:30:08.145828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:08.147231 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bacacf38-1502-4573-bc8c-7f2e05c828f2 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] Returning 404 to user: Instance e1107a02-4533-4692-8ad8-e42e1f2f12a7 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:30:08.148261 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bacacf38-1502-4573-bc8c-7f2e05c828f2 tempest-ServerShowV254Test-722451994 tempest-ServerShowV254Test-722451994-project] 10.222.0.49 "GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7" status: 404 len: 111 microversion: 2.54 time: 0.056794 May 21 21:30:08.149297 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2218/4560] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:30:08 2022] GET /compute/v2.1/servers/e1107a02-4533-4692-8ad8-e42e1f2f12a7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:30:08.493793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-4863fead-61df-499e-b336-b18f6e41ac6f req-2fea4e00-742f-45bc-9a77-b7b528a175f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f74db7ff-ff9c-47f1-9910-a12d77e7c7c0", "tag": "c8aecd10-c652-4c56-be6e-283bb3555048"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:08.498510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:08.510667 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4863fead-61df-499e-b336-b18f6e41ac6f req-2fea4e00-742f-45bc-9a77-b7b528a175f5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:08.514190 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4863fead-61df-499e-b336-b18f6e41ac6f req-2fea4e00-742f-45bc-9a77-b7b528a175f5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:08.532027 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-4863fead-61df-499e-b336-b18f6e41ac6f req-2fea4e00-742f-45bc-9a77-b7b528a175f5 service nova] Creating event network-changed:c8aecd10-c652-4c56-be6e-283bb3555048 for instance f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 on nch2-master-1 May 21 21:30:08.548164 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-4863fead-61df-499e-b336-b18f6e41ac6f req-2fea4e00-742f-45bc-9a77-b7b528a175f5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058175 May 21 21:30:08.552618 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2219/4561] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:30:08.699951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8f774faf-682f-41db-93ee-ffbf7e8b1c73 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:08.701523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8f774faf-682f-41db-93ee-ffbf7e8b1c73 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:08.712777 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f774faf-682f-41db-93ee-ffbf7e8b1c73 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:08.714141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f774faf-682f-41db-93ee-ffbf7e8b1c73 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:08.715719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f774faf-682f-41db-93ee-ffbf7e8b1c73 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:08.716462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f774faf-682f-41db-93ee-ffbf7e8b1c73 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:08.990375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8f774faf-682f-41db-93ee-ffbf7e8b1c73 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:08.999169 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8f774faf-682f-41db-93ee-ffbf7e8b1c73 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 200 len: 1309 microversion: 2.1 time: 0.303837 May 21 21:30:09.001521 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2220/4562] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:08 2022] GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 1309 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:09.007993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6d814022-d61a-45fe-933c-0fba84111408 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:09.008696 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6d814022-d61a-45fe-933c-0fba84111408 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:09.043657 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d814022-d61a-45fe-933c-0fba84111408 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:09.046645 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d814022-d61a-45fe-933c-0fba84111408 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:09.047728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d814022-d61a-45fe-933c-0fba84111408 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:09.049115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d814022-d61a-45fe-933c-0fba84111408 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:09.196087 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6d814022-d61a-45fe-933c-0fba84111408 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:09.206948 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6d814022-d61a-45fe-933c-0fba84111408 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:09.208543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6d814022-d61a-45fe-933c-0fba84111408 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:09.209768 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6d814022-d61a-45fe-933c-0fba84111408 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1366 microversion: 2.57 time: 0.209081 May 21 21:30:09.210407 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2221/4563] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:30:08 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:30:09.227334 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d3020b00-24f7-4c3e-99fb-762e9399b8e9 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:09.228698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d3020b00-24f7-4c3e-99fb-762e9399b8e9 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:09.244695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3020b00-24f7-4c3e-99fb-762e9399b8e9 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:09.245374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3020b00-24f7-4c3e-99fb-762e9399b8e9 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:09.246191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3020b00-24f7-4c3e-99fb-762e9399b8e9 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:09.246869 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3020b00-24f7-4c3e-99fb-762e9399b8e9 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:09.368658 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d3020b00-24f7-4c3e-99fb-762e9399b8e9 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:09.382975 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d3020b00-24f7-4c3e-99fb-762e9399b8e9 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1280 microversion: 2.1 time: 0.160335 May 21 21:30:09.385064 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2222/4564] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:09 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1280 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:10.017532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a23f2a76-6df7-4e50-b6b0-cf002edfab0c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:10.019062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a23f2a76-6df7-4e50-b6b0-cf002edfab0c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:10.027469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a23f2a76-6df7-4e50-b6b0-cf002edfab0c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:10.028171 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a23f2a76-6df7-4e50-b6b0-cf002edfab0c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:10.029157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a23f2a76-6df7-4e50-b6b0-cf002edfab0c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:10.029762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a23f2a76-6df7-4e50-b6b0-cf002edfab0c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:10.169149 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-703a61c2-0255-4064-92fe-eb2d01db34de tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.351831 May 21 21:30:10.170358 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2343/4565] 10.222.0.49 () {60 vars in 1169 bytes} [Sat May 21 21:30:04 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:30:10.183824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-29ec6372-e40b-4576-8d12-4bd954c9538a tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.95"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:10.185219 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-29ec6372-e40b-4576-8d12-4bd954c9538a tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:10.192257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29ec6372-e40b-4576-8d12-4bd954c9538a tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:10.192739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29ec6372-e40b-4576-8d12-4bd954c9538a tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:10.194004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29ec6372-e40b-4576-8d12-4bd954c9538a tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:10.194456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29ec6372-e40b-4576-8d12-4bd954c9538a tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:10.199925 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:10.223606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29ec6372-e40b-4576-8d12-4bd954c9538a tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Acquired lock "refresh_cache-2b507bdf-67be-44d6-be35-c2b41d16f48f" {{(pid=131277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 21 21:30:10.412129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a23f2a76-6df7-4e50-b6b0-cf002edfab0c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:10.430835 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a23f2a76-6df7-4e50-b6b0-cf002edfab0c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 200 len: 1309 microversion: 2.1 time: 0.417216 May 21 21:30:10.431442 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2223/4566] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:10 2022] GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 1309 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:10.436606 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5c48264f-efcf-4d89-b260-b4f123ba73c0 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:10.437438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5c48264f-efcf-4d89-b260-b4f123ba73c0 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:10.444232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c48264f-efcf-4d89-b260-b4f123ba73c0 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:10.444916 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c48264f-efcf-4d89-b260-b4f123ba73c0 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:10.445999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c48264f-efcf-4d89-b260-b4f123ba73c0 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:10.446566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c48264f-efcf-4d89-b260-b4f123ba73c0 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:10.537687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5c48264f-efcf-4d89-b260-b4f123ba73c0 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:10.548630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5c48264f-efcf-4d89-b260-b4f123ba73c0 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:10.550748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5c48264f-efcf-4d89-b260-b4f123ba73c0 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:10.552191 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5c48264f-efcf-4d89-b260-b4f123ba73c0 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1366 microversion: 2.57 time: 0.119212 May 21 21:30:10.552877 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2224/4567] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:30:10 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1366 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:30:10.557742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-61d51c2c-1045-42ea-aecd-038019c87f9a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:10.558360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-61d51c2c-1045-42ea-aecd-038019c87f9a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:10.565648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61d51c2c-1045-42ea-aecd-038019c87f9a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:10.566520 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61d51c2c-1045-42ea-aecd-038019c87f9a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:10.567183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61d51c2c-1045-42ea-aecd-038019c87f9a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:10.567701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61d51c2c-1045-42ea-aecd-038019c87f9a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:10.724578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-61d51c2c-1045-42ea-aecd-038019c87f9a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:10.732822 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-61d51c2c-1045-42ea-aecd-038019c87f9a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1280 microversion: 2.1 time: 0.178769 May 21 21:30:10.734161 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2225/4568] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:10 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1280 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:11.448038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7bbfa697-1d39-4886-a98d-693ce2f8094e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:11.449552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7bbfa697-1d39-4886-a98d-693ce2f8094e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:11.461997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7bbfa697-1d39-4886-a98d-693ce2f8094e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:11.462462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7bbfa697-1d39-4886-a98d-693ce2f8094e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:11.466212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7bbfa697-1d39-4886-a98d-693ce2f8094e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:11.466212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7bbfa697-1d39-4886-a98d-693ce2f8094e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:11.880905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7bbfa697-1d39-4886-a98d-693ce2f8094e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:11.899556 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7bbfa697-1d39-4886-a98d-693ce2f8094e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 200 len: 1309 microversion: 2.1 time: 0.455418 May 21 21:30:11.910849 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2226/4569] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:11 2022] GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 1309 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:11.916272 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-90d3c691-5b20-40b5-a56f-cc45a670aba1 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:11.917079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-90d3c691-5b20-40b5-a56f-cc45a670aba1 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:11.925632 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-90d3c691-5b20-40b5-a56f-cc45a670aba1 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:11.926350 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-90d3c691-5b20-40b5-a56f-cc45a670aba1 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:11.927302 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-90d3c691-5b20-40b5-a56f-cc45a670aba1 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:11.928161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-90d3c691-5b20-40b5-a56f-cc45a670aba1 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:12.105223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-90d3c691-5b20-40b5-a56f-cc45a670aba1 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:12.129735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-90d3c691-5b20-40b5-a56f-cc45a670aba1 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:12.131903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-90d3c691-5b20-40b5-a56f-cc45a670aba1 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:12.135038 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-90d3c691-5b20-40b5-a56f-cc45a670aba1 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1366 microversion: 2.57 time: 0.221571 May 21 21:30:12.137540 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2227/4570] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:30:11 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:30:12.155394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-87546b72-5fa8-4aeb-8e30-ca63009940e6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:12.156636 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-87546b72-5fa8-4aeb-8e30-ca63009940e6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:12.172986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87546b72-5fa8-4aeb-8e30-ca63009940e6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:12.173992 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87546b72-5fa8-4aeb-8e30-ca63009940e6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:12.174789 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87546b72-5fa8-4aeb-8e30-ca63009940e6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:12.175228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87546b72-5fa8-4aeb-8e30-ca63009940e6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:12.416984 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:12.640162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-87546b72-5fa8-4aeb-8e30-ca63009940e6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:12.644751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:12.651071 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-87546b72-5fa8-4aeb-8e30-ca63009940e6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1322 microversion: 2.1 time: 0.512108 May 21 21:30:12.662380 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2228/4571] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:12 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1322 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:13.069901 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=8 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:13.107356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] Action: 'create', calling method: .version_select at 0x7fc819e91dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-336976503", "metadata": {"Type": "work"}}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:13.836190 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-29ec6372-e40b-4576-8d12-4bd954c9538a tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Building network info cache for instance {{(pid=131277) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 21 21:30:14.589670 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.924226 May 21 21:30:14.591263 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2229/4572] 10.222.0.49 () {60 vars in 1155 bytes} [Sat May 21 21:30:12 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1926 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 21 21:30:14.597313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eecbab16-0974-4830-b622-c36b572de8b9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:14.598191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-eecbab16-0974-4830-b622-c36b572de8b9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:14.615679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eecbab16-0974-4830-b622-c36b572de8b9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:14.616666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eecbab16-0974-4830-b622-c36b572de8b9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:14.617676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eecbab16-0974-4830-b622-c36b572de8b9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:14.619191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eecbab16-0974-4830-b622-c36b572de8b9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:15.371484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:15.558158 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-eecbab16-0974-4830-b622-c36b572de8b9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:15.580382 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-eecbab16-0974-4830-b622-c36b572de8b9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 200 len: 1309 microversion: 2.1 time: 0.987791 May 21 21:30:15.580509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-29ec6372-e40b-4576-8d12-4bd954c9538a tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Updating instance_info_cache with network_info: [{"id": "f1e3e151-e89e-4972-b253-8b889eef1d77", "address": "fa:16:3e:3d:3e:02", "network": {"id": "2322dac3-cc4b-44d6-acd1-757c77fbeee8", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-329440060-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a426b85d93724b898ba8ce8c68dcead6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf1e3e151-e8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131277) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 21 21:30:15.593881 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2230/4573] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:14 2022] GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 1309 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:15.601733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f57b5646-eb28-41bb-8910-1d9e3fef61fd tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:15.602600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f57b5646-eb28-41bb-8910-1d9e3fef61fd tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:15.610639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f57b5646-eb28-41bb-8910-1d9e3fef61fd tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:15.611572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f57b5646-eb28-41bb-8910-1d9e3fef61fd tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:15.612589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f57b5646-eb28-41bb-8910-1d9e3fef61fd tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:15.616457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f57b5646-eb28-41bb-8910-1d9e3fef61fd tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:15.690804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29ec6372-e40b-4576-8d12-4bd954c9538a tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Releasing lock "refresh_cache-2b507bdf-67be-44d6-be35-c2b41d16f48f" {{(pid=131277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 21 21:30:15.693032 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-29ec6372-e40b-4576-8d12-4bd954c9538a tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "POST /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f/action" status: 202 len: 0 microversion: 2.1 time: 5.514629 May 21 21:30:15.697854 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2344/4574] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:30:10 2022] POST /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f/action => generated 0 bytes in 5520 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 21 21:30:15.704117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-570d5594-ee9f-49d8-bf5e-154b5cf50fa1 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:15.705818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-570d5594-ee9f-49d8-bf5e-154b5cf50fa1 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:15.713891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-570d5594-ee9f-49d8-bf5e-154b5cf50fa1 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:15.714452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-570d5594-ee9f-49d8-bf5e-154b5cf50fa1 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:15.715584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-570d5594-ee9f-49d8-bf5e-154b5cf50fa1 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:15.715857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f57b5646-eb28-41bb-8910-1d9e3fef61fd tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:15.716718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-570d5594-ee9f-49d8-bf5e-154b5cf50fa1 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:15.725184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f57b5646-eb28-41bb-8910-1d9e3fef61fd tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:15.727339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f57b5646-eb28-41bb-8910-1d9e3fef61fd tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:15.732192 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f57b5646-eb28-41bb-8910-1d9e3fef61fd tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1366 microversion: 2.57 time: 0.133955 May 21 21:30:15.732192 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2231/4575] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:30:15 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:30:15.735228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-e159021b-a44b-4dd7-9c1b-5d4aed1d8c9a req-54889787-e2fd-41a1-a23d-31d759634783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "506776f0-470a-4a6b-ac34-3414463a8770", "tag": "dde6dfe2-b739-4346-bc75-f66a5634741a"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:15.745124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e159021b-a44b-4dd7-9c1b-5d4aed1d8c9a req-54889787-e2fd-41a1-a23d-31d759634783 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:15.745785 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e159021b-a44b-4dd7-9c1b-5d4aed1d8c9a req-54889787-e2fd-41a1-a23d-31d759634783 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:15.759174 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-e159021b-a44b-4dd7-9c1b-5d4aed1d8c9a req-54889787-e2fd-41a1-a23d-31d759634783 service nova] Creating event network-changed:dde6dfe2-b739-4346-bc75-f66a5634741a for instance 506776f0-470a-4a6b-ac34-3414463a8770 on nch1-master-1 May 21 21:30:15.765694 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-e159021b-a44b-4dd7-9c1b-5d4aed1d8c9a req-54889787-e2fd-41a1-a23d-31d759634783 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034281 May 21 21:30:15.766502 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2232/4576] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:30:15.773401 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-953b641a-292c-43ea-8026-fb9c83941b12 req-b08c8344-0640-4277-a992-9903f2e00fed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3224316b-c287-4ec4-9b89-aeb8d9bf7adc", "tag": "94ca0b0b-018e-4c6a-8dd7-db57f04e9a46"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:15.787011 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-953b641a-292c-43ea-8026-fb9c83941b12 req-b08c8344-0640-4277-a992-9903f2e00fed service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:15.787124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-953b641a-292c-43ea-8026-fb9c83941b12 req-b08c8344-0640-4277-a992-9903f2e00fed service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:15.801991 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-953b641a-292c-43ea-8026-fb9c83941b12 req-b08c8344-0640-4277-a992-9903f2e00fed service nova] Creating event network-changed:94ca0b0b-018e-4c6a-8dd7-db57f04e9a46 for instance 3224316b-c287-4ec4-9b89-aeb8d9bf7adc on nch1-master-1 May 21 21:30:15.809514 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-953b641a-292c-43ea-8026-fb9c83941b12 req-b08c8344-0640-4277-a992-9903f2e00fed service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040594 May 21 21:30:15.810313 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2233/4577] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:30:15.818924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c317d97b-9e2d-4d7d-8767-80b7d9eef49b tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] Calling method '.version_select at 0x7fc81a0035e0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:15.900005 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c317d97b-9e2d-4d7d-8767-80b7d9eef49b tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/809a63e9-9319-4026-8c3e-f3e0dd7d67d7" status: 200 len: 345 microversion: 2.1 time: 0.088331 May 21 21:30:15.900917 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2234/4578] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:30:15 2022] GET /compute/v2.1/os-volumes/809a63e9-9319-4026-8c3e-f3e0dd7d67d7 => generated 345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:30:15.910120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-e1086b49-d5c5-4891-8c87-2dbbb65af4be req-e5ee358d-d01c-420a-957b-097805e6856a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f74db7ff-ff9c-47f1-9910-a12d77e7c7c0", "name": "network-vif-plugged", "status": "completed", "tag": "c8aecd10-c652-4c56-be6e-283bb3555048"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:15.928365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e1086b49-d5c5-4891-8c87-2dbbb65af4be req-e5ee358d-d01c-420a-957b-097805e6856a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:15.928805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e1086b49-d5c5-4891-8c87-2dbbb65af4be req-e5ee358d-d01c-420a-957b-097805e6856a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:15.951139 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-e1086b49-d5c5-4891-8c87-2dbbb65af4be req-e5ee358d-d01c-420a-957b-097805e6856a service nova] Creating event network-vif-plugged:c8aecd10-c652-4c56-be6e-283bb3555048 for instance f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 on nch2-master-1 May 21 21:30:15.961952 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-e1086b49-d5c5-4891-8c87-2dbbb65af4be req-e5ee358d-d01c-420a-957b-097805e6856a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054983 May 21 21:30:15.961952 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2235/4579] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:30:15.971937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-572f3f5d-f3b3-4a13-9eb4-352288fd81b9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.0.95"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:16.065680 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-570d5594-ee9f-49d8-bf5e-154b5cf50fa1 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:16.078146 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-570d5594-ee9f-49d8-bf5e-154b5cf50fa1 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1322 microversion: 2.1 time: 0.378607 May 21 21:30:16.089124 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2345/4580] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:15 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:16.430090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-572f3f5d-f3b3-4a13-9eb4-352288fd81b9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:16.440380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-572f3f5d-f3b3-4a13-9eb4-352288fd81b9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:16.441387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-572f3f5d-f3b3-4a13-9eb4-352288fd81b9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:16.442405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-572f3f5d-f3b3-4a13-9eb4-352288fd81b9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:16.445753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-572f3f5d-f3b3-4a13-9eb4-352288fd81b9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:16.604980 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c277acf5-a01b-4275-8772-540f3f3b1241 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:16.606144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c277acf5-a01b-4275-8772-540f3f3b1241 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:16.617550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c277acf5-a01b-4275-8772-540f3f3b1241 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:16.618163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c277acf5-a01b-4275-8772-540f3f3b1241 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:16.619118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c277acf5-a01b-4275-8772-540f3f3b1241 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:16.619960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c277acf5-a01b-4275-8772-540f3f3b1241 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:16.621590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=16 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:16.918808 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-572f3f5d-f3b3-4a13-9eb4-352288fd81b9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Acquired lock "refresh_cache-2b507bdf-67be-44d6-be35-c2b41d16f48f" {{(pid=131278) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 21 21:30:17.249476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c277acf5-a01b-4275-8772-540f3f3b1241 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:17.249476 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c277acf5-a01b-4275-8772-540f3f3b1241 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 200 len: 1309 microversion: 2.1 time: 0.526776 May 21 21:30:17.249476 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2346/4581] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:16 2022] GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 1309 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:17.249476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f8f17d0f-c49a-4f4d-806b-58470295f29d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:17.249476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f8f17d0f-c49a-4f4d-806b-58470295f29d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:17.249476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f8f17d0f-c49a-4f4d-806b-58470295f29d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:17.249476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f8f17d0f-c49a-4f4d-806b-58470295f29d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:17.249476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f8f17d0f-c49a-4f4d-806b-58470295f29d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:17.249476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f8f17d0f-c49a-4f4d-806b-58470295f29d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:17.249476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f8f17d0f-c49a-4f4d-806b-58470295f29d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:17.252796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f8f17d0f-c49a-4f4d-806b-58470295f29d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:17.254868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f8f17d0f-c49a-4f4d-806b-58470295f29d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:17.256317 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f8f17d0f-c49a-4f4d-806b-58470295f29d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1366 microversion: 2.57 time: 0.132907 May 21 21:30:17.264764 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2347/4582] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:30:17 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:30:17.274140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c2c74381-4483-4a99-a231-0ac398d9c1ee tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] Calling method '.version_select at 0x7fc81a3eb670>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:17.334217 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c2c74381-4483-4a99-a231-0ac398d9c1ee tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/809a63e9-9319-4026-8c3e-f3e0dd7d67d7" status: 200 len: 346 microversion: 2.1 time: 0.062429 May 21 21:30:17.334217 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2348/4583] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:30:17 2022] GET /compute/v2.1/os-volumes/809a63e9-9319-4026-8c3e-f3e0dd7d67d7 => generated 346 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:30:17.342299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3dc1ce81-fb40-4bdc-9cdf-ec565e2c7baa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:17.343750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3dc1ce81-fb40-4bdc-9cdf-ec565e2c7baa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:17.356882 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3dc1ce81-fb40-4bdc-9cdf-ec565e2c7baa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:17.357953 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3dc1ce81-fb40-4bdc-9cdf-ec565e2c7baa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:17.358251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3dc1ce81-fb40-4bdc-9cdf-ec565e2c7baa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:17.358768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3dc1ce81-fb40-4bdc-9cdf-ec565e2c7baa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:17.528563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3dc1ce81-fb40-4bdc-9cdf-ec565e2c7baa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:17.543486 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3dc1ce81-fb40-4bdc-9cdf-ec565e2c7baa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1322 microversion: 2.1 time: 0.204256 May 21 21:30:17.550399 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2349/4584] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:17 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:17.561817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bc1defd0-4fca-4bc7-a623-135bff64c4de tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] Calling method '.version_select at 0x7fc81a3c9700>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:17.645557 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bc1defd0-4fca-4bc7-a623-135bff64c4de tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/809a63e9-9319-4026-8c3e-f3e0dd7d67d7" status: 200 len: 346 microversion: 2.1 time: 0.094418 May 21 21:30:17.646957 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2350/4585] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:30:17 2022] GET /compute/v2.1/os-volumes/809a63e9-9319-4026-8c3e-f3e0dd7d67d7 => generated 346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:30:17.665783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c4a07975-8e3b-471e-9fde-25a9e8c94886 tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] Calling method '.version_select at 0x7fc81a3eb8b0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:17.928073 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c4a07975-8e3b-471e-9fde-25a9e8c94886 tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/809a63e9-9319-4026-8c3e-f3e0dd7d67d7" status: 202 len: 0 microversion: 2.1 time: 0.268656 May 21 21:30:17.932066 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2351/4586] 10.222.0.49 () {58 vars in 1247 bytes} [Sat May 21 21:30:17 2022] DELETE /compute/v2.1/os-volumes/809a63e9-9319-4026-8c3e-f3e0dd7d67d7 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 21 21:30:17.936935 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-de869aff-e39c-4bdf-9016-127c50ef72c1 req-19752797-6af7-4c0d-8d4b-737b00fd281e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b507bdf-67be-44d6-be35-c2b41d16f48f", "tag": "f1e3e151-e89e-4972-b253-8b889eef1d77"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:17.958802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-de869aff-e39c-4bdf-9016-127c50ef72c1 req-19752797-6af7-4c0d-8d4b-737b00fd281e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:17.959253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-de869aff-e39c-4bdf-9016-127c50ef72c1 req-19752797-6af7-4c0d-8d4b-737b00fd281e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:17.971895 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-de869aff-e39c-4bdf-9016-127c50ef72c1 req-19752797-6af7-4c0d-8d4b-737b00fd281e service nova] Creating event network-changed:f1e3e151-e89e-4972-b253-8b889eef1d77 for instance 2b507bdf-67be-44d6-be35-c2b41d16f48f on nch2-master-1 May 21 21:30:17.977910 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-de869aff-e39c-4bdf-9016-127c50ef72c1 req-19752797-6af7-4c0d-8d4b-737b00fd281e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044587 May 21 21:30:17.979202 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2352/4587] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:30:17.987588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-40bfa371-3307-4238-bf3d-d9b29e5e0236 tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] Calling method '.version_select at 0x7fc81a3e3820>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:18.066892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-572f3f5d-f3b3-4a13-9eb4-352288fd81b9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Building network info cache for instance {{(pid=131278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 21 21:30:18.101132 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-40bfa371-3307-4238-bf3d-d9b29e5e0236 tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/809a63e9-9319-4026-8c3e-f3e0dd7d67d7" status: 200 len: 345 microversion: 2.1 time: 0.120558 May 21 21:30:18.106192 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2353/4588] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:30:17 2022] GET /compute/v2.1/os-volumes/809a63e9-9319-4026-8c3e-f3e0dd7d67d7 => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:30:18.113474 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-7770c49e-faa0-4ad1-aa0a-74fb7249553a req-88805e01-1f08-4e8d-b65f-f5e59976cc77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b507bdf-67be-44d6-be35-c2b41d16f48f", "tag": "f1e3e151-e89e-4972-b253-8b889eef1d77"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:18.124214 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7770c49e-faa0-4ad1-aa0a-74fb7249553a req-88805e01-1f08-4e8d-b65f-f5e59976cc77 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:18.125347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7770c49e-faa0-4ad1-aa0a-74fb7249553a req-88805e01-1f08-4e8d-b65f-f5e59976cc77 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:18.137505 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-7770c49e-faa0-4ad1-aa0a-74fb7249553a req-88805e01-1f08-4e8d-b65f-f5e59976cc77 service nova] Creating event network-changed:f1e3e151-e89e-4972-b253-8b889eef1d77 for instance 2b507bdf-67be-44d6-be35-c2b41d16f48f on nch2-master-1 May 21 21:30:18.144995 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-7770c49e-faa0-4ad1-aa0a-74fb7249553a req-88805e01-1f08-4e8d-b65f-f5e59976cc77 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037134 May 21 21:30:18.146180 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2354/4589] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:30:18.239941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-43f89f68-b46b-41fa-9989-557844d3ee72 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:18.241590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-43f89f68-b46b-41fa-9989-557844d3ee72 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:18.255557 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43f89f68-b46b-41fa-9989-557844d3ee72 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:18.257175 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43f89f68-b46b-41fa-9989-557844d3ee72 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:18.258218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43f89f68-b46b-41fa-9989-557844d3ee72 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:18.258962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43f89f68-b46b-41fa-9989-557844d3ee72 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:18.689615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-43f89f68-b46b-41fa-9989-557844d3ee72 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:18.698538 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-43f89f68-b46b-41fa-9989-557844d3ee72 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 200 len: 1490 microversion: 2.1 time: 0.464539 May 21 21:30:18.699810 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2355/4590] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:18 2022] GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 1490 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:18.705386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2922275a-be91-4a59-aed3-5d8dbf4492e6 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:18.706271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2922275a-be91-4a59-aed3-5d8dbf4492e6 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:18.712899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2922275a-be91-4a59-aed3-5d8dbf4492e6 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:18.713867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2922275a-be91-4a59-aed3-5d8dbf4492e6 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:18.714650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2922275a-be91-4a59-aed3-5d8dbf4492e6 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:18.715438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2922275a-be91-4a59-aed3-5d8dbf4492e6 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:18.895478 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2922275a-be91-4a59-aed3-5d8dbf4492e6 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:18.925678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2922275a-be91-4a59-aed3-5d8dbf4492e6 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:18.958218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2922275a-be91-4a59-aed3-5d8dbf4492e6 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:18.958218 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2922275a-be91-4a59-aed3-5d8dbf4492e6 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1372 microversion: 2.57 time: 0.237970 May 21 21:30:18.958218 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2356/4591] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:30:18 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1372 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:30:18.958218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-04de26a0-4f88-4b28-8a10-8031f9fa2f4b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:18.958218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-04de26a0-4f88-4b28-8a10-8031f9fa2f4b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:18.958218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-04de26a0-4f88-4b28-8a10-8031f9fa2f4b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:18.958218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-04de26a0-4f88-4b28-8a10-8031f9fa2f4b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:18.958218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-04de26a0-4f88-4b28-8a10-8031f9fa2f4b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:18.958218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-04de26a0-4f88-4b28-8a10-8031f9fa2f4b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:19.133697 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-04de26a0-4f88-4b28-8a10-8031f9fa2f4b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:19.141925 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-04de26a0-4f88-4b28-8a10-8031f9fa2f4b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1322 microversion: 2.1 time: 0.199868 May 21 21:30:19.151385 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2357/4592] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:18 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:19.151385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a9e7b478-5f2f-427f-b670-7456d27d579b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:19.151385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a9e7b478-5f2f-427f-b670-7456d27d579b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:19.158830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9e7b478-5f2f-427f-b670-7456d27d579b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:19.159293 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9e7b478-5f2f-427f-b670-7456d27d579b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:19.160265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9e7b478-5f2f-427f-b670-7456d27d579b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:19.160735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9e7b478-5f2f-427f-b670-7456d27d579b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:19.389039 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a9e7b478-5f2f-427f-b670-7456d27d579b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "PUT /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 200 len: 1085 microversion: 2.1 time: 0.241903 May 21 21:30:19.390728 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2358/4593] 10.222.0.49 () {60 vars in 1255 bytes} [Sat May 21 21:30:19 2022] PUT /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 1085 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:19.402297 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f067301f-2a6c-43ad-a281-37cfd27afe3f tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] Calling method '.version_select at 0x7fc81a3eb940>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:19.529368 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f067301f-2a6c-43ad-a281-37cfd27afe3f tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/809a63e9-9319-4026-8c3e-f3e0dd7d67d7" status: 200 len: 345 microversion: 2.1 time: 0.136950 May 21 21:30:19.530170 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2359/4594] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:30:19 2022] GET /compute/v2.1/os-volumes/809a63e9-9319-4026-8c3e-f3e0dd7d67d7 => generated 345 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:30:19.542449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c5092d37-db2a-434c-a993-0f7de1fef8de tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:19.546599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c5092d37-db2a-434c-a993-0f7de1fef8de tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:19.560921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c5092d37-db2a-434c-a993-0f7de1fef8de tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:19.561639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c5092d37-db2a-434c-a993-0f7de1fef8de tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:19.564594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c5092d37-db2a-434c-a993-0f7de1fef8de tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:19.565597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c5092d37-db2a-434c-a993-0f7de1fef8de tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:19.679700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-572f3f5d-f3b3-4a13-9eb4-352288fd81b9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Updating instance_info_cache with network_info: [{"id": "f1e3e151-e89e-4972-b253-8b889eef1d77", "address": "fa:16:3e:3d:3e:02", "network": {"id": "2322dac3-cc4b-44d6-acd1-757c77fbeee8", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-329440060-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a426b85d93724b898ba8ce8c68dcead6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf1e3e151-e8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 21 21:30:19.862902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c5092d37-db2a-434c-a993-0f7de1fef8de tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:19.870894 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c5092d37-db2a-434c-a993-0f7de1fef8de tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 200 len: 1511 microversion: 2.1 time: 0.333293 May 21 21:30:19.871465 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2360/4595] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:19 2022] GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 1511 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:19.877119 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-572f3f5d-f3b3-4a13-9eb4-352288fd81b9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Releasing lock "refresh_cache-2b507bdf-67be-44d6-be35-c2b41d16f48f" {{(pid=131278) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 21 21:30:19.880211 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-572f3f5d-f3b3-4a13-9eb4-352288fd81b9 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "POST /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f/action" status: 202 len: 0 microversion: 2.1 time: 3.917694 May 21 21:30:19.880211 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2236/4596] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:30:15 2022] POST /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f/action => generated 0 bytes in 3919 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 21 21:30:19.887938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-51fc1c71-3061-4e51-b108-40b25253a705 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '.version_select at 0x7fc81a4f0700>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:19.889107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7e3af957-5330-4024-98eb-32bd4195226a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:19.889791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7e3af957-5330-4024-98eb-32bd4195226a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:19.914449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e3af957-5330-4024-98eb-32bd4195226a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:19.914449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e3af957-5330-4024-98eb-32bd4195226a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:19.914449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e3af957-5330-4024-98eb-32bd4195226a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:19.914449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e3af957-5330-4024-98eb-32bd4195226a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:20.215947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7e3af957-5330-4024-98eb-32bd4195226a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:20.227437 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7e3af957-5330-4024-98eb-32bd4195226a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 200 len: 1511 microversion: 2.1 time: 0.340769 May 21 21:30:20.231548 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2237/4597] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:19 2022] GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 1511 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:30:20.250793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-579c10d8-8d1e-46e0-a837-5bf4b0f34ff9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:20.252105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-579c10d8-8d1e-46e0-a837-5bf4b0f34ff9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:20.270213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-579c10d8-8d1e-46e0-a837-5bf4b0f34ff9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:20.270213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-579c10d8-8d1e-46e0-a837-5bf4b0f34ff9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:20.270213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-579c10d8-8d1e-46e0-a837-5bf4b0f34ff9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:20.270213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-579c10d8-8d1e-46e0-a837-5bf4b0f34ff9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:20.426421 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-579c10d8-8d1e-46e0-a837-5bf4b0f34ff9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:20.433221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-579c10d8-8d1e-46e0-a837-5bf4b0f34ff9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:20.435413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-579c10d8-8d1e-46e0-a837-5bf4b0f34ff9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:20.436639 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-579c10d8-8d1e-46e0-a837-5bf4b0f34ff9 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1372 microversion: 2.57 time: 0.206561 May 21 21:30:20.447724 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2238/4598] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:30:20 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1372 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:30:20.455613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4e2a8d09-c061-443d-8dba-5e7527d14074 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:20.459980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4e2a8d09-c061-443d-8dba-5e7527d14074 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:20.480378 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e2a8d09-c061-443d-8dba-5e7527d14074 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:20.480928 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e2a8d09-c061-443d-8dba-5e7527d14074 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:20.483203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e2a8d09-c061-443d-8dba-5e7527d14074 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:20.484722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e2a8d09-c061-443d-8dba-5e7527d14074 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:21.380432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4e2a8d09-c061-443d-8dba-5e7527d14074 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:21.384742 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4e2a8d09-c061-443d-8dba-5e7527d14074 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1322 microversion: 2.1 time: 0.945907 May 21 21:30:21.385636 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2239/4599] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:20 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1322 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:21.398864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2dd4dd90-227c-4c05-9324-b231bd7c70e0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:21.399394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2dd4dd90-227c-4c05-9324-b231bd7c70e0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:21.417531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2dd4dd90-227c-4c05-9324-b231bd7c70e0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:21.417996 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2dd4dd90-227c-4c05-9324-b231bd7c70e0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:21.419305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2dd4dd90-227c-4c05-9324-b231bd7c70e0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:21.419305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2dd4dd90-227c-4c05-9324-b231bd7c70e0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:21.455546 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2dd4dd90-227c-4c05-9324-b231bd7c70e0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:30:21.682161 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-51fc1c71-3061-4e51-b108-40b25253a705 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/c949ea08-383f-48ff-bc65-4af0e997505e" status: 202 len: 0 microversion: 2.1 time: 1.797702 May 21 21:30:21.683860 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2361/4600] 10.222.0.49 () {58 vars in 1262 bytes} [Sat May 21 21:30:19 2022] DELETE /compute/v2.1/os-floating-ips/c949ea08-383f-48ff-bc65-4af0e997505e => generated 0 bytes in 1801 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:30:21.690146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-56ef53a2-93b9-4ad5-b1e9-7517ed827313 tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] Calling method '.version_select at 0x7fc81a4fedc0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:21.756826 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-56ef53a2-93b9-4ad5-b1e9-7517ed827313 tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/809a63e9-9319-4026-8c3e-f3e0dd7d67d7" status: 200 len: 345 microversion: 2.1 time: 0.071162 May 21 21:30:21.763459 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2362/4601] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:30:21 2022] GET /compute/v2.1/os-volumes/809a63e9-9319-4026-8c3e-f3e0dd7d67d7 => generated 345 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:30:21.786212 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-1e060a51-1210-4626-9410-d125039c7630 req-ee83904d-9868-4471-8b19-c846958946a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3224316b-c287-4ec4-9b89-aeb8d9bf7adc", "name": "network-vif-plugged", "status": "completed", "tag": "94ca0b0b-018e-4c6a-8dd7-db57f04e9a46"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:21.801181 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-1e060a51-1210-4626-9410-d125039c7630 req-ee83904d-9868-4471-8b19-c846958946a8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:21.801715 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-1e060a51-1210-4626-9410-d125039c7630 req-ee83904d-9868-4471-8b19-c846958946a8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:21.814338 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-1e060a51-1210-4626-9410-d125039c7630 req-ee83904d-9868-4471-8b19-c846958946a8 service nova] Creating event network-vif-plugged:94ca0b0b-018e-4c6a-8dd7-db57f04e9a46 for instance 3224316b-c287-4ec4-9b89-aeb8d9bf7adc on nch1-master-1 May 21 21:30:21.820421 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-1e060a51-1210-4626-9410-d125039c7630 req-ee83904d-9868-4471-8b19-c846958946a8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051157 May 21 21:30:21.823636 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2363/4602] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:30:21.826152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f5025e86-5efd-41ae-897c-7b23c784d9b7 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:21.826900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f5025e86-5efd-41ae-897c-7b23c784d9b7 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:21.842760 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5025e86-5efd-41ae-897c-7b23c784d9b7 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:21.844079 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2dd4dd90-227c-4c05-9324-b231bd7c70e0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 204 len: 0 microversion: 2.1 time: 0.457336 May 21 21:30:21.844803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5025e86-5efd-41ae-897c-7b23c784d9b7 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:21.845050 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2240/4603] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:30:21 2022] DELETE /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:30:21.847545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5025e86-5efd-41ae-897c-7b23c784d9b7 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:21.848866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5025e86-5efd-41ae-897c-7b23c784d9b7 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:21.874747 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dec8d2cc-1493-472b-8c26-e286ee67f3dc tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '.version_select at 0x7fc819ee80d0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:21.975939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f5025e86-5efd-41ae-897c-7b23c784d9b7 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:21.988240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f5025e86-5efd-41ae-897c-7b23c784d9b7 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:21.990954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f5025e86-5efd-41ae-897c-7b23c784d9b7 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:21.992811 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f5025e86-5efd-41ae-897c-7b23c784d9b7 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1357 microversion: 2.57 time: 0.170315 May 21 21:30:21.993383 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2364/4604] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:30:21 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:30:21.999465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-90aa886d-5c02-4a0f-86ee-10ff697f20ab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:22.000321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-90aa886d-5c02-4a0f-86ee-10ff697f20ab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:22.016147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90aa886d-5c02-4a0f-86ee-10ff697f20ab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:22.017250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90aa886d-5c02-4a0f-86ee-10ff697f20ab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:22.018199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90aa886d-5c02-4a0f-86ee-10ff697f20ab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:22.018703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90aa886d-5c02-4a0f-86ee-10ff697f20ab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:22.212772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-90aa886d-5c02-4a0f-86ee-10ff697f20ab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:22.231180 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-90aa886d-5c02-4a0f-86ee-10ff697f20ab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 200 len: 1517 microversion: 2.1 time: 0.226714 May 21 21:30:22.231180 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2365/4605] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:21 2022] GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 1517 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:22.236152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-572ec0df-f27d-4db0-bb82-d20c720d4934 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:22.236969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-572ec0df-f27d-4db0-bb82-d20c720d4934 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:22.243560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-572ec0df-f27d-4db0-bb82-d20c720d4934 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:22.244096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-572ec0df-f27d-4db0-bb82-d20c720d4934 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:22.244929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-572ec0df-f27d-4db0-bb82-d20c720d4934 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:22.245371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-572ec0df-f27d-4db0-bb82-d20c720d4934 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:22.275036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-572ec0df-f27d-4db0-bb82-d20c720d4934 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:30:22.409211 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dec8d2cc-1493-472b-8c26-e286ee67f3dc tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/f11e7c2a-f276-479f-abdb-aa1e60a1af63" status: 202 len: 0 microversion: 2.1 time: 0.562877 May 21 21:30:22.410366 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2241/4606] 10.222.0.49 () {58 vars in 1271 bytes} [Sat May 21 21:30:21 2022] DELETE /compute/v2.1/os-security-groups/f11e7c2a-f276-479f-abdb-aa1e60a1af63 => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:30:22.413000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:22.417049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-acdfaa9c-3e9b-4268-95c3-2bc01322676f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:22.419839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-acdfaa9c-3e9b-4268-95c3-2bc01322676f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:22.436163 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-acdfaa9c-3e9b-4268-95c3-2bc01322676f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:22.436163 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-acdfaa9c-3e9b-4268-95c3-2bc01322676f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:22.436430 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-acdfaa9c-3e9b-4268-95c3-2bc01322676f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:22.440861 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-acdfaa9c-3e9b-4268-95c3-2bc01322676f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:22.583270 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-572ec0df-f27d-4db0-bb82-d20c720d4934 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 204 len: 0 microversion: 2.57 time: 0.359702 May 21 21:30:22.583876 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2366/4607] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:30:22 2022] DELETE /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:30:22.591808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ea11f278-b6ce-4410-acb8-c2d8094bd2de tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:22.593620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ea11f278-b6ce-4410-acb8-c2d8094bd2de tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:22.608583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea11f278-b6ce-4410-acb8-c2d8094bd2de tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:22.609327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea11f278-b6ce-4410-acb8-c2d8094bd2de tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:22.611694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea11f278-b6ce-4410-acb8-c2d8094bd2de tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:22.612166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea11f278-b6ce-4410-acb8-c2d8094bd2de tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:22.664982 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ea11f278-b6ce-4410-acb8-c2d8094bd2de tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:30:22.746065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-acdfaa9c-3e9b-4268-95c3-2bc01322676f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:22.758348 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-acdfaa9c-3e9b-4268-95c3-2bc01322676f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1322 microversion: 2.1 time: 0.345644 May 21 21:30:22.759630 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2242/4608] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:22 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:22.765714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fd4b448d-5889-467f-a29c-9261ece0eb39 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:22.766561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fd4b448d-5889-467f-a29c-9261ece0eb39 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:22.774103 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fd4b448d-5889-467f-a29c-9261ece0eb39 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:22.774611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fd4b448d-5889-467f-a29c-9261ece0eb39 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:22.775917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fd4b448d-5889-467f-a29c-9261ece0eb39 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:22.776390 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fd4b448d-5889-467f-a29c-9261ece0eb39 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:22.864731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fd4b448d-5889-467f-a29c-9261ece0eb39 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:22.874213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fd4b448d-5889-467f-a29c-9261ece0eb39 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:22.877191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fd4b448d-5889-467f-a29c-9261ece0eb39 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:22.878895 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fd4b448d-5889-467f-a29c-9261ece0eb39 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1363 microversion: 2.57 time: 0.117395 May 21 21:30:22.879693 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2243/4609] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:30:22 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1363 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:30:22.885674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f8d423a3-b88b-426d-93ea-49318b502e99 tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] Calling method '.version_select at 0x7fc819eae5e0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:22.957887 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f8d423a3-b88b-426d-93ea-49318b502e99 tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/809a63e9-9319-4026-8c3e-f3e0dd7d67d7" status: 200 len: 345 microversion: 2.1 time: 0.076885 May 21 21:30:22.958482 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2244/4610] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:30:22 2022] GET /compute/v2.1/os-volumes/809a63e9-9319-4026-8c3e-f3e0dd7d67d7 => generated 345 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:30:23.023082 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ea11f278-b6ce-4410-acb8-c2d8094bd2de tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 204 len: 0 microversion: 2.1 time: 0.437151 May 21 21:30:23.023785 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2367/4611] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:30:22 2022] DELETE /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:30:23.033955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-541ce567-769f-48be-93bf-28eb21639c19 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:23.034725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-541ce567-769f-48be-93bf-28eb21639c19 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:23.042512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-541ce567-769f-48be-93bf-28eb21639c19 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:23.043244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-541ce567-769f-48be-93bf-28eb21639c19 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:23.044167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-541ce567-769f-48be-93bf-28eb21639c19 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:23.045023 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-541ce567-769f-48be-93bf-28eb21639c19 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:23.226727 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-541ce567-769f-48be-93bf-28eb21639c19 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:23.239581 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c43178f1-67e0-4386-8ad4-beea7863db0e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:23.240599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c43178f1-67e0-4386-8ad4-beea7863db0e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:23.245503 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-541ce567-769f-48be-93bf-28eb21639c19 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1508 microversion: 2.1 time: 0.216769 May 21 21:30:23.255268 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2245/4612] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:23 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1508 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:30:23.257512 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c43178f1-67e0-4386-8ad4-beea7863db0e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:23.258224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c43178f1-67e0-4386-8ad4-beea7863db0e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:23.259107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c43178f1-67e0-4386-8ad4-beea7863db0e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:23.259769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c43178f1-67e0-4386-8ad4-beea7863db0e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:23.457776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c43178f1-67e0-4386-8ad4-beea7863db0e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:23.479149 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c43178f1-67e0-4386-8ad4-beea7863db0e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 200 len: 1517 microversion: 2.1 time: 0.238433 May 21 21:30:23.479149 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2368/4613] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:23 2022] GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 1517 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:23.775920 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b427a30f-cd07-4509-93c0-4e4a809e09ba tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:23.776607 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b427a30f-cd07-4509-93c0-4e4a809e09ba tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:23.787847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b427a30f-cd07-4509-93c0-4e4a809e09ba tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:23.788543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b427a30f-cd07-4509-93c0-4e4a809e09ba tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:23.789499 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b427a30f-cd07-4509-93c0-4e4a809e09ba tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:23.790088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b427a30f-cd07-4509-93c0-4e4a809e09ba tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:23.840784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-eeeb7c88-232a-410f-9f6a-4356c5dbdb79 req-c59556c4-e4db-4060-b620-8cb35486ef3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "506776f0-470a-4a6b-ac34-3414463a8770", "name": "network-vif-plugged", "status": "completed", "tag": "dde6dfe2-b739-4346-bc75-f66a5634741a"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:23.853980 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-eeeb7c88-232a-410f-9f6a-4356c5dbdb79 req-c59556c4-e4db-4060-b620-8cb35486ef3c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:23.854527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-eeeb7c88-232a-410f-9f6a-4356c5dbdb79 req-c59556c4-e4db-4060-b620-8cb35486ef3c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:23.868544 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-eeeb7c88-232a-410f-9f6a-4356c5dbdb79 req-c59556c4-e4db-4060-b620-8cb35486ef3c service nova] Creating event network-vif-plugged:dde6dfe2-b739-4346-bc75-f66a5634741a for instance 506776f0-470a-4a6b-ac34-3414463a8770 on nch1-master-1 May 21 21:30:23.875086 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-eeeb7c88-232a-410f-9f6a-4356c5dbdb79 req-c59556c4-e4db-4060-b620-8cb35486ef3c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039234 May 21 21:30:23.879900 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2369/4614] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:30:23.901341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-de608aa4-edf1-416d-8e88-899361d224f7 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:23.902254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-de608aa4-edf1-416d-8e88-899361d224f7 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:23.910699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-de608aa4-edf1-416d-8e88-899361d224f7 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:23.913059 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-de608aa4-edf1-416d-8e88-899361d224f7 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:23.913900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-de608aa4-edf1-416d-8e88-899361d224f7 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:23.914353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-de608aa4-edf1-416d-8e88-899361d224f7 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:23.977488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b427a30f-cd07-4509-93c0-4e4a809e09ba tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:23.987645 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b427a30f-cd07-4509-93c0-4e4a809e09ba tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1516 microversion: 2.1 time: 0.215727 May 21 21:30:23.988238 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2246/4615] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:23 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1516 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:23.993184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ae69ad68-60a3-40a9-9f53-011a7d9585da tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] Calling method '.version_select at 0x7fc819eea940>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:24.027189 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-ae69ad68-60a3-40a9-9f53-011a7d9585da tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] HTTP exception thrown: Volume 809a63e9-9319-4026-8c3e-f3e0dd7d67d7 could not be found. May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ae69ad68-60a3-40a9-9f53-011a7d9585da tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] Request method failure captured: May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-volumes/809a63e9-9319-4026-8c3e-f3e0dd7d67d7 HTTP/1.1 May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVnkR9iLyGaEtSZcpRt5snKQ0h2SPtWIywJ3W89hhy7cqyPV9wUYE-6aazkIaYpCf8vprDOP2QoRbJlcMB7ZDk-X3GC1ILKlN6sSiOVgokSWe1xXO2lFjvz8D2hY81SiQj2SpHSLiTRtCEL_vt6sfoFVVeO5rtyK_A3s66MP1MK9jxE May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 6e882e47915f4e728e8da5a38062dd42 May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-VolumesGetTestJSON-1744833942 May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6e882e47915f4e728e8da5a38062dd42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6e882e47915f4e728e8da5a38062dd42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6e882e47915f4e728e8da5a38062dd42", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6e882e47915f4e728e8da5a38062dd42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-VolumesGetTestJSON-1744833942 May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 6e882e47915f4e728e8da5a38062dd42 May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-VolumesGetTestJSON-1744833942 May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-VolumesGetTestJSON-1744833942-project May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 107fa7bc4f11461cb4000411af2e3968 May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-VolumesGetTestJSON-1744833942-project May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: exception: Volume 809a63e9-9319-4026-8c3e-f3e0dd7d67d7 could not be found. May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '809a63e9-9319-4026-8c3e-f3e0dd7d67d7'} May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi item = cinderclient( May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 809a63e9-9319-4026-8c3e-f3e0dd7d67d7 could not be found. (HTTP 404) (Request-ID: req-c6269fb5-222d-4502-b000-1e0ad599e9bc) May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 21 21:30:24.029579 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi item = cinderclient( May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 809a63e9-9319-4026-8c3e-f3e0dd7d67d7 could not be found. May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 809a63e9-9319-4026-8c3e-f3e0dd7d67d7 could not be found. May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 809a63e9-9319-4026-8c3e-f3e0dd7d67d7 could not be found. May 21 21:30:24.033769 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:24.037494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ae69ad68-60a3-40a9-9f53-011a7d9585da tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] Returning 404 to user: Volume 809a63e9-9319-4026-8c3e-f3e0dd7d67d7 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:30:24.038382 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ae69ad68-60a3-40a9-9f53-011a7d9585da tempest-VolumesGetTestJSON-1744833942 tempest-VolumesGetTestJSON-1744833942-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/809a63e9-9319-4026-8c3e-f3e0dd7d67d7" status: 404 len: 109 microversion: 2.1 time: 0.048873 May 21 21:30:24.038973 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2247/4616] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:30:23 2022] GET /compute/v2.1/os-volumes/809a63e9-9319-4026-8c3e-f3e0dd7d67d7 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:30:24.044395 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c4f530d4-bf50-45ce-8cae-13c8ee2eafa8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:24.046471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c4f530d4-bf50-45ce-8cae-13c8ee2eafa8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:24.054819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4f530d4-bf50-45ce-8cae-13c8ee2eafa8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:24.055284 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4f530d4-bf50-45ce-8cae-13c8ee2eafa8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:24.056257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4f530d4-bf50-45ce-8cae-13c8ee2eafa8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:24.057279 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4f530d4-bf50-45ce-8cae-13c8ee2eafa8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:24.086280 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-c4f530d4-bf50-45ce-8cae-13c8ee2eafa8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lazy-loading 'flavor' on Instance uuid 3224316b-c287-4ec4-9b89-aeb8d9bf7adc {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:30:24.093451 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-de608aa4-edf1-416d-8e88-899361d224f7 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:24.104030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-de608aa4-edf1-416d-8e88-899361d224f7 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:24.105946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-de608aa4-edf1-416d-8e88-899361d224f7 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:24.107294 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-de608aa4-edf1-416d-8e88-899361d224f7 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1363 microversion: 2.57 time: 0.212364 May 21 21:30:24.119644 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2370/4617] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:30:23 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:30:24.269428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:24.285664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-86dcdf98-c9b3-440d-a05b-046392cd24db tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:24.286698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-86dcdf98-c9b3-440d-a05b-046392cd24db tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:24.293154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86dcdf98-c9b3-440d-a05b-046392cd24db tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:24.293639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86dcdf98-c9b3-440d-a05b-046392cd24db tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:24.294417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86dcdf98-c9b3-440d-a05b-046392cd24db tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:24.294853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86dcdf98-c9b3-440d-a05b-046392cd24db tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:24.541296 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c4f530d4-bf50-45ce-8cae-13c8ee2eafa8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "POST /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc/action" status: 200 len: 32 microversion: 2.1 time: 0.500991 May 21 21:30:24.542485 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2248/4618] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:30:24 2022] POST /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc/action => generated 32 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:30:24.557740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a76e6a43-2401-40e2-ad48-5422b00ad22e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:24.563667 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a76e6a43-2401-40e2-ad48-5422b00ad22e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:24.575388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a76e6a43-2401-40e2-ad48-5422b00ad22e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:24.576884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a76e6a43-2401-40e2-ad48-5422b00ad22e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:24.577946 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a76e6a43-2401-40e2-ad48-5422b00ad22e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:24.578452 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a76e6a43-2401-40e2-ad48-5422b00ad22e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:24.668013 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-86dcdf98-c9b3-440d-a05b-046392cd24db tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:24.698899 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-86dcdf98-c9b3-440d-a05b-046392cd24db tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1508 microversion: 2.1 time: 0.430194 May 21 21:30:24.699910 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2371/4619] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:24 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1508 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:30:24.705654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3ec5e7b8-781b-47fd-a1cd-86e9baed8505 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:24.706458 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3ec5e7b8-781b-47fd-a1cd-86e9baed8505 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:24.714476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3ec5e7b8-781b-47fd-a1cd-86e9baed8505 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:24.715154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3ec5e7b8-781b-47fd-a1cd-86e9baed8505 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:24.716908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3ec5e7b8-781b-47fd-a1cd-86e9baed8505 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:24.717584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3ec5e7b8-781b-47fd-a1cd-86e9baed8505 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:24.919983 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a76e6a43-2401-40e2-ad48-5422b00ad22e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:24.932563 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a76e6a43-2401-40e2-ad48-5422b00ad22e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 200 len: 1517 microversion: 2.1 time: 0.388550 May 21 21:30:24.933518 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2249/4620] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:24 2022] GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 1517 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:25.012089 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3ec5e7b8-781b-47fd-a1cd-86e9baed8505 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:25.021447 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3ec5e7b8-781b-47fd-a1cd-86e9baed8505 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1522 microversion: 2.1 time: 0.320204 May 21 21:30:25.022056 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2372/4621] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:24 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:25.134196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-54f6cb93-2f97-4120-9326-859eb37a7331 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:25.134196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-54f6cb93-2f97-4120-9326-859eb37a7331 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:25.134196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54f6cb93-2f97-4120-9326-859eb37a7331 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:25.134943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54f6cb93-2f97-4120-9326-859eb37a7331 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:25.135933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54f6cb93-2f97-4120-9326-859eb37a7331 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:25.136562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54f6cb93-2f97-4120-9326-859eb37a7331 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:25.195349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54f6cb93-2f97-4120-9326-859eb37a7331 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:25.195799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-54f6cb93-2f97-4120-9326-859eb37a7331 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:25.196432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-54f6cb93-2f97-4120-9326-859eb37a7331 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lazy-loading 'fault' on Instance uuid b3e384e5-26ff-4c69-b80b-84187dd6776e {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:30:25.341219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-54f6cb93-2f97-4120-9326-859eb37a7331 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:25.351807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-54f6cb93-2f97-4120-9326-859eb37a7331 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:25.354080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-54f6cb93-2f97-4120-9326-859eb37a7331 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60e14a6b163049cb8349ccdcee74ddaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5915d8919d4922a53ce132ec597c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:25.355338 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-54f6cb93-2f97-4120-9326-859eb37a7331 tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 200 len: 1368 microversion: 2.57 time: 0.232237 May 21 21:30:25.356230 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2250/4622] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:30:25 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:30:25.718715 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7a362003-fb18-4b71-8aea-79931709aaa7 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:25.726846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7a362003-fb18-4b71-8aea-79931709aaa7 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:25.735441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a362003-fb18-4b71-8aea-79931709aaa7 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:25.736224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a362003-fb18-4b71-8aea-79931709aaa7 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:25.737299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a362003-fb18-4b71-8aea-79931709aaa7 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:25.738225 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a362003-fb18-4b71-8aea-79931709aaa7 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:25.957574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f1240793-f0a7-490a-8e14-94d203d7b85c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:25.962403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f1240793-f0a7-490a-8e14-94d203d7b85c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:25.975182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1240793-f0a7-490a-8e14-94d203d7b85c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:25.976039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1240793-f0a7-490a-8e14-94d203d7b85c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:25.977214 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1240793-f0a7-490a-8e14-94d203d7b85c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:25.978378 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1240793-f0a7-490a-8e14-94d203d7b85c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:26.023883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7a362003-fb18-4b71-8aea-79931709aaa7 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:26.037061 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7a362003-fb18-4b71-8aea-79931709aaa7 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1508 microversion: 2.1 time: 0.322224 May 21 21:30:26.048031 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2373/4623] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:25 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1508 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:26.053513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9946b281-faf2-4f92-8cb6-66d2d0f2ad55 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:26.054483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9946b281-faf2-4f92-8cb6-66d2d0f2ad55 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:26.063829 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9946b281-faf2-4f92-8cb6-66d2d0f2ad55 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:26.064848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9946b281-faf2-4f92-8cb6-66d2d0f2ad55 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:26.065886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9946b281-faf2-4f92-8cb6-66d2d0f2ad55 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:26.066551 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9946b281-faf2-4f92-8cb6-66d2d0f2ad55 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:26.442722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f1240793-f0a7-490a-8e14-94d203d7b85c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:26.453237 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f1240793-f0a7-490a-8e14-94d203d7b85c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 200 len: 1517 microversion: 2.1 time: 0.504719 May 21 21:30:26.454447 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2251/4624] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:25 2022] GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 1517 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:26.464122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-58617793-bf2e-4511-8a4f-56384caa535d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:26.468480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-58617793-bf2e-4511-8a4f-56384caa535d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] [instance: b3e384e5-26ff-4c69-b80b-84187dd6776e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:26.479098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58617793-bf2e-4511-8a4f-56384caa535d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:26.479859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58617793-bf2e-4511-8a4f-56384caa535d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:26.481013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58617793-bf2e-4511-8a4f-56384caa535d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:26.481650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58617793-bf2e-4511-8a4f-56384caa535d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:26.508571 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-58617793-bf2e-4511-8a4f-56384caa535d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] HTTP exception thrown: Instance b3e384e5-26ff-4c69-b80b-84187dd6776e could not be found. May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-58617793-bf2e-4511-8a4f-56384caa535d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Request method failure captured: May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e HTTP/1.1 May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVnFUP2i4k5i6y48Ue4y5RfVxAXn5shIK4VFtxtwcs3jy96kjhd_Db15HgR6hgxmec4sLPh18iNmbeRs5h-iTdwWITGjSH2E4IpeRqMliF9mRFrzTD75FOr0mYi0UMyZ3fr-OBKDZfcfQOKpS3ackrhBPPOgrE1Rpl51Znt0YsTdgHE May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: X-Openstack-Nova-Api-Version: 2.57 May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 6d5915d8919d4922a53ce132ec597c0b May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerShowV257Test-1976458509 May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6d5915d8919d4922a53ce132ec597c0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6d5915d8919d4922a53ce132ec597c0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6d5915d8919d4922a53ce132ec597c0b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6d5915d8919d4922a53ce132ec597c0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerShowV257Test-1976458509 May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 6d5915d8919d4922a53ce132ec597c0b May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerShowV257Test-1976458509 May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerShowV257Test-1976458509-project May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 60e14a6b163049cb8349ccdcee74ddaf May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerShowV257Test-1976458509-project May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance b3e384e5-26ff-4c69-b80b-84187dd6776e could not be found. May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'b3e384e5-26ff-4c69-b80b-84187dd6776e'} May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3e384e5-26ff-4c69-b80b-84187dd6776e could not be found. May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3e384e5-26ff-4c69-b80b-84187dd6776e could not be found. May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:26.511046 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:26.514438 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:26.514438 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:26.514438 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:26.514438 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:30:26.514438 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:30:26.514438 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3e384e5-26ff-4c69-b80b-84187dd6776e could not be found. May 21 21:30:26.514438 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:26.517893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-58617793-bf2e-4511-8a4f-56384caa535d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] Returning 404 to user: Instance b3e384e5-26ff-4c69-b80b-84187dd6776e could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:30:26.519330 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-58617793-bf2e-4511-8a4f-56384caa535d tempest-ServerShowV257Test-1976458509 tempest-ServerShowV257Test-1976458509-project] 10.222.0.49 "GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e" status: 404 len: 111 microversion: 2.57 time: 0.063542 May 21 21:30:26.520189 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2252/4625] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:30:26 2022] GET /compute/v2.1/servers/b3e384e5-26ff-4c69-b80b-84187dd6776e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:30:26.549987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9946b281-faf2-4f92-8cb6-66d2d0f2ad55 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:26.560589 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9946b281-faf2-4f92-8cb6-66d2d0f2ad55 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1522 microversion: 2.1 time: 0.510955 May 21 21:30:26.561184 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2374/4626] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:26 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1522 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:26.947057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-179120b0-f2b2-45fd-bb87-c82b30f161e2 req-d5bf270f-e37d-44a1-a683-acf8ef1ed391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b507bdf-67be-44d6-be35-c2b41d16f48f", "name": "network-vif-deleted", "tag": "f1e3e151-e89e-4972-b253-8b889eef1d77"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:26.961809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-179120b0-f2b2-45fd-bb87-c82b30f161e2 req-d5bf270f-e37d-44a1-a683-acf8ef1ed391 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:26.968654 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-179120b0-f2b2-45fd-bb87-c82b30f161e2 req-d5bf270f-e37d-44a1-a683-acf8ef1ed391 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:26.998329 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-179120b0-f2b2-45fd-bb87-c82b30f161e2 req-d5bf270f-e37d-44a1-a683-acf8ef1ed391 service nova] Creating event network-vif-deleted:f1e3e151-e89e-4972-b253-8b889eef1d77 for instance 2b507bdf-67be-44d6-be35-c2b41d16f48f on nch2-master-1 May 21 21:30:27.027871 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-179120b0-f2b2-45fd-bb87-c82b30f161e2 req-d5bf270f-e37d-44a1-a683-acf8ef1ed391 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086700 May 21 21:30:27.029277 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2253/4627] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:30:27.056203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ff1f2917-089c-4234-b133-6d55a263f5ca tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:27.057074 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ff1f2917-089c-4234-b133-6d55a263f5ca tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:27.077969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff1f2917-089c-4234-b133-6d55a263f5ca tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:27.080752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff1f2917-089c-4234-b133-6d55a263f5ca tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:27.080752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff1f2917-089c-4234-b133-6d55a263f5ca tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:27.080752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff1f2917-089c-4234-b133-6d55a263f5ca tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:27.295394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ff1f2917-089c-4234-b133-6d55a263f5ca tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:27.304142 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ff1f2917-089c-4234-b133-6d55a263f5ca tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1293 microversion: 2.1 time: 0.252824 May 21 21:30:27.305045 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2375/4628] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:27 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1293 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:27.477398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-63b7c781-0b0b-4634-bdcf-e2d21907df4b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:27.478374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-63b7c781-0b0b-4634-bdcf-e2d21907df4b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:27.494392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63b7c781-0b0b-4634-bdcf-e2d21907df4b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:27.494850 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63b7c781-0b0b-4634-bdcf-e2d21907df4b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:27.495653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63b7c781-0b0b-4634-bdcf-e2d21907df4b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:27.496100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63b7c781-0b0b-4634-bdcf-e2d21907df4b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:27.579445 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d9a0f8f2-1ee5-4def-86bd-b1c49a981ce0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:27.579665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d9a0f8f2-1ee5-4def-86bd-b1c49a981ce0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:27.589552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d9a0f8f2-1ee5-4def-86bd-b1c49a981ce0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:27.590212 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d9a0f8f2-1ee5-4def-86bd-b1c49a981ce0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:27.591160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d9a0f8f2-1ee5-4def-86bd-b1c49a981ce0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:27.591710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d9a0f8f2-1ee5-4def-86bd-b1c49a981ce0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:27.637700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-63b7c781-0b0b-4634-bdcf-e2d21907df4b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:27.645609 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-63b7c781-0b0b-4634-bdcf-e2d21907df4b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 200 len: 1315 microversion: 2.1 time: 0.177881 May 21 21:30:27.658374 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2254/4629] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:27 2022] GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:27.888131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d9a0f8f2-1ee5-4def-86bd-b1c49a981ce0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:27.902523 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d9a0f8f2-1ee5-4def-86bd-b1c49a981ce0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1522 microversion: 2.1 time: 0.326965 May 21 21:30:27.903293 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2376/4630] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:27 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:28.323378 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0132fd14-6c4e-4062-baa2-9b7464809a35 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:28.324627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0132fd14-6c4e-4062-baa2-9b7464809a35 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:28.333220 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0132fd14-6c4e-4062-baa2-9b7464809a35 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:28.333677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0132fd14-6c4e-4062-baa2-9b7464809a35 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:28.334464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0132fd14-6c4e-4062-baa2-9b7464809a35 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:28.334905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0132fd14-6c4e-4062-baa2-9b7464809a35 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:28.432186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0132fd14-6c4e-4062-baa2-9b7464809a35 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:28.435447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0132fd14-6c4e-4062-baa2-9b7464809a35 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:28.435447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-0132fd14-6c4e-4062-baa2-9b7464809a35 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lazy-loading 'fault' on Instance uuid 2b507bdf-67be-44d6-be35-c2b41d16f48f {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:30:28.501056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0132fd14-6c4e-4062-baa2-9b7464809a35 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbbb5240ae944cdb9797e78dce65978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a426b85d93724b898ba8ce8c68dcead6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:28.516661 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0132fd14-6c4e-4062-baa2-9b7464809a35 tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 200 len: 1312 microversion: 2.1 time: 0.197498 May 21 21:30:28.518955 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2255/4631] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:28 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 1312 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:30:28.665745 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2a208b3f-dc1a-4529-a958-41ba9cb97424 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:28.666364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2a208b3f-dc1a-4529-a958-41ba9cb97424 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:28.673024 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:28.683346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a208b3f-dc1a-4529-a958-41ba9cb97424 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:28.684518 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a208b3f-dc1a-4529-a958-41ba9cb97424 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:28.686045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a208b3f-dc1a-4529-a958-41ba9cb97424 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:28.689764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a208b3f-dc1a-4529-a958-41ba9cb97424 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:28.753938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a208b3f-dc1a-4529-a958-41ba9cb97424 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:28.754320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a208b3f-dc1a-4529-a958-41ba9cb97424 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:28.754782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-2a208b3f-dc1a-4529-a958-41ba9cb97424 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lazy-loading 'fault' on Instance uuid f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:30:28.809963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2a208b3f-dc1a-4529-a958-41ba9cb97424 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:28.817473 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2a208b3f-dc1a-4529-a958-41ba9cb97424 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 200 len: 1320 microversion: 2.1 time: 0.156231 May 21 21:30:28.818051 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2377/4632] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:28 2022] GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 1320 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:28.921387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dec4f76d-2b2d-440d-84f6-28680c2b9afc tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:28.922063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dec4f76d-2b2d-440d-84f6-28680c2b9afc tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:28.931337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dec4f76d-2b2d-440d-84f6-28680c2b9afc tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:28.932561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dec4f76d-2b2d-440d-84f6-28680c2b9afc tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:28.940386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dec4f76d-2b2d-440d-84f6-28680c2b9afc tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:28.940386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dec4f76d-2b2d-440d-84f6-28680c2b9afc tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:29.093713 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-b0eb8643-9e57-49ff-9c85-76248a5bf4ea req-f2b0da90-bd7a-47d8-b4bc-c0bb96e08021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f74db7ff-ff9c-47f1-9910-a12d77e7c7c0", "name": "network-vif-deleted", "tag": "c8aecd10-c652-4c56-be6e-283bb3555048"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:29.122152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b0eb8643-9e57-49ff-9c85-76248a5bf4ea req-f2b0da90-bd7a-47d8-b4bc-c0bb96e08021 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:29.122616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b0eb8643-9e57-49ff-9c85-76248a5bf4ea req-f2b0da90-bd7a-47d8-b4bc-c0bb96e08021 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:29.176779 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-b0eb8643-9e57-49ff-9c85-76248a5bf4ea req-f2b0da90-bd7a-47d8-b4bc-c0bb96e08021 service nova] Creating event network-vif-deleted:c8aecd10-c652-4c56-be6e-283bb3555048 for instance f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 on nch2-master-1 May 21 21:30:29.183301 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-b0eb8643-9e57-49ff-9c85-76248a5bf4ea req-f2b0da90-bd7a-47d8-b4bc-c0bb96e08021 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093648 May 21 21:30:29.187005 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2378/4633] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:30:29.283239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dec4f76d-2b2d-440d-84f6-28680c2b9afc tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:29.296179 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dec4f76d-2b2d-440d-84f6-28680c2b9afc tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1522 microversion: 2.1 time: 0.378638 May 21 21:30:29.298186 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2256/4634] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:28 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:29.543648 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3355be6b-47ff-4481-a9f7-21d73b04627c tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:29.544830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3355be6b-47ff-4481-a9f7-21d73b04627c tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] [instance: 2b507bdf-67be-44d6-be35-c2b41d16f48f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:29.558217 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3355be6b-47ff-4481-a9f7-21d73b04627c tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:29.559381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3355be6b-47ff-4481-a9f7-21d73b04627c tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:29.566315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3355be6b-47ff-4481-a9f7-21d73b04627c tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:29.566315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3355be6b-47ff-4481-a9f7-21d73b04627c tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:29.582217 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-3355be6b-47ff-4481-a9f7-21d73b04627c tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] HTTP exception thrown: Instance 2b507bdf-67be-44d6-be35-c2b41d16f48f could not be found. May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3355be6b-47ff-4481-a9f7-21d73b04627c tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Request method failure captured: May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f HTTP/1.1 May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVmrcwiXCdnQiVoR1ZgDJgU4-VLETwmzjMPPd6J_8Hez0h8GLykgCL0Yb5HOpMdXmSz1Xq2xHqy7YWy6vFt3LqyfSKQRRbJZFRV8s0sVTvbR5D4cxyEiqqjO3Sdst7xzUuwIxoqdg1ayOom39SlFEQ82KBcs7rhfv2T0N03CFy4joUY May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: a426b85d93724b898ba8ce8c68dcead6 May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1865241541 May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a426b85d93724b898ba8ce8c68dcead6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a426b85d93724b898ba8ce8c68dcead6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a426b85d93724b898ba8ce8c68dcead6", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a426b85d93724b898ba8ce8c68dcead6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1865241541 May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: a426b85d93724b898ba8ce8c68dcead6 May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1865241541 May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerRescueTestJSONUnderV235-1865241541-project May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: cbbbb5240ae944cdb9797e78dce65978 May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1865241541-project May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 2b507bdf-67be-44d6-be35-c2b41d16f48f could not be found. May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '2b507bdf-67be-44d6-be35-c2b41d16f48f'} May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b507bdf-67be-44d6-be35-c2b41d16f48f could not be found. May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b507bdf-67be-44d6-be35-c2b41d16f48f could not be found. May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:29.585224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:29.593695 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:29.593695 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:29.593695 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:29.593695 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:29.593695 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:30:29.593695 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:30:29.593695 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b507bdf-67be-44d6-be35-c2b41d16f48f could not be found. May 21 21:30:29.593695 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:29.593695 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3355be6b-47ff-4481-a9f7-21d73b04627c tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] Returning 404 to user: Instance 2b507bdf-67be-44d6-be35-c2b41d16f48f could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:30:29.593695 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3355be6b-47ff-4481-a9f7-21d73b04627c tempest-ServerRescueTestJSONUnderV235-1865241541 tempest-ServerRescueTestJSONUnderV235-1865241541-project] 10.222.0.49 "GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f" status: 404 len: 111 microversion: 2.1 time: 0.048851 May 21 21:30:29.593695 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2379/4635] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:29 2022] GET /compute/v2.1/servers/2b507bdf-67be-44d6-be35-c2b41d16f48f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:30:29.837514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3d141826-abac-488c-b914-c162fce11d28 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:29.838216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3d141826-abac-488c-b914-c162fce11d28 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:29.861626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d141826-abac-488c-b914-c162fce11d28 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:29.863278 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d141826-abac-488c-b914-c162fce11d28 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:29.865074 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d141826-abac-488c-b914-c162fce11d28 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:29.866428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d141826-abac-488c-b914-c162fce11d28 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:29.899588 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-3d141826-abac-488c-b914-c162fce11d28 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 could not be found. May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3d141826-abac-488c-b914-c162fce11d28 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 HTTP/1.1 May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 could not be found. May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'f74db7ff-ff9c-47f1-9910-a12d77e7c7c0'} May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 could not be found. May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 could not be found. May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:29.904777 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:29.908842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:29.908842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:29.908842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:30:29.908842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:30:29.908842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 could not be found. May 21 21:30:29.908842 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:29.910085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3d141826-abac-488c-b914-c162fce11d28 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:30:29.910978 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3d141826-abac-488c-b914-c162fce11d28 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 404 len: 111 microversion: 2.1 time: 0.079863 May 21 21:30:29.911761 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2380/4636] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:29 2022] GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:30:30.028868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1280eaf6-1765-4c60-8ca6-0ca96af9d6fd tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] Action: 'create', calling method: .version_select at 0x7fc819e91d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-569060780", "metadata": {"Type": "work"}}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1280eaf6-1765-4c60-8ca6-0ca96af9d6fd tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] Request method failure captured: May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 121 May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVn1uItwyxm-L4CrYrkBhN4aW-9Q4mkcB1bXRjWWot2MTuBd35qfvK4adaU6QnBX4vst0WWoErbyQnjns1_rw_LV8rRosfZbvWFZ5upmQAEiavK4sdAqTzsIc0b9pIEZS1ChNBxavg5iOcDgRKEQAYdUsQ3Ds62jY936OutBO68zRq0 May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 3b83d69521f44cc585474089a196f081 May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-VolumesNegativeTest-949873990 May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3b83d69521f44cc585474089a196f081"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b83d69521f44cc585474089a196f081"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3b83d69521f44cc585474089a196f081", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b83d69521f44cc585474089a196f081"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-VolumesNegativeTest-949873990 May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 3b83d69521f44cc585474089a196f081 May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-VolumesNegativeTest-949873990 May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-VolumesNegativeTest-949873990-project May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 031d3885473443de8e929b53b6862306 May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-VolumesNegativeTest-949873990-project May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-569060780", "metadata": {"Type": "work"}}} May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-569060780', 'metadata': {'Type': 'work'}}}} May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise error May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi On instance['volume']: May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi '#$%' May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:30:30.034100 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:30:30.037768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 21 21:30:30.037768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:30.037768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:30.037768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:30.037768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:30.037768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:30.037768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:30.037768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:30:30.037768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:30:30.037768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 21 21:30:30.037768 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:30.039870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1280eaf6-1765-4c60-8ca6-0ca96af9d6fd tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:30:30.041136 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1280eaf6-1765-4c60-8ca6-0ca96af9d6fd tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.479734 May 21 21:30:30.041959 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2257/4637] 10.222.0.49 () {60 vars in 1155 bytes} [Sat May 21 21:30:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 481 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 21 21:30:30.052899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-67a1de6f-41fe-4689-9b74-9caaf2149ea5 tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] Action: 'create', calling method: .version_select at 0x7fc81a5e9280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1390435931", "metadata": {"Type": "work"}}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-67a1de6f-41fe-4689-9b74-9caaf2149ea5 tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] Request method failure captured: May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 120 May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVn1uItwyxm-L4CrYrkBhN4aW-9Q4mkcB1bXRjWWot2MTuBd35qfvK4adaU6QnBX4vst0WWoErbyQnjns1_rw_LV8rRosfZbvWFZ5upmQAEiavK4sdAqTzsIc0b9pIEZS1ChNBxavg5iOcDgRKEQAYdUsQ3Ds62jY936OutBO68zRq0 May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 3b83d69521f44cc585474089a196f081 May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-VolumesNegativeTest-949873990 May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3b83d69521f44cc585474089a196f081"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b83d69521f44cc585474089a196f081"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3b83d69521f44cc585474089a196f081", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b83d69521f44cc585474089a196f081"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-VolumesNegativeTest-949873990 May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 3b83d69521f44cc585474089a196f081 May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-VolumesNegativeTest-949873990 May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-VolumesNegativeTest-949873990-project May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 031d3885473443de8e929b53b6862306 May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-VolumesNegativeTest-949873990-project May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1390435931", "metadata": {"Type": "work"}}} May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1390435931', 'metadata': {'Type': 'work'}}}} May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise error May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi On instance['volume']: May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi '0' May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:30:30.061276 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:30:30.066449 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 21 21:30:30.066449 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.066449 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:30.066449 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.066449 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:30.066449 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:30.066449 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:30.066449 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:30:30.066449 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:30:30.066449 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 21 21:30:30.066449 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.066449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-67a1de6f-41fe-4689-9b74-9caaf2149ea5 tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:30:30.066449 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-67a1de6f-41fe-4689-9b74-9caaf2149ea5 tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009728 May 21 21:30:30.066449 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2381/4638] 10.222.0.49 () {60 vars in 1155 bytes} [Sat May 21 21:30:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:30:30.076771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dd5c75ca-60ed-462a-bf26-acaa36fd4289 tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] Action: 'create', calling method: .version_select at 0x7fc819eb50d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-585614933", "metadata": {"Type": "work"}}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dd5c75ca-60ed-462a-bf26-acaa36fd4289 tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] Request method failure captured: May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 118 May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVn1uItwyxm-L4CrYrkBhN4aW-9Q4mkcB1bXRjWWot2MTuBd35qfvK4adaU6QnBX4vst0WWoErbyQnjns1_rw_LV8rRosfZbvWFZ5upmQAEiavK4sdAqTzsIc0b9pIEZS1ChNBxavg5iOcDgRKEQAYdUsQ3Ds62jY936OutBO68zRq0 May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 3b83d69521f44cc585474089a196f081 May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-VolumesNegativeTest-949873990 May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3b83d69521f44cc585474089a196f081"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b83d69521f44cc585474089a196f081"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3b83d69521f44cc585474089a196f081", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b83d69521f44cc585474089a196f081"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-VolumesNegativeTest-949873990 May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 3b83d69521f44cc585474089a196f081 May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-VolumesNegativeTest-949873990 May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-VolumesNegativeTest-949873990-project May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 031d3885473443de8e929b53b6862306 May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-VolumesNegativeTest-949873990-project May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-585614933", "metadata": {"Type": "work"}}} May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-585614933', 'metadata': {'Type': 'work'}}}} May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise error May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi On instance['volume']: May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi '' May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:30:30.086043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:30:30.089676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 21 21:30:30.089676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:30.089676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:30.089676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:30.089676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:30.089676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:30.089676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:30.089676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:30:30.089676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:30:30.089676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 21 21:30:30.089676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:30.089676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dd5c75ca-60ed-462a-bf26-acaa36fd4289 tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:30:30.098874 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dd5c75ca-60ed-462a-bf26-acaa36fd4289 tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026983 May 21 21:30:30.101702 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2258/4639] 10.222.0.49 () {60 vars in 1155 bytes} [Sat May 21 21:30:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:30:30.110928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e0297d31-8dfa-4986-9e3a-8ec70512275d tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] Calling method '.version_select at 0x7fc81a4fe430>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:30.143072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-38fbfa45-a722-47bb-9928-0838d17ecffc tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1107221228", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "88d40858-d8e8-4c97-8084-13382fa527f6"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:30.171325 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-e0297d31-8dfa-4986-9e3a-8ec70512275d tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] HTTP exception thrown: Volume tempest-invalid-65922089 could not be found. May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e0297d31-8dfa-4986-9e3a-8ec70512275d tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] Request method failure captured: May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-65922089 HTTP/1.1 May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVn1uItwyxm-L4CrYrkBhN4aW-9Q4mkcB1bXRjWWot2MTuBd35qfvK4adaU6QnBX4vst0WWoErbyQnjns1_rw_LV8rRosfZbvWFZ5upmQAEiavK4sdAqTzsIc0b9pIEZS1ChNBxavg5iOcDgRKEQAYdUsQ3Ds62jY936OutBO68zRq0 May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 3b83d69521f44cc585474089a196f081 May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-VolumesNegativeTest-949873990 May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3b83d69521f44cc585474089a196f081"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b83d69521f44cc585474089a196f081"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3b83d69521f44cc585474089a196f081", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b83d69521f44cc585474089a196f081"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-VolumesNegativeTest-949873990 May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 3b83d69521f44cc585474089a196f081 May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-VolumesNegativeTest-949873990 May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-VolumesNegativeTest-949873990-project May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 031d3885473443de8e929b53b6862306 May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-VolumesNegativeTest-949873990-project May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: exception: Volume tempest-invalid-65922089 could not be found. May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'tempest-invalid-65922089'} May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-65922089 could not be found. (HTTP 404) (Request-ID: req-19195ce9-ac2c-43dd-83ab-eef00fee8321) May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 21 21:30:30.173224 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-65922089 could not be found. May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-65922089 could not be found. May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-65922089 could not be found. May 21 21:30:30.177240 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.181537 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e0297d31-8dfa-4986-9e3a-8ec70512275d tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] Returning 404 to user: Volume tempest-invalid-65922089 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:30:30.181537 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e0297d31-8dfa-4986-9e3a-8ec70512275d tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-65922089" status: 404 len: 97 microversion: 2.1 time: 0.075776 May 21 21:30:30.187457 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2382/4640] 10.222.0.49 () {58 vars in 1211 bytes} [Sat May 21 21:30:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-65922089 => generated 97 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:30:30.195314 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8b5ba5cc-3bef-489b-883a-da921c41d72b tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006421 May 21 21:30:30.198964 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2383/4641] 10.222.0.49 () {58 vars in 1139 bytes} [Sat May 21 21:30:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 21 21:30:30.208820 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-43bdc111-0a8d-4ba3-8493-8961645d3c7f tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005662 May 21 21:30:30.210863 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2384/4642] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:30:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 21 21:30:30.224601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3c67e4b8-4ffd-4bcc-9c27-51f2d97670e0 tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] Calling method '.version_select at 0x7fc81a4fe0d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:30.278601 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-3c67e4b8-4ffd-4bcc-9c27-51f2d97670e0 tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] HTTP exception thrown: Volume 4bd0d547-69a0-4212-97a5-0661b46fbb4d could not be found. May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3c67e4b8-4ffd-4bcc-9c27-51f2d97670e0 tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] Request method failure captured: May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/os-volumes/4bd0d547-69a0-4212-97a5-0661b46fbb4d HTTP/1.1 May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVn1uItwyxm-L4CrYrkBhN4aW-9Q4mkcB1bXRjWWot2MTuBd35qfvK4adaU6QnBX4vst0WWoErbyQnjns1_rw_LV8rRosfZbvWFZ5upmQAEiavK4sdAqTzsIc0b9pIEZS1ChNBxavg5iOcDgRKEQAYdUsQ3Ds62jY936OutBO68zRq0 May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 3b83d69521f44cc585474089a196f081 May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-VolumesNegativeTest-949873990 May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3b83d69521f44cc585474089a196f081"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b83d69521f44cc585474089a196f081"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3b83d69521f44cc585474089a196f081", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b83d69521f44cc585474089a196f081"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-VolumesNegativeTest-949873990 May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 3b83d69521f44cc585474089a196f081 May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-VolumesNegativeTest-949873990 May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-VolumesNegativeTest-949873990-project May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 031d3885473443de8e929b53b6862306 May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-VolumesNegativeTest-949873990-project May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: exception: Volume 4bd0d547-69a0-4212-97a5-0661b46fbb4d could not be found. May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '4bd0d547-69a0-4212-97a5-0661b46fbb4d'} May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4bd0d547-69a0-4212-97a5-0661b46fbb4d could not be found. (HTTP 404) (Request-ID: req-4f97125b-1841-43d6-a7fa-966d14a53673) May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 21 21:30:30.293361 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4bd0d547-69a0-4212-97a5-0661b46fbb4d could not be found. May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4bd0d547-69a0-4212-97a5-0661b46fbb4d could not be found. May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4bd0d547-69a0-4212-97a5-0661b46fbb4d could not be found. May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3c67e4b8-4ffd-4bcc-9c27-51f2d97670e0 tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] Returning 404 to user: Volume 4bd0d547-69a0-4212-97a5-0661b46fbb4d could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3c67e4b8-4ffd-4bcc-9c27-51f2d97670e0 tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/4bd0d547-69a0-4212-97a5-0661b46fbb4d" status: 404 len: 109 microversion: 2.1 time: 0.078498 May 21 21:30:30.297969 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2385/4643] 10.222.0.49 () {58 vars in 1247 bytes} [Sat May 21 21:30:30 2022] DELETE /compute/v2.1/os-volumes/4bd0d547-69a0-4212-97a5-0661b46fbb4d => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:30:30.303117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-38fbfa45-a722-47bb-9928-0838d17ecffc tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] validate_networks() for [('88d40858-d8e8-4c97-8084-13382fa527f6', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:30:30.313434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3f0913d4-851f-4cd2-a853-6c615f3dfb3d tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] Calling method '.version_select at 0x7fc81a413b80>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:30.369586 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-3f0913d4-851f-4cd2-a853-6c615f3dfb3d tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] HTTP exception thrown: Volume eb879fed-49e8-4a44-afe6-0ea589a5c908 could not be found. May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3f0913d4-851f-4cd2-a853-6c615f3dfb3d tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] Request method failure captured: May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/os-volumes/eb879fed-49e8-4a44-afe6-0ea589a5c908 HTTP/1.1 May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVn1uItwyxm-L4CrYrkBhN4aW-9Q4mkcB1bXRjWWot2MTuBd35qfvK4adaU6QnBX4vst0WWoErbyQnjns1_rw_LV8rRosfZbvWFZ5upmQAEiavK4sdAqTzsIc0b9pIEZS1ChNBxavg5iOcDgRKEQAYdUsQ3Ds62jY936OutBO68zRq0 May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 3b83d69521f44cc585474089a196f081 May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-VolumesNegativeTest-949873990 May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3b83d69521f44cc585474089a196f081"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b83d69521f44cc585474089a196f081"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3b83d69521f44cc585474089a196f081", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b83d69521f44cc585474089a196f081"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-VolumesNegativeTest-949873990 May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 3b83d69521f44cc585474089a196f081 May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-VolumesNegativeTest-949873990 May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-VolumesNegativeTest-949873990-project May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 031d3885473443de8e929b53b6862306 May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-VolumesNegativeTest-949873990-project May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: method: May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: exception: Volume eb879fed-49e8-4a44-afe6-0ea589a5c908 could not be found. May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'eb879fed-49e8-4a44-afe6-0ea589a5c908'} May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi item = cinderclient( May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb879fed-49e8-4a44-afe6-0ea589a5c908 could not be found. (HTTP 404) (Request-ID: req-882bef2a-7074-4a3d-bdc1-f310abb241ca) May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 21 21:30:30.371925 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi item = cinderclient( May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb879fed-49e8-4a44-afe6-0ea589a5c908 could not be found. May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb879fed-49e8-4a44-afe6-0ea589a5c908 could not be found. May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb879fed-49e8-4a44-afe6-0ea589a5c908 could not be found. May 21 21:30:30.375910 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:30.383119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3f0913d4-851f-4cd2-a853-6c615f3dfb3d tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] Returning 404 to user: Volume eb879fed-49e8-4a44-afe6-0ea589a5c908 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:30:30.384496 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3f0913d4-851f-4cd2-a853-6c615f3dfb3d tempest-VolumesNegativeTest-949873990 tempest-VolumesNegativeTest-949873990-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/eb879fed-49e8-4a44-afe6-0ea589a5c908" status: 404 len: 109 microversion: 2.1 time: 0.081325 May 21 21:30:30.391302 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2386/4644] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:30:30 2022] GET /compute/v2.1/os-volumes/eb879fed-49e8-4a44-afe6-0ea589a5c908 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:30:30.400599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-37b9406f-721b-4439-9d2a-6025d3795e2c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:30.401284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-37b9406f-721b-4439-9d2a-6025d3795e2c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:30.415681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-37b9406f-721b-4439-9d2a-6025d3795e2c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:30.416140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-37b9406f-721b-4439-9d2a-6025d3795e2c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:30.422254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-37b9406f-721b-4439-9d2a-6025d3795e2c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:30.422960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-37b9406f-721b-4439-9d2a-6025d3795e2c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:30.994723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-37b9406f-721b-4439-9d2a-6025d3795e2c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:31.007102 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-37b9406f-721b-4439-9d2a-6025d3795e2c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1522 microversion: 2.1 time: 0.613969 May 21 21:30:31.007695 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2387/4645] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:30 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1522 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:31.238933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-38fbfa45-a722-47bb-9928-0838d17ecffc tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:30:31.240868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-38fbfa45-a722-47bb-9928-0838d17ecffc tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:30:31.240868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-38fbfa45-a722-47bb-9928-0838d17ecffc tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:30:31.240868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-38fbfa45-a722-47bb-9928-0838d17ecffc tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:30:31.241190 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-38fbfa45-a722-47bb-9928-0838d17ecffc tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:30:31.305110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38fbfa45-a722-47bb-9928-0838d17ecffc tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:31.306005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38fbfa45-a722-47bb-9928-0838d17ecffc tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:31.307301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38fbfa45-a722-47bb-9928-0838d17ecffc tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:31.308039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38fbfa45-a722-47bb-9928-0838d17ecffc tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:31.378420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-38fbfa45-a722-47bb-9928-0838d17ecffc tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Getting quotas for project 4dbb4bbc88f84520885c00a376ba0f7c. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:30:31.388618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-38fbfa45-a722-47bb-9928-0838d17ecffc tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Getting quotas for user c67dc8226610413a8bb889d6055a75d2 and project 4dbb4bbc88f84520885c00a376ba0f7c. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:30:31.419345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-38fbfa45-a722-47bb-9928-0838d17ecffc tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:30:31.421975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-38fbfa45-a722-47bb-9928-0838d17ecffc tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:30:31.635324 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-38fbfa45-a722-47bb-9928-0838d17ecffc tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.502274 May 21 21:30:31.635963 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2259/4646] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:30:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:30:31.648057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b2285135-744f-474b-ad5e-6c3133fa13d2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:31.648788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b2285135-744f-474b-ad5e-6c3133fa13d2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:31.832660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b2285135-744f-474b-ad5e-6c3133fa13d2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:31.846692 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b2285135-744f-474b-ad5e-6c3133fa13d2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1209 microversion: 2.1 time: 0.203955 May 21 21:30:31.848622 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2388/4647] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:31 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1209 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:32.024446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2131690a-69d1-4c4c-af7b-5cdc7c1c3d52 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:32.025680 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2131690a-69d1-4c4c-af7b-5cdc7c1c3d52 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:32.038817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2131690a-69d1-4c4c-af7b-5cdc7c1c3d52 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:32.043258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2131690a-69d1-4c4c-af7b-5cdc7c1c3d52 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:32.044524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2131690a-69d1-4c4c-af7b-5cdc7c1c3d52 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:32.046883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2131690a-69d1-4c4c-af7b-5cdc7c1c3d52 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:32.610009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2131690a-69d1-4c4c-af7b-5cdc7c1c3d52 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:32.624341 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2131690a-69d1-4c4c-af7b-5cdc7c1c3d52 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1522 microversion: 2.1 time: 0.603430 May 21 21:30:32.626028 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2260/4648] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:32 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1522 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:32.866948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6a5e91ea-6574-4439-85e1-7ff5725f95f0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:32.867867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6a5e91ea-6574-4439-85e1-7ff5725f95f0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:33.077198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6a5e91ea-6574-4439-85e1-7ff5725f95f0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:33.089080 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6a5e91ea-6574-4439-85e1-7ff5725f95f0 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1209 microversion: 2.1 time: 0.229800 May 21 21:30:33.091244 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2389/4649] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:32 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1209 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:33.670561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-645f8917-0cb9-4cdc-8904-9cd9306f003f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:33.672548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-645f8917-0cb9-4cdc-8904-9cd9306f003f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:33.682994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-645f8917-0cb9-4cdc-8904-9cd9306f003f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:33.688247 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-645f8917-0cb9-4cdc-8904-9cd9306f003f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:33.691520 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-645f8917-0cb9-4cdc-8904-9cd9306f003f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:33.692194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-645f8917-0cb9-4cdc-8904-9cd9306f003f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:34.112564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2de3e1ab-5acd-457d-a6e5-e955a6d532d1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:34.114453 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2de3e1ab-5acd-457d-a6e5-e955a6d532d1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:34.129428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2de3e1ab-5acd-457d-a6e5-e955a6d532d1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:34.132746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2de3e1ab-5acd-457d-a6e5-e955a6d532d1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:34.138328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2de3e1ab-5acd-457d-a6e5-e955a6d532d1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:34.139904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2de3e1ab-5acd-457d-a6e5-e955a6d532d1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:34.211500 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-645f8917-0cb9-4cdc-8904-9cd9306f003f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:34.224732 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-645f8917-0cb9-4cdc-8904-9cd9306f003f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1522 microversion: 2.1 time: 0.586145 May 21 21:30:34.246812 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2261/4650] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:33 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1522 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:34.334995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2de3e1ab-5acd-457d-a6e5-e955a6d532d1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:34.346124 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2de3e1ab-5acd-457d-a6e5-e955a6d532d1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1261 microversion: 2.1 time: 0.240977 May 21 21:30:34.347015 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2390/4651] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:34 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1261 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:35.253547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-16d68e2c-1bb6-4c0d-850f-5ccf81f32d8a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:35.264111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-16d68e2c-1bb6-4c0d-850f-5ccf81f32d8a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:35.286762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-16d68e2c-1bb6-4c0d-850f-5ccf81f32d8a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:35.296448 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-16d68e2c-1bb6-4c0d-850f-5ccf81f32d8a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:35.296448 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-16d68e2c-1bb6-4c0d-850f-5ccf81f32d8a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:35.296448 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-16d68e2c-1bb6-4c0d-850f-5ccf81f32d8a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:35.364892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aa71967f-b703-4082-82e2-e463c450e50e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:35.366364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aa71967f-b703-4082-82e2-e463c450e50e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:35.389941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa71967f-b703-4082-82e2-e463c450e50e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:35.390900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa71967f-b703-4082-82e2-e463c450e50e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:35.410305 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa71967f-b703-4082-82e2-e463c450e50e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:35.411117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa71967f-b703-4082-82e2-e463c450e50e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:35.622178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aa71967f-b703-4082-82e2-e463c450e50e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:35.637871 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aa71967f-b703-4082-82e2-e463c450e50e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1279 microversion: 2.1 time: 0.277483 May 21 21:30:35.640358 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2391/4652] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:35 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1279 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:36.665283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-39c38d94-480f-4e4b-973f-90b256b8e011 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:36.666608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-39c38d94-480f-4e4b-973f-90b256b8e011 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:36.691130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39c38d94-480f-4e4b-973f-90b256b8e011 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:36.701929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39c38d94-480f-4e4b-973f-90b256b8e011 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:36.707718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39c38d94-480f-4e4b-973f-90b256b8e011 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:36.714006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39c38d94-480f-4e4b-973f-90b256b8e011 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:36.744624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:36.871066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-16d68e2c-1bb6-4c0d-850f-5ccf81f32d8a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:36.888556 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-16d68e2c-1bb6-4c0d-850f-5ccf81f32d8a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1522 microversion: 2.1 time: 1.644501 May 21 21:30:36.903667 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2262/4653] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:35 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1522 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:36.945217 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-39c38d94-480f-4e4b-973f-90b256b8e011 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:36.958794 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-39c38d94-480f-4e4b-973f-90b256b8e011 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1267 microversion: 2.1 time: 0.296096 May 21 21:30:36.971738 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2392/4654] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:36 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1267 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:30:37.909585 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ce20eb78-2f20-4573-b62f-c606b2023e05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:37.910787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ce20eb78-2f20-4573-b62f-c606b2023e05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:37.928181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ce20eb78-2f20-4573-b62f-c606b2023e05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:37.930608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ce20eb78-2f20-4573-b62f-c606b2023e05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:37.936843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ce20eb78-2f20-4573-b62f-c606b2023e05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:37.943450 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ce20eb78-2f20-4573-b62f-c606b2023e05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:37.977697 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fbd09c51-8cf1-477b-b0c7-8b8489b48053 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:37.978374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fbd09c51-8cf1-477b-b0c7-8b8489b48053 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:38.001326 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbd09c51-8cf1-477b-b0c7-8b8489b48053 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:38.002124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbd09c51-8cf1-477b-b0c7-8b8489b48053 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:38.003105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbd09c51-8cf1-477b-b0c7-8b8489b48053 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:38.003692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbd09c51-8cf1-477b-b0c7-8b8489b48053 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:38.230140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fbd09c51-8cf1-477b-b0c7-8b8489b48053 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:38.248247 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fbd09c51-8cf1-477b-b0c7-8b8489b48053 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1267 microversion: 2.1 time: 0.275126 May 21 21:30:38.259004 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2393/4655] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:37 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1267 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:38.351561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ce20eb78-2f20-4573-b62f-c606b2023e05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:38.360591 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ce20eb78-2f20-4573-b62f-c606b2023e05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1522 microversion: 2.1 time: 0.456879 May 21 21:30:38.370673 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2263/4656] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:37 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:39.267309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5f0a213e-1949-4f1e-887f-57be228f2512 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:39.268033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5f0a213e-1949-4f1e-887f-57be228f2512 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:39.285483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5f0a213e-1949-4f1e-887f-57be228f2512 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:39.291538 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5f0a213e-1949-4f1e-887f-57be228f2512 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:39.295287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5f0a213e-1949-4f1e-887f-57be228f2512 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:39.295781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5f0a213e-1949-4f1e-887f-57be228f2512 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:39.380873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0bf1548d-7cb1-47d2-8bc5-c9a3e1089b51 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:39.381502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0bf1548d-7cb1-47d2-8bc5-c9a3e1089b51 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:39.384830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:39.414827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bf1548d-7cb1-47d2-8bc5-c9a3e1089b51 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:39.415346 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bf1548d-7cb1-47d2-8bc5-c9a3e1089b51 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:39.416202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bf1548d-7cb1-47d2-8bc5-c9a3e1089b51 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:39.416683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bf1548d-7cb1-47d2-8bc5-c9a3e1089b51 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:39.837833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5f0a213e-1949-4f1e-887f-57be228f2512 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:39.860760 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5f0a213e-1949-4f1e-887f-57be228f2512 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1309 microversion: 2.1 time: 0.587700 May 21 21:30:39.860760 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2394/4657] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:39 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1309 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:40.636925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0bf1548d-7cb1-47d2-8bc5-c9a3e1089b51 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:40.646476 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0bf1548d-7cb1-47d2-8bc5-c9a3e1089b51 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1522 microversion: 2.1 time: 1.272582 May 21 21:30:40.651065 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2264/4658] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:39 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1522 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:30:40.869124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3f6f16c4-84fe-4aa9-aa59-65c8c44e0409 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:40.870476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3f6f16c4-84fe-4aa9-aa59-65c8c44e0409 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:40.888041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f6f16c4-84fe-4aa9-aa59-65c8c44e0409 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:40.889108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f6f16c4-84fe-4aa9-aa59-65c8c44e0409 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:40.893965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f6f16c4-84fe-4aa9-aa59-65c8c44e0409 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:40.894645 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f6f16c4-84fe-4aa9-aa59-65c8c44e0409 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:41.261148 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3f6f16c4-84fe-4aa9-aa59-65c8c44e0409 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:41.312742 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3f6f16c4-84fe-4aa9-aa59-65c8c44e0409 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1309 microversion: 2.1 time: 0.447610 May 21 21:30:41.314132 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2395/4659] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:40 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1309 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:41.671082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-422dbe90-1fbf-4aa0-b77b-55ea86fbf13c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:41.671944 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-422dbe90-1fbf-4aa0-b77b-55ea86fbf13c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:41.674411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:41.675966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:41.682202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-422dbe90-1fbf-4aa0-b77b-55ea86fbf13c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:41.714268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-422dbe90-1fbf-4aa0-b77b-55ea86fbf13c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:41.714268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-422dbe90-1fbf-4aa0-b77b-55ea86fbf13c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:41.714268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-422dbe90-1fbf-4aa0-b77b-55ea86fbf13c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:42.304439 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-422dbe90-1fbf-4aa0-b77b-55ea86fbf13c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:42.318471 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-422dbe90-1fbf-4aa0-b77b-55ea86fbf13c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1522 microversion: 2.1 time: 0.656494 May 21 21:30:42.330931 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2265/4660] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:41 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1522 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:42.341353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-58814c9d-dddd-4d17-8dfb-babfff27e5e7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:42.342057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-58814c9d-dddd-4d17-8dfb-babfff27e5e7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:42.358258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-58814c9d-dddd-4d17-8dfb-babfff27e5e7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:42.358725 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-58814c9d-dddd-4d17-8dfb-babfff27e5e7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:42.362361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-58814c9d-dddd-4d17-8dfb-babfff27e5e7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:42.362361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-58814c9d-dddd-4d17-8dfb-babfff27e5e7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:42.813267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-58814c9d-dddd-4d17-8dfb-babfff27e5e7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:42.826043 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-58814c9d-dddd-4d17-8dfb-babfff27e5e7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1309 microversion: 2.1 time: 0.498278 May 21 21:30:42.841139 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2396/4661] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:42 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1309 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:42.846038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-d7e1f969-66a4-43e5-977e-644e63bbd87c req-90906e8e-8da3-4d8b-a9e7-6ee8f4e5333b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ab4f419-8067-4d96-bfd0-a5866cfd3ad5", "tag": "cc697345-1357-4c21-860a-bbf572179745"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:42.858481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-d7e1f969-66a4-43e5-977e-644e63bbd87c req-90906e8e-8da3-4d8b-a9e7-6ee8f4e5333b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:42.859061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-d7e1f969-66a4-43e5-977e-644e63bbd87c req-90906e8e-8da3-4d8b-a9e7-6ee8f4e5333b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:42.872190 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-d7e1f969-66a4-43e5-977e-644e63bbd87c req-90906e8e-8da3-4d8b-a9e7-6ee8f4e5333b service nova] Creating event network-changed:cc697345-1357-4c21-860a-bbf572179745 for instance 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 on nch2-master-1 May 21 21:30:42.878372 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-d7e1f969-66a4-43e5-977e-644e63bbd87c req-90906e8e-8da3-4d8b-a9e7-6ee8f4e5333b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038157 May 21 21:30:42.879573 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2266/4662] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:30:43.333335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:43.337660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-01b1d94b-7466-4240-bb16-dbc93f5d367e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:43.338630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-01b1d94b-7466-4240-bb16-dbc93f5d367e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:43.359524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-01b1d94b-7466-4240-bb16-dbc93f5d367e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:43.362152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-01b1d94b-7466-4240-bb16-dbc93f5d367e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:43.366959 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-01b1d94b-7466-4240-bb16-dbc93f5d367e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:43.367614 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-01b1d94b-7466-4240-bb16-dbc93f5d367e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:43.860410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-71f3b019-302f-464d-a085-234bdac257aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:43.861191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-71f3b019-302f-464d-a085-234bdac257aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:43.873603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71f3b019-302f-464d-a085-234bdac257aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:43.874059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71f3b019-302f-464d-a085-234bdac257aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:43.875190 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71f3b019-302f-464d-a085-234bdac257aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:43.881194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71f3b019-302f-464d-a085-234bdac257aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:43.942614 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-01b1d94b-7466-4240-bb16-dbc93f5d367e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:43.957308 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-01b1d94b-7466-4240-bb16-dbc93f5d367e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1522 microversion: 2.1 time: 0.624766 May 21 21:30:43.958348 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2397/4663] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:43 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1522 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:44.460169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-71f3b019-302f-464d-a085-234bdac257aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:44.477042 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-71f3b019-302f-464d-a085-234bdac257aa tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1309 microversion: 2.1 time: 0.621385 May 21 21:30:44.478523 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2267/4664] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:43 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1309 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:30:44.975528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-abcf25cb-dfba-441f-b8b7-4e3bccc15c05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:44.976146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-abcf25cb-dfba-441f-b8b7-4e3bccc15c05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:44.985144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-abcf25cb-dfba-441f-b8b7-4e3bccc15c05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:44.985879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-abcf25cb-dfba-441f-b8b7-4e3bccc15c05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:44.986662 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-abcf25cb-dfba-441f-b8b7-4e3bccc15c05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:44.987318 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-abcf25cb-dfba-441f-b8b7-4e3bccc15c05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:45.391973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-abcf25cb-dfba-441f-b8b7-4e3bccc15c05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:45.431948 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-abcf25cb-dfba-441f-b8b7-4e3bccc15c05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1522 microversion: 2.1 time: 0.456342 May 21 21:30:45.435312 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2398/4665] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:44 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1522 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:45.495331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e39d13fe-f87e-4ef2-8cc2-1971199e8438 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:45.495966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e39d13fe-f87e-4ef2-8cc2-1971199e8438 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:45.508892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e39d13fe-f87e-4ef2-8cc2-1971199e8438 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:45.510853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e39d13fe-f87e-4ef2-8cc2-1971199e8438 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:45.513841 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e39d13fe-f87e-4ef2-8cc2-1971199e8438 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:45.514304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e39d13fe-f87e-4ef2-8cc2-1971199e8438 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:45.810318 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e39d13fe-f87e-4ef2-8cc2-1971199e8438 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:45.813628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:45.822068 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e39d13fe-f87e-4ef2-8cc2-1971199e8438 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1309 microversion: 2.1 time: 0.330869 May 21 21:30:45.822668 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2268/4666] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:45 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1309 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:46.456234 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-46df90fb-4dc0-407d-a648-dcd3ce8b3b78 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:46.458522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-46df90fb-4dc0-407d-a648-dcd3ce8b3b78 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:46.466632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46df90fb-4dc0-407d-a648-dcd3ce8b3b78 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:46.467085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46df90fb-4dc0-407d-a648-dcd3ce8b3b78 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:46.467876 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46df90fb-4dc0-407d-a648-dcd3ce8b3b78 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:46.469266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46df90fb-4dc0-407d-a648-dcd3ce8b3b78 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:46.825192 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-46df90fb-4dc0-407d-a648-dcd3ce8b3b78 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:46.839110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4c2658e5-60b1-474c-991f-57fd78176cf3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:46.839730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4c2658e5-60b1-474c-991f-57fd78176cf3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:46.846144 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-46df90fb-4dc0-407d-a648-dcd3ce8b3b78 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1522 microversion: 2.1 time: 0.394919 May 21 21:30:46.849399 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2399/4667] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:46 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1522 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:46.866757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4c2658e5-60b1-474c-991f-57fd78176cf3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:46.868444 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4c2658e5-60b1-474c-991f-57fd78176cf3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:46.869976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4c2658e5-60b1-474c-991f-57fd78176cf3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:46.870699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4c2658e5-60b1-474c-991f-57fd78176cf3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:48.041791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4c2658e5-60b1-474c-991f-57fd78176cf3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:48.065820 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4c2658e5-60b1-474c-991f-57fd78176cf3 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1309 microversion: 2.1 time: 1.229241 May 21 21:30:48.067703 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2269/4668] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:46 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1309 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:48.068644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-70a4c18e-137c-43a8-af39-352daa633c06 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Action: 'create', calling method: .version_select at 0x7fc81a51c4c0>, body: {"keypair": {"name": "tempest-keypair-70569514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3Zv94gAuqi/0LJvfgIozougjXo54yNsE/yOPMPPItt9bcdNqeQdS30cEn03NLcwPtjI9eadh831Rdp+iN5yzM+qWI3qMNpFqg9M07VH+PON83NJUIV68/SrCPNGoI4jg=="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:48.082747 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eca166db-18e4-49d2-b9ed-32b7161fb3a3 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:48.083636 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-eca166db-18e4-49d2-b9ed-32b7161fb3a3 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:48.089457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-70a4c18e-137c-43a8-af39-352daa633c06 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Getting quotas for project dbeaf54409d44d0abe3cd6c176fa7ea4. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:30:48.096494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-70a4c18e-137c-43a8-af39-352daa633c06 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Getting quotas for user 66b6501f7543485db27a33dd1a1a8400 and project dbeaf54409d44d0abe3cd6c176fa7ea4. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:30:48.103596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eca166db-18e4-49d2-b9ed-32b7161fb3a3 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:48.105633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eca166db-18e4-49d2-b9ed-32b7161fb3a3 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:48.108072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eca166db-18e4-49d2-b9ed-32b7161fb3a3 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:48.110823 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eca166db-18e4-49d2-b9ed-32b7161fb3a3 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:48.294760 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-70a4c18e-137c-43a8-af39-352daa633c06 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.765131 May 21 21:30:48.294760 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2400/4669] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:30:47 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:30:48.489299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-eca166db-18e4-49d2-b9ed-32b7161fb3a3 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:48.489299 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-eca166db-18e4-49d2-b9ed-32b7161fb3a3 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1522 microversion: 2.1 time: 0.326467 May 21 21:30:48.489299 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2270/4670] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:48 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:49.088497 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-466f4d27-a782-442f-b0dc-8818e3a674d7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:49.093567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-466f4d27-a782-442f-b0dc-8818e3a674d7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:49.118008 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-466f4d27-a782-442f-b0dc-8818e3a674d7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:49.133452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-466f4d27-a782-442f-b0dc-8818e3a674d7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:49.133452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-466f4d27-a782-442f-b0dc-8818e3a674d7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:49.133452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-466f4d27-a782-442f-b0dc-8818e3a674d7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:49.722892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-466f4d27-a782-442f-b0dc-8818e3a674d7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:49.728690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7c388fe6-1933-4f66-8fee-37e8a5a83440 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1788997417", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:49.739431 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-466f4d27-a782-442f-b0dc-8818e3a674d7 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1309 microversion: 2.1 time: 0.659495 May 21 21:30:49.744055 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2401/4671] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:49 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1309 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:49.749550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-db058647-b0d7-4757-807e-bdd3ca894040 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:49.750182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-db058647-b0d7-4757-807e-bdd3ca894040 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:49.779013 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db058647-b0d7-4757-807e-bdd3ca894040 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:49.782171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db058647-b0d7-4757-807e-bdd3ca894040 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:49.786446 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db058647-b0d7-4757-807e-bdd3ca894040 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:49.786924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db058647-b0d7-4757-807e-bdd3ca894040 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:49.849867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-7c388fe6-1933-4f66-8fee-37e8a5a83440 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] validate_networks() for [('08704bbd-33da-45f4-ac41-9349866a62b3', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:30:50.135989 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-db058647-b0d7-4757-807e-bdd3ca894040 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:50.147827 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-db058647-b0d7-4757-807e-bdd3ca894040 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1522 microversion: 2.1 time: 0.402435 May 21 21:30:50.160693 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2402/4672] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:49 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:50.172822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-816ab056-e87d-458e-a4f2-6d7c430c9b25 req-405cad59-0056-4e0c-9c65-3c0b406d0ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ab4f419-8067-4d96-bfd0-a5866cfd3ad5", "name": "network-vif-plugged", "status": "completed", "tag": "cc697345-1357-4c21-860a-bbf572179745"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:50.193373 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-816ab056-e87d-458e-a4f2-6d7c430c9b25 req-405cad59-0056-4e0c-9c65-3c0b406d0ab8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:50.196740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-816ab056-e87d-458e-a4f2-6d7c430c9b25 req-405cad59-0056-4e0c-9c65-3c0b406d0ab8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:50.231218 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-816ab056-e87d-458e-a4f2-6d7c430c9b25 req-405cad59-0056-4e0c-9c65-3c0b406d0ab8 service nova] Creating event network-vif-plugged:cc697345-1357-4c21-860a-bbf572179745 for instance 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 on nch2-master-1 May 21 21:30:50.238950 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-816ab056-e87d-458e-a4f2-6d7c430c9b25 req-405cad59-0056-4e0c-9c65-3c0b406d0ab8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076790 May 21 21:30:50.239931 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2403/4673] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:30:50.702986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-7c388fe6-1933-4f66-8fee-37e8a5a83440 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:30:50.702986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-7c388fe6-1933-4f66-8fee-37e8a5a83440 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:30:50.702986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-7c388fe6-1933-4f66-8fee-37e8a5a83440 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:30:50.702986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-7c388fe6-1933-4f66-8fee-37e8a5a83440 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:30:50.705600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-7c388fe6-1933-4f66-8fee-37e8a5a83440 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:30:50.716081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c388fe6-1933-4f66-8fee-37e8a5a83440 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:50.716555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c388fe6-1933-4f66-8fee-37e8a5a83440 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:50.718081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c388fe6-1933-4f66-8fee-37e8a5a83440 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:50.718690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c388fe6-1933-4f66-8fee-37e8a5a83440 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:50.747517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-7c388fe6-1933-4f66-8fee-37e8a5a83440 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Getting quotas for project 27f0db8b0958479990724993361c0a51. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:30:50.754403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-7c388fe6-1933-4f66-8fee-37e8a5a83440 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Getting quotas for user 411af27147894e999b4242c5b9991c98 and project 27f0db8b0958479990724993361c0a51. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:30:50.762921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3b82ca50-d3ed-4eaa-b99e-91868898af78 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:50.763953 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3b82ca50-d3ed-4eaa-b99e-91868898af78 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:50.778801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b82ca50-d3ed-4eaa-b99e-91868898af78 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:50.779533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b82ca50-d3ed-4eaa-b99e-91868898af78 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:50.782918 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7c388fe6-1933-4f66-8fee-37e8a5a83440 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:30:50.783176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b82ca50-d3ed-4eaa-b99e-91868898af78 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:50.784053 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b82ca50-d3ed-4eaa-b99e-91868898af78 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:50.786068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7c388fe6-1933-4f66-8fee-37e8a5a83440 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:30:50.997277 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7c388fe6-1933-4f66-8fee-37e8a5a83440 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.708007 May 21 21:30:51.009254 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2271/4674] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:30:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:30:51.019794 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-669f569d-fca7-4068-960f-8d3f3f6499f3 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:51.020470 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-669f569d-fca7-4068-960f-8d3f3f6499f3 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:51.171609 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-669f569d-fca7-4068-960f-8d3f3f6499f3 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:51.181094 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-669f569d-fca7-4068-960f-8d3f3f6499f3 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1217 microversion: 2.1 time: 0.164682 May 21 21:30:51.182167 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2272/4675] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:51 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:51.206629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-05d607ec-e018-44c0-a2f4-3e53ab4eb5d5 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:51.210217 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-05d607ec-e018-44c0-a2f4-3e53ab4eb5d5 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:51.221265 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05d607ec-e018-44c0-a2f4-3e53ab4eb5d5 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:51.222011 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05d607ec-e018-44c0-a2f4-3e53ab4eb5d5 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:51.222982 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05d607ec-e018-44c0-a2f4-3e53ab4eb5d5 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:51.223588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05d607ec-e018-44c0-a2f4-3e53ab4eb5d5 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:51.335346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3b82ca50-d3ed-4eaa-b99e-91868898af78 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:51.352561 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3b82ca50-d3ed-4eaa-b99e-91868898af78 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1309 microversion: 2.1 time: 0.595368 May 21 21:30:51.353408 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2404/4676] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:50 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1309 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:51.681682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-05d607ec-e018-44c0-a2f4-3e53ab4eb5d5 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:51.702771 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-05d607ec-e018-44c0-a2f4-3e53ab4eb5d5 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1522 microversion: 2.1 time: 0.499790 May 21 21:30:51.704026 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2273/4677] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:51 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1522 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:52.202802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3da989e6-5b16-4131-b895-210dfe732769 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:52.203677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3da989e6-5b16-4131-b895-210dfe732769 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:52.304998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3da989e6-5b16-4131-b895-210dfe732769 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:52.318420 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3da989e6-5b16-4131-b895-210dfe732769 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1217 microversion: 2.1 time: 0.121852 May 21 21:30:52.318934 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2405/4678] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:52 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1217 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:52.371454 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d9261163-5a5e-4aea-a611-ab9da70ca1df tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:52.372638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d9261163-5a5e-4aea-a611-ab9da70ca1df tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:52.381101 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9261163-5a5e-4aea-a611-ab9da70ca1df tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:52.381709 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9261163-5a5e-4aea-a611-ab9da70ca1df tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:52.382646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9261163-5a5e-4aea-a611-ab9da70ca1df tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:52.383330 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9261163-5a5e-4aea-a611-ab9da70ca1df tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:52.699462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d9261163-5a5e-4aea-a611-ab9da70ca1df tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:52.708780 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d9261163-5a5e-4aea-a611-ab9da70ca1df tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1491 microversion: 2.1 time: 0.340978 May 21 21:30:52.710817 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2274/4679] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:52 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1491 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:52.723038 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-96c42da0-996c-46ce-a1df-fa2bfacd0b30 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:52.724338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-96c42da0-996c-46ce-a1df-fa2bfacd0b30 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:52.735326 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96c42da0-996c-46ce-a1df-fa2bfacd0b30 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:52.737589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96c42da0-996c-46ce-a1df-fa2bfacd0b30 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:52.740110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8d9a889d-ed2b-44e4-a7c3-9ccb0374dc8c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1335591316"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:52.740968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96c42da0-996c-46ce-a1df-fa2bfacd0b30 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:52.741474 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96c42da0-996c-46ce-a1df-fa2bfacd0b30 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:52.745183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8d9a889d-ed2b-44e4-a7c3-9ccb0374dc8c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:52.759059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d9a889d-ed2b-44e4-a7c3-9ccb0374dc8c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:52.760612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d9a889d-ed2b-44e4-a7c3-9ccb0374dc8c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:52.763899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d9a889d-ed2b-44e4-a7c3-9ccb0374dc8c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:52.764501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d9a889d-ed2b-44e4-a7c3-9ccb0374dc8c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:52.954098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-96c42da0-996c-46ce-a1df-fa2bfacd0b30 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:52.962839 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-96c42da0-996c-46ce-a1df-fa2bfacd0b30 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1522 microversion: 2.1 time: 0.247426 May 21 21:30:52.963446 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2406/4680] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:52 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:52.994547 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8d9a889d-ed2b-44e4-a7c3-9ccb0374dc8c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "PUT /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1076 microversion: 2.1 time: 0.262481 May 21 21:30:52.997198 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2275/4681] 10.222.0.49 () {60 vars in 1255 bytes} [Sat May 21 21:30:52 2022] PUT /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1076 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:53.009818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aaae5a4b-424d-410e-a815-c4f37d45d95e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:53.010471 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aaae5a4b-424d-410e-a815-c4f37d45d95e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:53.018529 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aaae5a4b-424d-410e-a815-c4f37d45d95e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:53.019010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aaae5a4b-424d-410e-a815-c4f37d45d95e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:53.019772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aaae5a4b-424d-410e-a815-c4f37d45d95e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:53.020495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aaae5a4b-424d-410e-a815-c4f37d45d95e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:53.208840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aaae5a4b-424d-410e-a815-c4f37d45d95e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:53.223898 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aaae5a4b-424d-410e-a815-c4f37d45d95e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1502 microversion: 2.1 time: 0.215649 May 21 21:30:53.226768 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2407/4682] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:53 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1502 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:53.241920 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ab0d3604-f9e4-49d6-850b-a1e69ddcac4c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:53.242547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ab0d3604-f9e4-49d6-850b-a1e69ddcac4c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:53.250677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab0d3604-f9e4-49d6-850b-a1e69ddcac4c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:53.251144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab0d3604-f9e4-49d6-850b-a1e69ddcac4c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:53.251994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab0d3604-f9e4-49d6-850b-a1e69ddcac4c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:53.252576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab0d3604-f9e4-49d6-850b-a1e69ddcac4c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:53.335748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-24636f65-d4d8-44bb-a887-04381444328b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:53.336751 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-24636f65-d4d8-44bb-a887-04381444328b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:53.344220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24636f65-d4d8-44bb-a887-04381444328b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:53.345206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24636f65-d4d8-44bb-a887-04381444328b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:53.346223 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24636f65-d4d8-44bb-a887-04381444328b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:53.346879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24636f65-d4d8-44bb-a887-04381444328b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:53.492524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-24636f65-d4d8-44bb-a887-04381444328b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:53.504048 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-24636f65-d4d8-44bb-a887-04381444328b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1221 microversion: 2.1 time: 0.172486 May 21 21:30:53.504843 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2408/4683] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:53 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1221 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:53.614142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ab0d3604-f9e4-49d6-850b-a1e69ddcac4c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:53.629879 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ab0d3604-f9e4-49d6-850b-a1e69ddcac4c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1502 microversion: 2.1 time: 0.392105 May 21 21:30:53.630536 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2276/4684] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:53 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1502 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:53.646824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-523c2beb-5ee0-4a00-a44c-d609b3fdf686 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:53.654633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-523c2beb-5ee0-4a00-a44c-d609b3fdf686 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:53.655794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-523c2beb-5ee0-4a00-a44c-d609b3fdf686 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:53.699715 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-523c2beb-5ee0-4a00-a44c-d609b3fdf686 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Going to try to stop instance {{(pid=131277) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 21 21:30:53.849460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bc817daa-4b44-46d2-925a-07b5167f278d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-146212513", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "86804df2-cb31-4df4-8335-5cf3b9dd4df4"}], "security_groups": [{"name": "tempest-securitygroup--316679318"}], "key_name": "tempest-keypair-70569514", "user_data": "}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:53.916629 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-523c2beb-5ee0-4a00-a44c-d609b3fdf686 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "POST /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5/action" status: 202 len: 0 microversion: 2.1 time: 0.273431 May 21 21:30:53.917423 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2409/4685] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:30:53 2022] POST /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 21 21:30:53.929053 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-84849a19-0ffd-418c-a706-46bdf5a1d495 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:53.929770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-84849a19-0ffd-418c-a706-46bdf5a1d495 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:53.936731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84849a19-0ffd-418c-a706-46bdf5a1d495 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:53.937213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84849a19-0ffd-418c-a706-46bdf5a1d495 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:53.938178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84849a19-0ffd-418c-a706-46bdf5a1d495 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:53.938754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84849a19-0ffd-418c-a706-46bdf5a1d495 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:53.963469 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:54.073890 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-bc817daa-4b44-46d2-925a-07b5167f278d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] validate_networks() for [('86804df2-cb31-4df4-8335-5cf3b9dd4df4', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:30:54.304678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-84849a19-0ffd-418c-a706-46bdf5a1d495 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:54.372554 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-84849a19-0ffd-418c-a706-46bdf5a1d495 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1512 microversion: 2.1 time: 0.443690 May 21 21:30:54.374658 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2410/4686] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:53 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1512 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:30:54.389897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ce23b71e-9547-4b24-aebc-78b1f420c273 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:54.396359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ce23b71e-9547-4b24-aebc-78b1f420c273 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:54.416710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce23b71e-9547-4b24-aebc-78b1f420c273 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:54.417177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce23b71e-9547-4b24-aebc-78b1f420c273 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:54.417976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce23b71e-9547-4b24-aebc-78b1f420c273 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:54.419707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce23b71e-9547-4b24-aebc-78b1f420c273 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:54.693484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ce23b71e-9547-4b24-aebc-78b1f420c273 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:54.705720 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ce23b71e-9547-4b24-aebc-78b1f420c273 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1522 microversion: 2.1 time: 0.326466 May 21 21:30:54.706569 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2411/4687] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:54 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:54.722132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8ec9dd54-c3cb-462b-a8ca-d62cb5ed05a1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:54.724560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8ec9dd54-c3cb-462b-a8ca-d62cb5ed05a1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:54.735123 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ec9dd54-c3cb-462b-a8ca-d62cb5ed05a1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:54.735596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ec9dd54-c3cb-462b-a8ca-d62cb5ed05a1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:54.736504 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ec9dd54-c3cb-462b-a8ca-d62cb5ed05a1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:54.736968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ec9dd54-c3cb-462b-a8ca-d62cb5ed05a1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:54.879020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8ec9dd54-c3cb-462b-a8ca-d62cb5ed05a1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:54.887944 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8ec9dd54-c3cb-462b-a8ca-d62cb5ed05a1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1287 microversion: 2.1 time: 0.179981 May 21 21:30:54.888843 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2412/4688] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:54 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1287 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:55.386193 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-604f9329-6fa2-4e16-a739-56c34acdbdee tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:55.386863 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-604f9329-6fa2-4e16-a739-56c34acdbdee tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:55.394279 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-604f9329-6fa2-4e16-a739-56c34acdbdee tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:55.394733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-604f9329-6fa2-4e16-a739-56c34acdbdee tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:55.395500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-604f9329-6fa2-4e16-a739-56c34acdbdee tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:55.395937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-604f9329-6fa2-4e16-a739-56c34acdbdee tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:55.414735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-bc817daa-4b44-46d2-925a-07b5167f278d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:30:55.422644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-bc817daa-4b44-46d2-925a-07b5167f278d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:30:55.424204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-bc817daa-4b44-46d2-925a-07b5167f278d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:30:55.424777 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-bc817daa-4b44-46d2-925a-07b5167f278d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:30:55.425270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-bc817daa-4b44-46d2-925a-07b5167f278d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:30:55.453762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc817daa-4b44-46d2-925a-07b5167f278d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:55.462321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc817daa-4b44-46d2-925a-07b5167f278d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:55.464250 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc817daa-4b44-46d2-925a-07b5167f278d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:55.464993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc817daa-4b44-46d2-925a-07b5167f278d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:55.489607 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-bc817daa-4b44-46d2-925a-07b5167f278d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Getting quotas for project dbeaf54409d44d0abe3cd6c176fa7ea4. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:30:55.494135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-bc817daa-4b44-46d2-925a-07b5167f278d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Getting quotas for user 66b6501f7543485db27a33dd1a1a8400 and project dbeaf54409d44d0abe3cd6c176fa7ea4. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:30:55.509839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bc817daa-4b44-46d2-925a-07b5167f278d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:30:55.512582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bc817daa-4b44-46d2-925a-07b5167f278d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:30:55.611983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-604f9329-6fa2-4e16-a739-56c34acdbdee tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:55.626497 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-604f9329-6fa2-4e16-a739-56c34acdbdee tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1512 microversion: 2.1 time: 0.244447 May 21 21:30:55.627800 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2413/4689] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:55 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1512 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:30:55.718987 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bc817daa-4b44-46d2-925a-07b5167f278d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.874227 May 21 21:30:55.722982 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2277/4690] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:30:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 1879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 21 21:30:55.730685 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5326b74b-b80b-485a-a938-94744dceaae7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:55.731814 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5326b74b-b80b-485a-a938-94744dceaae7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:55.739495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-043d5936-c189-4f44-9ebf-48e4da1837b6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:55.739648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-043d5936-c189-4f44-9ebf-48e4da1837b6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:55.754503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5326b74b-b80b-485a-a938-94744dceaae7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:55.754754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5326b74b-b80b-485a-a938-94744dceaae7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:55.757903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5326b74b-b80b-485a-a938-94744dceaae7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:55.762097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5326b74b-b80b-485a-a938-94744dceaae7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:55.931210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-043d5936-c189-4f44-9ebf-48e4da1837b6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:55.934627 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-043d5936-c189-4f44-9ebf-48e4da1837b6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1235 microversion: 2.1 time: 0.205423 May 21 21:30:55.948644 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2278/4691] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:55 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1235 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:55.968854 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a4f0475d-a455-4241-9be3-1f009d4b191e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:55.969754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a4f0475d-a455-4241-9be3-1f009d4b191e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:55.976407 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4f0475d-a455-4241-9be3-1f009d4b191e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:55.976922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4f0475d-a455-4241-9be3-1f009d4b191e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:55.977705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4f0475d-a455-4241-9be3-1f009d4b191e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:55.978150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4f0475d-a455-4241-9be3-1f009d4b191e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:55.995760 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5326b74b-b80b-485a-a938-94744dceaae7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:56.008191 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5326b74b-b80b-485a-a938-94744dceaae7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1502 microversion: 2.1 time: 0.285210 May 21 21:30:56.019003 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2414/4692] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:55 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1502 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:30:56.025324 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2fd74a4b-7edc-4b23-8a65-523d17046255 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:56.026155 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2fd74a4b-7edc-4b23-8a65-523d17046255 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:56.035455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fd74a4b-7edc-4b23-8a65-523d17046255 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:56.036016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fd74a4b-7edc-4b23-8a65-523d17046255 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:56.036774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fd74a4b-7edc-4b23-8a65-523d17046255 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:56.037287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fd74a4b-7edc-4b23-8a65-523d17046255 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:56.085544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a4f0475d-a455-4241-9be3-1f009d4b191e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:56.096251 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a4f0475d-a455-4241-9be3-1f009d4b191e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1275 microversion: 2.1 time: 0.146302 May 21 21:30:56.099649 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2279/4693] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:55 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1275 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:56.206495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2fd74a4b-7edc-4b23-8a65-523d17046255 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:56.214184 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2fd74a4b-7edc-4b23-8a65-523d17046255 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1515 microversion: 2.1 time: 0.193883 May 21 21:30:56.214768 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2415/4694] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:56 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1515 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:56.232812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9169ccff-32e0-4fcb-a501-69a67df52bfa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:56.235096 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9169ccff-32e0-4fcb-a501-69a67df52bfa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: bd8128be-e86e-4977-a4f9-d860b5986ced] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:56.241094 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-9169ccff-32e0-4fcb-a501-69a67df52bfa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] HTTP exception thrown: Instance bd8128be-e86e-4977-a4f9-d860b5986ced could not be found. May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9169ccff-32e0-4fcb-a501-69a67df52bfa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Request method failure captured: May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/bd8128be-e86e-4977-a4f9-d860b5986ced/action HTTP/1.1 May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 14 May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVnYy3SaySatFVqWuD4QLMX78tOZu2Sq081sncP5_CZnvryZkShUPSqptMQixW9D6QLw2UuDdxyQwaeJ6lrj30y7u6OXCJpzi5UJG9aI3fEqHW0Sq9F2EcE_2fCjYowdWcuux0Sp0LhoueDGd91ZOn29SJFvBmrTIiAhoJB3iHzY0IU May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 2e6d59483dc54fe4a558186055068419 May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2e6d59483dc54fe4a558186055068419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2e6d59483dc54fe4a558186055068419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2e6d59483dc54fe4a558186055068419", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2e6d59483dc54fe4a558186055068419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 2e6d59483dc54fe4a558186055068419 May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerRescueNegativeTestJSON-1981617934-project May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 9a0ccfb5c9a04ec0831a0bfe987bb659 May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1981617934-project May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: {"rescue": {}} May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance bd8128be-e86e-4977-a4f9-d860b5986ced could not be found. May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'bd8128be-e86e-4977-a4f9-d860b5986ced', 'body': {'rescue': {}}} May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd8128be-e86e-4977-a4f9-d860b5986ced could not be found. May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd8128be-e86e-4977-a4f9-d860b5986ced could not be found. May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:56.249643 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:56.254860 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:56.254860 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:56.254860 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:30:56.254860 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:30:56.254860 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd8128be-e86e-4977-a4f9-d860b5986ced could not be found. May 21 21:30:56.254860 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:30:56.254860 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9169ccff-32e0-4fcb-a501-69a67df52bfa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Returning 404 to user: Instance bd8128be-e86e-4977-a4f9-d860b5986ced could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:30:56.254860 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9169ccff-32e0-4fcb-a501-69a67df52bfa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "POST /compute/v2.1/servers/bd8128be-e86e-4977-a4f9-d860b5986ced/action" status: 404 len: 111 microversion: 2.1 time: 0.023494 May 21 21:30:56.254860 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2280/4695] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:30:56 2022] POST /compute/v2.1/servers/bd8128be-e86e-4977-a4f9-d860b5986ced/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:30:56.261029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fe2d8b4f-ffde-4b17-b547-d8ff30a26d83 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:56.261586 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fe2d8b4f-ffde-4b17-b547-d8ff30a26d83 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:56.277165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe2d8b4f-ffde-4b17-b547-d8ff30a26d83 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:56.277165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe2d8b4f-ffde-4b17-b547-d8ff30a26d83 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:56.277165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe2d8b4f-ffde-4b17-b547-d8ff30a26d83 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:56.277165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe2d8b4f-ffde-4b17-b547-d8ff30a26d83 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:56.647784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-06847fb7-d8e4-4edd-84b9-227857dce387 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:56.648734 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-06847fb7-d8e4-4edd-84b9-227857dce387 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:56.662698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06847fb7-d8e4-4edd-84b9-227857dce387 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:56.663454 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06847fb7-d8e4-4edd-84b9-227857dce387 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:56.664646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06847fb7-d8e4-4edd-84b9-227857dce387 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:56.665249 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06847fb7-d8e4-4edd-84b9-227857dce387 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:56.733051 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fe2d8b4f-ffde-4b17-b547-d8ff30a26d83 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "POST /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770/action" status: 202 len: 0 microversion: 2.1 time: 0.475223 May 21 21:30:56.738951 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2416/4696] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:30:56 2022] POST /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:30:56.755499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7abc16db-5aee-4f5a-bf17-5d1caa125018 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:56.758190 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7abc16db-5aee-4f5a-bf17-5d1caa125018 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:56.786600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7abc16db-5aee-4f5a-bf17-5d1caa125018 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:56.786600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7abc16db-5aee-4f5a-bf17-5d1caa125018 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:56.786600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7abc16db-5aee-4f5a-bf17-5d1caa125018 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:56.786600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7abc16db-5aee-4f5a-bf17-5d1caa125018 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:57.018149 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7abc16db-5aee-4f5a-bf17-5d1caa125018 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:57.038645 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7abc16db-5aee-4f5a-bf17-5d1caa125018 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1520 microversion: 2.1 time: 0.298273 May 21 21:30:57.039465 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2417/4697] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:56 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:57.045010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d36733bf-c23f-4fb1-8b07-fe82b4736a41 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:57.046672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d36733bf-c23f-4fb1-8b07-fe82b4736a41 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:57.125400 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-06847fb7-d8e4-4edd-84b9-227857dce387 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:57.137894 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-06847fb7-d8e4-4edd-84b9-227857dce387 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1512 microversion: 2.1 time: 0.495055 May 21 21:30:57.139891 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2281/4698] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:56 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1512 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:57.148017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f2702b65-c364-4d65-a9f9-8d423afec0f1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:57.150455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f2702b65-c364-4d65-a9f9-8d423afec0f1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:57.162256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d36733bf-c23f-4fb1-8b07-fe82b4736a41 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:57.179314 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d36733bf-c23f-4fb1-8b07-fe82b4736a41 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1235 microversion: 2.1 time: 0.135409 May 21 21:30:57.179579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2702b65-c364-4d65-a9f9-8d423afec0f1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:57.179915 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2702b65-c364-4d65-a9f9-8d423afec0f1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:57.180988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2702b65-c364-4d65-a9f9-8d423afec0f1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:57.181612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2702b65-c364-4d65-a9f9-8d423afec0f1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:57.188126 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2418/4699] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:57 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1235 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:58.060429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cd96a145-5482-46ff-b51f-acec9d49765d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:58.062468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cd96a145-5482-46ff-b51f-acec9d49765d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:58.072201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd96a145-5482-46ff-b51f-acec9d49765d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:58.073578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd96a145-5482-46ff-b51f-acec9d49765d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:58.074500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd96a145-5482-46ff-b51f-acec9d49765d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:58.075027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd96a145-5482-46ff-b51f-acec9d49765d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:58.173287 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f2702b65-c364-4d65-a9f9-8d423afec0f1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:58.188061 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f2702b65-c364-4d65-a9f9-8d423afec0f1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1317 microversion: 2.1 time: 1.045667 May 21 21:30:58.189037 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2282/4700] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:57 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1317 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:58.195426 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9d481ef2-fef9-4f28-a17d-e491e494187b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:58.205464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9d481ef2-fef9-4f28-a17d-e491e494187b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:58.206361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9d481ef2-fef9-4f28-a17d-e491e494187b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:58.206814 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9d481ef2-fef9-4f28-a17d-e491e494187b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:58.207761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9d481ef2-fef9-4f28-a17d-e491e494187b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:58.208466 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9d481ef2-fef9-4f28-a17d-e491e494187b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:58.274193 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cd96a145-5482-46ff-b51f-acec9d49765d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:58.283270 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cd96a145-5482-46ff-b51f-acec9d49765d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1500 microversion: 2.1 time: 0.229942 May 21 21:30:58.283938 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2419/4701] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:58 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1500 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:58.301196 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ded2629b-c1d8-4f6a-8cac-4f07af9a6a00 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:58.302045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ded2629b-c1d8-4f6a-8cac-4f07af9a6a00 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:58.308263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ded2629b-c1d8-4f6a-8cac-4f07af9a6a00 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:58.308771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ded2629b-c1d8-4f6a-8cac-4f07af9a6a00 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:58.309552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ded2629b-c1d8-4f6a-8cac-4f07af9a6a00 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:58.310004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ded2629b-c1d8-4f6a-8cac-4f07af9a6a00 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:58.382189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ded2629b-c1d8-4f6a-8cac-4f07af9a6a00 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:58.390894 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ded2629b-c1d8-4f6a-8cac-4f07af9a6a00 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1287 microversion: 2.1 time: 0.093362 May 21 21:30:58.391485 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2420/4702] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:58 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:58.408513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d381f4e5-b002-45fd-a107-083dee8a340e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:58.411683 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d381f4e5-b002-45fd-a107-083dee8a340e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:58.417660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d381f4e5-b002-45fd-a107-083dee8a340e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:58.418324 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d381f4e5-b002-45fd-a107-083dee8a340e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:58.419543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d381f4e5-b002-45fd-a107-083dee8a340e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:58.421662 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d381f4e5-b002-45fd-a107-083dee8a340e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:58.450866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-d381f4e5-b002-45fd-a107-083dee8a340e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lazy-loading 'flavor' on Instance uuid 506776f0-470a-4a6b-ac34-3414463a8770 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:30:58.469051 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-d381f4e5-b002-45fd-a107-083dee8a340e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] HTTP exception thrown: Cannot 'rescue' instance 506776f0-470a-4a6b-ac34-3414463a8770 while it is in vm_state paused May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d381f4e5-b002-45fd-a107-083dee8a340e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Request method failure captured: May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770/action HTTP/1.1 May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 14 May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVnYy3SaySatFVqWuD4QLMX78tOZu2Sq081sncP5_CZnvryZkShUPSqptMQixW9D6QLw2UuDdxyQwaeJ6lrj30y7u6OXCJpzi5UJG9aI3fEqHW0Sq9F2EcE_2fCjYowdWcuux0Sp0LhoueDGd91ZOn29SJFvBmrTIiAhoJB3iHzY0IU May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 2e6d59483dc54fe4a558186055068419 May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2e6d59483dc54fe4a558186055068419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2e6d59483dc54fe4a558186055068419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2e6d59483dc54fe4a558186055068419", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2e6d59483dc54fe4a558186055068419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 2e6d59483dc54fe4a558186055068419 May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerRescueNegativeTestJSON-1981617934-project May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 9a0ccfb5c9a04ec0831a0bfe987bb659 May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1981617934-project May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: {"rescue": {}} May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: exception: Cannot 'rescue' instance 506776f0-470a-4a6b-ac34-3414463a8770 while it is in vm_state paused May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '506776f0-470a-4a6b-ac34-3414463a8770', 'body': {'rescue': {}}} May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 506776f0-470a-4a6b-ac34-3414463a8770 in vm_state paused. Cannot rescue while the instance is in this state. May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 506776f0-470a-4a6b-ac34-3414463a8770 while it is in vm_state paused May 21 21:30:58.471242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:58.475865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:30:58.475865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:58.475865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:30:58.475865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:30:58.475865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:30:58.475865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:30:58.475865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:30:58.475865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 506776f0-470a-4a6b-ac34-3414463a8770 while it is in vm_state paused May 21 21:30:58.475865 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:30:58.475865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d381f4e5-b002-45fd-a107-083dee8a340e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Returning 409 to user: Cannot 'rescue' instance 506776f0-470a-4a6b-ac34-3414463a8770 while it is in vm_state paused {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:30:58.475865 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d381f4e5-b002-45fd-a107-083dee8a340e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "POST /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770/action" status: 409 len: 144 microversion: 2.1 time: 0.082645 May 21 21:30:58.479932 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2421/4703] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:30:58 2022] POST /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770/action => generated 144 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 21 21:30:58.488248 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-47ac34bc-7b88-4ad2-be68-409888bc3713 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:30:58.488843 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-47ac34bc-7b88-4ad2-be68-409888bc3713 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:58.495788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47ac34bc-7b88-4ad2-be68-409888bc3713 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:58.496263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47ac34bc-7b88-4ad2-be68-409888bc3713 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:58.497086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47ac34bc-7b88-4ad2-be68-409888bc3713 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:58.497536 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47ac34bc-7b88-4ad2-be68-409888bc3713 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:58.733698 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-47ac34bc-7b88-4ad2-be68-409888bc3713 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "POST /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770/action" status: 202 len: 0 microversion: 2.1 time: 0.252430 May 21 21:30:58.734995 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2422/4704] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:30:58 2022] POST /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:30:58.745453 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5a84d203-d6bb-406b-960d-8a7ba9ff70fa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:58.746501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5a84d203-d6bb-406b-960d-8a7ba9ff70fa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:58.746622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9d481ef2-fef9-4f28-a17d-e491e494187b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:58.753454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:58.755660 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9d481ef2-fef9-4f28-a17d-e491e494187b tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1512 microversion: 2.1 time: 0.565363 May 21 21:30:58.761653 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2283/4705] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:58 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1512 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:58.762576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5a84d203-d6bb-406b-960d-8a7ba9ff70fa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:58.762576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5a84d203-d6bb-406b-960d-8a7ba9ff70fa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:58.762576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5a84d203-d6bb-406b-960d-8a7ba9ff70fa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:58.762576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5a84d203-d6bb-406b-960d-8a7ba9ff70fa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:59.184896 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5a84d203-d6bb-406b-960d-8a7ba9ff70fa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:59.195590 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5a84d203-d6bb-406b-960d-8a7ba9ff70fa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1507 microversion: 2.1 time: 0.456619 May 21 21:30:59.199858 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2423/4706] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:58 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1507 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:30:59.213806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cb9d382f-153b-46ab-a94a-ce842312e079 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:59.215548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cb9d382f-153b-46ab-a94a-ce842312e079 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:59.224829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb9d382f-153b-46ab-a94a-ce842312e079 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:59.225644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb9d382f-153b-46ab-a94a-ce842312e079 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:59.227136 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb9d382f-153b-46ab-a94a-ce842312e079 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:59.227907 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb9d382f-153b-46ab-a94a-ce842312e079 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:59.411908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a01385b1-ee36-4b71-99fe-2cdbf89584a4 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:59.412861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a01385b1-ee36-4b71-99fe-2cdbf89584a4 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:59.425016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a01385b1-ee36-4b71-99fe-2cdbf89584a4 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:59.429265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a01385b1-ee36-4b71-99fe-2cdbf89584a4 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:59.429265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a01385b1-ee36-4b71-99fe-2cdbf89584a4 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:59.429265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a01385b1-ee36-4b71-99fe-2cdbf89584a4 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:59.550212 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a01385b1-ee36-4b71-99fe-2cdbf89584a4 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:59.566583 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a01385b1-ee36-4b71-99fe-2cdbf89584a4 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1293 microversion: 2.1 time: 0.161385 May 21 21:30:59.568936 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2424/4707] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:59 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1293 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:30:59.732399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cb9d382f-153b-46ab-a94a-ce842312e079 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:30:59.744502 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cb9d382f-153b-46ab-a94a-ce842312e079 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1317 microversion: 2.1 time: 0.542084 May 21 21:30:59.746501 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2284/4708] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:59 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:30:59.778745 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e22036b8-e9e3-49b7-85c6-ebbaebca032f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:30:59.780162 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e22036b8-e9e3-49b7-85c6-ebbaebca032f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:30:59.816930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e22036b8-e9e3-49b7-85c6-ebbaebca032f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:59.817383 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e22036b8-e9e3-49b7-85c6-ebbaebca032f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:30:59.818176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e22036b8-e9e3-49b7-85c6-ebbaebca032f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:30:59.818615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e22036b8-e9e3-49b7-85c6-ebbaebca032f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:00.033018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e22036b8-e9e3-49b7-85c6-ebbaebca032f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:00.048699 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e22036b8-e9e3-49b7-85c6-ebbaebca032f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1512 microversion: 2.1 time: 0.267480 May 21 21:31:00.049969 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2425/4709] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:30:59 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1512 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:00.216957 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0b21ce3d-1ff3-4a85-86ed-8086c1710f4c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:00.218415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0b21ce3d-1ff3-4a85-86ed-8086c1710f4c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:00.226096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b21ce3d-1ff3-4a85-86ed-8086c1710f4c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:00.226773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b21ce3d-1ff3-4a85-86ed-8086c1710f4c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:00.227565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b21ce3d-1ff3-4a85-86ed-8086c1710f4c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:00.228010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b21ce3d-1ff3-4a85-86ed-8086c1710f4c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:00.245467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:00.474630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-9c773d0b-1b51-4dc9-abe8-43cad0a956a5 req-a617ef0e-92ce-4c7f-8846-b86121489789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7de5bb-0233-4e88-a1a0-8561385e53cd", "tag": "fc4ad2f3-98e9-42fc-81a3-7fc4fa986079"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:00.485373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9c773d0b-1b51-4dc9-abe8-43cad0a956a5 req-a617ef0e-92ce-4c7f-8846-b86121489789 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:00.486786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9c773d0b-1b51-4dc9-abe8-43cad0a956a5 req-a617ef0e-92ce-4c7f-8846-b86121489789 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:00.522659 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-9c773d0b-1b51-4dc9-abe8-43cad0a956a5 req-a617ef0e-92ce-4c7f-8846-b86121489789 service nova] Creating event network-changed:fc4ad2f3-98e9-42fc-81a3-7fc4fa986079 for instance af7de5bb-0233-4e88-a1a0-8561385e53cd on nch2-master-1 May 21 21:31:00.529180 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-9c773d0b-1b51-4dc9-abe8-43cad0a956a5 req-a617ef0e-92ce-4c7f-8846-b86121489789 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.364403 May 21 21:31:00.530523 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2285/4710] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:31:00.588062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-783f5537-c92c-45b5-9fdc-e05b47fce7cd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:00.589424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-783f5537-c92c-45b5-9fdc-e05b47fce7cd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:00.597930 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-783f5537-c92c-45b5-9fdc-e05b47fce7cd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:00.598830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-783f5537-c92c-45b5-9fdc-e05b47fce7cd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:00.599862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-783f5537-c92c-45b5-9fdc-e05b47fce7cd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:00.600622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-783f5537-c92c-45b5-9fdc-e05b47fce7cd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:00.758945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0b21ce3d-1ff3-4a85-86ed-8086c1710f4c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:00.768944 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0b21ce3d-1ff3-4a85-86ed-8086c1710f4c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1515 microversion: 2.1 time: 0.555665 May 21 21:31:00.777282 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2426/4711] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:00 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1515 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:00.795249 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4b07e16f-46d2-419d-96aa-c937d0ad960f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:00.796104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4b07e16f-46d2-419d-96aa-c937d0ad960f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:00.807452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4b07e16f-46d2-419d-96aa-c937d0ad960f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:00.807907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4b07e16f-46d2-419d-96aa-c937d0ad960f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:00.820258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4b07e16f-46d2-419d-96aa-c937d0ad960f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:00.823983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4b07e16f-46d2-419d-96aa-c937d0ad960f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:01.355387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-783f5537-c92c-45b5-9fdc-e05b47fce7cd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:01.365634 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-783f5537-c92c-45b5-9fdc-e05b47fce7cd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1360 microversion: 2.1 time: 0.782768 May 21 21:31:01.366977 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2286/4712] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:00 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1360 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:01.372083 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-af457901-f7b5-4064-aeb0-f8f752be0b6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:01.372929 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-af457901-f7b5-4064-aeb0-f8f752be0b6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:01.391691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-af457901-f7b5-4064-aeb0-f8f752be0b6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:01.392156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-af457901-f7b5-4064-aeb0-f8f752be0b6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:01.393001 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-af457901-f7b5-4064-aeb0-f8f752be0b6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:01.393449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-af457901-f7b5-4064-aeb0-f8f752be0b6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:01.655151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4b07e16f-46d2-419d-96aa-c937d0ad960f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:01.668644 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4b07e16f-46d2-419d-96aa-c937d0ad960f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1317 microversion: 2.1 time: 0.890150 May 21 21:31:01.675879 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2427/4713] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:00 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1317 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:01.706878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-af457901-f7b5-4064-aeb0-f8f752be0b6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:01.721025 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-af457901-f7b5-4064-aeb0-f8f752be0b6e tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1512 microversion: 2.1 time: 0.352617 May 21 21:31:01.721694 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2287/4714] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:01 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:02.383633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ca48c921-1b62-4408-a2d1-49bd167e5883 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:02.384839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ca48c921-1b62-4408-a2d1-49bd167e5883 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:02.395036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca48c921-1b62-4408-a2d1-49bd167e5883 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:02.398625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca48c921-1b62-4408-a2d1-49bd167e5883 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:02.398625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca48c921-1b62-4408-a2d1-49bd167e5883 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:02.398625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca48c921-1b62-4408-a2d1-49bd167e5883 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:02.693457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-58337bc1-4ec2-4d83-bd30-c8f0e4d21500 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:02.695301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-58337bc1-4ec2-4d83-bd30-c8f0e4d21500 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:02.706016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58337bc1-4ec2-4d83-bd30-c8f0e4d21500 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:02.707526 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58337bc1-4ec2-4d83-bd30-c8f0e4d21500 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:02.710206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58337bc1-4ec2-4d83-bd30-c8f0e4d21500 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:02.710873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58337bc1-4ec2-4d83-bd30-c8f0e4d21500 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:02.841160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ca48c921-1b62-4408-a2d1-49bd167e5883 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:02.859573 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ca48c921-1b62-4408-a2d1-49bd167e5883 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1360 microversion: 2.1 time: 0.479815 May 21 21:31:02.860936 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2428/4715] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:02 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1360 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:02.871679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-29eac69e-26f7-477b-ae4c-88e3e98ae3c9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:02.872528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-29eac69e-26f7-477b-ae4c-88e3e98ae3c9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:02.885576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29eac69e-26f7-477b-ae4c-88e3e98ae3c9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:02.886792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29eac69e-26f7-477b-ae4c-88e3e98ae3c9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:02.893636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29eac69e-26f7-477b-ae4c-88e3e98ae3c9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:02.894417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29eac69e-26f7-477b-ae4c-88e3e98ae3c9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:03.033629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-58337bc1-4ec2-4d83-bd30-c8f0e4d21500 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:03.041440 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-58337bc1-4ec2-4d83-bd30-c8f0e4d21500 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1317 microversion: 2.1 time: 0.352910 May 21 21:31:03.051331 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2288/4716] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:02 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:03.056999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a7964734-fcfa-470e-8a15-4823b01994c2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:03.058311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a7964734-fcfa-470e-8a15-4823b01994c2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:03.065765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7964734-fcfa-470e-8a15-4823b01994c2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:03.066423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7964734-fcfa-470e-8a15-4823b01994c2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:03.069981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7964734-fcfa-470e-8a15-4823b01994c2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:03.069981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7964734-fcfa-470e-8a15-4823b01994c2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:03.097436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-a7964734-fcfa-470e-8a15-4823b01994c2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lazy-loading 'flavor' on Instance uuid 506776f0-470a-4a6b-ac34-3414463a8770 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:31:03.101941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:03.187833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-29eac69e-26f7-477b-ae4c-88e3e98ae3c9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:03.203377 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-29eac69e-26f7-477b-ae4c-88e3e98ae3c9 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1512 microversion: 2.1 time: 0.341113 May 21 21:31:03.203996 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2429/4717] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:02 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1512 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:03.344171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-37aab0f5-5333-4c02-a553-a68df2098b8e req-f5412dae-bf5a-4c4a-aada-50c170bdb14e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f6f2738-3e60-4235-ab67-86ad32c2a384", "tag": "0e5e1124-219a-4afb-a71f-cb8bce128991"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:03.368709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-37aab0f5-5333-4c02-a553-a68df2098b8e req-f5412dae-bf5a-4c4a-aada-50c170bdb14e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:03.369461 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-37aab0f5-5333-4c02-a553-a68df2098b8e req-f5412dae-bf5a-4c4a-aada-50c170bdb14e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:03.398368 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-37aab0f5-5333-4c02-a553-a68df2098b8e req-f5412dae-bf5a-4c4a-aada-50c170bdb14e service nova] Creating event network-changed:0e5e1124-219a-4afb-a71f-cb8bce128991 for instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 on nch1-master-1 May 21 21:31:03.405831 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-37aab0f5-5333-4c02-a553-a68df2098b8e req-f5412dae-bf5a-4c4a-aada-50c170bdb14e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065561 May 21 21:31:03.406723 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2430/4718] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:31:03.580611 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a7964734-fcfa-470e-8a15-4823b01994c2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "POST /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770/action" status: 200 len: 32 microversion: 2.1 time: 0.527455 May 21 21:31:03.581314 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2289/4719] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:31:03 2022] POST /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770/action => generated 32 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:31:03.591579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b457cef9-0c97-4f18-9f6d-570671cda46e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:03.593174 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b457cef9-0c97-4f18-9f6d-570671cda46e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:03.600903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b457cef9-0c97-4f18-9f6d-570671cda46e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:03.601348 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b457cef9-0c97-4f18-9f6d-570671cda46e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:03.605888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b457cef9-0c97-4f18-9f6d-570671cda46e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:03.610780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b457cef9-0c97-4f18-9f6d-570671cda46e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:03.884374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-576802d9-e5ee-4554-a988-0e84e29b9b8b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:03.884374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-576802d9-e5ee-4554-a988-0e84e29b9b8b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:03.894325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-576802d9-e5ee-4554-a988-0e84e29b9b8b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:03.895073 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-576802d9-e5ee-4554-a988-0e84e29b9b8b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:03.895962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-576802d9-e5ee-4554-a988-0e84e29b9b8b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:03.897267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-576802d9-e5ee-4554-a988-0e84e29b9b8b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:04.221986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-576802d9-e5ee-4554-a988-0e84e29b9b8b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:04.230073 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-576802d9-e5ee-4554-a988-0e84e29b9b8b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1360 microversion: 2.1 time: 0.355861 May 21 21:31:04.236379 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2290/4720] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:03 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1360 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:04.255680 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0c454c06-633f-442c-b185-8b23c887c628 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:04.257524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0c454c06-633f-442c-b185-8b23c887c628 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:04.270991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c454c06-633f-442c-b185-8b23c887c628 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:04.271875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c454c06-633f-442c-b185-8b23c887c628 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:04.273065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c454c06-633f-442c-b185-8b23c887c628 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:04.273665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c454c06-633f-442c-b185-8b23c887c628 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:04.333830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b457cef9-0c97-4f18-9f6d-570671cda46e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:04.343397 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b457cef9-0c97-4f18-9f6d-570671cda46e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1521 microversion: 2.1 time: 0.756158 May 21 21:31:04.352733 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2431/4721] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:03 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1521 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:04.362113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8c1f66fa-f3fd-434f-91c8-d1d5e0df0ca5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:04.362978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8c1f66fa-f3fd-434f-91c8-d1d5e0df0ca5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:04.380852 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c1f66fa-f3fd-434f-91c8-d1d5e0df0ca5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:04.382690 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c1f66fa-f3fd-434f-91c8-d1d5e0df0ca5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:04.386733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c1f66fa-f3fd-434f-91c8-d1d5e0df0ca5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:04.391975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c1f66fa-f3fd-434f-91c8-d1d5e0df0ca5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:04.636204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0c454c06-633f-442c-b185-8b23c887c628 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:04.643532 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0c454c06-633f-442c-b185-8b23c887c628 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1317 microversion: 2.1 time: 0.404777 May 21 21:31:04.648639 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2291/4722] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:04 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:04.856720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8c1f66fa-f3fd-434f-91c8-d1d5e0df0ca5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:04.866863 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8c1f66fa-f3fd-434f-91c8-d1d5e0df0ca5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1512 microversion: 2.1 time: 0.512643 May 21 21:31:04.877679 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2432/4723] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:04 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1512 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:05.254972 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-10958d5d-4905-47dc-bfbc-1462694cb6af tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:05.256313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-10958d5d-4905-47dc-bfbc-1462694cb6af tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:05.263324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-10958d5d-4905-47dc-bfbc-1462694cb6af tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:05.264051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-10958d5d-4905-47dc-bfbc-1462694cb6af tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:05.265285 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-10958d5d-4905-47dc-bfbc-1462694cb6af tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:05.265810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-10958d5d-4905-47dc-bfbc-1462694cb6af tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:05.368062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bc3c90b2-3665-4dc5-96a1-2a0ff8e78c63 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:05.368746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bc3c90b2-3665-4dc5-96a1-2a0ff8e78c63 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:05.375758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bc3c90b2-3665-4dc5-96a1-2a0ff8e78c63 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:05.376438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bc3c90b2-3665-4dc5-96a1-2a0ff8e78c63 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:05.377405 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bc3c90b2-3665-4dc5-96a1-2a0ff8e78c63 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:05.378012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bc3c90b2-3665-4dc5-96a1-2a0ff8e78c63 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:05.475889 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-10958d5d-4905-47dc-bfbc-1462694cb6af tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:05.486305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:05.497375 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-10958d5d-4905-47dc-bfbc-1462694cb6af tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1360 microversion: 2.1 time: 0.249056 May 21 21:31:05.507422 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2292/4724] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:05 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1360 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:05.577041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bc3c90b2-3665-4dc5-96a1-2a0ff8e78c63 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:05.591454 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bc3c90b2-3665-4dc5-96a1-2a0ff8e78c63 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1521 microversion: 2.1 time: 0.227403 May 21 21:31:05.602114 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2433/4725] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:05 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:05.667989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-98f5d6a1-26df-46ca-b8a3-7f158854e7be tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:05.669018 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-98f5d6a1-26df-46ca-b8a3-7f158854e7be tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:05.677887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98f5d6a1-26df-46ca-b8a3-7f158854e7be tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:05.678343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98f5d6a1-26df-46ca-b8a3-7f158854e7be tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:05.681162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98f5d6a1-26df-46ca-b8a3-7f158854e7be tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:05.681610 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98f5d6a1-26df-46ca-b8a3-7f158854e7be tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:05.847093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-98f5d6a1-26df-46ca-b8a3-7f158854e7be tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:05.855520 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-98f5d6a1-26df-46ca-b8a3-7f158854e7be tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1317 microversion: 2.1 time: 0.193526 May 21 21:31:05.856273 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2293/4726] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:05 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:05.888158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fe475c47-932d-4518-a06d-324e5e6b219f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:05.889705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fe475c47-932d-4518-a06d-324e5e6b219f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:05.896481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe475c47-932d-4518-a06d-324e5e6b219f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:05.896932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe475c47-932d-4518-a06d-324e5e6b219f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:05.897713 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe475c47-932d-4518-a06d-324e5e6b219f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:05.898362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe475c47-932d-4518-a06d-324e5e6b219f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:06.067846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fe475c47-932d-4518-a06d-324e5e6b219f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:06.089636 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fe475c47-932d-4518-a06d-324e5e6b219f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1512 microversion: 2.1 time: 0.209067 May 21 21:31:06.090221 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2434/4727] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:05 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1512 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:06.515064 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0c982cf5-bbdb-4daa-9900-1bb5f7b417da tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:06.515651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0c982cf5-bbdb-4daa-9900-1bb5f7b417da tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:06.518194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=16 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:06.524792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c982cf5-bbdb-4daa-9900-1bb5f7b417da tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:06.525262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c982cf5-bbdb-4daa-9900-1bb5f7b417da tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:06.526057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c982cf5-bbdb-4daa-9900-1bb5f7b417da tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:06.526508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c982cf5-bbdb-4daa-9900-1bb5f7b417da tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:06.609402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8b3fc06d-e971-45aa-9c44-4f989b511003 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:06.610131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8b3fc06d-e971-45aa-9c44-4f989b511003 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:06.626607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b3fc06d-e971-45aa-9c44-4f989b511003 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:06.627062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b3fc06d-e971-45aa-9c44-4f989b511003 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:06.627847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b3fc06d-e971-45aa-9c44-4f989b511003 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:06.628314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b3fc06d-e971-45aa-9c44-4f989b511003 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:06.704471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0c982cf5-bbdb-4daa-9900-1bb5f7b417da tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:06.715055 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0c982cf5-bbdb-4daa-9900-1bb5f7b417da tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1360 microversion: 2.1 time: 0.203910 May 21 21:31:06.716194 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2294/4728] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:06 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1360 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:06.823427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8b3fc06d-e971-45aa-9c44-4f989b511003 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:06.831828 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8b3fc06d-e971-45aa-9c44-4f989b511003 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1521 microversion: 2.1 time: 0.227116 May 21 21:31:06.832574 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2435/4729] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:06 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:06.873682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-64a2b57e-e387-4074-bc77-e1f074e5cd79 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:06.874641 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-64a2b57e-e387-4074-bc77-e1f074e5cd79 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:06.883942 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-64a2b57e-e387-4074-bc77-e1f074e5cd79 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:06.884918 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-64a2b57e-e387-4074-bc77-e1f074e5cd79 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:06.885897 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-64a2b57e-e387-4074-bc77-e1f074e5cd79 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:06.886627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-64a2b57e-e387-4074-bc77-e1f074e5cd79 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:07.056995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-64a2b57e-e387-4074-bc77-e1f074e5cd79 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:07.068966 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-64a2b57e-e387-4074-bc77-e1f074e5cd79 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1317 microversion: 2.1 time: 0.200429 May 21 21:31:07.069995 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2295/4730] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:06 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:07.113710 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-027fac94-3f4b-4320-aebe-3c963aced20d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:07.114400 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-027fac94-3f4b-4320-aebe-3c963aced20d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:07.121036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-027fac94-3f4b-4320-aebe-3c963aced20d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:07.121609 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-027fac94-3f4b-4320-aebe-3c963aced20d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:07.122417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-027fac94-3f4b-4320-aebe-3c963aced20d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:07.123633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-027fac94-3f4b-4320-aebe-3c963aced20d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:07.173503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=8 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:07.234983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-616aa67d-39f3-4cfa-a4b8-244b490d7f00 req-7505f4a4-ada2-4c7d-93e2-97dbaea38b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7de5bb-0233-4e88-a1a0-8561385e53cd", "name": "network-vif-plugged", "status": "completed", "tag": "fc4ad2f3-98e9-42fc-81a3-7fc4fa986079"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:07.246463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-616aa67d-39f3-4cfa-a4b8-244b490d7f00 req-7505f4a4-ada2-4c7d-93e2-97dbaea38b4d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:07.247612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-616aa67d-39f3-4cfa-a4b8-244b490d7f00 req-7505f4a4-ada2-4c7d-93e2-97dbaea38b4d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:07.266182 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-616aa67d-39f3-4cfa-a4b8-244b490d7f00 req-7505f4a4-ada2-4c7d-93e2-97dbaea38b4d service nova] Creating event network-vif-plugged:fc4ad2f3-98e9-42fc-81a3-7fc4fa986079 for instance af7de5bb-0233-4e88-a1a0-8561385e53cd on nch2-master-1 May 21 21:31:07.273189 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-616aa67d-39f3-4cfa-a4b8-244b490d7f00 req-7505f4a4-ada2-4c7d-93e2-97dbaea38b4d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.262537 May 21 21:31:07.274409 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2436/4731] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:31:07.282979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-027fac94-3f4b-4320-aebe-3c963aced20d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:07.292552 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-027fac94-3f4b-4320-aebe-3c963aced20d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1512 microversion: 2.1 time: 0.189704 May 21 21:31:07.293127 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2296/4732] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:07 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1512 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:07.735770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-06100187-4e14-42ab-a79b-b20219814545 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:07.737264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-06100187-4e14-42ab-a79b-b20219814545 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:07.745207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06100187-4e14-42ab-a79b-b20219814545 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:07.745668 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06100187-4e14-42ab-a79b-b20219814545 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:07.746613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06100187-4e14-42ab-a79b-b20219814545 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:07.747071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06100187-4e14-42ab-a79b-b20219814545 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:07.852034 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-32537a95-b30c-4462-9c5d-f4529b3b7349 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:07.852854 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-32537a95-b30c-4462-9c5d-f4529b3b7349 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:07.867145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:07.868935 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32537a95-b30c-4462-9c5d-f4529b3b7349 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:07.869456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32537a95-b30c-4462-9c5d-f4529b3b7349 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:07.870446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32537a95-b30c-4462-9c5d-f4529b3b7349 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:07.871065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32537a95-b30c-4462-9c5d-f4529b3b7349 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:07.935057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-06100187-4e14-42ab-a79b-b20219814545 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:07.935057 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-06100187-4e14-42ab-a79b-b20219814545 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1360 microversion: 2.1 time: 0.203996 May 21 21:31:07.947896 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2437/4733] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:07 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1360 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:08.087775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-baf1b97b-070c-4132-9056-f1712af12d09 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:08.088521 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-baf1b97b-070c-4132-9056-f1712af12d09 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:08.103906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-baf1b97b-070c-4132-9056-f1712af12d09 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:08.103906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-baf1b97b-070c-4132-9056-f1712af12d09 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:08.103906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-baf1b97b-070c-4132-9056-f1712af12d09 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:08.103906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-baf1b97b-070c-4132-9056-f1712af12d09 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:08.381898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-baf1b97b-070c-4132-9056-f1712af12d09 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:08.393516 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-baf1b97b-070c-4132-9056-f1712af12d09 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1317 microversion: 2.1 time: 0.310758 May 21 21:31:08.394841 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2438/4734] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:08 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:08.400651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-06a69421-3fa5-442c-9c1c-241a2058dd00 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:08.401582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-06a69421-3fa5-442c-9c1c-241a2058dd00 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:08.409050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06a69421-3fa5-442c-9c1c-241a2058dd00 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:08.410115 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06a69421-3fa5-442c-9c1c-241a2058dd00 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:08.411307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06a69421-3fa5-442c-9c1c-241a2058dd00 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:08.411980 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06a69421-3fa5-442c-9c1c-241a2058dd00 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:08.460664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-32537a95-b30c-4462-9c5d-f4529b3b7349 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:08.468980 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-32537a95-b30c-4462-9c5d-f4529b3b7349 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1521 microversion: 2.1 time: 0.623195 May 21 21:31:08.469565 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2297/4735] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:07 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1521 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:08.673544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-06a69421-3fa5-442c-9c1c-241a2058dd00 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:08.691081 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-06a69421-3fa5-442c-9c1c-241a2058dd00 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1512 microversion: 2.1 time: 0.294881 May 21 21:31:08.692453 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2439/4736] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:08 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1512 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:08.952175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-248a0a67-7267-4828-b5b7-75d7bd00b373 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:08.952874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-248a0a67-7267-4828-b5b7-75d7bd00b373 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:08.960366 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-248a0a67-7267-4828-b5b7-75d7bd00b373 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:08.960817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-248a0a67-7267-4828-b5b7-75d7bd00b373 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:08.961588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-248a0a67-7267-4828-b5b7-75d7bd00b373 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:08.962029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-248a0a67-7267-4828-b5b7-75d7bd00b373 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:09.123677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-248a0a67-7267-4828-b5b7-75d7bd00b373 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:09.131625 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-248a0a67-7267-4828-b5b7-75d7bd00b373 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1360 microversion: 2.1 time: 0.184112 May 21 21:31:09.132394 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2298/4737] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:08 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1360 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:09.411440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8e468551-01ac-4a75-b3e6-5486f166bb0d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:09.412163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8e468551-01ac-4a75-b3e6-5486f166bb0d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:09.423733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8e468551-01ac-4a75-b3e6-5486f166bb0d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:09.424205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8e468551-01ac-4a75-b3e6-5486f166bb0d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:09.425096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8e468551-01ac-4a75-b3e6-5486f166bb0d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:09.425543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8e468551-01ac-4a75-b3e6-5486f166bb0d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:09.495754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0b017223-e666-44a3-afdd-989823ad7f3b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:09.496830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0b017223-e666-44a3-afdd-989823ad7f3b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:09.505842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b017223-e666-44a3-afdd-989823ad7f3b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:09.506728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b017223-e666-44a3-afdd-989823ad7f3b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:09.509236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b017223-e666-44a3-afdd-989823ad7f3b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:09.509236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b017223-e666-44a3-afdd-989823ad7f3b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:09.627902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8e468551-01ac-4a75-b3e6-5486f166bb0d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:09.637802 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8e468551-01ac-4a75-b3e6-5486f166bb0d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.230437 May 21 21:31:09.639060 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2440/4738] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:09 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:09.708421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-44f82dcf-6f57-4436-9ab3-a47f584f4099 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:09.709040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-44f82dcf-6f57-4436-9ab3-a47f584f4099 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:09.723233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44f82dcf-6f57-4436-9ab3-a47f584f4099 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:09.729117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44f82dcf-6f57-4436-9ab3-a47f584f4099 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:09.730508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44f82dcf-6f57-4436-9ab3-a47f584f4099 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:09.730957 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-44f82dcf-6f57-4436-9ab3-a47f584f4099 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:09.802727 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0b017223-e666-44a3-afdd-989823ad7f3b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:09.813653 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0b017223-e666-44a3-afdd-989823ad7f3b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1521 microversion: 2.1 time: 0.322118 May 21 21:31:09.814561 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2299/4739] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:09 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:09.819858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-50da2d16-8ea6-4fdb-bad5-840f59414a68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1756978794", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:09.884114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-50da2d16-8ea6-4fdb-bad5-840f59414a68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] validate_networks() for [('08704bbd-33da-45f4-ac41-9349866a62b3', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:31:09.978157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-44f82dcf-6f57-4436-9ab3-a47f584f4099 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:09.989344 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-44f82dcf-6f57-4436-9ab3-a47f584f4099 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1512 microversion: 2.1 time: 0.284400 May 21 21:31:09.990408 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2441/4740] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:09 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1512 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:10.149285 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7df4e3f2-b0b4-4ec0-86f8-83b24863657d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:10.150178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7df4e3f2-b0b4-4ec0-86f8-83b24863657d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:10.159208 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7df4e3f2-b0b4-4ec0-86f8-83b24863657d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:10.159654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7df4e3f2-b0b4-4ec0-86f8-83b24863657d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:10.160483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7df4e3f2-b0b4-4ec0-86f8-83b24863657d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:10.160927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7df4e3f2-b0b4-4ec0-86f8-83b24863657d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:10.384052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7df4e3f2-b0b4-4ec0-86f8-83b24863657d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:10.393372 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7df4e3f2-b0b4-4ec0-86f8-83b24863657d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1360 microversion: 2.1 time: 0.247782 May 21 21:31:10.393933 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2442/4741] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:10 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1360 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:10.400086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-cf888d59-b77a-4e23-a9ec-5cb30f597e31 req-830e45a2-7a8f-4854-ba2b-a2cf8b55baed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f6f2738-3e60-4235-ab67-86ad32c2a384", "name": "network-vif-plugged", "status": "completed", "tag": "0e5e1124-219a-4afb-a71f-cb8bce128991"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:10.409202 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cf888d59-b77a-4e23-a9ec-5cb30f597e31 req-830e45a2-7a8f-4854-ba2b-a2cf8b55baed service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:10.409727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cf888d59-b77a-4e23-a9ec-5cb30f597e31 req-830e45a2-7a8f-4854-ba2b-a2cf8b55baed service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:10.422811 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-cf888d59-b77a-4e23-a9ec-5cb30f597e31 req-830e45a2-7a8f-4854-ba2b-a2cf8b55baed service nova] Creating event network-vif-plugged:0e5e1124-219a-4afb-a71f-cb8bce128991 for instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 on nch1-master-1 May 21 21:31:10.428270 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-cf888d59-b77a-4e23-a9ec-5cb30f597e31 req-830e45a2-7a8f-4854-ba2b-a2cf8b55baed service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032204 May 21 21:31:10.428928 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2443/4742] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:31:10.769195 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-50da2d16-8ea6-4fdb-bad5-840f59414a68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:31:10.769691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-50da2d16-8ea6-4fdb-bad5-840f59414a68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:31:10.770186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-50da2d16-8ea6-4fdb-bad5-840f59414a68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:31:10.770604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-50da2d16-8ea6-4fdb-bad5-840f59414a68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:31:10.771031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-50da2d16-8ea6-4fdb-bad5-840f59414a68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:31:10.781498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50da2d16-8ea6-4fdb-bad5-840f59414a68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:10.781962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50da2d16-8ea6-4fdb-bad5-840f59414a68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:10.782818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50da2d16-8ea6-4fdb-bad5-840f59414a68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:10.783268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50da2d16-8ea6-4fdb-bad5-840f59414a68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:10.801431 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-50da2d16-8ea6-4fdb-bad5-840f59414a68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Getting quotas for project 27f0db8b0958479990724993361c0a51. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:31:10.807060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-50da2d16-8ea6-4fdb-bad5-840f59414a68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Getting quotas for user 411af27147894e999b4242c5b9991c98 and project 27f0db8b0958479990724993361c0a51. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:31:10.820634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-50da2d16-8ea6-4fdb-bad5-840f59414a68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:31:10.823043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-50da2d16-8ea6-4fdb-bad5-840f59414a68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:31:10.832177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b842fe0a-5459-4fa7-a2c1-aa81cdd91a05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:10.832960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b842fe0a-5459-4fa7-a2c1-aa81cdd91a05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:10.842824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b842fe0a-5459-4fa7-a2c1-aa81cdd91a05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:10.844138 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b842fe0a-5459-4fa7-a2c1-aa81cdd91a05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:10.845243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b842fe0a-5459-4fa7-a2c1-aa81cdd91a05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:10.845851 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b842fe0a-5459-4fa7-a2c1-aa81cdd91a05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:10.983999 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-50da2d16-8ea6-4fdb-bad5-840f59414a68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.168028 May 21 21:31:10.990339 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2300/4743] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:31:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:31:10.995532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e0410e40-8746-43b0-b4d2-a87d11a4bd1c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:10.996193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e0410e40-8746-43b0-b4d2-a87d11a4bd1c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:11.096722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e0410e40-8746-43b0-b4d2-a87d11a4bd1c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:11.114476 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e0410e40-8746-43b0-b4d2-a87d11a4bd1c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38" status: 200 len: 1217 microversion: 2.1 time: 0.118734 May 21 21:31:11.118352 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2301/4744] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:10 2022] GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 => generated 1217 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:11.137005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9704cc6b-d872-45a0-a85d-d664cde01b14 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:11.140844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b842fe0a-5459-4fa7-a2c1-aa81cdd91a05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:11.141077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9704cc6b-d872-45a0-a85d-d664cde01b14 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:11.156568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9704cc6b-d872-45a0-a85d-d664cde01b14 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:11.157081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9704cc6b-d872-45a0-a85d-d664cde01b14 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:11.157818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9704cc6b-d872-45a0-a85d-d664cde01b14 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:11.158256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9704cc6b-d872-45a0-a85d-d664cde01b14 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:11.160585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:11.176920 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b842fe0a-5459-4fa7-a2c1-aa81cdd91a05 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1521 microversion: 2.1 time: 0.336267 May 21 21:31:11.176920 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2444/4745] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:10 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:11.411624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0d66ce19-14b4-4df3-9238-e1dfe9ce149e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:11.412394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0d66ce19-14b4-4df3-9238-e1dfe9ce149e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:11.426275 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d66ce19-14b4-4df3-9238-e1dfe9ce149e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:11.426861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d66ce19-14b4-4df3-9238-e1dfe9ce149e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:11.427843 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d66ce19-14b4-4df3-9238-e1dfe9ce149e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:11.429786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d66ce19-14b4-4df3-9238-e1dfe9ce149e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:11.470104 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9704cc6b-d872-45a0-a85d-d664cde01b14 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:11.482747 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9704cc6b-d872-45a0-a85d-d664cde01b14 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1512 microversion: 2.1 time: 0.362794 May 21 21:31:11.483441 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2302/4746] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:11 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1512 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:11.598585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0d66ce19-14b4-4df3-9238-e1dfe9ce149e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:11.608466 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0d66ce19-14b4-4df3-9238-e1dfe9ce149e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1360 microversion: 2.1 time: 0.199545 May 21 21:31:11.609235 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2445/4747] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:11 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1360 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:12.127816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1cbbe150-451d-4856-9e55-ba5bb8a7ac7f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:12.128481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1cbbe150-451d-4856-9e55-ba5bb8a7ac7f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:12.135544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1cbbe150-451d-4856-9e55-ba5bb8a7ac7f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:12.136008 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1cbbe150-451d-4856-9e55-ba5bb8a7ac7f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:12.136830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1cbbe150-451d-4856-9e55-ba5bb8a7ac7f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:12.137278 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1cbbe150-451d-4856-9e55-ba5bb8a7ac7f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:12.184736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-981575db-7c5b-4a91-b633-3151ea44b37a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:12.186509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-981575db-7c5b-4a91-b633-3151ea44b37a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:12.194023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-981575db-7c5b-4a91-b633-3151ea44b37a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:12.194730 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-981575db-7c5b-4a91-b633-3151ea44b37a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:12.195728 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-981575db-7c5b-4a91-b633-3151ea44b37a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:12.197008 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-981575db-7c5b-4a91-b633-3151ea44b37a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:12.305029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1cbbe150-451d-4856-9e55-ba5bb8a7ac7f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:12.316746 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1cbbe150-451d-4856-9e55-ba5bb8a7ac7f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38" status: 200 len: 1221 microversion: 2.1 time: 0.191735 May 21 21:31:12.325457 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2303/4748] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:12 2022] GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 => generated 1221 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:12.483147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-981575db-7c5b-4a91-b633-3151ea44b37a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:12.492812 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-981575db-7c5b-4a91-b633-3151ea44b37a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1521 microversion: 2.1 time: 0.311968 May 21 21:31:12.500019 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1dde4d3d-1221-4526-9c59-87a9d45fead6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:12.500905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1dde4d3d-1221-4526-9c59-87a9d45fead6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:12.504824 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2446/4749] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:12 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:12.507881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1dde4d3d-1221-4526-9c59-87a9d45fead6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:12.507881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1dde4d3d-1221-4526-9c59-87a9d45fead6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:12.508595 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1dde4d3d-1221-4526-9c59-87a9d45fead6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:12.517316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1dde4d3d-1221-4526-9c59-87a9d45fead6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:12.626207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4b42e035-612a-4283-8924-6ab3e60134b3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:12.626843 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4b42e035-612a-4283-8924-6ab3e60134b3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:12.643651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4b42e035-612a-4283-8924-6ab3e60134b3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:12.644233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4b42e035-612a-4283-8924-6ab3e60134b3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:12.645305 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4b42e035-612a-4283-8924-6ab3e60134b3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:12.646528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4b42e035-612a-4283-8924-6ab3e60134b3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:12.834778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1dde4d3d-1221-4526-9c59-87a9d45fead6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:12.848147 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1dde4d3d-1221-4526-9c59-87a9d45fead6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1512 microversion: 2.1 time: 0.349461 May 21 21:31:12.849548 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2304/4750] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:12 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1512 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:12.898258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4b42e035-612a-4283-8924-6ab3e60134b3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:12.912076 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4b42e035-612a-4283-8924-6ab3e60134b3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1546 microversion: 2.1 time: 0.290258 May 21 21:31:12.921036 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2447/4751] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:12 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1546 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:12.931464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-80481b35-dca0-4adc-9c0a-589aa3133cd5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:12.932528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-80481b35-dca0-4adc-9c0a-589aa3133cd5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:12.941376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-80481b35-dca0-4adc-9c0a-589aa3133cd5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:12.942259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-80481b35-dca0-4adc-9c0a-589aa3133cd5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:12.943258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-80481b35-dca0-4adc-9c0a-589aa3133cd5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:12.943893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-80481b35-dca0-4adc-9c0a-589aa3133cd5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:13.094173 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-80481b35-dca0-4adc-9c0a-589aa3133cd5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.167807 May 21 21:31:13.095381 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2305/4752] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 21:31:12 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384/os-interface => generated 285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:31:13.336189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-019e2745-d440-4aea-9632-4cbd6c0d87c4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:13.336905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-019e2745-d440-4aea-9632-4cbd6c0d87c4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:13.381499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-019e2745-d440-4aea-9632-4cbd6c0d87c4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:13.387043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-019e2745-d440-4aea-9632-4cbd6c0d87c4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:13.387043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-019e2745-d440-4aea-9632-4cbd6c0d87c4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:13.387043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-019e2745-d440-4aea-9632-4cbd6c0d87c4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:13.513345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1ca0f835-bba1-4ec6-9e65-1d58386a7588 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:13.514894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1ca0f835-bba1-4ec6-9e65-1d58386a7588 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:13.523532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ca0f835-bba1-4ec6-9e65-1d58386a7588 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:13.524582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ca0f835-bba1-4ec6-9e65-1d58386a7588 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:13.525578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ca0f835-bba1-4ec6-9e65-1d58386a7588 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:13.526216 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ca0f835-bba1-4ec6-9e65-1d58386a7588 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:13.570414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:13.609955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-019e2745-d440-4aea-9632-4cbd6c0d87c4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:13.618458 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-019e2745-d440-4aea-9632-4cbd6c0d87c4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38" status: 200 len: 1269 microversion: 2.1 time: 0.289911 May 21 21:31:13.635170 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2448/4753] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:13 2022] GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 => generated 1269 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:13.885227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-507ff779-c209-450e-a4de-1c6df35cf2b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:13.885868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-507ff779-c209-450e-a4de-1c6df35cf2b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:13.902817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-507ff779-c209-450e-a4de-1c6df35cf2b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:13.909896 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-507ff779-c209-450e-a4de-1c6df35cf2b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:13.910960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-507ff779-c209-450e-a4de-1c6df35cf2b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:13.911791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-507ff779-c209-450e-a4de-1c6df35cf2b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:14.073239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1ca0f835-bba1-4ec6-9e65-1d58386a7588 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:14.083399 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1ca0f835-bba1-4ec6-9e65-1d58386a7588 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1521 microversion: 2.1 time: 0.576268 May 21 21:31:14.085610 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2306/4754] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:13 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1521 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:14.641176 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-39e7968e-f414-4c28-914e-c1cfe430de1b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:14.641808 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-39e7968e-f414-4c28-914e-c1cfe430de1b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:14.662966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39e7968e-f414-4c28-914e-c1cfe430de1b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:14.663431 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39e7968e-f414-4c28-914e-c1cfe430de1b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:14.664247 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39e7968e-f414-4c28-914e-c1cfe430de1b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:14.665787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39e7968e-f414-4c28-914e-c1cfe430de1b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:14.806619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-39e7968e-f414-4c28-914e-c1cfe430de1b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:14.816886 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-39e7968e-f414-4c28-914e-c1cfe430de1b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38" status: 200 len: 1275 microversion: 2.1 time: 0.179521 May 21 21:31:14.821700 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2307/4755] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:14 2022] GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 => generated 1275 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:14.890255 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-507ff779-c209-450e-a4de-1c6df35cf2b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:14.909195 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-507ff779-c209-450e-a4de-1c6df35cf2b4 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1512 microversion: 2.1 time: 1.045339 May 21 21:31:14.911799 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2449/4756] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:13 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1512 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:15.102913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f23fc481-982c-42a7-bb6c-f459b0b366b2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:15.104385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f23fc481-982c-42a7-bb6c-f459b0b366b2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:15.111426 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f23fc481-982c-42a7-bb6c-f459b0b366b2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:15.112308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f23fc481-982c-42a7-bb6c-f459b0b366b2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:15.113327 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f23fc481-982c-42a7-bb6c-f459b0b366b2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:15.114106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f23fc481-982c-42a7-bb6c-f459b0b366b2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:15.386289 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f23fc481-982c-42a7-bb6c-f459b0b366b2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:15.395008 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f23fc481-982c-42a7-bb6c-f459b0b366b2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1521 microversion: 2.1 time: 0.295946 May 21 21:31:15.411787 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2308/4757] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:15 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:15.835630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1da8ff14-9fbc-4bce-93d8-bbd5fc389d17 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:15.836370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1da8ff14-9fbc-4bce-93d8-bbd5fc389d17 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:15.852036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1da8ff14-9fbc-4bce-93d8-bbd5fc389d17 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:15.852970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1da8ff14-9fbc-4bce-93d8-bbd5fc389d17 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:15.854056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1da8ff14-9fbc-4bce-93d8-bbd5fc389d17 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:15.855669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1da8ff14-9fbc-4bce-93d8-bbd5fc389d17 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:15.927976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fa03ab3d-6106-4e86-8cbd-4d1de843688f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:15.929111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fa03ab3d-6106-4e86-8cbd-4d1de843688f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:15.945457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa03ab3d-6106-4e86-8cbd-4d1de843688f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:15.945921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa03ab3d-6106-4e86-8cbd-4d1de843688f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:15.946729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa03ab3d-6106-4e86-8cbd-4d1de843688f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:15.947187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa03ab3d-6106-4e86-8cbd-4d1de843688f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:16.353344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fa03ab3d-6106-4e86-8cbd-4d1de843688f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:16.369525 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fa03ab3d-6106-4e86-8cbd-4d1de843688f tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1512 microversion: 2.1 time: 0.446155 May 21 21:31:16.371724 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2309/4758] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:15 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1512 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:16.431219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e9f36f48-448b-43b7-bc21-071f3f9854a7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:16.433019 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e9f36f48-448b-43b7-bc21-071f3f9854a7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:16.459972 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9f36f48-448b-43b7-bc21-071f3f9854a7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:16.464780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9f36f48-448b-43b7-bc21-071f3f9854a7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:16.466391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9f36f48-448b-43b7-bc21-071f3f9854a7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:16.466677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9f36f48-448b-43b7-bc21-071f3f9854a7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:16.699430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1da8ff14-9fbc-4bce-93d8-bbd5fc389d17 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:16.726577 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1da8ff14-9fbc-4bce-93d8-bbd5fc389d17 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38" status: 200 len: 1317 microversion: 2.1 time: 0.895834 May 21 21:31:16.748909 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2450/4759] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:15 2022] GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 => generated 1317 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:16.811306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f7156477-08b8-4163-ac42-505b38a50008 req-21085185-c2e1-4c80-87f2-c82e8cc862bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f6f2738-3e60-4235-ab67-86ad32c2a384", "tag": "0e5e1124-219a-4afb-a71f-cb8bce128991"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:16.819002 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f7156477-08b8-4163-ac42-505b38a50008 req-21085185-c2e1-4c80-87f2-c82e8cc862bc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:16.819654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f7156477-08b8-4163-ac42-505b38a50008 req-21085185-c2e1-4c80-87f2-c82e8cc862bc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:16.845529 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f7156477-08b8-4163-ac42-505b38a50008 req-21085185-c2e1-4c80-87f2-c82e8cc862bc service nova] Creating event network-changed:0e5e1124-219a-4afb-a71f-cb8bce128991 for instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 on nch1-master-1 May 21 21:31:16.852004 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f7156477-08b8-4163-ac42-505b38a50008 req-21085185-c2e1-4c80-87f2-c82e8cc862bc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051699 May 21 21:31:16.863774 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2451/4760] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:31:16.883194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e9f36f48-448b-43b7-bc21-071f3f9854a7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:16.892679 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e9f36f48-448b-43b7-bc21-071f3f9854a7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1521 microversion: 2.1 time: 0.482111 May 21 21:31:16.893299 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2310/4761] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:16 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1521 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:17.390070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-117a49f2-605d-48e1-84c4-3737963d8a5a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:17.390781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-117a49f2-605d-48e1-84c4-3737963d8a5a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:17.404877 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-117a49f2-605d-48e1-84c4-3737963d8a5a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:17.405594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-117a49f2-605d-48e1-84c4-3737963d8a5a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:17.409411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-117a49f2-605d-48e1-84c4-3737963d8a5a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:17.409411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-117a49f2-605d-48e1-84c4-3737963d8a5a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:17.420549 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-64e1f4e4-3664-48de-a4f6-f12348607e66 req-5e24781e-420d-46dd-8baf-a47639c268b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66d0a724-f81f-497a-8a29-656bce922d38", "tag": "737ac348-9819-4702-ae18-187c7f487368"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:17.454416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-64e1f4e4-3664-48de-a4f6-f12348607e66 req-5e24781e-420d-46dd-8baf-a47639c268b5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:17.455060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-64e1f4e4-3664-48de-a4f6-f12348607e66 req-5e24781e-420d-46dd-8baf-a47639c268b5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:17.491887 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-64e1f4e4-3664-48de-a4f6-f12348607e66 req-5e24781e-420d-46dd-8baf-a47639c268b5 service nova] Creating event network-changed:737ac348-9819-4702-ae18-187c7f487368 for instance 66d0a724-f81f-497a-8a29-656bce922d38 on nch2-master-1 May 21 21:31:17.500266 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-64e1f4e4-3664-48de-a4f6-f12348607e66 req-5e24781e-420d-46dd-8baf-a47639c268b5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083887 May 21 21:31:17.500986 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2311/4762] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:31:17.759580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-69baac0b-e3a8-4c65-8b8f-c3c6e7a5d782 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:17.760322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-69baac0b-e3a8-4c65-8b8f-c3c6e7a5d782 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:17.780876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69baac0b-e3a8-4c65-8b8f-c3c6e7a5d782 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:17.781345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69baac0b-e3a8-4c65-8b8f-c3c6e7a5d782 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:17.782158 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69baac0b-e3a8-4c65-8b8f-c3c6e7a5d782 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:17.782612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69baac0b-e3a8-4c65-8b8f-c3c6e7a5d782 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:18.041049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-69baac0b-e3a8-4c65-8b8f-c3c6e7a5d782 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:18.052322 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-69baac0b-e3a8-4c65-8b8f-c3c6e7a5d782 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38" status: 200 len: 1317 microversion: 2.1 time: 0.296850 May 21 21:31:18.055673 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2312/4763] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:17 2022] GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:18.069089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6b5aea78-b8d6-439c-b034-5abb4e5dbae7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:18.070120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6b5aea78-b8d6-439c-b034-5abb4e5dbae7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:18.086356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b5aea78-b8d6-439c-b034-5abb4e5dbae7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:18.086980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b5aea78-b8d6-439c-b034-5abb4e5dbae7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:18.087896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b5aea78-b8d6-439c-b034-5abb4e5dbae7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:18.088488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b5aea78-b8d6-439c-b034-5abb4e5dbae7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:18.352909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6b5aea78-b8d6-439c-b034-5abb4e5dbae7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:18.356175 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-117a49f2-605d-48e1-84c4-3737963d8a5a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:18.368482 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6b5aea78-b8d6-439c-b034-5abb4e5dbae7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1521 microversion: 2.1 time: 0.311131 May 21 21:31:18.388713 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-117a49f2-605d-48e1-84c4-3737963d8a5a tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1512 microversion: 2.1 time: 1.000395 May 21 21:31:18.388934 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2313/4764] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:18 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:18.389016 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2452/4765] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:17 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1512 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:19.072582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1b02923e-6e1f-4351-89df-93f375a76b24 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:19.073730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1b02923e-6e1f-4351-89df-93f375a76b24 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:19.084790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b02923e-6e1f-4351-89df-93f375a76b24 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:19.085741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b02923e-6e1f-4351-89df-93f375a76b24 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:19.087380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b02923e-6e1f-4351-89df-93f375a76b24 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:19.088729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b02923e-6e1f-4351-89df-93f375a76b24 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:19.281347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1b02923e-6e1f-4351-89df-93f375a76b24 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:19.290968 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1b02923e-6e1f-4351-89df-93f375a76b24 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38" status: 200 len: 1317 microversion: 2.1 time: 0.223119 May 21 21:31:19.303002 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2314/4766] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:19 2022] GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:19.388918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f543afad-d685-4af7-8bb8-c26228cfc315 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:19.390240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f543afad-d685-4af7-8bb8-c26228cfc315 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:19.405955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-08c9fe86-ea64-4c5d-8d17-83d4ee076c48 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:19.406596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-08c9fe86-ea64-4c5d-8d17-83d4ee076c48 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:19.414203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-08c9fe86-ea64-4c5d-8d17-83d4ee076c48 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:19.414893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-08c9fe86-ea64-4c5d-8d17-83d4ee076c48 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:19.415909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-08c9fe86-ea64-4c5d-8d17-83d4ee076c48 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:19.416609 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-08c9fe86-ea64-4c5d-8d17-83d4ee076c48 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:19.441562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f543afad-d685-4af7-8bb8-c26228cfc315 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:19.443187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f543afad-d685-4af7-8bb8-c26228cfc315 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:19.447815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f543afad-d685-4af7-8bb8-c26228cfc315 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:19.448578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f543afad-d685-4af7-8bb8-c26228cfc315 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:19.683166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-08c9fe86-ea64-4c5d-8d17-83d4ee076c48 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:19.696203 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-08c9fe86-ea64-4c5d-8d17-83d4ee076c48 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1512 microversion: 2.1 time: 0.294589 May 21 21:31:19.696849 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2315/4767] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:19 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:19.734812 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f543afad-d685-4af7-8bb8-c26228cfc315 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:19.758143 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f543afad-d685-4af7-8bb8-c26228cfc315 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1521 microversion: 2.1 time: 0.374891 May 21 21:31:19.773186 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2453/4768] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:19 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:20.310053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a8321c63-8c49-4e7b-9b18-e6de3c3fe8be tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:20.310799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a8321c63-8c49-4e7b-9b18-e6de3c3fe8be tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:20.318162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a8321c63-8c49-4e7b-9b18-e6de3c3fe8be tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:20.318705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a8321c63-8c49-4e7b-9b18-e6de3c3fe8be tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:20.319516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a8321c63-8c49-4e7b-9b18-e6de3c3fe8be tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:20.319961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a8321c63-8c49-4e7b-9b18-e6de3c3fe8be tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:20.492955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a8321c63-8c49-4e7b-9b18-e6de3c3fe8be tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:20.501455 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a8321c63-8c49-4e7b-9b18-e6de3c3fe8be tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38" status: 200 len: 1317 microversion: 2.1 time: 0.195602 May 21 21:31:20.502159 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2316/4769] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:20 2022] GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:20.715798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-58ddd188-c677-4f9e-8923-1a6c4e238165 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:20.717988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-58ddd188-c677-4f9e-8923-1a6c4e238165 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:20.727293 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-58ddd188-c677-4f9e-8923-1a6c4e238165 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:20.732187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-58ddd188-c677-4f9e-8923-1a6c4e238165 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:20.732187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-58ddd188-c677-4f9e-8923-1a6c4e238165 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:20.732187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-58ddd188-c677-4f9e-8923-1a6c4e238165 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:20.780840 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4dcb828c-8d83-4164-8827-ebe094440cf6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:20.781894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4dcb828c-8d83-4164-8827-ebe094440cf6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:20.789514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4dcb828c-8d83-4164-8827-ebe094440cf6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:20.790268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4dcb828c-8d83-4164-8827-ebe094440cf6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:20.791325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4dcb828c-8d83-4164-8827-ebe094440cf6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:20.792008 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4dcb828c-8d83-4164-8827-ebe094440cf6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:20.792834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:20.972809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-58ddd188-c677-4f9e-8923-1a6c4e238165 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:20.986773 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-58ddd188-c677-4f9e-8923-1a6c4e238165 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1489 microversion: 2.1 time: 0.275498 May 21 21:31:20.990250 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2454/4770] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:20 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1489 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:21.015870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0ab414a0-cdfa-43d3-b0d5-61907c655851 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1864459652"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:21.020788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0ab414a0-cdfa-43d3-b0d5-61907c655851 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:21.049773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ab414a0-cdfa-43d3-b0d5-61907c655851 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:21.051498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ab414a0-cdfa-43d3-b0d5-61907c655851 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:21.052400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ab414a0-cdfa-43d3-b0d5-61907c655851 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:21.052787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ab414a0-cdfa-43d3-b0d5-61907c655851 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:21.091442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4dcb828c-8d83-4164-8827-ebe094440cf6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:21.102959 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4dcb828c-8d83-4164-8827-ebe094440cf6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1521 microversion: 2.1 time: 0.324661 May 21 21:31:21.113469 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2317/4771] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:20 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:21.262943 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0ab414a0-cdfa-43d3-b0d5-61907c655851 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "PUT /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1062 microversion: 2.1 time: 0.256166 May 21 21:31:21.272465 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2455/4772] 10.222.0.49 () {60 vars in 1255 bytes} [Sat May 21 21:31:21 2022] PUT /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1062 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:21.277992 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6ffaa5b6-cb3c-4723-a6c9-fc059b83e286 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:21.279262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6ffaa5b6-cb3c-4723-a6c9-fc059b83e286 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:21.281333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=8 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:21.290283 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6ffaa5b6-cb3c-4723-a6c9-fc059b83e286 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:21.290739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6ffaa5b6-cb3c-4723-a6c9-fc059b83e286 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:21.297306 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6ffaa5b6-cb3c-4723-a6c9-fc059b83e286 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:21.297825 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6ffaa5b6-cb3c-4723-a6c9-fc059b83e286 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:21.531332 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3cc40451-e1a4-46a7-b3b7-ce1a4108525e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:21.533061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3cc40451-e1a4-46a7-b3b7-ce1a4108525e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:21.557741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3cc40451-e1a4-46a7-b3b7-ce1a4108525e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:21.559294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3cc40451-e1a4-46a7-b3b7-ce1a4108525e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:21.564158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3cc40451-e1a4-46a7-b3b7-ce1a4108525e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:21.567454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3cc40451-e1a4-46a7-b3b7-ce1a4108525e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:21.678961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6ffaa5b6-cb3c-4723-a6c9-fc059b83e286 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:21.699505 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6ffaa5b6-cb3c-4723-a6c9-fc059b83e286 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1489 microversion: 2.1 time: 0.417466 May 21 21:31:21.703007 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2318/4773] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:21 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1489 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:21.723596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ef2d2ce1-e65f-4967-8810-5f4827d79671 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:21.724705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ef2d2ce1-e65f-4967-8810-5f4827d79671 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:21.735853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef2d2ce1-e65f-4967-8810-5f4827d79671 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:21.742929 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef2d2ce1-e65f-4967-8810-5f4827d79671 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:21.744035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef2d2ce1-e65f-4967-8810-5f4827d79671 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:21.744954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef2d2ce1-e65f-4967-8810-5f4827d79671 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:22.022114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ef2d2ce1-e65f-4967-8810-5f4827d79671 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:22.043610 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ef2d2ce1-e65f-4967-8810-5f4827d79671 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1489 microversion: 2.1 time: 0.328995 May 21 21:31:22.064778 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2319/4774] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:21 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1489 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:22.065867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e0ecf8c7-8f97-4fa6-a651-a341b985bcdf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:22.067303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e0ecf8c7-8f97-4fa6-a651-a341b985bcdf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:22.077137 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0ecf8c7-8f97-4fa6-a651-a341b985bcdf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:22.078518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0ecf8c7-8f97-4fa6-a651-a341b985bcdf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:22.080201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0ecf8c7-8f97-4fa6-a651-a341b985bcdf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:22.080895 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0ecf8c7-8f97-4fa6-a651-a341b985bcdf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:22.084125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3cc40451-e1a4-46a7-b3b7-ce1a4108525e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:22.096685 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3cc40451-e1a4-46a7-b3b7-ce1a4108525e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38" status: 200 len: 1317 microversion: 2.1 time: 0.579011 May 21 21:31:22.097766 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2456/4775] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:21 2022] GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 => generated 1317 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:22.116595 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e0ecf8c7-8f97-4fa6-a651-a341b985bcdf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:31:22.122960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4881e071-13ce-4756-95fe-d294b1c14bc2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:22.123580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4881e071-13ce-4756-95fe-d294b1c14bc2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:22.129809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4881e071-13ce-4756-95fe-d294b1c14bc2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:22.130267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4881e071-13ce-4756-95fe-d294b1c14bc2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:22.131050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4881e071-13ce-4756-95fe-d294b1c14bc2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:22.131651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4881e071-13ce-4756-95fe-d294b1c14bc2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:22.328645 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4881e071-13ce-4756-95fe-d294b1c14bc2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:22.337298 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4881e071-13ce-4756-95fe-d294b1c14bc2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1521 microversion: 2.1 time: 0.219348 May 21 21:31:22.338437 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2457/4776] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:22 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:22.498779 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e0ecf8c7-8f97-4fa6-a651-a341b985bcdf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 204 len: 0 microversion: 2.1 time: 0.437606 May 21 21:31:22.499524 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2320/4777] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:31:22 2022] DELETE /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:31:22.507941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-87c2390a-3165-4e12-870b-00e50f01af06 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:22.508640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-87c2390a-3165-4e12-870b-00e50f01af06 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:22.516087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87c2390a-3165-4e12-870b-00e50f01af06 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:22.516588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87c2390a-3165-4e12-870b-00e50f01af06 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:22.517394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87c2390a-3165-4e12-870b-00e50f01af06 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:22.517848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87c2390a-3165-4e12-870b-00e50f01af06 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:22.673839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-87c2390a-3165-4e12-870b-00e50f01af06 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:22.682449 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-87c2390a-3165-4e12-870b-00e50f01af06 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1495 microversion: 2.1 time: 0.178348 May 21 21:31:22.691582 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2458/4778] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:22 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1495 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:23.119786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0d3b584e-afa5-4784-a506-b19b5d6fe623 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:23.126570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-40fb119f-74dc-4d0e-9962-e80d0a3ad9eb req-b7b29e63-502e-4c41-996d-fb237b0ef78d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66d0a724-f81f-497a-8a29-656bce922d38", "name": "network-vif-plugged", "status": "completed", "tag": "737ac348-9819-4702-ae18-187c7f487368"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:23.133042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0d3b584e-afa5-4784-a506-b19b5d6fe623 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:23.135928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-40fb119f-74dc-4d0e-9962-e80d0a3ad9eb req-b7b29e63-502e-4c41-996d-fb237b0ef78d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:23.136839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-40fb119f-74dc-4d0e-9962-e80d0a3ad9eb req-b7b29e63-502e-4c41-996d-fb237b0ef78d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:23.140892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d3b584e-afa5-4784-a506-b19b5d6fe623 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:23.141554 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d3b584e-afa5-4784-a506-b19b5d6fe623 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:23.143123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d3b584e-afa5-4784-a506-b19b5d6fe623 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:23.143716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d3b584e-afa5-4784-a506-b19b5d6fe623 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:23.150761 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-40fb119f-74dc-4d0e-9962-e80d0a3ad9eb req-b7b29e63-502e-4c41-996d-fb237b0ef78d service nova] Creating event network-vif-plugged:737ac348-9819-4702-ae18-187c7f487368 for instance 66d0a724-f81f-497a-8a29-656bce922d38 on nch2-master-1 May 21 21:31:23.158891 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-40fb119f-74dc-4d0e-9962-e80d0a3ad9eb req-b7b29e63-502e-4c41-996d-fb237b0ef78d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036930 May 21 21:31:23.162586 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2459/4779] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:31:23.310170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0d3b584e-afa5-4784-a506-b19b5d6fe623 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:23.321232 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0d3b584e-afa5-4784-a506-b19b5d6fe623 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38" status: 200 len: 1317 microversion: 2.1 time: 0.204567 May 21 21:31:23.321600 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2321/4780] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:23 2022] GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:23.355817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-84912d6a-7efe-4490-860e-8a291402841a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:23.359304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-84912d6a-7efe-4490-860e-8a291402841a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:23.369805 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84912d6a-7efe-4490-860e-8a291402841a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:23.371848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84912d6a-7efe-4490-860e-8a291402841a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:23.373066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84912d6a-7efe-4490-860e-8a291402841a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:23.373856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84912d6a-7efe-4490-860e-8a291402841a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:23.632428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-84912d6a-7efe-4490-860e-8a291402841a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:23.644334 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-84912d6a-7efe-4490-860e-8a291402841a tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1501 microversion: 2.1 time: 0.292871 May 21 21:31:23.645083 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2460/4781] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:23 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1501 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:23.663167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-db3fb876-133f-4c9d-bdf8-65de7adff349 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05d70c6a-b739-4ca4-96bd-e8a3338bb914"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:23.664458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-db3fb876-133f-4c9d-bdf8-65de7adff349 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:23.674161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-db3fb876-133f-4c9d-bdf8-65de7adff349 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:23.674725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-db3fb876-133f-4c9d-bdf8-65de7adff349 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:23.675594 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-db3fb876-133f-4c9d-bdf8-65de7adff349 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:23.676144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-db3fb876-133f-4c9d-bdf8-65de7adff349 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:23.687001 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:23.701800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c4b86f1e-2f89-4193-a1d3-283e6ed19fc1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:23.702484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c4b86f1e-2f89-4193-a1d3-283e6ed19fc1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:23.712958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4b86f1e-2f89-4193-a1d3-283e6ed19fc1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:23.713422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4b86f1e-2f89-4193-a1d3-283e6ed19fc1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:23.716835 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4b86f1e-2f89-4193-a1d3-283e6ed19fc1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:23.717299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4b86f1e-2f89-4193-a1d3-283e6ed19fc1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:23.737042 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-db3fb876-133f-4c9d-bdf8-65de7adff349 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] HTTP exception thrown: Cannot 'attach_volume' instance 506776f0-470a-4a6b-ac34-3414463a8770 while it is in vm_state rescued May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-db3fb876-133f-4c9d-bdf8-65de7adff349 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Request method failure captured: May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770/os-volume_attachments HTTP/1.1 May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 74 May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVnYy3SaySatFVqWuD4QLMX78tOZu2Sq081sncP5_CZnvryZkShUPSqptMQixW9D6QLw2UuDdxyQwaeJ6lrj30y7u6OXCJpzi5UJG9aI3fEqHW0Sq9F2EcE_2fCjYowdWcuux0Sp0LhoueDGd91ZOn29SJFvBmrTIiAhoJB3iHzY0IU May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 2e6d59483dc54fe4a558186055068419 May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2e6d59483dc54fe4a558186055068419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2e6d59483dc54fe4a558186055068419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2e6d59483dc54fe4a558186055068419", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2e6d59483dc54fe4a558186055068419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 2e6d59483dc54fe4a558186055068419 May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerRescueNegativeTestJSON-1981617934-project May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 9a0ccfb5c9a04ec0831a0bfe987bb659 May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1981617934-project May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: {"volumeAttachment": {"volumeId": "05d70c6a-b739-4ca4-96bd-e8a3338bb914"}} May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: exception: Cannot 'attach_volume' instance 506776f0-470a-4a6b-ac34-3414463a8770 while it is in vm_state rescued May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'server_id': '506776f0-470a-4a6b-ac34-3414463a8770', 'body': {'volumeAttachment': {'volumeId': '05d70c6a-b739-4ca4-96bd-e8a3338bb914'}}} May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 506776f0-470a-4a6b-ac34-3414463a8770 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 21 21:31:23.738975 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 21 21:31:23.750723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 21 21:31:23.750723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 21 21:31:23.750723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 506776f0-470a-4a6b-ac34-3414463a8770 while it is in vm_state rescued May 21 21:31:23.750723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:23.750723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:23.750723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:23.750723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:23.750723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:23.750723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:23.750723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:23.750723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:23.750723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 506776f0-470a-4a6b-ac34-3414463a8770 while it is in vm_state rescued May 21 21:31:23.750723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:23.750723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-db3fb876-133f-4c9d-bdf8-65de7adff349 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Returning 409 to user: Cannot 'attach_volume' instance 506776f0-470a-4a6b-ac34-3414463a8770 while it is in vm_state rescued {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:23.750723 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-db3fb876-133f-4c9d-bdf8-65de7adff349 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "POST /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.081670 May 21 21:31:23.750723 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2322/4782] 10.222.0.49 () {60 vars in 1322 bytes} [Sat May 21 21:31:23 2022] POST /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770/os-volume_attachments => generated 152 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 21 21:31:23.757717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f64335e8-3840-4a80-aab5-8880750c05aa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:23.758588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f64335e8-3840-4a80-aab5-8880750c05aa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:23.765893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f64335e8-3840-4a80-aab5-8880750c05aa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:23.766561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f64335e8-3840-4a80-aab5-8880750c05aa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:23.771780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f64335e8-3840-4a80-aab5-8880750c05aa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:23.771780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f64335e8-3840-4a80-aab5-8880750c05aa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:23.994266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c4b86f1e-2f89-4193-a1d3-283e6ed19fc1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:24.008214 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c4b86f1e-2f89-4193-a1d3-283e6ed19fc1 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1495 microversion: 2.1 time: 0.308199 May 21 21:31:24.009348 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2461/4783] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:23 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1495 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:24.055157 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f64335e8-3840-4a80-aab5-8880750c05aa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "POST /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770/action" status: 202 len: 0 microversion: 2.1 time: 0.301202 May 21 21:31:24.056071 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2323/4784] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:31:23 2022] POST /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:31:24.066019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-177494d6-998f-4ffc-8403-b5b112cf1b00 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:24.066658 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-177494d6-998f-4ffc-8403-b5b112cf1b00 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:24.076648 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-177494d6-998f-4ffc-8403-b5b112cf1b00 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:24.077113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-177494d6-998f-4ffc-8403-b5b112cf1b00 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:24.077919 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-177494d6-998f-4ffc-8403-b5b112cf1b00 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:24.078373 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-177494d6-998f-4ffc-8403-b5b112cf1b00 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:24.083044 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:24.338091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-51f0c481-2ba7-4ace-98ad-bad316e24364 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:24.339543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-51f0c481-2ba7-4ace-98ad-bad316e24364 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:24.348428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-51f0c481-2ba7-4ace-98ad-bad316e24364 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:24.349204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-51f0c481-2ba7-4ace-98ad-bad316e24364 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:24.350221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-51f0c481-2ba7-4ace-98ad-bad316e24364 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:24.350878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-51f0c481-2ba7-4ace-98ad-bad316e24364 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:24.407942 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-177494d6-998f-4ffc-8403-b5b112cf1b00 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:24.420946 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-177494d6-998f-4ffc-8403-b5b112cf1b00 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1509 microversion: 2.1 time: 0.356964 May 21 21:31:24.420946 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2462/4785] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:24 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1509 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:24.709156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-51f0c481-2ba7-4ace-98ad-bad316e24364 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:24.724568 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-51f0c481-2ba7-4ace-98ad-bad316e24364 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38" status: 200 len: 1317 microversion: 2.1 time: 0.389575 May 21 21:31:24.741815 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2324/4786] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:24 2022] GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:25.005179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-a70ec458-13fc-4eb5-8691-a070c8925168 req-f76b0e5c-7bd7-4d8d-9463-782c1f04c7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ab4f419-8067-4d96-bfd0-a5866cfd3ad5", "name": "network-vif-deleted", "tag": "cc697345-1357-4c21-860a-bbf572179745"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:25.030487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b1f44969-5d50-45f4-b3bf-a461a9fa2544 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:25.031534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b1f44969-5d50-45f4-b3bf-a461a9fa2544 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:25.044948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a70ec458-13fc-4eb5-8691-a070c8925168 req-f76b0e5c-7bd7-4d8d-9463-782c1f04c7c8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:25.044948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a70ec458-13fc-4eb5-8691-a070c8925168 req-f76b0e5c-7bd7-4d8d-9463-782c1f04c7c8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:25.052259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b1f44969-5d50-45f4-b3bf-a461a9fa2544 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:25.053045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b1f44969-5d50-45f4-b3bf-a461a9fa2544 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:25.057148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b1f44969-5d50-45f4-b3bf-a461a9fa2544 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:25.063465 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b1f44969-5d50-45f4-b3bf-a461a9fa2544 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:25.069897 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a70ec458-13fc-4eb5-8691-a070c8925168 req-f76b0e5c-7bd7-4d8d-9463-782c1f04c7c8 service nova] Creating event network-vif-deleted:cc697345-1357-4c21-860a-bbf572179745 for instance 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 on nch2-master-1 May 21 21:31:25.075559 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-a70ec458-13fc-4eb5-8691-a070c8925168 req-f76b0e5c-7bd7-4d8d-9463-782c1f04c7c8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074257 May 21 21:31:25.076873 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2463/4787] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:31:25.197881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b1f44969-5d50-45f4-b3bf-a461a9fa2544 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:25.206778 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b1f44969-5d50-45f4-b3bf-a461a9fa2544 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1453 microversion: 2.1 time: 0.184488 May 21 21:31:25.208833 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2325/4788] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:25 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:25.437069 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5600b565-5afb-4793-b40f-c04f420e46ab tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:25.438733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5600b565-5afb-4793-b40f-c04f420e46ab tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:25.452640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5600b565-5afb-4793-b40f-c04f420e46ab tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:25.453280 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5600b565-5afb-4793-b40f-c04f420e46ab tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:25.455968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5600b565-5afb-4793-b40f-c04f420e46ab tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:25.458076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5600b565-5afb-4793-b40f-c04f420e46ab tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:25.742494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d9da5234-a257-4b3f-b048-c5ff2a7aa97e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:25.743236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d9da5234-a257-4b3f-b048-c5ff2a7aa97e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:25.753095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9da5234-a257-4b3f-b048-c5ff2a7aa97e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:25.753623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9da5234-a257-4b3f-b048-c5ff2a7aa97e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:25.754638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9da5234-a257-4b3f-b048-c5ff2a7aa97e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:25.755251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9da5234-a257-4b3f-b048-c5ff2a7aa97e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:25.827214 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5600b565-5afb-4793-b40f-c04f420e46ab tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:25.835831 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5600b565-5afb-4793-b40f-c04f420e46ab tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1509 microversion: 2.1 time: 0.403626 May 21 21:31:25.836465 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2464/4789] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:25 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1509 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:25.926139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d9da5234-a257-4b3f-b048-c5ff2a7aa97e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:25.935197 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d9da5234-a257-4b3f-b048-c5ff2a7aa97e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38" status: 200 len: 1506 microversion: 2.1 time: 0.196201 May 21 21:31:25.946462 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2326/4790] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:25 2022] GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:25.953852 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a0928e06-32c7-452b-a099-b479a36fed48 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:25.954381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a0928e06-32c7-452b-a099-b479a36fed48 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:25.961197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a0928e06-32c7-452b-a099-b479a36fed48 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:25.961867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a0928e06-32c7-452b-a099-b479a36fed48 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:25.962655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a0928e06-32c7-452b-a099-b479a36fed48 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:25.963104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a0928e06-32c7-452b-a099-b479a36fed48 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:25.989365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a0928e06-32c7-452b-a099-b479a36fed48 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:31:26.224831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bf25eaee-58ca-47db-aaa1-458a9be752db tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:26.225473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bf25eaee-58ca-47db-aaa1-458a9be752db tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:26.233239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf25eaee-58ca-47db-aaa1-458a9be752db tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:26.234416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf25eaee-58ca-47db-aaa1-458a9be752db tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:26.235443 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf25eaee-58ca-47db-aaa1-458a9be752db tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:26.236086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf25eaee-58ca-47db-aaa1-458a9be752db tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:26.273262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf25eaee-58ca-47db-aaa1-458a9be752db tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:26.274441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf25eaee-58ca-47db-aaa1-458a9be752db tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:26.275233 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-bf25eaee-58ca-47db-aaa1-458a9be752db tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lazy-loading 'fault' on Instance uuid 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:31:26.413536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bf25eaee-58ca-47db-aaa1-458a9be752db tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:26.421249 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bf25eaee-58ca-47db-aaa1-458a9be752db tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 200 len: 1310 microversion: 2.1 time: 0.201317 May 21 21:31:26.422019 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2327/4791] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:26 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 1310 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:26.429831 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a0928e06-32c7-452b-a099-b479a36fed48 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "DELETE /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38" status: 204 len: 0 microversion: 2.1 time: 0.480215 May 21 21:31:26.431893 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2465/4792] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:31:25 2022] DELETE /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 21:31:26.439261 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-85090cbd-1d05-4544-a1ce-2503a51dacca tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:26.439980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-85090cbd-1d05-4544-a1ce-2503a51dacca tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:26.446641 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-85090cbd-1d05-4544-a1ce-2503a51dacca tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:26.447085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-85090cbd-1d05-4544-a1ce-2503a51dacca tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:26.447868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-85090cbd-1d05-4544-a1ce-2503a51dacca tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:26.448405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-85090cbd-1d05-4544-a1ce-2503a51dacca tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:26.598081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-85090cbd-1d05-4544-a1ce-2503a51dacca tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:26.605984 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-85090cbd-1d05-4544-a1ce-2503a51dacca tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38" status: 200 len: 1512 microversion: 2.1 time: 0.170932 May 21 21:31:26.606572 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2328/4793] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:26 2022] GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:26.855178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fe304c54-ba1c-4bb0-aca5-bdb7a8c32fe2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:26.855897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fe304c54-ba1c-4bb0-aca5-bdb7a8c32fe2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:26.866522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe304c54-ba1c-4bb0-aca5-bdb7a8c32fe2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:26.866984 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe304c54-ba1c-4bb0-aca5-bdb7a8c32fe2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:26.867777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe304c54-ba1c-4bb0-aca5-bdb7a8c32fe2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:26.868222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe304c54-ba1c-4bb0-aca5-bdb7a8c32fe2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.198940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fe304c54-ba1c-4bb0-aca5-bdb7a8c32fe2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:27.208067 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fe304c54-ba1c-4bb0-aca5-bdb7a8c32fe2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1509 microversion: 2.1 time: 0.357119 May 21 21:31:27.209101 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2466/4794] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:26 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1509 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:27.439826 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d9d35047-702f-4979-aeba-9c8028c6e4be tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:27.440554 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d9d35047-702f-4979-aeba-9c8028c6e4be tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:27.447990 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9d35047-702f-4979-aeba-9c8028c6e4be tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.448476 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9d35047-702f-4979-aeba-9c8028c6e4be tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.449440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9d35047-702f-4979-aeba-9c8028c6e4be tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.449910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9d35047-702f-4979-aeba-9c8028c6e4be tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.465052 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-d9d35047-702f-4979-aeba-9c8028c6e4be tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 could not be found. May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d9d35047-702f-4979-aeba-9c8028c6e4be tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 HTTP/1.1 May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 could not be found. May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '5ab4f419-8067-4d96-bfd0-a5866cfd3ad5'} May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 could not be found. May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 could not be found. May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.467713 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.472840 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.472840 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.472840 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:27.472840 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:27.472840 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 could not be found. May 21 21:31:27.472840 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.472840 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d9d35047-702f-4979-aeba-9c8028c6e4be tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:27.472840 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d9d35047-702f-4979-aeba-9c8028c6e4be tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 404 len: 111 microversion: 2.1 time: 0.034438 May 21 21:31:27.482355 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2329/4795] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:27 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:31:27.487282 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5d971f67-646a-4a57-ada2-ba101f6190d8 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:27.487899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5d971f67-646a-4a57-ada2-ba101f6190d8 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:27.494179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d971f67-646a-4a57-ada2-ba101f6190d8 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.495015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d971f67-646a-4a57-ada2-ba101f6190d8 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.496339 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d971f67-646a-4a57-ada2-ba101f6190d8 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.498673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d971f67-646a-4a57-ada2-ba101f6190d8 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.518116 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-5d971f67-646a-4a57-ada2-ba101f6190d8 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 could not be found. May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5d971f67-646a-4a57-ada2-ba101f6190d8 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 HTTP/1.1 May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 could not be found. May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '5ab4f419-8067-4d96-bfd0-a5866cfd3ad5'} May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 could not be found. May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:27.520091 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 could not be found. May 21 21:31:27.528460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:27.528460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.528460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:27.528460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.528460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.528460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.528460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:27.528460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:27.528460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 could not be found. May 21 21:31:27.528460 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:27.528460 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5d971f67-646a-4a57-ada2-ba101f6190d8 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:27.528460 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5d971f67-646a-4a57-ada2-ba101f6190d8 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 404 len: 111 microversion: 2.1 time: 0.042891 May 21 21:31:27.528460 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2467/4796] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:31:27 2022] DELETE /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:31:27.535902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e7414eb2-ae65-4781-b318-08e1ec3047fe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:27.536568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e7414eb2-ae65-4781-b318-08e1ec3047fe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:27.543018 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7414eb2-ae65-4781-b318-08e1ec3047fe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.543479 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7414eb2-ae65-4781-b318-08e1ec3047fe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.545257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7414eb2-ae65-4781-b318-08e1ec3047fe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.545788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7414eb2-ae65-4781-b318-08e1ec3047fe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.560756 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-e7414eb2-ae65-4781-b318-08e1ec3047fe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 could not be found. May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e7414eb2-ae65-4781-b318-08e1ec3047fe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 HTTP/1.1 May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 could not be found. May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '5ab4f419-8067-4d96-bfd0-a5866cfd3ad5'} May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 could not be found. May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 could not be found. May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.562312 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.566401 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.566401 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.566401 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:27.566401 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:27.566401 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 could not be found. May 21 21:31:27.566401 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.566401 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e7414eb2-ae65-4781-b318-08e1ec3047fe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance 5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:27.566401 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e7414eb2-ae65-4781-b318-08e1ec3047fe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5" status: 404 len: 111 microversion: 2.1 time: 0.031940 May 21 21:31:27.566401 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2330/4797] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:27 2022] GET /compute/v2.1/servers/5ab4f419-8067-4d96-bfd0-a5866cfd3ad5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:31:27.572828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d6a4c231-a4c4-4543-9f9d-bb328e33ac1c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:27.573405 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d6a4c231-a4c4-4543-9f9d-bb328e33ac1c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:27.580039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6a4c231-a4c4-4543-9f9d-bb328e33ac1c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.580578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6a4c231-a4c4-4543-9f9d-bb328e33ac1c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.581363 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6a4c231-a4c4-4543-9f9d-bb328e33ac1c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.581808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6a4c231-a4c4-4543-9f9d-bb328e33ac1c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.599198 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-d6a4c231-a4c4-4543-9f9d-bb328e33ac1c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 could not be found. May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d6a4c231-a4c4-4543-9f9d-bb328e33ac1c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 HTTP/1.1 May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 could not be found. May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'f74db7ff-ff9c-47f1-9910-a12d77e7c7c0'} May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 could not be found. May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:27.600815 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 could not be found. May 21 21:31:27.605172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:27.605172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.605172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:27.605172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.605172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.605172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.605172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:27.605172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:27.605172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 could not be found. May 21 21:31:27.605172 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:27.605172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d6a4c231-a4c4-4543-9f9d-bb328e33ac1c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:27.605172 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d6a4c231-a4c4-4543-9f9d-bb328e33ac1c tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 404 len: 111 microversion: 2.1 time: 0.033555 May 21 21:31:27.605172 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2468/4798] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:31:27 2022] DELETE /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:31:27.611461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0afde307-7f14-4f56-b271-05d0bdb8aa22 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:27.612086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0afde307-7f14-4f56-b271-05d0bdb8aa22 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f74db7ff-ff9c-47f1-9910-a12d77e7c7c0] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:27.620060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0afde307-7f14-4f56-b271-05d0bdb8aa22 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.620786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0afde307-7f14-4f56-b271-05d0bdb8aa22 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.621800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0afde307-7f14-4f56-b271-05d0bdb8aa22 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.622729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0afde307-7f14-4f56-b271-05d0bdb8aa22 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.622931 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-80a42803-2e4e-4cd9-816c-c33b57aaec84 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:27.623519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-80a42803-2e4e-4cd9-816c-c33b57aaec84 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:27.629887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80a42803-2e4e-4cd9-816c-c33b57aaec84 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.630339 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80a42803-2e4e-4cd9-816c-c33b57aaec84 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.631177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80a42803-2e4e-4cd9-816c-c33b57aaec84 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.631623 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80a42803-2e4e-4cd9-816c-c33b57aaec84 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.638076 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-0afde307-7f14-4f56-b271-05d0bdb8aa22 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 could not be found. May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0afde307-7f14-4f56-b271-05d0bdb8aa22 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 HTTP/1.1 May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 could not be found. May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'f74db7ff-ff9c-47f1-9910-a12d77e7c7c0'} May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 could not be found. May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 could not be found. May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.639774 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.644615 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.644615 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.644615 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:27.644615 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:27.644615 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 could not be found. May 21 21:31:27.644615 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.644615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0afde307-7f14-4f56-b271-05d0bdb8aa22 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:27.644615 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0afde307-7f14-4f56-b271-05d0bdb8aa22 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0" status: 404 len: 111 microversion: 2.1 time: 0.033726 May 21 21:31:27.644615 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2331/4799] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:27 2022] GET /compute/v2.1/servers/f74db7ff-ff9c-47f1-9910-a12d77e7c7c0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:31:27.655154 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8378f738-0ea5-4f77-bf78-7ce4caf4ded2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:27.655652 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8378f738-0ea5-4f77-bf78-7ce4caf4ded2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:27.662087 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8378f738-0ea5-4f77-bf78-7ce4caf4ded2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.662440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8378f738-0ea5-4f77-bf78-7ce4caf4ded2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.663219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8378f738-0ea5-4f77-bf78-7ce4caf4ded2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.663664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8378f738-0ea5-4f77-bf78-7ce4caf4ded2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.678843 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-8378f738-0ea5-4f77-bf78-7ce4caf4ded2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance cbe5a17b-6c84-492c-a252-a561e3920278 could not be found. May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8378f738-0ea5-4f77-bf78-7ce4caf4ded2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 HTTP/1.1 May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance cbe5a17b-6c84-492c-a252-a561e3920278 could not be found. May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'cbe5a17b-6c84-492c-a252-a561e3920278'} May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbe5a17b-6c84-492c-a252-a561e3920278 could not be found. May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:27.680501 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbe5a17b-6c84-492c-a252-a561e3920278 could not be found. May 21 21:31:27.684735 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.684735 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.684735 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.684735 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.684735 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.684735 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.684735 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:27.684735 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:27.684735 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbe5a17b-6c84-492c-a252-a561e3920278 could not be found. May 21 21:31:27.684735 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.684735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8378f738-0ea5-4f77-bf78-7ce4caf4ded2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance cbe5a17b-6c84-492c-a252-a561e3920278 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:27.684735 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8378f738-0ea5-4f77-bf78-7ce4caf4ded2 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 404 len: 111 microversion: 2.1 time: 0.031278 May 21 21:31:27.684735 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2332/4800] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:31:27 2022] DELETE /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:31:27.691196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d7e708a5-6b3f-402c-8926-55040a41efd5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:27.693757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d7e708a5-6b3f-402c-8926-55040a41efd5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: cbe5a17b-6c84-492c-a252-a561e3920278] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:27.700886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7e708a5-6b3f-402c-8926-55040a41efd5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.701344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7e708a5-6b3f-402c-8926-55040a41efd5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.702231 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7e708a5-6b3f-402c-8926-55040a41efd5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.702601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7e708a5-6b3f-402c-8926-55040a41efd5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.717770 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-d7e708a5-6b3f-402c-8926-55040a41efd5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance cbe5a17b-6c84-492c-a252-a561e3920278 could not be found. May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d7e708a5-6b3f-402c-8926-55040a41efd5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 HTTP/1.1 May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance cbe5a17b-6c84-492c-a252-a561e3920278 could not be found. May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'cbe5a17b-6c84-492c-a252-a561e3920278'} May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbe5a17b-6c84-492c-a252-a561e3920278 could not be found. May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbe5a17b-6c84-492c-a252-a561e3920278 could not be found. May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.719331 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.724186 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.724186 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.724186 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:27.724186 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:27.724186 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbe5a17b-6c84-492c-a252-a561e3920278 could not be found. May 21 21:31:27.724186 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.724186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d7e708a5-6b3f-402c-8926-55040a41efd5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance cbe5a17b-6c84-492c-a252-a561e3920278 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:27.724186 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d7e708a5-6b3f-402c-8926-55040a41efd5 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278" status: 404 len: 111 microversion: 2.1 time: 0.033506 May 21 21:31:27.724186 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2333/4801] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:27 2022] GET /compute/v2.1/servers/cbe5a17b-6c84-492c-a252-a561e3920278 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:31:27.729753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8b178c69-f1e7-4b41-a5fd-7338e4a495f6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:27.730570 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8b178c69-f1e7-4b41-a5fd-7338e4a495f6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:27.737613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b178c69-f1e7-4b41-a5fd-7338e4a495f6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.740152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b178c69-f1e7-4b41-a5fd-7338e4a495f6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.740152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b178c69-f1e7-4b41-a5fd-7338e4a495f6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.740152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b178c69-f1e7-4b41-a5fd-7338e4a495f6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.757094 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-8b178c69-f1e7-4b41-a5fd-7338e4a495f6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd could not be found. May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8b178c69-f1e7-4b41-a5fd-7338e4a495f6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd HTTP/1.1 May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd could not be found. May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '00f49c4e-7f9e-48b8-a1db-6be0456b1ebd'} May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd could not be found. May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:27.759179 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd could not be found. May 21 21:31:27.765177 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.765177 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.765177 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.765177 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.765177 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.765177 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.765177 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:27.765177 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:27.765177 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd could not be found. May 21 21:31:27.765177 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.765177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8b178c69-f1e7-4b41-a5fd-7338e4a495f6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:27.765177 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8b178c69-f1e7-4b41-a5fd-7338e4a495f6 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "DELETE /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 404 len: 111 microversion: 2.1 time: 0.036450 May 21 21:31:27.765177 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2334/4802] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:31:27 2022] DELETE /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:31:27.776108 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-37c85d57-64a9-44e3-b2f0-f0248902241d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:27.777252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-37c85d57-64a9-44e3-b2f0-f0248902241d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:27.779993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:27.785758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-37c85d57-64a9-44e3-b2f0-f0248902241d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.786214 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-37c85d57-64a9-44e3-b2f0-f0248902241d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.786998 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-37c85d57-64a9-44e3-b2f0-f0248902241d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.787437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-37c85d57-64a9-44e3-b2f0-f0248902241d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.803303 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-37c85d57-64a9-44e3-b2f0-f0248902241d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd could not be found. May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-37c85d57-64a9-44e3-b2f0-f0248902241d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd HTTP/1.1 May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd could not be found. May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '00f49c4e-7f9e-48b8-a1db-6be0456b1ebd'} May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd could not be found. May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd could not be found. May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.804910 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.809894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.809894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.809894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:27.809894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:27.809894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd could not be found. May 21 21:31:27.809894 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.809894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-37c85d57-64a9-44e3-b2f0-f0248902241d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance 00f49c4e-7f9e-48b8-a1db-6be0456b1ebd could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:27.809894 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-37c85d57-64a9-44e3-b2f0-f0248902241d tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd" status: 404 len: 111 microversion: 2.1 time: 0.037235 May 21 21:31:27.809894 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2335/4803] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:27 2022] GET /compute/v2.1/servers/00f49c4e-7f9e-48b8-a1db-6be0456b1ebd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:31:27.816200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3aea44f2-b159-49d5-bc0d-2805790b7b54 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:27.816828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3aea44f2-b159-49d5-bc0d-2805790b7b54 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:27.824134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3aea44f2-b159-49d5-bc0d-2805790b7b54 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.825316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3aea44f2-b159-49d5-bc0d-2805790b7b54 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.826227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3aea44f2-b159-49d5-bc0d-2805790b7b54 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.826834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3aea44f2-b159-49d5-bc0d-2805790b7b54 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.844624 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-3aea44f2-b159-49d5-bc0d-2805790b7b54 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance 7dff940b-adb6-40c4-a7a0-e6088b0a20be could not be found. May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3aea44f2-b159-49d5-bc0d-2805790b7b54 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be HTTP/1.1 May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 7dff940b-adb6-40c4-a7a0-e6088b0a20be could not be found. May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '7dff940b-adb6-40c4-a7a0-e6088b0a20be'} May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dff940b-adb6-40c4-a7a0-e6088b0a20be could not be found. May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:27.846539 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dff940b-adb6-40c4-a7a0-e6088b0a20be could not be found. May 21 21:31:27.850927 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.850927 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.850927 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.850927 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.850927 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.850927 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.850927 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:27.850927 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:27.850927 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dff940b-adb6-40c4-a7a0-e6088b0a20be could not be found. May 21 21:31:27.850927 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.850927 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3aea44f2-b159-49d5-bc0d-2805790b7b54 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance 7dff940b-adb6-40c4-a7a0-e6088b0a20be could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:27.851678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-80a42803-2e4e-4cd9-816c-c33b57aaec84 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:27.852499 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3aea44f2-b159-49d5-bc0d-2805790b7b54 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 404 len: 111 microversion: 2.1 time: 0.040939 May 21 21:31:27.857053 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2336/4804] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:31:27 2022] DELETE /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:31:27.864770 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-80a42803-2e4e-4cd9-816c-c33b57aaec84 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38" status: 200 len: 1512 microversion: 2.1 time: 0.244603 May 21 21:31:27.865562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e1ef8743-2bac-4729-96da-916c4d2c63ea tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:27.866349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e1ef8743-2bac-4729-96da-916c4d2c63ea tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: 7dff940b-adb6-40c4-a7a0-e6088b0a20be] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:27.873082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1ef8743-2bac-4729-96da-916c4d2c63ea tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.873653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1ef8743-2bac-4729-96da-916c4d2c63ea tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.874576 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2469/4805] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:27 2022] GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 => generated 1512 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:27.874714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1ef8743-2bac-4729-96da-916c4d2c63ea tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.875312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e1ef8743-2bac-4729-96da-916c4d2c63ea tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.892146 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-e1ef8743-2bac-4729-96da-916c4d2c63ea tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance 7dff940b-adb6-40c4-a7a0-e6088b0a20be could not be found. May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e1ef8743-2bac-4729-96da-916c4d2c63ea tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be HTTP/1.1 May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 7dff940b-adb6-40c4-a7a0-e6088b0a20be could not be found. May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '7dff940b-adb6-40c4-a7a0-e6088b0a20be'} May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dff940b-adb6-40c4-a7a0-e6088b0a20be could not be found. May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dff940b-adb6-40c4-a7a0-e6088b0a20be could not be found. May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.893800 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.898262 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.898262 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.898262 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:27.898262 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:27.898262 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dff940b-adb6-40c4-a7a0-e6088b0a20be could not be found. May 21 21:31:27.898262 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.898262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e1ef8743-2bac-4729-96da-916c4d2c63ea tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance 7dff940b-adb6-40c4-a7a0-e6088b0a20be could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:27.898262 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e1ef8743-2bac-4729-96da-916c4d2c63ea tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be" status: 404 len: 111 microversion: 2.1 time: 0.034264 May 21 21:31:27.898262 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2337/4806] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:27 2022] GET /compute/v2.1/servers/7dff940b-adb6-40c4-a7a0-e6088b0a20be => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:31:27.910151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ce175c36-347d-4ce3-a9b0-ce19b0ad64ba tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:27.910732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ce175c36-347d-4ce3-a9b0-ce19b0ad64ba tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:27.914812 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:27.919451 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce175c36-347d-4ce3-a9b0-ce19b0ad64ba tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.920055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce175c36-347d-4ce3-a9b0-ce19b0ad64ba tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.921068 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce175c36-347d-4ce3-a9b0-ce19b0ad64ba tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.926229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce175c36-347d-4ce3-a9b0-ce19b0ad64ba tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.936536 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-ce175c36-347d-4ce3-a9b0-ce19b0ad64ba tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance f75bc144-8ec2-4751-a77e-6c7c7fedaec9 could not be found. May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ce175c36-347d-4ce3-a9b0-ce19b0ad64ba tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 HTTP/1.1 May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance f75bc144-8ec2-4751-a77e-6c7c7fedaec9 could not be found. May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'f75bc144-8ec2-4751-a77e-6c7c7fedaec9'} May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f75bc144-8ec2-4751-a77e-6c7c7fedaec9 could not be found. May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:27.938343 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f75bc144-8ec2-4751-a77e-6c7c7fedaec9 could not be found. May 21 21:31:27.942342 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:27.942342 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.942342 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:27.942342 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.942342 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.942342 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.942342 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:27.942342 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:27.942342 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f75bc144-8ec2-4751-a77e-6c7c7fedaec9 could not be found. May 21 21:31:27.942342 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:27.943658 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ce175c36-347d-4ce3-a9b0-ce19b0ad64ba tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance f75bc144-8ec2-4751-a77e-6c7c7fedaec9 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:27.944549 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ce175c36-347d-4ce3-a9b0-ce19b0ad64ba tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 404 len: 111 microversion: 2.1 time: 0.038412 May 21 21:31:27.945110 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2470/4807] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:31:27 2022] DELETE /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:31:27.953910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ee0413ee-147a-4767-95df-ff7f485d7499 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:27.954629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ee0413ee-147a-4767-95df-ff7f485d7499 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: f75bc144-8ec2-4751-a77e-6c7c7fedaec9] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:27.961326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee0413ee-147a-4767-95df-ff7f485d7499 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.962490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee0413ee-147a-4767-95df-ff7f485d7499 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.962631 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee0413ee-147a-4767-95df-ff7f485d7499 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:27.962995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee0413ee-147a-4767-95df-ff7f485d7499 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:27.977705 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-ee0413ee-147a-4767-95df-ff7f485d7499 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance f75bc144-8ec2-4751-a77e-6c7c7fedaec9 could not be found. May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ee0413ee-147a-4767-95df-ff7f485d7499 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 HTTP/1.1 May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance f75bc144-8ec2-4751-a77e-6c7c7fedaec9 could not be found. May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'f75bc144-8ec2-4751-a77e-6c7c7fedaec9'} May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f75bc144-8ec2-4751-a77e-6c7c7fedaec9 could not be found. May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f75bc144-8ec2-4751-a77e-6c7c7fedaec9 could not be found. May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.979723 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:27.986095 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:27.986095 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:27.986095 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:27.986095 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:27.986095 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f75bc144-8ec2-4751-a77e-6c7c7fedaec9 could not be found. May 21 21:31:27.986095 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:27.986095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ee0413ee-147a-4767-95df-ff7f485d7499 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance f75bc144-8ec2-4751-a77e-6c7c7fedaec9 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:27.986095 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ee0413ee-147a-4767-95df-ff7f485d7499 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9" status: 404 len: 111 microversion: 2.1 time: 0.031758 May 21 21:31:27.986095 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2338/4808] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:27 2022] GET /compute/v2.1/servers/f75bc144-8ec2-4751-a77e-6c7c7fedaec9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:31:27.991969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-29d34f67-e00d-4cd2-900d-1ccbd6655873 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:27.992643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-29d34f67-e00d-4cd2-900d-1ccbd6655873 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: bd0952e5-db2c-45ed-ac68-e59b37512d12] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:28.000559 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-29d34f67-e00d-4cd2-900d-1ccbd6655873 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance bd0952e5-db2c-45ed-ac68-e59b37512d12 could not be found. May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-29d34f67-e00d-4cd2-900d-1ccbd6655873 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/bd0952e5-db2c-45ed-ac68-e59b37512d12 HTTP/1.1 May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance bd0952e5-db2c-45ed-ac68-e59b37512d12 could not be found. May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'bd0952e5-db2c-45ed-ac68-e59b37512d12'} May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd0952e5-db2c-45ed-ac68-e59b37512d12 could not be found. May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd0952e5-db2c-45ed-ac68-e59b37512d12 could not be found. May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:28.002926 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:28.007830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:28.007830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:28.007830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:28.007830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:28.007830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:28.007830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd0952e5-db2c-45ed-ac68-e59b37512d12 could not be found. May 21 21:31:28.007830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:28.014552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-29d34f67-e00d-4cd2-900d-1ccbd6655873 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance bd0952e5-db2c-45ed-ac68-e59b37512d12 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:28.014552 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-29d34f67-e00d-4cd2-900d-1ccbd6655873 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bd0952e5-db2c-45ed-ac68-e59b37512d12" status: 404 len: 111 microversion: 2.1 time: 0.022445 May 21 21:31:28.015097 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2471/4809] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:31:27 2022] DELETE /compute/v2.1/servers/bd0952e5-db2c-45ed-ac68-e59b37512d12 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:31:28.019957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d194c136-a4fc-4c03-be01-c811b1299bbe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:28.020612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d194c136-a4fc-4c03-be01-c811b1299bbe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: bd0952e5-db2c-45ed-ac68-e59b37512d12] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:28.026338 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-d194c136-a4fc-4c03-be01-c811b1299bbe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance bd0952e5-db2c-45ed-ac68-e59b37512d12 could not be found. May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d194c136-a4fc-4c03-be01-c811b1299bbe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/bd0952e5-db2c-45ed-ac68-e59b37512d12 HTTP/1.1 May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance bd0952e5-db2c-45ed-ac68-e59b37512d12 could not be found. May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'bd0952e5-db2c-45ed-ac68-e59b37512d12'} May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd0952e5-db2c-45ed-ac68-e59b37512d12 could not be found. May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd0952e5-db2c-45ed-ac68-e59b37512d12 could not be found. May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:28.027871 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:28.033577 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:28.033577 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:28.033577 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd0952e5-db2c-45ed-ac68-e59b37512d12 could not be found. May 21 21:31:28.033577 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:28.033577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d194c136-a4fc-4c03-be01-c811b1299bbe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance bd0952e5-db2c-45ed-ac68-e59b37512d12 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:28.033577 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d194c136-a4fc-4c03-be01-c811b1299bbe tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/bd0952e5-db2c-45ed-ac68-e59b37512d12" status: 404 len: 111 microversion: 2.1 time: 0.014637 May 21 21:31:28.033577 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2339/4810] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:28 2022] GET /compute/v2.1/servers/bd0952e5-db2c-45ed-ac68-e59b37512d12 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:31:28.040019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aafc5468-5ac6-48b1-86ce-71f403c8d5cf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:28.040714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aafc5468-5ac6-48b1-86ce-71f403c8d5cf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:28.048501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aafc5468-5ac6-48b1-86ce-71f403c8d5cf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:28.049102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aafc5468-5ac6-48b1-86ce-71f403c8d5cf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:28.050339 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aafc5468-5ac6-48b1-86ce-71f403c8d5cf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:28.050879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aafc5468-5ac6-48b1-86ce-71f403c8d5cf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:28.094101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aafc5468-5ac6-48b1-86ce-71f403c8d5cf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:31:28.228791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-008e320b-3c66-4ea3-b5c1-8c311aafba1c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:28.229419 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-008e320b-3c66-4ea3-b5c1-8c311aafba1c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:28.239333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-008e320b-3c66-4ea3-b5c1-8c311aafba1c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:28.239802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-008e320b-3c66-4ea3-b5c1-8c311aafba1c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:28.240639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-008e320b-3c66-4ea3-b5c1-8c311aafba1c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:28.241103 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-008e320b-3c66-4ea3-b5c1-8c311aafba1c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:28.452821 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aafc5468-5ac6-48b1-86ce-71f403c8d5cf tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "DELETE /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6" status: 204 len: 0 microversion: 2.1 time: 0.416761 May 21 21:31:28.453422 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2472/4811] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:31:28 2022] DELETE /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:31:28.467717 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e5405a3d-0216-499d-9328-8b6696a80263 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:28.468788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e5405a3d-0216-499d-9328-8b6696a80263 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:28.477357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5405a3d-0216-499d-9328-8b6696a80263 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:28.478430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5405a3d-0216-499d-9328-8b6696a80263 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:28.479714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5405a3d-0216-499d-9328-8b6696a80263 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:28.480130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5405a3d-0216-499d-9328-8b6696a80263 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:28.489451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-008e320b-3c66-4ea3-b5c1-8c311aafba1c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:28.499810 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-008e320b-3c66-4ea3-b5c1-8c311aafba1c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1515 microversion: 2.1 time: 0.274956 May 21 21:31:28.501278 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2340/4812] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:28 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1515 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:28.732472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-92cdf484-df4a-4f7c-ad63-c14008b5966d req-795a4b25-3db7-42db-ad80-34bffe719c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66d0a724-f81f-497a-8a29-656bce922d38", "name": "network-vif-deleted", "tag": "737ac348-9819-4702-ae18-187c7f487368"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:28.742691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-92cdf484-df4a-4f7c-ad63-c14008b5966d req-795a4b25-3db7-42db-ad80-34bffe719c64 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:28.743436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-92cdf484-df4a-4f7c-ad63-c14008b5966d req-795a4b25-3db7-42db-ad80-34bffe719c64 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:28.757178 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-92cdf484-df4a-4f7c-ad63-c14008b5966d req-795a4b25-3db7-42db-ad80-34bffe719c64 service nova] Creating event network-vif-deleted:737ac348-9819-4702-ae18-187c7f487368 for instance 66d0a724-f81f-497a-8a29-656bce922d38 on nch2-master-1 May 21 21:31:28.763843 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-92cdf484-df4a-4f7c-ad63-c14008b5966d req-795a4b25-3db7-42db-ad80-34bffe719c64 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035777 May 21 21:31:28.768408 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2341/4813] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:31:28.883347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-12a7ba5b-15c7-4198-bc75-4c5a52f4d6fe tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:28.883614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-12a7ba5b-15c7-4198-bc75-4c5a52f4d6fe tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:28.890354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-12a7ba5b-15c7-4198-bc75-4c5a52f4d6fe tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:28.890811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-12a7ba5b-15c7-4198-bc75-4c5a52f4d6fe tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:28.891589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-12a7ba5b-15c7-4198-bc75-4c5a52f4d6fe tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:28.892219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-12a7ba5b-15c7-4198-bc75-4c5a52f4d6fe tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:28.903955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e5405a3d-0216-499d-9328-8b6696a80263 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:28.924323 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e5405a3d-0216-499d-9328-8b6696a80263 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6" status: 200 len: 1480 microversion: 2.1 time: 0.460778 May 21 21:31:28.925252 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2473/4814] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:28 2022] GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 => generated 1480 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:29.002315 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-12a7ba5b-15c7-4198-bc75-4c5a52f4d6fe tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:29.010424 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-12a7ba5b-15c7-4198-bc75-4c5a52f4d6fe tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38" status: 200 len: 1470 microversion: 2.1 time: 0.131590 May 21 21:31:29.011141 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2342/4815] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:28 2022] GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 => generated 1470 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:29.944309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-78fd1cf3-5193-4817-ab9e-7d011e29f6ae tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:29.945315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-78fd1cf3-5193-4817-ab9e-7d011e29f6ae tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:29.957097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78fd1cf3-5193-4817-ab9e-7d011e29f6ae tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:29.958052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78fd1cf3-5193-4817-ab9e-7d011e29f6ae tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:29.959482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78fd1cf3-5193-4817-ab9e-7d011e29f6ae tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:29.960454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78fd1cf3-5193-4817-ab9e-7d011e29f6ae tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:30.039145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d501ec59-8e90-4595-bf5e-cb2059024c68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:30.040834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d501ec59-8e90-4595-bf5e-cb2059024c68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:30.062325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d501ec59-8e90-4595-bf5e-cb2059024c68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:30.063601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d501ec59-8e90-4595-bf5e-cb2059024c68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:30.063601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d501ec59-8e90-4595-bf5e-cb2059024c68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:30.063996 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d501ec59-8e90-4595-bf5e-cb2059024c68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:30.110797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d501ec59-8e90-4595-bf5e-cb2059024c68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:30.112635 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d501ec59-8e90-4595-bf5e-cb2059024c68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:30.114564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-d501ec59-8e90-4595-bf5e-cb2059024c68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lazy-loading 'fault' on Instance uuid 66d0a724-f81f-497a-8a29-656bce922d38 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:31:30.205911 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d501ec59-8e90-4595-bf5e-cb2059024c68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:30.224585 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d501ec59-8e90-4595-bf5e-cb2059024c68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38" status: 200 len: 1307 microversion: 2.1 time: 0.198951 May 21 21:31:30.225777 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2343/4816] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:30 2022] GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 => generated 1307 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:30.379149 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-78fd1cf3-5193-4817-ab9e-7d011e29f6ae tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:30.393401 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-78fd1cf3-5193-4817-ab9e-7d011e29f6ae tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6" status: 200 len: 1480 microversion: 2.1 time: 0.453104 May 21 21:31:30.396004 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2474/4817] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:29 2022] GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 => generated 1480 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:30.542566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d3549178-7fab-46c4-980b-eb034a25740a tempest-PortsAdminExtendedAttrsTestJSON-1153694399 tempest-PortsAdminExtendedAttrsTestJSON-1153694399-project-admin] Calling method '.version_select at 0x7fc81a0034c0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:30.543808 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:31:30.543808 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:31:30.545371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3549178-7fab-46c4-980b-eb034a25740a tempest-PortsAdminExtendedAttrsTestJSON-1153694399 tempest-PortsAdminExtendedAttrsTestJSON-1153694399-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:30.545923 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3549178-7fab-46c4-980b-eb034a25740a tempest-PortsAdminExtendedAttrsTestJSON-1153694399 tempest-PortsAdminExtendedAttrsTestJSON-1153694399-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:30.564705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3549178-7fab-46c4-980b-eb034a25740a tempest-PortsAdminExtendedAttrsTestJSON-1153694399 tempest-PortsAdminExtendedAttrsTestJSON-1153694399-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:30.565498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3549178-7fab-46c4-980b-eb034a25740a tempest-PortsAdminExtendedAttrsTestJSON-1153694399 tempest-PortsAdminExtendedAttrsTestJSON-1153694399-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:30.576622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3549178-7fab-46c4-980b-eb034a25740a tempest-PortsAdminExtendedAttrsTestJSON-1153694399 tempest-PortsAdminExtendedAttrsTestJSON-1153694399-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:30.577100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3549178-7fab-46c4-980b-eb034a25740a tempest-PortsAdminExtendedAttrsTestJSON-1153694399 tempest-PortsAdminExtendedAttrsTestJSON-1153694399-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:30.583360 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d3549178-7fab-46c4-980b-eb034a25740a tempest-PortsAdminExtendedAttrsTestJSON-1153694399 tempest-PortsAdminExtendedAttrsTestJSON-1153694399-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.346859 May 21 21:31:30.583950 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2344/4818] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:31:30 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:31:30.795235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-fcb8d833-5579-4aa9-9a18-48d310ebeb2f req-32216a88-2d95-499b-8e8e-1fe4521da4dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7a52b3-ff9e-4281-b9d8-78ad66dd33d6", "name": "network-vif-deleted", "tag": "9634c849-608d-4b8f-aee2-40d7512be721"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:30.810707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-fcb8d833-5579-4aa9-9a18-48d310ebeb2f req-32216a88-2d95-499b-8e8e-1fe4521da4dc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:30.811289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-fcb8d833-5579-4aa9-9a18-48d310ebeb2f req-32216a88-2d95-499b-8e8e-1fe4521da4dc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:30.826843 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-fcb8d833-5579-4aa9-9a18-48d310ebeb2f req-32216a88-2d95-499b-8e8e-1fe4521da4dc service nova] Creating event network-vif-deleted:9634c849-608d-4b8f-aee2-40d7512be721 for instance de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 on nch2-master-1 May 21 21:31:30.832664 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-fcb8d833-5579-4aa9-9a18-48d310ebeb2f req-32216a88-2d95-499b-8e8e-1fe4521da4dc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041708 May 21 21:31:30.833711 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2475/4819] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:31:31.253179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0ef2cc8b-9f3f-45a0-9890-55afef521433 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:31.254006 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0ef2cc8b-9f3f-45a0-9890-55afef521433 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:31.266089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ef2cc8b-9f3f-45a0-9890-55afef521433 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:31.266553 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ef2cc8b-9f3f-45a0-9890-55afef521433 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:31.267365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ef2cc8b-9f3f-45a0-9890-55afef521433 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:31.268619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ef2cc8b-9f3f-45a0-9890-55afef521433 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:31.306570 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-0ef2cc8b-9f3f-45a0-9890-55afef521433 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0ef2cc8b-9f3f-45a0-9890-55afef521433 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 HTTP/1.1 May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '66d0a724-f81f-497a-8a29-656bce922d38'} May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:31.312254 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:31.316708 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:31.316708 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:31.316708 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:31.316708 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:31.316708 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:31.316708 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:31:31.316708 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:31.321879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0ef2cc8b-9f3f-45a0-9890-55afef521433 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:31.323934 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0ef2cc8b-9f3f-45a0-9890-55afef521433 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38" status: 404 len: 111 microversion: 2.1 time: 0.080286 May 21 21:31:31.328920 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2345/4820] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:31 2022] GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:31:31.336011 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-653d6809-a99a-4b60-a891-2a9741075327 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:31.336770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-653d6809-a99a-4b60-a891-2a9741075327 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:31.344903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-653d6809-a99a-4b60-a891-2a9741075327 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:31.345590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-653d6809-a99a-4b60-a891-2a9741075327 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:31.346554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-653d6809-a99a-4b60-a891-2a9741075327 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:31.347002 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-653d6809-a99a-4b60-a891-2a9741075327 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:31.353240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-655c172f-cc25-4008-8c39-2dbb09c67ed4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Action: 'create', calling method: .version_select at 0x7fc819ed2e50>, body: {"keypair": {"name": "tempest-keypair-904144293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNIyB+WMFXx3OJqI+JleJxiuJ3Ah4Jsiut13QyDMnXwJ8LhbPB2QC7iBisi19gT/rhA9d6HJPvITldLEkzKANlq/hseID4nyJDWURXtHM6TGf/JT8EOy/fEOOwekHaqSQ=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:31.369844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-655c172f-cc25-4008-8c39-2dbb09c67ed4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Getting quotas for project 2e6d59483dc54fe4a558186055068419. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:31:31.377040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-655c172f-cc25-4008-8c39-2dbb09c67ed4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Getting quotas for user 9a0ccfb5c9a04ec0831a0bfe987bb659 and project 2e6d59483dc54fe4a558186055068419. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:31:31.567131 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-655c172f-cc25-4008-8c39-2dbb09c67ed4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.218310 May 21 21:31:31.568251 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2346/4821] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:31:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:31:31.576171 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ee26c4ed-ab30-45dc-b0b3-91e1ebc39452 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:31.576985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ee26c4ed-ab30-45dc-b0b3-91e1ebc39452 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:31.591044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee26c4ed-ab30-45dc-b0b3-91e1ebc39452 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:31.591044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee26c4ed-ab30-45dc-b0b3-91e1ebc39452 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:31.591044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee26c4ed-ab30-45dc-b0b3-91e1ebc39452 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:31.591044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee26c4ed-ab30-45dc-b0b3-91e1ebc39452 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:31.613027 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:31.640761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee26c4ed-ab30-45dc-b0b3-91e1ebc39452 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:31.641237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee26c4ed-ab30-45dc-b0b3-91e1ebc39452 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:31.641706 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-ee26c4ed-ab30-45dc-b0b3-91e1ebc39452 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lazy-loading 'fault' on Instance uuid de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:31:31.742535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ee26c4ed-ab30-45dc-b0b3-91e1ebc39452 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dc8226610413a8bb889d6055a75d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbb4bbc88f84520885c00a376ba0f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:31.762713 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ee26c4ed-ab30-45dc-b0b3-91e1ebc39452 tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6" status: 200 len: 1282 microversion: 2.1 time: 0.193440 May 21 21:31:31.764704 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2347/4822] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:31 2022] GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 => generated 1282 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:31.867808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-653d6809-a99a-4b60-a891-2a9741075327 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:31.876383 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-653d6809-a99a-4b60-a891-2a9741075327 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.545569 May 21 21:31:31.877424 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2476/4823] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:31 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:31.993386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8e626600-f502-42ff-b6a9-25012ae06454 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8e626600-f502-42ff-b6a9-25012ae06454 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 163 May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: {"server": {"name": 12345, "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452', 'networks': [{'uuid': '08704bbd-33da-45f4-ac41-9349866a62b3'}]}}} May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise error May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi On instance['server']: May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 12345 May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:31:31.995740 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:31:32.001083 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:31:32.001083 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 21 21:31:32.001083 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:32.001083 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:32.001083 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:32.001083 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:32.001083 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:32.001083 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:32.001083 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:31:32.001083 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:31:32.001083 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 21 21:31:32.001083 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:32.001083 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8e626600-f502-42ff-b6a9-25012ae06454 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:32.001083 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8e626600-f502-42ff-b6a9-25012ae06454 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.008419 May 21 21:31:32.001083 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2348/4824] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:31:31 2022] POST /compute/v2.1/servers => generated 127 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:31:32.007772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ad095c51-a63d-4c2c-9f3c-2da201f2f89c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:32.009451 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ad095c51-a63d-4c2c-9f3c-2da201f2f89c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:32.021158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad095c51-a63d-4c2c-9f3c-2da201f2f89c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:32.021831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad095c51-a63d-4c2c-9f3c-2da201f2f89c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:32.023111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad095c51-a63d-4c2c-9f3c-2da201f2f89c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:32.023707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad095c51-a63d-4c2c-9f3c-2da201f2f89c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:32.490462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ad095c51-a63d-4c2c-9f3c-2da201f2f89c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:32.504883 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ad095c51-a63d-4c2c-9f3c-2da201f2f89c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.499013 May 21 21:31:32.504883 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2477/4825] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:32 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:32.524697 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c8cf6ad6-77ef-4852-9e74-d0087b5a3b51 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:32.525466 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c8cf6ad6-77ef-4852-9e74-d0087b5a3b51 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:32.534949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8cf6ad6-77ef-4852-9e74-d0087b5a3b51 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:32.535647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8cf6ad6-77ef-4852-9e74-d0087b5a3b51 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:32.536633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8cf6ad6-77ef-4852-9e74-d0087b5a3b51 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:32.545002 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8cf6ad6-77ef-4852-9e74-d0087b5a3b51 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:32.782405 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8dafcabd-c7e7-4242-a91b-3ee6d39bbeab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:32.783521 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8dafcabd-c7e7-4242-a91b-3ee6d39bbeab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] [instance: de7a52b3-ff9e-4281-b9d8-78ad66dd33d6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:32.793007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8dafcabd-c7e7-4242-a91b-3ee6d39bbeab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:32.794501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8dafcabd-c7e7-4242-a91b-3ee6d39bbeab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:32.795760 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8dafcabd-c7e7-4242-a91b-3ee6d39bbeab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:32.796475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8dafcabd-c7e7-4242-a91b-3ee6d39bbeab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:32.801603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c8cf6ad6-77ef-4852-9e74-d0087b5a3b51 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:32.809989 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c8cf6ad6-77ef-4852-9e74-d0087b5a3b51 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.291350 May 21 21:31:32.810573 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2349/4826] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:32 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:32.815790 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-8dafcabd-c7e7-4242-a91b-3ee6d39bbeab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] HTTP exception thrown: Instance de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 could not be found. May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8dafcabd-c7e7-4242-a91b-3ee6d39bbeab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Request method failure captured: May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 HTTP/1.1 May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVlJmdyndvBdR3R3Fjv0968GJdJRDWPZmaEt8tjFIEtWQ1RJguX63bssj5LZTRU1lVEFBMs0j1M-4_ZAhawO3VUp0vY-ORL_Wdrkz7mtPyhPxc6dmp-87f-U-4GLrjlGhNHHVJppvE8oKcuQIdv1Us3bdcleQHx9fi4KiTQmkXSm7Kc May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4dbb4bbc88f84520885c00a376ba0f7c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4dbb4bbc88f84520885c00a376ba0f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersTestJSON-1332095339 May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 4dbb4bbc88f84520885c00a376ba0f7c May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersTestJSON-1332095339 May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersTestJSON-1332095339-project May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: c67dc8226610413a8bb889d6055a75d2 May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersTestJSON-1332095339-project May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 could not be found. May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'de7a52b3-ff9e-4281-b9d8-78ad66dd33d6'} May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 could not be found. May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 could not be found. May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:32.817741 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:32.821354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:32.821354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:32.821354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:32.821354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:32.821354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 could not be found. May 21 21:31:32.821354 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:32.823650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8dafcabd-c7e7-4242-a91b-3ee6d39bbeab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] Returning 404 to user: Instance de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:32.830698 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8dafcabd-c7e7-4242-a91b-3ee6d39bbeab tempest-ServersTestJSON-1332095339 tempest-ServersTestJSON-1332095339-project] 10.222.0.49 "GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6" status: 404 len: 111 microversion: 2.1 time: 0.053327 May 21 21:31:32.832035 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2478/4827] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:32 2022] GET /compute/v2.1/servers/de7a52b3-ff9e-4281-b9d8-78ad66dd33d6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:31:36.272111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d437c501-6fd7-4f72-8044-36e65b828ead tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1467891862", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "1443538c-c5ec-49af-ae97-c3dd6e72198e", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:36.363732 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-d437c501-6fd7-4f72-8044-36e65b828ead tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Block Device 1443538c-c5ec-49af-ae97-c3dd6e72198e is not bootable. May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d437c501-6fd7-4f72-8044-36e65b828ead tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 358 May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1467891862", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "1443538c-c5ec-49af-ae97-c3dd6e72198e", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: exception: Block Device 1443538c-c5ec-49af-ae97-c3dd6e72198e is not bootable. May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1467891862', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '1443538c-c5ec-49af-ae97-c3dd6e72198e'}], 'networks': [{'uuid': '08704bbd-33da-45f4-ac41-9349866a62b3'}]}}} May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._create_instance( May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 1443538c-c5ec-49af-ae97-c3dd6e72198e is not bootable. May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:36.383470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:36.387686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:36.387686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:36.387686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:36.387686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 21 21:31:36.387686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 21 21:31:36.387686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 21 21:31:36.387686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 1443538c-c5ec-49af-ae97-c3dd6e72198e is not bootable. May 21 21:31:36.387686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:36.387686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:36.387686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:36.387686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:36.387686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:36.387686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:36.387686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:36.387686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:36.387686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 1443538c-c5ec-49af-ae97-c3dd6e72198e is not bootable. May 21 21:31:36.387686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:36.387686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d437c501-6fd7-4f72-8044-36e65b828ead tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 400 to user: Block Device 1443538c-c5ec-49af-ae97-c3dd6e72198e is not bootable. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:36.387686 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d437c501-6fd7-4f72-8044-36e65b828ead tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.120766 May 21 21:31:36.387686 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2350/4828] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:31:36 2022] POST /compute/v2.1/servers => generated 110 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 21 21:31:36.396169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cd70c296-cb55-4b92-877d-0bc6395a9534 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:36.396821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cd70c296-cb55-4b92-877d-0bc6395a9534 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:36.407849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd70c296-cb55-4b92-877d-0bc6395a9534 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:36.415358 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd70c296-cb55-4b92-877d-0bc6395a9534 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:36.416216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd70c296-cb55-4b92-877d-0bc6395a9534 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:36.419487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd70c296-cb55-4b92-877d-0bc6395a9534 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:36.457778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-990cd46a-61eb-4870-994a-e125dd08ef88 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-777790861", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "803f67e8-d424-4079-9484-4c9fb1a3b195"}], "security_groups": [{"name": "tempest-securitygroup--1730077720"}], "key_name": "tempest-keypair-904144293", "user_data": "}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:36.756066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-990cd46a-61eb-4870-994a-e125dd08ef88 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] validate_networks() for [('803f67e8-d424-4079-9484-4c9fb1a3b195', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:31:37.118301 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cd70c296-cb55-4b92-877d-0bc6395a9534 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:37.127679 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cd70c296-cb55-4b92-877d-0bc6395a9534 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.735600 May 21 21:31:37.129028 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2479/4829] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:36 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:37.176968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-20c2b6ac-1804-454e-b85f-cb801f8b32c6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:37.177751 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-20c2b6ac-1804-454e-b85f-cb801f8b32c6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:37.192097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20c2b6ac-1804-454e-b85f-cb801f8b32c6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:37.192889 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20c2b6ac-1804-454e-b85f-cb801f8b32c6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:37.193707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20c2b6ac-1804-454e-b85f-cb801f8b32c6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:37.194303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20c2b6ac-1804-454e-b85f-cb801f8b32c6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:37.216444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:37.315056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-990cd46a-61eb-4870-994a-e125dd08ef88 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:31:37.315802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-990cd46a-61eb-4870-994a-e125dd08ef88 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:31:37.316430 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-990cd46a-61eb-4870-994a-e125dd08ef88 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:31:37.316743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-990cd46a-61eb-4870-994a-e125dd08ef88 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:31:37.317170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-990cd46a-61eb-4870-994a-e125dd08ef88 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:31:37.326733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-990cd46a-61eb-4870-994a-e125dd08ef88 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:37.327228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-990cd46a-61eb-4870-994a-e125dd08ef88 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:37.328050 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-990cd46a-61eb-4870-994a-e125dd08ef88 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:37.328523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-990cd46a-61eb-4870-994a-e125dd08ef88 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:37.349246 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-990cd46a-61eb-4870-994a-e125dd08ef88 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Getting quotas for project 2e6d59483dc54fe4a558186055068419. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:31:37.356323 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-990cd46a-61eb-4870-994a-e125dd08ef88 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Getting quotas for user 9a0ccfb5c9a04ec0831a0bfe987bb659 and project 2e6d59483dc54fe4a558186055068419. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:31:37.370696 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-990cd46a-61eb-4870-994a-e125dd08ef88 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:31:37.373109 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-990cd46a-61eb-4870-994a-e125dd08ef88 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:31:37.548565 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-990cd46a-61eb-4870-994a-e125dd08ef88 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.096184 May 21 21:31:37.549846 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2351/4830] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:31:36 2022] POST /compute/v2.1/servers => generated 409 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 21 21:31:37.567115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-09f570cc-112f-4827-ba2c-01dbdcc8fca2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:37.568140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-09f570cc-112f-4827-ba2c-01dbdcc8fca2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:37.635139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-09f570cc-112f-4827-ba2c-01dbdcc8fca2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:37.644839 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-09f570cc-112f-4827-ba2c-01dbdcc8fca2 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1244 microversion: 2.1 time: 0.088516 May 21 21:31:37.645616 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2352/4831] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:37 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:37.979244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-20c2b6ac-1804-454e-b85f-cb801f8b32c6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:37.994315 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-20c2b6ac-1804-454e-b85f-cb801f8b32c6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.841819 May 21 21:31:37.994941 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2480/4832] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:37 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:38.664084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-639074e2-8e20-4b5b-a4e0-97ef67fef8c4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:38.664768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-639074e2-8e20-4b5b-a4e0-97ef67fef8c4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:38.821149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-639074e2-8e20-4b5b-a4e0-97ef67fef8c4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:38.830783 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-639074e2-8e20-4b5b-a4e0-97ef67fef8c4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1244 microversion: 2.1 time: 0.172252 May 21 21:31:38.831424 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2353/4833] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:38 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1244 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:39.255999 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-953c83f4-732d-47f9-9ce0-a0d74f42223b tempest-ComputeTenantNetworksTest-202333424 tempest-ComputeTenantNetworksTest-202333424-project] Calling method '.version_select at 0x7fc81b6aa160>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:39.427864 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-953c83f4-732d-47f9-9ce0-a0d74f42223b tempest-ComputeTenantNetworksTest-202333424 tempest-ComputeTenantNetworksTest-202333424-project] 10.222.0.49 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.345304 May 21 21:31:39.428520 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2481/4834] 10.222.0.49 () {58 vars in 1157 bytes} [Sat May 21 21:31:39 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:31:39.439168 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a1f0813d-f7c2-4060-a236-6e649b23a5f2 tempest-ComputeTenantNetworksTest-202333424 tempest-ComputeTenantNetworksTest-202333424-project] Calling method '.version_select at 0x7fc81a164af0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:39.558247 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a1f0813d-f7c2-4060-a236-6e649b23a5f2 tempest-ComputeTenantNetworksTest-202333424 tempest-ComputeTenantNetworksTest-202333424-project] 10.222.0.49 "GET /compute/v2.1/os-tenant-networks/4e31637a-985d-4551-b858-9925ffe0e3f3" status: 200 len: 140 microversion: 2.1 time: 0.123148 May 21 21:31:39.559761 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2354/4835] 10.222.0.49 () {58 vars in 1268 bytes} [Sat May 21 21:31:39 2022] GET /compute/v2.1/os-tenant-networks/4e31637a-985d-4551-b858-9925ffe0e3f3 => generated 140 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:31:39.848085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9542bcb8-fbb5-4f7f-adfe-cfe4a0f69ba7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:39.848755 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9542bcb8-fbb5-4f7f-adfe-cfe4a0f69ba7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:39.857327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9542bcb8-fbb5-4f7f-adfe-cfe4a0f69ba7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:39.859036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9542bcb8-fbb5-4f7f-adfe-cfe4a0f69ba7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:39.859956 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9542bcb8-fbb5-4f7f-adfe-cfe4a0f69ba7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:39.860563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9542bcb8-fbb5-4f7f-adfe-cfe4a0f69ba7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:39.973993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9542bcb8-fbb5-4f7f-adfe-cfe4a0f69ba7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:39.985799 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9542bcb8-fbb5-4f7f-adfe-cfe4a0f69ba7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1296 microversion: 2.1 time: 0.142449 May 21 21:31:39.998129 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2482/4836] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:39 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1296 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:41.007171 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f22b4406-5261-47de-96c1-7b0886f91ee4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:41.010065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f22b4406-5261-47de-96c1-7b0886f91ee4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:41.022236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f22b4406-5261-47de-96c1-7b0886f91ee4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:41.023049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f22b4406-5261-47de-96c1-7b0886f91ee4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:41.024450 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f22b4406-5261-47de-96c1-7b0886f91ee4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:41.025113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f22b4406-5261-47de-96c1-7b0886f91ee4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:41.058061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-111afb3d-1225-4a5d-b2f5-7f6832272c06 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2054065720", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "destination_type": "local"}, {"source_type": "volume", "uuid": "843d6fda-b12c-470a-8f8c-5d3bbce1dede", "destination_type": "invalid"}], "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-111afb3d-1225-4a5d-b2f5-7f6832272c06 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 495 May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2054065720", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "destination_type": "local"}, {"source_type": "volume", "uuid": "843d6fda-b12c-470a-8f8c-5d3bbce1dede", "destination_type": "invalid"}], "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2054065720', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '843d6fda-b12c-470a-8f8c-5d3bbce1dede', 'destination_type': 'invalid'}], 'networks': [{'uuid': '08704bbd-33da-45f4-ac41-9349866a62b3'}]}}} May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise error May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'invalid' May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:41.066577 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:41.071285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:41.071285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:41.071285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:31:41.071285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:31:41.071285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:31:41.071285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:31:41.071285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:31:41.071285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:31:41.071285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 21 21:31:41.071285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:41.071285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:41.071285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:41.071285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:41.071285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:41.071285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:41.071285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:31:41.071285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:31:41.071285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 21 21:31:41.071285 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:41.071285 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-111afb3d-1225-4a5d-b2f5-7f6832272c06 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:41.073447 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-111afb3d-1225-4a5d-b2f5-7f6832272c06 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.019624 May 21 21:31:41.078755 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2483/4837] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:31:41 2022] POST /compute/v2.1/servers => generated 155 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:31:41.091271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-82a3334d-2a56-47ba-a052-1976cc92287d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:41.092272 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-82a3334d-2a56-47ba-a052-1976cc92287d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:41.108835 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82a3334d-2a56-47ba-a052-1976cc92287d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:41.109362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82a3334d-2a56-47ba-a052-1976cc92287d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:41.110729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82a3334d-2a56-47ba-a052-1976cc92287d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:41.111093 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82a3334d-2a56-47ba-a052-1976cc92287d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:41.167302 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f22b4406-5261-47de-96c1-7b0886f91ee4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:41.181306 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f22b4406-5261-47de-96c1-7b0886f91ee4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1302 microversion: 2.1 time: 0.181931 May 21 21:31:41.192761 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2355/4838] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:40 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1302 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:41.391646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-82a3334d-2a56-47ba-a052-1976cc92287d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:41.405658 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-82a3334d-2a56-47ba-a052-1976cc92287d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.324400 May 21 21:31:41.406527 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2484/4839] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:41 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:41.424759 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cb6457e7-593a-4bc4-aaf0-f764a5e70968 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:41.425395 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cb6457e7-593a-4bc4-aaf0-f764a5e70968 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:41.433354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb6457e7-593a-4bc4-aaf0-f764a5e70968 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:41.435353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb6457e7-593a-4bc4-aaf0-f764a5e70968 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:41.436166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb6457e7-593a-4bc4-aaf0-f764a5e70968 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:41.436653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb6457e7-593a-4bc4-aaf0-f764a5e70968 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:41.833540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cb6457e7-593a-4bc4-aaf0-f764a5e70968 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:41.842499 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cb6457e7-593a-4bc4-aaf0-f764a5e70968 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.421989 May 21 21:31:41.843366 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2356/4840] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:41 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:42.011308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-733517e0-3091-4c79-a19a-3283c92206aa tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1456319015", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-733517e0-3091-4c79-a19a-3283c92206aa tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 492 May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1456319015", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1456319015', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '08704bbd-33da-45f4-ac41-9349866a62b3'}]}}} May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise error May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: May 21 21:31:42.017567 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-733517e0-3091-4c79-a19a-3283c92206aa tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-733517e0-3091-4c79-a19a-3283c92206aa tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.013978 May 21 21:31:42.024336 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2485/4841] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:31:42 2022] POST /compute/v2.1/servers => generated 624 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:31:42.034840 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e8caf3c5-3f64-499f-9960-e2a86f885e79 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:42.036259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e8caf3c5-3f64-499f-9960-e2a86f885e79 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:42.045433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e8caf3c5-3f64-499f-9960-e2a86f885e79 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:42.049041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e8caf3c5-3f64-499f-9960-e2a86f885e79 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:42.049041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e8caf3c5-3f64-499f-9960-e2a86f885e79 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:42.049041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e8caf3c5-3f64-499f-9960-e2a86f885e79 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:42.201920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-819839af-b3d6-474e-9839-ae64539a31c3 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:42.202558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-819839af-b3d6-474e-9839-ae64539a31c3 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:42.217310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-819839af-b3d6-474e-9839-ae64539a31c3 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:42.220370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-819839af-b3d6-474e-9839-ae64539a31c3 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:42.221390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-819839af-b3d6-474e-9839-ae64539a31c3 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:42.223095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-819839af-b3d6-474e-9839-ae64539a31c3 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:42.428146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e8caf3c5-3f64-499f-9960-e2a86f885e79 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:42.439647 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e8caf3c5-3f64-499f-9960-e2a86f885e79 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.410346 May 21 21:31:42.441001 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2357/4842] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:42 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:42.459619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-17752647-d667-4210-8094-de334181e973 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:42.460427 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-17752647-d667-4210-8094-de334181e973 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:42.474343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17752647-d667-4210-8094-de334181e973 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:42.475160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17752647-d667-4210-8094-de334181e973 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:42.476187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17752647-d667-4210-8094-de334181e973 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:42.476874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17752647-d667-4210-8094-de334181e973 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:42.493043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-819839af-b3d6-474e-9839-ae64539a31c3 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:42.502686 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-819839af-b3d6-474e-9839-ae64539a31c3 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1370 microversion: 2.1 time: 0.306698 May 21 21:31:42.504474 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2486/4843] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:42 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1370 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:42.820989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-17752647-d667-4210-8094-de334181e973 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:42.832493 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-17752647-d667-4210-8094-de334181e973 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.377799 May 21 21:31:42.845509 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2358/4844] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:42 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:42.979778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ff0b029f-335a-4f3e-8ead-3962efa8835f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ff0b029f-335a-4f3e-8ead-3962efa8835f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 416 May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452', 'networks': [{'uuid': '08704bbd-33da-45f4-ac41-9349866a62b3'}]}}} May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise error May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi On instance['server']: May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:42.984885 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ff0b029f-335a-4f3e-8ead-3962efa8835f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:42.990976 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ff0b029f-335a-4f3e-8ead-3962efa8835f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.013606 May 21 21:31:42.997234 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2487/4845] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:31:42 2022] POST /compute/v2.1/servers => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:31:43.007962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f4de8648-814e-427d-9cc9-576c600d80a8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:43.008768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f4de8648-814e-427d-9cc9-576c600d80a8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:43.018064 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f4de8648-814e-427d-9cc9-576c600d80a8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:43.018629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f4de8648-814e-427d-9cc9-576c600d80a8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:43.019534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f4de8648-814e-427d-9cc9-576c600d80a8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:43.020238 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f4de8648-814e-427d-9cc9-576c600d80a8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:43.297947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f4de8648-814e-427d-9cc9-576c600d80a8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:43.311234 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f4de8648-814e-427d-9cc9-576c600d80a8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.306142 May 21 21:31:43.311234 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2359/4846] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:43 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:43.326913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-480e4f93-afbf-4b7f-9a0e-8053923af20c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:43.327539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-480e4f93-afbf-4b7f-9a0e-8053923af20c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:43.335368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-480e4f93-afbf-4b7f-9a0e-8053923af20c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:43.340109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-480e4f93-afbf-4b7f-9a0e-8053923af20c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:43.340109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-480e4f93-afbf-4b7f-9a0e-8053923af20c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:43.340109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-480e4f93-afbf-4b7f-9a0e-8053923af20c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:43.458526 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-6b236eb0-1c3a-4829-b14e-b183bd5ee109 req-1b1d746b-c536-4448-83a2-ea784ca7e799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54e8b13e-d6b2-467c-b801-2b0ad45e95ae", "tag": "ea540e6b-71e1-4aff-97b8-77527dd9d620"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:43.469855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6b236eb0-1c3a-4829-b14e-b183bd5ee109 req-1b1d746b-c536-4448-83a2-ea784ca7e799 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:43.470473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6b236eb0-1c3a-4829-b14e-b183bd5ee109 req-1b1d746b-c536-4448-83a2-ea784ca7e799 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:43.489098 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-6b236eb0-1c3a-4829-b14e-b183bd5ee109 req-1b1d746b-c536-4448-83a2-ea784ca7e799 service nova] Creating event network-changed:ea540e6b-71e1-4aff-97b8-77527dd9d620 for instance 54e8b13e-d6b2-467c-b801-2b0ad45e95ae on nch2-master-1 May 21 21:31:43.498384 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-6b236eb0-1c3a-4829-b14e-b183bd5ee109 req-1b1d746b-c536-4448-83a2-ea784ca7e799 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043452 May 21 21:31:43.499356 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2360/4847] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:31:43.522442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3ec6cd04-d57c-41b1-89b5-da82ee090db6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:43.523156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3ec6cd04-d57c-41b1-89b5-da82ee090db6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:43.533300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ec6cd04-d57c-41b1-89b5-da82ee090db6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:43.534562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ec6cd04-d57c-41b1-89b5-da82ee090db6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:43.534966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ec6cd04-d57c-41b1-89b5-da82ee090db6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:43.535575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3ec6cd04-d57c-41b1-89b5-da82ee090db6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:43.738353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-480e4f93-afbf-4b7f-9a0e-8053923af20c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:43.747323 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-480e4f93-afbf-4b7f-9a0e-8053923af20c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.425290 May 21 21:31:43.762621 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2488/4848] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:43 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:43.886992 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e8123d06-8d1c-41b9-8a7c-4c67b66ab75a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-668587528", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": -1, "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:43.898390 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-e8123d06-8d1c-41b9-8a7c-4c67b66ab75a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Flavor -1 could not be found. May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e8123d06-8d1c-41b9-8a7c-4c67b66ab75a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 205 May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-668587528", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": -1, "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: exception: Flavor -1 could not be found. May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-668587528', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': -1, 'networks': [{'uuid': '08704bbd-33da-45f4-ac41-9349866a62b3'}]}}} May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:43.905604 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:43.910475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:43.910475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:43.910475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:43.910475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:43.910475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 21 21:31:43.910475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 21 21:31:43.910475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 21 21:31:43.910475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. May 21 21:31:43.910475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:43.910475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:43.910475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:43.910475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:43.910475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:43.910475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:43.910475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:43.910475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:43.910475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. May 21 21:31:43.910475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:43.910475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e8123d06-8d1c-41b9-8a7c-4c67b66ab75a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:43.910475 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e8123d06-8d1c-41b9-8a7c-4c67b66ab75a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.025294 May 21 21:31:43.910475 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2489/4849] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:31:43 2022] POST /compute/v2.1/servers => generated 73 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 21 21:31:43.917413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f609538e-e24f-45c1-b374-d76da7fd3e49 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:43.918917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f609538e-e24f-45c1-b374-d76da7fd3e49 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:43.926838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f609538e-e24f-45c1-b374-d76da7fd3e49 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:43.932915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f609538e-e24f-45c1-b374-d76da7fd3e49 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:43.932915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f609538e-e24f-45c1-b374-d76da7fd3e49 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:43.932915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f609538e-e24f-45c1-b374-d76da7fd3e49 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:44.050757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3ec6cd04-d57c-41b1-89b5-da82ee090db6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:44.077465 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3ec6cd04-d57c-41b1-89b5-da82ee090db6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1370 microversion: 2.1 time: 0.554366 May 21 21:31:44.078144 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2361/4850] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:43 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1370 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:44.204843 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f609538e-e24f-45c1-b374-d76da7fd3e49 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:44.213960 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f609538e-e24f-45c1-b374-d76da7fd3e49 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.300306 May 21 21:31:44.216365 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2490/4851] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:43 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:44.234994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b7f99211-9b97-4838-9c69-56a2861eb592 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:44.235975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b7f99211-9b97-4838-9c69-56a2861eb592 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:44.242587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b7f99211-9b97-4838-9c69-56a2861eb592 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:44.243337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b7f99211-9b97-4838-9c69-56a2861eb592 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:44.244413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b7f99211-9b97-4838-9c69-56a2861eb592 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:44.245096 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b7f99211-9b97-4838-9c69-56a2861eb592 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:45.100904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-43b09336-153e-47c8-b31e-a653aeca6bb8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:45.102488 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-43b09336-153e-47c8-b31e-a653aeca6bb8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:45.114132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43b09336-153e-47c8-b31e-a653aeca6bb8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:45.115044 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43b09336-153e-47c8-b31e-a653aeca6bb8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:45.122284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43b09336-153e-47c8-b31e-a653aeca6bb8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:45.122980 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43b09336-153e-47c8-b31e-a653aeca6bb8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:45.133291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b7f99211-9b97-4838-9c69-56a2861eb592 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:45.152481 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b7f99211-9b97-4838-9c69-56a2861eb592 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.910086 May 21 21:31:45.152481 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2362/4852] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:44 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:45.226395 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b640755b-95f6-4caf-b25e-548373620066 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-512660715", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b640755b-95f6-4caf-b25e-548373620066 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 172 May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-512660715", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-512660715', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '08704bbd-33da-45f4-ac41-9349866a62b3'}]}}} May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise error May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi On instance['server']: May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi -1 May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:31:45.229367 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:31:45.239776 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:31:45.239776 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:31:45.239776 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 21 21:31:45.239776 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:45.239776 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:45.239776 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:45.239776 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:45.239776 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:45.239776 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:45.239776 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:31:45.239776 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:31:45.239776 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 21 21:31:45.239776 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:45.239776 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b640755b-95f6-4caf-b25e-548373620066 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:45.239776 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b640755b-95f6-4caf-b25e-548373620066 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.010131 May 21 21:31:45.239776 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2363/4853] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:31:45 2022] POST /compute/v2.1/servers => generated 145 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:31:45.241666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3b5b0092-94f3-49d9-8eb0-b1c9ab612c6c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:45.242299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3b5b0092-94f3-49d9-8eb0-b1c9ab612c6c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:45.255721 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b5b0092-94f3-49d9-8eb0-b1c9ab612c6c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:45.256372 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b5b0092-94f3-49d9-8eb0-b1c9ab612c6c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:45.258817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b5b0092-94f3-49d9-8eb0-b1c9ab612c6c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:45.259429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b5b0092-94f3-49d9-8eb0-b1c9ab612c6c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:45.421122 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-43b09336-153e-47c8-b31e-a653aeca6bb8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:45.434941 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-43b09336-153e-47c8-b31e-a653aeca6bb8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1370 microversion: 2.1 time: 0.342821 May 21 21:31:45.435728 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2491/4854] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:45 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1370 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:45.836086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3b5b0092-94f3-49d9-8eb0-b1c9ab612c6c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:45.848358 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3b5b0092-94f3-49d9-8eb0-b1c9ab612c6c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.610348 May 21 21:31:45.861521 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2364/4855] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:45 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:45.870087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9bdfd045-beca-4199-abe4-39320cf85422 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:45.871038 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9bdfd045-beca-4199-abe4-39320cf85422 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:45.879829 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9bdfd045-beca-4199-abe4-39320cf85422 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:45.881134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9bdfd045-beca-4199-abe4-39320cf85422 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:45.882127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9bdfd045-beca-4199-abe4-39320cf85422 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:45.882963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9bdfd045-beca-4199-abe4-39320cf85422 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:46.168711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9bdfd045-beca-4199-abe4-39320cf85422 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:46.181086 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9bdfd045-beca-4199-abe4-39320cf85422 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.318093 May 21 21:31:46.196303 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2492/4856] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:45 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:46.257210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4230d48e-2012-4795-af40-6921eded124d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1136527185", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:46.263583 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-4230d48e-2012-4795-af40-6921eded124d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4230d48e-2012-4795-af40-6921eded124d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 216 May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1136527185", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1136527185', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._validate_network_id( May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:46.265183 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:46.269268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:46.269268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:46.269268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:46.269268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:46.269268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:46.269268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 21 21:31:46.269268 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:46.269268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4230d48e-2012-4795-af40-6921eded124d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:46.269268 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4230d48e-2012-4795-af40-6921eded124d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.014762 May 21 21:31:46.269268 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2365/4857] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:31:46 2022] POST /compute/v2.1/servers => generated 123 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:31:46.276593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c6172728-e736-4eec-bd3e-15476f20ca41 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:46.277677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c6172728-e736-4eec-bd3e-15476f20ca41 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:46.300336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6172728-e736-4eec-bd3e-15476f20ca41 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:46.300815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6172728-e736-4eec-bd3e-15476f20ca41 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:46.303781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6172728-e736-4eec-bd3e-15476f20ca41 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:46.304245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6172728-e736-4eec-bd3e-15476f20ca41 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:46.455828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5cfef53f-25ea-456c-ab06-f777effec2ae tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:46.456514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5cfef53f-25ea-456c-ab06-f777effec2ae tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:46.469414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5cfef53f-25ea-456c-ab06-f777effec2ae tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:46.470140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5cfef53f-25ea-456c-ab06-f777effec2ae tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:46.471246 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5cfef53f-25ea-456c-ab06-f777effec2ae tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:46.471933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5cfef53f-25ea-456c-ab06-f777effec2ae tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:46.621192 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c6172728-e736-4eec-bd3e-15476f20ca41 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:46.635126 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c6172728-e736-4eec-bd3e-15476f20ca41 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.362927 May 21 21:31:46.636837 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2493/4858] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:46 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:46.655428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-588f87a2-64bb-4e48-8f92-aa7e8faa9d69 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:46.656391 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-588f87a2-64bb-4e48-8f92-aa7e8faa9d69 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:46.663240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-588f87a2-64bb-4e48-8f92-aa7e8faa9d69 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:46.663981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-588f87a2-64bb-4e48-8f92-aa7e8faa9d69 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:46.664787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-588f87a2-64bb-4e48-8f92-aa7e8faa9d69 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:46.665511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-588f87a2-64bb-4e48-8f92-aa7e8faa9d69 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:46.716975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5cfef53f-25ea-456c-ab06-f777effec2ae tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:46.728715 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5cfef53f-25ea-456c-ab06-f777effec2ae tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1370 microversion: 2.1 time: 0.280062 May 21 21:31:46.733470 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2366/4859] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:46 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1370 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:46.937082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-588f87a2-64bb-4e48-8f92-aa7e8faa9d69 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:46.946946 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-588f87a2-64bb-4e48-8f92-aa7e8faa9d69 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.296139 May 21 21:31:46.966301 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2494/4860] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:46 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:47.178867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5afd697a-2ce2-4607-a3ce-540b9ef65682 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-166601031", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "key_name": "tempest-key-1530133000", "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:47.259210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-5afd697a-2ce2-4607-a3ce-540b9ef65682 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] validate_networks() for [('08704bbd-33da-45f4-ac41-9349866a62b3', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:31:47.338283 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:47.719470 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-5afd697a-2ce2-4607-a3ce-540b9ef65682 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Invalid key_name provided. May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5afd697a-2ce2-4607-a3ce-540b9ef65682 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 246 May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-166601031", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "key_name": "tempest-key-1530133000", "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid key_name provided. May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-166601031', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452', 'key_name': 'tempest-key-1530133000', 'networks': [{'uuid': '08704bbd-33da-45f4-ac41-9349866a62b3'}]}}} May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._create_instance( May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1530133000 not found for user 411af27147894e999b4242c5b9991c98 May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:47.721887 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. May 21 21:31:47.725949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:47.729676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5afd697a-2ce2-4607-a3ce-540b9ef65682 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 400 to user: Invalid key_name provided. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:47.731600 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5afd697a-2ce2-4607-a3ce-540b9ef65682 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.556894 May 21 21:31:47.737303 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2367/4861] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:31:47 2022] POST /compute/v2.1/servers => generated 70 bytes in 562 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 21 21:31:47.740929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8a9c7388-019a-4b37-b2d7-c569a6ebec87 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:47.741563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8a9c7388-019a-4b37-b2d7-c569a6ebec87 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:47.751224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a9c7388-019a-4b37-b2d7-c569a6ebec87 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:47.751558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e7392d13-5158-4a58-9a83-e7f980e93a8d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:47.751675 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a9c7388-019a-4b37-b2d7-c569a6ebec87 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:47.752193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e7392d13-5158-4a58-9a83-e7f980e93a8d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:47.752646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a9c7388-019a-4b37-b2d7-c569a6ebec87 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:47.757662 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a9c7388-019a-4b37-b2d7-c569a6ebec87 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:47.768791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7392d13-5158-4a58-9a83-e7f980e93a8d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:47.769636 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7392d13-5158-4a58-9a83-e7f980e93a8d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:47.770672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7392d13-5158-4a58-9a83-e7f980e93a8d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:47.771356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7392d13-5158-4a58-9a83-e7f980e93a8d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:48.028410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8a9c7388-019a-4b37-b2d7-c569a6ebec87 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:48.038194 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8a9c7388-019a-4b37-b2d7-c569a6ebec87 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.300967 May 21 21:31:48.039417 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2495/4862] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:47 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:48.058222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f45babb6-cd00-41bf-8082-8f5ea39a7257 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:48.058938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f45babb6-cd00-41bf-8082-8f5ea39a7257 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:48.071442 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f45babb6-cd00-41bf-8082-8f5ea39a7257 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:48.072072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f45babb6-cd00-41bf-8082-8f5ea39a7257 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:48.075897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f45babb6-cd00-41bf-8082-8f5ea39a7257 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:48.076481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f45babb6-cd00-41bf-8082-8f5ea39a7257 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:48.080315 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e7392d13-5158-4a58-9a83-e7f980e93a8d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:48.091981 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e7392d13-5158-4a58-9a83-e7f980e93a8d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1370 microversion: 2.1 time: 0.344029 May 21 21:31:48.093292 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2368/4863] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:47 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1370 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:48.694728 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f45babb6-cd00-41bf-8082-8f5ea39a7257 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:48.703944 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f45babb6-cd00-41bf-8082-8f5ea39a7257 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.650763 May 21 21:31:48.720762 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2496/4864] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:48 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:48.872028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9966c722-ecba-4afb-aee1-4b7260dacb41 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1888405684", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:48.886632 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=14 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:48.997505 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.security_group_api [None req-9966c722-ecba-4afb-aee1-4b7260dacb41 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Neutron security group does_not_exist not found {{(pid=131278) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} May 21 21:31:48.999304 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-9966c722-ecba-4afb-aee1-4b7260dacb41 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9966c722-ecba-4afb-aee1-4b7260dacb41 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 258 May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1888405684", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: exception: Unable to find security_group with name or id 'does_not_exist' May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1888405684', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '08704bbd-33da-45f4-ac41-9349866a62b3'}]}}} May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name May 21 21:31:49.016809 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._create_instance( May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:49.021242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9966c722-ecba-4afb-aee1-4b7260dacb41 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:49.030112 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9966c722-ecba-4afb-aee1-4b7260dacb41 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.155140 May 21 21:31:49.030112 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2369/4865] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:31:48 2022] POST /compute/v2.1/servers => generated 106 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:31:49.035440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fadac8ca-031e-4569-b97a-6b3146f31089 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:49.037993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fadac8ca-031e-4569-b97a-6b3146f31089 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:49.046529 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fadac8ca-031e-4569-b97a-6b3146f31089 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:49.046959 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fadac8ca-031e-4569-b97a-6b3146f31089 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:49.047890 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fadac8ca-031e-4569-b97a-6b3146f31089 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:49.048517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fadac8ca-031e-4569-b97a-6b3146f31089 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:49.112632 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d80b91fd-b886-43e8-b9b5-21d9817f7e46 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:49.113312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d80b91fd-b886-43e8-b9b5-21d9817f7e46 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:49.115321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:49.120693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d80b91fd-b886-43e8-b9b5-21d9817f7e46 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:49.121487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d80b91fd-b886-43e8-b9b5-21d9817f7e46 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:49.122465 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d80b91fd-b886-43e8-b9b5-21d9817f7e46 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:49.123074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d80b91fd-b886-43e8-b9b5-21d9817f7e46 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:49.285323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fadac8ca-031e-4569-b97a-6b3146f31089 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:49.301404 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fadac8ca-031e-4569-b97a-6b3146f31089 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.267096 May 21 21:31:49.301404 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2497/4866] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:49 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:49.318011 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ba757a3f-7302-45f9-a460-beb6ff19906b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:49.318888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ba757a3f-7302-45f9-a460-beb6ff19906b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:49.326391 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba757a3f-7302-45f9-a460-beb6ff19906b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:49.330130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba757a3f-7302-45f9-a460-beb6ff19906b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:49.330130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba757a3f-7302-45f9-a460-beb6ff19906b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:49.330130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba757a3f-7302-45f9-a460-beb6ff19906b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:49.568805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d80b91fd-b886-43e8-b9b5-21d9817f7e46 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:49.577903 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d80b91fd-b886-43e8-b9b5-21d9817f7e46 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1370 microversion: 2.1 time: 0.470447 May 21 21:31:49.582773 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2370/4867] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:49 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1370 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:49.610141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ff4978a2-023c-4ef8-8a22-563183ff9168 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:49.619071 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ff4978a2-023c-4ef8-8a22-563183ff9168 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:49.646222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff4978a2-023c-4ef8-8a22-563183ff9168 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:49.646821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff4978a2-023c-4ef8-8a22-563183ff9168 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:49.649576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff4978a2-023c-4ef8-8a22-563183ff9168 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:49.650867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff4978a2-023c-4ef8-8a22-563183ff9168 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:49.734815 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ff4978a2-023c-4ef8-8a22-563183ff9168 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384/ips" status: 200 len: 146 microversion: 2.1 time: 0.150415 May 21 21:31:49.742242 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2371/4868] 10.222.0.49 () {58 vars in 1247 bytes} [Sat May 21 21:31:49 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384/ips => generated 146 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:31:49.889462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ba757a3f-7302-45f9-a460-beb6ff19906b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:49.908684 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ba757a3f-7302-45f9-a460-beb6ff19906b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.594402 May 21 21:31:49.909947 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2498/4869] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:49 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:49.931202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ec6806db-bf75-4ae7-9d24-d463d1d2cdbe tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:49.932327 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ec6806db-bf75-4ae7-9d24-d463d1d2cdbe tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 04aaddcf-8f8e-4256-be83-4f680e9cad64] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:49.945442 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-ec6806db-bf75-4ae7-9d24-d463d1d2cdbe tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance 04aaddcf-8f8e-4256-be83-4f680e9cad64 could not be found. May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ec6806db-bf75-4ae7-9d24-d463d1d2cdbe tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/04aaddcf-8f8e-4256-be83-4f680e9cad64 HTTP/1.1 May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 04aaddcf-8f8e-4256-be83-4f680e9cad64 could not be found. May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '04aaddcf-8f8e-4256-be83-4f680e9cad64'} May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04aaddcf-8f8e-4256-be83-4f680e9cad64 could not be found. May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04aaddcf-8f8e-4256-be83-4f680e9cad64 could not be found. May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:49.948192 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:49.955136 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:49.955136 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:49.955136 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:49.955136 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:49.955136 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:49.955136 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:49.955136 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04aaddcf-8f8e-4256-be83-4f680e9cad64 could not be found. May 21 21:31:49.955136 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:49.955136 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ec6806db-bf75-4ae7-9d24-d463d1d2cdbe tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance 04aaddcf-8f8e-4256-be83-4f680e9cad64 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:49.957456 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ec6806db-bf75-4ae7-9d24-d463d1d2cdbe tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "DELETE /compute/v2.1/servers/04aaddcf-8f8e-4256-be83-4f680e9cad64" status: 404 len: 111 microversion: 2.1 time: 0.030439 May 21 21:31:49.961420 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2372/4870] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:31:49 2022] DELETE /compute/v2.1/servers/04aaddcf-8f8e-4256-be83-4f680e9cad64 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:31:49.985889 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7baad9ca-1937-4b06-bc24-4695dcc8fe84 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:49.987887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7baad9ca-1937-4b06-bc24-4695dcc8fe84 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:49.996121 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7baad9ca-1937-4b06-bc24-4695dcc8fe84 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:49.997313 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7baad9ca-1937-4b06-bc24-4695dcc8fe84 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:49.999055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7baad9ca-1937-4b06-bc24-4695dcc8fe84 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:50.000017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7baad9ca-1937-4b06-bc24-4695dcc8fe84 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:50.303503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7baad9ca-1937-4b06-bc24-4695dcc8fe84 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:50.317458 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7baad9ca-1937-4b06-bc24-4695dcc8fe84 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.351194 May 21 21:31:50.334258 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2499/4871] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:49 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:50.345275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-72a448a7-9797-4018-ad77-31fc41e8c783 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:50.345908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-72a448a7-9797-4018-ad77-31fc41e8c783 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:50.368161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72a448a7-9797-4018-ad77-31fc41e8c783 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:50.370815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72a448a7-9797-4018-ad77-31fc41e8c783 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:50.371857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72a448a7-9797-4018-ad77-31fc41e8c783 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:50.372585 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72a448a7-9797-4018-ad77-31fc41e8c783 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:50.587950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-72a448a7-9797-4018-ad77-31fc41e8c783 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:50.597508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4f10454c-704b-427d-a88b-3bcded54ddaa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:50.598079 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4f10454c-704b-427d-a88b-3bcded54ddaa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:50.611931 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-72a448a7-9797-4018-ad77-31fc41e8c783 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.275321 May 21 21:31:50.622202 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2373/4872] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:50 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:50.622577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f10454c-704b-427d-a88b-3bcded54ddaa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:50.622577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f10454c-704b-427d-a88b-3bcded54ddaa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:50.622577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f10454c-704b-427d-a88b-3bcded54ddaa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:50.622577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f10454c-704b-427d-a88b-3bcded54ddaa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:50.637180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6eb49d64-54e9-40c4-b418-73883d78638e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:50.639077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6eb49d64-54e9-40c4-b418-73883d78638e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Failed to fetch instance by id 9223372036854775808 {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2926}} May 21 21:31:50.639077 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-6eb49d64-54e9-40c4-b418-73883d78638e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6eb49d64-54e9-40c4-b418-73883d78638e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 9223372036854775808 could not be found. May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '9223372036854775808'} May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:50.639813 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:50.645101 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:50.645101 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:50.645101 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:50.645101 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. May 21 21:31:50.645101 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:50.645101 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6eb49d64-54e9-40c4-b418-73883d78638e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:50.645101 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6eb49d64-54e9-40c4-b418-73883d78638e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.013458 May 21 21:31:50.652635 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2374/4873] 10.222.0.49 () {58 vars in 1187 bytes} [Sat May 21 21:31:50 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:31:50.662923 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a46d70e8-f703-4ad7-baf4-7b801306a687 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:50.663604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a46d70e8-f703-4ad7-baf4-7b801306a687 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:50.684151 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a46d70e8-f703-4ad7-baf4-7b801306a687 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:50.684973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a46d70e8-f703-4ad7-baf4-7b801306a687 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:50.685513 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a46d70e8-f703-4ad7-baf4-7b801306a687 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:50.686347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a46d70e8-f703-4ad7-baf4-7b801306a687 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:50.847251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4f10454c-704b-427d-a88b-3bcded54ddaa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:50.865636 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4f10454c-704b-427d-a88b-3bcded54ddaa tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1370 microversion: 2.1 time: 0.271242 May 21 21:31:50.868348 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2500/4874] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:50 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1370 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:51.299813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-8d55ff4d-9496-4fd7-9726-57849f85910a req-79805811-b568-4fba-9749-d484f55f5aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54e8b13e-d6b2-467c-b801-2b0ad45e95ae", "name": "network-vif-plugged", "status": "completed", "tag": "ea540e6b-71e1-4aff-97b8-77527dd9d620"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:51.321201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8d55ff4d-9496-4fd7-9726-57849f85910a req-79805811-b568-4fba-9749-d484f55f5aaa service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:51.324200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8d55ff4d-9496-4fd7-9726-57849f85910a req-79805811-b568-4fba-9749-d484f55f5aaa service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:51.346767 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-8d55ff4d-9496-4fd7-9726-57849f85910a req-79805811-b568-4fba-9749-d484f55f5aaa service nova] Creating event network-vif-plugged:ea540e6b-71e1-4aff-97b8-77527dd9d620 for instance 54e8b13e-d6b2-467c-b801-2b0ad45e95ae on nch2-master-1 May 21 21:31:51.353863 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-8d55ff4d-9496-4fd7-9726-57849f85910a req-79805811-b568-4fba-9749-d484f55f5aaa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059026 May 21 21:31:51.355338 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2501/4875] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:31:51.390718 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a46d70e8-f703-4ad7-baf4-7b801306a687 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:51.412556 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a46d70e8-f703-4ad7-baf4-7b801306a687 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.746624 May 21 21:31:51.433484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1792b191-2f6b-411c-bfe2-cb60ad3851ae tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:51.435129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1792b191-2f6b-411c-bfe2-cb60ad3851ae tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:51.437525 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2375/4876] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:50 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:51.441527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1792b191-2f6b-411c-bfe2-cb60ad3851ae tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:51.442267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1792b191-2f6b-411c-bfe2-cb60ad3851ae tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:51.443317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1792b191-2f6b-411c-bfe2-cb60ad3851ae tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:51.443971 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1792b191-2f6b-411c-bfe2-cb60ad3851ae tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:51.733532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1792b191-2f6b-411c-bfe2-cb60ad3851ae tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:51.735963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:51.742264 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1792b191-2f6b-411c-bfe2-cb60ad3851ae tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.313199 May 21 21:31:51.752955 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2502/4877] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:51 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:51.760671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-547d6b33-c62c-4ebc-b9dc-7965c6ce609e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:51.761989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-547d6b33-c62c-4ebc-b9dc-7965c6ce609e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Failed to fetch instance by id -1 {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2926}} May 21 21:31:51.762710 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-547d6b33-c62c-4ebc-b9dc-7965c6ce609e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance -1 could not be found. May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-547d6b33-c62c-4ebc-b9dc-7965c6ce609e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance -1 could not be found. May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '-1'} May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:51.764470 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:51.770325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:51.770325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:51.770325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. May 21 21:31:51.770325 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:51.770325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-547d6b33-c62c-4ebc-b9dc-7965c6ce609e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance -1 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:51.772197 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-547d6b33-c62c-4ebc-b9dc-7965c6ce609e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.009655 May 21 21:31:51.782516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2819308c-e72e-4f2c-8c3d-b5f42652f71c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:51.783120 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2376/4878] 10.222.0.49 () {58 vars in 1136 bytes} [Sat May 21 21:31:51 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 21 21:31:51.784009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2819308c-e72e-4f2c-8c3d-b5f42652f71c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:51.790719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2819308c-e72e-4f2c-8c3d-b5f42652f71c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:51.791503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2819308c-e72e-4f2c-8c3d-b5f42652f71c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:51.792669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2819308c-e72e-4f2c-8c3d-b5f42652f71c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:51.793345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2819308c-e72e-4f2c-8c3d-b5f42652f71c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:51.883670 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1b9e11fd-e0de-455b-8b90-fb4ed5ab1162 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:51.884723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1b9e11fd-e0de-455b-8b90-fb4ed5ab1162 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:51.898510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b9e11fd-e0de-455b-8b90-fb4ed5ab1162 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:51.899966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b9e11fd-e0de-455b-8b90-fb4ed5ab1162 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:51.900201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b9e11fd-e0de-455b-8b90-fb4ed5ab1162 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:51.900853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b9e11fd-e0de-455b-8b90-fb4ed5ab1162 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:51.923016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:52.068477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2819308c-e72e-4f2c-8c3d-b5f42652f71c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:52.088831 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2819308c-e72e-4f2c-8c3d-b5f42652f71c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.307976 May 21 21:31:52.091009 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2503/4879] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:51 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:52.113226 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-41701245-dd54-4cbb-8bd1-bb7bf7753429 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:52.114205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-41701245-dd54-4cbb-8bd1-bb7bf7753429 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:52.122224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-41701245-dd54-4cbb-8bd1-bb7bf7753429 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:52.122775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-41701245-dd54-4cbb-8bd1-bb7bf7753429 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:52.123711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-41701245-dd54-4cbb-8bd1-bb7bf7753429 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:52.124315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-41701245-dd54-4cbb-8bd1-bb7bf7753429 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:52.329312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-41701245-dd54-4cbb-8bd1-bb7bf7753429 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:52.338482 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-41701245-dd54-4cbb-8bd1-bb7bf7753429 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.233206 May 21 21:31:52.339927 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2504/4880] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:52 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:52.362924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1b9e11fd-e0de-455b-8b90-fb4ed5ab1162 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:52.372022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d3922192-fbd4-4c06-a6b7-7ea10b51768f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:52.372606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d3922192-fbd4-4c06-a6b7-7ea10b51768f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 7f96986f-ddfb-4445-be7c-30a37352d201] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:52.374637 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1b9e11fd-e0de-455b-8b90-fb4ed5ab1162 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1370 microversion: 2.1 time: 0.492429 May 21 21:31:52.375580 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2377/4881] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:51 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1370 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:31:52.381185 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-d3922192-fbd4-4c06-a6b7-7ea10b51768f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance 7f96986f-ddfb-4445-be7c-30a37352d201 could not be found. May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d3922192-fbd4-4c06-a6b7-7ea10b51768f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/7f96986f-ddfb-4445-be7c-30a37352d201/action HTTP/1.1 May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 19 May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: {"forceDelete": {}} May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 7f96986f-ddfb-4445-be7c-30a37352d201 could not be found. May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '7f96986f-ddfb-4445-be7c-30a37352d201', 'body': {'forceDelete': {}}} May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f96986f-ddfb-4445-be7c-30a37352d201 could not be found. May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f96986f-ddfb-4445-be7c-30a37352d201 could not be found. May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:52.390625 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:52.394596 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:52.394596 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:52.394596 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f96986f-ddfb-4445-be7c-30a37352d201 could not be found. May 21 21:31:52.394596 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:52.394596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d3922192-fbd4-4c06-a6b7-7ea10b51768f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance 7f96986f-ddfb-4445-be7c-30a37352d201 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:52.394596 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d3922192-fbd4-4c06-a6b7-7ea10b51768f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/7f96986f-ddfb-4445-be7c-30a37352d201/action" status: 404 len: 111 microversion: 2.1 time: 0.038367 May 21 21:31:52.396405 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2505/4882] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:31:52 2022] POST /compute/v2.1/servers/7f96986f-ddfb-4445-be7c-30a37352d201/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:31:52.408538 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-32a4720c-3cba-4d79-b482-a742f790dcaf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:52.409173 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-32a4720c-3cba-4d79-b482-a742f790dcaf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:52.419008 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32a4720c-3cba-4d79-b482-a742f790dcaf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:52.419876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32a4720c-3cba-4d79-b482-a742f790dcaf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:52.420707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32a4720c-3cba-4d79-b482-a742f790dcaf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:52.421464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32a4720c-3cba-4d79-b482-a742f790dcaf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:52.825615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-32a4720c-3cba-4d79-b482-a742f790dcaf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:52.835917 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-32a4720c-3cba-4d79-b482-a742f790dcaf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.438273 May 21 21:31:52.837941 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2378/4883] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:52 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:52.865621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b8c25e69-ab9d-4717-94c6-2b5ba5e8ee37 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:52.866448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b8c25e69-ab9d-4717-94c6-2b5ba5e8ee37 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:52.885490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8c25e69-ab9d-4717-94c6-2b5ba5e8ee37 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:52.889744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8c25e69-ab9d-4717-94c6-2b5ba5e8ee37 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:52.893874 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8c25e69-ab9d-4717-94c6-2b5ba5e8ee37 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:52.909987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8c25e69-ab9d-4717-94c6-2b5ba5e8ee37 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:53.099009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b8c25e69-ab9d-4717-94c6-2b5ba5e8ee37 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:53.130246 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b8c25e69-ab9d-4717-94c6-2b5ba5e8ee37 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.271600 May 21 21:31:53.133359 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2506/4884] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:52 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:53.164907 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-48363c6f-1efc-4fb8-ba30-f31a7798e8f0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:53.165554 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-48363c6f-1efc-4fb8-ba30-f31a7798e8f0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: da39bbd2-4264-411a-8d60-9152acbfa7c7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:53.184470 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-48363c6f-1efc-4fb8-ba30-f31a7798e8f0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance da39bbd2-4264-411a-8d60-9152acbfa7c7 could not be found. May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-48363c6f-1efc-4fb8-ba30-f31a7798e8f0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/da39bbd2-4264-411a-8d60-9152acbfa7c7/action HTTP/1.1 May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 39 May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: {"os-getConsoleOutput": {"length": 10}} May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance da39bbd2-4264-411a-8d60-9152acbfa7c7 could not be found. May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'da39bbd2-4264-411a-8d60-9152acbfa7c7', 'body': {'os-getConsoleOutput': {'length': 10}}} May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da39bbd2-4264-411a-8d60-9152acbfa7c7 could not be found. May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da39bbd2-4264-411a-8d60-9152acbfa7c7 could not be found. May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:53.201900 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:53.209997 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:53.209997 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:53.209997 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:53.209997 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:53.209997 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da39bbd2-4264-411a-8d60-9152acbfa7c7 could not be found. May 21 21:31:53.209997 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:53.209997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-48363c6f-1efc-4fb8-ba30-f31a7798e8f0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance da39bbd2-4264-411a-8d60-9152acbfa7c7 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:53.209997 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-48363c6f-1efc-4fb8-ba30-f31a7798e8f0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/da39bbd2-4264-411a-8d60-9152acbfa7c7/action" status: 404 len: 111 microversion: 2.1 time: 0.049762 May 21 21:31:53.209997 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2379/4885] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:31:53 2022] POST /compute/v2.1/servers/da39bbd2-4264-411a-8d60-9152acbfa7c7/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:31:53.215710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6066672b-5d7e-433e-a356-5d0750a273e0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:53.216831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6066672b-5d7e-433e-a356-5d0750a273e0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:53.224636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6066672b-5d7e-433e-a356-5d0750a273e0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:53.225308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6066672b-5d7e-433e-a356-5d0750a273e0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:53.229918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6066672b-5d7e-433e-a356-5d0750a273e0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:53.229918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6066672b-5d7e-433e-a356-5d0750a273e0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:53.393411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e33d1c5d-2161-4f71-875c-199d058287d4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:53.394042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e33d1c5d-2161-4f71-875c-199d058287d4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:53.403447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e33d1c5d-2161-4f71-875c-199d058287d4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:53.403909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e33d1c5d-2161-4f71-875c-199d058287d4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:53.404906 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e33d1c5d-2161-4f71-875c-199d058287d4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:53.405485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e33d1c5d-2161-4f71-875c-199d058287d4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:53.524548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6066672b-5d7e-433e-a356-5d0750a273e0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:53.539023 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6066672b-5d7e-433e-a356-5d0750a273e0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.329392 May 21 21:31:53.540154 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2507/4886] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:53 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:53.556899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d906f515-9923-4546-8128-524017989faf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:53.557549 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d906f515-9923-4546-8128-524017989faf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:53.564386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d906f515-9923-4546-8128-524017989faf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:53.565122 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d906f515-9923-4546-8128-524017989faf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:53.565988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d906f515-9923-4546-8128-524017989faf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:53.566601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d906f515-9923-4546-8128-524017989faf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:53.694991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e33d1c5d-2161-4f71-875c-199d058287d4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:53.705710 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e33d1c5d-2161-4f71-875c-199d058287d4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1564 microversion: 2.1 time: 0.316622 May 21 21:31:53.724572 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2380/4887] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:53 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1564 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:53.730970 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2a5b824b-a27d-4703-b71c-d4429212964d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:53.731955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2a5b824b-a27d-4703-b71c-d4429212964d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:53.738735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a5b824b-a27d-4703-b71c-d4429212964d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:53.739535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a5b824b-a27d-4703-b71c-d4429212964d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:53.740631 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a5b824b-a27d-4703-b71c-d4429212964d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:53.741281 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a5b824b-a27d-4703-b71c-d4429212964d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:53.821263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d906f515-9923-4546-8128-524017989faf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:53.830133 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d906f515-9923-4546-8128-524017989faf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.277065 May 21 21:31:53.831846 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2508/4888] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:53 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:53.848652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-32ced6c9-97f6-4b3b-bd1e-4dd3274b5534 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:53.851901 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-32ced6c9-97f6-4b3b-bd1e-4dd3274b5534 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 8ee77ce3-e62f-4e1f-a4c2-9388af16e51e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:53.856737 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-32ced6c9-97f6-4b3b-bd1e-4dd3274b5534 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance 8ee77ce3-e62f-4e1f-a4c2-9388af16e51e could not be found. May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-32ced6c9-97f6-4b3b-bd1e-4dd3274b5534 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/8ee77ce3-e62f-4e1f-a4c2-9388af16e51e HTTP/1.1 May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 8ee77ce3-e62f-4e1f-a4c2-9388af16e51e could not be found. May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '8ee77ce3-e62f-4e1f-a4c2-9388af16e51e'} May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ee77ce3-e62f-4e1f-a4c2-9388af16e51e could not be found. May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ee77ce3-e62f-4e1f-a4c2-9388af16e51e could not be found. May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:53.858253 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:53.864198 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:53.864198 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:53.864198 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:53.864198 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ee77ce3-e62f-4e1f-a4c2-9388af16e51e could not be found. May 21 21:31:53.864198 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:53.864198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-32ced6c9-97f6-4b3b-bd1e-4dd3274b5534 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance 8ee77ce3-e62f-4e1f-a4c2-9388af16e51e could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:53.864198 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-32ced6c9-97f6-4b3b-bd1e-4dd3274b5534 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/8ee77ce3-e62f-4e1f-a4c2-9388af16e51e" status: 404 len: 111 microversion: 2.1 time: 0.015594 May 21 21:31:53.864678 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2509/4889] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:53 2022] GET /compute/v2.1/servers/8ee77ce3-e62f-4e1f-a4c2-9388af16e51e => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:31:53.870255 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5f41fbd2-2751-4967-abe5-2d8f9d0954d2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:53.870957 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5f41fbd2-2751-4967-abe5-2d8f9d0954d2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:53.878840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5f41fbd2-2751-4967-abe5-2d8f9d0954d2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:53.879583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5f41fbd2-2751-4967-abe5-2d8f9d0954d2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:53.880439 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5f41fbd2-2751-4967-abe5-2d8f9d0954d2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:53.880884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5f41fbd2-2751-4967-abe5-2d8f9d0954d2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:53.925664 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2a5b824b-a27d-4703-b71c-d4429212964d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.200043 May 21 21:31:53.927113 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2381/4890] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 21:31:53 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae/os-interface => generated 284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:31:54.327132 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a4f2619b-e5b4-46f1-a202-a4a298be942a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d62796e-2b52-4323-9da6-17210b1a2dfc"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:54.328477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a4f2619b-e5b4-46f1-a202-a4a298be942a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:54.337062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4f2619b-e5b4-46f1-a202-a4a298be942a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:54.337525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4f2619b-e5b4-46f1-a202-a4a298be942a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:54.341188 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4f2619b-e5b4-46f1-a202-a4a298be942a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:54.349266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4f2619b-e5b4-46f1-a202-a4a298be942a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:54.467627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5f41fbd2-2751-4967-abe5-2d8f9d0954d2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:54.476894 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5f41fbd2-2751-4967-abe5-2d8f9d0954d2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.610927 May 21 21:31:54.480147 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2510/4891] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:53 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:54.501606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6eaf57aa-7f25-4b8a-8fd4-592afd3447f4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:54.503105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6eaf57aa-7f25-4b8a-8fd4-592afd3447f4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:54.526792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6eaf57aa-7f25-4b8a-8fd4-592afd3447f4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:54.532475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6eaf57aa-7f25-4b8a-8fd4-592afd3447f4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:54.534446 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6eaf57aa-7f25-4b8a-8fd4-592afd3447f4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:54.538101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6eaf57aa-7f25-4b8a-8fd4-592afd3447f4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:55.118976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6eaf57aa-7f25-4b8a-8fd4-592afd3447f4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:55.138785 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6eaf57aa-7f25-4b8a-8fd4-592afd3447f4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.642054 May 21 21:31:55.140018 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2511/4892] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:54 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:55.295177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-461e8ef1-a666-4357-a56e-db11a2066295 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2105948047", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-461e8ef1-a666-4357-a56e-db11a2066295 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 238 May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2105948047", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2105948047', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '08704bbd-33da-45f4-ac41-9349866a62b3'}]}}} May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise error May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi On instance['server']: May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:31:55.299459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:31:55.303613 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:31:55.303613 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:31:55.303613 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 21 21:31:55.303613 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:55.303613 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:55.303613 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:55.303613 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:55.303613 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:55.303613 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:55.303613 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:31:55.303613 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:31:55.303613 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 21 21:31:55.303613 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:55.306546 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-461e8ef1-a666-4357-a56e-db11a2066295 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:55.308360 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-461e8ef1-a666-4357-a56e-db11a2066295 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.017798 May 21 21:31:55.309648 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2512/4893] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:31:55 2022] POST /compute/v2.1/servers => generated 139 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 21 21:31:55.343209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-23adfaf3-65d6-469a-b716-feca2e330274 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:55.344372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-23adfaf3-65d6-469a-b716-feca2e330274 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:55.352377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23adfaf3-65d6-469a-b716-feca2e330274 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:55.356128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23adfaf3-65d6-469a-b716-feca2e330274 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:55.356128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23adfaf3-65d6-469a-b716-feca2e330274 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:55.356128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23adfaf3-65d6-469a-b716-feca2e330274 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:55.525396 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a4f2619b-e5b4-46f1-a202-a4a298be942a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "POST /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.203015 May 21 21:31:55.534298 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2382/4894] 10.222.0.49 () {60 vars in 1322 bytes} [Sat May 21 21:31:54 2022] POST /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384/os-volume_attachments => generated 194 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:31:55.905882 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-23adfaf3-65d6-469a-b716-feca2e330274 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:55.924194 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-23adfaf3-65d6-469a-b716-feca2e330274 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.577115 May 21 21:31:55.934075 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2513/4895] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:55 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:55.942410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-efc94cae-d47e-441d-a6c2-e131f1005efc tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:55.943135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-efc94cae-d47e-441d-a6c2-e131f1005efc tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:55.952979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efc94cae-d47e-441d-a6c2-e131f1005efc tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:55.953457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efc94cae-d47e-441d-a6c2-e131f1005efc tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:55.954265 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efc94cae-d47e-441d-a6c2-e131f1005efc tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:55.954871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efc94cae-d47e-441d-a6c2-e131f1005efc tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:56.889725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-efc94cae-d47e-441d-a6c2-e131f1005efc tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:56.902470 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-efc94cae-d47e-441d-a6c2-e131f1005efc tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.963694 May 21 21:31:56.906338 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2383/4896] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:55 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:56.989449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-52a51126-3cbc-4b36-9a78-c0466d72c3c0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1585836820", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-52a51126-3cbc-4b36-9a78-c0466d72c3c0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 235 May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1585836820", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1585836820', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '08704bbd-33da-45f4-ac41-9349866a62b3'}]}}} May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = func(instance) May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise error May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi On instance['server']: May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi 'notvalid' May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:56.999141 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-52a51126-3cbc-4b36-9a78-c0466d72c3c0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:57.003950 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-52a51126-3cbc-4b36-9a78-c0466d72c3c0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.015605 May 21 21:31:57.005601 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2514/4897] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:31:56 2022] POST /compute/v2.1/servers => generated 133 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:31:57.019537 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5d9c3046-5ea6-4631-bed0-1723a4b1db3f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:57.022787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5d9c3046-5ea6-4631-bed0-1723a4b1db3f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:57.041121 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d9c3046-5ea6-4631-bed0-1723a4b1db3f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:57.045411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d9c3046-5ea6-4631-bed0-1723a4b1db3f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:57.046463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d9c3046-5ea6-4631-bed0-1723a4b1db3f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:57.055847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d9c3046-5ea6-4631-bed0-1723a4b1db3f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:57.903432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5d9c3046-5ea6-4631-bed0-1723a4b1db3f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:57.911593 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5d9c3046-5ea6-4631-bed0-1723a4b1db3f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.904335 May 21 21:31:57.925769 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2384/4898] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:57 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:57.932214 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4ba3f02b-e54d-4a98-aafd-cc10c36fdac8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:57.933247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4ba3f02b-e54d-4a98-aafd-cc10c36fdac8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:57.942751 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ba3f02b-e54d-4a98-aafd-cc10c36fdac8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:57.956580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ba3f02b-e54d-4a98-aafd-cc10c36fdac8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:57.956580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ba3f02b-e54d-4a98-aafd-cc10c36fdac8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:57.956580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ba3f02b-e54d-4a98-aafd-cc10c36fdac8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:58.377531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4ba3f02b-e54d-4a98-aafd-cc10c36fdac8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:58.392075 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4ba3f02b-e54d-4a98-aafd-cc10c36fdac8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.460349 May 21 21:31:58.393291 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2515/4899] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:57 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:58.417618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-03361cf9-0f85-4430-9f01-4fe55f65d3a6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:58.418409 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-03361cf9-0f85-4430-9f01-4fe55f65d3a6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 1ae10f5e-60c5-47f7-a127-3aee2d88c7eb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:58.449234 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-03361cf9-0f85-4430-9f01-4fe55f65d3a6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance 1ae10f5e-60c5-47f7-a127-3aee2d88c7eb could not be found. May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-03361cf9-0f85-4430-9f01-4fe55f65d3a6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/1ae10f5e-60c5-47f7-a127-3aee2d88c7eb/action HTTP/1.1 May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 13 May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: {"pause": {}} May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 1ae10f5e-60c5-47f7-a127-3aee2d88c7eb could not be found. May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '1ae10f5e-60c5-47f7-a127-3aee2d88c7eb', 'body': {'pause': {}}} May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ae10f5e-60c5-47f7-a127-3aee2d88c7eb could not be found. May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ae10f5e-60c5-47f7-a127-3aee2d88c7eb could not be found. May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:31:58.460931 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:31:58.464964 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:31:58.464964 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:31:58.464964 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ae10f5e-60c5-47f7-a127-3aee2d88c7eb could not be found. May 21 21:31:58.464964 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:31:58.467217 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-03361cf9-0f85-4430-9f01-4fe55f65d3a6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance 1ae10f5e-60c5-47f7-a127-3aee2d88c7eb could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:31:58.468472 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-03361cf9-0f85-4430-9f01-4fe55f65d3a6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/1ae10f5e-60c5-47f7-a127-3aee2d88c7eb/action" status: 404 len: 111 microversion: 2.1 time: 0.058107 May 21 21:31:58.473556 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2385/4900] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:31:58 2022] POST /compute/v2.1/servers/1ae10f5e-60c5-47f7-a127-3aee2d88c7eb/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:31:58.479886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-41fcb291-fd13-4c98-93e6-7a2db613000a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:58.480748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-41fcb291-fd13-4c98-93e6-7a2db613000a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:58.488796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-41fcb291-fd13-4c98-93e6-7a2db613000a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:58.489279 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-41fcb291-fd13-4c98-93e6-7a2db613000a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:58.491884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-41fcb291-fd13-4c98-93e6-7a2db613000a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:58.493626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-41fcb291-fd13-4c98-93e6-7a2db613000a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:59.003930 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-da33da07-be66-46b2-9794-d6ad756197ee tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Action: 'create', calling method: .version_select at 0x7fc819f3e160>, body: {"keypair": {"name": "tempest-keypair-549632871", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI82hnGgrfLY6JF06eSfWcVyhiZaPODQ0gQOAEKE2wCwCb4OlI4YUQKe3+052IFchBfVjD5Dlaq2F/Mm/5zNa3QMoyXzMEKH/VAkuuBwqpecugZBt9LIqVebdA8+qTJcow=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:59.034813 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-da33da07-be66-46b2-9794-d6ad756197ee tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Getting quotas for project 28972bcc37da4f9188ffca6bd1a9a3b9. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:31:59.048665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-da33da07-be66-46b2-9794-d6ad756197ee tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Getting quotas for user b29c0c0fb03c46838f3efe58b16c68d2 and project 28972bcc37da4f9188ffca6bd1a9a3b9. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:31:59.200623 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-41fcb291-fd13-4c98-93e6-7a2db613000a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:31:59.209410 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-da33da07-be66-46b2-9794-d6ad756197ee tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.452825 May 21 21:31:59.214212 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-41fcb291-fd13-4c98-93e6-7a2db613000a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.739518 May 21 21:31:59.215983 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2386/4901] 10.222.0.49 () {62 vars in 1199 bytes} [Sat May 21 21:31:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 460 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 21 21:31:59.220831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-47a0cbf2-7f4a-48d6-a5b2-f5a23b054430 req-17785b5b-1949-459d-823c-345a30850cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54e8b13e-d6b2-467c-b801-2b0ad45e95ae", "tag": "ea540e6b-71e1-4aff-97b8-77527dd9d620"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:59.221441 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2516/4902] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:58 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:31:59.234406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-47a0cbf2-7f4a-48d6-a5b2-f5a23b054430 req-17785b5b-1949-459d-823c-345a30850cdc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:59.234859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-47a0cbf2-7f4a-48d6-a5b2-f5a23b054430 req-17785b5b-1949-459d-823c-345a30850cdc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:59.247911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cdca65e5-cc31-4d55-92bf-a34c987cde00 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:59.248633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cdca65e5-cc31-4d55-92bf-a34c987cde00 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:59.261264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdca65e5-cc31-4d55-92bf-a34c987cde00 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:59.263610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdca65e5-cc31-4d55-92bf-a34c987cde00 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:59.267891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdca65e5-cc31-4d55-92bf-a34c987cde00 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:59.268537 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdca65e5-cc31-4d55-92bf-a34c987cde00 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:59.270766 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-47a0cbf2-7f4a-48d6-a5b2-f5a23b054430 req-17785b5b-1949-459d-823c-345a30850cdc service nova] Creating event network-changed:ea540e6b-71e1-4aff-97b8-77527dd9d620 for instance 54e8b13e-d6b2-467c-b801-2b0ad45e95ae on nch2-master-1 May 21 21:31:59.278672 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-47a0cbf2-7f4a-48d6-a5b2-f5a23b054430 req-17785b5b-1949-459d-823c-345a30850cdc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061215 May 21 21:31:59.279528 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2387/4903] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:31:59.560881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b3452cfa-44f7-4484-b810-9ac86d4b1a06 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:31:59.580670 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3452cfa-44f7-4484-b810-9ac86d4b1a06 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:59.580670 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3452cfa-44f7-4484-b810-9ac86d4b1a06 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:59.607088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b3452cfa-44f7-4484-b810-9ac86d4b1a06 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Going to try to stop instance {{(pid=131278) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 21 21:31:59.886591 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b3452cfa-44f7-4484-b810-9ac86d4b1a06 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "POST /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384/action" status: 202 len: 0 microversion: 2.1 time: 0.332016 May 21 21:31:59.887726 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2388/4904] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:31:59 2022] POST /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:31:59.900694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9615718a-e1ca-4a68-9937-6bcdd0c9a9c0 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:31:59.903174 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9615718a-e1ca-4a68-9937-6bcdd0c9a9c0 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:31:59.922867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9615718a-e1ca-4a68-9937-6bcdd0c9a9c0 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:59.923357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9615718a-e1ca-4a68-9937-6bcdd0c9a9c0 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:31:59.925114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9615718a-e1ca-4a68-9937-6bcdd0c9a9c0 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:31:59.932928 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9615718a-e1ca-4a68-9937-6bcdd0c9a9c0 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:00.091140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cdca65e5-cc31-4d55-92bf-a34c987cde00 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:00.106337 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cdca65e5-cc31-4d55-92bf-a34c987cde00 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.866231 May 21 21:32:00.127059 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2517/4905] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:59 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:00.160923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4588e10b-ef44-486b-baa7-43a1ead356e1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:00.161487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4588e10b-ef44-486b-baa7-43a1ead356e1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:00.173130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:00.174761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4588e10b-ef44-486b-baa7-43a1ead356e1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:00.177297 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4588e10b-ef44-486b-baa7-43a1ead356e1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:00.178319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4588e10b-ef44-486b-baa7-43a1ead356e1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:00.181666 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4588e10b-ef44-486b-baa7-43a1ead356e1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:00.618871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9615718a-e1ca-4a68-9937-6bcdd0c9a9c0 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:00.629788 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9615718a-e1ca-4a68-9937-6bcdd0c9a9c0 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1721 microversion: 2.1 time: 0.736723 May 21 21:32:00.634669 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2389/4906] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:31:59 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1721 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:00.705025 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4588e10b-ef44-486b-baa7-43a1ead356e1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action" status: 202 len: 0 microversion: 2.1 time: 0.553233 May 21 21:32:00.723530 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9bb1e544-7d49-4374-9f8c-d1c7f17d1a52 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:00.724404 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9bb1e544-7d49-4374-9f8c-d1c7f17d1a52 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:00.726667 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2518/4907] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:32:00 2022] POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:32:00.743051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9bb1e544-7d49-4374-9f8c-d1c7f17d1a52 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:00.744118 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9bb1e544-7d49-4374-9f8c-d1c7f17d1a52 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:00.746071 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9bb1e544-7d49-4374-9f8c-d1c7f17d1a52 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:00.749447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9bb1e544-7d49-4374-9f8c-d1c7f17d1a52 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:01.660208 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8e47e4fa-ce04-4f95-ac82-c5b11d2ead6c tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:01.660949 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8e47e4fa-ce04-4f95-ac82-c5b11d2ead6c tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:01.673789 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8e47e4fa-ce04-4f95-ac82-c5b11d2ead6c tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:01.677384 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8e47e4fa-ce04-4f95-ac82-c5b11d2ead6c tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:01.683600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8e47e4fa-ce04-4f95-ac82-c5b11d2ead6c tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:01.684344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8e47e4fa-ce04-4f95-ac82-c5b11d2ead6c tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:02.177016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9bb1e544-7d49-4374-9f8c-d1c7f17d1a52 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:02.188783 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9bb1e544-7d49-4374-9f8c-d1c7f17d1a52 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1512 microversion: 2.1 time: 1.478336 May 21 21:32:02.190120 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2390/4908] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:00 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1512 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:02.332440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8e47e4fa-ce04-4f95-ac82-c5b11d2ead6c tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:02.340737 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8e47e4fa-ce04-4f95-ac82-c5b11d2ead6c tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1721 microversion: 2.1 time: 0.690070 May 21 21:32:02.345899 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2519/4909] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:01 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1721 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:03.208291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9779f034-25ff-4429-a2c5-89b982bf1058 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:03.214414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9779f034-25ff-4429-a2c5-89b982bf1058 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:03.242735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9779f034-25ff-4429-a2c5-89b982bf1058 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:03.242735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9779f034-25ff-4429-a2c5-89b982bf1058 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:03.243194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9779f034-25ff-4429-a2c5-89b982bf1058 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:03.243451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9779f034-25ff-4429-a2c5-89b982bf1058 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:03.364710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-922cc1ef-bee8-45c6-8d3a-12050725d575 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:03.366275 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-922cc1ef-bee8-45c6-8d3a-12050725d575 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:03.401219 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-922cc1ef-bee8-45c6-8d3a-12050725d575 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:03.403471 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-922cc1ef-bee8-45c6-8d3a-12050725d575 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:03.404386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-922cc1ef-bee8-45c6-8d3a-12050725d575 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:03.404846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-922cc1ef-bee8-45c6-8d3a-12050725d575 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:03.728053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9779f034-25ff-4429-a2c5-89b982bf1058 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:03.738598 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9779f034-25ff-4429-a2c5-89b982bf1058 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1492 microversion: 2.1 time: 0.535269 May 21 21:32:03.739766 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2391/4910] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:03 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1492 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:03.762111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7b28eda1-396b-49a1-b730-9002cc5c9adb tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:03.763358 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7b28eda1-396b-49a1-b730-9002cc5c9adb tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:03.793339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7b28eda1-396b-49a1-b730-9002cc5c9adb tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:03.793761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7b28eda1-396b-49a1-b730-9002cc5c9adb tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:03.797713 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7b28eda1-396b-49a1-b730-9002cc5c9adb tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:03.798380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7b28eda1-396b-49a1-b730-9002cc5c9adb tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:03.850965 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-7b28eda1-396b-49a1-b730-9002cc5c9adb tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Cannot 'pause' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state paused May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7b28eda1-396b-49a1-b730-9002cc5c9adb tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action HTTP/1.1 May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 13 May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: {"pause": {}} May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: exception: Cannot 'pause' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state paused May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'af7de5bb-0233-4e88-a1a0-8561385e53cd', 'body': {'pause': {}}} May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance af7de5bb-0233-4e88-a1a0-8561385e53cd in vm_state paused. Cannot pause while the instance is in this state. May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state paused May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:03.854777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:03.859525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:03.859525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:32:03.859525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:32:03.859525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state paused May 21 21:32:03.859525 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:03.865371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-922cc1ef-bee8-45c6-8d3a-12050725d575 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:03.874060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7b28eda1-396b-49a1-b730-9002cc5c9adb tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 409 to user: Cannot 'pause' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state paused {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:32:03.875951 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7b28eda1-396b-49a1-b730-9002cc5c9adb tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action" status: 409 len: 143 microversion: 2.1 time: 0.122041 May 21 21:32:03.879383 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-922cc1ef-bee8-45c6-8d3a-12050725d575 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1721 microversion: 2.1 time: 0.518602 May 21 21:32:03.883672 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2520/4911] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:03 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1721 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:03.892531 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2392/4912] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:32:03 2022] POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action => generated 143 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 21 21:32:03.892531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e06c9167-83bb-4659-93ba-94161125ae09 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:03.892531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e06c9167-83bb-4659-93ba-94161125ae09 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:03.899949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e06c9167-83bb-4659-93ba-94161125ae09 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:03.900445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e06c9167-83bb-4659-93ba-94161125ae09 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:03.901595 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e06c9167-83bb-4659-93ba-94161125ae09 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:03.902282 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e06c9167-83bb-4659-93ba-94161125ae09 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:04.220149 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e06c9167-83bb-4659-93ba-94161125ae09 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action" status: 202 len: 0 microversion: 2.1 time: 0.333945 May 21 21:32:04.222712 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2393/4913] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:32:03 2022] POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:32:04.236978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b908b224-16a0-4cf6-a9ba-90ad524d5e8e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:04.237847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b908b224-16a0-4cf6-a9ba-90ad524d5e8e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:04.249513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b908b224-16a0-4cf6-a9ba-90ad524d5e8e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:04.249981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b908b224-16a0-4cf6-a9ba-90ad524d5e8e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:04.250797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b908b224-16a0-4cf6-a9ba-90ad524d5e8e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:04.251441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b908b224-16a0-4cf6-a9ba-90ad524d5e8e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:04.638300 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b908b224-16a0-4cf6-a9ba-90ad524d5e8e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:04.671156 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b908b224-16a0-4cf6-a9ba-90ad524d5e8e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1499 microversion: 2.1 time: 0.436695 May 21 21:32:04.674404 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2521/4914] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:04 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1499 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:04.903629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-287958a0-a008-44c5-8982-4960cfcd6ce5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:04.904606 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-287958a0-a008-44c5-8982-4960cfcd6ce5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:04.920040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-287958a0-a008-44c5-8982-4960cfcd6ce5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:04.920542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-287958a0-a008-44c5-8982-4960cfcd6ce5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:04.921342 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-287958a0-a008-44c5-8982-4960cfcd6ce5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:04.923980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-287958a0-a008-44c5-8982-4960cfcd6ce5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:05.293853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-287958a0-a008-44c5-8982-4960cfcd6ce5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:05.306404 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-287958a0-a008-44c5-8982-4960cfcd6ce5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1721 microversion: 2.1 time: 0.408453 May 21 21:32:05.307582 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2394/4915] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:04 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1721 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:05.691015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cdc1a85a-bd2b-49bc-b549-6b9446bdd63c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:05.692550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cdc1a85a-bd2b-49bc-b549-6b9446bdd63c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:05.698455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdc1a85a-bd2b-49bc-b549-6b9446bdd63c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:05.698850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdc1a85a-bd2b-49bc-b549-6b9446bdd63c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:05.699618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdc1a85a-bd2b-49bc-b549-6b9446bdd63c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:05.700270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdc1a85a-bd2b-49bc-b549-6b9446bdd63c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:05.716483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:06.056163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cdc1a85a-bd2b-49bc-b549-6b9446bdd63c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:06.067268 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cdc1a85a-bd2b-49bc-b549-6b9446bdd63c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.379968 May 21 21:32:06.068106 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2522/4916] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:05 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:06.085824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a2cf72d0-3f35-477b-9e4d-9b0417327fe9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:06.086881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a2cf72d0-3f35-477b-9e4d-9b0417327fe9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:06.093845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2cf72d0-3f35-477b-9e4d-9b0417327fe9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:06.094446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2cf72d0-3f35-477b-9e4d-9b0417327fe9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:06.095310 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2cf72d0-3f35-477b-9e4d-9b0417327fe9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:06.095827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a2cf72d0-3f35-477b-9e4d-9b0417327fe9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:06.122191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:06.313034 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a2cf72d0-3f35-477b-9e4d-9b0417327fe9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:06.327580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6f2a03e3-bccf-4f63-8123-3a291db5c180 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:06.328906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6f2a03e3-bccf-4f63-8123-3a291db5c180 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:06.336989 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a2cf72d0-3f35-477b-9e4d-9b0417327fe9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.252661 May 21 21:32:06.338011 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2395/4917] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:06 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:06.341155 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f2a03e3-bccf-4f63-8123-3a291db5c180 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:06.341620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f2a03e3-bccf-4f63-8123-3a291db5c180 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:06.357359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f2a03e3-bccf-4f63-8123-3a291db5c180 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:06.357359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f2a03e3-bccf-4f63-8123-3a291db5c180 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:06.373044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e4a34191-2549-4ffd-9d97-4f7a7f4d5e91 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:06.378818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e4a34191-2549-4ffd-9d97-4f7a7f4d5e91 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:06.406670 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e4a34191-2549-4ffd-9d97-4f7a7f4d5e91 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:06.407535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e4a34191-2549-4ffd-9d97-4f7a7f4d5e91 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:06.409597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e4a34191-2549-4ffd-9d97-4f7a7f4d5e91 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:06.410563 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e4a34191-2549-4ffd-9d97-4f7a7f4d5e91 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:06.436231 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-e4a34191-2549-4ffd-9d97-4f7a7f4d5e91 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e4a34191-2549-4ffd-9d97-4f7a7f4d5e91 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38/action HTTP/1.1 May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 28 May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: {"reboot": {"type": "SOFT"}} May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '66d0a724-f81f-497a-8a29-656bce922d38', 'body': {'reboot': {'type': 'SOFT'}}} May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:32:06.438043 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:32:06.442745 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:32:06.442745 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:06.442745 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:06.442745 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:06.442745 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:06.442745 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:06.442745 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:06.442745 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:32:06.442745 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:32:06.442745 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:32:06.442745 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:06.442745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e4a34191-2549-4ffd-9d97-4f7a7f4d5e91 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:32:06.442745 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e4a34191-2549-4ffd-9d97-4f7a7f4d5e91 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38/action" status: 404 len: 111 microversion: 2.1 time: 0.077984 May 21 21:32:06.442745 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2396/4918] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:32:06 2022] POST /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38/action => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:32:06.468640 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c8912c4c-765c-4c98-879d-7b931ec60556 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:06.469366 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c8912c4c-765c-4c98-879d-7b931ec60556 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:06.476552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8912c4c-765c-4c98-879d-7b931ec60556 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:06.477119 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8912c4c-765c-4c98-879d-7b931ec60556 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:06.477981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8912c4c-765c-4c98-879d-7b931ec60556 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:06.478496 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8912c4c-765c-4c98-879d-7b931ec60556 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:06.683830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c8912c4c-765c-4c98-879d-7b931ec60556 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:06.694690 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c8912c4c-765c-4c98-879d-7b931ec60556 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.234901 May 21 21:32:06.696800 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2397/4919] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:06 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:06.717743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cb51542a-da75-4519-976c-7f8eda34b5d6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:06.718501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cb51542a-da75-4519-976c-7f8eda34b5d6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:06.725993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb51542a-da75-4519-976c-7f8eda34b5d6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:06.726631 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb51542a-da75-4519-976c-7f8eda34b5d6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:06.727516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb51542a-da75-4519-976c-7f8eda34b5d6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:06.728142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb51542a-da75-4519-976c-7f8eda34b5d6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:06.771511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6f2a03e3-bccf-4f63-8123-3a291db5c180 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:06.781968 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6f2a03e3-bccf-4f63-8123-3a291db5c180 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1721 microversion: 2.1 time: 0.461428 May 21 21:32:06.787762 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2523/4920] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:06 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1721 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:06.891746 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cb51542a-da75-4519-976c-7f8eda34b5d6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:06.904681 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cb51542a-da75-4519-976c-7f8eda34b5d6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.191647 May 21 21:32:06.905415 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2398/4921] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:06 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:06.924019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e2a819c0-0f1d-412d-b07c-66260ea20f12 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:06.925344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e2a819c0-0f1d-412d-b07c-66260ea20f12 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 2f9fcd3d-7bb1-4020-bc8a-7c02c5d55433] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:06.936599 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-e2a819c0-0f1d-412d-b07c-66260ea20f12 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance 2f9fcd3d-7bb1-4020-bc8a-7c02c5d55433 could not be found. May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e2a819c0-0f1d-412d-b07c-66260ea20f12 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/2f9fcd3d-7bb1-4020-bc8a-7c02c5d55433/action HTTP/1.1 May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 28 May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: {"reboot": {"type": "SOFT"}} May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 2f9fcd3d-7bb1-4020-bc8a-7c02c5d55433 could not be found. May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '2f9fcd3d-7bb1-4020-bc8a-7c02c5d55433', 'body': {'reboot': {'type': 'SOFT'}}} May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f9fcd3d-7bb1-4020-bc8a-7c02c5d55433 could not be found. May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f9fcd3d-7bb1-4020-bc8a-7c02c5d55433 could not be found. May 21 21:32:06.938966 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:32:06.942728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:06.942728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:32:06.942728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:06.942728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:06.942728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:06.942728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:32:06.942728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:32:06.942728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f9fcd3d-7bb1-4020-bc8a-7c02c5d55433 could not be found. May 21 21:32:06.942728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:32:06.944637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e2a819c0-0f1d-412d-b07c-66260ea20f12 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance 2f9fcd3d-7bb1-4020-bc8a-7c02c5d55433 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:32:06.946064 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e2a819c0-0f1d-412d-b07c-66260ea20f12 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/2f9fcd3d-7bb1-4020-bc8a-7c02c5d55433/action" status: 404 len: 111 microversion: 2.1 time: 0.027104 May 21 21:32:06.946064 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2524/4922] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:32:06 2022] POST /compute/v2.1/servers/2f9fcd3d-7bb1-4020-bc8a-7c02c5d55433/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:32:06.955549 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c5a1a7e5-ab46-466f-b9cb-9bb8e4fb41a6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:06.956178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c5a1a7e5-ab46-466f-b9cb-9bb8e4fb41a6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:06.962629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5a1a7e5-ab46-466f-b9cb-9bb8e4fb41a6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:06.963862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5a1a7e5-ab46-466f-b9cb-9bb8e4fb41a6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:06.964830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5a1a7e5-ab46-466f-b9cb-9bb8e4fb41a6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:06.965283 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5a1a7e5-ab46-466f-b9cb-9bb8e4fb41a6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:06.983779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0d25c6ea-f5a9-4355-9127-e31dbc9e231e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1610462040", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b82fc487-938c-4efe-8954-e9b63cbd5125"}], "security_groups": [{"name": "tempest-securitygroup--1515411031"}], "key_name": "tempest-keypair-549632871", "user_data": "}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:07.128150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c5a1a7e5-ab46-466f-b9cb-9bb8e4fb41a6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:07.137307 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c5a1a7e5-ab46-466f-b9cb-9bb8e4fb41a6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.185659 May 21 21:32:07.138496 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2399/4923] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:06 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:07.155511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fbe20b3d-8e75-4176-8f6e-99e896e22794 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:07.167305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fbe20b3d-8e75-4176-8f6e-99e896e22794 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:07.167305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fbe20b3d-8e75-4176-8f6e-99e896e22794 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:07.167305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fbe20b3d-8e75-4176-8f6e-99e896e22794 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:07.167305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fbe20b3d-8e75-4176-8f6e-99e896e22794 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:07.167305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fbe20b3d-8e75-4176-8f6e-99e896e22794 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:07.256590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-0d25c6ea-f5a9-4355-9127-e31dbc9e231e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] validate_networks() for [('b82fc487-938c-4efe-8954-e9b63cbd5125', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:32:07.341215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fbe20b3d-8e75-4176-8f6e-99e896e22794 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:07.349600 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fbe20b3d-8e75-4176-8f6e-99e896e22794 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.198492 May 21 21:32:07.350192 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2400/4924] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:07 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:07.368240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ad271697-043b-487d-afc3-f20c0b1c842a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:07.369899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ad271697-043b-487d-afc3-f20c0b1c842a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:07.383111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ad271697-043b-487d-afc3-f20c0b1c842a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:07.383111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ad271697-043b-487d-afc3-f20c0b1c842a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:07.383111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ad271697-043b-487d-afc3-f20c0b1c842a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:07.383111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ad271697-043b-487d-afc3-f20c0b1c842a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:07.402155 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-ad271697-043b-487d-afc3-f20c0b1c842a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ad271697-043b-487d-afc3-f20c0b1c842a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38/action HTTP/1.1 May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 65 May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: {"rebuild": {"imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c"}} May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '66d0a724-f81f-497a-8a29-656bce922d38', 'body': {'rebuild': {'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c'}}} May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 21 21:32:07.404175 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild May 21 21:32:07.410078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 21 21:32:07.410078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:32:07.410078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:32:07.410078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:32:07.410078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:32:07.410078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:32:07.410078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:07.410078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:07.410078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:07.410078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:07.410078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:07.410078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:07.410078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:32:07.410078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:32:07.410078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:32:07.410078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:07.410078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ad271697-043b-487d-afc3-f20c0b1c842a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:32:07.410078 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ad271697-043b-487d-afc3-f20c0b1c842a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38/action" status: 404 len: 111 microversion: 2.1 time: 0.041752 May 21 21:32:07.410078 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2401/4925] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:32:07 2022] POST /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:32:07.415231 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-19b6b866-eb10-4464-b8a1-a4e8b28b0193 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:07.415422 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-19b6b866-eb10-4464-b8a1-a4e8b28b0193 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:07.422665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19b6b866-eb10-4464-b8a1-a4e8b28b0193 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:07.423121 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19b6b866-eb10-4464-b8a1-a4e8b28b0193 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:07.423923 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19b6b866-eb10-4464-b8a1-a4e8b28b0193 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:07.424411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19b6b866-eb10-4464-b8a1-a4e8b28b0193 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:07.605432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-19b6b866-eb10-4464-b8a1-a4e8b28b0193 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:07.615191 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-19b6b866-eb10-4464-b8a1-a4e8b28b0193 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.204295 May 21 21:32:07.617267 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2402/4926] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:07 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:07.636023 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cc9f9b9d-3c51-47ab-8776-2d3d551f7259 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:07.637497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cc9f9b9d-3c51-47ab-8776-2d3d551f7259 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:07.645190 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cc9f9b9d-3c51-47ab-8776-2d3d551f7259 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:07.645645 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cc9f9b9d-3c51-47ab-8776-2d3d551f7259 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:07.646475 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cc9f9b9d-3c51-47ab-8776-2d3d551f7259 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:07.647226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cc9f9b9d-3c51-47ab-8776-2d3d551f7259 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:07.857065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cc9f9b9d-3c51-47ab-8776-2d3d551f7259 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:07.866528 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cc9f9b9d-3c51-47ab-8776-2d3d551f7259 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.235511 May 21 21:32:07.867128 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2403/4927] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:07 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:07.896669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cf05c720-30da-46f6-b9bd-0eeec52b2c9e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:07.896669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cf05c720-30da-46f6-b9bd-0eeec52b2c9e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:07.897959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf05c720-30da-46f6-b9bd-0eeec52b2c9e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:07.898843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf05c720-30da-46f6-b9bd-0eeec52b2c9e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:07.899847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf05c720-30da-46f6-b9bd-0eeec52b2c9e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:07.901036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf05c720-30da-46f6-b9bd-0eeec52b2c9e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:08.141826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-0d25c6ea-f5a9-4355-9127-e31dbc9e231e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:32:08.142346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-0d25c6ea-f5a9-4355-9127-e31dbc9e231e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:32:08.143418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-0d25c6ea-f5a9-4355-9127-e31dbc9e231e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:32:08.143983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-0d25c6ea-f5a9-4355-9127-e31dbc9e231e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:32:08.144459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-0d25c6ea-f5a9-4355-9127-e31dbc9e231e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:32:08.155768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d25c6ea-f5a9-4355-9127-e31dbc9e231e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:08.156225 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d25c6ea-f5a9-4355-9127-e31dbc9e231e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:08.157084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d25c6ea-f5a9-4355-9127-e31dbc9e231e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:08.157517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d25c6ea-f5a9-4355-9127-e31dbc9e231e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:08.177102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-0d25c6ea-f5a9-4355-9127-e31dbc9e231e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Getting quotas for project 28972bcc37da4f9188ffca6bd1a9a3b9. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:32:08.182853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-0d25c6ea-f5a9-4355-9127-e31dbc9e231e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Getting quotas for user b29c0c0fb03c46838f3efe58b16c68d2 and project 28972bcc37da4f9188ffca6bd1a9a3b9. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:32:08.196061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0d25c6ea-f5a9-4355-9127-e31dbc9e231e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:32:08.198941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0d25c6ea-f5a9-4355-9127-e31dbc9e231e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:32:08.272923 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cf05c720-30da-46f6-b9bd-0eeec52b2c9e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:08.282576 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cf05c720-30da-46f6-b9bd-0eeec52b2c9e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1721 microversion: 2.1 time: 0.413821 May 21 21:32:08.283149 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2404/4928] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:07 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1721 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:08.296822 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-92b424ba-2958-4a9a-b32d-f57ab5be64de tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:08.298286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-92b424ba-2958-4a9a-b32d-f57ab5be64de tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: a295f362-b97d-4b8d-98d4-d8eada7cf842] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:08.304602 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-92b424ba-2958-4a9a-b32d-f57ab5be64de tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance a295f362-b97d-4b8d-98d4-d8eada7cf842 could not be found. May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-92b424ba-2958-4a9a-b32d-f57ab5be64de tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/a295f362-b97d-4b8d-98d4-d8eada7cf842/action HTTP/1.1 May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 65 May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: {"rebuild": {"imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c"}} May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance a295f362-b97d-4b8d-98d4-d8eada7cf842 could not be found. May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'a295f362-b97d-4b8d-98d4-d8eada7cf842', 'body': {'rebuild': {'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c'}}} May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a295f362-b97d-4b8d-98d4-d8eada7cf842 could not be found. May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 21 21:32:08.306529 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:32:08.311163 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:32:08.311163 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:32:08.311163 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:32:08.311163 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a295f362-b97d-4b8d-98d4-d8eada7cf842 could not be found. May 21 21:32:08.311163 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:08.311163 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:08.311163 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:08.311163 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:08.311163 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:08.311163 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:08.311163 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:32:08.311163 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:32:08.311163 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a295f362-b97d-4b8d-98d4-d8eada7cf842 could not be found. May 21 21:32:08.311163 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:08.313078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-92b424ba-2958-4a9a-b32d-f57ab5be64de tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance a295f362-b97d-4b8d-98d4-d8eada7cf842 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:32:08.319227 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-92b424ba-2958-4a9a-b32d-f57ab5be64de tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/a295f362-b97d-4b8d-98d4-d8eada7cf842/action" status: 404 len: 111 microversion: 2.1 time: 0.029827 May 21 21:32:08.319227 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2405/4929] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:32:08 2022] POST /compute/v2.1/servers/a295f362-b97d-4b8d-98d4-d8eada7cf842/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:32:08.323622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1f0f08b1-a228-41b8-93a3-75d9791ee990 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:08.324560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1f0f08b1-a228-41b8-93a3-75d9791ee990 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:08.332493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f0f08b1-a228-41b8-93a3-75d9791ee990 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:08.332950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f0f08b1-a228-41b8-93a3-75d9791ee990 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:08.333753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f0f08b1-a228-41b8-93a3-75d9791ee990 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:08.334197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f0f08b1-a228-41b8-93a3-75d9791ee990 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:08.432741 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0d25c6ea-f5a9-4355-9127-e31dbc9e231e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.453229 May 21 21:32:08.433801 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2525/4930] 10.222.0.49 () {62 vars in 1187 bytes} [Sat May 21 21:32:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 1455 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 21 21:32:08.444417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-148e2c8d-5d13-474e-98d2-a7ed8607f730 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:08.445726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-148e2c8d-5d13-474e-98d2-a7ed8607f730 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:08.528326 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-148e2c8d-5d13-474e-98d2-a7ed8607f730 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:08.542515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-148e2c8d-5d13-474e-98d2-a7ed8607f730 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:08.545014 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-148e2c8d-5d13-474e-98d2-a7ed8607f730 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:08.546275 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-148e2c8d-5d13-474e-98d2-a7ed8607f730 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1281 microversion: 2.20 time: 0.106396 May 21 21:32:08.557661 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2526/4931] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:32:08 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1281 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:32:08.708884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1f0f08b1-a228-41b8-93a3-75d9791ee990 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:08.718087 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1f0f08b1-a228-41b8-93a3-75d9791ee990 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.399165 May 21 21:32:08.727411 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2406/4932] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:08 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:08.736251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-86f9c138-42dc-4fc8-9476-45960524f124 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:08.736990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-86f9c138-42dc-4fc8-9476-45960524f124 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:08.744903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86f9c138-42dc-4fc8-9476-45960524f124 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:08.745606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86f9c138-42dc-4fc8-9476-45960524f124 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:08.762416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86f9c138-42dc-4fc8-9476-45960524f124 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:08.762416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86f9c138-42dc-4fc8-9476-45960524f124 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:08.901215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-86f9c138-42dc-4fc8-9476-45960524f124 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:08.909555 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-86f9c138-42dc-4fc8-9476-45960524f124 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.177553 May 21 21:32:08.922326 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2527/4933] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:08 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:08.927696 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e76b8cd2-5dc5-4c81-8f93-ffbcd046e74e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:08.928422 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e76b8cd2-5dc5-4c81-8f93-ffbcd046e74e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 523a6ffe-aa98-4316-a970-a2c8d5313f49] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:08.935161 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-e76b8cd2-5dc5-4c81-8f93-ffbcd046e74e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance 523a6ffe-aa98-4316-a970-a2c8d5313f49 could not be found. May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e76b8cd2-5dc5-4c81-8f93-ffbcd046e74e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/523a6ffe-aa98-4316-a970-a2c8d5313f49/action HTTP/1.1 May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 15 May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: {"restore": {}} May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 523a6ffe-aa98-4316-a970-a2c8d5313f49 could not be found. May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '523a6ffe-aa98-4316-a970-a2c8d5313f49', 'body': {'restore': {}}} May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 523a6ffe-aa98-4316-a970-a2c8d5313f49 could not be found. May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 523a6ffe-aa98-4316-a970-a2c8d5313f49 could not be found. May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:08.937117 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:08.941700 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:32:08.941700 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:32:08.941700 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 523a6ffe-aa98-4316-a970-a2c8d5313f49 could not be found. May 21 21:32:08.941700 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:08.941700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e76b8cd2-5dc5-4c81-8f93-ffbcd046e74e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance 523a6ffe-aa98-4316-a970-a2c8d5313f49 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:32:08.941700 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e76b8cd2-5dc5-4c81-8f93-ffbcd046e74e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/523a6ffe-aa98-4316-a970-a2c8d5313f49/action" status: 404 len: 111 microversion: 2.1 time: 0.016199 May 21 21:32:08.941700 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2407/4934] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:32:08 2022] POST /compute/v2.1/servers/523a6ffe-aa98-4316-a970-a2c8d5313f49/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:32:08.950217 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f6245bd8-3da0-43d5-bd4d-0117b6d61fc4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:08.950833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f6245bd8-3da0-43d5-bd4d-0117b6d61fc4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:08.960263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6245bd8-3da0-43d5-bd4d-0117b6d61fc4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:08.960744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6245bd8-3da0-43d5-bd4d-0117b6d61fc4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:08.961554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6245bd8-3da0-43d5-bd4d-0117b6d61fc4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:08.965967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6245bd8-3da0-43d5-bd4d-0117b6d61fc4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:09.149310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f6245bd8-3da0-43d5-bd4d-0117b6d61fc4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:09.158330 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f6245bd8-3da0-43d5-bd4d-0117b6d61fc4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.212730 May 21 21:32:09.158914 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2528/4935] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:08 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:09.176129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e7e0f0e0-bb6f-4da6-a934-9289a298611a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:09.176774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e7e0f0e0-bb6f-4da6-a934-9289a298611a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:09.178850 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:09.186826 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7e0f0e0-bb6f-4da6-a934-9289a298611a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:09.187517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7e0f0e0-bb6f-4da6-a934-9289a298611a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:09.188506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7e0f0e0-bb6f-4da6-a934-9289a298611a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:09.189121 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e7e0f0e0-bb6f-4da6-a934-9289a298611a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:09.301327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e517d635-3ce7-4fa2-9ff9-8a2a3988fa88 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:09.302164 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e517d635-3ce7-4fa2-9ff9-8a2a3988fa88 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:09.309411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e517d635-3ce7-4fa2-9ff9-8a2a3988fa88 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:09.309866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e517d635-3ce7-4fa2-9ff9-8a2a3988fa88 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:09.310660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e517d635-3ce7-4fa2-9ff9-8a2a3988fa88 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:09.311101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e517d635-3ce7-4fa2-9ff9-8a2a3988fa88 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:09.473700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e517d635-3ce7-4fa2-9ff9-8a2a3988fa88 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:09.483023 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e517d635-3ce7-4fa2-9ff9-8a2a3988fa88 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1721 microversion: 2.1 time: 0.185582 May 21 21:32:09.493136 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2529/4936] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:09 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:09.565680 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-929fb6e0-350e-40a3-a37a-c593594f47d3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:09.566304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-929fb6e0-350e-40a3-a37a-c593594f47d3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:09.648164 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-929fb6e0-350e-40a3-a37a-c593594f47d3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:09.658890 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-929fb6e0-350e-40a3-a37a-c593594f47d3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:09.673147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-929fb6e0-350e-40a3-a37a-c593594f47d3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:09.674516 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-929fb6e0-350e-40a3-a37a-c593594f47d3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1281 microversion: 2.20 time: 0.112871 May 21 21:32:09.675585 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2530/4937] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:32:09 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1281 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:32:09.743227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e7e0f0e0-bb6f-4da6-a934-9289a298611a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:09.751646 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e7e0f0e0-bb6f-4da6-a934-9289a298611a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.579363 May 21 21:32:09.752370 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2408/4938] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:09 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:09.768457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-01fa827c-a4b4-49ae-b873-dc7c87dc4ce7 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:09.769011 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-01fa827c-a4b4-49ae-b873-dc7c87dc4ce7 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:09.777792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-01fa827c-a4b4-49ae-b873-dc7c87dc4ce7 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:09.778285 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-01fa827c-a4b4-49ae-b873-dc7c87dc4ce7 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:09.781110 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-01fa827c-a4b4-49ae-b873-dc7c87dc4ce7 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:09.781110 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-01fa827c-a4b4-49ae-b873-dc7c87dc4ce7 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:09.804989 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-01fa827c-a4b4-49ae-b873-dc7c87dc4ce7 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Cannot 'restore' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state active May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-01fa827c-a4b4-49ae-b873-dc7c87dc4ce7 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action HTTP/1.1 May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 15 May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: {"restore": {}} May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: exception: Cannot 'restore' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state active May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'af7de5bb-0233-4e88-a1a0-8561385e53cd', 'body': {'restore': {}}} May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance af7de5bb-0233-4e88-a1a0-8561385e53cd in vm_state active. Cannot restore while the instance is in this state. May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state active May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:09.806455 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:09.816912 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:09.816912 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:32:09.816912 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:32:09.816912 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state active May 21 21:32:09.816912 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:32:09.816912 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-01fa827c-a4b4-49ae-b873-dc7c87dc4ce7 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 409 to user: Cannot 'restore' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state active {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:32:09.816912 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-01fa827c-a4b4-49ae-b873-dc7c87dc4ce7 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action" status: 409 len: 145 microversion: 2.1 time: 0.044692 May 21 21:32:09.816912 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2531/4939] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:32:09 2022] POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action => generated 145 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 21 21:32:09.817918 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-60ef4e1a-5911-41b9-a9da-4bd8dbe6a5b1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:09.818543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-60ef4e1a-5911-41b9-a9da-4bd8dbe6a5b1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:09.825453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-60ef4e1a-5911-41b9-a9da-4bd8dbe6a5b1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:09.825936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-60ef4e1a-5911-41b9-a9da-4bd8dbe6a5b1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:09.826703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-60ef4e1a-5911-41b9-a9da-4bd8dbe6a5b1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:09.827170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-60ef4e1a-5911-41b9-a9da-4bd8dbe6a5b1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:10.149981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-60ef4e1a-5911-41b9-a9da-4bd8dbe6a5b1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:10.160126 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-60ef4e1a-5911-41b9-a9da-4bd8dbe6a5b1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.346074 May 21 21:32:10.164582 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2409/4940] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:09 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:10.180543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-063faa3d-7282-4da6-b52a-3182680ba704 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:10.181196 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-063faa3d-7282-4da6-b52a-3182680ba704 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:10.188568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-063faa3d-7282-4da6-b52a-3182680ba704 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:10.189029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-063faa3d-7282-4da6-b52a-3182680ba704 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:10.189823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-063faa3d-7282-4da6-b52a-3182680ba704 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:10.190271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-063faa3d-7282-4da6-b52a-3182680ba704 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:10.341564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-063faa3d-7282-4da6-b52a-3182680ba704 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:10.349847 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-063faa3d-7282-4da6-b52a-3182680ba704 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.173474 May 21 21:32:10.350533 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2532/4941] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:10 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:10.371157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8df7b662-dbdd-4283-ac7a-e2b6279a58c2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:10.371157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8df7b662-dbdd-4283-ac7a-e2b6279a58c2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: bdd364eb-5806-4782-8ab0-c0c9a34f192a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:10.375114 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-8df7b662-dbdd-4283-ac7a-e2b6279a58c2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance bdd364eb-5806-4782-8ab0-c0c9a34f192a could not be found. May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8df7b662-dbdd-4283-ac7a-e2b6279a58c2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/bdd364eb-5806-4782-8ab0-c0c9a34f192a/action HTTP/1.1 May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 14 May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: {"resume": {}} May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance bdd364eb-5806-4782-8ab0-c0c9a34f192a could not be found. May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'bdd364eb-5806-4782-8ab0-c0c9a34f192a', 'body': {'resume': {}}} May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdd364eb-5806-4782-8ab0-c0c9a34f192a could not be found. May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdd364eb-5806-4782-8ab0-c0c9a34f192a could not be found. May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:10.381943 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:10.388332 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:32:10.388332 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:32:10.388332 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdd364eb-5806-4782-8ab0-c0c9a34f192a could not be found. May 21 21:32:10.388332 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:10.388332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8df7b662-dbdd-4283-ac7a-e2b6279a58c2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance bdd364eb-5806-4782-8ab0-c0c9a34f192a could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:32:10.388332 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8df7b662-dbdd-4283-ac7a-e2b6279a58c2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/bdd364eb-5806-4782-8ab0-c0c9a34f192a/action" status: 404 len: 111 microversion: 2.1 time: 0.020252 May 21 21:32:10.388332 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2410/4942] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:32:10 2022] POST /compute/v2.1/servers/bdd364eb-5806-4782-8ab0-c0c9a34f192a/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:32:10.394556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9cfd7270-006a-46c0-aaa4-48665929726f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:10.395352 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9cfd7270-006a-46c0-aaa4-48665929726f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:10.402150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cfd7270-006a-46c0-aaa4-48665929726f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:10.402605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cfd7270-006a-46c0-aaa4-48665929726f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:10.403396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cfd7270-006a-46c0-aaa4-48665929726f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:10.405116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9cfd7270-006a-46c0-aaa4-48665929726f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:10.501418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8452822f-5dd3-4314-91fb-978efe177b44 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:10.502702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8452822f-5dd3-4314-91fb-978efe177b44 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:10.510632 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8452822f-5dd3-4314-91fb-978efe177b44 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:10.511395 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8452822f-5dd3-4314-91fb-978efe177b44 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:10.513869 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8452822f-5dd3-4314-91fb-978efe177b44 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:10.513869 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8452822f-5dd3-4314-91fb-978efe177b44 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:10.697890 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8452822f-5dd3-4314-91fb-978efe177b44 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:10.706848 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8452822f-5dd3-4314-91fb-978efe177b44 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1698 microversion: 2.1 time: 0.209354 May 21 21:32:10.707440 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2411/4943] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:10 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1698 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:10.712447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1e87d737-1250-4adb-ae5c-095bc6fbe8e5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:10.713628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1e87d737-1250-4adb-ae5c-095bc6fbe8e5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:10.720087 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e87d737-1250-4adb-ae5c-095bc6fbe8e5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:10.720579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e87d737-1250-4adb-ae5c-095bc6fbe8e5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:10.721366 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e87d737-1250-4adb-ae5c-095bc6fbe8e5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:10.725581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e87d737-1250-4adb-ae5c-095bc6fbe8e5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:10.762424 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9cfd7270-006a-46c0-aaa4-48665929726f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:10.779009 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9cfd7270-006a-46c0-aaa4-48665929726f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.388290 May 21 21:32:10.779754 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2533/4944] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:10 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:10.785316 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2589298c-2231-46ac-ab2d-3cef4181a8e1 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:10.796370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2589298c-2231-46ac-ab2d-3cef4181a8e1 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:10.797164 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2589298c-2231-46ac-ab2d-3cef4181a8e1 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:10.809700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1e87d737-1250-4adb-ae5c-095bc6fbe8e5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:10.821206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1e87d737-1250-4adb-ae5c-095bc6fbe8e5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:10.823511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2589298c-2231-46ac-ab2d-3cef4181a8e1 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Going to try to start instance {{(pid=131277) start /opt/stack/nova/nova/compute/api.py:2730}} May 21 21:32:10.824210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1e87d737-1250-4adb-ae5c-095bc6fbe8e5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:10.825912 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1e87d737-1250-4adb-ae5c-095bc6fbe8e5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1277 microversion: 2.20 time: 0.117434 May 21 21:32:10.826632 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2412/4945] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:32:10 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1277 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:32:10.833150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-839b4bcc-3603-4f58-8205-4b111b0f4124 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:10.833773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-839b4bcc-3603-4f58-8205-4b111b0f4124 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:10.845390 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-839b4bcc-3603-4f58-8205-4b111b0f4124 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:10.846104 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-839b4bcc-3603-4f58-8205-4b111b0f4124 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:10.847048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-839b4bcc-3603-4f58-8205-4b111b0f4124 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:10.847683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-839b4bcc-3603-4f58-8205-4b111b0f4124 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:11.004565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-839b4bcc-3603-4f58-8205-4b111b0f4124 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:11.012889 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-839b4bcc-3603-4f58-8205-4b111b0f4124 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.185035 May 21 21:32:11.013491 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2413/4946] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:10 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:11.030734 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b2723897-7f1b-4322-b885-ab5465610185 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:11.031281 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b2723897-7f1b-4322-b885-ab5465610185 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:11.038239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2723897-7f1b-4322-b885-ab5465610185 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:11.039214 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2723897-7f1b-4322-b885-ab5465610185 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:11.040010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2723897-7f1b-4322-b885-ab5465610185 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:11.040664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2723897-7f1b-4322-b885-ab5465610185 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:11.069211 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-b2723897-7f1b-4322-b885-ab5465610185 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Cannot 'resume' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state active May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b2723897-7f1b-4322-b885-ab5465610185 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action HTTP/1.1 May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 14 May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: {"resume": {}} May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: exception: Cannot 'resume' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state active May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'af7de5bb-0233-4e88-a1a0-8561385e53cd', 'body': {'resume': {}}} May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance af7de5bb-0233-4e88-a1a0-8561385e53cd in vm_state active. Cannot resume while the instance is in this state. May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state active May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:11.070698 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:11.074998 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:11.074998 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:32:11.074998 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:32:11.074998 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state active May 21 21:32:11.074998 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:11.074998 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b2723897-7f1b-4322-b885-ab5465610185 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 409 to user: Cannot 'resume' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state active {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:32:11.074998 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b2723897-7f1b-4322-b885-ab5465610185 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action" status: 409 len: 144 microversion: 2.1 time: 0.045567 May 21 21:32:11.074998 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2414/4947] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:32:11 2022] POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action => generated 144 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 21 21:32:11.081309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a1fbff01-36e1-4312-9f0e-8eab7f10f2c8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:11.081941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a1fbff01-36e1-4312-9f0e-8eab7f10f2c8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:11.086069 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2589298c-2231-46ac-ab2d-3cef4181a8e1 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "POST /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384/action" status: 202 len: 0 microversion: 2.1 time: 0.304550 May 21 21:32:11.088690 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2534/4948] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:32:10 2022] POST /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:32:11.089511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a1fbff01-36e1-4312-9f0e-8eab7f10f2c8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:11.089993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a1fbff01-36e1-4312-9f0e-8eab7f10f2c8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:11.090800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a1fbff01-36e1-4312-9f0e-8eab7f10f2c8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:11.091268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a1fbff01-36e1-4312-9f0e-8eab7f10f2c8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:11.109774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4e4e0057-b6a9-4741-8e65-f66772d943a8 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:11.110571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4e4e0057-b6a9-4741-8e65-f66772d943a8 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:11.118025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e4e0057-b6a9-4741-8e65-f66772d943a8 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:11.136265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e4e0057-b6a9-4741-8e65-f66772d943a8 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:11.136265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e4e0057-b6a9-4741-8e65-f66772d943a8 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:11.136265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e4e0057-b6a9-4741-8e65-f66772d943a8 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:11.266950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a1fbff01-36e1-4312-9f0e-8eab7f10f2c8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:11.277720 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a1fbff01-36e1-4312-9f0e-8eab7f10f2c8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.200310 May 21 21:32:11.278589 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2415/4949] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:11 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:11.296047 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-836d8eef-ed1c-4b75-9b47-02d5837555b6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:11.296701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-836d8eef-ed1c-4b75-9b47-02d5837555b6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:11.303607 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-836d8eef-ed1c-4b75-9b47-02d5837555b6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:11.304303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-836d8eef-ed1c-4b75-9b47-02d5837555b6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:11.305252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-836d8eef-ed1c-4b75-9b47-02d5837555b6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:11.306497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-836d8eef-ed1c-4b75-9b47-02d5837555b6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:11.327070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:11.598270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-836d8eef-ed1c-4b75-9b47-02d5837555b6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:11.607209 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-836d8eef-ed1c-4b75-9b47-02d5837555b6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.314923 May 21 21:32:11.616381 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2416/4950] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:11 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:11.744117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8d90fa16-f1b2-45cc-b8c9-b51d5b21c85a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8d90fa16-f1b2-45cc-b8c9-b51d5b21c85a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers HTTP/1.1 May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 160 May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: {"server": {"name": "", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "08704bbd-33da-45f4-ac41-9349866a62b3"}]}} May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid input for field/attribute name. Value: . '' is too short May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'body': {'server': {'name': '', 'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'flavorRef': '452', 'networks': [{'uuid': '08704bbd-33da-45f4-ac41-9349866a62b3'}]}}} May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise error May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi On instance['server']: May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi '' May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:32:11.747091 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:32:11.756760 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:32:11.756760 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 21 21:32:11.756760 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:11.756760 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:11.756760 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:11.756760 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:11.756760 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:11.756760 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:11.756760 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:32:11.756760 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:32:11.756760 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 21 21:32:11.756760 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:11.756760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8d90fa16-f1b2-45cc-b8c9-b51d5b21c85a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:32:11.756760 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8d90fa16-f1b2-45cc-b8c9-b51d5b21c85a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.008686 May 21 21:32:11.756760 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2417/4951] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:32:11 2022] POST /compute/v2.1/servers => generated 108 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 21 21:32:11.763174 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f2ca7db2-bf76-440d-9d63-28052f31ada0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:11.763647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f2ca7db2-bf76-440d-9d63-28052f31ada0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:11.768653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:11.776024 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4e4e0057-b6a9-4741-8e65-f66772d943a8 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:11.776779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2ca7db2-bf76-440d-9d63-28052f31ada0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:11.777647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2ca7db2-bf76-440d-9d63-28052f31ada0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:11.778544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2ca7db2-bf76-440d-9d63-28052f31ada0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:11.779661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2ca7db2-bf76-440d-9d63-28052f31ada0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:11.786180 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4e4e0057-b6a9-4741-8e65-f66772d943a8 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1707 microversion: 2.1 time: 0.689020 May 21 21:32:11.798547 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2535/4952] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:11 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1707 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:11.850520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-606601d0-cf96-4357-b711-a18265b8176a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:11.851949 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-606601d0-cf96-4357-b711-a18265b8176a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:11.869090 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-606601d0-cf96-4357-b711-a18265b8176a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:11.870232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-606601d0-cf96-4357-b711-a18265b8176a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:11.871226 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-606601d0-cf96-4357-b711-a18265b8176a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:11.872016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-606601d0-cf96-4357-b711-a18265b8176a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:11.993241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-606601d0-cf96-4357-b711-a18265b8176a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:12.004075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-606601d0-cf96-4357-b711-a18265b8176a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:12.005898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-606601d0-cf96-4357-b711-a18265b8176a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:12.007837 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-606601d0-cf96-4357-b711-a18265b8176a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1351 microversion: 2.20 time: 0.166382 May 21 21:32:12.008473 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2536/4953] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:32:11 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1351 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:32:12.027054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f2ca7db2-bf76-440d-9d63-28052f31ada0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:12.034780 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f2ca7db2-bf76-440d-9d63-28052f31ada0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.276883 May 21 21:32:12.035692 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2418/4954] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:11 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:12.057457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4bde8e29-c2a5-48a7-896a-6cb431dcd0e2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:12.058092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4bde8e29-c2a5-48a7-896a-6cb431dcd0e2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:12.065972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4bde8e29-c2a5-48a7-896a-6cb431dcd0e2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:12.066718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4bde8e29-c2a5-48a7-896a-6cb431dcd0e2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:12.067745 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4bde8e29-c2a5-48a7-896a-6cb431dcd0e2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:12.068475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4bde8e29-c2a5-48a7-896a-6cb431dcd0e2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:12.413993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4bde8e29-c2a5-48a7-896a-6cb431dcd0e2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:12.425332 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4bde8e29-c2a5-48a7-896a-6cb431dcd0e2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.373206 May 21 21:32:12.426372 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2537/4955] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:12 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:12.444474 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eeb6a768-50b3-40a6-aa70-37826814292f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:12.445037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-eeb6a768-50b3-40a6-aa70-37826814292f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 65e1f9e5-1f20-48b9-bb65-d1320c9e8ba6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:12.455103 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-eeb6a768-50b3-40a6-aa70-37826814292f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance 65e1f9e5-1f20-48b9-bb65-d1320c9e8ba6 could not be found. May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eeb6a768-50b3-40a6-aa70-37826814292f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/65e1f9e5-1f20-48b9-bb65-d1320c9e8ba6/action HTTP/1.1 May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 14 May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: {"shelve": {}} May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 65e1f9e5-1f20-48b9-bb65-d1320c9e8ba6 could not be found. May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '65e1f9e5-1f20-48b9-bb65-d1320c9e8ba6', 'body': {'shelve': {}}} May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65e1f9e5-1f20-48b9-bb65-d1320c9e8ba6 could not be found. May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65e1f9e5-1f20-48b9-bb65-d1320c9e8ba6 could not be found. May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:12.458012 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:12.463776 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:32:12.463776 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:32:12.463776 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65e1f9e5-1f20-48b9-bb65-d1320c9e8ba6 could not be found. May 21 21:32:12.463776 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:32:12.463776 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eeb6a768-50b3-40a6-aa70-37826814292f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance 65e1f9e5-1f20-48b9-bb65-d1320c9e8ba6 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:32:12.463776 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-eeb6a768-50b3-40a6-aa70-37826814292f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/65e1f9e5-1f20-48b9-bb65-d1320c9e8ba6/action" status: 404 len: 111 microversion: 2.1 time: 0.021664 May 21 21:32:12.469886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0247375e-d3c6-469f-bf54-4ba45c725623 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:12.470524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0247375e-d3c6-469f-bf54-4ba45c725623 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:12.475930 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2419/4956] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:32:12 2022] POST /compute/v2.1/servers/65e1f9e5-1f20-48b9-bb65-d1320c9e8ba6/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:32:12.489135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0247375e-d3c6-469f-bf54-4ba45c725623 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:12.489135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0247375e-d3c6-469f-bf54-4ba45c725623 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:12.489135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0247375e-d3c6-469f-bf54-4ba45c725623 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:12.489135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0247375e-d3c6-469f-bf54-4ba45c725623 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:12.805724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5c372142-cdd4-4832-8b8a-09fa0e9f85e9 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:12.806416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5c372142-cdd4-4832-8b8a-09fa0e9f85e9 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:12.829792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c372142-cdd4-4832-8b8a-09fa0e9f85e9 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:12.829792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c372142-cdd4-4832-8b8a-09fa0e9f85e9 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:12.829792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c372142-cdd4-4832-8b8a-09fa0e9f85e9 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:12.829792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c372142-cdd4-4832-8b8a-09fa0e9f85e9 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:12.930539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0247375e-d3c6-469f-bf54-4ba45c725623 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:12.942424 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0247375e-d3c6-469f-bf54-4ba45c725623 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.476552 May 21 21:32:12.948685 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2538/4957] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:12 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:12.968818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3a01a34d-85fa-4cd9-be04-a700ced8dc5b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:12.969688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3a01a34d-85fa-4cd9-be04-a700ced8dc5b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:12.977655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a01a34d-85fa-4cd9-be04-a700ced8dc5b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:12.979325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a01a34d-85fa-4cd9-be04-a700ced8dc5b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:12.980411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a01a34d-85fa-4cd9-be04-a700ced8dc5b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:12.981089 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a01a34d-85fa-4cd9-be04-a700ced8dc5b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:13.067031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5c372142-cdd4-4832-8b8a-09fa0e9f85e9 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:13.082589 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5c372142-cdd4-4832-8b8a-09fa0e9f85e9 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1707 microversion: 2.1 time: 0.280672 May 21 21:32:13.083985 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2420/4958] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:12 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1707 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:13.091515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8766aa50-776d-4d23-a8b7-68baf2feb9e9 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:13.092638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8766aa50-776d-4d23-a8b7-68baf2feb9e9 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:13.111409 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8766aa50-776d-4d23-a8b7-68baf2feb9e9 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:13.112447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8766aa50-776d-4d23-a8b7-68baf2feb9e9 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:13.113278 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8766aa50-776d-4d23-a8b7-68baf2feb9e9 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:13.113736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8766aa50-776d-4d23-a8b7-68baf2feb9e9 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:13.505239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8766aa50-776d-4d23-a8b7-68baf2feb9e9 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:13.510040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3a01a34d-85fa-4cd9-be04-a700ced8dc5b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:13.519825 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3a01a34d-85fa-4cd9-be04-a700ced8dc5b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.556696 May 21 21:32:13.531201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8766aa50-776d-4d23-a8b7-68baf2feb9e9 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:13.531201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8766aa50-776d-4d23-a8b7-68baf2feb9e9 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:13.531796 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2539/4959] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:12 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:13.531881 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8766aa50-776d-4d23-a8b7-68baf2feb9e9 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1407 microversion: 2.20 time: 0.438992 May 21 21:32:13.531881 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2421/4960] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:32:13 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1407 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:32:13.536780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-275648a6-57b2-434f-ae14-e4a521da7693 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:13.539588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-275648a6-57b2-434f-ae14-e4a521da7693 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:13.545532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-275648a6-57b2-434f-ae14-e4a521da7693 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:13.546426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-275648a6-57b2-434f-ae14-e4a521da7693 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:13.547459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-275648a6-57b2-434f-ae14-e4a521da7693 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:13.548137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-275648a6-57b2-434f-ae14-e4a521da7693 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:13.578197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-275648a6-57b2-434f-ae14-e4a521da7693 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lazy-loading 'flavor' on Instance uuid af7de5bb-0233-4e88-a1a0-8561385e53cd {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:32:13.724245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:14.102878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-15e12ffd-a627-4e2f-95df-87262758f6b6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:14.108698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-15e12ffd-a627-4e2f-95df-87262758f6b6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:14.129241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-15e12ffd-a627-4e2f-95df-87262758f6b6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:14.129931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-15e12ffd-a627-4e2f-95df-87262758f6b6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:14.132831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-15e12ffd-a627-4e2f-95df-87262758f6b6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:14.137055 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-15e12ffd-a627-4e2f-95df-87262758f6b6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:14.283742 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-275648a6-57b2-434f-ae14-e4a521da7693 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action" status: 202 len: 0 microversion: 2.1 time: 0.749458 May 21 21:32:14.285683 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2540/4961] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:32:13 2022] POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action => generated 0 bytes in 754 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:32:14.295560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ab8bca64-8e81-481a-9f2c-aaa944983906 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:14.296658 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ab8bca64-8e81-481a-9f2c-aaa944983906 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:14.304323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab8bca64-8e81-481a-9f2c-aaa944983906 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:14.305090 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab8bca64-8e81-481a-9f2c-aaa944983906 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:14.306118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab8bca64-8e81-481a-9f2c-aaa944983906 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:14.306985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ab8bca64-8e81-481a-9f2c-aaa944983906 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:14.468889 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ab8bca64-8e81-481a-9f2c-aaa944983906 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:14.480590 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ab8bca64-8e81-481a-9f2c-aaa944983906 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1513 microversion: 2.1 time: 0.190276 May 21 21:32:14.493425 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2541/4962] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:14 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1513 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:14.535855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-15e12ffd-a627-4e2f-95df-87262758f6b6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:14.544175 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6fa12a5f-24fe-4890-91f9-10211d0ed3a1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:14.544833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6fa12a5f-24fe-4890-91f9-10211d0ed3a1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:14.551373 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6fa12a5f-24fe-4890-91f9-10211d0ed3a1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:14.551844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6fa12a5f-24fe-4890-91f9-10211d0ed3a1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:14.552665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6fa12a5f-24fe-4890-91f9-10211d0ed3a1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:14.553441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6fa12a5f-24fe-4890-91f9-10211d0ed3a1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:14.556470 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-15e12ffd-a627-4e2f-95df-87262758f6b6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1711 microversion: 2.1 time: 0.457916 May 21 21:32:14.557262 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2422/4963] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:14 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1711 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:14.781070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-2bb69871-3423-4302-89ef-42ec17c88627 req-cb310665-9bb2-4074-b98e-a277c0d34840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc27a082-c144-436f-bd21-e8126e00db6c", "tag": "b4925385-7716-4fd9-99c7-de6cabe49d7f"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:14.791679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2bb69871-3423-4302-89ef-42ec17c88627 req-cb310665-9bb2-4074-b98e-a277c0d34840 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:14.792623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2bb69871-3423-4302-89ef-42ec17c88627 req-cb310665-9bb2-4074-b98e-a277c0d34840 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:14.813738 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-2bb69871-3423-4302-89ef-42ec17c88627 req-cb310665-9bb2-4074-b98e-a277c0d34840 service nova] Creating event network-changed:b4925385-7716-4fd9-99c7-de6cabe49d7f for instance cc27a082-c144-436f-bd21-e8126e00db6c on nch2-master-1 May 21 21:32:14.821563 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-2bb69871-3423-4302-89ef-42ec17c88627 req-cb310665-9bb2-4074-b98e-a277c0d34840 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047542 May 21 21:32:14.823087 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2423/4964] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:32:14.835282 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6fa12a5f-24fe-4890-91f9-10211d0ed3a1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:14.844321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6fa12a5f-24fe-4890-91f9-10211d0ed3a1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:14.846128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6fa12a5f-24fe-4890-91f9-10211d0ed3a1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:14.847486 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6fa12a5f-24fe-4890-91f9-10211d0ed3a1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1407 microversion: 2.20 time: 0.307981 May 21 21:32:14.848242 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2542/4965] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:32:14 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:32:15.501300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-78235cb1-e593-4cff-97e3-fef597ff8ab1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:15.502578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-78235cb1-e593-4cff-97e3-fef597ff8ab1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:15.510213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78235cb1-e593-4cff-97e3-fef597ff8ab1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:15.510910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78235cb1-e593-4cff-97e3-fef597ff8ab1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:15.511740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78235cb1-e593-4cff-97e3-fef597ff8ab1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:15.512176 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78235cb1-e593-4cff-97e3-fef597ff8ab1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:15.762573 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-78235cb1-e593-4cff-97e3-fef597ff8ab1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:15.776603 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-78235cb1-e593-4cff-97e3-fef597ff8ab1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1513 microversion: 2.1 time: 0.279396 May 21 21:32:15.777978 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2424/4966] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:15 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1513 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:15.868196 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7adc36b5-85cd-45a3-b287-60f9f1bf3105 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:15.869676 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7adc36b5-85cd-45a3-b287-60f9f1bf3105 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:15.878726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7adc36b5-85cd-45a3-b287-60f9f1bf3105 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:15.879032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7adc36b5-85cd-45a3-b287-60f9f1bf3105 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:15.879827 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7adc36b5-85cd-45a3-b287-60f9f1bf3105 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:15.880315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7adc36b5-85cd-45a3-b287-60f9f1bf3105 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:16.178007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7adc36b5-85cd-45a3-b287-60f9f1bf3105 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:16.186611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7adc36b5-85cd-45a3-b287-60f9f1bf3105 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:16.188124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7adc36b5-85cd-45a3-b287-60f9f1bf3105 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:16.189301 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7adc36b5-85cd-45a3-b287-60f9f1bf3105 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1407 microversion: 2.20 time: 0.325953 May 21 21:32:16.189865 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2543/4967] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:32:15 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1407 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:32:16.797639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-69783b41-d54a-4ba3-9d5b-95f7a6ea268c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:16.798209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-69783b41-d54a-4ba3-9d5b-95f7a6ea268c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:16.804829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69783b41-d54a-4ba3-9d5b-95f7a6ea268c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:16.805281 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69783b41-d54a-4ba3-9d5b-95f7a6ea268c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:16.806382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69783b41-d54a-4ba3-9d5b-95f7a6ea268c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:16.807068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69783b41-d54a-4ba3-9d5b-95f7a6ea268c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:16.986759 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-69783b41-d54a-4ba3-9d5b-95f7a6ea268c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:16.995390 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-69783b41-d54a-4ba3-9d5b-95f7a6ea268c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1513 microversion: 2.1 time: 0.204724 May 21 21:32:16.996035 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2425/4968] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:16 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1513 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:17.210431 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6fb9a954-ae94-43ed-9dae-8229d6ec458a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:17.211225 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6fb9a954-ae94-43ed-9dae-8229d6ec458a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:17.221263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6fb9a954-ae94-43ed-9dae-8229d6ec458a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:17.221718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6fb9a954-ae94-43ed-9dae-8229d6ec458a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:17.222744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6fb9a954-ae94-43ed-9dae-8229d6ec458a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:17.223191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6fb9a954-ae94-43ed-9dae-8229d6ec458a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:17.466058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6fb9a954-ae94-43ed-9dae-8229d6ec458a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:17.489176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6fb9a954-ae94-43ed-9dae-8229d6ec458a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:17.491114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6fb9a954-ae94-43ed-9dae-8229d6ec458a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:17.492576 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6fb9a954-ae94-43ed-9dae-8229d6ec458a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1407 microversion: 2.20 time: 0.289227 May 21 21:32:17.493326 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2544/4969] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:32:17 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1407 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:32:18.013501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-44bc5a04-5065-41a7-b257-9ce38a196fb0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:18.014224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-44bc5a04-5065-41a7-b257-9ce38a196fb0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:18.021607 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44bc5a04-5065-41a7-b257-9ce38a196fb0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:18.022069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44bc5a04-5065-41a7-b257-9ce38a196fb0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:18.022849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44bc5a04-5065-41a7-b257-9ce38a196fb0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:18.023291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44bc5a04-5065-41a7-b257-9ce38a196fb0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:18.175730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-44bc5a04-5065-41a7-b257-9ce38a196fb0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:18.187243 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-44bc5a04-5065-41a7-b257-9ce38a196fb0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1513 microversion: 2.1 time: 0.178244 May 21 21:32:18.187877 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2426/4970] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:18 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:18.513202 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0908ebb1-3996-4c09-8712-f5c81f38c681 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:18.514001 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0908ebb1-3996-4c09-8712-f5c81f38c681 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:18.515810 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:18.521813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0908ebb1-3996-4c09-8712-f5c81f38c681 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:18.522316 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0908ebb1-3996-4c09-8712-f5c81f38c681 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:18.523097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0908ebb1-3996-4c09-8712-f5c81f38c681 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:18.523808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0908ebb1-3996-4c09-8712-f5c81f38c681 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:18.738821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0908ebb1-3996-4c09-8712-f5c81f38c681 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:18.747773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0908ebb1-3996-4c09-8712-f5c81f38c681 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:18.749501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0908ebb1-3996-4c09-8712-f5c81f38c681 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:18.750816 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0908ebb1-3996-4c09-8712-f5c81f38c681 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1407 microversion: 2.20 time: 0.242469 May 21 21:32:18.751905 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2545/4971] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:32:18 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:32:19.209473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cbb4ccc6-679b-497b-b936-098ea63cd4d9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:19.216165 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cbb4ccc6-679b-497b-b936-098ea63cd4d9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:19.226323 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbb4ccc6-679b-497b-b936-098ea63cd4d9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:19.227000 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbb4ccc6-679b-497b-b936-098ea63cd4d9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:19.228326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbb4ccc6-679b-497b-b936-098ea63cd4d9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:19.228953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbb4ccc6-679b-497b-b936-098ea63cd4d9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:19.418092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cbb4ccc6-679b-497b-b936-098ea63cd4d9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:19.429941 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cbb4ccc6-679b-497b-b936-098ea63cd4d9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1513 microversion: 2.1 time: 0.228559 May 21 21:32:19.431580 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2427/4972] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:19 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:19.770973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7402ce13-9a15-4095-b4a8-0c456a9b81dd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:19.772439 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7402ce13-9a15-4095-b4a8-0c456a9b81dd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:19.785212 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=10 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:19.787473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7402ce13-9a15-4095-b4a8-0c456a9b81dd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:19.788141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7402ce13-9a15-4095-b4a8-0c456a9b81dd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:19.789131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7402ce13-9a15-4095-b4a8-0c456a9b81dd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:19.789572 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7402ce13-9a15-4095-b4a8-0c456a9b81dd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:20.047465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7402ce13-9a15-4095-b4a8-0c456a9b81dd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:20.057378 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7402ce13-9a15-4095-b4a8-0c456a9b81dd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:20.063243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7402ce13-9a15-4095-b4a8-0c456a9b81dd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:20.064477 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7402ce13-9a15-4095-b4a8-0c456a9b81dd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1407 microversion: 2.20 time: 0.297827 May 21 21:32:20.070276 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2546/4973] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:32:19 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:32:20.449521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-95cffbcd-c67d-44d4-b325-71a53ee2d163 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:20.450149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-95cffbcd-c67d-44d4-b325-71a53ee2d163 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:20.460455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95cffbcd-c67d-44d4-b325-71a53ee2d163 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:20.461211 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95cffbcd-c67d-44d4-b325-71a53ee2d163 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:20.462731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95cffbcd-c67d-44d4-b325-71a53ee2d163 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:20.463203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95cffbcd-c67d-44d4-b325-71a53ee2d163 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:21.060910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-95cffbcd-c67d-44d4-b325-71a53ee2d163 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:21.060910 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-95cffbcd-c67d-44d4-b325-71a53ee2d163 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1513 microversion: 2.1 time: 0.487575 May 21 21:32:21.060910 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2428/4974] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:20 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1513 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:21.084484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7175f41d-80c7-471d-b111-f1f6f692e213 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:21.087914 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7175f41d-80c7-471d-b111-f1f6f692e213 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:21.092523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7175f41d-80c7-471d-b111-f1f6f692e213 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:21.093020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7175f41d-80c7-471d-b111-f1f6f692e213 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:21.093757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7175f41d-80c7-471d-b111-f1f6f692e213 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:21.094355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7175f41d-80c7-471d-b111-f1f6f692e213 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:21.257344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7175f41d-80c7-471d-b111-f1f6f692e213 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:21.267662 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7175f41d-80c7-471d-b111-f1f6f692e213 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:21.269504 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7175f41d-80c7-471d-b111-f1f6f692e213 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:21.270847 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7175f41d-80c7-471d-b111-f1f6f692e213 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1407 microversion: 2.20 time: 0.191665 May 21 21:32:21.272368 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2547/4975] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:32:21 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:32:21.476526 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-f9147db7-88f2-4954-ba6c-6b1cd74524d1 req-af603716-f9d1-4e40-b328-b1be7d7f6045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc27a082-c144-436f-bd21-e8126e00db6c", "name": "network-vif-plugged", "status": "completed", "tag": "b4925385-7716-4fd9-99c7-de6cabe49d7f"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:21.487786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f9147db7-88f2-4954-ba6c-6b1cd74524d1 req-af603716-f9d1-4e40-b328-b1be7d7f6045 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:21.488242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f9147db7-88f2-4954-ba6c-6b1cd74524d1 req-af603716-f9d1-4e40-b328-b1be7d7f6045 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:21.500201 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-f9147db7-88f2-4954-ba6c-6b1cd74524d1 req-af603716-f9d1-4e40-b328-b1be7d7f6045 service nova] Creating event network-vif-plugged:b4925385-7716-4fd9-99c7-de6cabe49d7f for instance cc27a082-c144-436f-bd21-e8126e00db6c on nch2-master-1 May 21 21:32:21.505448 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-f9147db7-88f2-4954-ba6c-6b1cd74524d1 req-af603716-f9d1-4e40-b328-b1be7d7f6045 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032828 May 21 21:32:21.511383 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2429/4976] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:32:21.951049 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0d7c70dd-2fb3-4778-9d8c-2cd9a2b882ed tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:21.951672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0d7c70dd-2fb3-4778-9d8c-2cd9a2b882ed tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:21.959537 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d7c70dd-2fb3-4778-9d8c-2cd9a2b882ed tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:21.959537 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d7c70dd-2fb3-4778-9d8c-2cd9a2b882ed tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:21.959775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d7c70dd-2fb3-4778-9d8c-2cd9a2b882ed tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:21.960215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d7c70dd-2fb3-4778-9d8c-2cd9a2b882ed tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:22.166176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0d7c70dd-2fb3-4778-9d8c-2cd9a2b882ed tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:22.166176 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0d7c70dd-2fb3-4778-9d8c-2cd9a2b882ed tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1513 microversion: 2.1 time: 0.215271 May 21 21:32:22.166176 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2548/4977] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:21 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:22.292370 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bd720db1-60ef-47a3-9403-bfa4eb108781 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:22.292972 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bd720db1-60ef-47a3-9403-bfa4eb108781 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:22.299628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bd720db1-60ef-47a3-9403-bfa4eb108781 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:22.300077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bd720db1-60ef-47a3-9403-bfa4eb108781 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:22.300926 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bd720db1-60ef-47a3-9403-bfa4eb108781 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:22.301404 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bd720db1-60ef-47a3-9403-bfa4eb108781 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:22.579070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bd720db1-60ef-47a3-9403-bfa4eb108781 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:22.590809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bd720db1-60ef-47a3-9403-bfa4eb108781 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:22.592726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bd720db1-60ef-47a3-9403-bfa4eb108781 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:22.594021 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bd720db1-60ef-47a3-9403-bfa4eb108781 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1407 microversion: 2.20 time: 0.307164 May 21 21:32:22.594667 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2430/4978] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:32:22 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:32:23.183428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a23cd4fc-7577-4958-855c-fcb8b57e1410 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:23.184141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a23cd4fc-7577-4958-855c-fcb8b57e1410 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:23.198878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a23cd4fc-7577-4958-855c-fcb8b57e1410 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:23.199251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a23cd4fc-7577-4958-855c-fcb8b57e1410 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:23.200248 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a23cd4fc-7577-4958-855c-fcb8b57e1410 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:23.200884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a23cd4fc-7577-4958-855c-fcb8b57e1410 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:23.432511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a23cd4fc-7577-4958-855c-fcb8b57e1410 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:23.434697 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a23cd4fc-7577-4958-855c-fcb8b57e1410 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1513 microversion: 2.1 time: 0.256473 May 21 21:32:23.435294 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2549/4979] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:23 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1513 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:23.613600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b60fdd4b-4bf7-4da8-b4fa-71fe34dc5814 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:23.614399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b60fdd4b-4bf7-4da8-b4fa-71fe34dc5814 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:23.622595 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b60fdd4b-4bf7-4da8-b4fa-71fe34dc5814 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:23.623074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b60fdd4b-4bf7-4da8-b4fa-71fe34dc5814 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:23.623873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b60fdd4b-4bf7-4da8-b4fa-71fe34dc5814 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:23.624336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b60fdd4b-4bf7-4da8-b4fa-71fe34dc5814 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:24.009766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b60fdd4b-4bf7-4da8-b4fa-71fe34dc5814 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:24.018333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b60fdd4b-4bf7-4da8-b4fa-71fe34dc5814 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:24.019852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b60fdd4b-4bf7-4da8-b4fa-71fe34dc5814 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:24.021463 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b60fdd4b-4bf7-4da8-b4fa-71fe34dc5814 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1599 microversion: 2.20 time: 0.412621 May 21 21:32:24.026639 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2431/4980] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:32:23 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1599 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:32:24.040340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c391b5f6-52fb-4a3d-b7be-e94ab2e7f7e7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:24.041032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c391b5f6-52fb-4a3d-b7be-e94ab2e7f7e7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:24.047390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c391b5f6-52fb-4a3d-b7be-e94ab2e7f7e7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:24.052813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c391b5f6-52fb-4a3d-b7be-e94ab2e7f7e7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:24.052813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c391b5f6-52fb-4a3d-b7be-e94ab2e7f7e7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:24.052813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c391b5f6-52fb-4a3d-b7be-e94ab2e7f7e7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:24.138689 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c391b5f6-52fb-4a3d-b7be-e94ab2e7f7e7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.102469 May 21 21:32:24.139319 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2550/4981] 10.222.0.49 () {60 vars in 1315 bytes} [Sat May 21 21:32:24 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:32:24.453092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b3d10881-a2f7-4279-a8ed-61255304da19 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:24.453630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b3d10881-a2f7-4279-a8ed-61255304da19 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:24.460424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3d10881-a2f7-4279-a8ed-61255304da19 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:24.461198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3d10881-a2f7-4279-a8ed-61255304da19 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:24.462228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3d10881-a2f7-4279-a8ed-61255304da19 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:24.462856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3d10881-a2f7-4279-a8ed-61255304da19 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:24.631364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b3d10881-a2f7-4279-a8ed-61255304da19 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:24.640358 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b3d10881-a2f7-4279-a8ed-61255304da19 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1513 microversion: 2.1 time: 0.191124 May 21 21:32:24.641137 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2432/4982] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:24 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1513 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:25.658705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6336dec5-918b-47b4-9847-67afafdedd32 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:25.659492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6336dec5-918b-47b4-9847-67afafdedd32 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:25.667920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6336dec5-918b-47b4-9847-67afafdedd32 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:25.668443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6336dec5-918b-47b4-9847-67afafdedd32 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:25.669241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6336dec5-918b-47b4-9847-67afafdedd32 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:25.669894 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6336dec5-918b-47b4-9847-67afafdedd32 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:25.910237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-f9cd506b-a5ad-4850-8f50-7fa6a165c5d6 req-4a2268db-6796-4869-9e8e-e4f49d435643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc27a082-c144-436f-bd21-e8126e00db6c", "tag": "b4925385-7716-4fd9-99c7-de6cabe49d7f"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:25.914605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6336dec5-918b-47b4-9847-67afafdedd32 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:25.915845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f9cd506b-a5ad-4850-8f50-7fa6a165c5d6 req-4a2268db-6796-4869-9e8e-e4f49d435643 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:25.916320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f9cd506b-a5ad-4850-8f50-7fa6a165c5d6 req-4a2268db-6796-4869-9e8e-e4f49d435643 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:25.924890 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6336dec5-918b-47b4-9847-67afafdedd32 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1513 microversion: 2.1 time: 0.270952 May 21 21:32:25.926071 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2551/4983] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:25 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1513 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:25.937534 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-f9cd506b-a5ad-4850-8f50-7fa6a165c5d6 req-4a2268db-6796-4869-9e8e-e4f49d435643 service nova] Creating event network-changed:b4925385-7716-4fd9-99c7-de6cabe49d7f for instance cc27a082-c144-436f-bd21-e8126e00db6c on nch2-master-1 May 21 21:32:25.946393 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-f9cd506b-a5ad-4850-8f50-7fa6a165c5d6 req-4a2268db-6796-4869-9e8e-e4f49d435643 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051284 May 21 21:32:25.947963 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2433/4984] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:32:26.942893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5be40f1c-d95e-4d16-a8ad-faf3db088cdd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:26.944367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5be40f1c-d95e-4d16-a8ad-faf3db088cdd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:26.960095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5be40f1c-d95e-4d16-a8ad-faf3db088cdd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:26.960832 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5be40f1c-d95e-4d16-a8ad-faf3db088cdd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:26.962105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5be40f1c-d95e-4d16-a8ad-faf3db088cdd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:26.962651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5be40f1c-d95e-4d16-a8ad-faf3db088cdd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:27.158811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5be40f1c-d95e-4d16-a8ad-faf3db088cdd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:27.168508 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5be40f1c-d95e-4d16-a8ad-faf3db088cdd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1513 microversion: 2.1 time: 0.229903 May 21 21:32:27.169301 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2552/4985] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:26 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:28.187882 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5c9925d9-7dfd-4e2f-87b0-485a4a4a9ba0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:28.188733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5c9925d9-7dfd-4e2f-87b0-485a4a4a9ba0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:28.196906 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c9925d9-7dfd-4e2f-87b0-485a4a4a9ba0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:28.197592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c9925d9-7dfd-4e2f-87b0-485a4a4a9ba0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:28.198480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c9925d9-7dfd-4e2f-87b0-485a4a4a9ba0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:28.198960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c9925d9-7dfd-4e2f-87b0-485a4a4a9ba0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:28.350374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5c9925d9-7dfd-4e2f-87b0-485a4a4a9ba0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:28.358709 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5c9925d9-7dfd-4e2f-87b0-485a4a4a9ba0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1513 microversion: 2.1 time: 0.176170 May 21 21:32:28.359541 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2434/4986] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:28 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:29.378056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c089a826-ee9f-4510-928b-0b3576f6add2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:29.379276 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c089a826-ee9f-4510-928b-0b3576f6add2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:29.386274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c089a826-ee9f-4510-928b-0b3576f6add2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:29.386732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c089a826-ee9f-4510-928b-0b3576f6add2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:29.387522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c089a826-ee9f-4510-928b-0b3576f6add2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:29.388004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c089a826-ee9f-4510-928b-0b3576f6add2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:29.542517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c089a826-ee9f-4510-928b-0b3576f6add2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:29.551714 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c089a826-ee9f-4510-928b-0b3576f6add2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1513 microversion: 2.1 time: 0.177132 May 21 21:32:29.551714 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2553/4987] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:29 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:30.325647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b60ba2a7-5094-4b5f-90f2-4e0de1cec76c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0b1920b-8151-4e90-ac66-f993da5e7e8e"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:30.326973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b60ba2a7-5094-4b5f-90f2-4e0de1cec76c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:30.334274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b60ba2a7-5094-4b5f-90f2-4e0de1cec76c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:30.334736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b60ba2a7-5094-4b5f-90f2-4e0de1cec76c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:30.335515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b60ba2a7-5094-4b5f-90f2-4e0de1cec76c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:30.335955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b60ba2a7-5094-4b5f-90f2-4e0de1cec76c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:30.569417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-254e4d63-efe2-454c-9f20-107d5999d41b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:30.570800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-254e4d63-efe2-454c-9f20-107d5999d41b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:30.577956 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-254e4d63-efe2-454c-9f20-107d5999d41b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:30.578414 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-254e4d63-efe2-454c-9f20-107d5999d41b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:30.579198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-254e4d63-efe2-454c-9f20-107d5999d41b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:30.579815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-254e4d63-efe2-454c-9f20-107d5999d41b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:30.837650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-254e4d63-efe2-454c-9f20-107d5999d41b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:30.846184 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-254e4d63-efe2-454c-9f20-107d5999d41b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1534 microversion: 2.1 time: 0.282165 May 21 21:32:30.846882 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2554/4988] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:30 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1534 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:31.223324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:31.324704 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b60ba2a7-5094-4b5f-90f2-4e0de1cec76c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "POST /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.003041 May 21 21:32:31.346553 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2435/4989] 10.222.0.49 () {60 vars in 1322 bytes} [Sat May 21 21:32:30 2022] POST /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae/os-volume_attachments => generated 194 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:32:31.865876 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b8aab230-5130-47d8-b57b-e9bde7fa18d1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:31.866629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b8aab230-5130-47d8-b57b-e9bde7fa18d1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:31.890014 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8aab230-5130-47d8-b57b-e9bde7fa18d1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:31.890014 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8aab230-5130-47d8-b57b-e9bde7fa18d1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:31.890014 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8aab230-5130-47d8-b57b-e9bde7fa18d1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:31.890014 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8aab230-5130-47d8-b57b-e9bde7fa18d1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:32.106663 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b8aab230-5130-47d8-b57b-e9bde7fa18d1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:32.117844 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b8aab230-5130-47d8-b57b-e9bde7fa18d1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1534 microversion: 2.1 time: 0.256140 May 21 21:32:32.129754 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2555/4990] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:31 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1534 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:33.138415 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5b3837a0-0161-4db7-b97f-86d52a0eae38 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:33.139041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5b3837a0-0161-4db7-b97f-86d52a0eae38 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:33.147045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5b3837a0-0161-4db7-b97f-86d52a0eae38 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:33.147448 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5b3837a0-0161-4db7-b97f-86d52a0eae38 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:33.148555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5b3837a0-0161-4db7-b97f-86d52a0eae38 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:33.159184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5b3837a0-0161-4db7-b97f-86d52a0eae38 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:33.421055 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5b3837a0-0161-4db7-b97f-86d52a0eae38 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:33.422075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-33cda426-9b56-4a52-9f4e-68bfe605b921 req-44a59603-78fa-4eea-825f-544253fb717f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7de5bb-0233-4e88-a1a0-8561385e53cd", "name": "network-vif-plugged", "status": "completed", "tag": "fc4ad2f3-98e9-42fc-81a3-7fc4fa986079"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:33.432040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:33.434604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-33cda426-9b56-4a52-9f4e-68bfe605b921 req-44a59603-78fa-4eea-825f-544253fb717f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:33.435263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-33cda426-9b56-4a52-9f4e-68bfe605b921 req-44a59603-78fa-4eea-825f-544253fb717f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:33.436263 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5b3837a0-0161-4db7-b97f-86d52a0eae38 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1529 microversion: 2.1 time: 0.303242 May 21 21:32:33.437377 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2436/4991] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:33 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1529 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:33.448305 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-33cda426-9b56-4a52-9f4e-68bfe605b921 req-44a59603-78fa-4eea-825f-544253fb717f service nova] Creating event network-vif-plugged:fc4ad2f3-98e9-42fc-81a3-7fc4fa986079 for instance af7de5bb-0233-4e88-a1a0-8561385e53cd on nch2-master-1 May 21 21:32:33.454143 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-33cda426-9b56-4a52-9f4e-68bfe605b921 req-44a59603-78fa-4eea-825f-544253fb717f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035297 May 21 21:32:33.455648 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2556/4992] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:32:34.455115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2dc6295d-238d-4344-a837-66ea314f8245 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:34.456659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2dc6295d-238d-4344-a837-66ea314f8245 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:34.466612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2dc6295d-238d-4344-a837-66ea314f8245 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:34.467456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2dc6295d-238d-4344-a837-66ea314f8245 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:34.468555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2dc6295d-238d-4344-a837-66ea314f8245 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:34.469282 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2dc6295d-238d-4344-a837-66ea314f8245 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:34.900820 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2dc6295d-238d-4344-a837-66ea314f8245 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:34.914183 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2dc6295d-238d-4344-a837-66ea314f8245 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1529 microversion: 2.1 time: 0.463060 May 21 21:32:34.925074 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2437/4993] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:34 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1529 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:35.864017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-113caab0-32a3-437c-a29a-349e2e4711c5 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:35.866753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-113caab0-32a3-437c-a29a-349e2e4711c5 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:35.877303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-113caab0-32a3-437c-a29a-349e2e4711c5 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:35.878803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-113caab0-32a3-437c-a29a-349e2e4711c5 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:35.879870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-113caab0-32a3-437c-a29a-349e2e4711c5 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:35.880607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-113caab0-32a3-437c-a29a-349e2e4711c5 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:35.917861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-113caab0-32a3-437c-a29a-349e2e4711c5 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lazy-loading 'flavor' on Instance uuid 54e8b13e-d6b2-467c-b801-2b0ad45e95ae {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:32:35.918612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:35.941108 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1a0a1af4-81e7-4a67-a003-12cb4a127403 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:35.942361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1a0a1af4-81e7-4a67-a003-12cb4a127403 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:35.958490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a0a1af4-81e7-4a67-a003-12cb4a127403 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:35.959354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a0a1af4-81e7-4a67-a003-12cb4a127403 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:35.961195 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a0a1af4-81e7-4a67-a003-12cb4a127403 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:35.963838 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a0a1af4-81e7-4a67-a003-12cb4a127403 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:36.341388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1a0a1af4-81e7-4a67-a003-12cb4a127403 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:36.352236 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1a0a1af4-81e7-4a67-a003-12cb4a127403 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1529 microversion: 2.1 time: 0.418447 May 21 21:32:36.354831 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2438/4994] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:35 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1529 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:36.483209 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-113caab0-32a3-437c-a29a-349e2e4711c5 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "POST /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae/action" status: 200 len: 32 microversion: 2.1 time: 0.620537 May 21 21:32:36.489838 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2557/4995] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:32:35 2022] POST /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae/action => generated 32 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:32:36.499907 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aeaba68f-5b8b-42b8-b026-49b8fd1435f0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:36.500746 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-aeaba68f-5b8b-42b8-b026-49b8fd1435f0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:36.519540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aeaba68f-5b8b-42b8-b026-49b8fd1435f0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:36.519540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aeaba68f-5b8b-42b8-b026-49b8fd1435f0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:36.519540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aeaba68f-5b8b-42b8-b026-49b8fd1435f0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:36.519540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aeaba68f-5b8b-42b8-b026-49b8fd1435f0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:37.054282 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-aeaba68f-5b8b-42b8-b026-49b8fd1435f0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:37.073425 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-aeaba68f-5b8b-42b8-b026-49b8fd1435f0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1734 microversion: 2.1 time: 0.577602 May 21 21:32:37.073425 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2439/4996] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:36 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1734 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:37.389607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1751f8bc-e574-40db-bec4-b55a78c93cf5 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:37.390459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1751f8bc-e574-40db-bec4-b55a78c93cf5 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:37.400733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1751f8bc-e574-40db-bec4-b55a78c93cf5 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:37.401730 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1751f8bc-e574-40db-bec4-b55a78c93cf5 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:37.402793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1751f8bc-e574-40db-bec4-b55a78c93cf5 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:37.403307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1751f8bc-e574-40db-bec4-b55a78c93cf5 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:37.607465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1751f8bc-e574-40db-bec4-b55a78c93cf5 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:37.625060 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1751f8bc-e574-40db-bec4-b55a78c93cf5 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1529 microversion: 2.1 time: 0.248810 May 21 21:32:37.625670 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2558/4997] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:37 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1529 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:38.090528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-83e3d819-6b3f-42c3-b3e8-ab54be045f1f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:38.091461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-83e3d819-6b3f-42c3-b3e8-ab54be045f1f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:38.100460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-83e3d819-6b3f-42c3-b3e8-ab54be045f1f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:38.101056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-83e3d819-6b3f-42c3-b3e8-ab54be045f1f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:38.102154 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-83e3d819-6b3f-42c3-b3e8-ab54be045f1f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:38.102771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-83e3d819-6b3f-42c3-b3e8-ab54be045f1f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:38.293183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-83e3d819-6b3f-42c3-b3e8-ab54be045f1f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:38.312265 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-83e3d819-6b3f-42c3-b3e8-ab54be045f1f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1734 microversion: 2.1 time: 0.226480 May 21 21:32:38.323403 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2440/4998] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:38 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1734 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:38.650438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1b75bebe-c3fe-43e0-ac49-4d873274635c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:38.653373 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1b75bebe-c3fe-43e0-ac49-4d873274635c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:38.667784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1b75bebe-c3fe-43e0-ac49-4d873274635c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:38.668836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1b75bebe-c3fe-43e0-ac49-4d873274635c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:38.670110 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1b75bebe-c3fe-43e0-ac49-4d873274635c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:38.670739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1b75bebe-c3fe-43e0-ac49-4d873274635c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:38.986690 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1b75bebe-c3fe-43e0-ac49-4d873274635c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:39.010245 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1b75bebe-c3fe-43e0-ac49-4d873274635c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1529 microversion: 2.1 time: 0.356632 May 21 21:32:39.010245 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2559/4999] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:38 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1529 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:39.331624 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-72b31f26-bffe-4b2a-b4a0-178c01db80b8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:39.332319 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-72b31f26-bffe-4b2a-b4a0-178c01db80b8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:39.347021 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72b31f26-bffe-4b2a-b4a0-178c01db80b8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:39.347643 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72b31f26-bffe-4b2a-b4a0-178c01db80b8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:39.348547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72b31f26-bffe-4b2a-b4a0-178c01db80b8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:39.355139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72b31f26-bffe-4b2a-b4a0-178c01db80b8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:39.538502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-72b31f26-bffe-4b2a-b4a0-178c01db80b8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:39.550359 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-72b31f26-bffe-4b2a-b4a0-178c01db80b8 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1734 microversion: 2.1 time: 0.222793 May 21 21:32:39.551219 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2441/5000] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:39 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1734 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:40.017757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fc0b875b-72b1-4308-ae99-fd5b0456bf50 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:40.018402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fc0b875b-72b1-4308-ae99-fd5b0456bf50 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:40.029952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc0b875b-72b1-4308-ae99-fd5b0456bf50 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:40.030713 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc0b875b-72b1-4308-ae99-fd5b0456bf50 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:40.031864 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc0b875b-72b1-4308-ae99-fd5b0456bf50 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:40.032333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc0b875b-72b1-4308-ae99-fd5b0456bf50 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:40.569197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6b60f6a1-c663-41ff-a6ac-f825d08bb7ce tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:40.570482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6b60f6a1-c663-41ff-a6ac-f825d08bb7ce tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:40.579708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b60f6a1-c663-41ff-a6ac-f825d08bb7ce tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:40.580541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b60f6a1-c663-41ff-a6ac-f825d08bb7ce tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:40.581758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b60f6a1-c663-41ff-a6ac-f825d08bb7ce tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:40.582374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b60f6a1-c663-41ff-a6ac-f825d08bb7ce tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:40.640643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fc0b875b-72b1-4308-ae99-fd5b0456bf50 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:40.651528 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fc0b875b-72b1-4308-ae99-fd5b0456bf50 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1529 microversion: 2.1 time: 0.637755 May 21 21:32:40.652178 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2560/5001] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:40 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1529 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:40.785345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6b60f6a1-c663-41ff-a6ac-f825d08bb7ce tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:40.797312 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6b60f6a1-c663-41ff-a6ac-f825d08bb7ce tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1734 microversion: 2.1 time: 0.234174 May 21 21:32:40.798113 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2442/5002] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:40 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1734 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:41.670711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ff911832-6d9a-4d48-8845-62fc8d67b717 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:41.671343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ff911832-6d9a-4d48-8845-62fc8d67b717 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:41.678418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff911832-6d9a-4d48-8845-62fc8d67b717 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:41.679160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff911832-6d9a-4d48-8845-62fc8d67b717 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:41.680709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff911832-6d9a-4d48-8845-62fc8d67b717 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:41.681527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff911832-6d9a-4d48-8845-62fc8d67b717 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:41.817633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f9326727-9922-45cc-a88e-77ab55fa1dab tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:41.823255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f9326727-9922-45cc-a88e-77ab55fa1dab tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:41.829665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f9326727-9922-45cc-a88e-77ab55fa1dab tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:41.830134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f9326727-9922-45cc-a88e-77ab55fa1dab tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:41.831004 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f9326727-9922-45cc-a88e-77ab55fa1dab tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:41.831454 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f9326727-9922-45cc-a88e-77ab55fa1dab tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:41.918750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ff911832-6d9a-4d48-8845-62fc8d67b717 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:41.928237 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ff911832-6d9a-4d48-8845-62fc8d67b717 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1529 microversion: 2.1 time: 0.261373 May 21 21:32:41.941531 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2561/5003] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:41 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1529 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:42.131843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f9326727-9922-45cc-a88e-77ab55fa1dab tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:42.144223 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f9326727-9922-45cc-a88e-77ab55fa1dab tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1734 microversion: 2.1 time: 0.331302 May 21 21:32:42.157257 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2443/5004] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:41 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1734 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:42.946181 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3e7c96cb-0c8e-4a87-b6d8-9e5b88884cb2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:42.947679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3e7c96cb-0c8e-4a87-b6d8-9e5b88884cb2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:42.955094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e7c96cb-0c8e-4a87-b6d8-9e5b88884cb2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:42.955556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e7c96cb-0c8e-4a87-b6d8-9e5b88884cb2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:42.956372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e7c96cb-0c8e-4a87-b6d8-9e5b88884cb2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:42.957172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e7c96cb-0c8e-4a87-b6d8-9e5b88884cb2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:43.162420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e72c27d0-7642-4a63-81e9-cd884dc1905e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:43.163191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e72c27d0-7642-4a63-81e9-cd884dc1905e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:43.176822 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=52 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:43.182101 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e72c27d0-7642-4a63-81e9-cd884dc1905e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:43.182824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e72c27d0-7642-4a63-81e9-cd884dc1905e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:43.184130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e72c27d0-7642-4a63-81e9-cd884dc1905e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:43.184766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e72c27d0-7642-4a63-81e9-cd884dc1905e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:43.266197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3e7c96cb-0c8e-4a87-b6d8-9e5b88884cb2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:43.283467 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3e7c96cb-0c8e-4a87-b6d8-9e5b88884cb2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1529 microversion: 2.1 time: 0.341300 May 21 21:32:43.297065 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2562/5005] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:42 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1529 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:43.591297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e72c27d0-7642-4a63-81e9-cd884dc1905e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:43.613580 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e72c27d0-7642-4a63-81e9-cd884dc1905e tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1734 microversion: 2.1 time: 0.455011 May 21 21:32:43.614904 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2444/5006] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:43 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1734 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:44.301889 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-28044cb1-96ed-4dcd-9862-cd7896f5cf7d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:44.303127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-28044cb1-96ed-4dcd-9862-cd7896f5cf7d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:44.319889 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-28044cb1-96ed-4dcd-9862-cd7896f5cf7d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:44.325516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-28044cb1-96ed-4dcd-9862-cd7896f5cf7d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:44.329984 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-28044cb1-96ed-4dcd-9862-cd7896f5cf7d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:44.330823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-28044cb1-96ed-4dcd-9862-cd7896f5cf7d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:44.631507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bac13cb5-e87d-43b4-af97-c3bae06fea22 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:44.633668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bac13cb5-e87d-43b4-af97-c3bae06fea22 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:44.655374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bac13cb5-e87d-43b4-af97-c3bae06fea22 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:44.656079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bac13cb5-e87d-43b4-af97-c3bae06fea22 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:44.659136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-28044cb1-96ed-4dcd-9862-cd7896f5cf7d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:44.659630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bac13cb5-e87d-43b4-af97-c3bae06fea22 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:44.660344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bac13cb5-e87d-43b4-af97-c3bae06fea22 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:44.675941 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-28044cb1-96ed-4dcd-9862-cd7896f5cf7d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1529 microversion: 2.1 time: 0.377890 May 21 21:32:44.688200 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2563/5007] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:44 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1529 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:44.923358 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bac13cb5-e87d-43b4-af97-c3bae06fea22 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:44.944921 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bac13cb5-e87d-43b4-af97-c3bae06fea22 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1734 microversion: 2.1 time: 0.317482 May 21 21:32:44.945670 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2445/5008] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:44 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1734 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:45.709317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-65d43b87-13c6-4e78-ab4d-2f992968d898 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:45.709951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-65d43b87-13c6-4e78-ab4d-2f992968d898 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:45.732144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65d43b87-13c6-4e78-ab4d-2f992968d898 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:45.733003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65d43b87-13c6-4e78-ab4d-2f992968d898 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:45.734022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65d43b87-13c6-4e78-ab4d-2f992968d898 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:45.736819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65d43b87-13c6-4e78-ab4d-2f992968d898 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:45.970702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f0a5ff6e-546e-41d1-acff-c06173946ae0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:45.971695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f0a5ff6e-546e-41d1-acff-c06173946ae0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:45.997850 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0a5ff6e-546e-41d1-acff-c06173946ae0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:45.998330 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0a5ff6e-546e-41d1-acff-c06173946ae0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:46.005094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-65d43b87-13c6-4e78-ab4d-2f992968d898 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:46.005636 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0a5ff6e-546e-41d1-acff-c06173946ae0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:46.008181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0a5ff6e-546e-41d1-acff-c06173946ae0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:46.017856 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-65d43b87-13c6-4e78-ab4d-2f992968d898 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1529 microversion: 2.1 time: 0.314640 May 21 21:32:46.018861 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2564/5009] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:45 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1529 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:46.260912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f0a5ff6e-546e-41d1-acff-c06173946ae0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:46.274729 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f0a5ff6e-546e-41d1-acff-c06173946ae0 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1734 microversion: 2.1 time: 0.306842 May 21 21:32:46.276748 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2446/5010] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:45 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1734 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:46.463865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-28aeb8ef-85d7-41ee-ad5c-45a1cf1db772 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:46.468008 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-28aeb8ef-85d7-41ee-ad5c-45a1cf1db772 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:46.471870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-28aeb8ef-85d7-41ee-ad5c-45a1cf1db772 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:46.472580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-28aeb8ef-85d7-41ee-ad5c-45a1cf1db772 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:46.473670 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-28aeb8ef-85d7-41ee-ad5c-45a1cf1db772 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:46.474122 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-28aeb8ef-85d7-41ee-ad5c-45a1cf1db772 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:46.579076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-28aeb8ef-85d7-41ee-ad5c-45a1cf1db772 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lazy-loading 'services' on Instance uuid 3f6f2738-3e60-4235-ab67-86ad32c2a384 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:32:46.850315 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-28aeb8ef-85d7-41ee-ad5c-45a1cf1db772 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384/os-volume_attachments/8d62796e-2b52-4323-9da6-17210b1a2dfc" status: 202 len: 0 microversion: 2.1 time: 0.390290 May 21 21:32:46.854812 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2565/5011] 10.222.0.49 () {58 vars in 1415 bytes} [Sat May 21 21:32:46 2022] DELETE /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384/os-volume_attachments/8d62796e-2b52-4323-9da6-17210b1a2dfc => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:32:47.037995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4867ec8e-ed27-4016-a5fd-a0beb555947f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:47.038633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4867ec8e-ed27-4016-a5fd-a0beb555947f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:47.046867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4867ec8e-ed27-4016-a5fd-a0beb555947f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:47.047360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4867ec8e-ed27-4016-a5fd-a0beb555947f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:47.048157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4867ec8e-ed27-4016-a5fd-a0beb555947f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:47.054589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4867ec8e-ed27-4016-a5fd-a0beb555947f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:47.221644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4867ec8e-ed27-4016-a5fd-a0beb555947f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:47.230711 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4867ec8e-ed27-4016-a5fd-a0beb555947f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1529 microversion: 2.1 time: 0.197295 May 21 21:32:47.231315 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2447/5012] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:47 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1529 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:47.293601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3988492f-bc40-4b5f-a188-261df450a6eb tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:47.294688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3988492f-bc40-4b5f-a188-261df450a6eb tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:47.301655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3988492f-bc40-4b5f-a188-261df450a6eb tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:47.304086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3988492f-bc40-4b5f-a188-261df450a6eb tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:47.304086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3988492f-bc40-4b5f-a188-261df450a6eb tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:47.304086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3988492f-bc40-4b5f-a188-261df450a6eb tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:47.467711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3988492f-bc40-4b5f-a188-261df450a6eb tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:47.481950 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3988492f-bc40-4b5f-a188-261df450a6eb tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1734 microversion: 2.1 time: 0.189200 May 21 21:32:47.481950 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2566/5013] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:47 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1734 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:47.990316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-39ce8584-c18c-4f5d-9b47-4675192b3522 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:48.000074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39ce8584-c18c-4f5d-9b47-4675192b3522 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:48.000640 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39ce8584-c18c-4f5d-9b47-4675192b3522 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:48.028413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-39ce8584-c18c-4f5d-9b47-4675192b3522 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Going to try to stop instance {{(pid=131278) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 21 21:32:48.233003 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-39ce8584-c18c-4f5d-9b47-4675192b3522 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "POST /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384/action" status: 202 len: 0 microversion: 2.1 time: 0.246527 May 21 21:32:48.237110 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2448/5014] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:32:47 2022] POST /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:32:48.249360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e34870cf-0735-40dd-a877-736f29b1491c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:48.250868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e34870cf-0735-40dd-a877-736f29b1491c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:48.251227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a7def3cd-06f0-4297-abe9-62e6e4fa136c tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:48.251872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a7def3cd-06f0-4297-abe9-62e6e4fa136c tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:48.261339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e34870cf-0735-40dd-a877-736f29b1491c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:48.262148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e34870cf-0735-40dd-a877-736f29b1491c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:48.263904 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e34870cf-0735-40dd-a877-736f29b1491c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:48.265444 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e34870cf-0735-40dd-a877-736f29b1491c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:48.269396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7def3cd-06f0-4297-abe9-62e6e4fa136c tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:48.269890 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7def3cd-06f0-4297-abe9-62e6e4fa136c tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:48.270830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7def3cd-06f0-4297-abe9-62e6e4fa136c tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:48.273608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7def3cd-06f0-4297-abe9-62e6e4fa136c tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:48.460083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a7def3cd-06f0-4297-abe9-62e6e4fa136c tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:48.472005 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a7def3cd-06f0-4297-abe9-62e6e4fa136c tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1675 microversion: 2.1 time: 0.231320 May 21 21:32:48.476339 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2567/5015] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:48 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1675 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:48.496528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0912066d-4f06-4d99-862f-fa79c541e386 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:48.497218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0912066d-4f06-4d99-862f-fa79c541e386 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:48.503931 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0912066d-4f06-4d99-862f-fa79c541e386 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:48.504413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0912066d-4f06-4d99-862f-fa79c541e386 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:48.505202 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0912066d-4f06-4d99-862f-fa79c541e386 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:48.505646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0912066d-4f06-4d99-862f-fa79c541e386 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:48.642911 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e34870cf-0735-40dd-a877-736f29b1491c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:48.654818 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e34870cf-0735-40dd-a877-736f29b1491c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1511 microversion: 2.1 time: 0.410428 May 21 21:32:48.655420 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2449/5016] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:48 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1511 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:48.736788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0912066d-4f06-4d99-862f-fa79c541e386 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:48.748867 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0912066d-4f06-4d99-862f-fa79c541e386 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1734 microversion: 2.1 time: 0.256902 May 21 21:32:48.749829 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2568/5017] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:48 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1734 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:49.491455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-60ced8b3-222d-4d78-b07f-c18ea92a84a3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:49.492014 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-60ced8b3-222d-4d78-b07f-c18ea92a84a3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:49.499525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-60ced8b3-222d-4d78-b07f-c18ea92a84a3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:49.499986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-60ced8b3-222d-4d78-b07f-c18ea92a84a3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:49.500816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-60ced8b3-222d-4d78-b07f-c18ea92a84a3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:49.501261 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-60ced8b3-222d-4d78-b07f-c18ea92a84a3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:49.680196 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ca113f44-cb67-4db7-9c1f-64f985991395 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:49.682456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ca113f44-cb67-4db7-9c1f-64f985991395 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:49.705552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca113f44-cb67-4db7-9c1f-64f985991395 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:49.708213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca113f44-cb67-4db7-9c1f-64f985991395 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:49.709230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca113f44-cb67-4db7-9c1f-64f985991395 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:49.709836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca113f44-cb67-4db7-9c1f-64f985991395 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:49.900773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ca113f44-cb67-4db7-9c1f-64f985991395 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:49.909740 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ca113f44-cb67-4db7-9c1f-64f985991395 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1511 microversion: 2.1 time: 0.233224 May 21 21:32:49.910475 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2569/5018] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:49 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1511 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:49.915258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5075b663-b982-49c4-a852-7bfc0d458ab4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:49.916156 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5075b663-b982-49c4-a852-7bfc0d458ab4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:49.926525 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5075b663-b982-49c4-a852-7bfc0d458ab4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:49.927182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5075b663-b982-49c4-a852-7bfc0d458ab4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:49.928161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5075b663-b982-49c4-a852-7bfc0d458ab4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:49.929344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5075b663-b982-49c4-a852-7bfc0d458ab4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:49.965758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-60ced8b3-222d-4d78-b07f-c18ea92a84a3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:49.984163 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-60ced8b3-222d-4d78-b07f-c18ea92a84a3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1675 microversion: 2.1 time: 0.497947 May 21 21:32:49.984807 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2450/5019] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:49 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1675 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:50.137617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5075b663-b982-49c4-a852-7bfc0d458ab4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:50.147142 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5075b663-b982-49c4-a852-7bfc0d458ab4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1734 microversion: 2.1 time: 0.235581 May 21 21:32:50.147741 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2570/5020] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:49 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1734 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:50.928143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c2420fd9-9a98-4d61-96b7-bca375f00f83 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:50.930111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c2420fd9-9a98-4d61-96b7-bca375f00f83 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:50.938264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2420fd9-9a98-4d61-96b7-bca375f00f83 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:50.938950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2420fd9-9a98-4d61-96b7-bca375f00f83 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:50.939742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2420fd9-9a98-4d61-96b7-bca375f00f83 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:50.940181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2420fd9-9a98-4d61-96b7-bca375f00f83 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:50.958837 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:51.007417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e760384b-5e3a-4ba4-b241-cb0d90a63eae tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:51.008131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e760384b-5e3a-4ba4-b241-cb0d90a63eae tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:51.018103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e760384b-5e3a-4ba4-b241-cb0d90a63eae tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:51.019440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e760384b-5e3a-4ba4-b241-cb0d90a63eae tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:51.020606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e760384b-5e3a-4ba4-b241-cb0d90a63eae tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:51.021416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e760384b-5e3a-4ba4-b241-cb0d90a63eae tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:51.117040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c2420fd9-9a98-4d61-96b7-bca375f00f83 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:51.127990 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c2420fd9-9a98-4d61-96b7-bca375f00f83 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1511 microversion: 2.1 time: 0.204099 May 21 21:32:51.128902 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2451/5021] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:50 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1511 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:51.170109 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6de21e93-89e5-4fec-a2be-a355291a127c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:51.170941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6de21e93-89e5-4fec-a2be-a355291a127c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:51.178855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6de21e93-89e5-4fec-a2be-a355291a127c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:51.179308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6de21e93-89e5-4fec-a2be-a355291a127c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:51.180336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6de21e93-89e5-4fec-a2be-a355291a127c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:51.182299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6de21e93-89e5-4fec-a2be-a355291a127c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:51.331274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e760384b-5e3a-4ba4-b241-cb0d90a63eae tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:51.333707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:51.340075 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e760384b-5e3a-4ba4-b241-cb0d90a63eae tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1675 microversion: 2.1 time: 0.336877 May 21 21:32:51.349897 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6de21e93-89e5-4fec-a2be-a355291a127c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:51.350383 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2571/5022] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:51 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1675 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:51.356578 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6de21e93-89e5-4fec-a2be-a355291a127c tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1734 microversion: 2.1 time: 0.194504 May 21 21:32:51.357533 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2452/5023] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:51 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1734 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:51.410542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-3d89fa46-5f3e-479c-bad0-6527e73ecc6f req-0a76d86e-de5f-4416-80a9-abe4cf5f647f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7de5bb-0233-4e88-a1a0-8561385e53cd", "name": "network-vif-unplugged", "status": "completed", "tag": "fc4ad2f3-98e9-42fc-81a3-7fc4fa986079"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:51.420654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-3d89fa46-5f3e-479c-bad0-6527e73ecc6f req-0a76d86e-de5f-4416-80a9-abe4cf5f647f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:51.421181 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-3d89fa46-5f3e-479c-bad0-6527e73ecc6f req-0a76d86e-de5f-4416-80a9-abe4cf5f647f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:51.432843 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-3d89fa46-5f3e-479c-bad0-6527e73ecc6f req-0a76d86e-de5f-4416-80a9-abe4cf5f647f service nova] Creating event network-vif-unplugged:fc4ad2f3-98e9-42fc-81a3-7fc4fa986079 for instance af7de5bb-0233-4e88-a1a0-8561385e53cd on nch2-master-1 May 21 21:32:51.437982 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-3d89fa46-5f3e-479c-bad0-6527e73ecc6f req-0a76d86e-de5f-4416-80a9-abe4cf5f647f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032215 May 21 21:32:51.438580 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2572/5024] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:32:52.145434 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-62e6a74b-b4d8-4e8b-b200-27c8b0073045 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:52.146069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-62e6a74b-b4d8-4e8b-b200-27c8b0073045 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:52.154381 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62e6a74b-b4d8-4e8b-b200-27c8b0073045 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:52.154841 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62e6a74b-b4d8-4e8b-b200-27c8b0073045 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:52.155625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62e6a74b-b4d8-4e8b-b200-27c8b0073045 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:52.156068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62e6a74b-b4d8-4e8b-b200-27c8b0073045 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:52.360744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6f270bc8-429a-4391-8044-40417f0da8cd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:52.361568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6f270bc8-429a-4391-8044-40417f0da8cd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:52.369238 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f270bc8-429a-4391-8044-40417f0da8cd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:52.369777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f270bc8-429a-4391-8044-40417f0da8cd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:52.370627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f270bc8-429a-4391-8044-40417f0da8cd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:52.371605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f270bc8-429a-4391-8044-40417f0da8cd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:52.434603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-62e6a74b-b4d8-4e8b-b200-27c8b0073045 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:52.453396 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-62e6a74b-b4d8-4e8b-b200-27c8b0073045 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1511 microversion: 2.1 time: 0.312349 May 21 21:32:52.455806 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2453/5025] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:52 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1511 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:52.465406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-62467944-0518-49f3-84e1-6133e199bb84 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:52.472793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-62467944-0518-49f3-84e1-6133e199bb84 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:52.485698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62467944-0518-49f3-84e1-6133e199bb84 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:52.486164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62467944-0518-49f3-84e1-6133e199bb84 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:52.486960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62467944-0518-49f3-84e1-6133e199bb84 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:52.487408 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62467944-0518-49f3-84e1-6133e199bb84 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:52.551983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6f270bc8-429a-4391-8044-40417f0da8cd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:52.560127 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6f270bc8-429a-4391-8044-40417f0da8cd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1675 microversion: 2.1 time: 0.205303 May 21 21:32:52.560752 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2573/5026] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:52 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1675 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:52.733584 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-62467944-0518-49f3-84e1-6133e199bb84 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:52.743065 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-62467944-0518-49f3-84e1-6133e199bb84 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1714 microversion: 2.1 time: 0.285753 May 21 21:32:52.744513 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2454/5027] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:52 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1714 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:52.858882 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4621c61d-b02b-4a78-a194-e3e179ee4d76 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:52.859386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4621c61d-b02b-4a78-a194-e3e179ee4d76 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:52.866255 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4621c61d-b02b-4a78-a194-e3e179ee4d76 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:52.866717 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4621c61d-b02b-4a78-a194-e3e179ee4d76 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:52.867494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4621c61d-b02b-4a78-a194-e3e179ee4d76 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:52.867927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4621c61d-b02b-4a78-a194-e3e179ee4d76 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:52.960270 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-4621c61d-b02b-4a78-a194-e3e179ee4d76 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] HTTP exception thrown: Cannot 'detach_volume' instance 54e8b13e-d6b2-467c-b801-2b0ad45e95ae while it is in vm_state rescued May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4621c61d-b02b-4a78-a194-e3e179ee4d76 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Request method failure captured: May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae/os-volume_attachments/b0b1920b-8151-4e90-ac66-f993da5e7e8e HTTP/1.1 May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVnYy3SaySatFVqWuD4QLMX78tOZu2Sq081sncP5_CZnvryZkShUPSqptMQixW9D6QLw2UuDdxyQwaeJ6lrj30y7u6OXCJpzi5UJG9aI3fEqHW0Sq9F2EcE_2fCjYowdWcuux0Sp0LhoueDGd91ZOn29SJFvBmrTIiAhoJB3iHzY0IU May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 2e6d59483dc54fe4a558186055068419 May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2e6d59483dc54fe4a558186055068419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2e6d59483dc54fe4a558186055068419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2e6d59483dc54fe4a558186055068419", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2e6d59483dc54fe4a558186055068419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 2e6d59483dc54fe4a558186055068419 May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerRescueNegativeTestJSON-1981617934-project May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 9a0ccfb5c9a04ec0831a0bfe987bb659 May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1981617934-project May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: exception: Cannot 'detach_volume' instance 54e8b13e-d6b2-467c-b801-2b0ad45e95ae while it is in vm_state rescued May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'server_id': '54e8b13e-d6b2-467c-b801-2b0ad45e95ae', 'id': 'b0b1920b-8151-4e90-ac66-f993da5e7e8e'} May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 54e8b13e-d6b2-467c-b801-2b0ad45e95ae in vm_state rescued. Cannot detach_volume while the instance is in this state. May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 54e8b13e-d6b2-467c-b801-2b0ad45e95ae while it is in vm_state rescued May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:32:52.962013 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:52.967206 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:52.967206 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:52.967206 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:32:52.967206 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:32:52.967206 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 54e8b13e-d6b2-467c-b801-2b0ad45e95ae while it is in vm_state rescued May 21 21:32:52.967206 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:32:52.967206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4621c61d-b02b-4a78-a194-e3e179ee4d76 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Returning 409 to user: Cannot 'detach_volume' instance 54e8b13e-d6b2-467c-b801-2b0ad45e95ae while it is in vm_state rescued {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:32:52.967206 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4621c61d-b02b-4a78-a194-e3e179ee4d76 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "DELETE /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae/os-volume_attachments/b0b1920b-8151-4e90-ac66-f993da5e7e8e" status: 409 len: 152 microversion: 2.1 time: 0.109769 May 21 21:32:52.967206 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2574/5028] 10.222.0.49 () {58 vars in 1415 bytes} [Sat May 21 21:32:52 2022] DELETE /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae/os-volume_attachments/b0b1920b-8151-4e90-ac66-f993da5e7e8e => generated 152 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 21 21:32:52.973863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cdeac5e0-d72c-40de-b381-fd7554c35f7b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:52.974406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cdeac5e0-d72c-40de-b381-fd7554c35f7b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:52.982017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cdeac5e0-d72c-40de-b381-fd7554c35f7b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:52.982474 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cdeac5e0-d72c-40de-b381-fd7554c35f7b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:52.983244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cdeac5e0-d72c-40de-b381-fd7554c35f7b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:52.983681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cdeac5e0-d72c-40de-b381-fd7554c35f7b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:53.194839 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cdeac5e0-d72c-40de-b381-fd7554c35f7b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "POST /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae/action" status: 202 len: 0 microversion: 2.1 time: 0.224878 May 21 21:32:53.196120 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2455/5029] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:32:52 2022] POST /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:32:53.204331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-38d558dd-1351-42b0-9590-5b40cc0397d4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:53.204895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-38d558dd-1351-42b0-9590-5b40cc0397d4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:53.212444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38d558dd-1351-42b0-9590-5b40cc0397d4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:53.212972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38d558dd-1351-42b0-9590-5b40cc0397d4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:53.213714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38d558dd-1351-42b0-9590-5b40cc0397d4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:53.214160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38d558dd-1351-42b0-9590-5b40cc0397d4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:53.372224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-38d558dd-1351-42b0-9590-5b40cc0397d4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:53.381723 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-38d558dd-1351-42b0-9590-5b40cc0397d4 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1722 microversion: 2.1 time: 0.181370 May 21 21:32:53.382295 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2575/5030] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:53 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:53.472274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d299cd73-73c0-4c54-8ab7-355741c55d6a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:53.473150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d299cd73-73c0-4c54-8ab7-355741c55d6a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:53.480767 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d299cd73-73c0-4c54-8ab7-355741c55d6a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:53.481226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d299cd73-73c0-4c54-8ab7-355741c55d6a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:53.481999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d299cd73-73c0-4c54-8ab7-355741c55d6a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:53.482614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d299cd73-73c0-4c54-8ab7-355741c55d6a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:53.578487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3285a84b-9d38-4fd7-aee4-ba7561e5f083 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:53.579475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3285a84b-9d38-4fd7-aee4-ba7561e5f083 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:53.625681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3285a84b-9d38-4fd7-aee4-ba7561e5f083 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:53.629376 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3285a84b-9d38-4fd7-aee4-ba7561e5f083 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:53.629376 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3285a84b-9d38-4fd7-aee4-ba7561e5f083 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:53.629376 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3285a84b-9d38-4fd7-aee4-ba7561e5f083 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:53.839384 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d299cd73-73c0-4c54-8ab7-355741c55d6a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:53.849578 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d299cd73-73c0-4c54-8ab7-355741c55d6a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1454 microversion: 2.1 time: 0.381659 May 21 21:32:53.860578 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2456/5031] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:53 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1454 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:53.875205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b4ffdc88-aa0a-4bd9-ba03-2c3d9f247cad tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:53.876069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b4ffdc88-aa0a-4bd9-ba03-2c3d9f247cad tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:53.882906 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b4ffdc88-aa0a-4bd9-ba03-2c3d9f247cad tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:53.883551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b4ffdc88-aa0a-4bd9-ba03-2c3d9f247cad tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:53.884586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b4ffdc88-aa0a-4bd9-ba03-2c3d9f247cad tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:53.885197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b4ffdc88-aa0a-4bd9-ba03-2c3d9f247cad tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:54.116883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3285a84b-9d38-4fd7-aee4-ba7561e5f083 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:54.125623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b4ffdc88-aa0a-4bd9-ba03-2c3d9f247cad tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:54.130509 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3285a84b-9d38-4fd7-aee4-ba7561e5f083 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1675 microversion: 2.1 time: 0.556308 May 21 21:32:54.139277 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2576/5032] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:53 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1675 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:54.139441 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b4ffdc88-aa0a-4bd9-ba03-2c3d9f247cad tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1454 microversion: 2.1 time: 0.267699 May 21 21:32:54.140433 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2457/5033] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:53 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1454 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:54.211032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-52d5eade-07ef-433a-80c7-464c0eb53355 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:54.211662 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-52d5eade-07ef-433a-80c7-464c0eb53355 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:54.218749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-52d5eade-07ef-433a-80c7-464c0eb53355 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:54.219205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-52d5eade-07ef-433a-80c7-464c0eb53355 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:54.219985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-52d5eade-07ef-433a-80c7-464c0eb53355 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:54.220458 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-52d5eade-07ef-433a-80c7-464c0eb53355 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:54.245057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-52d5eade-07ef-433a-80c7-464c0eb53355 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lazy-loading 'flavor' on Instance uuid af7de5bb-0233-4e88-a1a0-8561385e53cd {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:32:54.258469 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-52d5eade-07ef-433a-80c7-464c0eb53355 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Cannot 'shelve' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state shelved_offloaded May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-52d5eade-07ef-433a-80c7-464c0eb53355 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action HTTP/1.1 May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 14 May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: {"shelve": {}} May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: exception: Cannot 'shelve' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state shelved_offloaded May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'af7de5bb-0233-4e88-a1a0-8561385e53cd', 'body': {'shelve': {}}} May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance af7de5bb-0233-4e88-a1a0-8561385e53cd in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve May 21 21:32:54.261598 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 21 21:32:54.271239 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 21 21:32:54.271239 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 21 21:32:54.271239 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state shelved_offloaded May 21 21:32:54.271239 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:32:54.271239 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:32:54.271239 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:32:54.271239 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:32:54.271239 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:32:54.271239 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:32:54.271239 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:32:54.271239 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:32:54.271239 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state shelved_offloaded May 21 21:32:54.271239 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:32:54.271239 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-52d5eade-07ef-433a-80c7-464c0eb53355 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 409 to user: Cannot 'shelve' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state shelved_offloaded {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:32:54.271239 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-52d5eade-07ef-433a-80c7-464c0eb53355 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action" status: 409 len: 155 microversion: 2.1 time: 0.061951 May 21 21:32:54.271239 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2577/5034] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:32:54 2022] POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action => generated 155 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 21 21:32:54.278722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1e333ffb-6ee4-4d28-9853-c62f20ba55dd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:54.279979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1e333ffb-6ee4-4d28-9853-c62f20ba55dd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:54.287184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e333ffb-6ee4-4d28-9853-c62f20ba55dd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:54.287939 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e333ffb-6ee4-4d28-9853-c62f20ba55dd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:54.289072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e333ffb-6ee4-4d28-9853-c62f20ba55dd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:54.289752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e333ffb-6ee4-4d28-9853-c62f20ba55dd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:54.400641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c2e80d9d-6278-42c2-8259-9974b74e9ef6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:54.401273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c2e80d9d-6278-42c2-8259-9974b74e9ef6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:54.409599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2e80d9d-6278-42c2-8259-9974b74e9ef6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:54.410070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2e80d9d-6278-42c2-8259-9974b74e9ef6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:54.410897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2e80d9d-6278-42c2-8259-9974b74e9ef6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:54.411343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2e80d9d-6278-42c2-8259-9974b74e9ef6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:54.708690 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1e333ffb-6ee4-4d28-9853-c62f20ba55dd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action" status: 202 len: 0 microversion: 2.1 time: 0.434062 May 21 21:32:54.709320 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2458/5035] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:32:54 2022] POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:32:54.724603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-720ab2fc-0910-4d24-b1c1-ee1baa9623c0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:54.725223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-720ab2fc-0910-4d24-b1c1-ee1baa9623c0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:54.741929 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-720ab2fc-0910-4d24-b1c1-ee1baa9623c0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:54.742378 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-720ab2fc-0910-4d24-b1c1-ee1baa9623c0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:54.743414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-720ab2fc-0910-4d24-b1c1-ee1baa9623c0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:54.744136 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-720ab2fc-0910-4d24-b1c1-ee1baa9623c0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:54.973690 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c2e80d9d-6278-42c2-8259-9974b74e9ef6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:54.983849 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c2e80d9d-6278-42c2-8259-9974b74e9ef6 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1722 microversion: 2.1 time: 0.588566 May 21 21:32:54.993946 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2578/5036] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:54 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1722 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:55.036535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-720ab2fc-0910-4d24-b1c1-ee1baa9623c0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:55.045915 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-720ab2fc-0910-4d24-b1c1-ee1baa9623c0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1462 microversion: 2.1 time: 0.325344 May 21 21:32:55.046734 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2459/5037] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:54 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1462 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:55.157200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a2ed9c01-ad87-4ad3-8a4d-6598f7e95b16 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:55.158006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a2ed9c01-ad87-4ad3-8a4d-6598f7e95b16 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:55.164769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a2ed9c01-ad87-4ad3-8a4d-6598f7e95b16 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:55.166005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a2ed9c01-ad87-4ad3-8a4d-6598f7e95b16 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:55.166881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a2ed9c01-ad87-4ad3-8a4d-6598f7e95b16 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:55.167395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a2ed9c01-ad87-4ad3-8a4d-6598f7e95b16 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:55.360183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a2ed9c01-ad87-4ad3-8a4d-6598f7e95b16 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:55.370434 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a2ed9c01-ad87-4ad3-8a4d-6598f7e95b16 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1675 microversion: 2.1 time: 0.226108 May 21 21:32:55.372731 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2579/5038] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:55 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1675 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:56.001278 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-164d5a4a-5614-40fa-b340-5fca9cb04b50 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:56.002038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-164d5a4a-5614-40fa-b340-5fca9cb04b50 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:56.010711 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-164d5a4a-5614-40fa-b340-5fca9cb04b50 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:56.011176 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-164d5a4a-5614-40fa-b340-5fca9cb04b50 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:56.012116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-164d5a4a-5614-40fa-b340-5fca9cb04b50 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:56.012627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-164d5a4a-5614-40fa-b340-5fca9cb04b50 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:56.064223 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-14277be3-ab5a-45a2-8eab-79ba0fc5a703 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:56.065705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-14277be3-ab5a-45a2-8eab-79ba0fc5a703 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:56.074675 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14277be3-ab5a-45a2-8eab-79ba0fc5a703 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:56.075166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14277be3-ab5a-45a2-8eab-79ba0fc5a703 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:56.076129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14277be3-ab5a-45a2-8eab-79ba0fc5a703 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:56.076630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14277be3-ab5a-45a2-8eab-79ba0fc5a703 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:56.286031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-14277be3-ab5a-45a2-8eab-79ba0fc5a703 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:56.294232 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-14277be3-ab5a-45a2-8eab-79ba0fc5a703 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1462 microversion: 2.1 time: 0.234273 May 21 21:32:56.294981 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2580/5039] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:56 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1462 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:56.308794 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-164d5a4a-5614-40fa-b340-5fca9cb04b50 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:56.316927 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-164d5a4a-5614-40fa-b340-5fca9cb04b50 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1728 microversion: 2.1 time: 0.319622 May 21 21:32:56.317591 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2460/5040] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:55 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1728 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:56.334368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bb8318b0-ecb0-40f5-9af8-04c5dab3be83 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:56.335142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bb8318b0-ecb0-40f5-9af8-04c5dab3be83 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:56.342435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb8318b0-ecb0-40f5-9af8-04c5dab3be83 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:56.342886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb8318b0-ecb0-40f5-9af8-04c5dab3be83 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:56.343672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb8318b0-ecb0-40f5-9af8-04c5dab3be83 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:56.344121 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb8318b0-ecb0-40f5-9af8-04c5dab3be83 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:56.391255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6e3fbc21-47af-4ce6-b478-90feeaddd001 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:56.391879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6e3fbc21-47af-4ce6-b478-90feeaddd001 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:56.425221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e3fbc21-47af-4ce6-b478-90feeaddd001 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:56.427401 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e3fbc21-47af-4ce6-b478-90feeaddd001 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:56.430120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e3fbc21-47af-4ce6-b478-90feeaddd001 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:56.430664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e3fbc21-47af-4ce6-b478-90feeaddd001 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:56.464351 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bb8318b0-ecb0-40f5-9af8-04c5dab3be83 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133870 May 21 21:32:56.465362 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2581/5041] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 21:32:56 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:32:56.613871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6e3fbc21-47af-4ce6-b478-90feeaddd001 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:56.624427 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6e3fbc21-47af-4ce6-b478-90feeaddd001 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1675 microversion: 2.1 time: 0.237371 May 21 21:32:56.625495 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2461/5042] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:56 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1675 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:57.312120 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b410b78f-3de1-496f-a023-0c32c50c43d9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:57.312776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b410b78f-3de1-496f-a023-0c32c50c43d9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:57.319216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b410b78f-3de1-496f-a023-0c32c50c43d9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:57.319673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b410b78f-3de1-496f-a023-0c32c50c43d9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:57.320685 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b410b78f-3de1-496f-a023-0c32c50c43d9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:57.321163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b410b78f-3de1-496f-a023-0c32c50c43d9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:57.610891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b410b78f-3de1-496f-a023-0c32c50c43d9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:57.621285 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b410b78f-3de1-496f-a023-0c32c50c43d9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1520 microversion: 2.1 time: 0.313931 May 21 21:32:57.622490 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2582/5043] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:57 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1520 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:57.649843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9d6564da-cdd2-4cda-93ae-6e01aaccd122 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:57.649843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9d6564da-cdd2-4cda-93ae-6e01aaccd122 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:57.656593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9d6564da-cdd2-4cda-93ae-6e01aaccd122 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:57.657372 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9d6564da-cdd2-4cda-93ae-6e01aaccd122 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:57.658415 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9d6564da-cdd2-4cda-93ae-6e01aaccd122 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:57.659466 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9d6564da-cdd2-4cda-93ae-6e01aaccd122 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:57.861739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9d6564da-cdd2-4cda-93ae-6e01aaccd122 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:57.870854 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9d6564da-cdd2-4cda-93ae-6e01aaccd122 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1675 microversion: 2.1 time: 0.232776 May 21 21:32:57.871525 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2462/5044] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:57 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:58.212714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-a3049e6e-291a-4e27-8afc-7aa6c90aa841 req-8483ca65-c84b-4219-a2d2-b34e7f36cd76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54e8b13e-d6b2-467c-b801-2b0ad45e95ae", "tag": "ea540e6b-71e1-4aff-97b8-77527dd9d620"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:58.222234 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a3049e6e-291a-4e27-8afc-7aa6c90aa841 req-8483ca65-c84b-4219-a2d2-b34e7f36cd76 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:58.222934 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a3049e6e-291a-4e27-8afc-7aa6c90aa841 req-8483ca65-c84b-4219-a2d2-b34e7f36cd76 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:58.242436 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a3049e6e-291a-4e27-8afc-7aa6c90aa841 req-8483ca65-c84b-4219-a2d2-b34e7f36cd76 service nova] Creating event network-changed:ea540e6b-71e1-4aff-97b8-77527dd9d620 for instance 54e8b13e-d6b2-467c-b801-2b0ad45e95ae on nch2-master-1 May 21 21:32:58.250145 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-a3049e6e-291a-4e27-8afc-7aa6c90aa841 req-8483ca65-c84b-4219-a2d2-b34e7f36cd76 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190511 May 21 21:32:58.250867 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2583/5045] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:32:58.639852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e63f6cff-c7eb-45bb-b00d-d5c05f796819 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:58.640525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e63f6cff-c7eb-45bb-b00d-d5c05f796819 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:58.646984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e63f6cff-c7eb-45bb-b00d-d5c05f796819 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:58.647482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e63f6cff-c7eb-45bb-b00d-d5c05f796819 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:58.648524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e63f6cff-c7eb-45bb-b00d-d5c05f796819 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:58.648976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e63f6cff-c7eb-45bb-b00d-d5c05f796819 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:58.882447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e63f6cff-c7eb-45bb-b00d-d5c05f796819 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:58.906063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0b86bf58-3525-4824-8ff5-f71ac56d9f01 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:58.906063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0b86bf58-3525-4824-8ff5-f71ac56d9f01 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:58.920025 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e63f6cff-c7eb-45bb-b00d-d5c05f796819 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1520 microversion: 2.1 time: 0.283649 May 21 21:32:58.927196 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2463/5046] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:58 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:58.929183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b86bf58-3525-4824-8ff5-f71ac56d9f01 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:58.930163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b86bf58-3525-4824-8ff5-f71ac56d9f01 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:58.934843 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b86bf58-3525-4824-8ff5-f71ac56d9f01 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:58.934843 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b86bf58-3525-4824-8ff5-f71ac56d9f01 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:59.172988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0b86bf58-3525-4824-8ff5-f71ac56d9f01 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:59.191604 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0b86bf58-3525-4824-8ff5-f71ac56d9f01 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1652 microversion: 2.1 time: 0.303455 May 21 21:32:59.193716 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2584/5047] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:58 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1652 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:32:59.211475 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e28dc359-1620-4c25-8c08-cec93590b1ab tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:32:59.221142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e28dc359-1620-4c25-8c08-cec93590b1ab tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:59.221944 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e28dc359-1620-4c25-8c08-cec93590b1ab tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:59.257699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e28dc359-1620-4c25-8c08-cec93590b1ab tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Going to try to start instance {{(pid=131278) start /opt/stack/nova/nova/compute/api.py:2730}} May 21 21:32:59.512841 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e28dc359-1620-4c25-8c08-cec93590b1ab tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "POST /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384/action" status: 202 len: 0 microversion: 2.1 time: 0.305661 May 21 21:32:59.513994 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2464/5048] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:32:59 2022] POST /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:32:59.523029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b1f155b5-4c6e-4aad-bd4a-0f4161412cbd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:59.523692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b1f155b5-4c6e-4aad-bd4a-0f4161412cbd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:59.535775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1f155b5-4c6e-4aad-bd4a-0f4161412cbd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:59.539776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1f155b5-4c6e-4aad-bd4a-0f4161412cbd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:59.541182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1f155b5-4c6e-4aad-bd4a-0f4161412cbd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:59.541786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1f155b5-4c6e-4aad-bd4a-0f4161412cbd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:59.936078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b1f155b5-4c6e-4aad-bd4a-0f4161412cbd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:32:59.945669 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b1f155b5-4c6e-4aad-bd4a-0f4161412cbd tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1661 microversion: 2.1 time: 0.427146 May 21 21:32:59.946839 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2585/5049] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:59 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1661 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:32:59.948227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c21c4075-354d-4d86-ae22-68db5b5536c6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:32:59.949052 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c21c4075-354d-4d86-ae22-68db5b5536c6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:32:59.974208 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c21c4075-354d-4d86-ae22-68db5b5536c6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:59.974679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c21c4075-354d-4d86-ae22-68db5b5536c6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:59.977997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c21c4075-354d-4d86-ae22-68db5b5536c6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:32:59.978679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c21c4075-354d-4d86-ae22-68db5b5536c6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:32:59.989493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:00.276196 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f3e5d121-3533-4ea9-ad77-31f9bb75decd req-8ca1af5e-3d08-494e-9c1d-c55479fa86bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54e8b13e-d6b2-467c-b801-2b0ad45e95ae", "tag": "ea540e6b-71e1-4aff-97b8-77527dd9d620"}, {"name": "network-changed", "server_uuid": "af7de5bb-0233-4e88-a1a0-8561385e53cd", "tag": "fc4ad2f3-98e9-42fc-81a3-7fc4fa986079"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:00.293627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f3e5d121-3533-4ea9-ad77-31f9bb75decd req-8ca1af5e-3d08-494e-9c1d-c55479fa86bc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:00.294446 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f3e5d121-3533-4ea9-ad77-31f9bb75decd req-8ca1af5e-3d08-494e-9c1d-c55479fa86bc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:00.310253 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f3e5d121-3533-4ea9-ad77-31f9bb75decd req-8ca1af5e-3d08-494e-9c1d-c55479fa86bc service nova] Creating event network-changed:ea540e6b-71e1-4aff-97b8-77527dd9d620 for instance 54e8b13e-d6b2-467c-b801-2b0ad45e95ae on nch2-master-1 May 21 21:33:00.311209 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f3e5d121-3533-4ea9-ad77-31f9bb75decd req-8ca1af5e-3d08-494e-9c1d-c55479fa86bc service nova] Creating event network-changed:fc4ad2f3-98e9-42fc-81a3-7fc4fa986079 for instance af7de5bb-0233-4e88-a1a0-8561385e53cd on nch1-master-1 May 21 21:33:00.320699 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f3e5d121-3533-4ea9-ad77-31f9bb75decd req-8ca1af5e-3d08-494e-9c1d-c55479fa86bc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048384 May 21 21:33:00.322762 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2586/5050] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:33:00.330878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c21c4075-354d-4d86-ae22-68db5b5536c6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:00.336422 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c21c4075-354d-4d86-ae22-68db5b5536c6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1520 microversion: 2.1 time: 0.395000 May 21 21:33:00.337396 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2465/5051] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:32:59 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1520 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:00.970101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-af14ee38-0893-447f-84f8-056322ae9353 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:00.971438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-af14ee38-0893-447f-84f8-056322ae9353 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:00.978359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af14ee38-0893-447f-84f8-056322ae9353 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:00.978926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af14ee38-0893-447f-84f8-056322ae9353 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:00.979795 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af14ee38-0893-447f-84f8-056322ae9353 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:00.980479 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af14ee38-0893-447f-84f8-056322ae9353 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:01.357429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0f012d83-610d-4903-9132-e6d3279e1dc1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:01.359966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0f012d83-610d-4903-9132-e6d3279e1dc1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:01.381781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f012d83-610d-4903-9132-e6d3279e1dc1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:01.400653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f012d83-610d-4903-9132-e6d3279e1dc1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:01.403207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f012d83-610d-4903-9132-e6d3279e1dc1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:01.414774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0f012d83-610d-4903-9132-e6d3279e1dc1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:01.571442 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-af14ee38-0893-447f-84f8-056322ae9353 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:01.593370 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-af14ee38-0893-447f-84f8-056322ae9353 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1661 microversion: 2.1 time: 0.632354 May 21 21:33:01.595353 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2587/5052] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:00 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1661 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:02.271748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0f012d83-610d-4903-9132-e6d3279e1dc1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:02.284132 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0f012d83-610d-4903-9132-e6d3279e1dc1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1520 microversion: 2.1 time: 0.933120 May 21 21:33:02.290716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-94e95251-1c9a-4d0d-afa4-eb5a969fa7d6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:02.290716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-94e95251-1c9a-4d0d-afa4-eb5a969fa7d6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:02.291246 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2466/5053] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:01 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1520 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:02.298269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94e95251-1c9a-4d0d-afa4-eb5a969fa7d6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:02.301220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94e95251-1c9a-4d0d-afa4-eb5a969fa7d6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:02.302486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94e95251-1c9a-4d0d-afa4-eb5a969fa7d6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:02.303245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94e95251-1c9a-4d0d-afa4-eb5a969fa7d6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:02.356062 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-94e95251-1c9a-4d0d-afa4-eb5a969fa7d6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c/ips" status: 200 len: 151 microversion: 2.20 time: 0.076506 May 21 21:33:02.363458 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2588/5054] 10.222.0.49 () {60 vars in 1288 bytes} [Sat May 21 21:33:02 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c/ips => generated 151 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 21 21:33:02.616106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8d9fa975-92c5-4602-93af-6a568164a640 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:02.617522 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8d9fa975-92c5-4602-93af-6a568164a640 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:02.637626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d9fa975-92c5-4602-93af-6a568164a640 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:02.640978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d9fa975-92c5-4602-93af-6a568164a640 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:02.643840 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d9fa975-92c5-4602-93af-6a568164a640 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:02.644360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d9fa975-92c5-4602-93af-6a568164a640 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:03.261789 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8d9fa975-92c5-4602-93af-6a568164a640 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:03.271620 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8d9fa975-92c5-4602-93af-6a568164a640 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1665 microversion: 2.1 time: 0.661479 May 21 21:33:03.278374 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2467/5055] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:02 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1665 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:03.309610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4e864f5e-d8a7-4128-bb89-f5b3f0d49e70 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:03.311423 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4e864f5e-d8a7-4128-bb89-f5b3f0d49e70 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:03.330005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e864f5e-d8a7-4128-bb89-f5b3f0d49e70 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:03.331037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e864f5e-d8a7-4128-bb89-f5b3f0d49e70 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:03.339084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e864f5e-d8a7-4128-bb89-f5b3f0d49e70 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:03.340915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e864f5e-d8a7-4128-bb89-f5b3f0d49e70 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:04.476503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4e864f5e-d8a7-4128-bb89-f5b3f0d49e70 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:04.491009 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4e864f5e-d8a7-4128-bb89-f5b3f0d49e70 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1520 microversion: 2.1 time: 1.188546 May 21 21:33:04.504063 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2589/5056] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:03 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1520 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:05.515640 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6da0f760-1e1b-45e8-87a9-7923ec3ffcc3 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:05.516426 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6da0f760-1e1b-45e8-87a9-7923ec3ffcc3 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:05.536119 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6da0f760-1e1b-45e8-87a9-7923ec3ffcc3 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:05.536720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6da0f760-1e1b-45e8-87a9-7923ec3ffcc3 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:05.537530 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6da0f760-1e1b-45e8-87a9-7923ec3ffcc3 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:05.537978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6da0f760-1e1b-45e8-87a9-7923ec3ffcc3 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:05.901590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6da0f760-1e1b-45e8-87a9-7923ec3ffcc3 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:05.915787 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6da0f760-1e1b-45e8-87a9-7923ec3ffcc3 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1520 microversion: 2.1 time: 0.409198 May 21 21:33:05.924397 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2468/5057] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:05 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1520 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:06.191031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9ac74eba-7e34-40e8-bb21-f73b87cb8164 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:06.192983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9ac74eba-7e34-40e8-bb21-f73b87cb8164 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:06.211884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ac74eba-7e34-40e8-bb21-f73b87cb8164 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:06.212646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ac74eba-7e34-40e8-bb21-f73b87cb8164 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:06.213453 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ac74eba-7e34-40e8-bb21-f73b87cb8164 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:06.213892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ac74eba-7e34-40e8-bb21-f73b87cb8164 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:06.273161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-9ac74eba-7e34-40e8-bb21-f73b87cb8164 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lazy-loading 'flavor' on Instance uuid cc27a082-c144-436f-bd21-e8126e00db6c {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:33:06.320411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:06.935463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e8bd33ad-0f47-458d-800b-737e1a49e2cc tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:06.936394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e8bd33ad-0f47-458d-800b-737e1a49e2cc tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:06.952694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e8bd33ad-0f47-458d-800b-737e1a49e2cc tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:06.955344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e8bd33ad-0f47-458d-800b-737e1a49e2cc tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:06.957884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e8bd33ad-0f47-458d-800b-737e1a49e2cc tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:06.958547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e8bd33ad-0f47-458d-800b-737e1a49e2cc tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:07.230725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e8bd33ad-0f47-458d-800b-737e1a49e2cc tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:07.241435 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e8bd33ad-0f47-458d-800b-737e1a49e2cc tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1520 microversion: 2.1 time: 0.311023 May 21 21:33:07.244256 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2469/5058] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:06 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1520 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:33:07.307036 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9ac74eba-7e34-40e8-bb21-f73b87cb8164 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "POST /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c/action" status: 202 len: 0 microversion: 2.20 time: 1.126104 May 21 21:33:07.315388 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2590/5059] 10.222.0.49 () {62 vars in 1318 bytes} [Sat May 21 21:33:06 2022] POST /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c/action => generated 0 bytes in 1137 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 21 21:33:07.321369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-65721bc1-fa7c-48cc-9d63-cde0758d9b5b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:07.324991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-65721bc1-fa7c-48cc-9d63-cde0758d9b5b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:07.331480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65721bc1-fa7c-48cc-9d63-cde0758d9b5b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:07.332116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65721bc1-fa7c-48cc-9d63-cde0758d9b5b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:07.333105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65721bc1-fa7c-48cc-9d63-cde0758d9b5b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:07.333812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65721bc1-fa7c-48cc-9d63-cde0758d9b5b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:07.715485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-65721bc1-fa7c-48cc-9d63-cde0758d9b5b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:07.752962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-65721bc1-fa7c-48cc-9d63-cde0758d9b5b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:07.756095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-65721bc1-fa7c-48cc-9d63-cde0758d9b5b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:07.757568 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-65721bc1-fa7c-48cc-9d63-cde0758d9b5b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1723 microversion: 2.20 time: 0.445427 May 21 21:33:07.759246 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2470/5060] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:07 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1723 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:33:08.267040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f9cf4e98-574e-4ae0-97ca-b4c81f7d9e39 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:08.268188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f9cf4e98-574e-4ae0-97ca-b4c81f7d9e39 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:08.274987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=70 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:08.282453 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f9cf4e98-574e-4ae0-97ca-b4c81f7d9e39 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:08.283397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f9cf4e98-574e-4ae0-97ca-b4c81f7d9e39 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:08.284643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f9cf4e98-574e-4ae0-97ca-b4c81f7d9e39 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:08.285470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f9cf4e98-574e-4ae0-97ca-b4c81f7d9e39 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:08.694158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f9cf4e98-574e-4ae0-97ca-b4c81f7d9e39 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:08.715588 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f9cf4e98-574e-4ae0-97ca-b4c81f7d9e39 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1520 microversion: 2.1 time: 0.454185 May 21 21:33:08.720642 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2591/5061] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:08 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1520 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:08.782939 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-25357d54-246e-427a-ba83-5d70dd8d347d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:08.784244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-25357d54-246e-427a-ba83-5d70dd8d347d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:08.807004 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25357d54-246e-427a-ba83-5d70dd8d347d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:08.807725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25357d54-246e-427a-ba83-5d70dd8d347d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:08.810895 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25357d54-246e-427a-ba83-5d70dd8d347d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:08.812895 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25357d54-246e-427a-ba83-5d70dd8d347d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:09.079488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-25357d54-246e-427a-ba83-5d70dd8d347d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:09.089997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-25357d54-246e-427a-ba83-5d70dd8d347d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:09.092227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-25357d54-246e-427a-ba83-5d70dd8d347d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:09.093731 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-25357d54-246e-427a-ba83-5d70dd8d347d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1723 microversion: 2.20 time: 0.318292 May 21 21:33:09.094885 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2471/5062] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:08 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:09.738837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-14dab3bf-9e6e-42be-8d1d-c511c5934b65 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:09.738837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-14dab3bf-9e6e-42be-8d1d-c511c5934b65 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:09.754207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14dab3bf-9e6e-42be-8d1d-c511c5934b65 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:09.755468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14dab3bf-9e6e-42be-8d1d-c511c5934b65 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:09.757145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14dab3bf-9e6e-42be-8d1d-c511c5934b65 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:09.758919 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14dab3bf-9e6e-42be-8d1d-c511c5934b65 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:10.114701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-55723a4a-2892-4984-8d43-bd5f5e91e0cd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:10.115314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-55723a4a-2892-4984-8d43-bd5f5e91e0cd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:10.131265 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-55723a4a-2892-4984-8d43-bd5f5e91e0cd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:10.131776 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-55723a4a-2892-4984-8d43-bd5f5e91e0cd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:10.134152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-55723a4a-2892-4984-8d43-bd5f5e91e0cd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:10.136383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-55723a4a-2892-4984-8d43-bd5f5e91e0cd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:10.459398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-55723a4a-2892-4984-8d43-bd5f5e91e0cd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:10.470830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-55723a4a-2892-4984-8d43-bd5f5e91e0cd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:10.478818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-55723a4a-2892-4984-8d43-bd5f5e91e0cd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:10.485515 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-55723a4a-2892-4984-8d43-bd5f5e91e0cd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1723 microversion: 2.20 time: 0.370166 May 21 21:33:10.486218 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2472/5063] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:10 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1723 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:10.522201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-14dab3bf-9e6e-42be-8d1d-c511c5934b65 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:10.533357 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-14dab3bf-9e6e-42be-8d1d-c511c5934b65 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1520 microversion: 2.1 time: 0.799308 May 21 21:33:10.534584 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2592/5064] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:09 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1520 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:33:11.507019 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-73df0ba1-bf80-4aaf-b980-33f6a69debf2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:11.509457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-73df0ba1-bf80-4aaf-b980-33f6a69debf2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:11.517913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-73df0ba1-bf80-4aaf-b980-33f6a69debf2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:11.518903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-73df0ba1-bf80-4aaf-b980-33f6a69debf2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:11.520657 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-73df0ba1-bf80-4aaf-b980-33f6a69debf2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:11.525572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-73df0ba1-bf80-4aaf-b980-33f6a69debf2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:11.558926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9b07fab0-6784-4220-99c3-9368e3f3db89 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:11.559824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9b07fab0-6784-4220-99c3-9368e3f3db89 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:11.579151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b07fab0-6784-4220-99c3-9368e3f3db89 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:11.579657 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b07fab0-6784-4220-99c3-9368e3f3db89 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:11.580565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b07fab0-6784-4220-99c3-9368e3f3db89 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:11.580993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b07fab0-6784-4220-99c3-9368e3f3db89 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:11.788921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-73df0ba1-bf80-4aaf-b980-33f6a69debf2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:11.803735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-73df0ba1-bf80-4aaf-b980-33f6a69debf2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:11.806632 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-73df0ba1-bf80-4aaf-b980-33f6a69debf2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:11.808989 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-73df0ba1-bf80-4aaf-b980-33f6a69debf2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1723 microversion: 2.20 time: 0.307354 May 21 21:33:11.819962 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2473/5065] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:11 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:11.974311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9b07fab0-6784-4220-99c3-9368e3f3db89 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:11.984721 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9b07fab0-6784-4220-99c3-9368e3f3db89 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1520 microversion: 2.1 time: 0.429315 May 21 21:33:11.984721 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2593/5066] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:11 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1520 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:33:12.829008 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aaf61c07-a43a-4305-9095-5afb273af8be tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:12.830216 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-aaf61c07-a43a-4305-9095-5afb273af8be tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:12.838629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aaf61c07-a43a-4305-9095-5afb273af8be tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:12.839493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aaf61c07-a43a-4305-9095-5afb273af8be tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:12.840490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aaf61c07-a43a-4305-9095-5afb273af8be tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:12.840932 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aaf61c07-a43a-4305-9095-5afb273af8be tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:13.003838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-135b7e9b-7429-4cda-a739-5ffd5db5ddaf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:13.004454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-135b7e9b-7429-4cda-a739-5ffd5db5ddaf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:13.016708 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-135b7e9b-7429-4cda-a739-5ffd5db5ddaf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:13.019586 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-135b7e9b-7429-4cda-a739-5ffd5db5ddaf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:13.020452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-135b7e9b-7429-4cda-a739-5ffd5db5ddaf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:13.020910 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-135b7e9b-7429-4cda-a739-5ffd5db5ddaf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:13.077392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-aaf61c07-a43a-4305-9095-5afb273af8be tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:13.086502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-aaf61c07-a43a-4305-9095-5afb273af8be tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:13.088857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-aaf61c07-a43a-4305-9095-5afb273af8be tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:13.090331 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-aaf61c07-a43a-4305-9095-5afb273af8be tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1723 microversion: 2.20 time: 0.265502 May 21 21:33:13.091070 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2474/5067] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:12 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:13.304149 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-135b7e9b-7429-4cda-a739-5ffd5db5ddaf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:13.313491 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-135b7e9b-7429-4cda-a739-5ffd5db5ddaf tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1520 microversion: 2.1 time: 0.315467 May 21 21:33:13.314454 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2594/5068] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:12 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:14.111018 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-97066410-22bd-4ce6-8b00-e03349dc36cd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:14.112352 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-97066410-22bd-4ce6-8b00-e03349dc36cd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:14.122179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=64 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:14.124611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-97066410-22bd-4ce6-8b00-e03349dc36cd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:14.133446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-97066410-22bd-4ce6-8b00-e03349dc36cd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:14.133446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-97066410-22bd-4ce6-8b00-e03349dc36cd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:14.133446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-97066410-22bd-4ce6-8b00-e03349dc36cd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:14.292834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-97066410-22bd-4ce6-8b00-e03349dc36cd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:14.306951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-97066410-22bd-4ce6-8b00-e03349dc36cd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:14.308856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-97066410-22bd-4ce6-8b00-e03349dc36cd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:14.311037 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-97066410-22bd-4ce6-8b00-e03349dc36cd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1723 microversion: 2.20 time: 0.206186 May 21 21:33:14.311863 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2475/5069] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:14 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:14.332556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c7d93561-017d-4924-818d-293c3118d42d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:14.333165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c7d93561-017d-4924-818d-293c3118d42d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:14.341213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7d93561-017d-4924-818d-293c3118d42d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:14.341683 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7d93561-017d-4924-818d-293c3118d42d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:14.342477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7d93561-017d-4924-818d-293c3118d42d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:14.342920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7d93561-017d-4924-818d-293c3118d42d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:14.522259 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c7d93561-017d-4924-818d-293c3118d42d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:14.531358 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c7d93561-017d-4924-818d-293c3118d42d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1520 microversion: 2.1 time: 0.202715 May 21 21:33:14.531940 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2595/5070] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:14 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:15.333303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-44d1f65a-8d2a-4117-9cac-4053e5f6d9ca tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:15.336136 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-44d1f65a-8d2a-4117-9cac-4053e5f6d9ca tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:15.343564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44d1f65a-8d2a-4117-9cac-4053e5f6d9ca tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:15.344029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44d1f65a-8d2a-4117-9cac-4053e5f6d9ca tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:15.344940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44d1f65a-8d2a-4117-9cac-4053e5f6d9ca tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:15.345713 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44d1f65a-8d2a-4117-9cac-4053e5f6d9ca tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:15.530627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-44d1f65a-8d2a-4117-9cac-4053e5f6d9ca tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:15.545937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-44d1f65a-8d2a-4117-9cac-4053e5f6d9ca tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:15.547619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-44d1f65a-8d2a-4117-9cac-4053e5f6d9ca tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:15.549051 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-44d1f65a-8d2a-4117-9cac-4053e5f6d9ca tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1723 microversion: 2.20 time: 0.219937 May 21 21:33:15.550228 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2476/5071] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:15 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:15.560709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2e901737-e904-48a5-a35f-867a50cddf94 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:15.561643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2e901737-e904-48a5-a35f-867a50cddf94 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:15.592477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2e901737-e904-48a5-a35f-867a50cddf94 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:15.593380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2e901737-e904-48a5-a35f-867a50cddf94 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:15.595449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2e901737-e904-48a5-a35f-867a50cddf94 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:15.595917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2e901737-e904-48a5-a35f-867a50cddf94 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:15.911001 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2e901737-e904-48a5-a35f-867a50cddf94 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:15.930140 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2e901737-e904-48a5-a35f-867a50cddf94 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1520 microversion: 2.1 time: 0.384707 May 21 21:33:15.937778 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2596/5072] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:15 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1520 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:33:16.567446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3f75d5f7-03ee-4877-aa40-897364fe6ff1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:16.568899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3f75d5f7-03ee-4877-aa40-897364fe6ff1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:16.578878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f75d5f7-03ee-4877-aa40-897364fe6ff1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:16.579569 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f75d5f7-03ee-4877-aa40-897364fe6ff1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:16.580568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f75d5f7-03ee-4877-aa40-897364fe6ff1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:16.581164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f75d5f7-03ee-4877-aa40-897364fe6ff1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:16.753323 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3f75d5f7-03ee-4877-aa40-897364fe6ff1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:16.766606 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3f75d5f7-03ee-4877-aa40-897364fe6ff1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:16.769449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3f75d5f7-03ee-4877-aa40-897364fe6ff1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:16.770898 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3f75d5f7-03ee-4877-aa40-897364fe6ff1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1723 microversion: 2.20 time: 0.207777 May 21 21:33:16.785422 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2477/5073] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:16 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:16.955220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-82958ff9-e9c9-4d3a-ba94-2795a4bdc180 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:16.956465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-82958ff9-e9c9-4d3a-ba94-2795a4bdc180 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:16.964625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82958ff9-e9c9-4d3a-ba94-2795a4bdc180 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:16.965339 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82958ff9-e9c9-4d3a-ba94-2795a4bdc180 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:16.966314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82958ff9-e9c9-4d3a-ba94-2795a4bdc180 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:16.966969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82958ff9-e9c9-4d3a-ba94-2795a4bdc180 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:17.191749 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-d52967ee-2f2e-45fd-85f1-4a933d17d7b8 req-458de0fc-b290-47f2-9831-5e98dee66fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7de5bb-0233-4e88-a1a0-8561385e53cd", "name": "network-vif-plugged", "status": "completed", "tag": "fc4ad2f3-98e9-42fc-81a3-7fc4fa986079"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:17.197850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-82958ff9-e9c9-4d3a-ba94-2795a4bdc180 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:17.201533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-d52967ee-2f2e-45fd-85f1-4a933d17d7b8 req-458de0fc-b290-47f2-9831-5e98dee66fe4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:17.204398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-d52967ee-2f2e-45fd-85f1-4a933d17d7b8 req-458de0fc-b290-47f2-9831-5e98dee66fe4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:17.215669 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-82958ff9-e9c9-4d3a-ba94-2795a4bdc180 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1520 microversion: 2.1 time: 0.263964 May 21 21:33:17.217245 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2597/5074] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:16 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:17.218734 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-d52967ee-2f2e-45fd-85f1-4a933d17d7b8 req-458de0fc-b290-47f2-9831-5e98dee66fe4 service nova] Creating event network-vif-plugged:fc4ad2f3-98e9-42fc-81a3-7fc4fa986079 for instance af7de5bb-0233-4e88-a1a0-8561385e53cd on nch1-master-1 May 21 21:33:17.229534 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-d52967ee-2f2e-45fd-85f1-4a933d17d7b8 req-458de0fc-b290-47f2-9831-5e98dee66fe4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041552 May 21 21:33:17.230968 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2478/5075] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:33:17.791567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-97b765a4-9efb-4abc-8dc7-dc443d21872b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:17.792187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-97b765a4-9efb-4abc-8dc7-dc443d21872b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:17.805279 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-97b765a4-9efb-4abc-8dc7-dc443d21872b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:17.810667 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-97b765a4-9efb-4abc-8dc7-dc443d21872b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:17.812298 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-97b765a4-9efb-4abc-8dc7-dc443d21872b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:17.814498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-97b765a4-9efb-4abc-8dc7-dc443d21872b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:18.098215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-97b765a4-9efb-4abc-8dc7-dc443d21872b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:18.114369 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-97b765a4-9efb-4abc-8dc7-dc443d21872b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:18.116059 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-97b765a4-9efb-4abc-8dc7-dc443d21872b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:18.118772 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-97b765a4-9efb-4abc-8dc7-dc443d21872b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1723 microversion: 2.20 time: 0.331224 May 21 21:33:18.120065 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2598/5076] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:17 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1723 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:33:18.237355 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6d9068dd-27b1-4ead-82c3-398993f90707 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:18.238745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6d9068dd-27b1-4ead-82c3-398993f90707 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:18.249031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d9068dd-27b1-4ead-82c3-398993f90707 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:18.249497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d9068dd-27b1-4ead-82c3-398993f90707 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:18.250305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d9068dd-27b1-4ead-82c3-398993f90707 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:18.250753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d9068dd-27b1-4ead-82c3-398993f90707 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:18.503667 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6d9068dd-27b1-4ead-82c3-398993f90707 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:18.515158 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6d9068dd-27b1-4ead-82c3-398993f90707 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1520 microversion: 2.1 time: 0.285448 May 21 21:33:18.516076 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2479/5077] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:18 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:19.139636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-84ea15b6-d4b9-42ac-a497-d0aca1d15df3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:19.142840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-84ea15b6-d4b9-42ac-a497-d0aca1d15df3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:19.153714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84ea15b6-d4b9-42ac-a497-d0aca1d15df3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:19.156380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84ea15b6-d4b9-42ac-a497-d0aca1d15df3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:19.157306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84ea15b6-d4b9-42ac-a497-d0aca1d15df3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:19.157765 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84ea15b6-d4b9-42ac-a497-d0aca1d15df3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:19.479801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-84ea15b6-d4b9-42ac-a497-d0aca1d15df3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:19.505517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-84ea15b6-d4b9-42ac-a497-d0aca1d15df3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:19.508727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-84ea15b6-d4b9-42ac-a497-d0aca1d15df3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:19.510348 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-84ea15b6-d4b9-42ac-a497-d0aca1d15df3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1744 microversion: 2.20 time: 0.376355 May 21 21:33:19.512139 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2599/5078] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:19 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1744 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:19.536814 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b598aabb-a81c-4f20-b902-41d36588606e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:19.538272 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b598aabb-a81c-4f20-b902-41d36588606e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:19.548078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b598aabb-a81c-4f20-b902-41d36588606e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:19.548669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b598aabb-a81c-4f20-b902-41d36588606e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:19.549607 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b598aabb-a81c-4f20-b902-41d36588606e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:19.550065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b598aabb-a81c-4f20-b902-41d36588606e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:19.752018 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b598aabb-a81c-4f20-b902-41d36588606e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:19.765183 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b598aabb-a81c-4f20-b902-41d36588606e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1520 microversion: 2.1 time: 0.232184 May 21 21:33:19.765972 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2480/5079] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:19 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:20.530333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1a9f67b0-a32a-44b2-a6ed-6d96d6293ce1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:20.530965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1a9f67b0-a32a-44b2-a6ed-6d96d6293ce1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:20.538655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a9f67b0-a32a-44b2-a6ed-6d96d6293ce1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:20.539809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a9f67b0-a32a-44b2-a6ed-6d96d6293ce1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:20.540821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a9f67b0-a32a-44b2-a6ed-6d96d6293ce1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:20.541429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a9f67b0-a32a-44b2-a6ed-6d96d6293ce1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:20.783145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-20027370-1042-435b-acb2-ab6d86d702b6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:20.783793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-20027370-1042-435b-acb2-ab6d86d702b6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:20.791373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20027370-1042-435b-acb2-ab6d86d702b6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:20.792078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20027370-1042-435b-acb2-ab6d86d702b6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:20.793070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20027370-1042-435b-acb2-ab6d86d702b6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:20.793526 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20027370-1042-435b-acb2-ab6d86d702b6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:20.799636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1a9f67b0-a32a-44b2-a6ed-6d96d6293ce1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:20.812183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1a9f67b0-a32a-44b2-a6ed-6d96d6293ce1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:20.814299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1a9f67b0-a32a-44b2-a6ed-6d96d6293ce1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:20.815928 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1a9f67b0-a32a-44b2-a6ed-6d96d6293ce1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1744 microversion: 2.20 time: 0.289567 May 21 21:33:20.816832 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2600/5080] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:20 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1744 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:21.020020 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-20027370-1042-435b-acb2-ab6d86d702b6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:21.030916 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-20027370-1042-435b-acb2-ab6d86d702b6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.251806 May 21 21:33:21.035074 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2481/5081] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:20 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:33:21.053299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f94ea295-fb01-47d8-bb73-4f52132e1030 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:21.055230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f94ea295-fb01-47d8-bb73-4f52132e1030 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:21.072443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f94ea295-fb01-47d8-bb73-4f52132e1030 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:21.072917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f94ea295-fb01-47d8-bb73-4f52132e1030 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:21.073941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f94ea295-fb01-47d8-bb73-4f52132e1030 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:21.074396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f94ea295-fb01-47d8-bb73-4f52132e1030 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:21.413176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f94ea295-fb01-47d8-bb73-4f52132e1030 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:21.431833 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f94ea295-fb01-47d8-bb73-4f52132e1030 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.382089 May 21 21:33:21.432656 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2601/5082] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:21 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:21.461492 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1c7adcd6-3a04-46cf-9438-749eeb67bee6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:21.462408 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1c7adcd6-3a04-46cf-9438-749eeb67bee6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:21.468720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1c7adcd6-3a04-46cf-9438-749eeb67bee6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:21.469199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1c7adcd6-3a04-46cf-9438-749eeb67bee6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:21.470030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1c7adcd6-3a04-46cf-9438-749eeb67bee6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:21.470478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1c7adcd6-3a04-46cf-9438-749eeb67bee6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:21.492323 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:21.658030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1c7adcd6-3a04-46cf-9438-749eeb67bee6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:21.667637 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1c7adcd6-3a04-46cf-9438-749eeb67bee6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.210938 May 21 21:33:21.669817 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2482/5083] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:21 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:21.691982 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bafd49dd-6027-4c1d-bff3-559a9964e7dc tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:21.702398 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-bafd49dd-6027-4c1d-bff3-559a9964e7dc tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance 58bf1ae3-8050-4775-8a29-a65242c2a2f6 has no mapping to a cell. May 21 21:33:21.702770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-82cd2790-02d2-40f9-9fb3-bcacff16069f req-984a9784-bcc7-407d-8b08-4e2006ccc7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc27a082-c144-436f-bd21-e8126e00db6c", "name": "network-vif-plugged", "status": "completed", "tag": "b4925385-7716-4fd9-99c7-de6cabe49d7f"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:21.721150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-82cd2790-02d2-40f9-9fb3-bcacff16069f req-984a9784-bcc7-407d-8b08-4e2006ccc7d6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:21.721150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-82cd2790-02d2-40f9-9fb3-bcacff16069f req-984a9784-bcc7-407d-8b08-4e2006ccc7d6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bafd49dd-6027-4c1d-bff3-559a9964e7dc tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/58bf1ae3-8050-4775-8a29-a65242c2a2f6/action HTTP/1.1 May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 15 May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: {"os-stop": {}} May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 58bf1ae3-8050-4775-8a29-a65242c2a2f6 has no mapping to a cell. May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '58bf1ae3-8050-4775-8a29-a65242c2a2f6', 'body': {'os-stop': {}}} May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 58bf1ae3-8050-4775-8a29-a65242c2a2f6 has no mapping to a cell. May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 21 21:33:21.723599 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58bf1ae3-8050-4775-8a29-a65242c2a2f6 has no mapping to a cell. May 21 21:33:21.729489 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:21.729489 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:21.729489 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:21.729489 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:21.729489 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:21.729489 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:21.729489 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:33:21.729489 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:33:21.729489 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58bf1ae3-8050-4775-8a29-a65242c2a2f6 has no mapping to a cell. May 21 21:33:21.729489 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:21.729489 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bafd49dd-6027-4c1d-bff3-559a9964e7dc tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance 58bf1ae3-8050-4775-8a29-a65242c2a2f6 has no mapping to a cell. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:33:21.729489 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bafd49dd-6027-4c1d-bff3-559a9964e7dc tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/58bf1ae3-8050-4775-8a29-a65242c2a2f6/action" status: 404 len: 117 microversion: 2.1 time: 0.041890 May 21 21:33:21.729489 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2602/5084] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:33:21 2022] POST /compute/v2.1/servers/58bf1ae3-8050-4775-8a29-a65242c2a2f6/action => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:33:21.732373 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-82cd2790-02d2-40f9-9fb3-bcacff16069f req-984a9784-bcc7-407d-8b08-4e2006ccc7d6 service nova] Creating event network-vif-plugged:b4925385-7716-4fd9-99c7-de6cabe49d7f for instance cc27a082-c144-436f-bd21-e8126e00db6c on nch2-master-1 May 21 21:33:21.738047 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-82cd2790-02d2-40f9-9fb3-bcacff16069f req-984a9784-bcc7-407d-8b08-4e2006ccc7d6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044241 May 21 21:33:21.738698 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2483/5085] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:33:21.742493 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-643d2fed-4aec-4b94-95a1-d7ed656c3193 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:21.744655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-643d2fed-4aec-4b94-95a1-d7ed656c3193 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:21.753159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-643d2fed-4aec-4b94-95a1-d7ed656c3193 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:21.753872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-643d2fed-4aec-4b94-95a1-d7ed656c3193 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:21.754749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-643d2fed-4aec-4b94-95a1-d7ed656c3193 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:21.755267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-643d2fed-4aec-4b94-95a1-d7ed656c3193 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:21.837083 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e3260e84-9930-46d5-b968-aabe4759cd9a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:21.838012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e3260e84-9930-46d5-b968-aabe4759cd9a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:21.850464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3260e84-9930-46d5-b968-aabe4759cd9a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:21.852338 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3260e84-9930-46d5-b968-aabe4759cd9a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:21.853416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3260e84-9930-46d5-b968-aabe4759cd9a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:21.854124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e3260e84-9930-46d5-b968-aabe4759cd9a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:22.084370 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e3260e84-9930-46d5-b968-aabe4759cd9a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:22.099284 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e3260e84-9930-46d5-b968-aabe4759cd9a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:22.101221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e3260e84-9930-46d5-b968-aabe4759cd9a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:22.102864 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e3260e84-9930-46d5-b968-aabe4759cd9a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1739 microversion: 2.20 time: 0.271513 May 21 21:33:22.104751 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2484/5086] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:21 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1739 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:33:22.185353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-643d2fed-4aec-4b94-95a1-d7ed656c3193 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:22.193756 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-643d2fed-4aec-4b94-95a1-d7ed656c3193 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.460203 May 21 21:33:22.197356 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2603/5087] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:21 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:22.221161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-57a8513a-80dc-45a9-abaa-8ebca30fb934 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:22.222071 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-57a8513a-80dc-45a9-abaa-8ebca30fb934 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:22.231404 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-57a8513a-80dc-45a9-abaa-8ebca30fb934 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:22.232122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-57a8513a-80dc-45a9-abaa-8ebca30fb934 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:22.232947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-57a8513a-80dc-45a9-abaa-8ebca30fb934 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:22.233391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-57a8513a-80dc-45a9-abaa-8ebca30fb934 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:22.548719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-57a8513a-80dc-45a9-abaa-8ebca30fb934 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:22.560867 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-57a8513a-80dc-45a9-abaa-8ebca30fb934 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.346893 May 21 21:33:22.562831 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2485/5088] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:22 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:33:22.580336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-60347bbc-0113-4e88-ad94-51bb36bce0e9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:22.581187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-60347bbc-0113-4e88-ad94-51bb36bce0e9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 37e680df-9bdc-4bf0-9453-262394a9e714] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:22.598363 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-60347bbc-0113-4e88-ad94-51bb36bce0e9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance 37e680df-9bdc-4bf0-9453-262394a9e714 could not be found. May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-60347bbc-0113-4e88-ad94-51bb36bce0e9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/37e680df-9bdc-4bf0-9453-262394a9e714/action HTTP/1.1 May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 15 May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: {"suspend": {}} May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 37e680df-9bdc-4bf0-9453-262394a9e714 could not be found. May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '37e680df-9bdc-4bf0-9453-262394a9e714', 'body': {'suspend': {}}} May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37e680df-9bdc-4bf0-9453-262394a9e714 could not be found. May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37e680df-9bdc-4bf0-9453-262394a9e714 could not be found. May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:22.600242 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:22.605234 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:33:22.605234 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:33:22.605234 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37e680df-9bdc-4bf0-9453-262394a9e714 could not be found. May 21 21:33:22.605234 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:22.605768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-60347bbc-0113-4e88-ad94-51bb36bce0e9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance 37e680df-9bdc-4bf0-9453-262394a9e714 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:33:22.607682 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-60347bbc-0113-4e88-ad94-51bb36bce0e9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/37e680df-9bdc-4bf0-9453-262394a9e714/action" status: 404 len: 111 microversion: 2.1 time: 0.031836 May 21 21:33:22.612930 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2604/5089] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:33:22 2022] POST /compute/v2.1/servers/37e680df-9bdc-4bf0-9453-262394a9e714/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:33:22.623456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ca6ab18e-eb9b-4086-9106-1c8eb2388af4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:22.624391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ca6ab18e-eb9b-4086-9106-1c8eb2388af4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:22.643019 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca6ab18e-eb9b-4086-9106-1c8eb2388af4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:22.645840 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca6ab18e-eb9b-4086-9106-1c8eb2388af4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:22.646956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca6ab18e-eb9b-4086-9106-1c8eb2388af4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:22.648586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca6ab18e-eb9b-4086-9106-1c8eb2388af4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:23.005622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ca6ab18e-eb9b-4086-9106-1c8eb2388af4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:23.032268 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ca6ab18e-eb9b-4086-9106-1c8eb2388af4 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.415014 May 21 21:33:23.033874 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2486/5090] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:22 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:23.051097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4d3ee85b-36d4-4751-b120-c0f7db707a69 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:23.052421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4d3ee85b-36d4-4751-b120-c0f7db707a69 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:23.067985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d3ee85b-36d4-4751-b120-c0f7db707a69 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:23.071249 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d3ee85b-36d4-4751-b120-c0f7db707a69 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:23.072274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d3ee85b-36d4-4751-b120-c0f7db707a69 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:23.074567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d3ee85b-36d4-4751-b120-c0f7db707a69 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:23.125208 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d3809cdd-3f7a-468e-9ae6-6011cb41a260 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:23.126258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d3809cdd-3f7a-468e-9ae6-6011cb41a260 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:23.143223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3809cdd-3f7a-468e-9ae6-6011cb41a260 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:23.148707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3809cdd-3f7a-468e-9ae6-6011cb41a260 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:23.167698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3809cdd-3f7a-468e-9ae6-6011cb41a260 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:23.167698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3809cdd-3f7a-468e-9ae6-6011cb41a260 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:23.414561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4d3ee85b-36d4-4751-b120-c0f7db707a69 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:23.423368 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4d3ee85b-36d4-4751-b120-c0f7db707a69 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.376199 May 21 21:33:23.432695 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2605/5091] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:23 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:23.445415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9717cbed-d6a2-4605-acd8-dd692cd4b6df tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:23.446278 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9717cbed-d6a2-4605-acd8-dd692cd4b6df tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:23.453556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9717cbed-d6a2-4605-acd8-dd692cd4b6df tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:23.454355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9717cbed-d6a2-4605-acd8-dd692cd4b6df tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:23.455378 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9717cbed-d6a2-4605-acd8-dd692cd4b6df tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:23.457627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9717cbed-d6a2-4605-acd8-dd692cd4b6df tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:23.483655 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d3809cdd-3f7a-468e-9ae6-6011cb41a260 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:23.498702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d3809cdd-3f7a-468e-9ae6-6011cb41a260 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:23.501723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-9717cbed-d6a2-4605-acd8-dd692cd4b6df tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lazy-loading 'flavor' on Instance uuid af7de5bb-0233-4e88-a1a0-8561385e53cd {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:33:23.503549 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d3809cdd-3f7a-468e-9ae6-6011cb41a260 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:23.506640 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d3809cdd-3f7a-468e-9ae6-6011cb41a260 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1739 microversion: 2.20 time: 0.387958 May 21 21:33:23.514745 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2487/5092] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:23 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1739 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:23.714241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:23.935553 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9717cbed-d6a2-4605-acd8-dd692cd4b6df tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action" status: 202 len: 0 microversion: 2.1 time: 0.494519 May 21 21:33:23.936814 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2606/5093] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:33:23 2022] POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:33:23.949081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-40602729-5742-4563-aec0-1049d63231b2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:23.950486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-40602729-5742-4563-aec0-1049d63231b2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:23.962412 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40602729-5742-4563-aec0-1049d63231b2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:23.965289 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40602729-5742-4563-aec0-1049d63231b2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:23.968360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40602729-5742-4563-aec0-1049d63231b2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:23.969056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40602729-5742-4563-aec0-1049d63231b2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:24.246340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-40602729-5742-4563-aec0-1049d63231b2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:24.256962 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-40602729-5742-4563-aec0-1049d63231b2 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1515 microversion: 2.1 time: 0.312492 May 21 21:33:24.271483 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2488/5094] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:23 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1515 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:24.544191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a17c6078-2943-4bc7-9e91-508bce4ce088 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:24.545869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a17c6078-2943-4bc7-9e91-508bce4ce088 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:24.561864 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a17c6078-2943-4bc7-9e91-508bce4ce088 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:24.580811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a17c6078-2943-4bc7-9e91-508bce4ce088 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:24.582821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a17c6078-2943-4bc7-9e91-508bce4ce088 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:24.586996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a17c6078-2943-4bc7-9e91-508bce4ce088 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:25.282820 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a7c19e60-bb16-4f7e-9e28-02270f96af7b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:25.283716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a7c19e60-bb16-4f7e-9e28-02270f96af7b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:25.306996 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7c19e60-bb16-4f7e-9e28-02270f96af7b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:25.309075 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7c19e60-bb16-4f7e-9e28-02270f96af7b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:25.314505 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7c19e60-bb16-4f7e-9e28-02270f96af7b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:25.315476 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a7c19e60-bb16-4f7e-9e28-02270f96af7b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:25.620754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a17c6078-2943-4bc7-9e91-508bce4ce088 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:25.655725 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a17c6078-2943-4bc7-9e91-508bce4ce088 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:25.660015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a17c6078-2943-4bc7-9e91-508bce4ce088 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:25.674698 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a17c6078-2943-4bc7-9e91-508bce4ce088 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1739 microversion: 2.20 time: 1.145038 May 21 21:33:25.675513 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2607/5095] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:24 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1739 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:25.685587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a7c19e60-bb16-4f7e-9e28-02270f96af7b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:25.697511 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a7c19e60-bb16-4f7e-9e28-02270f96af7b tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1498 microversion: 2.1 time: 0.422996 May 21 21:33:25.698111 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2489/5096] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:25 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1498 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:25.718516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-28c98da8-4a10-49c4-94dc-dc9ad6cd8dc6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:25.720173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-28c98da8-4a10-49c4-94dc-dc9ad6cd8dc6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:25.728427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-28c98da8-4a10-49c4-94dc-dc9ad6cd8dc6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:25.730815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-28c98da8-4a10-49c4-94dc-dc9ad6cd8dc6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:25.732396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-28c98da8-4a10-49c4-94dc-dc9ad6cd8dc6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:25.734614 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-28c98da8-4a10-49c4-94dc-dc9ad6cd8dc6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:25.768052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-28c98da8-4a10-49c4-94dc-dc9ad6cd8dc6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lazy-loading 'flavor' on Instance uuid af7de5bb-0233-4e88-a1a0-8561385e53cd {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:33:25.787042 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-28c98da8-4a10-49c4-94dc-dc9ad6cd8dc6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Cannot 'suspend' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state suspended May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-28c98da8-4a10-49c4-94dc-dc9ad6cd8dc6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action HTTP/1.1 May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 15 May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: {"suspend": {}} May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: exception: Cannot 'suspend' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state suspended May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'af7de5bb-0233-4e88-a1a0-8561385e53cd', 'body': {'suspend': {}}} May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance af7de5bb-0233-4e88-a1a0-8561385e53cd in vm_state suspended. Cannot suspend while the instance is in this state. May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend May 21 21:33:25.790992 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 21 21:33:25.799963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 21 21:33:25.799963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 21 21:33:25.799963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state suspended May 21 21:33:25.799963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:25.799963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:25.799963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:25.799963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:25.799963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:25.799963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:25.799963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:33:25.799963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:33:25.799963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state suspended May 21 21:33:25.799963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:25.805620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-28c98da8-4a10-49c4-94dc-dc9ad6cd8dc6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 409 to user: Cannot 'suspend' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state suspended {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:33:25.809397 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-28c98da8-4a10-49c4-94dc-dc9ad6cd8dc6 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action" status: 409 len: 148 microversion: 2.1 time: 0.094286 May 21 21:33:25.809397 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2608/5097] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:33:25 2022] POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action => generated 148 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 21 21:33:25.815987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8cbebc22-a958-4f39-a3ab-38c36dc0b000 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:25.817481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8cbebc22-a958-4f39-a3ab-38c36dc0b000 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:25.830692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8cbebc22-a958-4f39-a3ab-38c36dc0b000 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:25.831321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8cbebc22-a958-4f39-a3ab-38c36dc0b000 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:25.832231 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8cbebc22-a958-4f39-a3ab-38c36dc0b000 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:25.833436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8cbebc22-a958-4f39-a3ab-38c36dc0b000 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:26.219740 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8cbebc22-a958-4f39-a3ab-38c36dc0b000 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action" status: 202 len: 0 microversion: 2.1 time: 0.407330 May 21 21:33:26.223834 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2490/5098] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:33:25 2022] POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:33:26.235491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a96e87ed-2a8c-4cf2-b9d0-7a67d7e6f8cd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:26.238059 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a96e87ed-2a8c-4cf2-b9d0-7a67d7e6f8cd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:26.265203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a96e87ed-2a8c-4cf2-b9d0-7a67d7e6f8cd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:26.267098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a96e87ed-2a8c-4cf2-b9d0-7a67d7e6f8cd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:26.268508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a96e87ed-2a8c-4cf2-b9d0-7a67d7e6f8cd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:26.271516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a96e87ed-2a8c-4cf2-b9d0-7a67d7e6f8cd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:26.694392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-694f60a7-193a-4313-bc4f-1bde650dffe6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:26.696309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-694f60a7-193a-4313-bc4f-1bde650dffe6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:26.707507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-694f60a7-193a-4313-bc4f-1bde650dffe6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:26.715652 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-694f60a7-193a-4313-bc4f-1bde650dffe6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:26.723798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-694f60a7-193a-4313-bc4f-1bde650dffe6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:26.724559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-694f60a7-193a-4313-bc4f-1bde650dffe6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:26.831597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a96e87ed-2a8c-4cf2-b9d0-7a67d7e6f8cd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:26.852476 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a96e87ed-2a8c-4cf2-b9d0-7a67d7e6f8cd tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1504 microversion: 2.1 time: 0.626527 May 21 21:33:26.859801 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2609/5099] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:26 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1504 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:27.282082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-694f60a7-193a-4313-bc4f-1bde650dffe6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:27.292696 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-694f60a7-193a-4313-bc4f-1bde650dffe6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:27.294712 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-694f60a7-193a-4313-bc4f-1bde650dffe6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:27.296091 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-694f60a7-193a-4313-bc4f-1bde650dffe6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1739 microversion: 2.20 time: 0.606134 May 21 21:33:27.296789 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2491/5100] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:26 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1739 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:33:27.445933 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 21:33:27.452462 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 21:33:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 21:33:27.887892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cdac64c9-bf96-4101-8056-c7586468f25d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:27.889256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cdac64c9-bf96-4101-8056-c7586468f25d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:27.899754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdac64c9-bf96-4101-8056-c7586468f25d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:27.900640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdac64c9-bf96-4101-8056-c7586468f25d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:27.904910 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdac64c9-bf96-4101-8056-c7586468f25d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:27.904910 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cdac64c9-bf96-4101-8056-c7586468f25d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:28.202965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cdac64c9-bf96-4101-8056-c7586468f25d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:28.229200 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cdac64c9-bf96-4101-8056-c7586468f25d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1504 microversion: 2.1 time: 0.350564 May 21 21:33:28.244580 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2610/5101] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:27 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1504 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:28.324717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8b2e6d7f-801c-4e87-ba58-f9b368e83c9a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:28.326166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8b2e6d7f-801c-4e87-ba58-f9b368e83c9a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:28.335104 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b2e6d7f-801c-4e87-ba58-f9b368e83c9a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:28.336526 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b2e6d7f-801c-4e87-ba58-f9b368e83c9a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:28.337509 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b2e6d7f-801c-4e87-ba58-f9b368e83c9a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:28.338128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8b2e6d7f-801c-4e87-ba58-f9b368e83c9a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:28.604820 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8b2e6d7f-801c-4e87-ba58-f9b368e83c9a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:28.631813 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8b2e6d7f-801c-4e87-ba58-f9b368e83c9a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:28.635127 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8b2e6d7f-801c-4e87-ba58-f9b368e83c9a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:28.639102 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8b2e6d7f-801c-4e87-ba58-f9b368e83c9a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1739 microversion: 2.20 time: 0.323983 May 21 21:33:28.640923 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2492/5102] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:28 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1739 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:29.255659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b1739987-9bad-46da-a09e-7bccf81b189f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:29.258152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b1739987-9bad-46da-a09e-7bccf81b189f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:29.265114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1739987-9bad-46da-a09e-7bccf81b189f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:29.265562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1739987-9bad-46da-a09e-7bccf81b189f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:29.266346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1739987-9bad-46da-a09e-7bccf81b189f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:29.266797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1739987-9bad-46da-a09e-7bccf81b189f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:29.669009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b1739987-9bad-46da-a09e-7bccf81b189f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:29.672483 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-62b0aa57-7d6e-435d-9fcd-6762d7341920 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:29.673944 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-62b0aa57-7d6e-435d-9fcd-6762d7341920 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:29.681040 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b1739987-9bad-46da-a09e-7bccf81b189f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.428569 May 21 21:33:29.695360 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2611/5103] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:29 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:29.700189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62b0aa57-7d6e-435d-9fcd-6762d7341920 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:29.700687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62b0aa57-7d6e-435d-9fcd-6762d7341920 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:29.701497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62b0aa57-7d6e-435d-9fcd-6762d7341920 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:29.701979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62b0aa57-7d6e-435d-9fcd-6762d7341920 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:29.709017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8fd99f37-f931-4e04-b252-c9c28403dd6a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:29.712787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8fd99f37-f931-4e04-b252-c9c28403dd6a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:29.737869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8fd99f37-f931-4e04-b252-c9c28403dd6a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:29.737869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8fd99f37-f931-4e04-b252-c9c28403dd6a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:29.737869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8fd99f37-f931-4e04-b252-c9c28403dd6a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:29.738889 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8fd99f37-f931-4e04-b252-c9c28403dd6a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:29.939644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-62b0aa57-7d6e-435d-9fcd-6762d7341920 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:29.950343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-62b0aa57-7d6e-435d-9fcd-6762d7341920 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:29.952006 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-62b0aa57-7d6e-435d-9fcd-6762d7341920 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:29.953373 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-62b0aa57-7d6e-435d-9fcd-6762d7341920 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1739 microversion: 2.20 time: 0.297788 May 21 21:33:29.953947 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2493/5104] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:29 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1739 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:29.962865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e09c2f95-1b1d-4851-8a4f-df6e09aaac97 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:29.965262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e09c2f95-1b1d-4851-8a4f-df6e09aaac97 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:29.971790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e09c2f95-1b1d-4851-8a4f-df6e09aaac97 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:29.972718 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e09c2f95-1b1d-4851-8a4f-df6e09aaac97 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:29.974360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e09c2f95-1b1d-4851-8a4f-df6e09aaac97 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:29.974984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e09c2f95-1b1d-4851-8a4f-df6e09aaac97 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:30.083226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-e09c2f95-1b1d-4851-8a4f-df6e09aaac97 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lazy-loading 'services' on Instance uuid 54e8b13e-d6b2-467c-b801-2b0ad45e95ae {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:33:30.122140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8fd99f37-f931-4e04-b252-c9c28403dd6a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:30.130666 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8fd99f37-f931-4e04-b252-c9c28403dd6a tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.431570 May 21 21:33:30.132082 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2612/5105] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:29 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:30.151290 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-469dabc4-2275-4ffa-bf3b-b86ca7f52819 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:30.152322 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-469dabc4-2275-4ffa-bf3b-b86ca7f52819 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 6d149423-3b90-4587-8a8a-54fb59b0ace7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:30.163497 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-469dabc4-2275-4ffa-bf3b-b86ca7f52819 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance 6d149423-3b90-4587-8a8a-54fb59b0ace7 could not be found. May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-469dabc4-2275-4ffa-bf3b-b86ca7f52819 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/6d149423-3b90-4587-8a8a-54fb59b0ace7/action HTTP/1.1 May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 15 May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: {"unpause": {}} May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 6d149423-3b90-4587-8a8a-54fb59b0ace7 could not be found. May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '6d149423-3b90-4587-8a8a-54fb59b0ace7', 'body': {'unpause': {}}} May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d149423-3b90-4587-8a8a-54fb59b0ace7 could not be found. May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d149423-3b90-4587-8a8a-54fb59b0ace7 could not be found. May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:30.165412 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:30.178949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:33:30.178949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:33:30.178949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d149423-3b90-4587-8a8a-54fb59b0ace7 could not be found. May 21 21:33:30.178949 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:30.178949 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-469dabc4-2275-4ffa-bf3b-b86ca7f52819 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance 6d149423-3b90-4587-8a8a-54fb59b0ace7 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:33:30.178949 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-469dabc4-2275-4ffa-bf3b-b86ca7f52819 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/6d149423-3b90-4587-8a8a-54fb59b0ace7/action" status: 404 len: 111 microversion: 2.1 time: 0.020847 May 21 21:33:30.178949 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2613/5106] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:33:30 2022] POST /compute/v2.1/servers/6d149423-3b90-4587-8a8a-54fb59b0ace7/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:33:30.183404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-761ac983-d2ba-4e48-8154-d449f3fd338f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:30.184246 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-761ac983-d2ba-4e48-8154-d449f3fd338f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:30.192534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-761ac983-d2ba-4e48-8154-d449f3fd338f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:30.193430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-761ac983-d2ba-4e48-8154-d449f3fd338f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:30.195182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-761ac983-d2ba-4e48-8154-d449f3fd338f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:30.195840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-761ac983-d2ba-4e48-8154-d449f3fd338f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:30.348498 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e09c2f95-1b1d-4851-8a4f-df6e09aaac97 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "DELETE /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae/os-volume_attachments/b0b1920b-8151-4e90-ac66-f993da5e7e8e" status: 202 len: 0 microversion: 2.1 time: 0.390776 May 21 21:33:30.351451 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2494/5107] 10.222.0.49 () {58 vars in 1415 bytes} [Sat May 21 21:33:29 2022] DELETE /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae/os-volume_attachments/b0b1920b-8151-4e90-ac66-f993da5e7e8e => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:33:30.367867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-32e2d916-2e59-499a-b72c-a6705f461186 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:30.374739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-32e2d916-2e59-499a-b72c-a6705f461186 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:30.402586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32e2d916-2e59-499a-b72c-a6705f461186 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:30.403064 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32e2d916-2e59-499a-b72c-a6705f461186 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:30.403885 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32e2d916-2e59-499a-b72c-a6705f461186 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:30.406905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32e2d916-2e59-499a-b72c-a6705f461186 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:30.558166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-761ac983-d2ba-4e48-8154-d449f3fd338f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:30.567799 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-32e2d916-2e59-499a-b72c-a6705f461186 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205894 May 21 21:33:30.570431 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2495/5108] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:33:30 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:33:30.591198 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-761ac983-d2ba-4e48-8154-d449f3fd338f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.417621 May 21 21:33:30.593587 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2614/5109] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:30 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:30.614401 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-be621d40-b0f3-4d91-be0f-55f8f9fddc7e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:30.618248 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-be621d40-b0f3-4d91-be0f-55f8f9fddc7e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:30.633297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be621d40-b0f3-4d91-be0f-55f8f9fddc7e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:30.634936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be621d40-b0f3-4d91-be0f-55f8f9fddc7e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:30.641106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be621d40-b0f3-4d91-be0f-55f8f9fddc7e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:30.641106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be621d40-b0f3-4d91-be0f-55f8f9fddc7e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:30.971782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-02e72351-d7dc-4272-8573-8ded605bec8e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:30.972940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-02e72351-d7dc-4272-8573-8ded605bec8e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:30.988066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02e72351-d7dc-4272-8573-8ded605bec8e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:30.988915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02e72351-d7dc-4272-8573-8ded605bec8e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:30.989962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02e72351-d7dc-4272-8573-8ded605bec8e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:30.990766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02e72351-d7dc-4272-8573-8ded605bec8e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:31.032497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-be621d40-b0f3-4d91-be0f-55f8f9fddc7e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:31.048053 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-be621d40-b0f3-4d91-be0f-55f8f9fddc7e tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.438406 May 21 21:33:31.053317 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2496/5110] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:30 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:31.069146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a1db2998-be90-403d-a77c-8fb7bb615a00 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:31.070107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a1db2998-be90-403d-a77c-8fb7bb615a00 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:31.085113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a1db2998-be90-403d-a77c-8fb7bb615a00 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:31.094984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a1db2998-be90-403d-a77c-8fb7bb615a00 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:31.100665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a1db2998-be90-403d-a77c-8fb7bb615a00 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:31.101490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a1db2998-be90-403d-a77c-8fb7bb615a00 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:31.160260 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-a1db2998-be90-403d-a77c-8fb7bb615a00 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Cannot 'unpause' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state active May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a1db2998-be90-403d-a77c-8fb7bb615a00 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action HTTP/1.1 May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 15 May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: {"unpause": {}} May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: exception: Cannot 'unpause' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state active May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'af7de5bb-0233-4e88-a1a0-8561385e53cd', 'body': {'unpause': {}}} May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance af7de5bb-0233-4e88-a1a0-8561385e53cd in vm_state active. Cannot unpause while the instance is in this state. May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state active May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:31.162142 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:31.168296 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:31.168296 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:33:31.168296 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:33:31.168296 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state active May 21 21:33:31.168296 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:31.168296 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a1db2998-be90-403d-a77c-8fb7bb615a00 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 409 to user: Cannot 'unpause' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state active {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:33:31.168296 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a1db2998-be90-403d-a77c-8fb7bb615a00 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action" status: 409 len: 145 microversion: 2.1 time: 0.098776 May 21 21:33:31.168296 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2497/5111] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:33:31 2022] POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action => generated 145 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 21 21:33:31.172841 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4bbaa02e-0ec0-4030-8700-3dcb456dcbb0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:31.173477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4bbaa02e-0ec0-4030-8700-3dcb456dcbb0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:31.190539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bbaa02e-0ec0-4030-8700-3dcb456dcbb0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:31.191265 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bbaa02e-0ec0-4030-8700-3dcb456dcbb0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:31.192257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bbaa02e-0ec0-4030-8700-3dcb456dcbb0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:31.198464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bbaa02e-0ec0-4030-8700-3dcb456dcbb0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:31.243414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:31.325007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-02e72351-d7dc-4272-8573-8ded605bec8e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:31.337200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-02e72351-d7dc-4272-8573-8ded605bec8e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:31.338860 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-02e72351-d7dc-4272-8573-8ded605bec8e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:31.340644 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-02e72351-d7dc-4272-8573-8ded605bec8e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1739 microversion: 2.20 time: 0.373232 May 21 21:33:31.353883 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2615/5112] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:30 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1739 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:33:31.568835 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4bbaa02e-0ec0-4030-8700-3dcb456dcbb0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:31.581865 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4bbaa02e-0ec0-4030-8700-3dcb456dcbb0 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.407965 May 21 21:33:31.594385 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2498/5113] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:31 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:31.597032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7d6ba365-a074-4540-b246-b9f2dbfd53cd tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:31.599148 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7d6ba365-a074-4540-b246-b9f2dbfd53cd tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:31.604701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8e0e1640-f243-4573-be2b-507e479cdd68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:31.605241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8e0e1640-f243-4573-be2b-507e479cdd68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:31.608148 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7d6ba365-a074-4540-b246-b9f2dbfd53cd tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:31.608863 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7d6ba365-a074-4540-b246-b9f2dbfd53cd tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:31.610066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7d6ba365-a074-4540-b246-b9f2dbfd53cd tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:31.610659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7d6ba365-a074-4540-b246-b9f2dbfd53cd tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:31.621677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e0e1640-f243-4573-be2b-507e479cdd68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:31.622137 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e0e1640-f243-4573-be2b-507e479cdd68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:31.622928 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e0e1640-f243-4573-be2b-507e479cdd68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:31.626094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e0e1640-f243-4573-be2b-507e479cdd68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:31.732719 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7d6ba365-a074-4540-b246-b9f2dbfd53cd tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084648 May 21 21:33:31.732719 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2616/5114] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:33:31 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:33:31.818643 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8e0e1640-f243-4573-be2b-507e479cdd68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:31.829154 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8e0e1640-f243-4573-be2b-507e479cdd68 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.228937 May 21 21:33:31.830142 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2499/5115] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:31 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:33:31.848649 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0ea097a8-161c-48b4-b6cd-d3d1b9aafff8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:31.849679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0ea097a8-161c-48b4-b6cd-d3d1b9aafff8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 86c9c9cb-d868-447e-b185-4498402421e0] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:31.861451 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-0ea097a8-161c-48b4-b6cd-d3d1b9aafff8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance 86c9c9cb-d868-447e-b185-4498402421e0 could not be found. May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0ea097a8-161c-48b4-b6cd-d3d1b9aafff8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/86c9c9cb-d868-447e-b185-4498402421e0/action HTTP/1.1 May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 18 May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: {"unshelve": null} May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 86c9c9cb-d868-447e-b185-4498402421e0 could not be found. May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '86c9c9cb-d868-447e-b185-4498402421e0', 'body': {'unshelve': None}} May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86c9c9cb-d868-447e-b185-4498402421e0 could not be found. May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86c9c9cb-d868-447e-b185-4498402421e0 could not be found. May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:31.863088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:31.868806 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:31.868806 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:31.868806 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:33:31.868806 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:33:31.868806 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86c9c9cb-d868-447e-b185-4498402421e0 could not be found. May 21 21:33:31.868806 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:31.868806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0ea097a8-161c-48b4-b6cd-d3d1b9aafff8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance 86c9c9cb-d868-447e-b185-4498402421e0 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:33:31.868806 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0ea097a8-161c-48b4-b6cd-d3d1b9aafff8 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/86c9c9cb-d868-447e-b185-4498402421e0/action" status: 404 len: 111 microversion: 2.1 time: 0.020972 May 21 21:33:31.872027 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2617/5116] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:33:31 2022] POST /compute/v2.1/servers/86c9c9cb-d868-447e-b185-4498402421e0/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:33:31.882604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c031600f-b7d8-4a78-ac77-1abeb1af0eb1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:31.883231 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c031600f-b7d8-4a78-ac77-1abeb1af0eb1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:31.890212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c031600f-b7d8-4a78-ac77-1abeb1af0eb1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:31.890859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c031600f-b7d8-4a78-ac77-1abeb1af0eb1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:31.892274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c031600f-b7d8-4a78-ac77-1abeb1af0eb1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:31.893100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c031600f-b7d8-4a78-ac77-1abeb1af0eb1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:32.071721 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c031600f-b7d8-4a78-ac77-1abeb1af0eb1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:32.086564 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c031600f-b7d8-4a78-ac77-1abeb1af0eb1 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.209645 May 21 21:33:32.111384 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ef89e6e4-0c00-455b-a029-df7298421a6f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:32.111934 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2500/5117] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:31 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:32.112171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ef89e6e4-0c00-455b-a029-df7298421a6f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:32.120471 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef89e6e4-0c00-455b-a029-df7298421a6f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:32.120932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef89e6e4-0c00-455b-a029-df7298421a6f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:32.121926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef89e6e4-0c00-455b-a029-df7298421a6f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:32.122534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef89e6e4-0c00-455b-a029-df7298421a6f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:32.359473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-039a15fd-c1ed-4df2-ad39-8b9c86b78177 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:32.360097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-039a15fd-c1ed-4df2-ad39-8b9c86b78177 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:32.367214 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-039a15fd-c1ed-4df2-ad39-8b9c86b78177 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:32.367598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-039a15fd-c1ed-4df2-ad39-8b9c86b78177 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:32.373346 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-039a15fd-c1ed-4df2-ad39-8b9c86b78177 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:32.374191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-039a15fd-c1ed-4df2-ad39-8b9c86b78177 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:32.438434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ef89e6e4-0c00-455b-a029-df7298421a6f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:32.446501 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ef89e6e4-0c00-455b-a029-df7298421a6f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.340431 May 21 21:33:32.447090 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2618/5118] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:32 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:32.488644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-395d9951-3077-48cb-82a9-7d77e1868080 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:32.490398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-395d9951-3077-48cb-82a9-7d77e1868080 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:32.504900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-395d9951-3077-48cb-82a9-7d77e1868080 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:32.505637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-395d9951-3077-48cb-82a9-7d77e1868080 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:32.506688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-395d9951-3077-48cb-82a9-7d77e1868080 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:32.507366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-395d9951-3077-48cb-82a9-7d77e1868080 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:32.704844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-039a15fd-c1ed-4df2-ad39-8b9c86b78177 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:32.707391 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-395d9951-3077-48cb-82a9-7d77e1868080 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Cannot 'unshelve' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state active May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-395d9951-3077-48cb-82a9-7d77e1868080 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action HTTP/1.1 May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 18 May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: {"unshelve": null} May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: exception: Cannot 'unshelve' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state active May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'af7de5bb-0233-4e88-a1a0-8561385e53cd', 'body': {'unshelve': None}} May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance af7de5bb-0233-4e88-a1a0-8561385e53cd in vm_state active. Cannot unshelve while the instance is in this state. May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 21 21:33:32.711689 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state active May 21 21:33:32.716473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:32.716473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:32.716473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:32.716473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:32.716473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:32.716473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:32.716473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:33:32.716473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:33:32.716473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state active May 21 21:33:32.716473 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:32.720007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-395d9951-3077-48cb-82a9-7d77e1868080 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 409 to user: Cannot 'unshelve' instance af7de5bb-0233-4e88-a1a0-8561385e53cd while it is in vm_state active {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:33:32.721268 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-395d9951-3077-48cb-82a9-7d77e1868080 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action" status: 409 len: 146 microversion: 2.1 time: 0.239455 May 21 21:33:32.722923 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2619/5119] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:33:32 2022] POST /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd/action => generated 146 bytes in 255 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 21 21:33:32.724385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-039a15fd-c1ed-4df2-ad39-8b9c86b78177 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:32.727143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-039a15fd-c1ed-4df2-ad39-8b9c86b78177 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:32.731605 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-039a15fd-c1ed-4df2-ad39-8b9c86b78177 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1739 microversion: 2.20 time: 0.373407 May 21 21:33:32.731605 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2501/5120] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:32 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1739 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:32.731822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-47468ba4-d4b4-4cf1-b37f-975f03305c39 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:32.731822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-47468ba4-d4b4-4cf1-b37f-975f03305c39 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:32.734085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a061dbce-0326-4d27-bc14-616fa89baba9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:32.734949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a061dbce-0326-4d27-bc14-616fa89baba9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:32.742454 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a061dbce-0326-4d27-bc14-616fa89baba9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:32.743314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a061dbce-0326-4d27-bc14-616fa89baba9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:32.743444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47468ba4-d4b4-4cf1-b37f-975f03305c39 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:32.743826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47468ba4-d4b4-4cf1-b37f-975f03305c39 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:32.744758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47468ba4-d4b4-4cf1-b37f-975f03305c39 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:32.744988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a061dbce-0326-4d27-bc14-616fa89baba9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:32.745253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47468ba4-d4b4-4cf1-b37f-975f03305c39 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:32.745827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a061dbce-0326-4d27-bc14-616fa89baba9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:32.805125 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-47468ba4-d4b4-4cf1-b37f-975f03305c39 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080813 May 21 21:33:32.805739 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2620/5121] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:33:32 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:33:32.897953 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-91a6cc93-e30a-45fc-afc2-7bd435982551 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:32.899138 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-91a6cc93-e30a-45fc-afc2-7bd435982551 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:32.906121 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-91a6cc93-e30a-45fc-afc2-7bd435982551 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:32.908451 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-91a6cc93-e30a-45fc-afc2-7bd435982551 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:32.911695 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-91a6cc93-e30a-45fc-afc2-7bd435982551 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:32.912501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-91a6cc93-e30a-45fc-afc2-7bd435982551 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:32.948804 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-91a6cc93-e30a-45fc-afc2-7bd435982551 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] HTTP exception thrown: Cannot 'reboot' instance 3224316b-c287-4ec4-9b89-aeb8d9bf7adc while it is in vm_state rescued May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-91a6cc93-e30a-45fc-afc2-7bd435982551 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Request method failure captured: May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc/action HTTP/1.1 May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 28 May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVnYy3SaySatFVqWuD4QLMX78tOZu2Sq081sncP5_CZnvryZkShUPSqptMQixW9D6QLw2UuDdxyQwaeJ6lrj30y7u6OXCJpzi5UJG9aI3fEqHW0Sq9F2EcE_2fCjYowdWcuux0Sp0LhoueDGd91ZOn29SJFvBmrTIiAhoJB3iHzY0IU May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 2e6d59483dc54fe4a558186055068419 May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2e6d59483dc54fe4a558186055068419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2e6d59483dc54fe4a558186055068419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2e6d59483dc54fe4a558186055068419", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2e6d59483dc54fe4a558186055068419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 2e6d59483dc54fe4a558186055068419 May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerRescueNegativeTestJSON-1981617934-project May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 9a0ccfb5c9a04ec0831a0bfe987bb659 May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1981617934-project May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: {"reboot": {"type": "HARD"}} May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: exception: Cannot 'reboot' instance 3224316b-c287-4ec4-9b89-aeb8d9bf7adc while it is in vm_state rescued May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '3224316b-c287-4ec4-9b89-aeb8d9bf7adc', 'body': {'reboot': {'type': 'HARD'}}} May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3224316b-c287-4ec4-9b89-aeb8d9bf7adc in vm_state rescued. Cannot _hard_reboot while the instance is in this state. May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 21 21:33:32.951769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 21 21:33:32.956475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 3224316b-c287-4ec4-9b89-aeb8d9bf7adc while it is in vm_state rescued May 21 21:33:32.956475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:32.956475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:32.956475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:32.956475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:32.956475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:32.956475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:32.956475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:33:32.956475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:33:32.956475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 3224316b-c287-4ec4-9b89-aeb8d9bf7adc while it is in vm_state rescued May 21 21:33:32.956475 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:32.958540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-91a6cc93-e30a-45fc-afc2-7bd435982551 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Returning 409 to user: Cannot 'reboot' instance 3224316b-c287-4ec4-9b89-aeb8d9bf7adc while it is in vm_state rescued {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:33:32.959811 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-91a6cc93-e30a-45fc-afc2-7bd435982551 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "POST /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc/action" status: 409 len: 145 microversion: 2.1 time: 0.067895 May 21 21:33:32.960863 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2621/5122] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:33:32 2022] POST /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc/action => generated 145 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 21 21:33:32.971343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b30b5842-b40e-4d5f-8d7d-5cbf0b232525 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:32.972859 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b30b5842-b40e-4d5f-8d7d-5cbf0b232525 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:32.980169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b30b5842-b40e-4d5f-8d7d-5cbf0b232525 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:32.980699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b30b5842-b40e-4d5f-8d7d-5cbf0b232525 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:32.981705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b30b5842-b40e-4d5f-8d7d-5cbf0b232525 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:32.982312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b30b5842-b40e-4d5f-8d7d-5cbf0b232525 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:33.013395 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-b30b5842-b40e-4d5f-8d7d-5cbf0b232525 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] HTTP exception thrown: Cannot 'rebuild' instance 3224316b-c287-4ec4-9b89-aeb8d9bf7adc while it is in vm_state rescued May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b30b5842-b40e-4d5f-8d7d-5cbf0b232525 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Request method failure captured: May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc/action HTTP/1.1 May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 65 May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVnYy3SaySatFVqWuD4QLMX78tOZu2Sq081sncP5_CZnvryZkShUPSqptMQixW9D6QLw2UuDdxyQwaeJ6lrj30y7u6OXCJpzi5UJG9aI3fEqHW0Sq9F2EcE_2fCjYowdWcuux0Sp0LhoueDGd91ZOn29SJFvBmrTIiAhoJB3iHzY0IU May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 2e6d59483dc54fe4a558186055068419 May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2e6d59483dc54fe4a558186055068419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2e6d59483dc54fe4a558186055068419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2e6d59483dc54fe4a558186055068419", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2e6d59483dc54fe4a558186055068419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 2e6d59483dc54fe4a558186055068419 May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerRescueNegativeTestJSON-1981617934-project May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 9a0ccfb5c9a04ec0831a0bfe987bb659 May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1981617934-project May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: {"rebuild": {"imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c"}} May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: exception: Cannot 'rebuild' instance 3224316b-c287-4ec4-9b89-aeb8d9bf7adc while it is in vm_state rescued May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '3224316b-c287-4ec4-9b89-aeb8d9bf7adc', 'body': {'rebuild': {'imageRef': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c'}}} May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3224316b-c287-4ec4-9b89-aeb8d9bf7adc in vm_state rescued. Cannot rebuild while the instance is in this state. May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:33:33.018961 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:33:33.023800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:33:33.023800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 21 21:33:33.023800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild May 21 21:33:33.023800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 21 21:33:33.023800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 21 21:33:33.023800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 21 21:33:33.023800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 3224316b-c287-4ec4-9b89-aeb8d9bf7adc while it is in vm_state rescued May 21 21:33:33.023800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:33.023800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:33.023800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:33.023800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:33.023800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:33.023800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:33.023800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:33:33.023800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:33:33.023800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 3224316b-c287-4ec4-9b89-aeb8d9bf7adc while it is in vm_state rescued May 21 21:33:33.023800 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:33.023800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b30b5842-b40e-4d5f-8d7d-5cbf0b232525 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Returning 409 to user: Cannot 'rebuild' instance 3224316b-c287-4ec4-9b89-aeb8d9bf7adc while it is in vm_state rescued {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:33:33.023800 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b30b5842-b40e-4d5f-8d7d-5cbf0b232525 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "POST /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc/action" status: 409 len: 146 microversion: 2.1 time: 0.049376 May 21 21:33:33.023800 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2622/5123] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:33:32 2022] POST /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc/action => generated 146 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 21 21:33:33.030986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b2b088c3-99aa-4961-95e1-b5e1448b105d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:33.031585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b2b088c3-99aa-4961-95e1-b5e1448b105d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:33.040704 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2b088c3-99aa-4961-95e1-b5e1448b105d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:33.041257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2b088c3-99aa-4961-95e1-b5e1448b105d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:33.042184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2b088c3-99aa-4961-95e1-b5e1448b105d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:33.042953 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b2b088c3-99aa-4961-95e1-b5e1448b105d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:33.084254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b2b088c3-99aa-4961-95e1-b5e1448b105d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:33:33.101417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a061dbce-0326-4d27-bc14-616fa89baba9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:33.121323 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a061dbce-0326-4d27-bc14-616fa89baba9 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.391032 May 21 21:33:33.122519 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2502/5124] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:32 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:33.145889 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8d9e1e77-92cb-468a-b0f9-194ae649485d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:33.149967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8d9e1e77-92cb-468a-b0f9-194ae649485d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:33.156699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d9e1e77-92cb-468a-b0f9-194ae649485d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:33.157151 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d9e1e77-92cb-468a-b0f9-194ae649485d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:33.157933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d9e1e77-92cb-468a-b0f9-194ae649485d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:33.158564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d9e1e77-92cb-468a-b0f9-194ae649485d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:33.440972 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b2b088c3-99aa-4961-95e1-b5e1448b105d tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "DELETE /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 204 len: 0 microversion: 2.1 time: 0.413579 May 21 21:33:33.442733 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2623/5125] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:33:33 2022] DELETE /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:33:33.452846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d909d589-a0d9-49b4-bc84-62492fdaa429 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:33.454003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d909d589-a0d9-49b4-bc84-62492fdaa429 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:33.473588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d909d589-a0d9-49b4-bc84-62492fdaa429 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:33.474193 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d909d589-a0d9-49b4-bc84-62492fdaa429 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:33.475785 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d909d589-a0d9-49b4-bc84-62492fdaa429 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:33.479372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d909d589-a0d9-49b4-bc84-62492fdaa429 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:33.484035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8d9e1e77-92cb-468a-b0f9-194ae649485d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:33.495443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:33.504956 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8d9e1e77-92cb-468a-b0f9-194ae649485d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.367277 May 21 21:33:33.506664 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2503/5126] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:33 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:33.539385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ed30fa06-0d52-40a4-82c6-9433b7a64e0f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-965296812_updated"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:33.540636 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ed30fa06-0d52-40a4-82c6-9433b7a64e0f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: b17d62b0-136d-47fd-aed6-1e766c3bec86] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:33.575094 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-ed30fa06-0d52-40a4-82c6-9433b7a64e0f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance b17d62b0-136d-47fd-aed6-1e766c3bec86 could not be found. May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ed30fa06-0d52-40a4-82c6-9433b7a64e0f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: request: PUT /compute/v2.1/servers/b17d62b0-136d-47fd-aed6-1e766c3bec86 HTTP/1.1 May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 80 May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-965296812_updated"}} May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance b17d62b0-136d-47fd-aed6-1e766c3bec86 could not be found. May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'b17d62b0-136d-47fd-aed6-1e766c3bec86', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-965296812_updated'}}} May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b17d62b0-136d-47fd-aed6-1e766c3bec86 could not be found. May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) May 21 21:33:33.576784 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:33:33.581614 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:33:33.581614 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:33:33.581614 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:33:33.581614 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b17d62b0-136d-47fd-aed6-1e766c3bec86 could not be found. May 21 21:33:33.581614 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:33.581614 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:33.581614 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:33.581614 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:33.581614 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:33.581614 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:33.581614 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:33:33.581614 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:33:33.581614 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b17d62b0-136d-47fd-aed6-1e766c3bec86 could not be found. May 21 21:33:33.581614 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:33.585146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ed30fa06-0d52-40a4-82c6-9433b7a64e0f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance b17d62b0-136d-47fd-aed6-1e766c3bec86 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:33:33.586248 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ed30fa06-0d52-40a4-82c6-9433b7a64e0f tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "PUT /compute/v2.1/servers/b17d62b0-136d-47fd-aed6-1e766c3bec86" status: 404 len: 111 microversion: 2.1 time: 0.064375 May 21 21:33:33.588486 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2504/5127] 10.222.0.49 () {60 vars in 1255 bytes} [Sat May 21 21:33:33 2022] PUT /compute/v2.1/servers/b17d62b0-136d-47fd-aed6-1e766c3bec86 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:33:33.611778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-65139480-b8fe-48f5-8dad-894cedcdf560 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:33.612867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-65139480-b8fe-48f5-8dad-894cedcdf560 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:33.632413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65139480-b8fe-48f5-8dad-894cedcdf560 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:33.632933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65139480-b8fe-48f5-8dad-894cedcdf560 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:33.633744 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65139480-b8fe-48f5-8dad-894cedcdf560 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:33.634195 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65139480-b8fe-48f5-8dad-894cedcdf560 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:33.703577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d909d589-a0d9-49b4-bc84-62492fdaa429 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:33.714326 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d909d589-a0d9-49b4-bc84-62492fdaa429 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1688 microversion: 2.1 time: 0.265376 May 21 21:33:33.716073 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2624/5128] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:33 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1688 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:33:33.765435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6c36e384-d23b-4b5c-af48-9b377586a8c4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:33.770754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6c36e384-d23b-4b5c-af48-9b377586a8c4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:33.789312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6c36e384-d23b-4b5c-af48-9b377586a8c4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:33.789312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6c36e384-d23b-4b5c-af48-9b377586a8c4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:33.791888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6c36e384-d23b-4b5c-af48-9b377586a8c4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:33.791888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6c36e384-d23b-4b5c-af48-9b377586a8c4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:33.994916 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6c36e384-d23b-4b5c-af48-9b377586a8c4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:34.003930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6c36e384-d23b-4b5c-af48-9b377586a8c4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:34.009722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-65139480-b8fe-48f5-8dad-894cedcdf560 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:34.011030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6c36e384-d23b-4b5c-af48-9b377586a8c4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:34.013462 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6c36e384-d23b-4b5c-af48-9b377586a8c4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1739 microversion: 2.20 time: 0.251997 May 21 21:33:34.027513 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2625/5129] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:33 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:34.031055 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-65139480-b8fe-48f5-8dad-894cedcdf560 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.431071 May 21 21:33:34.032315 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2505/5130] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:33 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:33:34.054322 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7a61f72c-3248-4b5f-9b76-945e9949732d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:34.055352 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7a61f72c-3248-4b5f-9b76-945e9949732d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:34.072028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a61f72c-3248-4b5f-9b76-945e9949732d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:34.072672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a61f72c-3248-4b5f-9b76-945e9949732d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:34.073555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a61f72c-3248-4b5f-9b76-945e9949732d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:34.077249 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a61f72c-3248-4b5f-9b76-945e9949732d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:34.298250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7a61f72c-3248-4b5f-9b76-945e9949732d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:34.314998 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7a61f72c-3248-4b5f-9b76-945e9949732d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.264683 May 21 21:33:34.316896 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2626/5131] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:34 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:34.334036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7a7bb3a4-6716-4dc4-964f-65a6b43ec290 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7a7bb3a4-6716-4dc4-964f-65a6b43ec290 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: request: PUT /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd HTTP/1.1 May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 280 May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'af7de5bb-0233-4e88-a1a0-8561385e53cd', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise error May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi On instance['server']: May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:34.337689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 21 21:33:34.345072 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:34.348587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7a7bb3a4-6716-4dc4-964f-65a6b43ec290 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:33:34.356093 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7a7bb3a4-6716-4dc4-964f-65a6b43ec290 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "PUT /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 400 len: 619 microversion: 2.1 time: 0.020170 May 21 21:33:34.356093 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2506/5132] 10.222.0.49 () {60 vars in 1256 bytes} [Sat May 21 21:33:34 2022] PUT /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:33:34.361206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ace45c71-7c4b-426c-b715-1e0f56bab976 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:34.362141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ace45c71-7c4b-426c-b715-1e0f56bab976 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:34.369860 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ace45c71-7c4b-426c-b715-1e0f56bab976 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:34.370321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ace45c71-7c4b-426c-b715-1e0f56bab976 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:34.371119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ace45c71-7c4b-426c-b715-1e0f56bab976 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:34.371567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ace45c71-7c4b-426c-b715-1e0f56bab976 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:34.601787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ace45c71-7c4b-426c-b715-1e0f56bab976 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:34.624901 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ace45c71-7c4b-426c-b715-1e0f56bab976 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.267526 May 21 21:33:34.630694 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2627/5133] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:34 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:34.645872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c2ee310e-a39c-4fee-b7c9-d6b215b3df65 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:34.646174 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c2ee310e-a39c-4fee-b7c9-d6b215b3df65 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:34.655869 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2ee310e-a39c-4fee-b7c9-d6b215b3df65 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:34.656370 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2ee310e-a39c-4fee-b7c9-d6b215b3df65 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:34.657169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2ee310e-a39c-4fee-b7c9-d6b215b3df65 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:34.657707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c2ee310e-a39c-4fee-b7c9-d6b215b3df65 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:34.733502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-89eca299-42a1-46f0-9c6a-7b92c9e2c096 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:34.734138 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-89eca299-42a1-46f0-9c6a-7b92c9e2c096 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:34.743420 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89eca299-42a1-46f0-9c6a-7b92c9e2c096 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:34.744396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89eca299-42a1-46f0-9c6a-7b92c9e2c096 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:34.745500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89eca299-42a1-46f0-9c6a-7b92c9e2c096 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:34.746188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89eca299-42a1-46f0-9c6a-7b92c9e2c096 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:34.991401 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c2ee310e-a39c-4fee-b7c9-d6b215b3df65 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:35.006091 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c2ee310e-a39c-4fee-b7c9-d6b215b3df65 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.364647 May 21 21:33:35.008011 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2507/5134] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:34 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:33:35.034684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d19ae681-9702-4487-99a4-7e152df72822 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d19ae681-9702-4487-99a4-7e152df72822 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: request: PUT /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd HTTP/1.1 May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 24 May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: {"server": {"name": ""}} May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid input for field/attribute name. Value: . '' is too short May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'af7de5bb-0233-4e88-a1a0-8561385e53cd', 'body': {'server': {'name': ''}}} May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise error May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi On instance['server']: May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi '' May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 21:33:35.038423 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 21 21:33:35.043534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:35.043534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:35.043534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:35.043534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:35.043534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:35.043534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:35.043534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 21:33:35.043534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 21:33:35.043534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 21 21:33:35.043534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:35.050249 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d19ae681-9702-4487-99a4-7e152df72822 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:33:35.050249 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d19ae681-9702-4487-99a4-7e152df72822 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "PUT /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 400 len: 108 microversion: 2.1 time: 0.018188 May 21 21:33:35.050249 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2508/5135] 10.222.0.49 () {60 vars in 1255 bytes} [Sat May 21 21:33:35 2022] PUT /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:33:35.055896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8904adec-bae9-4a6e-b8b2-2217a118dde5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:35.056844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8904adec-bae9-4a6e-b8b2-2217a118dde5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:35.064378 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-89eca299-42a1-46f0-9c6a-7b92c9e2c096 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:35.079402 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-89eca299-42a1-46f0-9c6a-7b92c9e2c096 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1688 microversion: 2.1 time: 0.346614 May 21 21:33:35.080245 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2628/5136] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:34 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1688 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:35.081995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8904adec-bae9-4a6e-b8b2-2217a118dde5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:35.085647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8904adec-bae9-4a6e-b8b2-2217a118dde5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:35.087028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8904adec-bae9-4a6e-b8b2-2217a118dde5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:35.087629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8904adec-bae9-4a6e-b8b2-2217a118dde5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:35.090394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dd8814c3-53ea-4cd0-88ec-50005dbff81c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:35.102044 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dd8814c3-53ea-4cd0-88ec-50005dbff81c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:35.118701 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd8814c3-53ea-4cd0-88ec-50005dbff81c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:35.119704 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd8814c3-53ea-4cd0-88ec-50005dbff81c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:35.120771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd8814c3-53ea-4cd0-88ec-50005dbff81c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:35.121375 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd8814c3-53ea-4cd0-88ec-50005dbff81c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:35.344333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-dd8814c3-53ea-4cd0-88ec-50005dbff81c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:35.355912 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dd8814c3-53ea-4cd0-88ec-50005dbff81c tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1507 microversion: 2.1 time: 0.272575 May 21 21:33:35.357326 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2629/5137] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:35 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1507 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:35.376646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8904adec-bae9-4a6e-b8b2-2217a118dde5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:35.389937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8904adec-bae9-4a6e-b8b2-2217a118dde5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:35.391778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8904adec-bae9-4a6e-b8b2-2217a118dde5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:35.393435 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8904adec-bae9-4a6e-b8b2-2217a118dde5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1739 microversion: 2.20 time: 0.344113 May 21 21:33:35.394185 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2509/5138] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:35 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1739 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:35.570409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6449dfe8-c27f-472e-a518-0ed547e77d4e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:35.571825 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6449dfe8-c27f-472e-a518-0ed547e77d4e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:35.602366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6449dfe8-c27f-472e-a518-0ed547e77d4e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:35.604614 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6449dfe8-c27f-472e-a518-0ed547e77d4e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:35.606419 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6449dfe8-c27f-472e-a518-0ed547e77d4e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:35.608584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6449dfe8-c27f-472e-a518-0ed547e77d4e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:35.718735 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6449dfe8-c27f-472e-a518-0ed547e77d4e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.152804 May 21 21:33:35.722692 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2630/5139] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:33:35 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384/os-volume_attachments => generated 25 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:33:35.873437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6e6a0685-585d-4a30-af55-b452ae7201c3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:35.874292 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6e6a0685-585d-4a30-af55-b452ae7201c3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:35.884227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e6a0685-585d-4a30-af55-b452ae7201c3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:35.884883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e6a0685-585d-4a30-af55-b452ae7201c3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:35.885896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e6a0685-585d-4a30-af55-b452ae7201c3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:35.886458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e6a0685-585d-4a30-af55-b452ae7201c3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:35.941786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6e6a0685-585d-4a30-af55-b452ae7201c3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:33:36.097231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-63377f96-8367-49b3-a25e-92e1ee8e4023 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:36.098635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-63377f96-8367-49b3-a25e-92e1ee8e4023 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:36.105566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-63377f96-8367-49b3-a25e-92e1ee8e4023 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:36.106330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-63377f96-8367-49b3-a25e-92e1ee8e4023 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:36.107355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-63377f96-8367-49b3-a25e-92e1ee8e4023 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:36.107996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-63377f96-8367-49b3-a25e-92e1ee8e4023 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:36.259396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-63377f96-8367-49b3-a25e-92e1ee8e4023 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:36.268245 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-63377f96-8367-49b3-a25e-92e1ee8e4023 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1688 microversion: 2.1 time: 0.175140 May 21 21:33:36.268861 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2631/5140] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:36 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:33:36.427650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4920c226-2e2c-4633-9f12-2697b9525e10 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:36.433256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4920c226-2e2c-4633-9f12-2697b9525e10 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:36.453044 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4920c226-2e2c-4633-9f12-2697b9525e10 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:36.453787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4920c226-2e2c-4633-9f12-2697b9525e10 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:36.454605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4920c226-2e2c-4633-9f12-2697b9525e10 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:36.455057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4920c226-2e2c-4633-9f12-2697b9525e10 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:36.564872 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6e6a0685-585d-4a30-af55-b452ae7201c3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 204 len: 0 microversion: 2.1 time: 0.695208 May 21 21:33:36.572533 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2510/5141] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:33:35 2022] DELETE /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:33:36.579123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-471b0033-f829-4b95-847a-ed812101e406 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:36.581202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-471b0033-f829-4b95-847a-ed812101e406 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:36.601958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-471b0033-f829-4b95-847a-ed812101e406 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:36.604608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-471b0033-f829-4b95-847a-ed812101e406 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:36.607307 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-471b0033-f829-4b95-847a-ed812101e406 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:36.608018 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-471b0033-f829-4b95-847a-ed812101e406 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:36.828250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4920c226-2e2c-4633-9f12-2697b9525e10 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:36.840000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4920c226-2e2c-4633-9f12-2697b9525e10 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:36.841858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4920c226-2e2c-4633-9f12-2697b9525e10 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:36.843869 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4920c226-2e2c-4633-9f12-2697b9525e10 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1739 microversion: 2.20 time: 0.435445 May 21 21:33:36.855793 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2632/5142] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:36 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1739 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:37.291323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5f12d8d1-f7e9-4c4f-aefc-6ae277111a19 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:37.293140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5f12d8d1-f7e9-4c4f-aefc-6ae277111a19 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:37.302143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5f12d8d1-f7e9-4c4f-aefc-6ae277111a19 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:37.303676 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5f12d8d1-f7e9-4c4f-aefc-6ae277111a19 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:37.304836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5f12d8d1-f7e9-4c4f-aefc-6ae277111a19 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:37.305864 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5f12d8d1-f7e9-4c4f-aefc-6ae277111a19 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:37.522584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5f12d8d1-f7e9-4c4f-aefc-6ae277111a19 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:37.532427 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5f12d8d1-f7e9-4c4f-aefc-6ae277111a19 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1688 microversion: 2.1 time: 0.249125 May 21 21:33:37.547930 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2633/5143] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:37 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1688 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:37.744758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-471b0033-f829-4b95-847a-ed812101e406 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:37.753335 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-471b0033-f829-4b95-847a-ed812101e406 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1671 microversion: 2.1 time: 1.179164 May 21 21:33:37.757803 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2511/5144] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:36 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1671 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:37.863018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f3232134-ac03-40dd-9b4b-4164e1e9a6f8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:37.863695 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f3232134-ac03-40dd-9b4b-4164e1e9a6f8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:37.870902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3232134-ac03-40dd-9b4b-4164e1e9a6f8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:37.871364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3232134-ac03-40dd-9b4b-4164e1e9a6f8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:37.872163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3232134-ac03-40dd-9b4b-4164e1e9a6f8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:37.872635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3232134-ac03-40dd-9b4b-4164e1e9a6f8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:38.044390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f3232134-ac03-40dd-9b4b-4164e1e9a6f8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:38.052673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f3232134-ac03-40dd-9b4b-4164e1e9a6f8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:38.054510 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f3232134-ac03-40dd-9b4b-4164e1e9a6f8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:38.056266 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f3232134-ac03-40dd-9b4b-4164e1e9a6f8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1739 microversion: 2.20 time: 0.197210 May 21 21:33:38.057222 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2634/5145] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:37 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:38.552029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-41f3ca34-7308-4009-8386-5843d9de2dcc tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:38.552911 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-41f3ca34-7308-4009-8386-5843d9de2dcc tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:38.566842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41f3ca34-7308-4009-8386-5843d9de2dcc tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:38.569199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41f3ca34-7308-4009-8386-5843d9de2dcc tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:38.569199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41f3ca34-7308-4009-8386-5843d9de2dcc tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:38.569749 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41f3ca34-7308-4009-8386-5843d9de2dcc tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:38.688880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-41f3ca34-7308-4009-8386-5843d9de2dcc tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:38.697789 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-41f3ca34-7308-4009-8386-5843d9de2dcc tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1620 microversion: 2.1 time: 0.151160 May 21 21:33:38.706121 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2512/5146] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:38 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1620 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:38.775001 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fb416859-76a4-43f0-b89b-8648aa565861 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:38.775628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fb416859-76a4-43f0-b89b-8648aa565861 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:38.784437 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb416859-76a4-43f0-b89b-8648aa565861 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:38.785186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb416859-76a4-43f0-b89b-8648aa565861 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:38.786125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb416859-76a4-43f0-b89b-8648aa565861 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:38.786706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fb416859-76a4-43f0-b89b-8648aa565861 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:39.075453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dc66288e-e1f5-4632-9c48-06b4761780f0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:39.077001 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dc66288e-e1f5-4632-9c48-06b4761780f0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:39.084506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc66288e-e1f5-4632-9c48-06b4761780f0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:39.085320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc66288e-e1f5-4632-9c48-06b4761780f0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:39.086392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc66288e-e1f5-4632-9c48-06b4761780f0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:39.087061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc66288e-e1f5-4632-9c48-06b4761780f0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:39.178574 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fb416859-76a4-43f0-b89b-8648aa565861 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:39.191831 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fb416859-76a4-43f0-b89b-8648aa565861 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1671 microversion: 2.1 time: 0.424454 May 21 21:33:39.200390 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2635/5147] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:38 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1671 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:39.405796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-eb99e218-db15-4558-9771-302fe8e2f536 req-d783e4bb-da2e-4adf-a42f-a752a576af30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54e8b13e-d6b2-467c-b801-2b0ad45e95ae", "name": "network-vif-deleted", "tag": "ea540e6b-71e1-4aff-97b8-77527dd9d620"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:39.418720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-eb99e218-db15-4558-9771-302fe8e2f536 req-d783e4bb-da2e-4adf-a42f-a752a576af30 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:39.419431 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-eb99e218-db15-4558-9771-302fe8e2f536 req-d783e4bb-da2e-4adf-a42f-a752a576af30 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:39.435685 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-eb99e218-db15-4558-9771-302fe8e2f536 req-d783e4bb-da2e-4adf-a42f-a752a576af30 service nova] Creating event network-vif-deleted:ea540e6b-71e1-4aff-97b8-77527dd9d620 for instance 54e8b13e-d6b2-467c-b801-2b0ad45e95ae on nch2-master-1 May 21 21:33:39.445183 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-eb99e218-db15-4558-9771-302fe8e2f536 req-d783e4bb-da2e-4adf-a42f-a752a576af30 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042406 May 21 21:33:39.446376 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2636/5148] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:33:39.471567 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dc66288e-e1f5-4632-9c48-06b4761780f0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:39.487793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dc66288e-e1f5-4632-9c48-06b4761780f0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:39.489807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dc66288e-e1f5-4632-9c48-06b4761780f0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:39.492403 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dc66288e-e1f5-4632-9c48-06b4761780f0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1721 microversion: 2.20 time: 0.420753 May 21 21:33:39.515091 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2513/5149] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:39 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1721 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:39.725422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e4313274-399f-47bd-8467-2426a4ffe6b7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:39.726722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e4313274-399f-47bd-8467-2426a4ffe6b7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:39.744694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e4313274-399f-47bd-8467-2426a4ffe6b7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:39.745420 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e4313274-399f-47bd-8467-2426a4ffe6b7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:39.747055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e4313274-399f-47bd-8467-2426a4ffe6b7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:39.749340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e4313274-399f-47bd-8467-2426a4ffe6b7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:39.878639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e4313274-399f-47bd-8467-2426a4ffe6b7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:39.891337 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e4313274-399f-47bd-8467-2426a4ffe6b7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1329 microversion: 2.1 time: 0.179268 May 21 21:33:39.892629 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2637/5150] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:39 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1329 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:39.922456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-4f69103d-4c35-40f8-8666-dbd443045ce3 req-c5184089-ce45-4a15-9559-d5fcfdddc735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc27a082-c144-436f-bd21-e8126e00db6c", "name": "network-vif-unplugged", "status": "completed", "tag": "b4925385-7716-4fd9-99c7-de6cabe49d7f"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:39.939196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4f69103d-4c35-40f8-8666-dbd443045ce3 req-c5184089-ce45-4a15-9559-d5fcfdddc735 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:39.945972 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4f69103d-4c35-40f8-8666-dbd443045ce3 req-c5184089-ce45-4a15-9559-d5fcfdddc735 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:39.962567 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-4f69103d-4c35-40f8-8666-dbd443045ce3 req-c5184089-ce45-4a15-9559-d5fcfdddc735 service nova] Creating event network-vif-unplugged:b4925385-7716-4fd9-99c7-de6cabe49d7f for instance cc27a082-c144-436f-bd21-e8126e00db6c on nch2-master-1 May 21 21:33:39.968331 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-4f69103d-4c35-40f8-8666-dbd443045ce3 req-c5184089-ce45-4a15-9559-d5fcfdddc735 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053488 May 21 21:33:39.969593 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2514/5151] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:33:40.212489 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f9c424ec-918d-4fc9-bc24-d6d3cc474866 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:40.213106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f9c424ec-918d-4fc9-bc24-d6d3cc474866 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:40.216623 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:40.220489 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f9c424ec-918d-4fc9-bc24-d6d3cc474866 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:40.221007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f9c424ec-918d-4fc9-bc24-d6d3cc474866 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:40.221798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f9c424ec-918d-4fc9-bc24-d6d3cc474866 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:40.222236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f9c424ec-918d-4fc9-bc24-d6d3cc474866 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:40.515698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-022a16c2-23d5-48b6-b36a-dcfc44cec399 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:40.516655 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-022a16c2-23d5-48b6-b36a-dcfc44cec399 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:40.523549 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-022a16c2-23d5-48b6-b36a-dcfc44cec399 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:40.524098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-022a16c2-23d5-48b6-b36a-dcfc44cec399 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:40.525107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-022a16c2-23d5-48b6-b36a-dcfc44cec399 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:40.525623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-022a16c2-23d5-48b6-b36a-dcfc44cec399 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:40.602159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f9c424ec-918d-4fc9-bc24-d6d3cc474866 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:40.612578 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f9c424ec-918d-4fc9-bc24-d6d3cc474866 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1671 microversion: 2.1 time: 0.405018 May 21 21:33:40.613629 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2638/5152] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:40 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1671 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:40.722117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-022a16c2-23d5-48b6-b36a-dcfc44cec399 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:40.742826 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-022a16c2-23d5-48b6-b36a-dcfc44cec399 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:40.756962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-022a16c2-23d5-48b6-b36a-dcfc44cec399 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:40.760050 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-022a16c2-23d5-48b6-b36a-dcfc44cec399 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1721 microversion: 2.20 time: 0.247217 May 21 21:33:40.760050 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2515/5153] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:40 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:33:40.910465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-46d92ca6-56a1-46e1-b35f-65c957225230 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:40.911679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-46d92ca6-56a1-46e1-b35f-65c957225230 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:40.920256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46d92ca6-56a1-46e1-b35f-65c957225230 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:40.922380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46d92ca6-56a1-46e1-b35f-65c957225230 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:40.923384 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46d92ca6-56a1-46e1-b35f-65c957225230 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:40.923989 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46d92ca6-56a1-46e1-b35f-65c957225230 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:40.968125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46d92ca6-56a1-46e1-b35f-65c957225230 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:40.968880 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46d92ca6-56a1-46e1-b35f-65c957225230 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:40.969505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-46d92ca6-56a1-46e1-b35f-65c957225230 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lazy-loading 'fault' on Instance uuid 54e8b13e-d6b2-467c-b801-2b0ad45e95ae {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:33:41.079354 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-46d92ca6-56a1-46e1-b35f-65c957225230 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:41.090384 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-46d92ca6-56a1-46e1-b35f-65c957225230 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 200 len: 1334 microversion: 2.1 time: 0.184087 May 21 21:33:41.091595 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2639/5154] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:40 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 1334 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:41.348035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-ab952008-c7df-45ed-af20-35091dc6534d req-3b5314f4-13d1-4097-afa8-15c3b676fb19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f6f2738-3e60-4235-ab67-86ad32c2a384", "name": "network-vif-deleted", "tag": "0e5e1124-219a-4afb-a71f-cb8bce128991"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:41.358038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ab952008-c7df-45ed-af20-35091dc6534d req-3b5314f4-13d1-4097-afa8-15c3b676fb19 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:41.358526 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ab952008-c7df-45ed-af20-35091dc6534d req-3b5314f4-13d1-4097-afa8-15c3b676fb19 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:41.384135 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-ab952008-c7df-45ed-af20-35091dc6534d req-3b5314f4-13d1-4097-afa8-15c3b676fb19 service nova] Creating event network-vif-deleted:0e5e1124-219a-4afb-a71f-cb8bce128991 for instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 on nch1-master-1 May 21 21:33:41.389734 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-ab952008-c7df-45ed-af20-35091dc6534d req-3b5314f4-13d1-4097-afa8-15c3b676fb19 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045373 May 21 21:33:41.390358 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2516/5155] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:33:41.634733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a9da5d47-44ae-4537-9bc5-d9f8706d8429 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:41.635698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a9da5d47-44ae-4537-9bc5-d9f8706d8429 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:41.643315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9da5d47-44ae-4537-9bc5-d9f8706d8429 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:41.644243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9da5d47-44ae-4537-9bc5-d9f8706d8429 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:41.645982 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9da5d47-44ae-4537-9bc5-d9f8706d8429 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:41.648060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9da5d47-44ae-4537-9bc5-d9f8706d8429 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:41.704112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9da5d47-44ae-4537-9bc5-d9f8706d8429 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:41.705148 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9da5d47-44ae-4537-9bc5-d9f8706d8429 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:41.705877 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-a9da5d47-44ae-4537-9bc5-d9f8706d8429 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lazy-loading 'fault' on Instance uuid 3f6f2738-3e60-4235-ab67-86ad32c2a384 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:33:41.780011 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-601d2a99-dc65-4024-a0c8-4959275a73ef tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:41.781578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-601d2a99-dc65-4024-a0c8-4959275a73ef tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:41.793145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a9da5d47-44ae-4537-9bc5-d9f8706d8429 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:41.795992 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:41.805834 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a9da5d47-44ae-4537-9bc5-d9f8706d8429 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 200 len: 1325 microversion: 2.1 time: 0.179258 May 21 21:33:41.813953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-601d2a99-dc65-4024-a0c8-4959275a73ef tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:41.813953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-601d2a99-dc65-4024-a0c8-4959275a73ef tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:41.813953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-601d2a99-dc65-4024-a0c8-4959275a73ef tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:41.813953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-601d2a99-dc65-4024-a0c8-4959275a73ef tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:41.814502 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2640/5156] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:41 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 1325 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:42.071203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-601d2a99-dc65-4024-a0c8-4959275a73ef tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:42.091493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:42.110040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-601d2a99-dc65-4024-a0c8-4959275a73ef tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:42.114950 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1d3f3dab-211f-463e-aaa1-7b1a759eb119 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:42.116621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1d3f3dab-211f-463e-aaa1-7b1a759eb119 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 54e8b13e-d6b2-467c-b801-2b0ad45e95ae] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:42.119221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-601d2a99-dc65-4024-a0c8-4959275a73ef tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:42.126980 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-601d2a99-dc65-4024-a0c8-4959275a73ef tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1724 microversion: 2.20 time: 0.350150 May 21 21:33:42.132832 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2517/5157] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:41 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1724 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:33:42.144800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d3f3dab-211f-463e-aaa1-7b1a759eb119 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:42.145267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d3f3dab-211f-463e-aaa1-7b1a759eb119 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:42.149045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d3f3dab-211f-463e-aaa1-7b1a759eb119 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:42.149045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d3f3dab-211f-463e-aaa1-7b1a759eb119 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:42.151202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3c869552-54ef-4b85-b550-a348e39cf7ab tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc38d82a-c55c-417b-ad9e-028de27fde5a"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:42.152444 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3c869552-54ef-4b85-b550-a348e39cf7ab tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:42.172201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3c869552-54ef-4b85-b550-a348e39cf7ab tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:42.172201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3c869552-54ef-4b85-b550-a348e39cf7ab tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:42.173112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3c869552-54ef-4b85-b550-a348e39cf7ab tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:42.175269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3c869552-54ef-4b85-b550-a348e39cf7ab tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:42.215521 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-1d3f3dab-211f-463e-aaa1-7b1a759eb119 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] HTTP exception thrown: Instance 54e8b13e-d6b2-467c-b801-2b0ad45e95ae could not be found. May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1d3f3dab-211f-463e-aaa1-7b1a759eb119 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Request method failure captured: May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae HTTP/1.1 May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVnYy3SaySatFVqWuD4QLMX78tOZu2Sq081sncP5_CZnvryZkShUPSqptMQixW9D6QLw2UuDdxyQwaeJ6lrj30y7u6OXCJpzi5UJG9aI3fEqHW0Sq9F2EcE_2fCjYowdWcuux0Sp0LhoueDGd91ZOn29SJFvBmrTIiAhoJB3iHzY0IU May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 2e6d59483dc54fe4a558186055068419 May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2e6d59483dc54fe4a558186055068419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2e6d59483dc54fe4a558186055068419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2e6d59483dc54fe4a558186055068419", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2e6d59483dc54fe4a558186055068419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 2e6d59483dc54fe4a558186055068419 May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerRescueNegativeTestJSON-1981617934-project May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 9a0ccfb5c9a04ec0831a0bfe987bb659 May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1981617934-project May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 54e8b13e-d6b2-467c-b801-2b0ad45e95ae could not be found. May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '54e8b13e-d6b2-467c-b801-2b0ad45e95ae'} May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54e8b13e-d6b2-467c-b801-2b0ad45e95ae could not be found. May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54e8b13e-d6b2-467c-b801-2b0ad45e95ae could not be found. May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:42.217281 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:42.226161 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:42.226161 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:42.226161 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:42.226161 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:42.226161 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:33:42.226161 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:33:42.226161 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54e8b13e-d6b2-467c-b801-2b0ad45e95ae could not be found. May 21 21:33:42.226161 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:42.226161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1d3f3dab-211f-463e-aaa1-7b1a759eb119 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Returning 404 to user: Instance 54e8b13e-d6b2-467c-b801-2b0ad45e95ae could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:33:42.226161 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1d3f3dab-211f-463e-aaa1-7b1a759eb119 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae" status: 404 len: 111 microversion: 2.1 time: 0.107635 May 21 21:33:42.227060 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2641/5158] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:42 2022] GET /compute/v2.1/servers/54e8b13e-d6b2-467c-b801-2b0ad45e95ae => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:33:42.251965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-62bd4f34-fef9-4c99-8e4f-3fce9e8bd856 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '.version_select at 0x7fc81a58a160>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:42.401955 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-62bd4f34-fef9-4c99-8e4f-3fce9e8bd856 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-904144293" status: 202 len: 0 microversion: 2.1 time: 0.166903 May 21 21:33:42.413355 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2642/5159] 10.222.0.49 () {58 vars in 1217 bytes} [Sat May 21 21:33:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-904144293 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:33:42.826413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-770fb2bc-f82d-494f-b773-19b3567c45f5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:42.827165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-770fb2bc-f82d-494f-b773-19b3567c45f5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:42.841116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-770fb2bc-f82d-494f-b773-19b3567c45f5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:42.843859 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-770fb2bc-f82d-494f-b773-19b3567c45f5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:42.846120 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-770fb2bc-f82d-494f-b773-19b3567c45f5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:42.848332 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-770fb2bc-f82d-494f-b773-19b3567c45f5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:42.920030 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-770fb2bc-f82d-494f-b773-19b3567c45f5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] HTTP exception thrown: Instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 could not be found. May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-770fb2bc-f82d-494f-b773-19b3567c45f5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Request method failure captured: May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 HTTP/1.1 May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoHzVV9oy_EU_IYsFGeHTnkJmeTGzL2hOMScY5fxlHdGzMWQlNmx3ok0yXGSd9z2iwg80ZehVP0P56CYfJwVfM_nDvD93NkoExhFShdfIjmz7V2cxd1lVxbL0ZNl4BcIq8yEbgDNERe6ES_QxVWEtoma-h3VIrTk9Hp49olyJDQrfA May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: dbeaf54409d44d0abe3cd6c176fa7ea4 May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AttachVolumeTestJSON-105426157 May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dbeaf54409d44d0abe3cd6c176fa7ea4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dbeaf54409d44d0abe3cd6c176fa7ea4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dbeaf54409d44d0abe3cd6c176fa7ea4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dbeaf54409d44d0abe3cd6c176fa7ea4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AttachVolumeTestJSON-105426157 May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: dbeaf54409d44d0abe3cd6c176fa7ea4 May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AttachVolumeTestJSON-105426157 May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AttachVolumeTestJSON-105426157-project May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 66b6501f7543485db27a33dd1a1a8400 May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AttachVolumeTestJSON-105426157-project May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 could not be found. May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '3f6f2738-3e60-4235-ab67-86ad32c2a384'} May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 could not be found. May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 could not be found. May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:42.921690 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:42.926746 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:42.926746 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:42.926746 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:42.926746 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:33:42.926746 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:33:42.926746 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 could not be found. May 21 21:33:42.926746 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:42.926746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-770fb2bc-f82d-494f-b773-19b3567c45f5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Returning 404 to user: Instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:33:42.926746 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-770fb2bc-f82d-494f-b773-19b3567c45f5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 404 len: 111 microversion: 2.1 time: 0.101567 May 21 21:33:42.926746 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2643/5160] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:42 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:33:42.941736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-55ef0427-ba43-4a6c-90e6-31add443b3e7 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '.version_select at 0x7fc81bb458b0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:43.068955 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-55ef0427-ba43-4a6c-90e6-31add443b3e7 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-70569514" status: 202 len: 0 microversion: 2.1 time: 0.134169 May 21 21:33:43.069982 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2644/5161] 10.222.0.49 () {58 vars in 1214 bytes} [Sat May 21 21:33:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-70569514 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:33:43.826120 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3c869552-54ef-4b85-b550-a348e39cf7ab tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "POST /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.681454 May 21 21:33:43.827501 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2518/5162] 10.222.0.49 () {62 vars in 1363 bytes} [Sat May 21 21:33:42 2022] POST /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c/os-volume_attachments => generated 188 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:33:43.977554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9159a9bf-35d1-44bf-9d15-46d84f320725 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:43.978674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9159a9bf-35d1-44bf-9d15-46d84f320725 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:43.985983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9159a9bf-35d1-44bf-9d15-46d84f320725 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:43.986441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9159a9bf-35d1-44bf-9d15-46d84f320725 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:43.987221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9159a9bf-35d1-44bf-9d15-46d84f320725 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:43.987659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9159a9bf-35d1-44bf-9d15-46d84f320725 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:44.268399 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9159a9bf-35d1-44bf-9d15-46d84f320725 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "POST /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c/action" status: 202 len: 0 microversion: 2.20 time: 0.296605 May 21 21:33:44.268938 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2645/5163] 10.222.0.49 () {62 vars in 1318 bytes} [Sat May 21 21:33:43 2022] POST /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 21 21:33:44.278642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-31c2b4ce-d357-44c6-bf15-dd1f03ff063e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:44.279261 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-31c2b4ce-d357-44c6-bf15-dd1f03ff063e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:44.289281 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-31c2b4ce-d357-44c6-bf15-dd1f03ff063e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:44.292975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-31c2b4ce-d357-44c6-bf15-dd1f03ff063e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:44.292975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-31c2b4ce-d357-44c6-bf15-dd1f03ff063e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:44.292975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-31c2b4ce-d357-44c6-bf15-dd1f03ff063e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:44.520197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-905f4692-c107-4f32-a6bd-0cfad4446bd4 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Action: 'create', calling method: .version_select at 0x7fc81bb45dc0>, body: {"keypair": {"name": "tempest-keypair-1120378386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOY5hSiHdA+tR+DWiZ1NghmijniMj74NUrXxmJlBqdJ7zluMgVAbmCchetkSL29tyFgANoK7N1N+IyG2NcxTpJgrCsJ2rHWAPtit3JyqYTLxdyYu9xgK2TPbgS9lfTBkw=="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:44.538668 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-905f4692-c107-4f32-a6bd-0cfad4446bd4 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Getting quotas for project dbeaf54409d44d0abe3cd6c176fa7ea4. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:33:44.548787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-905f4692-c107-4f32-a6bd-0cfad4446bd4 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Getting quotas for user 66b6501f7543485db27a33dd1a1a8400 and project dbeaf54409d44d0abe3cd6c176fa7ea4. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:33:44.722079 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-905f4692-c107-4f32-a6bd-0cfad4446bd4 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.206502 May 21 21:33:44.723304 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2646/5164] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:33:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:33:44.886482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-31c2b4ce-d357-44c6-bf15-dd1f03ff063e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:44.920503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-31c2b4ce-d357-44c6-bf15-dd1f03ff063e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:44.927758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-31c2b4ce-d357-44c6-bf15-dd1f03ff063e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:44.929646 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-31c2b4ce-d357-44c6-bf15-dd1f03ff063e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1750 microversion: 2.20 time: 0.655367 May 21 21:33:44.930558 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2519/5165] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:44 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1750 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:45.948077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-80e29391-3df9-410c-bbb9-edfc92679fb7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:45.948731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-80e29391-3df9-410c-bbb9-edfc92679fb7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:45.958572 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80e29391-3df9-410c-bbb9-edfc92679fb7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:45.959840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80e29391-3df9-410c-bbb9-edfc92679fb7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:45.960870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80e29391-3df9-410c-bbb9-edfc92679fb7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:45.961494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80e29391-3df9-410c-bbb9-edfc92679fb7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:46.164316 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-80e29391-3df9-410c-bbb9-edfc92679fb7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:46.173734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-80e29391-3df9-410c-bbb9-edfc92679fb7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:46.175116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-80e29391-3df9-410c-bbb9-edfc92679fb7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:46.176689 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-80e29391-3df9-410c-bbb9-edfc92679fb7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1750 microversion: 2.20 time: 0.233671 May 21 21:33:46.189645 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2647/5166] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:45 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1750 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:47.198163 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2d3ff1f6-fc7f-4ee4-a558-995fa46e5b8f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:47.198907 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2d3ff1f6-fc7f-4ee4-a558-995fa46e5b8f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:47.204469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:47.214960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2d3ff1f6-fc7f-4ee4-a558-995fa46e5b8f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:47.221358 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2d3ff1f6-fc7f-4ee4-a558-995fa46e5b8f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:47.222295 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2d3ff1f6-fc7f-4ee4-a558-995fa46e5b8f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:47.226530 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2d3ff1f6-fc7f-4ee4-a558-995fa46e5b8f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:47.467636 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2d3ff1f6-fc7f-4ee4-a558-995fa46e5b8f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:47.482684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2d3ff1f6-fc7f-4ee4-a558-995fa46e5b8f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:47.490396 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2d3ff1f6-fc7f-4ee4-a558-995fa46e5b8f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:47.494764 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2d3ff1f6-fc7f-4ee4-a558-995fa46e5b8f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1752 microversion: 2.20 time: 0.301696 May 21 21:33:47.497406 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2520/5167] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:47 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1752 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:48.515983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-afde4d8b-8254-4cae-a42e-417cb4fa5c54 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:48.516798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-afde4d8b-8254-4cae-a42e-417cb4fa5c54 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:48.525107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-afde4d8b-8254-4cae-a42e-417cb4fa5c54 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:48.534116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-afde4d8b-8254-4cae-a42e-417cb4fa5c54 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:48.535226 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-afde4d8b-8254-4cae-a42e-417cb4fa5c54 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:48.539195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-afde4d8b-8254-4cae-a42e-417cb4fa5c54 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:48.717086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-24cab2e6-a1fb-41dd-9c7c-09ac863e78f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1061647384", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "86804df2-cb31-4df4-8335-5cf3b9dd4df4"}], "security_groups": [{"name": "tempest-securitygroup--1716947072"}], "key_name": "tempest-keypair-1120378386", "user_data": "}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:48.860056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-afde4d8b-8254-4cae-a42e-417cb4fa5c54 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:48.871773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-afde4d8b-8254-4cae-a42e-417cb4fa5c54 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:48.874366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-afde4d8b-8254-4cae-a42e-417cb4fa5c54 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:48.876538 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-afde4d8b-8254-4cae-a42e-417cb4fa5c54 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1752 microversion: 2.20 time: 0.365514 May 21 21:33:48.877349 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2648/5168] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:48 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1752 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:48.937354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-24cab2e6-a1fb-41dd-9c7c-09ac863e78f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] validate_networks() for [('86804df2-cb31-4df4-8335-5cf3b9dd4df4', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:33:49.733230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-24cab2e6-a1fb-41dd-9c7c-09ac863e78f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:33:49.733912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-24cab2e6-a1fb-41dd-9c7c-09ac863e78f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:33:49.734416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-24cab2e6-a1fb-41dd-9c7c-09ac863e78f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:33:49.734925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-24cab2e6-a1fb-41dd-9c7c-09ac863e78f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:33:49.735359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-24cab2e6-a1fb-41dd-9c7c-09ac863e78f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:33:49.747891 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24cab2e6-a1fb-41dd-9c7c-09ac863e78f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:49.748379 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24cab2e6-a1fb-41dd-9c7c-09ac863e78f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:49.749570 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24cab2e6-a1fb-41dd-9c7c-09ac863e78f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:49.750176 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24cab2e6-a1fb-41dd-9c7c-09ac863e78f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:49.770550 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-24cab2e6-a1fb-41dd-9c7c-09ac863e78f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Getting quotas for project dbeaf54409d44d0abe3cd6c176fa7ea4. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:33:49.776732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-24cab2e6-a1fb-41dd-9c7c-09ac863e78f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Getting quotas for user 66b6501f7543485db27a33dd1a1a8400 and project dbeaf54409d44d0abe3cd6c176fa7ea4. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:33:49.792641 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-24cab2e6-a1fb-41dd-9c7c-09ac863e78f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:33:49.801834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-24cab2e6-a1fb-41dd-9c7c-09ac863e78f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:33:49.896647 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5cad9ee9-dc31-4b43-8ac9-0192fdf5efc2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:49.897674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5cad9ee9-dc31-4b43-8ac9-0192fdf5efc2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:49.905722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5cad9ee9-dc31-4b43-8ac9-0192fdf5efc2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:49.906302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5cad9ee9-dc31-4b43-8ac9-0192fdf5efc2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:49.907192 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5cad9ee9-dc31-4b43-8ac9-0192fdf5efc2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:49.907736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5cad9ee9-dc31-4b43-8ac9-0192fdf5efc2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:50.028655 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-24cab2e6-a1fb-41dd-9c7c-09ac863e78f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.318558 May 21 21:33:50.035589 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2521/5169] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:33:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 1327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 21 21:33:50.041998 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e48fdfdc-352e-4748-bc50-a59e2c4452da tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:50.042848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e48fdfdc-352e-4748-bc50-a59e2c4452da tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:50.173605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5cad9ee9-dc31-4b43-8ac9-0192fdf5efc2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:50.183835 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5cad9ee9-dc31-4b43-8ac9-0192fdf5efc2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:50.188718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5cad9ee9-dc31-4b43-8ac9-0192fdf5efc2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:50.192354 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5cad9ee9-dc31-4b43-8ac9-0192fdf5efc2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1808 microversion: 2.20 time: 0.300129 May 21 21:33:50.193468 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2649/5170] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:49 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1808 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:33:50.222184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b9834f4a-eca5-4ed8-b883-e5d64ebab81d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:50.232220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b9834f4a-eca5-4ed8-b883-e5d64ebab81d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:50.233435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b9834f4a-eca5-4ed8-b883-e5d64ebab81d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:50.234104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b9834f4a-eca5-4ed8-b883-e5d64ebab81d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:50.237455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e48fdfdc-352e-4748-bc50-a59e2c4452da tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:50.242336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b9834f4a-eca5-4ed8-b883-e5d64ebab81d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:50.242798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b9834f4a-eca5-4ed8-b883-e5d64ebab81d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:50.246039 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e48fdfdc-352e-4748-bc50-a59e2c4452da tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 200 len: 1238 microversion: 2.1 time: 0.208230 May 21 21:33:50.246635 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2522/5171] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:50 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 1238 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:50.262202 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-b9834f4a-eca5-4ed8-b883-e5d64ebab81d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b9834f4a-eca5-4ed8-b883-e5d64ebab81d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 HTTP/1.1 May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '66d0a724-f81f-497a-8a29-656bce922d38'} May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:33:50.266314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:33:50.270950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:33:50.270950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:50.270950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:50.270950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:50.270950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:50.270950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:50.270950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:50.270950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:33:50.270950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:33:50.270950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:33:50.270950 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:50.270950 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b9834f4a-eca5-4ed8-b883-e5d64ebab81d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:33:50.270950 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b9834f4a-eca5-4ed8-b883-e5d64ebab81d tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "DELETE /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38" status: 404 len: 111 microversion: 2.1 time: 0.062880 May 21 21:33:50.270950 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2650/5172] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:33:50 2022] DELETE /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:33:50.281952 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9a73d419-cb5d-4128-a8ab-710579b2cb75 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:50.282595 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9a73d419-cb5d-4128-a8ab-710579b2cb75 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: 66d0a724-f81f-497a-8a29-656bce922d38] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:50.289403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a73d419-cb5d-4128-a8ab-710579b2cb75 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:50.289744 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a73d419-cb5d-4128-a8ab-710579b2cb75 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:50.290576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a73d419-cb5d-4128-a8ab-710579b2cb75 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:50.290958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a73d419-cb5d-4128-a8ab-710579b2cb75 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:50.325835 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-9a73d419-cb5d-4128-a8ab-710579b2cb75 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9a73d419-cb5d-4128-a8ab-710579b2cb75 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 HTTP/1.1 May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '66d0a724-f81f-497a-8a29-656bce922d38'} May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:50.328451 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:50.333676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:50.333676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:50.333676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:50.333676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:33:50.333676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:33:50.333676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. May 21 21:33:50.333676 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:33:50.333676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9a73d419-cb5d-4128-a8ab-710579b2cb75 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance 66d0a724-f81f-497a-8a29-656bce922d38 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:33:50.333676 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9a73d419-cb5d-4128-a8ab-710579b2cb75 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38" status: 404 len: 111 microversion: 2.1 time: 0.050913 May 21 21:33:50.336603 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2523/5173] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:50 2022] GET /compute/v2.1/servers/66d0a724-f81f-497a-8a29-656bce922d38 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:33:50.341271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-23fcd17f-aad3-4539-b33a-cc65a7310398 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:50.341826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-23fcd17f-aad3-4539-b33a-cc65a7310398 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:50.357212 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23fcd17f-aad3-4539-b33a-cc65a7310398 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:50.357212 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23fcd17f-aad3-4539-b33a-cc65a7310398 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:50.357212 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23fcd17f-aad3-4539-b33a-cc65a7310398 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:50.357212 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23fcd17f-aad3-4539-b33a-cc65a7310398 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:50.394776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-23fcd17f-aad3-4539-b33a-cc65a7310398 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:33:50.962898 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-23fcd17f-aad3-4539-b33a-cc65a7310398 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "DELETE /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 204 len: 0 microversion: 2.1 time: 0.626636 May 21 21:33:50.963855 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2651/5174] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:33:50 2022] DELETE /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 0 bytes in 628 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:33:50.972062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-64d18656-4f9b-407b-bf6e-c97dbb9cc592 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:50.972772 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-64d18656-4f9b-407b-bf6e-c97dbb9cc592 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:50.995864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-64d18656-4f9b-407b-bf6e-c97dbb9cc592 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:50.996362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-64d18656-4f9b-407b-bf6e-c97dbb9cc592 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:50.997305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-64d18656-4f9b-407b-bf6e-c97dbb9cc592 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:50.997642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-64d18656-4f9b-407b-bf6e-c97dbb9cc592 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:51.212684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-71a03680-5d01-4599-a280-30bd889e04f8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:51.213672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-71a03680-5d01-4599-a280-30bd889e04f8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:51.223664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-71a03680-5d01-4599-a280-30bd889e04f8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:51.227946 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-64d18656-4f9b-407b-bf6e-c97dbb9cc592 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:51.229379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-71a03680-5d01-4599-a280-30bd889e04f8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:51.230888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-71a03680-5d01-4599-a280-30bd889e04f8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:51.232185 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-71a03680-5d01-4599-a280-30bd889e04f8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:51.254721 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-64d18656-4f9b-407b-bf6e-c97dbb9cc592 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1513 microversion: 2.1 time: 0.285218 May 21 21:33:51.259203 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2524/5175] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:50 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1513 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:33:51.273672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-31af5e23-f3b3-4c8b-aaf1-2dc299f2829e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:51.274575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-31af5e23-f3b3-4c8b-aaf1-2dc299f2829e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:51.281392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-31af5e23-f3b3-4c8b-aaf1-2dc299f2829e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:51.282107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-31af5e23-f3b3-4c8b-aaf1-2dc299f2829e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:51.283060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-31af5e23-f3b3-4c8b-aaf1-2dc299f2829e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:51.283661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-31af5e23-f3b3-4c8b-aaf1-2dc299f2829e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:51.520607 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-31af5e23-f3b3-4c8b-aaf1-2dc299f2829e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:51.530689 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-31af5e23-f3b3-4c8b-aaf1-2dc299f2829e tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 200 len: 1242 microversion: 2.1 time: 0.261301 May 21 21:33:51.531274 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2525/5176] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:51 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 1242 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:51.611152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-71a03680-5d01-4599-a280-30bd889e04f8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:51.628325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-71a03680-5d01-4599-a280-30bd889e04f8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:51.633023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-71a03680-5d01-4599-a280-30bd889e04f8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:51.635351 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-71a03680-5d01-4599-a280-30bd889e04f8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1808 microversion: 2.20 time: 0.427846 May 21 21:33:51.647498 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2652/5177] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:51 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1808 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:52.278341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-62410be4-96f7-474c-b831-c2f6472f1eae tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:52.279103 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-62410be4-96f7-474c-b831-c2f6472f1eae tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:52.290440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62410be4-96f7-474c-b831-c2f6472f1eae tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:52.290902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62410be4-96f7-474c-b831-c2f6472f1eae tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:52.296585 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62410be4-96f7-474c-b831-c2f6472f1eae tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:52.297072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62410be4-96f7-474c-b831-c2f6472f1eae tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:52.551118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0042fb5b-a7ea-43cd-b4fe-eda6fef96626 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:52.551837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0042fb5b-a7ea-43cd-b4fe-eda6fef96626 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:52.560009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0042fb5b-a7ea-43cd-b4fe-eda6fef96626 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:52.560848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0042fb5b-a7ea-43cd-b4fe-eda6fef96626 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:52.561734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0042fb5b-a7ea-43cd-b4fe-eda6fef96626 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:52.562178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0042fb5b-a7ea-43cd-b4fe-eda6fef96626 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:52.723615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0042fb5b-a7ea-43cd-b4fe-eda6fef96626 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:52.736653 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0042fb5b-a7ea-43cd-b4fe-eda6fef96626 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 200 len: 1290 microversion: 2.1 time: 0.189585 May 21 21:33:52.738948 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2653/5178] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:52 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 1290 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:33:52.748767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9218c1dd-4328-4c52-a43b-88570ed1fc01 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:52.756235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9218c1dd-4328-4c52-a43b-88570ed1fc01 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:52.781213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9218c1dd-4328-4c52-a43b-88570ed1fc01 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:52.781951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9218c1dd-4328-4c52-a43b-88570ed1fc01 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:52.782960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9218c1dd-4328-4c52-a43b-88570ed1fc01 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:52.787524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9218c1dd-4328-4c52-a43b-88570ed1fc01 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:52.951273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-62410be4-96f7-474c-b831-c2f6472f1eae tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:52.961965 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-62410be4-96f7-474c-b831-c2f6472f1eae tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1513 microversion: 2.1 time: 0.690301 May 21 21:33:52.963615 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2526/5179] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:52 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1513 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:53.183965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9218c1dd-4328-4c52-a43b-88570ed1fc01 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:53.195721 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9218c1dd-4328-4c52-a43b-88570ed1fc01 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:53.199539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9218c1dd-4328-4c52-a43b-88570ed1fc01 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:53.200816 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9218c1dd-4328-4c52-a43b-88570ed1fc01 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1808 microversion: 2.20 time: 0.459712 May 21 21:33:53.201386 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2654/5180] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:52 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1808 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:53.756886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0c83aa23-9b3e-433a-bfe7-e97839e9ea66 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:53.757520 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0c83aa23-9b3e-433a-bfe7-e97839e9ea66 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:53.767410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c83aa23-9b3e-433a-bfe7-e97839e9ea66 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:53.768166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c83aa23-9b3e-433a-bfe7-e97839e9ea66 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:53.769184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c83aa23-9b3e-433a-bfe7-e97839e9ea66 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:53.775743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c83aa23-9b3e-433a-bfe7-e97839e9ea66 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:53.930994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0c83aa23-9b3e-433a-bfe7-e97839e9ea66 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:53.947213 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0c83aa23-9b3e-433a-bfe7-e97839e9ea66 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 200 len: 1308 microversion: 2.1 time: 0.194521 May 21 21:33:53.948399 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2527/5181] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:53 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 1308 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:53.980064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aad6a8dd-ab25-4bb8-a4b8-761f40139e22 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:53.988994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aad6a8dd-ab25-4bb8-a4b8-761f40139e22 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:53.993436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aad6a8dd-ab25-4bb8-a4b8-761f40139e22 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:53.993897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aad6a8dd-ab25-4bb8-a4b8-761f40139e22 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:53.994755 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aad6a8dd-ab25-4bb8-a4b8-761f40139e22 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:53.995193 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aad6a8dd-ab25-4bb8-a4b8-761f40139e22 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:54.001421 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-fba0bfa2-df3a-4602-b841-8be6421dc790 req-46c4e822-2f26-445f-8c44-175b47cc0bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7de5bb-0233-4e88-a1a0-8561385e53cd", "name": "network-vif-deleted", "tag": "fc4ad2f3-98e9-42fc-81a3-7fc4fa986079"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:54.027969 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-fba0bfa2-df3a-4602-b841-8be6421dc790 req-46c4e822-2f26-445f-8c44-175b47cc0bc3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:54.035804 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-fba0bfa2-df3a-4602-b841-8be6421dc790 req-46c4e822-2f26-445f-8c44-175b47cc0bc3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:54.064788 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-fba0bfa2-df3a-4602-b841-8be6421dc790 req-46c4e822-2f26-445f-8c44-175b47cc0bc3 service nova] Creating event network-vif-deleted:fc4ad2f3-98e9-42fc-81a3-7fc4fa986079 for instance af7de5bb-0233-4e88-a1a0-8561385e53cd on nch1-master-1 May 21 21:33:54.080452 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-fba0bfa2-df3a-4602-b841-8be6421dc790 req-46c4e822-2f26-445f-8c44-175b47cc0bc3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083593 May 21 21:33:54.096849 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2528/5182] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:33:54.141650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aad6a8dd-ab25-4bb8-a4b8-761f40139e22 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:54.162391 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aad6a8dd-ab25-4bb8-a4b8-761f40139e22 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1471 microversion: 2.1 time: 0.186188 May 21 21:33:54.167208 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2655/5183] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:53 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1471 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:54.222365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bc55ab02-6fb8-4c7c-af79-b45237b05589 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:54.223081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bc55ab02-6fb8-4c7c-af79-b45237b05589 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:54.236996 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc55ab02-6fb8-4c7c-af79-b45237b05589 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:54.240839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc55ab02-6fb8-4c7c-af79-b45237b05589 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:54.240839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc55ab02-6fb8-4c7c-af79-b45237b05589 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:54.240839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc55ab02-6fb8-4c7c-af79-b45237b05589 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:54.742535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bc55ab02-6fb8-4c7c-af79-b45237b05589 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:54.753525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bc55ab02-6fb8-4c7c-af79-b45237b05589 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:54.758586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bc55ab02-6fb8-4c7c-af79-b45237b05589 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:54.767753 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bc55ab02-6fb8-4c7c-af79-b45237b05589 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1808 microversion: 2.20 time: 0.546491 May 21 21:33:54.767753 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2529/5184] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:54 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1808 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:54.967310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-454ddd57-f62e-4226-86ba-2a674ab8f4bb tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:54.968177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-454ddd57-f62e-4226-86ba-2a674ab8f4bb tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:54.971275 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:54.985509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-454ddd57-f62e-4226-86ba-2a674ab8f4bb tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:54.988157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-454ddd57-f62e-4226-86ba-2a674ab8f4bb tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:54.989097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-454ddd57-f62e-4226-86ba-2a674ab8f4bb tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:54.993720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-454ddd57-f62e-4226-86ba-2a674ab8f4bb tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:55.112177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-454ddd57-f62e-4226-86ba-2a674ab8f4bb tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:55.125664 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-454ddd57-f62e-4226-86ba-2a674ab8f4bb tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 200 len: 1296 microversion: 2.1 time: 0.161893 May 21 21:33:55.128367 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2656/5185] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:54 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 1296 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:55.181546 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c432c9ab-7c43-43ce-afb6-b86152889716 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:55.183043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c432c9ab-7c43-43ce-afb6-b86152889716 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:55.194003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c432c9ab-7c43-43ce-afb6-b86152889716 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:55.194902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c432c9ab-7c43-43ce-afb6-b86152889716 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:55.196173 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c432c9ab-7c43-43ce-afb6-b86152889716 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:55.197042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c432c9ab-7c43-43ce-afb6-b86152889716 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:55.287820 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c432c9ab-7c43-43ce-afb6-b86152889716 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:55.288766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c432c9ab-7c43-43ce-afb6-b86152889716 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:55.289656 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-c432c9ab-7c43-43ce-afb6-b86152889716 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lazy-loading 'fault' on Instance uuid af7de5bb-0233-4e88-a1a0-8561385e53cd {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:33:55.367656 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c432c9ab-7c43-43ce-afb6-b86152889716 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '411af27147894e999b4242c5b9991c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f0db8b0958479990724993361c0a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:55.378872 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c432c9ab-7c43-43ce-afb6-b86152889716 tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 200 len: 1307 microversion: 2.1 time: 0.202048 May 21 21:33:55.380707 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2530/5186] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:55 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 1307 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:55.477338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-53a26430-2273-4b14-a980-655d94d89577 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:55.478523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-53a26430-2273-4b14-a980-655d94d89577 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:55.508717 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53a26430-2273-4b14-a980-655d94d89577 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:55.509841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53a26430-2273-4b14-a980-655d94d89577 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:55.510071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53a26430-2273-4b14-a980-655d94d89577 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:55.513734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53a26430-2273-4b14-a980-655d94d89577 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:55.573361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-53a26430-2273-4b14-a980-655d94d89577 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:33:55.801339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c8f75262-76b5-42a1-8c74-3fbb0ce92973 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:55.802912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c8f75262-76b5-42a1-8c74-3fbb0ce92973 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:55.865540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8f75262-76b5-42a1-8c74-3fbb0ce92973 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:55.867025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8f75262-76b5-42a1-8c74-3fbb0ce92973 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:55.869634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8f75262-76b5-42a1-8c74-3fbb0ce92973 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:55.873516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8f75262-76b5-42a1-8c74-3fbb0ce92973 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:56.169982 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-53a26430-2273-4b14-a980-655d94d89577 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 204 len: 0 microversion: 2.1 time: 0.702453 May 21 21:33:56.178903 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2657/5187] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:33:55 2022] DELETE /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 0 bytes in 708 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 21:33:56.186961 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-59467070-4e27-4b15-8278-27459876dbbe tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:56.189618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-59467070-4e27-4b15-8278-27459876dbbe tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:56.200002 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-59467070-4e27-4b15-8278-27459876dbbe tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:56.200876 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-59467070-4e27-4b15-8278-27459876dbbe tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:56.202455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-59467070-4e27-4b15-8278-27459876dbbe tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:56.203532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-59467070-4e27-4b15-8278-27459876dbbe tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:56.213616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:56.275847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c8f75262-76b5-42a1-8c74-3fbb0ce92973 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:56.285783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c8f75262-76b5-42a1-8c74-3fbb0ce92973 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:56.289036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c8f75262-76b5-42a1-8c74-3fbb0ce92973 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:56.290580 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c8f75262-76b5-42a1-8c74-3fbb0ce92973 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1808 microversion: 2.20 time: 0.511028 May 21 21:33:56.303854 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2531/5188] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:55 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1808 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:56.311084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1806756f-92fc-43f0-85ab-d785830fc634 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:56.312151 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1806756f-92fc-43f0-85ab-d785830fc634 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:56.320389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1806756f-92fc-43f0-85ab-d785830fc634 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:56.321067 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1806756f-92fc-43f0-85ab-d785830fc634 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:56.322175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1806756f-92fc-43f0-85ab-d785830fc634 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:56.322905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1806756f-92fc-43f0-85ab-d785830fc634 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:56.590170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-59467070-4e27-4b15-8278-27459876dbbe tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:56.600804 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-59467070-4e27-4b15-8278-27459876dbbe tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 200 len: 1364 microversion: 2.1 time: 0.420122 May 21 21:33:56.602209 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2658/5189] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:56 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 1364 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:56.608143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e5a8cda7-790f-489d-9770-e5fed4e173ef tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:56.608990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e5a8cda7-790f-489d-9770-e5fed4e173ef tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] [instance: af7de5bb-0233-4e88-a1a0-8561385e53cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:56.616270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5a8cda7-790f-489d-9770-e5fed4e173ef tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:56.616849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5a8cda7-790f-489d-9770-e5fed4e173ef tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:56.617641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5a8cda7-790f-489d-9770-e5fed4e173ef tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:56.618083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5a8cda7-790f-489d-9770-e5fed4e173ef tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:56.635349 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-e5a8cda7-790f-489d-9770-e5fed4e173ef tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] HTTP exception thrown: Instance af7de5bb-0233-4e88-a1a0-8561385e53cd could not be found. May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e5a8cda7-790f-489d-9770-e5fed4e173ef tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Request method failure captured: May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd HTTP/1.1 May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoJy-JSo6SArYifR7TzzNmTVfxK0foTrYrGnevA23o9MAeBZywRFJC1f9a8sMmV8ru648Yb28srOSit4e3V8_Fk5mY9oLosNOy1xuMPMz9PH2BFz1t6Hmi606hIRTTRFDA9ivk6uc8BgGAbXEzOTR4g4xgVSJrjpLJwYxOVYYN6obk May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/27f0db8b0958479990724993361c0a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_27f0db8b0958479990724993361c0a51", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/27f0db8b0958479990724993361c0a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 27f0db8b0958479990724993361c0a51 May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1080286652 May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 411af27147894e999b4242c5b9991c98 May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-1080286652-project May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance af7de5bb-0233-4e88-a1a0-8561385e53cd could not be found. May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'af7de5bb-0233-4e88-a1a0-8561385e53cd'} May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7de5bb-0233-4e88-a1a0-8561385e53cd could not be found. May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7de5bb-0233-4e88-a1a0-8561385e53cd could not be found. May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:33:56.637547 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:56.642064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:33:56.642064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:33:56.642064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:33:56.642064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:33:56.642064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:33:56.642064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7de5bb-0233-4e88-a1a0-8561385e53cd could not be found. May 21 21:33:56.642064 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:33:56.643505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e5a8cda7-790f-489d-9770-e5fed4e173ef tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] Returning 404 to user: Instance af7de5bb-0233-4e88-a1a0-8561385e53cd could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:33:56.644596 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e5a8cda7-790f-489d-9770-e5fed4e173ef tempest-ServersNegativeTestJSON-1080286652 tempest-ServersNegativeTestJSON-1080286652-project] 10.222.0.49 "GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd" status: 404 len: 111 microversion: 2.1 time: 0.041007 May 21 21:33:56.645317 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2659/5190] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:56 2022] GET /compute/v2.1/servers/af7de5bb-0233-4e88-a1a0-8561385e53cd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:33:56.797842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1806756f-92fc-43f0-85ab-d785830fc634 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:56.808673 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1806756f-92fc-43f0-85ab-d785830fc634 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1508 microversion: 2.1 time: 0.503199 May 21 21:33:56.814014 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2532/5191] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:56 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1508 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:57.311541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ce3f7fda-66ff-46e6-9a56-2008c3de5064 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:57.312093 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ce3f7fda-66ff-46e6-9a56-2008c3de5064 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:57.335908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce3f7fda-66ff-46e6-9a56-2008c3de5064 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:57.338776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce3f7fda-66ff-46e6-9a56-2008c3de5064 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:57.341978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce3f7fda-66ff-46e6-9a56-2008c3de5064 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:57.342477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce3f7fda-66ff-46e6-9a56-2008c3de5064 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:57.766120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2954d0e0-e4b5-4bdc-b18f-4bd7880453c2 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:57.766120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2954d0e0-e4b5-4bdc-b18f-4bd7880453c2 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:57.766120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2954d0e0-e4b5-4bdc-b18f-4bd7880453c2 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:57.766120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2954d0e0-e4b5-4bdc-b18f-4bd7880453c2 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:57.766120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2954d0e0-e4b5-4bdc-b18f-4bd7880453c2 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:57.766120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2954d0e0-e4b5-4bdc-b18f-4bd7880453c2 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:57.908438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2954d0e0-e4b5-4bdc-b18f-4bd7880453c2 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:57.918534 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2954d0e0-e4b5-4bdc-b18f-4bd7880453c2 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 200 len: 1364 microversion: 2.1 time: 0.304265 May 21 21:33:57.919901 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2533/5192] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:57 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 1364 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:33:57.925511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-19c5f7ba-a6dd-4113-9060-27308c8d0d9b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:57.926454 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-19c5f7ba-a6dd-4113-9060-27308c8d0d9b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:57.934883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19c5f7ba-a6dd-4113-9060-27308c8d0d9b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:57.935767 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19c5f7ba-a6dd-4113-9060-27308c8d0d9b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:57.936865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19c5f7ba-a6dd-4113-9060-27308c8d0d9b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:57.937590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19c5f7ba-a6dd-4113-9060-27308c8d0d9b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:57.950791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ce3f7fda-66ff-46e6-9a56-2008c3de5064 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:57.965969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ce3f7fda-66ff-46e6-9a56-2008c3de5064 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:57.973425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ce3f7fda-66ff-46e6-9a56-2008c3de5064 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:57.975554 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ce3f7fda-66ff-46e6-9a56-2008c3de5064 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1808 microversion: 2.20 time: 0.668435 May 21 21:33:57.976631 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2660/5193] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:57 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1808 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:33:57.978035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:58.249061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-84147a34-94a6-4dce-b24e-772e3cdf2b22 req-ebc73ad3-95fc-4666-8d46-9e5add554999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fdb37d6-723b-4053-81cd-697a6aa334a2", "tag": "f564fcbe-89e0-4d41-98a7-8cf562ada89c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:58.270640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-84147a34-94a6-4dce-b24e-772e3cdf2b22 req-ebc73ad3-95fc-4666-8d46-9e5add554999 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:58.271141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-84147a34-94a6-4dce-b24e-772e3cdf2b22 req-ebc73ad3-95fc-4666-8d46-9e5add554999 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:58.294373 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-84147a34-94a6-4dce-b24e-772e3cdf2b22 req-ebc73ad3-95fc-4666-8d46-9e5add554999 service nova] Creating event network-changed:f564fcbe-89e0-4d41-98a7-8cf562ada89c for instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 on nch2-master-1 May 21 21:33:58.319782 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-84147a34-94a6-4dce-b24e-772e3cdf2b22 req-ebc73ad3-95fc-4666-8d46-9e5add554999 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071310 May 21 21:33:58.321521 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2661/5194] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:33:58.561752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-19c5f7ba-a6dd-4113-9060-27308c8d0d9b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:58.572385 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-19c5f7ba-a6dd-4113-9060-27308c8d0d9b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1508 microversion: 2.1 time: 0.651101 May 21 21:33:58.577501 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2534/5195] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:57 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1508 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:58.939761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b7003674-be85-4407-8235-2468cfa5a470 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:58.941192 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b7003674-be85-4407-8235-2468cfa5a470 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:58.956680 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7003674-be85-4407-8235-2468cfa5a470 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:58.959517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7003674-be85-4407-8235-2468cfa5a470 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:58.961496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7003674-be85-4407-8235-2468cfa5a470 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:58.965438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7003674-be85-4407-8235-2468cfa5a470 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:58.996321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0cbafc1f-dfef-4001-b234-a91337c36cd3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:58.997924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0cbafc1f-dfef-4001-b234-a91337c36cd3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:59.024010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0cbafc1f-dfef-4001-b234-a91337c36cd3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:59.025112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0cbafc1f-dfef-4001-b234-a91337c36cd3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:59.028914 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0cbafc1f-dfef-4001-b234-a91337c36cd3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:59.032382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0cbafc1f-dfef-4001-b234-a91337c36cd3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:59.419401 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b7003674-be85-4407-8235-2468cfa5a470 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:59.441762 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b7003674-be85-4407-8235-2468cfa5a470 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 200 len: 1364 microversion: 2.1 time: 0.508343 May 21 21:33:59.448649 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2662/5196] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:58 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 1364 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:59.457082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0cbafc1f-dfef-4001-b234-a91337c36cd3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:59.469301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0cbafc1f-dfef-4001-b234-a91337c36cd3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:59.470874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0cbafc1f-dfef-4001-b234-a91337c36cd3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:59.472145 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0cbafc1f-dfef-4001-b234-a91337c36cd3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1808 microversion: 2.20 time: 0.480727 May 21 21:33:59.473268 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2535/5197] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:33:58 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1808 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:33:59.593670 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-251a8ca5-8d4d-4e5f-80c5-a6428d67b4d1 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:33:59.594319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-251a8ca5-8d4d-4e5f-80c5-a6428d67b4d1 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:33:59.602574 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-251a8ca5-8d4d-4e5f-80c5-a6428d67b4d1 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:59.603016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-251a8ca5-8d4d-4e5f-80c5-a6428d67b4d1 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:59.603805 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-251a8ca5-8d4d-4e5f-80c5-a6428d67b4d1 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:59.604255 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-251a8ca5-8d4d-4e5f-80c5-a6428d67b4d1 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:59.723311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-251a8ca5-8d4d-4e5f-80c5-a6428d67b4d1 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:33:59.743585 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-251a8ca5-8d4d-4e5f-80c5-a6428d67b4d1 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1466 microversion: 2.1 time: 0.153491 May 21 21:33:59.746252 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2663/5198] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:33:59 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1466 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:33:59.850736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-acbef5a0-b718-4b8f-8307-60d9db554b96 req-a3337541-d2ba-4688-ba2c-2fb79faa7af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3224316b-c287-4ec4-9b89-aeb8d9bf7adc", "name": "network-vif-deleted", "tag": "94ca0b0b-018e-4c6a-8dd7-db57f04e9a46"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:33:59.858653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:59.893592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-acbef5a0-b718-4b8f-8307-60d9db554b96 req-a3337541-d2ba-4688-ba2c-2fb79faa7af3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:33:59.893592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-acbef5a0-b718-4b8f-8307-60d9db554b96 req-a3337541-d2ba-4688-ba2c-2fb79faa7af3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:33:59.894509 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-acbef5a0-b718-4b8f-8307-60d9db554b96 req-a3337541-d2ba-4688-ba2c-2fb79faa7af3 service nova] Creating event network-vif-deleted:94ca0b0b-018e-4c6a-8dd7-db57f04e9a46 for instance 3224316b-c287-4ec4-9b89-aeb8d9bf7adc on nch1-master-1 May 21 21:33:59.916194 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-acbef5a0-b718-4b8f-8307-60d9db554b96 req-a3337541-d2ba-4688-ba2c-2fb79faa7af3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067086 May 21 21:33:59.917818 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2536/5199] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:34:00.466671 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b17ca2c3-abb2-4599-bc95-1308d831350b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:00.468013 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b17ca2c3-abb2-4599-bc95-1308d831350b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:00.477878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b17ca2c3-abb2-4599-bc95-1308d831350b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:00.478337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b17ca2c3-abb2-4599-bc95-1308d831350b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:00.479305 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b17ca2c3-abb2-4599-bc95-1308d831350b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:00.479754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b17ca2c3-abb2-4599-bc95-1308d831350b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:00.493619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-155eef0b-c4fa-4d87-b3fe-5b693cb3c920 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:00.494964 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-155eef0b-c4fa-4d87-b3fe-5b693cb3c920 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:00.505779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=8 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:34:00.508403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-155eef0b-c4fa-4d87-b3fe-5b693cb3c920 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:00.508688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-155eef0b-c4fa-4d87-b3fe-5b693cb3c920 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:00.509691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-155eef0b-c4fa-4d87-b3fe-5b693cb3c920 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:00.510429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-155eef0b-c4fa-4d87-b3fe-5b693cb3c920 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:00.734864 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b17ca2c3-abb2-4599-bc95-1308d831350b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:00.745301 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b17ca2c3-abb2-4599-bc95-1308d831350b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 200 len: 1364 microversion: 2.1 time: 0.281183 May 21 21:34:00.747562 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2664/5200] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:34:00 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:34:00.766284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4173f807-9e32-43b6-a217-c65ff8149b24 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:00.768666 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4173f807-9e32-43b6-a217-c65ff8149b24 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:00.779146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4173f807-9e32-43b6-a217-c65ff8149b24 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:00.781404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4173f807-9e32-43b6-a217-c65ff8149b24 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:00.783588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4173f807-9e32-43b6-a217-c65ff8149b24 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:00.784343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4173f807-9e32-43b6-a217-c65ff8149b24 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:00.872222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4173f807-9e32-43b6-a217-c65ff8149b24 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:00.875464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4173f807-9e32-43b6-a217-c65ff8149b24 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:00.876139 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-4173f807-9e32-43b6-a217-c65ff8149b24 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lazy-loading 'fault' on Instance uuid 3224316b-c287-4ec4-9b89-aeb8d9bf7adc {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:34:00.912118 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-155eef0b-c4fa-4d87-b3fe-5b693cb3c920 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:00.921179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-155eef0b-c4fa-4d87-b3fe-5b693cb3c920 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:00.922800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-155eef0b-c4fa-4d87-b3fe-5b693cb3c920 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:00.924363 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-155eef0b-c4fa-4d87-b3fe-5b693cb3c920 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1808 microversion: 2.20 time: 0.435712 May 21 21:34:00.924879 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2537/5201] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:00 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1808 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:01.005416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4173f807-9e32-43b6-a217-c65ff8149b24 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:01.026778 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4173f807-9e32-43b6-a217-c65ff8149b24 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 200 len: 1312 microversion: 2.1 time: 0.266777 May 21 21:34:01.041612 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2665/5202] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:34:00 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 1312 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:34:01.778798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-49bf1958-f7c4-4cf1-a17a-3043864861f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:01.778798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-49bf1958-f7c4-4cf1-a17a-3043864861f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:01.778798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-49bf1958-f7c4-4cf1-a17a-3043864861f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:01.778798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-49bf1958-f7c4-4cf1-a17a-3043864861f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:01.778798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-49bf1958-f7c4-4cf1-a17a-3043864861f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:01.778798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-49bf1958-f7c4-4cf1-a17a-3043864861f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:01.945238 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b8f4b202-aff0-4153-9448-4ddd5b9e875a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:01.946527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b8f4b202-aff0-4153-9448-4ddd5b9e875a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:01.954818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8f4b202-aff0-4153-9448-4ddd5b9e875a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:01.955661 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8f4b202-aff0-4153-9448-4ddd5b9e875a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:01.956738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8f4b202-aff0-4153-9448-4ddd5b9e875a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:01.958444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8f4b202-aff0-4153-9448-4ddd5b9e875a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:02.174256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-49bf1958-f7c4-4cf1-a17a-3043864861f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:02.182324 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-49bf1958-f7c4-4cf1-a17a-3043864861f3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 200 len: 1364 microversion: 2.1 time: 0.423065 May 21 21:34:02.182864 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2538/5203] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:34:01 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 1364 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:34:02.183015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b8f4b202-aff0-4153-9448-4ddd5b9e875a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:02.188458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-841e871c-1e5b-43d9-91cc-d184de7fbb7f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:02.189397 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-841e871c-1e5b-43d9-91cc-d184de7fbb7f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 3224316b-c287-4ec4-9b89-aeb8d9bf7adc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:02.196716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-841e871c-1e5b-43d9-91cc-d184de7fbb7f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:02.197518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-841e871c-1e5b-43d9-91cc-d184de7fbb7f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:02.198540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-841e871c-1e5b-43d9-91cc-d184de7fbb7f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:02.199203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-841e871c-1e5b-43d9-91cc-d184de7fbb7f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:02.200636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b8f4b202-aff0-4153-9448-4ddd5b9e875a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:02.202889 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b8f4b202-aff0-4153-9448-4ddd5b9e875a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:02.204079 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b8f4b202-aff0-4153-9448-4ddd5b9e875a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1808 microversion: 2.20 time: 0.264283 May 21 21:34:02.205785 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2666/5204] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:01 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1808 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:02.221385 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-841e871c-1e5b-43d9-91cc-d184de7fbb7f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] HTTP exception thrown: Instance 3224316b-c287-4ec4-9b89-aeb8d9bf7adc could not be found. May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-841e871c-1e5b-43d9-91cc-d184de7fbb7f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Request method failure captured: May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc HTTP/1.1 May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVnYy3SaySatFVqWuD4QLMX78tOZu2Sq081sncP5_CZnvryZkShUPSqptMQixW9D6QLw2UuDdxyQwaeJ6lrj30y7u6OXCJpzi5UJG9aI3fEqHW0Sq9F2EcE_2fCjYowdWcuux0Sp0LhoueDGd91ZOn29SJFvBmrTIiAhoJB3iHzY0IU May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 2e6d59483dc54fe4a558186055068419 May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2e6d59483dc54fe4a558186055068419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2e6d59483dc54fe4a558186055068419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2e6d59483dc54fe4a558186055068419", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2e6d59483dc54fe4a558186055068419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 2e6d59483dc54fe4a558186055068419 May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerRescueNegativeTestJSON-1981617934-project May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 9a0ccfb5c9a04ec0831a0bfe987bb659 May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1981617934-project May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 3224316b-c287-4ec4-9b89-aeb8d9bf7adc could not be found. May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '3224316b-c287-4ec4-9b89-aeb8d9bf7adc'} May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3224316b-c287-4ec4-9b89-aeb8d9bf7adc could not be found. May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3224316b-c287-4ec4-9b89-aeb8d9bf7adc could not be found. May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:34:02.223343 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:34:02.229381 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:34:02.229381 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:34:02.229381 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:34:02.229381 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:34:02.229381 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:34:02.229381 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:34:02.229381 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3224316b-c287-4ec4-9b89-aeb8d9bf7adc could not be found. May 21 21:34:02.229381 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:34:02.229381 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-841e871c-1e5b-43d9-91cc-d184de7fbb7f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Returning 404 to user: Instance 3224316b-c287-4ec4-9b89-aeb8d9bf7adc could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:34:02.229381 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-841e871c-1e5b-43d9-91cc-d184de7fbb7f tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc" status: 404 len: 111 microversion: 2.1 time: 0.041023 May 21 21:34:02.229381 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2539/5205] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:34:02 2022] GET /compute/v2.1/servers/3224316b-c287-4ec4-9b89-aeb8d9bf7adc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:34:02.234867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aa9cf317-1f70-4687-849c-aa740a316600 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:02.234867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aa9cf317-1f70-4687-849c-aa740a316600 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:02.241430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa9cf317-1f70-4687-849c-aa740a316600 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:02.245609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa9cf317-1f70-4687-849c-aa740a316600 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:02.245609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa9cf317-1f70-4687-849c-aa740a316600 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:02.245609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa9cf317-1f70-4687-849c-aa740a316600 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:02.283498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aa9cf317-1f70-4687-849c-aa740a316600 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:34:03.199731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-37a0510d-3d99-4d3a-a53b-26e8376c5b2a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:03.205070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-37a0510d-3d99-4d3a-a53b-26e8376c5b2a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:03.214383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-37a0510d-3d99-4d3a-a53b-26e8376c5b2a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:03.214884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-37a0510d-3d99-4d3a-a53b-26e8376c5b2a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:03.215601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-37a0510d-3d99-4d3a-a53b-26e8376c5b2a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:03.216042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-37a0510d-3d99-4d3a-a53b-26e8376c5b2a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:03.343339 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aa9cf317-1f70-4687-849c-aa740a316600 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "DELETE /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 204 len: 0 microversion: 2.1 time: 1.112289 May 21 21:34:03.347376 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2667/5206] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:34:02 2022] DELETE /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 0 bytes in 1115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:34:03.351072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9aff0210-d4db-4983-81bb-54d3d758e6bf tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:03.351628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9aff0210-d4db-4983-81bb-54d3d758e6bf tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:03.367571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:34:03.369838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9aff0210-d4db-4983-81bb-54d3d758e6bf tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:03.370608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9aff0210-d4db-4983-81bb-54d3d758e6bf tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:03.371801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9aff0210-d4db-4983-81bb-54d3d758e6bf tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:03.372685 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9aff0210-d4db-4983-81bb-54d3d758e6bf tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:03.428036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-37a0510d-3d99-4d3a-a53b-26e8376c5b2a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:03.448928 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-37a0510d-3d99-4d3a-a53b-26e8376c5b2a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 200 len: 1364 microversion: 2.1 time: 0.253489 May 21 21:34:03.449531 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2540/5207] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:34:03 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 1364 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:34:03.459381 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f692903d-03c4-4b03-a47d-bfdd211da6c9 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:03.459966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f692903d-03c4-4b03-a47d-bfdd211da6c9 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:03.479784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f692903d-03c4-4b03-a47d-bfdd211da6c9 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:03.480254 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f692903d-03c4-4b03-a47d-bfdd211da6c9 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:03.481211 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f692903d-03c4-4b03-a47d-bfdd211da6c9 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:03.481663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f692903d-03c4-4b03-a47d-bfdd211da6c9 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:03.611365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9aff0210-d4db-4983-81bb-54d3d758e6bf tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:03.627720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9aff0210-d4db-4983-81bb-54d3d758e6bf tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:03.630706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9aff0210-d4db-4983-81bb-54d3d758e6bf tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:03.632380 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9aff0210-d4db-4983-81bb-54d3d758e6bf tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1808 microversion: 2.20 time: 0.286972 May 21 21:34:03.633226 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2668/5208] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:03 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1808 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:03.683563 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f692903d-03c4-4b03-a47d-bfdd211da6c9 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:03.696592 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f692903d-03c4-4b03-a47d-bfdd211da6c9 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1521 microversion: 2.1 time: 0.245854 May 21 21:34:03.708521 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2541/5209] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:34:03 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:34:04.466933 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-726a3533-e8a3-4417-b636-84600a754170 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:04.467547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-726a3533-e8a3-4417-b636-84600a754170 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:04.475483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-726a3533-e8a3-4417-b636-84600a754170 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:04.475958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-726a3533-e8a3-4417-b636-84600a754170 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:04.476802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-726a3533-e8a3-4417-b636-84600a754170 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:04.477246 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-726a3533-e8a3-4417-b636-84600a754170 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:04.653284 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aad74072-4c96-4753-93ca-38f55706c4a6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:04.660134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-aad74072-4c96-4753-93ca-38f55706c4a6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:04.662521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aad74072-4c96-4753-93ca-38f55706c4a6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:04.663257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aad74072-4c96-4753-93ca-38f55706c4a6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:04.664295 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aad74072-4c96-4753-93ca-38f55706c4a6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:04.665776 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aad74072-4c96-4753-93ca-38f55706c4a6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:04.744579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-726a3533-e8a3-4417-b636-84600a754170 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:04.752914 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-726a3533-e8a3-4417-b636-84600a754170 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 200 len: 1364 microversion: 2.1 time: 0.290095 May 21 21:34:04.767716 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2669/5210] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:34:04 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 1364 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:34:04.767716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-726a3533-e8a3-4417-b636-84600a754170 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:04.767716 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-726a3533-e8a3-4417-b636-84600a754170 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001371 May 21 21:34:04.767716 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2670/5211] 10.222.0.49 () {56 vars in 885 bytes} [Sat May 21 21:34:04 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 21 21:34:04.773194 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a0faff4e-05c6-4b4a-924f-bb27cade3c1b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:04.774488 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a0faff4e-05c6-4b4a-924f-bb27cade3c1b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:04.782151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a0faff4e-05c6-4b4a-924f-bb27cade3c1b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:04.783294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a0faff4e-05c6-4b4a-924f-bb27cade3c1b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:04.784841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a0faff4e-05c6-4b4a-924f-bb27cade3c1b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:04.785610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a0faff4e-05c6-4b4a-924f-bb27cade3c1b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:04.838851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-aad74072-4c96-4753-93ca-38f55706c4a6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:04.851633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-aad74072-4c96-4753-93ca-38f55706c4a6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:04.852689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-aad74072-4c96-4753-93ca-38f55706c4a6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:04.854003 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-aad74072-4c96-4753-93ca-38f55706c4a6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1808 microversion: 2.20 time: 0.206297 May 21 21:34:04.854654 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2542/5212] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:04 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:05.286088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a0faff4e-05c6-4b4a-924f-bb27cade3c1b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:05.295223 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a0faff4e-05c6-4b4a-924f-bb27cade3c1b tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1521 microversion: 2.1 time: 0.527019 May 21 21:34:05.295823 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2671/5213] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:34:04 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1521 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:34:05.772529 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7a6349bf-da7f-4039-bf6f-bebfe74fba2b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:05.773761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7a6349bf-da7f-4039-bf6f-bebfe74fba2b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:05.781106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7a6349bf-da7f-4039-bf6f-bebfe74fba2b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:05.781568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7a6349bf-da7f-4039-bf6f-bebfe74fba2b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:05.782359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7a6349bf-da7f-4039-bf6f-bebfe74fba2b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:05.782814 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7a6349bf-da7f-4039-bf6f-bebfe74fba2b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:05.876463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-77aad512-8dae-4f5c-bc60-24770ef2bd94 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:05.877311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-77aad512-8dae-4f5c-bc60-24770ef2bd94 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:05.887377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-77aad512-8dae-4f5c-bc60-24770ef2bd94 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:05.896017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-77aad512-8dae-4f5c-bc60-24770ef2bd94 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:05.899385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-77aad512-8dae-4f5c-bc60-24770ef2bd94 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:05.900082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-77aad512-8dae-4f5c-bc60-24770ef2bd94 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:06.038686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7a6349bf-da7f-4039-bf6f-bebfe74fba2b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:06.047462 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7a6349bf-da7f-4039-bf6f-bebfe74fba2b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 200 len: 1364 microversion: 2.1 time: 0.280048 May 21 21:34:06.053019 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2543/5214] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:34:05 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 1364 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:34:06.263263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-77aad512-8dae-4f5c-bc60-24770ef2bd94 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:06.275435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-77aad512-8dae-4f5c-bc60-24770ef2bd94 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:06.276996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-77aad512-8dae-4f5c-bc60-24770ef2bd94 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:06.278229 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-77aad512-8dae-4f5c-bc60-24770ef2bd94 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1808 microversion: 2.20 time: 0.406769 May 21 21:34:06.278805 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2672/5215] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:05 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1808 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:06.319561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d58f4aad-2b32-440e-a01f-dbf5468ccfb7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:06.321044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d58f4aad-2b32-440e-a01f-dbf5468ccfb7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:06.328069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d58f4aad-2b32-440e-a01f-dbf5468ccfb7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:06.328684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d58f4aad-2b32-440e-a01f-dbf5468ccfb7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:06.329547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d58f4aad-2b32-440e-a01f-dbf5468ccfb7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:06.330056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d58f4aad-2b32-440e-a01f-dbf5468ccfb7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:06.640320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d58f4aad-2b32-440e-a01f-dbf5468ccfb7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:06.652593 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d58f4aad-2b32-440e-a01f-dbf5468ccfb7 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1521 microversion: 2.1 time: 0.343305 May 21 21:34:06.653635 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2544/5216] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:34:06 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:34:07.065642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d6e9f894-72ad-43e4-bddf-d2bb467503d3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:07.066949 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d6e9f894-72ad-43e4-bddf-d2bb467503d3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:07.074580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6e9f894-72ad-43e4-bddf-d2bb467503d3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:07.075030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6e9f894-72ad-43e4-bddf-d2bb467503d3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:07.075994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6e9f894-72ad-43e4-bddf-d2bb467503d3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:07.076476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6e9f894-72ad-43e4-bddf-d2bb467503d3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:07.298951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1ef73827-0321-43c6-addf-dbf745fe8a4a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:07.299856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1ef73827-0321-43c6-addf-dbf745fe8a4a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:07.313958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ef73827-0321-43c6-addf-dbf745fe8a4a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:07.320748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ef73827-0321-43c6-addf-dbf745fe8a4a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:07.320748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ef73827-0321-43c6-addf-dbf745fe8a4a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:07.320748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ef73827-0321-43c6-addf-dbf745fe8a4a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:07.420887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d6e9f894-72ad-43e4-bddf-d2bb467503d3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:07.436561 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d6e9f894-72ad-43e4-bddf-d2bb467503d3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 200 len: 1364 microversion: 2.1 time: 0.374713 May 21 21:34:07.440170 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2673/5217] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:34:07 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 1364 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:34:07.449270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-ad25c584-6fb3-4bf6-b9ae-586d35fd0954 req-1dbecc7a-5695-4ebe-8d0a-7ce6d434817a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "506776f0-470a-4a6b-ac34-3414463a8770", "name": "network-vif-deleted", "tag": "dde6dfe2-b739-4346-bc75-f66a5634741a"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:34:07.465607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ad25c584-6fb3-4bf6-b9ae-586d35fd0954 req-1dbecc7a-5695-4ebe-8d0a-7ce6d434817a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:07.466998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ad25c584-6fb3-4bf6-b9ae-586d35fd0954 req-1dbecc7a-5695-4ebe-8d0a-7ce6d434817a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:07.486485 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-ad25c584-6fb3-4bf6-b9ae-586d35fd0954 req-1dbecc7a-5695-4ebe-8d0a-7ce6d434817a service nova] Creating event network-vif-deleted:dde6dfe2-b739-4346-bc75-f66a5634741a for instance 506776f0-470a-4a6b-ac34-3414463a8770 on nch1-master-1 May 21 21:34:07.492957 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-ad25c584-6fb3-4bf6-b9ae-586d35fd0954 req-1dbecc7a-5695-4ebe-8d0a-7ce6d434817a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051224 May 21 21:34:07.501111 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2674/5218] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:34:07.626346 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1ef73827-0321-43c6-addf-dbf745fe8a4a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:07.638103 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1ef73827-0321-43c6-addf-dbf745fe8a4a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:07.640219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1ef73827-0321-43c6-addf-dbf745fe8a4a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:07.642348 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1ef73827-0321-43c6-addf-dbf745fe8a4a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1808 microversion: 2.20 time: 0.348042 May 21 21:34:07.643260 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2545/5219] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:07 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1808 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:07.671955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aea70d48-11e4-4663-a1be-b1f2d66e9493 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:07.678160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aea70d48-11e4-4663-a1be-b1f2d66e9493 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:07.700094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aea70d48-11e4-4663-a1be-b1f2d66e9493 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:07.706629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aea70d48-11e4-4663-a1be-b1f2d66e9493 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:07.708149 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aea70d48-11e4-4663-a1be-b1f2d66e9493 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:07.709111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aea70d48-11e4-4663-a1be-b1f2d66e9493 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:08.052055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aea70d48-11e4-4663-a1be-b1f2d66e9493 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0ccfb5c9a04ec0831a0bfe987bb659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d59483dc54fe4a558186055068419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:08.055515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:34:08.067730 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aea70d48-11e4-4663-a1be-b1f2d66e9493 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 200 len: 1306 microversion: 2.1 time: 0.400794 May 21 21:34:08.069439 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2675/5220] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:34:07 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 1306 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:34:08.466315 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4ec6ccc4-8a1b-4494-ba64-b11045db69c0 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:08.468732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4ec6ccc4-8a1b-4494-ba64-b11045db69c0 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:08.502160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4ec6ccc4-8a1b-4494-ba64-b11045db69c0 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:08.507606 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4ec6ccc4-8a1b-4494-ba64-b11045db69c0 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:08.509539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4ec6ccc4-8a1b-4494-ba64-b11045db69c0 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:08.512468 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4ec6ccc4-8a1b-4494-ba64-b11045db69c0 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:08.623968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-953b4b49-6286-4eb3-ac66-dde30e56debd req-864b4894-ea0c-4774-aa02-d5a3e0ba9ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fdb37d6-723b-4053-81cd-697a6aa334a2", "name": "network-vif-plugged", "status": "completed", "tag": "f564fcbe-89e0-4d41-98a7-8cf562ada89c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:34:08.632524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-953b4b49-6286-4eb3-ac66-dde30e56debd req-864b4894-ea0c-4774-aa02-d5a3e0ba9ebe service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:08.636861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-953b4b49-6286-4eb3-ac66-dde30e56debd req-864b4894-ea0c-4774-aa02-d5a3e0ba9ebe service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:08.650120 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-953b4b49-6286-4eb3-ac66-dde30e56debd req-864b4894-ea0c-4774-aa02-d5a3e0ba9ebe service nova] Creating event network-vif-plugged:f564fcbe-89e0-4d41-98a7-8cf562ada89c for instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 on nch2-master-1 May 21 21:34:08.656262 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-953b4b49-6286-4eb3-ac66-dde30e56debd req-864b4894-ea0c-4774-aa02-d5a3e0ba9ebe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037374 May 21 21:34:08.661623 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2676/5221] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:34:08.677240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a2e8d770-ea3a-46c4-9ad9-346f696a9ba6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:08.685231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a2e8d770-ea3a-46c4-9ad9-346f696a9ba6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:08.695204 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a2e8d770-ea3a-46c4-9ad9-346f696a9ba6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:08.695837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a2e8d770-ea3a-46c4-9ad9-346f696a9ba6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:08.696826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a2e8d770-ea3a-46c4-9ad9-346f696a9ba6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:08.697419 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a2e8d770-ea3a-46c4-9ad9-346f696a9ba6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:09.069609 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4ec6ccc4-8a1b-4494-ba64-b11045db69c0 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:09.080615 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4ec6ccc4-8a1b-4494-ba64-b11045db69c0 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 200 len: 1364 microversion: 2.1 time: 0.630669 May 21 21:34:09.081531 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2546/5222] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:34:08 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 1364 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:34:09.086752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c3c8bea5-fcfb-4ba7-ac07-248f472b2239 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:09.087371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c3c8bea5-fcfb-4ba7-ac07-248f472b2239 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] [instance: 506776f0-470a-4a6b-ac34-3414463a8770] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:09.094884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3c8bea5-fcfb-4ba7-ac07-248f472b2239 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:09.095368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3c8bea5-fcfb-4ba7-ac07-248f472b2239 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:09.096450 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3c8bea5-fcfb-4ba7-ac07-248f472b2239 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:09.096896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3c8bea5-fcfb-4ba7-ac07-248f472b2239 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:09.115345 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-c3c8bea5-fcfb-4ba7-ac07-248f472b2239 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] HTTP exception thrown: Instance 506776f0-470a-4a6b-ac34-3414463a8770 could not be found. May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c3c8bea5-fcfb-4ba7-ac07-248f472b2239 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Request method failure captured: May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 HTTP/1.1 May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVnYy3SaySatFVqWuD4QLMX78tOZu2Sq081sncP5_CZnvryZkShUPSqptMQixW9D6QLw2UuDdxyQwaeJ6lrj30y7u6OXCJpzi5UJG9aI3fEqHW0Sq9F2EcE_2fCjYowdWcuux0Sp0LhoueDGd91ZOn29SJFvBmrTIiAhoJB3iHzY0IU May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 2e6d59483dc54fe4a558186055068419 May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2e6d59483dc54fe4a558186055068419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2e6d59483dc54fe4a558186055068419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2e6d59483dc54fe4a558186055068419", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2e6d59483dc54fe4a558186055068419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 2e6d59483dc54fe4a558186055068419 May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1981617934 May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerRescueNegativeTestJSON-1981617934-project May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 9a0ccfb5c9a04ec0831a0bfe987bb659 May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1981617934-project May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 506776f0-470a-4a6b-ac34-3414463a8770 could not be found. May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '506776f0-470a-4a6b-ac34-3414463a8770'} May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 506776f0-470a-4a6b-ac34-3414463a8770 could not be found. May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 506776f0-470a-4a6b-ac34-3414463a8770 could not be found. May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:34:09.117553 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:34:09.122045 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:34:09.122045 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:34:09.122045 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:34:09.122045 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:34:09.122045 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:34:09.122045 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:34:09.122045 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 506776f0-470a-4a6b-ac34-3414463a8770 could not be found. May 21 21:34:09.122045 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:34:09.122045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c3c8bea5-fcfb-4ba7-ac07-248f472b2239 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] Returning 404 to user: Instance 506776f0-470a-4a6b-ac34-3414463a8770 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:34:09.122045 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c3c8bea5-fcfb-4ba7-ac07-248f472b2239 tempest-ServerRescueNegativeTestJSON-1981617934 tempest-ServerRescueNegativeTestJSON-1981617934-project] 10.222.0.49 "GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770" status: 404 len: 111 microversion: 2.1 time: 0.036404 May 21 21:34:09.122045 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2547/5223] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:34:09 2022] GET /compute/v2.1/servers/506776f0-470a-4a6b-ac34-3414463a8770 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:34:09.197952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a2e8d770-ea3a-46c4-9ad9-346f696a9ba6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:09.211892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a2e8d770-ea3a-46c4-9ad9-346f696a9ba6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:09.213773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a2e8d770-ea3a-46c4-9ad9-346f696a9ba6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:09.218829 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a2e8d770-ea3a-46c4-9ad9-346f696a9ba6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1808 microversion: 2.20 time: 0.545897 May 21 21:34:09.230172 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2677/5224] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:08 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1808 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:09.306043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2c7fe51c-c91b-4f13-9336-930d21ff87d0 tempest-QuotasTestJSON-647728965 tempest-QuotasTestJSON-647728965-project] Calling method '.version_select at 0x7fc81ad100d0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:09.384890 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2c7fe51c-c91b-4f13-9336-930d21ff87d0 tempest-QuotasTestJSON-647728965 tempest-QuotasTestJSON-647728965-project] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/5f6b02b6e0034b56891a19d2a6b12212/defaults" status: 200 len: 371 microversion: 2.1 time: 0.246299 May 21 21:34:09.391144 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2548/5225] 10.222.0.49 () {58 vars in 1268 bytes} [Sat May 21 21:34:09 2022] GET /compute/v2.1/os-quota-sets/5f6b02b6e0034b56891a19d2a6b12212/defaults => generated 371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:34:09.398927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bee42888-9e94-4f13-9aae-4c8d1fc168dd tempest-QuotasTestJSON-647728965 tempest-QuotasTestJSON-647728965-project] Calling method '.version_select at 0x7fc82d087820>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:09.499352 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bee42888-9e94-4f13-9aae-4c8d1fc168dd tempest-QuotasTestJSON-647728965 tempest-QuotasTestJSON-647728965-project] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/5f6b02b6e0034b56891a19d2a6b12212" status: 200 len: 371 microversion: 2.1 time: 0.106392 May 21 21:34:09.500238 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2678/5226] 10.222.0.49 () {58 vars in 1241 bytes} [Sat May 21 21:34:09 2022] GET /compute/v2.1/os-quota-sets/5f6b02b6e0034b56891a19d2a6b12212 => generated 371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:34:09.517651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-22d1dad0-3a1a-4e8d-ae54-bba2e4d48d2a tempest-QuotasTestJSON-647728965 tempest-QuotasTestJSON-647728965-project] Calling method '.version_select at 0x7fc81ba79700>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:09.601048 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-22d1dad0-3a1a-4e8d-ae54-bba2e4d48d2a tempest-QuotasTestJSON-647728965 tempest-QuotasTestJSON-647728965-project] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/5f6b02b6e0034b56891a19d2a6b12212/defaults" status: 200 len: 371 microversion: 2.1 time: 0.089152 May 21 21:34:09.611546 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2549/5227] 10.222.0.49 () {58 vars in 1268 bytes} [Sat May 21 21:34:09 2022] GET /compute/v2.1/os-quota-sets/5f6b02b6e0034b56891a19d2a6b12212/defaults => generated 371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:34:09.617465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0dcb69bd-7d50-4c88-b32e-ffafce9ebae9 tempest-QuotasTestJSON-647728965 tempest-QuotasTestJSON-647728965-project] Calling method '.version_select at 0x7fc81b4e8430>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:09.749927 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0dcb69bd-7d50-4c88-b32e-ffafce9ebae9 tempest-QuotasTestJSON-647728965 tempest-QuotasTestJSON-647728965-project] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/5f6b02b6e0034b56891a19d2a6b12212" status: 200 len: 371 microversion: 2.1 time: 0.129261 May 21 21:34:09.749927 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2679/5228] 10.222.0.49 () {58 vars in 1241 bytes} [Sat May 21 21:34:09 2022] GET /compute/v2.1/os-quota-sets/5f6b02b6e0034b56891a19d2a6b12212 => generated 371 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:34:09.762715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-639ea721-5829-4980-815c-263f194adc83 tempest-QuotasTestJSON-647728965 tempest-QuotasTestJSON-647728965-project] Calling method '.version_select at 0x7fc81ad10ee0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:09.893314 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-639ea721-5829-4980-815c-263f194adc83 tempest-QuotasTestJSON-647728965 tempest-QuotasTestJSON-647728965-project] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/5f6b02b6e0034b56891a19d2a6b12212?user_id=96deb9e9a956411a96ecb00354beb98c" status: 200 len: 371 microversion: 2.1 time: 0.138328 May 21 21:34:09.894729 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2550/5229] 10.222.0.49 () {58 vars in 1322 bytes} [Sat May 21 21:34:09 2022] GET /compute/v2.1/os-quota-sets/5f6b02b6e0034b56891a19d2a6b12212?user_id=96deb9e9a956411a96ecb00354beb98c => generated 371 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:34:10.097325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4a038129-b5fb-46a5-ba4a-52e334f7c2c5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:10.099099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4a038129-b5fb-46a5-ba4a-52e334f7c2c5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:10.110909 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a038129-b5fb-46a5-ba4a-52e334f7c2c5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:10.111842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a038129-b5fb-46a5-ba4a-52e334f7c2c5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:10.113132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a038129-b5fb-46a5-ba4a-52e334f7c2c5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:10.114462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a038129-b5fb-46a5-ba4a-52e334f7c2c5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:10.238598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8d9fe52e-134e-4644-826d-ce5d4c677d80 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:10.239433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8d9fe52e-134e-4644-826d-ce5d4c677d80 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:10.246898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d9fe52e-134e-4644-826d-ce5d4c677d80 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:10.247431 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d9fe52e-134e-4644-826d-ce5d4c677d80 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:10.248240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d9fe52e-134e-4644-826d-ce5d4c677d80 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:10.248993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d9fe52e-134e-4644-826d-ce5d4c677d80 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:10.553523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4a038129-b5fb-46a5-ba4a-52e334f7c2c5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:10.567524 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4a038129-b5fb-46a5-ba4a-52e334f7c2c5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 200 len: 1364 microversion: 2.1 time: 0.473439 May 21 21:34:10.570443 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2680/5230] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:34:10 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 1364 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:34:10.893417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8d9fe52e-134e-4644-826d-ce5d4c677d80 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:10.915913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8d9fe52e-134e-4644-826d-ce5d4c677d80 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:10.917957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8d9fe52e-134e-4644-826d-ce5d4c677d80 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:10.921792 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8d9fe52e-134e-4644-826d-ce5d4c677d80 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1808 microversion: 2.20 time: 0.687708 May 21 21:34:10.935076 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2551/5231] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:10 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1808 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:34:11.585750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c4251ada-5684-4af2-b7ef-67846cdf6440 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:11.587080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c4251ada-5684-4af2-b7ef-67846cdf6440 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:11.611118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4251ada-5684-4af2-b7ef-67846cdf6440 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:11.611669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4251ada-5684-4af2-b7ef-67846cdf6440 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:11.612862 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4251ada-5684-4af2-b7ef-67846cdf6440 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:11.613887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4251ada-5684-4af2-b7ef-67846cdf6440 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:11.943717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8ce4ae3c-2608-4780-96ea-ec163ed077e5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:11.946003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8ce4ae3c-2608-4780-96ea-ec163ed077e5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:11.958602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8ce4ae3c-2608-4780-96ea-ec163ed077e5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:11.962264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8ce4ae3c-2608-4780-96ea-ec163ed077e5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:11.965077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8ce4ae3c-2608-4780-96ea-ec163ed077e5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:11.965744 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8ce4ae3c-2608-4780-96ea-ec163ed077e5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:12.058339 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c4251ada-5684-4af2-b7ef-67846cdf6440 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:12.071137 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c4251ada-5684-4af2-b7ef-67846cdf6440 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 200 len: 1550 microversion: 2.1 time: 0.490302 May 21 21:34:12.071741 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2681/5232] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:34:11 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 1550 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:34:12.099428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-009bc93a-48b9-40e2-be72-bbaf60772cea tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:12.100192 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-009bc93a-48b9-40e2-be72-bbaf60772cea tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:12.117014 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-009bc93a-48b9-40e2-be72-bbaf60772cea tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:12.117639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-009bc93a-48b9-40e2-be72-bbaf60772cea tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:12.118464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-009bc93a-48b9-40e2-be72-bbaf60772cea tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:12.121351 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-009bc93a-48b9-40e2-be72-bbaf60772cea tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:12.424644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8ce4ae3c-2608-4780-96ea-ec163ed077e5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:12.439799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8ce4ae3c-2608-4780-96ea-ec163ed077e5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:12.444816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8ce4ae3c-2608-4780-96ea-ec163ed077e5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:12.445210 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8ce4ae3c-2608-4780-96ea-ec163ed077e5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1808 microversion: 2.20 time: 0.506868 May 21 21:34:12.446291 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2552/5233] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:11 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1808 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:12.479195 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-009bc93a-48b9-40e2-be72-bbaf60772cea tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.389170 May 21 21:34:12.479806 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2682/5234] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 21:34:12 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-interface => generated 285 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:34:12.775866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-099d94dc-0152-4759-88c8-d20fa73b546d req-5b1b7af8-5c1b-47eb-b947-9c0b3299d71a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc27a082-c144-436f-bd21-e8126e00db6c", "name": "network-vif-plugged", "status": "completed", "tag": "b4925385-7716-4fd9-99c7-de6cabe49d7f"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:34:12.818780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-099d94dc-0152-4759-88c8-d20fa73b546d req-5b1b7af8-5c1b-47eb-b947-9c0b3299d71a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:12.821788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-099d94dc-0152-4759-88c8-d20fa73b546d req-5b1b7af8-5c1b-47eb-b947-9c0b3299d71a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:12.868115 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-099d94dc-0152-4759-88c8-d20fa73b546d req-5b1b7af8-5c1b-47eb-b947-9c0b3299d71a service nova] Creating event network-vif-plugged:b4925385-7716-4fd9-99c7-de6cabe49d7f for instance cc27a082-c144-436f-bd21-e8126e00db6c on nch2-master-1 May 21 21:34:12.885542 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-099d94dc-0152-4759-88c8-d20fa73b546d req-5b1b7af8-5c1b-47eb-b947-9c0b3299d71a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113477 May 21 21:34:12.889811 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2553/5235] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:34:13.466506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c86a3ca6-aa2f-468b-88fb-af27d6bc290a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:13.467127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c86a3ca6-aa2f-468b-88fb-af27d6bc290a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:13.474865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c86a3ca6-aa2f-468b-88fb-af27d6bc290a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:13.475325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c86a3ca6-aa2f-468b-88fb-af27d6bc290a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:13.476128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c86a3ca6-aa2f-468b-88fb-af27d6bc290a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:13.482856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c86a3ca6-aa2f-468b-88fb-af27d6bc290a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:14.184607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c86a3ca6-aa2f-468b-88fb-af27d6bc290a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:14.201106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c86a3ca6-aa2f-468b-88fb-af27d6bc290a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:14.205649 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c86a3ca6-aa2f-468b-88fb-af27d6bc290a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:14.212119 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c86a3ca6-aa2f-468b-88fb-af27d6bc290a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1808 microversion: 2.20 time: 0.745552 May 21 21:34:14.212119 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2683/5236] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:13 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1808 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:15.202017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-08a57f30-6b58-4e1a-b12b-86752573d693 req-c760d45d-8325-4a88-a910-92636d8c14e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fdb37d6-723b-4053-81cd-697a6aa334a2", "tag": "f564fcbe-89e0-4d41-98a7-8cf562ada89c"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:34:15.224887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-08a57f30-6b58-4e1a-b12b-86752573d693 req-c760d45d-8325-4a88-a910-92636d8c14e9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:15.225874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-08a57f30-6b58-4e1a-b12b-86752573d693 req-c760d45d-8325-4a88-a910-92636d8c14e9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:15.229058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8bc2d4d0-62b8-4ce0-8ac0-cf42244dd395 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:15.230657 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8bc2d4d0-62b8-4ce0-8ac0-cf42244dd395 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:15.249544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8bc2d4d0-62b8-4ce0-8ac0-cf42244dd395 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:15.250701 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-08a57f30-6b58-4e1a-b12b-86752573d693 req-c760d45d-8325-4a88-a910-92636d8c14e9 service nova] Creating event network-changed:f564fcbe-89e0-4d41-98a7-8cf562ada89c for instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 on nch2-master-1 May 21 21:34:15.251100 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8bc2d4d0-62b8-4ce0-8ac0-cf42244dd395 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:15.252597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8bc2d4d0-62b8-4ce0-8ac0-cf42244dd395 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:15.253837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8bc2d4d0-62b8-4ce0-8ac0-cf42244dd395 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:15.282242 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-08a57f30-6b58-4e1a-b12b-86752573d693 req-c760d45d-8325-4a88-a910-92636d8c14e9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085537 May 21 21:34:15.286690 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2554/5237] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:34:15.541487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8bc2d4d0-62b8-4ce0-8ac0-cf42244dd395 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:15.553347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8bc2d4d0-62b8-4ce0-8ac0-cf42244dd395 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:15.555987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8bc2d4d0-62b8-4ce0-8ac0-cf42244dd395 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:15.557598 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8bc2d4d0-62b8-4ce0-8ac0-cf42244dd395 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1808 microversion: 2.20 time: 0.333867 May 21 21:34:15.558660 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2684/5238] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:15 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1808 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:34:16.585713 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cd5257ae-777a-4853-bcae-d9f6651c1346 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:16.586493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cd5257ae-777a-4853-bcae-d9f6651c1346 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:16.604154 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd5257ae-777a-4853-bcae-d9f6651c1346 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:16.604645 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd5257ae-777a-4853-bcae-d9f6651c1346 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:16.609954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd5257ae-777a-4853-bcae-d9f6651c1346 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:16.610502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd5257ae-777a-4853-bcae-d9f6651c1346 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:17.373810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cd5257ae-777a-4853-bcae-d9f6651c1346 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:17.387067 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cd5257ae-777a-4853-bcae-d9f6651c1346 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:17.387911 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cd5257ae-777a-4853-bcae-d9f6651c1346 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:17.389437 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cd5257ae-777a-4853-bcae-d9f6651c1346 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1808 microversion: 2.20 time: 0.809851 May 21 21:34:17.390222 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2555/5239] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:16 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1808 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:18.407997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cf297998-4320-4c7a-b209-e0c32dd2a17d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:18.408643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cf297998-4320-4c7a-b209-e0c32dd2a17d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:18.415662 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cf297998-4320-4c7a-b209-e0c32dd2a17d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:18.416120 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cf297998-4320-4c7a-b209-e0c32dd2a17d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:18.416940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cf297998-4320-4c7a-b209-e0c32dd2a17d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:18.417387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cf297998-4320-4c7a-b209-e0c32dd2a17d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:18.618757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cf297998-4320-4c7a-b209-e0c32dd2a17d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:18.632494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cf297998-4320-4c7a-b209-e0c32dd2a17d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:18.634012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cf297998-4320-4c7a-b209-e0c32dd2a17d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:18.635452 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cf297998-4320-4c7a-b209-e0c32dd2a17d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1795 microversion: 2.20 time: 0.231502 May 21 21:34:18.636019 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2685/5240] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:18 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1795 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:21.501273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:34:21.966512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-401cf200-6683-4fd0-a114-84a4b7734374 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1175281028", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": "none"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:34:21.994133 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:34:22.069978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-401cf200-6683-4fd0-a114-84a4b7734374 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:34:22.070559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-401cf200-6683-4fd0-a114-84a4b7734374 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:34:22.071132 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-401cf200-6683-4fd0-a114-84a4b7734374 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:34:22.071557 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-401cf200-6683-4fd0-a114-84a4b7734374 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:34:22.075126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-401cf200-6683-4fd0-a114-84a4b7734374 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:34:22.094892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-401cf200-6683-4fd0-a114-84a4b7734374 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:22.095382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-401cf200-6683-4fd0-a114-84a4b7734374 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:22.096386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-401cf200-6683-4fd0-a114-84a4b7734374 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:22.096759 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-401cf200-6683-4fd0-a114-84a4b7734374 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:22.124093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-401cf200-6683-4fd0-a114-84a4b7734374 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Getting quotas for project 70fa0b97b1b14e058012af12fa705b29. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:34:22.135042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-401cf200-6683-4fd0-a114-84a4b7734374 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Getting quotas for user 83eabb990d2b4a1cb3eefb962271d36c and project 70fa0b97b1b14e058012af12fa705b29. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:34:22.155740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-401cf200-6683-4fd0-a114-84a4b7734374 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:34:22.158107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-401cf200-6683-4fd0-a114-84a4b7734374 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 6a1bbc2d-c96b-44ed-9baf-b24b38d3b599] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:34:22.287688 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-401cf200-6683-4fd0-a114-84a4b7734374 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.791916 May 21 21:34:22.288488 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2556/5241] 10.222.0.49 () {62 vars in 1187 bytes} [Sat May 21 21:34:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 21 21:34:22.298687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a8bb9e5a-5695-4929-82c0-8b9e23f8a3aa tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:22.299875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a8bb9e5a-5695-4929-82c0-8b9e23f8a3aa tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 6a1bbc2d-c96b-44ed-9baf-b24b38d3b599] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:22.311462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:34:22.445756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a8bb9e5a-5695-4929-82c0-8b9e23f8a3aa tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:22.455752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a8bb9e5a-5695-4929-82c0-8b9e23f8a3aa tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:22.458315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a8bb9e5a-5695-4929-82c0-8b9e23f8a3aa tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:22.459671 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a8bb9e5a-5695-4929-82c0-8b9e23f8a3aa tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/6a1bbc2d-c96b-44ed-9baf-b24b38d3b599" status: 200 len: 1278 microversion: 2.47 time: 0.165088 May 21 21:34:22.477077 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2686/5242] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:22 2022] GET /compute/v2.1/servers/6a1bbc2d-c96b-44ed-9baf-b24b38d3b599 => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:22.674664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-87c5d87c-989f-492e-82c0-f3e2a3b6598b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-520511075", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": "none"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:34:22.749782 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-87c5d87c-989f-492e-82c0-f3e2a3b6598b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:34:22.750222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-87c5d87c-989f-492e-82c0-f3e2a3b6598b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:34:22.750708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-87c5d87c-989f-492e-82c0-f3e2a3b6598b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:34:22.751132 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-87c5d87c-989f-492e-82c0-f3e2a3b6598b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:34:22.751559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-87c5d87c-989f-492e-82c0-f3e2a3b6598b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:34:22.761441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87c5d87c-989f-492e-82c0-f3e2a3b6598b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:22.762222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87c5d87c-989f-492e-82c0-f3e2a3b6598b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:22.762856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87c5d87c-989f-492e-82c0-f3e2a3b6598b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:22.763460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87c5d87c-989f-492e-82c0-f3e2a3b6598b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:22.792980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-87c5d87c-989f-492e-82c0-f3e2a3b6598b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Getting quotas for project 70fa0b97b1b14e058012af12fa705b29. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:34:22.799126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-87c5d87c-989f-492e-82c0-f3e2a3b6598b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Getting quotas for user 83eabb990d2b4a1cb3eefb962271d36c and project 70fa0b97b1b14e058012af12fa705b29. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:34:22.816940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-87c5d87c-989f-492e-82c0-f3e2a3b6598b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:34:22.819735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-87c5d87c-989f-492e-82c0-f3e2a3b6598b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:34:23.022738 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-87c5d87c-989f-492e-82c0-f3e2a3b6598b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.355030 May 21 21:34:23.023615 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2557/5243] 10.222.0.49 () {62 vars in 1187 bytes} [Sat May 21 21:34:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 357 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 21 21:34:23.035155 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-96410c8f-4a0b-4019-b5de-81ef10606c6b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:34:23.036500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-96410c8f-4a0b-4019-b5de-81ef10606c6b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:23.083421 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-96410c8f-4a0b-4019-b5de-81ef10606c6b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "PUT /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 991 microversion: 2.47 time: 0.053121 May 21 21:34:23.084456 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2687/5244] 10.222.0.49 () {62 vars in 1296 bytes} [Sat May 21 21:34:23 2022] PUT /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:34:23.100190 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-95d52f0a-e118-494a-ad07-bc13d68fe566 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:23.107536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-95d52f0a-e118-494a-ad07-bc13d68fe566 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:23.186489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-95d52f0a-e118-494a-ad07-bc13d68fe566 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:23.198023 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-95d52f0a-e118-494a-ad07-bc13d68fe566 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:23.202289 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-95d52f0a-e118-494a-ad07-bc13d68fe566 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:23.203896 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-95d52f0a-e118-494a-ad07-bc13d68fe566 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1277 microversion: 2.47 time: 0.108857 May 21 21:34:23.204680 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2558/5245] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:23 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1277 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:24.228964 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-96b7ebaf-b1eb-4d96-b483-30aac026a34a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:24.230198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-96b7ebaf-b1eb-4d96-b483-30aac026a34a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:24.309534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-96b7ebaf-b1eb-4d96-b483-30aac026a34a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:24.322023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-96b7ebaf-b1eb-4d96-b483-30aac026a34a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:24.323567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-96b7ebaf-b1eb-4d96-b483-30aac026a34a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:24.324776 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-96b7ebaf-b1eb-4d96-b483-30aac026a34a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1277 microversion: 2.47 time: 0.104882 May 21 21:34:24.325620 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2688/5246] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:24 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1277 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:25.348149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7aec92af-8a2b-4385-9d92-cc2e1d54cd13 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:25.349381 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7aec92af-8a2b-4385-9d92-cc2e1d54cd13 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:25.367999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7aec92af-8a2b-4385-9d92-cc2e1d54cd13 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:25.368673 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7aec92af-8a2b-4385-9d92-cc2e1d54cd13 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:25.369803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7aec92af-8a2b-4385-9d92-cc2e1d54cd13 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:25.370902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7aec92af-8a2b-4385-9d92-cc2e1d54cd13 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:25.548311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7aec92af-8a2b-4385-9d92-cc2e1d54cd13 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:25.552665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:34:25.561203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7aec92af-8a2b-4385-9d92-cc2e1d54cd13 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:25.566893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7aec92af-8a2b-4385-9d92-cc2e1d54cd13 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:25.570215 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7aec92af-8a2b-4385-9d92-cc2e1d54cd13 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1329 microversion: 2.47 time: 0.226795 May 21 21:34:25.572354 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2559/5247] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:25 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1329 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:26.591633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c730f09e-38f6-4821-9fdb-6cae64a26d92 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:26.592944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c730f09e-38f6-4821-9fdb-6cae64a26d92 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:26.603016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c730f09e-38f6-4821-9fdb-6cae64a26d92 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:26.603833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c730f09e-38f6-4821-9fdb-6cae64a26d92 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:26.605036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c730f09e-38f6-4821-9fdb-6cae64a26d92 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:26.605740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c730f09e-38f6-4821-9fdb-6cae64a26d92 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:26.695505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c730f09e-38f6-4821-9fdb-6cae64a26d92 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:26.713788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c730f09e-38f6-4821-9fdb-6cae64a26d92 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:26.716017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c730f09e-38f6-4821-9fdb-6cae64a26d92 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:26.717866 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c730f09e-38f6-4821-9fdb-6cae64a26d92 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1337 microversion: 2.47 time: 0.132181 May 21 21:34:26.719271 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2689/5248] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:26 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1337 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:27.741469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-876baaf7-383f-4a66-8daa-c22ab7eb80ea tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:27.742691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-876baaf7-383f-4a66-8daa-c22ab7eb80ea tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:27.751625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-876baaf7-383f-4a66-8daa-c22ab7eb80ea tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:27.752302 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-876baaf7-383f-4a66-8daa-c22ab7eb80ea tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:27.753284 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-876baaf7-383f-4a66-8daa-c22ab7eb80ea tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:27.753910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-876baaf7-383f-4a66-8daa-c22ab7eb80ea tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:27.865954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-876baaf7-383f-4a66-8daa-c22ab7eb80ea tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:27.874858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-876baaf7-383f-4a66-8daa-c22ab7eb80ea tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:27.883060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-876baaf7-383f-4a66-8daa-c22ab7eb80ea tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:27.883060 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-876baaf7-383f-4a66-8daa-c22ab7eb80ea tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1335 microversion: 2.47 time: 0.140922 May 21 21:34:27.883060 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2560/5249] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:27 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1335 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:28.898448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-60d71faa-2a14-4da3-939b-89ddff7e8ded tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:28.899789 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-60d71faa-2a14-4da3-939b-89ddff7e8ded tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:28.907494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-60d71faa-2a14-4da3-939b-89ddff7e8ded tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:28.908257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-60d71faa-2a14-4da3-939b-89ddff7e8ded tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:28.911080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-60d71faa-2a14-4da3-939b-89ddff7e8ded tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:28.911080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-60d71faa-2a14-4da3-939b-89ddff7e8ded tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:29.012637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-60d71faa-2a14-4da3-939b-89ddff7e8ded tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:29.023373 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-60d71faa-2a14-4da3-939b-89ddff7e8ded tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:29.026016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-60d71faa-2a14-4da3-939b-89ddff7e8ded tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:29.027196 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-60d71faa-2a14-4da3-939b-89ddff7e8ded tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1335 microversion: 2.47 time: 0.133755 May 21 21:34:29.028145 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2690/5250] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:28 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1335 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:30.046392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9c661a59-5887-4813-a5bb-cc868a23d3c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:30.047070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9c661a59-5887-4813-a5bb-cc868a23d3c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:30.054985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c661a59-5887-4813-a5bb-cc868a23d3c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:30.055443 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c661a59-5887-4813-a5bb-cc868a23d3c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:30.056213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c661a59-5887-4813-a5bb-cc868a23d3c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:30.056682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c661a59-5887-4813-a5bb-cc868a23d3c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:30.133269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9c661a59-5887-4813-a5bb-cc868a23d3c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:30.143071 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9c661a59-5887-4813-a5bb-cc868a23d3c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:30.146110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9c661a59-5887-4813-a5bb-cc868a23d3c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:30.147959 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9c661a59-5887-4813-a5bb-cc868a23d3c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1356 microversion: 2.47 time: 0.105489 May 21 21:34:30.149613 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2561/5251] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:30 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:30.167886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b93abf55-cde2-4310-b579-d439bca2be68 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:34:30.170107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b93abf55-cde2-4310-b579-d439bca2be68 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:30.178109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b93abf55-cde2-4310-b579-d439bca2be68 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:30.178564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b93abf55-cde2-4310-b579-d439bca2be68 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:30.179627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b93abf55-cde2-4310-b579-d439bca2be68 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:30.180136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b93abf55-cde2-4310-b579-d439bca2be68 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:30.264756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-b93abf55-cde2-4310-b579-d439bca2be68 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:34:30.265188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-b93abf55-cde2-4310-b579-d439bca2be68 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:34:30.265667 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-b93abf55-cde2-4310-b579-d439bca2be68 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:34:30.266117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-b93abf55-cde2-4310-b579-d439bca2be68 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:34:30.266589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-b93abf55-cde2-4310-b579-d439bca2be68 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:34:30.524739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b93abf55-cde2-4310-b579-d439bca2be68 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:30.531821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b93abf55-cde2-4310-b579-d439bca2be68 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:30.532550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b93abf55-cde2-4310-b579-d439bca2be68 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:30.533703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b93abf55-cde2-4310-b579-d439bca2be68 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:30.534817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b93abf55-cde2-4310-b579-d439bca2be68 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:30.577541 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b93abf55-cde2-4310-b579-d439bca2be68 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "POST /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786/action" status: 202 len: 1078 microversion: 2.47 time: 0.413451 May 21 21:34:30.579280 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2691/5252] 10.222.0.49 () {62 vars in 1318 bytes} [Sat May 21 21:34:30 2022] POST /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786/action => generated 1078 bytes in 416 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 21 21:34:30.595629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-02be5483-0aa0-48f8-a740-bd0e9fc3aabc tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:30.596056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-02be5483-0aa0-48f8-a740-bd0e9fc3aabc tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:30.602579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02be5483-0aa0-48f8-a740-bd0e9fc3aabc tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:30.603875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02be5483-0aa0-48f8-a740-bd0e9fc3aabc tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:30.604715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02be5483-0aa0-48f8-a740-bd0e9fc3aabc tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:30.606407 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02be5483-0aa0-48f8-a740-bd0e9fc3aabc tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:30.698774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-02be5483-0aa0-48f8-a740-bd0e9fc3aabc tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:30.725405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-02be5483-0aa0-48f8-a740-bd0e9fc3aabc tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:30.727014 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-02be5483-0aa0-48f8-a740-bd0e9fc3aabc tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:30.728474 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-02be5483-0aa0-48f8-a740-bd0e9fc3aabc tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.136980 May 21 21:34:30.729529 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2562/5253] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:30 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:31.749098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-807132c8-ba2a-4002-8688-80db6a2141cb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:31.751444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-807132c8-ba2a-4002-8688-80db6a2141cb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:31.758539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-807132c8-ba2a-4002-8688-80db6a2141cb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:31.759235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-807132c8-ba2a-4002-8688-80db6a2141cb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:31.760323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-807132c8-ba2a-4002-8688-80db6a2141cb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:31.760783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-807132c8-ba2a-4002-8688-80db6a2141cb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:31.841772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-807132c8-ba2a-4002-8688-80db6a2141cb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:31.850777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-807132c8-ba2a-4002-8688-80db6a2141cb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:31.852267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-807132c8-ba2a-4002-8688-80db6a2141cb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:31.853476 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-807132c8-ba2a-4002-8688-80db6a2141cb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.108421 May 21 21:34:31.854037 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2692/5254] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:31 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:32.874774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5f41999b-feaf-466c-9d93-4f92e3f34890 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:32.876043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5f41999b-feaf-466c-9d93-4f92e3f34890 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:32.882960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:34:32.888516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5f41999b-feaf-466c-9d93-4f92e3f34890 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:32.889260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5f41999b-feaf-466c-9d93-4f92e3f34890 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:32.889760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5f41999b-feaf-466c-9d93-4f92e3f34890 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:32.890197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5f41999b-feaf-466c-9d93-4f92e3f34890 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:32.979525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5f41999b-feaf-466c-9d93-4f92e3f34890 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:32.989040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5f41999b-feaf-466c-9d93-4f92e3f34890 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:32.990609 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5f41999b-feaf-466c-9d93-4f92e3f34890 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:32.991803 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5f41999b-feaf-466c-9d93-4f92e3f34890 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.123750 May 21 21:34:32.992392 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2563/5255] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:32 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:34.010397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-88eaf4ef-2fb9-4c82-8a9b-2da2d8723995 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:34.011029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-88eaf4ef-2fb9-4c82-8a9b-2da2d8723995 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:34.018715 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88eaf4ef-2fb9-4c82-8a9b-2da2d8723995 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:34.018715 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88eaf4ef-2fb9-4c82-8a9b-2da2d8723995 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:34.019448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88eaf4ef-2fb9-4c82-8a9b-2da2d8723995 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:34.019899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88eaf4ef-2fb9-4c82-8a9b-2da2d8723995 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:34.113881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-88eaf4ef-2fb9-4c82-8a9b-2da2d8723995 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:34.122372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-88eaf4ef-2fb9-4c82-8a9b-2da2d8723995 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:34.123944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-88eaf4ef-2fb9-4c82-8a9b-2da2d8723995 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:34.125167 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-88eaf4ef-2fb9-4c82-8a9b-2da2d8723995 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.118807 May 21 21:34:34.139106 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2693/5256] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:34 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:35.158128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-22dfa001-353b-47b6-8415-49b2fc8cb932 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:35.158792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-22dfa001-353b-47b6-8415-49b2fc8cb932 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:35.161033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=14 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:34:35.166706 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22dfa001-353b-47b6-8415-49b2fc8cb932 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:35.167167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22dfa001-353b-47b6-8415-49b2fc8cb932 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:35.167945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22dfa001-353b-47b6-8415-49b2fc8cb932 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:35.168421 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22dfa001-353b-47b6-8415-49b2fc8cb932 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:35.241469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-22dfa001-353b-47b6-8415-49b2fc8cb932 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:35.252823 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-22dfa001-353b-47b6-8415-49b2fc8cb932 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:35.254588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-22dfa001-353b-47b6-8415-49b2fc8cb932 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:35.255968 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-22dfa001-353b-47b6-8415-49b2fc8cb932 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.103260 May 21 21:34:35.256570 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2564/5257] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:35 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:36.275291 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5501e083-86c7-4a4d-9c23-2cf22e7a3455 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:36.275984 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5501e083-86c7-4a4d-9c23-2cf22e7a3455 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:36.282808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:34:36.292775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5501e083-86c7-4a4d-9c23-2cf22e7a3455 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:36.293506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5501e083-86c7-4a4d-9c23-2cf22e7a3455 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:36.294346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5501e083-86c7-4a4d-9c23-2cf22e7a3455 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:36.294955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5501e083-86c7-4a4d-9c23-2cf22e7a3455 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:36.383100 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5501e083-86c7-4a4d-9c23-2cf22e7a3455 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:36.392379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5501e083-86c7-4a4d-9c23-2cf22e7a3455 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:36.394649 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5501e083-86c7-4a4d-9c23-2cf22e7a3455 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:36.398678 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5501e083-86c7-4a4d-9c23-2cf22e7a3455 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.125153 May 21 21:34:36.398678 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2694/5258] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:36 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:37.417226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-76820fe6-b3fb-43af-a5b7-349be71dce6b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:37.418548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-76820fe6-b3fb-43af-a5b7-349be71dce6b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:37.427130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-76820fe6-b3fb-43af-a5b7-349be71dce6b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:37.427544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-76820fe6-b3fb-43af-a5b7-349be71dce6b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:37.428374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-76820fe6-b3fb-43af-a5b7-349be71dce6b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:37.428827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-76820fe6-b3fb-43af-a5b7-349be71dce6b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:37.528894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-76820fe6-b3fb-43af-a5b7-349be71dce6b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:37.549931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-76820fe6-b3fb-43af-a5b7-349be71dce6b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:37.551691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-76820fe6-b3fb-43af-a5b7-349be71dce6b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:37.552935 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-76820fe6-b3fb-43af-a5b7-349be71dce6b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.140866 May 21 21:34:37.553867 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2565/5259] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:37 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:38.571782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0e234e29-c537-417f-a765-de73ec584dec tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:38.572603 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0e234e29-c537-417f-a765-de73ec584dec tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:38.575465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=70 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:34:38.581367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e234e29-c537-417f-a765-de73ec584dec tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:38.581885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e234e29-c537-417f-a765-de73ec584dec tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:38.582707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e234e29-c537-417f-a765-de73ec584dec tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:38.583146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e234e29-c537-417f-a765-de73ec584dec tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:38.686201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0e234e29-c537-417f-a765-de73ec584dec tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:38.696438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0e234e29-c537-417f-a765-de73ec584dec tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:38.698874 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0e234e29-c537-417f-a765-de73ec584dec tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:38.700317 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0e234e29-c537-417f-a765-de73ec584dec tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.132938 May 21 21:34:38.700874 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2695/5260] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:38 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:39.719674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7b885f61-5e54-48db-b580-f980653401c0 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:39.721059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7b885f61-5e54-48db-b580-f980653401c0 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:39.729090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7b885f61-5e54-48db-b580-f980653401c0 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:39.729784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7b885f61-5e54-48db-b580-f980653401c0 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:39.730574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7b885f61-5e54-48db-b580-f980653401c0 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:39.733800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7b885f61-5e54-48db-b580-f980653401c0 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:39.806420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7b885f61-5e54-48db-b580-f980653401c0 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:39.814616 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7b885f61-5e54-48db-b580-f980653401c0 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:39.816146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7b885f61-5e54-48db-b580-f980653401c0 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:39.817662 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7b885f61-5e54-48db-b580-f980653401c0 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.101928 May 21 21:34:39.818403 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2566/5261] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:39 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:34:40.835710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1d718d13-149a-4137-a17c-ef678e879595 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:40.840714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1d718d13-149a-4137-a17c-ef678e879595 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:40.845782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d718d13-149a-4137-a17c-ef678e879595 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:40.846303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d718d13-149a-4137-a17c-ef678e879595 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:40.847158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d718d13-149a-4137-a17c-ef678e879595 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:40.847660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d718d13-149a-4137-a17c-ef678e879595 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:40.858002 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:34:40.932948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1d718d13-149a-4137-a17c-ef678e879595 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:40.941929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1d718d13-149a-4137-a17c-ef678e879595 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:40.943573 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1d718d13-149a-4137-a17c-ef678e879595 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:40.944859 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1d718d13-149a-4137-a17c-ef678e879595 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.113308 May 21 21:34:40.945619 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2696/5262] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:40 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:41.964106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-deb0fcfe-30b7-47ab-b4a0-895bdbf997b4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:41.965314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-deb0fcfe-30b7-47ab-b4a0-895bdbf997b4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:41.973455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-deb0fcfe-30b7-47ab-b4a0-895bdbf997b4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:41.974120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-deb0fcfe-30b7-47ab-b4a0-895bdbf997b4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:41.975072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-deb0fcfe-30b7-47ab-b4a0-895bdbf997b4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:41.975828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-deb0fcfe-30b7-47ab-b4a0-895bdbf997b4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:42.054997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-deb0fcfe-30b7-47ab-b4a0-895bdbf997b4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:42.063246 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-deb0fcfe-30b7-47ab-b4a0-895bdbf997b4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:42.064830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-deb0fcfe-30b7-47ab-b4a0-895bdbf997b4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:42.066019 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-deb0fcfe-30b7-47ab-b4a0-895bdbf997b4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.106290 May 21 21:34:42.067140 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2567/5263] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:41 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:43.086489 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ded0be2d-304a-4906-82ce-baa54b5d3e51 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:43.087108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ded0be2d-304a-4906-82ce-baa54b5d3e51 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:43.094770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ded0be2d-304a-4906-82ce-baa54b5d3e51 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:43.095231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ded0be2d-304a-4906-82ce-baa54b5d3e51 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:43.096004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ded0be2d-304a-4906-82ce-baa54b5d3e51 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:43.096476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ded0be2d-304a-4906-82ce-baa54b5d3e51 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:43.178840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ded0be2d-304a-4906-82ce-baa54b5d3e51 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:43.197775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ded0be2d-304a-4906-82ce-baa54b5d3e51 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:43.199454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ded0be2d-304a-4906-82ce-baa54b5d3e51 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:43.200885 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ded0be2d-304a-4906-82ce-baa54b5d3e51 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.119555 May 21 21:34:43.201441 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2697/5264] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:43 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:44.222082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-00134e68-c6f8-4c04-9dc2-4478d562c640 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:44.223537 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-00134e68-c6f8-4c04-9dc2-4478d562c640 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:44.231159 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00134e68-c6f8-4c04-9dc2-4478d562c640 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:44.231626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00134e68-c6f8-4c04-9dc2-4478d562c640 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:44.232490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00134e68-c6f8-4c04-9dc2-4478d562c640 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:44.232949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00134e68-c6f8-4c04-9dc2-4478d562c640 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:44.309193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-00134e68-c6f8-4c04-9dc2-4478d562c640 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:44.318792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-00134e68-c6f8-4c04-9dc2-4478d562c640 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:44.320766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-00134e68-c6f8-4c04-9dc2-4478d562c640 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:44.322071 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-00134e68-c6f8-4c04-9dc2-4478d562c640 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.105076 May 21 21:34:44.322733 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2568/5265] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:44 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:45.342046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ff5470c9-5c5c-4dd0-8bac-ecf3c5cf3a2e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:45.342763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ff5470c9-5c5c-4dd0-8bac-ecf3c5cf3a2e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:45.350862 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff5470c9-5c5c-4dd0-8bac-ecf3c5cf3a2e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:45.351405 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff5470c9-5c5c-4dd0-8bac-ecf3c5cf3a2e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:45.356294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff5470c9-5c5c-4dd0-8bac-ecf3c5cf3a2e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:45.357081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff5470c9-5c5c-4dd0-8bac-ecf3c5cf3a2e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:45.468037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ff5470c9-5c5c-4dd0-8bac-ecf3c5cf3a2e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:45.477565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ff5470c9-5c5c-4dd0-8bac-ecf3c5cf3a2e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:45.479215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ff5470c9-5c5c-4dd0-8bac-ecf3c5cf3a2e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:45.480934 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ff5470c9-5c5c-4dd0-8bac-ecf3c5cf3a2e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.143185 May 21 21:34:45.481914 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2698/5266] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:45 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:46.499889 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-de613865-b87e-494b-87f3-cbce4aee8c4e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:46.500574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-de613865-b87e-494b-87f3-cbce4aee8c4e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:46.508112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de613865-b87e-494b-87f3-cbce4aee8c4e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:46.508736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de613865-b87e-494b-87f3-cbce4aee8c4e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:46.509364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de613865-b87e-494b-87f3-cbce4aee8c4e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:46.509805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de613865-b87e-494b-87f3-cbce4aee8c4e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:46.587680 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-de613865-b87e-494b-87f3-cbce4aee8c4e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:46.594460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-de613865-b87e-494b-87f3-cbce4aee8c4e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:46.594998 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-de613865-b87e-494b-87f3-cbce4aee8c4e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:46.596482 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-de613865-b87e-494b-87f3-cbce4aee8c4e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.100355 May 21 21:34:46.597275 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2569/5267] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:46 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:47.616535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5a6abf76-cbc4-4ba3-9f87-9aad4288451b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:47.617310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5a6abf76-cbc4-4ba3-9f87-9aad4288451b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:47.625881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5a6abf76-cbc4-4ba3-9f87-9aad4288451b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:47.626265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5a6abf76-cbc4-4ba3-9f87-9aad4288451b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:47.627243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5a6abf76-cbc4-4ba3-9f87-9aad4288451b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:47.627728 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5a6abf76-cbc4-4ba3-9f87-9aad4288451b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:47.790006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5a6abf76-cbc4-4ba3-9f87-9aad4288451b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:47.798966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5a6abf76-cbc4-4ba3-9f87-9aad4288451b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:47.802576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5a6abf76-cbc4-4ba3-9f87-9aad4288451b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:47.805242 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5a6abf76-cbc4-4ba3-9f87-9aad4288451b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.192507 May 21 21:34:47.805242 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2699/5268] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:47 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:48.798608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f608f4d9-141c-4af7-9097-17548a6d87f1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:48.799138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f608f4d9-141c-4af7-9097-17548a6d87f1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:48.807703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f608f4d9-141c-4af7-9097-17548a6d87f1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:48.808192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f608f4d9-141c-4af7-9097-17548a6d87f1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:48.809010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f608f4d9-141c-4af7-9097-17548a6d87f1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:48.809459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f608f4d9-141c-4af7-9097-17548a6d87f1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:48.822891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5ee63e86-6b17-4ad6-9d45-da24acc7ae6a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:48.823606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5ee63e86-6b17-4ad6-9d45-da24acc7ae6a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:48.830870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ee63e86-6b17-4ad6-9d45-da24acc7ae6a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:48.831403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ee63e86-6b17-4ad6-9d45-da24acc7ae6a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:48.832808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ee63e86-6b17-4ad6-9d45-da24acc7ae6a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:48.833398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ee63e86-6b17-4ad6-9d45-da24acc7ae6a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:48.844477 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f608f4d9-141c-4af7-9097-17548a6d87f1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c/os-volume_attachments/fc38d82a-c55c-417b-ad9e-028de27fde5a" status: 200 len: 194 microversion: 2.20 time: 0.056348 May 21 21:34:48.845102 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2570/5269] 10.222.0.49 () {60 vars in 1453 bytes} [Sat May 21 21:34:48 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c/os-volume_attachments/fc38d82a-c55c-417b-ad9e-028de27fde5a => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:34:48.919922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9dd288fb-49cd-4aab-8dbe-289027132fda tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:48.920543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9dd288fb-49cd-4aab-8dbe-289027132fda tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:48.929825 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5ee63e86-6b17-4ad6-9d45-da24acc7ae6a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:48.930513 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9dd288fb-49cd-4aab-8dbe-289027132fda tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:48.931303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9dd288fb-49cd-4aab-8dbe-289027132fda tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:48.937111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9dd288fb-49cd-4aab-8dbe-289027132fda tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:48.937111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9dd288fb-49cd-4aab-8dbe-289027132fda tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:48.943963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5ee63e86-6b17-4ad6-9d45-da24acc7ae6a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:48.946371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5ee63e86-6b17-4ad6-9d45-da24acc7ae6a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:48.947940 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5ee63e86-6b17-4ad6-9d45-da24acc7ae6a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.128811 May 21 21:34:48.949738 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2700/5270] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:48 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:34:48.965965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7f37711a-8046-483f-9197-6652b410b109 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:48.966732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7f37711a-8046-483f-9197-6652b410b109 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:48.975902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f37711a-8046-483f-9197-6652b410b109 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:48.976452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f37711a-8046-483f-9197-6652b410b109 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:48.977239 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f37711a-8046-483f-9197-6652b410b109 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:48.977736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f37711a-8046-483f-9197-6652b410b109 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:49.007028 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7f37711a-8046-483f-9197-6652b410b109 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/ips" status: 200 len: 145 microversion: 2.1 time: 0.055530 May 21 21:34:49.007633 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2701/5271] 10.222.0.49 () {58 vars in 1247 bytes} [Sat May 21 21:34:48 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/ips => generated 145 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:34:49.032706 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-9dd288fb-49cd-4aab-8dbe-289027132fda tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lazy-loading 'services' on Instance uuid cc27a082-c144-436f-bd21-e8126e00db6c {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:34:49.297042 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9dd288fb-49cd-4aab-8dbe-289027132fda tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c/os-volume_attachments/fc38d82a-c55c-417b-ad9e-028de27fde5a" status: 202 len: 0 microversion: 2.20 time: 0.381022 May 21 21:34:49.299760 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2571/5272] 10.222.0.49 () {60 vars in 1456 bytes} [Sat May 21 21:34:48 2022] DELETE /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c/os-volume_attachments/fc38d82a-c55c-417b-ad9e-028de27fde5a => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 21 21:34:49.307476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fc52af97-8dbb-4fee-b294-8c8c70712d37 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:49.308717 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fc52af97-8dbb-4fee-b294-8c8c70712d37 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:49.317478 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc52af97-8dbb-4fee-b294-8c8c70712d37 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:49.318137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc52af97-8dbb-4fee-b294-8c8c70712d37 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:49.319136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc52af97-8dbb-4fee-b294-8c8c70712d37 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:49.319689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc52af97-8dbb-4fee-b294-8c8c70712d37 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:49.354161 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fc52af97-8dbb-4fee-b294-8c8c70712d37 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051374 May 21 21:34:49.354737 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2702/5273] 10.222.0.49 () {60 vars in 1342 bytes} [Sat May 21 21:34:49 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:34:49.969156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4b6f8684-8c42-499d-ba78-770ee2af1496 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:49.969798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4b6f8684-8c42-499d-ba78-770ee2af1496 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:49.977080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b6f8684-8c42-499d-ba78-770ee2af1496 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:49.977594 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b6f8684-8c42-499d-ba78-770ee2af1496 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:49.978390 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b6f8684-8c42-499d-ba78-770ee2af1496 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:49.978833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b6f8684-8c42-499d-ba78-770ee2af1496 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:50.090376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4b6f8684-8c42-499d-ba78-770ee2af1496 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:50.103453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4b6f8684-8c42-499d-ba78-770ee2af1496 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:50.110062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4b6f8684-8c42-499d-ba78-770ee2af1496 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:50.110062 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4b6f8684-8c42-499d-ba78-770ee2af1496 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.143042 May 21 21:34:50.110062 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2572/5274] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:49 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:34:50.376198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4180b3d4-ac64-4bfe-8c69-8bdfdd66f100 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:50.377390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4180b3d4-ac64-4bfe-8c69-8bdfdd66f100 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:50.388253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4180b3d4-ac64-4bfe-8c69-8bdfdd66f100 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:50.388917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4180b3d4-ac64-4bfe-8c69-8bdfdd66f100 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:50.392309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4180b3d4-ac64-4bfe-8c69-8bdfdd66f100 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:50.392309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4180b3d4-ac64-4bfe-8c69-8bdfdd66f100 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:50.429904 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4180b3d4-ac64-4bfe-8c69-8bdfdd66f100 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058533 May 21 21:34:50.430849 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2703/5275] 10.222.0.49 () {60 vars in 1342 bytes} [Sat May 21 21:34:50 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:34:51.127501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4f2b303e-6d52-4aab-86ed-f12f61ed343f tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:51.128518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4f2b303e-6d52-4aab-86ed-f12f61ed343f tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:51.136990 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f2b303e-6d52-4aab-86ed-f12f61ed343f tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:51.139568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f2b303e-6d52-4aab-86ed-f12f61ed343f tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:51.139568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f2b303e-6d52-4aab-86ed-f12f61ed343f tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:51.139568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f2b303e-6d52-4aab-86ed-f12f61ed343f tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:51.216265 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4f2b303e-6d52-4aab-86ed-f12f61ed343f tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:51.224628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4f2b303e-6d52-4aab-86ed-f12f61ed343f tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:51.226144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4f2b303e-6d52-4aab-86ed-f12f61ed343f tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:51.227740 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4f2b303e-6d52-4aab-86ed-f12f61ed343f tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.103945 May 21 21:34:51.228330 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2573/5276] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:51 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:51.442259 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7cd1f9e0-71dd-4d53-8312-11acce968e04 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:51.443189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7cd1f9e0-71dd-4d53-8312-11acce968e04 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:51.450439 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7cd1f9e0-71dd-4d53-8312-11acce968e04 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:51.450886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7cd1f9e0-71dd-4d53-8312-11acce968e04 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:51.451663 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7cd1f9e0-71dd-4d53-8312-11acce968e04 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:51.452227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7cd1f9e0-71dd-4d53-8312-11acce968e04 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:51.482289 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7cd1f9e0-71dd-4d53-8312-11acce968e04 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044704 May 21 21:34:51.482853 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2704/5277] 10.222.0.49 () {60 vars in 1342 bytes} [Sat May 21 21:34:51 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:34:51.548238 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9b94f025-4cef-4682-bbd0-54c6229e1395 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:51.548767 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9b94f025-4cef-4682-bbd0-54c6229e1395 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:51.557467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9b94f025-4cef-4682-bbd0-54c6229e1395 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:51.557667 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9b94f025-4cef-4682-bbd0-54c6229e1395 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:51.558499 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9b94f025-4cef-4682-bbd0-54c6229e1395 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:51.558990 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9b94f025-4cef-4682-bbd0-54c6229e1395 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:51.586225 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9b94f025-4cef-4682-bbd0-54c6229e1395 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:34:51.623979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:34:51.843000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bbe21f9d-ed13-4188-b700-b2cba43ac50a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7fe4a25-3d2f-4cc7-92c7-c4adcc753524"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:34:51.844142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bbe21f9d-ed13-4188-b700-b2cba43ac50a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:51.861292 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bbe21f9d-ed13-4188-b700-b2cba43ac50a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:51.862330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bbe21f9d-ed13-4188-b700-b2cba43ac50a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:51.864665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bbe21f9d-ed13-4188-b700-b2cba43ac50a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:51.865319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bbe21f9d-ed13-4188-b700-b2cba43ac50a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:51.929386 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9b94f025-4cef-4682-bbd0-54c6229e1395 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 204 len: 0 microversion: 2.20 time: 0.384459 May 21 21:34:51.930954 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2574/5278] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:34:51 2022] DELETE /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:34:51.944137 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b363c359-5a4e-4288-a4c9-b13cd6b2396f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:51.945308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b363c359-5a4e-4288-a4c9-b13cd6b2396f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:51.959689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b363c359-5a4e-4288-a4c9-b13cd6b2396f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:51.960632 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b363c359-5a4e-4288-a4c9-b13cd6b2396f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:51.961803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b363c359-5a4e-4288-a4c9-b13cd6b2396f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:51.962493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b363c359-5a4e-4288-a4c9-b13cd6b2396f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:52.157941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b363c359-5a4e-4288-a4c9-b13cd6b2396f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:52.166327 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b363c359-5a4e-4288-a4c9-b13cd6b2396f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:52.167952 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b363c359-5a4e-4288-a4c9-b13cd6b2396f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:52.169213 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b363c359-5a4e-4288-a4c9-b13cd6b2396f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1723 microversion: 2.20 time: 0.232372 May 21 21:34:52.170706 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2575/5279] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:51 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:34:52.246152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9a79b5a6-0f1f-4025-8509-b353168caff4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:52.247184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9a79b5a6-0f1f-4025-8509-b353168caff4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:52.255782 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a79b5a6-0f1f-4025-8509-b353168caff4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:52.256246 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a79b5a6-0f1f-4025-8509-b353168caff4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:52.257093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a79b5a6-0f1f-4025-8509-b353168caff4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:52.257913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a79b5a6-0f1f-4025-8509-b353168caff4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:52.336084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9a79b5a6-0f1f-4025-8509-b353168caff4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:52.344112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9a79b5a6-0f1f-4025-8509-b353168caff4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:52.345666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9a79b5a6-0f1f-4025-8509-b353168caff4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:52.346891 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9a79b5a6-0f1f-4025-8509-b353168caff4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.104654 May 21 21:34:52.347891 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2576/5280] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:52 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:53.190796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5938d837-3606-4541-b4a5-c7246c754ccd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:53.190796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5938d837-3606-4541-b4a5-c7246c754ccd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:53.196997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5938d837-3606-4541-b4a5-c7246c754ccd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:53.197698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5938d837-3606-4541-b4a5-c7246c754ccd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:53.198580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5938d837-3606-4541-b4a5-c7246c754ccd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:53.199130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5938d837-3606-4541-b4a5-c7246c754ccd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:53.412129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5938d837-3606-4541-b4a5-c7246c754ccd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:53.422290 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5938d837-3606-4541-b4a5-c7246c754ccd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:53.424100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5938d837-3606-4541-b4a5-c7246c754ccd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:53.425502 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5938d837-3606-4541-b4a5-c7246c754ccd tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1723 microversion: 2.20 time: 0.241842 May 21 21:34:53.426289 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2577/5281] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:53 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:34:53.430993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-14c67134-8ab8-4be3-91bb-261d02ed65e4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:53.431613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-14c67134-8ab8-4be3-91bb-261d02ed65e4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:53.438538 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14c67134-8ab8-4be3-91bb-261d02ed65e4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:53.439145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14c67134-8ab8-4be3-91bb-261d02ed65e4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:53.440064 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14c67134-8ab8-4be3-91bb-261d02ed65e4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:53.440541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14c67134-8ab8-4be3-91bb-261d02ed65e4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:53.553869 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-14c67134-8ab8-4be3-91bb-261d02ed65e4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:53.570701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-14c67134-8ab8-4be3-91bb-261d02ed65e4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:53.573777 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-14c67134-8ab8-4be3-91bb-261d02ed65e4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:53.576107 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-14c67134-8ab8-4be3-91bb-261d02ed65e4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.148309 May 21 21:34:53.601476 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2578/5282] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:53 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:53.942945 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bbe21f9d-ed13-4188-b700-b2cba43ac50a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "POST /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.109397 May 21 21:34:53.945960 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2705/5283] 10.222.0.49 () {60 vars in 1322 bytes} [Sat May 21 21:34:51 2022] POST /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments => generated 194 bytes in 2112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:34:54.446070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-598983b5-c0b1-42c9-ab22-38bb60208861 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:54.446770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-598983b5-c0b1-42c9-ab22-38bb60208861 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:54.456762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-598983b5-c0b1-42c9-ab22-38bb60208861 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:54.457950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-598983b5-c0b1-42c9-ab22-38bb60208861 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:54.463471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-598983b5-c0b1-42c9-ab22-38bb60208861 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:54.464212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-598983b5-c0b1-42c9-ab22-38bb60208861 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:54.595066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-598983b5-c0b1-42c9-ab22-38bb60208861 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:54.606729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-598983b5-c0b1-42c9-ab22-38bb60208861 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:54.608321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-598983b5-c0b1-42c9-ab22-38bb60208861 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:54.609692 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-598983b5-c0b1-42c9-ab22-38bb60208861 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 200 len: 1655 microversion: 2.20 time: 0.169241 May 21 21:34:54.611667 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d19081b5-81be-40c0-97b9-b57e2c9dd171 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:54.612867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d19081b5-81be-40c0-97b9-b57e2c9dd171 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:54.621644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d19081b5-81be-40c0-97b9-b57e2c9dd171 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:54.622210 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2579/5284] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:54 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 1655 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:54.622692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d19081b5-81be-40c0-97b9-b57e2c9dd171 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:54.623611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d19081b5-81be-40c0-97b9-b57e2c9dd171 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:54.624127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d19081b5-81be-40c0-97b9-b57e2c9dd171 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:54.788449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-feec7907-9860-4d04-b7d9-a345e0a5c962 req-4bebce87-4069-4f04-b8ed-8aa198fee254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc27a082-c144-436f-bd21-e8126e00db6c", "name": "network-vif-deleted", "tag": "b4925385-7716-4fd9-99c7-de6cabe49d7f"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:34:54.803112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-feec7907-9860-4d04-b7d9-a345e0a5c962 req-4bebce87-4069-4f04-b8ed-8aa198fee254 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:54.804533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-feec7907-9860-4d04-b7d9-a345e0a5c962 req-4bebce87-4069-4f04-b8ed-8aa198fee254 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:54.808683 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d19081b5-81be-40c0-97b9-b57e2c9dd171 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:54.822039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d19081b5-81be-40c0-97b9-b57e2c9dd171 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:54.823831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d19081b5-81be-40c0-97b9-b57e2c9dd171 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:54.825506 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d19081b5-81be-40c0-97b9-b57e2c9dd171 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.220310 May 21 21:34:54.826976 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2706/5285] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:54 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:54.829660 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-feec7907-9860-4d04-b7d9-a345e0a5c962 req-4bebce87-4069-4f04-b8ed-8aa198fee254 service nova] Creating event network-vif-deleted:b4925385-7716-4fd9-99c7-de6cabe49d7f for instance cc27a082-c144-436f-bd21-e8126e00db6c on nch2-master-1 May 21 21:34:54.836939 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-feec7907-9860-4d04-b7d9-a345e0a5c962 req-4bebce87-4069-4f04-b8ed-8aa198fee254 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052986 May 21 21:34:54.837572 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2580/5286] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:34:55.629925 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0682741e-db24-444b-8077-d3d25c8b2495 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:55.630560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0682741e-db24-444b-8077-d3d25c8b2495 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:55.640444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0682741e-db24-444b-8077-d3d25c8b2495 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:55.641414 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0682741e-db24-444b-8077-d3d25c8b2495 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:55.642418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0682741e-db24-444b-8077-d3d25c8b2495 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:55.642866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0682741e-db24-444b-8077-d3d25c8b2495 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:55.658471 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-0682741e-db24-444b-8077-d3d25c8b2495 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] HTTP exception thrown: Instance cc27a082-c144-436f-bd21-e8126e00db6c could not be found. May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0682741e-db24-444b-8077-d3d25c8b2495 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Request method failure captured: May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c HTTP/1.1 May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVpOrnERzyeb7lMwVrn21cDoytWSNetCxqJgc5CVJ4eZy_ADVN1u_wWHNlz7BERkUOTkiEjss2yTMr2a-dhSC64AIDVnRC3eP4Ra3zV9oKseEcbHfjIvval7rydSKZcSfEpW1DE2X4UM7KB2L0XgIGvwSoJ3DftD470kJ4lDxI-IudI May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: X-Openstack-Nova-Api-Version: 2.20 May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 28972bcc37da4f9188ffca6bd1a9a3b9 May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-418539187 May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/28972bcc37da4f9188ffca6bd1a9a3b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/28972bcc37da4f9188ffca6bd1a9a3b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_28972bcc37da4f9188ffca6bd1a9a3b9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/28972bcc37da4f9188ffca6bd1a9a3b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AttachVolumeShelveTestJSON-418539187 May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 28972bcc37da4f9188ffca6bd1a9a3b9 May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-418539187 May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AttachVolumeShelveTestJSON-418539187-project May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: b29c0c0fb03c46838f3efe58b16c68d2 May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AttachVolumeShelveTestJSON-418539187-project May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance cc27a082-c144-436f-bd21-e8126e00db6c could not be found. May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'cc27a082-c144-436f-bd21-e8126e00db6c'} May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc27a082-c144-436f-bd21-e8126e00db6c could not be found. May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc27a082-c144-436f-bd21-e8126e00db6c could not be found. May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:34:55.667728 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:34:55.673046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:34:55.673046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:34:55.673046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:34:55.673046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:34:55.673046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:34:55.673046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:34:55.673046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc27a082-c144-436f-bd21-e8126e00db6c could not be found. May 21 21:34:55.673046 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:34:55.675098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0682741e-db24-444b-8077-d3d25c8b2495 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Returning 404 to user: Instance cc27a082-c144-436f-bd21-e8126e00db6c could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:34:55.687334 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0682741e-db24-444b-8077-d3d25c8b2495 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 404 len: 111 microversion: 2.20 time: 0.051131 May 21 21:34:55.687334 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2707/5287] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:55 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:34:55.696926 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-70802b1f-7c7f-4019-9da5-2a8100f07f22 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '.version_select at 0x7fc81b872940>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:55.701035 ncdv-master-1 devstack@n-api.service[131278]: ERROR oslo.messaging._drivers.impl_rabbit [None req-70802b1f-7c7f-4019-9da5-2a8100f07f22 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [757ee1d9-e142-49b6-8af4-504059748295] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 21 21:34:55.854105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9ae0d4fc-23f9-4133-bd56-a5c1f810beba tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:55.855005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9ae0d4fc-23f9-4133-bd56-a5c1f810beba tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:55.880417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ae0d4fc-23f9-4133-bd56-a5c1f810beba tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:55.880924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ae0d4fc-23f9-4133-bd56-a5c1f810beba tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:55.881759 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ae0d4fc-23f9-4133-bd56-a5c1f810beba tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:55.885820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ae0d4fc-23f9-4133-bd56-a5c1f810beba tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:56.014089 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9ae0d4fc-23f9-4133-bd56-a5c1f810beba tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:56.035231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9ae0d4fc-23f9-4133-bd56-a5c1f810beba tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:56.054376 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9ae0d4fc-23f9-4133-bd56-a5c1f810beba tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:56.055809 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9ae0d4fc-23f9-4133-bd56-a5c1f810beba tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.212716 May 21 21:34:56.060708 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2708/5288] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:55 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:34:56.709765 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [None req-70802b1f-7c7f-4019-9da5-2a8100f07f22 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [757ee1d9-e142-49b6-8af4-504059748295] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43574. May 21 21:34:56.717434 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:34:56.818806 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-70802b1f-7c7f-4019-9da5-2a8100f07f22 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-549632871" status: 204 len: 0 microversion: 2.20 time: 1.127761 May 21 21:34:56.819888 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2581/5289] 10.222.0.49 () {60 vars in 1258 bytes} [Sat May 21 21:34:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-549632871 => generated 0 bytes in 1129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:34:57.082378 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4a65a045-5c7e-4fda-9f69-e7b2d1c0b777 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:57.083009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4a65a045-5c7e-4fda-9f69-e7b2d1c0b777 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:57.089710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a65a045-5c7e-4fda-9f69-e7b2d1c0b777 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:57.090171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a65a045-5c7e-4fda-9f69-e7b2d1c0b777 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:57.090951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a65a045-5c7e-4fda-9f69-e7b2d1c0b777 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:57.091605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a65a045-5c7e-4fda-9f69-e7b2d1c0b777 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:57.171866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4a65a045-5c7e-4fda-9f69-e7b2d1c0b777 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:57.187453 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4a65a045-5c7e-4fda-9f69-e7b2d1c0b777 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:57.189264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4a65a045-5c7e-4fda-9f69-e7b2d1c0b777 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:57.191370 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4a65a045-5c7e-4fda-9f69-e7b2d1c0b777 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.113138 May 21 21:34:57.192457 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2709/5290] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:57 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:34:57.382458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dc594d01-1176-4018-b27c-67cc598624b5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:57.383906 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dc594d01-1176-4018-b27c-67cc598624b5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:57.392209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc594d01-1176-4018-b27c-67cc598624b5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:57.392957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc594d01-1176-4018-b27c-67cc598624b5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:57.394157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc594d01-1176-4018-b27c-67cc598624b5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:57.395030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc594d01-1176-4018-b27c-67cc598624b5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:57.434340 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dc594d01-1176-4018-b27c-67cc598624b5 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056727 May 21 21:34:57.435381 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2582/5291] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:34:57 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:34:57.447518 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e7d8f96d-9a12-4e9e-9b48-69da1e572e12 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:57.448050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e7d8f96d-9a12-4e9e-9b48-69da1e572e12 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:57.454878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7d8f96d-9a12-4e9e-9b48-69da1e572e12 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:57.455725 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7d8f96d-9a12-4e9e-9b48-69da1e572e12 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:57.456607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7d8f96d-9a12-4e9e-9b48-69da1e572e12 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:57.457056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e7d8f96d-9a12-4e9e-9b48-69da1e572e12 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:57.489604 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e7d8f96d-9a12-4e9e-9b48-69da1e572e12 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments/f7fe4a25-3d2f-4cc7-92c7-c4adcc753524" status: 200 len: 194 microversion: 2.1 time: 0.048419 May 21 21:34:57.490310 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2710/5292] 10.222.0.49 () {58 vars in 1412 bytes} [Sat May 21 21:34:57 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments/f7fe4a25-3d2f-4cc7-92c7-c4adcc753524 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:34:58.023056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-88d9ce6d-a9b1-49c9-a8b3-dbc727a9af4b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Action: 'create', calling method: .version_select at 0x7fc81b568550>, body: {"keypair": {"name": "tempest-keypair-1016185945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWtvNDmQedLBXcJa+20Qui9zPevSvu351YccVDvaJedoaKa0pQqy+XxwAkAKgj4ks3s/bP7ozZSxVPJB3Zpq+tfGSBf408pteVJTHPkIErpQrRakOm8BYChwWahj2pF5g=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:34:58.039901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-88d9ce6d-a9b1-49c9-a8b3-dbc727a9af4b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Getting quotas for project 28972bcc37da4f9188ffca6bd1a9a3b9. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:34:58.047716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-88d9ce6d-a9b1-49c9-a8b3-dbc727a9af4b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Getting quotas for user b29c0c0fb03c46838f3efe58b16c68d2 and project 28972bcc37da4f9188ffca6bd1a9a3b9. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:34:58.136186 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-88d9ce6d-a9b1-49c9-a8b3-dbc727a9af4b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.117542 May 21 21:34:58.138346 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2583/5293] 10.222.0.49 () {62 vars in 1199 bytes} [Sat May 21 21:34:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 21 21:34:58.211486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-79f67c7d-28d2-40ad-89ed-bba2d7079ccb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:58.212218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-79f67c7d-28d2-40ad-89ed-bba2d7079ccb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:58.219363 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-79f67c7d-28d2-40ad-89ed-bba2d7079ccb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:58.219827 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-79f67c7d-28d2-40ad-89ed-bba2d7079ccb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:58.220642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-79f67c7d-28d2-40ad-89ed-bba2d7079ccb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:58.221090 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-79f67c7d-28d2-40ad-89ed-bba2d7079ccb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:58.304804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-79f67c7d-28d2-40ad-89ed-bba2d7079ccb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:58.318380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-79f67c7d-28d2-40ad-89ed-bba2d7079ccb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:58.320470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-79f67c7d-28d2-40ad-89ed-bba2d7079ccb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:58.322632 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-79f67c7d-28d2-40ad-89ed-bba2d7079ccb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.114704 May 21 21:34:58.324328 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2711/5294] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:58 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:34:59.203052 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b164ded3-fb7c-4a97-95f1-7649be6b9e40 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdc5df23-beb1-4657-b84c-dda6067aaee3"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:34:59.204156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b164ded3-fb7c-4a97-95f1-7649be6b9e40 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:59.211360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b164ded3-fb7c-4a97-95f1-7649be6b9e40 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:59.211818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b164ded3-fb7c-4a97-95f1-7649be6b9e40 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:59.212653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b164ded3-fb7c-4a97-95f1-7649be6b9e40 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:59.213095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b164ded3-fb7c-4a97-95f1-7649be6b9e40 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:59.342720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-88e37134-1657-4b4e-967a-422ae48fab3e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:34:59.343375 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-88e37134-1657-4b4e-967a-422ae48fab3e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:34:59.352010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88e37134-1657-4b4e-967a-422ae48fab3e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:59.352598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88e37134-1657-4b4e-967a-422ae48fab3e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:59.353453 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88e37134-1657-4b4e-967a-422ae48fab3e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:34:59.353967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-88e37134-1657-4b4e-967a-422ae48fab3e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:34:59.371506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:34:59.447756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-88e37134-1657-4b4e-967a-422ae48fab3e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:59.463083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-88e37134-1657-4b4e-967a-422ae48fab3e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:59.465103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-88e37134-1657-4b4e-967a-422ae48fab3e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:34:59.466534 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-88e37134-1657-4b4e-967a-422ae48fab3e tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.127900 May 21 21:34:59.467610 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2712/5295] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:34:59 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:35:00.210757 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b164ded3-fb7c-4a97-95f1-7649be6b9e40 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "POST /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.012386 May 21 21:35:00.216006 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2584/5296] 10.222.0.49 () {60 vars in 1322 bytes} [Sat May 21 21:34:59 2022] POST /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments => generated 194 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:00.487054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-12d5ab27-5723-4520-9aed-3820b935bf8b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:00.488477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-12d5ab27-5723-4520-9aed-3820b935bf8b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:00.497266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-12d5ab27-5723-4520-9aed-3820b935bf8b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:00.500929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-12d5ab27-5723-4520-9aed-3820b935bf8b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:00.500929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-12d5ab27-5723-4520-9aed-3820b935bf8b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:00.500929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-12d5ab27-5723-4520-9aed-3820b935bf8b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:00.630064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-12d5ab27-5723-4520-9aed-3820b935bf8b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:00.689485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-12d5ab27-5723-4520-9aed-3820b935bf8b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:00.691267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-12d5ab27-5723-4520-9aed-3820b935bf8b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:00.692548 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-12d5ab27-5723-4520-9aed-3820b935bf8b tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.211198 May 21 21:35:00.696137 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2713/5297] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:00 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:35:01.455337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0d7819a1-1e72-4a1e-a4b7-21f07e4a1e02 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-98634235", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b82fc487-938c-4efe-8954-e9b63cbd5125"}], "security_groups": [{"name": "tempest-securitygroup--2005262606"}], "key_name": "tempest-keypair-1016185945", "user_data": "}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:35:01.581899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-0d7819a1-1e72-4a1e-a4b7-21f07e4a1e02 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] validate_networks() for [('b82fc487-938c-4efe-8954-e9b63cbd5125', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:35:01.712682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e75ee7e2-dbfd-4697-8d78-4c23b6596584 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:01.713312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e75ee7e2-dbfd-4697-8d78-4c23b6596584 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:01.724859 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e75ee7e2-dbfd-4697-8d78-4c23b6596584 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:01.725317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e75ee7e2-dbfd-4697-8d78-4c23b6596584 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:01.726218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e75ee7e2-dbfd-4697-8d78-4c23b6596584 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:01.726606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e75ee7e2-dbfd-4697-8d78-4c23b6596584 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:01.845137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e75ee7e2-dbfd-4697-8d78-4c23b6596584 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:01.857066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e75ee7e2-dbfd-4697-8d78-4c23b6596584 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:01.858575 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e75ee7e2-dbfd-4697-8d78-4c23b6596584 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:01.860978 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e75ee7e2-dbfd-4697-8d78-4c23b6596584 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.153183 May 21 21:35:01.862084 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2714/5298] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:01 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:35:02.143094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0d7819a1-1e72-4a1e-a4b7-21f07e4a1e02 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:35:02.143751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0d7819a1-1e72-4a1e-a4b7-21f07e4a1e02 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:35:02.144328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0d7819a1-1e72-4a1e-a4b7-21f07e4a1e02 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:35:02.144664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0d7819a1-1e72-4a1e-a4b7-21f07e4a1e02 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:35:02.145086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-0d7819a1-1e72-4a1e-a4b7-21f07e4a1e02 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:35:02.165445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d7819a1-1e72-4a1e-a4b7-21f07e4a1e02 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:02.165900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d7819a1-1e72-4a1e-a4b7-21f07e4a1e02 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:02.166702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d7819a1-1e72-4a1e-a4b7-21f07e4a1e02 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:02.167144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d7819a1-1e72-4a1e-a4b7-21f07e4a1e02 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:02.186616 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-0d7819a1-1e72-4a1e-a4b7-21f07e4a1e02 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Getting quotas for project 28972bcc37da4f9188ffca6bd1a9a3b9. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:35:02.193685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-0d7819a1-1e72-4a1e-a4b7-21f07e4a1e02 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Getting quotas for user b29c0c0fb03c46838f3efe58b16c68d2 and project 28972bcc37da4f9188ffca6bd1a9a3b9. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:35:02.210299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0d7819a1-1e72-4a1e-a4b7-21f07e4a1e02 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:35:02.214067 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0d7819a1-1e72-4a1e-a4b7-21f07e4a1e02 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:35:02.381119 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0d7819a1-1e72-4a1e-a4b7-21f07e4a1e02 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.931107 May 21 21:35:02.382147 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2585/5299] 10.222.0.49 () {62 vars in 1187 bytes} [Sat May 21 21:35:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 21 21:35:02.416038 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8f666d9c-72e5-47fa-9e42-b7b65c21327a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:02.417098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8f666d9c-72e5-47fa-9e42-b7b65c21327a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:02.547717 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8f666d9c-72e5-47fa-9e42-b7b65c21327a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:02.556219 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8f666d9c-72e5-47fa-9e42-b7b65c21327a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:02.557895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8f666d9c-72e5-47fa-9e42-b7b65c21327a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:02.559318 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8f666d9c-72e5-47fa-9e42-b7b65c21327a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1280 microversion: 2.20 time: 0.161914 May 21 21:35:02.571307 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2715/5300] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:02 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1280 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:35:02.885665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0dd33a40-beae-4960-8f8a-66a612f7dbd4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:02.886888 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0dd33a40-beae-4960-8f8a-66a612f7dbd4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:02.897580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0dd33a40-beae-4960-8f8a-66a612f7dbd4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:02.897580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0dd33a40-beae-4960-8f8a-66a612f7dbd4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:02.897580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0dd33a40-beae-4960-8f8a-66a612f7dbd4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:02.897896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0dd33a40-beae-4960-8f8a-66a612f7dbd4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:03.000364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0dd33a40-beae-4960-8f8a-66a612f7dbd4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:03.017366 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0dd33a40-beae-4960-8f8a-66a612f7dbd4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:03.021204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0dd33a40-beae-4960-8f8a-66a612f7dbd4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:03.060743 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0dd33a40-beae-4960-8f8a-66a612f7dbd4 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1365 microversion: 2.47 time: 0.180645 May 21 21:35:03.061814 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2586/5301] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:02 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:35:03.579024 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8fde98c9-fb53-41a7-a484-69d19c8c5e8c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:03.579698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8fde98c9-fb53-41a7-a484-69d19c8c5e8c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:03.599051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8fde98c9-fb53-41a7-a484-69d19c8c5e8c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:03.599512 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8fde98c9-fb53-41a7-a484-69d19c8c5e8c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:03.600983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8fde98c9-fb53-41a7-a484-69d19c8c5e8c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:03.601435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8fde98c9-fb53-41a7-a484-69d19c8c5e8c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:03.606140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1e3182ea-3c99-475b-8542-a94e7d14c55f tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:03.607255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1e3182ea-3c99-475b-8542-a94e7d14c55f tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:03.619364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e3182ea-3c99-475b-8542-a94e7d14c55f tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:03.620186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e3182ea-3c99-475b-8542-a94e7d14c55f tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:03.622232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e3182ea-3c99-475b-8542-a94e7d14c55f tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:03.626551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e3182ea-3c99-475b-8542-a94e7d14c55f tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:03.683430 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1e3182ea-3c99-475b-8542-a94e7d14c55f tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.081178 May 21 21:35:03.690873 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2587/5302] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:35:03 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments => generated 371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:03.704454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8fde98c9-fb53-41a7-a484-69d19c8c5e8c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:03.714873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8fde98c9-fb53-41a7-a484-69d19c8c5e8c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:03.716374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8fde98c9-fb53-41a7-a484-69d19c8c5e8c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:03.717597 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8fde98c9-fb53-41a7-a484-69d19c8c5e8c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1284 microversion: 2.20 time: 0.143197 May 21 21:35:03.718982 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2716/5303] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:03 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:35:03.827015 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c1f9cca3-dee5-4ebc-b909-ac95d16cb416 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:03.827528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c1f9cca3-dee5-4ebc-b909-ac95d16cb416 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:03.835004 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1f9cca3-dee5-4ebc-b909-ac95d16cb416 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:03.835992 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1f9cca3-dee5-4ebc-b909-ac95d16cb416 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:03.836971 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1f9cca3-dee5-4ebc-b909-ac95d16cb416 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:03.837577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c1f9cca3-dee5-4ebc-b909-ac95d16cb416 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:03.875403 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c1f9cca3-dee5-4ebc-b909-ac95d16cb416 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments/f7fe4a25-3d2f-4cc7-92c7-c4adcc753524" status: 200 len: 194 microversion: 2.1 time: 0.052519 May 21 21:35:03.876029 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2588/5304] 10.222.0.49 () {58 vars in 1412 bytes} [Sat May 21 21:35:03 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments/f7fe4a25-3d2f-4cc7-92c7-c4adcc753524 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:03.890613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8561e774-db48-4865-8a29-c9336a060ff3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:03.891168 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8561e774-db48-4865-8a29-c9336a060ff3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:03.898655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8561e774-db48-4865-8a29-c9336a060ff3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:03.902763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8561e774-db48-4865-8a29-c9336a060ff3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:03.902763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8561e774-db48-4865-8a29-c9336a060ff3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:03.902763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8561e774-db48-4865-8a29-c9336a060ff3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:04.002251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-8561e774-db48-4865-8a29-c9336a060ff3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lazy-loading 'services' on Instance uuid 1fdb37d6-723b-4053-81cd-697a6aa334a2 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:35:04.090783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c3234e01-d7f0-4a7a-87b0-39875d047d25 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:04.091838 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c3234e01-d7f0-4a7a-87b0-39875d047d25 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:04.107206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3234e01-d7f0-4a7a-87b0-39875d047d25 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:04.108745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3234e01-d7f0-4a7a-87b0-39875d047d25 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:04.109638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3234e01-d7f0-4a7a-87b0-39875d047d25 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:04.113040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3234e01-d7f0-4a7a-87b0-39875d047d25 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:04.205144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c3234e01-d7f0-4a7a-87b0-39875d047d25 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:04.215028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c3234e01-d7f0-4a7a-87b0-39875d047d25 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:04.216605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c3234e01-d7f0-4a7a-87b0-39875d047d25 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:04.219215 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c3234e01-d7f0-4a7a-87b0-39875d047d25 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1371 microversion: 2.47 time: 0.133509 May 21 21:35:04.220328 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2589/5305] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:04 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:35:04.238099 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8561e774-db48-4865-8a29-c9336a060ff3 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments/f7fe4a25-3d2f-4cc7-92c7-c4adcc753524" status: 202 len: 0 microversion: 2.1 time: 0.352444 May 21 21:35:04.238823 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2717/5306] 10.222.0.49 () {58 vars in 1415 bytes} [Sat May 21 21:35:03 2022] DELETE /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments/f7fe4a25-3d2f-4cc7-92c7-c4adcc753524 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:35:04.743270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-42211ed3-1782-476c-a2a2-2b6abb1e3a5c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:04.743936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-42211ed3-1782-476c-a2a2-2b6abb1e3a5c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:04.767833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42211ed3-1782-476c-a2a2-2b6abb1e3a5c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:04.767833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42211ed3-1782-476c-a2a2-2b6abb1e3a5c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:04.767833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42211ed3-1782-476c-a2a2-2b6abb1e3a5c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:04.767833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42211ed3-1782-476c-a2a2-2b6abb1e3a5c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:04.903227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-42211ed3-1782-476c-a2a2-2b6abb1e3a5c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:04.929924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-42211ed3-1782-476c-a2a2-2b6abb1e3a5c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:04.932579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-42211ed3-1782-476c-a2a2-2b6abb1e3a5c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:04.936208 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-42211ed3-1782-476c-a2a2-2b6abb1e3a5c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1340 microversion: 2.20 time: 0.201707 May 21 21:35:04.936208 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2590/5307] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:04 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1340 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:35:05.243960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-75236047-ac71-4a65-8097-d52977ffb4b8 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:05.247605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-75236047-ac71-4a65-8097-d52977ffb4b8 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:05.270398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-75236047-ac71-4a65-8097-d52977ffb4b8 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:05.271112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-75236047-ac71-4a65-8097-d52977ffb4b8 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:05.271945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-75236047-ac71-4a65-8097-d52977ffb4b8 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:05.272399 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-75236047-ac71-4a65-8097-d52977ffb4b8 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:05.417666 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-75236047-ac71-4a65-8097-d52977ffb4b8 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:05.435010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-75236047-ac71-4a65-8097-d52977ffb4b8 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:05.437218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-75236047-ac71-4a65-8097-d52977ffb4b8 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:05.442368 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-75236047-ac71-4a65-8097-d52977ffb4b8 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1371 microversion: 2.47 time: 0.205940 May 21 21:35:05.457492 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2718/5308] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:05 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:35:05.473108 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-27910264-52b0-47c2-aae7-40906f51a818 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:05.473760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-27910264-52b0-47c2-aae7-40906f51a818 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:05.490264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-27910264-52b0-47c2-aae7-40906f51a818 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:05.496125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-27910264-52b0-47c2-aae7-40906f51a818 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:05.512459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-27910264-52b0-47c2-aae7-40906f51a818 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:05.513902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-27910264-52b0-47c2-aae7-40906f51a818 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:05.589718 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-27910264-52b0-47c2-aae7-40906f51a818 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments/cdc5df23-beb1-4657-b84c-dda6067aaee3" status: 200 len: 194 microversion: 2.1 time: 0.121880 May 21 21:35:05.590792 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2591/5309] 10.222.0.49 () {58 vars in 1412 bytes} [Sat May 21 21:35:05 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments/cdc5df23-beb1-4657-b84c-dda6067aaee3 => generated 194 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:05.606156 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1841282d-4fa3-43e3-a079-01e785d54cf7 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:05.607489 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1841282d-4fa3-43e3-a079-01e785d54cf7 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:05.615241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1841282d-4fa3-43e3-a079-01e785d54cf7 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:05.615749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1841282d-4fa3-43e3-a079-01e785d54cf7 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:05.616791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1841282d-4fa3-43e3-a079-01e785d54cf7 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:05.617268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1841282d-4fa3-43e3-a079-01e785d54cf7 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:05.756772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-1841282d-4fa3-43e3-a079-01e785d54cf7 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lazy-loading 'services' on Instance uuid 1fdb37d6-723b-4053-81cd-697a6aa334a2 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:35:05.953233 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-89922c1e-a547-4fe9-b59f-c779a67278c0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:05.954857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-89922c1e-a547-4fe9-b59f-c779a67278c0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:05.968940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-89922c1e-a547-4fe9-b59f-c779a67278c0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:05.970466 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-89922c1e-a547-4fe9-b59f-c779a67278c0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:05.976388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-89922c1e-a547-4fe9-b59f-c779a67278c0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:05.976910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-89922c1e-a547-4fe9-b59f-c779a67278c0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:06.053302 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1841282d-4fa3-43e3-a079-01e785d54cf7 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments/cdc5df23-beb1-4657-b84c-dda6067aaee3" status: 202 len: 0 microversion: 2.1 time: 0.456792 May 21 21:35:06.057529 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2719/5310] 10.222.0.49 () {58 vars in 1415 bytes} [Sat May 21 21:35:05 2022] DELETE /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments/cdc5df23-beb1-4657-b84c-dda6067aaee3 => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:35:06.104347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-89922c1e-a547-4fe9-b59f-c779a67278c0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:06.110121 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:35:06.114577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-89922c1e-a547-4fe9-b59f-c779a67278c0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:06.117245 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-89922c1e-a547-4fe9-b59f-c779a67278c0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:06.118573 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-89922c1e-a547-4fe9-b59f-c779a67278c0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1338 microversion: 2.20 time: 0.170804 May 21 21:35:06.121012 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2592/5311] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:05 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1338 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:35:06.471093 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1ecee576-a750-47eb-a5a6-c8b0e70f1958 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:06.475456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1ecee576-a750-47eb-a5a6-c8b0e70f1958 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:06.491491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ecee576-a750-47eb-a5a6-c8b0e70f1958 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:06.491945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ecee576-a750-47eb-a5a6-c8b0e70f1958 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:06.492838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ecee576-a750-47eb-a5a6-c8b0e70f1958 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:06.493283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ecee576-a750-47eb-a5a6-c8b0e70f1958 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:06.632953 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1ecee576-a750-47eb-a5a6-c8b0e70f1958 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:06.648255 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1ecee576-a750-47eb-a5a6-c8b0e70f1958 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:06.650052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1ecee576-a750-47eb-a5a6-c8b0e70f1958 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:06.654387 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1ecee576-a750-47eb-a5a6-c8b0e70f1958 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1356 microversion: 2.47 time: 0.188643 May 21 21:35:06.688616 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2720/5312] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:06 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1356 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:35:06.698136 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0bbe0735-ccb3-4b22-9b55-ce22ec7d116a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:06.704013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0bbe0735-ccb3-4b22-9b55-ce22ec7d116a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:06.704799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0bbe0735-ccb3-4b22-9b55-ce22ec7d116a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Searching by: {'deleted': False, 'project_id': '70fa0b97b1b14e058012af12fa705b29'} {{(pid=131278) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 21:35:06.715395 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bbe0735-ccb3-4b22-9b55-ce22ec7d116a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:06.716858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bbe0735-ccb3-4b22-9b55-ce22ec7d116a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:06.717210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bbe0735-ccb3-4b22-9b55-ce22ec7d116a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:06.717817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bbe0735-ccb3-4b22-9b55-ce22ec7d116a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:06.914756 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.multi_cell_list [None req-0bbe0735-ccb3-4b22-9b55-ce22ec7d116a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 21:35:07.076495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0bbe0735-ccb3-4b22-9b55-ce22ec7d116a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:07.091893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bbe0735-ccb3-4b22-9b55-ce22ec7d116a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:07.097537 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bbe0735-ccb3-4b22-9b55-ce22ec7d116a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:07.138760 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-52ce9840-178a-4f35-a114-f2d52b6521f2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:07.139996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-52ce9840-178a-4f35-a114-f2d52b6521f2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:07.151110 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-52ce9840-178a-4f35-a114-f2d52b6521f2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:07.151561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-52ce9840-178a-4f35-a114-f2d52b6521f2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:07.154538 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-52ce9840-178a-4f35-a114-f2d52b6521f2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:07.155006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-52ce9840-178a-4f35-a114-f2d52b6521f2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:07.160058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0bbe0735-ccb3-4b22-9b55-ce22ec7d116a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:07.168581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0bbe0735-ccb3-4b22-9b55-ce22ec7d116a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:07.324592 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0bbe0735-ccb3-4b22-9b55-ce22ec7d116a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.618140 May 21 21:35:07.324592 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2593/5313] 10.222.0.49 () {60 vars in 1186 bytes} [Sat May 21 21:35:06 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:35:07.324592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-07cc49c3-66b4-416b-ae3f-9f7f2761ef7b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:07.324592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-07cc49c3-66b4-416b-ae3f-9f7f2761ef7b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:07.336579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-07cc49c3-66b4-416b-ae3f-9f7f2761ef7b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:07.337131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-07cc49c3-66b4-416b-ae3f-9f7f2761ef7b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:07.338027 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-07cc49c3-66b4-416b-ae3f-9f7f2761ef7b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:07.338477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-07cc49c3-66b4-416b-ae3f-9f7f2761ef7b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:07.372821 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-07cc49c3-66b4-416b-ae3f-9f7f2761ef7b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059943 May 21 21:35:07.376428 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2594/5314] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:35:07 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 21 21:35:07.385157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-659cf3e3-77fe-4e12-8aa3-f255cd55a50a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:07.385672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-659cf3e3-77fe-4e12-8aa3-f255cd55a50a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:07.392244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-659cf3e3-77fe-4e12-8aa3-f255cd55a50a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:07.392919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-659cf3e3-77fe-4e12-8aa3-f255cd55a50a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:07.394887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-659cf3e3-77fe-4e12-8aa3-f255cd55a50a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:07.395572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-659cf3e3-77fe-4e12-8aa3-f255cd55a50a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:07.425881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-659cf3e3-77fe-4e12-8aa3-f255cd55a50a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:35:07.433811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-52ce9840-178a-4f35-a114-f2d52b6521f2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:07.446131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-52ce9840-178a-4f35-a114-f2d52b6521f2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:07.448049 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-52ce9840-178a-4f35-a114-f2d52b6521f2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:07.449453 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-52ce9840-178a-4f35-a114-f2d52b6521f2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1406 microversion: 2.20 time: 0.314728 May 21 21:35:07.450027 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2721/5315] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:07 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1406 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:35:07.541709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a9ee0d5f-561b-4759-b01f-4e8a08445910 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:07.543353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a9ee0d5f-561b-4759-b01f-4e8a08445910 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:07.551918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9ee0d5f-561b-4759-b01f-4e8a08445910 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:07.552755 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9ee0d5f-561b-4759-b01f-4e8a08445910 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:07.553727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9ee0d5f-561b-4759-b01f-4e8a08445910 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:07.554494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a9ee0d5f-561b-4759-b01f-4e8a08445910 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:07.589687 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a9ee0d5f-561b-4759-b01f-4e8a08445910 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050744 May 21 21:35:07.602734 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2722/5316] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:35:07 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:35:07.713367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0e7f02dd-476f-45d3-962a-c1f41ddd37af tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:07.713944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0e7f02dd-476f-45d3-962a-c1f41ddd37af tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:07.745776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e7f02dd-476f-45d3-962a-c1f41ddd37af tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:07.746388 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e7f02dd-476f-45d3-962a-c1f41ddd37af tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:07.756911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e7f02dd-476f-45d3-962a-c1f41ddd37af tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:07.756911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e7f02dd-476f-45d3-962a-c1f41ddd37af tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:07.809744 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-659cf3e3-77fe-4e12-8aa3-f255cd55a50a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "DELETE /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 204 len: 0 microversion: 2.47 time: 0.433325 May 21 21:35:07.812505 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2595/5317] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:35:07 2022] DELETE /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:35:07.823345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c3aa8742-dea5-4cda-84bc-bf6289e55d7d tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:07.826111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c3aa8742-dea5-4cda-84bc-bf6289e55d7d tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:07.841275 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0e7f02dd-476f-45d3-962a-c1f41ddd37af tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:35:07.845860 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3aa8742-dea5-4cda-84bc-bf6289e55d7d tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:07.847484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3aa8742-dea5-4cda-84bc-bf6289e55d7d tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:07.847484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3aa8742-dea5-4cda-84bc-bf6289e55d7d tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:07.847707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3aa8742-dea5-4cda-84bc-bf6289e55d7d tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:08.036870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c3aa8742-dea5-4cda-84bc-bf6289e55d7d tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:08.048990 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c3aa8742-dea5-4cda-84bc-bf6289e55d7d tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:08.053889 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c3aa8742-dea5-4cda-84bc-bf6289e55d7d tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:08.053889 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c3aa8742-dea5-4cda-84bc-bf6289e55d7d tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1362 microversion: 2.47 time: 0.238266 May 21 21:35:08.059744 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2596/5318] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:07 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:35:08.224322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-4d1be4da-c74c-477c-a38b-0e01ffe840f0 req-7ad6281b-8e5b-4d75-a8bb-76251728522c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7cc5c56-edbc-4588-9912-c07974b1f4e7", "tag": "b88a4bf2-b43b-40cf-9426-b3b39cf8f325"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:35:08.240892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4d1be4da-c74c-477c-a38b-0e01ffe840f0 req-7ad6281b-8e5b-4d75-a8bb-76251728522c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:08.241618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4d1be4da-c74c-477c-a38b-0e01ffe840f0 req-7ad6281b-8e5b-4d75-a8bb-76251728522c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:08.256835 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-4d1be4da-c74c-477c-a38b-0e01ffe840f0 req-7ad6281b-8e5b-4d75-a8bb-76251728522c service nova] Creating event network-changed:b88a4bf2-b43b-40cf-9426-b3b39cf8f325 for instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 on nch2-master-1 May 21 21:35:08.271651 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-4d1be4da-c74c-477c-a38b-0e01ffe840f0 req-7ad6281b-8e5b-4d75-a8bb-76251728522c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053632 May 21 21:35:08.273528 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2597/5319] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:35:08.355194 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0e7f02dd-476f-45d3-962a-c1f41ddd37af tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 204 len: 0 microversion: 2.1 time: 0.653318 May 21 21:35:08.363106 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2723/5320] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:35:07 2022] DELETE /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:35:08.370981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bf79566d-a1b8-4ac1-8795-60738e230a1d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:08.371708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bf79566d-a1b8-4ac1-8795-60738e230a1d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:08.379675 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf79566d-a1b8-4ac1-8795-60738e230a1d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:08.380218 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf79566d-a1b8-4ac1-8795-60738e230a1d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:08.381574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf79566d-a1b8-4ac1-8795-60738e230a1d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:08.382304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bf79566d-a1b8-4ac1-8795-60738e230a1d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:08.475006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-24046274-180f-4406-9607-94c528bf7eef tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:08.475006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-24046274-180f-4406-9607-94c528bf7eef tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:08.498757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24046274-180f-4406-9607-94c528bf7eef tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:08.498757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24046274-180f-4406-9607-94c528bf7eef tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:08.499167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24046274-180f-4406-9607-94c528bf7eef tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:08.499608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24046274-180f-4406-9607-94c528bf7eef tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:08.618248 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bf79566d-a1b8-4ac1-8795-60738e230a1d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:08.626775 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bf79566d-a1b8-4ac1-8795-60738e230a1d tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 200 len: 1674 microversion: 2.1 time: 0.261271 May 21 21:35:08.637017 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2598/5321] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:35:08 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 1674 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:35:08.724689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-24046274-180f-4406-9607-94c528bf7eef tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:08.733256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-24046274-180f-4406-9607-94c528bf7eef tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:08.734814 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-24046274-180f-4406-9607-94c528bf7eef tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:08.735972 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-24046274-180f-4406-9607-94c528bf7eef tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1406 microversion: 2.20 time: 0.266985 May 21 21:35:08.745765 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2724/5322] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:08 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1406 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:35:09.072548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f14d6f78-df60-4236-ba5e-5a8eee1f8b42 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:09.073265 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f14d6f78-df60-4236-ba5e-5a8eee1f8b42 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:09.082033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f14d6f78-df60-4236-ba5e-5a8eee1f8b42 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:09.083223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f14d6f78-df60-4236-ba5e-5a8eee1f8b42 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:09.083557 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f14d6f78-df60-4236-ba5e-5a8eee1f8b42 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:09.084090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f14d6f78-df60-4236-ba5e-5a8eee1f8b42 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:09.162098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f14d6f78-df60-4236-ba5e-5a8eee1f8b42 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:09.172458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f14d6f78-df60-4236-ba5e-5a8eee1f8b42 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:09.173981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f14d6f78-df60-4236-ba5e-5a8eee1f8b42 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:09.176632 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f14d6f78-df60-4236-ba5e-5a8eee1f8b42 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1362 microversion: 2.47 time: 0.108420 May 21 21:35:09.185092 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2599/5323] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:09 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1362 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:35:09.645595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-38de269f-6143-4662-9bcb-dc688afe788a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:09.646684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-38de269f-6143-4662-9bcb-dc688afe788a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:09.655448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38de269f-6143-4662-9bcb-dc688afe788a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:09.656112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38de269f-6143-4662-9bcb-dc688afe788a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:09.657857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38de269f-6143-4662-9bcb-dc688afe788a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:09.658403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38de269f-6143-4662-9bcb-dc688afe788a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:09.754796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7de236bd-af55-4a9f-be2b-9f3a5edb7766 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:09.755672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7de236bd-af55-4a9f-be2b-9f3a5edb7766 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:09.764261 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7de236bd-af55-4a9f-be2b-9f3a5edb7766 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:09.766347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7de236bd-af55-4a9f-be2b-9f3a5edb7766 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:09.767158 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7de236bd-af55-4a9f-be2b-9f3a5edb7766 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:09.767620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7de236bd-af55-4a9f-be2b-9f3a5edb7766 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:09.902932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-38de269f-6143-4662-9bcb-dc688afe788a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:09.914540 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-38de269f-6143-4662-9bcb-dc688afe788a tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 200 len: 1674 microversion: 2.1 time: 0.273633 May 21 21:35:09.915865 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2725/5324] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:35:09 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 1674 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:35:10.158024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7de236bd-af55-4a9f-be2b-9f3a5edb7766 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:10.167428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7de236bd-af55-4a9f-be2b-9f3a5edb7766 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:10.169660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7de236bd-af55-4a9f-be2b-9f3a5edb7766 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:10.170835 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7de236bd-af55-4a9f-be2b-9f3a5edb7766 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1406 microversion: 2.20 time: 0.420240 May 21 21:35:10.171587 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2600/5325] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:09 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1406 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:35:10.197285 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3e63fd06-11bc-4169-9176-2cc48323e2c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:10.198195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3e63fd06-11bc-4169-9176-2cc48323e2c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:10.207295 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e63fd06-11bc-4169-9176-2cc48323e2c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:10.208085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e63fd06-11bc-4169-9176-2cc48323e2c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:10.208915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e63fd06-11bc-4169-9176-2cc48323e2c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:10.209358 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e63fd06-11bc-4169-9176-2cc48323e2c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:10.254583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e63fd06-11bc-4169-9176-2cc48323e2c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:10.255047 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e63fd06-11bc-4169-9176-2cc48323e2c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:10.255509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-3e63fd06-11bc-4169-9176-2cc48323e2c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lazy-loading 'fault' on Instance uuid 083310df-3463-40a8-906e-50cc448b7786 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:35:10.318220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3e63fd06-11bc-4169-9176-2cc48323e2c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:10.321759 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:35:10.335342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3e63fd06-11bc-4169-9176-2cc48323e2c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:10.338465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3e63fd06-11bc-4169-9176-2cc48323e2c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:10.341049 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3e63fd06-11bc-4169-9176-2cc48323e2c2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 200 len: 1367 microversion: 2.47 time: 0.148372 May 21 21:35:10.342902 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2726/5326] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:10 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:35:10.934659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2f43bbff-69f3-49ed-bff1-765443fdb1fc tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:10.935290 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2f43bbff-69f3-49ed-bff1-765443fdb1fc tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:10.945104 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f43bbff-69f3-49ed-bff1-765443fdb1fc tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:10.945104 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f43bbff-69f3-49ed-bff1-765443fdb1fc tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:10.945104 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f43bbff-69f3-49ed-bff1-765443fdb1fc tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:10.945104 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f43bbff-69f3-49ed-bff1-765443fdb1fc tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:11.191192 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-32a5b9c7-90a9-4244-a9c9-47c8d66b5fcb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:11.192086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-32a5b9c7-90a9-4244-a9c9-47c8d66b5fcb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:11.196219 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:35:11.203656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32a5b9c7-90a9-4244-a9c9-47c8d66b5fcb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:11.204616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32a5b9c7-90a9-4244-a9c9-47c8d66b5fcb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:11.210624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32a5b9c7-90a9-4244-a9c9-47c8d66b5fcb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:11.210624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32a5b9c7-90a9-4244-a9c9-47c8d66b5fcb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:11.253697 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2f43bbff-69f3-49ed-bff1-765443fdb1fc tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:11.267891 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2f43bbff-69f3-49ed-bff1-765443fdb1fc tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 200 len: 1674 microversion: 2.1 time: 0.335764 May 21 21:35:11.269727 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2601/5327] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:35:10 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 1674 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:35:11.364497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a12c29a6-40ca-4341-bbe5-7964736e97a5 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:11.365780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a12c29a6-40ca-4341-bbe5-7964736e97a5 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 083310df-3463-40a8-906e-50cc448b7786] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:11.374917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a12c29a6-40ca-4341-bbe5-7964736e97a5 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:11.381122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a12c29a6-40ca-4341-bbe5-7964736e97a5 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:11.387672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a12c29a6-40ca-4341-bbe5-7964736e97a5 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:11.387672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a12c29a6-40ca-4341-bbe5-7964736e97a5 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:11.406568 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-a12c29a6-40ca-4341-bbe5-7964736e97a5 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] HTTP exception thrown: Instance 083310df-3463-40a8-906e-50cc448b7786 could not be found. May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a12c29a6-40ca-4341-bbe5-7964736e97a5 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Request method failure captured: May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 HTTP/1.1 May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVrdDgx5jBuk85IqpgE2zfrbt38p9E5tcBebx_agVhqDuUm94GRpm3WU6UId8T1Da2Bm98ente9HZTmRGs07ra-TWt0lxmXVbEFD0-tRwgYlFK8TMpdA0jNVUhv-ntOrjPtHvLuq2j96F1jsvsAux5ss_wBUq--rdfW5T_tLwkawXWQ May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: X-Openstack-Nova-Api-Version: 2.47 May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 70fa0b97b1b14e058012af12fa705b29 May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerShowV247Test-1218232338 May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/70fa0b97b1b14e058012af12fa705b29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70fa0b97b1b14e058012af12fa705b29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_70fa0b97b1b14e058012af12fa705b29", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70fa0b97b1b14e058012af12fa705b29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerShowV247Test-1218232338 May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 70fa0b97b1b14e058012af12fa705b29 May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerShowV247Test-1218232338 May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerShowV247Test-1218232338-project May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 83eabb990d2b4a1cb3eefb962271d36c May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerShowV247Test-1218232338-project May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 083310df-3463-40a8-906e-50cc448b7786 could not be found. May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '083310df-3463-40a8-906e-50cc448b7786'} May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 083310df-3463-40a8-906e-50cc448b7786 could not be found. May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 083310df-3463-40a8-906e-50cc448b7786 could not be found. May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:35:11.408261 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:11.420481 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:11.420481 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:35:11.420481 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:35:11.420481 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:35:11.420481 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:35:11.420481 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 083310df-3463-40a8-906e-50cc448b7786 could not be found. May 21 21:35:11.420481 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:11.420481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a12c29a6-40ca-4341-bbe5-7964736e97a5 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Returning 404 to user: Instance 083310df-3463-40a8-906e-50cc448b7786 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:35:11.420481 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a12c29a6-40ca-4341-bbe5-7964736e97a5 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786" status: 404 len: 111 microversion: 2.47 time: 0.051149 May 21 21:35:11.420481 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2602/5328] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:11 2022] GET /compute/v2.1/servers/083310df-3463-40a8-906e-50cc448b7786 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 21 21:35:11.420481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-69d74c3c-02b9-4986-97ab-6ed39c337edb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:11.422123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-69d74c3c-02b9-4986-97ab-6ed39c337edb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 6a1bbc2d-c96b-44ed-9baf-b24b38d3b599] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:11.427717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69d74c3c-02b9-4986-97ab-6ed39c337edb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:11.428319 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69d74c3c-02b9-4986-97ab-6ed39c337edb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:11.429193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69d74c3c-02b9-4986-97ab-6ed39c337edb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:11.429640 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69d74c3c-02b9-4986-97ab-6ed39c337edb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:11.476251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-32a5b9c7-90a9-4244-a9c9-47c8d66b5fcb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:11.485819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-69d74c3c-02b9-4986-97ab-6ed39c337edb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 6a1bbc2d-c96b-44ed-9baf-b24b38d3b599] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:35:11.508030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-32a5b9c7-90a9-4244-a9c9-47c8d66b5fcb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:11.511335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-32a5b9c7-90a9-4244-a9c9-47c8d66b5fcb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:11.513247 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-32a5b9c7-90a9-4244-a9c9-47c8d66b5fcb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1406 microversion: 2.20 time: 0.327525 May 21 21:35:11.514911 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2727/5329] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:11 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1406 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:35:11.859961 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-472eea24-1311-4559-b6a2-cde7dee159a4 req-03854f0e-6585-44ff-8c08-e4cfa5967a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fdb37d6-723b-4053-81cd-697a6aa334a2", "name": "network-vif-deleted", "tag": "f564fcbe-89e0-4d41-98a7-8cf562ada89c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:35:11.889120 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-472eea24-1311-4559-b6a2-cde7dee159a4 req-03854f0e-6585-44ff-8c08-e4cfa5967a8c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:11.891368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-472eea24-1311-4559-b6a2-cde7dee159a4 req-03854f0e-6585-44ff-8c08-e4cfa5967a8c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:11.942583 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-472eea24-1311-4559-b6a2-cde7dee159a4 req-03854f0e-6585-44ff-8c08-e4cfa5967a8c service nova] Creating event network-vif-deleted:f564fcbe-89e0-4d41-98a7-8cf562ada89c for instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 on nch2-master-1 May 21 21:35:11.959965 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-472eea24-1311-4559-b6a2-cde7dee159a4 req-03854f0e-6585-44ff-8c08-e4cfa5967a8c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112359 May 21 21:35:11.960888 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2728/5330] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:35:11.969147 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-69d74c3c-02b9-4986-97ab-6ed39c337edb tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6a1bbc2d-c96b-44ed-9baf-b24b38d3b599" status: 204 len: 0 microversion: 2.47 time: 0.552370 May 21 21:35:11.970955 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2603/5331] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:35:11 2022] DELETE /compute/v2.1/servers/6a1bbc2d-c96b-44ed-9baf-b24b38d3b599 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 21 21:35:11.980629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-578af163-ea2f-4353-a76c-ff1249a97539 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:11.981343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-578af163-ea2f-4353-a76c-ff1249a97539 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 6a1bbc2d-c96b-44ed-9baf-b24b38d3b599] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:12.004733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-578af163-ea2f-4353-a76c-ff1249a97539 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:12.009547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-578af163-ea2f-4353-a76c-ff1249a97539 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:12.010707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-578af163-ea2f-4353-a76c-ff1249a97539 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:12.011380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-578af163-ea2f-4353-a76c-ff1249a97539 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:12.291414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-27705253-55eb-4408-9309-6d9ce3b538ac tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:12.300760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-27705253-55eb-4408-9309-6d9ce3b538ac tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:12.309092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-27705253-55eb-4408-9309-6d9ce3b538ac tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:12.309911 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-27705253-55eb-4408-9309-6d9ce3b538ac tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:12.310903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-27705253-55eb-4408-9309-6d9ce3b538ac tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:12.311534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-27705253-55eb-4408-9309-6d9ce3b538ac tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:12.375024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-27705253-55eb-4408-9309-6d9ce3b538ac tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:12.375693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-27705253-55eb-4408-9309-6d9ce3b538ac tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:12.377367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-27705253-55eb-4408-9309-6d9ce3b538ac tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lazy-loading 'fault' on Instance uuid 1fdb37d6-723b-4053-81cd-697a6aa334a2 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:35:12.483444 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-27705253-55eb-4408-9309-6d9ce3b538ac tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6501f7543485db27a33dd1a1a8400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeaf54409d44d0abe3cd6c176fa7ea4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:12.487207 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-27705253-55eb-4408-9309-6d9ce3b538ac tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 200 len: 1328 microversion: 2.1 time: 0.205317 May 21 21:35:12.488111 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2604/5332] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:35:12 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 1328 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:35:12.501577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-578af163-ea2f-4353-a76c-ff1249a97539 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:12.512518 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-578af163-ea2f-4353-a76c-ff1249a97539 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:12.514739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-578af163-ea2f-4353-a76c-ff1249a97539 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:12.516209 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-578af163-ea2f-4353-a76c-ff1249a97539 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/6a1bbc2d-c96b-44ed-9baf-b24b38d3b599" status: 200 len: 1363 microversion: 2.47 time: 0.540310 May 21 21:35:12.529733 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2729/5333] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:11 2022] GET /compute/v2.1/servers/6a1bbc2d-c96b-44ed-9baf-b24b38d3b599 => generated 1363 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:35:12.536409 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d9debf06-ad6b-4abd-b93c-27005c502fc8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:12.538246 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d9debf06-ad6b-4abd-b93c-27005c502fc8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:12.547094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9debf06-ad6b-4abd-b93c-27005c502fc8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:12.549638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9debf06-ad6b-4abd-b93c-27005c502fc8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:12.551223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9debf06-ad6b-4abd-b93c-27005c502fc8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:12.552306 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d9debf06-ad6b-4abd-b93c-27005c502fc8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:12.786075 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d9debf06-ad6b-4abd-b93c-27005c502fc8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:12.794684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d9debf06-ad6b-4abd-b93c-27005c502fc8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:12.796200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d9debf06-ad6b-4abd-b93c-27005c502fc8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:12.797373 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d9debf06-ad6b-4abd-b93c-27005c502fc8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1406 microversion: 2.20 time: 0.266082 May 21 21:35:12.797947 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2605/5334] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:12 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:35:13.500907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:35:13.508593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fddc57f1-c4dc-46af-a7f8-4ce9f5eee1ad tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:13.510009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fddc57f1-c4dc-46af-a7f8-4ce9f5eee1ad tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:13.516569 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fddc57f1-c4dc-46af-a7f8-4ce9f5eee1ad tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:13.517263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fddc57f1-c4dc-46af-a7f8-4ce9f5eee1ad tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:13.519756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fddc57f1-c4dc-46af-a7f8-4ce9f5eee1ad tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:13.520540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fddc57f1-c4dc-46af-a7f8-4ce9f5eee1ad tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:13.536723 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-fddc57f1-c4dc-46af-a7f8-4ce9f5eee1ad tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] HTTP exception thrown: Instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 could not be found. May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fddc57f1-c4dc-46af-a7f8-4ce9f5eee1ad tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Request method failure captured: May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 HTTP/1.1 May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoHzVV9oy_EU_IYsFGeHTnkJmeTGzL2hOMScY5fxlHdGzMWQlNmx3ok0yXGSd9z2iwg80ZehVP0P56CYfJwVfM_nDvD93NkoExhFShdfIjmz7V2cxd1lVxbL0ZNl4BcIq8yEbgDNERe6ES_QxVWEtoma-h3VIrTk9Hp49olyJDQrfA May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: dbeaf54409d44d0abe3cd6c176fa7ea4 May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AttachVolumeTestJSON-105426157 May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dbeaf54409d44d0abe3cd6c176fa7ea4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dbeaf54409d44d0abe3cd6c176fa7ea4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dbeaf54409d44d0abe3cd6c176fa7ea4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dbeaf54409d44d0abe3cd6c176fa7ea4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AttachVolumeTestJSON-105426157 May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: dbeaf54409d44d0abe3cd6c176fa7ea4 May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AttachVolumeTestJSON-105426157 May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AttachVolumeTestJSON-105426157-project May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 66b6501f7543485db27a33dd1a1a8400 May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AttachVolumeTestJSON-105426157-project May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 could not be found. May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '1fdb37d6-723b-4053-81cd-697a6aa334a2'} May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 could not be found. May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 could not be found. May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:35:13.538516 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:35:13.542974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:13.542974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:35:13.542974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:35:13.542974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:35:13.542974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:35:13.542974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 could not be found. May 21 21:35:13.542974 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:35:13.542974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fddc57f1-c4dc-46af-a7f8-4ce9f5eee1ad tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Returning 404 to user: Instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:35:13.542974 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fddc57f1-c4dc-46af-a7f8-4ce9f5eee1ad tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 404 len: 111 microversion: 2.1 time: 0.039937 May 21 21:35:13.542974 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2730/5335] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:35:13 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:35:13.545216 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b5b552a6-9152-4dd3-be30-53751f63f9d2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:13.545844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b5b552a6-9152-4dd3-be30-53751f63f9d2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 6a1bbc2d-c96b-44ed-9baf-b24b38d3b599] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:13.554373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5b552a6-9152-4dd3-be30-53751f63f9d2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:13.555099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d5861f73-8d40-49e2-9c3a-b16c7225137c tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '.version_select at 0x7fc81a3e88b0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:13.555451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5b552a6-9152-4dd3-be30-53751f63f9d2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:13.556533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5b552a6-9152-4dd3-be30-53751f63f9d2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:13.556981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5b552a6-9152-4dd3-be30-53751f63f9d2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:13.574036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:35:13.633276 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b5b552a6-9152-4dd3-be30-53751f63f9d2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:13.644791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b5b552a6-9152-4dd3-be30-53751f63f9d2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:13.646967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b5b552a6-9152-4dd3-be30-53751f63f9d2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:13.648582 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b5b552a6-9152-4dd3-be30-53751f63f9d2 tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/6a1bbc2d-c96b-44ed-9baf-b24b38d3b599" status: 200 len: 1363 microversion: 2.47 time: 0.113865 May 21 21:35:13.649735 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2606/5336] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:13 2022] GET /compute/v2.1/servers/6a1bbc2d-c96b-44ed-9baf-b24b38d3b599 => generated 1363 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:35:13.751285 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d5861f73-8d40-49e2-9c3a-b16c7225137c tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120378386" status: 202 len: 0 microversion: 2.1 time: 0.200116 May 21 21:35:13.753183 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2731/5337] 10.222.0.49 () {58 vars in 1220 bytes} [Sat May 21 21:35:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120378386 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 21 21:35:13.814996 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-21282d1c-8438-4e70-a8a0-600a13293c4c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:13.815881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-21282d1c-8438-4e70-a8a0-600a13293c4c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:13.822357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21282d1c-8438-4e70-a8a0-600a13293c4c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:13.823156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21282d1c-8438-4e70-a8a0-600a13293c4c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:13.823843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21282d1c-8438-4e70-a8a0-600a13293c4c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:13.824486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21282d1c-8438-4e70-a8a0-600a13293c4c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:14.011094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-21282d1c-8438-4e70-a8a0-600a13293c4c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:14.024201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-21282d1c-8438-4e70-a8a0-600a13293c4c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:14.026013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-21282d1c-8438-4e70-a8a0-600a13293c4c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:14.027413 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-21282d1c-8438-4e70-a8a0-600a13293c4c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1406 microversion: 2.20 time: 0.216559 May 21 21:35:14.028057 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2607/5338] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:13 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:35:14.693469 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4933e257-ba39-48eb-91e5-9c310a24cd4a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:14.694254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4933e257-ba39-48eb-91e5-9c310a24cd4a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 6a1bbc2d-c96b-44ed-9baf-b24b38d3b599] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:14.707210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4933e257-ba39-48eb-91e5-9c310a24cd4a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:14.714225 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4933e257-ba39-48eb-91e5-9c310a24cd4a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:14.715254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4933e257-ba39-48eb-91e5-9c310a24cd4a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:14.716251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4933e257-ba39-48eb-91e5-9c310a24cd4a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:14.778802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4933e257-ba39-48eb-91e5-9c310a24cd4a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:14.781532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4933e257-ba39-48eb-91e5-9c310a24cd4a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:14.781532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-4933e257-ba39-48eb-91e5-9c310a24cd4a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lazy-loading 'fault' on Instance uuid 6a1bbc2d-c96b-44ed-9baf-b24b38d3b599 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:35:14.833048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4933e257-ba39-48eb-91e5-9c310a24cd4a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:14.845379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4933e257-ba39-48eb-91e5-9c310a24cd4a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:14.847968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4933e257-ba39-48eb-91e5-9c310a24cd4a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83eabb990d2b4a1cb3eefb962271d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fa0b97b1b14e058012af12fa705b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:14.849543 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4933e257-ba39-48eb-91e5-9c310a24cd4a tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/6a1bbc2d-c96b-44ed-9baf-b24b38d3b599" status: 200 len: 1368 microversion: 2.47 time: 0.165058 May 21 21:35:14.850932 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2732/5339] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:14 2022] GET /compute/v2.1/servers/6a1bbc2d-c96b-44ed-9baf-b24b38d3b599 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:35:15.046892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0c3c8198-27dd-4969-9aa5-3d70a798f37b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:15.047565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0c3c8198-27dd-4969-9aa5-3d70a798f37b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:15.057342 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c3c8198-27dd-4969-9aa5-3d70a798f37b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:15.057797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c3c8198-27dd-4969-9aa5-3d70a798f37b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:15.058584 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c3c8198-27dd-4969-9aa5-3d70a798f37b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:15.059027 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c3c8198-27dd-4969-9aa5-3d70a798f37b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:15.211279 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0c3c8198-27dd-4969-9aa5-3d70a798f37b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:15.219612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0c3c8198-27dd-4969-9aa5-3d70a798f37b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:15.221788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0c3c8198-27dd-4969-9aa5-3d70a798f37b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:15.222978 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0c3c8198-27dd-4969-9aa5-3d70a798f37b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1406 microversion: 2.20 time: 0.180601 May 21 21:35:15.223613 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2608/5340] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:15 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:35:15.869558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b3834939-7706-48af-9cf5-9e7012a1660f tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:15.870339 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b3834939-7706-48af-9cf5-9e7012a1660f tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] [instance: 6a1bbc2d-c96b-44ed-9baf-b24b38d3b599] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:15.883075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b3834939-7706-48af-9cf5-9e7012a1660f tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:15.883564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b3834939-7706-48af-9cf5-9e7012a1660f tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:15.884436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b3834939-7706-48af-9cf5-9e7012a1660f tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:15.884885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b3834939-7706-48af-9cf5-9e7012a1660f tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:15.908873 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-b3834939-7706-48af-9cf5-9e7012a1660f tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] HTTP exception thrown: Instance 6a1bbc2d-c96b-44ed-9baf-b24b38d3b599 could not be found. May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b3834939-7706-48af-9cf5-9e7012a1660f tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Request method failure captured: May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/6a1bbc2d-c96b-44ed-9baf-b24b38d3b599 HTTP/1.1 May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVrdDgx5jBuk85IqpgE2zfrbt38p9E5tcBebx_agVhqDuUm94GRpm3WU6UId8T1Da2Bm98ente9HZTmRGs07ra-TWt0lxmXVbEFD0-tRwgYlFK8TMpdA0jNVUhv-ntOrjPtHvLuq2j96F1jsvsAux5ss_wBUq--rdfW5T_tLwkawXWQ May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: X-Openstack-Nova-Api-Version: 2.47 May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 70fa0b97b1b14e058012af12fa705b29 May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerShowV247Test-1218232338 May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/70fa0b97b1b14e058012af12fa705b29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70fa0b97b1b14e058012af12fa705b29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_70fa0b97b1b14e058012af12fa705b29", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70fa0b97b1b14e058012af12fa705b29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerShowV247Test-1218232338 May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 70fa0b97b1b14e058012af12fa705b29 May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerShowV247Test-1218232338 May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerShowV247Test-1218232338-project May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 83eabb990d2b4a1cb3eefb962271d36c May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerShowV247Test-1218232338-project May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 6a1bbc2d-c96b-44ed-9baf-b24b38d3b599 could not be found. May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '6a1bbc2d-c96b-44ed-9baf-b24b38d3b599'} May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a1bbc2d-c96b-44ed-9baf-b24b38d3b599 could not be found. May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a1bbc2d-c96b-44ed-9baf-b24b38d3b599 could not be found. May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:35:15.913607 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:35:15.919510 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:15.919510 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:35:15.919510 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:35:15.919510 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:35:15.919510 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:35:15.919510 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a1bbc2d-c96b-44ed-9baf-b24b38d3b599 could not be found. May 21 21:35:15.919510 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:35:15.919510 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b3834939-7706-48af-9cf5-9e7012a1660f tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] Returning 404 to user: Instance 6a1bbc2d-c96b-44ed-9baf-b24b38d3b599 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:35:15.919510 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b3834939-7706-48af-9cf5-9e7012a1660f tempest-ServerShowV247Test-1218232338 tempest-ServerShowV247Test-1218232338-project] 10.222.0.49 "GET /compute/v2.1/servers/6a1bbc2d-c96b-44ed-9baf-b24b38d3b599" status: 404 len: 111 microversion: 2.47 time: 0.047472 May 21 21:35:15.919510 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2733/5341] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:15 2022] GET /compute/v2.1/servers/6a1bbc2d-c96b-44ed-9baf-b24b38d3b599 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:35:16.242088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-04f61cae-3837-4d17-8c57-a2ca7c3eb338 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:16.242702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-04f61cae-3837-4d17-8c57-a2ca7c3eb338 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:16.247144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:35:16.250610 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04f61cae-3837-4d17-8c57-a2ca7c3eb338 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:16.251061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04f61cae-3837-4d17-8c57-a2ca7c3eb338 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:16.251887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04f61cae-3837-4d17-8c57-a2ca7c3eb338 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:16.252505 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04f61cae-3837-4d17-8c57-a2ca7c3eb338 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:16.504726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-2b063332-cbd6-42d1-9acf-b523bd659dd4 req-4637b9a2-25ce-44d8-bfa1-76376e00bf5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cc5c56-edbc-4588-9912-c07974b1f4e7", "name": "network-vif-plugged", "status": "completed", "tag": "b88a4bf2-b43b-40cf-9426-b3b39cf8f325"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:35:16.514182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2b063332-cbd6-42d1-9acf-b523bd659dd4 req-4637b9a2-25ce-44d8-bfa1-76376e00bf5c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:16.514642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2b063332-cbd6-42d1-9acf-b523bd659dd4 req-4637b9a2-25ce-44d8-bfa1-76376e00bf5c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:16.529190 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-2b063332-cbd6-42d1-9acf-b523bd659dd4 req-4637b9a2-25ce-44d8-bfa1-76376e00bf5c service nova] Creating event network-vif-plugged:b88a4bf2-b43b-40cf-9426-b3b39cf8f325 for instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 on nch2-master-1 May 21 21:35:16.534997 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-2b063332-cbd6-42d1-9acf-b523bd659dd4 req-4637b9a2-25ce-44d8-bfa1-76376e00bf5c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035108 May 21 21:35:16.535712 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2734/5342] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:35:16.786592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:35:16.841881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-04f61cae-3837-4d17-8c57-a2ca7c3eb338 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:16.865654 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-04f61cae-3837-4d17-8c57-a2ca7c3eb338 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:16.865654 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-04f61cae-3837-4d17-8c57-a2ca7c3eb338 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:16.865654 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-04f61cae-3837-4d17-8c57-a2ca7c3eb338 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1406 microversion: 2.20 time: 0.620531 May 21 21:35:16.865654 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2609/5343] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:16 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1406 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:35:17.883736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-85216911-1945-4e33-8825-87d9385db4e1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:17.885060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-85216911-1945-4e33-8825-87d9385db4e1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:17.893040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85216911-1945-4e33-8825-87d9385db4e1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:17.893341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85216911-1945-4e33-8825-87d9385db4e1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:17.894134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85216911-1945-4e33-8825-87d9385db4e1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:17.894576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-85216911-1945-4e33-8825-87d9385db4e1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:18.070260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-85216911-1945-4e33-8825-87d9385db4e1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:18.080649 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-85216911-1945-4e33-8825-87d9385db4e1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:18.082792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-85216911-1945-4e33-8825-87d9385db4e1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:18.084027 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-85216911-1945-4e33-8825-87d9385db4e1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1406 microversion: 2.20 time: 0.207578 May 21 21:35:18.095530 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2735/5344] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:17 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:35:18.999926 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=12 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:35:19.102599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d9938722-88a2-4b5d-a74f-191758105621 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:19.103010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d9938722-88a2-4b5d-a74f-191758105621 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:19.121197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d9938722-88a2-4b5d-a74f-191758105621 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:19.121661 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d9938722-88a2-4b5d-a74f-191758105621 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:19.125127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d9938722-88a2-4b5d-a74f-191758105621 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:19.125585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d9938722-88a2-4b5d-a74f-191758105621 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:19.128551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8bbd5515-ea71-4534-bd0e-2466eb6b3a06 tempest-ExtensionsTest-171582052 tempest-ExtensionsTest-171582052-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:19.130269 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8bbd5515-ea71-4534-bd0e-2466eb6b3a06 tempest-ExtensionsTest-171582052 tempest-ExtensionsTest-171582052-project] 10.222.0.49 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.144425 May 21 21:35:19.130819 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2610/5345] 10.222.0.49 () {58 vars in 1169 bytes} [Sat May 21 21:35:18 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:19.139816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-421d4aab-a789-427b-ae1b-129a2692fcc6 tempest-ExtensionsTest-171582052 tempest-ExtensionsTest-171582052-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:19.142122 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-421d4aab-a789-427b-ae1b-129a2692fcc6 tempest-ExtensionsTest-171582052 tempest-ExtensionsTest-171582052-project] 10.222.0.49 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006052 May 21 21:35:19.143466 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2611/5346] 10.222.0.49 () {58 vars in 1133 bytes} [Sat May 21 21:35:19 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:35:19.293410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d9938722-88a2-4b5d-a74f-191758105621 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:19.303266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d9938722-88a2-4b5d-a74f-191758105621 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:19.305056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d9938722-88a2-4b5d-a74f-191758105621 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:19.306295 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d9938722-88a2-4b5d-a74f-191758105621 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1598 microversion: 2.20 time: 0.207971 May 21 21:35:19.306850 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2736/5347] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:19 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1598 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:35:19.329234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-099714eb-88b5-4d70-90a8-2732a4c83792 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:19.330344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-099714eb-88b5-4d70-90a8-2732a4c83792 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:19.337321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-099714eb-88b5-4d70-90a8-2732a4c83792 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:19.337866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-099714eb-88b5-4d70-90a8-2732a4c83792 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:19.338729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-099714eb-88b5-4d70-90a8-2732a4c83792 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:19.339251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-099714eb-88b5-4d70-90a8-2732a4c83792 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:19.427703 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-099714eb-88b5-4d70-90a8-2732a4c83792 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.102746 May 21 21:35:19.428463 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2612/5348] 10.222.0.49 () {60 vars in 1315 bytes} [Sat May 21 21:35:19 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:35:21.205353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-a195882f-a431-4ff5-992f-ad4ff19a955c req-278770f5-345f-414d-98f7-17289afa4ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7cc5c56-edbc-4588-9912-c07974b1f4e7", "tag": "b88a4bf2-b43b-40cf-9426-b3b39cf8f325"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:35:21.215374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a195882f-a431-4ff5-992f-ad4ff19a955c req-278770f5-345f-414d-98f7-17289afa4ef7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:21.215820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-a195882f-a431-4ff5-992f-ad4ff19a955c req-278770f5-345f-414d-98f7-17289afa4ef7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:21.228872 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-a195882f-a431-4ff5-992f-ad4ff19a955c req-278770f5-345f-414d-98f7-17289afa4ef7 service nova] Creating event network-changed:b88a4bf2-b43b-40cf-9426-b3b39cf8f325 for instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 on nch2-master-1 May 21 21:35:21.234167 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-a195882f-a431-4ff5-992f-ad4ff19a955c req-278770f5-345f-414d-98f7-17289afa4ef7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033085 May 21 21:35:21.235229 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2737/5349] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:22.246859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-099714eb-88b5-4d70-90a8-2732a4c83792 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:22.247852 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-099714eb-88b5-4d70-90a8-2732a4c83792 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001308 May 21 21:35:22.249423 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2613/5350] 10.222.0.49 () {56 vars in 885 bytes} [Sat May 21 21:35:22 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 21 21:35:22.259882 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-a195882f-a431-4ff5-992f-ad4ff19a955c req-278770f5-345f-414d-98f7-17289afa4ef7 service nova] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:22.261109 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-a195882f-a431-4ff5-992f-ad4ff19a955c req-278770f5-345f-414d-98f7-17289afa4ef7 service nova] 10.222.0.49 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002118 May 21 21:35:22.261520 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2738/5351] 10.222.0.49 () {54 vars in 1034 bytes} [Sat May 21 21:35:22 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) May 21 21:35:22.269186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-099714eb-88b5-4d70-90a8-2732a4c83792 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:22.270524 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-099714eb-88b5-4d70-90a8-2732a4c83792 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003121 May 21 21:35:22.271630 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2614/5352] 10.222.0.49 () {54 vars in 1040 bytes} [Sat May 21 21:35:22 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:22.289977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-a195882f-a431-4ff5-992f-ad4ff19a955c req-278770f5-345f-414d-98f7-17289afa4ef7 service nova] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:22.291690 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-a195882f-a431-4ff5-992f-ad4ff19a955c req-278770f5-345f-414d-98f7-17289afa4ef7 service nova] 10.222.0.49 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002092 May 21 21:35:22.292039 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2739/5353] 10.222.0.49 () {56 vars in 885 bytes} [Sat May 21 21:35:22 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 21 21:35:26.227950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-80ba9178-b34a-4fbb-97ab-b9a255a112f6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:26.228472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-80ba9178-b34a-4fbb-97ab-b9a255a112f6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:26.243788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-80ba9178-b34a-4fbb-97ab-b9a255a112f6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:26.244254 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-80ba9178-b34a-4fbb-97ab-b9a255a112f6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:26.247959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-80ba9178-b34a-4fbb-97ab-b9a255a112f6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:26.247959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-80ba9178-b34a-4fbb-97ab-b9a255a112f6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:26.262446 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-80ba9178-b34a-4fbb-97ab-b9a255a112f6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] HTTP exception thrown: Instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 could not be found. May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-80ba9178-b34a-4fbb-97ab-b9a255a112f6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Request method failure captured: May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 HTTP/1.1 May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoHzVV9oy_EU_IYsFGeHTnkJmeTGzL2hOMScY5fxlHdGzMWQlNmx3ok0yXGSd9z2iwg80ZehVP0P56CYfJwVfM_nDvD93NkoExhFShdfIjmz7V2cxd1lVxbL0ZNl4BcIq8yEbgDNERe6ES_QxVWEtoma-h3VIrTk9Hp49olyJDQrfA May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: dbeaf54409d44d0abe3cd6c176fa7ea4 May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-AttachVolumeTestJSON-105426157 May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dbeaf54409d44d0abe3cd6c176fa7ea4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dbeaf54409d44d0abe3cd6c176fa7ea4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dbeaf54409d44d0abe3cd6c176fa7ea4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dbeaf54409d44d0abe3cd6c176fa7ea4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-AttachVolumeTestJSON-105426157 May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: dbeaf54409d44d0abe3cd6c176fa7ea4 May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-AttachVolumeTestJSON-105426157 May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-AttachVolumeTestJSON-105426157-project May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 66b6501f7543485db27a33dd1a1a8400 May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-AttachVolumeTestJSON-105426157-project May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 could not be found. May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '1fdb37d6-723b-4053-81cd-697a6aa334a2'} May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 could not be found. May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:35:26.281511 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:35:26.287703 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 could not be found. May 21 21:35:26.287703 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:26.287703 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:35:26.287703 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:26.287703 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:26.287703 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:35:26.287703 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:35:26.287703 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:35:26.287703 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:35:26.287703 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 could not be found. May 21 21:35:26.287703 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:26.287703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-80ba9178-b34a-4fbb-97ab-b9a255a112f6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Returning 404 to user: Instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:35:26.287703 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-80ba9178-b34a-4fbb-97ab-b9a255a112f6 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 404 len: 111 microversion: 2.1 time: 0.063531 May 21 21:35:26.290480 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2615/5354] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:35:26 2022] DELETE /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:35:26.296853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f266e437-7784-49f2-b952-fdb4a0f0a71b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:26.297642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f266e437-7784-49f2-b952-fdb4a0f0a71b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 1fdb37d6-723b-4053-81cd-697a6aa334a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:26.321659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f266e437-7784-49f2-b952-fdb4a0f0a71b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:26.323435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f266e437-7784-49f2-b952-fdb4a0f0a71b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:26.325601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f266e437-7784-49f2-b952-fdb4a0f0a71b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:26.326262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f266e437-7784-49f2-b952-fdb4a0f0a71b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:26.344975 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-f266e437-7784-49f2-b952-fdb4a0f0a71b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] HTTP exception thrown: Instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 could not be found. May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f266e437-7784-49f2-b952-fdb4a0f0a71b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Request method failure captured: May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 HTTP/1.1 May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoHzVV9oy_EU_IYsFGeHTnkJmeTGzL2hOMScY5fxlHdGzMWQlNmx3ok0yXGSd9z2iwg80ZehVP0P56CYfJwVfM_nDvD93NkoExhFShdfIjmz7V2cxd1lVxbL0ZNl4BcIq8yEbgDNERe6ES_QxVWEtoma-h3VIrTk9Hp49olyJDQrfA May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: dbeaf54409d44d0abe3cd6c176fa7ea4 May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AttachVolumeTestJSON-105426157 May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dbeaf54409d44d0abe3cd6c176fa7ea4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dbeaf54409d44d0abe3cd6c176fa7ea4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dbeaf54409d44d0abe3cd6c176fa7ea4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dbeaf54409d44d0abe3cd6c176fa7ea4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AttachVolumeTestJSON-105426157 May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: dbeaf54409d44d0abe3cd6c176fa7ea4 May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AttachVolumeTestJSON-105426157 May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AttachVolumeTestJSON-105426157-project May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 66b6501f7543485db27a33dd1a1a8400 May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AttachVolumeTestJSON-105426157-project May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 could not be found. May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '1fdb37d6-723b-4053-81cd-697a6aa334a2'} May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 could not be found. May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 could not be found. May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:35:26.346845 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:35:26.351834 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:26.351834 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:35:26.351834 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:35:26.351834 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:35:26.351834 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:35:26.351834 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 could not be found. May 21 21:35:26.351834 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:35:26.351834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f266e437-7784-49f2-b952-fdb4a0f0a71b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Returning 404 to user: Instance 1fdb37d6-723b-4053-81cd-697a6aa334a2 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:35:26.351834 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f266e437-7784-49f2-b952-fdb4a0f0a71b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2" status: 404 len: 111 microversion: 2.1 time: 0.057163 May 21 21:35:26.351834 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2740/5355] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:35:26 2022] GET /compute/v2.1/servers/1fdb37d6-723b-4053-81cd-697a6aa334a2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:35:32.056841 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bbc79074-0113-4f32-9cbe-8fee1281f90b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:32.057473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bbc79074-0113-4f32-9cbe-8fee1281f90b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:32.065096 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bbc79074-0113-4f32-9cbe-8fee1281f90b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:32.065838 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bbc79074-0113-4f32-9cbe-8fee1281f90b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:32.066704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bbc79074-0113-4f32-9cbe-8fee1281f90b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:32.067215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bbc79074-0113-4f32-9cbe-8fee1281f90b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:32.089336 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-bbc79074-0113-4f32-9cbe-8fee1281f90b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] HTTP exception thrown: Instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 could not be found. May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bbc79074-0113-4f32-9cbe-8fee1281f90b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Request method failure captured: May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 HTTP/1.1 May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVoHzVV9oy_EU_IYsFGeHTnkJmeTGzL2hOMScY5fxlHdGzMWQlNmx3ok0yXGSd9z2iwg80ZehVP0P56CYfJwVfM_nDvD93NkoExhFShdfIjmz7V2cxd1lVxbL0ZNl4BcIq8yEbgDNERe6ES_QxVWEtoma-h3VIrTk9Hp49olyJDQrfA May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: dbeaf54409d44d0abe3cd6c176fa7ea4 May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-AttachVolumeTestJSON-105426157 May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dbeaf54409d44d0abe3cd6c176fa7ea4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dbeaf54409d44d0abe3cd6c176fa7ea4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dbeaf54409d44d0abe3cd6c176fa7ea4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dbeaf54409d44d0abe3cd6c176fa7ea4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-AttachVolumeTestJSON-105426157 May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: dbeaf54409d44d0abe3cd6c176fa7ea4 May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-AttachVolumeTestJSON-105426157 May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-AttachVolumeTestJSON-105426157-project May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 66b6501f7543485db27a33dd1a1a8400 May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-AttachVolumeTestJSON-105426157-project May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 could not be found. May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '3f6f2738-3e60-4235-ab67-86ad32c2a384'} May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 could not be found. May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:35:32.091535 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:35:32.098267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 could not be found. May 21 21:35:32.098267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:32.098267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:35:32.098267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:32.098267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:32.098267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:35:32.098267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:35:32.098267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:35:32.098267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:35:32.098267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 could not be found. May 21 21:35:32.098267 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:32.098267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bbc79074-0113-4f32-9cbe-8fee1281f90b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Returning 404 to user: Instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:35:32.098267 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bbc79074-0113-4f32-9cbe-8fee1281f90b tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 404 len: 111 microversion: 2.1 time: 0.040368 May 21 21:35:32.098267 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2616/5356] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:35:32 2022] DELETE /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:35:32.106142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-53851dce-1b27-4d61-8acf-d71b15716435 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:32.106908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-53851dce-1b27-4d61-8acf-d71b15716435 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] [instance: 3f6f2738-3e60-4235-ab67-86ad32c2a384] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:32.120076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53851dce-1b27-4d61-8acf-d71b15716435 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:32.127936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53851dce-1b27-4d61-8acf-d71b15716435 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:32.131887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53851dce-1b27-4d61-8acf-d71b15716435 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:32.136990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53851dce-1b27-4d61-8acf-d71b15716435 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:32.156584 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-53851dce-1b27-4d61-8acf-d71b15716435 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] HTTP exception thrown: Instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 could not be found. May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-53851dce-1b27-4d61-8acf-d71b15716435 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Request method failure captured: May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 HTTP/1.1 May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVoHzVV9oy_EU_IYsFGeHTnkJmeTGzL2hOMScY5fxlHdGzMWQlNmx3ok0yXGSd9z2iwg80ZehVP0P56CYfJwVfM_nDvD93NkoExhFShdfIjmz7V2cxd1lVxbL0ZNl4BcIq8yEbgDNERe6ES_QxVWEtoma-h3VIrTk9Hp49olyJDQrfA May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: dbeaf54409d44d0abe3cd6c176fa7ea4 May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AttachVolumeTestJSON-105426157 May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dbeaf54409d44d0abe3cd6c176fa7ea4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dbeaf54409d44d0abe3cd6c176fa7ea4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dbeaf54409d44d0abe3cd6c176fa7ea4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dbeaf54409d44d0abe3cd6c176fa7ea4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AttachVolumeTestJSON-105426157 May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: dbeaf54409d44d0abe3cd6c176fa7ea4 May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AttachVolumeTestJSON-105426157 May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AttachVolumeTestJSON-105426157-project May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 66b6501f7543485db27a33dd1a1a8400 May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AttachVolumeTestJSON-105426157-project May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 could not be found. May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '3f6f2738-3e60-4235-ab67-86ad32c2a384'} May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 could not be found. May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 could not be found. May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:35:32.160143 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:35:32.176067 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:32.176067 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:35:32.176067 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:35:32.176067 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:35:32.176067 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:35:32.176067 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 could not be found. May 21 21:35:32.176067 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:35:32.176067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-53851dce-1b27-4d61-8acf-d71b15716435 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] Returning 404 to user: Instance 3f6f2738-3e60-4235-ab67-86ad32c2a384 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:35:32.176067 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-53851dce-1b27-4d61-8acf-d71b15716435 tempest-AttachVolumeTestJSON-105426157 tempest-AttachVolumeTestJSON-105426157-project] 10.222.0.49 "GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384" status: 404 len: 111 microversion: 2.1 time: 0.061698 May 21 21:35:32.176067 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2741/5357] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:35:32 2022] GET /compute/v2.1/servers/3f6f2738-3e60-4235-ab67-86ad32c2a384 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:35:44.006331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=7 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:35:44.007251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=29 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:35:44.497901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6872e286-8a4d-4d65-acd8-fb7abba10c4b tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Action: 'create', calling method: .version_select at 0x7fc819e62790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-724773042"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:35:45.363081 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6872e286-8a4d-4d65-acd8-fb7abba10c4b tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 337 microversion: 2.1 time: 1.363705 May 21 21:35:45.364650 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2617/5358] 10.222.0.49 () {60 vars in 1154 bytes} [Sat May 21 21:35:43 2022] POST /compute/v2.1/os-volumes => generated 337 bytes in 1365 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 21 21:35:45.385665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3ac619f8-6555-4902-b70d-1bcfc6aac4dc tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc81a514280>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:45.405447 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:35:45.407853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=47 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:35:45.777332 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3ac619f8-6555-4902-b70d-1bcfc6aac4dc tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718" status: 200 len: 337 microversion: 2.1 time: 0.405508 May 21 21:35:45.778719 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2742/5359] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:35:45 2022] GET /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 => generated 337 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:45.929933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6d8db313-e794-46f6-aadb-c3c0e5c585e4 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-615718096", "availability_zone": "foo_zone"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:35:45.931772 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:35:45.931772 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:35:45.935351 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.aggregate [None req-6d8db313-e794-46f6-aadb-c3c0e5c585e4 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] Generated uuid 458edca6-7a74-4fcc-bdc6-7c0ed3448c3a for aggregate {{(pid=131278) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 21 21:35:46.040359 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6d8db313-e794-46f6-aadb-c3c0e5c585e4 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.181552 May 21 21:35:46.041606 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2618/5360] 10.222.0.49 () {60 vars in 1163 bytes} [Sat May 21 21:35:45 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:46.052653 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-80f9e71f-1925-40e5-b12a-66a31924a3f8 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:35:46.054509 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:35:46.054509 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:35:46.171479 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-80f9e71f-1925-40e5-b12a-66a31924a3f8 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.123807 May 21 21:35:46.173618 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2743/5361] 10.222.0.49 () {60 vars in 1193 bytes} [Sat May 21 21:35:46 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:46.185881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eb11832e-420c-47eb-b2bc-1cdd5ade04b9 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:46.187259 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:35:46.187259 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:35:46.188986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb11832e-420c-47eb-b2bc-1cdd5ade04b9 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:46.189681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb11832e-420c-47eb-b2bc-1cdd5ade04b9 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:46.191296 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb11832e-420c-47eb-b2bc-1cdd5ade04b9 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:46.192136 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb11832e-420c-47eb-b2bc-1cdd5ade04b9 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:46.225395 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-eb11832e-420c-47eb-b2bc-1cdd5ade04b9 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.045170 May 21 21:35:46.226313 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2619/5362] 10.222.0.49 () {58 vars in 1175 bytes} [Sat May 21 21:35:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:46.236811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dbd9c408-db65-415a-bc75-d975c12ece37 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:46.240367 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:35:46.240367 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:35:46.249001 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dbd9c408-db65-415a-bc75-d975c12ece37 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.016406 May 21 21:35:46.257146 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2744/5363] 10.222.0.49 () {58 vars in 1142 bytes} [Sat May 21 21:35:46 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:46.267052 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c782cf3b-8c30-48ab-884a-f6b732c87396 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:35:46.268320 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:35:46.268320 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:35:46.276899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c782cf3b-8c30-48ab-884a-f6b732c87396 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:46.277446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c782cf3b-8c30-48ab-884a-f6b732c87396 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:46.790625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-63cc53e7-572d-45c7-bed2-f3b969de3338 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc81a531e50>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:46.816318 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c782cf3b-8c30-48ab-884a-f6b732c87396 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.553735 May 21 21:35:46.822379 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2620/5364] 10.222.0.49 () {60 vars in 1193 bytes} [Sat May 21 21:35:46 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:46.833616 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2be343b5-9e61-4aed-9537-505bb3e9809e tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:46.834749 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:35:46.834749 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:35:46.844663 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2be343b5-9e61-4aed-9537-505bb3e9809e tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.015965 May 21 21:35:46.854183 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2621/5365] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:35:46 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:46.859005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-159d1aa3-2821-4c00-9efe-8427e7a87568 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1371652938", "availability_zone": "foo_zone"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:35:46.861204 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:35:46.861204 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:35:46.878882 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-63cc53e7-572d-45c7-bed2-f3b969de3338 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718" status: 200 len: 338 microversion: 2.1 time: 0.092158 May 21 21:35:46.881344 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2745/5366] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:35:46 2022] GET /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 => generated 338 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:46.895136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a83081b8-d75c-41af-8f4d-7a6239bc2bd9 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Action: 'create', calling method: .version_select at 0x7fc82d0ceee0>, body: {"snapshot": {"volume_id": "d2ddf5f1-ca93-4d2c-ba9b-0eb432223718", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-107787996"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:35:47.057596 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-159d1aa3-2821-4c00-9efe-8427e7a87568 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.201975 May 21 21:35:47.060077 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2622/5367] 10.222.0.49 () {60 vars in 1172 bytes} [Sat May 21 21:35:46 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:47.076573 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5a8133a1-167e-4f03-853d-bf6aa3f7e210 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:35:47.076573 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:35:47.076573 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:35:47.176392 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5a8133a1-167e-4f03-853d-bf6aa3f7e210 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.109598 May 21 21:35:47.178105 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2623/5368] 10.222.0.49 () {60 vars in 1193 bytes} [Sat May 21 21:35:47 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:47.190457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c48cace3-2630-49ed-a315-aecc6eb783a5 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:47.192164 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:35:47.192164 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:35:47.205061 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c48cace3-2630-49ed-a315-aecc6eb783a5 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.020405 May 21 21:35:47.208023 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2624/5369] 10.222.0.49 () {58 vars in 1151 bytes} [Sat May 21 21:35:47 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:47.219194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a1d1d4aa-a6a8-405b-9690-5efab6379f05 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:35:47.221515 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:35:47.221515 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:35:47.233140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a1d1d4aa-a6a8-405b-9690-5efab6379f05 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:47.234015 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a1d1d4aa-a6a8-405b-9690-5efab6379f05 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:47.576566 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a83081b8-d75c-41af-8f4d-7a6239bc2bd9 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.687598 May 21 21:35:47.582727 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2746/5370] 10.222.0.49 () {60 vars in 1161 bytes} [Sat May 21 21:35:46 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:47.588632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cf110bbd-1e67-4c61-86b8-c29589eea030 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc81b70b040>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:47.591925 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a1d1d4aa-a6a8-405b-9690-5efab6379f05 tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.376993 May 21 21:35:47.593338 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2625/5371] 10.222.0.49 () {60 vars in 1193 bytes} [Sat May 21 21:35:47 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:35:47.618509 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2d12bcb9-dad8-4cc3-b48c-40a241291eaa tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:47.625336 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:35:47.625336 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:35:47.644458 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cf110bbd-1e67-4c61-86b8-c29589eea030 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4c98838a-b181-4285-9fd1-c2dd37e4e352" status: 200 len: 286 microversion: 2.1 time: 0.059816 May 21 21:35:47.647314 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2747/5372] 10.222.0.49 () {58 vars in 1250 bytes} [Sat May 21 21:35:47 2022] GET /compute/v2.1/os-snapshots/4c98838a-b181-4285-9fd1-c2dd37e4e352 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:47.657909 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1c6e7f9d-7cd8-4910-a3b3-43ae13b5d910 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc82d11f1f0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:47.691866 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1c6e7f9d-7cd8-4910-a3b3-43ae13b5d910 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.038354 May 21 21:35:47.692560 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2748/5373] 10.222.0.49 () {58 vars in 1139 bytes} [Sat May 21 21:35:47 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:47.713760 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-92bbc821-0ec0-429d-ab0f-9cbbcf2f89eb tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc81a5a5280>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:47.755903 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-92bbc821-0ec0-429d-ab0f-9cbbcf2f89eb tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4c98838a-b181-4285-9fd1-c2dd37e4e352" status: 200 len: 286 microversion: 2.1 time: 0.054867 May 21 21:35:47.756741 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2749/5374] 10.222.0.49 () {58 vars in 1250 bytes} [Sat May 21 21:35:47 2022] GET /compute/v2.1/os-snapshots/4c98838a-b181-4285-9fd1-c2dd37e4e352 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:47.820615 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2d12bcb9-dad8-4cc3-b48c-40a241291eaa tempest-TestAggregatesBasicOps-179393581 tempest-TestAggregatesBasicOps-179393581-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.201700 May 21 21:35:47.820615 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2626/5375] 10.222.0.49 () {58 vars in 1154 bytes} [Sat May 21 21:35:47 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 21 21:35:48.769147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-38045ad9-3443-40ac-9f81-dac4b8133e38 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc82cfda310>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:48.819955 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-38045ad9-3443-40ac-9f81-dac4b8133e38 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4c98838a-b181-4285-9fd1-c2dd37e4e352" status: 200 len: 286 microversion: 2.1 time: 0.056654 May 21 21:35:48.825316 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2750/5376] 10.222.0.49 () {58 vars in 1250 bytes} [Sat May 21 21:35:48 2022] GET /compute/v2.1/os-snapshots/4c98838a-b181-4285-9fd1-c2dd37e4e352 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:49.839079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c2ddc8e1-fde9-4d7e-83c2-8f6437381958 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc819dc3160>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:49.920912 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c2ddc8e1-fde9-4d7e-83c2-8f6437381958 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4c98838a-b181-4285-9fd1-c2dd37e4e352" status: 200 len: 286 microversion: 2.1 time: 0.093786 May 21 21:35:49.926812 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2627/5377] 10.222.0.49 () {58 vars in 1250 bytes} [Sat May 21 21:35:49 2022] GET /compute/v2.1/os-snapshots/4c98838a-b181-4285-9fd1-c2dd37e4e352 => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:50.938742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-63a4e182-61f7-4c5e-b141-0d9c0b0c30ec tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc81a57e9d0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:51.001617 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-63a4e182-61f7-4c5e-b141-0d9c0b0c30ec tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4c98838a-b181-4285-9fd1-c2dd37e4e352" status: 200 len: 287 microversion: 2.1 time: 0.072493 May 21 21:35:51.009349 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2751/5378] 10.222.0.49 () {58 vars in 1250 bytes} [Sat May 21 21:35:50 2022] GET /compute/v2.1/os-snapshots/4c98838a-b181-4285-9fd1-c2dd37e4e352 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:51.018646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bc047c40-d93d-49d5-a9bc-0eaa17dbe523 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc81ac8f8b0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:51.253363 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bc047c40-d93d-49d5-a9bc-0eaa17dbe523 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/4c98838a-b181-4285-9fd1-c2dd37e4e352" status: 202 len: 0 microversion: 2.1 time: 0.233894 May 21 21:35:51.253363 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2628/5379] 10.222.0.49 () {58 vars in 1253 bytes} [Sat May 21 21:35:51 2022] DELETE /compute/v2.1/os-snapshots/4c98838a-b181-4285-9fd1-c2dd37e4e352 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:35:51.256353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-75c8b54b-4db3-44fa-9be5-38279b652e19 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc82cfa9f70>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:51.292024 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-75c8b54b-4db3-44fa-9be5-38279b652e19 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4c98838a-b181-4285-9fd1-c2dd37e4e352" status: 200 len: 286 microversion: 2.1 time: 0.039782 May 21 21:35:51.298695 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2752/5380] 10.222.0.49 () {58 vars in 1250 bytes} [Sat May 21 21:35:51 2022] GET /compute/v2.1/os-snapshots/4c98838a-b181-4285-9fd1-c2dd37e4e352 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:52.306830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b77d7903-e376-47e9-b89b-edbbaef22719 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc819dc7280>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:52.340753 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b77d7903-e376-47e9-b89b-edbbaef22719 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4c98838a-b181-4285-9fd1-c2dd37e4e352" status: 200 len: 286 microversion: 2.1 time: 0.040565 May 21 21:35:52.341535 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2629/5381] 10.222.0.49 () {58 vars in 1250 bytes} [Sat May 21 21:35:52 2022] GET /compute/v2.1/os-snapshots/4c98838a-b181-4285-9fd1-c2dd37e4e352 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:53.356470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-99a69a1e-2157-410a-9484-41514490a780 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc81a581c10>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:53.411594 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-99a69a1e-2157-410a-9484-41514490a780 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4c98838a-b181-4285-9fd1-c2dd37e4e352" status: 200 len: 286 microversion: 2.1 time: 0.062176 May 21 21:35:53.412734 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2753/5382] 10.222.0.49 () {58 vars in 1250 bytes} [Sat May 21 21:35:53 2022] GET /compute/v2.1/os-snapshots/4c98838a-b181-4285-9fd1-c2dd37e4e352 => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:54.430025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e01c0341-1b3c-45c4-b00e-74b558bf1fb7 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc819e62d30>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:54.479847 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-e01c0341-1b3c-45c4-b00e-74b558bf1fb7 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] HTTP exception thrown: Snapshot 4c98838a-b181-4285-9fd1-c2dd37e4e352 could not be found. May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e01c0341-1b3c-45c4-b00e-74b558bf1fb7 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Request method failure captured: May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-snapshots/4c98838a-b181-4285-9fd1-c2dd37e4e352 HTTP/1.1 May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVsvRdOKHPKsYkI8-daVuxDWqySA4prc5YMpLoQhFJ2ETjt0qWKLdmBTFN0jVHey9L1WLoIVEnyfKmnRX0J23VcLG5aVrtEOvxCdhvNVYT7EtJXd6oVhWCem94vTk7CUo2_cj945fwp8UeYbLE9axcIAo6DwQt7cq0EKGZbHf24uIbk May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: ef6ca19b86d748438ebfd030f2f293e0 May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-782237458 May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ef6ca19b86d748438ebfd030f2f293e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ef6ca19b86d748438ebfd030f2f293e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ef6ca19b86d748438ebfd030f2f293e0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ef6ca19b86d748438ebfd030f2f293e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-VolumesSnapshotsTestJSON-782237458 May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: ef6ca19b86d748438ebfd030f2f293e0 May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-782237458 May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-VolumesSnapshotsTestJSON-782237458-project May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: d5aa01fa55ad4b6b8f7f8d0557273565 May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-VolumesSnapshotsTestJSON-782237458-project May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: exception: Snapshot 4c98838a-b181-4285-9fd1-c2dd37e4e352 could not be found. May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '4c98838a-b181-4285-9fd1-c2dd37e4e352'} May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4c98838a-b181-4285-9fd1-c2dd37e4e352 could not be found. (HTTP 404) (Request-ID: req-20e44a31-e568-43cf-bfb8-30bf03e75d14) May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 21 21:35:54.490182 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4c98838a-b181-4285-9fd1-c2dd37e4e352 could not be found. May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4c98838a-b181-4285-9fd1-c2dd37e4e352 could not be found. May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4c98838a-b181-4285-9fd1-c2dd37e4e352 could not be found. May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:35:54.495538 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e01c0341-1b3c-45c4-b00e-74b558bf1fb7 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Returning 404 to user: Snapshot 4c98838a-b181-4285-9fd1-c2dd37e4e352 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:35:54.503641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-54678bc4-bbef-4868-9626-edc72bb55e3d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:54.503641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-54678bc4-bbef-4868-9626-edc72bb55e3d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:54.504229 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e01c0341-1b3c-45c4-b00e-74b558bf1fb7 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4c98838a-b181-4285-9fd1-c2dd37e4e352" status: 404 len: 111 microversion: 2.1 time: 0.078069 May 21 21:35:54.504229 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2630/5383] 10.222.0.49 () {58 vars in 1250 bytes} [Sat May 21 21:35:54 2022] GET /compute/v2.1/os-snapshots/4c98838a-b181-4285-9fd1-c2dd37e4e352 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:35:54.508217 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54678bc4-bbef-4868-9626-edc72bb55e3d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:54.511589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54678bc4-bbef-4868-9626-edc72bb55e3d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:54.513847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-01da55c1-cda3-4b4e-a4d1-6a3a2a367646 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc819dc34c0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:54.514810 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54678bc4-bbef-4868-9626-edc72bb55e3d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:54.516735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54678bc4-bbef-4868-9626-edc72bb55e3d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:54.583933 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-54678bc4-bbef-4868-9626-edc72bb55e3d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7/ips" status: 200 len: 152 microversion: 2.20 time: 0.092466 May 21 21:35:54.585591 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2754/5384] 10.222.0.49 () {60 vars in 1288 bytes} [Sat May 21 21:35:54 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7/ips => generated 152 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 21 21:35:54.795885 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-01da55c1-cda3-4b4e-a4d1-6a3a2a367646 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718" status: 202 len: 0 microversion: 2.1 time: 0.288104 May 21 21:35:54.796488 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2631/5385] 10.222.0.49 () {58 vars in 1247 bytes} [Sat May 21 21:35:54 2022] DELETE /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:35:54.805961 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b357654a-9a7d-4d61-aeb8-1ed06c4eee42 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc81a581040>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:54.909507 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b357654a-9a7d-4d61-aeb8-1ed06c4eee42 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718" status: 200 len: 337 microversion: 2.1 time: 0.107946 May 21 21:35:54.910221 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2755/5386] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:35:54 2022] GET /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 => generated 337 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:35:55.925095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d6753f6a-ffeb-4f48-b6fc-4ed2df0b4364 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc819dcf310>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:56.014907 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d6753f6a-ffeb-4f48-b6fc-4ed2df0b4364 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718" status: 200 len: 337 microversion: 2.1 time: 0.095967 May 21 21:35:56.016560 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2632/5387] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:35:55 2022] GET /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 => generated 337 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:57.029909 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4ca6113f-6ee1-43f6-b594-06a8dfb9690a tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc81a5a54c0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:57.096083 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4ca6113f-6ee1-43f6-b594-06a8dfb9690a tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718" status: 200 len: 337 microversion: 2.1 time: 0.071158 May 21 21:35:57.098161 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2756/5388] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:35:57 2022] GET /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 => generated 337 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:58.089365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:35:58.091846 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=10 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:35:58.093261 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:35:58.102776 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7a96a911-70b3-485b-8903-dc5796708803 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:35:58.110752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d84402f0-c209-4a1c-a2c2-d528611c05fc tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc81a3e88b0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:58.117616 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7a96a911-70b3-485b-8903-dc5796708803 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:58.129951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7a96a911-70b3-485b-8903-dc5796708803 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:58.131222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7a96a911-70b3-485b-8903-dc5796708803 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:58.131867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7a96a911-70b3-485b-8903-dc5796708803 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:58.132067 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7a96a911-70b3-485b-8903-dc5796708803 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:58.159811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-7a96a911-70b3-485b-8903-dc5796708803 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lazy-loading 'flavor' on Instance uuid b7cc5c56-edbc-4588-9912-c07974b1f4e7 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:35:58.177280 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d84402f0-c209-4a1c-a2c2-d528611c05fc tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718" status: 200 len: 337 microversion: 2.1 time: 0.072169 May 21 21:35:58.178092 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2757/5389] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:35:58 2022] GET /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 => generated 337 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:35:58.922572 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7a96a911-70b3-485b-8903-dc5796708803 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "POST /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7/action" status: 202 len: 0 microversion: 2.20 time: 0.832821 May 21 21:35:58.924060 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2633/5390] 10.222.0.49 () {62 vars in 1318 bytes} [Sat May 21 21:35:58 2022] POST /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7/action => generated 0 bytes in 837 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 21 21:35:58.932102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-078033db-7a83-4496-855e-37e7e6b158c3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:58.932964 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-078033db-7a83-4496-855e-37e7e6b158c3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:35:58.944496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-078033db-7a83-4496-855e-37e7e6b158c3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:58.944952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-078033db-7a83-4496-855e-37e7e6b158c3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:58.946288 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-078033db-7a83-4496-855e-37e7e6b158c3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:35:58.948924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-078033db-7a83-4496-855e-37e7e6b158c3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:35:59.194611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ccaeb507-b7bb-4c72-8000-c0081caed7de tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc819dcf790>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:35:59.248358 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ccaeb507-b7bb-4c72-8000-c0081caed7de tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718" status: 200 len: 337 microversion: 2.1 time: 0.061713 May 21 21:35:59.249541 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2634/5391] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:35:59 2022] GET /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 => generated 337 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:35:59.259264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-078033db-7a83-4496-855e-37e7e6b158c3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:59.270240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-078033db-7a83-4496-855e-37e7e6b158c3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:59.271791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-078033db-7a83-4496-855e-37e7e6b158c3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:35:59.273302 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-078033db-7a83-4496-855e-37e7e6b158c3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1723 microversion: 2.20 time: 0.345213 May 21 21:35:59.273870 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2758/5392] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:35:58 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1723 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:00.264485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a2eaa1a5-2c5b-4657-8e3d-f53329ad6cbd tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc81b568e50>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:00.294061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-469315da-e537-41cc-beb0-0dc11c690d0f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:00.294876 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-469315da-e537-41cc-beb0-0dc11c690d0f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:00.304436 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-a2eaa1a5-2c5b-4657-8e3d-f53329ad6cbd tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] HTTP exception thrown: Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 could not be found. May 21 21:36:00.305046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-469315da-e537-41cc-beb0-0dc11c690d0f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:00.305930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-469315da-e537-41cc-beb0-0dc11c690d0f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a2eaa1a5-2c5b-4657-8e3d-f53329ad6cbd tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Request method failure captured: May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 HTTP/1.1 May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVsvRdOKHPKsYkI8-daVuxDWqySA4prc5YMpLoQhFJ2ETjt0qWKLdmBTFN0jVHey9L1WLoIVEnyfKmnRX0J23VcLG5aVrtEOvxCdhvNVYT7EtJXd6oVhWCem94vTk7CUo2_cj945fwp8UeYbLE9axcIAo6DwQt7cq0EKGZbHf24uIbk May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: ef6ca19b86d748438ebfd030f2f293e0 May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-782237458 May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ef6ca19b86d748438ebfd030f2f293e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ef6ca19b86d748438ebfd030f2f293e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ef6ca19b86d748438ebfd030f2f293e0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ef6ca19b86d748438ebfd030f2f293e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-VolumesSnapshotsTestJSON-782237458 May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: ef6ca19b86d748438ebfd030f2f293e0 May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-782237458 May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-VolumesSnapshotsTestJSON-782237458-project May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: d5aa01fa55ad4b6b8f7f8d0557273565 May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-VolumesSnapshotsTestJSON-782237458-project May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: exception: Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 could not be found. May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'd2ddf5f1-ca93-4d2c-ba9b-0eb432223718'} May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi item = cinderclient( May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 could not be found. (HTTP 404) (Request-ID: req-85d0622f-5618-43ae-9ccd-f42e5e81b174) May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 21 21:36:00.306985 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi item = cinderclient( May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 could not be found. May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 could not be found. May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 could not be found. May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a2eaa1a5-2c5b-4657-8e3d-f53329ad6cbd tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Returning 404 to user: Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a2eaa1a5-2c5b-4657-8e3d-f53329ad6cbd tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718" status: 404 len: 109 microversion: 2.1 time: 0.050326 May 21 21:36:00.311566 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2635/5393] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:36:00 2022] GET /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:36:00.316161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-469315da-e537-41cc-beb0-0dc11c690d0f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:00.316746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-469315da-e537-41cc-beb0-0dc11c690d0f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:00.326412 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1febdd41-5159-451d-b1ef-b1e24b2e4b43 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc819dcf3a0>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:00.363386 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-1febdd41-5159-451d-b1ef-b1e24b2e4b43 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] HTTP exception thrown: Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 could not be found. May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1febdd41-5159-451d-b1ef-b1e24b2e4b43 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Request method failure captured: May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 HTTP/1.1 May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVsvRdOKHPKsYkI8-daVuxDWqySA4prc5YMpLoQhFJ2ETjt0qWKLdmBTFN0jVHey9L1WLoIVEnyfKmnRX0J23VcLG5aVrtEOvxCdhvNVYT7EtJXd6oVhWCem94vTk7CUo2_cj945fwp8UeYbLE9axcIAo6DwQt7cq0EKGZbHf24uIbk May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: ef6ca19b86d748438ebfd030f2f293e0 May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-782237458 May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ef6ca19b86d748438ebfd030f2f293e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ef6ca19b86d748438ebfd030f2f293e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ef6ca19b86d748438ebfd030f2f293e0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ef6ca19b86d748438ebfd030f2f293e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-VolumesSnapshotsTestJSON-782237458 May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: ef6ca19b86d748438ebfd030f2f293e0 May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-782237458 May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-VolumesSnapshotsTestJSON-782237458-project May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: d5aa01fa55ad4b6b8f7f8d0557273565 May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-VolumesSnapshotsTestJSON-782237458-project May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: exception: Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 could not be found. May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'd2ddf5f1-ca93-4d2c-ba9b-0eb432223718'} May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 could not be found. (HTTP 404) (Request-ID: req-87dd1617-faac-42ff-97cd-c8f794e9fbbf) May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 21 21:36:00.366594 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 could not be found. May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 could not be found. May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 could not be found. May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1febdd41-5159-451d-b1ef-b1e24b2e4b43 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Returning 404 to user: Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1febdd41-5159-451d-b1ef-b1e24b2e4b43 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718" status: 404 len: 109 microversion: 2.1 time: 0.052583 May 21 21:36:00.376659 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2636/5394] 10.222.0.49 () {58 vars in 1247 bytes} [Sat May 21 21:36:00 2022] DELETE /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:36:00.383903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-570760da-8058-4721-9158-0b1006260356 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Calling method '.version_select at 0x7fc819dc7700>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:00.418156 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-570760da-8058-4721-9158-0b1006260356 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] HTTP exception thrown: Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 could not be found. May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-570760da-8058-4721-9158-0b1006260356 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Request method failure captured: May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 HTTP/1.1 May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVsvRdOKHPKsYkI8-daVuxDWqySA4prc5YMpLoQhFJ2ETjt0qWKLdmBTFN0jVHey9L1WLoIVEnyfKmnRX0J23VcLG5aVrtEOvxCdhvNVYT7EtJXd6oVhWCem94vTk7CUo2_cj945fwp8UeYbLE9axcIAo6DwQt7cq0EKGZbHf24uIbk May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: ef6ca19b86d748438ebfd030f2f293e0 May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-782237458 May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ef6ca19b86d748438ebfd030f2f293e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ef6ca19b86d748438ebfd030f2f293e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ef6ca19b86d748438ebfd030f2f293e0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ef6ca19b86d748438ebfd030f2f293e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-VolumesSnapshotsTestJSON-782237458 May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: ef6ca19b86d748438ebfd030f2f293e0 May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-782237458 May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-VolumesSnapshotsTestJSON-782237458-project May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: d5aa01fa55ad4b6b8f7f8d0557273565 May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-VolumesSnapshotsTestJSON-782237458-project May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: method: May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: exception: Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 could not be found. May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'd2ddf5f1-ca93-4d2c-ba9b-0eb432223718'} May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi item = cinderclient( May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 could not be found. (HTTP 404) (Request-ID: req-4981a7b5-047c-4f8f-b664-abf40ad2cc69) May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 21 21:36:00.421629 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi item = cinderclient( May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 could not be found. May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 could not be found. May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 could not be found. May 21 21:36:00.428779 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:36:00.436947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-570760da-8058-4721-9158-0b1006260356 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] Returning 404 to user: Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:36:00.436947 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-570760da-8058-4721-9158-0b1006260356 tempest-VolumesSnapshotsTestJSON-782237458 tempest-VolumesSnapshotsTestJSON-782237458-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718" status: 404 len: 109 microversion: 2.1 time: 0.056110 May 21 21:36:00.436947 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2637/5395] 10.222.0.49 () {58 vars in 1244 bytes} [Sat May 21 21:36:00 2022] GET /compute/v2.1/os-volumes/d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:36:00.743779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-469315da-e537-41cc-beb0-0dc11c690d0f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:00.754513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-469315da-e537-41cc-beb0-0dc11c690d0f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:00.756083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-469315da-e537-41cc-beb0-0dc11c690d0f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:00.757305 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-469315da-e537-41cc-beb0-0dc11c690d0f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1723 microversion: 2.20 time: 0.469390 May 21 21:36:00.761113 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2759/5396] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:00 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1723 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:01.777809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b356a38a-8b8c-4977-a006-b33c754bc854 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:01.779514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b356a38a-8b8c-4977-a006-b33c754bc854 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:01.788534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b356a38a-8b8c-4977-a006-b33c754bc854 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:01.789270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b356a38a-8b8c-4977-a006-b33c754bc854 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:01.790361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b356a38a-8b8c-4977-a006-b33c754bc854 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:01.791205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b356a38a-8b8c-4977-a006-b33c754bc854 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:01.975491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b356a38a-8b8c-4977-a006-b33c754bc854 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:01.986755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b356a38a-8b8c-4977-a006-b33c754bc854 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:01.988989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b356a38a-8b8c-4977-a006-b33c754bc854 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:01.991072 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b356a38a-8b8c-4977-a006-b33c754bc854 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1723 microversion: 2.20 time: 0.218945 May 21 21:36:01.993502 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2638/5397] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:01 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:03.010989 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-00907896-bce7-4d4f-8a45-e770d8e81c9c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:03.011622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-00907896-bce7-4d4f-8a45-e770d8e81c9c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:03.024892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00907896-bce7-4d4f-8a45-e770d8e81c9c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:03.025356 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00907896-bce7-4d4f-8a45-e770d8e81c9c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:03.026162 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00907896-bce7-4d4f-8a45-e770d8e81c9c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:03.026611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00907896-bce7-4d4f-8a45-e770d8e81c9c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:03.322104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-00907896-bce7-4d4f-8a45-e770d8e81c9c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:03.330460 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-00907896-bce7-4d4f-8a45-e770d8e81c9c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:03.332350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-00907896-bce7-4d4f-8a45-e770d8e81c9c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:03.335718 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-00907896-bce7-4d4f-8a45-e770d8e81c9c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1723 microversion: 2.20 time: 0.328315 May 21 21:36:03.336639 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2760/5398] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:03 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1723 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:04.357030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1948989b-8d2a-4684-ba8d-655c66f5b2c5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:04.358042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1948989b-8d2a-4684-ba8d-655c66f5b2c5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:04.366059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1948989b-8d2a-4684-ba8d-655c66f5b2c5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:04.366521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1948989b-8d2a-4684-ba8d-655c66f5b2c5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:04.367308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1948989b-8d2a-4684-ba8d-655c66f5b2c5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:04.367752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1948989b-8d2a-4684-ba8d-655c66f5b2c5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:04.522063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1948989b-8d2a-4684-ba8d-655c66f5b2c5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:04.534089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1948989b-8d2a-4684-ba8d-655c66f5b2c5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:04.536168 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1948989b-8d2a-4684-ba8d-655c66f5b2c5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:04.537774 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1948989b-8d2a-4684-ba8d-655c66f5b2c5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1723 microversion: 2.20 time: 0.185257 May 21 21:36:04.538997 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2639/5399] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:04 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:05.559918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9ffae287-4eaa-4e7e-aab8-28e07574d6b2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:05.560551 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9ffae287-4eaa-4e7e-aab8-28e07574d6b2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:05.568531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ffae287-4eaa-4e7e-aab8-28e07574d6b2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:05.568987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ffae287-4eaa-4e7e-aab8-28e07574d6b2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:05.569771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ffae287-4eaa-4e7e-aab8-28e07574d6b2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:05.570203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ffae287-4eaa-4e7e-aab8-28e07574d6b2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:05.879431 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9ffae287-4eaa-4e7e-aab8-28e07574d6b2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:05.887814 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9ffae287-4eaa-4e7e-aab8-28e07574d6b2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:05.889353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9ffae287-4eaa-4e7e-aab8-28e07574d6b2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:05.891635 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9ffae287-4eaa-4e7e-aab8-28e07574d6b2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1723 microversion: 2.20 time: 0.335378 May 21 21:36:05.894459 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2761/5400] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:05 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:06.911708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-42e5deab-58b3-47f3-ae80-ca0bdde91dc5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:06.912532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-42e5deab-58b3-47f3-ae80-ca0bdde91dc5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:06.920525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42e5deab-58b3-47f3-ae80-ca0bdde91dc5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:06.921136 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42e5deab-58b3-47f3-ae80-ca0bdde91dc5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:06.922847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42e5deab-58b3-47f3-ae80-ca0bdde91dc5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:06.923646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42e5deab-58b3-47f3-ae80-ca0bdde91dc5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:07.279866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-42e5deab-58b3-47f3-ae80-ca0bdde91dc5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:07.289148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-42e5deab-58b3-47f3-ae80-ca0bdde91dc5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:07.303672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-42e5deab-58b3-47f3-ae80-ca0bdde91dc5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:07.303672 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-42e5deab-58b3-47f3-ae80-ca0bdde91dc5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1723 microversion: 2.20 time: 0.384796 May 21 21:36:07.303672 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2640/5401] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:06 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1723 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:08.310831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4f43866f-8b86-4984-89cc-1edb6631c4e6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:08.312927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4f43866f-8b86-4984-89cc-1edb6631c4e6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:08.330983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f43866f-8b86-4984-89cc-1edb6631c4e6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:08.331526 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f43866f-8b86-4984-89cc-1edb6631c4e6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:08.333211 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f43866f-8b86-4984-89cc-1edb6631c4e6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:08.333906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f43866f-8b86-4984-89cc-1edb6631c4e6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:08.541120 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4f43866f-8b86-4984-89cc-1edb6631c4e6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:08.553012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4f43866f-8b86-4984-89cc-1edb6631c4e6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:08.555640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4f43866f-8b86-4984-89cc-1edb6631c4e6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:08.557452 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4f43866f-8b86-4984-89cc-1edb6631c4e6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1723 microversion: 2.20 time: 0.250521 May 21 21:36:08.561621 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2762/5402] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:08 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:09.576695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-32017360-9a8f-422e-b018-a8c6be405aad tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:09.578013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-32017360-9a8f-422e-b018-a8c6be405aad tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:09.587313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32017360-9a8f-422e-b018-a8c6be405aad tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:09.588170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32017360-9a8f-422e-b018-a8c6be405aad tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:09.589292 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32017360-9a8f-422e-b018-a8c6be405aad tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:09.590006 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-32017360-9a8f-422e-b018-a8c6be405aad tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:10.068995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-32017360-9a8f-422e-b018-a8c6be405aad tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:10.081187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-32017360-9a8f-422e-b018-a8c6be405aad tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:10.082759 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-32017360-9a8f-422e-b018-a8c6be405aad tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:10.089350 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-32017360-9a8f-422e-b018-a8c6be405aad tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1744 microversion: 2.20 time: 0.512091 May 21 21:36:10.089350 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2641/5403] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:09 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1744 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:11.103646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d931111d-e635-444f-bd6a-72547da39b60 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:11.104217 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d931111d-e635-444f-bd6a-72547da39b60 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:11.112619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d931111d-e635-444f-bd6a-72547da39b60 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:11.113284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d931111d-e635-444f-bd6a-72547da39b60 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:11.114257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d931111d-e635-444f-bd6a-72547da39b60 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:11.114875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d931111d-e635-444f-bd6a-72547da39b60 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:11.418421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d931111d-e635-444f-bd6a-72547da39b60 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:11.427408 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d931111d-e635-444f-bd6a-72547da39b60 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:11.428980 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d931111d-e635-444f-bd6a-72547da39b60 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:11.440811 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d931111d-e635-444f-bd6a-72547da39b60 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1744 microversion: 2.20 time: 0.340933 May 21 21:36:11.451430 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2763/5404] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:11 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1744 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:12.459989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c24cc076-cb74-42a7-8b95-d3d2a0ee12f9 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:12.465660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c24cc076-cb74-42a7-8b95-d3d2a0ee12f9 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:12.470620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c24cc076-cb74-42a7-8b95-d3d2a0ee12f9 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:12.471574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c24cc076-cb74-42a7-8b95-d3d2a0ee12f9 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:12.472676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c24cc076-cb74-42a7-8b95-d3d2a0ee12f9 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:12.473408 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c24cc076-cb74-42a7-8b95-d3d2a0ee12f9 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:13.246522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-ba8bc399-54b2-4e24-8882-47667fa05f87 req-5c79ca8c-fabb-413c-8ae9-f733cb7d09b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cc5c56-edbc-4588-9912-c07974b1f4e7", "name": "network-vif-plugged", "status": "completed", "tag": "b88a4bf2-b43b-40cf-9426-b3b39cf8f325"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:36:13.258870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ba8bc399-54b2-4e24-8882-47667fa05f87 req-5c79ca8c-fabb-413c-8ae9-f733cb7d09b9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:13.259511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ba8bc399-54b2-4e24-8882-47667fa05f87 req-5c79ca8c-fabb-413c-8ae9-f733cb7d09b9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:13.278734 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-ba8bc399-54b2-4e24-8882-47667fa05f87 req-5c79ca8c-fabb-413c-8ae9-f733cb7d09b9 service nova] Creating event network-vif-plugged:b88a4bf2-b43b-40cf-9426-b3b39cf8f325 for instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 on nch2-master-1 May 21 21:36:13.287169 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-ba8bc399-54b2-4e24-8882-47667fa05f87 req-5c79ca8c-fabb-413c-8ae9-f733cb7d09b9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.469557 May 21 21:36:13.288553 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2764/5405] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:36:13.375321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c24cc076-cb74-42a7-8b95-d3d2a0ee12f9 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:13.397651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c24cc076-cb74-42a7-8b95-d3d2a0ee12f9 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:13.402797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c24cc076-cb74-42a7-8b95-d3d2a0ee12f9 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:13.404112 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c24cc076-cb74-42a7-8b95-d3d2a0ee12f9 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1739 microversion: 2.20 time: 0.948547 May 21 21:36:13.407269 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2642/5406] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:12 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1739 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:14.426256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f6e6a921-8f27-40e9-835e-27738fa5b882 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:14.427114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f6e6a921-8f27-40e9-835e-27738fa5b882 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:14.443595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6e6a921-8f27-40e9-835e-27738fa5b882 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:14.444230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6e6a921-8f27-40e9-835e-27738fa5b882 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:14.448673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6e6a921-8f27-40e9-835e-27738fa5b882 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:14.458280 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6e6a921-8f27-40e9-835e-27738fa5b882 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:14.981197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f48a2cad-fd81-4e23-9c1e-1cddcd04c269 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-22811688", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "1d860598-93fb-4b0c-91db-8e15c4e937ad"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:36:15.128603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-f48a2cad-fd81-4e23-9c1e-1cddcd04c269 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] validate_networks() for [('1d860598-93fb-4b0c-91db-8e15c4e937ad', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:36:15.500244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f6e6a921-8f27-40e9-835e-27738fa5b882 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:15.517608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f6e6a921-8f27-40e9-835e-27738fa5b882 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:15.520855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f6e6a921-8f27-40e9-835e-27738fa5b882 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:15.526551 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f6e6a921-8f27-40e9-835e-27738fa5b882 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1739 microversion: 2.20 time: 1.104453 May 21 21:36:15.528651 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2765/5407] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:14 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1739 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:16.131829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f48a2cad-fd81-4e23-9c1e-1cddcd04c269 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:36:16.133063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f48a2cad-fd81-4e23-9c1e-1cddcd04c269 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:36:16.133837 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f48a2cad-fd81-4e23-9c1e-1cddcd04c269 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:36:16.134467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f48a2cad-fd81-4e23-9c1e-1cddcd04c269 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:36:16.135057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f48a2cad-fd81-4e23-9c1e-1cddcd04c269 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:36:16.154305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f48a2cad-fd81-4e23-9c1e-1cddcd04c269 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:16.157303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f48a2cad-fd81-4e23-9c1e-1cddcd04c269 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:16.157303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f48a2cad-fd81-4e23-9c1e-1cddcd04c269 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:16.157303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f48a2cad-fd81-4e23-9c1e-1cddcd04c269 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:16.227699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-f48a2cad-fd81-4e23-9c1e-1cddcd04c269 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Getting quotas for project dadf0c028b4441b0871d6c484ed30418. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:36:16.242140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-f48a2cad-fd81-4e23-9c1e-1cddcd04c269 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Getting quotas for user 991088a86b78431a96c0d4f69035e791 and project dadf0c028b4441b0871d6c484ed30418. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:36:16.288982 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f48a2cad-fd81-4e23-9c1e-1cddcd04c269 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:36:16.301400 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f48a2cad-fd81-4e23-9c1e-1cddcd04c269 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:36:16.481523 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f48a2cad-fd81-4e23-9c1e-1cddcd04c269 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.504254 May 21 21:36:16.490537 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2643/5408] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:36:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:36:16.495240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ec2e5ae9-3107-4485-b295-923cd9e521ac tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:16.496132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ec2e5ae9-3107-4485-b295-923cd9e521ac tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:16.549190 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9ca42a0a-3174-41a4-bb2c-8b2117285a44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:16.553138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9ca42a0a-3174-41a4-bb2c-8b2117285a44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:16.580179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ca42a0a-3174-41a4-bb2c-8b2117285a44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:16.586161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ca42a0a-3174-41a4-bb2c-8b2117285a44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:16.590755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ca42a0a-3174-41a4-bb2c-8b2117285a44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:16.590755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ca42a0a-3174-41a4-bb2c-8b2117285a44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:17.040889 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9ca42a0a-3174-41a4-bb2c-8b2117285a44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:17.054863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9ca42a0a-3174-41a4-bb2c-8b2117285a44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:17.056806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9ca42a0a-3174-41a4-bb2c-8b2117285a44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:17.058401 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9ca42a0a-3174-41a4-bb2c-8b2117285a44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1739 microversion: 2.20 time: 0.515950 May 21 21:36:17.059193 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2644/5409] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:16 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1739 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:17.174122 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ec2e5ae9-3107-4485-b295-923cd9e521ac tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:17.182048 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ec2e5ae9-3107-4485-b295-923cd9e521ac tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 200 len: 1212 microversion: 2.1 time: 0.691093 May 21 21:36:17.183178 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2766/5410] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:16 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 1212 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:36:18.080834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5b4f2173-5c90-4b1e-9db1-9462f0afb5d5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:18.081459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5b4f2173-5c90-4b1e-9db1-9462f0afb5d5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:18.092126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5b4f2173-5c90-4b1e-9db1-9462f0afb5d5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:18.099495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5b4f2173-5c90-4b1e-9db1-9462f0afb5d5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:18.100629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5b4f2173-5c90-4b1e-9db1-9462f0afb5d5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:18.109855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5b4f2173-5c90-4b1e-9db1-9462f0afb5d5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:18.206417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-50ba7c43-94f4-4c5c-8bd4-575c8e0a8dea tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:18.206417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-50ba7c43-94f4-4c5c-8bd4-575c8e0a8dea tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:18.211788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:36:18.381834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-50ba7c43-94f4-4c5c-8bd4-575c8e0a8dea tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:18.391922 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-50ba7c43-94f4-4c5c-8bd4-575c8e0a8dea tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 200 len: 1212 microversion: 2.1 time: 0.194522 May 21 21:36:18.393630 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2767/5411] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:18 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 1212 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:18.635972 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5b4f2173-5c90-4b1e-9db1-9462f0afb5d5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:18.649593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5b4f2173-5c90-4b1e-9db1-9462f0afb5d5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:18.651425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5b4f2173-5c90-4b1e-9db1-9462f0afb5d5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:18.653003 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5b4f2173-5c90-4b1e-9db1-9462f0afb5d5 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1739 microversion: 2.20 time: 0.576492 May 21 21:36:18.666572 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2645/5412] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:18 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1739 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:19.411486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-76aee6ab-8e26-4591-bbfe-3bc74c593fdd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:19.412121 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-76aee6ab-8e26-4591-bbfe-3bc74c593fdd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:19.429914 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-76aee6ab-8e26-4591-bbfe-3bc74c593fdd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:19.431012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-76aee6ab-8e26-4591-bbfe-3bc74c593fdd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:19.432988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-76aee6ab-8e26-4591-bbfe-3bc74c593fdd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:19.434484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-76aee6ab-8e26-4591-bbfe-3bc74c593fdd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:19.491604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=49 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:36:19.673958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e59fbae2-7d79-4da2-8bd5-29b0dcfaa14e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:19.675165 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e59fbae2-7d79-4da2-8bd5-29b0dcfaa14e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:19.691995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e59fbae2-7d79-4da2-8bd5-29b0dcfaa14e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:19.692956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e59fbae2-7d79-4da2-8bd5-29b0dcfaa14e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:19.695987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e59fbae2-7d79-4da2-8bd5-29b0dcfaa14e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:19.696701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e59fbae2-7d79-4da2-8bd5-29b0dcfaa14e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:19.802500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-76aee6ab-8e26-4591-bbfe-3bc74c593fdd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:19.812032 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-76aee6ab-8e26-4591-bbfe-3bc74c593fdd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 200 len: 1264 microversion: 2.1 time: 0.405054 May 21 21:36:19.818330 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2768/5413] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:19 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 1264 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:20.131326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e59fbae2-7d79-4da2-8bd5-29b0dcfaa14e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:20.146924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e59fbae2-7d79-4da2-8bd5-29b0dcfaa14e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:20.149098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e59fbae2-7d79-4da2-8bd5-29b0dcfaa14e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:20.150669 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e59fbae2-7d79-4da2-8bd5-29b0dcfaa14e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1739 microversion: 2.20 time: 0.481834 May 21 21:36:20.162667 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2646/5414] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:19 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1739 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:36:20.834908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fd417413-754a-4c7c-a9e3-e77cbad50a95 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:20.835737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fd417413-754a-4c7c-a9e3-e77cbad50a95 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:20.853974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd417413-754a-4c7c-a9e3-e77cbad50a95 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:20.860118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd417413-754a-4c7c-a9e3-e77cbad50a95 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:20.863820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd417413-754a-4c7c-a9e3-e77cbad50a95 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:20.865303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd417413-754a-4c7c-a9e3-e77cbad50a95 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:21.171438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1068ce91-0550-4f69-a90d-db1f92851f5e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:21.172192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1068ce91-0550-4f69-a90d-db1f92851f5e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:21.195956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1068ce91-0550-4f69-a90d-db1f92851f5e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:21.197347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1068ce91-0550-4f69-a90d-db1f92851f5e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:21.200457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1068ce91-0550-4f69-a90d-db1f92851f5e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:21.210017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1068ce91-0550-4f69-a90d-db1f92851f5e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:21.315832 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fd417413-754a-4c7c-a9e3-e77cbad50a95 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:21.339661 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fd417413-754a-4c7c-a9e3-e77cbad50a95 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 200 len: 1270 microversion: 2.1 time: 0.509005 May 21 21:36:21.362606 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2769/5415] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:20 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 1270 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:21.565565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1068ce91-0550-4f69-a90d-db1f92851f5e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:21.605498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1068ce91-0550-4f69-a90d-db1f92851f5e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:21.614350 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1068ce91-0550-4f69-a90d-db1f92851f5e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:21.618405 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1068ce91-0550-4f69-a90d-db1f92851f5e tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1739 microversion: 2.20 time: 0.452241 May 21 21:36:21.619885 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2647/5416] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:21 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1739 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:36:22.370457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d707228c-3030-4844-85da-a19732d76de1 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:22.371601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d707228c-3030-4844-85da-a19732d76de1 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:22.389853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d707228c-3030-4844-85da-a19732d76de1 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:22.391171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d707228c-3030-4844-85da-a19732d76de1 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:22.395556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d707228c-3030-4844-85da-a19732d76de1 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:22.396244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d707228c-3030-4844-85da-a19732d76de1 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:22.577370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d707228c-3030-4844-85da-a19732d76de1 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:22.589558 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d707228c-3030-4844-85da-a19732d76de1 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 200 len: 1270 microversion: 2.1 time: 0.223990 May 21 21:36:22.590268 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2770/5417] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:22 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 1270 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:22.665658 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-33a4b492-5503-478d-aa27-062fe061193b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:22.678306 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-33a4b492-5503-478d-aa27-062fe061193b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:22.722386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33a4b492-5503-478d-aa27-062fe061193b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:22.733905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33a4b492-5503-478d-aa27-062fe061193b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:22.741174 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33a4b492-5503-478d-aa27-062fe061193b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:22.745063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33a4b492-5503-478d-aa27-062fe061193b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:23.072134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-33a4b492-5503-478d-aa27-062fe061193b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:23.084753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-33a4b492-5503-478d-aa27-062fe061193b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:23.086745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-33a4b492-5503-478d-aa27-062fe061193b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:23.088770 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-33a4b492-5503-478d-aa27-062fe061193b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1739 microversion: 2.20 time: 0.452137 May 21 21:36:23.089838 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2648/5418] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:22 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1739 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:23.607050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1fe40b1d-2244-45e9-a1ee-0188bf63a643 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:23.607815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1fe40b1d-2244-45e9-a1ee-0188bf63a643 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:23.615512 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1fe40b1d-2244-45e9-a1ee-0188bf63a643 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:23.615975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1fe40b1d-2244-45e9-a1ee-0188bf63a643 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:23.616773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1fe40b1d-2244-45e9-a1ee-0188bf63a643 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:23.617396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1fe40b1d-2244-45e9-a1ee-0188bf63a643 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:23.691856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1fe40b1d-2244-45e9-a1ee-0188bf63a643 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:23.700129 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1fe40b1d-2244-45e9-a1ee-0188bf63a643 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 200 len: 1270 microversion: 2.1 time: 0.096930 May 21 21:36:23.700758 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2771/5419] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:23 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:24.110285 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e16a02b1-28d2-46dc-9e10-7f36b1b1c9a4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:24.110682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e16a02b1-28d2-46dc-9e10-7f36b1b1c9a4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:24.123229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e16a02b1-28d2-46dc-9e10-7f36b1b1c9a4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:24.124075 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e16a02b1-28d2-46dc-9e10-7f36b1b1c9a4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:24.125812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e16a02b1-28d2-46dc-9e10-7f36b1b1c9a4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:24.125812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e16a02b1-28d2-46dc-9e10-7f36b1b1c9a4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:24.540981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e16a02b1-28d2-46dc-9e10-7f36b1b1c9a4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:24.551145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e16a02b1-28d2-46dc-9e10-7f36b1b1c9a4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:24.558308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e16a02b1-28d2-46dc-9e10-7f36b1b1c9a4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:24.559988 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e16a02b1-28d2-46dc-9e10-7f36b1b1c9a4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1739 microversion: 2.20 time: 0.455053 May 21 21:36:24.562667 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2649/5420] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:24 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1739 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:24.719013 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d86a396b-5a80-4f18-812a-268f4b74cfb1 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:24.719683 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d86a396b-5a80-4f18-812a-268f4b74cfb1 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:24.735573 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d86a396b-5a80-4f18-812a-268f4b74cfb1 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:24.736660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d86a396b-5a80-4f18-812a-268f4b74cfb1 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:24.738084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d86a396b-5a80-4f18-812a-268f4b74cfb1 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:24.742266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d86a396b-5a80-4f18-812a-268f4b74cfb1 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:25.571418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d86a396b-5a80-4f18-812a-268f4b74cfb1 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:25.590484 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d86a396b-5a80-4f18-812a-268f4b74cfb1 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 200 len: 1312 microversion: 2.1 time: 0.874209 May 21 21:36:25.591132 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2772/5421] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:24 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 1312 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:25.592833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7d6996e5-35e2-4954-b08e-7e595db8938c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:25.594081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7d6996e5-35e2-4954-b08e-7e595db8938c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:25.609331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7d6996e5-35e2-4954-b08e-7e595db8938c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:25.611279 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7d6996e5-35e2-4954-b08e-7e595db8938c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:25.615191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7d6996e5-35e2-4954-b08e-7e595db8938c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:25.616681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7d6996e5-35e2-4954-b08e-7e595db8938c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:25.949855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7d6996e5-35e2-4954-b08e-7e595db8938c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:25.966413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7d6996e5-35e2-4954-b08e-7e595db8938c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:25.971001 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7d6996e5-35e2-4954-b08e-7e595db8938c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:25.976206 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7d6996e5-35e2-4954-b08e-7e595db8938c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1739 microversion: 2.20 time: 0.388618 May 21 21:36:25.988468 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2650/5422] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:25 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1739 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:26.607361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-50b1fa5a-b864-4f3a-92e2-83f576d82396 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:26.608960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-50b1fa5a-b864-4f3a-92e2-83f576d82396 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:26.622691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50b1fa5a-b864-4f3a-92e2-83f576d82396 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:26.624464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50b1fa5a-b864-4f3a-92e2-83f576d82396 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:26.625591 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50b1fa5a-b864-4f3a-92e2-83f576d82396 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:26.626204 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50b1fa5a-b864-4f3a-92e2-83f576d82396 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:26.951934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-ed00d842-cbd9-4015-a2aa-75efb0fd2245 req-8793e489-9867-4a26-ae69-7c387de0a719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7418aa6-4538-48fa-b168-64083d3f381c", "tag": "b64a5bdb-c2e6-40b5-9fa2-b98f3e40a746"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:36:26.963746 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:36:26.966378 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:36:26.971604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ed00d842-cbd9-4015-a2aa-75efb0fd2245 req-8793e489-9867-4a26-ae69-7c387de0a719 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:26.976047 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ed00d842-cbd9-4015-a2aa-75efb0fd2245 req-8793e489-9867-4a26-ae69-7c387de0a719 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:27.022880 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-ed00d842-cbd9-4015-a2aa-75efb0fd2245 req-8793e489-9867-4a26-ae69-7c387de0a719 service nova] Creating event network-changed:b64a5bdb-c2e6-40b5-9fa2-b98f3e40a746 for instance d7418aa6-4538-48fa-b168-64083d3f381c on nch1-master-1 May 21 21:36:27.038669 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-ed00d842-cbd9-4015-a2aa-75efb0fd2245 req-8793e489-9867-4a26-ae69-7c387de0a719 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091502 May 21 21:36:27.039956 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2651/5423] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:36:27.054663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d3b2d665-a896-4177-81fe-4365ea9078b1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:27.056681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d3b2d665-a896-4177-81fe-4365ea9078b1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:27.065998 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3b2d665-a896-4177-81fe-4365ea9078b1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:27.067533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3b2d665-a896-4177-81fe-4365ea9078b1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:27.068653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3b2d665-a896-4177-81fe-4365ea9078b1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:27.075370 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3b2d665-a896-4177-81fe-4365ea9078b1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:27.508211 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-50b1fa5a-b864-4f3a-92e2-83f576d82396 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:27.532005 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-50b1fa5a-b864-4f3a-92e2-83f576d82396 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 200 len: 1312 microversion: 2.1 time: 0.928877 May 21 21:36:27.532656 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2773/5424] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:26 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 1312 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:27.746038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d3b2d665-a896-4177-81fe-4365ea9078b1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:27.754193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:36:27.765625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d3b2d665-a896-4177-81fe-4365ea9078b1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:27.765625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d3b2d665-a896-4177-81fe-4365ea9078b1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:27.765625 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d3b2d665-a896-4177-81fe-4365ea9078b1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1739 microversion: 2.20 time: 0.722649 May 21 21:36:27.765958 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2652/5425] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:27 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1739 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:28.552929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-26ae7add-e59d-48c5-83cd-b3112c9f0e6b tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:28.554232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-26ae7add-e59d-48c5-83cd-b3112c9f0e6b tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:28.563933 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:36:28.565951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-26ae7add-e59d-48c5-83cd-b3112c9f0e6b tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:28.566576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-26ae7add-e59d-48c5-83cd-b3112c9f0e6b tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:28.570201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-26ae7add-e59d-48c5-83cd-b3112c9f0e6b tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:28.570201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-26ae7add-e59d-48c5-83cd-b3112c9f0e6b tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:28.783742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e07ca3ab-54bc-44aa-81d6-e4f56f0e9d41 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:28.784403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e07ca3ab-54bc-44aa-81d6-e4f56f0e9d41 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:28.795339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e07ca3ab-54bc-44aa-81d6-e4f56f0e9d41 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:28.801046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e07ca3ab-54bc-44aa-81d6-e4f56f0e9d41 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:28.805362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e07ca3ab-54bc-44aa-81d6-e4f56f0e9d41 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:28.808417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e07ca3ab-54bc-44aa-81d6-e4f56f0e9d41 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:29.208907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-26ae7add-e59d-48c5-83cd-b3112c9f0e6b tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:29.221886 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-26ae7add-e59d-48c5-83cd-b3112c9f0e6b tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 200 len: 1312 microversion: 2.1 time: 0.676598 May 21 21:36:29.237598 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2774/5426] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:28 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 1312 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:29.239644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e07ca3ab-54bc-44aa-81d6-e4f56f0e9d41 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:29.260419 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e07ca3ab-54bc-44aa-81d6-e4f56f0e9d41 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:29.262865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e07ca3ab-54bc-44aa-81d6-e4f56f0e9d41 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:29.264602 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e07ca3ab-54bc-44aa-81d6-e4f56f0e9d41 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1739 microversion: 2.20 time: 0.484763 May 21 21:36:29.265663 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2653/5427] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:28 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1739 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:36:30.239747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-64f5ce83-d575-4e14-aed5-deba18b40228 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:30.241616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-64f5ce83-d575-4e14-aed5-deba18b40228 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:30.263639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-64f5ce83-d575-4e14-aed5-deba18b40228 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:30.264113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-64f5ce83-d575-4e14-aed5-deba18b40228 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:30.264974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-64f5ce83-d575-4e14-aed5-deba18b40228 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:30.265415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-64f5ce83-d575-4e14-aed5-deba18b40228 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:30.291650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-24bd216e-721e-45d6-b339-672c7644d493 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:30.292453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-24bd216e-721e-45d6-b339-672c7644d493 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:30.317307 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24bd216e-721e-45d6-b339-672c7644d493 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:30.317804 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24bd216e-721e-45d6-b339-672c7644d493 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:30.321876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24bd216e-721e-45d6-b339-672c7644d493 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:30.322624 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24bd216e-721e-45d6-b339-672c7644d493 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:30.547967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-64f5ce83-d575-4e14-aed5-deba18b40228 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:30.555930 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-64f5ce83-d575-4e14-aed5-deba18b40228 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 200 len: 1312 microversion: 2.1 time: 0.320159 May 21 21:36:30.556555 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2775/5428] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:30 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 1312 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:30.630990 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-24bd216e-721e-45d6-b339-672c7644d493 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:30.655998 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-24bd216e-721e-45d6-b339-672c7644d493 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:30.672168 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-24bd216e-721e-45d6-b339-672c7644d493 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:30.686978 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-24bd216e-721e-45d6-b339-672c7644d493 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1739 microversion: 2.20 time: 0.401071 May 21 21:36:30.689390 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2654/5429] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:30 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1739 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:31.578029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b3136b1c-d7de-45cc-9b95-1d9d69b567fe tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:31.578689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b3136b1c-d7de-45cc-9b95-1d9d69b567fe tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:31.603821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b3136b1c-d7de-45cc-9b95-1d9d69b567fe tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:31.604347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b3136b1c-d7de-45cc-9b95-1d9d69b567fe tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:31.605271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b3136b1c-d7de-45cc-9b95-1d9d69b567fe tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:31.605652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b3136b1c-d7de-45cc-9b95-1d9d69b567fe tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:31.715142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5d8dce5c-2bcb-4075-95c9-f625addaa187 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:31.716435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5d8dce5c-2bcb-4075-95c9-f625addaa187 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:31.740100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d8dce5c-2bcb-4075-95c9-f625addaa187 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:31.744185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d8dce5c-2bcb-4075-95c9-f625addaa187 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:31.749386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d8dce5c-2bcb-4075-95c9-f625addaa187 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:31.749877 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d8dce5c-2bcb-4075-95c9-f625addaa187 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:32.136975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5d8dce5c-2bcb-4075-95c9-f625addaa187 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:32.148800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5d8dce5c-2bcb-4075-95c9-f625addaa187 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:32.154147 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5d8dce5c-2bcb-4075-95c9-f625addaa187 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:32.156232 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5d8dce5c-2bcb-4075-95c9-f625addaa187 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1739 microversion: 2.20 time: 0.445087 May 21 21:36:32.167223 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2655/5430] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:31 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1739 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:36:32.217587 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b3136b1c-d7de-45cc-9b95-1d9d69b567fe tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:32.228873 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b3136b1c-d7de-45cc-9b95-1d9d69b567fe tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 200 len: 1312 microversion: 2.1 time: 0.655683 May 21 21:36:32.229745 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2776/5431] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:31 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 1312 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:33.175795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1ae42ea4-f30d-4a1d-a816-85ff50b17e40 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:33.176560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1ae42ea4-f30d-4a1d-a816-85ff50b17e40 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:33.189389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ae42ea4-f30d-4a1d-a816-85ff50b17e40 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:33.189851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ae42ea4-f30d-4a1d-a816-85ff50b17e40 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:33.196420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ae42ea4-f30d-4a1d-a816-85ff50b17e40 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:33.197267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ae42ea4-f30d-4a1d-a816-85ff50b17e40 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:33.252048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-06270177-996c-4e3a-bb95-b371006e702d tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:33.263323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-06270177-996c-4e3a-bb95-b371006e702d tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:33.270448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06270177-996c-4e3a-bb95-b371006e702d tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:33.275577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06270177-996c-4e3a-bb95-b371006e702d tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:33.278445 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06270177-996c-4e3a-bb95-b371006e702d tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:33.280758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06270177-996c-4e3a-bb95-b371006e702d tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:33.718386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1ae42ea4-f30d-4a1d-a816-85ff50b17e40 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:33.729605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1ae42ea4-f30d-4a1d-a816-85ff50b17e40 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:33.731174 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1ae42ea4-f30d-4a1d-a816-85ff50b17e40 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:33.738845 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1ae42ea4-f30d-4a1d-a816-85ff50b17e40 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1721 microversion: 2.20 time: 0.567084 May 21 21:36:33.743924 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2656/5432] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:33 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1721 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:34.089515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-06270177-996c-4e3a-bb95-b371006e702d tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:34.108371 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-06270177-996c-4e3a-bb95-b371006e702d tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 200 len: 1312 microversion: 2.1 time: 0.855150 May 21 21:36:34.109119 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2777/5433] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:33 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 1312 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:36:34.759605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cebf8298-e513-4002-9194-843754c66ed4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:34.760229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cebf8298-e513-4002-9194-843754c66ed4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:34.763129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:36:34.779994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cebf8298-e513-4002-9194-843754c66ed4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:34.780492 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cebf8298-e513-4002-9194-843754c66ed4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:34.781453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cebf8298-e513-4002-9194-843754c66ed4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:34.781909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cebf8298-e513-4002-9194-843754c66ed4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:34.970804 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cebf8298-e513-4002-9194-843754c66ed4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:34.985195 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cebf8298-e513-4002-9194-843754c66ed4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:34.987785 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cebf8298-e513-4002-9194-843754c66ed4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:34.989043 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cebf8298-e513-4002-9194-843754c66ed4 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1721 microversion: 2.20 time: 0.234281 May 21 21:36:34.990312 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2657/5434] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:34 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:35.131417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b49792ec-b98f-40bc-96e3-60fc6459bf9e tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:35.132956 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b49792ec-b98f-40bc-96e3-60fc6459bf9e tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:35.149812 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b49792ec-b98f-40bc-96e3-60fc6459bf9e tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:35.150767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b49792ec-b98f-40bc-96e3-60fc6459bf9e tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:35.152436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b49792ec-b98f-40bc-96e3-60fc6459bf9e tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:35.152886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b49792ec-b98f-40bc-96e3-60fc6459bf9e tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:35.670126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b49792ec-b98f-40bc-96e3-60fc6459bf9e tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:35.705305 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b49792ec-b98f-40bc-96e3-60fc6459bf9e tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 200 len: 1312 microversion: 2.1 time: 0.583491 May 21 21:36:35.719461 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2778/5435] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:35 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 1312 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:36.010438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0eca0544-71d5-4988-8c18-35ddc81b9b44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:36.010438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0eca0544-71d5-4988-8c18-35ddc81b9b44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:36.024202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0eca0544-71d5-4988-8c18-35ddc81b9b44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:36.024702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0eca0544-71d5-4988-8c18-35ddc81b9b44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:36.025517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0eca0544-71d5-4988-8c18-35ddc81b9b44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:36.026050 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0eca0544-71d5-4988-8c18-35ddc81b9b44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:36.735597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-774e0e15-8fed-4d34-bfb0-7acce7aefa70 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:36.738420 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-774e0e15-8fed-4d34-bfb0-7acce7aefa70 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:36.765442 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-774e0e15-8fed-4d34-bfb0-7acce7aefa70 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:36.775864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0eca0544-71d5-4988-8c18-35ddc81b9b44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:36.796576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-774e0e15-8fed-4d34-bfb0-7acce7aefa70 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:36.803302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-774e0e15-8fed-4d34-bfb0-7acce7aefa70 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:36.803792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-774e0e15-8fed-4d34-bfb0-7acce7aefa70 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:36.808769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0eca0544-71d5-4988-8c18-35ddc81b9b44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:36.830293 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0eca0544-71d5-4988-8c18-35ddc81b9b44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:36.831559 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0eca0544-71d5-4988-8c18-35ddc81b9b44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1721 microversion: 2.20 time: 0.827199 May 21 21:36:36.832356 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2658/5436] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:36 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1721 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:37.037370 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-48b6ae60-751c-41e6-b279-db483f8ec84b req-855e20d9-dfda-457e-8ff1-67ccb37e0c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cc5c56-edbc-4588-9912-c07974b1f4e7", "name": "network-vif-unplugged", "status": "completed", "tag": "b88a4bf2-b43b-40cf-9426-b3b39cf8f325"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:36:37.074602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-48b6ae60-751c-41e6-b279-db483f8ec84b req-855e20d9-dfda-457e-8ff1-67ccb37e0c07 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:37.077615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-48b6ae60-751c-41e6-b279-db483f8ec84b req-855e20d9-dfda-457e-8ff1-67ccb37e0c07 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:37.122666 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-48b6ae60-751c-41e6-b279-db483f8ec84b req-855e20d9-dfda-457e-8ff1-67ccb37e0c07 service nova] Creating event network-vif-unplugged:b88a4bf2-b43b-40cf-9426-b3b39cf8f325 for instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 on nch2-master-1 May 21 21:36:37.146258 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-48b6ae60-751c-41e6-b279-db483f8ec84b req-855e20d9-dfda-457e-8ff1-67ccb37e0c07 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114257 May 21 21:36:37.151251 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2659/5437] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:36:37.413947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-774e0e15-8fed-4d34-bfb0-7acce7aefa70 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:37.426207 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-774e0e15-8fed-4d34-bfb0-7acce7aefa70 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 200 len: 1312 microversion: 2.1 time: 0.701789 May 21 21:36:37.437266 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2779/5438] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:36 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 1312 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:37.853062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ea3ca896-a111-4b77-a423-680ba335de87 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:37.853826 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ea3ca896-a111-4b77-a423-680ba335de87 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:37.867414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ea3ca896-a111-4b77-a423-680ba335de87 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:37.875159 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ea3ca896-a111-4b77-a423-680ba335de87 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:37.875159 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ea3ca896-a111-4b77-a423-680ba335de87 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:37.875159 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ea3ca896-a111-4b77-a423-680ba335de87 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:38.455616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-55794da6-6666-4a4c-93fe-6daeff40b2ce tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:38.455616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-55794da6-6666-4a4c-93fe-6daeff40b2ce tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:38.467543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-55794da6-6666-4a4c-93fe-6daeff40b2ce tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:38.468046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-55794da6-6666-4a4c-93fe-6daeff40b2ce tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:38.468868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-55794da6-6666-4a4c-93fe-6daeff40b2ce tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:38.469304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-55794da6-6666-4a4c-93fe-6daeff40b2ce tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:38.599197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ea3ca896-a111-4b77-a423-680ba335de87 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:38.625659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ea3ca896-a111-4b77-a423-680ba335de87 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:38.647351 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ea3ca896-a111-4b77-a423-680ba335de87 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:38.649060 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ea3ca896-a111-4b77-a423-680ba335de87 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1664 microversion: 2.20 time: 0.801722 May 21 21:36:38.650626 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2660/5439] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:37 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1664 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:38.684303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a4b8e63b-cb57-4c5d-8e9f-6ebeb8005a3a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "864c40b1-6204-4590-b0ce-4ef445d07347"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:36:38.686243 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a4b8e63b-cb57-4c5d-8e9f-6ebeb8005a3a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:38.697518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4b8e63b-cb57-4c5d-8e9f-6ebeb8005a3a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:38.698153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4b8e63b-cb57-4c5d-8e9f-6ebeb8005a3a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:38.699306 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4b8e63b-cb57-4c5d-8e9f-6ebeb8005a3a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:38.700455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4b8e63b-cb57-4c5d-8e9f-6ebeb8005a3a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:39.124541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-55794da6-6666-4a4c-93fe-6daeff40b2ce tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:39.136497 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-55794da6-6666-4a4c-93fe-6daeff40b2ce tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 200 len: 1312 microversion: 2.1 time: 0.695734 May 21 21:36:39.148884 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2780/5440] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:38 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 1312 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:36:39.360975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-8ee9ea29-5ea4-4b66-8f61-4fe420c44cd5 req-659f3a23-7f06-435a-8aae-83637cec431d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7418aa6-4538-48fa-b168-64083d3f381c", "name": "network-vif-plugged", "status": "completed", "tag": "b64a5bdb-c2e6-40b5-9fa2-b98f3e40a746"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:36:39.386820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8ee9ea29-5ea4-4b66-8f61-4fe420c44cd5 req-659f3a23-7f06-435a-8aae-83637cec431d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:39.387399 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8ee9ea29-5ea4-4b66-8f61-4fe420c44cd5 req-659f3a23-7f06-435a-8aae-83637cec431d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:39.424318 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-8ee9ea29-5ea4-4b66-8f61-4fe420c44cd5 req-659f3a23-7f06-435a-8aae-83637cec431d service nova] Creating event network-vif-plugged:b64a5bdb-c2e6-40b5-9fa2-b98f3e40a746 for instance d7418aa6-4538-48fa-b168-64083d3f381c on nch1-master-1 May 21 21:36:39.443255 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-8ee9ea29-5ea4-4b66-8f61-4fe420c44cd5 req-659f3a23-7f06-435a-8aae-83637cec431d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096004 May 21 21:36:39.459114 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2781/5441] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:36:40.157018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-654a5e7a-b41e-488f-bbba-ab6ed6c5dafd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:40.158170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-654a5e7a-b41e-488f-bbba-ab6ed6c5dafd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:40.169970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-654a5e7a-b41e-488f-bbba-ab6ed6c5dafd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:40.170233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-654a5e7a-b41e-488f-bbba-ab6ed6c5dafd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:40.171386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-654a5e7a-b41e-488f-bbba-ab6ed6c5dafd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:40.172007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-654a5e7a-b41e-488f-bbba-ab6ed6c5dafd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:40.239446 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a4b8e63b-cb57-4c5d-8e9f-6ebeb8005a3a tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "POST /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.559491 May 21 21:36:40.239971 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2661/5442] 10.222.0.49 () {62 vars in 1363 bytes} [Sat May 21 21:36:38 2022] POST /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7/os-volume_attachments => generated 188 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:36:40.443841 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f28e3bdb-0a79-42b3-9b52-599ae0c5b38b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:40.445290 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f28e3bdb-0a79-42b3-9b52-599ae0c5b38b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:40.457598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f28e3bdb-0a79-42b3-9b52-599ae0c5b38b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:40.457848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f28e3bdb-0a79-42b3-9b52-599ae0c5b38b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:40.461890 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f28e3bdb-0a79-42b3-9b52-599ae0c5b38b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:40.462337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f28e3bdb-0a79-42b3-9b52-599ae0c5b38b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:40.750801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-654a5e7a-b41e-488f-bbba-ab6ed6c5dafd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:40.758970 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-654a5e7a-b41e-488f-bbba-ab6ed6c5dafd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 200 len: 1312 microversion: 2.1 time: 0.607929 May 21 21:36:40.759972 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2782/5443] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:40 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 1312 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:41.398179 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f28e3bdb-0a79-42b3-9b52-599ae0c5b38b tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7/os-volume_attachments/864c40b1-6204-4590-b0ce-4ef445d07347" status: 202 len: 0 microversion: 2.20 time: 0.957995 May 21 21:36:41.398645 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2662/5444] 10.222.0.49 () {60 vars in 1456 bytes} [Sat May 21 21:36:40 2022] DELETE /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7/os-volume_attachments/864c40b1-6204-4590-b0ce-4ef445d07347 => generated 0 bytes in 959 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 21 21:36:41.536017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-79b1bebf-61d7-4cd4-b90a-ae31b1ea31a3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:36:41.536821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-79b1bebf-61d7-4cd4-b90a-ae31b1ea31a3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:41.548395 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-79b1bebf-61d7-4cd4-b90a-ae31b1ea31a3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:41.550987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-79b1bebf-61d7-4cd4-b90a-ae31b1ea31a3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:41.550987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-79b1bebf-61d7-4cd4-b90a-ae31b1ea31a3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:41.550987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-79b1bebf-61d7-4cd4-b90a-ae31b1ea31a3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:41.664257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e4e47674-b651-4afe-b8df-9a188717cbbc tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:41.665610 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:36:41.665610 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:36:41.667044 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e4e47674-b651-4afe-b8df-9a188717cbbc tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:41.667807 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e4e47674-b651-4afe-b8df-9a188717cbbc tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:41.668888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e4e47674-b651-4afe-b8df-9a188717cbbc tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:41.669629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e4e47674-b651-4afe-b8df-9a188717cbbc tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:41.723520 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e4e47674-b651-4afe-b8df-9a188717cbbc tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.253884 May 21 21:36:41.725660 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2783/5445] 10.222.0.49 () {58 vars in 1184 bytes} [Sat May 21 21:36:41 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:36:41.776783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2a355528-3ddc-4c7c-8bce-bcf90101d483 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:41.777404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2a355528-3ddc-4c7c-8bce-bcf90101d483 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:41.796658 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a355528-3ddc-4c7c-8bce-bcf90101d483 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:41.797495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a355528-3ddc-4c7c-8bce-bcf90101d483 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:41.799289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a355528-3ddc-4c7c-8bce-bcf90101d483 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:41.799955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a355528-3ddc-4c7c-8bce-bcf90101d483 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:41.879529 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-79b1bebf-61d7-4cd4-b90a-ae31b1ea31a3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "POST /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7/action" status: 202 len: 0 microversion: 2.20 time: 0.347794 May 21 21:36:41.884029 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2663/5446] 10.222.0.49 () {62 vars in 1318 bytes} [Sat May 21 21:36:41 2022] POST /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 21 21:36:41.896905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1ccf09b0-5f8f-4541-bd68-5300f73afeeb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:41.900180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1ccf09b0-5f8f-4541-bd68-5300f73afeeb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:41.920226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ccf09b0-5f8f-4541-bd68-5300f73afeeb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:41.920768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ccf09b0-5f8f-4541-bd68-5300f73afeeb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:41.929055 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ccf09b0-5f8f-4541-bd68-5300f73afeeb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:41.929055 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1ccf09b0-5f8f-4541-bd68-5300f73afeeb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:42.005476 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:36:42.075978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2a355528-3ddc-4c7c-8bce-bcf90101d483 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:42.085995 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2a355528-3ddc-4c7c-8bce-bcf90101d483 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 200 len: 1496 microversion: 2.1 time: 0.313497 May 21 21:36:42.102446 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2784/5447] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:41 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 1496 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:42.112554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9ac954a5-59ab-4d88-bb8f-f7c54ce7aed0 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1169579295", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "f3f457f4-8bd7-4376-b341-2bbbed0f371a"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:36:42.205887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-9ac954a5-59ab-4d88-bb8f-f7c54ce7aed0 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] validate_networks() for [('f3f457f4-8bd7-4376-b341-2bbbed0f371a', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:36:42.260642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1ccf09b0-5f8f-4541-bd68-5300f73afeeb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:42.272658 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1ccf09b0-5f8f-4541-bd68-5300f73afeeb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:42.278297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1ccf09b0-5f8f-4541-bd68-5300f73afeeb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:42.278297 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1ccf09b0-5f8f-4541-bd68-5300f73afeeb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1672 microversion: 2.20 time: 0.387847 May 21 21:36:42.291107 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2664/5448] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:41 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1672 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:42.965548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-9ac954a5-59ab-4d88-bb8f-f7c54ce7aed0 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:36:42.966603 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-9ac954a5-59ab-4d88-bb8f-f7c54ce7aed0 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:36:42.967547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-9ac954a5-59ab-4d88-bb8f-f7c54ce7aed0 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:36:42.967974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-9ac954a5-59ab-4d88-bb8f-f7c54ce7aed0 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:36:42.968451 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-9ac954a5-59ab-4d88-bb8f-f7c54ce7aed0 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:36:42.987307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ac954a5-59ab-4d88-bb8f-f7c54ce7aed0 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:42.987887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ac954a5-59ab-4d88-bb8f-f7c54ce7aed0 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:42.989323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ac954a5-59ab-4d88-bb8f-f7c54ce7aed0 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:42.989932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ac954a5-59ab-4d88-bb8f-f7c54ce7aed0 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:43.015499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-9ac954a5-59ab-4d88-bb8f-f7c54ce7aed0 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Getting quotas for project ee4ecc5a231c4c9ea359633525a20502. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:36:43.023780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-9ac954a5-59ab-4d88-bb8f-f7c54ce7aed0 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Getting quotas for user 9cd1068bb25d4b8da52490826a11eeba and project ee4ecc5a231c4c9ea359633525a20502. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:36:43.042907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9ac954a5-59ab-4d88-bb8f-f7c54ce7aed0 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:36:43.046809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9ac954a5-59ab-4d88-bb8f-f7c54ce7aed0 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:36:43.220335 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9ac954a5-59ab-4d88-bb8f-f7c54ce7aed0 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.112608 May 21 21:36:43.221063 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2785/5449] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:36:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:36:43.241280 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6dd5495a-acd7-4fb3-aa92-c3df077e9845 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:43.241280 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6dd5495a-acd7-4fb3-aa92-c3df077e9845 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:43.299427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-67f8994d-1124-40a2-9d25-ff89a98cf111 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:43.300379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-67f8994d-1124-40a2-9d25-ff89a98cf111 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:43.314130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67f8994d-1124-40a2-9d25-ff89a98cf111 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:43.314994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67f8994d-1124-40a2-9d25-ff89a98cf111 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:43.316024 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67f8994d-1124-40a2-9d25-ff89a98cf111 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:43.319890 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67f8994d-1124-40a2-9d25-ff89a98cf111 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:43.364956 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6dd5495a-acd7-4fb3-aa92-c3df077e9845 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1329 microversion: 2.1 time: 0.137385 May 21 21:36:43.365879 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2665/5450] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:43 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1329 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:43.499761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a3df060d-9e2a-495a-b5c7-88bfceb87733 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:43.500700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a3df060d-9e2a-495a-b5c7-88bfceb87733 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:43.549221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3df060d-9e2a-495a-b5c7-88bfceb87733 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:43.549221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3df060d-9e2a-495a-b5c7-88bfceb87733 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:43.553026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3df060d-9e2a-495a-b5c7-88bfceb87733 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:43.554063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3df060d-9e2a-495a-b5c7-88bfceb87733 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:43.648091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a3df060d-9e2a-495a-b5c7-88bfceb87733 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:36:43.690249 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-67f8994d-1124-40a2-9d25-ff89a98cf111 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:43.694756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:36:43.702957 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-67f8994d-1124-40a2-9d25-ff89a98cf111 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:43.705541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-67f8994d-1124-40a2-9d25-ff89a98cf111 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:43.707277 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-67f8994d-1124-40a2-9d25-ff89a98cf111 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1672 microversion: 2.20 time: 0.412409 May 21 21:36:43.708752 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2786/5451] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:43 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1672 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:36:44.198536 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a3df060d-9e2a-495a-b5c7-88bfceb87733 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 204 len: 0 microversion: 2.1 time: 0.704292 May 21 21:36:44.201779 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2666/5452] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:36:43 2022] DELETE /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 0 bytes in 709 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 21:36:44.210275 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7bf519da-2779-44b7-abb7-e323fb186eea tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:44.213939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7bf519da-2779-44b7-abb7-e323fb186eea tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:44.222491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7bf519da-2779-44b7-abb7-e323fb186eea tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:44.225522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7bf519da-2779-44b7-abb7-e323fb186eea tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:44.226573 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7bf519da-2779-44b7-abb7-e323fb186eea tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:44.227198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7bf519da-2779-44b7-abb7-e323fb186eea tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:44.395048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1ed9804c-4225-4ced-b08e-a5e853cb871f tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:44.397732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1ed9804c-4225-4ced-b08e-a5e853cb871f tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:44.455167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7bf519da-2779-44b7-abb7-e323fb186eea tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:44.463895 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7bf519da-2779-44b7-abb7-e323fb186eea tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 200 len: 1502 microversion: 2.1 time: 0.257684 May 21 21:36:44.476097 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2787/5453] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:44 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 1502 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:44.480421 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1ed9804c-4225-4ced-b08e-a5e853cb871f tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1329 microversion: 2.1 time: 0.092880 May 21 21:36:44.481010 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2667/5454] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:44 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1329 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:44.729714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f768cb12-3623-478f-a52b-cf3313a44539 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:44.730273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f768cb12-3623-478f-a52b-cf3313a44539 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:44.746056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f768cb12-3623-478f-a52b-cf3313a44539 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:44.746552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f768cb12-3623-478f-a52b-cf3313a44539 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:44.747954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f768cb12-3623-478f-a52b-cf3313a44539 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:44.753166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f768cb12-3623-478f-a52b-cf3313a44539 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:45.029908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f768cb12-3623-478f-a52b-cf3313a44539 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:45.041558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f768cb12-3623-478f-a52b-cf3313a44539 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:45.045485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f768cb12-3623-478f-a52b-cf3313a44539 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:45.048904 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f768cb12-3623-478f-a52b-cf3313a44539 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1730 microversion: 2.20 time: 0.322506 May 21 21:36:45.051480 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2788/5455] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:44 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1730 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:45.481822 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dbe1870b-938d-4abd-8cdd-fbb0123259bd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:45.483011 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dbe1870b-938d-4abd-8cdd-fbb0123259bd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:45.495772 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbe1870b-938d-4abd-8cdd-fbb0123259bd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:45.499855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-86289f98-037c-41a6-bcc1-3b424ad30771 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:45.501480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-86289f98-037c-41a6-bcc1-3b424ad30771 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:45.502679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbe1870b-938d-4abd-8cdd-fbb0123259bd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:45.503538 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbe1870b-938d-4abd-8cdd-fbb0123259bd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:45.506199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbe1870b-938d-4abd-8cdd-fbb0123259bd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:45.514765 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86289f98-037c-41a6-bcc1-3b424ad30771 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:45.524850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86289f98-037c-41a6-bcc1-3b424ad30771 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:45.532910 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86289f98-037c-41a6-bcc1-3b424ad30771 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:45.534171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86289f98-037c-41a6-bcc1-3b424ad30771 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:45.773474 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-86289f98-037c-41a6-bcc1-3b424ad30771 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1346 microversion: 2.1 time: 0.275576 May 21 21:36:45.774726 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2789/5456] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:45 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1346 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:46.074962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dbe1870b-938d-4abd-8cdd-fbb0123259bd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:46.081640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f3d2b341-68d3-459e-96e4-8ab439dbfb54 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:46.081640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f3d2b341-68d3-459e-96e4-8ab439dbfb54 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:46.092571 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dbe1870b-938d-4abd-8cdd-fbb0123259bd tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 200 len: 1502 microversion: 2.1 time: 0.609483 May 21 21:36:46.105561 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2668/5457] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:45 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 1502 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:46.109780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3d2b341-68d3-459e-96e4-8ab439dbfb54 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:46.110914 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3d2b341-68d3-459e-96e4-8ab439dbfb54 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:46.112680 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3d2b341-68d3-459e-96e4-8ab439dbfb54 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:46.114827 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3d2b341-68d3-459e-96e4-8ab439dbfb54 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:46.758842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f3d2b341-68d3-459e-96e4-8ab439dbfb54 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:46.781202 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f3d2b341-68d3-459e-96e4-8ab439dbfb54 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:46.783254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f3d2b341-68d3-459e-96e4-8ab439dbfb54 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:46.784682 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f3d2b341-68d3-459e-96e4-8ab439dbfb54 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1730 microversion: 2.20 time: 0.719002 May 21 21:36:46.791394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-172957b6-ccb3-4c0f-a05f-7ab085f1d807 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:46.793304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-172957b6-ccb3-4c0f-a05f-7ab085f1d807 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:46.804919 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2790/5458] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:46 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1730 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:36:46.820874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-172957b6-ccb3-4c0f-a05f-7ab085f1d807 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:46.821490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-172957b6-ccb3-4c0f-a05f-7ab085f1d807 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:46.823930 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-172957b6-ccb3-4c0f-a05f-7ab085f1d807 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:46.824619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-172957b6-ccb3-4c0f-a05f-7ab085f1d807 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:47.035173 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-172957b6-ccb3-4c0f-a05f-7ab085f1d807 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1424 microversion: 2.1 time: 0.247639 May 21 21:36:47.036443 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2669/5459] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:46 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1424 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:36:47.116401 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9b5a9fe9-9e8e-4c1c-9dad-360d371507d2 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:47.117677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9b5a9fe9-9e8e-4c1c-9dad-360d371507d2 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:47.132777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b5a9fe9-9e8e-4c1c-9dad-360d371507d2 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:47.135269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b5a9fe9-9e8e-4c1c-9dad-360d371507d2 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:47.141420 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b5a9fe9-9e8e-4c1c-9dad-360d371507d2 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:47.142978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b5a9fe9-9e8e-4c1c-9dad-360d371507d2 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:47.680952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9b5a9fe9-9e8e-4c1c-9dad-360d371507d2 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:47.686943 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9b5a9fe9-9e8e-4c1c-9dad-360d371507d2 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 200 len: 1502 microversion: 2.1 time: 0.580497 May 21 21:36:47.687530 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2791/5460] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:47 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 1502 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:47.825469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b356fe32-c358-452b-9930-0e74422f03d7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:47.826977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b356fe32-c358-452b-9930-0e74422f03d7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:47.844428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b356fe32-c358-452b-9930-0e74422f03d7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:47.845926 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b356fe32-c358-452b-9930-0e74422f03d7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:47.848604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b356fe32-c358-452b-9930-0e74422f03d7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:47.850300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b356fe32-c358-452b-9930-0e74422f03d7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:48.000629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-cbb8ab8b-d155-4b40-a53e-b7d810d525ec req-c1c9e860-3ef4-4cb4-9d04-ab9897e4900f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7418aa6-4538-48fa-b168-64083d3f381c", "name": "network-vif-deleted", "tag": "b64a5bdb-c2e6-40b5-9fa2-b98f3e40a746"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:36:48.032092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cbb8ab8b-d155-4b40-a53e-b7d810d525ec req-c1c9e860-3ef4-4cb4-9d04-ab9897e4900f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:48.033560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cbb8ab8b-d155-4b40-a53e-b7d810d525ec req-c1c9e860-3ef4-4cb4-9d04-ab9897e4900f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:48.072634 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-cbb8ab8b-d155-4b40-a53e-b7d810d525ec req-c1c9e860-3ef4-4cb4-9d04-ab9897e4900f service nova] Creating event network-vif-deleted:b64a5bdb-c2e6-40b5-9fa2-b98f3e40a746 for instance d7418aa6-4538-48fa-b168-64083d3f381c on nch1-master-1 May 21 21:36:48.088181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b356fe32-c358-452b-9930-0e74422f03d7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:48.099894 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-cbb8ab8b-d155-4b40-a53e-b7d810d525ec req-c1c9e860-3ef4-4cb4-9d04-ab9897e4900f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108589 May 21 21:36:48.105255 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2792/5461] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:36:48.112088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b356fe32-c358-452b-9930-0e74422f03d7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:48.118555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-89a2b7a3-d5f8-4eb7-9ef8-dfec1df3d880 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:48.118904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-89a2b7a3-d5f8-4eb7-9ef8-dfec1df3d880 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:48.128004 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b356fe32-c358-452b-9930-0e74422f03d7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:48.138418 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b356fe32-c358-452b-9930-0e74422f03d7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1730 microversion: 2.20 time: 0.313350 May 21 21:36:48.143313 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2670/5462] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:47 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1730 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:48.167841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89a2b7a3-d5f8-4eb7-9ef8-dfec1df3d880 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:48.171848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89a2b7a3-d5f8-4eb7-9ef8-dfec1df3d880 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:48.171848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89a2b7a3-d5f8-4eb7-9ef8-dfec1df3d880 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:48.171848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89a2b7a3-d5f8-4eb7-9ef8-dfec1df3d880 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:48.576135 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-89a2b7a3-d5f8-4eb7-9ef8-dfec1df3d880 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1422 microversion: 2.1 time: 0.464621 May 21 21:36:48.576135 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2793/5463] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:48 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1422 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:48.703908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1d516e45-15c7-4be4-ad3a-406a9b25da79 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:48.704560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1d516e45-15c7-4be4-ad3a-406a9b25da79 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:48.729451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d516e45-15c7-4be4-ad3a-406a9b25da79 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:48.729927 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d516e45-15c7-4be4-ad3a-406a9b25da79 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:48.730763 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d516e45-15c7-4be4-ad3a-406a9b25da79 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:48.736971 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d516e45-15c7-4be4-ad3a-406a9b25da79 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:48.859682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d516e45-15c7-4be4-ad3a-406a9b25da79 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:48.860419 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d516e45-15c7-4be4-ad3a-406a9b25da79 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:48.860615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-1d516e45-15c7-4be4-ad3a-406a9b25da79 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lazy-loading 'fault' on Instance uuid d7418aa6-4538-48fa-b168-64083d3f381c {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:36:48.975291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1d516e45-15c7-4be4-ad3a-406a9b25da79 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:48.987725 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1d516e45-15c7-4be4-ad3a-406a9b25da79 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 200 len: 1302 microversion: 2.1 time: 0.288396 May 21 21:36:48.988337 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2671/5464] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:48 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 1302 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:49.164751 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-07989a0e-8127-49d0-8fd2-648245a4dd28 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:49.166226 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-07989a0e-8127-49d0-8fd2-648245a4dd28 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:49.177378 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07989a0e-8127-49d0-8fd2-648245a4dd28 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:49.181751 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07989a0e-8127-49d0-8fd2-648245a4dd28 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:49.185475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07989a0e-8127-49d0-8fd2-648245a4dd28 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:49.186259 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07989a0e-8127-49d0-8fd2-648245a4dd28 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:49.594376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3901b1de-434e-4887-80e4-2a9b11aa5e5b tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:49.595400 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3901b1de-434e-4887-80e4-2a9b11aa5e5b tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:49.610655 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3901b1de-434e-4887-80e4-2a9b11aa5e5b tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:49.611362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3901b1de-434e-4887-80e4-2a9b11aa5e5b tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:49.613308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3901b1de-434e-4887-80e4-2a9b11aa5e5b tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:49.615530 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3901b1de-434e-4887-80e4-2a9b11aa5e5b tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:49.713823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-07989a0e-8127-49d0-8fd2-648245a4dd28 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:49.730894 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-07989a0e-8127-49d0-8fd2-648245a4dd28 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:49.738143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-07989a0e-8127-49d0-8fd2-648245a4dd28 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:49.747489 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-07989a0e-8127-49d0-8fd2-648245a4dd28 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1730 microversion: 2.20 time: 0.580764 May 21 21:36:49.747489 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2794/5465] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:49 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1730 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:50.010196 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-56cc39df-8eba-4a19-9897-ae14b42e4c2b tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:50.011295 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-56cc39df-8eba-4a19-9897-ae14b42e4c2b tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: d7418aa6-4538-48fa-b168-64083d3f381c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:50.028084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56cc39df-8eba-4a19-9897-ae14b42e4c2b tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:50.035478 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56cc39df-8eba-4a19-9897-ae14b42e4c2b tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:50.037884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56cc39df-8eba-4a19-9897-ae14b42e4c2b tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:50.040843 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56cc39df-8eba-4a19-9897-ae14b42e4c2b tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:50.072715 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-56cc39df-8eba-4a19-9897-ae14b42e4c2b tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] HTTP exception thrown: Instance d7418aa6-4538-48fa-b168-64083d3f381c could not be found. May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-56cc39df-8eba-4a19-9897-ae14b42e4c2b tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Request method failure captured: May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c HTTP/1.1 May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVtLgVyYWorsYRmQw3_4XAmY3bk8UsBgKsDi0XV7jkrVFvNqxhwo-ovhNES2WoXaj2GfhP5GtNBL7zEr_SMhItIyyygqmrPjRCDPZTYa7eS8ICClnrm1whLtMjo7k5BtdvPhp-LRWH_EALU-LMV3KeXrbp__nNTOqdelvFlXNTZ55E4 May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: dadf0c028b4441b0871d6c484ed30418 May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-VolumesActionsTest-344293892 May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dadf0c028b4441b0871d6c484ed30418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dadf0c028b4441b0871d6c484ed30418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dadf0c028b4441b0871d6c484ed30418", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dadf0c028b4441b0871d6c484ed30418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-VolumesActionsTest-344293892 May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: dadf0c028b4441b0871d6c484ed30418 May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-VolumesActionsTest-344293892 May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-VolumesActionsTest-344293892-project May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 991088a86b78431a96c0d4f69035e791 May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-VolumesActionsTest-344293892-project May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance d7418aa6-4538-48fa-b168-64083d3f381c could not be found. May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'd7418aa6-4538-48fa-b168-64083d3f381c'} May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7418aa6-4538-48fa-b168-64083d3f381c could not be found. May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7418aa6-4538-48fa-b168-64083d3f381c could not be found. May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:36:50.076470 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:36:50.083909 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:36:50.083909 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:36:50.083909 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:36:50.083909 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:36:50.083909 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:36:50.083909 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7418aa6-4538-48fa-b168-64083d3f381c could not be found. May 21 21:36:50.083909 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:36:50.087999 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-56cc39df-8eba-4a19-9897-ae14b42e4c2b tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Returning 404 to user: Instance d7418aa6-4538-48fa-b168-64083d3f381c could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:36:50.087999 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-56cc39df-8eba-4a19-9897-ae14b42e4c2b tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c" status: 404 len: 111 microversion: 2.1 time: 0.083834 May 21 21:36:50.099912 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2795/5466] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:50 2022] GET /compute/v2.1/servers/d7418aa6-4538-48fa-b168-64083d3f381c => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:36:50.138678 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3901b1de-434e-4887-80e4-2a9b11aa5e5b tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1464 microversion: 2.1 time: 0.548963 May 21 21:36:50.140748 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2672/5467] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:49 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1464 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:36:50.309216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-12847919-098e-4d44-b3f2-915eacbc66ec tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1756100452", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "1d860598-93fb-4b0c-91db-8e15c4e937ad"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:36:50.441006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-12847919-098e-4d44-b3f2-915eacbc66ec tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] validate_networks() for [('1d860598-93fb-4b0c-91db-8e15c4e937ad', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:36:50.760386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0e5a7f72-c269-45f2-b026-d7436c62bdbb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:50.761438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0e5a7f72-c269-45f2-b026-d7436c62bdbb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:50.775848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e5a7f72-c269-45f2-b026-d7436c62bdbb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:50.777449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e5a7f72-c269-45f2-b026-d7436c62bdbb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:50.781320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e5a7f72-c269-45f2-b026-d7436c62bdbb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:50.782785 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e5a7f72-c269-45f2-b026-d7436c62bdbb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:51.228375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0e5a7f72-c269-45f2-b026-d7436c62bdbb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:51.244338 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0e5a7f72-c269-45f2-b026-d7436c62bdbb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:51.246375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0e5a7f72-c269-45f2-b026-d7436c62bdbb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:51.249036 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0e5a7f72-c269-45f2-b026-d7436c62bdbb tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1730 microversion: 2.20 time: 0.493500 May 21 21:36:51.256421 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2673/5468] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:50 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1730 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:51.265341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-622b968d-d876-43da-912e-de91fd6086e1 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:51.266329 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-622b968d-d876-43da-912e-de91fd6086e1 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:51.282832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-622b968d-d876-43da-912e-de91fd6086e1 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:51.283637 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-622b968d-d876-43da-912e-de91fd6086e1 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:51.286492 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-622b968d-d876-43da-912e-de91fd6086e1 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:51.287288 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-622b968d-d876-43da-912e-de91fd6086e1 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:51.571423 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-622b968d-d876-43da-912e-de91fd6086e1 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1464 microversion: 2.1 time: 0.313643 May 21 21:36:51.573151 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2674/5469] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:51 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1464 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:52.303739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d97021c8-730c-4b57-be9f-cf4b37eaee79 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:52.303739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d97021c8-730c-4b57-be9f-cf4b37eaee79 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:52.326385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d97021c8-730c-4b57-be9f-cf4b37eaee79 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:52.330586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d97021c8-730c-4b57-be9f-cf4b37eaee79 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:52.335811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d97021c8-730c-4b57-be9f-cf4b37eaee79 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:52.336798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d97021c8-730c-4b57-be9f-cf4b37eaee79 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:52.725095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d97021c8-730c-4b57-be9f-cf4b37eaee79 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:52.737564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d97021c8-730c-4b57-be9f-cf4b37eaee79 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:52.741354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d97021c8-730c-4b57-be9f-cf4b37eaee79 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:52.743587 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d97021c8-730c-4b57-be9f-cf4b37eaee79 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1730 microversion: 2.20 time: 0.471648 May 21 21:36:52.759677 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2675/5470] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:52 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1730 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:52.773315 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-302b897e-365f-467b-a4e2-0e7f3d5cbba6 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:52.774640 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-302b897e-365f-467b-a4e2-0e7f3d5cbba6 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:52.785090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-302b897e-365f-467b-a4e2-0e7f3d5cbba6 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:52.791984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-302b897e-365f-467b-a4e2-0e7f3d5cbba6 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:52.791984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-302b897e-365f-467b-a4e2-0e7f3d5cbba6 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:52.791984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-302b897e-365f-467b-a4e2-0e7f3d5cbba6 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:53.005471 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:36:53.037216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:36:53.158365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-12847919-098e-4d44-b3f2-915eacbc66ec tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:36:53.160588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-12847919-098e-4d44-b3f2-915eacbc66ec tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:36:53.161846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-12847919-098e-4d44-b3f2-915eacbc66ec tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:36:53.162550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-12847919-098e-4d44-b3f2-915eacbc66ec tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:36:53.163454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-12847919-098e-4d44-b3f2-915eacbc66ec tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:36:53.166625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:36:53.182855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-12847919-098e-4d44-b3f2-915eacbc66ec tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:53.183308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-12847919-098e-4d44-b3f2-915eacbc66ec tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:53.191064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-12847919-098e-4d44-b3f2-915eacbc66ec tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:53.191733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-12847919-098e-4d44-b3f2-915eacbc66ec tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:53.250556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-12847919-098e-4d44-b3f2-915eacbc66ec tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Getting quotas for project dadf0c028b4441b0871d6c484ed30418. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:36:53.263980 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-12847919-098e-4d44-b3f2-915eacbc66ec tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Getting quotas for user 991088a86b78431a96c0d4f69035e791 and project dadf0c028b4441b0871d6c484ed30418. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:36:53.356449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-12847919-098e-4d44-b3f2-915eacbc66ec tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:36:53.356449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-12847919-098e-4d44-b3f2-915eacbc66ec tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:36:53.449034 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-302b897e-365f-467b-a4e2-0e7f3d5cbba6 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1464 microversion: 2.1 time: 0.683383 May 21 21:36:53.450768 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2676/5471] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:52 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1464 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:53.764016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3c5413f7-a9c5-4c95-adbd-5ed8bbf8d22f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:53.765071 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3c5413f7-a9c5-4c95-adbd-5ed8bbf8d22f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:53.780724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3c5413f7-a9c5-4c95-adbd-5ed8bbf8d22f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:53.786639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3c5413f7-a9c5-4c95-adbd-5ed8bbf8d22f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:53.794021 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3c5413f7-a9c5-4c95-adbd-5ed8bbf8d22f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:53.794787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3c5413f7-a9c5-4c95-adbd-5ed8bbf8d22f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:53.798828 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-12847919-098e-4d44-b3f2-915eacbc66ec tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.493214 May 21 21:36:53.804264 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2796/5472] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:36:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:36:53.815217 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-39807cd8-511e-401c-8f28-b19d65d3c51f tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:53.816662 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-39807cd8-511e-401c-8f28-b19d65d3c51f tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:54.085824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-39807cd8-511e-401c-8f28-b19d65d3c51f tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:54.100092 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-39807cd8-511e-401c-8f28-b19d65d3c51f tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15" status: 200 len: 1214 microversion: 2.1 time: 0.289895 May 21 21:36:54.104754 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2797/5473] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:53 2022] GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 => generated 1214 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:36:54.477674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:36:54.480107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c751dc99-414f-4c7f-a303-14936c897d22 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:54.482094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c751dc99-414f-4c7f-a303-14936c897d22 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:54.502169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c751dc99-414f-4c7f-a303-14936c897d22 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:54.505133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c751dc99-414f-4c7f-a303-14936c897d22 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:54.505133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c751dc99-414f-4c7f-a303-14936c897d22 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:54.505133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c751dc99-414f-4c7f-a303-14936c897d22 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:55.007200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3c5413f7-a9c5-4c95-adbd-5ed8bbf8d22f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:55.026320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3c5413f7-a9c5-4c95-adbd-5ed8bbf8d22f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:55.036536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3c5413f7-a9c5-4c95-adbd-5ed8bbf8d22f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:55.038245 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3c5413f7-a9c5-4c95-adbd-5ed8bbf8d22f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1730 microversion: 2.20 time: 1.278702 May 21 21:36:55.050492 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2677/5474] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:53 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1730 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:36:55.123766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e7d9bda6-3892-44b8-8608-55e3d1b4a901 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:55.124437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e7d9bda6-3892-44b8-8608-55e3d1b4a901 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:55.299291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e7d9bda6-3892-44b8-8608-55e3d1b4a901 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:55.307533 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e7d9bda6-3892-44b8-8608-55e3d1b4a901 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15" status: 200 len: 1214 microversion: 2.1 time: 0.188533 May 21 21:36:55.313571 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2678/5475] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:55 2022] GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 => generated 1214 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:36:55.336014 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-98d25036-ffa4-4a9d-aacc-0c4e23b6b4ee req-613b42cc-9117-41d8-8ddb-596c3b81a0cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24862fdd-22fe-4329-b5ac-de9813a4ecc7", "tag": "5a6c8fdd-94b4-4ab9-9377-e9173824d4bf"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:36:55.349947 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c751dc99-414f-4c7f-a303-14936c897d22 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1464 microversion: 2.1 time: 0.886169 May 21 21:36:55.351760 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2798/5476] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:54 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1464 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:36:55.363029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-98d25036-ffa4-4a9d-aacc-0c4e23b6b4ee req-613b42cc-9117-41d8-8ddb-596c3b81a0cf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:55.363505 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-98d25036-ffa4-4a9d-aacc-0c4e23b6b4ee req-613b42cc-9117-41d8-8ddb-596c3b81a0cf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:55.396586 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-98d25036-ffa4-4a9d-aacc-0c4e23b6b4ee req-613b42cc-9117-41d8-8ddb-596c3b81a0cf service nova] Creating event network-changed:5a6c8fdd-94b4-4ab9-9377-e9173824d4bf for instance 24862fdd-22fe-4329-b5ac-de9813a4ecc7 on nch1-master-1 May 21 21:36:55.414652 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-98d25036-ffa4-4a9d-aacc-0c4e23b6b4ee req-613b42cc-9117-41d8-8ddb-596c3b81a0cf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082513 May 21 21:36:55.426361 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2679/5477] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:36:56.075479 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-988c564b-5668-4376-a46c-4d72861c77fc tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:56.076607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-988c564b-5668-4376-a46c-4d72861c77fc tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:56.097386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-988c564b-5668-4376-a46c-4d72861c77fc tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:56.098465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-988c564b-5668-4376-a46c-4d72861c77fc tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:56.099337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-988c564b-5668-4376-a46c-4d72861c77fc tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:56.103193 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-988c564b-5668-4376-a46c-4d72861c77fc tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:56.333071 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4d02c4f0-97c7-4838-8c28-608606ad9200 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:56.334573 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4d02c4f0-97c7-4838-8c28-608606ad9200 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:56.369013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d02c4f0-97c7-4838-8c28-608606ad9200 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:56.376463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d02c4f0-97c7-4838-8c28-608606ad9200 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:56.376463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d02c4f0-97c7-4838-8c28-608606ad9200 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:56.376463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d02c4f0-97c7-4838-8c28-608606ad9200 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:56.503113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4d02c4f0-97c7-4838-8c28-608606ad9200 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:56.512853 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4d02c4f0-97c7-4838-8c28-608606ad9200 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15" status: 200 len: 1210 microversion: 2.1 time: 0.185035 May 21 21:36:56.515001 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2680/5478] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:56 2022] GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 => generated 1210 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:36:56.520337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ca80fc21-866b-47ec-b4bf-9ca3d8097dad tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:56.525659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ca80fc21-866b-47ec-b4bf-9ca3d8097dad tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:56.528114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca80fc21-866b-47ec-b4bf-9ca3d8097dad tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:56.528747 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca80fc21-866b-47ec-b4bf-9ca3d8097dad tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:56.529543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca80fc21-866b-47ec-b4bf-9ca3d8097dad tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:56.530180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca80fc21-866b-47ec-b4bf-9ca3d8097dad tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:56.851783 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ca80fc21-866b-47ec-b4bf-9ca3d8097dad tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1464 microversion: 2.1 time: 0.335410 May 21 21:36:56.860503 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2681/5479] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:56 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1464 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:57.063367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-988c564b-5668-4376-a46c-4d72861c77fc tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:57.100984 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-988c564b-5668-4376-a46c-4d72861c77fc tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:57.102465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-988c564b-5668-4376-a46c-4d72861c77fc tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:57.103745 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-988c564b-5668-4376-a46c-4d72861c77fc tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1730 microversion: 2.20 time: 1.037048 May 21 21:36:57.119320 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2799/5480] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:56 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1730 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:36:57.534825 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1fb1c967-07bf-46c7-aac8-a8658725c95c tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:57.535447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1fb1c967-07bf-46c7-aac8-a8658725c95c tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:57.558578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1fb1c967-07bf-46c7-aac8-a8658725c95c tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:57.559080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1fb1c967-07bf-46c7-aac8-a8658725c95c tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:57.560053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1fb1c967-07bf-46c7-aac8-a8658725c95c tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:57.560532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1fb1c967-07bf-46c7-aac8-a8658725c95c tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:57.612899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:36:57.783701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1fb1c967-07bf-46c7-aac8-a8658725c95c tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:57.799435 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1fb1c967-07bf-46c7-aac8-a8658725c95c tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15" status: 200 len: 1266 microversion: 2.1 time: 0.268505 May 21 21:36:57.800056 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2682/5481] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:57 2022] GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:57.877076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c995762d-8e77-44b7-aaa0-a87e885a8bc2 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:57.877876 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c995762d-8e77-44b7-aaa0-a87e885a8bc2 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:57.890258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c995762d-8e77-44b7-aaa0-a87e885a8bc2 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:57.890973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c995762d-8e77-44b7-aaa0-a87e885a8bc2 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:57.891986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c995762d-8e77-44b7-aaa0-a87e885a8bc2 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:57.892637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c995762d-8e77-44b7-aaa0-a87e885a8bc2 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:58.144349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f97722bc-4e33-43d5-8471-b95da88b0f44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:58.144349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f97722bc-4e33-43d5-8471-b95da88b0f44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:58.151742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f97722bc-4e33-43d5-8471-b95da88b0f44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:58.153130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f97722bc-4e33-43d5-8471-b95da88b0f44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:58.154391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f97722bc-4e33-43d5-8471-b95da88b0f44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:58.156100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f97722bc-4e33-43d5-8471-b95da88b0f44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:58.583564 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c995762d-8e77-44b7-aaa0-a87e885a8bc2 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1464 microversion: 2.1 time: 0.711028 May 21 21:36:58.593997 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2800/5482] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:57 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1464 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:58.615869 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f97722bc-4e33-43d5-8471-b95da88b0f44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:58.630644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f97722bc-4e33-43d5-8471-b95da88b0f44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:58.632262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f97722bc-4e33-43d5-8471-b95da88b0f44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:58.634202 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f97722bc-4e33-43d5-8471-b95da88b0f44 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1730 microversion: 2.20 time: 0.500234 May 21 21:36:58.635516 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2683/5483] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:58 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1730 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:36:58.818167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-09469c77-0329-4fe7-9450-93aefd9633aa tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:58.818806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-09469c77-0329-4fe7-9450-93aefd9633aa tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:58.826660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-09469c77-0329-4fe7-9450-93aefd9633aa tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:58.827123 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-09469c77-0329-4fe7-9450-93aefd9633aa tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:58.828518 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-09469c77-0329-4fe7-9450-93aefd9633aa tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:58.829300 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-09469c77-0329-4fe7-9450-93aefd9633aa tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:58.914217 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-09469c77-0329-4fe7-9450-93aefd9633aa tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:36:58.927797 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-09469c77-0329-4fe7-9450-93aefd9633aa tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15" status: 200 len: 1266 microversion: 2.1 time: 0.110716 May 21 21:36:58.928877 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2801/5484] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:58 2022] GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 => generated 1266 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:36:59.601988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b6634ee8-e435-4b25-9908-7350def55902 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:36:59.602802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b6634ee8-e435-4b25-9908-7350def55902 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:36:59.621821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6634ee8-e435-4b25-9908-7350def55902 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:59.624886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6634ee8-e435-4b25-9908-7350def55902 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:36:59.632125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6634ee8-e435-4b25-9908-7350def55902 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:36:59.637326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6634ee8-e435-4b25-9908-7350def55902 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:00.164080 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b6634ee8-e435-4b25-9908-7350def55902 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1464 microversion: 2.1 time: 0.566750 May 21 21:37:00.167373 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2684/5485] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:36:59 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1464 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:00.177584 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-38429b8c-452b-42cd-aba9-5a0f53860475 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:00.180670 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-38429b8c-452b-42cd-aba9-5a0f53860475 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:00.196025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38429b8c-452b-42cd-aba9-5a0f53860475 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:00.196872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38429b8c-452b-42cd-aba9-5a0f53860475 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:00.197855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38429b8c-452b-42cd-aba9-5a0f53860475 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:00.206723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38429b8c-452b-42cd-aba9-5a0f53860475 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:00.248529 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-42c59794-eb6d-470e-b0b4-0783dffbe123 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:00.251685 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-42c59794-eb6d-470e-b0b4-0783dffbe123 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:00.262644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42c59794-eb6d-470e-b0b4-0783dffbe123 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:00.263700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42c59794-eb6d-470e-b0b4-0783dffbe123 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:00.264746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42c59794-eb6d-470e-b0b4-0783dffbe123 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:00.265368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42c59794-eb6d-470e-b0b4-0783dffbe123 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:00.372554 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-38429b8c-452b-42cd-aba9-5a0f53860475 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:00.381764 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-38429b8c-452b-42cd-aba9-5a0f53860475 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15" status: 200 len: 1272 microversion: 2.1 time: 0.212890 May 21 21:37:00.385465 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2685/5486] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:00 2022] GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 => generated 1272 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:00.500516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-42c59794-eb6d-470e-b0b4-0783dffbe123 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:00.508932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-42c59794-eb6d-470e-b0b4-0783dffbe123 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:00.510459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-42c59794-eb6d-470e-b0b4-0783dffbe123 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:00.512434 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-42c59794-eb6d-470e-b0b4-0783dffbe123 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1730 microversion: 2.20 time: 0.862159 May 21 21:37:00.513058 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2802/5487] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:36:59 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1730 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:37:01.183992 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e9ce16c2-c1e2-4c4b-a55b-e068424f50d8 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:01.185578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e9ce16c2-c1e2-4c4b-a55b-e068424f50d8 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:01.193850 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9ce16c2-c1e2-4c4b-a55b-e068424f50d8 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:01.194450 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9ce16c2-c1e2-4c4b-a55b-e068424f50d8 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:01.195583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9ce16c2-c1e2-4c4b-a55b-e068424f50d8 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:01.196342 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9ce16c2-c1e2-4c4b-a55b-e068424f50d8 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:01.406487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fbc9999c-d3e2-4ed5-a0ba-ae19a5ba0b36 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:01.407981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fbc9999c-d3e2-4ed5-a0ba-ae19a5ba0b36 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:01.428800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbc9999c-d3e2-4ed5-a0ba-ae19a5ba0b36 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:01.430107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbc9999c-d3e2-4ed5-a0ba-ae19a5ba0b36 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:01.431181 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbc9999c-d3e2-4ed5-a0ba-ae19a5ba0b36 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:01.431807 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbc9999c-d3e2-4ed5-a0ba-ae19a5ba0b36 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:01.479891 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e9ce16c2-c1e2-4c4b-a55b-e068424f50d8 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1464 microversion: 2.1 time: 0.300459 May 21 21:37:01.483323 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2686/5488] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:01 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1464 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:01.533142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-60944ed5-5fca-4532-8845-01eea3f7aefa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:01.534020 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-60944ed5-5fca-4532-8845-01eea3f7aefa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:01.541617 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-60944ed5-5fca-4532-8845-01eea3f7aefa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:01.542340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-60944ed5-5fca-4532-8845-01eea3f7aefa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:01.544164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-60944ed5-5fca-4532-8845-01eea3f7aefa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:01.544648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-60944ed5-5fca-4532-8845-01eea3f7aefa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:01.787671 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fbc9999c-d3e2-4ed5-a0ba-ae19a5ba0b36 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:01.799979 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fbc9999c-d3e2-4ed5-a0ba-ae19a5ba0b36 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15" status: 200 len: 1314 microversion: 2.1 time: 0.397409 May 21 21:37:01.800939 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2803/5489] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:01 2022] GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:37:02.057007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-60944ed5-5fca-4532-8845-01eea3f7aefa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:02.064715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-60944ed5-5fca-4532-8845-01eea3f7aefa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:02.070270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-60944ed5-5fca-4532-8845-01eea3f7aefa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:02.071588 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-60944ed5-5fca-4532-8845-01eea3f7aefa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1730 microversion: 2.20 time: 0.544415 May 21 21:37:02.093347 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2687/5490] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:37:01 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1730 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:37:02.500719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-57dad65c-eef8-4058-b561-197ca4bb4b12 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:02.502088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-57dad65c-eef8-4058-b561-197ca4bb4b12 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:02.515133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57dad65c-eef8-4058-b561-197ca4bb4b12 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:02.519726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57dad65c-eef8-4058-b561-197ca4bb4b12 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:02.519726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57dad65c-eef8-4058-b561-197ca4bb4b12 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:02.520946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57dad65c-eef8-4058-b561-197ca4bb4b12 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:02.818046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-50a35af8-8fcf-467d-9cf4-b817f8a08794 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:02.819298 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-50a35af8-8fcf-467d-9cf4-b817f8a08794 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:02.832194 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-57dad65c-eef8-4058-b561-197ca4bb4b12 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1464 microversion: 2.1 time: 0.336676 May 21 21:37:02.832954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50a35af8-8fcf-467d-9cf4-b817f8a08794 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:02.832954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50a35af8-8fcf-467d-9cf4-b817f8a08794 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:02.836152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50a35af8-8fcf-467d-9cf4-b817f8a08794 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:02.837031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50a35af8-8fcf-467d-9cf4-b817f8a08794 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:02.849314 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2804/5491] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:02 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1464 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:03.095968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1d5672d2-cc2b-43ea-90f1-949fe97130aa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:03.096382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1d5672d2-cc2b-43ea-90f1-949fe97130aa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:03.112391 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d5672d2-cc2b-43ea-90f1-949fe97130aa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:03.113193 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d5672d2-cc2b-43ea-90f1-949fe97130aa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:03.114934 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d5672d2-cc2b-43ea-90f1-949fe97130aa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:03.115626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d5672d2-cc2b-43ea-90f1-949fe97130aa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:03.502837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1d5672d2-cc2b-43ea-90f1-949fe97130aa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:03.542116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1d5672d2-cc2b-43ea-90f1-949fe97130aa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:03.551878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1d5672d2-cc2b-43ea-90f1-949fe97130aa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:03.553538 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1d5672d2-cc2b-43ea-90f1-949fe97130aa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1730 microversion: 2.20 time: 0.466036 May 21 21:37:03.558056 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2805/5492] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:37:03 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1730 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:37:03.787052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-07824b11-0223-4d2d-8ea3-7b21538ef0b1 req-23b48559-62ce-4260-b64d-45e045d0e133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fac7b33-2e5f-40a9-9bd6-4e23eba62e15", "tag": "a597f33c-81dc-4037-a790-18ce0c99ee17"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:37:03.801683 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-07824b11-0223-4d2d-8ea3-7b21538ef0b1 req-23b48559-62ce-4260-b64d-45e045d0e133 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:03.802350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-07824b11-0223-4d2d-8ea3-7b21538ef0b1 req-23b48559-62ce-4260-b64d-45e045d0e133 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:03.819956 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-07824b11-0223-4d2d-8ea3-7b21538ef0b1 req-23b48559-62ce-4260-b64d-45e045d0e133 service nova] Creating event network-changed:a597f33c-81dc-4037-a790-18ce0c99ee17 for instance 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 on nch2-master-1 May 21 21:37:03.828901 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-07824b11-0223-4d2d-8ea3-7b21538ef0b1 req-23b48559-62ce-4260-b64d-45e045d0e133 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.265043 May 21 21:37:03.831016 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2806/5493] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:37:03.879883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-752572cb-eaa9-49c1-a798-c0478bc30fb1 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:03.883067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-752572cb-eaa9-49c1-a798-c0478bc30fb1 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:03.887938 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-50a35af8-8fcf-467d-9cf4-b817f8a08794 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:03.899604 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-50a35af8-8fcf-467d-9cf4-b817f8a08794 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15" status: 200 len: 1314 microversion: 2.1 time: 1.084878 May 21 21:37:03.909707 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2688/5494] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:02 2022] GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 => generated 1314 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:03.910023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-752572cb-eaa9-49c1-a798-c0478bc30fb1 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:03.910023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-752572cb-eaa9-49c1-a798-c0478bc30fb1 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:03.910023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-752572cb-eaa9-49c1-a798-c0478bc30fb1 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:03.910023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-752572cb-eaa9-49c1-a798-c0478bc30fb1 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:03.919375 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:37:03.941043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:37:04.093582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=8 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:37:04.331689 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-752572cb-eaa9-49c1-a798-c0478bc30fb1 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1464 microversion: 2.1 time: 0.480183 May 21 21:37:04.332346 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2807/5495] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:03 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1464 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:37:04.409234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-56a234a3-4631-4acd-a1a8-98fbfc682ec2 req-7d43654c-001a-4b09-bd6e-70b7160c14e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24862fdd-22fe-4329-b5ac-de9813a4ecc7", "name": "network-vif-plugged", "status": "completed", "tag": "5a6c8fdd-94b4-4ab9-9377-e9173824d4bf"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:37:04.427369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-56a234a3-4631-4acd-a1a8-98fbfc682ec2 req-7d43654c-001a-4b09-bd6e-70b7160c14e8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:04.428669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-56a234a3-4631-4acd-a1a8-98fbfc682ec2 req-7d43654c-001a-4b09-bd6e-70b7160c14e8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:04.453111 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-56a234a3-4631-4acd-a1a8-98fbfc682ec2 req-7d43654c-001a-4b09-bd6e-70b7160c14e8 service nova] Creating event network-vif-plugged:5a6c8fdd-94b4-4ab9-9377-e9173824d4bf for instance 24862fdd-22fe-4329-b5ac-de9813a4ecc7 on nch1-master-1 May 21 21:37:04.464046 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-56a234a3-4631-4acd-a1a8-98fbfc682ec2 req-7d43654c-001a-4b09-bd6e-70b7160c14e8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058786 May 21 21:37:04.466358 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2689/5496] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:37:04.577966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b6f6fb09-13e6-44f8-a86d-a3de615f9b50 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:04.579577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b6f6fb09-13e6-44f8-a86d-a3de615f9b50 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:04.603263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6f6fb09-13e6-44f8-a86d-a3de615f9b50 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:04.604116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6f6fb09-13e6-44f8-a86d-a3de615f9b50 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:04.605342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6f6fb09-13e6-44f8-a86d-a3de615f9b50 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:04.606193 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b6f6fb09-13e6-44f8-a86d-a3de615f9b50 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:04.919742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-642b8316-cb39-4b15-b040-72b3dc7cfdb8 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:04.922707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-642b8316-cb39-4b15-b040-72b3dc7cfdb8 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:04.934135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-642b8316-cb39-4b15-b040-72b3dc7cfdb8 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:04.935068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-642b8316-cb39-4b15-b040-72b3dc7cfdb8 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:04.936177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-642b8316-cb39-4b15-b040-72b3dc7cfdb8 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:04.937819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-642b8316-cb39-4b15-b040-72b3dc7cfdb8 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:05.261905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-642b8316-cb39-4b15-b040-72b3dc7cfdb8 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:05.274605 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-642b8316-cb39-4b15-b040-72b3dc7cfdb8 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15" status: 200 len: 1314 microversion: 2.1 time: 0.361302 May 21 21:37:05.275263 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2690/5497] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:04 2022] GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:37:05.349354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b7510963-5549-4745-a206-e8950831b028 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:05.349898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b7510963-5549-4745-a206-e8950831b028 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:05.356738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b7510963-5549-4745-a206-e8950831b028 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:05.357458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b7510963-5549-4745-a206-e8950831b028 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:05.358269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b7510963-5549-4745-a206-e8950831b028 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:05.358704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b7510963-5549-4745-a206-e8950831b028 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:05.398299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:37:05.425289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b6f6fb09-13e6-44f8-a86d-a3de615f9b50 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:05.441258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b6f6fb09-13e6-44f8-a86d-a3de615f9b50 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:05.442209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b6f6fb09-13e6-44f8-a86d-a3de615f9b50 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:05.444477 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b6f6fb09-13e6-44f8-a86d-a3de615f9b50 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1730 microversion: 2.20 time: 0.873306 May 21 21:37:05.456540 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2808/5498] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:37:04 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1730 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:37:05.561623 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b7510963-5549-4745-a206-e8950831b028 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1464 microversion: 2.1 time: 0.215846 May 21 21:37:05.562986 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2691/5499] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:05 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1464 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:37:06.292002 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-34c2862e-ab03-428e-bb16-fc19c597e290 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:06.293470 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-34c2862e-ab03-428e-bb16-fc19c597e290 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:06.321597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34c2862e-ab03-428e-bb16-fc19c597e290 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:06.328515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34c2862e-ab03-428e-bb16-fc19c597e290 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:06.329503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34c2862e-ab03-428e-bb16-fc19c597e290 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:06.330164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-34c2862e-ab03-428e-bb16-fc19c597e290 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:06.405775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b7021964-c36a-4788-b4f5-c7921000c728 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1839388914 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1839388914-project-admin] Calling method '.version_select at 0x7fc81a3b2700>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:06.407612 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:37:06.407612 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:37:06.408996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7021964-c36a-4788-b4f5-c7921000c728 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1839388914 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1839388914-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:06.409645 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7021964-c36a-4788-b4f5-c7921000c728 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1839388914 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1839388914-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:06.455692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7021964-c36a-4788-b4f5-c7921000c728 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1839388914 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1839388914-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:06.456157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7021964-c36a-4788-b4f5-c7921000c728 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1839388914 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1839388914-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:06.475301 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7021964-c36a-4788-b4f5-c7921000c728 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1839388914 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1839388914-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:06.475763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7021964-c36a-4788-b4f5-c7921000c728 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1839388914 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1839388914-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:06.483896 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b7021964-c36a-4788-b4f5-c7921000c728 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1839388914 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1839388914-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.281666 May 21 21:37:06.485879 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2809/5500] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:37:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:37:06.491499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2448c7c1-d143-44ab-b4fb-1817e1faa1e8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:06.492466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2448c7c1-d143-44ab-b4fb-1817e1faa1e8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:06.502074 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2448c7c1-d143-44ab-b4fb-1817e1faa1e8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:06.503064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2448c7c1-d143-44ab-b4fb-1817e1faa1e8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:06.503804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2448c7c1-d143-44ab-b4fb-1817e1faa1e8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:06.504473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2448c7c1-d143-44ab-b4fb-1817e1faa1e8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:06.876983 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-34c2862e-ab03-428e-bb16-fc19c597e290 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:06.878386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2448c7c1-d143-44ab-b4fb-1817e1faa1e8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:06.930197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2448c7c1-d143-44ab-b4fb-1817e1faa1e8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:06.932403 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-34c2862e-ab03-428e-bb16-fc19c597e290 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15" status: 200 len: 1314 microversion: 2.1 time: 0.642762 May 21 21:37:06.936694 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2692/5501] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:06 2022] GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:37:06.938862 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2448c7c1-d143-44ab-b4fb-1817e1faa1e8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:06.940522 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2448c7c1-d143-44ab-b4fb-1817e1faa1e8 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1730 microversion: 2.20 time: 0.453016 May 21 21:37:06.945013 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2810/5502] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:37:06 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1730 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:37:06.959966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-aa60f007-a05d-453f-8cc5-56a4821f6f87 req-089e46f3-daf9-4244-a180-be34502532ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cc5c56-edbc-4588-9912-c07974b1f4e7", "name": "network-vif-plugged", "status": "completed", "tag": "b88a4bf2-b43b-40cf-9426-b3b39cf8f325"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:37:06.973773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-720d464e-e383-4602-9ec9-7cb08c85fcf7 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:06.974611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-720d464e-e383-4602-9ec9-7cb08c85fcf7 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:07.020848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-720d464e-e383-4602-9ec9-7cb08c85fcf7 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:07.021066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-aa60f007-a05d-453f-8cc5-56a4821f6f87 req-089e46f3-daf9-4244-a180-be34502532ec service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:07.021957 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-720d464e-e383-4602-9ec9-7cb08c85fcf7 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:07.022962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-aa60f007-a05d-453f-8cc5-56a4821f6f87 req-089e46f3-daf9-4244-a180-be34502532ec service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:07.027921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-720d464e-e383-4602-9ec9-7cb08c85fcf7 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:07.028751 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-720d464e-e383-4602-9ec9-7cb08c85fcf7 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:07.046068 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-aa60f007-a05d-453f-8cc5-56a4821f6f87 req-089e46f3-daf9-4244-a180-be34502532ec service nova] Creating event network-vif-plugged:b88a4bf2-b43b-40cf-9426-b3b39cf8f325 for instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 on nch2-master-1 May 21 21:37:07.053508 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-aa60f007-a05d-453f-8cc5-56a4821f6f87 req-089e46f3-daf9-4244-a180-be34502532ec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114534 May 21 21:37:07.055031 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2693/5503] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:37:07.463952 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-720d464e-e383-4602-9ec9-7cb08c85fcf7 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1648 microversion: 2.1 time: 0.515874 May 21 21:37:07.477535 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2811/5504] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:06 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1648 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:07.494206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1efde29f-1404-4206-822e-58e49562ec6e tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:07.496599 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1efde29f-1404-4206-822e-58e49562ec6e tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:07.520482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:37:07.526371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1efde29f-1404-4206-822e-58e49562ec6e tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:07.529543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1efde29f-1404-4206-822e-58e49562ec6e tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:07.531753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1efde29f-1404-4206-822e-58e49562ec6e tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:07.532378 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1efde29f-1404-4206-822e-58e49562ec6e tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:07.935937 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1efde29f-1404-4206-822e-58e49562ec6e tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1648 microversion: 2.1 time: 0.451281 May 21 21:37:07.938157 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2694/5505] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:07 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1648 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:07.953038 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3a0a0da7-ffae-4350-8db8-4bf5baf77f5d tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:07.953692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3a0a0da7-ffae-4350-8db8-4bf5baf77f5d tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:07.958103 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3450ed33-76cf-4bba-bf0f-2dabb1e797bf tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:07.959110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3450ed33-76cf-4bba-bf0f-2dabb1e797bf tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:07.960768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a0a0da7-ffae-4350-8db8-4bf5baf77f5d tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:07.965341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a0a0da7-ffae-4350-8db8-4bf5baf77f5d tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:07.965341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a0a0da7-ffae-4350-8db8-4bf5baf77f5d tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:07.965341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a0a0da7-ffae-4350-8db8-4bf5baf77f5d tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:07.966540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3450ed33-76cf-4bba-bf0f-2dabb1e797bf tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:07.967056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3450ed33-76cf-4bba-bf0f-2dabb1e797bf tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:07.967849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3450ed33-76cf-4bba-bf0f-2dabb1e797bf tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:07.968324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3450ed33-76cf-4bba-bf0f-2dabb1e797bf tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:08.189389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3a0a0da7-ffae-4350-8db8-4bf5baf77f5d tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:08.197556 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3a0a0da7-ffae-4350-8db8-4bf5baf77f5d tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15" status: 200 len: 1314 microversion: 2.1 time: 0.250218 May 21 21:37:08.201259 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2812/5506] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:07 2022] GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:37:08.220580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f66a18f5-2809-4875-a95b-b5e5422c5e0c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:08.221199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f66a18f5-2809-4875-a95b-b5e5422c5e0c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:08.228794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f66a18f5-2809-4875-a95b-b5e5422c5e0c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:08.228794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f66a18f5-2809-4875-a95b-b5e5422c5e0c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:08.232981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f66a18f5-2809-4875-a95b-b5e5422c5e0c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:08.232981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f66a18f5-2809-4875-a95b-b5e5422c5e0c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:08.304560 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3450ed33-76cf-4bba-bf0f-2dabb1e797bf tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1648 microversion: 2.1 time: 0.349699 May 21 21:37:08.305698 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2695/5507] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:07 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1648 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:08.456263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5a10f782-d5ce-40a0-b69d-07452a035bc4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1453652296", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "f3f457f4-8bd7-4376-b341-2bbbed0f371a"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:37:08.529178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f66a18f5-2809-4875-a95b-b5e5422c5e0c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:08.539789 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f66a18f5-2809-4875-a95b-b5e5422c5e0c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:08.544418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f66a18f5-2809-4875-a95b-b5e5422c5e0c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:08.549707 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f66a18f5-2809-4875-a95b-b5e5422c5e0c tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1730 microversion: 2.20 time: 0.345315 May 21 21:37:08.562976 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2813/5508] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:37:08 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1730 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:37:08.577517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-5a10f782-d5ce-40a0-b69d-07452a035bc4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] validate_networks() for [('f3f457f4-8bd7-4376-b341-2bbbed0f371a', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:37:09.095337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f23434e4-b3d7-4115-af9b-9de4427581a5 req-aca8faf8-288e-4efe-9502-db35ddd05796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fac7b33-2e5f-40a9-9bd6-4e23eba62e15", "name": "network-vif-plugged", "status": "completed", "tag": "a597f33c-81dc-4037-a790-18ce0c99ee17"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:37:09.105828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f23434e4-b3d7-4115-af9b-9de4427581a5 req-aca8faf8-288e-4efe-9502-db35ddd05796 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:09.106664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f23434e4-b3d7-4115-af9b-9de4427581a5 req-aca8faf8-288e-4efe-9502-db35ddd05796 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:09.118781 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f23434e4-b3d7-4115-af9b-9de4427581a5 req-aca8faf8-288e-4efe-9502-db35ddd05796 service nova] Creating event network-vif-plugged:a597f33c-81dc-4037-a790-18ce0c99ee17 for instance 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 on nch2-master-1 May 21 21:37:09.124718 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f23434e4-b3d7-4115-af9b-9de4427581a5 req-aca8faf8-288e-4efe-9502-db35ddd05796 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034725 May 21 21:37:09.125713 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2814/5509] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:37:09.237790 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d0714563-abc0-43ca-bd04-d93493eabb89 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:09.241393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d0714563-abc0-43ca-bd04-d93493eabb89 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:09.252504 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d0714563-abc0-43ca-bd04-d93493eabb89 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:09.253101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d0714563-abc0-43ca-bd04-d93493eabb89 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:09.253976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d0714563-abc0-43ca-bd04-d93493eabb89 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:09.254681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d0714563-abc0-43ca-bd04-d93493eabb89 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:09.784466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d0714563-abc0-43ca-bd04-d93493eabb89 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:09.794382 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d0714563-abc0-43ca-bd04-d93493eabb89 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15" status: 200 len: 1314 microversion: 2.1 time: 0.572579 May 21 21:37:09.818129 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2815/5510] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:09 2022] GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:09.828434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-18379318-7a3b-4639-bc81-89f829db4b88 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:09.829934 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-18379318-7a3b-4639-bc81-89f829db4b88 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:09.840106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-18379318-7a3b-4639-bc81-89f829db4b88 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:09.840570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-18379318-7a3b-4639-bc81-89f829db4b88 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:09.841410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-18379318-7a3b-4639-bc81-89f829db4b88 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:09.841856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-18379318-7a3b-4639-bc81-89f829db4b88 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:09.863241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-5a10f782-d5ce-40a0-b69d-07452a035bc4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:37:09.864241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-5a10f782-d5ce-40a0-b69d-07452a035bc4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:37:09.864982 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-5a10f782-d5ce-40a0-b69d-07452a035bc4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:37:09.865399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-5a10f782-d5ce-40a0-b69d-07452a035bc4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:37:09.866018 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-5a10f782-d5ce-40a0-b69d-07452a035bc4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:37:09.882073 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5a10f782-d5ce-40a0-b69d-07452a035bc4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:09.882530 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5a10f782-d5ce-40a0-b69d-07452a035bc4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:09.885146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5a10f782-d5ce-40a0-b69d-07452a035bc4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:09.888105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5a10f782-d5ce-40a0-b69d-07452a035bc4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:09.923917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-5a10f782-d5ce-40a0-b69d-07452a035bc4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Getting quotas for project ee4ecc5a231c4c9ea359633525a20502. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:37:09.930582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-5a10f782-d5ce-40a0-b69d-07452a035bc4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Getting quotas for user 9cd1068bb25d4b8da52490826a11eeba and project ee4ecc5a231c4c9ea359633525a20502. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:37:09.950811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5a10f782-d5ce-40a0-b69d-07452a035bc4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:37:09.955186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5a10f782-d5ce-40a0-b69d-07452a035bc4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:37:10.083778 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5a10f782-d5ce-40a0-b69d-07452a035bc4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.633341 May 21 21:37:10.086055 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2696/5511] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:37:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 21 21:37:10.095959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7d75b1be-244f-4d0c-a732-186f61594c2f tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:10.096621 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7d75b1be-244f-4d0c-a732-186f61594c2f tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:10.183561 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7d75b1be-244f-4d0c-a732-186f61594c2f tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741" status: 200 len: 1329 microversion: 2.1 time: 0.090553 May 21 21:37:10.184479 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2697/5512] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:10 2022] GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 => generated 1329 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:37:10.345920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-18379318-7a3b-4639-bc81-89f829db4b88 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:10.354104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-18379318-7a3b-4639-bc81-89f829db4b88 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:10.356406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-18379318-7a3b-4639-bc81-89f829db4b88 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:10.357634 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-18379318-7a3b-4639-bc81-89f829db4b88 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1730 microversion: 2.20 time: 0.536218 May 21 21:37:10.368414 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2816/5513] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:37:09 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1730 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:37:10.814456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0595b453-3260-4f6c-995b-826ed01acebc tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:10.815294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0595b453-3260-4f6c-995b-826ed01acebc tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:10.832037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0595b453-3260-4f6c-995b-826ed01acebc tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:10.832037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0595b453-3260-4f6c-995b-826ed01acebc tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:10.832716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0595b453-3260-4f6c-995b-826ed01acebc tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:10.836913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0595b453-3260-4f6c-995b-826ed01acebc tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:11.203102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9b77a089-9bc2-4a00-8e13-abae6f95f2dc tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:11.206988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9b77a089-9bc2-4a00-8e13-abae6f95f2dc tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:11.242381 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0595b453-3260-4f6c-995b-826ed01acebc tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:11.255694 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0595b453-3260-4f6c-995b-826ed01acebc tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15" status: 200 len: 1314 microversion: 2.1 time: 0.447857 May 21 21:37:11.256680 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2698/5514] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:10 2022] GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:11.286798 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9b77a089-9bc2-4a00-8e13-abae6f95f2dc tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741" status: 200 len: 1329 microversion: 2.1 time: 0.089663 May 21 21:37:11.288480 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2817/5515] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:11 2022] GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 => generated 1329 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:11.378274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3f85b462-c33f-412f-9c5c-205892dbf9d0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:11.378915 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3f85b462-c33f-412f-9c5c-205892dbf9d0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:11.385398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f85b462-c33f-412f-9c5c-205892dbf9d0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:11.386891 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f85b462-c33f-412f-9c5c-205892dbf9d0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:11.387863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f85b462-c33f-412f-9c5c-205892dbf9d0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:11.388531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3f85b462-c33f-412f-9c5c-205892dbf9d0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:11.645901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3f85b462-c33f-412f-9c5c-205892dbf9d0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:11.659138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3f85b462-c33f-412f-9c5c-205892dbf9d0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:11.661217 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3f85b462-c33f-412f-9c5c-205892dbf9d0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:11.663079 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3f85b462-c33f-412f-9c5c-205892dbf9d0 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1717 microversion: 2.20 time: 0.290554 May 21 21:37:11.676782 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2699/5516] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:37:11 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1717 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 21 21:37:12.274346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ffd38988-c70b-4132-91ba-de06e692e1ab tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:12.276098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ffd38988-c70b-4132-91ba-de06e692e1ab tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:12.287162 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffd38988-c70b-4132-91ba-de06e692e1ab tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:12.287857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffd38988-c70b-4132-91ba-de06e692e1ab tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:12.288986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffd38988-c70b-4132-91ba-de06e692e1ab tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:12.289748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffd38988-c70b-4132-91ba-de06e692e1ab tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:12.306732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d594e7c3-7294-48c9-9c15-d70c2c8ca045 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:12.308765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d594e7c3-7294-48c9-9c15-d70c2c8ca045 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:12.325661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d594e7c3-7294-48c9-9c15-d70c2c8ca045 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:12.328622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d594e7c3-7294-48c9-9c15-d70c2c8ca045 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:12.329767 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d594e7c3-7294-48c9-9c15-d70c2c8ca045 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:12.333155 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d594e7c3-7294-48c9-9c15-d70c2c8ca045 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:12.514174 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d594e7c3-7294-48c9-9c15-d70c2c8ca045 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741" status: 200 len: 1416 microversion: 2.1 time: 0.213993 May 21 21:37:12.515486 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2700/5517] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:12 2022] GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 => generated 1416 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:12.648655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ffd38988-c70b-4132-91ba-de06e692e1ab tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:12.660924 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ffd38988-c70b-4132-91ba-de06e692e1ab tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15" status: 200 len: 1497 microversion: 2.1 time: 0.390002 May 21 21:37:12.662154 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2818/5518] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:12 2022] GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 => generated 1497 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:13.531879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-efef7133-f0d6-42d4-bb30-7e9430265c07 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:13.533340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-efef7133-f0d6-42d4-bb30-7e9430265c07 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:13.541106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efef7133-f0d6-42d4-bb30-7e9430265c07 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:13.541835 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efef7133-f0d6-42d4-bb30-7e9430265c07 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:13.543924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efef7133-f0d6-42d4-bb30-7e9430265c07 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:13.544679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efef7133-f0d6-42d4-bb30-7e9430265c07 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:13.576616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0a523397-e821-4c36-8dab-ebd821a34060 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:13.578091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0a523397-e821-4c36-8dab-ebd821a34060 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:13.585970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a523397-e821-4c36-8dab-ebd821a34060 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:13.586426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a523397-e821-4c36-8dab-ebd821a34060 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:13.587345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a523397-e821-4c36-8dab-ebd821a34060 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:13.588005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a523397-e821-4c36-8dab-ebd821a34060 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:13.617111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0a523397-e821-4c36-8dab-ebd821a34060 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:37:13.717382 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-efef7133-f0d6-42d4-bb30-7e9430265c07 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741" status: 200 len: 1422 microversion: 2.1 time: 0.189651 May 21 21:37:13.727470 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2701/5519] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:13 2022] GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 => generated 1422 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:13.966610 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0a523397-e821-4c36-8dab-ebd821a34060 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15" status: 204 len: 0 microversion: 2.1 time: 0.397495 May 21 21:37:13.970359 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2819/5520] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:37:13 2022] DELETE /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 21:37:13.975787 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fe0e0e81-5b60-4eb1-8bc6-0f54f7bd9762 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:13.976450 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fe0e0e81-5b60-4eb1-8bc6-0f54f7bd9762 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:13.983371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fe0e0e81-5b60-4eb1-8bc6-0f54f7bd9762 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:13.983831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fe0e0e81-5b60-4eb1-8bc6-0f54f7bd9762 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:13.984800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fe0e0e81-5b60-4eb1-8bc6-0f54f7bd9762 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:13.985432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fe0e0e81-5b60-4eb1-8bc6-0f54f7bd9762 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:13.997866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:37:14.409715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fe0e0e81-5b60-4eb1-8bc6-0f54f7bd9762 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:14.419600 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fe0e0e81-5b60-4eb1-8bc6-0f54f7bd9762 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15" status: 200 len: 1503 microversion: 2.1 time: 0.447947 May 21 21:37:14.420202 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2702/5521] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:13 2022] GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 => generated 1503 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:14.738746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8332d41c-538b-46f2-95d7-38d983fa4521 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:14.740614 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8332d41c-538b-46f2-95d7-38d983fa4521 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:14.750673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8332d41c-538b-46f2-95d7-38d983fa4521 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:14.751268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8332d41c-538b-46f2-95d7-38d983fa4521 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:14.752328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8332d41c-538b-46f2-95d7-38d983fa4521 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:14.753004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8332d41c-538b-46f2-95d7-38d983fa4521 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:14.933418 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8332d41c-538b-46f2-95d7-38d983fa4521 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741" status: 200 len: 1464 microversion: 2.1 time: 0.201358 May 21 21:37:14.943301 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2820/5522] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:14 2022] GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 => generated 1464 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:37:15.437589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c248d95b-aa95-43fe-9f1f-43da76ea8829 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:15.439016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c248d95b-aa95-43fe-9f1f-43da76ea8829 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:15.455341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c248d95b-aa95-43fe-9f1f-43da76ea8829 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:15.456062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c248d95b-aa95-43fe-9f1f-43da76ea8829 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:15.457173 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c248d95b-aa95-43fe-9f1f-43da76ea8829 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:15.457967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c248d95b-aa95-43fe-9f1f-43da76ea8829 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:15.934135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c248d95b-aa95-43fe-9f1f-43da76ea8829 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:15.945566 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c248d95b-aa95-43fe-9f1f-43da76ea8829 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15" status: 200 len: 1503 microversion: 2.1 time: 0.512632 May 21 21:37:15.946817 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2703/5523] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:15 2022] GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 => generated 1503 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:15.950073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f4069488-149b-4dfa-860a-4ab317aed93b tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:15.950672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f4069488-149b-4dfa-860a-4ab317aed93b tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:15.957608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4069488-149b-4dfa-860a-4ab317aed93b tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:15.958050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4069488-149b-4dfa-860a-4ab317aed93b tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:15.973602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4069488-149b-4dfa-860a-4ab317aed93b tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:15.974504 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4069488-149b-4dfa-860a-4ab317aed93b tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:16.282363 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f4069488-149b-4dfa-860a-4ab317aed93b tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741" status: 200 len: 1464 microversion: 2.1 time: 0.336231 May 21 21:37:16.282962 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2821/5524] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:15 2022] GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 => generated 1464 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:37:16.973977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a07effd4-00dd-4b58-bb8d-0dd9b2a830ed tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:16.975220 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a07effd4-00dd-4b58-bb8d-0dd9b2a830ed tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:16.985948 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a07effd4-00dd-4b58-bb8d-0dd9b2a830ed tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:16.986614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a07effd4-00dd-4b58-bb8d-0dd9b2a830ed tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:16.987399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a07effd4-00dd-4b58-bb8d-0dd9b2a830ed tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:16.987832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a07effd4-00dd-4b58-bb8d-0dd9b2a830ed tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:17.299546 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ad402a75-ba42-45f6-bf4d-b2ff9b7a07a6 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:17.301030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ad402a75-ba42-45f6-bf4d-b2ff9b7a07a6 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:17.314976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad402a75-ba42-45f6-bf4d-b2ff9b7a07a6 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:17.320988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad402a75-ba42-45f6-bf4d-b2ff9b7a07a6 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:17.322060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad402a75-ba42-45f6-bf4d-b2ff9b7a07a6 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:17.322877 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad402a75-ba42-45f6-bf4d-b2ff9b7a07a6 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:17.591414 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ad402a75-ba42-45f6-bf4d-b2ff9b7a07a6 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741" status: 200 len: 1464 microversion: 2.1 time: 0.295756 May 21 21:37:17.592003 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2822/5525] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:17 2022] GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 => generated 1464 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:17.632186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a07effd4-00dd-4b58-bb8d-0dd9b2a830ed tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:17.640981 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a07effd4-00dd-4b58-bb8d-0dd9b2a830ed tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15" status: 200 len: 1503 microversion: 2.1 time: 0.671638 May 21 21:37:17.641911 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2704/5526] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:16 2022] GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 => generated 1503 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:17.824562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-35c19906-b145-45f7-873c-f333cb5a8013 req-6dcb8f6e-3572-4176-81a0-c634da15f268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fac7b33-2e5f-40a9-9bd6-4e23eba62e15", "name": "network-vif-deleted", "tag": "a597f33c-81dc-4037-a790-18ce0c99ee17"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:37:17.833238 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-35c19906-b145-45f7-873c-f333cb5a8013 req-6dcb8f6e-3572-4176-81a0-c634da15f268 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:17.833768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-35c19906-b145-45f7-873c-f333cb5a8013 req-6dcb8f6e-3572-4176-81a0-c634da15f268 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:17.848383 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-35c19906-b145-45f7-873c-f333cb5a8013 req-6dcb8f6e-3572-4176-81a0-c634da15f268 service nova] Creating event network-vif-deleted:a597f33c-81dc-4037-a790-18ce0c99ee17 for instance 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 on nch2-master-1 May 21 21:37:17.853748 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-35c19906-b145-45f7-873c-f333cb5a8013 req-6dcb8f6e-3572-4176-81a0-c634da15f268 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034036 May 21 21:37:17.855672 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2823/5527] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:37:18.608825 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-426027b0-a3dc-456a-b0df-ba4cf7282f53 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:18.609439 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-426027b0-a3dc-456a-b0df-ba4cf7282f53 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:18.617609 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-426027b0-a3dc-456a-b0df-ba4cf7282f53 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:18.618246 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-426027b0-a3dc-456a-b0df-ba4cf7282f53 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:18.619030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-426027b0-a3dc-456a-b0df-ba4cf7282f53 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:18.619523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-426027b0-a3dc-456a-b0df-ba4cf7282f53 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:18.661140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-165acf39-0b25-496e-95c3-0ae5dc8abfe8 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:18.661834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-165acf39-0b25-496e-95c3-0ae5dc8abfe8 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:18.672701 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-165acf39-0b25-496e-95c3-0ae5dc8abfe8 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:18.673145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-165acf39-0b25-496e-95c3-0ae5dc8abfe8 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:18.674105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-165acf39-0b25-496e-95c3-0ae5dc8abfe8 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:18.674541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-165acf39-0b25-496e-95c3-0ae5dc8abfe8 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:18.693167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:37:18.713345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-165acf39-0b25-496e-95c3-0ae5dc8abfe8 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:18.714087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-165acf39-0b25-496e-95c3-0ae5dc8abfe8 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:18.714802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-165acf39-0b25-496e-95c3-0ae5dc8abfe8 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lazy-loading 'fault' on Instance uuid 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:37:18.773071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-165acf39-0b25-496e-95c3-0ae5dc8abfe8 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991088a86b78431a96c0d4f69035e791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadf0c028b4441b0871d6c484ed30418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:18.783890 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-165acf39-0b25-496e-95c3-0ae5dc8abfe8 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15" status: 200 len: 1304 microversion: 2.1 time: 0.128147 May 21 21:37:18.790213 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2824/5528] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:18 2022] GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 => generated 1304 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:19.130852 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-426027b0-a3dc-456a-b0df-ba4cf7282f53 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741" status: 200 len: 1464 microversion: 2.1 time: 0.526400 May 21 21:37:19.132677 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2705/5529] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:18 2022] GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 => generated 1464 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:19.802679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a6c76878-9d78-447a-8f8d-d863bbf14f06 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:19.803972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a6c76878-9d78-447a-8f8d-d863bbf14f06 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] [instance: 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:19.813295 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a6c76878-9d78-447a-8f8d-d863bbf14f06 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:19.813763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a6c76878-9d78-447a-8f8d-d863bbf14f06 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:19.814776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a6c76878-9d78-447a-8f8d-d863bbf14f06 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:19.815225 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a6c76878-9d78-447a-8f8d-d863bbf14f06 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:19.830328 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-a6c76878-9d78-447a-8f8d-d863bbf14f06 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] HTTP exception thrown: Instance 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 could not be found. May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a6c76878-9d78-447a-8f8d-d863bbf14f06 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Request method failure captured: May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 HTTP/1.1 May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVtLgVyYWorsYRmQw3_4XAmY3bk8UsBgKsDi0XV7jkrVFvNqxhwo-ovhNES2WoXaj2GfhP5GtNBL7zEr_SMhItIyyygqmrPjRCDPZTYa7eS8ICClnrm1whLtMjo7k5BtdvPhp-LRWH_EALU-LMV3KeXrbp__nNTOqdelvFlXNTZ55E4 May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: dadf0c028b4441b0871d6c484ed30418 May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-VolumesActionsTest-344293892 May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dadf0c028b4441b0871d6c484ed30418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dadf0c028b4441b0871d6c484ed30418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dadf0c028b4441b0871d6c484ed30418", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dadf0c028b4441b0871d6c484ed30418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-VolumesActionsTest-344293892 May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: dadf0c028b4441b0871d6c484ed30418 May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-VolumesActionsTest-344293892 May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-VolumesActionsTest-344293892-project May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 991088a86b78431a96c0d4f69035e791 May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-VolumesActionsTest-344293892-project May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 could not be found. May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '5fac7b33-2e5f-40a9-9bd6-4e23eba62e15'} May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 could not be found. May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 could not be found. May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:37:19.832168 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:37:19.842300 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:37:19.842300 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:37:19.842300 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:37:19.842300 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:37:19.842300 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:37:19.842300 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 could not be found. May 21 21:37:19.842300 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:37:19.842300 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a6c76878-9d78-447a-8f8d-d863bbf14f06 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] Returning 404 to user: Instance 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:37:19.842300 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a6c76878-9d78-447a-8f8d-d863bbf14f06 tempest-VolumesActionsTest-344293892 tempest-VolumesActionsTest-344293892-project] 10.222.0.49 "GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15" status: 404 len: 111 microversion: 2.1 time: 0.035652 May 21 21:37:19.842300 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2825/5530] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:19 2022] GET /compute/v2.1/servers/5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:37:19.871443 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-8327cad0-030f-4476-a854-c49e615c318a req-2518f20a-4686-478c-87b6-7d69a18e7864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "323b4746-cee2-481b-8c02-972910cab741", "tag": "61848ef5-e786-49c8-a93d-e18073292a34"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:37:19.881187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-8327cad0-030f-4476-a854-c49e615c318a req-2518f20a-4686-478c-87b6-7d69a18e7864 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:19.881937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-8327cad0-030f-4476-a854-c49e615c318a req-2518f20a-4686-478c-87b6-7d69a18e7864 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:19.895412 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-8327cad0-030f-4476-a854-c49e615c318a req-2518f20a-4686-478c-87b6-7d69a18e7864 service nova] Creating event network-changed:61848ef5-e786-49c8-a93d-e18073292a34 for instance 323b4746-cee2-481b-8c02-972910cab741 on nch2-master-1 May 21 21:37:19.901849 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-8327cad0-030f-4476-a854-c49e615c318a req-2518f20a-4686-478c-87b6-7d69a18e7864 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033646 May 21 21:37:19.905709 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2706/5531] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:37:20.163005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f27b1163-a00a-4b40-81f1-0ea5c7bb0e6d tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:20.164675 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f27b1163-a00a-4b40-81f1-0ea5c7bb0e6d tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:20.173982 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f27b1163-a00a-4b40-81f1-0ea5c7bb0e6d tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:20.174428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f27b1163-a00a-4b40-81f1-0ea5c7bb0e6d tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:20.175239 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f27b1163-a00a-4b40-81f1-0ea5c7bb0e6d tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:20.179838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f27b1163-a00a-4b40-81f1-0ea5c7bb0e6d tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:20.502436 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f27b1163-a00a-4b40-81f1-0ea5c7bb0e6d tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741" status: 200 len: 1464 microversion: 2.1 time: 0.352812 May 21 21:37:20.506514 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2826/5532] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:20 2022] GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 => generated 1464 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:37:21.526758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ee09d384-1c39-4ae2-9040-1bb5669c078a tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:21.528500 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ee09d384-1c39-4ae2-9040-1bb5669c078a tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:21.531530 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:37:21.532785 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=8 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:37:21.543495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee09d384-1c39-4ae2-9040-1bb5669c078a tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:21.546320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee09d384-1c39-4ae2-9040-1bb5669c078a tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:21.546320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee09d384-1c39-4ae2-9040-1bb5669c078a tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:21.546320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee09d384-1c39-4ae2-9040-1bb5669c078a tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:21.824928 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ee09d384-1c39-4ae2-9040-1bb5669c078a tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741" status: 200 len: 1464 microversion: 2.1 time: 0.306545 May 21 21:37:21.826026 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2707/5533] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:21 2022] GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 => generated 1464 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:22.861266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-849150b4-8533-4eb3-bfa4-78b65335a239 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:22.862720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-849150b4-8533-4eb3-bfa4-78b65335a239 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:22.871600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:37:22.874893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-849150b4-8533-4eb3-bfa4-78b65335a239 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:22.875870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-849150b4-8533-4eb3-bfa4-78b65335a239 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:22.877142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-849150b4-8533-4eb3-bfa4-78b65335a239 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:22.877895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-849150b4-8533-4eb3-bfa4-78b65335a239 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:23.282637 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-849150b4-8533-4eb3-bfa4-78b65335a239 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741" status: 200 len: 1464 microversion: 2.1 time: 0.429610 May 21 21:37:23.283249 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2827/5534] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:22 2022] GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 => generated 1464 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:23.658032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-bd76499c-9b74-4937-8e02-e6c0932f4596 req-4bbce9b5-a5a8-412c-8446-c379f846e6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323b4746-cee2-481b-8c02-972910cab741", "name": "network-vif-plugged", "status": "completed", "tag": "61848ef5-e786-49c8-a93d-e18073292a34"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:37:23.705662 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-bd76499c-9b74-4937-8e02-e6c0932f4596 req-4bbce9b5-a5a8-412c-8446-c379f846e6c7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:23.706120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-bd76499c-9b74-4937-8e02-e6c0932f4596 req-4bbce9b5-a5a8-412c-8446-c379f846e6c7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:23.759139 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-bd76499c-9b74-4937-8e02-e6c0932f4596 req-4bbce9b5-a5a8-412c-8446-c379f846e6c7 service nova] Creating event network-vif-plugged:61848ef5-e786-49c8-a93d-e18073292a34 for instance 323b4746-cee2-481b-8c02-972910cab741 on nch2-master-1 May 21 21:37:23.770688 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-bd76499c-9b74-4937-8e02-e6c0932f4596 req-4bbce9b5-a5a8-412c-8446-c379f846e6c7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116808 May 21 21:37:23.774759 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2708/5535] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:37:24.302513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0e6e354c-4805-4797-929e-8a63940f3ebd tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:24.304231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0e6e354c-4805-4797-929e-8a63940f3ebd tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:24.321430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e6e354c-4805-4797-929e-8a63940f3ebd tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:24.334757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e6e354c-4805-4797-929e-8a63940f3ebd tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:24.338062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e6e354c-4805-4797-929e-8a63940f3ebd tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:24.346284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e6e354c-4805-4797-929e-8a63940f3ebd tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:24.727323 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0e6e354c-4805-4797-929e-8a63940f3ebd tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741" status: 200 len: 1464 microversion: 2.1 time: 0.430179 May 21 21:37:24.728520 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2828/5536] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:24 2022] GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 => generated 1464 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:25.752211 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e9c8fb12-3a3a-40da-a389-d17b31997adf tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:25.753375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e9c8fb12-3a3a-40da-a389-d17b31997adf tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:25.770385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9c8fb12-3a3a-40da-a389-d17b31997adf tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:25.771183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9c8fb12-3a3a-40da-a389-d17b31997adf tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:25.772190 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9c8fb12-3a3a-40da-a389-d17b31997adf tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:25.772834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9c8fb12-3a3a-40da-a389-d17b31997adf tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:26.093548 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e9c8fb12-3a3a-40da-a389-d17b31997adf tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741" status: 200 len: 1649 microversion: 2.1 time: 0.346707 May 21 21:37:26.105794 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2709/5537] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:25 2022] GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 => generated 1649 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:26.111872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-15524a3d-5511-4d2d-baae-0e858e04a382 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:26.113164 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-15524a3d-5511-4d2d-baae-0e858e04a382 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:26.120203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:37:26.122972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15524a3d-5511-4d2d-baae-0e858e04a382 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:26.124423 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15524a3d-5511-4d2d-baae-0e858e04a382 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:26.126309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15524a3d-5511-4d2d-baae-0e858e04a382 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:26.127084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15524a3d-5511-4d2d-baae-0e858e04a382 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:27.161449 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-15524a3d-5511-4d2d-baae-0e858e04a382 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741" status: 200 len: 1649 microversion: 2.1 time: 1.052528 May 21 21:37:27.164833 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2829/5538] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:26 2022] GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 => generated 1649 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:27.191639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0d25c1bc-71a5-438a-bb06-cb292510e62f tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:27.192931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0d25c1bc-71a5-438a-bb06-cb292510e62f tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:27.211661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d25c1bc-71a5-438a-bb06-cb292510e62f tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:27.212856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d25c1bc-71a5-438a-bb06-cb292510e62f tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:27.213905 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d25c1bc-71a5-438a-bb06-cb292510e62f tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:27.214528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0d25c1bc-71a5-438a-bb06-cb292510e62f tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:27.435735 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0d25c1bc-71a5-438a-bb06-cb292510e62f tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741" status: 200 len: 1649 microversion: 2.1 time: 0.253577 May 21 21:37:27.436798 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2710/5539] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:27 2022] GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 => generated 1649 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:27.454707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0634b571-c620-4e14-844b-0eada796c57a tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:27.455565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0634b571-c620-4e14-844b-0eada796c57a tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:27.473231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0634b571-c620-4e14-844b-0eada796c57a tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:27.474348 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0634b571-c620-4e14-844b-0eada796c57a tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:27.475600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0634b571-c620-4e14-844b-0eada796c57a tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:27.476365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0634b571-c620-4e14-844b-0eada796c57a tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:27.555599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0634b571-c620-4e14-844b-0eada796c57a tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:37:28.052197 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0634b571-c620-4e14-844b-0eada796c57a tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "DELETE /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741" status: 204 len: 0 microversion: 2.1 time: 0.602299 May 21 21:37:28.053558 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2830/5540] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:37:27 2022] DELETE /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:37:28.066611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8e8fa578-4d83-4ae7-8db2-79e773280c22 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:28.067880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8e8fa578-4d83-4ae7-8db2-79e773280c22 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:28.085264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e8fa578-4d83-4ae7-8db2-79e773280c22 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:28.086533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e8fa578-4d83-4ae7-8db2-79e773280c22 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:28.087641 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e8fa578-4d83-4ae7-8db2-79e773280c22 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:28.089201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e8fa578-4d83-4ae7-8db2-79e773280c22 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:28.763216 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8e8fa578-4d83-4ae7-8db2-79e773280c22 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741" status: 200 len: 1655 microversion: 2.1 time: 0.698017 May 21 21:37:28.763216 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2711/5541] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:28 2022] GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 => generated 1655 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:29.777670 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9d73bceb-920b-4631-a48d-9d3e4bd902a4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:29.778379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9d73bceb-920b-4631-a48d-9d3e4bd902a4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:29.803839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d73bceb-920b-4631-a48d-9d3e4bd902a4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:29.805250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d73bceb-920b-4631-a48d-9d3e4bd902a4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:29.809232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d73bceb-920b-4631-a48d-9d3e4bd902a4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:29.810506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d73bceb-920b-4631-a48d-9d3e4bd902a4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:30.178445 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9d73bceb-920b-4631-a48d-9d3e4bd902a4 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741" status: 200 len: 1655 microversion: 2.1 time: 0.404891 May 21 21:37:30.182384 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2831/5542] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:29 2022] GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 => generated 1655 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:31.196132 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-da159f6d-2f62-4da1-9fab-a1b27226c49b tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:31.202197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-da159f6d-2f62-4da1-9fab-a1b27226c49b tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:31.240049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da159f6d-2f62-4da1-9fab-a1b27226c49b tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:31.241130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da159f6d-2f62-4da1-9fab-a1b27226c49b tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:31.243056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da159f6d-2f62-4da1-9fab-a1b27226c49b tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:31.245494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da159f6d-2f62-4da1-9fab-a1b27226c49b tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:31.487869 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-da159f6d-2f62-4da1-9fab-a1b27226c49b tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741" status: 200 len: 1613 microversion: 2.1 time: 0.296671 May 21 21:37:31.495005 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2712/5543] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:31 2022] GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 => generated 1613 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:31.593548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-e8a251a1-8a9c-4acb-bc5b-51c7ffe01d79 req-4598392b-e884-4d9c-93e5-6e5e2a8bf66b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323b4746-cee2-481b-8c02-972910cab741", "name": "network-vif-deleted", "tag": "61848ef5-e786-49c8-a93d-e18073292a34"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:37:31.630419 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-e8a251a1-8a9c-4acb-bc5b-51c7ffe01d79 req-4598392b-e884-4d9c-93e5-6e5e2a8bf66b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:31.636346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-e8a251a1-8a9c-4acb-bc5b-51c7ffe01d79 req-4598392b-e884-4d9c-93e5-6e5e2a8bf66b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:31.708849 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-e8a251a1-8a9c-4acb-bc5b-51c7ffe01d79 req-4598392b-e884-4d9c-93e5-6e5e2a8bf66b service nova] Creating event network-vif-deleted:61848ef5-e786-49c8-a93d-e18073292a34 for instance 323b4746-cee2-481b-8c02-972910cab741 on nch2-master-1 May 21 21:37:31.721049 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-e8a251a1-8a9c-4acb-bc5b-51c7ffe01d79 req-4598392b-e884-4d9c-93e5-6e5e2a8bf66b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132539 May 21 21:37:31.737850 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2832/5544] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:37:32.512469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a950f3c1-bac2-4244-9c16-6d70be73c8a3 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:32.515909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a950f3c1-bac2-4244-9c16-6d70be73c8a3 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:32.535786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a950f3c1-bac2-4244-9c16-6d70be73c8a3 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:32.536251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a950f3c1-bac2-4244-9c16-6d70be73c8a3 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:32.550319 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a950f3c1-bac2-4244-9c16-6d70be73c8a3 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:32.551497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a950f3c1-bac2-4244-9c16-6d70be73c8a3 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:32.611632 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a950f3c1-bac2-4244-9c16-6d70be73c8a3 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:32.611632 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a950f3c1-bac2-4244-9c16-6d70be73c8a3 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:32.611632 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-a950f3c1-bac2-4244-9c16-6d70be73c8a3 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lazy-loading 'fault' on Instance uuid 323b4746-cee2-481b-8c02-972910cab741 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:37:32.776843 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a950f3c1-bac2-4244-9c16-6d70be73c8a3 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741" status: 200 len: 1454 microversion: 2.1 time: 0.269478 May 21 21:37:32.780744 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2713/5545] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:32 2022] GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 => generated 1454 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:33.796067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ee4fe591-a776-4538-b13e-04a40f23e794 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:33.796693 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ee4fe591-a776-4538-b13e-04a40f23e794 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 323b4746-cee2-481b-8c02-972910cab741] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:33.815364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee4fe591-a776-4538-b13e-04a40f23e794 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:33.818976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee4fe591-a776-4538-b13e-04a40f23e794 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:33.824647 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee4fe591-a776-4538-b13e-04a40f23e794 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:33.825364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee4fe591-a776-4538-b13e-04a40f23e794 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:33.902669 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-ee4fe591-a776-4538-b13e-04a40f23e794 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] HTTP exception thrown: Instance 323b4746-cee2-481b-8c02-972910cab741 could not be found. May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ee4fe591-a776-4538-b13e-04a40f23e794 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Request method failure captured: May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 HTTP/1.1 May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVtpgb8taVS53VIKgE8F9CFhHgGXd22ita4K_BCPovpDROUE00x8h0tjgg1CnEwj4Mzf43vvGByJOszNASXD6J06WahNa0Qx1wLxYbgovcOXHbaV3ehGVvNneJMZDzfsRHICQPcf5iOykFJANuqIUVZEr0c9PGjp-iuXp7O6Cu8pHZM May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: ee4ecc5a231c4c9ea359633525a20502 May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-TestServerMultinode-993071324 May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ee4ecc5a231c4c9ea359633525a20502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ee4ecc5a231c4c9ea359633525a20502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ee4ecc5a231c4c9ea359633525a20502", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ee4ecc5a231c4c9ea359633525a20502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-TestServerMultinode-993071324 May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: ee4ecc5a231c4c9ea359633525a20502 May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-TestServerMultinode-993071324 May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-TestServerMultinode-993071324-project-admin May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 9cd1068bb25d4b8da52490826a11eeba May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-TestServerMultinode-993071324-project-admin May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 323b4746-cee2-481b-8c02-972910cab741 could not be found. May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '323b4746-cee2-481b-8c02-972910cab741'} May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 323b4746-cee2-481b-8c02-972910cab741 could not be found. May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 323b4746-cee2-481b-8c02-972910cab741 could not be found. May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:37:33.918444 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:37:33.933765 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:37:33.933765 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:37:33.933765 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:37:33.933765 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:37:33.933765 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:37:33.933765 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 323b4746-cee2-481b-8c02-972910cab741 could not be found. May 21 21:37:33.933765 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:37:33.933765 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ee4fe591-a776-4538-b13e-04a40f23e794 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Returning 404 to user: Instance 323b4746-cee2-481b-8c02-972910cab741 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:37:33.933765 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ee4fe591-a776-4538-b13e-04a40f23e794 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741" status: 404 len: 111 microversion: 2.1 time: 0.133677 May 21 21:37:33.937565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c0a0a945-f670-4107-9e4c-9bb65de9db69 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:33.938064 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c0a0a945-f670-4107-9e4c-9bb65de9db69 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:33.940600 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2833/5546] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:33 2022] GET /compute/v2.1/servers/323b4746-cee2-481b-8c02-972910cab741 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:37:33.961731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c0a0a945-f670-4107-9e4c-9bb65de9db69 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:33.964518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c0a0a945-f670-4107-9e4c-9bb65de9db69 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:33.965360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c0a0a945-f670-4107-9e4c-9bb65de9db69 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:33.965803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c0a0a945-f670-4107-9e4c-9bb65de9db69 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:34.057859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c0a0a945-f670-4107-9e4c-9bb65de9db69 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:37:34.476275 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c0a0a945-f670-4107-9e4c-9bb65de9db69 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "DELETE /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 204 len: 0 microversion: 2.1 time: 0.542483 May 21 21:37:34.480866 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2714/5547] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:37:33 2022] DELETE /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:37:34.490367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-24681ec4-1334-4ef3-869c-95569af73dd8 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:34.490367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-24681ec4-1334-4ef3-869c-95569af73dd8 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:34.504582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24681ec4-1334-4ef3-869c-95569af73dd8 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:34.506327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24681ec4-1334-4ef3-869c-95569af73dd8 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:34.512255 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24681ec4-1334-4ef3-869c-95569af73dd8 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:34.512958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24681ec4-1334-4ef3-869c-95569af73dd8 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:35.259131 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-24681ec4-1334-4ef3-869c-95569af73dd8 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1654 microversion: 2.1 time: 0.776591 May 21 21:37:35.278613 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2834/5548] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:34 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1654 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:36.289354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-787c7ffe-7b4a-47af-a98a-19e921d6cc74 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:36.294435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-787c7ffe-7b4a-47af-a98a-19e921d6cc74 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:36.307109 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-787c7ffe-7b4a-47af-a98a-19e921d6cc74 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:36.309733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-787c7ffe-7b4a-47af-a98a-19e921d6cc74 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:36.309733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-787c7ffe-7b4a-47af-a98a-19e921d6cc74 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:36.310904 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-787c7ffe-7b4a-47af-a98a-19e921d6cc74 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:36.564992 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-787c7ffe-7b4a-47af-a98a-19e921d6cc74 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1654 microversion: 2.1 time: 0.282571 May 21 21:37:36.580036 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2715/5549] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:36 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1654 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:37.589888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d07a2ade-0fd7-4e2b-8998-c32d4bdd99a9 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:37.592055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d07a2ade-0fd7-4e2b-8998-c32d4bdd99a9 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:37.622251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d07a2ade-0fd7-4e2b-8998-c32d4bdd99a9 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:37.622729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d07a2ade-0fd7-4e2b-8998-c32d4bdd99a9 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:37.645989 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d07a2ade-0fd7-4e2b-8998-c32d4bdd99a9 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:37.647119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d07a2ade-0fd7-4e2b-8998-c32d4bdd99a9 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:37.790366 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-5ca4dd84-5fcb-4b3e-8791-b398eb3286b6 req-da89afc1-b053-4032-a90b-7e100ee33088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24862fdd-22fe-4329-b5ac-de9813a4ecc7", "name": "network-vif-deleted", "tag": "5a6c8fdd-94b4-4ab9-9377-e9173824d4bf"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:37:37.799593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-5ca4dd84-5fcb-4b3e-8791-b398eb3286b6 req-da89afc1-b053-4032-a90b-7e100ee33088 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:37.800057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-5ca4dd84-5fcb-4b3e-8791-b398eb3286b6 req-da89afc1-b053-4032-a90b-7e100ee33088 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:37.839418 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d07a2ade-0fd7-4e2b-8998-c32d4bdd99a9 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 200 len: 1612 microversion: 2.1 time: 0.255826 May 21 21:37:37.844505 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2835/5550] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:37 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 1612 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:37.848246 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-5ca4dd84-5fcb-4b3e-8791-b398eb3286b6 req-da89afc1-b053-4032-a90b-7e100ee33088 service nova] Creating event network-vif-deleted:5a6c8fdd-94b4-4ab9-9377-e9173824d4bf for instance 24862fdd-22fe-4329-b5ac-de9813a4ecc7 on nch1-master-1 May 21 21:37:37.871264 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-5ca4dd84-5fcb-4b3e-8791-b398eb3286b6 req-da89afc1-b053-4032-a90b-7e100ee33088 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084921 May 21 21:37:37.871406 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2716/5551] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:37:38.858860 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cd51359b-ace4-4c67-ab94-dcb029ad2e37 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:38.860129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cd51359b-ace4-4c67-ab94-dcb029ad2e37 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] [instance: 24862fdd-22fe-4329-b5ac-de9813a4ecc7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:38.870665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd51359b-ace4-4c67-ab94-dcb029ad2e37 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:38.885612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd51359b-ace4-4c67-ab94-dcb029ad2e37 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:38.885612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd51359b-ace4-4c67-ab94-dcb029ad2e37 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:38.885612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd51359b-ace4-4c67-ab94-dcb029ad2e37 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:38.929451 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-cd51359b-ace4-4c67-ab94-dcb029ad2e37 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] HTTP exception thrown: Instance 24862fdd-22fe-4329-b5ac-de9813a4ecc7 could not be found. May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cd51359b-ace4-4c67-ab94-dcb029ad2e37 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Request method failure captured: May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 HTTP/1.1 May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVtpgb8taVS53VIKgE8F9CFhHgGXd22ita4K_BCPovpDROUE00x8h0tjgg1CnEwj4Mzf43vvGByJOszNASXD6J06WahNa0Qx1wLxYbgovcOXHbaV3ehGVvNneJMZDzfsRHICQPcf5iOykFJANuqIUVZEr0c9PGjp-iuXp7O6Cu8pHZM May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: ee4ecc5a231c4c9ea359633525a20502 May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-TestServerMultinode-993071324 May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ee4ecc5a231c4c9ea359633525a20502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ee4ecc5a231c4c9ea359633525a20502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ee4ecc5a231c4c9ea359633525a20502", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ee4ecc5a231c4c9ea359633525a20502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-TestServerMultinode-993071324 May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: ee4ecc5a231c4c9ea359633525a20502 May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-TestServerMultinode-993071324 May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-TestServerMultinode-993071324-project-admin May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 9cd1068bb25d4b8da52490826a11eeba May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-TestServerMultinode-993071324-project-admin May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 24862fdd-22fe-4329-b5ac-de9813a4ecc7 could not be found. May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '24862fdd-22fe-4329-b5ac-de9813a4ecc7'} May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24862fdd-22fe-4329-b5ac-de9813a4ecc7 could not be found. May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24862fdd-22fe-4329-b5ac-de9813a4ecc7 could not be found. May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:37:38.941941 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:37:38.949042 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:37:38.949042 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:37:38.949042 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:37:38.949042 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:37:38.949042 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:37:38.949042 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24862fdd-22fe-4329-b5ac-de9813a4ecc7 could not be found. May 21 21:37:38.949042 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:37:38.952267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cd51359b-ace4-4c67-ab94-dcb029ad2e37 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] Returning 404 to user: Instance 24862fdd-22fe-4329-b5ac-de9813a4ecc7 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:37:38.959589 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cd51359b-ace4-4c67-ab94-dcb029ad2e37 tempest-TestServerMultinode-993071324 tempest-TestServerMultinode-993071324-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7" status: 404 len: 111 microversion: 2.1 time: 0.104771 May 21 21:37:38.963087 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2836/5552] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:37:38 2022] GET /compute/v2.1/servers/24862fdd-22fe-4329-b5ac-de9813a4ecc7 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:37:42.318976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-75fbbcd0-27a0-4483-8172-afdda33df51d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:42.320806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-75fbbcd0-27a0-4483-8172-afdda33df51d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:42.330430 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:37:42.333269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-75fbbcd0-27a0-4483-8172-afdda33df51d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:42.334160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-75fbbcd0-27a0-4483-8172-afdda33df51d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:42.335450 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-75fbbcd0-27a0-4483-8172-afdda33df51d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:42.337705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-75fbbcd0-27a0-4483-8172-afdda33df51d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:42.448196 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-75fbbcd0-27a0-4483-8172-afdda33df51d tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.135635 May 21 21:37:42.449286 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2717/5553] 10.222.0.49 () {60 vars in 1342 bytes} [Sat May 21 21:37:42 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7/os-volume_attachments => generated 25 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:37:42.536255 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f32c9cc0-967f-4c6e-899d-04fa405f6a09 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:42.540173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f32c9cc0-967f-4c6e-899d-04fa405f6a09 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:42.560451 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f32c9cc0-967f-4c6e-899d-04fa405f6a09 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:42.562735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f32c9cc0-967f-4c6e-899d-04fa405f6a09 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:42.562735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f32c9cc0-967f-4c6e-899d-04fa405f6a09 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:42.562735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f32c9cc0-967f-4c6e-899d-04fa405f6a09 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:42.628213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f32c9cc0-967f-4c6e-899d-04fa405f6a09 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:37:43.065707 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f32c9cc0-967f-4c6e-899d-04fa405f6a09 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 204 len: 0 microversion: 2.20 time: 0.533473 May 21 21:37:43.066656 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2837/5554] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:37:42 2022] DELETE /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:37:43.077220 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-72d6a3b4-2aa9-4d90-9fa7-27413f0f743f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:43.077887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-72d6a3b4-2aa9-4d90-9fa7-27413f0f743f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:43.107418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72d6a3b4-2aa9-4d90-9fa7-27413f0f743f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:43.111250 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72d6a3b4-2aa9-4d90-9fa7-27413f0f743f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:43.113582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72d6a3b4-2aa9-4d90-9fa7-27413f0f743f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:43.116329 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72d6a3b4-2aa9-4d90-9fa7-27413f0f743f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:43.909628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-72d6a3b4-2aa9-4d90-9fa7-27413f0f743f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:43.914665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:37:43.942903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-72d6a3b4-2aa9-4d90-9fa7-27413f0f743f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:43.954375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-72d6a3b4-2aa9-4d90-9fa7-27413f0f743f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:43.956093 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-72d6a3b4-2aa9-4d90-9fa7-27413f0f743f tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1723 microversion: 2.20 time: 0.885290 May 21 21:37:43.956869 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2718/5555] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:37:43 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1723 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:37:44.981299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-579ecc2b-6b48-4e17-b52a-941a2eaacfbe tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:44.982020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-579ecc2b-6b48-4e17-b52a-941a2eaacfbe tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:44.998417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-579ecc2b-6b48-4e17-b52a-941a2eaacfbe tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:45.013773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-579ecc2b-6b48-4e17-b52a-941a2eaacfbe tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:45.014945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-579ecc2b-6b48-4e17-b52a-941a2eaacfbe tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:45.015569 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-579ecc2b-6b48-4e17-b52a-941a2eaacfbe tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:45.806498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-579ecc2b-6b48-4e17-b52a-941a2eaacfbe tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:45.832270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-579ecc2b-6b48-4e17-b52a-941a2eaacfbe tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:45.837120 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-579ecc2b-6b48-4e17-b52a-941a2eaacfbe tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:45.838872 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-579ecc2b-6b48-4e17-b52a-941a2eaacfbe tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1723 microversion: 2.20 time: 0.863498 May 21 21:37:45.844080 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2838/5556] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:37:44 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1723 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:37:46.914232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-85cabe1c-51ec-49e3-ab30-59792b906523 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:46.915877 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-85cabe1c-51ec-49e3-ab30-59792b906523 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:46.936863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-85cabe1c-51ec-49e3-ab30-59792b906523 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:46.944553 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-85cabe1c-51ec-49e3-ab30-59792b906523 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:46.945598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-85cabe1c-51ec-49e3-ab30-59792b906523 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:46.948668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-85cabe1c-51ec-49e3-ab30-59792b906523 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:47.229891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-405a2650-fab4-4316-8907-e661cfd54f47 req-fa1dbd7c-1387-431a-98d5-fa6e19e81a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cc5c56-edbc-4588-9912-c07974b1f4e7", "name": "network-vif-unplugged", "status": "completed", "tag": "b88a4bf2-b43b-40cf-9426-b3b39cf8f325"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:37:47.255465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-405a2650-fab4-4316-8907-e661cfd54f47 req-fa1dbd7c-1387-431a-98d5-fa6e19e81a22 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:47.261855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-405a2650-fab4-4316-8907-e661cfd54f47 req-fa1dbd7c-1387-431a-98d5-fa6e19e81a22 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:47.305088 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-405a2650-fab4-4316-8907-e661cfd54f47 req-fa1dbd7c-1387-431a-98d5-fa6e19e81a22 service nova] Creating event network-vif-unplugged:b88a4bf2-b43b-40cf-9426-b3b39cf8f325 for instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 on nch2-master-1 May 21 21:37:47.319123 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-405a2650-fab4-4316-8907-e661cfd54f47 req-fa1dbd7c-1387-431a-98d5-fa6e19e81a22 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093396 May 21 21:37:47.320553 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2839/5557] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:37:48.283605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-85cabe1c-51ec-49e3-ab30-59792b906523 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:48.299522 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-85cabe1c-51ec-49e3-ab30-59792b906523 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:48.306058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-85cabe1c-51ec-49e3-ab30-59792b906523 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:48.310229 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-85cabe1c-51ec-49e3-ab30-59792b906523 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1723 microversion: 2.20 time: 1.398667 May 21 21:37:48.311917 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2719/5558] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:37:46 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1723 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:37:49.336043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d3819f39-c711-47c5-93b0-a9f2a06897c3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:49.336043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d3819f39-c711-47c5-93b0-a9f2a06897c3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:49.373917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3819f39-c711-47c5-93b0-a9f2a06897c3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:49.400250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3819f39-c711-47c5-93b0-a9f2a06897c3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:49.400250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3819f39-c711-47c5-93b0-a9f2a06897c3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:49.400250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3819f39-c711-47c5-93b0-a9f2a06897c3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:49.534445 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d3819f39-c711-47c5-93b0-a9f2a06897c3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:49.546724 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:37:49.559254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d3819f39-c711-47c5-93b0-a9f2a06897c3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:49.564195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d3819f39-c711-47c5-93b0-a9f2a06897c3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:49.566723 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d3819f39-c711-47c5-93b0-a9f2a06897c3 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1655 microversion: 2.20 time: 0.238094 May 21 21:37:49.569115 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2840/5559] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:37:49 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1655 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:37:50.587613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7d66093e-4380-46cf-ba62-53ef28b051a7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:50.588354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7d66093e-4380-46cf-ba62-53ef28b051a7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:50.602010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7d66093e-4380-46cf-ba62-53ef28b051a7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:50.602465 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7d66093e-4380-46cf-ba62-53ef28b051a7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:50.603260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7d66093e-4380-46cf-ba62-53ef28b051a7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:50.603703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7d66093e-4380-46cf-ba62-53ef28b051a7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:51.049202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7d66093e-4380-46cf-ba62-53ef28b051a7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:51.117680 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7d66093e-4380-46cf-ba62-53ef28b051a7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:51.126206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7d66093e-4380-46cf-ba62-53ef28b051a7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b29c0c0fb03c46838f3efe58b16c68d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28972bcc37da4f9188ffca6bd1a9a3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:37:51.134850 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7d66093e-4380-46cf-ba62-53ef28b051a7 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 200 len: 1655 microversion: 2.20 time: 0.545857 May 21 21:37:51.135780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f458e1da-2197-42ac-9857-fbf9e2d50842 req-0ba40ba1-81a0-4f99-abc5-cca88abbf964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cc5c56-edbc-4588-9912-c07974b1f4e7", "name": "network-vif-deleted", "tag": "b88a4bf2-b43b-40cf-9426-b3b39cf8f325"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:37:51.136752 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2720/5560] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:37:50 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 1655 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 21 21:37:51.157793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f458e1da-2197-42ac-9857-fbf9e2d50842 req-0ba40ba1-81a0-4f99-abc5-cca88abbf964 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:51.158486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f458e1da-2197-42ac-9857-fbf9e2d50842 req-0ba40ba1-81a0-4f99-abc5-cca88abbf964 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:51.187136 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f458e1da-2197-42ac-9857-fbf9e2d50842 req-0ba40ba1-81a0-4f99-abc5-cca88abbf964 service nova] Creating event network-vif-deleted:b88a4bf2-b43b-40cf-9426-b3b39cf8f325 for instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 on nch2-master-1 May 21 21:37:51.192202 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f458e1da-2197-42ac-9857-fbf9e2d50842 req-0ba40ba1-81a0-4f99-abc5-cca88abbf964 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064153 May 21 21:37:51.193013 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2841/5561] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:37:52.162870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2a336473-2008-4ed2-b91f-b79c5265d1d2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:52.165757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2a336473-2008-4ed2-b91f-b79c5265d1d2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:37:52.196873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a336473-2008-4ed2-b91f-b79c5265d1d2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:52.197347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a336473-2008-4ed2-b91f-b79c5265d1d2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:52.218251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a336473-2008-4ed2-b91f-b79c5265d1d2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:37:52.218767 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a336473-2008-4ed2-b91f-b79c5265d1d2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:37:52.270664 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-2a336473-2008-4ed2-b91f-b79c5265d1d2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] HTTP exception thrown: Instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 could not be found. May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2a336473-2008-4ed2-b91f-b79c5265d1d2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Request method failure captured: May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 HTTP/1.1 May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVpOrnERzyeb7lMwVrn21cDoytWSNetCxqJgc5CVJ4eZy_ADVN1u_wWHNlz7BERkUOTkiEjss2yTMr2a-dhSC64AIDVnRC3eP4Ra3zV9oKseEcbHfjIvval7rydSKZcSfEpW1DE2X4UM7KB2L0XgIGvwSoJ3DftD470kJ4lDxI-IudI May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: X-Openstack-Nova-Api-Version: 2.20 May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 28972bcc37da4f9188ffca6bd1a9a3b9 May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-418539187 May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/28972bcc37da4f9188ffca6bd1a9a3b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/28972bcc37da4f9188ffca6bd1a9a3b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_28972bcc37da4f9188ffca6bd1a9a3b9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/28972bcc37da4f9188ffca6bd1a9a3b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-AttachVolumeShelveTestJSON-418539187 May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 28972bcc37da4f9188ffca6bd1a9a3b9 May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-418539187 May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-AttachVolumeShelveTestJSON-418539187-project May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: b29c0c0fb03c46838f3efe58b16c68d2 May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-AttachVolumeShelveTestJSON-418539187-project May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 could not be found. May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'b7cc5c56-edbc-4588-9912-c07974b1f4e7'} May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 could not be found. May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 could not be found. May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:37:52.289174 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:37:52.295702 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:37:52.295702 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:37:52.295702 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:37:52.295702 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:37:52.295702 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:37:52.295702 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:37:52.295702 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 could not be found. May 21 21:37:52.295702 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:37:52.295702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2a336473-2008-4ed2-b91f-b79c5265d1d2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Returning 404 to user: Instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:37:52.295702 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2a336473-2008-4ed2-b91f-b79c5265d1d2 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 404 len: 111 microversion: 2.20 time: 0.130441 May 21 21:37:52.295702 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2721/5562] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:37:52 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:37:52.296727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1834e79c-cf21-4b65-944c-a9e36bdf6e75 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '.version_select at 0x7fc81a3453a0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:37:52.411195 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1834e79c-cf21-4b65-944c-a9e36bdf6e75 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1016185945" status: 204 len: 0 microversion: 2.20 time: 0.125426 May 21 21:37:52.411796 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2842/5563] 10.222.0.49 () {60 vars in 1261 bytes} [Sat May 21 21:37:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1016185945 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 21 21:38:00.139821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a3ab0865-9229-49c9-9595-aa3d69ace7f6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:38:00.140437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a3ab0865-9229-49c9-9595-aa3d69ace7f6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:38:00.158316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3ab0865-9229-49c9-9595-aa3d69ace7f6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:00.158316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3ab0865-9229-49c9-9595-aa3d69ace7f6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:00.158316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3ab0865-9229-49c9-9595-aa3d69ace7f6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:00.158316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a3ab0865-9229-49c9-9595-aa3d69ace7f6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:00.179485 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-a3ab0865-9229-49c9-9595-aa3d69ace7f6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] HTTP exception thrown: Instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 could not be found. May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a3ab0865-9229-49c9-9595-aa3d69ace7f6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Request method failure captured: May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 HTTP/1.1 May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVpOrnERzyeb7lMwVrn21cDoytWSNetCxqJgc5CVJ4eZy_ADVN1u_wWHNlz7BERkUOTkiEjss2yTMr2a-dhSC64AIDVnRC3eP4Ra3zV9oKseEcbHfjIvval7rydSKZcSfEpW1DE2X4UM7KB2L0XgIGvwSoJ3DftD470kJ4lDxI-IudI May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: X-Openstack-Nova-Api-Version: 2.20 May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 28972bcc37da4f9188ffca6bd1a9a3b9 May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-418539187 May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/28972bcc37da4f9188ffca6bd1a9a3b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/28972bcc37da4f9188ffca6bd1a9a3b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_28972bcc37da4f9188ffca6bd1a9a3b9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/28972bcc37da4f9188ffca6bd1a9a3b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-AttachVolumeShelveTestJSON-418539187 May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 28972bcc37da4f9188ffca6bd1a9a3b9 May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-418539187 May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-AttachVolumeShelveTestJSON-418539187-project May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: b29c0c0fb03c46838f3efe58b16c68d2 May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-AttachVolumeShelveTestJSON-418539187-project May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 could not be found. May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'b7cc5c56-edbc-4588-9912-c07974b1f4e7'} May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 could not be found. May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:38:00.190896 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:38:00.203266 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 could not be found. May 21 21:38:00.203266 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:38:00.203266 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:38:00.203266 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:38:00.203266 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:38:00.203266 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:38:00.203266 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:38:00.203266 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:38:00.203266 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:38:00.203266 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 could not be found. May 21 21:38:00.203266 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:38:00.207260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a3ab0865-9229-49c9-9595-aa3d69ace7f6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Returning 404 to user: Instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:38:00.217575 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a3ab0865-9229-49c9-9595-aa3d69ace7f6 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 404 len: 111 microversion: 2.20 time: 0.075802 May 21 21:38:00.217575 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2722/5564] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:38:00 2022] DELETE /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:38:00.230373 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5877a1bb-4531-4360-864b-049496a537aa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:38:00.231967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5877a1bb-4531-4360-864b-049496a537aa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: b7cc5c56-edbc-4588-9912-c07974b1f4e7] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:38:00.239823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:38:00.249159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5877a1bb-4531-4360-864b-049496a537aa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:00.249631 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5877a1bb-4531-4360-864b-049496a537aa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:00.250439 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5877a1bb-4531-4360-864b-049496a537aa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:00.250885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5877a1bb-4531-4360-864b-049496a537aa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:00.302241 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-5877a1bb-4531-4360-864b-049496a537aa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] HTTP exception thrown: Instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 could not be found. May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5877a1bb-4531-4360-864b-049496a537aa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Request method failure captured: May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 HTTP/1.1 May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVpOrnERzyeb7lMwVrn21cDoytWSNetCxqJgc5CVJ4eZy_ADVN1u_wWHNlz7BERkUOTkiEjss2yTMr2a-dhSC64AIDVnRC3eP4Ra3zV9oKseEcbHfjIvval7rydSKZcSfEpW1DE2X4UM7KB2L0XgIGvwSoJ3DftD470kJ4lDxI-IudI May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: X-Openstack-Nova-Api-Version: 2.20 May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 28972bcc37da4f9188ffca6bd1a9a3b9 May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-418539187 May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/28972bcc37da4f9188ffca6bd1a9a3b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/28972bcc37da4f9188ffca6bd1a9a3b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_28972bcc37da4f9188ffca6bd1a9a3b9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/28972bcc37da4f9188ffca6bd1a9a3b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AttachVolumeShelveTestJSON-418539187 May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 28972bcc37da4f9188ffca6bd1a9a3b9 May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-418539187 May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AttachVolumeShelveTestJSON-418539187-project May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: b29c0c0fb03c46838f3efe58b16c68d2 May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AttachVolumeShelveTestJSON-418539187-project May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 could not be found. May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'b7cc5c56-edbc-4588-9912-c07974b1f4e7'} May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 could not be found. May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 could not be found. May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:38:00.303927 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:38:00.310370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:38:00.310370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:38:00.310370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:38:00.310370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:38:00.310370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:38:00.310370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:38:00.310370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 could not be found. May 21 21:38:00.310370 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:38:00.316836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5877a1bb-4531-4360-864b-049496a537aa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Returning 404 to user: Instance b7cc5c56-edbc-4588-9912-c07974b1f4e7 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:38:00.325805 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5877a1bb-4531-4360-864b-049496a537aa tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7" status: 404 len: 111 microversion: 2.20 time: 0.104848 May 21 21:38:00.327744 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2843/5565] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:38:00 2022] GET /compute/v2.1/servers/b7cc5c56-edbc-4588-9912-c07974b1f4e7 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:38:05.071648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0c9888ed-cc8c-4bf8-a508-0329c8ac1cc1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:38:05.072528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0c9888ed-cc8c-4bf8-a508-0329c8ac1cc1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:38:05.084883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c9888ed-cc8c-4bf8-a508-0329c8ac1cc1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:05.085716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c9888ed-cc8c-4bf8-a508-0329c8ac1cc1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:05.086778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c9888ed-cc8c-4bf8-a508-0329c8ac1cc1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:05.087554 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c9888ed-cc8c-4bf8-a508-0329c8ac1cc1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:05.118154 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-0c9888ed-cc8c-4bf8-a508-0329c8ac1cc1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] HTTP exception thrown: Instance cc27a082-c144-436f-bd21-e8126e00db6c could not be found. May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0c9888ed-cc8c-4bf8-a508-0329c8ac1cc1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Request method failure captured: May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c HTTP/1.1 May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVpOrnERzyeb7lMwVrn21cDoytWSNetCxqJgc5CVJ4eZy_ADVN1u_wWHNlz7BERkUOTkiEjss2yTMr2a-dhSC64AIDVnRC3eP4Ra3zV9oKseEcbHfjIvval7rydSKZcSfEpW1DE2X4UM7KB2L0XgIGvwSoJ3DftD470kJ4lDxI-IudI May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: X-Openstack-Nova-Api-Version: 2.20 May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 28972bcc37da4f9188ffca6bd1a9a3b9 May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-418539187 May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/28972bcc37da4f9188ffca6bd1a9a3b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/28972bcc37da4f9188ffca6bd1a9a3b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_28972bcc37da4f9188ffca6bd1a9a3b9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/28972bcc37da4f9188ffca6bd1a9a3b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-AttachVolumeShelveTestJSON-418539187 May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 28972bcc37da4f9188ffca6bd1a9a3b9 May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-418539187 May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-AttachVolumeShelveTestJSON-418539187-project May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: b29c0c0fb03c46838f3efe58b16c68d2 May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-AttachVolumeShelveTestJSON-418539187-project May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance cc27a082-c144-436f-bd21-e8126e00db6c could not be found. May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'cc27a082-c144-436f-bd21-e8126e00db6c'} May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc27a082-c144-436f-bd21-e8126e00db6c could not be found. May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:38:05.120217 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:38:05.125814 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc27a082-c144-436f-bd21-e8126e00db6c could not be found. May 21 21:38:05.125814 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:38:05.125814 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:38:05.125814 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:38:05.125814 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:38:05.125814 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:38:05.125814 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:38:05.125814 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:38:05.125814 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:38:05.125814 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc27a082-c144-436f-bd21-e8126e00db6c could not be found. May 21 21:38:05.125814 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:38:05.125814 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0c9888ed-cc8c-4bf8-a508-0329c8ac1cc1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Returning 404 to user: Instance cc27a082-c144-436f-bd21-e8126e00db6c could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:38:05.125814 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0c9888ed-cc8c-4bf8-a508-0329c8ac1cc1 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 404 len: 111 microversion: 2.20 time: 0.054415 May 21 21:38:05.125814 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2723/5566] 10.222.0.49 () {60 vars in 1279 bytes} [Sat May 21 21:38:05 2022] DELETE /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:38:05.130277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ebb7a9f0-6436-4164-8cc8-136ba1286314 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:38:05.130903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ebb7a9f0-6436-4164-8cc8-136ba1286314 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] [instance: cc27a082-c144-436f-bd21-e8126e00db6c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:38:05.143973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebb7a9f0-6436-4164-8cc8-136ba1286314 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:05.150210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebb7a9f0-6436-4164-8cc8-136ba1286314 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:05.150210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebb7a9f0-6436-4164-8cc8-136ba1286314 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:05.150210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ebb7a9f0-6436-4164-8cc8-136ba1286314 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:05.160636 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-ebb7a9f0-6436-4164-8cc8-136ba1286314 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] HTTP exception thrown: Instance cc27a082-c144-436f-bd21-e8126e00db6c could not be found. May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ebb7a9f0-6436-4164-8cc8-136ba1286314 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Request method failure captured: May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c HTTP/1.1 May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVpOrnERzyeb7lMwVrn21cDoytWSNetCxqJgc5CVJ4eZy_ADVN1u_wWHNlz7BERkUOTkiEjss2yTMr2a-dhSC64AIDVnRC3eP4Ra3zV9oKseEcbHfjIvval7rydSKZcSfEpW1DE2X4UM7KB2L0XgIGvwSoJ3DftD470kJ4lDxI-IudI May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: X-Openstack-Nova-Api-Version: 2.20 May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 28972bcc37da4f9188ffca6bd1a9a3b9 May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-418539187 May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/28972bcc37da4f9188ffca6bd1a9a3b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/28972bcc37da4f9188ffca6bd1a9a3b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_28972bcc37da4f9188ffca6bd1a9a3b9", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/28972bcc37da4f9188ffca6bd1a9a3b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AttachVolumeShelveTestJSON-418539187 May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 28972bcc37da4f9188ffca6bd1a9a3b9 May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-418539187 May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AttachVolumeShelveTestJSON-418539187-project May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: b29c0c0fb03c46838f3efe58b16c68d2 May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AttachVolumeShelveTestJSON-418539187-project May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance cc27a082-c144-436f-bd21-e8126e00db6c could not be found. May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'cc27a082-c144-436f-bd21-e8126e00db6c'} May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc27a082-c144-436f-bd21-e8126e00db6c could not be found. May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc27a082-c144-436f-bd21-e8126e00db6c could not be found. May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:38:05.162145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:38:05.168459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:38:05.168459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:38:05.168459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:38:05.168459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:38:05.168459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:38:05.168459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:38:05.168459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc27a082-c144-436f-bd21-e8126e00db6c could not be found. May 21 21:38:05.168459 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:38:05.168459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ebb7a9f0-6436-4164-8cc8-136ba1286314 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] Returning 404 to user: Instance cc27a082-c144-436f-bd21-e8126e00db6c could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:38:05.168459 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ebb7a9f0-6436-4164-8cc8-136ba1286314 tempest-AttachVolumeShelveTestJSON-418539187 tempest-AttachVolumeShelveTestJSON-418539187-project] 10.222.0.49 "GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c" status: 404 len: 111 microversion: 2.20 time: 0.037241 May 21 21:38:05.168459 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2844/5567] 10.222.0.49 () {60 vars in 1276 bytes} [Sat May 21 21:38:05 2022] GET /compute/v2.1/servers/cc27a082-c144-436f-bd21-e8126e00db6c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 21 21:38:26.477271 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 21:38:26.478061 ncdv-master-1 devstack@n-api.service[131278]: Sat May 21 21:38:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 21:38:29.424081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=13 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:38:29.427086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=19 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:38:29.610529 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-adabaae5-eaaa-4966-9cde-621d213ce64c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Action: 'create', calling method: .version_select at 0x7fc819d604c0>, body: {"keypair": {"name": "tempest-keypair-827461958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfiT3tTekzefIUfo9yRiCKARpj4LFhMM5+Vbak5l/ZwF1hhZN6GbsETR+oMaiCkIpz+FjR5+aL8u/6c9+iUuYSawDCTNk+jC+7oZa+H54iDyRe11DCDf2CzuVm1JKgFpA=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:38:29.628213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-adabaae5-eaaa-4966-9cde-621d213ce64c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Getting quotas for project 41b9c87f24cd4bac983b83b49daeae5a. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:38:29.634328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-adabaae5-eaaa-4966-9cde-621d213ce64c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Getting quotas for user f01908adbe2c4aebb89d6fd3af3de207 and project 41b9c87f24cd4bac983b83b49daeae5a. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:38:29.809656 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-adabaae5-eaaa-4966-9cde-621d213ce64c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.400104 May 21 21:38:29.812961 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2724/5568] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:38:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:38:33.960994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-056e755b-391e-4301-b15f-710c66d2efcf tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1727634086", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b9f276e-ad4f-4a34-856b-bc3620bd7879"}], "security_groups": [{"name": "tempest-securitygroup--1887091881"}], "key_name": "tempest-keypair-827461958", "user_data": "}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:38:33.980304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=7 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:38:34.211023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-056e755b-391e-4301-b15f-710c66d2efcf tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] validate_networks() for [('7b9f276e-ad4f-4a34-856b-bc3620bd7879', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:38:35.903276 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-056e755b-391e-4301-b15f-710c66d2efcf tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:38:35.904029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-056e755b-391e-4301-b15f-710c66d2efcf tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:38:35.904363 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-056e755b-391e-4301-b15f-710c66d2efcf tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:38:35.904775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-056e755b-391e-4301-b15f-710c66d2efcf tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:38:35.905268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-056e755b-391e-4301-b15f-710c66d2efcf tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:38:35.938352 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-056e755b-391e-4301-b15f-710c66d2efcf tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:35.944130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-056e755b-391e-4301-b15f-710c66d2efcf tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:35.945445 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-056e755b-391e-4301-b15f-710c66d2efcf tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:35.946095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-056e755b-391e-4301-b15f-710c66d2efcf tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:36.007062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-056e755b-391e-4301-b15f-710c66d2efcf tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Getting quotas for project 41b9c87f24cd4bac983b83b49daeae5a. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:38:36.033458 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-056e755b-391e-4301-b15f-710c66d2efcf tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Getting quotas for user f01908adbe2c4aebb89d6fd3af3de207 and project 41b9c87f24cd4bac983b83b49daeae5a. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:38:36.053174 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-056e755b-391e-4301-b15f-710c66d2efcf tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:38:36.056022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-056e755b-391e-4301-b15f-710c66d2efcf tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:38:36.205577 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-056e755b-391e-4301-b15f-710c66d2efcf tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.247536 May 21 21:38:36.206385 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2845/5569] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:38:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 2251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:38:36.218669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-02be3112-b636-4652-8737-7c56f951297e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:38:36.219962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-02be3112-b636-4652-8737-7c56f951297e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:38:36.645808 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-02be3112-b636-4652-8737-7c56f951297e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:38:36.655964 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-02be3112-b636-4652-8737-7c56f951297e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 200 len: 1241 microversion: 2.1 time: 0.443255 May 21 21:38:36.665431 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2725/5570] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:38:36 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 1241 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:38:37.674414 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-74338779-8ca5-452c-a9be-2e8810d3b2f1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:38:37.674915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-74338779-8ca5-452c-a9be-2e8810d3b2f1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:38:37.812232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-74338779-8ca5-452c-a9be-2e8810d3b2f1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:38:37.824529 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-74338779-8ca5-452c-a9be-2e8810d3b2f1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 200 len: 1241 microversion: 2.1 time: 0.155336 May 21 21:38:37.826976 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2846/5571] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:38:37 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 1241 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:38:38.842312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c33caddb-38c1-4694-b25c-7119b6b9a937 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:38:38.842956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c33caddb-38c1-4694-b25c-7119b6b9a937 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:38:38.851001 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c33caddb-38c1-4694-b25c-7119b6b9a937 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:38.851512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c33caddb-38c1-4694-b25c-7119b6b9a937 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:38.852251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c33caddb-38c1-4694-b25c-7119b6b9a937 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:38.853948 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c33caddb-38c1-4694-b25c-7119b6b9a937 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:38.968898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c33caddb-38c1-4694-b25c-7119b6b9a937 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:38:38.987434 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c33caddb-38c1-4694-b25c-7119b6b9a937 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 200 len: 1293 microversion: 2.1 time: 0.146994 May 21 21:38:38.988759 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2726/5572] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:38:38 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 1293 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:38:40.005361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8042745e-2e6c-46db-a924-e218a311a063 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:38:40.006170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8042745e-2e6c-46db-a924-e218a311a063 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:38:40.018739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8042745e-2e6c-46db-a924-e218a311a063 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:40.019676 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8042745e-2e6c-46db-a924-e218a311a063 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:40.020959 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8042745e-2e6c-46db-a924-e218a311a063 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:40.021800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8042745e-2e6c-46db-a924-e218a311a063 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:40.206973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8042745e-2e6c-46db-a924-e218a311a063 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:38:40.243595 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8042745e-2e6c-46db-a924-e218a311a063 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 200 len: 1299 microversion: 2.1 time: 0.242596 May 21 21:38:40.245260 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2847/5573] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:38:39 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 1299 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:38:41.265015 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-72b199c0-4dac-4c87-bc35-377e475446df tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:38:41.265015 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-72b199c0-4dac-4c87-bc35-377e475446df tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:38:41.272673 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72b199c0-4dac-4c87-bc35-377e475446df tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:41.273276 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72b199c0-4dac-4c87-bc35-377e475446df tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:41.274403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72b199c0-4dac-4c87-bc35-377e475446df tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:41.274953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72b199c0-4dac-4c87-bc35-377e475446df tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:41.444251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-72b199c0-4dac-4c87-bc35-377e475446df tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:38:41.456310 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-72b199c0-4dac-4c87-bc35-377e475446df tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 200 len: 1299 microversion: 2.1 time: 0.199039 May 21 21:38:41.457240 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2727/5574] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:38:41 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 1299 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:38:42.473760 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0a30cb9b-84fc-4157-b066-ec61396de98a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:38:42.475052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0a30cb9b-84fc-4157-b066-ec61396de98a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:38:42.484158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a30cb9b-84fc-4157-b066-ec61396de98a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:42.490247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a30cb9b-84fc-4157-b066-ec61396de98a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:42.490707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a30cb9b-84fc-4157-b066-ec61396de98a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:42.497932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a30cb9b-84fc-4157-b066-ec61396de98a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:42.872435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0a30cb9b-84fc-4157-b066-ec61396de98a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:38:42.882514 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0a30cb9b-84fc-4157-b066-ec61396de98a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 200 len: 1367 microversion: 2.1 time: 0.412290 May 21 21:38:42.885061 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2848/5575] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:38:42 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 1367 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:38:43.900114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-47d4540c-22a6-4f65-b64e-691e06cc426f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:38:43.901078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-47d4540c-22a6-4f65-b64e-691e06cc426f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:38:43.923337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47d4540c-22a6-4f65-b64e-691e06cc426f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:43.924523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47d4540c-22a6-4f65-b64e-691e06cc426f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:43.925633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47d4540c-22a6-4f65-b64e-691e06cc426f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:43.926368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-47d4540c-22a6-4f65-b64e-691e06cc426f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:44.054039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-1b7007bc-f8e4-40df-97a9-191b1a45fa6e req-fff981c9-a893-4738-8b63-0e11d1ec4c3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cec7592-1285-42ea-8563-a49982585edc", "tag": "9887480f-d175-4ebb-8008-cb6e07e2ed6b"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:38:44.066683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-1b7007bc-f8e4-40df-97a9-191b1a45fa6e req-fff981c9-a893-4738-8b63-0e11d1ec4c3a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:44.067513 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-1b7007bc-f8e4-40df-97a9-191b1a45fa6e req-fff981c9-a893-4738-8b63-0e11d1ec4c3a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:44.080673 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-1b7007bc-f8e4-40df-97a9-191b1a45fa6e req-fff981c9-a893-4738-8b63-0e11d1ec4c3a service nova] Creating event network-changed:9887480f-d175-4ebb-8008-cb6e07e2ed6b for instance 4cec7592-1285-42ea-8563-a49982585edc on nch1-master-1 May 21 21:38:44.087831 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-1b7007bc-f8e4-40df-97a9-191b1a45fa6e req-fff981c9-a893-4738-8b63-0e11d1ec4c3a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.299457 May 21 21:38:44.089330 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2728/5576] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:38:44.312481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-47d4540c-22a6-4f65-b64e-691e06cc426f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:38:44.346148 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-47d4540c-22a6-4f65-b64e-691e06cc426f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 200 len: 1367 microversion: 2.1 time: 0.450823 May 21 21:38:44.349600 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2849/5577] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:38:43 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 1367 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:38:45.367980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-44756fce-374b-402f-b377-04a1778d9a64 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:38:45.369988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-44756fce-374b-402f-b377-04a1778d9a64 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:38:45.387973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44756fce-374b-402f-b377-04a1778d9a64 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:45.387973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44756fce-374b-402f-b377-04a1778d9a64 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:45.387973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44756fce-374b-402f-b377-04a1778d9a64 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:45.387973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44756fce-374b-402f-b377-04a1778d9a64 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:45.757038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-44756fce-374b-402f-b377-04a1778d9a64 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:38:45.766058 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-44756fce-374b-402f-b377-04a1778d9a64 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 200 len: 1367 microversion: 2.1 time: 0.405345 May 21 21:38:45.767336 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2729/5578] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:38:45 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 1367 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:38:46.784597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6471f60b-88c4-4fc7-9556-32bbc2cc7f8c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:38:46.785221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6471f60b-88c4-4fc7-9556-32bbc2cc7f8c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:38:46.788641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:38:46.796901 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6471f60b-88c4-4fc7-9556-32bbc2cc7f8c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:46.797622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6471f60b-88c4-4fc7-9556-32bbc2cc7f8c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:46.798657 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6471f60b-88c4-4fc7-9556-32bbc2cc7f8c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:46.799467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6471f60b-88c4-4fc7-9556-32bbc2cc7f8c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:46.992540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6471f60b-88c4-4fc7-9556-32bbc2cc7f8c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:38:47.010645 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6471f60b-88c4-4fc7-9556-32bbc2cc7f8c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 200 len: 1367 microversion: 2.1 time: 0.230823 May 21 21:38:47.012791 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2850/5579] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:38:46 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:38:48.029714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-989ada07-97fd-4ba9-9681-d4a8d299d6d4 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:38:48.031243 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-989ada07-97fd-4ba9-9681-d4a8d299d6d4 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:38:48.038069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:38:48.058785 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-989ada07-97fd-4ba9-9681-d4a8d299d6d4 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:48.065614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-989ada07-97fd-4ba9-9681-d4a8d299d6d4 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:48.066912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-989ada07-97fd-4ba9-9681-d4a8d299d6d4 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:48.070469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-989ada07-97fd-4ba9-9681-d4a8d299d6d4 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:48.474261 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-989ada07-97fd-4ba9-9681-d4a8d299d6d4 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:38:48.484618 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-989ada07-97fd-4ba9-9681-d4a8d299d6d4 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 200 len: 1367 microversion: 2.1 time: 0.461314 May 21 21:38:48.494107 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2730/5580] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:38:48 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 1367 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:38:49.507803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2b155245-d705-4e08-94d7-6a78c6028708 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:38:49.508794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2b155245-d705-4e08-94d7-6a78c6028708 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:38:49.518360 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=8 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:38:49.533896 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b155245-d705-4e08-94d7-6a78c6028708 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:49.534366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b155245-d705-4e08-94d7-6a78c6028708 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:49.540548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b155245-d705-4e08-94d7-6a78c6028708 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:49.541066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b155245-d705-4e08-94d7-6a78c6028708 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:50.133873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2b155245-d705-4e08-94d7-6a78c6028708 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:38:50.146796 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2b155245-d705-4e08-94d7-6a78c6028708 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 200 len: 1367 microversion: 2.1 time: 0.648864 May 21 21:38:50.149246 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2851/5581] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:38:49 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 1367 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:38:51.164359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5ef06acd-9dcb-44ef-9575-5c273ea5c700 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:38:51.164991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5ef06acd-9dcb-44ef-9575-5c273ea5c700 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:38:51.177827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ef06acd-9dcb-44ef-9575-5c273ea5c700 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:51.178286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ef06acd-9dcb-44ef-9575-5c273ea5c700 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:51.179092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ef06acd-9dcb-44ef-9575-5c273ea5c700 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:51.179533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ef06acd-9dcb-44ef-9575-5c273ea5c700 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:51.458383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5ef06acd-9dcb-44ef-9575-5c273ea5c700 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:38:51.482052 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5ef06acd-9dcb-44ef-9575-5c273ea5c700 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 200 len: 1367 microversion: 2.1 time: 0.321208 May 21 21:38:51.489614 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2731/5582] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:38:51 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 1367 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:38:51.501457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-291d4160-ceb4-4538-8675-662c0b515114 req-3d902e76-829e-42b7-acec-bfea14b7ee09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cec7592-1285-42ea-8563-a49982585edc", "name": "network-vif-plugged", "status": "completed", "tag": "9887480f-d175-4ebb-8008-cb6e07e2ed6b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:38:51.533362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-291d4160-ceb4-4538-8675-662c0b515114 req-3d902e76-829e-42b7-acec-bfea14b7ee09 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:51.534119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-291d4160-ceb4-4538-8675-662c0b515114 req-3d902e76-829e-42b7-acec-bfea14b7ee09 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:51.553701 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-291d4160-ceb4-4538-8675-662c0b515114 req-3d902e76-829e-42b7-acec-bfea14b7ee09 service nova] Creating event network-vif-plugged:9887480f-d175-4ebb-8008-cb6e07e2ed6b for instance 4cec7592-1285-42ea-8563-a49982585edc on nch1-master-1 May 21 21:38:51.564616 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-291d4160-ceb4-4538-8675-662c0b515114 req-3d902e76-829e-42b7-acec-bfea14b7ee09 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072600 May 21 21:38:51.567126 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2852/5583] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:38:52.508797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d198988f-0973-4990-8ea2-fba86a57a0ca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:38:52.509411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d198988f-0973-4990-8ea2-fba86a57a0ca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:38:52.521837 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d198988f-0973-4990-8ea2-fba86a57a0ca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:52.523786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d198988f-0973-4990-8ea2-fba86a57a0ca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:52.526325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d198988f-0973-4990-8ea2-fba86a57a0ca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:52.530950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d198988f-0973-4990-8ea2-fba86a57a0ca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:52.819819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d198988f-0973-4990-8ea2-fba86a57a0ca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:38:52.842787 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d198988f-0973-4990-8ea2-fba86a57a0ca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 200 len: 1367 microversion: 2.1 time: 0.339197 May 21 21:38:52.843968 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2732/5584] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:38:52 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 1367 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:38:53.864472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f674747f-9e67-4af5-9303-24f53ce689ac tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:38:53.865344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f674747f-9e67-4af5-9303-24f53ce689ac tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:38:53.881768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f674747f-9e67-4af5-9303-24f53ce689ac tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:53.882517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f674747f-9e67-4af5-9303-24f53ce689ac tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:53.883558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f674747f-9e67-4af5-9303-24f53ce689ac tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:53.884262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f674747f-9e67-4af5-9303-24f53ce689ac tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:54.446131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f674747f-9e67-4af5-9303-24f53ce689ac tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:38:54.460209 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f674747f-9e67-4af5-9303-24f53ce689ac tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 200 len: 1557 microversion: 2.1 time: 0.603682 May 21 21:38:54.461126 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2853/5585] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:38:53 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 1557 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:38:54.478119 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5bd002a9-c4b0-4f1f-8bc7-0174bafe61b0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:38:54.478873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5bd002a9-c4b0-4f1f-8bc7-0174bafe61b0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:38:54.502661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5bd002a9-c4b0-4f1f-8bc7-0174bafe61b0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:54.503278 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5bd002a9-c4b0-4f1f-8bc7-0174bafe61b0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:54.504203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5bd002a9-c4b0-4f1f-8bc7-0174bafe61b0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:54.505825 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5bd002a9-c4b0-4f1f-8bc7-0174bafe61b0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:54.772480 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5bd002a9-c4b0-4f1f-8bc7-0174bafe61b0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.296625 May 21 21:38:54.772480 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2733/5586] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 21:38:54 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc/os-interface => generated 285 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:38:58.513025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-c6d5c867-6488-4981-877f-01dd48deeb39 req-383d8beb-5b44-4edc-8bd6-aa65c1af3abf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cec7592-1285-42ea-8563-a49982585edc", "tag": "9887480f-d175-4ebb-8008-cb6e07e2ed6b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:38:58.542868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c6d5c867-6488-4981-877f-01dd48deeb39 req-383d8beb-5b44-4edc-8bd6-aa65c1af3abf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:38:58.543317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c6d5c867-6488-4981-877f-01dd48deeb39 req-383d8beb-5b44-4edc-8bd6-aa65c1af3abf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:38:58.566797 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-c6d5c867-6488-4981-877f-01dd48deeb39 req-383d8beb-5b44-4edc-8bd6-aa65c1af3abf service nova] Creating event network-changed:9887480f-d175-4ebb-8008-cb6e07e2ed6b for instance 4cec7592-1285-42ea-8563-a49982585edc on nch1-master-1 May 21 21:38:58.582182 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-c6d5c867-6488-4981-877f-01dd48deeb39 req-383d8beb-5b44-4edc-8bd6-aa65c1af3abf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084731 May 21 21:38:58.583167 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2854/5587] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:39:13.745433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:39:13.747855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=42 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:39:13.973688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-00cbc7c5-8e08-4094-b85b-9a55f1951f5a tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Action: 'create', calling method: .version_select at 0x7fc819d1cf70>, body: {"keypair": {"name": "tempest-TestServerBasicOps-451792469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEZuyrMzoVT2ougbXaVgjjy41tJDOVK5YBxpgoNVyfFiKKzzocgt7V4X1Fcsatu0dSkP3/af+o23eKUPR77qAJeI+oOXIJyLao7sO+Vypl5Y8VMm6dm8Vm8rmU6r7HX4A=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:39:14.016904 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-00cbc7c5-8e08-4094-b85b-9a55f1951f5a tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Getting quotas for project c03901d3dd7b42a4816399ae4896b506. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:39:14.027763 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-00cbc7c5-8e08-4094-b85b-9a55f1951f5a tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Getting quotas for user fd4719c5630b42c6b6d180255db3a202 and project c03901d3dd7b42a4816399ae4896b506. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:39:14.130189 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-00cbc7c5-8e08-4094-b85b-9a55f1951f5a tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.391676 May 21 21:39:14.131502 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2734/5588] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:39:13 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:39:18.082311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a8af5c98-9b53-4063-97ca-bdf4a9fc6540 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1588856724", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-451792469", "security_groups": [{"name": "tempest-secgroup-smoke-813007278"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "3e681225-24bc-4b55-bdae-7fbfc222b742"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:39:18.122678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:39:18.124633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=42 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:39:18.376720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-a8af5c98-9b53-4063-97ca-bdf4a9fc6540 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] validate_networks() for [('3e681225-24bc-4b55-bdae-7fbfc222b742', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:39:19.116569 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-a8af5c98-9b53-4063-97ca-bdf4a9fc6540 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Getting quotas for project c03901d3dd7b42a4816399ae4896b506. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:39:19.124247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-a8af5c98-9b53-4063-97ca-bdf4a9fc6540 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Getting quotas for user fd4719c5630b42c6b6d180255db3a202 and project c03901d3dd7b42a4816399ae4896b506. Resources: dict_keys(['metadata_items']) {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:39:19.149925 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-a8af5c98-9b53-4063-97ca-bdf4a9fc6540 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:39:19.150809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-a8af5c98-9b53-4063-97ca-bdf4a9fc6540 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:39:19.151475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-a8af5c98-9b53-4063-97ca-bdf4a9fc6540 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:39:19.152110 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-a8af5c98-9b53-4063-97ca-bdf4a9fc6540 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:39:19.152564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-a8af5c98-9b53-4063-97ca-bdf4a9fc6540 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:39:19.163728 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8af5c98-9b53-4063-97ca-bdf4a9fc6540 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:19.164504 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8af5c98-9b53-4063-97ca-bdf4a9fc6540 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:19.165786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8af5c98-9b53-4063-97ca-bdf4a9fc6540 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:19.166420 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8af5c98-9b53-4063-97ca-bdf4a9fc6540 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:19.190592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-a8af5c98-9b53-4063-97ca-bdf4a9fc6540 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Getting quotas for project c03901d3dd7b42a4816399ae4896b506. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:39:19.203835 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-a8af5c98-9b53-4063-97ca-bdf4a9fc6540 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Getting quotas for user fd4719c5630b42c6b6d180255db3a202 and project c03901d3dd7b42a4816399ae4896b506. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:39:19.229657 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a8af5c98-9b53-4063-97ca-bdf4a9fc6540 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:39:19.241090 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a8af5c98-9b53-4063-97ca-bdf4a9fc6540 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:39:19.411211 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a8af5c98-9b53-4063-97ca-bdf4a9fc6540 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.335109 May 21 21:39:19.416126 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2855/5589] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:39:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:39:19.431164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-749165be-ff4e-442a-91ad-e6ce037a5834 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:19.433007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-749165be-ff4e-442a-91ad-e6ce037a5834 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:19.948328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-749165be-ff4e-442a-91ad-e6ce037a5834 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4719c5630b42c6b6d180255db3a202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03901d3dd7b42a4816399ae4896b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:19.961726 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-749165be-ff4e-442a-91ad-e6ce037a5834 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 200 len: 1302 microversion: 2.1 time: 0.538589 May 21 21:39:19.962920 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2735/5590] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:19 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 1302 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:20.979974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-08e7337a-16c4-419b-9658-5c87bafc44bb tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:20.980651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-08e7337a-16c4-419b-9658-5c87bafc44bb tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:21.063056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-08e7337a-16c4-419b-9658-5c87bafc44bb tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4719c5630b42c6b6d180255db3a202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03901d3dd7b42a4816399ae4896b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:21.088044 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-08e7337a-16c4-419b-9658-5c87bafc44bb tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 200 len: 1302 microversion: 2.1 time: 0.112692 May 21 21:39:21.098613 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2856/5591] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:20 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 1302 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:22.105269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fa858105-0a71-4f96-961d-1956447911e7 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:22.106448 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fa858105-0a71-4f96-961d-1956447911e7 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:22.115344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa858105-0a71-4f96-961d-1956447911e7 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:22.115985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa858105-0a71-4f96-961d-1956447911e7 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:22.116830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa858105-0a71-4f96-961d-1956447911e7 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:22.117445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa858105-0a71-4f96-961d-1956447911e7 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:22.215510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fa858105-0a71-4f96-961d-1956447911e7 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4719c5630b42c6b6d180255db3a202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03901d3dd7b42a4816399ae4896b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:22.230357 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fa858105-0a71-4f96-961d-1956447911e7 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 200 len: 1306 microversion: 2.1 time: 0.127594 May 21 21:39:22.232024 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2736/5592] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:22 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 1306 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:23.250393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-415b4e8b-71c1-4aca-8e2c-b46ec80e3b69 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:23.253049 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-415b4e8b-71c1-4aca-8e2c-b46ec80e3b69 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:23.281712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-415b4e8b-71c1-4aca-8e2c-b46ec80e3b69 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:23.281712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-415b4e8b-71c1-4aca-8e2c-b46ec80e3b69 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:23.281712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-415b4e8b-71c1-4aca-8e2c-b46ec80e3b69 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:23.281712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-415b4e8b-71c1-4aca-8e2c-b46ec80e3b69 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:23.515681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-415b4e8b-71c1-4aca-8e2c-b46ec80e3b69 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4719c5630b42c6b6d180255db3a202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03901d3dd7b42a4816399ae4896b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:23.524519 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-415b4e8b-71c1-4aca-8e2c-b46ec80e3b69 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 200 len: 1306 microversion: 2.1 time: 0.278533 May 21 21:39:23.525280 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2857/5593] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:23 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 1306 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:24.544841 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-919df52b-6e79-4c9d-b311-067ed8b42673 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:24.546047 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-919df52b-6e79-4c9d-b311-067ed8b42673 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:24.553762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-919df52b-6e79-4c9d-b311-067ed8b42673 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:24.554221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-919df52b-6e79-4c9d-b311-067ed8b42673 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:24.555362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-919df52b-6e79-4c9d-b311-067ed8b42673 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:24.556049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-919df52b-6e79-4c9d-b311-067ed8b42673 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:24.599486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fda12a6a-7b8d-4d4e-a036-afb1250fd400 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:24.600016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fda12a6a-7b8d-4d4e-a036-afb1250fd400 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:24.610453 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fda12a6a-7b8d-4d4e-a036-afb1250fd400 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:24.611096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fda12a6a-7b8d-4d4e-a036-afb1250fd400 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:24.612311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fda12a6a-7b8d-4d4e-a036-afb1250fd400 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:24.612767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fda12a6a-7b8d-4d4e-a036-afb1250fd400 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:24.657542 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fda12a6a-7b8d-4d4e-a036-afb1250fd400 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc/ips" status: 200 len: 150 microversion: 2.1 time: 0.062814 May 21 21:39:24.671761 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2858/5594] 10.222.0.49 () {58 vars in 1247 bytes} [Sat May 21 21:39:24 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc/ips => generated 150 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:39:24.757653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-919df52b-6e79-4c9d-b311-067ed8b42673 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4719c5630b42c6b6d180255db3a202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03901d3dd7b42a4816399ae4896b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:24.787348 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-919df52b-6e79-4c9d-b311-067ed8b42673 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 200 len: 1372 microversion: 2.1 time: 0.239853 May 21 21:39:24.805340 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2737/5595] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:24 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 1372 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:25.810796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ffb81501-1501-4a4f-b6bb-2c6a8da73d7d tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:25.811566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ffb81501-1501-4a4f-b6bb-2c6a8da73d7d tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:25.821766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffb81501-1501-4a4f-b6bb-2c6a8da73d7d tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:25.822223 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffb81501-1501-4a4f-b6bb-2c6a8da73d7d tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:25.828477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffb81501-1501-4a4f-b6bb-2c6a8da73d7d tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:25.828477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffb81501-1501-4a4f-b6bb-2c6a8da73d7d tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:26.105077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ffb81501-1501-4a4f-b6bb-2c6a8da73d7d tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4719c5630b42c6b6d180255db3a202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03901d3dd7b42a4816399ae4896b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:26.118885 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ffb81501-1501-4a4f-b6bb-2c6a8da73d7d tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 200 len: 1360 microversion: 2.1 time: 0.313909 May 21 21:39:26.119739 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2859/5596] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:25 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 1360 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:39:27.137807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ec7c8b43-5ccc-4dba-98f9-bfe3803b814b tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:27.138316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ec7c8b43-5ccc-4dba-98f9-bfe3803b814b tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:27.147543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ec7c8b43-5ccc-4dba-98f9-bfe3803b814b tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:27.153733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ec7c8b43-5ccc-4dba-98f9-bfe3803b814b tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:27.155073 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ec7c8b43-5ccc-4dba-98f9-bfe3803b814b tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:27.156652 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ec7c8b43-5ccc-4dba-98f9-bfe3803b814b tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:27.555681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ec7c8b43-5ccc-4dba-98f9-bfe3803b814b tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4719c5630b42c6b6d180255db3a202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03901d3dd7b42a4816399ae4896b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:27.571527 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ec7c8b43-5ccc-4dba-98f9-bfe3803b814b tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 200 len: 1427 microversion: 2.1 time: 0.438216 May 21 21:39:27.573361 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2738/5597] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:27 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 1427 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:27.814231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2226aa75-45af-4623-a700-6256152802c7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01346cc1-2b76-407c-9c84-8982256c9623"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:39:27.815950 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2226aa75-45af-4623-a700-6256152802c7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:27.830404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2226aa75-45af-4623-a700-6256152802c7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:27.832818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2226aa75-45af-4623-a700-6256152802c7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:27.834005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2226aa75-45af-4623-a700-6256152802c7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:27.836382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2226aa75-45af-4623-a700-6256152802c7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:28.152016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-d5bfd97f-dc8c-4899-bbb2-42c04e1d6924 req-f9303c2b-85c7-441c-b687-5199ba000f58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "490c94b0-b64f-4b74-90d2-a6972c6bd8a5", "tag": "0775ded7-f0a3-4833-a397-de269afa6c87"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:39:28.152016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-d5bfd97f-dc8c-4899-bbb2-42c04e1d6924 req-f9303c2b-85c7-441c-b687-5199ba000f58 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:28.152016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-d5bfd97f-dc8c-4899-bbb2-42c04e1d6924 req-f9303c2b-85c7-441c-b687-5199ba000f58 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:28.167126 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-d5bfd97f-dc8c-4899-bbb2-42c04e1d6924 req-f9303c2b-85c7-441c-b687-5199ba000f58 service nova] Creating event network-changed:0775ded7-f0a3-4833-a397-de269afa6c87 for instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 on nch2-master-1 May 21 21:39:28.172111 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-d5bfd97f-dc8c-4899-bbb2-42c04e1d6924 req-f9303c2b-85c7-441c-b687-5199ba000f58 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040166 May 21 21:39:28.176026 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2739/5598] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:39:28.590477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6867a8ba-a845-4aff-b364-1fb20c9a25d8 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:28.591188 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6867a8ba-a845-4aff-b364-1fb20c9a25d8 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:28.606092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6867a8ba-a845-4aff-b364-1fb20c9a25d8 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:28.606548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6867a8ba-a845-4aff-b364-1fb20c9a25d8 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:28.607515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6867a8ba-a845-4aff-b364-1fb20c9a25d8 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:28.607970 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6867a8ba-a845-4aff-b364-1fb20c9a25d8 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:28.848510 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2226aa75-45af-4623-a700-6256152802c7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "POST /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.040035 May 21 21:39:28.849139 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2860/5599] 10.222.0.49 () {60 vars in 1322 bytes} [Sat May 21 21:39:27 2022] POST /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc/os-volume_attachments => generated 194 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:39:29.129914 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6867a8ba-a845-4aff-b364-1fb20c9a25d8 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4719c5630b42c6b6d180255db3a202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03901d3dd7b42a4816399ae4896b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:29.139099 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6867a8ba-a845-4aff-b364-1fb20c9a25d8 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 200 len: 1427 microversion: 2.1 time: 0.552854 May 21 21:39:29.150470 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2740/5600] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:28 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 1427 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:39:30.161171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b64b287e-042b-4234-a5c6-1087322d4875 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:30.165996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b64b287e-042b-4234-a5c6-1087322d4875 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:30.171243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:39:30.178977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b64b287e-042b-4234-a5c6-1087322d4875 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:30.180744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b64b287e-042b-4234-a5c6-1087322d4875 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:30.181678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b64b287e-042b-4234-a5c6-1087322d4875 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:30.183934 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b64b287e-042b-4234-a5c6-1087322d4875 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:30.778798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b64b287e-042b-4234-a5c6-1087322d4875 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4719c5630b42c6b6d180255db3a202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03901d3dd7b42a4816399ae4896b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:30.791254 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b64b287e-042b-4234-a5c6-1087322d4875 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 200 len: 1427 microversion: 2.1 time: 0.637928 May 21 21:39:30.792432 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2861/5601] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:30 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 1427 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:31.809445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-867972e4-ec11-46cc-862b-67e60e45cffd tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:31.810161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-867972e4-ec11-46cc-862b-67e60e45cffd tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:31.822550 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:39:31.834314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-867972e4-ec11-46cc-862b-67e60e45cffd tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:31.834314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-867972e4-ec11-46cc-862b-67e60e45cffd tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:31.834314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-867972e4-ec11-46cc-862b-67e60e45cffd tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:31.834314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-867972e4-ec11-46cc-862b-67e60e45cffd tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:32.032818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-867972e4-ec11-46cc-862b-67e60e45cffd tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4719c5630b42c6b6d180255db3a202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03901d3dd7b42a4816399ae4896b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:32.041182 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-867972e4-ec11-46cc-862b-67e60e45cffd tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 200 len: 1427 microversion: 2.1 time: 0.235944 May 21 21:39:32.041975 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2741/5602] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:31 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 1427 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:33.058926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a3f04c72-01f6-4e7a-8997-a5da5cb14ed2 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:33.060234 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a3f04c72-01f6-4e7a-8997-a5da5cb14ed2 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:33.064581 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=12 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:39:33.071002 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a3f04c72-01f6-4e7a-8997-a5da5cb14ed2 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:33.071757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a3f04c72-01f6-4e7a-8997-a5da5cb14ed2 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:33.072793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a3f04c72-01f6-4e7a-8997-a5da5cb14ed2 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:33.074537 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a3f04c72-01f6-4e7a-8997-a5da5cb14ed2 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:33.410691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e7f28918-455c-4b35-833b-53429d079538 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Action: 'create', calling method: .version_select at 0x7fc819d0d550>, body: {"keypair": {"name": "tempest-keypair-152943240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx5vkfg6KxR/jCUyIZuNLbPi0ej21jqKDbHTic3zCv9rXRNz6ahBGCrjZYTGJH1AtmbvRSI4jcRLHJftA25eZ1ZzSsq+FJUgyc39P5q2+D0zzvvDzUDePeTpP72z4BuAQ=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:39:33.433540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-e7f28918-455c-4b35-833b-53429d079538 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Getting quotas for project 41b9c87f24cd4bac983b83b49daeae5a. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:39:33.439930 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-e7f28918-455c-4b35-833b-53429d079538 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Getting quotas for user f01908adbe2c4aebb89d6fd3af3de207 and project 41b9c87f24cd4bac983b83b49daeae5a. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:39:33.541627 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e7f28918-455c-4b35-833b-53429d079538 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.137609 May 21 21:39:33.542703 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2742/5603] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:39:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:39:33.603827 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a3f04c72-01f6-4e7a-8997-a5da5cb14ed2 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4719c5630b42c6b6d180255db3a202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03901d3dd7b42a4816399ae4896b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:33.621658 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a3f04c72-01f6-4e7a-8997-a5da5cb14ed2 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 200 len: 1427 microversion: 2.1 time: 0.561506 May 21 21:39:33.622478 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2862/5604] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:33 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 1427 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:34.642085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7690924e-51fd-4824-893c-53e13637c81d tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:34.644945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7690924e-51fd-4824-893c-53e13637c81d tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:34.655470 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7690924e-51fd-4824-893c-53e13637c81d tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:34.656140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7690924e-51fd-4824-893c-53e13637c81d tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:34.656962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7690924e-51fd-4824-893c-53e13637c81d tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:34.657402 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7690924e-51fd-4824-893c-53e13637c81d tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:34.993056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7690924e-51fd-4824-893c-53e13637c81d tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4719c5630b42c6b6d180255db3a202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03901d3dd7b42a4816399ae4896b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:34.995761 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7690924e-51fd-4824-893c-53e13637c81d tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 200 len: 1427 microversion: 2.1 time: 0.360682 May 21 21:39:34.996750 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2743/5605] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:34 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 1427 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:39:35.648826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-6600b970-cffb-4ab7-937e-7a4f20d9509a req-be4ae316-1066-4863-b772-b1dc7820457f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "490c94b0-b64f-4b74-90d2-a6972c6bd8a5", "name": "network-vif-plugged", "status": "completed", "tag": "0775ded7-f0a3-4833-a397-de269afa6c87"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:39:35.659884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6600b970-cffb-4ab7-937e-7a4f20d9509a req-be4ae316-1066-4863-b772-b1dc7820457f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:35.660001 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6600b970-cffb-4ab7-937e-7a4f20d9509a req-be4ae316-1066-4863-b772-b1dc7820457f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:35.682925 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-6600b970-cffb-4ab7-937e-7a4f20d9509a req-be4ae316-1066-4863-b772-b1dc7820457f service nova] Creating event network-vif-plugged:0775ded7-f0a3-4833-a397-de269afa6c87 for instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 on nch2-master-1 May 21 21:39:35.698894 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-6600b970-cffb-4ab7-937e-7a4f20d9509a req-be4ae316-1066-4863-b772-b1dc7820457f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052850 May 21 21:39:35.702076 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2863/5606] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:39:36.013230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7e7aeb81-7625-4e19-be9a-e68a407150a0 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:36.013864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7e7aeb81-7625-4e19-be9a-e68a407150a0 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:36.023891 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e7aeb81-7625-4e19-be9a-e68a407150a0 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:36.024801 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e7aeb81-7625-4e19-be9a-e68a407150a0 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:36.025951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e7aeb81-7625-4e19-be9a-e68a407150a0 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:36.026750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e7aeb81-7625-4e19-be9a-e68a407150a0 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:36.387432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7e7aeb81-7625-4e19-be9a-e68a407150a0 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4719c5630b42c6b6d180255db3a202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03901d3dd7b42a4816399ae4896b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:36.402647 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7e7aeb81-7625-4e19-be9a-e68a407150a0 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 200 len: 1427 microversion: 2.1 time: 0.393127 May 21 21:39:36.420670 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2744/5607] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:36 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 1427 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:37.428307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cac0384a-5b65-4312-9a4d-6e41314a4e46 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:37.428756 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f3536627-243d-45bc-a2db-067d296ccdcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-141699619", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b9f276e-ad4f-4a34-856b-bc3620bd7879"}], "security_groups": [{"name": "tempest-securitygroup--1639744877"}], "key_name": "tempest-keypair-152943240", "user_data": "}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:39:37.429132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cac0384a-5b65-4312-9a4d-6e41314a4e46 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:37.437991 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cac0384a-5b65-4312-9a4d-6e41314a4e46 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:37.438669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cac0384a-5b65-4312-9a4d-6e41314a4e46 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:37.439609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cac0384a-5b65-4312-9a4d-6e41314a4e46 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:37.440189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cac0384a-5b65-4312-9a4d-6e41314a4e46 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:37.662019 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-f3536627-243d-45bc-a2db-067d296ccdcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] validate_networks() for [('7b9f276e-ad4f-4a34-856b-bc3620bd7879', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:39:37.963616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cac0384a-5b65-4312-9a4d-6e41314a4e46 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4719c5630b42c6b6d180255db3a202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03901d3dd7b42a4816399ae4896b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:37.973010 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cac0384a-5b65-4312-9a4d-6e41314a4e46 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 200 len: 1608 microversion: 2.1 time: 0.550040 May 21 21:39:37.985602 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2864/5608] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:37 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 1608 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:37.993195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8b3b2252-641b-429e-ae3b-f440d0c9e50b tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:37.994076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8b3b2252-641b-429e-ae3b-f440d0c9e50b tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:38.002039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b3b2252-641b-429e-ae3b-f440d0c9e50b tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:38.003264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b3b2252-641b-429e-ae3b-f440d0c9e50b tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:38.004075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b3b2252-641b-429e-ae3b-f440d0c9e50b tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:38.004726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b3b2252-641b-429e-ae3b-f440d0c9e50b tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:38.426503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8b3b2252-641b-429e-ae3b-f440d0c9e50b tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4719c5630b42c6b6d180255db3a202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03901d3dd7b42a4816399ae4896b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:38.446416 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8b3b2252-641b-429e-ae3b-f440d0c9e50b tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 200 len: 1608 microversion: 2.1 time: 0.454777 May 21 21:39:38.464384 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2865/5609] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:37 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 1608 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:38.470595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a813b27c-5be0-4587-96f8-69be227510ed tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:38.471476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a813b27c-5be0-4587-96f8-69be227510ed tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:38.478961 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a813b27c-5be0-4587-96f8-69be227510ed tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:38.479679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a813b27c-5be0-4587-96f8-69be227510ed tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:38.480752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a813b27c-5be0-4587-96f8-69be227510ed tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:38.481453 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a813b27c-5be0-4587-96f8-69be227510ed tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:38.491722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f3536627-243d-45bc-a2db-067d296ccdcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:39:38.491722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f3536627-243d-45bc-a2db-067d296ccdcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:39:38.492262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f3536627-243d-45bc-a2db-067d296ccdcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:39:38.494069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f3536627-243d-45bc-a2db-067d296ccdcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:39:38.494542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f3536627-243d-45bc-a2db-067d296ccdcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:39:38.519575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3536627-243d-45bc-a2db-067d296ccdcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:38.520991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3536627-243d-45bc-a2db-067d296ccdcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:38.523024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3536627-243d-45bc-a2db-067d296ccdcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:38.523632 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3536627-243d-45bc-a2db-067d296ccdcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:38.546252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-f3536627-243d-45bc-a2db-067d296ccdcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Getting quotas for project 41b9c87f24cd4bac983b83b49daeae5a. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:39:38.556751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-f3536627-243d-45bc-a2db-067d296ccdcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Getting quotas for user f01908adbe2c4aebb89d6fd3af3de207 and project 41b9c87f24cd4bac983b83b49daeae5a. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:39:38.574447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f3536627-243d-45bc-a2db-067d296ccdcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:39:38.582898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f3536627-243d-45bc-a2db-067d296ccdcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:39:38.786191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a813b27c-5be0-4587-96f8-69be227510ed tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4719c5630b42c6b6d180255db3a202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03901d3dd7b42a4816399ae4896b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:38.796469 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a813b27c-5be0-4587-96f8-69be227510ed tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 200 len: 1608 microversion: 2.1 time: 0.330485 May 21 21:39:38.798265 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2866/5610] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:38 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 1608 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:38.973309 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f3536627-243d-45bc-a2db-067d296ccdcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.551197 May 21 21:39:38.981851 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2745/5611] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:39:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 1560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:39:38.993994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-049a899d-1fec-41e6-9e55-02d80bcd66c3 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:38.994934 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-049a899d-1fec-41e6-9e55-02d80bcd66c3 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:39.116443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-049a899d-1fec-41e6-9e55-02d80bcd66c3 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:39.132250 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-049a899d-1fec-41e6-9e55-02d80bcd66c3 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76" status: 200 len: 1240 microversion: 2.1 time: 0.140735 May 21 21:39:39.132250 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2867/5612] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:38 2022] GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 => generated 1240 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:40.148125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-65b3a86b-cfdc-4dba-aa17-ab7f329368d6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:40.150256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-65b3a86b-cfdc-4dba-aa17-ab7f329368d6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:40.304645 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-65b3a86b-cfdc-4dba-aa17-ab7f329368d6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:40.313398 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-65b3a86b-cfdc-4dba-aa17-ab7f329368d6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76" status: 200 len: 1240 microversion: 2.1 time: 0.169896 May 21 21:39:40.323759 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2746/5613] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:40 2022] GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 => generated 1240 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:41.335812 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d4c90802-9c76-44f2-a8d8-ccf37bea1a33 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:41.336545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d4c90802-9c76-44f2-a8d8-ccf37bea1a33 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:41.345317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d4c90802-9c76-44f2-a8d8-ccf37bea1a33 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:41.346049 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d4c90802-9c76-44f2-a8d8-ccf37bea1a33 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:41.346995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d4c90802-9c76-44f2-a8d8-ccf37bea1a33 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:41.347609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d4c90802-9c76-44f2-a8d8-ccf37bea1a33 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:41.515954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d4c90802-9c76-44f2-a8d8-ccf37bea1a33 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:41.527050 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d4c90802-9c76-44f2-a8d8-ccf37bea1a33 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76" status: 200 len: 1292 microversion: 2.1 time: 0.199960 May 21 21:39:41.528540 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2868/5614] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:41 2022] GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 => generated 1292 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:42.548272 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b37bfda4-947e-41ff-a5fd-3ab3c6a4dd4e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:42.548776 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b37bfda4-947e-41ff-a5fd-3ab3c6a4dd4e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:42.560150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b37bfda4-947e-41ff-a5fd-3ab3c6a4dd4e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:42.564441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b37bfda4-947e-41ff-a5fd-3ab3c6a4dd4e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:42.566776 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b37bfda4-947e-41ff-a5fd-3ab3c6a4dd4e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:42.569795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b37bfda4-947e-41ff-a5fd-3ab3c6a4dd4e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:42.721590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b37bfda4-947e-41ff-a5fd-3ab3c6a4dd4e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:42.736900 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b37bfda4-947e-41ff-a5fd-3ab3c6a4dd4e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76" status: 200 len: 1298 microversion: 2.1 time: 0.190532 May 21 21:39:42.749269 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2747/5615] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:42 2022] GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 => generated 1298 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:43.757229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f6396968-a0fe-4901-8f88-f3be97122709 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:43.759152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f6396968-a0fe-4901-8f88-f3be97122709 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:43.790499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6396968-a0fe-4901-8f88-f3be97122709 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:43.791137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6396968-a0fe-4901-8f88-f3be97122709 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:43.792627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6396968-a0fe-4901-8f88-f3be97122709 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:43.793637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6396968-a0fe-4901-8f88-f3be97122709 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:44.154606 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-1d83663e-b2bc-48eb-a4d4-95378f913cd9 req-9a9edbba-7d74-4be4-a12e-8db3ff9960aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "490c94b0-b64f-4b74-90d2-a6972c6bd8a5", "tag": "0775ded7-f0a3-4833-a397-de269afa6c87"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:39:44.170203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-1d83663e-b2bc-48eb-a4d4-95378f913cd9 req-9a9edbba-7d74-4be4-a12e-8db3ff9960aa service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:44.170673 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-1d83663e-b2bc-48eb-a4d4-95378f913cd9 req-9a9edbba-7d74-4be4-a12e-8db3ff9960aa service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:44.178066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=53 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:39:44.190916 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-1d83663e-b2bc-48eb-a4d4-95378f913cd9 req-9a9edbba-7d74-4be4-a12e-8db3ff9960aa service nova] Creating event network-changed:0775ded7-f0a3-4833-a397-de269afa6c87 for instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 on nch2-master-1 May 21 21:39:44.199513 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-1d83663e-b2bc-48eb-a4d4-95378f913cd9 req-9a9edbba-7d74-4be4-a12e-8db3ff9960aa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050189 May 21 21:39:44.201030 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2748/5616] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:39:44.826793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f6396968-a0fe-4901-8f88-f3be97122709 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:44.839496 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f6396968-a0fe-4901-8f88-f3be97122709 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76" status: 200 len: 1366 microversion: 2.1 time: 1.087555 May 21 21:39:44.840097 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2869/5617] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:43 2022] GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 => generated 1366 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:45.858748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fa365174-ff30-41e9-913b-e325fd4a986f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:45.861506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fa365174-ff30-41e9-913b-e325fd4a986f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:45.877091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa365174-ff30-41e9-913b-e325fd4a986f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:45.877626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa365174-ff30-41e9-913b-e325fd4a986f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:45.878440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa365174-ff30-41e9-913b-e325fd4a986f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:45.878894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa365174-ff30-41e9-913b-e325fd4a986f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:46.240769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-b812bcfc-818f-4c99-b7bb-79875e76396f req-29aacd5a-0f5c-48b8-8c4f-ec94b59bf270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c3c7c67-2ce7-4df1-bdae-5278e5e39f76", "tag": "9625b6c8-f42f-4b5e-bf2a-d7d245fc6fcf"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:39:46.252941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b812bcfc-818f-4c99-b7bb-79875e76396f req-29aacd5a-0f5c-48b8-8c4f-ec94b59bf270 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:46.253765 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b812bcfc-818f-4c99-b7bb-79875e76396f req-29aacd5a-0f5c-48b8-8c4f-ec94b59bf270 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:46.267026 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-b812bcfc-818f-4c99-b7bb-79875e76396f req-29aacd5a-0f5c-48b8-8c4f-ec94b59bf270 service nova] Creating event network-changed:9625b6c8-f42f-4b5e-bf2a-d7d245fc6fcf for instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 on nch1-master-1 May 21 21:39:46.272750 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-b812bcfc-818f-4c99-b7bb-79875e76396f req-29aacd5a-0f5c-48b8-8c4f-ec94b59bf270 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038439 May 21 21:39:46.275339 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2870/5618] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:39:46.284377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fa365174-ff30-41e9-913b-e325fd4a986f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:46.292949 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fa365174-ff30-41e9-913b-e325fd4a986f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76" status: 200 len: 1366 microversion: 2.1 time: 0.439848 May 21 21:39:46.293998 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2749/5619] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:45 2022] GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 => generated 1366 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:47.312299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fc4817d7-4719-4116-a4a4-eccafea1d06d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:47.319923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fc4817d7-4719-4116-a4a4-eccafea1d06d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:47.327363 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc4817d7-4719-4116-a4a4-eccafea1d06d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:47.339215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc4817d7-4719-4116-a4a4-eccafea1d06d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:47.340169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc4817d7-4719-4116-a4a4-eccafea1d06d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:47.340566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc4817d7-4719-4116-a4a4-eccafea1d06d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:47.790909 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fc4817d7-4719-4116-a4a4-eccafea1d06d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:47.799696 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fc4817d7-4719-4116-a4a4-eccafea1d06d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76" status: 200 len: 1366 microversion: 2.1 time: 0.492798 May 21 21:39:47.809156 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2871/5620] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:47 2022] GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 => generated 1366 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:48.817250 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-48eefc65-47d1-4e38-8602-5e60664ab030 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:48.818469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-48eefc65-47d1-4e38-8602-5e60664ab030 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:48.822661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:39:48.826758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-48eefc65-47d1-4e38-8602-5e60664ab030 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:48.827399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-48eefc65-47d1-4e38-8602-5e60664ab030 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:48.828424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-48eefc65-47d1-4e38-8602-5e60664ab030 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:48.829020 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-48eefc65-47d1-4e38-8602-5e60664ab030 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:49.112133 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-48eefc65-47d1-4e38-8602-5e60664ab030 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:49.122039 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-48eefc65-47d1-4e38-8602-5e60664ab030 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76" status: 200 len: 1366 microversion: 2.1 time: 0.308972 May 21 21:39:49.122643 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2750/5621] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:48 2022] GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:50.143593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d1fb53fb-cad9-479c-9fbb-ec207b3220d5 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:50.144210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d1fb53fb-cad9-479c-9fbb-ec207b3220d5 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:50.151705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:39:50.152962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:39:50.154305 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d1fb53fb-cad9-479c-9fbb-ec207b3220d5 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:50.154867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d1fb53fb-cad9-479c-9fbb-ec207b3220d5 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:50.156735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d1fb53fb-cad9-479c-9fbb-ec207b3220d5 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:50.156735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d1fb53fb-cad9-479c-9fbb-ec207b3220d5 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:50.161517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:39:50.493075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d1fb53fb-cad9-479c-9fbb-ec207b3220d5 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:50.506557 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d1fb53fb-cad9-479c-9fbb-ec207b3220d5 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76" status: 200 len: 1366 microversion: 2.1 time: 0.367145 May 21 21:39:50.507730 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2872/5622] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:50 2022] GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 => generated 1366 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:51.535034 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b5c81556-44f1-445b-b28a-acf3d893e7e8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:51.535848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b5c81556-44f1-445b-b28a-acf3d893e7e8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:51.560050 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=12 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:39:51.561465 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=5 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:39:51.563895 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5c81556-44f1-445b-b28a-acf3d893e7e8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:51.564605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5c81556-44f1-445b-b28a-acf3d893e7e8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:51.565699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5c81556-44f1-445b-b28a-acf3d893e7e8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:51.566387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5c81556-44f1-445b-b28a-acf3d893e7e8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:51.892208 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b5c81556-44f1-445b-b28a-acf3d893e7e8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:51.903456 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b5c81556-44f1-445b-b28a-acf3d893e7e8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76" status: 200 len: 1366 microversion: 2.1 time: 0.382187 May 21 21:39:51.904490 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2751/5623] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:51 2022] GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 => generated 1366 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:52.924539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-34ed1fca-7986-4287-afa5-80d3cfa31e9b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:52.925163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-34ed1fca-7986-4287-afa5-80d3cfa31e9b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:52.946877 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34ed1fca-7986-4287-afa5-80d3cfa31e9b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:52.952746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34ed1fca-7986-4287-afa5-80d3cfa31e9b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:52.954917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34ed1fca-7986-4287-afa5-80d3cfa31e9b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:52.955529 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-34ed1fca-7986-4287-afa5-80d3cfa31e9b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:53.143475 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-3a9540ff-e6be-458b-9ee3-98b54c876528 req-4df4e5a4-4046-4f34-afc1-7a984f6cf686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c3c7c67-2ce7-4df1-bdae-5278e5e39f76", "name": "network-vif-plugged", "status": "completed", "tag": "9625b6c8-f42f-4b5e-bf2a-d7d245fc6fcf"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:39:53.165815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3a9540ff-e6be-458b-9ee3-98b54c876528 req-4df4e5a4-4046-4f34-afc1-7a984f6cf686 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:53.169769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3a9540ff-e6be-458b-9ee3-98b54c876528 req-4df4e5a4-4046-4f34-afc1-7a984f6cf686 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:53.189473 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-3a9540ff-e6be-458b-9ee3-98b54c876528 req-4df4e5a4-4046-4f34-afc1-7a984f6cf686 service nova] Creating event network-vif-plugged:9625b6c8-f42f-4b5e-bf2a-d7d245fc6fcf for instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 on nch1-master-1 May 21 21:39:53.194858 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-3a9540ff-e6be-458b-9ee3-98b54c876528 req-4df4e5a4-4046-4f34-afc1-7a984f6cf686 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056466 May 21 21:39:53.196060 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2752/5624] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:39:53.216583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-34ed1fca-7986-4287-afa5-80d3cfa31e9b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:53.227891 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-34ed1fca-7986-4287-afa5-80d3cfa31e9b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76" status: 200 len: 1366 microversion: 2.1 time: 0.310008 May 21 21:39:53.228513 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2873/5625] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:52 2022] GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:54.246250 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-81629142-bf73-4c23-a478-f57700313056 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:54.246964 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-81629142-bf73-4c23-a478-f57700313056 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:54.255149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81629142-bf73-4c23-a478-f57700313056 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:54.265989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81629142-bf73-4c23-a478-f57700313056 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:54.265989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81629142-bf73-4c23-a478-f57700313056 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:54.265989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81629142-bf73-4c23-a478-f57700313056 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:54.872252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-81629142-bf73-4c23-a478-f57700313056 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:54.881366 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-81629142-bf73-4c23-a478-f57700313056 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76" status: 200 len: 1366 microversion: 2.1 time: 0.639902 May 21 21:39:54.882055 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2753/5626] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:54 2022] GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 => generated 1366 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:55.898950 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bfff9f6a-dafc-4b89-ad93-bbc3355e0adc tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:55.899819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bfff9f6a-dafc-4b89-ad93-bbc3355e0adc tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:55.921167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bfff9f6a-dafc-4b89-ad93-bbc3355e0adc tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:55.921288 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bfff9f6a-dafc-4b89-ad93-bbc3355e0adc tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:55.926457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bfff9f6a-dafc-4b89-ad93-bbc3355e0adc tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:55.927077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bfff9f6a-dafc-4b89-ad93-bbc3355e0adc tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:56.233372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bfff9f6a-dafc-4b89-ad93-bbc3355e0adc tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:39:56.246621 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bfff9f6a-dafc-4b89-ad93-bbc3355e0adc tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76" status: 200 len: 1556 microversion: 2.1 time: 0.352357 May 21 21:39:56.247938 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2874/5627] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:39:55 2022] GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 => generated 1556 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:39:56.267455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-586a7603-1196-4a8c-8c0f-65a750779f8e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:39:56.268685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-586a7603-1196-4a8c-8c0f-65a750779f8e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:39:56.280447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-586a7603-1196-4a8c-8c0f-65a750779f8e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:56.281494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-586a7603-1196-4a8c-8c0f-65a750779f8e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:56.282738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-586a7603-1196-4a8c-8c0f-65a750779f8e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:56.283391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-586a7603-1196-4a8c-8c0f-65a750779f8e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:56.485302 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-586a7603-1196-4a8c-8c0f-65a750779f8e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.223640 May 21 21:39:56.488167 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2754/5628] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 21:39:56 2022] GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76/os-interface => generated 285 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:39:58.936543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-8080a938-b688-466f-bd7b-53a949968a9f req-328be75e-0850-40e8-a6ff-74c0f87c2488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c3c7c67-2ce7-4df1-bdae-5278e5e39f76", "tag": "9625b6c8-f42f-4b5e-bf2a-d7d245fc6fcf"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:39:58.947824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8080a938-b688-466f-bd7b-53a949968a9f req-328be75e-0850-40e8-a6ff-74c0f87c2488 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:39:58.948798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8080a938-b688-466f-bd7b-53a949968a9f req-328be75e-0850-40e8-a6ff-74c0f87c2488 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:39:58.963403 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-8080a938-b688-466f-bd7b-53a949968a9f req-328be75e-0850-40e8-a6ff-74c0f87c2488 service nova] Creating event network-changed:9625b6c8-f42f-4b5e-bf2a-d7d245fc6fcf for instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 on nch1-master-1 May 21 21:39:58.975338 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-8080a938-b688-466f-bd7b-53a949968a9f req-328be75e-0850-40e8-a6ff-74c0f87c2488 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042562 May 21 21:39:58.976667 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2875/5629] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:40:15.868315 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-577cc911-ec55-4084-ae90-cc694ae002a5 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:15.868866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-577cc911-ec55-4084-ae90-cc694ae002a5 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:15.872109 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=7 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:40:15.872831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=31 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:40:15.882562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-577cc911-ec55-4084-ae90-cc694ae002a5 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:15.886806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-577cc911-ec55-4084-ae90-cc694ae002a5 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:15.887845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-577cc911-ec55-4084-ae90-cc694ae002a5 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:15.888484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-577cc911-ec55-4084-ae90-cc694ae002a5 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:15.934616 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-577cc911-ec55-4084-ae90-cc694ae002a5 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.070308 May 21 21:40:15.939917 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2755/5630] 10.222.0.49 () {58 vars in 1292 bytes} [Sat May 21 21:40:15 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5/os-server-password => generated 116 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:40:31.072434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=7 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:40:31.074041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=19 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:40:31.087769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-46c41363-989a-4b4b-9a6d-f4b031abef34 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:31.088476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-46c41363-989a-4b4b-9a6d-f4b031abef34 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:31.095517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46c41363-989a-4b4b-9a6d-f4b031abef34 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:31.099031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46c41363-989a-4b4b-9a6d-f4b031abef34 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:31.099031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46c41363-989a-4b4b-9a6d-f4b031abef34 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:31.099031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46c41363-989a-4b4b-9a6d-f4b031abef34 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:31.124808 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-46c41363-989a-4b4b-9a6d-f4b031abef34 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76/ips" status: 200 len: 150 microversion: 2.1 time: 0.054799 May 21 21:40:31.125398 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2876/5631] 10.222.0.49 () {58 vars in 1247 bytes} [Sat May 21 21:40:31 2022] GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76/ips => generated 150 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:40:31.137127 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1320873b-ce4c-4c96-b0aa-78fda2b9bce5 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01346cc1-2b76-407c-9c84-8982256c9623"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:40:31.138373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1320873b-ce4c-4c96-b0aa-78fda2b9bce5 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:31.146937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1320873b-ce4c-4c96-b0aa-78fda2b9bce5 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:31.149376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1320873b-ce4c-4c96-b0aa-78fda2b9bce5 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:31.151025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1320873b-ce4c-4c96-b0aa-78fda2b9bce5 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:31.152059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1320873b-ce4c-4c96-b0aa-78fda2b9bce5 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:31.497959 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-1320873b-ce4c-4c96-b0aa-78fda2b9bce5 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] HTTP exception thrown: Invalid volume: volume 01346cc1-2b76-407c-9c84-8982256c9623 is already attached to instances: 4cec7592-1285-42ea-8563-a49982585edc May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1320873b-ce4c-4c96-b0aa-78fda2b9bce5 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Request method failure captured: May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76/os-volume_attachments HTTP/1.1 May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 74 May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVvVu5OzFh24dUt3T88Soh9um-hz8IBE4d2VFNx-7YcUllc6ZgBzSOlBZt4dp3QDBJfl3krubFG6vrVTWf0UKEtCtTXwmRMqQ2n6JZxp3lQ_OPmOt-nERii-Ro60TAc3AEIDmkAGoz0K0OzdsNDz_o5Rh8C_XfpIypxa4UiR_gbJbi4 May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_41b9c87f24cd4bac983b83b49daeae5a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-AttachVolumeNegativeTest-617587518 May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: f01908adbe2c4aebb89d6fd3af3de207 May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: {"volumeAttachment": {"volumeId": "01346cc1-2b76-407c-9c84-8982256c9623"}} May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: exception: Invalid volume: volume 01346cc1-2b76-407c-9c84-8982256c9623 is already attached to instances: 4cec7592-1285-42ea-8563-a49982585edc May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'server_id': '6c3c7c67-2ce7-4df1-bdae-5278e5e39f76', 'body': {'volumeAttachment': {'volumeId': '01346cc1-2b76-407c-9c84-8982256c9623'}}} May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 01346cc1-2b76-407c-9c84-8982256c9623 is already attached to instances: 4cec7592-1285-42ea-8563-a49982585edc May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:40:31.499865 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:40:31.509828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:40:31.509828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:40:31.509828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 21 21:40:31.509828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 21 21:40:31.509828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 01346cc1-2b76-407c-9c84-8982256c9623 is already attached to instances: 4cec7592-1285-42ea-8563-a49982585edc May 21 21:40:31.509828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:40:31.509828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:40:31.509828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:40:31.509828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:40:31.509828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:40:31.509828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:40:31.509828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:40:31.509828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:40:31.509828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 01346cc1-2b76-407c-9c84-8982256c9623 is already attached to instances: 4cec7592-1285-42ea-8563-a49982585edc May 21 21:40:31.509828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:40:31.509828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1320873b-ce4c-4c96-b0aa-78fda2b9bce5 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Returning 400 to user: Invalid volume: volume 01346cc1-2b76-407c-9c84-8982256c9623 is already attached to instances: 4cec7592-1285-42ea-8563-a49982585edc {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:40:31.509828 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1320873b-ce4c-4c96-b0aa-78fda2b9bce5 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "POST /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.369340 May 21 21:40:31.509828 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2756/5632] 10.222.0.49 () {60 vars in 1322 bytes} [Sat May 21 21:40:31 2022] POST /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76/os-volume_attachments => generated 174 bytes in 371 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:40:31.510851 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-38760697-ce22-47d7-9319-b5619c52cbcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:31.510851 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-38760697-ce22-47d7-9319-b5619c52cbcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:31.518254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38760697-ce22-47d7-9319-b5619c52cbcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:31.518708 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38760697-ce22-47d7-9319-b5619c52cbcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:31.519482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38760697-ce22-47d7-9319-b5619c52cbcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:31.519941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-38760697-ce22-47d7-9319-b5619c52cbcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:31.548713 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-38760697-ce22-47d7-9319-b5619c52cbcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:40:31.894611 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-38760697-ce22-47d7-9319-b5619c52cbcb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76" status: 204 len: 0 microversion: 2.1 time: 0.387746 May 21 21:40:31.895602 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2877/5633] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:40:31 2022] DELETE /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:40:31.904420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-06f49945-ab51-432a-bc7b-04aeee2e204c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:31.905442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-06f49945-ab51-432a-bc7b-04aeee2e204c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:31.915133 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06f49945-ab51-432a-bc7b-04aeee2e204c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:31.915604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06f49945-ab51-432a-bc7b-04aeee2e204c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:31.916429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06f49945-ab51-432a-bc7b-04aeee2e204c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:31.917086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06f49945-ab51-432a-bc7b-04aeee2e204c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:32.177053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-06f49945-ab51-432a-bc7b-04aeee2e204c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:40:32.184998 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-06f49945-ab51-432a-bc7b-04aeee2e204c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76" status: 200 len: 1681 microversion: 2.1 time: 0.285074 May 21 21:40:32.185574 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2757/5634] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:40:31 2022] GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 => generated 1681 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:40:33.208995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-daeaabe7-1360-4f6e-a663-b24b20269c05 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:33.210578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-daeaabe7-1360-4f6e-a663-b24b20269c05 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:33.219262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-daeaabe7-1360-4f6e-a663-b24b20269c05 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:33.219712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-daeaabe7-1360-4f6e-a663-b24b20269c05 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:33.220820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-daeaabe7-1360-4f6e-a663-b24b20269c05 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:33.221920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-daeaabe7-1360-4f6e-a663-b24b20269c05 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:33.648388 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-daeaabe7-1360-4f6e-a663-b24b20269c05 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:40:33.658688 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-daeaabe7-1360-4f6e-a663-b24b20269c05 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76" status: 200 len: 1681 microversion: 2.1 time: 0.457698 May 21 21:40:33.659537 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2878/5635] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:40:33 2022] GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 => generated 1681 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:40:34.677973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-33e1100a-096f-4fae-8f70-b3ffe693821d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:34.683493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-33e1100a-096f-4fae-8f70-b3ffe693821d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:34.685623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33e1100a-096f-4fae-8f70-b3ffe693821d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:34.686267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33e1100a-096f-4fae-8f70-b3ffe693821d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:34.687230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33e1100a-096f-4fae-8f70-b3ffe693821d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:34.687877 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33e1100a-096f-4fae-8f70-b3ffe693821d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:34.800888 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-33e1100a-096f-4fae-8f70-b3ffe693821d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:40:34.816072 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-33e1100a-096f-4fae-8f70-b3ffe693821d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76" status: 200 len: 1613 microversion: 2.1 time: 0.143551 May 21 21:40:34.817029 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2758/5636] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:40:34 2022] GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 => generated 1613 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:40:35.541977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-88c6d76d-b35a-47a5-9b5c-f2824acb6158 req-26dc0d4e-27e6-489f-9f6c-f96fedf85e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c3c7c67-2ce7-4df1-bdae-5278e5e39f76", "name": "network-vif-deleted", "tag": "9625b6c8-f42f-4b5e-bf2a-d7d245fc6fcf"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:40:35.553346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-88c6d76d-b35a-47a5-9b5c-f2824acb6158 req-26dc0d4e-27e6-489f-9f6c-f96fedf85e76 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:35.553976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-88c6d76d-b35a-47a5-9b5c-f2824acb6158 req-26dc0d4e-27e6-489f-9f6c-f96fedf85e76 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:35.567232 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-88c6d76d-b35a-47a5-9b5c-f2824acb6158 req-26dc0d4e-27e6-489f-9f6c-f96fedf85e76 service nova] Creating event network-vif-deleted:9625b6c8-f42f-4b5e-bf2a-d7d245fc6fcf for instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 on nch1-master-1 May 21 21:40:35.572838 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-88c6d76d-b35a-47a5-9b5c-f2824acb6158 req-26dc0d4e-27e6-489f-9f6c-f96fedf85e76 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035299 May 21 21:40:35.573986 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2879/5637] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:40:35.836021 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cfc22387-26dc-456f-902e-8f75153fc131 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:35.836844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cfc22387-26dc-456f-902e-8f75153fc131 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:35.845918 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cfc22387-26dc-456f-902e-8f75153fc131 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:35.847615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cfc22387-26dc-456f-902e-8f75153fc131 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:35.848897 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cfc22387-26dc-456f-902e-8f75153fc131 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:35.849634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cfc22387-26dc-456f-902e-8f75153fc131 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:35.890669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cfc22387-26dc-456f-902e-8f75153fc131 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:35.891435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cfc22387-26dc-456f-902e-8f75153fc131 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:35.892159 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-cfc22387-26dc-456f-902e-8f75153fc131 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lazy-loading 'fault' on Instance uuid 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:40:36.172730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cfc22387-26dc-456f-902e-8f75153fc131 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:40:36.185337 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cfc22387-26dc-456f-902e-8f75153fc131 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76" status: 200 len: 1330 microversion: 2.1 time: 0.354142 May 21 21:40:36.186419 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2759/5638] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:40:35 2022] GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 => generated 1330 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:40:37.206891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6946b7bc-eafe-4c93-b572-fd063c23906c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:37.208546 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6946b7bc-eafe-4c93-b572-fd063c23906c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:37.221244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6946b7bc-eafe-4c93-b572-fd063c23906c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:37.221859 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6946b7bc-eafe-4c93-b572-fd063c23906c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:37.223626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6946b7bc-eafe-4c93-b572-fd063c23906c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:37.224339 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6946b7bc-eafe-4c93-b572-fd063c23906c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:37.246141 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-6946b7bc-eafe-4c93-b572-fd063c23906c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] HTTP exception thrown: Instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 could not be found. May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6946b7bc-eafe-4c93-b572-fd063c23906c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Request method failure captured: May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 HTTP/1.1 May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVvVu5OzFh24dUt3T88Soh9um-hz8IBE4d2VFNx-7YcUllc6ZgBzSOlBZt4dp3QDBJfl3krubFG6vrVTWf0UKEtCtTXwmRMqQ2n6JZxp3lQ_OPmOt-nERii-Ro60TAc3AEIDmkAGoz0K0OzdsNDz_o5Rh8C_XfpIypxa4UiR_gbJbi4 May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_41b9c87f24cd4bac983b83b49daeae5a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AttachVolumeNegativeTest-617587518 May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: f01908adbe2c4aebb89d6fd3af3de207 May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 could not be found. May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '6c3c7c67-2ce7-4df1-bdae-5278e5e39f76'} May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 could not be found. May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 could not be found. May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:40:37.249632 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:40:37.259195 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:40:37.259195 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:40:37.259195 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:40:37.259195 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:40:37.259195 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:40:37.259195 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 could not be found. May 21 21:40:37.259195 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:40:37.259195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6946b7bc-eafe-4c93-b572-fd063c23906c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Returning 404 to user: Instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:40:37.262524 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6946b7bc-eafe-4c93-b572-fd063c23906c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76" status: 404 len: 111 microversion: 2.1 time: 0.062317 May 21 21:40:37.263742 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2880/5639] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:40:37 2022] GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:40:37.274949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0b57475f-371b-42ac-a970-57d585d3788d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '.version_select at 0x7fc819daa790>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:37.328433 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0b57475f-371b-42ac-a970-57d585d3788d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-152943240" status: 202 len: 0 microversion: 2.1 time: 0.058407 May 21 21:40:37.332448 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2760/5640] 10.222.0.49 () {58 vars in 1217 bytes} [Sat May 21 21:40:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-152943240 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:40:38.972693 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0dd93f70-700f-43cf-8474-b2e1e4323a18 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:38.973204 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0dd93f70-700f-43cf-8474-b2e1e4323a18 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:38.980436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0dd93f70-700f-43cf-8474-b2e1e4323a18 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:38.980890 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0dd93f70-700f-43cf-8474-b2e1e4323a18 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:38.981718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0dd93f70-700f-43cf-8474-b2e1e4323a18 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:38.982158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0dd93f70-700f-43cf-8474-b2e1e4323a18 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:39.088855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-0dd93f70-700f-43cf-8474-b2e1e4323a18 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lazy-loading 'services' on Instance uuid 4cec7592-1285-42ea-8563-a49982585edc {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:40:39.253165 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0dd93f70-700f-43cf-8474-b2e1e4323a18 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc/os-volume_attachments/01346cc1-2b76-407c-9c84-8982256c9623" status: 202 len: 0 microversion: 2.1 time: 0.284166 May 21 21:40:39.254123 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2881/5641] 10.222.0.49 () {58 vars in 1415 bytes} [Sat May 21 21:40:38 2022] DELETE /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc/os-volume_attachments/01346cc1-2b76-407c-9c84-8982256c9623 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:40:39.263699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-015401e8-5f8d-47b8-9f39-a9591e2631d1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:39.265382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-015401e8-5f8d-47b8-9f39-a9591e2631d1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:39.274673 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-015401e8-5f8d-47b8-9f39-a9591e2631d1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:39.275297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-015401e8-5f8d-47b8-9f39-a9591e2631d1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:39.276203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-015401e8-5f8d-47b8-9f39-a9591e2631d1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:39.276798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-015401e8-5f8d-47b8-9f39-a9591e2631d1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:39.309770 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-015401e8-5f8d-47b8-9f39-a9591e2631d1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050332 May 21 21:40:39.310522 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2761/5642] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:40:39 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:40:40.322977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-57f5343e-0ae1-4ffe-9cd3-2adfb09694b0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:40.324104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-57f5343e-0ae1-4ffe-9cd3-2adfb09694b0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:40.334669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57f5343e-0ae1-4ffe-9cd3-2adfb09694b0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:40.336173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57f5343e-0ae1-4ffe-9cd3-2adfb09694b0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:40.336357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57f5343e-0ae1-4ffe-9cd3-2adfb09694b0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:40.337307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57f5343e-0ae1-4ffe-9cd3-2adfb09694b0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:40.373621 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-57f5343e-0ae1-4ffe-9cd3-2adfb09694b0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054956 May 21 21:40:40.376171 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2882/5643] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:40:40 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:40:40.446626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-44aa276d-0486-4f12-9228-b95cdd2dd0fb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:40.448316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-44aa276d-0486-4f12-9228-b95cdd2dd0fb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:40.457086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44aa276d-0486-4f12-9228-b95cdd2dd0fb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:40.457707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44aa276d-0486-4f12-9228-b95cdd2dd0fb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:40.458608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44aa276d-0486-4f12-9228-b95cdd2dd0fb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:40.459148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44aa276d-0486-4f12-9228-b95cdd2dd0fb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:40.490439 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-44aa276d-0486-4f12-9228-b95cdd2dd0fb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:40:40.750048 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-44aa276d-0486-4f12-9228-b95cdd2dd0fb tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 204 len: 0 microversion: 2.1 time: 0.307552 May 21 21:40:40.750676 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2762/5644] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:40:40 2022] DELETE /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:40:40.760203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-701e96a1-34e3-429a-a395-aa9db3c714e8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:40.760865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-701e96a1-34e3-429a-a395-aa9db3c714e8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:40.768376 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-701e96a1-34e3-429a-a395-aa9db3c714e8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:40.769088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-701e96a1-34e3-429a-a395-aa9db3c714e8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:40.769888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-701e96a1-34e3-429a-a395-aa9db3c714e8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:40.770334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-701e96a1-34e3-429a-a395-aa9db3c714e8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:41.133061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-701e96a1-34e3-429a-a395-aa9db3c714e8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:40:41.143419 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-701e96a1-34e3-429a-a395-aa9db3c714e8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 200 len: 1682 microversion: 2.1 time: 0.387719 May 21 21:40:41.144096 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2883/5645] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:40:40 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 1682 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:40:42.162166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-12c5422f-3562-4f87-89de-0def54df341f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:42.162982 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-12c5422f-3562-4f87-89de-0def54df341f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:42.170918 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-12c5422f-3562-4f87-89de-0def54df341f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:42.171509 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-12c5422f-3562-4f87-89de-0def54df341f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:42.172424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-12c5422f-3562-4f87-89de-0def54df341f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:42.172962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-12c5422f-3562-4f87-89de-0def54df341f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:42.384364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-12c5422f-3562-4f87-89de-0def54df341f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:40:42.397052 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-12c5422f-3562-4f87-89de-0def54df341f tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 200 len: 1682 microversion: 2.1 time: 0.239972 May 21 21:40:42.397880 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2763/5646] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:40:42 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 1682 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:40:43.415506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bb63bad0-df95-4f6f-99de-b1216cb0cb79 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:43.416692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bb63bad0-df95-4f6f-99de-b1216cb0cb79 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:43.423357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb63bad0-df95-4f6f-99de-b1216cb0cb79 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:43.425112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb63bad0-df95-4f6f-99de-b1216cb0cb79 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:43.425910 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb63bad0-df95-4f6f-99de-b1216cb0cb79 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:43.426351 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb63bad0-df95-4f6f-99de-b1216cb0cb79 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:43.742222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bb63bad0-df95-4f6f-99de-b1216cb0cb79 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:40:43.753777 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bb63bad0-df95-4f6f-99de-b1216cb0cb79 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 200 len: 1614 microversion: 2.1 time: 0.341977 May 21 21:40:43.755129 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2884/5647] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:40:43 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 1614 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:40:44.551887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-3af08014-b547-4fc0-b234-50de03c6fdd0 req-0ad7dcaa-4e6b-4675-bcc8-ba37c38a8d05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cec7592-1285-42ea-8563-a49982585edc", "name": "network-vif-deleted", "tag": "9887480f-d175-4ebb-8008-cb6e07e2ed6b"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:40:44.563456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3af08014-b547-4fc0-b234-50de03c6fdd0 req-0ad7dcaa-4e6b-4675-bcc8-ba37c38a8d05 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:44.563901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3af08014-b547-4fc0-b234-50de03c6fdd0 req-0ad7dcaa-4e6b-4675-bcc8-ba37c38a8d05 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:44.576202 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-3af08014-b547-4fc0-b234-50de03c6fdd0 req-0ad7dcaa-4e6b-4675-bcc8-ba37c38a8d05 service nova] Creating event network-vif-deleted:9887480f-d175-4ebb-8008-cb6e07e2ed6b for instance 4cec7592-1285-42ea-8563-a49982585edc on nch1-master-1 May 21 21:40:44.581641 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-3af08014-b547-4fc0-b234-50de03c6fdd0 req-0ad7dcaa-4e6b-4675-bcc8-ba37c38a8d05 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035306 May 21 21:40:44.582771 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2764/5648] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:40:44.772062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8be10f49-d378-49e0-acdb-c39252034f52 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:44.772766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8be10f49-d378-49e0-acdb-c39252034f52 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:44.780329 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8be10f49-d378-49e0-acdb-c39252034f52 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:44.780797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8be10f49-d378-49e0-acdb-c39252034f52 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:44.781578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8be10f49-d378-49e0-acdb-c39252034f52 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:44.782027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8be10f49-d378-49e0-acdb-c39252034f52 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:44.888944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8be10f49-d378-49e0-acdb-c39252034f52 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:40:44.899716 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8be10f49-d378-49e0-acdb-c39252034f52 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 200 len: 1326 microversion: 2.1 time: 0.132381 May 21 21:40:44.911804 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2885/5649] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:40:44 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 1326 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:40:45.924730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c12a1c3c-ec2f-4db0-ac31-53773093702d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:45.925674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c12a1c3c-ec2f-4db0-ac31-53773093702d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:45.935592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c12a1c3c-ec2f-4db0-ac31-53773093702d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:45.936193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c12a1c3c-ec2f-4db0-ac31-53773093702d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:45.938189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c12a1c3c-ec2f-4db0-ac31-53773093702d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:45.938737 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c12a1c3c-ec2f-4db0-ac31-53773093702d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:45.962278 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-c12a1c3c-ec2f-4db0-ac31-53773093702d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] HTTP exception thrown: Instance 4cec7592-1285-42ea-8563-a49982585edc could not be found. May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c12a1c3c-ec2f-4db0-ac31-53773093702d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Request method failure captured: May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc HTTP/1.1 May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVvVu5OzFh24dUt3T88Soh9um-hz8IBE4d2VFNx-7YcUllc6ZgBzSOlBZt4dp3QDBJfl3krubFG6vrVTWf0UKEtCtTXwmRMqQ2n6JZxp3lQ_OPmOt-nERii-Ro60TAc3AEIDmkAGoz0K0OzdsNDz_o5Rh8C_XfpIypxa4UiR_gbJbi4 May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_41b9c87f24cd4bac983b83b49daeae5a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-AttachVolumeNegativeTest-617587518 May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: f01908adbe2c4aebb89d6fd3af3de207 May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 4cec7592-1285-42ea-8563-a49982585edc could not be found. May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '4cec7592-1285-42ea-8563-a49982585edc'} May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cec7592-1285-42ea-8563-a49982585edc could not be found. May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cec7592-1285-42ea-8563-a49982585edc could not be found. May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:40:45.964340 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:40:45.968505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:40:45.968505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:40:45.968505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:40:45.968505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:40:45.968505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:40:45.968505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cec7592-1285-42ea-8563-a49982585edc could not be found. May 21 21:40:45.968505 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:40:45.969089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c12a1c3c-ec2f-4db0-ac31-53773093702d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Returning 404 to user: Instance 4cec7592-1285-42ea-8563-a49982585edc could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:40:45.971102 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c12a1c3c-ec2f-4db0-ac31-53773093702d tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 404 len: 111 microversion: 2.1 time: 0.051727 May 21 21:40:45.991748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5645940c-227f-4383-a314-7a105997643c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '.version_select at 0x7fc81a341940>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:45.998464 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2765/5650] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:40:45 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:40:46.129446 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5645940c-227f-4383-a314-7a105997643c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-827461958" status: 202 len: 0 microversion: 2.1 time: 0.152421 May 21 21:40:46.133695 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2886/5651] 10.222.0.49 () {58 vars in 1217 bytes} [Sat May 21 21:40:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-827461958 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:40:48.202227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8985bffb-4975-4525-be0e-35fab8f8ea36 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Action: 'create', calling method: .version_select at 0x7fc819d8b670>, body: {"keypair": {"name": "tempest-keypair-1427855483", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqYZM84CObOxMgkKzkgNJIqlDlbyIBGD2OJXYVR9cvcYlM0rTXjGOdcl4XNyny0KEbcv8RC+4SICxq8EdjffRKRuHqqnR1r3u73wPrunkZJ4xe+6fnge6ESXF5IW1JjIA=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:40:48.219956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-8985bffb-4975-4525-be0e-35fab8f8ea36 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Getting quotas for project 41b9c87f24cd4bac983b83b49daeae5a. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:40:48.228957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-8985bffb-4975-4525-be0e-35fab8f8ea36 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Getting quotas for user f01908adbe2c4aebb89d6fd3af3de207 and project 41b9c87f24cd4bac983b83b49daeae5a. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:40:48.319644 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8985bffb-4975-4525-be0e-35fab8f8ea36 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121010 May 21 21:40:48.323174 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2766/5652] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:40:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:40:52.337895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d619282f-cbd1-4661-8727-b2656fe31c15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-202912136", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b9f276e-ad4f-4a34-856b-bc3620bd7879"}], "security_groups": [{"name": "tempest-securitygroup--741203799"}], "key_name": "tempest-keypair-1427855483", "user_data": "}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:40:52.748066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-d619282f-cbd1-4661-8727-b2656fe31c15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] validate_networks() for [('7b9f276e-ad4f-4a34-856b-bc3620bd7879', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:40:53.932086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-d619282f-cbd1-4661-8727-b2656fe31c15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:40:53.932731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-d619282f-cbd1-4661-8727-b2656fe31c15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:40:53.933020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-d619282f-cbd1-4661-8727-b2656fe31c15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:40:53.933465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-d619282f-cbd1-4661-8727-b2656fe31c15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:40:53.933919 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-d619282f-cbd1-4661-8727-b2656fe31c15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:40:53.945120 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d619282f-cbd1-4661-8727-b2656fe31c15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:53.945750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d619282f-cbd1-4661-8727-b2656fe31c15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:53.946567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d619282f-cbd1-4661-8727-b2656fe31c15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:53.947173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d619282f-cbd1-4661-8727-b2656fe31c15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:53.965938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-d619282f-cbd1-4661-8727-b2656fe31c15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Getting quotas for project 41b9c87f24cd4bac983b83b49daeae5a. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:40:53.972199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-d619282f-cbd1-4661-8727-b2656fe31c15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Getting quotas for user f01908adbe2c4aebb89d6fd3af3de207 and project 41b9c87f24cd4bac983b83b49daeae5a. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:40:53.985406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d619282f-cbd1-4661-8727-b2656fe31c15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:40:53.988020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d619282f-cbd1-4661-8727-b2656fe31c15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:40:54.203634 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d619282f-cbd1-4661-8727-b2656fe31c15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.870246 May 21 21:40:54.216664 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2887/5653] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:40:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 1884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:40:54.223624 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-737398db-aae7-427b-a452-1b48bb089257 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:54.226397 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-737398db-aae7-427b-a452-1b48bb089257 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:54.355567 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-737398db-aae7-427b-a452-1b48bb089257 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:40:54.365161 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-737398db-aae7-427b-a452-1b48bb089257 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57" status: 200 len: 1241 microversion: 2.1 time: 0.149172 May 21 21:40:54.367012 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2767/5654] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:40:54 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 => generated 1241 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:40:55.387654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c35aa8a5-8277-4703-92bb-38ce9f5ae1a0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:55.389120 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c35aa8a5-8277-4703-92bb-38ce9f5ae1a0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:55.399244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c35aa8a5-8277-4703-92bb-38ce9f5ae1a0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:55.400020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c35aa8a5-8277-4703-92bb-38ce9f5ae1a0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:55.400845 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c35aa8a5-8277-4703-92bb-38ce9f5ae1a0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:55.401484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c35aa8a5-8277-4703-92bb-38ce9f5ae1a0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:55.506577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c35aa8a5-8277-4703-92bb-38ce9f5ae1a0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:40:55.515533 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c35aa8a5-8277-4703-92bb-38ce9f5ae1a0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57" status: 200 len: 1245 microversion: 2.1 time: 0.136884 May 21 21:40:55.525702 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2888/5655] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:40:55 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 => generated 1245 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:40:56.536899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ff76a8e0-97e9-495f-b6b0-4ff16d1bc6ac tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:56.537597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ff76a8e0-97e9-495f-b6b0-4ff16d1bc6ac tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:56.540557 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:40:56.571529 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff76a8e0-97e9-495f-b6b0-4ff16d1bc6ac tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:56.572468 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff76a8e0-97e9-495f-b6b0-4ff16d1bc6ac tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:56.573654 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff76a8e0-97e9-495f-b6b0-4ff16d1bc6ac tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:56.574310 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff76a8e0-97e9-495f-b6b0-4ff16d1bc6ac tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:56.680201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ff76a8e0-97e9-495f-b6b0-4ff16d1bc6ac tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:40:56.691192 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ff76a8e0-97e9-495f-b6b0-4ff16d1bc6ac tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57" status: 200 len: 1301 microversion: 2.1 time: 0.162390 May 21 21:40:56.692042 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2768/5656] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:40:56 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 => generated 1301 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:40:57.709789 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-33d2ced9-b62e-4bf6-8604-efde4a7f3aca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:57.711284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-33d2ced9-b62e-4bf6-8604-efde4a7f3aca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:57.719549 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33d2ced9-b62e-4bf6-8604-efde4a7f3aca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:57.720077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33d2ced9-b62e-4bf6-8604-efde4a7f3aca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:57.722229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33d2ced9-b62e-4bf6-8604-efde4a7f3aca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:57.722879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33d2ced9-b62e-4bf6-8604-efde4a7f3aca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:57.801366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-33d2ced9-b62e-4bf6-8604-efde4a7f3aca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:40:57.810993 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-33d2ced9-b62e-4bf6-8604-efde4a7f3aca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57" status: 200 len: 1299 microversion: 2.1 time: 0.104446 May 21 21:40:57.810993 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2889/5657] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:40:57 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:40:58.828796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ea5f5038-3e84-40b1-8fab-2bba4c160e8c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:40:58.829417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ea5f5038-3e84-40b1-8fab-2bba4c160e8c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:40:58.839620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ea5f5038-3e84-40b1-8fab-2bba4c160e8c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:58.840988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ea5f5038-3e84-40b1-8fab-2bba4c160e8c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:58.842523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ea5f5038-3e84-40b1-8fab-2bba4c160e8c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:58.843121 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ea5f5038-3e84-40b1-8fab-2bba4c160e8c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:59.558487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ea5f5038-3e84-40b1-8fab-2bba4c160e8c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:40:59.567830 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ea5f5038-3e84-40b1-8fab-2bba4c160e8c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57" status: 200 len: 1366 microversion: 2.1 time: 0.744614 May 21 21:40:59.568550 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2769/5658] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:40:58 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 => generated 1366 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:40:59.699267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-2dcc4494-705c-4867-860e-b199f5fec740 req-c6584f8d-8bf5-436f-98ce-0ac9da132a84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57", "tag": "ffcec92b-41a7-4336-8da9-896496224456"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:40:59.711280 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2dcc4494-705c-4867-860e-b199f5fec740 req-c6584f8d-8bf5-436f-98ce-0ac9da132a84 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:40:59.711861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2dcc4494-705c-4867-860e-b199f5fec740 req-c6584f8d-8bf5-436f-98ce-0ac9da132a84 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:40:59.726260 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-2dcc4494-705c-4867-860e-b199f5fec740 req-c6584f8d-8bf5-436f-98ce-0ac9da132a84 service nova] Creating event network-changed:ffcec92b-41a7-4336-8da9-896496224456 for instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 on nch1-master-1 May 21 21:40:59.732513 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-2dcc4494-705c-4867-860e-b199f5fec740 req-c6584f8d-8bf5-436f-98ce-0ac9da132a84 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037676 May 21 21:40:59.734167 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2890/5659] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:41:00.586810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5ca85678-7dbb-444d-a665-89afa538ba2b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:00.587545 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5ca85678-7dbb-444d-a665-89afa538ba2b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:00.595738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ca85678-7dbb-444d-a665-89afa538ba2b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:00.600363 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ca85678-7dbb-444d-a665-89afa538ba2b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:00.601305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ca85678-7dbb-444d-a665-89afa538ba2b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:00.602864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ca85678-7dbb-444d-a665-89afa538ba2b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:00.935218 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5ca85678-7dbb-444d-a665-89afa538ba2b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:00.944724 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5ca85678-7dbb-444d-a665-89afa538ba2b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57" status: 200 len: 1366 microversion: 2.1 time: 0.362526 May 21 21:41:00.953316 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2770/5660] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:00 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:01.969799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e1036701-0fef-4a2e-a6f5-32525b709437 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:01.970944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e1036701-0fef-4a2e-a6f5-32525b709437 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:01.973662 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:41:01.979312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1036701-0fef-4a2e-a6f5-32525b709437 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:01.979848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1036701-0fef-4a2e-a6f5-32525b709437 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:01.980755 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1036701-0fef-4a2e-a6f5-32525b709437 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:01.981273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1036701-0fef-4a2e-a6f5-32525b709437 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:01.985747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:41:02.343744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e1036701-0fef-4a2e-a6f5-32525b709437 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:02.353480 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e1036701-0fef-4a2e-a6f5-32525b709437 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57" status: 200 len: 1366 microversion: 2.1 time: 0.395076 May 21 21:41:02.354234 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2891/5661] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:01 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 => generated 1366 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:03.378921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f7c7c154-ad21-4899-859f-80c9c7a609f1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:03.380187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f7c7c154-ad21-4899-859f-80c9c7a609f1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:03.394524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:41:03.399680 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f7c7c154-ad21-4899-859f-80c9c7a609f1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:03.400214 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f7c7c154-ad21-4899-859f-80c9c7a609f1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:03.401119 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f7c7c154-ad21-4899-859f-80c9c7a609f1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:03.401626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f7c7c154-ad21-4899-859f-80c9c7a609f1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:03.713429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f7c7c154-ad21-4899-859f-80c9c7a609f1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:03.723786 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f7c7c154-ad21-4899-859f-80c9c7a609f1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57" status: 200 len: 1366 microversion: 2.1 time: 0.356887 May 21 21:41:03.742083 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2771/5662] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:03 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 => generated 1366 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:03.848837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0099a70c-48ca-4eb7-9e46-186f554455d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-2031890240", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "ef139d27-7a33-4233-a13e-7075d9dbc231"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:41:03.923939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-0099a70c-48ca-4eb7-9e46-186f554455d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] validate_networks() for [('ef139d27-7a33-4233-a13e-7075d9dbc231', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:41:03.957588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:41:03.979397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:41:04.477379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-0099a70c-48ca-4eb7-9e46-186f554455d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:41:04.477820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-0099a70c-48ca-4eb7-9e46-186f554455d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:41:04.478490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-0099a70c-48ca-4eb7-9e46-186f554455d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:41:04.478916 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-0099a70c-48ca-4eb7-9e46-186f554455d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:41:04.479338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-0099a70c-48ca-4eb7-9e46-186f554455d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:41:04.490015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0099a70c-48ca-4eb7-9e46-186f554455d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:04.490479 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0099a70c-48ca-4eb7-9e46-186f554455d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:04.491299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0099a70c-48ca-4eb7-9e46-186f554455d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:04.491749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0099a70c-48ca-4eb7-9e46-186f554455d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:04.510462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-0099a70c-48ca-4eb7-9e46-186f554455d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Getting quotas for project ce7a2804147443428f76312db8fac560. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:41:04.516723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-0099a70c-48ca-4eb7-9e46-186f554455d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Getting quotas for user a7985923a95348bda97f1012377157fd and project ce7a2804147443428f76312db8fac560. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:41:04.531370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0099a70c-48ca-4eb7-9e46-186f554455d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:41:04.533743 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0099a70c-48ca-4eb7-9e46-186f554455d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:41:04.666847 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0099a70c-48ca-4eb7-9e46-186f554455d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.977793 May 21 21:41:04.681049 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2892/5663] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:41:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:41:04.687800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-250a6fad-9965-46d1-8f17-9e420abcdf57 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:04.688490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-250a6fad-9965-46d1-8f17-9e420abcdf57 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:04.690506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:41:04.743112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-575a1ab0-8431-49f8-a1a9-ead5b83f182b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:04.744088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-575a1ab0-8431-49f8-a1a9-ead5b83f182b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:04.763761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-575a1ab0-8431-49f8-a1a9-ead5b83f182b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:04.764233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-575a1ab0-8431-49f8-a1a9-ead5b83f182b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:04.767881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-575a1ab0-8431-49f8-a1a9-ead5b83f182b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:04.768430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-575a1ab0-8431-49f8-a1a9-ead5b83f182b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:04.873919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-250a6fad-9965-46d1-8f17-9e420abcdf57 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:04.884471 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-250a6fad-9965-46d1-8f17-9e420abcdf57 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1215 microversion: 2.1 time: 0.201499 May 21 21:41:04.885101 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2772/5664] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:04 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1215 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:41:05.040392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-575a1ab0-8431-49f8-a1a9-ead5b83f182b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:05.051143 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-575a1ab0-8431-49f8-a1a9-ead5b83f182b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57" status: 200 len: 1366 microversion: 2.1 time: 0.313898 May 21 21:41:05.053227 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2893/5665] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:04 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:41:05.905365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-34fe31f6-3710-4d01-8ffb-8ab8ea68347b tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:05.906152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-34fe31f6-3710-4d01-8ffb-8ab8ea68347b tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:06.007541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-34fe31f6-3710-4d01-8ffb-8ab8ea68347b tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:06.014659 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-34fe31f6-3710-4d01-8ffb-8ab8ea68347b tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1215 microversion: 2.1 time: 0.116634 May 21 21:41:06.015245 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2773/5666] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:05 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1215 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:06.068729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5da9aa3c-bf1d-4f40-95bb-bae35f06ed7c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:06.069432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5da9aa3c-bf1d-4f40-95bb-bae35f06ed7c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:06.076648 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5da9aa3c-bf1d-4f40-95bb-bae35f06ed7c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:06.077102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5da9aa3c-bf1d-4f40-95bb-bae35f06ed7c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:06.077872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5da9aa3c-bf1d-4f40-95bb-bae35f06ed7c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:06.078312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5da9aa3c-bf1d-4f40-95bb-bae35f06ed7c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:06.260157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5da9aa3c-bf1d-4f40-95bb-bae35f06ed7c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:06.275377 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5da9aa3c-bf1d-4f40-95bb-bae35f06ed7c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57" status: 200 len: 1366 microversion: 2.1 time: 0.210577 May 21 21:41:06.287219 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2894/5667] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:06 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:06.998059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-91c825a9-0264-4ebb-93b8-d26e3983bec2 req-3dd930fb-dfc6-42c5-a1ce-5c1852163164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57", "name": "network-vif-plugged", "status": "completed", "tag": "ffcec92b-41a7-4336-8da9-896496224456"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:41:07.007075 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-91c825a9-0264-4ebb-93b8-d26e3983bec2 req-3dd930fb-dfc6-42c5-a1ce-5c1852163164 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:07.007524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-91c825a9-0264-4ebb-93b8-d26e3983bec2 req-3dd930fb-dfc6-42c5-a1ce-5c1852163164 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:07.018710 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-91c825a9-0264-4ebb-93b8-d26e3983bec2 req-3dd930fb-dfc6-42c5-a1ce-5c1852163164 service nova] Creating event network-vif-plugged:ffcec92b-41a7-4336-8da9-896496224456 for instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 on nch1-master-1 May 21 21:41:07.023780 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-91c825a9-0264-4ebb-93b8-d26e3983bec2 req-3dd930fb-dfc6-42c5-a1ce-5c1852163164 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029949 May 21 21:41:07.024411 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2774/5668] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:41:07.032918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9592eb93-6b9e-4dc3-bb6b-0f4b8fee76bc tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:07.036590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9592eb93-6b9e-4dc3-bb6b-0f4b8fee76bc tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:07.043885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9592eb93-6b9e-4dc3-bb6b-0f4b8fee76bc tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:07.044466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9592eb93-6b9e-4dc3-bb6b-0f4b8fee76bc tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:07.045457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9592eb93-6b9e-4dc3-bb6b-0f4b8fee76bc tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:07.045937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9592eb93-6b9e-4dc3-bb6b-0f4b8fee76bc tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:07.157893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9592eb93-6b9e-4dc3-bb6b-0f4b8fee76bc tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:07.166175 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9592eb93-6b9e-4dc3-bb6b-0f4b8fee76bc tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1267 microversion: 2.1 time: 0.137511 May 21 21:41:07.167429 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2895/5669] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:07 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:07.294014 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-010112b2-3254-42d4-b856-8cf5ede26de2 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:07.294978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-010112b2-3254-42d4-b856-8cf5ede26de2 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:07.304805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-010112b2-3254-42d4-b856-8cf5ede26de2 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:07.305609 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-010112b2-3254-42d4-b856-8cf5ede26de2 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:07.306913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-010112b2-3254-42d4-b856-8cf5ede26de2 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:07.307963 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-010112b2-3254-42d4-b856-8cf5ede26de2 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:07.584627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-010112b2-3254-42d4-b856-8cf5ede26de2 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:07.597669 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-010112b2-3254-42d4-b856-8cf5ede26de2 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57" status: 200 len: 1366 microversion: 2.1 time: 0.307355 May 21 21:41:07.598786 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2775/5670] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:07 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:08.183235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2695b04f-935e-4335-aa70-67d835dc6bdc tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:08.183990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2695b04f-935e-4335-aa70-67d835dc6bdc tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:08.191319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2695b04f-935e-4335-aa70-67d835dc6bdc tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:08.192025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2695b04f-935e-4335-aa70-67d835dc6bdc tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:08.192919 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2695b04f-935e-4335-aa70-67d835dc6bdc tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:08.193439 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2695b04f-935e-4335-aa70-67d835dc6bdc tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:08.418821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2695b04f-935e-4335-aa70-67d835dc6bdc tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:08.429639 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2695b04f-935e-4335-aa70-67d835dc6bdc tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1315 microversion: 2.1 time: 0.250379 May 21 21:41:08.430252 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2896/5671] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:08 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:08.615762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-996ed7c9-6691-4523-9e45-33d3df8b8595 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:08.616437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-996ed7c9-6691-4523-9e45-33d3df8b8595 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:08.629409 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-996ed7c9-6691-4523-9e45-33d3df8b8595 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:08.630820 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-996ed7c9-6691-4523-9e45-33d3df8b8595 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:08.631641 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-996ed7c9-6691-4523-9e45-33d3df8b8595 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:08.632083 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-996ed7c9-6691-4523-9e45-33d3df8b8595 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:09.106798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-996ed7c9-6691-4523-9e45-33d3df8b8595 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:09.116747 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-996ed7c9-6691-4523-9e45-33d3df8b8595 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57" status: 200 len: 1556 microversion: 2.1 time: 0.504900 May 21 21:41:09.117644 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2776/5672] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:08 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 => generated 1556 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:09.134419 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0b4370a0-219c-43db-bcba-33d487b540b9 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:09.135193 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0b4370a0-219c-43db-bcba-33d487b540b9 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:09.141818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b4370a0-219c-43db-bcba-33d487b540b9 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:09.142385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b4370a0-219c-43db-bcba-33d487b540b9 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:09.143275 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b4370a0-219c-43db-bcba-33d487b540b9 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:09.143931 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b4370a0-219c-43db-bcba-33d487b540b9 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:09.311231 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0b4370a0-219c-43db-bcba-33d487b540b9 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.180940 May 21 21:41:09.317928 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2897/5673] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 21:41:09 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57/os-interface => generated 285 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:41:09.449641 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-af380639-98fb-4b25-b518-10942d5a54ed tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:09.451106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-af380639-98fb-4b25-b518-10942d5a54ed tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:09.458999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-af380639-98fb-4b25-b518-10942d5a54ed tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:09.459726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-af380639-98fb-4b25-b518-10942d5a54ed tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:09.460967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-af380639-98fb-4b25-b518-10942d5a54ed tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:09.461744 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-af380639-98fb-4b25-b518-10942d5a54ed tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:10.281515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-af380639-98fb-4b25-b518-10942d5a54ed tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:10.291184 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-af380639-98fb-4b25-b518-10942d5a54ed tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1315 microversion: 2.1 time: 0.845734 May 21 21:41:10.302146 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2777/5674] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:09 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1315 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:11.309491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1ca60cf0-5773-48ae-b903-1812a1b00096 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:11.311067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1ca60cf0-5773-48ae-b903-1812a1b00096 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:11.323020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ca60cf0-5773-48ae-b903-1812a1b00096 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:11.323485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ca60cf0-5773-48ae-b903-1812a1b00096 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:11.324346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ca60cf0-5773-48ae-b903-1812a1b00096 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:11.324966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ca60cf0-5773-48ae-b903-1812a1b00096 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:11.552059 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1ca60cf0-5773-48ae-b903-1812a1b00096 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:11.560979 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1ca60cf0-5773-48ae-b903-1812a1b00096 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1315 microversion: 2.1 time: 0.256394 May 21 21:41:11.561497 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2898/5675] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:11 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:11.882564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-1e958db9-440f-4afc-85ce-f8398581de81 req-89921d72-a2b2-47ec-9096-b10031ba6467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d003042-aaac-436f-87bc-11be3b58a429", "tag": "62204095-e7e0-4338-8091-ae65a8efc822"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:41:11.898226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-1e958db9-440f-4afc-85ce-f8398581de81 req-89921d72-a2b2-47ec-9096-b10031ba6467 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:11.899459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-1e958db9-440f-4afc-85ce-f8398581de81 req-89921d72-a2b2-47ec-9096-b10031ba6467 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:11.912376 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-1e958db9-440f-4afc-85ce-f8398581de81 req-89921d72-a2b2-47ec-9096-b10031ba6467 service nova] Creating event network-changed:62204095-e7e0-4338-8091-ae65a8efc822 for instance 0d003042-aaac-436f-87bc-11be3b58a429 on nch2-master-1 May 21 21:41:11.917543 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-1e958db9-440f-4afc-85ce-f8398581de81 req-89921d72-a2b2-47ec-9096-b10031ba6467 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039188 May 21 21:41:11.918636 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2778/5676] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:41:12.580762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3f0bd134-d529-4e9b-857c-bbca813532d4 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:12.583521 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3f0bd134-d529-4e9b-857c-bbca813532d4 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:12.593591 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f0bd134-d529-4e9b-857c-bbca813532d4 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:12.594047 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f0bd134-d529-4e9b-857c-bbca813532d4 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:12.595006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f0bd134-d529-4e9b-857c-bbca813532d4 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:12.595448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f0bd134-d529-4e9b-857c-bbca813532d4 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:12.902847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3f0bd134-d529-4e9b-857c-bbca813532d4 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:12.914535 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3f0bd134-d529-4e9b-857c-bbca813532d4 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1315 microversion: 2.1 time: 0.339741 May 21 21:41:12.915908 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2899/5677] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:12 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:13.932995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-da4d7d92-594b-4b31-86af-6016d8684283 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:13.934652 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-da4d7d92-594b-4b31-86af-6016d8684283 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:13.944157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da4d7d92-594b-4b31-86af-6016d8684283 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:13.944728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da4d7d92-594b-4b31-86af-6016d8684283 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:13.945705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da4d7d92-594b-4b31-86af-6016d8684283 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:13.946244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da4d7d92-594b-4b31-86af-6016d8684283 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:13.950097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-7193b174-a698-490f-a3a3-b59c67573d92 req-7fb552c8-b4ac-4a27-bf92-5d9cf13e6ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57", "tag": "ffcec92b-41a7-4336-8da9-896496224456"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:41:13.961059 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7193b174-a698-490f-a3a3-b59c67573d92 req-7fb552c8-b4ac-4a27-bf92-5d9cf13e6ce1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:13.961599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7193b174-a698-490f-a3a3-b59c67573d92 req-7fb552c8-b4ac-4a27-bf92-5d9cf13e6ce1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:13.974667 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-7193b174-a698-490f-a3a3-b59c67573d92 req-7fb552c8-b4ac-4a27-bf92-5d9cf13e6ce1 service nova] Creating event network-changed:ffcec92b-41a7-4336-8da9-896496224456 for instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 on nch1-master-1 May 21 21:41:13.980632 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-7193b174-a698-490f-a3a3-b59c67573d92 req-7fb552c8-b4ac-4a27-bf92-5d9cf13e6ce1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034006 May 21 21:41:13.981832 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2900/5678] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:41:14.249386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-da4d7d92-594b-4b31-86af-6016d8684283 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:14.262150 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-da4d7d92-594b-4b31-86af-6016d8684283 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1315 microversion: 2.1 time: 0.333438 May 21 21:41:14.274436 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2779/5679] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:13 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:15.277288 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:41:15.279184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:41:15.285034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4f1b83cc-58a7-422c-b442-146d76b5b965 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:15.286197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4f1b83cc-58a7-422c-b442-146d76b5b965 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:15.293313 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f1b83cc-58a7-422c-b442-146d76b5b965 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:15.294085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f1b83cc-58a7-422c-b442-146d76b5b965 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:15.295076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f1b83cc-58a7-422c-b442-146d76b5b965 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:15.295620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f1b83cc-58a7-422c-b442-146d76b5b965 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:15.776682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4f1b83cc-58a7-422c-b442-146d76b5b965 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:15.784870 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4f1b83cc-58a7-422c-b442-146d76b5b965 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1315 microversion: 2.1 time: 0.508360 May 21 21:41:15.785604 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2901/5680] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:15 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:16.801487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-39e796f7-4665-49cc-92af-e60eec257ca0 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:16.802064 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-39e796f7-4665-49cc-92af-e60eec257ca0 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:16.805001 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:41:16.809903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39e796f7-4665-49cc-92af-e60eec257ca0 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:16.810356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39e796f7-4665-49cc-92af-e60eec257ca0 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:16.811120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39e796f7-4665-49cc-92af-e60eec257ca0 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:16.811564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39e796f7-4665-49cc-92af-e60eec257ca0 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:17.033586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-39e796f7-4665-49cc-92af-e60eec257ca0 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:17.041898 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-39e796f7-4665-49cc-92af-e60eec257ca0 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1315 microversion: 2.1 time: 0.244589 May 21 21:41:17.042501 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2780/5681] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:16 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:18.060377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7efab823-c156-43b7-ad11-97ad140518c9 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:18.061189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7efab823-c156-43b7-ad11-97ad140518c9 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:18.069512 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7efab823-c156-43b7-ad11-97ad140518c9 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:18.069983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7efab823-c156-43b7-ad11-97ad140518c9 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:18.070785 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7efab823-c156-43b7-ad11-97ad140518c9 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:18.071270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7efab823-c156-43b7-ad11-97ad140518c9 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:18.249986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-2ea68554-f2f6-4e06-9813-b3fa7edc1808 req-af4bc029-4e99-49f3-a77d-165df9aa65f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d003042-aaac-436f-87bc-11be3b58a429", "name": "network-vif-plugged", "status": "completed", "tag": "62204095-e7e0-4338-8091-ae65a8efc822"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:41:18.262672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2ea68554-f2f6-4e06-9813-b3fa7edc1808 req-af4bc029-4e99-49f3-a77d-165df9aa65f4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:18.263399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2ea68554-f2f6-4e06-9813-b3fa7edc1808 req-af4bc029-4e99-49f3-a77d-165df9aa65f4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:18.276678 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-2ea68554-f2f6-4e06-9813-b3fa7edc1808 req-af4bc029-4e99-49f3-a77d-165df9aa65f4 service nova] Creating event network-vif-plugged:62204095-e7e0-4338-8091-ae65a8efc822 for instance 0d003042-aaac-436f-87bc-11be3b58a429 on nch2-master-1 May 21 21:41:18.283085 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-2ea68554-f2f6-4e06-9813-b3fa7edc1808 req-af4bc029-4e99-49f3-a77d-165df9aa65f4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189902 May 21 21:41:18.283885 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2781/5682] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:41:18.305059 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7efab823-c156-43b7-ad11-97ad140518c9 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:18.332134 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7efab823-c156-43b7-ad11-97ad140518c9 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1315 microversion: 2.1 time: 0.276320 May 21 21:41:18.344659 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2902/5683] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:18 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:19.353667 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6881cddc-3326-41a0-8e75-45e27f27f3e8 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:19.354630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6881cddc-3326-41a0-8e75-45e27f27f3e8 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:19.362518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6881cddc-3326-41a0-8e75-45e27f27f3e8 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:19.363091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6881cddc-3326-41a0-8e75-45e27f27f3e8 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:19.364504 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6881cddc-3326-41a0-8e75-45e27f27f3e8 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:19.364950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6881cddc-3326-41a0-8e75-45e27f27f3e8 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:19.551727 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6881cddc-3326-41a0-8e75-45e27f27f3e8 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:19.562673 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6881cddc-3326-41a0-8e75-45e27f27f3e8 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1315 microversion: 2.1 time: 0.215568 May 21 21:41:19.563794 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2782/5684] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:19 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:20.581258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-39d407c7-070b-466f-8102-6a058082d2a0 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:20.581883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-39d407c7-070b-466f-8102-6a058082d2a0 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:20.589292 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39d407c7-070b-466f-8102-6a058082d2a0 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:20.589746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39d407c7-070b-466f-8102-6a058082d2a0 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:20.590530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39d407c7-070b-466f-8102-6a058082d2a0 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:20.590964 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39d407c7-070b-466f-8102-6a058082d2a0 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:20.875548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-39d407c7-070b-466f-8102-6a058082d2a0 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:20.883584 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-39d407c7-070b-466f-8102-6a058082d2a0 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1501 microversion: 2.1 time: 0.306315 May 21 21:41:20.884186 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2903/5685] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:20 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1501 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:20.900812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5e6aa98f-7d2a-42d8-a8c9-f4a3fdee3bb8 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:20.901427 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5e6aa98f-7d2a-42d8-a8c9-f4a3fdee3bb8 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:20.908307 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e6aa98f-7d2a-42d8-a8c9-f4a3fdee3bb8 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:20.908791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e6aa98f-7d2a-42d8-a8c9-f4a3fdee3bb8 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:20.909570 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e6aa98f-7d2a-42d8-a8c9-f4a3fdee3bb8 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:20.910106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e6aa98f-7d2a-42d8-a8c9-f4a3fdee3bb8 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:21.061790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5e6aa98f-7d2a-42d8-a8c9-f4a3fdee3bb8 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:21.070208 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5e6aa98f-7d2a-42d8-a8c9-f4a3fdee3bb8 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1501 microversion: 2.1 time: 0.173496 May 21 21:41:21.070793 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2783/5686] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:20 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1501 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:21.086420 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c7e1255f-59ef-49ed-9623-ab410e128d67 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:41:21.086974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c7e1255f-59ef-49ed-9623-ab410e128d67 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:21.093133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7e1255f-59ef-49ed-9623-ab410e128d67 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:21.093584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7e1255f-59ef-49ed-9623-ab410e128d67 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:21.094357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7e1255f-59ef-49ed-9623-ab410e128d67 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:21.094802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c7e1255f-59ef-49ed-9623-ab410e128d67 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:21.121833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-c7e1255f-59ef-49ed-9623-ab410e128d67 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lazy-loading 'flavor' on Instance uuid 0d003042-aaac-436f-87bc-11be3b58a429 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:41:21.453469 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c7e1255f-59ef-49ed-9623-ab410e128d67 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "POST /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429/action" status: 202 len: 0 microversion: 2.1 time: 0.370808 May 21 21:41:21.454209 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2904/5687] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:41:21 2022] POST /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:41:21.462931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5e56e9f5-3b4d-4dc2-bac7-5938be5e67df tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:21.463557 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5e56e9f5-3b4d-4dc2-bac7-5938be5e67df tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:21.478187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e56e9f5-3b4d-4dc2-bac7-5938be5e67df tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:21.489140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e56e9f5-3b4d-4dc2-bac7-5938be5e67df tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:21.489140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e56e9f5-3b4d-4dc2-bac7-5938be5e67df tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:21.489140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e56e9f5-3b4d-4dc2-bac7-5938be5e67df tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:21.687020 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5e56e9f5-3b4d-4dc2-bac7-5938be5e67df tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:21.697358 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5e56e9f5-3b4d-4dc2-bac7-5938be5e67df tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1509 microversion: 2.1 time: 0.238182 May 21 21:41:21.698026 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2784/5688] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:21 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1509 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:22.717846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-faf14fd5-b690-45ef-8f02-1d142fc4cc95 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:22.718592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-faf14fd5-b690-45ef-8f02-1d142fc4cc95 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:22.725475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-faf14fd5-b690-45ef-8f02-1d142fc4cc95 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:22.726005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-faf14fd5-b690-45ef-8f02-1d142fc4cc95 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:22.726959 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-faf14fd5-b690-45ef-8f02-1d142fc4cc95 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:22.727402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-faf14fd5-b690-45ef-8f02-1d142fc4cc95 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:22.892546 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-faf14fd5-b690-45ef-8f02-1d142fc4cc95 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:22.901226 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-faf14fd5-b690-45ef-8f02-1d142fc4cc95 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1492 microversion: 2.1 time: 0.188845 May 21 21:41:22.901961 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2905/5689] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:22 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1492 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:22.919755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5a8c69a4-cb08-4149-bce9-73ff2b2d49fb tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:41:22.920484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5a8c69a4-cb08-4149-bce9-73ff2b2d49fb tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:22.928664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5a8c69a4-cb08-4149-bce9-73ff2b2d49fb tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:22.929115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5a8c69a4-cb08-4149-bce9-73ff2b2d49fb tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:22.930081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5a8c69a4-cb08-4149-bce9-73ff2b2d49fb tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:22.930789 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5a8c69a4-cb08-4149-bce9-73ff2b2d49fb tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:23.071245 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5a8c69a4-cb08-4149-bce9-73ff2b2d49fb tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "POST /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429/action" status: 202 len: 0 microversion: 2.1 time: 0.155827 May 21 21:41:23.071900 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2785/5690] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:41:22 2022] POST /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 21 21:41:23.082602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d2bc63ee-1410-448c-87b0-fe1e12f6f4f6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:23.083508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d2bc63ee-1410-448c-87b0-fe1e12f6f4f6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:23.090084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d2bc63ee-1410-448c-87b0-fe1e12f6f4f6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:23.096781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d2bc63ee-1410-448c-87b0-fe1e12f6f4f6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:23.096781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d2bc63ee-1410-448c-87b0-fe1e12f6f4f6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:23.096781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d2bc63ee-1410-448c-87b0-fe1e12f6f4f6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:23.291338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d2bc63ee-1410-448c-87b0-fe1e12f6f4f6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:23.309296 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d2bc63ee-1410-448c-87b0-fe1e12f6f4f6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1498 microversion: 2.1 time: 0.232766 May 21 21:41:23.317293 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2906/5691] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:23 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1498 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:24.328965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-004bc299-2cdc-4a6a-826e-21ef857313ba tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:24.329672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-004bc299-2cdc-4a6a-826e-21ef857313ba tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:24.337388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-004bc299-2cdc-4a6a-826e-21ef857313ba tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:24.337879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-004bc299-2cdc-4a6a-826e-21ef857313ba tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:24.338644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-004bc299-2cdc-4a6a-826e-21ef857313ba tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:24.339078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-004bc299-2cdc-4a6a-826e-21ef857313ba tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:24.528708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-004bc299-2cdc-4a6a-826e-21ef857313ba tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:24.539624 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-004bc299-2cdc-4a6a-826e-21ef857313ba tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1498 microversion: 2.1 time: 0.215925 May 21 21:41:24.549356 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2786/5692] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:24 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1498 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:25.558757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a8629bff-369a-45b1-bd59-23ef5091a4d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:25.559356 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a8629bff-369a-45b1-bd59-23ef5091a4d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:25.566031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8629bff-369a-45b1-bd59-23ef5091a4d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:25.567092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8629bff-369a-45b1-bd59-23ef5091a4d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:25.568065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8629bff-369a-45b1-bd59-23ef5091a4d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:25.568543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8629bff-369a-45b1-bd59-23ef5091a4d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:25.828495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a8629bff-369a-45b1-bd59-23ef5091a4d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:25.831116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:41:25.838372 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a8629bff-369a-45b1-bd59-23ef5091a4d6 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1501 microversion: 2.1 time: 0.284983 May 21 21:41:25.839129 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2907/5693] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:25 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1501 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:41:25.855957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-83100722-58e4-465e-86fc-df03cad01599 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:41:25.856569 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-83100722-58e4-465e-86fc-df03cad01599 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:25.868735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-83100722-58e4-465e-86fc-df03cad01599 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:25.869433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-83100722-58e4-465e-86fc-df03cad01599 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:25.870454 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-83100722-58e4-465e-86fc-df03cad01599 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:25.871117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-83100722-58e4-465e-86fc-df03cad01599 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:25.893849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:41:25.902880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-83100722-58e4-465e-86fc-df03cad01599 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lazy-loading 'flavor' on Instance uuid 0d003042-aaac-436f-87bc-11be3b58a429 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:41:26.122321 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-83100722-58e4-465e-86fc-df03cad01599 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "POST /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429/action" status: 202 len: 0 microversion: 2.1 time: 0.270344 May 21 21:41:26.126198 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2787/5694] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:41:25 2022] POST /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:41:26.133891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9d62503b-e6a0-421a-8048-43fd0e81a350 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:26.134509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9d62503b-e6a0-421a-8048-43fd0e81a350 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:26.144655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d62503b-e6a0-421a-8048-43fd0e81a350 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:26.145131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d62503b-e6a0-421a-8048-43fd0e81a350 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:26.146125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d62503b-e6a0-421a-8048-43fd0e81a350 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:26.146574 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d62503b-e6a0-421a-8048-43fd0e81a350 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:26.370994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9d62503b-e6a0-421a-8048-43fd0e81a350 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:26.381712 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9d62503b-e6a0-421a-8048-43fd0e81a350 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1509 microversion: 2.1 time: 0.253518 May 21 21:41:26.385588 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2908/5695] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:26 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:41:27.404198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-05d180c7-c119-446c-9ff9-441ee580218e tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:27.412880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-05d180c7-c119-446c-9ff9-441ee580218e tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:27.415037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05d180c7-c119-446c-9ff9-441ee580218e tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:27.415605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05d180c7-c119-446c-9ff9-441ee580218e tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:27.416837 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05d180c7-c119-446c-9ff9-441ee580218e tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:27.417624 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05d180c7-c119-446c-9ff9-441ee580218e tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:27.573882 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-05d180c7-c119-446c-9ff9-441ee580218e tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:27.583546 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-05d180c7-c119-446c-9ff9-441ee580218e tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1492 microversion: 2.1 time: 0.185387 May 21 21:41:27.584513 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2788/5696] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:27 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1492 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:27.604584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fbea4c3b-16b7-4638-913d-1c7e825dc9a4 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:41:27.605142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fbea4c3b-16b7-4638-913d-1c7e825dc9a4 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:27.611921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbea4c3b-16b7-4638-913d-1c7e825dc9a4 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:27.612595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbea4c3b-16b7-4638-913d-1c7e825dc9a4 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:27.614356 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbea4c3b-16b7-4638-913d-1c7e825dc9a4 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:27.614822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbea4c3b-16b7-4638-913d-1c7e825dc9a4 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:27.813834 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fbea4c3b-16b7-4638-913d-1c7e825dc9a4 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "POST /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429/action" status: 202 len: 0 microversion: 2.1 time: 0.213286 May 21 21:41:27.814647 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2909/5697] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:41:27 2022] POST /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:41:27.829953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3157c181-465b-416b-a98b-4e107f79345f tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:27.830572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3157c181-465b-416b-a98b-4e107f79345f tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:27.837751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3157c181-465b-416b-a98b-4e107f79345f tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:27.838129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3157c181-465b-416b-a98b-4e107f79345f tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:27.838929 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3157c181-465b-416b-a98b-4e107f79345f tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:27.839366 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3157c181-465b-416b-a98b-4e107f79345f tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:28.059599 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3157c181-465b-416b-a98b-4e107f79345f tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:28.068371 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3157c181-465b-416b-a98b-4e107f79345f tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1498 microversion: 2.1 time: 0.242237 May 21 21:41:28.069358 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2789/5698] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:27 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1498 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:41:29.088774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0b2762f5-5b15-4acd-ad91-64d28f563f9f tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:29.089490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0b2762f5-5b15-4acd-ad91-64d28f563f9f tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:29.104469 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b2762f5-5b15-4acd-ad91-64d28f563f9f tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:29.104934 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b2762f5-5b15-4acd-ad91-64d28f563f9f tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:29.105722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b2762f5-5b15-4acd-ad91-64d28f563f9f tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:29.107952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b2762f5-5b15-4acd-ad91-64d28f563f9f tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:29.356376 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0b2762f5-5b15-4acd-ad91-64d28f563f9f tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:29.369610 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0b2762f5-5b15-4acd-ad91-64d28f563f9f tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1498 microversion: 2.1 time: 0.284013 May 21 21:41:29.369810 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2910/5699] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:29 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1498 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:30.386111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3d31ad60-34ef-4fd5-898b-a7139f6452f7 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:30.386720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3d31ad60-34ef-4fd5-898b-a7139f6452f7 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:30.393892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d31ad60-34ef-4fd5-898b-a7139f6452f7 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:30.394296 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d31ad60-34ef-4fd5-898b-a7139f6452f7 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:30.395730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d31ad60-34ef-4fd5-898b-a7139f6452f7 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:30.396170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d31ad60-34ef-4fd5-898b-a7139f6452f7 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:30.562379 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3d31ad60-34ef-4fd5-898b-a7139f6452f7 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:30.577864 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3d31ad60-34ef-4fd5-898b-a7139f6452f7 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1501 microversion: 2.1 time: 0.195769 May 21 21:41:30.578459 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2790/5700] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:30 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1501 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:30.594773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a2fbc434-b978-43e7-ba16-2bc135825749 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:30.595550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a2fbc434-b978-43e7-ba16-2bc135825749 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:30.604005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a2fbc434-b978-43e7-ba16-2bc135825749 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:30.604611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a2fbc434-b978-43e7-ba16-2bc135825749 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:30.605514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a2fbc434-b978-43e7-ba16-2bc135825749 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:30.605989 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a2fbc434-b978-43e7-ba16-2bc135825749 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:30.637125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a2fbc434-b978-43e7-ba16-2bc135825749 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:41:31.004042 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a2fbc434-b978-43e7-ba16-2bc135825749 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 204 len: 0 microversion: 2.1 time: 0.413093 May 21 21:41:31.005077 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2911/5701] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:41:30 2022] DELETE /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:41:31.013494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-209c7434-78e7-4426-b3e2-c0072b57e50d tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:31.014117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-209c7434-78e7-4426-b3e2-c0072b57e50d tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:31.020753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-209c7434-78e7-4426-b3e2-c0072b57e50d tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:31.021316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-209c7434-78e7-4426-b3e2-c0072b57e50d tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:31.022100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-209c7434-78e7-4426-b3e2-c0072b57e50d tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:31.022534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-209c7434-78e7-4426-b3e2-c0072b57e50d tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:31.189273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-209c7434-78e7-4426-b3e2-c0072b57e50d tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:31.197870 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-209c7434-78e7-4426-b3e2-c0072b57e50d tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1507 microversion: 2.1 time: 0.188382 May 21 21:41:31.203722 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2791/5702] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:31 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:32.224231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ae80f8c2-88e6-4c07-b1e0-3a3c2d0343d1 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:32.228692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ae80f8c2-88e6-4c07-b1e0-3a3c2d0343d1 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:32.233175 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ae80f8c2-88e6-4c07-b1e0-3a3c2d0343d1 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:32.233641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ae80f8c2-88e6-4c07-b1e0-3a3c2d0343d1 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:32.234429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ae80f8c2-88e6-4c07-b1e0-3a3c2d0343d1 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:32.234959 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ae80f8c2-88e6-4c07-b1e0-3a3c2d0343d1 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:32.524156 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ae80f8c2-88e6-4c07-b1e0-3a3c2d0343d1 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:32.531753 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ae80f8c2-88e6-4c07-b1e0-3a3c2d0343d1 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1507 microversion: 2.1 time: 0.320376 May 21 21:41:32.532360 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2912/5703] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:32 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1507 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:33.491233 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-02a1ae5b-44f0-4c42-bc7c-961b6e209b21 req-94b981bc-9bca-4eb5-8ff4-05a89807daa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d003042-aaac-436f-87bc-11be3b58a429", "name": "network-vif-deleted", "tag": "62204095-e7e0-4338-8091-ae65a8efc822"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:41:33.502326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-02a1ae5b-44f0-4c42-bc7c-961b6e209b21 req-94b981bc-9bca-4eb5-8ff4-05a89807daa6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:33.502826 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-02a1ae5b-44f0-4c42-bc7c-961b6e209b21 req-94b981bc-9bca-4eb5-8ff4-05a89807daa6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:33.516815 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-02a1ae5b-44f0-4c42-bc7c-961b6e209b21 req-94b981bc-9bca-4eb5-8ff4-05a89807daa6 service nova] Creating event network-vif-deleted:62204095-e7e0-4338-8091-ae65a8efc822 for instance 0d003042-aaac-436f-87bc-11be3b58a429 on nch2-master-1 May 21 21:41:33.523007 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-02a1ae5b-44f0-4c42-bc7c-961b6e209b21 req-94b981bc-9bca-4eb5-8ff4-05a89807daa6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037467 May 21 21:41:33.523604 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2792/5704] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:41:33.550059 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8de89f76-7f7a-4b88-b52e-d6718ce887e2 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:33.551230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8de89f76-7f7a-4b88-b52e-d6718ce887e2 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:33.566255 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8de89f76-7f7a-4b88-b52e-d6718ce887e2 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:33.566945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8de89f76-7f7a-4b88-b52e-d6718ce887e2 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:33.567928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8de89f76-7f7a-4b88-b52e-d6718ce887e2 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:33.568577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8de89f76-7f7a-4b88-b52e-d6718ce887e2 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:33.648532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8de89f76-7f7a-4b88-b52e-d6718ce887e2 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7985923a95348bda97f1012377157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a2804147443428f76312db8fac560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:33.659178 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8de89f76-7f7a-4b88-b52e-d6718ce887e2 tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 200 len: 1465 microversion: 2.1 time: 0.112817 May 21 21:41:33.672508 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2913/5705] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:33 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 1465 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:34.681134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0a18c4a6-c409-4187-a57e-96e170d22aac tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:34.681940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0a18c4a6-c409-4187-a57e-96e170d22aac tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] [instance: 0d003042-aaac-436f-87bc-11be3b58a429] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:34.692915 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a18c4a6-c409-4187-a57e-96e170d22aac tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:34.695526 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a18c4a6-c409-4187-a57e-96e170d22aac tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:34.695526 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a18c4a6-c409-4187-a57e-96e170d22aac tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:34.695526 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0a18c4a6-c409-4187-a57e-96e170d22aac tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:34.710809 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-0a18c4a6-c409-4187-a57e-96e170d22aac tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] HTTP exception thrown: Instance 0d003042-aaac-436f-87bc-11be3b58a429 could not be found. May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0a18c4a6-c409-4187-a57e-96e170d22aac tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Request method failure captured: May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 HTTP/1.1 May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVxsWWyuPsuNUpVcaXM7umhtqkofbheGWIJRh164AVj4TB4BfAMLdebFU6PcAUzKxz5SybuC5nqRWObieo940yluMe9tcvSs2J9lfN4DM_1nOgx2QDTGgxX5gvCpYpUoIp6aqpvCmfnAkByUKjug39X2Q1OM3EJVeVuju129C4K5suw May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: ce7a2804147443428f76312db8fac560 May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestServerAdvancedOps-2113845744 May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ce7a2804147443428f76312db8fac560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ce7a2804147443428f76312db8fac560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ce7a2804147443428f76312db8fac560", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ce7a2804147443428f76312db8fac560"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestServerAdvancedOps-2113845744 May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: ce7a2804147443428f76312db8fac560 May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestServerAdvancedOps-2113845744 May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestServerAdvancedOps-2113845744-project May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: a7985923a95348bda97f1012377157fd May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestServerAdvancedOps-2113845744-project May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 0d003042-aaac-436f-87bc-11be3b58a429 could not be found. May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '0d003042-aaac-436f-87bc-11be3b58a429'} May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d003042-aaac-436f-87bc-11be3b58a429 could not be found. May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d003042-aaac-436f-87bc-11be3b58a429 could not be found. May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:41:34.712536 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:41:34.719362 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:41:34.719362 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:41:34.719362 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:41:34.719362 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:41:34.719362 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:41:34.719362 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d003042-aaac-436f-87bc-11be3b58a429 could not be found. May 21 21:41:34.719362 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:41:34.719362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0a18c4a6-c409-4187-a57e-96e170d22aac tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] Returning 404 to user: Instance 0d003042-aaac-436f-87bc-11be3b58a429 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:41:34.719362 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0a18c4a6-c409-4187-a57e-96e170d22aac tempest-TestServerAdvancedOps-2113845744 tempest-TestServerAdvancedOps-2113845744-project] 10.222.0.49 "GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429" status: 404 len: 111 microversion: 2.1 time: 0.038747 May 21 21:41:34.719362 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2793/5706] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:34 2022] GET /compute/v2.1/servers/0d003042-aaac-436f-87bc-11be3b58a429 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:41:41.673116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a68cfb35-8c37-4847-872e-f1f7b762bb26 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:41.673660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a68cfb35-8c37-4847-872e-f1f7b762bb26 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:41.677765 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:41:41.683294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a68cfb35-8c37-4847-872e-f1f7b762bb26 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:41.684157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a68cfb35-8c37-4847-872e-f1f7b762bb26 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:41.685435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a68cfb35-8c37-4847-872e-f1f7b762bb26 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:41.685699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a68cfb35-8c37-4847-872e-f1f7b762bb26 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:41.713914 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a68cfb35-8c37-4847-872e-f1f7b762bb26 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57/ips" status: 200 len: 149 microversion: 2.1 time: 0.044833 May 21 21:41:41.714612 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2914/5707] 10.222.0.49 () {58 vars in 1247 bytes} [Sat May 21 21:41:41 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:41:44.482703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5e576c31-e531-4ecf-9c1e-62b820f2c15c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c377029-622a-4080-a22a-7ff58210f09d"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:41:44.484608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5e576c31-e531-4ecf-9c1e-62b820f2c15c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:44.490440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=50 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:41:44.494844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e576c31-e531-4ecf-9c1e-62b820f2c15c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:44.495737 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e576c31-e531-4ecf-9c1e-62b820f2c15c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:44.496775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e576c31-e531-4ecf-9c1e-62b820f2c15c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:44.497409 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e576c31-e531-4ecf-9c1e-62b820f2c15c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:45.382605 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5e576c31-e531-4ecf-9c1e-62b820f2c15c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "POST /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.895858 May 21 21:41:45.382605 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2794/5708] 10.222.0.49 () {60 vars in 1322 bytes} [Sat May 21 21:41:44 2022] POST /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57/os-volume_attachments => generated 194 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:41:49.888205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c697ba93-c59a-488d-8d2b-e26a9f75a6a7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c377029-622a-4080-a22a-7ff58210f09d"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:41:49.890153 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c697ba93-c59a-488d-8d2b-e26a9f75a6a7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:49.900978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c697ba93-c59a-488d-8d2b-e26a9f75a6a7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:49.901821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c697ba93-c59a-488d-8d2b-e26a9f75a6a7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:49.902702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c697ba93-c59a-488d-8d2b-e26a9f75a6a7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:49.904064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c697ba93-c59a-488d-8d2b-e26a9f75a6a7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:50.006491 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-c697ba93-c59a-488d-8d2b-e26a9f75a6a7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] HTTP exception thrown: Invalid volume: volume 6c377029-622a-4080-a22a-7ff58210f09d is already attached to instances: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c697ba93-c59a-488d-8d2b-e26a9f75a6a7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Request method failure captured: May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57/os-volume_attachments HTTP/1.1 May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 74 May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVvVu5OzFh24dUt3T88Soh9um-hz8IBE4d2VFNx-7YcUllc6ZgBzSOlBZt4dp3QDBJfl3krubFG6vrVTWf0UKEtCtTXwmRMqQ2n6JZxp3lQ_OPmOt-nERii-Ro60TAc3AEIDmkAGoz0K0OzdsNDz_o5Rh8C_XfpIypxa4UiR_gbJbi4 May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_41b9c87f24cd4bac983b83b49daeae5a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AttachVolumeNegativeTest-617587518 May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: f01908adbe2c4aebb89d6fd3af3de207 May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: {"volumeAttachment": {"volumeId": "6c377029-622a-4080-a22a-7ff58210f09d"}} May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid volume: volume 6c377029-622a-4080-a22a-7ff58210f09d is already attached to instances: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'server_id': '8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57', 'body': {'volumeAttachment': {'volumeId': '6c377029-622a-4080-a22a-7ff58210f09d'}}} May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6c377029-622a-4080-a22a-7ff58210f09d is already attached to instances: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:41:50.008438 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:41:50.011923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:41:50.011923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:41:50.011923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 21 21:41:50.011923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 21 21:41:50.011923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6c377029-622a-4080-a22a-7ff58210f09d is already attached to instances: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 May 21 21:41:50.011923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:41:50.011923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:41:50.011923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:41:50.011923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:41:50.011923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:41:50.011923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:41:50.011923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:41:50.011923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:41:50.011923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6c377029-622a-4080-a22a-7ff58210f09d is already attached to instances: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 May 21 21:41:50.011923 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:41:50.011923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c697ba93-c59a-488d-8d2b-e26a9f75a6a7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Returning 400 to user: Invalid volume: volume 6c377029-622a-4080-a22a-7ff58210f09d is already attached to instances: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:41:50.011923 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c697ba93-c59a-488d-8d2b-e26a9f75a6a7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "POST /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.128486 May 21 21:41:50.011923 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2915/5709] 10.222.0.49 () {60 vars in 1322 bytes} [Sat May 21 21:41:49 2022] POST /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57/os-volume_attachments => generated 174 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 21:41:50.080062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1e42d0b0-ba16-46f2-af6e-e0c1b3380aca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:50.080972 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1e42d0b0-ba16-46f2-af6e-e0c1b3380aca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:50.088515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e42d0b0-ba16-46f2-af6e-e0c1b3380aca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:50.089146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e42d0b0-ba16-46f2-af6e-e0c1b3380aca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:50.090090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e42d0b0-ba16-46f2-af6e-e0c1b3380aca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:50.090693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e42d0b0-ba16-46f2-af6e-e0c1b3380aca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:50.202785 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-1e42d0b0-ba16-46f2-af6e-e0c1b3380aca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lazy-loading 'services' on Instance uuid 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:41:50.430844 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1e42d0b0-ba16-46f2-af6e-e0c1b3380aca tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57/os-volume_attachments/6c377029-622a-4080-a22a-7ff58210f09d" status: 202 len: 0 microversion: 2.1 time: 0.345787 May 21 21:41:50.430844 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2795/5710] 10.222.0.49 () {58 vars in 1415 bytes} [Sat May 21 21:41:50 2022] DELETE /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57/os-volume_attachments/6c377029-622a-4080-a22a-7ff58210f09d => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:41:50.441321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-53ce7421-f21c-4c7e-9368-26a8d554619c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:50.442753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-53ce7421-f21c-4c7e-9368-26a8d554619c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:50.449605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53ce7421-f21c-4c7e-9368-26a8d554619c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:50.450062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53ce7421-f21c-4c7e-9368-26a8d554619c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:50.450848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53ce7421-f21c-4c7e-9368-26a8d554619c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:50.451291 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53ce7421-f21c-4c7e-9368-26a8d554619c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:50.485403 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-53ce7421-f21c-4c7e-9368-26a8d554619c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057717 May 21 21:41:50.491011 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2916/5711] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:41:50 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:41:51.511270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-61305555-fb7a-4ca3-a1ca-2fc956d87608 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:51.512602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-61305555-fb7a-4ca3-a1ca-2fc956d87608 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:51.530151 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61305555-fb7a-4ca3-a1ca-2fc956d87608 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:51.531372 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61305555-fb7a-4ca3-a1ca-2fc956d87608 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:51.532117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61305555-fb7a-4ca3-a1ca-2fc956d87608 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:51.532729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61305555-fb7a-4ca3-a1ca-2fc956d87608 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:51.575569 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-61305555-fb7a-4ca3-a1ca-2fc956d87608 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081064 May 21 21:41:51.576483 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2796/5712] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:41:51 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:41:52.603990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3efbfccd-a5d4-48ac-ade5-bb03e333f057 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:52.607003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3efbfccd-a5d4-48ac-ade5-bb03e333f057 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:52.622779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3efbfccd-a5d4-48ac-ade5-bb03e333f057 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:52.624764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3efbfccd-a5d4-48ac-ade5-bb03e333f057 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:52.624764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3efbfccd-a5d4-48ac-ade5-bb03e333f057 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:52.625615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3efbfccd-a5d4-48ac-ade5-bb03e333f057 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:52.786056 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3efbfccd-a5d4-48ac-ade5-bb03e333f057 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.195959 May 21 21:41:52.787387 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2917/5713] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:41:52 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57/os-volume_attachments => generated 25 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:41:52.916618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dc41a287-09aa-4a34-8228-09536737f419 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:52.917720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dc41a287-09aa-4a34-8228-09536737f419 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:52.930554 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc41a287-09aa-4a34-8228-09536737f419 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:52.931008 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc41a287-09aa-4a34-8228-09536737f419 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:52.931809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc41a287-09aa-4a34-8228-09536737f419 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:52.932242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc41a287-09aa-4a34-8228-09536737f419 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:52.987320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dc41a287-09aa-4a34-8228-09536737f419 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:41:53.370665 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dc41a287-09aa-4a34-8228-09536737f419 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57" status: 204 len: 0 microversion: 2.1 time: 0.458360 May 21 21:41:53.374868 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2797/5714] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:41:52 2022] DELETE /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:41:53.380367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1cfc3115-1922-4026-bcc3-5988d57ab5e0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:53.381363 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1cfc3115-1922-4026-bcc3-5988d57ab5e0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:53.389657 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1cfc3115-1922-4026-bcc3-5988d57ab5e0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:53.390301 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1cfc3115-1922-4026-bcc3-5988d57ab5e0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:53.391256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1cfc3115-1922-4026-bcc3-5988d57ab5e0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:53.391854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1cfc3115-1922-4026-bcc3-5988d57ab5e0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:53.966880 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1cfc3115-1922-4026-bcc3-5988d57ab5e0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:53.979176 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1cfc3115-1922-4026-bcc3-5988d57ab5e0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57" status: 200 len: 1680 microversion: 2.1 time: 0.603224 May 21 21:41:53.980592 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2918/5715] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:53 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 => generated 1680 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:55.005580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1f83e287-2ff7-4f8c-99f9-75feca33bfa6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:55.006297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1f83e287-2ff7-4f8c-99f9-75feca33bfa6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:55.047328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f83e287-2ff7-4f8c-99f9-75feca33bfa6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:55.047328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f83e287-2ff7-4f8c-99f9-75feca33bfa6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:55.051338 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f83e287-2ff7-4f8c-99f9-75feca33bfa6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:55.051997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f83e287-2ff7-4f8c-99f9-75feca33bfa6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:55.383575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1f83e287-2ff7-4f8c-99f9-75feca33bfa6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:55.394089 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1f83e287-2ff7-4f8c-99f9-75feca33bfa6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57" status: 200 len: 1680 microversion: 2.1 time: 0.394192 May 21 21:41:55.397538 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2798/5716] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:54 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 => generated 1680 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:56.413083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-56f5ba7d-816a-4749-94d6-38ca136c0b34 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:56.414787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-56f5ba7d-816a-4749-94d6-38ca136c0b34 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:56.433227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56f5ba7d-816a-4749-94d6-38ca136c0b34 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:56.434094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56f5ba7d-816a-4749-94d6-38ca136c0b34 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:56.436652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56f5ba7d-816a-4749-94d6-38ca136c0b34 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:56.439305 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56f5ba7d-816a-4749-94d6-38ca136c0b34 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:56.450087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:41:57.095720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-56f5ba7d-816a-4749-94d6-38ca136c0b34 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:57.110153 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-56f5ba7d-816a-4749-94d6-38ca136c0b34 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57" status: 200 len: 1613 microversion: 2.1 time: 0.698522 May 21 21:41:57.112208 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2919/5717] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:56 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 => generated 1613 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:57.574448 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-e7ee3233-51ff-4570-a7eb-99c2335c34dd req-bffc9aff-69c2-40e7-a933-c195188e8a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57", "name": "network-vif-deleted", "tag": "ffcec92b-41a7-4336-8da9-896496224456"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:41:57.598734 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e7ee3233-51ff-4570-a7eb-99c2335c34dd req-bffc9aff-69c2-40e7-a933-c195188e8a79 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:57.605033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e7ee3233-51ff-4570-a7eb-99c2335c34dd req-bffc9aff-69c2-40e7-a933-c195188e8a79 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:57.611531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:41:57.626386 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-e7ee3233-51ff-4570-a7eb-99c2335c34dd req-bffc9aff-69c2-40e7-a933-c195188e8a79 service nova] Creating event network-vif-deleted:ffcec92b-41a7-4336-8da9-896496224456 for instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 on nch1-master-1 May 21 21:41:57.635075 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-e7ee3233-51ff-4570-a7eb-99c2335c34dd req-bffc9aff-69c2-40e7-a933-c195188e8a79 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064187 May 21 21:41:57.636192 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2799/5718] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:41:58.129727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-56232539-2d4a-40ad-b8e3-e3edddf35704 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:58.131305 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-56232539-2d4a-40ad-b8e3-e3edddf35704 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:58.147791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56232539-2d4a-40ad-b8e3-e3edddf35704 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:58.148249 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56232539-2d4a-40ad-b8e3-e3edddf35704 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:58.150161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56232539-2d4a-40ad-b8e3-e3edddf35704 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:58.150622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56232539-2d4a-40ad-b8e3-e3edddf35704 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:58.223702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56232539-2d4a-40ad-b8e3-e3edddf35704 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:58.224425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56232539-2d4a-40ad-b8e3-e3edddf35704 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:58.225036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-56232539-2d4a-40ad-b8e3-e3edddf35704 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lazy-loading 'fault' on Instance uuid 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:41:58.317958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-56232539-2d4a-40ad-b8e3-e3edddf35704 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:41:58.335916 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-56232539-2d4a-40ad-b8e3-e3edddf35704 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57" status: 200 len: 1331 microversion: 2.1 time: 0.210351 May 21 21:41:58.337864 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2920/5719] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:58 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 => generated 1331 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:41:59.356524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a4dca2ce-57d5-480a-9dbe-d08dac3cf9b1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:59.357430 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a4dca2ce-57d5-480a-9dbe-d08dac3cf9b1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:41:59.369488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4dca2ce-57d5-480a-9dbe-d08dac3cf9b1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:59.369668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4dca2ce-57d5-480a-9dbe-d08dac3cf9b1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:59.371801 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4dca2ce-57d5-480a-9dbe-d08dac3cf9b1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:41:59.374365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4dca2ce-57d5-480a-9dbe-d08dac3cf9b1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:41:59.397373 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-a4dca2ce-57d5-480a-9dbe-d08dac3cf9b1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] HTTP exception thrown: Instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 could not be found. May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a4dca2ce-57d5-480a-9dbe-d08dac3cf9b1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Request method failure captured: May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 HTTP/1.1 May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVvVu5OzFh24dUt3T88Soh9um-hz8IBE4d2VFNx-7YcUllc6ZgBzSOlBZt4dp3QDBJfl3krubFG6vrVTWf0UKEtCtTXwmRMqQ2n6JZxp3lQ_OPmOt-nERii-Ro60TAc3AEIDmkAGoz0K0OzdsNDz_o5Rh8C_XfpIypxa4UiR_gbJbi4 May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_41b9c87f24cd4bac983b83b49daeae5a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-AttachVolumeNegativeTest-617587518 May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: f01908adbe2c4aebb89d6fd3af3de207 May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 could not be found. May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57'} May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 could not be found. May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 could not be found. May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:41:59.413580 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:41:59.419680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:41:59.419680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:41:59.419680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:41:59.419680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:41:59.419680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:41:59.419680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 could not be found. May 21 21:41:59.419680 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:41:59.425135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a4dca2ce-57d5-480a-9dbe-d08dac3cf9b1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Returning 404 to user: Instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:41:59.426911 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a4dca2ce-57d5-480a-9dbe-d08dac3cf9b1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57" status: 404 len: 111 microversion: 2.1 time: 0.075393 May 21 21:41:59.427115 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2800/5720] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:41:59 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:41:59.439053 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cb482a73-33bb-4ecc-b13f-027a46935c70 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '.version_select at 0x7fc81a31d670>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:41:59.530990 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cb482a73-33bb-4ecc-b13f-027a46935c70 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1427855483" status: 202 len: 0 microversion: 2.1 time: 0.098182 May 21 21:41:59.534761 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2921/5721] 10.222.0.49 () {58 vars in 1220 bytes} [Sat May 21 21:41:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1427855483 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:42:01.445109 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-44fe635b-d13a-4213-94f0-4f67be068405 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Action: 'create', calling method: .version_select at 0x7fc819d6baf0>, body: {"keypair": {"name": "tempest-keypair-1943176445", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxjs3w/u4+AIvw3nfeXXfTOk8O1rYuG5CMWLfmTZ9isictqGKdISPZ2bKHap7a33VzRJ2iVPSJxPpqf1hbMgcQLXHqmL+3hjPFrja2XALbr9xCCoN6xYkKQCcFYviE6RQ=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:42:01.489099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-44fe635b-d13a-4213-94f0-4f67be068405 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Getting quotas for project 41b9c87f24cd4bac983b83b49daeae5a. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:42:01.497996 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-44fe635b-d13a-4213-94f0-4f67be068405 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Getting quotas for user f01908adbe2c4aebb89d6fd3af3de207 and project 41b9c87f24cd4bac983b83b49daeae5a. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:42:01.619191 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-44fe635b-d13a-4213-94f0-4f67be068405 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.178559 May 21 21:42:01.619976 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2801/5722] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:42:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:42:05.060590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8899712c-4341-4346-a95c-76d1d705e8af tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-551718684", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b9f276e-ad4f-4a34-856b-bc3620bd7879"}], "security_groups": [{"name": "tempest-securitygroup--807631204"}], "key_name": "tempest-keypair-1943176445", "user_data": "}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:42:05.277513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-8899712c-4341-4346-a95c-76d1d705e8af tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] validate_networks() for [('7b9f276e-ad4f-4a34-856b-bc3620bd7879', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:42:05.891886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-8899712c-4341-4346-a95c-76d1d705e8af tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:42:05.892583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-8899712c-4341-4346-a95c-76d1d705e8af tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:42:05.893477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-8899712c-4341-4346-a95c-76d1d705e8af tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:42:05.893477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-8899712c-4341-4346-a95c-76d1d705e8af tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:42:05.893899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-8899712c-4341-4346-a95c-76d1d705e8af tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:42:05.903839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8899712c-4341-4346-a95c-76d1d705e8af tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:05.904331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8899712c-4341-4346-a95c-76d1d705e8af tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:05.905152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8899712c-4341-4346-a95c-76d1d705e8af tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:05.905626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8899712c-4341-4346-a95c-76d1d705e8af tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:05.926416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-8899712c-4341-4346-a95c-76d1d705e8af tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Getting quotas for project 41b9c87f24cd4bac983b83b49daeae5a. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:42:05.933126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-8899712c-4341-4346-a95c-76d1d705e8af tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Getting quotas for user f01908adbe2c4aebb89d6fd3af3de207 and project 41b9c87f24cd4bac983b83b49daeae5a. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:42:05.948317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8899712c-4341-4346-a95c-76d1d705e8af tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:42:05.950703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8899712c-4341-4346-a95c-76d1d705e8af tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:42:06.062654 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8899712c-4341-4346-a95c-76d1d705e8af tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.007666 May 21 21:42:06.063310 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2922/5723] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:42:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:42:06.073488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b0452fb6-3c6c-47eb-a35e-7ff929b302e6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:06.074110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b0452fb6-3c6c-47eb-a35e-7ff929b302e6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:06.157832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b0452fb6-3c6c-47eb-a35e-7ff929b302e6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:06.175258 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b0452fb6-3c6c-47eb-a35e-7ff929b302e6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393" status: 200 len: 1241 microversion: 2.1 time: 0.105533 May 21 21:42:06.175850 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2802/5724] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:06 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 => generated 1241 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:42:07.197149 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2c7fb245-8397-4376-9383-98d4c189faea tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:07.197676 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2c7fb245-8397-4376-9383-98d4c189faea tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:07.205738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c7fb245-8397-4376-9383-98d4c189faea tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:07.206195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c7fb245-8397-4376-9383-98d4c189faea tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:07.206975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c7fb245-8397-4376-9383-98d4c189faea tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:07.209094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c7fb245-8397-4376-9383-98d4c189faea tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:07.284891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2c7fb245-8397-4376-9383-98d4c189faea tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:07.295290 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2c7fb245-8397-4376-9383-98d4c189faea tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393" status: 200 len: 1245 microversion: 2.1 time: 0.103533 May 21 21:42:07.295971 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2923/5725] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:07 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 => generated 1245 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:08.313341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5974a2b1-0887-4f93-bb16-ccfd2485d0bc tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:08.314805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5974a2b1-0887-4f93-bb16-ccfd2485d0bc tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:08.324554 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5974a2b1-0887-4f93-bb16-ccfd2485d0bc tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:08.325009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5974a2b1-0887-4f93-bb16-ccfd2485d0bc tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:08.327598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5974a2b1-0887-4f93-bb16-ccfd2485d0bc tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:08.328347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5974a2b1-0887-4f93-bb16-ccfd2485d0bc tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:08.461765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5974a2b1-0887-4f93-bb16-ccfd2485d0bc tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:08.468166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a8c4c359-c983-4803-88b3-3fab97994751 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1160064655", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c534288c-e6e7-47cb-83be-40d881750c23", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "8f8d42c3-82dd-4a20-aef1-3a31892db1cf"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:42:08.493848 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5974a2b1-0887-4f93-bb16-ccfd2485d0bc tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393" status: 200 len: 1301 microversion: 2.1 time: 0.184324 May 21 21:42:08.508970 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2803/5726] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:08 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 => generated 1301 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:08.596390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-a8c4c359-c983-4803-88b3-3fab97994751 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] validate_networks() for [('8f8d42c3-82dd-4a20-aef1-3a31892db1cf', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:42:09.362945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-a8c4c359-c983-4803-88b3-3fab97994751 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:42:09.363407 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-a8c4c359-c983-4803-88b3-3fab97994751 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:42:09.364003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-a8c4c359-c983-4803-88b3-3fab97994751 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:42:09.364818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-a8c4c359-c983-4803-88b3-3fab97994751 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:42:09.365347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-a8c4c359-c983-4803-88b3-3fab97994751 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:42:09.378635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8c4c359-c983-4803-88b3-3fab97994751 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:09.378635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8c4c359-c983-4803-88b3-3fab97994751 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:09.378635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8c4c359-c983-4803-88b3-3fab97994751 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:09.378635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a8c4c359-c983-4803-88b3-3fab97994751 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:09.399314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-a8c4c359-c983-4803-88b3-3fab97994751 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Getting quotas for project 8149564857f64342aef93f18c0d90eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:42:09.406400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-a8c4c359-c983-4803-88b3-3fab97994751 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Getting quotas for user 730839d5531644eb9aa26dabe2fbd8f6 and project 8149564857f64342aef93f18c0d90eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:42:09.421287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a8c4c359-c983-4803-88b3-3fab97994751 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:42:09.423167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a8c4c359-c983-4803-88b3-3fab97994751 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='c534288c-e6e7-47cb-83be-40d881750c23',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:42:09.514071 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6442d36f-977f-4ebc-9d7c-d11d6c6f08aa tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:09.514695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6442d36f-977f-4ebc-9d7c-d11d6c6f08aa tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:09.522325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6442d36f-977f-4ebc-9d7c-d11d6c6f08aa tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:09.523021 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6442d36f-977f-4ebc-9d7c-d11d6c6f08aa tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:09.530991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6442d36f-977f-4ebc-9d7c-d11d6c6f08aa tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:09.530991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6442d36f-977f-4ebc-9d7c-d11d6c6f08aa tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:09.685845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6442d36f-977f-4ebc-9d7c-d11d6c6f08aa tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:09.695614 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6442d36f-977f-4ebc-9d7c-d11d6c6f08aa tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393" status: 200 len: 1299 microversion: 2.1 time: 0.185457 May 21 21:42:09.696539 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2804/5727] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:09 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 => generated 1299 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:42:09.852536 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a8c4c359-c983-4803-88b3-3fab97994751 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.387775 May 21 21:42:09.854548 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2924/5728] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:42:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:42:09.883110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1b3eabff-ae05-44ba-8a78-d34e3e78539a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:09.884107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1b3eabff-ae05-44ba-8a78-d34e3e78539a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:10.076681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1b3eabff-ae05-44ba-8a78-d34e3e78539a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:10.084314 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1b3eabff-ae05-44ba-8a78-d34e3e78539a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1057 microversion: 2.1 time: 0.223188 May 21 21:42:10.085421 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2805/5729] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:09 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1057 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:10.714437 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dd94d944-6c63-4a2f-9f21-5c1cb6a22697 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:10.715321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dd94d944-6c63-4a2f-9f21-5c1cb6a22697 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:10.731008 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd94d944-6c63-4a2f-9f21-5c1cb6a22697 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:10.733103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd94d944-6c63-4a2f-9f21-5c1cb6a22697 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:10.735422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd94d944-6c63-4a2f-9f21-5c1cb6a22697 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:10.736041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dd94d944-6c63-4a2f-9f21-5c1cb6a22697 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:11.078213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-dd94d944-6c63-4a2f-9f21-5c1cb6a22697 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:11.088611 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dd94d944-6c63-4a2f-9f21-5c1cb6a22697 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393" status: 200 len: 1366 microversion: 2.1 time: 0.378719 May 21 21:42:11.092580 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2925/5730] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:10 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:11.103258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-25a467cc-9994-464e-99a9-43f4967fb8c5 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:11.103968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-25a467cc-9994-464e-99a9-43f4967fb8c5 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:11.172160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-25a467cc-9994-464e-99a9-43f4967fb8c5 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:11.181617 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-25a467cc-9994-464e-99a9-43f4967fb8c5 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1057 microversion: 2.1 time: 0.083897 May 21 21:42:11.182216 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2806/5731] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:11 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1057 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:11.418694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-dc78a348-b05b-4a1e-8f9f-4141f11baddb req-54187578-b5e7-45d8-a7ad-6b044f3f6d44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2320fe8d-7d56-42f9-95fa-5570a44e1393", "tag": "5dc5e2d8-dcfa-4b31-bf51-431708938a5c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:42:11.436180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-dc78a348-b05b-4a1e-8f9f-4141f11baddb req-54187578-b5e7-45d8-a7ad-6b044f3f6d44 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:11.437373 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-dc78a348-b05b-4a1e-8f9f-4141f11baddb req-54187578-b5e7-45d8-a7ad-6b044f3f6d44 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:11.451870 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-dc78a348-b05b-4a1e-8f9f-4141f11baddb req-54187578-b5e7-45d8-a7ad-6b044f3f6d44 service nova] Creating event network-changed:5dc5e2d8-dcfa-4b31-bf51-431708938a5c for instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 on nch1-master-1 May 21 21:42:11.459530 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-dc78a348-b05b-4a1e-8f9f-4141f11baddb req-54187578-b5e7-45d8-a7ad-6b044f3f6d44 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044711 May 21 21:42:11.461169 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2926/5732] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:42:12.114834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-015063e1-5b11-480a-b15d-7009bb24f8c6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:12.116153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-015063e1-5b11-480a-b15d-7009bb24f8c6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:12.123698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-015063e1-5b11-480a-b15d-7009bb24f8c6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:12.124597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-015063e1-5b11-480a-b15d-7009bb24f8c6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:12.126304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-015063e1-5b11-480a-b15d-7009bb24f8c6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:12.126915 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-015063e1-5b11-480a-b15d-7009bb24f8c6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:12.201447 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-79c2d0e1-7b28-4553-b41d-d2021abd4992 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:12.202103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-79c2d0e1-7b28-4553-b41d-d2021abd4992 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:12.214593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-79c2d0e1-7b28-4553-b41d-d2021abd4992 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:12.218875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-79c2d0e1-7b28-4553-b41d-d2021abd4992 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:12.218875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-79c2d0e1-7b28-4553-b41d-d2021abd4992 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:12.220297 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-79c2d0e1-7b28-4553-b41d-d2021abd4992 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:12.332400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-79c2d0e1-7b28-4553-b41d-d2021abd4992 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:12.344502 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-79c2d0e1-7b28-4553-b41d-d2021abd4992 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1109 microversion: 2.1 time: 0.148915 May 21 21:42:12.345377 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2927/5733] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:12 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1109 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:42:12.394105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-015063e1-5b11-480a-b15d-7009bb24f8c6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:12.404326 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-015063e1-5b11-480a-b15d-7009bb24f8c6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393" status: 200 len: 1366 microversion: 2.1 time: 0.294876 May 21 21:42:12.407967 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2807/5734] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:12 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:13.364949 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7e974c02-2a18-4122-9462-2af1d2eddfcf tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:13.365758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7e974c02-2a18-4122-9462-2af1d2eddfcf tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:13.378590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e974c02-2a18-4122-9462-2af1d2eddfcf tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:13.379293 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e974c02-2a18-4122-9462-2af1d2eddfcf tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:13.380468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e974c02-2a18-4122-9462-2af1d2eddfcf tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:13.381779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e974c02-2a18-4122-9462-2af1d2eddfcf tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:13.421200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ffc06ece-2d37-4896-8347-52d08b4e0283 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:13.424724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ffc06ece-2d37-4896-8347-52d08b4e0283 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:13.442345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffc06ece-2d37-4896-8347-52d08b4e0283 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:13.445779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffc06ece-2d37-4896-8347-52d08b4e0283 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:13.447352 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffc06ece-2d37-4896-8347-52d08b4e0283 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:13.450596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffc06ece-2d37-4896-8347-52d08b4e0283 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:13.497625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7e974c02-2a18-4122-9462-2af1d2eddfcf tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:13.505401 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7e974c02-2a18-4122-9462-2af1d2eddfcf tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1127 microversion: 2.1 time: 0.146124 May 21 21:42:13.506121 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2928/5735] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:13 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1127 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:13.818153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ffc06ece-2d37-4896-8347-52d08b4e0283 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:13.831870 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ffc06ece-2d37-4896-8347-52d08b4e0283 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393" status: 200 len: 1366 microversion: 2.1 time: 0.414400 May 21 21:42:13.844743 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2808/5736] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:13 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 => generated 1366 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:14.524181 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b8cc4933-930d-491c-9b36-4ec40a47c54f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:14.526438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b8cc4933-930d-491c-9b36-4ec40a47c54f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:14.572040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8cc4933-930d-491c-9b36-4ec40a47c54f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:14.572648 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8cc4933-930d-491c-9b36-4ec40a47c54f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:14.573656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8cc4933-930d-491c-9b36-4ec40a47c54f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:14.574405 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8cc4933-930d-491c-9b36-4ec40a47c54f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:14.753625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b8cc4933-930d-491c-9b36-4ec40a47c54f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:14.762840 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b8cc4933-930d-491c-9b36-4ec40a47c54f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1169 microversion: 2.1 time: 0.243551 May 21 21:42:14.763424 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2929/5737] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:14 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1169 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:14.850050 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6344a9e5-1148-48f0-89ed-756e65f1a4fd tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:14.851414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6344a9e5-1148-48f0-89ed-756e65f1a4fd tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:14.854440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:42:14.859792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6344a9e5-1148-48f0-89ed-756e65f1a4fd tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:14.860351 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6344a9e5-1148-48f0-89ed-756e65f1a4fd tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:14.861429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6344a9e5-1148-48f0-89ed-756e65f1a4fd tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:14.861963 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6344a9e5-1148-48f0-89ed-756e65f1a4fd tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:15.661273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6344a9e5-1148-48f0-89ed-756e65f1a4fd tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:15.671908 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6344a9e5-1148-48f0-89ed-756e65f1a4fd tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393" status: 200 len: 1366 microversion: 2.1 time: 0.825764 May 21 21:42:15.681647 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2809/5738] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:14 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 => generated 1366 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:15.793550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3b28053c-471f-4051-9b97-b08d33248bf1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:15.793550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3b28053c-471f-4051-9b97-b08d33248bf1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:15.805180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b28053c-471f-4051-9b97-b08d33248bf1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:15.805872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b28053c-471f-4051-9b97-b08d33248bf1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:15.806958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b28053c-471f-4051-9b97-b08d33248bf1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:15.807583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b28053c-471f-4051-9b97-b08d33248bf1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:16.021963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3b28053c-471f-4051-9b97-b08d33248bf1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:16.031007 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3b28053c-471f-4051-9b97-b08d33248bf1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1169 microversion: 2.1 time: 0.255255 May 21 21:42:16.032226 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2930/5739] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:15 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1169 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:16.690969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b867f687-dfa2-44d9-8b87-57b8dda2de15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:16.693027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b867f687-dfa2-44d9-8b87-57b8dda2de15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:16.705275 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b867f687-dfa2-44d9-8b87-57b8dda2de15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:16.712990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b867f687-dfa2-44d9-8b87-57b8dda2de15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:16.717287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b867f687-dfa2-44d9-8b87-57b8dda2de15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:16.717761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b867f687-dfa2-44d9-8b87-57b8dda2de15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:16.826935 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-27fff02a-44cd-4913-9ca6-c070ce1a2936 req-2d36da92-0a50-4b0e-b12f-d59b0edf4e83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f3d790-8da8-41a3-84dc-957af2000a01", "tag": "2e37ae20-8e95-4e41-b9f6-8b446f9ed817"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:42:16.839017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-27fff02a-44cd-4913-9ca6-c070ce1a2936 req-2d36da92-0a50-4b0e-b12f-d59b0edf4e83 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:16.839859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-27fff02a-44cd-4913-9ca6-c070ce1a2936 req-2d36da92-0a50-4b0e-b12f-d59b0edf4e83 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:16.858593 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-27fff02a-44cd-4913-9ca6-c070ce1a2936 req-2d36da92-0a50-4b0e-b12f-d59b0edf4e83 service nova] Creating event network-changed:2e37ae20-8e95-4e41-b9f6-8b446f9ed817 for instance 67f3d790-8da8-41a3-84dc-957af2000a01 on nch2-master-1 May 21 21:42:16.865904 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-27fff02a-44cd-4913-9ca6-c070ce1a2936 req-2d36da92-0a50-4b0e-b12f-d59b0edf4e83 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.340681 May 21 21:42:16.866874 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2810/5740] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:42:17.051810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2e3f35ef-a6b1-49fb-92d5-d414093b87e6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:17.052998 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2e3f35ef-a6b1-49fb-92d5-d414093b87e6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:17.070563 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e3f35ef-a6b1-49fb-92d5-d414093b87e6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:17.071367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e3f35ef-a6b1-49fb-92d5-d414093b87e6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:17.074242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e3f35ef-a6b1-49fb-92d5-d414093b87e6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:17.075748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e3f35ef-a6b1-49fb-92d5-d414093b87e6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:17.115382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b867f687-dfa2-44d9-8b87-57b8dda2de15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:17.130492 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b867f687-dfa2-44d9-8b87-57b8dda2de15 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393" status: 200 len: 1366 microversion: 2.1 time: 0.442722 May 21 21:42:17.134863 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2931/5741] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:16 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 => generated 1366 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:17.427805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2e3f35ef-a6b1-49fb-92d5-d414093b87e6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:17.440212 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2e3f35ef-a6b1-49fb-92d5-d414093b87e6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1169 microversion: 2.1 time: 0.394730 May 21 21:42:17.445123 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2811/5742] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:17 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1169 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:42:17.548704 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f9b4d01b-a636-4264-9f55-7491a5ec78d1 req-41e619b4-72d9-4075-a7be-c6934a455c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2320fe8d-7d56-42f9-95fa-5570a44e1393", "name": "network-vif-plugged", "status": "completed", "tag": "5dc5e2d8-dcfa-4b31-bf51-431708938a5c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:42:17.560000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f9b4d01b-a636-4264-9f55-7491a5ec78d1 req-41e619b4-72d9-4075-a7be-c6934a455c59 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:17.560655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f9b4d01b-a636-4264-9f55-7491a5ec78d1 req-41e619b4-72d9-4075-a7be-c6934a455c59 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:17.584344 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f9b4d01b-a636-4264-9f55-7491a5ec78d1 req-41e619b4-72d9-4075-a7be-c6934a455c59 service nova] Creating event network-vif-plugged:5dc5e2d8-dcfa-4b31-bf51-431708938a5c for instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 on nch1-master-1 May 21 21:42:17.591140 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f9b4d01b-a636-4264-9f55-7491a5ec78d1 req-41e619b4-72d9-4075-a7be-c6934a455c59 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045563 May 21 21:42:17.595571 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2932/5743] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:42:18.149071 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4e4ddfe0-dd2b-4e51-bf36-e63f6545675a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:18.149805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4e4ddfe0-dd2b-4e51-bf36-e63f6545675a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:18.159479 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e4ddfe0-dd2b-4e51-bf36-e63f6545675a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:18.160183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e4ddfe0-dd2b-4e51-bf36-e63f6545675a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:18.161254 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e4ddfe0-dd2b-4e51-bf36-e63f6545675a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:18.161906 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e4ddfe0-dd2b-4e51-bf36-e63f6545675a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:18.429283 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4e4ddfe0-dd2b-4e51-bf36-e63f6545675a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:18.437633 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4e4ddfe0-dd2b-4e51-bf36-e63f6545675a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393" status: 200 len: 1366 microversion: 2.1 time: 0.294321 May 21 21:42:18.438452 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2812/5744] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:18 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:18.463545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c2aa8938-470e-4441-830f-a5c3aa3cd538 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:18.464259 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c2aa8938-470e-4441-830f-a5c3aa3cd538 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:18.476101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2aa8938-470e-4441-830f-a5c3aa3cd538 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:18.476603 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2aa8938-470e-4441-830f-a5c3aa3cd538 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:18.477431 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2aa8938-470e-4441-830f-a5c3aa3cd538 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:18.477875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2aa8938-470e-4441-830f-a5c3aa3cd538 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:18.727227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c2aa8938-470e-4441-830f-a5c3aa3cd538 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:18.736130 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c2aa8938-470e-4441-830f-a5c3aa3cd538 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1215 microversion: 2.1 time: 0.278233 May 21 21:42:18.737282 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2933/5745] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:18 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1215 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:19.459350 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-746706a5-9f73-416f-9092-fcc12334ced9 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:19.459350 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-746706a5-9f73-416f-9092-fcc12334ced9 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:19.467575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-746706a5-9f73-416f-9092-fcc12334ced9 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:19.468379 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-746706a5-9f73-416f-9092-fcc12334ced9 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:19.469303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-746706a5-9f73-416f-9092-fcc12334ced9 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:19.470226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-746706a5-9f73-416f-9092-fcc12334ced9 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:19.631172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-746706a5-9f73-416f-9092-fcc12334ced9 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:19.639137 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-746706a5-9f73-416f-9092-fcc12334ced9 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393" status: 200 len: 1555 microversion: 2.1 time: 0.188376 May 21 21:42:19.639715 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2813/5746] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:19 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 => generated 1555 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:19.662900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cc5de40a-2909-4283-ae93-ed8bffaaa129 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:19.664394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cc5de40a-2909-4283-ae93-ed8bffaaa129 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:19.671359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:42:19.672406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=12 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:42:19.676862 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cc5de40a-2909-4283-ae93-ed8bffaaa129 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:19.677714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cc5de40a-2909-4283-ae93-ed8bffaaa129 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:19.678774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cc5de40a-2909-4283-ae93-ed8bffaaa129 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:19.679470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cc5de40a-2909-4283-ae93-ed8bffaaa129 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:19.753989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2f3af5ed-7fd4-40b5-8188-616c0d6b4aa1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:19.755480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2f3af5ed-7fd4-40b5-8188-616c0d6b4aa1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:19.762615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f3af5ed-7fd4-40b5-8188-616c0d6b4aa1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:19.763218 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f3af5ed-7fd4-40b5-8188-616c0d6b4aa1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:19.764089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f3af5ed-7fd4-40b5-8188-616c0d6b4aa1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:19.764645 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f3af5ed-7fd4-40b5-8188-616c0d6b4aa1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:19.798877 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cc5de40a-2909-4283-ae93-ed8bffaaa129 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.141848 May 21 21:42:19.799476 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2934/5747] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 21:42:19 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:42:19.945229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2f3af5ed-7fd4-40b5-8188-616c0d6b4aa1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:19.955237 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2f3af5ed-7fd4-40b5-8188-616c0d6b4aa1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1203 microversion: 2.1 time: 0.205267 May 21 21:42:19.965847 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2814/5748] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:19 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1203 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:42:20.975035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c69b8b1a-f0c1-482f-9420-fb4619e5b11c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:20.975654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c69b8b1a-f0c1-482f-9420-fb4619e5b11c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:20.982256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c69b8b1a-f0c1-482f-9420-fb4619e5b11c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:20.982712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c69b8b1a-f0c1-482f-9420-fb4619e5b11c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:20.983482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c69b8b1a-f0c1-482f-9420-fb4619e5b11c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:20.983926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c69b8b1a-f0c1-482f-9420-fb4619e5b11c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:21.309082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c69b8b1a-f0c1-482f-9420-fb4619e5b11c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:21.318296 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c69b8b1a-f0c1-482f-9420-fb4619e5b11c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1203 microversion: 2.1 time: 0.348826 May 21 21:42:21.318889 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2935/5749] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:20 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1203 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:21.421843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-c68e021a-dd61-4732-883d-b46277c0cfbe req-b6b4754d-b8f4-4d37-be3d-2fe3d1b903d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2320fe8d-7d56-42f9-95fa-5570a44e1393", "tag": "5dc5e2d8-dcfa-4b31-bf51-431708938a5c"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:42:21.427783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=10 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:42:21.432326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c68e021a-dd61-4732-883d-b46277c0cfbe req-b6b4754d-b8f4-4d37-be3d-2fe3d1b903d9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:21.432851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c68e021a-dd61-4732-883d-b46277c0cfbe req-b6b4754d-b8f4-4d37-be3d-2fe3d1b903d9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:21.445994 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-c68e021a-dd61-4732-883d-b46277c0cfbe req-b6b4754d-b8f4-4d37-be3d-2fe3d1b903d9 service nova] Creating event network-changed:5dc5e2d8-dcfa-4b31-bf51-431708938a5c for instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 on nch1-master-1 May 21 21:42:21.451587 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-c68e021a-dd61-4732-883d-b46277c0cfbe req-b6b4754d-b8f4-4d37-be3d-2fe3d1b903d9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034429 May 21 21:42:21.452786 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2815/5750] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:42:22.335364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-45d07d2e-69d9-4f2d-af27-a3d5eb3fcb1b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:22.336613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-45d07d2e-69d9-4f2d-af27-a3d5eb3fcb1b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:22.344515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-45d07d2e-69d9-4f2d-af27-a3d5eb3fcb1b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:22.345046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-45d07d2e-69d9-4f2d-af27-a3d5eb3fcb1b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:22.345863 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-45d07d2e-69d9-4f2d-af27-a3d5eb3fcb1b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:22.346310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-45d07d2e-69d9-4f2d-af27-a3d5eb3fcb1b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:22.529288 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-45d07d2e-69d9-4f2d-af27-a3d5eb3fcb1b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:22.539510 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-45d07d2e-69d9-4f2d-af27-a3d5eb3fcb1b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1203 microversion: 2.1 time: 0.207922 May 21 21:42:22.544976 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2936/5751] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:22 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1203 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:23.561470 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a31c5bbf-cb29-4de2-b8c1-f347be405ae4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:23.562742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a31c5bbf-cb29-4de2-b8c1-f347be405ae4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:23.575644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a31c5bbf-cb29-4de2-b8c1-f347be405ae4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:23.576121 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a31c5bbf-cb29-4de2-b8c1-f347be405ae4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:23.577070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a31c5bbf-cb29-4de2-b8c1-f347be405ae4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:23.578499 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a31c5bbf-cb29-4de2-b8c1-f347be405ae4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:23.786227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a31c5bbf-cb29-4de2-b8c1-f347be405ae4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:23.794475 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a31c5bbf-cb29-4de2-b8c1-f347be405ae4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1203 microversion: 2.1 time: 0.240314 May 21 21:42:23.795077 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2816/5752] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:23 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1203 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:24.811404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-caccf453-d617-4686-bf53-ab756b2ebbb3 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:24.813023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-caccf453-d617-4686-bf53-ab756b2ebbb3 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:24.821159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:42:24.823534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-caccf453-d617-4686-bf53-ab756b2ebbb3 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:24.824185 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-caccf453-d617-4686-bf53-ab756b2ebbb3 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:24.825276 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-caccf453-d617-4686-bf53-ab756b2ebbb3 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:24.825993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-caccf453-d617-4686-bf53-ab756b2ebbb3 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:25.084406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-caccf453-d617-4686-bf53-ab756b2ebbb3 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:25.093254 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-caccf453-d617-4686-bf53-ab756b2ebbb3 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1203 microversion: 2.1 time: 0.285967 May 21 21:42:25.103305 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2937/5753] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:24 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1203 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:26.110539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-929e6d7f-92ba-4fc7-aabf-b00cbb3483a4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:26.111159 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-929e6d7f-92ba-4fc7-aabf-b00cbb3483a4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:26.134743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-929e6d7f-92ba-4fc7-aabf-b00cbb3483a4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:26.135206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-929e6d7f-92ba-4fc7-aabf-b00cbb3483a4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:26.136007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-929e6d7f-92ba-4fc7-aabf-b00cbb3483a4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:26.136487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-929e6d7f-92ba-4fc7-aabf-b00cbb3483a4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:26.390885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-ce370ad0-df05-465a-af44-58205fae1dbc req-9b134e1f-a766-4eb8-b891-b7ab252b909f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f3d790-8da8-41a3-84dc-957af2000a01", "name": "network-vif-plugged", "status": "completed", "tag": "2e37ae20-8e95-4e41-b9f6-8b446f9ed817"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:42:26.401962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ce370ad0-df05-465a-af44-58205fae1dbc req-9b134e1f-a766-4eb8-b891-b7ab252b909f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:26.402551 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ce370ad0-df05-465a-af44-58205fae1dbc req-9b134e1f-a766-4eb8-b891-b7ab252b909f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:26.415976 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-ce370ad0-df05-465a-af44-58205fae1dbc req-9b134e1f-a766-4eb8-b891-b7ab252b909f service nova] Creating event network-vif-plugged:2e37ae20-8e95-4e41-b9f6-8b446f9ed817 for instance 67f3d790-8da8-41a3-84dc-957af2000a01 on nch2-master-1 May 21 21:42:26.422190 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-ce370ad0-df05-465a-af44-58205fae1dbc req-9b134e1f-a766-4eb8-b891-b7ab252b909f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035463 May 21 21:42:26.422798 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2938/5754] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:42:26.428372 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-929e6d7f-92ba-4fc7-aabf-b00cbb3483a4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:26.438417 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-929e6d7f-92ba-4fc7-aabf-b00cbb3483a4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1203 microversion: 2.1 time: 0.331765 May 21 21:42:26.439590 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2817/5755] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:26 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1203 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:27.458864 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7bbbfc4f-dde9-4f6b-b617-3fb3ed6d3a35 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:27.459879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7bbbfc4f-dde9-4f6b-b617-3fb3ed6d3a35 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:27.467697 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7bbbfc4f-dde9-4f6b-b617-3fb3ed6d3a35 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:27.468364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7bbbfc4f-dde9-4f6b-b617-3fb3ed6d3a35 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:27.469221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7bbbfc4f-dde9-4f6b-b617-3fb3ed6d3a35 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:27.469763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7bbbfc4f-dde9-4f6b-b617-3fb3ed6d3a35 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:27.707698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7bbbfc4f-dde9-4f6b-b617-3fb3ed6d3a35 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:27.718620 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7bbbfc4f-dde9-4f6b-b617-3fb3ed6d3a35 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1203 microversion: 2.1 time: 0.265667 May 21 21:42:27.736847 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2939/5756] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:27 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1203 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:28.736427 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2a95595e-46f3-4fba-87c5-55bc97024ba7 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:28.737147 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2a95595e-46f3-4fba-87c5-55bc97024ba7 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:28.744571 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a95595e-46f3-4fba-87c5-55bc97024ba7 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:28.745068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a95595e-46f3-4fba-87c5-55bc97024ba7 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:28.745842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a95595e-46f3-4fba-87c5-55bc97024ba7 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:28.746289 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a95595e-46f3-4fba-87c5-55bc97024ba7 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:28.985472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2a95595e-46f3-4fba-87c5-55bc97024ba7 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:28.993485 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2a95595e-46f3-4fba-87c5-55bc97024ba7 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1389 microversion: 2.1 time: 0.261065 May 21 21:42:28.994476 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2818/5757] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:28 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1389 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:29.009963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a15227cd-386a-40d7-9a29-007d8d94a3b4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:29.010519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a15227cd-386a-40d7-9a29-007d8d94a3b4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:29.025530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a15227cd-386a-40d7-9a29-007d8d94a3b4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:29.026001 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a15227cd-386a-40d7-9a29-007d8d94a3b4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:29.026806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a15227cd-386a-40d7-9a29-007d8d94a3b4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:29.027305 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a15227cd-386a-40d7-9a29-007d8d94a3b4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:29.031995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:42:29.243221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a15227cd-386a-40d7-9a29-007d8d94a3b4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:29.252581 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a15227cd-386a-40d7-9a29-007d8d94a3b4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1389 microversion: 2.1 time: 0.246402 May 21 21:42:29.253158 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2940/5758] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:29 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1389 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:29.268950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b39e880e-ff18-4512-ae25-7fed98ff0700 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:29.269492 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b39e880e-ff18-4512-ae25-7fed98ff0700 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:29.277357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b39e880e-ff18-4512-ae25-7fed98ff0700 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:29.277912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b39e880e-ff18-4512-ae25-7fed98ff0700 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:29.278892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b39e880e-ff18-4512-ae25-7fed98ff0700 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:29.279409 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b39e880e-ff18-4512-ae25-7fed98ff0700 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:29.472573 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b39e880e-ff18-4512-ae25-7fed98ff0700 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:29.481272 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b39e880e-ff18-4512-ae25-7fed98ff0700 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1389 microversion: 2.1 time: 0.216088 May 21 21:42:29.482411 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2819/5759] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:29 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1389 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:29.560847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1bd82220-1ddb-4d8f-8fe5-dff2eda906ee tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:29.561353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1bd82220-1ddb-4d8f-8fe5-dff2eda906ee tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:29.568965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1bd82220-1ddb-4d8f-8fe5-dff2eda906ee tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:29.573556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1bd82220-1ddb-4d8f-8fe5-dff2eda906ee tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:29.573556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1bd82220-1ddb-4d8f-8fe5-dff2eda906ee tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:29.573556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1bd82220-1ddb-4d8f-8fe5-dff2eda906ee tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:29.596796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1bd82220-1ddb-4d8f-8fe5-dff2eda906ee tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:42:29.959837 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1bd82220-1ddb-4d8f-8fe5-dff2eda906ee tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "DELETE /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 204 len: 0 microversion: 2.1 time: 0.402782 May 21 21:42:29.960559 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2941/5760] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:42:29 2022] DELETE /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:42:29.968602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7ed8a2b9-4f6e-4375-99e5-04fe296e041c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:29.969275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7ed8a2b9-4f6e-4375-99e5-04fe296e041c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:29.977283 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7ed8a2b9-4f6e-4375-99e5-04fe296e041c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:29.977751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7ed8a2b9-4f6e-4375-99e5-04fe296e041c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:29.978566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7ed8a2b9-4f6e-4375-99e5-04fe296e041c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:29.979445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7ed8a2b9-4f6e-4375-99e5-04fe296e041c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:30.175702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7ed8a2b9-4f6e-4375-99e5-04fe296e041c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:30.184063 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7ed8a2b9-4f6e-4375-99e5-04fe296e041c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1395 microversion: 2.1 time: 0.219301 May 21 21:42:30.184676 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2820/5761] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:29 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1395 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:31.207134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0b547767-2468-4f5f-9847-4cbbff21ed87 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:31.216320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0b547767-2468-4f5f-9847-4cbbff21ed87 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:31.228859 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b547767-2468-4f5f-9847-4cbbff21ed87 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:31.229810 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b547767-2468-4f5f-9847-4cbbff21ed87 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:31.230978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b547767-2468-4f5f-9847-4cbbff21ed87 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:31.231653 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b547767-2468-4f5f-9847-4cbbff21ed87 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:31.491554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0b547767-2468-4f5f-9847-4cbbff21ed87 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:31.500137 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0b547767-2468-4f5f-9847-4cbbff21ed87 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1395 microversion: 2.1 time: 0.301191 May 21 21:42:31.500842 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2942/5762] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:31 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1395 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:32.183137 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-2aaf0452-85a9-4cc9-a2ef-91c810ed31ab req-bfe3d157-289e-44b0-b192-b10df80b71bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f3d790-8da8-41a3-84dc-957af2000a01", "name": "network-vif-deleted", "tag": "2e37ae20-8e95-4e41-b9f6-8b446f9ed817"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:42:32.189317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2aaf0452-85a9-4cc9-a2ef-91c810ed31ab req-bfe3d157-289e-44b0-b192-b10df80b71bf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:32.190030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2aaf0452-85a9-4cc9-a2ef-91c810ed31ab req-bfe3d157-289e-44b0-b192-b10df80b71bf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:32.209353 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-2aaf0452-85a9-4cc9-a2ef-91c810ed31ab req-bfe3d157-289e-44b0-b192-b10df80b71bf service nova] Creating event network-vif-deleted:2e37ae20-8e95-4e41-b9f6-8b446f9ed817 for instance 67f3d790-8da8-41a3-84dc-957af2000a01 on nch2-master-1 May 21 21:42:32.218443 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-2aaf0452-85a9-4cc9-a2ef-91c810ed31ab req-bfe3d157-289e-44b0-b192-b10df80b71bf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042367 May 21 21:42:32.219734 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2821/5763] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:42:32.518589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fe8c1a83-f127-4f89-bd35-628b6d8b02d8 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:32.519205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fe8c1a83-f127-4f89-bd35-628b6d8b02d8 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:32.530364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe8c1a83-f127-4f89-bd35-628b6d8b02d8 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:32.530364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe8c1a83-f127-4f89-bd35-628b6d8b02d8 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:32.530364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe8c1a83-f127-4f89-bd35-628b6d8b02d8 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:32.530364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe8c1a83-f127-4f89-bd35-628b6d8b02d8 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:32.644621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fe8c1a83-f127-4f89-bd35-628b6d8b02d8 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:32.656965 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fe8c1a83-f127-4f89-bd35-628b6d8b02d8 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1188 microversion: 2.1 time: 0.143302 May 21 21:42:32.658072 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2943/5764] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:32 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1188 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:33.675572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-28c5e3d6-ef48-47de-90c3-88d978c155de tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:33.677026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-28c5e3d6-ef48-47de-90c3-88d978c155de tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:33.687570 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28c5e3d6-ef48-47de-90c3-88d978c155de tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:33.688306 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28c5e3d6-ef48-47de-90c3-88d978c155de tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:33.689300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28c5e3d6-ef48-47de-90c3-88d978c155de tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:33.689910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28c5e3d6-ef48-47de-90c3-88d978c155de tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:33.729637 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28c5e3d6-ef48-47de-90c3-88d978c155de tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:33.730180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28c5e3d6-ef48-47de-90c3-88d978c155de tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:33.730715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-28c5e3d6-ef48-47de-90c3-88d978c155de tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lazy-loading 'fault' on Instance uuid 67f3d790-8da8-41a3-84dc-957af2000a01 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:42:33.807246 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-28c5e3d6-ef48-47de-90c3-88d978c155de tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:42:33.815187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:42:33.820093 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-28c5e3d6-ef48-47de-90c3-88d978c155de tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 200 len: 1147 microversion: 2.1 time: 0.148866 May 21 21:42:33.820807 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2822/5765] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:33 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 1147 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:42:34.839567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5c4f0524-3f62-4faa-b840-1e883d1d920c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:34.840440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5c4f0524-3f62-4faa-b840-1e883d1d920c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:34.846800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c4f0524-3f62-4faa-b840-1e883d1d920c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:34.847325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c4f0524-3f62-4faa-b840-1e883d1d920c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:34.848456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c4f0524-3f62-4faa-b840-1e883d1d920c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:34.849108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c4f0524-3f62-4faa-b840-1e883d1d920c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:34.863486 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-5c4f0524-3f62-4faa-b840-1e883d1d920c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] HTTP exception thrown: Instance 67f3d790-8da8-41a3-84dc-957af2000a01 could not be found. May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5c4f0524-3f62-4faa-b840-1e883d1d920c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Request method failure captured: May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 HTTP/1.1 May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVyb9roFCu9pnW6_pGv_nwgdhY8sEs_xi4xzjfpDmQYM_NB-BEWin4ww1-OB-8Ni8Qy5i-drXJJg6PZ5rgg6kLY2EzVB8CGkx9nUQjfPTlEOhCIPDxJkqBjIKr09mBAiVYVzwVkvD5WDNG25XAxQrBLXY2awCOo8K-DKCVfdi9UoZVs May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 8149564857f64342aef93f18c0d90eb1 May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-TestVolumeBootPattern-343249266 May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8149564857f64342aef93f18c0d90eb1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-TestVolumeBootPattern-343249266 May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 8149564857f64342aef93f18c0d90eb1 May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-TestVolumeBootPattern-343249266 May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-TestVolumeBootPattern-343249266-project May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 730839d5531644eb9aa26dabe2fbd8f6 May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-TestVolumeBootPattern-343249266-project May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 67f3d790-8da8-41a3-84dc-957af2000a01 could not be found. May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '67f3d790-8da8-41a3-84dc-957af2000a01'} May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67f3d790-8da8-41a3-84dc-957af2000a01 could not be found. May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67f3d790-8da8-41a3-84dc-957af2000a01 could not be found. May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:42:34.865557 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:42:34.869893 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:42:34.869893 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:42:34.869893 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:42:34.869893 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:42:34.869893 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:42:34.869893 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67f3d790-8da8-41a3-84dc-957af2000a01 could not be found. May 21 21:42:34.869893 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:42:34.872017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5c4f0524-3f62-4faa-b840-1e883d1d920c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Returning 404 to user: Instance 67f3d790-8da8-41a3-84dc-957af2000a01 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:42:34.873105 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5c4f0524-3f62-4faa-b840-1e883d1d920c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 404 len: 111 microversion: 2.1 time: 0.038856 May 21 21:42:34.887715 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2944/5766] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:34 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:42:37.030192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-12bd09bf-e3bc-44a4-b0bd-c0e9a1154a75 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:37.031480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-12bd09bf-e3bc-44a4-b0bd-c0e9a1154a75 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:37.040390 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-12bd09bf-e3bc-44a4-b0bd-c0e9a1154a75 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:37.044872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-12bd09bf-e3bc-44a4-b0bd-c0e9a1154a75 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:37.044872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-12bd09bf-e3bc-44a4-b0bd-c0e9a1154a75 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:37.044872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-12bd09bf-e3bc-44a4-b0bd-c0e9a1154a75 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:37.061163 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-12bd09bf-e3bc-44a4-b0bd-c0e9a1154a75 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] HTTP exception thrown: Instance 67f3d790-8da8-41a3-84dc-957af2000a01 could not be found. May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-12bd09bf-e3bc-44a4-b0bd-c0e9a1154a75 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Request method failure captured: May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 HTTP/1.1 May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVyb9roFCu9pnW6_pGv_nwgdhY8sEs_xi4xzjfpDmQYM_NB-BEWin4ww1-OB-8Ni8Qy5i-drXJJg6PZ5rgg6kLY2EzVB8CGkx9nUQjfPTlEOhCIPDxJkqBjIKr09mBAiVYVzwVkvD5WDNG25XAxQrBLXY2awCOo8K-DKCVfdi9UoZVs May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8149564857f64342aef93f18c0d90eb1 May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestVolumeBootPattern-343249266 May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8149564857f64342aef93f18c0d90eb1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestVolumeBootPattern-343249266 May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8149564857f64342aef93f18c0d90eb1 May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestVolumeBootPattern-343249266 May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestVolumeBootPattern-343249266-project May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 730839d5531644eb9aa26dabe2fbd8f6 May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestVolumeBootPattern-343249266-project May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 67f3d790-8da8-41a3-84dc-957af2000a01 could not be found. May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '67f3d790-8da8-41a3-84dc-957af2000a01'} May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67f3d790-8da8-41a3-84dc-957af2000a01 could not be found. May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:42:37.062982 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:42:37.069577 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67f3d790-8da8-41a3-84dc-957af2000a01 could not be found. May 21 21:42:37.069577 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:42:37.069577 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:42:37.069577 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:42:37.069577 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:42:37.069577 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:42:37.069577 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:42:37.069577 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:42:37.069577 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:42:37.069577 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67f3d790-8da8-41a3-84dc-957af2000a01 could not be found. May 21 21:42:37.069577 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:42:37.069577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-12bd09bf-e3bc-44a4-b0bd-c0e9a1154a75 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Returning 404 to user: Instance 67f3d790-8da8-41a3-84dc-957af2000a01 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:42:37.069577 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-12bd09bf-e3bc-44a4-b0bd-c0e9a1154a75 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "DELETE /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 404 len: 111 microversion: 2.1 time: 0.039375 May 21 21:42:37.069577 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2823/5767] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:42:37 2022] DELETE /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:42:37.075964 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2b2edec6-fbc5-46c5-85a9-fd4c57313995 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:37.076627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2b2edec6-fbc5-46c5-85a9-fd4c57313995 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 67f3d790-8da8-41a3-84dc-957af2000a01] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:37.084431 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b2edec6-fbc5-46c5-85a9-fd4c57313995 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:37.085144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b2edec6-fbc5-46c5-85a9-fd4c57313995 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:37.086130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b2edec6-fbc5-46c5-85a9-fd4c57313995 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:37.086735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b2edec6-fbc5-46c5-85a9-fd4c57313995 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:37.102520 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-2b2edec6-fbc5-46c5-85a9-fd4c57313995 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] HTTP exception thrown: Instance 67f3d790-8da8-41a3-84dc-957af2000a01 could not be found. May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2b2edec6-fbc5-46c5-85a9-fd4c57313995 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Request method failure captured: May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 HTTP/1.1 May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVyb9roFCu9pnW6_pGv_nwgdhY8sEs_xi4xzjfpDmQYM_NB-BEWin4ww1-OB-8Ni8Qy5i-drXJJg6PZ5rgg6kLY2EzVB8CGkx9nUQjfPTlEOhCIPDxJkqBjIKr09mBAiVYVzwVkvD5WDNG25XAxQrBLXY2awCOo8K-DKCVfdi9UoZVs May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 8149564857f64342aef93f18c0d90eb1 May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-TestVolumeBootPattern-343249266 May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8149564857f64342aef93f18c0d90eb1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-TestVolumeBootPattern-343249266 May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 8149564857f64342aef93f18c0d90eb1 May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-TestVolumeBootPattern-343249266 May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-TestVolumeBootPattern-343249266-project May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 730839d5531644eb9aa26dabe2fbd8f6 May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-TestVolumeBootPattern-343249266-project May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 67f3d790-8da8-41a3-84dc-957af2000a01 could not be found. May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '67f3d790-8da8-41a3-84dc-957af2000a01'} May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67f3d790-8da8-41a3-84dc-957af2000a01 could not be found. May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67f3d790-8da8-41a3-84dc-957af2000a01 could not be found. May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:42:37.104299 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:42:37.108869 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:42:37.108869 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:42:37.108869 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:42:37.108869 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:42:37.108869 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:42:37.108869 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67f3d790-8da8-41a3-84dc-957af2000a01 could not be found. May 21 21:42:37.108869 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:42:37.108869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2b2edec6-fbc5-46c5-85a9-fd4c57313995 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Returning 404 to user: Instance 67f3d790-8da8-41a3-84dc-957af2000a01 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:42:37.108869 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2b2edec6-fbc5-46c5-85a9-fd4c57313995 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01" status: 404 len: 111 microversion: 2.1 time: 0.034898 May 21 21:42:37.108869 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2945/5768] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:42:37 2022] GET /compute/v2.1/servers/67f3d790-8da8-41a3-84dc-957af2000a01 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:42:55.552514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4d1c4cbc-b4fb-4465-b889-8d064106a449 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:42:55.555614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4d1c4cbc-b4fb-4465-b889-8d064106a449 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:42:55.561277 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=31 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:42:55.562647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:42:55.567750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d1c4cbc-b4fb-4465-b889-8d064106a449 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:55.568619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d1c4cbc-b4fb-4465-b889-8d064106a449 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:55.569877 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d1c4cbc-b4fb-4465-b889-8d064106a449 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:42:55.570536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d1c4cbc-b4fb-4465-b889-8d064106a449 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:42:55.615427 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4d1c4cbc-b4fb-4465-b889-8d064106a449 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393/ips" status: 200 len: 149 microversion: 2.1 time: 0.061484 May 21 21:42:55.615982 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2824/5769] 10.222.0.49 () {58 vars in 1247 bytes} [Sat May 21 21:42:55 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393/ips => generated 149 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:43:02.765930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-db02f22d-e79b-485b-a418-ad88f923272b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d49aa79f-8460-4aea-b95f-7a47df397625"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:43:02.766652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-db02f22d-e79b-485b-a418-ad88f923272b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:02.769030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:43:02.769712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:43:02.774936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db02f22d-e79b-485b-a418-ad88f923272b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:02.776218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db02f22d-e79b-485b-a418-ad88f923272b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:02.777421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db02f22d-e79b-485b-a418-ad88f923272b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:02.777934 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db02f22d-e79b-485b-a418-ad88f923272b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:03.696227 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-db02f22d-e79b-485b-a418-ad88f923272b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "POST /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.934979 May 21 21:43:03.703617 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2946/5770] 10.222.0.49 () {60 vars in 1322 bytes} [Sat May 21 21:43:02 2022] POST /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393/os-volume_attachments => generated 194 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:43:07.236506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-112fb4da-2db3-4073-ac66-8b9f14184268 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-68537441", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f13b6e40-0105-40ef-8eda-4c160169087e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "8f8d42c3-82dd-4a20-aef1-3a31892db1cf"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:43:07.247678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:43:07.305711 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-112fb4da-2db3-4073-ac66-8b9f14184268 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] validate_networks() for [('8f8d42c3-82dd-4a20-aef1-3a31892db1cf', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:43:07.892683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-112fb4da-2db3-4073-ac66-8b9f14184268 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:43:07.893103 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-112fb4da-2db3-4073-ac66-8b9f14184268 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:43:07.899219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-112fb4da-2db3-4073-ac66-8b9f14184268 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:43:07.899219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-112fb4da-2db3-4073-ac66-8b9f14184268 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:43:07.900099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-112fb4da-2db3-4073-ac66-8b9f14184268 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:43:07.911076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-112fb4da-2db3-4073-ac66-8b9f14184268 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:07.911625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-112fb4da-2db3-4073-ac66-8b9f14184268 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:07.912719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-112fb4da-2db3-4073-ac66-8b9f14184268 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:07.913226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-112fb4da-2db3-4073-ac66-8b9f14184268 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:07.934961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-112fb4da-2db3-4073-ac66-8b9f14184268 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Getting quotas for project 8149564857f64342aef93f18c0d90eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:43:07.959775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-112fb4da-2db3-4073-ac66-8b9f14184268 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Getting quotas for user 730839d5531644eb9aa26dabe2fbd8f6 and project 8149564857f64342aef93f18c0d90eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:43:08.085064 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-112fb4da-2db3-4073-ac66-8b9f14184268 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:43:08.088538 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-112fb4da-2db3-4073-ac66-8b9f14184268 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f13b6e40-0105-40ef-8eda-4c160169087e',volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:43:08.329394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f5c8401e-9c83-466c-a710-aeaa4382d644 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:08.329981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f5c8401e-9c83-466c-a710-aeaa4382d644 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:08.354193 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5c8401e-9c83-466c-a710-aeaa4382d644 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:08.354665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5c8401e-9c83-466c-a710-aeaa4382d644 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:08.355453 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5c8401e-9c83-466c-a710-aeaa4382d644 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:08.355894 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5c8401e-9c83-466c-a710-aeaa4382d644 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:08.475032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-f5c8401e-9c83-466c-a710-aeaa4382d644 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lazy-loading 'services' on Instance uuid 2320fe8d-7d56-42f9-95fa-5570a44e1393 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:43:08.748582 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-112fb4da-2db3-4073-ac66-8b9f14184268 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.516589 May 21 21:43:08.749921 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2825/5771] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:43:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:43:08.762100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-68aa1dfa-c8b5-4736-a25d-83b56a35db6e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:08.762778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-68aa1dfa-c8b5-4736-a25d-83b56a35db6e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:08.838476 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f5c8401e-9c83-466c-a710-aeaa4382d644 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393/os-volume_attachments/d49aa79f-8460-4aea-b95f-7a47df397625" status: 202 len: 0 microversion: 2.1 time: 0.514544 May 21 21:43:08.839578 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2947/5772] 10.222.0.49 () {58 vars in 1415 bytes} [Sat May 21 21:43:08 2022] DELETE /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393/os-volume_attachments/d49aa79f-8460-4aea-b95f-7a47df397625 => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:43:08.871729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-68aa1dfa-c8b5-4736-a25d-83b56a35db6e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:08.875355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-301a111f-8670-45b7-bfff-03b6584ab3b7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:08.878107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-301a111f-8670-45b7-bfff-03b6584ab3b7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:08.880403 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-68aa1dfa-c8b5-4736-a25d-83b56a35db6e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 200 len: 1069 microversion: 2.1 time: 0.121387 May 21 21:43:08.881349 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2826/5773] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:08 2022] GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 1069 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:08.899508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-301a111f-8670-45b7-bfff-03b6584ab3b7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:08.900055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-301a111f-8670-45b7-bfff-03b6584ab3b7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:08.901066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-301a111f-8670-45b7-bfff-03b6584ab3b7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:08.901582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-301a111f-8670-45b7-bfff-03b6584ab3b7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:08.944378 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-301a111f-8670-45b7-bfff-03b6584ab3b7 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091498 May 21 21:43:08.945503 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2948/5774] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:43:08 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:43:09.900056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c01d83c4-c837-4a9e-934e-0d315e6662c3 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:09.908976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c01d83c4-c837-4a9e-934e-0d315e6662c3 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:09.930103 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c01d83c4-c837-4a9e-934e-0d315e6662c3 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:09.931065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c01d83c4-c837-4a9e-934e-0d315e6662c3 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:09.932192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c01d83c4-c837-4a9e-934e-0d315e6662c3 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:09.932949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c01d83c4-c837-4a9e-934e-0d315e6662c3 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:09.958672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-035d95e4-06f8-4969-881e-4b92a2b5f04e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:09.961381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-035d95e4-06f8-4969-881e-4b92a2b5f04e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:09.974263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-035d95e4-06f8-4969-881e-4b92a2b5f04e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:09.976933 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-035d95e4-06f8-4969-881e-4b92a2b5f04e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:09.979905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-035d95e4-06f8-4969-881e-4b92a2b5f04e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:09.980716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-035d95e4-06f8-4969-881e-4b92a2b5f04e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:10.066254 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-035d95e4-06f8-4969-881e-4b92a2b5f04e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113434 May 21 21:43:10.067804 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2949/5775] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:43:09 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:43:10.135665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c01d83c4-c837-4a9e-934e-0d315e6662c3 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:10.147813 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c01d83c4-c837-4a9e-934e-0d315e6662c3 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 200 len: 1119 microversion: 2.1 time: 0.252950 May 21 21:43:10.149860 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2827/5776] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:09 2022] GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 1119 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:11.080043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1ad99215-018b-4c8b-91d8-bd0d120e6db0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:11.081584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1ad99215-018b-4c8b-91d8-bd0d120e6db0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:11.091847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ad99215-018b-4c8b-91d8-bd0d120e6db0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:11.092327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ad99215-018b-4c8b-91d8-bd0d120e6db0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:11.097977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ad99215-018b-4c8b-91d8-bd0d120e6db0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:11.098657 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ad99215-018b-4c8b-91d8-bd0d120e6db0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:11.131928 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1ad99215-018b-4c8b-91d8-bd0d120e6db0 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055007 May 21 21:43:11.133604 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2950/5777] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 21:43:11 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 21:43:11.175321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-07829b93-8256-4599-b351-a1c589f8652e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:11.177498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-07829b93-8256-4599-b351-a1c589f8652e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:11.189916 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-07829b93-8256-4599-b351-a1c589f8652e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:11.190386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-07829b93-8256-4599-b351-a1c589f8652e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:11.194583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-07829b93-8256-4599-b351-a1c589f8652e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:11.195593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-07829b93-8256-4599-b351-a1c589f8652e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:11.219198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b5476b73-90f1-49e6-b4ef-6e474dde13d1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:11.220574 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b5476b73-90f1-49e6-b4ef-6e474dde13d1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:11.228486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b5476b73-90f1-49e6-b4ef-6e474dde13d1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:11.229699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b5476b73-90f1-49e6-b4ef-6e474dde13d1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:11.230777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b5476b73-90f1-49e6-b4ef-6e474dde13d1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:11.232361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b5476b73-90f1-49e6-b4ef-6e474dde13d1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:11.274049 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b5476b73-90f1-49e6-b4ef-6e474dde13d1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:43:11.332933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-07829b93-8256-4599-b351-a1c589f8652e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:11.342191 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-07829b93-8256-4599-b351-a1c589f8652e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 200 len: 1175 microversion: 2.1 time: 0.171742 May 21 21:43:11.342782 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2828/5778] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:11 2022] GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 1175 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:11.629928 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b5476b73-90f1-49e6-b4ef-6e474dde13d1 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393" status: 204 len: 0 microversion: 2.1 time: 0.414066 May 21 21:43:11.632487 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2951/5779] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:43:11 2022] DELETE /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:43:11.640391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1afb10cb-66b7-4d31-9c76-f980f01ade3c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:11.641088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1afb10cb-66b7-4d31-9c76-f980f01ade3c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:11.651098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1afb10cb-66b7-4d31-9c76-f980f01ade3c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:11.651558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1afb10cb-66b7-4d31-9c76-f980f01ade3c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:11.652381 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1afb10cb-66b7-4d31-9c76-f980f01ade3c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:11.652834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1afb10cb-66b7-4d31-9c76-f980f01ade3c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:12.000326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1afb10cb-66b7-4d31-9c76-f980f01ade3c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:12.019041 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1afb10cb-66b7-4d31-9c76-f980f01ade3c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393" status: 200 len: 1680 microversion: 2.1 time: 0.372554 May 21 21:43:12.019041 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2829/5780] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:11 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 => generated 1680 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:12.361566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-42eaeccf-3925-4279-a807-4c769ee538be tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:12.363170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-42eaeccf-3925-4279-a807-4c769ee538be tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:12.371060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42eaeccf-3925-4279-a807-4c769ee538be tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:12.371829 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42eaeccf-3925-4279-a807-4c769ee538be tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:12.372857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42eaeccf-3925-4279-a807-4c769ee538be tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:12.373489 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42eaeccf-3925-4279-a807-4c769ee538be tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:12.740972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-42eaeccf-3925-4279-a807-4c769ee538be tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:12.748981 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-42eaeccf-3925-4279-a807-4c769ee538be tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 200 len: 1227 microversion: 2.1 time: 0.393126 May 21 21:43:12.749758 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2952/5781] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:12 2022] GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 1227 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:13.027262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-022ef346-2272-442b-b1db-98873a8c7655 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:13.028710 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-022ef346-2272-442b-b1db-98873a8c7655 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:13.036249 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-022ef346-2272-442b-b1db-98873a8c7655 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:13.037831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-022ef346-2272-442b-b1db-98873a8c7655 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:13.039502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-022ef346-2272-442b-b1db-98873a8c7655 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:13.039502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-022ef346-2272-442b-b1db-98873a8c7655 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:13.293283 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-022ef346-2272-442b-b1db-98873a8c7655 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:13.302227 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-022ef346-2272-442b-b1db-98873a8c7655 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393" status: 200 len: 1680 microversion: 2.1 time: 0.279086 May 21 21:43:13.304803 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2830/5782] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:13 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 => generated 1680 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:13.769770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5202382e-7551-4c46-a631-cde72756777b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:13.770500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5202382e-7551-4c46-a631-cde72756777b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:13.789015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5202382e-7551-4c46-a631-cde72756777b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:13.794025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5202382e-7551-4c46-a631-cde72756777b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:13.795362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5202382e-7551-4c46-a631-cde72756777b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:13.795882 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5202382e-7551-4c46-a631-cde72756777b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:14.223087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5202382e-7551-4c46-a631-cde72756777b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:14.233028 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5202382e-7551-4c46-a631-cde72756777b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 200 len: 1215 microversion: 2.1 time: 0.467597 May 21 21:43:14.233618 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2953/5783] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:13 2022] GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 1215 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:14.324106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f852ae54-8a3e-4bff-8c3f-d8c333e42b56 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:14.325303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f852ae54-8a3e-4bff-8c3f-d8c333e42b56 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:14.334755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f852ae54-8a3e-4bff-8c3f-d8c333e42b56 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:14.336546 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f852ae54-8a3e-4bff-8c3f-d8c333e42b56 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:14.337571 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f852ae54-8a3e-4bff-8c3f-d8c333e42b56 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:14.338080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f852ae54-8a3e-4bff-8c3f-d8c333e42b56 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:14.529980 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-8abe08d4-edd5-4aea-8f30-8c0dc96e253a req-5d9415af-fadc-4b3f-a6ba-7f8eed0a4f0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c849176-2492-4527-89ed-9632fdb2a1b6", "tag": "a2195ae9-33a1-4b3c-b593-c9c89fe3af77"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:43:14.555756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8abe08d4-edd5-4aea-8f30-8c0dc96e253a req-5d9415af-fadc-4b3f-a6ba-7f8eed0a4f0a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:14.556210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8abe08d4-edd5-4aea-8f30-8c0dc96e253a req-5d9415af-fadc-4b3f-a6ba-7f8eed0a4f0a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:14.571855 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-8abe08d4-edd5-4aea-8f30-8c0dc96e253a req-5d9415af-fadc-4b3f-a6ba-7f8eed0a4f0a service nova] Creating event network-changed:a2195ae9-33a1-4b3c-b593-c9c89fe3af77 for instance 2c849176-2492-4527-89ed-9632fdb2a1b6 on nch1-master-1 May 21 21:43:14.575686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f852ae54-8a3e-4bff-8c3f-d8c333e42b56 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:14.578653 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-8abe08d4-edd5-4aea-8f30-8c0dc96e253a req-5d9415af-fadc-4b3f-a6ba-7f8eed0a4f0a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052379 May 21 21:43:14.579276 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2954/5784] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:43:14.608476 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f852ae54-8a3e-4bff-8c3f-d8c333e42b56 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393" status: 200 len: 1680 microversion: 2.1 time: 0.280246 May 21 21:43:14.608476 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2831/5785] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:14 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 => generated 1680 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:15.254468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1c1adb8e-eca2-4249-b1aa-42caad6feb0f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:15.255186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1c1adb8e-eca2-4249-b1aa-42caad6feb0f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:15.276938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1c1adb8e-eca2-4249-b1aa-42caad6feb0f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:15.279776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1c1adb8e-eca2-4249-b1aa-42caad6feb0f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:15.280762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1c1adb8e-eca2-4249-b1aa-42caad6feb0f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:15.282766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1c1adb8e-eca2-4249-b1aa-42caad6feb0f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:15.621954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d2c410da-f216-4f4f-aa5c-6f11280b85bd tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:15.624800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d2c410da-f216-4f4f-aa5c-6f11280b85bd tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:15.639547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2c410da-f216-4f4f-aa5c-6f11280b85bd tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:15.639997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2c410da-f216-4f4f-aa5c-6f11280b85bd tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:15.640983 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2c410da-f216-4f4f-aa5c-6f11280b85bd tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:15.642360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2c410da-f216-4f4f-aa5c-6f11280b85bd tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:15.673368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1c1adb8e-eca2-4249-b1aa-42caad6feb0f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:15.691487 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1c1adb8e-eca2-4249-b1aa-42caad6feb0f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 200 len: 1215 microversion: 2.1 time: 0.440902 May 21 21:43:15.694893 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2955/5786] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:15 2022] GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 1215 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:15.772661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d2c410da-f216-4f4f-aa5c-6f11280b85bd tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01908adbe2c4aebb89d6fd3af3de207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b9c87f24cd4bac983b83b49daeae5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:15.782857 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d2c410da-f216-4f4f-aa5c-6f11280b85bd tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393" status: 200 len: 1326 microversion: 2.1 time: 0.168544 May 21 21:43:15.784224 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2832/5787] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:15 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 => generated 1326 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:43:16.648493 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-ea3656e9-d8a5-4b5c-a3db-7fc64cbf9a53 req-4c8dfa97-8c4a-474d-92d0-050cb1bff19e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2320fe8d-7d56-42f9-95fa-5570a44e1393", "name": "network-vif-deleted", "tag": "5dc5e2d8-dcfa-4b31-bf51-431708938a5c"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:43:16.657376 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ea3656e9-d8a5-4b5c-a3db-7fc64cbf9a53 req-4c8dfa97-8c4a-474d-92d0-050cb1bff19e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:16.657821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ea3656e9-d8a5-4b5c-a3db-7fc64cbf9a53 req-4c8dfa97-8c4a-474d-92d0-050cb1bff19e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:16.671508 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-ea3656e9-d8a5-4b5c-a3db-7fc64cbf9a53 req-4c8dfa97-8c4a-474d-92d0-050cb1bff19e service nova] Creating event network-vif-deleted:5dc5e2d8-dcfa-4b31-bf51-431708938a5c for instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 on nch1-master-1 May 21 21:43:16.679558 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-ea3656e9-d8a5-4b5c-a3db-7fc64cbf9a53 req-4c8dfa97-8c4a-474d-92d0-050cb1bff19e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034157 May 21 21:43:16.681058 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2956/5788] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:43:16.710915 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-342e60ef-e78c-43ac-8d64-80739613b0e8 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:16.711551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-342e60ef-e78c-43ac-8d64-80739613b0e8 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:16.719427 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-342e60ef-e78c-43ac-8d64-80739613b0e8 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:16.719749 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-342e60ef-e78c-43ac-8d64-80739613b0e8 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:16.720764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-342e60ef-e78c-43ac-8d64-80739613b0e8 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:16.721413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-342e60ef-e78c-43ac-8d64-80739613b0e8 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:16.801650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b5337e48-4595-4f63-bf68-270b3811d96b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:16.803585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b5337e48-4595-4f63-bf68-270b3811d96b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:16.824403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b5337e48-4595-4f63-bf68-270b3811d96b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:16.824982 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b5337e48-4595-4f63-bf68-270b3811d96b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:16.825867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b5337e48-4595-4f63-bf68-270b3811d96b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:16.826412 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b5337e48-4595-4f63-bf68-270b3811d96b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:16.842887 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-b5337e48-4595-4f63-bf68-270b3811d96b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] HTTP exception thrown: Instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 could not be found. May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b5337e48-4595-4f63-bf68-270b3811d96b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Request method failure captured: May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 HTTP/1.1 May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVvVu5OzFh24dUt3T88Soh9um-hz8IBE4d2VFNx-7YcUllc6ZgBzSOlBZt4dp3QDBJfl3krubFG6vrVTWf0UKEtCtTXwmRMqQ2n6JZxp3lQ_OPmOt-nERii-Ro60TAc3AEIDmkAGoz0K0OzdsNDz_o5Rh8C_XfpIypxa4UiR_gbJbi4 May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_41b9c87f24cd4bac983b83b49daeae5a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: f01908adbe2c4aebb89d6fd3af3de207 May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 could not be found. May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '2320fe8d-7d56-42f9-95fa-5570a44e1393'} May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 could not be found. May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 could not be found. May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:43:16.849394 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:16.854205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:16.854205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:43:16.854205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:43:16.854205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:43:16.854205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:43:16.854205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 could not be found. May 21 21:43:16.854205 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:16.854205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b5337e48-4595-4f63-bf68-270b3811d96b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Returning 404 to user: Instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:43:16.855645 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b5337e48-4595-4f63-bf68-270b3811d96b tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393" status: 404 len: 111 microversion: 2.1 time: 0.052519 May 21 21:43:16.856303 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2957/5789] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:16 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:43:16.868949 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2b31b99a-1cad-4281-a729-5fc2d9106db2 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '.version_select at 0x7fc81b4e8b80>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:16.984461 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2b31b99a-1cad-4281-a729-5fc2d9106db2 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1943176445" status: 202 len: 0 microversion: 2.1 time: 0.119632 May 21 21:43:16.985648 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2958/5790] 10.222.0.49 () {58 vars in 1220 bytes} [Sat May 21 21:43:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1943176445 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:43:17.013628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-342e60ef-e78c-43ac-8d64-80739613b0e8 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:17.025610 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-342e60ef-e78c-43ac-8d64-80739613b0e8 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 200 len: 1215 microversion: 2.1 time: 0.319392 May 21 21:43:17.026633 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2833/5791] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:16 2022] GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 1215 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:18.044531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-78267d03-3bd7-4cbe-a55d-4aae4701fa7a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:18.045153 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-78267d03-3bd7-4cbe-a55d-4aae4701fa7a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:18.052559 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78267d03-3bd7-4cbe-a55d-4aae4701fa7a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:18.053925 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78267d03-3bd7-4cbe-a55d-4aae4701fa7a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:18.054981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78267d03-3bd7-4cbe-a55d-4aae4701fa7a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:18.055429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78267d03-3bd7-4cbe-a55d-4aae4701fa7a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:18.227703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-78267d03-3bd7-4cbe-a55d-4aae4701fa7a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:18.235711 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-78267d03-3bd7-4cbe-a55d-4aae4701fa7a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 200 len: 1215 microversion: 2.1 time: 0.196091 May 21 21:43:18.236306 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2959/5792] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:18 2022] GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 1215 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:19.252894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cb0782e9-bdb2-48c5-a1f6-26d4630586f5 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:19.254035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cb0782e9-bdb2-48c5-a1f6-26d4630586f5 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:19.261766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:43:19.262348 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=8 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:43:19.264127 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb0782e9-bdb2-48c5-a1f6-26d4630586f5 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:19.264609 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb0782e9-bdb2-48c5-a1f6-26d4630586f5 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:19.265614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb0782e9-bdb2-48c5-a1f6-26d4630586f5 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:19.266062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cb0782e9-bdb2-48c5-a1f6-26d4630586f5 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:19.680144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cb0782e9-bdb2-48c5-a1f6-26d4630586f5 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:19.688447 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cb0782e9-bdb2-48c5-a1f6-26d4630586f5 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 200 len: 1215 microversion: 2.1 time: 0.439309 May 21 21:43:19.689362 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2834/5793] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:19 2022] GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 1215 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:20.706523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-57a36904-d4e2-4e68-a8fe-37bd42eada77 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:20.711704 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-57a36904-d4e2-4e68-a8fe-37bd42eada77 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:20.720979 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57a36904-d4e2-4e68-a8fe-37bd42eada77 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:20.722044 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57a36904-d4e2-4e68-a8fe-37bd42eada77 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:20.723296 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57a36904-d4e2-4e68-a8fe-37bd42eada77 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:20.723950 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57a36904-d4e2-4e68-a8fe-37bd42eada77 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:21.013506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-57a36904-d4e2-4e68-a8fe-37bd42eada77 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:21.024324 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-57a36904-d4e2-4e68-a8fe-37bd42eada77 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 200 len: 1215 microversion: 2.1 time: 0.321337 May 21 21:43:21.028652 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2960/5794] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:20 2022] GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 1215 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:21.576551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-ac1c335d-e9d9-407e-b428-7ae08dfc898b req-1f4e66eb-9367-4de3-87bf-ef6e7f5438ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c849176-2492-4527-89ed-9632fdb2a1b6", "name": "network-vif-plugged", "status": "completed", "tag": "a2195ae9-33a1-4b3c-b593-c9c89fe3af77"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:43:21.589369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ac1c335d-e9d9-407e-b428-7ae08dfc898b req-1f4e66eb-9367-4de3-87bf-ef6e7f5438ac service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:21.589740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ac1c335d-e9d9-407e-b428-7ae08dfc898b req-1f4e66eb-9367-4de3-87bf-ef6e7f5438ac service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:21.602088 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-ac1c335d-e9d9-407e-b428-7ae08dfc898b req-1f4e66eb-9367-4de3-87bf-ef6e7f5438ac service nova] Creating event network-vif-plugged:a2195ae9-33a1-4b3c-b593-c9c89fe3af77 for instance 2c849176-2492-4527-89ed-9632fdb2a1b6 on nch1-master-1 May 21 21:43:21.608160 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-ac1c335d-e9d9-407e-b428-7ae08dfc898b req-1f4e66eb-9367-4de3-87bf-ef6e7f5438ac service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036934 May 21 21:43:21.610493 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2835/5795] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:43:22.041015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9686dc82-ce69-451f-89f8-11feb0291503 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:22.041565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9686dc82-ce69-451f-89f8-11feb0291503 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:22.048955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9686dc82-ce69-451f-89f8-11feb0291503 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:22.049413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9686dc82-ce69-451f-89f8-11feb0291503 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:22.050189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9686dc82-ce69-451f-89f8-11feb0291503 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:22.050634 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9686dc82-ce69-451f-89f8-11feb0291503 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:22.212648 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9686dc82-ce69-451f-89f8-11feb0291503 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:22.216622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:43:22.221878 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9686dc82-ce69-451f-89f8-11feb0291503 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 200 len: 1215 microversion: 2.1 time: 0.185510 May 21 21:43:22.222512 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2961/5796] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:22 2022] GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 1215 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:23.243743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fadaf939-7751-4a48-86c5-54e94f3e2fb1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:23.244961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fadaf939-7751-4a48-86c5-54e94f3e2fb1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:23.257517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fadaf939-7751-4a48-86c5-54e94f3e2fb1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:23.257980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fadaf939-7751-4a48-86c5-54e94f3e2fb1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:23.258779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fadaf939-7751-4a48-86c5-54e94f3e2fb1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:23.259236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fadaf939-7751-4a48-86c5-54e94f3e2fb1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:23.420870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fadaf939-7751-4a48-86c5-54e94f3e2fb1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:23.433018 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fadaf939-7751-4a48-86c5-54e94f3e2fb1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 200 len: 1215 microversion: 2.1 time: 0.196447 May 21 21:43:23.434298 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2836/5797] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:23 2022] GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 1215 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:24.452755 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0d84fc54-6241-4223-80d3-c299a9c00717 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:24.453430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0d84fc54-6241-4223-80d3-c299a9c00717 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:24.461712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d84fc54-6241-4223-80d3-c299a9c00717 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:24.462173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d84fc54-6241-4223-80d3-c299a9c00717 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:24.463168 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d84fc54-6241-4223-80d3-c299a9c00717 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:24.463653 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d84fc54-6241-4223-80d3-c299a9c00717 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:24.718612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0d84fc54-6241-4223-80d3-c299a9c00717 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:24.726984 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0d84fc54-6241-4223-80d3-c299a9c00717 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 200 len: 1401 microversion: 2.1 time: 0.278668 May 21 21:43:24.727565 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2962/5798] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:24 2022] GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 1401 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:24.745131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3814a024-fab6-4fe0-a8c0-cab39bbb0bb6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:24.745846 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3814a024-fab6-4fe0-a8c0-cab39bbb0bb6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:24.752951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3814a024-fab6-4fe0-a8c0-cab39bbb0bb6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:24.753487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3814a024-fab6-4fe0-a8c0-cab39bbb0bb6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:24.754653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3814a024-fab6-4fe0-a8c0-cab39bbb0bb6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:24.755303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3814a024-fab6-4fe0-a8c0-cab39bbb0bb6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:24.943254 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3814a024-fab6-4fe0-a8c0-cab39bbb0bb6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:24.953301 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3814a024-fab6-4fe0-a8c0-cab39bbb0bb6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 200 len: 1401 microversion: 2.1 time: 0.213053 May 21 21:43:24.955665 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2837/5799] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:24 2022] GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 1401 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:24.971887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8adf3298-9158-4e51-89a1-c98bfabc5bb2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1153864891"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:43:24.975307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8adf3298-9158-4e51-89a1-c98bfabc5bb2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:24.983333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8adf3298-9158-4e51-89a1-c98bfabc5bb2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:24.983668 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8adf3298-9158-4e51-89a1-c98bfabc5bb2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:24.985694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8adf3298-9158-4e51-89a1-c98bfabc5bb2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:24.986311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8adf3298-9158-4e51-89a1-c98bfabc5bb2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:25.132082 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.compute.api [None req-8adf3298-9158-4e51-89a1-c98bfabc5bb2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Attempting to quiesce instance before volume snapshot. May 21 21:43:25.198516 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.compute.api [None req-8adf3298-9158-4e51-89a1-c98bfabc5bb2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Skipping quiescing instance because the operation is not supported by the underlying compute driver. May 21 21:43:25.437257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8adf3298-9158-4e51-89a1-c98bfabc5bb2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Creating snapshot from volume f13b6e40-0105-40ef-8eda-4c160169087e. {{(pid=131277) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} May 21 21:43:27.682128 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8adf3298-9158-4e51-89a1-c98bfabc5bb2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "POST /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6/action" status: 202 len: 0 microversion: 2.1 time: 2.714445 May 21 21:43:27.683766 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2963/5800] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:43:24 2022] POST /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6/action => generated 0 bytes in 2717 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 21 21:43:29.885789 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cce88d23-c4db-42d6-b47a-577e1d1a633e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-567631489", "imageRef": "120b79a6-97ae-4a59-b022-3daed886a095", "flavorRef": "452", "networks": [{"uuid": "8f8d42c3-82dd-4a20-aef1-3a31892db1cf"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:43:29.952781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-cce88d23-c4db-42d6-b47a-577e1d1a633e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] validate_networks() for [('8f8d42c3-82dd-4a20-aef1-3a31892db1cf', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:43:30.493151 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-cce88d23-c4db-42d6-b47a-577e1d1a633e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:43:30.493578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-cce88d23-c4db-42d6-b47a-577e1d1a633e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:43:30.494056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-cce88d23-c4db-42d6-b47a-577e1d1a633e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:43:30.494467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-cce88d23-c4db-42d6-b47a-577e1d1a633e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:43:30.494880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-cce88d23-c4db-42d6-b47a-577e1d1a633e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:43:30.504361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cce88d23-c4db-42d6-b47a-577e1d1a633e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:30.504812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cce88d23-c4db-42d6-b47a-577e1d1a633e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:30.505638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cce88d23-c4db-42d6-b47a-577e1d1a633e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:30.506079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cce88d23-c4db-42d6-b47a-577e1d1a633e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:30.525300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-cce88d23-c4db-42d6-b47a-577e1d1a633e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Getting quotas for project 8149564857f64342aef93f18c0d90eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:43:30.530866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-cce88d23-c4db-42d6-b47a-577e1d1a633e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Getting quotas for user 730839d5531644eb9aa26dabe2fbd8f6 and project 8149564857f64342aef93f18c0d90eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:43:30.544085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cce88d23-c4db-42d6-b47a-577e1d1a633e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:43:30.546911 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cce88d23-c4db-42d6-b47a-577e1d1a633e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='99cc8ea9-83d1-400c-a93e-ffb9942a0da8',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:43:30.691637 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cce88d23-c4db-42d6-b47a-577e1d1a633e tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810597 May 21 21:43:30.692310 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2838/5801] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:43:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:43:30.704757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0b09532d-81d5-4e42-ab50-6e4846b58bf0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:30.705488 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0b09532d-81d5-4e42-ab50-6e4846b58bf0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:30.776586 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0b09532d-81d5-4e42-ab50-6e4846b58bf0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:30.784143 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0b09532d-81d5-4e42-ab50-6e4846b58bf0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1229 microversion: 2.1 time: 0.084907 May 21 21:43:30.784747 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2964/5802] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:30 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1229 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:31.117176 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1d1d4c34-baae-4df9-800a-d17c1f0ff45a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:31.117687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1d1d4c34-baae-4df9-800a-d17c1f0ff45a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:31.126663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d1d4c34-baae-4df9-800a-d17c1f0ff45a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:31.127123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d1d4c34-baae-4df9-800a-d17c1f0ff45a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:31.127916 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d1d4c34-baae-4df9-800a-d17c1f0ff45a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:31.128387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d1d4c34-baae-4df9-800a-d17c1f0ff45a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:31.142753 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-1d1d4c34-baae-4df9-800a-d17c1f0ff45a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] HTTP exception thrown: Instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 could not be found. May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1d1d4c34-baae-4df9-800a-d17c1f0ff45a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Request method failure captured: May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 HTTP/1.1 May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVvVu5OzFh24dUt3T88Soh9um-hz8IBE4d2VFNx-7YcUllc6ZgBzSOlBZt4dp3QDBJfl3krubFG6vrVTWf0UKEtCtTXwmRMqQ2n6JZxp3lQ_OPmOt-nERii-Ro60TAc3AEIDmkAGoz0K0OzdsNDz_o5Rh8C_XfpIypxa4UiR_gbJbi4 May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_41b9c87f24cd4bac983b83b49daeae5a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: f01908adbe2c4aebb89d6fd3af3de207 May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 could not be found. May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '2320fe8d-7d56-42f9-95fa-5570a44e1393'} May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 could not be found. May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:43:31.144466 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:43:31.149147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 could not be found. May 21 21:43:31.149147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:43:31.149147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:43:31.149147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:43:31.149147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:31.149147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:43:31.149147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:43:31.149147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:43:31.149147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:43:31.149147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 could not be found. May 21 21:43:31.149147 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:43:31.149147 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1d1d4c34-baae-4df9-800a-d17c1f0ff45a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Returning 404 to user: Instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:43:31.149147 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1d1d4c34-baae-4df9-800a-d17c1f0ff45a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393" status: 404 len: 111 microversion: 2.1 time: 0.033816 May 21 21:43:31.149147 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2839/5803] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:43:31 2022] DELETE /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:43:31.155629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7f044c59-b570-494e-8576-749efd2a563e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:31.156268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7f044c59-b570-494e-8576-749efd2a563e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 2320fe8d-7d56-42f9-95fa-5570a44e1393] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:31.162947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f044c59-b570-494e-8576-749efd2a563e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:31.163417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f044c59-b570-494e-8576-749efd2a563e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:31.164203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f044c59-b570-494e-8576-749efd2a563e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:31.164688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f044c59-b570-494e-8576-749efd2a563e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:31.180001 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-7f044c59-b570-494e-8576-749efd2a563e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] HTTP exception thrown: Instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 could not be found. May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7f044c59-b570-494e-8576-749efd2a563e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Request method failure captured: May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 HTTP/1.1 May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVvVu5OzFh24dUt3T88Soh9um-hz8IBE4d2VFNx-7YcUllc6ZgBzSOlBZt4dp3QDBJfl3krubFG6vrVTWf0UKEtCtTXwmRMqQ2n6JZxp3lQ_OPmOt-nERii-Ro60TAc3AEIDmkAGoz0K0OzdsNDz_o5Rh8C_XfpIypxa4UiR_gbJbi4 May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_41b9c87f24cd4bac983b83b49daeae5a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: f01908adbe2c4aebb89d6fd3af3de207 May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 could not be found. May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '2320fe8d-7d56-42f9-95fa-5570a44e1393'} May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 could not be found. May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 could not be found. May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:43:31.181703 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:31.199165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:31.199165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:43:31.199165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:43:31.199165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:43:31.199165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:43:31.199165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 could not be found. May 21 21:43:31.199165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:31.199165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7f044c59-b570-494e-8576-749efd2a563e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Returning 404 to user: Instance 2320fe8d-7d56-42f9-95fa-5570a44e1393 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:43:31.199165 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7f044c59-b570-494e-8576-749efd2a563e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393" status: 404 len: 111 microversion: 2.1 time: 0.031585 May 21 21:43:31.199165 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2965/5804] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:31 2022] GET /compute/v2.1/servers/2320fe8d-7d56-42f9-95fa-5570a44e1393 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:43:31.802842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7c218471-4a8b-4bdc-9d71-342546320532 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:31.803590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7c218471-4a8b-4bdc-9d71-342546320532 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:31.812040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c218471-4a8b-4bdc-9d71-342546320532 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:31.812529 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c218471-4a8b-4bdc-9d71-342546320532 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:31.813375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c218471-4a8b-4bdc-9d71-342546320532 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:31.814039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c218471-4a8b-4bdc-9d71-342546320532 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:31.900702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7c218471-4a8b-4bdc-9d71-342546320532 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:31.908195 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7c218471-4a8b-4bdc-9d71-342546320532 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1233 microversion: 2.1 time: 0.109247 May 21 21:43:31.915532 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2840/5805] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:31 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1233 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:32.933425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-907cf3c0-36a9-4b67-8551-5b5b89a10667 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:32.934092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-907cf3c0-36a9-4b67-8551-5b5b89a10667 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:32.937080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:43:32.944965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-907cf3c0-36a9-4b67-8551-5b5b89a10667 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:32.945458 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-907cf3c0-36a9-4b67-8551-5b5b89a10667 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:32.946276 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-907cf3c0-36a9-4b67-8551-5b5b89a10667 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:32.946791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-907cf3c0-36a9-4b67-8551-5b5b89a10667 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:33.020394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-907cf3c0-36a9-4b67-8551-5b5b89a10667 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:33.030558 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-907cf3c0-36a9-4b67-8551-5b5b89a10667 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1289 microversion: 2.1 time: 0.101961 May 21 21:43:33.038598 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2966/5806] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:32 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1289 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:34.049191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6efab891-eff6-48a1-8747-b609bd4b5ed1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:34.049913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6efab891-eff6-48a1-8747-b609bd4b5ed1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:34.058051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6efab891-eff6-48a1-8747-b609bd4b5ed1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:34.060992 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6efab891-eff6-48a1-8747-b609bd4b5ed1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:34.060992 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6efab891-eff6-48a1-8747-b609bd4b5ed1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:34.060992 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6efab891-eff6-48a1-8747-b609bd4b5ed1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:34.414053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6efab891-eff6-48a1-8747-b609bd4b5ed1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:34.429633 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6efab891-eff6-48a1-8747-b609bd4b5ed1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1341 microversion: 2.1 time: 0.383469 May 21 21:43:34.430529 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2841/5807] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:34 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1341 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:43:35.448135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-599f3959-dc1e-470b-87d8-94ad1b7dfa61 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:35.450896 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-599f3959-dc1e-470b-87d8-94ad1b7dfa61 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:35.460820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-599f3959-dc1e-470b-87d8-94ad1b7dfa61 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:35.461295 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-599f3959-dc1e-470b-87d8-94ad1b7dfa61 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:35.462768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-599f3959-dc1e-470b-87d8-94ad1b7dfa61 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:35.462768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-599f3959-dc1e-470b-87d8-94ad1b7dfa61 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:35.722927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-599f3959-dc1e-470b-87d8-94ad1b7dfa61 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:35.733575 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-599f3959-dc1e-470b-87d8-94ad1b7dfa61 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1341 microversion: 2.1 time: 0.290273 May 21 21:43:35.734291 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2967/5808] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:35 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1341 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:36.498456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-4b60ec13-9498-440a-bc86-b1d01ba2fbe2 req-b31e3bfc-d164-41af-aa16-60dc79ec6725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2", "tag": "c6d16cab-d8d8-43b8-98f7-1c9de89c1e5a"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:43:36.549406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4b60ec13-9498-440a-bc86-b1d01ba2fbe2 req-b31e3bfc-d164-41af-aa16-60dc79ec6725 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:36.550010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4b60ec13-9498-440a-bc86-b1d01ba2fbe2 req-b31e3bfc-d164-41af-aa16-60dc79ec6725 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:36.577349 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-4b60ec13-9498-440a-bc86-b1d01ba2fbe2 req-b31e3bfc-d164-41af-aa16-60dc79ec6725 service nova] Creating event network-changed:c6d16cab-d8d8-43b8-98f7-1c9de89c1e5a for instance 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 on nch2-master-1 May 21 21:43:36.583585 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-4b60ec13-9498-440a-bc86-b1d01ba2fbe2 req-b31e3bfc-d164-41af-aa16-60dc79ec6725 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090271 May 21 21:43:36.587208 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2842/5809] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:43:36.752078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f1b9f892-c0e6-46dc-9988-bf1666ff2361 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:36.753372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f1b9f892-c0e6-46dc-9988-bf1666ff2361 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:36.782398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1b9f892-c0e6-46dc-9988-bf1666ff2361 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:36.786336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1b9f892-c0e6-46dc-9988-bf1666ff2361 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:36.789746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1b9f892-c0e6-46dc-9988-bf1666ff2361 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:36.791122 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1b9f892-c0e6-46dc-9988-bf1666ff2361 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:36.989990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f1b9f892-c0e6-46dc-9988-bf1666ff2361 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:37.001061 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f1b9f892-c0e6-46dc-9988-bf1666ff2361 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1341 microversion: 2.1 time: 0.253528 May 21 21:43:37.002939 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2968/5810] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:36 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1341 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:38.019629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-be77b467-b1f9-4fcc-a9a7-45c177283af2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:38.020256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-be77b467-b1f9-4fcc-a9a7-45c177283af2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:38.023000 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:43:38.028045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be77b467-b1f9-4fcc-a9a7-45c177283af2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:38.028539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be77b467-b1f9-4fcc-a9a7-45c177283af2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:38.029323 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be77b467-b1f9-4fcc-a9a7-45c177283af2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:38.029768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be77b467-b1f9-4fcc-a9a7-45c177283af2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:38.032484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=87 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:43:38.390469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-be77b467-b1f9-4fcc-a9a7-45c177283af2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:38.399406 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-be77b467-b1f9-4fcc-a9a7-45c177283af2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1341 microversion: 2.1 time: 0.384675 May 21 21:43:38.408933 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2843/5811] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:38 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1341 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:39.421746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2c0abd65-3475-4d00-96f0-38bf49ec3cbd tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:39.422384 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2c0abd65-3475-4d00-96f0-38bf49ec3cbd tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:39.431625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c0abd65-3475-4d00-96f0-38bf49ec3cbd tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:39.432087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c0abd65-3475-4d00-96f0-38bf49ec3cbd tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:39.432919 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c0abd65-3475-4d00-96f0-38bf49ec3cbd tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:39.433373 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2c0abd65-3475-4d00-96f0-38bf49ec3cbd tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:39.704450 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2c0abd65-3475-4d00-96f0-38bf49ec3cbd tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:39.712436 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2c0abd65-3475-4d00-96f0-38bf49ec3cbd tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1341 microversion: 2.1 time: 0.300049 May 21 21:43:39.713028 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2969/5812] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:39 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1341 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:40.731875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e11241fa-d6b5-4368-9a1e-bf4cc9b23a6b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:40.732716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e11241fa-d6b5-4368-9a1e-bf4cc9b23a6b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:40.735608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:43:40.736362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:43:40.742765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e11241fa-d6b5-4368-9a1e-bf4cc9b23a6b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:40.743230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e11241fa-d6b5-4368-9a1e-bf4cc9b23a6b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:40.744026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e11241fa-d6b5-4368-9a1e-bf4cc9b23a6b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:40.744495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e11241fa-d6b5-4368-9a1e-bf4cc9b23a6b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:41.176572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e11241fa-d6b5-4368-9a1e-bf4cc9b23a6b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:41.184537 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e11241fa-d6b5-4368-9a1e-bf4cc9b23a6b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1341 microversion: 2.1 time: 0.457684 May 21 21:43:41.185129 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2844/5813] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:40 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1341 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:42.201676 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fdeb2672-a1b5-4373-a3c8-c7f39051de36 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:42.202221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fdeb2672-a1b5-4373-a3c8-c7f39051de36 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:42.205010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:43:42.210441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fdeb2672-a1b5-4373-a3c8-c7f39051de36 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:42.210871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fdeb2672-a1b5-4373-a3c8-c7f39051de36 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:42.211665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fdeb2672-a1b5-4373-a3c8-c7f39051de36 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:42.212127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fdeb2672-a1b5-4373-a3c8-c7f39051de36 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:42.393822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fdeb2672-a1b5-4373-a3c8-c7f39051de36 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:42.403747 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fdeb2672-a1b5-4373-a3c8-c7f39051de36 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1375 microversion: 2.1 time: 0.205999 May 21 21:43:42.404365 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2970/5814] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:42 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1375 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:43.112675 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c0b4801f-5eb8-4a9e-a41d-4f879b2b5cc6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:43.113297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c0b4801f-5eb8-4a9e-a41d-4f879b2b5cc6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:43.121025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c0b4801f-5eb8-4a9e-a41d-4f879b2b5cc6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:43.121488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c0b4801f-5eb8-4a9e-a41d-4f879b2b5cc6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:43.122268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c0b4801f-5eb8-4a9e-a41d-4f879b2b5cc6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:43.122712 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c0b4801f-5eb8-4a9e-a41d-4f879b2b5cc6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:43.137129 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-c0b4801f-5eb8-4a9e-a41d-4f879b2b5cc6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] HTTP exception thrown: Instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 could not be found. May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c0b4801f-5eb8-4a9e-a41d-4f879b2b5cc6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Request method failure captured: May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 HTTP/1.1 May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVvVu5OzFh24dUt3T88Soh9um-hz8IBE4d2VFNx-7YcUllc6ZgBzSOlBZt4dp3QDBJfl3krubFG6vrVTWf0UKEtCtTXwmRMqQ2n6JZxp3lQ_OPmOt-nERii-Ro60TAc3AEIDmkAGoz0K0OzdsNDz_o5Rh8C_XfpIypxa4UiR_gbJbi4 May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_41b9c87f24cd4bac983b83b49daeae5a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: f01908adbe2c4aebb89d6fd3af3de207 May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 could not be found. May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57'} May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 could not be found. May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:43:43.138828 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:43:43.145237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 could not be found. May 21 21:43:43.145237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:43:43.145237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:43:43.145237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:43:43.145237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:43.145237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:43:43.145237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:43:43.145237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:43:43.145237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:43:43.145237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 could not be found. May 21 21:43:43.145237 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:43:43.145237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c0b4801f-5eb8-4a9e-a41d-4f879b2b5cc6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Returning 404 to user: Instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:43:43.145237 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c0b4801f-5eb8-4a9e-a41d-4f879b2b5cc6 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57" status: 404 len: 111 microversion: 2.1 time: 0.031466 May 21 21:43:43.145237 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2845/5815] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:43:43 2022] DELETE /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:43:43.150400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3b677161-39c8-4f48-b7c8-b99bef3017a8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:43.151036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3b677161-39c8-4f48-b7c8-b99bef3017a8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:43.157828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b677161-39c8-4f48-b7c8-b99bef3017a8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:43.158302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b677161-39c8-4f48-b7c8-b99bef3017a8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:43.159155 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b677161-39c8-4f48-b7c8-b99bef3017a8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:43.159677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b677161-39c8-4f48-b7c8-b99bef3017a8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:43.174629 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-3b677161-39c8-4f48-b7c8-b99bef3017a8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] HTTP exception thrown: Instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 could not be found. May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3b677161-39c8-4f48-b7c8-b99bef3017a8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Request method failure captured: May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 HTTP/1.1 May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVvVu5OzFh24dUt3T88Soh9um-hz8IBE4d2VFNx-7YcUllc6ZgBzSOlBZt4dp3QDBJfl3krubFG6vrVTWf0UKEtCtTXwmRMqQ2n6JZxp3lQ_OPmOt-nERii-Ro60TAc3AEIDmkAGoz0K0OzdsNDz_o5Rh8C_XfpIypxa4UiR_gbJbi4 May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_41b9c87f24cd4bac983b83b49daeae5a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: f01908adbe2c4aebb89d6fd3af3de207 May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 could not be found. May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57'} May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 could not be found. May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 could not be found. May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:43:43.176319 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:43.182076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:43.182076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:43:43.182076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:43:43.182076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:43:43.182076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:43:43.182076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 could not be found. May 21 21:43:43.182076 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:43.182076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3b677161-39c8-4f48-b7c8-b99bef3017a8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Returning 404 to user: Instance 8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:43:43.182076 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3b677161-39c8-4f48-b7c8-b99bef3017a8 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57" status: 404 len: 111 microversion: 2.1 time: 0.032209 May 21 21:43:43.182925 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2971/5816] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:43 2022] GET /compute/v2.1/servers/8cb35ac1-a6e2-4b1b-9a16-4d5e4a480e57 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:43:43.187888 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5a32eaae-971d-448f-b4c7-6dfedd1f3a1a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:43.188425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5a32eaae-971d-448f-b4c7-6dfedd1f3a1a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:43.195454 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5a32eaae-971d-448f-b4c7-6dfedd1f3a1a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:43.196065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5a32eaae-971d-448f-b4c7-6dfedd1f3a1a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:43.196892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5a32eaae-971d-448f-b4c7-6dfedd1f3a1a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:43.197339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5a32eaae-971d-448f-b4c7-6dfedd1f3a1a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:43.211674 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-5a32eaae-971d-448f-b4c7-6dfedd1f3a1a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] HTTP exception thrown: Instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 could not be found. May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5a32eaae-971d-448f-b4c7-6dfedd1f3a1a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Request method failure captured: May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 HTTP/1.1 May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVvVu5OzFh24dUt3T88Soh9um-hz8IBE4d2VFNx-7YcUllc6ZgBzSOlBZt4dp3QDBJfl3krubFG6vrVTWf0UKEtCtTXwmRMqQ2n6JZxp3lQ_OPmOt-nERii-Ro60TAc3AEIDmkAGoz0K0OzdsNDz_o5Rh8C_XfpIypxa4UiR_gbJbi4 May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_41b9c87f24cd4bac983b83b49daeae5a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: f01908adbe2c4aebb89d6fd3af3de207 May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 could not be found. May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '6c3c7c67-2ce7-4df1-bdae-5278e5e39f76'} May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 could not be found. May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:43:43.213250 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:43:43.217848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 could not be found. May 21 21:43:43.217848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:43:43.217848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:43:43.217848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:43:43.217848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:43.217848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:43:43.217848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:43:43.217848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:43:43.217848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:43:43.217848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 could not be found. May 21 21:43:43.217848 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:43:43.217848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5a32eaae-971d-448f-b4c7-6dfedd1f3a1a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Returning 404 to user: Instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:43:43.217848 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5a32eaae-971d-448f-b4c7-6dfedd1f3a1a tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76" status: 404 len: 111 microversion: 2.1 time: 0.030702 May 21 21:43:43.217848 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2846/5817] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:43:43 2022] DELETE /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:43:43.223446 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-37bc43a1-309c-45a2-bda2-1d362562094e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:43.224217 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-37bc43a1-309c-45a2-bda2-1d362562094e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:43.231764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-37bc43a1-309c-45a2-bda2-1d362562094e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:43.232237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-37bc43a1-309c-45a2-bda2-1d362562094e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:43.233062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-37bc43a1-309c-45a2-bda2-1d362562094e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:43.233524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-37bc43a1-309c-45a2-bda2-1d362562094e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:43.247939 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-37bc43a1-309c-45a2-bda2-1d362562094e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] HTTP exception thrown: Instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 could not be found. May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-37bc43a1-309c-45a2-bda2-1d362562094e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Request method failure captured: May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 HTTP/1.1 May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVvVu5OzFh24dUt3T88Soh9um-hz8IBE4d2VFNx-7YcUllc6ZgBzSOlBZt4dp3QDBJfl3krubFG6vrVTWf0UKEtCtTXwmRMqQ2n6JZxp3lQ_OPmOt-nERii-Ro60TAc3AEIDmkAGoz0K0OzdsNDz_o5Rh8C_XfpIypxa4UiR_gbJbi4 May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_41b9c87f24cd4bac983b83b49daeae5a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: f01908adbe2c4aebb89d6fd3af3de207 May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 could not be found. May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '6c3c7c67-2ce7-4df1-bdae-5278e5e39f76'} May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 could not be found. May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 could not be found. May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:43:43.249575 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:43.254033 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:43.254033 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:43:43.254033 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:43:43.254033 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:43:43.254033 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:43:43.254033 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 could not be found. May 21 21:43:43.254033 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:43.254033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-37bc43a1-309c-45a2-bda2-1d362562094e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Returning 404 to user: Instance 6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:43:43.254033 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-37bc43a1-309c-45a2-bda2-1d362562094e tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76" status: 404 len: 111 microversion: 2.1 time: 0.031551 May 21 21:43:43.255560 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2972/5818] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:43 2022] GET /compute/v2.1/servers/6c3c7c67-2ce7-4df1-bdae-5278e5e39f76 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:43:43.424685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a9a2ee54-26ac-43f5-9124-640616b012ca tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:43.426039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a9a2ee54-26ac-43f5-9124-640616b012ca tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:43.434761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a9a2ee54-26ac-43f5-9124-640616b012ca tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:43.435266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a9a2ee54-26ac-43f5-9124-640616b012ca tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:43.436501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a9a2ee54-26ac-43f5-9124-640616b012ca tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:43.436968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a9a2ee54-26ac-43f5-9124-640616b012ca tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:43.678773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a9a2ee54-26ac-43f5-9124-640616b012ca tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:43.688093 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a9a2ee54-26ac-43f5-9124-640616b012ca tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1375 microversion: 2.1 time: 0.268996 May 21 21:43:43.688697 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2847/5819] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:43 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1375 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:44.707769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3e696d58-aa9d-4d61-9298-97fb45c514cd tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:44.708526 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3e696d58-aa9d-4d61-9298-97fb45c514cd tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:44.717567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e696d58-aa9d-4d61-9298-97fb45c514cd tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:44.718034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e696d58-aa9d-4d61-9298-97fb45c514cd tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:44.719052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e696d58-aa9d-4d61-9298-97fb45c514cd tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:44.719542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e696d58-aa9d-4d61-9298-97fb45c514cd tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:44.878171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3e696d58-aa9d-4d61-9298-97fb45c514cd tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:44.886010 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3e696d58-aa9d-4d61-9298-97fb45c514cd tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1375 microversion: 2.1 time: 0.183830 May 21 21:43:44.886592 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2973/5820] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:44 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1375 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:45.903340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e126c626-6162-4f1c-917f-c38eea2a4829 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:45.903915 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e126c626-6162-4f1c-917f-c38eea2a4829 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:45.911051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e126c626-6162-4f1c-917f-c38eea2a4829 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:45.911510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e126c626-6162-4f1c-917f-c38eea2a4829 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:45.912309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e126c626-6162-4f1c-917f-c38eea2a4829 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:45.912753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e126c626-6162-4f1c-917f-c38eea2a4829 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:46.208426 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e126c626-6162-4f1c-917f-c38eea2a4829 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:46.217444 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e126c626-6162-4f1c-917f-c38eea2a4829 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1375 microversion: 2.1 time: 0.317966 May 21 21:43:46.218346 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2848/5821] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:45 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1375 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:47.235308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-64cba774-8e54-4c59-9d75-d8d0ae118372 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:47.236094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-64cba774-8e54-4c59-9d75-d8d0ae118372 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:47.243945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-64cba774-8e54-4c59-9d75-d8d0ae118372 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:47.244477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-64cba774-8e54-4c59-9d75-d8d0ae118372 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:47.245299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-64cba774-8e54-4c59-9d75-d8d0ae118372 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:47.245778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-64cba774-8e54-4c59-9d75-d8d0ae118372 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:47.513636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-64cba774-8e54-4c59-9d75-d8d0ae118372 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:47.524303 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-64cba774-8e54-4c59-9d75-d8d0ae118372 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1375 microversion: 2.1 time: 0.292925 May 21 21:43:47.525758 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2974/5822] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:47 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1375 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:48.541572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7f7c8e57-85ce-420c-acea-b25e94eb849a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:48.542246 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7f7c8e57-85ce-420c-acea-b25e94eb849a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:48.550155 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f7c8e57-85ce-420c-acea-b25e94eb849a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:48.550607 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f7c8e57-85ce-420c-acea-b25e94eb849a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:48.551394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f7c8e57-85ce-420c-acea-b25e94eb849a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:48.552069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7f7c8e57-85ce-420c-acea-b25e94eb849a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:48.729736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7f7c8e57-85ce-420c-acea-b25e94eb849a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:48.737735 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7f7c8e57-85ce-420c-acea-b25e94eb849a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1375 microversion: 2.1 time: 0.200164 May 21 21:43:48.738335 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2849/5823] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:48 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1375 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:49.755021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8a9a6c37-d263-418f-85ff-9c354f5d79f5 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:49.755649 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8a9a6c37-d263-418f-85ff-9c354f5d79f5 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:49.763783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a9a6c37-d263-418f-85ff-9c354f5d79f5 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:49.764256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a9a6c37-d263-418f-85ff-9c354f5d79f5 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:49.765391 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a9a6c37-d263-418f-85ff-9c354f5d79f5 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:49.766110 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a9a6c37-d263-418f-85ff-9c354f5d79f5 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:49.962660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8a9a6c37-d263-418f-85ff-9c354f5d79f5 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:49.970958 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8a9a6c37-d263-418f-85ff-9c354f5d79f5 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1375 microversion: 2.1 time: 0.219771 May 21 21:43:49.981003 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2975/5824] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:49 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1375 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:50.671426 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-222ade72-d379-444b-bfcf-9118abfcc160 req-980d7f51-7abf-4637-a9b0-0bbb2102c5ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2", "name": "network-vif-plugged", "status": "completed", "tag": "c6d16cab-d8d8-43b8-98f7-1c9de89c1e5a"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:43:50.722388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-222ade72-d379-444b-bfcf-9118abfcc160 req-980d7f51-7abf-4637-a9b0-0bbb2102c5ba service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:50.722388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-222ade72-d379-444b-bfcf-9118abfcc160 req-980d7f51-7abf-4637-a9b0-0bbb2102c5ba service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:50.722697 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-222ade72-d379-444b-bfcf-9118abfcc160 req-980d7f51-7abf-4637-a9b0-0bbb2102c5ba service nova] Creating event network-vif-plugged:c6d16cab-d8d8-43b8-98f7-1c9de89c1e5a for instance 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 on nch2-master-1 May 21 21:43:50.729959 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-222ade72-d379-444b-bfcf-9118abfcc160 req-980d7f51-7abf-4637-a9b0-0bbb2102c5ba service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071757 May 21 21:43:50.730611 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2850/5825] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:43:50.996447 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f2d4be69-1349-4850-a4d0-2bbbf398326b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:50.996447 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f2d4be69-1349-4850-a4d0-2bbbf398326b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:51.001415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2d4be69-1349-4850-a4d0-2bbbf398326b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:51.001885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2d4be69-1349-4850-a4d0-2bbbf398326b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:51.003112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2d4be69-1349-4850-a4d0-2bbbf398326b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:51.004607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2d4be69-1349-4850-a4d0-2bbbf398326b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:51.170721 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f2d4be69-1349-4850-a4d0-2bbbf398326b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:51.184768 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f2d4be69-1349-4850-a4d0-2bbbf398326b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1375 microversion: 2.1 time: 0.196756 May 21 21:43:51.185436 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2976/5826] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:50 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1375 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:52.202559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dd0471f9-2fb8-47c5-892b-86eb8397dc63 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:52.203265 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dd0471f9-2fb8-47c5-892b-86eb8397dc63 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:52.212581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd0471f9-2fb8-47c5-892b-86eb8397dc63 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:52.213554 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd0471f9-2fb8-47c5-892b-86eb8397dc63 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:52.214809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd0471f9-2fb8-47c5-892b-86eb8397dc63 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:52.215583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd0471f9-2fb8-47c5-892b-86eb8397dc63 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:52.502653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dd0471f9-2fb8-47c5-892b-86eb8397dc63 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:52.515786 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dd0471f9-2fb8-47c5-892b-86eb8397dc63 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1375 microversion: 2.1 time: 0.317100 May 21 21:43:52.522501 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2851/5827] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:52 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1375 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:53.538125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-389025b2-74f9-4f88-9ff0-b80862614bc4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:53.539582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-389025b2-74f9-4f88-9ff0-b80862614bc4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:53.547732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-389025b2-74f9-4f88-9ff0-b80862614bc4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:53.548172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-389025b2-74f9-4f88-9ff0-b80862614bc4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:53.549008 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-389025b2-74f9-4f88-9ff0-b80862614bc4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:53.549471 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-389025b2-74f9-4f88-9ff0-b80862614bc4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:53.783865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-389025b2-74f9-4f88-9ff0-b80862614bc4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:53.793300 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-389025b2-74f9-4f88-9ff0-b80862614bc4 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1375 microversion: 2.1 time: 0.259375 May 21 21:43:53.793883 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2977/5828] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:53 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1375 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:54.811170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-59acfcb4-ced6-4ac5-93cb-fd8ae581ac8f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:54.811968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-59acfcb4-ced6-4ac5-93cb-fd8ae581ac8f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:54.818941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59acfcb4-ced6-4ac5-93cb-fd8ae581ac8f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:54.819403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59acfcb4-ced6-4ac5-93cb-fd8ae581ac8f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:54.820183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59acfcb4-ced6-4ac5-93cb-fd8ae581ac8f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:54.820662 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59acfcb4-ced6-4ac5-93cb-fd8ae581ac8f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:54.979989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-59acfcb4-ced6-4ac5-93cb-fd8ae581ac8f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:54.989613 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-59acfcb4-ced6-4ac5-93cb-fd8ae581ac8f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1562 microversion: 2.1 time: 0.182482 May 21 21:43:54.990289 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2852/5829] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:54 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1562 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:55.018734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a70c1192-3893-40c6-b98e-2de43581b9a9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:55.019362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a70c1192-3893-40c6-b98e-2de43581b9a9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:55.028086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a70c1192-3893-40c6-b98e-2de43581b9a9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:55.029544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a70c1192-3893-40c6-b98e-2de43581b9a9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:55.030511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a70c1192-3893-40c6-b98e-2de43581b9a9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:55.031167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a70c1192-3893-40c6-b98e-2de43581b9a9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:55.354786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a70c1192-3893-40c6-b98e-2de43581b9a9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:55.362667 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a70c1192-3893-40c6-b98e-2de43581b9a9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1562 microversion: 2.1 time: 0.348099 May 21 21:43:55.363567 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2978/5830] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:55 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1562 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:55.433544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d46f7d99-e8bb-4b61-911b-c813afb6e148 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:55.434192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d46f7d99-e8bb-4b61-911b-c813afb6e148 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:55.440676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d46f7d99-e8bb-4b61-911b-c813afb6e148 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:55.441127 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d46f7d99-e8bb-4b61-911b-c813afb6e148 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:55.441902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d46f7d99-e8bb-4b61-911b-c813afb6e148 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:55.442337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d46f7d99-e8bb-4b61-911b-c813afb6e148 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:55.469214 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d46f7d99-e8bb-4b61-911b-c813afb6e148 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:43:55.790576 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d46f7d99-e8bb-4b61-911b-c813afb6e148 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 204 len: 0 microversion: 2.1 time: 0.361141 May 21 21:43:55.791835 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2853/5831] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:43:55 2022] DELETE /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:43:55.800841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2b77b272-230d-44d0-8ffd-20918d759096 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:55.801596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2b77b272-230d-44d0-8ffd-20918d759096 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:55.808028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b77b272-230d-44d0-8ffd-20918d759096 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:55.808545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b77b272-230d-44d0-8ffd-20918d759096 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:55.809348 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b77b272-230d-44d0-8ffd-20918d759096 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:55.809804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b77b272-230d-44d0-8ffd-20918d759096 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:55.814108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:43:56.027662 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2b77b272-230d-44d0-8ffd-20918d759096 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:56.035310 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2b77b272-230d-44d0-8ffd-20918d759096 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1568 microversion: 2.1 time: 0.238643 May 21 21:43:56.035883 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2979/5832] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:55 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:57.057825 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3834133d-917a-4b2f-9733-36e9db09e74b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:57.057825 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3834133d-917a-4b2f-9733-36e9db09e74b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:57.063793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3834133d-917a-4b2f-9733-36e9db09e74b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:57.064258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3834133d-917a-4b2f-9733-36e9db09e74b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:57.065084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3834133d-917a-4b2f-9733-36e9db09e74b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:57.065537 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3834133d-917a-4b2f-9733-36e9db09e74b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:57.236033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3834133d-917a-4b2f-9733-36e9db09e74b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:57.246026 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3834133d-917a-4b2f-9733-36e9db09e74b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1568 microversion: 2.1 time: 0.197044 May 21 21:43:57.246760 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2854/5833] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:57 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:57.321911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b0c73560-1555-4a6f-87b0-4bb3dfd19427 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:57.322476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b0c73560-1555-4a6f-87b0-4bb3dfd19427 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:57.329359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0c73560-1555-4a6f-87b0-4bb3dfd19427 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:57.329834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0c73560-1555-4a6f-87b0-4bb3dfd19427 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:57.330644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0c73560-1555-4a6f-87b0-4bb3dfd19427 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:57.331133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0c73560-1555-4a6f-87b0-4bb3dfd19427 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:57.345671 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-b0c73560-1555-4a6f-87b0-4bb3dfd19427 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] HTTP exception thrown: Instance 4cec7592-1285-42ea-8563-a49982585edc could not be found. May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b0c73560-1555-4a6f-87b0-4bb3dfd19427 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Request method failure captured: May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc HTTP/1.1 May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVvVu5OzFh24dUt3T88Soh9um-hz8IBE4d2VFNx-7YcUllc6ZgBzSOlBZt4dp3QDBJfl3krubFG6vrVTWf0UKEtCtTXwmRMqQ2n6JZxp3lQ_OPmOt-nERii-Ro60TAc3AEIDmkAGoz0K0OzdsNDz_o5Rh8C_XfpIypxa4UiR_gbJbi4 May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_41b9c87f24cd4bac983b83b49daeae5a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: f01908adbe2c4aebb89d6fd3af3de207 May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 4cec7592-1285-42ea-8563-a49982585edc could not be found. May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '4cec7592-1285-42ea-8563-a49982585edc'} May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cec7592-1285-42ea-8563-a49982585edc could not be found. May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:43:57.347288 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:43:57.352620 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cec7592-1285-42ea-8563-a49982585edc could not be found. May 21 21:43:57.352620 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:57.352620 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:43:57.352620 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:57.352620 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:57.352620 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:43:57.352620 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:43:57.352620 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:43:57.352620 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:43:57.352620 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cec7592-1285-42ea-8563-a49982585edc could not be found. May 21 21:43:57.352620 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:43:57.352620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b0c73560-1555-4a6f-87b0-4bb3dfd19427 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Returning 404 to user: Instance 4cec7592-1285-42ea-8563-a49982585edc could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:43:57.352620 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b0c73560-1555-4a6f-87b0-4bb3dfd19427 tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 404 len: 111 microversion: 2.1 time: 0.031256 May 21 21:43:57.352620 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2980/5834] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:43:57 2022] DELETE /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:43:57.358304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2b83dd52-2a9f-4f28-a4f2-f9302709cc6c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:57.358924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2b83dd52-2a9f-4f28-a4f2-f9302709cc6c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] [instance: 4cec7592-1285-42ea-8563-a49982585edc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:57.365062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b83dd52-2a9f-4f28-a4f2-f9302709cc6c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:57.365508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b83dd52-2a9f-4f28-a4f2-f9302709cc6c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:57.366480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b83dd52-2a9f-4f28-a4f2-f9302709cc6c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:57.367510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b83dd52-2a9f-4f28-a4f2-f9302709cc6c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:57.671564 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-2b83dd52-2a9f-4f28-a4f2-f9302709cc6c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] HTTP exception thrown: Instance 4cec7592-1285-42ea-8563-a49982585edc could not be found. May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2b83dd52-2a9f-4f28-a4f2-f9302709cc6c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Request method failure captured: May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc HTTP/1.1 May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVvVu5OzFh24dUt3T88Soh9um-hz8IBE4d2VFNx-7YcUllc6ZgBzSOlBZt4dp3QDBJfl3krubFG6vrVTWf0UKEtCtTXwmRMqQ2n6JZxp3lQ_OPmOt-nERii-Ro60TAc3AEIDmkAGoz0K0OzdsNDz_o5Rh8C_XfpIypxa4UiR_gbJbi4 May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_41b9c87f24cd4bac983b83b49daeae5a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/41b9c87f24cd4bac983b83b49daeae5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 41b9c87f24cd4bac983b83b49daeae5a May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617587518 May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: f01908adbe2c4aebb89d6fd3af3de207 May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-AttachVolumeNegativeTest-617587518-project May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 4cec7592-1285-42ea-8563-a49982585edc could not be found. May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '4cec7592-1285-42ea-8563-a49982585edc'} May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cec7592-1285-42ea-8563-a49982585edc could not be found. May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cec7592-1285-42ea-8563-a49982585edc could not be found. May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:43:57.673295 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:43:57.677534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:43:57.677534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:43:57.677534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:43:57.677534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:43:57.677534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:43:57.677534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cec7592-1285-42ea-8563-a49982585edc could not be found. May 21 21:43:57.677534 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:43:57.677534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2b83dd52-2a9f-4f28-a4f2-f9302709cc6c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] Returning 404 to user: Instance 4cec7592-1285-42ea-8563-a49982585edc could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:43:57.677534 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2b83dd52-2a9f-4f28-a4f2-f9302709cc6c tempest-AttachVolumeNegativeTest-617587518 tempest-AttachVolumeNegativeTest-617587518-project] 10.222.0.49 "GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc" status: 404 len: 111 microversion: 2.1 time: 0.320272 May 21 21:43:57.677534 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2855/5835] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:57 2022] GET /compute/v2.1/servers/4cec7592-1285-42ea-8563-a49982585edc => generated 111 bytes in 321 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:43:58.264211 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-02e94ccb-46ba-4c3c-9157-5b9b3975f837 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:58.264952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-02e94ccb-46ba-4c3c-9157-5b9b3975f837 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:58.274922 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02e94ccb-46ba-4c3c-9157-5b9b3975f837 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:58.276588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02e94ccb-46ba-4c3c-9157-5b9b3975f837 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:58.278604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02e94ccb-46ba-4c3c-9157-5b9b3975f837 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:58.279373 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02e94ccb-46ba-4c3c-9157-5b9b3975f837 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:58.391383 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-02e94ccb-46ba-4c3c-9157-5b9b3975f837 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:58.398456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-e290c802-4dea-494b-9e90-bf124e285bb5 req-131c3857-9864-4d62-9ef5-1e5d788d31be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2", "name": "network-vif-deleted", "tag": "c6d16cab-d8d8-43b8-98f7-1c9de89c1e5a"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:43:58.404948 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-02e94ccb-46ba-4c3c-9157-5b9b3975f837 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1526 microversion: 2.1 time: 0.144305 May 21 21:43:58.409301 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2981/5836] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:58 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1526 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:43:58.414304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e290c802-4dea-494b-9e90-bf124e285bb5 req-131c3857-9864-4d62-9ef5-1e5d788d31be service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:58.417772 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e290c802-4dea-494b-9e90-bf124e285bb5 req-131c3857-9864-4d62-9ef5-1e5d788d31be service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:58.441501 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-e290c802-4dea-494b-9e90-bf124e285bb5 req-131c3857-9864-4d62-9ef5-1e5d788d31be service nova] Creating event network-vif-deleted:c6d16cab-d8d8-43b8-98f7-1c9de89c1e5a for instance 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 on nch2-master-1 May 21 21:43:58.452820 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-e290c802-4dea-494b-9e90-bf124e285bb5 req-131c3857-9864-4d62-9ef5-1e5d788d31be service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057837 May 21 21:43:58.455193 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2856/5837] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:43:59.428166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7e60d5d1-4b62-41c5-bd1f-784b0ba27862 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:43:59.429060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7e60d5d1-4b62-41c5-bd1f-784b0ba27862 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:43:59.437078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e60d5d1-4b62-41c5-bd1f-784b0ba27862 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:59.437776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e60d5d1-4b62-41c5-bd1f-784b0ba27862 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:59.438891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e60d5d1-4b62-41c5-bd1f-784b0ba27862 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:59.445724 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e60d5d1-4b62-41c5-bd1f-784b0ba27862 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:59.517344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e60d5d1-4b62-41c5-bd1f-784b0ba27862 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:43:59.517738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e60d5d1-4b62-41c5-bd1f-784b0ba27862 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:43:59.518405 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-7e60d5d1-4b62-41c5-bd1f-784b0ba27862 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lazy-loading 'fault' on Instance uuid 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:43:59.617962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7e60d5d1-4b62-41c5-bd1f-784b0ba27862 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:43:59.629681 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7e60d5d1-4b62-41c5-bd1f-784b0ba27862 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 200 len: 1365 microversion: 2.1 time: 0.206982 May 21 21:43:59.630986 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2982/5838] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:43:59 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:44:00.650959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3a093986-270c-44ad-a916-30571f6a7d21 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:00.652543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3a093986-270c-44ad-a916-30571f6a7d21 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:00.673852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a093986-270c-44ad-a916-30571f6a7d21 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:00.679815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a093986-270c-44ad-a916-30571f6a7d21 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:00.679815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a093986-270c-44ad-a916-30571f6a7d21 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:00.679815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a093986-270c-44ad-a916-30571f6a7d21 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:00.700839 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-3a093986-270c-44ad-a916-30571f6a7d21 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] HTTP exception thrown: Instance 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 could not be found. May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3a093986-270c-44ad-a916-30571f6a7d21 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Request method failure captured: May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 HTTP/1.1 May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVyb9roFCu9pnW6_pGv_nwgdhY8sEs_xi4xzjfpDmQYM_NB-BEWin4ww1-OB-8Ni8Qy5i-drXJJg6PZ5rgg6kLY2EzVB8CGkx9nUQjfPTlEOhCIPDxJkqBjIKr09mBAiVYVzwVkvD5WDNG25XAxQrBLXY2awCOo8K-DKCVfdi9UoZVs May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8149564857f64342aef93f18c0d90eb1 May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestVolumeBootPattern-343249266 May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8149564857f64342aef93f18c0d90eb1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestVolumeBootPattern-343249266 May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8149564857f64342aef93f18c0d90eb1 May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestVolumeBootPattern-343249266 May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestVolumeBootPattern-343249266-project May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 730839d5531644eb9aa26dabe2fbd8f6 May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestVolumeBootPattern-343249266-project May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 could not be found. May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2'} May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 could not be found. May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 could not be found. May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:44:00.702783 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:00.712531 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:00.712531 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:44:00.712531 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:44:00.712531 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:44:00.712531 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:44:00.712531 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 could not be found. May 21 21:44:00.712531 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:00.712531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3a093986-270c-44ad-a916-30571f6a7d21 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Returning 404 to user: Instance 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:44:00.712531 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3a093986-270c-44ad-a916-30571f6a7d21 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 404 len: 111 microversion: 2.1 time: 0.059923 May 21 21:44:00.712531 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2857/5839] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:00 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:44:19.323260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=35 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:44:19.326378 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=21 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:44:19.688362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-81e5e268-5e9b-45b8-b3bf-50dbe1ad497a tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:19.688893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-81e5e268-5e9b-45b8-b3bf-50dbe1ad497a tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:19.699108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81e5e268-5e9b-45b8-b3bf-50dbe1ad497a tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:19.700431 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81e5e268-5e9b-45b8-b3bf-50dbe1ad497a tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:19.702038 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81e5e268-5e9b-45b8-b3bf-50dbe1ad497a tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:19.711717 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81e5e268-5e9b-45b8-b3bf-50dbe1ad497a tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:19.762462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-81e5e268-5e9b-45b8-b3bf-50dbe1ad497a tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:44:20.232092 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-81e5e268-5e9b-45b8-b3bf-50dbe1ad497a tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "DELETE /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 204 len: 0 microversion: 2.1 time: 0.915130 May 21 21:44:20.237182 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2983/5840] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:44:19 2022] DELETE /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 0 bytes in 917 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:44:20.243605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-77af5b03-bc39-41ef-858c-07d7bfcbbb97 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:20.244908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-77af5b03-bc39-41ef-858c-07d7bfcbbb97 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:20.254909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:44:20.256214 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:44:20.259363 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-77af5b03-bc39-41ef-858c-07d7bfcbbb97 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:20.261817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-77af5b03-bc39-41ef-858c-07d7bfcbbb97 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:20.261817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-77af5b03-bc39-41ef-858c-07d7bfcbbb97 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:20.261817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-77af5b03-bc39-41ef-858c-07d7bfcbbb97 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:20.511143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f3fd89cf-af56-4566-8be4-84aeda56dd0f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-134353610", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "80ae28ec-4868-42c7-a453-aaf978cf6b40"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:44:20.553597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-77af5b03-bc39-41ef-858c-07d7bfcbbb97 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4719c5630b42c6b6d180255db3a202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03901d3dd7b42a4816399ae4896b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:44:20.578034 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-77af5b03-bc39-41ef-858c-07d7bfcbbb97 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 200 len: 1733 microversion: 2.1 time: 0.339930 May 21 21:44:20.579514 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2858/5841] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:20 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 1733 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:44:20.622689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-f3fd89cf-af56-4566-8be4-84aeda56dd0f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] validate_networks() for [('80ae28ec-4868-42c7-a453-aaf978cf6b40', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:44:21.613128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1e1db99e-bc41-45fd-9da1-069667b72fc9 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:21.614582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1e1db99e-bc41-45fd-9da1-069667b72fc9 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:21.630487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e1db99e-bc41-45fd-9da1-069667b72fc9 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:21.631211 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e1db99e-bc41-45fd-9da1-069667b72fc9 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:21.632228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e1db99e-bc41-45fd-9da1-069667b72fc9 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:21.632926 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1e1db99e-bc41-45fd-9da1-069667b72fc9 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:21.930150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1e1db99e-bc41-45fd-9da1-069667b72fc9 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4719c5630b42c6b6d180255db3a202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03901d3dd7b42a4816399ae4896b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:44:21.939060 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1e1db99e-bc41-45fd-9da1-069667b72fc9 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 200 len: 1733 microversion: 2.1 time: 0.331410 May 21 21:44:21.944182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-f3fd89cf-af56-4566-8be4-84aeda56dd0f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:44:21.945389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-f3fd89cf-af56-4566-8be4-84aeda56dd0f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:44:21.945897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-f3fd89cf-af56-4566-8be4-84aeda56dd0f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:44:21.946328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-f3fd89cf-af56-4566-8be4-84aeda56dd0f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:44:21.946760 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-f3fd89cf-af56-4566-8be4-84aeda56dd0f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:44:21.951632 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2859/5842] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:21 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 1733 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:44:21.962405 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3fd89cf-af56-4566-8be4-84aeda56dd0f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:21.962875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3fd89cf-af56-4566-8be4-84aeda56dd0f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:21.963715 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3fd89cf-af56-4566-8be4-84aeda56dd0f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:21.964175 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3fd89cf-af56-4566-8be4-84aeda56dd0f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:21.984739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-f3fd89cf-af56-4566-8be4-84aeda56dd0f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Getting quotas for project 07e046067a8e4197b18860f9b9e1e344. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:44:21.995746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-f3fd89cf-af56-4566-8be4-84aeda56dd0f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Getting quotas for user 88d6ab0c56ae4b16805f265728e20ed6 and project 07e046067a8e4197b18860f9b9e1e344. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:44:22.017354 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f3fd89cf-af56-4566-8be4-84aeda56dd0f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:44:22.020523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f3fd89cf-af56-4566-8be4-84aeda56dd0f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 812a8ad7-8714-40c5-8243-ea20fbe816df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:44:22.127363 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f3fd89cf-af56-4566-8be4-84aeda56dd0f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.620533 May 21 21:44:22.128392 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2984/5843] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:44:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 21 21:44:22.142411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f71e3017-0c64-4a4e-a85b-2983c01835fb tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:22.143046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f71e3017-0c64-4a4e-a85b-2983c01835fb tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 812a8ad7-8714-40c5-8243-ea20fbe816df] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:22.389053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f71e3017-0c64-4a4e-a85b-2983c01835fb tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:44:22.419527 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f71e3017-0c64-4a4e-a85b-2983c01835fb tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df" status: 200 len: 1218 microversion: 2.1 time: 0.273516 May 21 21:44:22.422787 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2860/5844] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:22 2022] GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df => generated 1218 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:44:22.960157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-371ce118-aa5d-446e-9948-2be83f35b766 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:22.973674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-371ce118-aa5d-446e-9948-2be83f35b766 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:22.998303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-371ce118-aa5d-446e-9948-2be83f35b766 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:23.002929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-371ce118-aa5d-446e-9948-2be83f35b766 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:23.009200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-371ce118-aa5d-446e-9948-2be83f35b766 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:23.009679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-371ce118-aa5d-446e-9948-2be83f35b766 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:23.278367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-f61ec12b-a54d-40c4-abfc-9ae2b0ff77d1 req-d3fc3fd1-6b69-4f01-a36c-4871840d03db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "490c94b0-b64f-4b74-90d2-a6972c6bd8a5", "name": "network-vif-deleted", "tag": "0775ded7-f0a3-4833-a397-de269afa6c87"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:44:23.332000 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f61ec12b-a54d-40c4-abfc-9ae2b0ff77d1 req-d3fc3fd1-6b69-4f01-a36c-4871840d03db service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:23.334885 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f61ec12b-a54d-40c4-abfc-9ae2b0ff77d1 req-d3fc3fd1-6b69-4f01-a36c-4871840d03db service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:23.342243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-371ce118-aa5d-446e-9948-2be83f35b766 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4719c5630b42c6b6d180255db3a202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03901d3dd7b42a4816399ae4896b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:44:23.363938 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-371ce118-aa5d-446e-9948-2be83f35b766 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 200 len: 1666 microversion: 2.1 time: 0.408836 May 21 21:44:23.367526 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2985/5845] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:22 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 1666 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:44:23.396547 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-f61ec12b-a54d-40c4-abfc-9ae2b0ff77d1 req-d3fc3fd1-6b69-4f01-a36c-4871840d03db service nova] Creating event network-vif-deleted:0775ded7-f0a3-4833-a397-de269afa6c87 for instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 on nch2-master-1 May 21 21:44:23.406225 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-f61ec12b-a54d-40c4-abfc-9ae2b0ff77d1 req-d3fc3fd1-6b69-4f01-a36c-4871840d03db service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142924 May 21 21:44:23.408216 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2861/5846] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:44:23.439341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-083c1978-41bf-4adb-91fd-5ff7c9b40d4d tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:23.440073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-083c1978-41bf-4adb-91fd-5ff7c9b40d4d tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 812a8ad7-8714-40c5-8243-ea20fbe816df] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:23.510663 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-083c1978-41bf-4adb-91fd-5ff7c9b40d4d tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:44:23.521007 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-083c1978-41bf-4adb-91fd-5ff7c9b40d4d tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df" status: 200 len: 1218 microversion: 2.1 time: 0.083905 May 21 21:44:23.522775 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2986/5847] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:23 2022] GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:44:24.384524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-58729086-8673-440c-bddb-60d36a7962c3 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:24.388601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-58729086-8673-440c-bddb-60d36a7962c3 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:24.395026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58729086-8673-440c-bddb-60d36a7962c3 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:24.395630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58729086-8673-440c-bddb-60d36a7962c3 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:24.396600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58729086-8673-440c-bddb-60d36a7962c3 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:24.397046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58729086-8673-440c-bddb-60d36a7962c3 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:24.459736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58729086-8673-440c-bddb-60d36a7962c3 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:24.459856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58729086-8673-440c-bddb-60d36a7962c3 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:24.460332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-58729086-8673-440c-bddb-60d36a7962c3 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lazy-loading 'fault' on Instance uuid 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:44:24.534393 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-58729086-8673-440c-bddb-60d36a7962c3 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4719c5630b42c6b6d180255db3a202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03901d3dd7b42a4816399ae4896b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:44:24.542731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5b0e68d1-8a5c-49e3-9579-bdc5b0c00c22 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:24.543207 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-58729086-8673-440c-bddb-60d36a7962c3 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 200 len: 1388 microversion: 2.1 time: 0.163670 May 21 21:44:24.543560 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2862/5848] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:24 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 1388 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:44:24.544834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5b0e68d1-8a5c-49e3-9579-bdc5b0c00c22 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 812a8ad7-8714-40c5-8243-ea20fbe816df] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:24.561707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b0e68d1-8a5c-49e3-9579-bdc5b0c00c22 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:24.563803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b0e68d1-8a5c-49e3-9579-bdc5b0c00c22 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:24.564833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b0e68d1-8a5c-49e3-9579-bdc5b0c00c22 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:24.566109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b0e68d1-8a5c-49e3-9579-bdc5b0c00c22 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:24.662235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5b0e68d1-8a5c-49e3-9579-bdc5b0c00c22 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:44:24.677059 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5b0e68d1-8a5c-49e3-9579-bdc5b0c00c22 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df" status: 200 len: 1270 microversion: 2.1 time: 0.142383 May 21 21:44:24.689876 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2987/5849] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:24 2022] GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:44:25.572405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-38630fac-b8f5-4bca-be89-bdbefd02831c tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:25.573955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-38630fac-b8f5-4bca-be89-bdbefd02831c tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:25.581263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38630fac-b8f5-4bca-be89-bdbefd02831c tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:25.581720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38630fac-b8f5-4bca-be89-bdbefd02831c tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:25.582740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38630fac-b8f5-4bca-be89-bdbefd02831c tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:25.583212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-38630fac-b8f5-4bca-be89-bdbefd02831c tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:25.599060 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-38630fac-b8f5-4bca-be89-bdbefd02831c tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] HTTP exception thrown: Instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 could not be found. May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-38630fac-b8f5-4bca-be89-bdbefd02831c tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Request method failure captured: May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 HTTP/1.1 May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVv16oPmVxiUHiyYJAiHP9LNSnRXVsQ8WCI5gvnpJlKArlRNwzcnC3RIaThv_MH3Z1kbS1fmHOsMbIW_Xcc7_wJKz1Tw8nxr7broDgw64dJ35EqXECUeUAq1upUMR9yaGBhmqr08QtKk0Vo_ESDhpYKI-tnu22SyBYxkfHMe9QxmpEU May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: c03901d3dd7b42a4816399ae4896b506 May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestServerBasicOps-411183175 May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c03901d3dd7b42a4816399ae4896b506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c03901d3dd7b42a4816399ae4896b506"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c03901d3dd7b42a4816399ae4896b506", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c03901d3dd7b42a4816399ae4896b506"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestServerBasicOps-411183175 May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: c03901d3dd7b42a4816399ae4896b506 May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestServerBasicOps-411183175 May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestServerBasicOps-411183175-project May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: fd4719c5630b42c6b6d180255db3a202 May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestServerBasicOps-411183175-project May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 could not be found. May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '490c94b0-b64f-4b74-90d2-a6972c6bd8a5'} May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 could not be found. May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 could not be found. May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:44:25.600892 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:25.605457 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:25.605457 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:44:25.605457 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:44:25.605457 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:44:25.605457 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:44:25.605457 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 could not be found. May 21 21:44:25.605457 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:25.605457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-38630fac-b8f5-4bca-be89-bdbefd02831c tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Returning 404 to user: Instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:44:25.605457 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-38630fac-b8f5-4bca-be89-bdbefd02831c tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 404 len: 111 microversion: 2.1 time: 0.035440 May 21 21:44:25.605457 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2863/5850] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:25 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:44:25.697785 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b56182fd-120c-498c-a5cd-bd4b1203051d tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:25.699390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b56182fd-120c-498c-a5cd-bd4b1203051d tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 812a8ad7-8714-40c5-8243-ea20fbe816df] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:25.713237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b56182fd-120c-498c-a5cd-bd4b1203051d tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:25.715868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b56182fd-120c-498c-a5cd-bd4b1203051d tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:25.716909 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b56182fd-120c-498c-a5cd-bd4b1203051d tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:25.717545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b56182fd-120c-498c-a5cd-bd4b1203051d tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:25.860878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b56182fd-120c-498c-a5cd-bd4b1203051d tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:44:25.891534 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b56182fd-120c-498c-a5cd-bd4b1203051d tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df" status: 200 len: 1276 microversion: 2.1 time: 0.199358 May 21 21:44:25.896913 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2988/5851] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:25 2022] GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df => generated 1276 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:44:26.527971 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d0db6cbc-f169-4ed2-90b2-a94b874a5ee9 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:26.529416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d0db6cbc-f169-4ed2-90b2-a94b874a5ee9 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:26.544149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0db6cbc-f169-4ed2-90b2-a94b874a5ee9 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:26.544946 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0db6cbc-f169-4ed2-90b2-a94b874a5ee9 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:26.545847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0db6cbc-f169-4ed2-90b2-a94b874a5ee9 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:26.546399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0db6cbc-f169-4ed2-90b2-a94b874a5ee9 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:26.569173 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-d0db6cbc-f169-4ed2-90b2-a94b874a5ee9 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] HTTP exception thrown: Instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 could not be found. May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d0db6cbc-f169-4ed2-90b2-a94b874a5ee9 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Request method failure captured: May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 HTTP/1.1 May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVv16oPmVxiUHiyYJAiHP9LNSnRXVsQ8WCI5gvnpJlKArlRNwzcnC3RIaThv_MH3Z1kbS1fmHOsMbIW_Xcc7_wJKz1Tw8nxr7broDgw64dJ35EqXECUeUAq1upUMR9yaGBhmqr08QtKk0Vo_ESDhpYKI-tnu22SyBYxkfHMe9QxmpEU May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: c03901d3dd7b42a4816399ae4896b506 May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestServerBasicOps-411183175 May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c03901d3dd7b42a4816399ae4896b506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c03901d3dd7b42a4816399ae4896b506"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c03901d3dd7b42a4816399ae4896b506", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c03901d3dd7b42a4816399ae4896b506"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestServerBasicOps-411183175 May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: c03901d3dd7b42a4816399ae4896b506 May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestServerBasicOps-411183175 May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestServerBasicOps-411183175-project May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: fd4719c5630b42c6b6d180255db3a202 May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestServerBasicOps-411183175-project May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 could not be found. May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '490c94b0-b64f-4b74-90d2-a6972c6bd8a5'} May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 could not be found. May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:44:26.576561 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 could not be found. May 21 21:44:26.582773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:26.582773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:44:26.582773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:26.582773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:26.582773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:44:26.582773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:44:26.582773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:44:26.582773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:44:26.582773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 could not be found. May 21 21:44:26.582773 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:26.589693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d0db6cbc-f169-4ed2-90b2-a94b874a5ee9 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Returning 404 to user: Instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:44:26.591067 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d0db6cbc-f169-4ed2-90b2-a94b874a5ee9 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "DELETE /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 404 len: 111 microversion: 2.1 time: 0.069041 May 21 21:44:26.600941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3b3cb6d0-6466-467b-9517-15097a96fe9f tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:26.604670 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3b3cb6d0-6466-467b-9517-15097a96fe9f tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] [instance: 490c94b0-b64f-4b74-90d2-a6972c6bd8a5] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:26.606248 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2864/5852] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:44:26 2022] DELETE /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:44:26.613999 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b3cb6d0-6466-467b-9517-15097a96fe9f tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:26.614850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b3cb6d0-6466-467b-9517-15097a96fe9f tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:26.616584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b3cb6d0-6466-467b-9517-15097a96fe9f tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:26.617367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b3cb6d0-6466-467b-9517-15097a96fe9f tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:26.639509 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-3b3cb6d0-6466-467b-9517-15097a96fe9f tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] HTTP exception thrown: Instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 could not be found. May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3b3cb6d0-6466-467b-9517-15097a96fe9f tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Request method failure captured: May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 HTTP/1.1 May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVv16oPmVxiUHiyYJAiHP9LNSnRXVsQ8WCI5gvnpJlKArlRNwzcnC3RIaThv_MH3Z1kbS1fmHOsMbIW_Xcc7_wJKz1Tw8nxr7broDgw64dJ35EqXECUeUAq1upUMR9yaGBhmqr08QtKk0Vo_ESDhpYKI-tnu22SyBYxkfHMe9QxmpEU May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: c03901d3dd7b42a4816399ae4896b506 May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-TestServerBasicOps-411183175 May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c03901d3dd7b42a4816399ae4896b506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c03901d3dd7b42a4816399ae4896b506"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c03901d3dd7b42a4816399ae4896b506", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c03901d3dd7b42a4816399ae4896b506"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-TestServerBasicOps-411183175 May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: c03901d3dd7b42a4816399ae4896b506 May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-TestServerBasicOps-411183175 May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-TestServerBasicOps-411183175-project May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: fd4719c5630b42c6b6d180255db3a202 May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-TestServerBasicOps-411183175-project May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 could not be found. May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '490c94b0-b64f-4b74-90d2-a6972c6bd8a5'} May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 could not be found. May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 could not be found. May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:44:26.642524 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:44:26.652872 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:26.652872 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:44:26.652872 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:44:26.652872 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:44:26.652872 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:44:26.652872 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 could not be found. May 21 21:44:26.652872 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:44:26.652872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3b3cb6d0-6466-467b-9517-15097a96fe9f tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Returning 404 to user: Instance 490c94b0-b64f-4b74-90d2-a6972c6bd8a5 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:44:26.652872 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3b3cb6d0-6466-467b-9517-15097a96fe9f tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5" status: 404 len: 111 microversion: 2.1 time: 0.054996 May 21 21:44:26.652872 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2989/5853] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:26 2022] GET /compute/v2.1/servers/490c94b0-b64f-4b74-90d2-a6972c6bd8a5 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:44:26.919793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9867c7c2-0702-46cf-96d1-9be2008657ed tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:26.922000 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9867c7c2-0702-46cf-96d1-9be2008657ed tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 812a8ad7-8714-40c5-8243-ea20fbe816df] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:26.939302 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9867c7c2-0702-46cf-96d1-9be2008657ed tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:26.942942 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9867c7c2-0702-46cf-96d1-9be2008657ed tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:26.944094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9867c7c2-0702-46cf-96d1-9be2008657ed tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:26.947572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9867c7c2-0702-46cf-96d1-9be2008657ed tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:27.086456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f7541546-59ff-4730-a495-47d9f37839a8 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] Calling method '.version_select at 0x7fc81a3b2430>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:27.170747 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9867c7c2-0702-46cf-96d1-9be2008657ed tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:44:27.180868 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9867c7c2-0702-46cf-96d1-9be2008657ed tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df" status: 200 len: 1318 microversion: 2.1 time: 0.268398 May 21 21:44:27.182177 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2865/5854] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:26 2022] GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:44:27.191852 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f7541546-59ff-4730-a495-47d9f37839a8 tempest-TestServerBasicOps-411183175 tempest-TestServerBasicOps-411183175-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-451792469" status: 202 len: 0 microversion: 2.1 time: 0.099957 May 21 21:44:27.193306 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2990/5855] 10.222.0.49 () {58 vars in 1250 bytes} [Sat May 21 21:44:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-451792469 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:44:28.200762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7d1388ec-4874-42d4-b88d-530ca605e4c7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:28.201294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7d1388ec-4874-42d4-b88d-530ca605e4c7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 812a8ad7-8714-40c5-8243-ea20fbe816df] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:28.219551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7d1388ec-4874-42d4-b88d-530ca605e4c7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:28.219551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7d1388ec-4874-42d4-b88d-530ca605e4c7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:28.220848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7d1388ec-4874-42d4-b88d-530ca605e4c7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:28.221723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7d1388ec-4874-42d4-b88d-530ca605e4c7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:28.787945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7d1388ec-4874-42d4-b88d-530ca605e4c7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:44:28.798044 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7d1388ec-4874-42d4-b88d-530ca605e4c7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df" status: 200 len: 1318 microversion: 2.1 time: 0.600666 May 21 21:44:28.798044 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2866/5856] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:28 2022] GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df => generated 1318 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:44:29.210193 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-2f1823a4-7f71-4589-b0ed-afe38a9b3b06 req-29ae8b89-9157-4ec1-88f3-0b6a7cde8974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "812a8ad7-8714-40c5-8243-ea20fbe816df", "tag": "2221f4ea-6972-40c5-b498-570c625a4495"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:44:29.222253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2f1823a4-7f71-4589-b0ed-afe38a9b3b06 req-29ae8b89-9157-4ec1-88f3-0b6a7cde8974 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:29.223201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2f1823a4-7f71-4589-b0ed-afe38a9b3b06 req-29ae8b89-9157-4ec1-88f3-0b6a7cde8974 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:29.234729 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-2f1823a4-7f71-4589-b0ed-afe38a9b3b06 req-29ae8b89-9157-4ec1-88f3-0b6a7cde8974 service nova] Creating event network-changed:2221f4ea-6972-40c5-b498-570c625a4495 for instance 812a8ad7-8714-40c5-8243-ea20fbe816df on nch1-master-1 May 21 21:44:29.240219 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-2f1823a4-7f71-4589-b0ed-afe38a9b3b06 req-29ae8b89-9157-4ec1-88f3-0b6a7cde8974 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211545 May 21 21:44:29.244262 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2991/5857] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:44:29.821062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2b55bfe3-1769-4d57-807a-740c6eadbe8e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:29.825836 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2b55bfe3-1769-4d57-807a-740c6eadbe8e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 812a8ad7-8714-40c5-8243-ea20fbe816df] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:29.844349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b55bfe3-1769-4d57-807a-740c6eadbe8e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:29.844349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b55bfe3-1769-4d57-807a-740c6eadbe8e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:29.844349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b55bfe3-1769-4d57-807a-740c6eadbe8e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:29.845675 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b55bfe3-1769-4d57-807a-740c6eadbe8e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:30.097765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2b55bfe3-1769-4d57-807a-740c6eadbe8e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:44:30.106824 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2b55bfe3-1769-4d57-807a-740c6eadbe8e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df" status: 200 len: 1318 microversion: 2.1 time: 0.295120 May 21 21:44:30.107412 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2867/5858] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:29 2022] GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:44:31.125771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-06f5696c-52b5-46fa-8f3e-76ff93d8a85c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:31.126739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-06f5696c-52b5-46fa-8f3e-76ff93d8a85c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 812a8ad7-8714-40c5-8243-ea20fbe816df] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:31.134992 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06f5696c-52b5-46fa-8f3e-76ff93d8a85c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:31.135478 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06f5696c-52b5-46fa-8f3e-76ff93d8a85c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:31.136268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06f5696c-52b5-46fa-8f3e-76ff93d8a85c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:31.137129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06f5696c-52b5-46fa-8f3e-76ff93d8a85c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:31.930121 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-06f5696c-52b5-46fa-8f3e-76ff93d8a85c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:44:31.943536 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-06f5696c-52b5-46fa-8f3e-76ff93d8a85c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df" status: 200 len: 1318 microversion: 2.1 time: 0.822994 May 21 21:44:31.944135 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2992/5859] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:31 2022] GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df => generated 1318 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:44:32.969409 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ef27f0cd-9fff-4de7-a55a-3830564a7239 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:32.970728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ef27f0cd-9fff-4de7-a55a-3830564a7239 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 812a8ad7-8714-40c5-8243-ea20fbe816df] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:32.979092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:44:32.982113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef27f0cd-9fff-4de7-a55a-3830564a7239 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:32.982113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef27f0cd-9fff-4de7-a55a-3830564a7239 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:32.983201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef27f0cd-9fff-4de7-a55a-3830564a7239 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:32.983894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ef27f0cd-9fff-4de7-a55a-3830564a7239 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:33.214116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ef27f0cd-9fff-4de7-a55a-3830564a7239 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:44:33.228926 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ef27f0cd-9fff-4de7-a55a-3830564a7239 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df" status: 200 len: 1318 microversion: 2.1 time: 0.264576 May 21 21:44:33.229754 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2868/5860] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:32 2022] GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:44:34.249592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8425842f-a0be-42a2-b55c-3d1db75965b6 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:34.251289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8425842f-a0be-42a2-b55c-3d1db75965b6 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 812a8ad7-8714-40c5-8243-ea20fbe816df] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:34.254815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:44:34.258011 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=8 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:44:34.261495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8425842f-a0be-42a2-b55c-3d1db75965b6 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:34.262119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8425842f-a0be-42a2-b55c-3d1db75965b6 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:34.263031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8425842f-a0be-42a2-b55c-3d1db75965b6 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:34.263556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8425842f-a0be-42a2-b55c-3d1db75965b6 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:34.274364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-7708d6b7-bb74-4769-bea3-cfbf6081590f req-b71f3df2-9d5c-4797-b1d4-37f7bbaacdac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812a8ad7-8714-40c5-8243-ea20fbe816df", "name": "network-vif-plugged", "status": "completed", "tag": "2221f4ea-6972-40c5-b498-570c625a4495"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:44:34.305063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-7708d6b7-bb74-4769-bea3-cfbf6081590f req-b71f3df2-9d5c-4797-b1d4-37f7bbaacdac service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:34.305063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-7708d6b7-bb74-4769-bea3-cfbf6081590f req-b71f3df2-9d5c-4797-b1d4-37f7bbaacdac service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:34.331995 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-7708d6b7-bb74-4769-bea3-cfbf6081590f req-b71f3df2-9d5c-4797-b1d4-37f7bbaacdac service nova] Creating event network-vif-plugged:2221f4ea-6972-40c5-b498-570c625a4495 for instance 812a8ad7-8714-40c5-8243-ea20fbe816df on nch1-master-1 May 21 21:44:34.345819 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-7708d6b7-bb74-4769-bea3-cfbf6081590f req-b71f3df2-9d5c-4797-b1d4-37f7bbaacdac service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077301 May 21 21:44:34.353385 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2869/5861] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:44:34.705756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8425842f-a0be-42a2-b55c-3d1db75965b6 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:44:34.714442 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8425842f-a0be-42a2-b55c-3d1db75965b6 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df" status: 200 len: 1318 microversion: 2.1 time: 0.470384 May 21 21:44:34.715034 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2993/5862] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:34 2022] GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:44:35.733749 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-94d3865f-1767-421a-bf0b-955c5d61a745 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:35.735057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-94d3865f-1767-421a-bf0b-955c5d61a745 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 812a8ad7-8714-40c5-8243-ea20fbe816df] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:35.742318 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94d3865f-1767-421a-bf0b-955c5d61a745 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:35.744038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94d3865f-1767-421a-bf0b-955c5d61a745 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:35.746048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94d3865f-1767-421a-bf0b-955c5d61a745 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:35.746707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94d3865f-1767-421a-bf0b-955c5d61a745 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:36.078142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-94d3865f-1767-421a-bf0b-955c5d61a745 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:44:36.086924 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-94d3865f-1767-421a-bf0b-955c5d61a745 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df" status: 200 len: 1318 microversion: 2.1 time: 0.358731 May 21 21:44:36.087967 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2870/5863] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:35 2022] GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:44:37.105599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1263b95a-720b-4c50-bfc7-b0091071de18 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:37.107203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1263b95a-720b-4c50-bfc7-b0091071de18 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 812a8ad7-8714-40c5-8243-ea20fbe816df] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:37.116266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1263b95a-720b-4c50-bfc7-b0091071de18 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:37.117061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1263b95a-720b-4c50-bfc7-b0091071de18 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:37.117873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1263b95a-720b-4c50-bfc7-b0091071de18 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:37.118330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1263b95a-720b-4c50-bfc7-b0091071de18 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:37.396582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1263b95a-720b-4c50-bfc7-b0091071de18 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:44:37.411239 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1263b95a-720b-4c50-bfc7-b0091071de18 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df" status: 200 len: 1507 microversion: 2.1 time: 0.310264 May 21 21:44:37.433235 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2994/5864] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:37 2022] GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df => generated 1507 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:44:43.971296 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:43.971802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:43.979721 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:43.980173 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:43.980971 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:43.981408 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:44.010313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:44:44.334067 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 204 len: 0 microversion: 2.1 time: 0.366382 May 21 21:44:44.335863 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2871/5865] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:44:43 2022] DELETE /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:44:44.344381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7c1e5869-412e-46e6-b40c-6ad3ceceb977 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:44.350319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7c1e5869-412e-46e6-b40c-6ad3ceceb977 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:44.359945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c1e5869-412e-46e6-b40c-6ad3ceceb977 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:44.360696 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c1e5869-412e-46e6-b40c-6ad3ceceb977 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:44.361803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c1e5869-412e-46e6-b40c-6ad3ceceb977 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:44.362424 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7c1e5869-412e-46e6-b40c-6ad3ceceb977 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:44.587984 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7c1e5869-412e-46e6-b40c-6ad3ceceb977 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:44:44.596013 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7c1e5869-412e-46e6-b40c-6ad3ceceb977 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 200 len: 1407 microversion: 2.1 time: 0.255608 May 21 21:44:44.596619 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2995/5866] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:44 2022] GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:44:45.614418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-55515915-dd60-4d0b-b3d5-8327f5fedf46 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:45.615140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-55515915-dd60-4d0b-b3d5-8327f5fedf46 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:45.622621 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-55515915-dd60-4d0b-b3d5-8327f5fedf46 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:45.623122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-55515915-dd60-4d0b-b3d5-8327f5fedf46 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:45.624060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-55515915-dd60-4d0b-b3d5-8327f5fedf46 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:45.624531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-55515915-dd60-4d0b-b3d5-8327f5fedf46 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:45.778989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-55515915-dd60-4d0b-b3d5-8327f5fedf46 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:44:45.787738 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-55515915-dd60-4d0b-b3d5-8327f5fedf46 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 200 len: 1407 microversion: 2.1 time: 0.177565 May 21 21:44:45.798363 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2872/5867] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:45 2022] GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:44:45.821817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-93bbdf6f-6ebb-4894-9aa7-da25dfdf6c1c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0073fe3d-0903-4f84-8e07-7e6bd96bbf32", "device": "/dev/sdb"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:44:45.823116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-93bbdf6f-6ebb-4894-9aa7-da25dfdf6c1c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 812a8ad7-8714-40c5-8243-ea20fbe816df] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:45.830279 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-93bbdf6f-6ebb-4894-9aa7-da25dfdf6c1c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:45.830753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-93bbdf6f-6ebb-4894-9aa7-da25dfdf6c1c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:45.831552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-93bbdf6f-6ebb-4894-9aa7-da25dfdf6c1c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:45.832119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-93bbdf6f-6ebb-4894-9aa7-da25dfdf6c1c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:46.591644 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-93bbdf6f-6ebb-4894-9aa7-da25dfdf6c1c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "POST /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.774343 May 21 21:44:46.592373 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2996/5868] 10.222.0.49 () {60 vars in 1322 bytes} [Sat May 21 21:44:45 2022] POST /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df/os-volume_attachments => generated 194 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:44:46.806294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-345306da-29fe-409a-945d-dc2bb06e5508 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:46.806969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-345306da-29fe-409a-945d-dc2bb06e5508 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:46.810449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-be01d2cf-09be-4b39-9777-8febb49a2aeb req-868e9582-8bbb-481a-9fc3-ee16362a3acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c849176-2492-4527-89ed-9632fdb2a1b6", "name": "network-vif-deleted", "tag": "a2195ae9-33a1-4b3c-b593-c9c89fe3af77"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:44:46.814012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-345306da-29fe-409a-945d-dc2bb06e5508 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:46.822672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-345306da-29fe-409a-945d-dc2bb06e5508 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:46.822672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-345306da-29fe-409a-945d-dc2bb06e5508 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:46.822672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-345306da-29fe-409a-945d-dc2bb06e5508 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:46.823649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-be01d2cf-09be-4b39-9777-8febb49a2aeb req-868e9582-8bbb-481a-9fc3-ee16362a3acf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:46.824092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-be01d2cf-09be-4b39-9777-8febb49a2aeb req-868e9582-8bbb-481a-9fc3-ee16362a3acf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:46.841755 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-be01d2cf-09be-4b39-9777-8febb49a2aeb req-868e9582-8bbb-481a-9fc3-ee16362a3acf service nova] Creating event network-vif-deleted:a2195ae9-33a1-4b3c-b593-c9c89fe3af77 for instance 2c849176-2492-4527-89ed-9632fdb2a1b6 on nch1-master-1 May 21 21:44:46.847612 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-be01d2cf-09be-4b39-9777-8febb49a2aeb req-868e9582-8bbb-481a-9fc3-ee16362a3acf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050180 May 21 21:44:46.848822 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2873/5869] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:44:46.898495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-345306da-29fe-409a-945d-dc2bb06e5508 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:44:46.906581 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-345306da-29fe-409a-945d-dc2bb06e5508 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 200 len: 1365 microversion: 2.1 time: 0.105493 May 21 21:44:46.907173 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2997/5870] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:46 2022] GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 1365 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:44:47.925953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6f195ba7-f446-45ed-bc22-35b2241ba8ff tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:47.926808 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6f195ba7-f446-45ed-bc22-35b2241ba8ff tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:47.939145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f195ba7-f446-45ed-bc22-35b2241ba8ff tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:47.940274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f195ba7-f446-45ed-bc22-35b2241ba8ff tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:47.941106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f195ba7-f446-45ed-bc22-35b2241ba8ff tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:47.941552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f195ba7-f446-45ed-bc22-35b2241ba8ff tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:47.974620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f195ba7-f446-45ed-bc22-35b2241ba8ff tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:47.977800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f195ba7-f446-45ed-bc22-35b2241ba8ff tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:47.977800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-6f195ba7-f446-45ed-bc22-35b2241ba8ff tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lazy-loading 'fault' on Instance uuid 2c849176-2492-4527-89ed-9632fdb2a1b6 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:44:48.024404 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6f195ba7-f446-45ed-bc22-35b2241ba8ff tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:44:48.032237 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6f195ba7-f446-45ed-bc22-35b2241ba8ff tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 200 len: 1205 microversion: 2.1 time: 0.112098 May 21 21:44:48.032850 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2874/5871] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:47 2022] GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 1205 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:44:49.049783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d9aedd5d-b620-4df6-9193-873a4229600f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:49.050415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d9aedd5d-b620-4df6-9193-873a4229600f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:49.058232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d9aedd5d-b620-4df6-9193-873a4229600f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:49.058707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d9aedd5d-b620-4df6-9193-873a4229600f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:49.059551 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d9aedd5d-b620-4df6-9193-873a4229600f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:49.059956 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d9aedd5d-b620-4df6-9193-873a4229600f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:49.073701 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-d9aedd5d-b620-4df6-9193-873a4229600f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] HTTP exception thrown: Instance 2c849176-2492-4527-89ed-9632fdb2a1b6 could not be found. May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d9aedd5d-b620-4df6-9193-873a4229600f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Request method failure captured: May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 HTTP/1.1 May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVyb9roFCu9pnW6_pGv_nwgdhY8sEs_xi4xzjfpDmQYM_NB-BEWin4ww1-OB-8Ni8Qy5i-drXJJg6PZ5rgg6kLY2EzVB8CGkx9nUQjfPTlEOhCIPDxJkqBjIKr09mBAiVYVzwVkvD5WDNG25XAxQrBLXY2awCOo8K-DKCVfdi9UoZVs May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 8149564857f64342aef93f18c0d90eb1 May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-TestVolumeBootPattern-343249266 May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8149564857f64342aef93f18c0d90eb1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-TestVolumeBootPattern-343249266 May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 8149564857f64342aef93f18c0d90eb1 May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-TestVolumeBootPattern-343249266 May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-TestVolumeBootPattern-343249266-project May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 730839d5531644eb9aa26dabe2fbd8f6 May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-TestVolumeBootPattern-343249266-project May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 2c849176-2492-4527-89ed-9632fdb2a1b6 could not be found. May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '2c849176-2492-4527-89ed-9632fdb2a1b6'} May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c849176-2492-4527-89ed-9632fdb2a1b6 could not be found. May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c849176-2492-4527-89ed-9632fdb2a1b6 could not be found. May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:44:49.075383 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:44:49.080525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:49.080525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:44:49.080525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:44:49.080525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:44:49.080525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:44:49.080525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c849176-2492-4527-89ed-9632fdb2a1b6 could not be found. May 21 21:44:49.080525 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:44:49.080525 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d9aedd5d-b620-4df6-9193-873a4229600f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Returning 404 to user: Instance 2c849176-2492-4527-89ed-9632fdb2a1b6 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:44:49.080525 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d9aedd5d-b620-4df6-9193-873a4229600f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 404 len: 111 microversion: 2.1 time: 0.031292 May 21 21:44:49.080525 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2998/5872] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:49 2022] GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:44:56.473646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-58fdc132-45d7-4f0b-ac1c-944d817f7523 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:56.474228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-58fdc132-45d7-4f0b-ac1c-944d817f7523 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:56.479834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:44:56.482754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58fdc132-45d7-4f0b-ac1c-944d817f7523 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:56.483221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58fdc132-45d7-4f0b-ac1c-944d817f7523 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:56.484256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58fdc132-45d7-4f0b-ac1c-944d817f7523 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:56.484750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58fdc132-45d7-4f0b-ac1c-944d817f7523 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:56.488999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:44:56.498704 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-58fdc132-45d7-4f0b-ac1c-944d817f7523 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] HTTP exception thrown: Instance 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 could not be found. May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-58fdc132-45d7-4f0b-ac1c-944d817f7523 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Request method failure captured: May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 HTTP/1.1 May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVyb9roFCu9pnW6_pGv_nwgdhY8sEs_xi4xzjfpDmQYM_NB-BEWin4ww1-OB-8Ni8Qy5i-drXJJg6PZ5rgg6kLY2EzVB8CGkx9nUQjfPTlEOhCIPDxJkqBjIKr09mBAiVYVzwVkvD5WDNG25XAxQrBLXY2awCOo8K-DKCVfdi9UoZVs May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8149564857f64342aef93f18c0d90eb1 May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestVolumeBootPattern-343249266 May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8149564857f64342aef93f18c0d90eb1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestVolumeBootPattern-343249266 May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8149564857f64342aef93f18c0d90eb1 May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestVolumeBootPattern-343249266 May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestVolumeBootPattern-343249266-project May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 730839d5531644eb9aa26dabe2fbd8f6 May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestVolumeBootPattern-343249266-project May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 could not be found. May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2'} May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 could not be found. May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:44:56.502841 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:44:56.507478 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 could not be found. May 21 21:44:56.507478 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:56.507478 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:44:56.507478 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:56.507478 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:56.507478 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:44:56.507478 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:44:56.507478 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:44:56.507478 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:44:56.507478 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 could not be found. May 21 21:44:56.507478 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:56.507478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-58fdc132-45d7-4f0b-ac1c-944d817f7523 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Returning 404 to user: Instance 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:44:56.507478 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-58fdc132-45d7-4f0b-ac1c-944d817f7523 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 404 len: 111 microversion: 2.1 time: 0.032123 May 21 21:44:56.507478 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2875/5873] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:44:56 2022] DELETE /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:44:56.511061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-527cf48a-8882-4e5b-a089-c072a83dfbc2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:56.511697 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-527cf48a-8882-4e5b-a089-c072a83dfbc2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:56.515714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:44:56.519283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-527cf48a-8882-4e5b-a089-c072a83dfbc2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:56.519762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-527cf48a-8882-4e5b-a089-c072a83dfbc2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:56.520685 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-527cf48a-8882-4e5b-a089-c072a83dfbc2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:56.521164 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-527cf48a-8882-4e5b-a089-c072a83dfbc2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:56.523884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:44:56.536832 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-527cf48a-8882-4e5b-a089-c072a83dfbc2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] HTTP exception thrown: Instance 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 could not be found. May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-527cf48a-8882-4e5b-a089-c072a83dfbc2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Request method failure captured: May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 HTTP/1.1 May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVyb9roFCu9pnW6_pGv_nwgdhY8sEs_xi4xzjfpDmQYM_NB-BEWin4ww1-OB-8Ni8Qy5i-drXJJg6PZ5rgg6kLY2EzVB8CGkx9nUQjfPTlEOhCIPDxJkqBjIKr09mBAiVYVzwVkvD5WDNG25XAxQrBLXY2awCOo8K-DKCVfdi9UoZVs May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 8149564857f64342aef93f18c0d90eb1 May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-TestVolumeBootPattern-343249266 May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8149564857f64342aef93f18c0d90eb1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-TestVolumeBootPattern-343249266 May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 8149564857f64342aef93f18c0d90eb1 May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-TestVolumeBootPattern-343249266 May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-TestVolumeBootPattern-343249266-project May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 730839d5531644eb9aa26dabe2fbd8f6 May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-TestVolumeBootPattern-343249266-project May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 could not be found. May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2'} May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 could not be found. May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 could not be found. May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:44:56.538452 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:44:56.542740 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:56.542740 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:44:56.542740 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:44:56.542740 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:44:56.542740 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:44:56.542740 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 could not be found. May 21 21:44:56.542740 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:44:56.542740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-527cf48a-8882-4e5b-a089-c072a83dfbc2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Returning 404 to user: Instance 3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:44:56.542740 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-527cf48a-8882-4e5b-a089-c072a83dfbc2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2" status: 404 len: 111 microversion: 2.1 time: 0.033263 May 21 21:44:56.542740 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 2999/5874] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:56 2022] GET /compute/v2.1/servers/3cf0370f-f7f6-4e6a-b02f-c5601a7df6a2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:44:57.527833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4f8f25aa-2883-4daa-b656-678d9d72ec38 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:57.528383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4f8f25aa-2883-4daa-b656-678d9d72ec38 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:57.537477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f8f25aa-2883-4daa-b656-678d9d72ec38 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:57.537945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f8f25aa-2883-4daa-b656-678d9d72ec38 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:57.538732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f8f25aa-2883-4daa-b656-678d9d72ec38 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:57.539183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f8f25aa-2883-4daa-b656-678d9d72ec38 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:57.555064 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-4f8f25aa-2883-4daa-b656-678d9d72ec38 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] HTTP exception thrown: Instance 2c849176-2492-4527-89ed-9632fdb2a1b6 could not be found. May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4f8f25aa-2883-4daa-b656-678d9d72ec38 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Request method failure captured: May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 HTTP/1.1 May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVyb9roFCu9pnW6_pGv_nwgdhY8sEs_xi4xzjfpDmQYM_NB-BEWin4ww1-OB-8Ni8Qy5i-drXJJg6PZ5rgg6kLY2EzVB8CGkx9nUQjfPTlEOhCIPDxJkqBjIKr09mBAiVYVzwVkvD5WDNG25XAxQrBLXY2awCOo8K-DKCVfdi9UoZVs May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8149564857f64342aef93f18c0d90eb1 May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestVolumeBootPattern-343249266 May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8149564857f64342aef93f18c0d90eb1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestVolumeBootPattern-343249266 May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8149564857f64342aef93f18c0d90eb1 May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestVolumeBootPattern-343249266 May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestVolumeBootPattern-343249266-project May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 730839d5531644eb9aa26dabe2fbd8f6 May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestVolumeBootPattern-343249266-project May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 2c849176-2492-4527-89ed-9632fdb2a1b6 could not be found. May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '2c849176-2492-4527-89ed-9632fdb2a1b6'} May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c849176-2492-4527-89ed-9632fdb2a1b6 could not be found. May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:44:57.556891 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:44:57.562777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c849176-2492-4527-89ed-9632fdb2a1b6 could not be found. May 21 21:44:57.562777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:57.562777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:44:57.562777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:57.562777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:57.562777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:44:57.562777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:44:57.562777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:44:57.562777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:44:57.562777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c849176-2492-4527-89ed-9632fdb2a1b6 could not be found. May 21 21:44:57.562777 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:44:57.562777 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4f8f25aa-2883-4daa-b656-678d9d72ec38 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Returning 404 to user: Instance 2c849176-2492-4527-89ed-9632fdb2a1b6 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:44:57.562777 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4f8f25aa-2883-4daa-b656-678d9d72ec38 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 404 len: 111 microversion: 2.1 time: 0.035354 May 21 21:44:57.562777 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2876/5875] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:44:57 2022] DELETE /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:44:57.568008 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1dfa13f3-2e97-4f03-bf1f-7d9d8f800367 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:44:57.568670 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1dfa13f3-2e97-4f03-bf1f-7d9d8f800367 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: 2c849176-2492-4527-89ed-9632fdb2a1b6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:44:57.576397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dfa13f3-2e97-4f03-bf1f-7d9d8f800367 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:57.576759 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dfa13f3-2e97-4f03-bf1f-7d9d8f800367 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:57.577574 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dfa13f3-2e97-4f03-bf1f-7d9d8f800367 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:44:57.578129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1dfa13f3-2e97-4f03-bf1f-7d9d8f800367 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:44:57.593047 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-1dfa13f3-2e97-4f03-bf1f-7d9d8f800367 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] HTTP exception thrown: Instance 2c849176-2492-4527-89ed-9632fdb2a1b6 could not be found. May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1dfa13f3-2e97-4f03-bf1f-7d9d8f800367 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Request method failure captured: May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 HTTP/1.1 May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVyb9roFCu9pnW6_pGv_nwgdhY8sEs_xi4xzjfpDmQYM_NB-BEWin4ww1-OB-8Ni8Qy5i-drXJJg6PZ5rgg6kLY2EzVB8CGkx9nUQjfPTlEOhCIPDxJkqBjIKr09mBAiVYVzwVkvD5WDNG25XAxQrBLXY2awCOo8K-DKCVfdi9UoZVs May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 8149564857f64342aef93f18c0d90eb1 May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-TestVolumeBootPattern-343249266 May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8149564857f64342aef93f18c0d90eb1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-TestVolumeBootPattern-343249266 May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 8149564857f64342aef93f18c0d90eb1 May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-TestVolumeBootPattern-343249266 May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-TestVolumeBootPattern-343249266-project May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 730839d5531644eb9aa26dabe2fbd8f6 May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-TestVolumeBootPattern-343249266-project May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 2c849176-2492-4527-89ed-9632fdb2a1b6 could not be found. May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '2c849176-2492-4527-89ed-9632fdb2a1b6'} May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c849176-2492-4527-89ed-9632fdb2a1b6 could not be found. May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c849176-2492-4527-89ed-9632fdb2a1b6 could not be found. May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:44:57.594693 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:44:57.598698 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:44:57.598698 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:44:57.598698 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:44:57.598698 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:44:57.598698 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:44:57.598698 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c849176-2492-4527-89ed-9632fdb2a1b6 could not be found. May 21 21:44:57.598698 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:44:57.598698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1dfa13f3-2e97-4f03-bf1f-7d9d8f800367 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Returning 404 to user: Instance 2c849176-2492-4527-89ed-9632fdb2a1b6 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:44:57.598698 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1dfa13f3-2e97-4f03-bf1f-7d9d8f800367 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6" status: 404 len: 111 microversion: 2.1 time: 0.032913 May 21 21:44:57.598698 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3000/5876] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:44:57 2022] GET /compute/v2.1/servers/2c849176-2492-4527-89ed-9632fdb2a1b6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:44:57.677971 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-154f3717-9052-4a3d-81c6-2e24e60ee13c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Action: 'create', calling method: .version_select at 0x7fc819d13550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1881011435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNazvTa7943hZvC/PbvoII7YkkUtl7aiOyczLg0P7jo0nyYkN+kjgfLYeU7rHeCtpSC99CI3yMviKnJXyU/hjks+M94PkksZxdceeVOS61emXsTGHKQVCmvsaRmpHRpQA=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:44:57.693886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-154f3717-9052-4a3d-81c6-2e24e60ee13c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Getting quotas for project 8149564857f64342aef93f18c0d90eb1. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:44:57.699267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-154f3717-9052-4a3d-81c6-2e24e60ee13c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Getting quotas for user 730839d5531644eb9aa26dabe2fbd8f6 and project 8149564857f64342aef93f18c0d90eb1. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:44:57.714349 ncdv-master-1 devstack@n-api.service[131278]: ERROR oslo.messaging._drivers.impl_rabbit [None req-154f3717-9052-4a3d-81c6-2e24e60ee13c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [757ee1d9-e142-49b6-8af4-504059748295] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 21 21:44:58.721685 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [None req-154f3717-9052-4a3d-81c6-2e24e60ee13c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [757ee1d9-e142-49b6-8af4-504059748295] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 56710. May 21 21:44:58.850428 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-154f3717-9052-4a3d-81c6-2e24e60ee13c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.177474 May 21 21:44:58.851169 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2877/5877] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:44:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:45:07.770686 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d4066eff-58f1-438b-b1c9-7828d55248e0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1342193469", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1881011435", "security_groups": [{"name": "tempest-secgroup-smoke-1166015804"}], "block_device_mapping_v2": [{"uuid": "0e7a744e-a92c-4fa2-bdf3-fe7de7654651", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8f8d42c3-82dd-4a20-aef1-3a31892db1cf"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:45:07.907057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-d4066eff-58f1-438b-b1c9-7828d55248e0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] validate_networks() for [('8f8d42c3-82dd-4a20-aef1-3a31892db1cf', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:45:08.406217 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-d4066eff-58f1-438b-b1c9-7828d55248e0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:45:08.406664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-d4066eff-58f1-438b-b1c9-7828d55248e0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:45:08.407168 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-d4066eff-58f1-438b-b1c9-7828d55248e0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:45:08.407598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-d4066eff-58f1-438b-b1c9-7828d55248e0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:45:08.408030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-d4066eff-58f1-438b-b1c9-7828d55248e0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:45:08.417690 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d4066eff-58f1-438b-b1c9-7828d55248e0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:08.418171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d4066eff-58f1-438b-b1c9-7828d55248e0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:08.418999 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d4066eff-58f1-438b-b1c9-7828d55248e0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:08.419459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d4066eff-58f1-438b-b1c9-7828d55248e0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:08.437898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-d4066eff-58f1-438b-b1c9-7828d55248e0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Getting quotas for project 8149564857f64342aef93f18c0d90eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:45:08.443447 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-d4066eff-58f1-438b-b1c9-7828d55248e0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Getting quotas for user 730839d5531644eb9aa26dabe2fbd8f6 and project 8149564857f64342aef93f18c0d90eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:45:08.508311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d4066eff-58f1-438b-b1c9-7828d55248e0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:45:08.510479 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d4066eff-58f1-438b-b1c9-7828d55248e0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0e7a744e-a92c-4fa2-bdf3-fe7de7654651',volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:45:08.899055 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d4066eff-58f1-438b-b1c9-7828d55248e0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.132245 May 21 21:45:08.900163 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3001/5878] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:45:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:45:08.910370 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0521ba0a-765c-4cad-9c43-248f5412d64f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:08.910987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0521ba0a-765c-4cad-9c43-248f5412d64f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:08.914964 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:45:08.916022 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:45:08.916677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:45:08.991345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0521ba0a-765c-4cad-9c43-248f5412d64f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:09.001153 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0521ba0a-765c-4cad-9c43-248f5412d64f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d" status: 200 len: 1095 microversion: 2.1 time: 0.094538 May 21 21:45:09.001734 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2878/5879] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:08 2022] GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d => generated 1095 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:10.018368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3f447286-0f33-4bf2-a28d-aae0f790077d tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:10.019006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3f447286-0f33-4bf2-a28d-aae0f790077d tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:10.026956 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f447286-0f33-4bf2-a28d-aae0f790077d tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:10.027515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f447286-0f33-4bf2-a28d-aae0f790077d tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:10.028228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f447286-0f33-4bf2-a28d-aae0f790077d tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:10.028710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f447286-0f33-4bf2-a28d-aae0f790077d tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:10.101124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3f447286-0f33-4bf2-a28d-aae0f790077d tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:10.110430 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3f447286-0f33-4bf2-a28d-aae0f790077d tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d" status: 200 len: 1145 microversion: 2.1 time: 0.096017 May 21 21:45:10.111080 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3002/5880] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:10 2022] GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d => generated 1145 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:11.128546 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d22c3b4a-e88f-43d7-a42b-5e423dded90c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:11.129150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d22c3b4a-e88f-43d7-a42b-5e423dded90c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:11.138689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d22c3b4a-e88f-43d7-a42b-5e423dded90c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:11.138907 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d22c3b4a-e88f-43d7-a42b-5e423dded90c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:11.139694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d22c3b4a-e88f-43d7-a42b-5e423dded90c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:11.140140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d22c3b4a-e88f-43d7-a42b-5e423dded90c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:11.233317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d22c3b4a-e88f-43d7-a42b-5e423dded90c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:11.244005 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d22c3b4a-e88f-43d7-a42b-5e423dded90c tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d" status: 200 len: 1201 microversion: 2.1 time: 0.119738 May 21 21:45:11.248131 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2879/5881] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:11 2022] GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d => generated 1201 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:12.265788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-be3f80c5-61ac-41e8-9e44-248d2df5a851 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:12.266418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-be3f80c5-61ac-41e8-9e44-248d2df5a851 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:12.274501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be3f80c5-61ac-41e8-9e44-248d2df5a851 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:12.275321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be3f80c5-61ac-41e8-9e44-248d2df5a851 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:12.276326 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be3f80c5-61ac-41e8-9e44-248d2df5a851 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:12.276846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-be3f80c5-61ac-41e8-9e44-248d2df5a851 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:12.509523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-be3f80c5-61ac-41e8-9e44-248d2df5a851 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:12.519107 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-be3f80c5-61ac-41e8-9e44-248d2df5a851 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d" status: 200 len: 1279 microversion: 2.1 time: 0.257863 May 21 21:45:12.519716 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3003/5882] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:12 2022] GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d => generated 1279 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:13.380689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-4b8a371d-04e1-4479-b8a7-904865ba8efd req-0e4ec2f5-03cb-4681-b9d6-ab3e3ea7ff3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca5309cd-f1d9-43de-afd7-808a2879de1d", "tag": "4ca581b3-4eeb-4848-bdd6-e64e1e8729d2"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:45:13.395331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4b8a371d-04e1-4479-b8a7-904865ba8efd req-0e4ec2f5-03cb-4681-b9d6-ab3e3ea7ff3f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:13.396022 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4b8a371d-04e1-4479-b8a7-904865ba8efd req-0e4ec2f5-03cb-4681-b9d6-ab3e3ea7ff3f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:13.418796 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-4b8a371d-04e1-4479-b8a7-904865ba8efd req-0e4ec2f5-03cb-4681-b9d6-ab3e3ea7ff3f service nova] Creating event network-changed:4ca581b3-4eeb-4848-bdd6-e64e1e8729d2 for instance ca5309cd-f1d9-43de-afd7-808a2879de1d on nch2-master-1 May 21 21:45:13.433664 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-4b8a371d-04e1-4479-b8a7-904865ba8efd req-0e4ec2f5-03cb-4681-b9d6-ab3e3ea7ff3f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059040 May 21 21:45:13.434652 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2880/5883] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:45:13.537336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7557f911-fdec-42f3-b60c-de8ae8555775 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:13.537987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7557f911-fdec-42f3-b60c-de8ae8555775 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:13.553693 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7557f911-fdec-42f3-b60c-de8ae8555775 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:13.554177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7557f911-fdec-42f3-b60c-de8ae8555775 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:13.555030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7557f911-fdec-42f3-b60c-de8ae8555775 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:13.555503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7557f911-fdec-42f3-b60c-de8ae8555775 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:13.809239 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7557f911-fdec-42f3-b60c-de8ae8555775 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:13.818054 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7557f911-fdec-42f3-b60c-de8ae8555775 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d" status: 200 len: 1267 microversion: 2.1 time: 0.284734 May 21 21:45:13.823272 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3004/5884] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:13 2022] GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d => generated 1267 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:14.839646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b8e0d081-1ab4-42d1-8ded-9383712ea925 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:14.841350 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b8e0d081-1ab4-42d1-8ded-9383712ea925 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:14.849107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b8e0d081-1ab4-42d1-8ded-9383712ea925 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:14.851797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b8e0d081-1ab4-42d1-8ded-9383712ea925 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:14.851797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b8e0d081-1ab4-42d1-8ded-9383712ea925 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:14.851797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b8e0d081-1ab4-42d1-8ded-9383712ea925 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:15.053301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b8e0d081-1ab4-42d1-8ded-9383712ea925 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:15.071645 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b8e0d081-1ab4-42d1-8ded-9383712ea925 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d" status: 200 len: 1267 microversion: 2.1 time: 0.235291 May 21 21:45:15.089914 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2881/5885] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:14 2022] GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d => generated 1267 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:16.086028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4f85cbb6-6d93-4aa1-8598-c031b63aff3a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:16.086667 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4f85cbb6-6d93-4aa1-8598-c031b63aff3a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:16.093972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f85cbb6-6d93-4aa1-8598-c031b63aff3a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:16.094533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f85cbb6-6d93-4aa1-8598-c031b63aff3a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:16.095242 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f85cbb6-6d93-4aa1-8598-c031b63aff3a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:16.095700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f85cbb6-6d93-4aa1-8598-c031b63aff3a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:16.248756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4f85cbb6-6d93-4aa1-8598-c031b63aff3a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:16.256949 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4f85cbb6-6d93-4aa1-8598-c031b63aff3a tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d" status: 200 len: 1267 microversion: 2.1 time: 0.174784 May 21 21:45:16.257531 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3005/5886] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:16 2022] GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:17.274784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-98532bad-ca0d-408b-ac64-21c3729a283f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:17.275413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-98532bad-ca0d-408b-ac64-21c3729a283f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:17.282731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98532bad-ca0d-408b-ac64-21c3729a283f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:17.283266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98532bad-ca0d-408b-ac64-21c3729a283f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:17.284048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98532bad-ca0d-408b-ac64-21c3729a283f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:17.284525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98532bad-ca0d-408b-ac64-21c3729a283f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:17.434160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-98532bad-ca0d-408b-ac64-21c3729a283f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:17.442311 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-98532bad-ca0d-408b-ac64-21c3729a283f tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d" status: 200 len: 1267 microversion: 2.1 time: 0.171550 May 21 21:45:17.442880 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2882/5887] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:17 2022] GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:18.459015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-78a901c6-7145-4ac8-ae77-b327586739b1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:18.459655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-78a901c6-7145-4ac8-ae77-b327586739b1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:18.462470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:45:18.463198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:45:18.468250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78a901c6-7145-4ac8-ae77-b327586739b1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:18.468778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78a901c6-7145-4ac8-ae77-b327586739b1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:18.476078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78a901c6-7145-4ac8-ae77-b327586739b1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:18.476078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78a901c6-7145-4ac8-ae77-b327586739b1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:18.623397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-78a901c6-7145-4ac8-ae77-b327586739b1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:18.631094 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-78a901c6-7145-4ac8-ae77-b327586739b1 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d" status: 200 len: 1267 microversion: 2.1 time: 0.176080 May 21 21:45:18.631673 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3006/5888] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:18 2022] GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:19.648467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7710b02d-c966-4b65-a6cd-3e8a3c96a510 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:19.649207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7710b02d-c966-4b65-a6cd-3e8a3c96a510 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:19.657225 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7710b02d-c966-4b65-a6cd-3e8a3c96a510 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:19.657691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7710b02d-c966-4b65-a6cd-3e8a3c96a510 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:19.658473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7710b02d-c966-4b65-a6cd-3e8a3c96a510 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:19.658941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7710b02d-c966-4b65-a6cd-3e8a3c96a510 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:19.811454 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7710b02d-c966-4b65-a6cd-3e8a3c96a510 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:19.819431 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7710b02d-c966-4b65-a6cd-3e8a3c96a510 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d" status: 200 len: 1267 microversion: 2.1 time: 0.174978 May 21 21:45:19.820005 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2883/5889] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:19 2022] GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:20.837083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ca4bc727-57ab-4687-9ee8-1bb1f7b6a1b2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:20.837764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ca4bc727-57ab-4687-9ee8-1bb1f7b6a1b2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:20.845600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca4bc727-57ab-4687-9ee8-1bb1f7b6a1b2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:20.846064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca4bc727-57ab-4687-9ee8-1bb1f7b6a1b2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:20.846844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca4bc727-57ab-4687-9ee8-1bb1f7b6a1b2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:20.847297 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca4bc727-57ab-4687-9ee8-1bb1f7b6a1b2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:21.009587 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ca4bc727-57ab-4687-9ee8-1bb1f7b6a1b2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:21.018817 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ca4bc727-57ab-4687-9ee8-1bb1f7b6a1b2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d" status: 200 len: 1267 microversion: 2.1 time: 0.185575 May 21 21:45:21.019664 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3007/5890] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:20 2022] GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:21.036039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-fb670e26-ad60-418e-88be-6ff324c9a681 req-cf65c727-df38-4c8b-bea0-25e67c9c4d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca5309cd-f1d9-43de-afd7-808a2879de1d", "name": "network-vif-plugged", "status": "completed", "tag": "4ca581b3-4eeb-4848-bdd6-e64e1e8729d2"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:45:21.046311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-fb670e26-ad60-418e-88be-6ff324c9a681 req-cf65c727-df38-4c8b-bea0-25e67c9c4d96 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:21.051150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-fb670e26-ad60-418e-88be-6ff324c9a681 req-cf65c727-df38-4c8b-bea0-25e67c9c4d96 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:21.058413 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-fb670e26-ad60-418e-88be-6ff324c9a681 req-cf65c727-df38-4c8b-bea0-25e67c9c4d96 service nova] Creating event network-vif-plugged:4ca581b3-4eeb-4848-bdd6-e64e1e8729d2 for instance ca5309cd-f1d9-43de-afd7-808a2879de1d on nch2-master-1 May 21 21:45:21.063957 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-fb670e26-ad60-418e-88be-6ff324c9a681 req-cf65c727-df38-4c8b-bea0-25e67c9c4d96 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031757 May 21 21:45:21.064610 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2884/5891] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:45:22.035824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6f259cf2-6415-410e-a171-106b19efcda9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:22.036431 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6f259cf2-6415-410e-a171-106b19efcda9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:22.043622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f259cf2-6415-410e-a171-106b19efcda9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:22.044098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f259cf2-6415-410e-a171-106b19efcda9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:22.045516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f259cf2-6415-410e-a171-106b19efcda9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:22.045981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f259cf2-6415-410e-a171-106b19efcda9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:22.201736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6f259cf2-6415-410e-a171-106b19efcda9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:22.209632 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6f259cf2-6415-410e-a171-106b19efcda9 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d" status: 200 len: 1267 microversion: 2.1 time: 0.177957 May 21 21:45:22.210202 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3008/5892] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:22 2022] GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:23.233995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:45:23.233995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8fcc7974-d319-4033-bb03-557412bb3e24 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:23.233995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8fcc7974-d319-4033-bb03-557412bb3e24 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:23.237591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8fcc7974-d319-4033-bb03-557412bb3e24 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:23.238056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8fcc7974-d319-4033-bb03-557412bb3e24 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:23.238835 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8fcc7974-d319-4033-bb03-557412bb3e24 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:23.239287 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8fcc7974-d319-4033-bb03-557412bb3e24 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:23.393688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8fcc7974-d319-4033-bb03-557412bb3e24 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:23.402148 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8fcc7974-d319-4033-bb03-557412bb3e24 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d" status: 200 len: 1454 microversion: 2.1 time: 0.178848 May 21 21:45:23.402765 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2885/5893] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:23 2022] GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d => generated 1454 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:23.432145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b264e33b-44d6-430d-8ee5-e624f640ef50 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:23.432852 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b264e33b-44d6-430d-8ee5-e624f640ef50 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:23.440046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b264e33b-44d6-430d-8ee5-e624f640ef50 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:23.440583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b264e33b-44d6-430d-8ee5-e624f640ef50 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:23.441388 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b264e33b-44d6-430d-8ee5-e624f640ef50 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:23.441879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b264e33b-44d6-430d-8ee5-e624f640ef50 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:23.593500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b264e33b-44d6-430d-8ee5-e624f640ef50 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:23.601378 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b264e33b-44d6-430d-8ee5-e624f640ef50 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d" status: 200 len: 1454 microversion: 2.1 time: 0.180983 May 21 21:45:23.601960 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3009/5894] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:23 2022] GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d => generated 1454 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:26.111331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-b71a601a-3e7e-413c-a638-72b1e2c40db8 req-e72fdbb4-02cf-4557-9969-0bbe0e353b3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca5309cd-f1d9-43de-afd7-808a2879de1d", "tag": "4ca581b3-4eeb-4848-bdd6-e64e1e8729d2"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:45:26.121138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b71a601a-3e7e-413c-a638-72b1e2c40db8 req-e72fdbb4-02cf-4557-9969-0bbe0e353b3e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:26.121594 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b71a601a-3e7e-413c-a638-72b1e2c40db8 req-e72fdbb4-02cf-4557-9969-0bbe0e353b3e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:26.134258 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-b71a601a-3e7e-413c-a638-72b1e2c40db8 req-e72fdbb4-02cf-4557-9969-0bbe0e353b3e service nova] Creating event network-changed:4ca581b3-4eeb-4848-bdd6-e64e1e8729d2 for instance ca5309cd-f1d9-43de-afd7-808a2879de1d on nch2-master-1 May 21 21:45:26.141741 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-b71a601a-3e7e-413c-a638-72b1e2c40db8 req-e72fdbb4-02cf-4557-9969-0bbe0e353b3e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034959 May 21 21:45:26.142675 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2886/5895] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:45:43.077761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-35341409-3405-4080-9d3f-6e1b9a255baa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-796880646", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:45:43.088229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:45:43.088974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=53 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:45:43.133463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-35341409-3405-4080-9d3f-6e1b9a255baa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] validate_networks() for None {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:45:43.521834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-35341409-3405-4080-9d3f-6e1b9a255baa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:45:43.522373 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-35341409-3405-4080-9d3f-6e1b9a255baa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:45:43.522867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-35341409-3405-4080-9d3f-6e1b9a255baa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:45:43.523297 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-35341409-3405-4080-9d3f-6e1b9a255baa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:45:43.523726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-35341409-3405-4080-9d3f-6e1b9a255baa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:45:43.534167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35341409-3405-4080-9d3f-6e1b9a255baa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:43.534610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35341409-3405-4080-9d3f-6e1b9a255baa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:43.535464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35341409-3405-4080-9d3f-6e1b9a255baa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:43.535952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35341409-3405-4080-9d3f-6e1b9a255baa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:43.554962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-35341409-3405-4080-9d3f-6e1b9a255baa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Getting quotas for project a3ad039cefcd45fa827017cf6c30c895. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:45:43.560143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-35341409-3405-4080-9d3f-6e1b9a255baa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Getting quotas for user 5c8068f63a974cf09e08695c80e57871 and project a3ad039cefcd45fa827017cf6c30c895. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:45:43.572963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-35341409-3405-4080-9d3f-6e1b9a255baa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:45:43.575140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-35341409-3405-4080-9d3f-6e1b9a255baa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] [instance: 7c425a7f-a3ee-4b62-b074-4702a958e4aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:45:43.691173 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-35341409-3405-4080-9d3f-6e1b9a255baa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618469 May 21 21:45:43.691840 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3010/5896] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:45:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:45:43.704433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7f8ce512-8237-4642-a249-c4b433404424 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:43.708973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7f8ce512-8237-4642-a249-c4b433404424 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] [instance: 7c425a7f-a3ee-4b62-b074-4702a958e4aa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:43.710341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=20 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:45:43.711424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=36 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:45:43.921771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7f8ce512-8237-4642-a249-c4b433404424 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8068f63a974cf09e08695c80e57871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ad039cefcd45fa827017cf6c30c895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:43.932983 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7f8ce512-8237-4642-a249-c4b433404424 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] 10.222.0.49 "GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa" status: 200 len: 1213 microversion: 2.1 time: 0.234361 May 21 21:45:43.933573 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2887/5897] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:43 2022] GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa => generated 1213 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:44.953220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-71e27d3f-f98d-45ac-93b1-be256d47a76f tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:44.953916 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-71e27d3f-f98d-45ac-93b1-be256d47a76f tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] [instance: 7c425a7f-a3ee-4b62-b074-4702a958e4aa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:45.017153 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-71e27d3f-f98d-45ac-93b1-be256d47a76f tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8068f63a974cf09e08695c80e57871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ad039cefcd45fa827017cf6c30c895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:45.024057 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-71e27d3f-f98d-45ac-93b1-be256d47a76f tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] 10.222.0.49 "GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa" status: 200 len: 1213 microversion: 2.1 time: 0.076786 May 21 21:45:45.030240 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3011/5898] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:44 2022] GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:46.046149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a5cf15cd-242f-4804-941c-b482b18e1730 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:46.046816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a5cf15cd-242f-4804-941c-b482b18e1730 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] [instance: 7c425a7f-a3ee-4b62-b074-4702a958e4aa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:46.054527 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5cf15cd-242f-4804-941c-b482b18e1730 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:46.054981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5cf15cd-242f-4804-941c-b482b18e1730 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:46.055789 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5cf15cd-242f-4804-941c-b482b18e1730 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:46.056502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5cf15cd-242f-4804-941c-b482b18e1730 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:46.129753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a5cf15cd-242f-4804-941c-b482b18e1730 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8068f63a974cf09e08695c80e57871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ad039cefcd45fa827017cf6c30c895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:46.137431 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a5cf15cd-242f-4804-941c-b482b18e1730 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] 10.222.0.49 "GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa" status: 200 len: 1265 microversion: 2.1 time: 0.095901 May 21 21:45:46.138014 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2888/5899] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:46 2022] GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:47.154973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4a55cb61-d4d0-42b9-82e0-321857404fc5 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:47.156209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4a55cb61-d4d0-42b9-82e0-321857404fc5 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] [instance: 7c425a7f-a3ee-4b62-b074-4702a958e4aa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:47.164515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a55cb61-d4d0-42b9-82e0-321857404fc5 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:47.164986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a55cb61-d4d0-42b9-82e0-321857404fc5 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:47.165781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a55cb61-d4d0-42b9-82e0-321857404fc5 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:47.166237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a55cb61-d4d0-42b9-82e0-321857404fc5 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:47.255300 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4a55cb61-d4d0-42b9-82e0-321857404fc5 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8068f63a974cf09e08695c80e57871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ad039cefcd45fa827017cf6c30c895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:47.263850 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4a55cb61-d4d0-42b9-82e0-321857404fc5 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] 10.222.0.49 "GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa" status: 200 len: 1271 microversion: 2.1 time: 0.112499 May 21 21:45:47.274120 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3012/5900] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:47 2022] GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa => generated 1271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:48.282211 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cf03d31b-966a-4a37-8af5-ff049f038a7a tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:48.283176 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cf03d31b-966a-4a37-8af5-ff049f038a7a tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] [instance: 7c425a7f-a3ee-4b62-b074-4702a958e4aa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:48.289802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf03d31b-966a-4a37-8af5-ff049f038a7a tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:48.290267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf03d31b-966a-4a37-8af5-ff049f038a7a tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:48.291079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf03d31b-966a-4a37-8af5-ff049f038a7a tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:48.291565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf03d31b-966a-4a37-8af5-ff049f038a7a tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:48.493044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cf03d31b-966a-4a37-8af5-ff049f038a7a tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8068f63a974cf09e08695c80e57871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ad039cefcd45fa827017cf6c30c895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:48.503348 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cf03d31b-966a-4a37-8af5-ff049f038a7a tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] 10.222.0.49 "GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa" status: 200 len: 1313 microversion: 2.1 time: 0.225297 May 21 21:45:48.504396 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2889/5901] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:48 2022] GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:48.793051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-d788e693-6c39-4c0a-affd-01c44ac3d761 req-9d173e0b-592b-42fd-bed3-62f98b4f8b47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c425a7f-a3ee-4b62-b074-4702a958e4aa", "tag": "6d5af19a-e08e-4bac-9515-e31e8a920721"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:45:48.803460 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d788e693-6c39-4c0a-affd-01c44ac3d761 req-9d173e0b-592b-42fd-bed3-62f98b4f8b47 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:48.803922 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d788e693-6c39-4c0a-affd-01c44ac3d761 req-9d173e0b-592b-42fd-bed3-62f98b4f8b47 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:48.820369 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-d788e693-6c39-4c0a-affd-01c44ac3d761 req-9d173e0b-592b-42fd-bed3-62f98b4f8b47 service nova] Creating event network-changed:6d5af19a-e08e-4bac-9515-e31e8a920721 for instance 7c425a7f-a3ee-4b62-b074-4702a958e4aa on nch1-master-1 May 21 21:45:48.826041 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-d788e693-6c39-4c0a-affd-01c44ac3d761 req-9d173e0b-592b-42fd-bed3-62f98b4f8b47 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036759 May 21 21:45:48.831556 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3013/5902] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:45:49.521785 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a0cdf0c7-8d3f-4166-ac90-387418f54335 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:49.522486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a0cdf0c7-8d3f-4166-ac90-387418f54335 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] [instance: 7c425a7f-a3ee-4b62-b074-4702a958e4aa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:49.530118 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a0cdf0c7-8d3f-4166-ac90-387418f54335 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:49.531167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a0cdf0c7-8d3f-4166-ac90-387418f54335 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:49.531957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a0cdf0c7-8d3f-4166-ac90-387418f54335 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:49.532433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a0cdf0c7-8d3f-4166-ac90-387418f54335 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:49.729302 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a0cdf0c7-8d3f-4166-ac90-387418f54335 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8068f63a974cf09e08695c80e57871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ad039cefcd45fa827017cf6c30c895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:49.739092 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a0cdf0c7-8d3f-4166-ac90-387418f54335 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] 10.222.0.49 "GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa" status: 200 len: 1313 microversion: 2.1 time: 0.221417 May 21 21:45:49.739679 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2890/5903] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:49 2022] GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:50.757848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-22f54ceb-b3bd-4dbb-bc4c-69ebcef573f6 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:50.758569 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-22f54ceb-b3bd-4dbb-bc4c-69ebcef573f6 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] [instance: 7c425a7f-a3ee-4b62-b074-4702a958e4aa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:50.765626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-22f54ceb-b3bd-4dbb-bc4c-69ebcef573f6 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:50.766173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-22f54ceb-b3bd-4dbb-bc4c-69ebcef573f6 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:50.766968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-22f54ceb-b3bd-4dbb-bc4c-69ebcef573f6 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:50.767427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-22f54ceb-b3bd-4dbb-bc4c-69ebcef573f6 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:50.930391 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-22f54ceb-b3bd-4dbb-bc4c-69ebcef573f6 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8068f63a974cf09e08695c80e57871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ad039cefcd45fa827017cf6c30c895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:50.939084 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-22f54ceb-b3bd-4dbb-bc4c-69ebcef573f6 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] 10.222.0.49 "GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa" status: 200 len: 1313 microversion: 2.1 time: 0.186357 May 21 21:45:50.939667 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3014/5904] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:50 2022] GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:51.957369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e137d15c-8329-48cc-8a95-1e268fb6ef1d tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:51.957913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e137d15c-8329-48cc-8a95-1e268fb6ef1d tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] [instance: 7c425a7f-a3ee-4b62-b074-4702a958e4aa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:51.965006 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e137d15c-8329-48cc-8a95-1e268fb6ef1d tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:51.965462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e137d15c-8329-48cc-8a95-1e268fb6ef1d tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:51.966302 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e137d15c-8329-48cc-8a95-1e268fb6ef1d tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:51.966727 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e137d15c-8329-48cc-8a95-1e268fb6ef1d tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:52.118059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e137d15c-8329-48cc-8a95-1e268fb6ef1d tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8068f63a974cf09e08695c80e57871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ad039cefcd45fa827017cf6c30c895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:52.126759 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e137d15c-8329-48cc-8a95-1e268fb6ef1d tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] 10.222.0.49 "GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa" status: 200 len: 1313 microversion: 2.1 time: 0.174656 May 21 21:45:52.127331 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2891/5905] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:51 2022] GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:53.143557 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f4c05294-77ce-461a-9bb3-bd637528a1a7 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:53.144144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f4c05294-77ce-461a-9bb3-bd637528a1a7 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] [instance: 7c425a7f-a3ee-4b62-b074-4702a958e4aa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:53.151645 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4c05294-77ce-461a-9bb3-bd637528a1a7 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:53.152127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4c05294-77ce-461a-9bb3-bd637528a1a7 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:53.152961 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4c05294-77ce-461a-9bb3-bd637528a1a7 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:53.153422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f4c05294-77ce-461a-9bb3-bd637528a1a7 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:53.439939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f4c05294-77ce-461a-9bb3-bd637528a1a7 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8068f63a974cf09e08695c80e57871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ad039cefcd45fa827017cf6c30c895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:53.449394 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f4c05294-77ce-461a-9bb3-bd637528a1a7 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] 10.222.0.49 "GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa" status: 200 len: 1313 microversion: 2.1 time: 0.310095 May 21 21:45:53.464792 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3015/5906] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:53 2022] GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:45:54.474646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-a6f7d43f-e59d-4b7f-a32d-03a3d824d429 req-50086f62-94f0-48ca-baf5-8005efc21879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c425a7f-a3ee-4b62-b074-4702a958e4aa", "name": "network-vif-plugged", "status": "completed", "tag": "6d5af19a-e08e-4bac-9515-e31e8a920721"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:45:54.482535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:45:54.488071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-af574f37-9e83-4a19-aa39-69d84bddc988 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:54.488735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-af574f37-9e83-4a19-aa39-69d84bddc988 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] [instance: 7c425a7f-a3ee-4b62-b074-4702a958e4aa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:54.490353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:45:54.496558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a6f7d43f-e59d-4b7f-a32d-03a3d824d429 req-50086f62-94f0-48ca-baf5-8005efc21879 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:54.496822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af574f37-9e83-4a19-aa39-69d84bddc988 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:54.497014 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a6f7d43f-e59d-4b7f-a32d-03a3d824d429 req-50086f62-94f0-48ca-baf5-8005efc21879 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:54.497290 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af574f37-9e83-4a19-aa39-69d84bddc988 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:54.498355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af574f37-9e83-4a19-aa39-69d84bddc988 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:54.498977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af574f37-9e83-4a19-aa39-69d84bddc988 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:54.508868 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-a6f7d43f-e59d-4b7f-a32d-03a3d824d429 req-50086f62-94f0-48ca-baf5-8005efc21879 service nova] Creating event network-vif-plugged:6d5af19a-e08e-4bac-9515-e31e8a920721 for instance 7c425a7f-a3ee-4b62-b074-4702a958e4aa on nch1-master-1 May 21 21:45:54.514125 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-a6f7d43f-e59d-4b7f-a32d-03a3d824d429 req-50086f62-94f0-48ca-baf5-8005efc21879 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043461 May 21 21:45:54.514734 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2892/5907] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:45:54.732077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-af574f37-9e83-4a19-aa39-69d84bddc988 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8068f63a974cf09e08695c80e57871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ad039cefcd45fa827017cf6c30c895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:54.740921 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-af574f37-9e83-4a19-aa39-69d84bddc988 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] 10.222.0.49 "GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa" status: 200 len: 1313 microversion: 2.1 time: 0.259234 May 21 21:45:54.741502 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3016/5908] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:54 2022] GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:55.760594 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-19d59245-94ce-4920-98a4-24d6787e6d64 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:55.761471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-19d59245-94ce-4920-98a4-24d6787e6d64 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] [instance: 7c425a7f-a3ee-4b62-b074-4702a958e4aa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:55.768741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19d59245-94ce-4920-98a4-24d6787e6d64 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:55.769195 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19d59245-94ce-4920-98a4-24d6787e6d64 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:55.769977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19d59245-94ce-4920-98a4-24d6787e6d64 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:55.770421 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-19d59245-94ce-4920-98a4-24d6787e6d64 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:55.930880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-19d59245-94ce-4920-98a4-24d6787e6d64 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8068f63a974cf09e08695c80e57871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ad039cefcd45fa827017cf6c30c895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:55.940192 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-19d59245-94ce-4920-98a4-24d6787e6d64 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] 10.222.0.49 "GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa" status: 200 len: 1313 microversion: 2.1 time: 0.185408 May 21 21:45:55.949821 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2893/5909] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:55 2022] GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:56.958097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2ffbc5fb-f668-48d7-8b7f-884f761020fa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:45:56.958871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2ffbc5fb-f668-48d7-8b7f-884f761020fa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] [instance: 7c425a7f-a3ee-4b62-b074-4702a958e4aa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:56.960894 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=8 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:45:56.967341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2ffbc5fb-f668-48d7-8b7f-884f761020fa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:56.970512 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2ffbc5fb-f668-48d7-8b7f-884f761020fa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:56.970512 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2ffbc5fb-f668-48d7-8b7f-884f761020fa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:56.970512 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2ffbc5fb-f668-48d7-8b7f-884f761020fa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:57.122136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2ffbc5fb-f668-48d7-8b7f-884f761020fa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8068f63a974cf09e08695c80e57871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ad039cefcd45fa827017cf6c30c895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:45:57.130259 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2ffbc5fb-f668-48d7-8b7f-884f761020fa tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] 10.222.0.49 "GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa" status: 200 len: 1463 microversion: 2.1 time: 0.177110 May 21 21:45:57.131649 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3017/5910] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:45:56 2022] GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa => generated 1463 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:45:57.148195 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-36749a68-86a3-476d-9d6e-e1c29d0ecd13 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7165abec-f3d0-4873-a873-13811bf90dbd", "device": "/dev/sdb"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:45:57.149511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-36749a68-86a3-476d-9d6e-e1c29d0ecd13 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] [instance: 7c425a7f-a3ee-4b62-b074-4702a958e4aa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:45:57.157361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36749a68-86a3-476d-9d6e-e1c29d0ecd13 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:57.157868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36749a68-86a3-476d-9d6e-e1c29d0ecd13 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:57.158651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36749a68-86a3-476d-9d6e-e1c29d0ecd13 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:45:57.159097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36749a68-86a3-476d-9d6e-e1c29d0ecd13 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:45:58.002767 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-36749a68-86a3-476d-9d6e-e1c29d0ecd13 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] 10.222.0.49 "POST /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.858302 May 21 21:45:58.003399 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2894/5911] 10.222.0.49 () {60 vars in 1322 bytes} [Sat May 21 21:45:57 2022] POST /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa/os-volume_attachments => generated 194 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:46:12.651290 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:46:12.652272 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=34 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:46:12.778175 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-32679183-8968-4929-b3f8-7db09e2ae142 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-396479061", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "09c16d2f-df8a-447b-bb18-6e1254de88f9"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:46:12.830152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-32679183-8968-4929-b3f8-7db09e2ae142 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] validate_networks() for [('09c16d2f-df8a-447b-bb18-6e1254de88f9', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:46:13.248517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-32679183-8968-4929-b3f8-7db09e2ae142 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:46:13.248960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-32679183-8968-4929-b3f8-7db09e2ae142 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:46:13.249473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-32679183-8968-4929-b3f8-7db09e2ae142 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:46:13.249900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-32679183-8968-4929-b3f8-7db09e2ae142 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:46:13.250328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-32679183-8968-4929-b3f8-7db09e2ae142 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:46:13.260653 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32679183-8968-4929-b3f8-7db09e2ae142 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:13.264254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32679183-8968-4929-b3f8-7db09e2ae142 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:13.264254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32679183-8968-4929-b3f8-7db09e2ae142 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:13.264254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32679183-8968-4929-b3f8-7db09e2ae142 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:13.287169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-32679183-8968-4929-b3f8-7db09e2ae142 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Getting quotas for project 4e77549b3c184b4ba121a88322438858. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:46:13.287434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-32679183-8968-4929-b3f8-7db09e2ae142 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Getting quotas for user 5af6cf74a0ee4034891f69eeb773848c and project 4e77549b3c184b4ba121a88322438858. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:46:13.300928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-32679183-8968-4929-b3f8-7db09e2ae142 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:46:13.303547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-32679183-8968-4929-b3f8-7db09e2ae142 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] [instance: 42bac608-99d5-4044-b279-d7feccf1c673] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:46:13.435728 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-32679183-8968-4929-b3f8-7db09e2ae142 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789664 May 21 21:46:13.448549 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3018/5912] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:46:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:46:13.460886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f3e4ebd4-d2f5-4fef-88df-20c74d8acfa3 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:13.461621 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f3e4ebd4-d2f5-4fef-88df-20c74d8acfa3 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] [instance: 42bac608-99d5-4044-b279-d7feccf1c673] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:13.466209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=18 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:46:13.466923 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:46:13.528322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f3e4ebd4-d2f5-4fef-88df-20c74d8acfa3 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af6cf74a0ee4034891f69eeb773848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e77549b3c184b4ba121a88322438858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:46:13.536814 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f3e4ebd4-d2f5-4fef-88df-20c74d8acfa3 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] 10.222.0.49 "GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673" status: 200 len: 1213 microversion: 2.1 time: 0.081185 May 21 21:46:13.537903 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2895/5913] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:13 2022] GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:46:14.562060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-db6a1f66-5931-4f93-a010-f79cee897544 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:14.562729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-db6a1f66-5931-4f93-a010-f79cee897544 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] [instance: 42bac608-99d5-4044-b279-d7feccf1c673] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:14.620961 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-db6a1f66-5931-4f93-a010-f79cee897544 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af6cf74a0ee4034891f69eeb773848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e77549b3c184b4ba121a88322438858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:46:14.628137 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-db6a1f66-5931-4f93-a010-f79cee897544 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] 10.222.0.49 "GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673" status: 200 len: 1213 microversion: 2.1 time: 0.069962 May 21 21:46:14.629065 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3019/5914] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:14 2022] GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:46:15.645924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-309849c8-9fb0-49c7-a2f5-9f43e4a80c4d tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:15.646659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-309849c8-9fb0-49c7-a2f5-9f43e4a80c4d tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] [instance: 42bac608-99d5-4044-b279-d7feccf1c673] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:15.656116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-309849c8-9fb0-49c7-a2f5-9f43e4a80c4d tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:15.656595 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-309849c8-9fb0-49c7-a2f5-9f43e4a80c4d tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:15.657372 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-309849c8-9fb0-49c7-a2f5-9f43e4a80c4d tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:15.657816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-309849c8-9fb0-49c7-a2f5-9f43e4a80c4d tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:15.729569 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-309849c8-9fb0-49c7-a2f5-9f43e4a80c4d tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af6cf74a0ee4034891f69eeb773848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e77549b3c184b4ba121a88322438858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:46:15.737125 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-309849c8-9fb0-49c7-a2f5-9f43e4a80c4d tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] 10.222.0.49 "GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673" status: 200 len: 1265 microversion: 2.1 time: 0.095678 May 21 21:46:15.737713 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2896/5915] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:15 2022] GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673 => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:46:16.755343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fd795a4b-6b81-470b-9588-b09cf23accf0 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:16.756073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fd795a4b-6b81-470b-9588-b09cf23accf0 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] [instance: 42bac608-99d5-4044-b279-d7feccf1c673] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:16.764211 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd795a4b-6b81-470b-9588-b09cf23accf0 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:16.764717 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd795a4b-6b81-470b-9588-b09cf23accf0 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:16.765514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd795a4b-6b81-470b-9588-b09cf23accf0 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:16.765972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fd795a4b-6b81-470b-9588-b09cf23accf0 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:17.031113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fd795a4b-6b81-470b-9588-b09cf23accf0 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af6cf74a0ee4034891f69eeb773848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e77549b3c184b4ba121a88322438858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:46:17.043013 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fd795a4b-6b81-470b-9588-b09cf23accf0 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] 10.222.0.49 "GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673" status: 200 len: 1313 microversion: 2.1 time: 0.292191 May 21 21:46:17.043921 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3020/5916] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:16 2022] GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:46:17.899988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-7e442547-8ec2-4bb2-86f9-fbb5bc6a3f79 req-7526a537-a062-4f4e-93ef-b76326655b3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42bac608-99d5-4044-b279-d7feccf1c673", "tag": "4c9fc7ff-1af8-4680-9f74-c4aeca3e4582"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:46:17.909368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-7e442547-8ec2-4bb2-86f9-fbb5bc6a3f79 req-7526a537-a062-4f4e-93ef-b76326655b3b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:17.909817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-7e442547-8ec2-4bb2-86f9-fbb5bc6a3f79 req-7526a537-a062-4f4e-93ef-b76326655b3b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:17.920900 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-7e442547-8ec2-4bb2-86f9-fbb5bc6a3f79 req-7526a537-a062-4f4e-93ef-b76326655b3b service nova] Creating event network-changed:4c9fc7ff-1af8-4680-9f74-c4aeca3e4582 for instance 42bac608-99d5-4044-b279-d7feccf1c673 on nch2-master-1 May 21 21:46:17.925613 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-7e442547-8ec2-4bb2-86f9-fbb5bc6a3f79 req-7526a537-a062-4f4e-93ef-b76326655b3b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029230 May 21 21:46:17.926811 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2897/5917] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:46:18.061323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c494c3b0-929d-497c-bef1-c3ab666177c8 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:18.062077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c494c3b0-929d-497c-bef1-c3ab666177c8 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] [instance: 42bac608-99d5-4044-b279-d7feccf1c673] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:18.069879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c494c3b0-929d-497c-bef1-c3ab666177c8 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:18.070342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c494c3b0-929d-497c-bef1-c3ab666177c8 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:18.074185 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c494c3b0-929d-497c-bef1-c3ab666177c8 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:18.074185 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c494c3b0-929d-497c-bef1-c3ab666177c8 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:18.218205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c494c3b0-929d-497c-bef1-c3ab666177c8 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af6cf74a0ee4034891f69eeb773848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e77549b3c184b4ba121a88322438858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:46:18.226407 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c494c3b0-929d-497c-bef1-c3ab666177c8 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] 10.222.0.49 "GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673" status: 200 len: 1313 microversion: 2.1 time: 0.168994 May 21 21:46:18.226997 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3021/5918] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:18 2022] GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:46:19.244580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2efa155b-2cfc-4506-882f-f4ecfa4a34d2 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:19.245284 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2efa155b-2cfc-4506-882f-f4ecfa4a34d2 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] [instance: 42bac608-99d5-4044-b279-d7feccf1c673] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:19.251663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2efa155b-2cfc-4506-882f-f4ecfa4a34d2 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:19.252111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2efa155b-2cfc-4506-882f-f4ecfa4a34d2 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:19.252910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2efa155b-2cfc-4506-882f-f4ecfa4a34d2 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:19.253349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2efa155b-2cfc-4506-882f-f4ecfa4a34d2 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:19.399085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2efa155b-2cfc-4506-882f-f4ecfa4a34d2 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af6cf74a0ee4034891f69eeb773848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e77549b3c184b4ba121a88322438858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:46:19.406699 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2efa155b-2cfc-4506-882f-f4ecfa4a34d2 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] 10.222.0.49 "GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673" status: 200 len: 1313 microversion: 2.1 time: 0.167352 May 21 21:46:19.407289 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2898/5919] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:19 2022] GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:46:20.424866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-540961db-d86b-4362-9041-de60b1b1ef6a tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:20.425501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-540961db-d86b-4362-9041-de60b1b1ef6a tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] [instance: 42bac608-99d5-4044-b279-d7feccf1c673] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:20.433584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-540961db-d86b-4362-9041-de60b1b1ef6a tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:20.434051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-540961db-d86b-4362-9041-de60b1b1ef6a tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:20.434841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-540961db-d86b-4362-9041-de60b1b1ef6a tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:20.435295 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-540961db-d86b-4362-9041-de60b1b1ef6a tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:20.588326 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-540961db-d86b-4362-9041-de60b1b1ef6a tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af6cf74a0ee4034891f69eeb773848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e77549b3c184b4ba121a88322438858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:46:20.596019 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-540961db-d86b-4362-9041-de60b1b1ef6a tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] 10.222.0.49 "GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673" status: 200 len: 1313 microversion: 2.1 time: 0.175203 May 21 21:46:20.596627 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3022/5920] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:20 2022] GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:46:21.612887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-433e1b31-882c-42d8-b643-fb0de4319fb4 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:21.613511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-433e1b31-882c-42d8-b643-fb0de4319fb4 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] [instance: 42bac608-99d5-4044-b279-d7feccf1c673] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:21.620862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-433e1b31-882c-42d8-b643-fb0de4319fb4 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:21.621305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-433e1b31-882c-42d8-b643-fb0de4319fb4 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:21.622079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-433e1b31-882c-42d8-b643-fb0de4319fb4 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:21.622555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-433e1b31-882c-42d8-b643-fb0de4319fb4 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:21.771811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-433e1b31-882c-42d8-b643-fb0de4319fb4 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af6cf74a0ee4034891f69eeb773848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e77549b3c184b4ba121a88322438858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:46:21.779555 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-433e1b31-882c-42d8-b643-fb0de4319fb4 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] 10.222.0.49 "GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673" status: 200 len: 1313 microversion: 2.1 time: 0.170651 May 21 21:46:21.780123 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2899/5921] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:21 2022] GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:46:22.796907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-124589e5-a293-4e2e-84b9-16f0251f6d9e tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:22.797547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-124589e5-a293-4e2e-84b9-16f0251f6d9e tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] [instance: 42bac608-99d5-4044-b279-d7feccf1c673] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:22.805492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-124589e5-a293-4e2e-84b9-16f0251f6d9e tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:22.805960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-124589e5-a293-4e2e-84b9-16f0251f6d9e tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:22.806748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-124589e5-a293-4e2e-84b9-16f0251f6d9e tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:22.807202 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-124589e5-a293-4e2e-84b9-16f0251f6d9e tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:22.953396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-124589e5-a293-4e2e-84b9-16f0251f6d9e tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af6cf74a0ee4034891f69eeb773848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e77549b3c184b4ba121a88322438858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:46:22.961616 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-124589e5-a293-4e2e-84b9-16f0251f6d9e tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] 10.222.0.49 "GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673" status: 200 len: 1313 microversion: 2.1 time: 0.168806 May 21 21:46:22.962193 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3023/5922] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:22 2022] GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:46:23.424053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-3309dce6-c947-40ac-ad79-9bc8f7af0d0d req-5388ede3-0d7d-4022-af40-10bf2123ec0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42bac608-99d5-4044-b279-d7feccf1c673", "name": "network-vif-plugged", "status": "completed", "tag": "4c9fc7ff-1af8-4680-9f74-c4aeca3e4582"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:46:23.433056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3309dce6-c947-40ac-ad79-9bc8f7af0d0d req-5388ede3-0d7d-4022-af40-10bf2123ec0a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:23.433810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3309dce6-c947-40ac-ad79-9bc8f7af0d0d req-5388ede3-0d7d-4022-af40-10bf2123ec0a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:23.445155 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-3309dce6-c947-40ac-ad79-9bc8f7af0d0d req-5388ede3-0d7d-4022-af40-10bf2123ec0a service nova] Creating event network-vif-plugged:4c9fc7ff-1af8-4680-9f74-c4aeca3e4582 for instance 42bac608-99d5-4044-b279-d7feccf1c673 on nch2-master-1 May 21 21:46:23.450848 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-3309dce6-c947-40ac-ad79-9bc8f7af0d0d req-5388ede3-0d7d-4022-af40-10bf2123ec0a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100804 May 21 21:46:23.451530 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2900/5923] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:46:23.984262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-da67d56d-ba9e-4c6f-adee-ca55b284bb60 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:23.984952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-da67d56d-ba9e-4c6f-adee-ca55b284bb60 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] [instance: 42bac608-99d5-4044-b279-d7feccf1c673] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:23.986889 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:46:23.992805 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da67d56d-ba9e-4c6f-adee-ca55b284bb60 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:23.993273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da67d56d-ba9e-4c6f-adee-ca55b284bb60 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:23.994409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da67d56d-ba9e-4c6f-adee-ca55b284bb60 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:23.994507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da67d56d-ba9e-4c6f-adee-ca55b284bb60 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:24.144360 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-da67d56d-ba9e-4c6f-adee-ca55b284bb60 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af6cf74a0ee4034891f69eeb773848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e77549b3c184b4ba121a88322438858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:46:24.152305 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-da67d56d-ba9e-4c6f-adee-ca55b284bb60 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] 10.222.0.49 "GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673" status: 200 len: 1313 microversion: 2.1 time: 0.172049 May 21 21:46:24.152885 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3024/5924] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:23 2022] GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:46:24.923116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:46:24.928715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-62bfc094-9b74-4532-8dee-af028493d60d tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:24.929357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-62bfc094-9b74-4532-8dee-af028493d60d tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] [instance: 7c425a7f-a3ee-4b62-b074-4702a958e4aa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:24.937773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62bfc094-9b74-4532-8dee-af028493d60d tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:24.937773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62bfc094-9b74-4532-8dee-af028493d60d tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:24.937773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62bfc094-9b74-4532-8dee-af028493d60d tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:24.937773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-62bfc094-9b74-4532-8dee-af028493d60d tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:25.019324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-62bfc094-9b74-4532-8dee-af028493d60d tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lazy-loading 'services' on Instance uuid 7c425a7f-a3ee-4b62-b074-4702a958e4aa {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:46:25.169840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7fe77bd6-61e2-4e35-adfc-1345ffe369d3 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:25.171155 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7fe77bd6-61e2-4e35-adfc-1345ffe369d3 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] [instance: 42bac608-99d5-4044-b279-d7feccf1c673] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:25.173202 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=8 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:46:25.179762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fe77bd6-61e2-4e35-adfc-1345ffe369d3 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:25.180439 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fe77bd6-61e2-4e35-adfc-1345ffe369d3 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:25.181230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fe77bd6-61e2-4e35-adfc-1345ffe369d3 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:25.181684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fe77bd6-61e2-4e35-adfc-1345ffe369d3 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:25.331652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7fe77bd6-61e2-4e35-adfc-1345ffe369d3 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af6cf74a0ee4034891f69eeb773848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e77549b3c184b4ba121a88322438858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:46:25.339058 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-62bfc094-9b74-4532-8dee-af028493d60d tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa/os-volume_attachments/7165abec-f3d0-4873-a873-13811bf90dbd" status: 202 len: 0 microversion: 2.1 time: 0.416647 May 21 21:46:25.339665 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2901/5925] 10.222.0.49 () {58 vars in 1415 bytes} [Sat May 21 21:46:24 2022] DELETE /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa/os-volume_attachments/7165abec-f3d0-4873-a873-13811bf90dbd => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:46:25.340255 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7fe77bd6-61e2-4e35-adfc-1345ffe369d3 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] 10.222.0.49 "GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673" status: 200 len: 1497 microversion: 2.1 time: 0.174317 May 21 21:46:25.341003 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3025/5926] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:25 2022] GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673 => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:46:26.459536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-66ab5af8-9244-400e-b880-e5b9ddb18527 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:26.460933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-66ab5af8-9244-400e-b880-e5b9ddb18527 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] [instance: 7c425a7f-a3ee-4b62-b074-4702a958e4aa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:26.467703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66ab5af8-9244-400e-b880-e5b9ddb18527 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:26.468492 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66ab5af8-9244-400e-b880-e5b9ddb18527 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:26.469130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66ab5af8-9244-400e-b880-e5b9ddb18527 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:26.469581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66ab5af8-9244-400e-b880-e5b9ddb18527 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:26.498933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-66ab5af8-9244-400e-b880-e5b9ddb18527 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] [instance: 7c425a7f-a3ee-4b62-b074-4702a958e4aa] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:46:26.747333 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-66ab5af8-9244-400e-b880-e5b9ddb18527 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa" status: 204 len: 0 microversion: 2.1 time: 0.293151 May 21 21:46:26.748100 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2902/5927] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:46:26 2022] DELETE /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:46:26.756762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1ba547b7-1414-4ff4-8ee2-d90eb67bd7c5 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:26.757907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1ba547b7-1414-4ff4-8ee2-d90eb67bd7c5 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] [instance: 7c425a7f-a3ee-4b62-b074-4702a958e4aa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:26.765491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ba547b7-1414-4ff4-8ee2-d90eb67bd7c5 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:26.765954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ba547b7-1414-4ff4-8ee2-d90eb67bd7c5 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:26.766764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ba547b7-1414-4ff4-8ee2-d90eb67bd7c5 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:26.767333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1ba547b7-1414-4ff4-8ee2-d90eb67bd7c5 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:26.911698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1ba547b7-1414-4ff4-8ee2-d90eb67bd7c5 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8068f63a974cf09e08695c80e57871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ad039cefcd45fa827017cf6c30c895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:46:26.919656 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1ba547b7-1414-4ff4-8ee2-d90eb67bd7c5 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] 10.222.0.49 "GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa" status: 200 len: 1469 microversion: 2.1 time: 0.167064 May 21 21:46:26.920236 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3026/5928] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:26 2022] GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa => generated 1469 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:46:27.938185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e48188b1-0284-4375-a1ec-f15995d301a0 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:27.938981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e48188b1-0284-4375-a1ec-f15995d301a0 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] [instance: 7c425a7f-a3ee-4b62-b074-4702a958e4aa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:27.947459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e48188b1-0284-4375-a1ec-f15995d301a0 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:27.947927 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e48188b1-0284-4375-a1ec-f15995d301a0 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:27.948758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e48188b1-0284-4375-a1ec-f15995d301a0 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:27.951178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e48188b1-0284-4375-a1ec-f15995d301a0 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:28.098748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e48188b1-0284-4375-a1ec-f15995d301a0 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8068f63a974cf09e08695c80e57871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ad039cefcd45fa827017cf6c30c895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:46:28.106920 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e48188b1-0284-4375-a1ec-f15995d301a0 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] 10.222.0.49 "GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa" status: 200 len: 1469 microversion: 2.1 time: 0.173061 May 21 21:46:28.108323 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2903/5929] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:27 2022] GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa => generated 1469 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:46:29.004488 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-484a25e2-40dd-4f4c-85ad-5a5e96b3d1d0 req-69621791-5caf-4d9b-aed7-98f201222f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c425a7f-a3ee-4b62-b074-4702a958e4aa", "name": "network-vif-deleted", "tag": "6d5af19a-e08e-4bac-9515-e31e8a920721"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:46:29.016726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-484a25e2-40dd-4f4c-85ad-5a5e96b3d1d0 req-69621791-5caf-4d9b-aed7-98f201222f76 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:29.017217 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-484a25e2-40dd-4f4c-85ad-5a5e96b3d1d0 req-69621791-5caf-4d9b-aed7-98f201222f76 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:29.029442 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-484a25e2-40dd-4f4c-85ad-5a5e96b3d1d0 req-69621791-5caf-4d9b-aed7-98f201222f76 service nova] Creating event network-vif-deleted:6d5af19a-e08e-4bac-9515-e31e8a920721 for instance 7c425a7f-a3ee-4b62-b074-4702a958e4aa on nch1-master-1 May 21 21:46:29.034598 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-484a25e2-40dd-4f4c-85ad-5a5e96b3d1d0 req-69621791-5caf-4d9b-aed7-98f201222f76 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034154 May 21 21:46:29.035204 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3027/5930] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:46:29.125219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-85d8d8fd-84fb-4952-acbf-cb746bc55651 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:29.125880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-85d8d8fd-84fb-4952-acbf-cb746bc55651 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] [instance: 7c425a7f-a3ee-4b62-b074-4702a958e4aa] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:29.133083 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-85d8d8fd-84fb-4952-acbf-cb746bc55651 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:29.133533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-85d8d8fd-84fb-4952-acbf-cb746bc55651 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:29.134332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-85d8d8fd-84fb-4952-acbf-cb746bc55651 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:29.134779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-85d8d8fd-84fb-4952-acbf-cb746bc55651 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:29.206285 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-85d8d8fd-84fb-4952-acbf-cb746bc55651 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8068f63a974cf09e08695c80e57871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ad039cefcd45fa827017cf6c30c895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:46:29.214621 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-85d8d8fd-84fb-4952-acbf-cb746bc55651 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] 10.222.0.49 "GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa" status: 200 len: 1427 microversion: 2.1 time: 0.093504 May 21 21:46:29.215214 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2904/5931] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:29 2022] GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:46:29.551248 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-10844336-2151-4971-ac27-a2283322c847 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:29.552116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-10844336-2151-4971-ac27-a2283322c847 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] [instance: 42bac608-99d5-4044-b279-d7feccf1c673] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:29.558802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-10844336-2151-4971-ac27-a2283322c847 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:29.559402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-10844336-2151-4971-ac27-a2283322c847 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:29.560054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-10844336-2151-4971-ac27-a2283322c847 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:29.560545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-10844336-2151-4971-ac27-a2283322c847 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:29.588780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-10844336-2151-4971-ac27-a2283322c847 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] [instance: 42bac608-99d5-4044-b279-d7feccf1c673] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:46:29.913180 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-10844336-2151-4971-ac27-a2283322c847 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] 10.222.0.49 "DELETE /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673" status: 204 len: 0 microversion: 2.1 time: 0.365882 May 21 21:46:29.913783 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3028/5932] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:46:29 2022] DELETE /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:46:29.924814 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-789a2ed6-ae72-4d8c-8557-f87765c3646e tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:29.927292 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-789a2ed6-ae72-4d8c-8557-f87765c3646e tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] [instance: 42bac608-99d5-4044-b279-d7feccf1c673] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:29.934856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-789a2ed6-ae72-4d8c-8557-f87765c3646e tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:29.935312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-789a2ed6-ae72-4d8c-8557-f87765c3646e tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:29.936120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-789a2ed6-ae72-4d8c-8557-f87765c3646e tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:29.936591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-789a2ed6-ae72-4d8c-8557-f87765c3646e tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:30.087810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-789a2ed6-ae72-4d8c-8557-f87765c3646e tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af6cf74a0ee4034891f69eeb773848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e77549b3c184b4ba121a88322438858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:46:30.095545 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-789a2ed6-ae72-4d8c-8557-f87765c3646e tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] 10.222.0.49 "GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673" status: 200 len: 1503 microversion: 2.1 time: 0.177043 May 21 21:46:30.096369 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2905/5933] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:29 2022] GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673 => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:46:30.231986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-17fc170d-5dc5-4987-a3f6-c456de21c099 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:30.232760 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-17fc170d-5dc5-4987-a3f6-c456de21c099 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] [instance: 7c425a7f-a3ee-4b62-b074-4702a958e4aa] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:30.240133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-17fc170d-5dc5-4987-a3f6-c456de21c099 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:30.240644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-17fc170d-5dc5-4987-a3f6-c456de21c099 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:30.241556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-17fc170d-5dc5-4987-a3f6-c456de21c099 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:30.242014 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-17fc170d-5dc5-4987-a3f6-c456de21c099 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:30.257801 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-17fc170d-5dc5-4987-a3f6-c456de21c099 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] HTTP exception thrown: Instance 7c425a7f-a3ee-4b62-b074-4702a958e4aa could not be found. May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-17fc170d-5dc5-4987-a3f6-c456de21c099 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Request method failure captured: May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa HTTP/1.1 May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiV2DC6A8tBGb0kDjhxwJdsEQ0F8hsJ3lKnj7ouRzo1qTGsy2t34YFBSrZOerWkCjRCRbYm9BjXIqk4OsIgN8qvhfr6fSee4ZSApKztSCBj-RTTeBhH0HZQoY8bZIOmKGAiKYpMm0HTsmdRy4-SG2Htzc_OTRSqRO6281H4Yctof-2hw May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: a3ad039cefcd45fa827017cf6c30c895 May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-VolumesBackupsTest-1124201519 May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a3ad039cefcd45fa827017cf6c30c895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a3ad039cefcd45fa827017cf6c30c895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a3ad039cefcd45fa827017cf6c30c895", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a3ad039cefcd45fa827017cf6c30c895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-VolumesBackupsTest-1124201519 May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: a3ad039cefcd45fa827017cf6c30c895 May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-VolumesBackupsTest-1124201519 May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-VolumesBackupsTest-1124201519-project May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 5c8068f63a974cf09e08695c80e57871 May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-VolumesBackupsTest-1124201519-project May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 7c425a7f-a3ee-4b62-b074-4702a958e4aa could not be found. May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '7c425a7f-a3ee-4b62-b074-4702a958e4aa'} May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c425a7f-a3ee-4b62-b074-4702a958e4aa could not be found. May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c425a7f-a3ee-4b62-b074-4702a958e4aa could not be found. May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:46:30.260536 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:46:30.265749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:46:30.265749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:46:30.265749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:46:30.265749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:46:30.265749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:46:30.265749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c425a7f-a3ee-4b62-b074-4702a958e4aa could not be found. May 21 21:46:30.265749 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:46:30.265749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-17fc170d-5dc5-4987-a3f6-c456de21c099 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] Returning 404 to user: Instance 7c425a7f-a3ee-4b62-b074-4702a958e4aa could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:46:30.265749 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-17fc170d-5dc5-4987-a3f6-c456de21c099 tempest-VolumesBackupsTest-1124201519 tempest-VolumesBackupsTest-1124201519-project] 10.222.0.49 "GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa" status: 404 len: 111 microversion: 2.1 time: 0.034666 May 21 21:46:30.265749 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3029/5934] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:30 2022] GET /compute/v2.1/servers/7c425a7f-a3ee-4b62-b074-4702a958e4aa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:46:31.137130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1d9eca86-e0f7-4b26-9207-f060d93eaf62 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:31.137130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1d9eca86-e0f7-4b26-9207-f060d93eaf62 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] [instance: 42bac608-99d5-4044-b279-d7feccf1c673] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:31.137130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d9eca86-e0f7-4b26-9207-f060d93eaf62 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:31.137130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d9eca86-e0f7-4b26-9207-f060d93eaf62 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:31.137130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d9eca86-e0f7-4b26-9207-f060d93eaf62 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:31.137130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1d9eca86-e0f7-4b26-9207-f060d93eaf62 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:31.339335 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1d9eca86-e0f7-4b26-9207-f060d93eaf62 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af6cf74a0ee4034891f69eeb773848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e77549b3c184b4ba121a88322438858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:46:31.347348 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1d9eca86-e0f7-4b26-9207-f060d93eaf62 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] 10.222.0.49 "GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673" status: 200 len: 1503 microversion: 2.1 time: 0.236608 May 21 21:46:31.347960 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2906/5935] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:31 2022] GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673 => generated 1503 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:46:31.947337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-e000bf7d-c9bf-4b8b-beb3-1a0f4685d952 req-41eee1dd-b4d7-4aa6-9421-6a8b0248f2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42bac608-99d5-4044-b279-d7feccf1c673", "name": "network-vif-deleted", "tag": "4c9fc7ff-1af8-4680-9f74-c4aeca3e4582"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:46:31.957189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-e000bf7d-c9bf-4b8b-beb3-1a0f4685d952 req-41eee1dd-b4d7-4aa6-9421-6a8b0248f2a8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:31.959864 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-e000bf7d-c9bf-4b8b-beb3-1a0f4685d952 req-41eee1dd-b4d7-4aa6-9421-6a8b0248f2a8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:31.968822 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-e000bf7d-c9bf-4b8b-beb3-1a0f4685d952 req-41eee1dd-b4d7-4aa6-9421-6a8b0248f2a8 service nova] Creating event network-vif-deleted:4c9fc7ff-1af8-4680-9f74-c4aeca3e4582 for instance 42bac608-99d5-4044-b279-d7feccf1c673 on nch2-master-1 May 21 21:46:31.973702 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-e000bf7d-c9bf-4b8b-beb3-1a0f4685d952 req-41eee1dd-b4d7-4aa6-9421-6a8b0248f2a8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030629 May 21 21:46:31.974280 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3030/5936] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:46:32.366938 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5c1d9a10-9831-4dea-b685-c7cb128b9871 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:32.368148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5c1d9a10-9831-4dea-b685-c7cb128b9871 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] [instance: 42bac608-99d5-4044-b279-d7feccf1c673] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:32.375564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c1d9a10-9831-4dea-b685-c7cb128b9871 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:32.376020 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c1d9a10-9831-4dea-b685-c7cb128b9871 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:32.376835 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c1d9a10-9831-4dea-b685-c7cb128b9871 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:32.377279 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c1d9a10-9831-4dea-b685-c7cb128b9871 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:32.409044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c1d9a10-9831-4dea-b685-c7cb128b9871 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:32.409498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c1d9a10-9831-4dea-b685-c7cb128b9871 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:32.410042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-5c1d9a10-9831-4dea-b685-c7cb128b9871 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lazy-loading 'fault' on Instance uuid 42bac608-99d5-4044-b279-d7feccf1c673 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:46:32.456660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5c1d9a10-9831-4dea-b685-c7cb128b9871 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af6cf74a0ee4034891f69eeb773848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e77549b3c184b4ba121a88322438858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:46:32.464520 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5c1d9a10-9831-4dea-b685-c7cb128b9871 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] 10.222.0.49 "GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673" status: 200 len: 1303 microversion: 2.1 time: 0.101491 May 21 21:46:32.465092 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2907/5937] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:32 2022] GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:46:33.483465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1412af56-331b-4830-9137-bfb7f7157565 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:33.484249 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1412af56-331b-4830-9137-bfb7f7157565 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] [instance: 42bac608-99d5-4044-b279-d7feccf1c673] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:33.490619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1412af56-331b-4830-9137-bfb7f7157565 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:33.491967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1412af56-331b-4830-9137-bfb7f7157565 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:33.491967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1412af56-331b-4830-9137-bfb7f7157565 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:33.492387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1412af56-331b-4830-9137-bfb7f7157565 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:33.505986 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-1412af56-331b-4830-9137-bfb7f7157565 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] HTTP exception thrown: Instance 42bac608-99d5-4044-b279-d7feccf1c673 could not be found. May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1412af56-331b-4830-9137-bfb7f7157565 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Request method failure captured: May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673 HTTP/1.1 May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiV2hXhMhQ46z3RCLkZX2PGVjXufc2-mJhoSkCDYX0OyG68q1IcIDR-YMdoZMFqnmNh2ZSYBdn1eFfQD4OPRfcNwf2bqaHgACixboKneE8ApdrvYA02JNTCcLOwwZhWhPIksCRTOPARBU7U6bYi1DwSv6rLZFnAwFSmroGyDxci15zhk May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 4e77549b3c184b4ba121a88322438858 May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-VolumesActionsTest-1843210645 May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4e77549b3c184b4ba121a88322438858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4e77549b3c184b4ba121a88322438858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4e77549b3c184b4ba121a88322438858", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4e77549b3c184b4ba121a88322438858"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-VolumesActionsTest-1843210645 May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 4e77549b3c184b4ba121a88322438858 May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-VolumesActionsTest-1843210645 May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-VolumesActionsTest-1843210645-project May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 5af6cf74a0ee4034891f69eeb773848c May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-VolumesActionsTest-1843210645-project May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 42bac608-99d5-4044-b279-d7feccf1c673 could not be found. May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '42bac608-99d5-4044-b279-d7feccf1c673'} May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42bac608-99d5-4044-b279-d7feccf1c673 could not be found. May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42bac608-99d5-4044-b279-d7feccf1c673 could not be found. May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:46:33.507661 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:46:33.513042 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:46:33.513042 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:46:33.513042 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:46:33.513042 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:46:33.513042 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:46:33.513042 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42bac608-99d5-4044-b279-d7feccf1c673 could not be found. May 21 21:46:33.513042 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:46:33.513042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1412af56-331b-4830-9137-bfb7f7157565 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] Returning 404 to user: Instance 42bac608-99d5-4044-b279-d7feccf1c673 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:46:33.513042 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1412af56-331b-4830-9137-bfb7f7157565 tempest-VolumesActionsTest-1843210645 tempest-VolumesActionsTest-1843210645-project] 10.222.0.49 "GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673" status: 404 len: 111 microversion: 2.1 time: 0.031605 May 21 21:46:33.513042 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3031/5938] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:33 2022] GET /compute/v2.1/servers/42bac608-99d5-4044-b279-d7feccf1c673 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:46:44.760555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4e107ed7-1fef-4398-b557-d37436715c08 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:44.761098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4e107ed7-1fef-4398-b557-d37436715c08 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 812a8ad7-8714-40c5-8243-ea20fbe816df] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:44.765582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:46:44.765889 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:46:44.771008 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e107ed7-1fef-4398-b557-d37436715c08 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:44.771457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e107ed7-1fef-4398-b557-d37436715c08 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:44.772232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e107ed7-1fef-4398-b557-d37436715c08 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:44.772695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e107ed7-1fef-4398-b557-d37436715c08 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:44.860909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-4e107ed7-1fef-4398-b557-d37436715c08 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lazy-loading 'services' on Instance uuid 812a8ad7-8714-40c5-8243-ea20fbe816df {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:46:45.094891 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4e107ed7-1fef-4398-b557-d37436715c08 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "DELETE /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df/os-volume_attachments/0073fe3d-0903-4f84-8e07-7e6bd96bbf32" status: 202 len: 0 microversion: 2.1 time: 0.338598 May 21 21:46:45.095610 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2908/5939] 10.222.0.49 () {58 vars in 1415 bytes} [Sat May 21 21:46:44 2022] DELETE /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df/os-volume_attachments/0073fe3d-0903-4f84-8e07-7e6bd96bbf32 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:46:46.211080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-594d762b-8737-4e42-99d1-7c66b6da2cb7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:46.211604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-594d762b-8737-4e42-99d1-7c66b6da2cb7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 812a8ad7-8714-40c5-8243-ea20fbe816df] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:46.214449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:46:46.216415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:46:46.220741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-594d762b-8737-4e42-99d1-7c66b6da2cb7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:46.221216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-594d762b-8737-4e42-99d1-7c66b6da2cb7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:46.222009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-594d762b-8737-4e42-99d1-7c66b6da2cb7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:46.222471 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-594d762b-8737-4e42-99d1-7c66b6da2cb7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:46.252250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-594d762b-8737-4e42-99d1-7c66b6da2cb7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 812a8ad7-8714-40c5-8243-ea20fbe816df] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:46:46.535670 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-594d762b-8737-4e42-99d1-7c66b6da2cb7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "DELETE /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df" status: 204 len: 0 microversion: 2.1 time: 0.328286 May 21 21:46:46.537009 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3032/5940] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:46:46 2022] DELETE /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:46:46.547391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dbf5be19-0551-4ae9-8c9a-e7818b0c2b6b tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:46.548114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dbf5be19-0551-4ae9-8c9a-e7818b0c2b6b tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 812a8ad7-8714-40c5-8243-ea20fbe816df] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:46.555325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbf5be19-0551-4ae9-8c9a-e7818b0c2b6b tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:46.555785 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbf5be19-0551-4ae9-8c9a-e7818b0c2b6b tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:46.556591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbf5be19-0551-4ae9-8c9a-e7818b0c2b6b tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:46.557102 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbf5be19-0551-4ae9-8c9a-e7818b0c2b6b tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:46.602875 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 21:46:46.603121 ncdv-master-1 devstack@n-api.service[131278]: Sat May 21 21:46:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df (ip 10.222.0.49) !!! May 21 21:46:46.709209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dbf5be19-0551-4ae9-8c9a-e7818b0c2b6b tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:46:46.717090 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dbf5be19-0551-4ae9-8c9a-e7818b0c2b6b tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df" status: 200 len: 1513 microversion: 2.1 time: 0.175739 May 21 21:46:46.724455 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2909/5941] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:46 2022] GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:46:47.472630 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 21:46:47.473163 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 21:46:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 21:46:47.735987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5f2a3230-3d19-4d82-89e0-b4daec7c419c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:47.736734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5f2a3230-3d19-4d82-89e0-b4daec7c419c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 812a8ad7-8714-40c5-8243-ea20fbe816df] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:47.744963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5f2a3230-3d19-4d82-89e0-b4daec7c419c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:47.747005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5f2a3230-3d19-4d82-89e0-b4daec7c419c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:47.747005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5f2a3230-3d19-4d82-89e0-b4daec7c419c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:47.747005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5f2a3230-3d19-4d82-89e0-b4daec7c419c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:47.903036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5f2a3230-3d19-4d82-89e0-b4daec7c419c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:46:47.912595 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5f2a3230-3d19-4d82-89e0-b4daec7c419c tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df" status: 200 len: 1513 microversion: 2.1 time: 0.181572 May 21 21:46:47.913280 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3033/5942] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:47 2022] GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:46:48.597403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-5143e9eb-c3b3-4152-bff6-c0ce9e020ad6 req-bd789768-f708-4e6d-87ee-d92200d019f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812a8ad7-8714-40c5-8243-ea20fbe816df", "name": "network-vif-deleted", "tag": "2221f4ea-6972-40c5-b498-570c625a4495"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:46:48.607402 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-5143e9eb-c3b3-4152-bff6-c0ce9e020ad6 req-bd789768-f708-4e6d-87ee-d92200d019f3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:48.607848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-5143e9eb-c3b3-4152-bff6-c0ce9e020ad6 req-bd789768-f708-4e6d-87ee-d92200d019f3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:48.620305 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-5143e9eb-c3b3-4152-bff6-c0ce9e020ad6 req-bd789768-f708-4e6d-87ee-d92200d019f3 service nova] Creating event network-vif-deleted:2221f4ea-6972-40c5-b498-570c625a4495 for instance 812a8ad7-8714-40c5-8243-ea20fbe816df on nch1-master-1 May 21 21:46:48.625224 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-5143e9eb-c3b3-4152-bff6-c0ce9e020ad6 req-bd789768-f708-4e6d-87ee-d92200d019f3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032059 May 21 21:46:48.625829 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2910/5943] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:46:48.935558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-50d6f255-cbf7-4f73-b115-2432ebbf1e04 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:48.936793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-50d6f255-cbf7-4f73-b115-2432ebbf1e04 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 812a8ad7-8714-40c5-8243-ea20fbe816df] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:48.945382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50d6f255-cbf7-4f73-b115-2432ebbf1e04 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:48.945852 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50d6f255-cbf7-4f73-b115-2432ebbf1e04 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:48.946683 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50d6f255-cbf7-4f73-b115-2432ebbf1e04 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:48.947113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50d6f255-cbf7-4f73-b115-2432ebbf1e04 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:48.980250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50d6f255-cbf7-4f73-b115-2432ebbf1e04 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:48.980748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50d6f255-cbf7-4f73-b115-2432ebbf1e04 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:48.981221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-50d6f255-cbf7-4f73-b115-2432ebbf1e04 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lazy-loading 'fault' on Instance uuid 812a8ad7-8714-40c5-8243-ea20fbe816df {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:46:49.028013 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-50d6f255-cbf7-4f73-b115-2432ebbf1e04 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:46:49.036588 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-50d6f255-cbf7-4f73-b115-2432ebbf1e04 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df" status: 200 len: 1308 microversion: 2.1 time: 0.107197 May 21 21:46:49.037112 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3034/5944] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:48 2022] GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:46:50.058854 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1b484863-67fc-4b81-88a2-4a959a1820db tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:46:50.059563 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1b484863-67fc-4b81-88a2-4a959a1820db tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 812a8ad7-8714-40c5-8243-ea20fbe816df] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:46:50.066732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b484863-67fc-4b81-88a2-4a959a1820db tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:50.067191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b484863-67fc-4b81-88a2-4a959a1820db tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:50.067986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b484863-67fc-4b81-88a2-4a959a1820db tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:46:50.068462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b484863-67fc-4b81-88a2-4a959a1820db tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:46:50.081812 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-1b484863-67fc-4b81-88a2-4a959a1820db tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] HTTP exception thrown: Instance 812a8ad7-8714-40c5-8243-ea20fbe816df could not be found. May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1b484863-67fc-4b81-88a2-4a959a1820db tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Request method failure captured: May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df HTTP/1.1 May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVzFkT9tssbVnxxOCZXwDEZe6rJ-Gc6rYExujke4rcIK_Q61mh208OtmzQwxzGS1IxR0whTou3xrDX2kCc2rVUgPFsQrFZWx5X1jgAUphoi3NxdgBqn9GuWq_MjF7guDRcjgfK8WPAbl24n6oni6mjkkKeDgajBnNAAO7pCQT50y0Jc May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 07e046067a8e4197b18860f9b9e1e344 May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2065732980 May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/07e046067a8e4197b18860f9b9e1e344"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/07e046067a8e4197b18860f9b9e1e344"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_07e046067a8e4197b18860f9b9e1e344", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/07e046067a8e4197b18860f9b9e1e344"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-VolumesSnapshotTestJSON-2065732980 May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 07e046067a8e4197b18860f9b9e1e344 May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2065732980 May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-VolumesSnapshotTestJSON-2065732980-project May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 88d6ab0c56ae4b16805f265728e20ed6 May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-VolumesSnapshotTestJSON-2065732980-project May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 812a8ad7-8714-40c5-8243-ea20fbe816df could not be found. May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '812a8ad7-8714-40c5-8243-ea20fbe816df'} May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 812a8ad7-8714-40c5-8243-ea20fbe816df could not be found. May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 812a8ad7-8714-40c5-8243-ea20fbe816df could not be found. May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:46:50.083453 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:46:50.088213 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:46:50.088213 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:46:50.088213 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:46:50.088213 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:46:50.088213 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:46:50.088213 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 812a8ad7-8714-40c5-8243-ea20fbe816df could not be found. May 21 21:46:50.088213 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:46:50.088213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1b484863-67fc-4b81-88a2-4a959a1820db tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Returning 404 to user: Instance 812a8ad7-8714-40c5-8243-ea20fbe816df could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:46:50.088213 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1b484863-67fc-4b81-88a2-4a959a1820db tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df" status: 404 len: 111 microversion: 2.1 time: 0.031208 May 21 21:46:50.088213 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2911/5945] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:46:50 2022] GET /compute/v2.1/servers/812a8ad7-8714-40c5-8243-ea20fbe816df => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:47:07.832665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3ce56297-93fe-4c0b-896d-e1dabb39d94e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1602782062", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "80ae28ec-4868-42c7-a453-aaf978cf6b40"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:47:07.840807 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:47:07.841490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:47:07.889403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-3ce56297-93fe-4c0b-896d-e1dabb39d94e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] validate_networks() for [('80ae28ec-4868-42c7-a453-aaf978cf6b40', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:47:08.314323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-3ce56297-93fe-4c0b-896d-e1dabb39d94e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:47:08.314761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-3ce56297-93fe-4c0b-896d-e1dabb39d94e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:47:08.315254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-3ce56297-93fe-4c0b-896d-e1dabb39d94e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:47:08.315677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-3ce56297-93fe-4c0b-896d-e1dabb39d94e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:47:08.316102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-3ce56297-93fe-4c0b-896d-e1dabb39d94e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:47:08.326308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3ce56297-93fe-4c0b-896d-e1dabb39d94e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:08.326955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3ce56297-93fe-4c0b-896d-e1dabb39d94e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:08.327859 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3ce56297-93fe-4c0b-896d-e1dabb39d94e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:08.328301 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3ce56297-93fe-4c0b-896d-e1dabb39d94e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:08.347583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-3ce56297-93fe-4c0b-896d-e1dabb39d94e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Getting quotas for project 07e046067a8e4197b18860f9b9e1e344. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:47:08.353087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-3ce56297-93fe-4c0b-896d-e1dabb39d94e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Getting quotas for user 88d6ab0c56ae4b16805f265728e20ed6 and project 07e046067a8e4197b18860f9b9e1e344. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:47:08.366108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3ce56297-93fe-4c0b-896d-e1dabb39d94e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:47:08.368767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3ce56297-93fe-4c0b-896d-e1dabb39d94e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 240299be-ecdf-462c-a876-72f02bcebeed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:47:08.503434 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3ce56297-93fe-4c0b-896d-e1dabb39d94e tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674769 May 21 21:47:08.504301 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3035/5946] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:47:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:47:08.514799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2c7ba29c-416f-4d83-8d69-5941421968b0 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:47:08.515437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2c7ba29c-416f-4d83-8d69-5941421968b0 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 240299be-ecdf-462c-a876-72f02bcebeed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:47:08.517791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=8 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:47:08.518469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:47:08.609857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2c7ba29c-416f-4d83-8d69-5941421968b0 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:47:08.621684 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2c7ba29c-416f-4d83-8d69-5941421968b0 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed" status: 200 len: 1219 microversion: 2.1 time: 0.111334 May 21 21:47:08.622280 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2912/5947] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:47:08 2022] GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:47:09.640960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0c0c786b-7a1c-4163-9b76-349764c5a3ae tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:47:09.640960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0c0c786b-7a1c-4163-9b76-349764c5a3ae tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 240299be-ecdf-462c-a876-72f02bcebeed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:47:09.648473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0c0c786b-7a1c-4163-9b76-349764c5a3ae tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:09.648983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0c0c786b-7a1c-4163-9b76-349764c5a3ae tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:09.649798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0c0c786b-7a1c-4163-9b76-349764c5a3ae tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:09.650291 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0c0c786b-7a1c-4163-9b76-349764c5a3ae tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:09.729318 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0c0c786b-7a1c-4163-9b76-349764c5a3ae tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:47:09.737403 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0c0c786b-7a1c-4163-9b76-349764c5a3ae tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed" status: 200 len: 1223 microversion: 2.1 time: 0.103608 May 21 21:47:09.740218 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3036/5948] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:47:09 2022] GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:47:10.755261 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c6bbb040-461e-4e8e-a454-26c92809f522 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:47:10.755920 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c6bbb040-461e-4e8e-a454-26c92809f522 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 240299be-ecdf-462c-a876-72f02bcebeed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:47:10.766098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c6bbb040-461e-4e8e-a454-26c92809f522 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:10.766552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c6bbb040-461e-4e8e-a454-26c92809f522 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:10.767330 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c6bbb040-461e-4e8e-a454-26c92809f522 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:10.767776 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c6bbb040-461e-4e8e-a454-26c92809f522 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:10.855571 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c6bbb040-461e-4e8e-a454-26c92809f522 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:47:10.855571 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c6bbb040-461e-4e8e-a454-26c92809f522 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed" status: 200 len: 1279 microversion: 2.1 time: 0.098786 May 21 21:47:10.855571 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2913/5949] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:47:10 2022] GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed => generated 1279 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:47:11.867212 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e5c0516a-c6b4-45e5-b997-ab921a4d2bf4 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:47:11.867885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e5c0516a-c6b4-45e5-b997-ab921a4d2bf4 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 240299be-ecdf-462c-a876-72f02bcebeed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:47:11.877098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5c0516a-c6b4-45e5-b997-ab921a4d2bf4 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:11.877679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5c0516a-c6b4-45e5-b997-ab921a4d2bf4 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:11.878947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5c0516a-c6b4-45e5-b997-ab921a4d2bf4 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:11.879394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e5c0516a-c6b4-45e5-b997-ab921a4d2bf4 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:12.190132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e5c0516a-c6b4-45e5-b997-ab921a4d2bf4 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:47:12.198036 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e5c0516a-c6b4-45e5-b997-ab921a4d2bf4 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed" status: 200 len: 1319 microversion: 2.1 time: 0.334774 May 21 21:47:12.201676 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3037/5950] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:47:11 2022] GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:47:12.905794 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-b7ddab66-ce19-42d3-964c-20e3ec8b7ce8 req-557f3fa9-8725-4e80-b382-f0d8b7623e70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "240299be-ecdf-462c-a876-72f02bcebeed", "tag": "1a6394fd-15ec-4067-98dd-6a95c5922777"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:47:12.915481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b7ddab66-ce19-42d3-964c-20e3ec8b7ce8 req-557f3fa9-8725-4e80-b382-f0d8b7623e70 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:12.915928 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b7ddab66-ce19-42d3-964c-20e3ec8b7ce8 req-557f3fa9-8725-4e80-b382-f0d8b7623e70 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:12.933554 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-b7ddab66-ce19-42d3-964c-20e3ec8b7ce8 req-557f3fa9-8725-4e80-b382-f0d8b7623e70 service nova] Creating event network-changed:1a6394fd-15ec-4067-98dd-6a95c5922777 for instance 240299be-ecdf-462c-a876-72f02bcebeed on nch1-master-1 May 21 21:47:12.943383 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-b7ddab66-ce19-42d3-964c-20e3ec8b7ce8 req-557f3fa9-8725-4e80-b382-f0d8b7623e70 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042976 May 21 21:47:12.944064 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2914/5951] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:47:13.217244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-246dd267-882c-4ba0-95cc-6f2d56ce36a1 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:47:13.217994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-246dd267-882c-4ba0-95cc-6f2d56ce36a1 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 240299be-ecdf-462c-a876-72f02bcebeed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:47:13.232656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-246dd267-882c-4ba0-95cc-6f2d56ce36a1 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:13.232656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-246dd267-882c-4ba0-95cc-6f2d56ce36a1 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:13.232656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-246dd267-882c-4ba0-95cc-6f2d56ce36a1 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:13.232656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-246dd267-882c-4ba0-95cc-6f2d56ce36a1 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:13.844382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-246dd267-882c-4ba0-95cc-6f2d56ce36a1 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:47:13.852016 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-246dd267-882c-4ba0-95cc-6f2d56ce36a1 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed" status: 200 len: 1319 microversion: 2.1 time: 0.639583 May 21 21:47:13.852630 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3038/5952] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:47:13 2022] GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed => generated 1319 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:47:14.870346 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-934d4676-fe7b-44ab-b861-ad899f1ebf72 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:47:14.871105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-934d4676-fe7b-44ab-b861-ad899f1ebf72 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 240299be-ecdf-462c-a876-72f02bcebeed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:47:14.877977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-934d4676-fe7b-44ab-b861-ad899f1ebf72 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:14.878433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-934d4676-fe7b-44ab-b861-ad899f1ebf72 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:14.879208 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-934d4676-fe7b-44ab-b861-ad899f1ebf72 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:14.879655 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-934d4676-fe7b-44ab-b861-ad899f1ebf72 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:15.034724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-934d4676-fe7b-44ab-b861-ad899f1ebf72 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:47:15.042481 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-934d4676-fe7b-44ab-b861-ad899f1ebf72 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed" status: 200 len: 1319 microversion: 2.1 time: 0.177233 May 21 21:47:15.043052 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2915/5953] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:47:14 2022] GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:47:16.063360 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a5dcc07a-5ba5-4914-a6a3-26097d0a2d64 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:47:16.064083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a5dcc07a-5ba5-4914-a6a3-26097d0a2d64 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 240299be-ecdf-462c-a876-72f02bcebeed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:47:16.071526 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5dcc07a-5ba5-4914-a6a3-26097d0a2d64 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:16.071990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5dcc07a-5ba5-4914-a6a3-26097d0a2d64 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:16.072806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5dcc07a-5ba5-4914-a6a3-26097d0a2d64 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:16.073256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5dcc07a-5ba5-4914-a6a3-26097d0a2d64 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:16.234382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a5dcc07a-5ba5-4914-a6a3-26097d0a2d64 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:47:16.242200 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a5dcc07a-5ba5-4914-a6a3-26097d0a2d64 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed" status: 200 len: 1319 microversion: 2.1 time: 0.186772 May 21 21:47:16.242813 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3039/5954] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:47:16 2022] GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:47:17.259391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2a34cc86-b6cc-4a13-b8e1-715b652f2717 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:47:17.260189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2a34cc86-b6cc-4a13-b8e1-715b652f2717 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 240299be-ecdf-462c-a876-72f02bcebeed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:47:17.268019 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a34cc86-b6cc-4a13-b8e1-715b652f2717 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:17.268502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a34cc86-b6cc-4a13-b8e1-715b652f2717 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:17.269292 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a34cc86-b6cc-4a13-b8e1-715b652f2717 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:17.269734 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a34cc86-b6cc-4a13-b8e1-715b652f2717 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:17.419777 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2a34cc86-b6cc-4a13-b8e1-715b652f2717 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:47:17.427518 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2a34cc86-b6cc-4a13-b8e1-715b652f2717 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed" status: 200 len: 1319 microversion: 2.1 time: 0.172238 May 21 21:47:17.428109 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2916/5955] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:47:17 2022] GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:47:18.444931 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4f8b030b-baff-4b9b-8e74-16f954fcc61f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:47:18.445550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4f8b030b-baff-4b9b-8e74-16f954fcc61f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 240299be-ecdf-462c-a876-72f02bcebeed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:47:18.448496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:47:18.449191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:47:18.455930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f8b030b-baff-4b9b-8e74-16f954fcc61f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:18.456699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f8b030b-baff-4b9b-8e74-16f954fcc61f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:18.457256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f8b030b-baff-4b9b-8e74-16f954fcc61f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:18.457710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4f8b030b-baff-4b9b-8e74-16f954fcc61f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:18.617003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4f8b030b-baff-4b9b-8e74-16f954fcc61f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:47:18.625849 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4f8b030b-baff-4b9b-8e74-16f954fcc61f tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed" status: 200 len: 1319 microversion: 2.1 time: 0.184968 May 21 21:47:18.626435 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3040/5956] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:47:18 2022] GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:47:18.737292 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-9f3390be-e3b7-4add-b052-4059392c3d13 req-2b6ba95a-f5c6-4e37-894d-26b27fff70d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "240299be-ecdf-462c-a876-72f02bcebeed", "name": "network-vif-plugged", "status": "completed", "tag": "1a6394fd-15ec-4067-98dd-6a95c5922777"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:47:18.741777 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:47:18.748034 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9f3390be-e3b7-4add-b052-4059392c3d13 req-2b6ba95a-f5c6-4e37-894d-26b27fff70d8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:18.748534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9f3390be-e3b7-4add-b052-4059392c3d13 req-2b6ba95a-f5c6-4e37-894d-26b27fff70d8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:18.760165 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-9f3390be-e3b7-4add-b052-4059392c3d13 req-2b6ba95a-f5c6-4e37-894d-26b27fff70d8 service nova] Creating event network-vif-plugged:1a6394fd-15ec-4067-98dd-6a95c5922777 for instance 240299be-ecdf-462c-a876-72f02bcebeed on nch1-master-1 May 21 21:47:18.765358 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-9f3390be-e3b7-4add-b052-4059392c3d13 req-2b6ba95a-f5c6-4e37-894d-26b27fff70d8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031721 May 21 21:47:18.765962 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2917/5957] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:47:19.647185 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-19bdefcd-6074-447e-8289-2dfec9925337 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:47:19.647854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-19bdefcd-6074-447e-8289-2dfec9925337 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 240299be-ecdf-462c-a876-72f02bcebeed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:47:19.655862 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19bdefcd-6074-447e-8289-2dfec9925337 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:19.656361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19bdefcd-6074-447e-8289-2dfec9925337 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:19.657159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19bdefcd-6074-447e-8289-2dfec9925337 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:19.657623 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-19bdefcd-6074-447e-8289-2dfec9925337 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:19.814815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-19bdefcd-6074-447e-8289-2dfec9925337 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:47:19.822453 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-19bdefcd-6074-447e-8289-2dfec9925337 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed" status: 200 len: 1319 microversion: 2.1 time: 0.179324 May 21 21:47:19.823028 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3041/5958] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:47:19 2022] GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:47:20.842145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-01c1b78d-2f9e-49be-a90b-af7f3818d9c3 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:47:20.842864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-01c1b78d-2f9e-49be-a90b-af7f3818d9c3 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 240299be-ecdf-462c-a876-72f02bcebeed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:47:20.849913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-01c1b78d-2f9e-49be-a90b-af7f3818d9c3 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:20.850367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-01c1b78d-2f9e-49be-a90b-af7f3818d9c3 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:20.851149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-01c1b78d-2f9e-49be-a90b-af7f3818d9c3 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:20.851592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-01c1b78d-2f9e-49be-a90b-af7f3818d9c3 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:21.000750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-01c1b78d-2f9e-49be-a90b-af7f3818d9c3 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:47:21.008420 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-01c1b78d-2f9e-49be-a90b-af7f3818d9c3 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed" status: 200 len: 1507 microversion: 2.1 time: 0.172100 May 21 21:47:21.008999 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2918/5959] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:47:20 2022] GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:47:21.025651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8b8d86fb-1256-4eae-9fb0-4cbd7022b5a7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83ee5203-dcde-4e2f-9c30-819d45781c45", "device": "/dev/sdb"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:47:21.026881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8b8d86fb-1256-4eae-9fb0-4cbd7022b5a7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 240299be-ecdf-462c-a876-72f02bcebeed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:47:21.034677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b8d86fb-1256-4eae-9fb0-4cbd7022b5a7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:21.035147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b8d86fb-1256-4eae-9fb0-4cbd7022b5a7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:21.035932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b8d86fb-1256-4eae-9fb0-4cbd7022b5a7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:47:21.036488 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b8d86fb-1256-4eae-9fb0-4cbd7022b5a7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:47:21.753080 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8b8d86fb-1256-4eae-9fb0-4cbd7022b5a7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "POST /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.731327 May 21 21:47:21.753668 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3042/5960] 10.222.0.49 () {60 vars in 1322 bytes} [Sat May 21 21:47:21 2022] POST /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed/os-volume_attachments => generated 194 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:48:50.373762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=16 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:48:50.382637 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=28 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:48:50.547272 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3d52eae1-18f3-41c7-9d5c-ef4aabad0bd2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:48:50.548297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3d52eae1-18f3-41c7-9d5c-ef4aabad0bd2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:48:50.555095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d52eae1-18f3-41c7-9d5c-ef4aabad0bd2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:48:50.555550 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d52eae1-18f3-41c7-9d5c-ef4aabad0bd2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:48:50.556599 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d52eae1-18f3-41c7-9d5c-ef4aabad0bd2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:48:50.557038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d52eae1-18f3-41c7-9d5c-ef4aabad0bd2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:48:50.607829 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3d52eae1-18f3-41c7-9d5c-ef4aabad0bd2 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "POST /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d/action" status: 200 len: 24568 microversion: 2.1 time: 0.235878 May 21 21:48:50.608487 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2919/5961] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:48:50 2022] POST /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d/action => generated 24568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:48:51.803325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:48:51.804152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:48:51.806843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-2683961c-1f90-486a-a883-dab8dce40546 req-2a61b0c8-7479-44a2-b663-1ef7c235ecb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca5309cd-f1d9-43de-afd7-808a2879de1d", "tag": "4ca581b3-4eeb-4848-bdd6-e64e1e8729d2"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:48:51.813390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5b929cd6-8adb-4716-9786-84ed119dec1b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:48:51.814215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5b929cd6-8adb-4716-9786-84ed119dec1b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:48:51.818281 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2683961c-1f90-486a-a883-dab8dce40546 req-2a61b0c8-7479-44a2-b663-1ef7c235ecb2 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:48:51.821087 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2683961c-1f90-486a-a883-dab8dce40546 req-2a61b0c8-7479-44a2-b663-1ef7c235ecb2 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:48:51.821201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b929cd6-8adb-4716-9786-84ed119dec1b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:48:51.821568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b929cd6-8adb-4716-9786-84ed119dec1b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:48:51.822385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b929cd6-8adb-4716-9786-84ed119dec1b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:48:51.823436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5b929cd6-8adb-4716-9786-84ed119dec1b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:48:51.831030 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-2683961c-1f90-486a-a883-dab8dce40546 req-2a61b0c8-7479-44a2-b663-1ef7c235ecb2 service nova] Creating event network-changed:4ca581b3-4eeb-4848-bdd6-e64e1e8729d2 for instance ca5309cd-f1d9-43de-afd7-808a2879de1d on nch2-master-1 May 21 21:48:51.836545 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-2683961c-1f90-486a-a883-dab8dce40546 req-2a61b0c8-7479-44a2-b663-1ef7c235ecb2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039504 May 21 21:48:51.837228 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2920/5962] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:48:51.860508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5b929cd6-8adb-4716-9786-84ed119dec1b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:48:52.180604 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5b929cd6-8adb-4716-9786-84ed119dec1b tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d" status: 204 len: 0 microversion: 2.1 time: 0.386857 May 21 21:48:52.181474 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3043/5963] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:48:51 2022] DELETE /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:48:52.190946 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2654e971-e4dd-458a-8ce8-f61c8c2230a0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:48:52.191630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2654e971-e4dd-458a-8ce8-f61c8c2230a0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:48:52.200373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2654e971-e4dd-458a-8ce8-f61c8c2230a0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:48:52.200832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2654e971-e4dd-458a-8ce8-f61c8c2230a0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:48:52.201615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2654e971-e4dd-458a-8ce8-f61c8c2230a0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:48:52.202055 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2654e971-e4dd-458a-8ce8-f61c8c2230a0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:48:52.353371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2654e971-e4dd-458a-8ce8-f61c8c2230a0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:48:52.361320 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2654e971-e4dd-458a-8ce8-f61c8c2230a0 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d" status: 200 len: 1578 microversion: 2.1 time: 0.174747 May 21 21:48:52.362748 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2921/5964] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:48:52 2022] GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:48:53.380256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ce8b9aff-69d4-4580-a7dc-4f3fa2258b37 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:48:53.381279 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ce8b9aff-69d4-4580-a7dc-4f3fa2258b37 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:48:53.388872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce8b9aff-69d4-4580-a7dc-4f3fa2258b37 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:48:53.389500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce8b9aff-69d4-4580-a7dc-4f3fa2258b37 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:48:53.390314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce8b9aff-69d4-4580-a7dc-4f3fa2258b37 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:48:53.390771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce8b9aff-69d4-4580-a7dc-4f3fa2258b37 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:48:53.563570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ce8b9aff-69d4-4580-a7dc-4f3fa2258b37 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:48:53.572926 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ce8b9aff-69d4-4580-a7dc-4f3fa2258b37 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d" status: 200 len: 1578 microversion: 2.1 time: 0.197292 May 21 21:48:53.573518 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3044/5965] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:48:53 2022] GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d => generated 1578 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:48:54.591266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c09b11fb-3b29-438b-bf75-f4474b9f4bcc tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:48:54.591885 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c09b11fb-3b29-438b-bf75-f4474b9f4bcc tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:48:54.599730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c09b11fb-3b29-438b-bf75-f4474b9f4bcc tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:48:54.600399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c09b11fb-3b29-438b-bf75-f4474b9f4bcc tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:48:54.601408 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c09b11fb-3b29-438b-bf75-f4474b9f4bcc tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:48:54.601860 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c09b11fb-3b29-438b-bf75-f4474b9f4bcc tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:48:54.706635 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c09b11fb-3b29-438b-bf75-f4474b9f4bcc tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:48:54.715440 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c09b11fb-3b29-438b-bf75-f4474b9f4bcc tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d" status: 200 len: 1392 microversion: 2.1 time: 0.128140 May 21 21:48:54.716028 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2922/5966] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:48:54 2022] GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d => generated 1392 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:48:54.794118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-ca899110-67fc-4b3a-afc4-acbc2d6e1643 req-39012d59-3d5c-4f4f-a733-9e6aea38abcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca5309cd-f1d9-43de-afd7-808a2879de1d", "name": "network-vif-deleted", "tag": "4ca581b3-4eeb-4848-bdd6-e64e1e8729d2"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:48:54.805388 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ca899110-67fc-4b3a-afc4-acbc2d6e1643 req-39012d59-3d5c-4f4f-a733-9e6aea38abcc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:48:54.806140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ca899110-67fc-4b3a-afc4-acbc2d6e1643 req-39012d59-3d5c-4f4f-a733-9e6aea38abcc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:48:54.818735 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-ca899110-67fc-4b3a-afc4-acbc2d6e1643 req-39012d59-3d5c-4f4f-a733-9e6aea38abcc service nova] Creating event network-vif-deleted:4ca581b3-4eeb-4848-bdd6-e64e1e8729d2 for instance ca5309cd-f1d9-43de-afd7-808a2879de1d on nch2-master-1 May 21 21:48:54.824164 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-ca899110-67fc-4b3a-afc4-acbc2d6e1643 req-39012d59-3d5c-4f4f-a733-9e6aea38abcc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110168 May 21 21:48:54.824748 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3045/5967] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:48:55.733070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6f3fdcb6-9ec1-4d27-b8b4-71274374c376 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:48:55.733727 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6f3fdcb6-9ec1-4d27-b8b4-71274374c376 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:48:55.741399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f3fdcb6-9ec1-4d27-b8b4-71274374c376 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:48:55.745369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f3fdcb6-9ec1-4d27-b8b4-71274374c376 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:48:55.745369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f3fdcb6-9ec1-4d27-b8b4-71274374c376 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:48:55.745369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f3fdcb6-9ec1-4d27-b8b4-71274374c376 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:48:55.809862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6f3fdcb6-9ec1-4d27-b8b4-71274374c376 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:48:55.818643 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6f3fdcb6-9ec1-4d27-b8b4-71274374c376 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d" status: 200 len: 1226 microversion: 2.1 time: 0.089505 May 21 21:48:55.819301 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2923/5968] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:48:55 2022] GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:48:56.835528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f26fad69-dcb9-4157-8b7d-50097bea9bc6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:48:56.836334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f26fad69-dcb9-4157-8b7d-50097bea9bc6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:48:56.844050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f26fad69-dcb9-4157-8b7d-50097bea9bc6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:48:56.848186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f26fad69-dcb9-4157-8b7d-50097bea9bc6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:48:56.848186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f26fad69-dcb9-4157-8b7d-50097bea9bc6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:48:56.848186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f26fad69-dcb9-4157-8b7d-50097bea9bc6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:48:56.927185 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f26fad69-dcb9-4157-8b7d-50097bea9bc6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730839d5531644eb9aa26dabe2fbd8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8149564857f64342aef93f18c0d90eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:48:56.936244 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f26fad69-dcb9-4157-8b7d-50097bea9bc6 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d" status: 200 len: 1226 microversion: 2.1 time: 0.104811 May 21 21:48:56.936805 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3046/5969] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:48:56 2022] GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:48:57.959110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7310ca43-79bc-4071-b1ac-3b3e1e1ca1e7 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:48:57.959689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7310ca43-79bc-4071-b1ac-3b3e1e1ca1e7 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] [instance: ca5309cd-f1d9-43de-afd7-808a2879de1d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:48:57.968110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7310ca43-79bc-4071-b1ac-3b3e1e1ca1e7 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:48:57.968681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7310ca43-79bc-4071-b1ac-3b3e1e1ca1e7 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:48:57.969630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7310ca43-79bc-4071-b1ac-3b3e1e1ca1e7 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:48:57.970125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7310ca43-79bc-4071-b1ac-3b3e1e1ca1e7 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:48:57.988204 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-7310ca43-79bc-4071-b1ac-3b3e1e1ca1e7 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] HTTP exception thrown: Instance ca5309cd-f1d9-43de-afd7-808a2879de1d could not be found. May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7310ca43-79bc-4071-b1ac-3b3e1e1ca1e7 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Request method failure captured: May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d HTTP/1.1 May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiVyb9roFCu9pnW6_pGv_nwgdhY8sEs_xi4xzjfpDmQYM_NB-BEWin4ww1-OB-8Ni8Qy5i-drXJJg6PZ5rgg6kLY2EzVB8CGkx9nUQjfPTlEOhCIPDxJkqBjIKr09mBAiVYVzwVkvD5WDNG25XAxQrBLXY2awCOo8K-DKCVfdi9UoZVs May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 8149564857f64342aef93f18c0d90eb1 May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestVolumeBootPattern-343249266 May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8149564857f64342aef93f18c0d90eb1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8149564857f64342aef93f18c0d90eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestVolumeBootPattern-343249266 May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 8149564857f64342aef93f18c0d90eb1 May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestVolumeBootPattern-343249266 May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestVolumeBootPattern-343249266-project May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 730839d5531644eb9aa26dabe2fbd8f6 May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestVolumeBootPattern-343249266-project May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance ca5309cd-f1d9-43de-afd7-808a2879de1d could not be found. May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'ca5309cd-f1d9-43de-afd7-808a2879de1d'} May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca5309cd-f1d9-43de-afd7-808a2879de1d could not be found. May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca5309cd-f1d9-43de-afd7-808a2879de1d could not be found. May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:48:57.990000 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:48:57.995078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:48:57.995078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:48:57.995078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:48:57.995078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:48:57.995078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:48:57.995078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca5309cd-f1d9-43de-afd7-808a2879de1d could not be found. May 21 21:48:57.995078 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:48:57.995078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7310ca43-79bc-4071-b1ac-3b3e1e1ca1e7 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Returning 404 to user: Instance ca5309cd-f1d9-43de-afd7-808a2879de1d could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:48:57.995078 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7310ca43-79bc-4071-b1ac-3b3e1e1ca1e7 tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d" status: 404 len: 111 microversion: 2.1 time: 0.041276 May 21 21:48:57.995078 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2924/5970] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:48:57 2022] GET /compute/v2.1/servers/ca5309cd-f1d9-43de-afd7-808a2879de1d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:49:07.936694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dd730721-c673-41e3-911c-0382e0767a4d tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] Calling method '.version_select at 0x7fc81a3e8a60>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:49:07.943881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:49:07.943881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:49:08.052911 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dd730721-c673-41e3-911c-0382e0767a4d tempest-TestVolumeBootPattern-343249266 tempest-TestVolumeBootPattern-343249266-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1881011435" status: 202 len: 0 microversion: 2.1 time: 0.120369 May 21 21:49:08.053583 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3047/5971] 10.222.0.49 () {58 vars in 1262 bytes} [Sat May 21 21:49:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1881011435 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:49:10.194162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bc4d269f-49dc-42ed-b14c-c57353380612 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:49:10.194750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bc4d269f-49dc-42ed-b14c-c57353380612 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 240299be-ecdf-462c-a876-72f02bcebeed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:49:10.209656 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=12 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:49:10.210853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=26 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:49:10.213509 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc4d269f-49dc-42ed-b14c-c57353380612 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:10.217975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc4d269f-49dc-42ed-b14c-c57353380612 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:10.217975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc4d269f-49dc-42ed-b14c-c57353380612 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:10.217975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc4d269f-49dc-42ed-b14c-c57353380612 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:10.368040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-bc4d269f-49dc-42ed-b14c-c57353380612 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lazy-loading 'services' on Instance uuid 240299be-ecdf-462c-a876-72f02bcebeed {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:49:10.607643 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bc4d269f-49dc-42ed-b14c-c57353380612 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "DELETE /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed/os-volume_attachments/83ee5203-dcde-4e2f-9c30-819d45781c45" status: 202 len: 0 microversion: 2.1 time: 0.418568 May 21 21:49:10.612488 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2925/5972] 10.222.0.49 () {58 vars in 1415 bytes} [Sat May 21 21:49:10 2022] DELETE /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed/os-volume_attachments/83ee5203-dcde-4e2f-9c30-819d45781c45 => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:49:11.502022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-513047d7-de5e-4e12-853a-d0aff282e020 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'create', calling method: .version_select at 0x7fc81b6b08b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1291906418", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJi6CnAAMxNDdnsS2juR31VY8FZGAmHC/UZds76oxcfLdR7U+HJdRbrt5vKIumYoCFLRIUjkWMHxkE+97ArFU+uozWwDuRmFFeGBfPyyPKPXXmjJlrehl63u0GtsKbTNg=="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:49:11.537621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-513047d7-de5e-4e12-853a-d0aff282e020 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Getting quotas for project 3b2e8e3a4821406893ebe9c189311cbf. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:49:11.550618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-513047d7-de5e-4e12-853a-d0aff282e020 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Getting quotas for user 3083c05994cd4f599a2def7fa1281d60 and project 3b2e8e3a4821406893ebe9c189311cbf. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:49:11.691264 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-513047d7-de5e-4e12-853a-d0aff282e020 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.654999 May 21 21:49:11.697912 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3048/5973] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:49:11 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:49:11.776253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-66f83b0c-04d7-45b8-bc3b-91cff95461b7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:49:11.777421 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-66f83b0c-04d7-45b8-bc3b-91cff95461b7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 240299be-ecdf-462c-a876-72f02bcebeed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:49:11.793830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66f83b0c-04d7-45b8-bc3b-91cff95461b7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:11.794623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66f83b0c-04d7-45b8-bc3b-91cff95461b7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:11.795818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66f83b0c-04d7-45b8-bc3b-91cff95461b7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:11.797133 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66f83b0c-04d7-45b8-bc3b-91cff95461b7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:11.828018 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-66f83b0c-04d7-45b8-bc3b-91cff95461b7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 240299be-ecdf-462c-a876-72f02bcebeed] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:49:12.284436 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-66f83b0c-04d7-45b8-bc3b-91cff95461b7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "DELETE /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed" status: 204 len: 0 microversion: 2.1 time: 0.514502 May 21 21:49:12.289767 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2926/5974] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:49:11 2022] DELETE /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:49:12.297672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f5b11d3d-79bc-4346-8c4e-1f58085014a7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:49:12.298357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f5b11d3d-79bc-4346-8c4e-1f58085014a7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 240299be-ecdf-462c-a876-72f02bcebeed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:49:12.305587 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5b11d3d-79bc-4346-8c4e-1f58085014a7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:12.306054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5b11d3d-79bc-4346-8c4e-1f58085014a7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:12.307116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5b11d3d-79bc-4346-8c4e-1f58085014a7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:12.307633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5b11d3d-79bc-4346-8c4e-1f58085014a7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:12.502234 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f5b11d3d-79bc-4346-8c4e-1f58085014a7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:49:12.510962 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f5b11d3d-79bc-4346-8c4e-1f58085014a7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed" status: 200 len: 1513 microversion: 2.1 time: 0.219778 May 21 21:49:12.511540 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3049/5975] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:49:12 2022] GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed => generated 1513 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:49:13.540172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bc1374ff-4675-4487-9173-a0b5b969e4e7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:49:13.541516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bc1374ff-4675-4487-9173-a0b5b969e4e7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 240299be-ecdf-462c-a876-72f02bcebeed] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:49:13.565018 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc1374ff-4675-4487-9173-a0b5b969e4e7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:13.565495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc1374ff-4675-4487-9173-a0b5b969e4e7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:13.566301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc1374ff-4675-4487-9173-a0b5b969e4e7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:13.567758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc1374ff-4675-4487-9173-a0b5b969e4e7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:13.747186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bc1374ff-4675-4487-9173-a0b5b969e4e7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:49:13.757260 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bc1374ff-4675-4487-9173-a0b5b969e4e7 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed" status: 200 len: 1513 microversion: 2.1 time: 0.226229 May 21 21:49:13.761737 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2927/5976] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:49:13 2022] GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:49:14.774798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2a069e34-46d1-4db9-8af5-9d295a5fd853 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:49:14.775437 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2a069e34-46d1-4db9-8af5-9d295a5fd853 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 240299be-ecdf-462c-a876-72f02bcebeed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:49:14.782368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a069e34-46d1-4db9-8af5-9d295a5fd853 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:14.783465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a069e34-46d1-4db9-8af5-9d295a5fd853 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:14.784702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a069e34-46d1-4db9-8af5-9d295a5fd853 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:14.785143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a069e34-46d1-4db9-8af5-9d295a5fd853 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:15.114630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2a069e34-46d1-4db9-8af5-9d295a5fd853 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d6ab0c56ae4b16805f265728e20ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e046067a8e4197b18860f9b9e1e344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:49:15.131662 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2a069e34-46d1-4db9-8af5-9d295a5fd853 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed" status: 200 len: 1513 microversion: 2.1 time: 0.360725 May 21 21:49:15.132905 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3050/5977] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:49:14 2022] GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed => generated 1513 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:49:15.141200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-66f94ebc-04fe-4b08-9ac3-4bfbe74cae68 req-d30d03fa-bf2c-4e72-9e1f-fffe0d631c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "240299be-ecdf-462c-a876-72f02bcebeed", "name": "network-vif-deleted", "tag": "1a6394fd-15ec-4067-98dd-6a95c5922777"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:49:15.152833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-66f94ebc-04fe-4b08-9ac3-4bfbe74cae68 req-d30d03fa-bf2c-4e72-9e1f-fffe0d631c07 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:15.153292 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-66f94ebc-04fe-4b08-9ac3-4bfbe74cae68 req-d30d03fa-bf2c-4e72-9e1f-fffe0d631c07 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:15.167752 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-66f94ebc-04fe-4b08-9ac3-4bfbe74cae68 req-d30d03fa-bf2c-4e72-9e1f-fffe0d631c07 service nova] Creating event network-vif-deleted:1a6394fd-15ec-4067-98dd-6a95c5922777 for instance 240299be-ecdf-462c-a876-72f02bcebeed on nch1-master-1 May 21 21:49:15.174793 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-66f94ebc-04fe-4b08-9ac3-4bfbe74cae68 req-d30d03fa-bf2c-4e72-9e1f-fffe0d631c07 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045141 May 21 21:49:15.175657 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2928/5978] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:49:16.151202 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-227dc897-74b9-462c-9244-ee9aa0116d44 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:49:16.152436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-227dc897-74b9-462c-9244-ee9aa0116d44 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] [instance: 240299be-ecdf-462c-a876-72f02bcebeed] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:49:16.159906 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-227dc897-74b9-462c-9244-ee9aa0116d44 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:16.160839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-227dc897-74b9-462c-9244-ee9aa0116d44 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:16.167832 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-227dc897-74b9-462c-9244-ee9aa0116d44 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:16.167832 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-227dc897-74b9-462c-9244-ee9aa0116d44 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:16.177589 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-227dc897-74b9-462c-9244-ee9aa0116d44 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] HTTP exception thrown: Instance 240299be-ecdf-462c-a876-72f02bcebeed could not be found. May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-227dc897-74b9-462c-9244-ee9aa0116d44 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Request method failure captured: May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed HTTP/1.1 May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiVzFkT9tssbVnxxOCZXwDEZe6rJ-Gc6rYExujke4rcIK_Q61mh208OtmzQwxzGS1IxR0whTou3xrDX2kCc2rVUgPFsQrFZWx5X1jgAUphoi3NxdgBqn9GuWq_MjF7guDRcjgfK8WPAbl24n6oni6mjkkKeDgajBnNAAO7pCQT50y0Jc May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 07e046067a8e4197b18860f9b9e1e344 May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2065732980 May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/07e046067a8e4197b18860f9b9e1e344"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/07e046067a8e4197b18860f9b9e1e344"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_07e046067a8e4197b18860f9b9e1e344", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/07e046067a8e4197b18860f9b9e1e344"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-VolumesSnapshotTestJSON-2065732980 May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 07e046067a8e4197b18860f9b9e1e344 May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2065732980 May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-VolumesSnapshotTestJSON-2065732980-project May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 88d6ab0c56ae4b16805f265728e20ed6 May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-VolumesSnapshotTestJSON-2065732980-project May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 240299be-ecdf-462c-a876-72f02bcebeed could not be found. May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '240299be-ecdf-462c-a876-72f02bcebeed'} May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 240299be-ecdf-462c-a876-72f02bcebeed could not be found. May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 240299be-ecdf-462c-a876-72f02bcebeed could not be found. May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:49:16.179305 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:49:16.184763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:49:16.184763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:49:16.184763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:49:16.184763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:49:16.184763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:49:16.184763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 240299be-ecdf-462c-a876-72f02bcebeed could not be found. May 21 21:49:16.184763 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:49:16.184763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-227dc897-74b9-462c-9244-ee9aa0116d44 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] Returning 404 to user: Instance 240299be-ecdf-462c-a876-72f02bcebeed could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:49:16.184763 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-227dc897-74b9-462c-9244-ee9aa0116d44 tempest-VolumesSnapshotTestJSON-2065732980 tempest-VolumesSnapshotTestJSON-2065732980-project] 10.222.0.49 "GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed" status: 404 len: 111 microversion: 2.1 time: 0.033592 May 21 21:49:16.184763 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3051/5979] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:49:16 2022] GET /compute/v2.1/servers/240299be-ecdf-462c-a876-72f02bcebeed => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:49:23.646428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4b6f6882-ef87-4ffb-b166-65f683198276 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-841631961", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "20bd79f9-b28a-4a04-9444-fd485ba06ab8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1291906418", "security_groups": [{"name": "tempest-secgroup-smoke-1816680644"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:49:23.819806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-4b6f6882-ef87-4ffb-b166-65f683198276 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] validate_networks() for [('20bd79f9-b28a-4a04-9444-fd485ba06ab8', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:49:24.543828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-4b6f6882-ef87-4ffb-b166-65f683198276 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:49:24.544564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-4b6f6882-ef87-4ffb-b166-65f683198276 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:49:24.545049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-4b6f6882-ef87-4ffb-b166-65f683198276 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:49:24.545509 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-4b6f6882-ef87-4ffb-b166-65f683198276 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:49:24.547446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-4b6f6882-ef87-4ffb-b166-65f683198276 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:49:24.559093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b6f6882-ef87-4ffb-b166-65f683198276 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:24.562362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b6f6882-ef87-4ffb-b166-65f683198276 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:24.562362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b6f6882-ef87-4ffb-b166-65f683198276 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:24.562362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4b6f6882-ef87-4ffb-b166-65f683198276 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:24.594471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-4b6f6882-ef87-4ffb-b166-65f683198276 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Getting quotas for project 3b2e8e3a4821406893ebe9c189311cbf. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:49:24.603901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-4b6f6882-ef87-4ffb-b166-65f683198276 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Getting quotas for user 3083c05994cd4f599a2def7fa1281d60 and project 3b2e8e3a4821406893ebe9c189311cbf. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:49:24.618955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4b6f6882-ef87-4ffb-b166-65f683198276 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:49:24.621708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4b6f6882-ef87-4ffb-b166-65f683198276 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:49:24.756884 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4b6f6882-ef87-4ffb-b166-65f683198276 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.115039 May 21 21:49:24.769248 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2929/5980] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:49:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:49:24.769493 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b7fa15b5-12e6-4168-b627-1d5a10ed795b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:49:24.771594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b7fa15b5-12e6-4168-b627-1d5a10ed795b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:49:24.795968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:49:24.892854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b7fa15b5-12e6-4168-b627-1d5a10ed795b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:49:24.908614 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b7fa15b5-12e6-4168-b627-1d5a10ed795b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1266 microversion: 2.1 time: 0.144197 May 21 21:49:24.910482 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3052/5981] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:49:24 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:49:25.928198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0beaafbf-9ef8-4042-b7ea-77641020e904 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:49:25.929155 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0beaafbf-9ef8-4042-b7ea-77641020e904 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:49:25.993501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0beaafbf-9ef8-4042-b7ea-77641020e904 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:49:26.001010 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0beaafbf-9ef8-4042-b7ea-77641020e904 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1266 microversion: 2.1 time: 0.078303 May 21 21:49:26.002387 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2930/5982] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:49:25 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:49:27.019788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-99e68654-51c7-4464-aa80-29eadc18853a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:49:27.020334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-99e68654-51c7-4464-aa80-29eadc18853a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:49:27.027971 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=14 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:49:27.030497 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-99e68654-51c7-4464-aa80-29eadc18853a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:27.031014 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-99e68654-51c7-4464-aa80-29eadc18853a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:27.031802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-99e68654-51c7-4464-aa80-29eadc18853a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:27.032257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-99e68654-51c7-4464-aa80-29eadc18853a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:27.111856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-99e68654-51c7-4464-aa80-29eadc18853a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:49:27.121462 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-99e68654-51c7-4464-aa80-29eadc18853a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1318 microversion: 2.1 time: 0.105475 May 21 21:49:27.124326 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3053/5983] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:49:27 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1318 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:49:28.138587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-65c29e06-b44f-4e59-87c9-e89542d5bf39 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:49:28.139215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-65c29e06-b44f-4e59-87c9-e89542d5bf39 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:49:28.153612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65c29e06-b44f-4e59-87c9-e89542d5bf39 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:28.155869 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65c29e06-b44f-4e59-87c9-e89542d5bf39 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:28.158616 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65c29e06-b44f-4e59-87c9-e89542d5bf39 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:28.159539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65c29e06-b44f-4e59-87c9-e89542d5bf39 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:28.233239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-65c29e06-b44f-4e59-87c9-e89542d5bf39 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:49:28.241637 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-65c29e06-b44f-4e59-87c9-e89542d5bf39 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1324 microversion: 2.1 time: 0.107090 May 21 21:49:28.251921 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2931/5984] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:49:28 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1324 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:49:29.259641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cde1b3df-f019-4194-8915-8886c0901447 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:49:29.260421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cde1b3df-f019-4194-8915-8886c0901447 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:49:29.270043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cde1b3df-f019-4194-8915-8886c0901447 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:29.270637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cde1b3df-f019-4194-8915-8886c0901447 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:29.271665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cde1b3df-f019-4194-8915-8886c0901447 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:29.272418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cde1b3df-f019-4194-8915-8886c0901447 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:29.472965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cde1b3df-f019-4194-8915-8886c0901447 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:49:29.480622 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cde1b3df-f019-4194-8915-8886c0901447 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1392 microversion: 2.1 time: 0.225488 May 21 21:49:29.481199 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3054/5985] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:49:29 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1392 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:49:29.725902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-b23ae40b-66ef-44cd-a563-a0af622f2b77 req-1a0175f7-2121-475b-9a81-cd2b72567cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b5d5ca4-8254-4287-a682-0393951bfb7d", "tag": "079739f3-5bd8-4b2e-919a-ddd4ca9e7d87"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:49:29.734785 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b23ae40b-66ef-44cd-a563-a0af622f2b77 req-1a0175f7-2121-475b-9a81-cd2b72567cd7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:29.735239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b23ae40b-66ef-44cd-a563-a0af622f2b77 req-1a0175f7-2121-475b-9a81-cd2b72567cd7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:29.748727 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-b23ae40b-66ef-44cd-a563-a0af622f2b77 req-1a0175f7-2121-475b-9a81-cd2b72567cd7 service nova] Creating event network-changed:079739f3-5bd8-4b2e-919a-ddd4ca9e7d87 for instance 7b5d5ca4-8254-4287-a682-0393951bfb7d on nch1-master-1 May 21 21:49:29.754361 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-b23ae40b-66ef-44cd-a563-a0af622f2b77 req-1a0175f7-2121-475b-9a81-cd2b72567cd7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211043 May 21 21:49:29.755102 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2932/5986] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:49:30.498173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e8ba208b-d26f-41ab-8489-f52e50b64433 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:49:30.498803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e8ba208b-d26f-41ab-8489-f52e50b64433 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:49:30.506828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8ba208b-d26f-41ab-8489-f52e50b64433 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:30.507301 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8ba208b-d26f-41ab-8489-f52e50b64433 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:30.508091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8ba208b-d26f-41ab-8489-f52e50b64433 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:30.508569 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8ba208b-d26f-41ab-8489-f52e50b64433 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:30.655748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e8ba208b-d26f-41ab-8489-f52e50b64433 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:49:30.663984 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e8ba208b-d26f-41ab-8489-f52e50b64433 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1392 microversion: 2.1 time: 0.169790 May 21 21:49:30.664621 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3055/5987] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:49:30 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:49:31.683175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2c7fcab2-3e5f-45b4-b302-8bd11d97b703 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:49:31.684781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2c7fcab2-3e5f-45b4-b302-8bd11d97b703 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:49:31.692765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c7fcab2-3e5f-45b4-b302-8bd11d97b703 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:31.693569 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c7fcab2-3e5f-45b4-b302-8bd11d97b703 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:31.694203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c7fcab2-3e5f-45b4-b302-8bd11d97b703 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:31.694646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c7fcab2-3e5f-45b4-b302-8bd11d97b703 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:31.876234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2c7fcab2-3e5f-45b4-b302-8bd11d97b703 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:49:31.886246 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2c7fcab2-3e5f-45b4-b302-8bd11d97b703 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1392 microversion: 2.1 time: 0.208241 May 21 21:49:31.892389 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2933/5988] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:49:31 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1392 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:49:32.904355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9c5e1444-60cc-4395-aa58-8b471d993312 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:49:32.905146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9c5e1444-60cc-4395-aa58-8b471d993312 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:49:32.912410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c5e1444-60cc-4395-aa58-8b471d993312 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:32.912887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c5e1444-60cc-4395-aa58-8b471d993312 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:32.913710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c5e1444-60cc-4395-aa58-8b471d993312 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:32.914466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c5e1444-60cc-4395-aa58-8b471d993312 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:33.074576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9c5e1444-60cc-4395-aa58-8b471d993312 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:49:33.083897 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9c5e1444-60cc-4395-aa58-8b471d993312 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1392 microversion: 2.1 time: 0.183349 May 21 21:49:33.084518 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3056/5989] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:49:32 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1392 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:49:33.295108 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-650116c4-099b-4f3a-b83e-1a56c45d81e6 req-fced787c-73f1-46cd-9bff-117a022da2ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5d5ca4-8254-4287-a682-0393951bfb7d", "name": "network-vif-plugged", "status": "completed", "tag": "079739f3-5bd8-4b2e-919a-ddd4ca9e7d87"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:49:33.305608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-650116c4-099b-4f3a-b83e-1a56c45d81e6 req-fced787c-73f1-46cd-9bff-117a022da2ba service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:33.306095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-650116c4-099b-4f3a-b83e-1a56c45d81e6 req-fced787c-73f1-46cd-9bff-117a022da2ba service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:33.318105 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-650116c4-099b-4f3a-b83e-1a56c45d81e6 req-fced787c-73f1-46cd-9bff-117a022da2ba service nova] Creating event network-vif-plugged:079739f3-5bd8-4b2e-919a-ddd4ca9e7d87 for instance 7b5d5ca4-8254-4287-a682-0393951bfb7d on nch1-master-1 May 21 21:49:33.322988 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-650116c4-099b-4f3a-b83e-1a56c45d81e6 req-fced787c-73f1-46cd-9bff-117a022da2ba service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031669 May 21 21:49:33.323579 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2934/5990] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:49:34.102672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-477f176c-87eb-4052-818b-68aef0b65156 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:49:34.103302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-477f176c-87eb-4052-818b-68aef0b65156 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:49:34.110401 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-477f176c-87eb-4052-818b-68aef0b65156 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:34.110899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-477f176c-87eb-4052-818b-68aef0b65156 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:34.111686 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-477f176c-87eb-4052-818b-68aef0b65156 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:34.112141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-477f176c-87eb-4052-818b-68aef0b65156 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:34.267796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-477f176c-87eb-4052-818b-68aef0b65156 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:49:34.281644 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-477f176c-87eb-4052-818b-68aef0b65156 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1392 microversion: 2.1 time: 0.177907 May 21 21:49:34.281644 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3057/5991] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:49:34 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:49:35.300210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:49:35.305765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-47c89b6a-0437-4208-afbd-5efa9565eafd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:49:35.306481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-47c89b6a-0437-4208-afbd-5efa9565eafd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:49:35.314033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-47c89b6a-0437-4208-afbd-5efa9565eafd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:35.314684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-47c89b6a-0437-4208-afbd-5efa9565eafd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:35.315473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-47c89b6a-0437-4208-afbd-5efa9565eafd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:35.320562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-47c89b6a-0437-4208-afbd-5efa9565eafd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:35.472437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-47c89b6a-0437-4208-afbd-5efa9565eafd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:49:35.480543 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-47c89b6a-0437-4208-afbd-5efa9565eafd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1564 microversion: 2.1 time: 0.183266 May 21 21:49:35.481134 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2935/5992] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:49:35 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1564 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:49:35.496980 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-739f35af-7d6e-41f7-8d64-e8b1027e57d6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:49:35.497634 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-739f35af-7d6e-41f7-8d64-e8b1027e57d6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:49:35.505134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-739f35af-7d6e-41f7-8d64-e8b1027e57d6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:35.505879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-739f35af-7d6e-41f7-8d64-e8b1027e57d6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:35.509042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-739f35af-7d6e-41f7-8d64-e8b1027e57d6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:35.509355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-739f35af-7d6e-41f7-8d64-e8b1027e57d6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:35.669844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-739f35af-7d6e-41f7-8d64-e8b1027e57d6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:49:35.678333 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-739f35af-7d6e-41f7-8d64-e8b1027e57d6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1564 microversion: 2.1 time: 0.185248 May 21 21:49:35.678923 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3058/5993] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:49:35 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1564 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:49:38.019622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-b2891465-90a5-493a-9760-20d339458893 req-098bd50e-98c9-40eb-8b09-1669372c9371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b5d5ca4-8254-4287-a682-0393951bfb7d", "tag": "079739f3-5bd8-4b2e-919a-ddd4ca9e7d87"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:49:38.023898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:49:38.025908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-268ebfba-54a3-4143-b72d-6cf2e2d34375 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:49:38.026534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-268ebfba-54a3-4143-b72d-6cf2e2d34375 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:49:38.028493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=8 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:49:38.034943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-268ebfba-54a3-4143-b72d-6cf2e2d34375 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:38.035399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-268ebfba-54a3-4143-b72d-6cf2e2d34375 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:38.035986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b2891465-90a5-493a-9760-20d339458893 req-098bd50e-98c9-40eb-8b09-1669372c9371 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:38.036174 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-268ebfba-54a3-4143-b72d-6cf2e2d34375 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:38.036521 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b2891465-90a5-493a-9760-20d339458893 req-098bd50e-98c9-40eb-8b09-1669372c9371 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:38.036825 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-268ebfba-54a3-4143-b72d-6cf2e2d34375 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:38.053147 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-b2891465-90a5-493a-9760-20d339458893 req-098bd50e-98c9-40eb-8b09-1669372c9371 service nova] Creating event network-changed:079739f3-5bd8-4b2e-919a-ddd4ca9e7d87 for instance 7b5d5ca4-8254-4287-a682-0393951bfb7d on nch1-master-1 May 21 21:49:38.059065 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-b2891465-90a5-493a-9760-20d339458893 req-098bd50e-98c9-40eb-8b09-1669372c9371 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043550 May 21 21:49:38.063803 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3059/5994] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:49:38.194789 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-268ebfba-54a3-4143-b72d-6cf2e2d34375 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:49:38.202947 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-268ebfba-54a3-4143-b72d-6cf2e2d34375 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1564 microversion: 2.1 time: 0.191722 May 21 21:49:38.203550 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2936/5995] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:49:38 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1564 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:49:58.612298 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:49:58.613672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=38 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:49:58.618466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-db834777-14da-4fe4-b6c9-c6c4f328ef12 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:49:58.619532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-db834777-14da-4fe4-b6c9-c6c4f328ef12 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:49:58.626163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db834777-14da-4fe4-b6c9-c6c4f328ef12 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:58.626630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db834777-14da-4fe4-b6c9-c6c4f328ef12 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:58.627404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db834777-14da-4fe4-b6c9-c6c4f328ef12 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:49:58.627855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db834777-14da-4fe4-b6c9-c6c4f328ef12 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:49:58.678326 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-db834777-14da-4fe4-b6c9-c6c4f328ef12 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d/action" status: 200 len: 24575 microversion: 2.1 time: 0.068429 May 21 21:49:58.680390 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3060/5996] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:49:58 2022] POST /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d/action => generated 24575 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:50:06.502843 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 21:50:06.502843 ncdv-master-1 devstack@n-api.service[131278]: Sat May 21 21:50:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 21:50:07.700432 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 21:50:07.700894 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 21:50:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 21:50:08.563439 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-58f90a2f-e93f-4cd6-b9d4-bee695cc483d tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1069744873", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:50:08.569377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:50:08.570140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:50:08.617723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-58f90a2f-e93f-4cd6-b9d4-bee695cc483d tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] validate_networks() for None {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:50:08.967645 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-58f90a2f-e93f-4cd6-b9d4-bee695cc483d tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:50:08.968081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-58f90a2f-e93f-4cd6-b9d4-bee695cc483d tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:50:08.968605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-58f90a2f-e93f-4cd6-b9d4-bee695cc483d tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:50:08.969028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-58f90a2f-e93f-4cd6-b9d4-bee695cc483d tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:50:08.969456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-58f90a2f-e93f-4cd6-b9d4-bee695cc483d tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:50:08.979392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58f90a2f-e93f-4cd6-b9d4-bee695cc483d tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:08.987350 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58f90a2f-e93f-4cd6-b9d4-bee695cc483d tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:08.987350 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58f90a2f-e93f-4cd6-b9d4-bee695cc483d tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:08.987350 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58f90a2f-e93f-4cd6-b9d4-bee695cc483d tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:08.999205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-58f90a2f-e93f-4cd6-b9d4-bee695cc483d tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Getting quotas for project bbc286a0828448e6960f83d60b98a646. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:50:09.004575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-58f90a2f-e93f-4cd6-b9d4-bee695cc483d tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Getting quotas for user aac93e7b93bc46f68fe4c14122d95a69 and project bbc286a0828448e6960f83d60b98a646. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:50:09.017555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-58f90a2f-e93f-4cd6-b9d4-bee695cc483d tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:50:09.019841 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-58f90a2f-e93f-4cd6-b9d4-bee695cc483d tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] [instance: 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:50:09.137706 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-58f90a2f-e93f-4cd6-b9d4-bee695cc483d tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578310 May 21 21:50:09.138339 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2937/5997] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:50:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:50:09.149589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-564e7f2e-0c38-4fb2-9b95-277818c464f4 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:09.150312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-564e7f2e-0c38-4fb2-9b95-277818c464f4 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] [instance: 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:09.212197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-564e7f2e-0c38-4fb2-9b95-277818c464f4 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac93e7b93bc46f68fe4c14122d95a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc286a0828448e6960f83d60b98a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:09.219084 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-564e7f2e-0c38-4fb2-9b95-277818c464f4 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] 10.222.0.49 "GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe" status: 200 len: 1215 microversion: 2.1 time: 0.074541 May 21 21:50:09.219692 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3061/5998] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:09 2022] GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:09.760845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-00c76e74-f489-4d6b-b552-75163a12f07a tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:09.761461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-00c76e74-f489-4d6b-b552-75163a12f07a tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:09.768544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00c76e74-f489-4d6b-b552-75163a12f07a tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:09.768998 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00c76e74-f489-4d6b-b552-75163a12f07a tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:09.769774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00c76e74-f489-4d6b-b552-75163a12f07a tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:09.770219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-00c76e74-f489-4d6b-b552-75163a12f07a tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:10.079415 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-00c76e74-f489-4d6b-b552-75163a12f07a tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1834 microversion: 2.1 time: 0.324038 May 21 21:50:10.080410 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2938/5999] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:09 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1834 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:10.097167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c2b36c50-1939-46a4-b27b-0503ed740c9e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:10.097824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c2b36c50-1939-46a4-b27b-0503ed740c9e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:10.105847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2b36c50-1939-46a4-b27b-0503ed740c9e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:10.106313 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2b36c50-1939-46a4-b27b-0503ed740c9e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:10.107091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2b36c50-1939-46a4-b27b-0503ed740c9e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:10.107608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2b36c50-1939-46a4-b27b-0503ed740c9e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:10.235956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cd3df083-d08b-4c33-8325-4c3dde4aa014 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:10.238618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cd3df083-d08b-4c33-8325-4c3dde4aa014 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] [instance: 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:10.273753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c2b36c50-1939-46a4-b27b-0503ed740c9e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:10.286289 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c2b36c50-1939-46a4-b27b-0503ed740c9e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1683 microversion: 2.1 time: 0.192733 May 21 21:50:10.287205 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3062/6000] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:10 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1683 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:10.295552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cd3df083-d08b-4c33-8325-4c3dde4aa014 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac93e7b93bc46f68fe4c14122d95a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc286a0828448e6960f83d60b98a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:10.302569 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cd3df083-d08b-4c33-8325-4c3dde4aa014 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] 10.222.0.49 "GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe" status: 200 len: 1215 microversion: 2.1 time: 0.070451 May 21 21:50:10.303342 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2939/6001] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:10 2022] GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:50:10.390254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-305c69e9-3a6b-4059-a209-f55cf407b1cd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:50:10.391258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-305c69e9-3a6b-4059-a209-f55cf407b1cd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:10.398166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-305c69e9-3a6b-4059-a209-f55cf407b1cd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:10.398836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-305c69e9-3a6b-4059-a209-f55cf407b1cd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:10.399636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-305c69e9-3a6b-4059-a209-f55cf407b1cd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:10.400098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-305c69e9-3a6b-4059-a209-f55cf407b1cd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:10.448940 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-305c69e9-3a6b-4059-a209-f55cf407b1cd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d/action" status: 200 len: 32641 microversion: 2.1 time: 0.062409 May 21 21:50:10.449527 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3063/6002] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:50:10 2022] POST /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d/action => generated 32641 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:50:10.639161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2e108d2c-86a1-4e31-9b52-e40772718c4d tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:50:10.643878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2e108d2c-86a1-4e31-9b52-e40772718c4d tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:10.645997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e108d2c-86a1-4e31-9b52-e40772718c4d tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:10.646456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e108d2c-86a1-4e31-9b52-e40772718c4d tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:10.647229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e108d2c-86a1-4e31-9b52-e40772718c4d tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:10.647712 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e108d2c-86a1-4e31-9b52-e40772718c4d tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:10.699073 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2e108d2c-86a1-4e31-9b52-e40772718c4d tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '47d30ff01dbb418395eb8e2cf0786616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d91d681971413c9dfb817969f75b95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:10.699073 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2e108d2c-86a1-4e31-9b52-e40772718c4d tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] flavor_id is None. Assuming migration. {{(pid=131278) resize /opt/stack/nova/nova/compute/api.py:4142}} May 21 21:50:10.699073 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2e108d2c-86a1-4e31-9b52-e40772718c4d tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131278) resize /opt/stack/nova/nova/compute/api.py:4166}} May 21 21:50:11.105702 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2e108d2c-86a1-4e31-9b52-e40772718c4d tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d/action" status: 202 len: 0 microversion: 2.1 time: 0.470390 May 21 21:50:11.106358 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2940/6003] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:50:10 2022] POST /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:50:11.115319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d30867ab-caa3-4cc9-aca4-7ac872ef813c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:11.116040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d30867ab-caa3-4cc9-aca4-7ac872ef813c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:11.124389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d30867ab-caa3-4cc9-aca4-7ac872ef813c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:11.124870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d30867ab-caa3-4cc9-aca4-7ac872ef813c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:11.128445 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d30867ab-caa3-4cc9-aca4-7ac872ef813c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:11.128445 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d30867ab-caa3-4cc9-aca4-7ac872ef813c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:11.284801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d30867ab-caa3-4cc9-aca4-7ac872ef813c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:11.293214 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d30867ab-caa3-4cc9-aca4-7ac872ef813c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1692 microversion: 2.1 time: 0.182464 May 21 21:50:11.293828 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3064/6004] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:11 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1692 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:50:11.321130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1a955c87-c7f7-44a0-bd63-22ac5e893579 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:11.321713 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1a955c87-c7f7-44a0-bd63-22ac5e893579 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] [instance: 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:11.342224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a955c87-c7f7-44a0-bd63-22ac5e893579 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:11.344490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a955c87-c7f7-44a0-bd63-22ac5e893579 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:11.344490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a955c87-c7f7-44a0-bd63-22ac5e893579 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:11.344490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1a955c87-c7f7-44a0-bd63-22ac5e893579 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:11.417105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1a955c87-c7f7-44a0-bd63-22ac5e893579 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac93e7b93bc46f68fe4c14122d95a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc286a0828448e6960f83d60b98a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:11.430742 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1a955c87-c7f7-44a0-bd63-22ac5e893579 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] 10.222.0.49 "GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe" status: 200 len: 1219 microversion: 2.1 time: 0.112811 May 21 21:50:11.431724 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2941/6005] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:11 2022] GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:12.311133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-29efcebf-3210-4926-9ff0-b8ed4a3757d8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:12.311810 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-29efcebf-3210-4926-9ff0-b8ed4a3757d8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:12.319819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29efcebf-3210-4926-9ff0-b8ed4a3757d8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:12.320330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29efcebf-3210-4926-9ff0-b8ed4a3757d8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:12.321148 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29efcebf-3210-4926-9ff0-b8ed4a3757d8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:12.321610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29efcebf-3210-4926-9ff0-b8ed4a3757d8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:12.448221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-42aefb12-047a-416b-86fc-d8c20a3bebc5 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:12.449092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-42aefb12-047a-416b-86fc-d8c20a3bebc5 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] [instance: 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:12.456307 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42aefb12-047a-416b-86fc-d8c20a3bebc5 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:12.456772 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42aefb12-047a-416b-86fc-d8c20a3bebc5 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:12.457546 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42aefb12-047a-416b-86fc-d8c20a3bebc5 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:12.457985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42aefb12-047a-416b-86fc-d8c20a3bebc5 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:12.474918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-29efcebf-3210-4926-9ff0-b8ed4a3757d8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:12.483087 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-29efcebf-3210-4926-9ff0-b8ed4a3757d8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1692 microversion: 2.1 time: 0.176123 May 21 21:50:12.483666 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3065/6006] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:12 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1692 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:12.529129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-42aefb12-047a-416b-86fc-d8c20a3bebc5 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac93e7b93bc46f68fe4c14122d95a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc286a0828448e6960f83d60b98a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:12.538421 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-42aefb12-047a-416b-86fc-d8c20a3bebc5 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] 10.222.0.49 "GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe" status: 200 len: 1219 microversion: 2.1 time: 0.094710 May 21 21:50:12.540321 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2942/6007] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:12 2022] GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:50:13.500588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7bc44858-8b9d-4c96-badd-a1388a127d25 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:13.501271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7bc44858-8b9d-4c96-badd-a1388a127d25 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:13.509409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7bc44858-8b9d-4c96-badd-a1388a127d25 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:13.509907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7bc44858-8b9d-4c96-badd-a1388a127d25 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:13.510706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7bc44858-8b9d-4c96-badd-a1388a127d25 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:13.511169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7bc44858-8b9d-4c96-badd-a1388a127d25 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:13.558769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5ac6b813-d538-4814-b304-7734e6b2fd59 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:13.560170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5ac6b813-d538-4814-b304-7734e6b2fd59 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] [instance: 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:13.569130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ac6b813-d538-4814-b304-7734e6b2fd59 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:13.571311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ac6b813-d538-4814-b304-7734e6b2fd59 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:13.572314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ac6b813-d538-4814-b304-7734e6b2fd59 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:13.572755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ac6b813-d538-4814-b304-7734e6b2fd59 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:13.667937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5ac6b813-d538-4814-b304-7734e6b2fd59 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac93e7b93bc46f68fe4c14122d95a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc286a0828448e6960f83d60b98a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:13.678231 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5ac6b813-d538-4814-b304-7734e6b2fd59 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] 10.222.0.49 "GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe" status: 200 len: 1275 microversion: 2.1 time: 0.125309 May 21 21:50:13.679878 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2943/6008] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:13 2022] GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe => generated 1275 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:13.713198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7bc44858-8b9d-4c96-badd-a1388a127d25 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:13.721076 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7bc44858-8b9d-4c96-badd-a1388a127d25 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1692 microversion: 2.1 time: 0.224590 May 21 21:50:13.721666 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3066/6009] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:13 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1692 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:14.697892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f57aaea5-7dc1-41c1-aa98-65b2bac6609b tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:14.698512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f57aaea5-7dc1-41c1-aa98-65b2bac6609b tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] [instance: 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:14.705970 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f57aaea5-7dc1-41c1-aa98-65b2bac6609b tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:14.706431 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f57aaea5-7dc1-41c1-aa98-65b2bac6609b tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:14.707218 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f57aaea5-7dc1-41c1-aa98-65b2bac6609b tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:14.707668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f57aaea5-7dc1-41c1-aa98-65b2bac6609b tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:14.738947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aacb6916-e3d3-45e4-ab4c-04ff857a144a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:14.739706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aacb6916-e3d3-45e4-ab4c-04ff857a144a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:14.747820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aacb6916-e3d3-45e4-ab4c-04ff857a144a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:14.748443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aacb6916-e3d3-45e4-ab4c-04ff857a144a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:14.749286 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aacb6916-e3d3-45e4-ab4c-04ff857a144a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:14.749743 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aacb6916-e3d3-45e4-ab4c-04ff857a144a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:14.787442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f57aaea5-7dc1-41c1-aa98-65b2bac6609b tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac93e7b93bc46f68fe4c14122d95a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc286a0828448e6960f83d60b98a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:14.803791 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f57aaea5-7dc1-41c1-aa98-65b2bac6609b tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] 10.222.0.49 "GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe" status: 200 len: 1273 microversion: 2.1 time: 0.110244 May 21 21:50:14.805459 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2944/6010] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:14 2022] GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:14.916008 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aacb6916-e3d3-45e4-ab4c-04ff857a144a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:14.927324 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aacb6916-e3d3-45e4-ab4c-04ff857a144a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1692 microversion: 2.1 time: 0.192441 May 21 21:50:14.928498 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3067/6011] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:14 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1692 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:50:15.826802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-25d24f51-a885-44f8-8a7e-692cbdbb707a tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:15.829413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-25d24f51-a885-44f8-8a7e-692cbdbb707a tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] [instance: 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:15.835640 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25d24f51-a885-44f8-8a7e-692cbdbb707a tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:15.836372 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25d24f51-a885-44f8-8a7e-692cbdbb707a tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:15.837468 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25d24f51-a885-44f8-8a7e-692cbdbb707a tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:15.838031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25d24f51-a885-44f8-8a7e-692cbdbb707a tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:15.945046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f49fdaa7-7044-478d-a51c-7c88d3e79888 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:15.945801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f49fdaa7-7044-478d-a51c-7c88d3e79888 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:15.953277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f49fdaa7-7044-478d-a51c-7c88d3e79888 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:15.954195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f49fdaa7-7044-478d-a51c-7c88d3e79888 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:15.955003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f49fdaa7-7044-478d-a51c-7c88d3e79888 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:15.955464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f49fdaa7-7044-478d-a51c-7c88d3e79888 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:16.055599 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-25d24f51-a885-44f8-8a7e-692cbdbb707a tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac93e7b93bc46f68fe4c14122d95a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc286a0828448e6960f83d60b98a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:16.064071 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-25d24f51-a885-44f8-8a7e-692cbdbb707a tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] 10.222.0.49 "GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe" status: 200 len: 1315 microversion: 2.1 time: 0.241455 May 21 21:50:16.070316 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2945/6012] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:15 2022] GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:50:16.079017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-34f04f61-25cc-41a6-a88a-98795fde7703 req-33161896-b0b4-4be0-a3e8-cda912e9ee50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14bbb4cd-e63f-4acb-ab5e-bfe42c536afe", "tag": "c7065e35-f81b-415e-8196-b186047f913c"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:50:16.088777 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-34f04f61-25cc-41a6-a88a-98795fde7703 req-33161896-b0b4-4be0-a3e8-cda912e9ee50 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:16.089482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-34f04f61-25cc-41a6-a88a-98795fde7703 req-33161896-b0b4-4be0-a3e8-cda912e9ee50 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:16.112022 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-34f04f61-25cc-41a6-a88a-98795fde7703 req-33161896-b0b4-4be0-a3e8-cda912e9ee50 service nova] Creating event network-changed:c7065e35-f81b-415e-8196-b186047f913c for instance 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe on nch2-master-1 May 21 21:50:16.119181 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-34f04f61-25cc-41a6-a88a-98795fde7703 req-33161896-b0b4-4be0-a3e8-cda912e9ee50 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052071 May 21 21:50:16.120591 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2946/6013] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:50:16.138983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f49fdaa7-7044-478d-a51c-7c88d3e79888 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:16.147474 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f49fdaa7-7044-478d-a51c-7c88d3e79888 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1697 microversion: 2.1 time: 0.206302 May 21 21:50:16.158369 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3068/6014] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:15 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1697 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:50:17.081740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-61751739-b4ee-4192-a9d4-1dd2f1ff036b tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:17.082476 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-61751739-b4ee-4192-a9d4-1dd2f1ff036b tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] [instance: 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:17.090924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61751739-b4ee-4192-a9d4-1dd2f1ff036b tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:17.091421 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61751739-b4ee-4192-a9d4-1dd2f1ff036b tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:17.094403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61751739-b4ee-4192-a9d4-1dd2f1ff036b tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:17.094403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61751739-b4ee-4192-a9d4-1dd2f1ff036b tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:17.170639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aef710bc-cbab-4d27-b8b5-08d6dfc51a38 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:17.171274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aef710bc-cbab-4d27-b8b5-08d6dfc51a38 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:17.178331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aef710bc-cbab-4d27-b8b5-08d6dfc51a38 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:17.178806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aef710bc-cbab-4d27-b8b5-08d6dfc51a38 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:17.179662 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aef710bc-cbab-4d27-b8b5-08d6dfc51a38 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:17.180746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aef710bc-cbab-4d27-b8b5-08d6dfc51a38 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:17.245748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-61751739-b4ee-4192-a9d4-1dd2f1ff036b tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac93e7b93bc46f68fe4c14122d95a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc286a0828448e6960f83d60b98a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:17.253619 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-61751739-b4ee-4192-a9d4-1dd2f1ff036b tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] 10.222.0.49 "GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe" status: 200 len: 1315 microversion: 2.1 time: 0.176163 May 21 21:50:17.254204 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2947/6015] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:17 2022] GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:17.336340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aef710bc-cbab-4d27-b8b5-08d6dfc51a38 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:17.344044 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aef710bc-cbab-4d27-b8b5-08d6dfc51a38 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1697 microversion: 2.1 time: 0.177411 May 21 21:50:17.344658 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3069/6016] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:17 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:50:18.270941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-accb569b-42a8-4bd7-a961-be8ea410c5a0 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:18.271562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-accb569b-42a8-4bd7-a961-be8ea410c5a0 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] [instance: 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:18.278654 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-accb569b-42a8-4bd7-a961-be8ea410c5a0 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:18.279117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-accb569b-42a8-4bd7-a961-be8ea410c5a0 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:18.279890 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-accb569b-42a8-4bd7-a961-be8ea410c5a0 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:18.280487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-accb569b-42a8-4bd7-a961-be8ea410c5a0 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:18.361917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9dabdafd-2782-486d-9aa3-2a83b785c2c9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:18.362762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9dabdafd-2782-486d-9aa3-2a83b785c2c9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:18.370925 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9dabdafd-2782-486d-9aa3-2a83b785c2c9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:18.373169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9dabdafd-2782-486d-9aa3-2a83b785c2c9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:18.373169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9dabdafd-2782-486d-9aa3-2a83b785c2c9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:18.373169 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9dabdafd-2782-486d-9aa3-2a83b785c2c9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:18.424931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-accb569b-42a8-4bd7-a961-be8ea410c5a0 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac93e7b93bc46f68fe4c14122d95a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc286a0828448e6960f83d60b98a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:18.433822 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-accb569b-42a8-4bd7-a961-be8ea410c5a0 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] 10.222.0.49 "GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe" status: 200 len: 1315 microversion: 2.1 time: 0.166766 May 21 21:50:18.434413 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2948/6017] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:18 2022] GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:18.527667 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9dabdafd-2782-486d-9aa3-2a83b785c2c9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:18.535694 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9dabdafd-2782-486d-9aa3-2a83b785c2c9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1697 microversion: 2.1 time: 0.177739 May 21 21:50:18.539529 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3070/6018] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:18 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:50:19.451263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4ccf9d65-eaf1-44f1-9594-0825587a3963 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:19.451921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4ccf9d65-eaf1-44f1-9594-0825587a3963 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] [instance: 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:19.454026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:50:19.459921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4ccf9d65-eaf1-44f1-9594-0825587a3963 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:19.463223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4ccf9d65-eaf1-44f1-9594-0825587a3963 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:19.463223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4ccf9d65-eaf1-44f1-9594-0825587a3963 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:19.463223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4ccf9d65-eaf1-44f1-9594-0825587a3963 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:19.553131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-70a76b61-0bcb-4a6f-adc3-655ad97c3498 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:19.554481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-70a76b61-0bcb-4a6f-adc3-655ad97c3498 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:19.556954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:50:19.563165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-70a76b61-0bcb-4a6f-adc3-655ad97c3498 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:19.566480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-70a76b61-0bcb-4a6f-adc3-655ad97c3498 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:19.566480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-70a76b61-0bcb-4a6f-adc3-655ad97c3498 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:19.566480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-70a76b61-0bcb-4a6f-adc3-655ad97c3498 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:19.607864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4ccf9d65-eaf1-44f1-9594-0825587a3963 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac93e7b93bc46f68fe4c14122d95a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc286a0828448e6960f83d60b98a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:19.615531 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4ccf9d65-eaf1-44f1-9594-0825587a3963 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] 10.222.0.49 "GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe" status: 200 len: 1315 microversion: 2.1 time: 0.168154 May 21 21:50:19.616105 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2949/6019] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:19 2022] GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:19.721120 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-70a76b61-0bcb-4a6f-adc3-655ad97c3498 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:19.729793 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-70a76b61-0bcb-4a6f-adc3-655ad97c3498 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1697 microversion: 2.1 time: 0.180551 May 21 21:50:19.730382 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3071/6020] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:19 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1697 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:20.634435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-17a6ca91-4e4c-45bf-adac-54a5b1b2a87a tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:20.635232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-17a6ca91-4e4c-45bf-adac-54a5b1b2a87a tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] [instance: 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:20.637489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=8 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:50:20.643997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17a6ca91-4e4c-45bf-adac-54a5b1b2a87a tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:20.644601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17a6ca91-4e4c-45bf-adac-54a5b1b2a87a tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:20.645835 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17a6ca91-4e4c-45bf-adac-54a5b1b2a87a tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:20.647538 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17a6ca91-4e4c-45bf-adac-54a5b1b2a87a tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:20.748073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3f92bb1f-176e-48d7-9db8-257ae64db91f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:20.748758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3f92bb1f-176e-48d7-9db8-257ae64db91f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:20.763566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f92bb1f-176e-48d7-9db8-257ae64db91f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:20.764047 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f92bb1f-176e-48d7-9db8-257ae64db91f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:20.764895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f92bb1f-176e-48d7-9db8-257ae64db91f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:20.765361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f92bb1f-176e-48d7-9db8-257ae64db91f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:20.875581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-17a6ca91-4e4c-45bf-adac-54a5b1b2a87a tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac93e7b93bc46f68fe4c14122d95a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc286a0828448e6960f83d60b98a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:20.884255 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-17a6ca91-4e4c-45bf-adac-54a5b1b2a87a tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] 10.222.0.49 "GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe" status: 200 len: 1315 microversion: 2.1 time: 0.254483 May 21 21:50:20.884903 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2950/6021] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:20 2022] GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:20.890838 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-a981fa8c-eb20-41e3-91eb-bfd6f915ee9b req-3f5a69ba-a7db-4be8-89c0-6eafd7eb96b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bbb4cd-e63f-4acb-ab5e-bfe42c536afe", "name": "network-vif-plugged", "status": "completed", "tag": "c7065e35-f81b-415e-8196-b186047f913c"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:50:20.903100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a981fa8c-eb20-41e3-91eb-bfd6f915ee9b req-3f5a69ba-a7db-4be8-89c0-6eafd7eb96b0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:20.903561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a981fa8c-eb20-41e3-91eb-bfd6f915ee9b req-3f5a69ba-a7db-4be8-89c0-6eafd7eb96b0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:20.916468 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-a981fa8c-eb20-41e3-91eb-bfd6f915ee9b req-3f5a69ba-a7db-4be8-89c0-6eafd7eb96b0 service nova] Creating event network-vif-plugged:c7065e35-f81b-415e-8196-b186047f913c for instance 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe on nch2-master-1 May 21 21:50:20.921704 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-a981fa8c-eb20-41e3-91eb-bfd6f915ee9b req-3f5a69ba-a7db-4be8-89c0-6eafd7eb96b0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035650 May 21 21:50:20.928031 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2951/6022] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:50:21.046582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3f92bb1f-176e-48d7-9db8-257ae64db91f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:21.062006 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3f92bb1f-176e-48d7-9db8-257ae64db91f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1697 microversion: 2.1 time: 0.318937 May 21 21:50:21.064297 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3072/6023] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:20 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1697 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:50:21.902655 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-64cd1ec7-e22e-421e-b1d7-40b6615aea89 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:21.903363 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-64cd1ec7-e22e-421e-b1d7-40b6615aea89 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] [instance: 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:21.909917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-64cd1ec7-e22e-421e-b1d7-40b6615aea89 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:21.910367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-64cd1ec7-e22e-421e-b1d7-40b6615aea89 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:21.911137 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-64cd1ec7-e22e-421e-b1d7-40b6615aea89 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:21.911576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-64cd1ec7-e22e-421e-b1d7-40b6615aea89 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:22.065738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-64cd1ec7-e22e-421e-b1d7-40b6615aea89 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac93e7b93bc46f68fe4c14122d95a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc286a0828448e6960f83d60b98a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:22.074254 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-64cd1ec7-e22e-421e-b1d7-40b6615aea89 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] 10.222.0.49 "GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe" status: 200 len: 1315 microversion: 2.1 time: 0.176689 May 21 21:50:22.074863 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2952/6024] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:21 2022] GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:22.078903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-138d7d14-cec8-45f7-8dd8-9efded944b2b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:22.079539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-138d7d14-cec8-45f7-8dd8-9efded944b2b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:22.086835 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-138d7d14-cec8-45f7-8dd8-9efded944b2b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:22.088124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-138d7d14-cec8-45f7-8dd8-9efded944b2b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:22.089269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-138d7d14-cec8-45f7-8dd8-9efded944b2b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:22.089724 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-138d7d14-cec8-45f7-8dd8-9efded944b2b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:22.249448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-138d7d14-cec8-45f7-8dd8-9efded944b2b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:22.257580 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-138d7d14-cec8-45f7-8dd8-9efded944b2b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1697 microversion: 2.1 time: 0.182379 May 21 21:50:22.258352 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3073/6025] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:22 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:50:23.090893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-965e9e6b-1ca8-44b0-a4a3-5937b5392e21 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:23.091541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-965e9e6b-1ca8-44b0-a4a3-5937b5392e21 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] [instance: 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:23.098937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-965e9e6b-1ca8-44b0-a4a3-5937b5392e21 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:23.099429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-965e9e6b-1ca8-44b0-a4a3-5937b5392e21 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:23.100181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-965e9e6b-1ca8-44b0-a4a3-5937b5392e21 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:23.100647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-965e9e6b-1ca8-44b0-a4a3-5937b5392e21 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:23.250244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-965e9e6b-1ca8-44b0-a4a3-5937b5392e21 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac93e7b93bc46f68fe4c14122d95a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc286a0828448e6960f83d60b98a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:23.258782 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-965e9e6b-1ca8-44b0-a4a3-5937b5392e21 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] 10.222.0.49 "GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe" status: 200 len: 1465 microversion: 2.1 time: 0.171715 May 21 21:50:23.259385 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2953/6026] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:23 2022] GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe => generated 1465 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:23.275677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1c1c2620-f82b-4693-a926-b240992245fc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:23.276640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1c1c2620-f82b-4693-a926-b240992245fc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:23.284501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1c1c2620-f82b-4693-a926-b240992245fc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:23.284984 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1c1c2620-f82b-4693-a926-b240992245fc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:23.285793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1c1c2620-f82b-4693-a926-b240992245fc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:23.286388 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1c1c2620-f82b-4693-a926-b240992245fc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:23.304807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6edab8a2-65ce-4efe-a27d-e69ddb6faa4c tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:23.305980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6edab8a2-65ce-4efe-a27d-e69ddb6faa4c tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] [instance: 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:23.313510 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6edab8a2-65ce-4efe-a27d-e69ddb6faa4c tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:23.313965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6edab8a2-65ce-4efe-a27d-e69ddb6faa4c tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:23.314740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6edab8a2-65ce-4efe-a27d-e69ddb6faa4c tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:23.315358 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6edab8a2-65ce-4efe-a27d-e69ddb6faa4c tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:23.342744 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6edab8a2-65ce-4efe-a27d-e69ddb6faa4c tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] [instance: 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:50:23.346042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:50:23.453717 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1c1c2620-f82b-4693-a926-b240992245fc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:23.462122 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1c1c2620-f82b-4693-a926-b240992245fc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1697 microversion: 2.1 time: 0.191025 May 21 21:50:23.464912 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3074/6027] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:23 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1697 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:23.747719 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6edab8a2-65ce-4efe-a27d-e69ddb6faa4c tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] 10.222.0.49 "DELETE /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe" status: 204 len: 0 microversion: 2.1 time: 0.447752 May 21 21:50:23.748573 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2954/6028] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:50:23 2022] DELETE /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 21:50:23.756815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-35cade12-0fe2-4e62-979a-1bff59f48da4 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:23.757506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-35cade12-0fe2-4e62-979a-1bff59f48da4 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] [instance: 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:23.763973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35cade12-0fe2-4e62-979a-1bff59f48da4 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:23.764473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35cade12-0fe2-4e62-979a-1bff59f48da4 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:23.765354 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35cade12-0fe2-4e62-979a-1bff59f48da4 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:23.765804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35cade12-0fe2-4e62-979a-1bff59f48da4 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:23.910250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-35cade12-0fe2-4e62-979a-1bff59f48da4 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac93e7b93bc46f68fe4c14122d95a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc286a0828448e6960f83d60b98a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:23.918752 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-35cade12-0fe2-4e62-979a-1bff59f48da4 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] 10.222.0.49 "GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe" status: 200 len: 1471 microversion: 2.1 time: 0.165965 May 21 21:50:23.919337 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3075/6029] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:23 2022] GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:24.481842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0817354c-b3e3-4368-a653-4d1701d3b1fa tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:24.482683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0817354c-b3e3-4368-a653-4d1701d3b1fa tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:24.489617 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0817354c-b3e3-4368-a653-4d1701d3b1fa tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:24.490084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0817354c-b3e3-4368-a653-4d1701d3b1fa tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:24.493810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0817354c-b3e3-4368-a653-4d1701d3b1fa tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:24.493810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0817354c-b3e3-4368-a653-4d1701d3b1fa tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:24.723040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0817354c-b3e3-4368-a653-4d1701d3b1fa tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:24.731158 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0817354c-b3e3-4368-a653-4d1701d3b1fa tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1697 microversion: 2.1 time: 0.255126 May 21 21:50:24.731727 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2955/6030] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:24 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1697 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:24.936170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7e2556c1-df9c-4cb7-bf91-0debacf12d32 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:24.936869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7e2556c1-df9c-4cb7-bf91-0debacf12d32 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] [instance: 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:24.944085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e2556c1-df9c-4cb7-bf91-0debacf12d32 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:24.944611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e2556c1-df9c-4cb7-bf91-0debacf12d32 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:24.946478 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e2556c1-df9c-4cb7-bf91-0debacf12d32 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:24.946946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7e2556c1-df9c-4cb7-bf91-0debacf12d32 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:25.104233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7e2556c1-df9c-4cb7-bf91-0debacf12d32 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac93e7b93bc46f68fe4c14122d95a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc286a0828448e6960f83d60b98a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:25.112377 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7e2556c1-df9c-4cb7-bf91-0debacf12d32 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] 10.222.0.49 "GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe" status: 200 len: 1471 microversion: 2.1 time: 0.180323 May 21 21:50:25.112970 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3076/6031] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:24 2022] GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:50:25.747982 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-da71dbef-6993-4f42-a9a8-c05e4978735a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:25.748819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-da71dbef-6993-4f42-a9a8-c05e4978735a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:25.755986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da71dbef-6993-4f42-a9a8-c05e4978735a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:25.756482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da71dbef-6993-4f42-a9a8-c05e4978735a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:25.760023 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da71dbef-6993-4f42-a9a8-c05e4978735a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:25.760023 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da71dbef-6993-4f42-a9a8-c05e4978735a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:26.062658 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-da71dbef-6993-4f42-a9a8-c05e4978735a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:26.071957 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-da71dbef-6993-4f42-a9a8-c05e4978735a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1697 microversion: 2.1 time: 0.327870 May 21 21:50:26.072585 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2956/6032] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:25 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1697 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:26.130653 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-90b1feee-ef5d-4882-b8b7-ba0966ac6f68 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:26.134255 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-90b1feee-ef5d-4882-b8b7-ba0966ac6f68 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] [instance: 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:26.140798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90b1feee-ef5d-4882-b8b7-ba0966ac6f68 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:26.141594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90b1feee-ef5d-4882-b8b7-ba0966ac6f68 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:26.142357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90b1feee-ef5d-4882-b8b7-ba0966ac6f68 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:26.142831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90b1feee-ef5d-4882-b8b7-ba0966ac6f68 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:26.215070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-90b1feee-ef5d-4882-b8b7-ba0966ac6f68 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac93e7b93bc46f68fe4c14122d95a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc286a0828448e6960f83d60b98a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:26.223723 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-90b1feee-ef5d-4882-b8b7-ba0966ac6f68 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] 10.222.0.49 "GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe" status: 200 len: 1429 microversion: 2.1 time: 0.096949 May 21 21:50:26.224342 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3077/6033] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:26 2022] GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe => generated 1429 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:26.257986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-0449d9d2-0b4f-49b6-967a-796477a75525 req-6bd37f57-f3b4-4b61-b9a2-14adc249076f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bbb4cd-e63f-4acb-ab5e-bfe42c536afe", "name": "network-vif-deleted", "tag": "c7065e35-f81b-415e-8196-b186047f913c"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:50:26.266817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0449d9d2-0b4f-49b6-967a-796477a75525 req-6bd37f57-f3b4-4b61-b9a2-14adc249076f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:26.267262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0449d9d2-0b4f-49b6-967a-796477a75525 req-6bd37f57-f3b4-4b61-b9a2-14adc249076f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:26.279724 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-0449d9d2-0b4f-49b6-967a-796477a75525 req-6bd37f57-f3b4-4b61-b9a2-14adc249076f service nova] Creating event network-vif-deleted:c7065e35-f81b-415e-8196-b186047f913c for instance 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe on nch2-master-1 May 21 21:50:26.284988 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-0449d9d2-0b4f-49b6-967a-796477a75525 req-6bd37f57-f3b4-4b61-b9a2-14adc249076f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031717 May 21 21:50:26.285828 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2957/6034] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:50:27.090387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0a9758fa-03f9-4aea-aade-e31b748ee555 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:27.091195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0a9758fa-03f9-4aea-aade-e31b748ee555 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:27.098362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a9758fa-03f9-4aea-aade-e31b748ee555 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:27.099057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a9758fa-03f9-4aea-aade-e31b748ee555 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:27.100019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a9758fa-03f9-4aea-aade-e31b748ee555 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:27.103138 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a9758fa-03f9-4aea-aade-e31b748ee555 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:27.106172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:50:27.243134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e2273b13-b1a5-4bd7-913c-96d86e098335 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:27.246586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e2273b13-b1a5-4bd7-913c-96d86e098335 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] [instance: 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:27.251642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e2273b13-b1a5-4bd7-913c-96d86e098335 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:27.252495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e2273b13-b1a5-4bd7-913c-96d86e098335 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:27.253514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e2273b13-b1a5-4bd7-913c-96d86e098335 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:27.254180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e2273b13-b1a5-4bd7-913c-96d86e098335 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:27.283427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0a9758fa-03f9-4aea-aade-e31b748ee555 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:27.298233 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0a9758fa-03f9-4aea-aade-e31b748ee555 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1696 microversion: 2.1 time: 0.212173 May 21 21:50:27.299959 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3078/6035] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:27 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1696 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:27.306143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e2273b13-b1a5-4bd7-913c-96d86e098335 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:27.306851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e2273b13-b1a5-4bd7-913c-96d86e098335 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:27.311580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-e2273b13-b1a5-4bd7-913c-96d86e098335 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lazy-loading 'fault' on Instance uuid 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:50:27.382767 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e2273b13-b1a5-4bd7-913c-96d86e098335 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac93e7b93bc46f68fe4c14122d95a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc286a0828448e6960f83d60b98a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:27.390257 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e2273b13-b1a5-4bd7-913c-96d86e098335 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] 10.222.0.49 "GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe" status: 200 len: 1305 microversion: 2.1 time: 0.153045 May 21 21:50:27.396814 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2958/6036] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:27 2022] GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe => generated 1305 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:50:28.304253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-2bd22034-2bed-4131-920f-f7974b1495fc req-a93d78d9-3a77-4c02-98d5-fd757c2d5b41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5d5ca4-8254-4287-a682-0393951bfb7d", "name": "network-vif-unplugged", "status": "completed", "tag": "079739f3-5bd8-4b2e-919a-ddd4ca9e7d87"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:50:28.319350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2bd22034-2bed-4131-920f-f7974b1495fc req-a93d78d9-3a77-4c02-98d5-fd757c2d5b41 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:28.322395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2bd22034-2bed-4131-920f-f7974b1495fc req-a93d78d9-3a77-4c02-98d5-fd757c2d5b41 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:28.330444 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-63f07375-2ff2-49ac-971c-805470a4d1cb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:28.331239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-63f07375-2ff2-49ac-971c-805470a4d1cb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:28.339373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63f07375-2ff2-49ac-971c-805470a4d1cb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:28.339840 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63f07375-2ff2-49ac-971c-805470a4d1cb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:28.340669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63f07375-2ff2-49ac-971c-805470a4d1cb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:28.341276 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63f07375-2ff2-49ac-971c-805470a4d1cb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:28.346665 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-2bd22034-2bed-4131-920f-f7974b1495fc req-a93d78d9-3a77-4c02-98d5-fd757c2d5b41 service nova] Creating event network-vif-unplugged:079739f3-5bd8-4b2e-919a-ddd4ca9e7d87 for instance 7b5d5ca4-8254-4287-a682-0393951bfb7d on nch2-master-1 May 21 21:50:28.352059 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [req-2bd22034-2bed-4131-920f-f7974b1495fc req-a93d78d9-3a77-4c02-98d5-fd757c2d5b41 service nova] Instance 7b5d5ca4-8254-4287-a682-0393951bfb7d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 21:50:28.365615 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-2bd22034-2bed-4131-920f-f7974b1495fc req-a93d78d9-3a77-4c02-98d5-fd757c2d5b41 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066894 May 21 21:50:28.366239 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3079/6037] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:50:28.411792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3490bbdd-4a4e-4b8d-880e-306c3bc68a94 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:28.412534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3490bbdd-4a4e-4b8d-880e-306c3bc68a94 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] [instance: 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:28.419257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3490bbdd-4a4e-4b8d-880e-306c3bc68a94 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:28.419697 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3490bbdd-4a4e-4b8d-880e-306c3bc68a94 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:28.420588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3490bbdd-4a4e-4b8d-880e-306c3bc68a94 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:28.421230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3490bbdd-4a4e-4b8d-880e-306c3bc68a94 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:28.436029 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-3490bbdd-4a4e-4b8d-880e-306c3bc68a94 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] HTTP exception thrown: Instance 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe could not be found. May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3490bbdd-4a4e-4b8d-880e-306c3bc68a94 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Request method failure captured: May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe HTTP/1.1 May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiV6N5CC1UEyL8zbojxDGP_y714zF-RiyrZlPLXKm1nTV4Z7ELim4LBOo-hXLV9fExGEi0VLK9n0fSw-9Cts6AH1TCdGLA9bkBWL3Ab3fTsPXtXai1gneNYymfODb4igOLrV0kxedA_ZG_SjWpI5XRL32QBtgBbH7QS24uQj7bY7oMYQ May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: bbc286a0828448e6960f83d60b98a646 May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-VolumesNegativeTest-593522334 May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bbc286a0828448e6960f83d60b98a646"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bbc286a0828448e6960f83d60b98a646"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bbc286a0828448e6960f83d60b98a646", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bbc286a0828448e6960f83d60b98a646"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-VolumesNegativeTest-593522334 May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: bbc286a0828448e6960f83d60b98a646 May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-VolumesNegativeTest-593522334 May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-VolumesNegativeTest-593522334-project May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: aac93e7b93bc46f68fe4c14122d95a69 May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-VolumesNegativeTest-593522334-project May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe could not be found. May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '14bbb4cd-e63f-4acb-ab5e-bfe42c536afe'} May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe could not be found. May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe could not be found. May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:50:28.438088 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:50:28.442830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:50:28.442830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:50:28.442830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:50:28.442830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:50:28.442830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:50:28.442830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe could not be found. May 21 21:50:28.442830 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:50:28.442830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3490bbdd-4a4e-4b8d-880e-306c3bc68a94 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] Returning 404 to user: Instance 14bbb4cd-e63f-4acb-ab5e-bfe42c536afe could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:50:28.442830 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3490bbdd-4a4e-4b8d-880e-306c3bc68a94 tempest-VolumesNegativeTest-593522334 tempest-VolumesNegativeTest-593522334-project] 10.222.0.49 "GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe" status: 404 len: 111 microversion: 2.1 time: 0.032120 May 21 21:50:28.442830 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3080/6038] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:28 2022] GET /compute/v2.1/servers/14bbb4cd-e63f-4acb-ab5e-bfe42c536afe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:50:28.602849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-63f07375-2ff2-49ac-971c-805470a4d1cb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:28.611576 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-63f07375-2ff2-49ac-971c-805470a4d1cb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1696 microversion: 2.1 time: 0.288298 May 21 21:50:28.612325 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2959/6039] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:28 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1696 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:29.641040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-66e71fa3-5c68-49fd-be74-42be7a811151 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:29.642978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-66e71fa3-5c68-49fd-be74-42be7a811151 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:29.653677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-66e71fa3-5c68-49fd-be74-42be7a811151 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:29.654729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-66e71fa3-5c68-49fd-be74-42be7a811151 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:29.656484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-66e71fa3-5c68-49fd-be74-42be7a811151 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:29.657140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-66e71fa3-5c68-49fd-be74-42be7a811151 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:29.987068 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-66e71fa3-5c68-49fd-be74-42be7a811151 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:29.996789 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-66e71fa3-5c68-49fd-be74-42be7a811151 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1696 microversion: 2.1 time: 0.370697 May 21 21:50:30.006390 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3081/6040] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:29 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1696 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:30.391401 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-3b72e4f8-a84a-49cc-a418-15df3b358ac2 req-e3d81f99-4f56-40c7-b214-5414a62c1ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b5d5ca4-8254-4287-a682-0393951bfb7d", "tag": "079739f3-5bd8-4b2e-919a-ddd4ca9e7d87"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:50:30.410772 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3b72e4f8-a84a-49cc-a418-15df3b358ac2 req-e3d81f99-4f56-40c7-b214-5414a62c1ade service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:30.414366 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3b72e4f8-a84a-49cc-a418-15df3b358ac2 req-e3d81f99-4f56-40c7-b214-5414a62c1ade service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:30.436671 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-3b72e4f8-a84a-49cc-a418-15df3b358ac2 req-e3d81f99-4f56-40c7-b214-5414a62c1ade service nova] Creating event network-changed:079739f3-5bd8-4b2e-919a-ddd4ca9e7d87 for instance 7b5d5ca4-8254-4287-a682-0393951bfb7d on nch2-master-1 May 21 21:50:30.443423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [req-3b72e4f8-a84a-49cc-a418-15df3b358ac2 req-e3d81f99-4f56-40c7-b214-5414a62c1ade service nova] Instance 7b5d5ca4-8254-4287-a682-0393951bfb7d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 21:50:30.456914 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-3b72e4f8-a84a-49cc-a418-15df3b358ac2 req-e3d81f99-4f56-40c7-b214-5414a62c1ade service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070036 May 21 21:50:30.457900 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2960/6041] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:50:31.020344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d8088fd4-0fdb-46fc-89c9-758c2e2e816d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:31.021775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d8088fd4-0fdb-46fc-89c9-758c2e2e816d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:31.032112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8088fd4-0fdb-46fc-89c9-758c2e2e816d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:31.034071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8088fd4-0fdb-46fc-89c9-758c2e2e816d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:31.035286 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8088fd4-0fdb-46fc-89c9-758c2e2e816d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:31.036325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8088fd4-0fdb-46fc-89c9-758c2e2e816d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:31.479123 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d8088fd4-0fdb-46fc-89c9-758c2e2e816d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:31.490597 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d8088fd4-0fdb-46fc-89c9-758c2e2e816d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1694 microversion: 2.1 time: 0.475283 May 21 21:50:31.491204 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3082/6042] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:31 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1694 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:32.517177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5848e985-8cb9-4a89-86ea-0f50b6991bab tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:32.519027 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5848e985-8cb9-4a89-86ea-0f50b6991bab tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:32.531483 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5848e985-8cb9-4a89-86ea-0f50b6991bab tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:32.532205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5848e985-8cb9-4a89-86ea-0f50b6991bab tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:32.534116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5848e985-8cb9-4a89-86ea-0f50b6991bab tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:32.534751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5848e985-8cb9-4a89-86ea-0f50b6991bab tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:32.819348 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5848e985-8cb9-4a89-86ea-0f50b6991bab tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:32.830895 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5848e985-8cb9-4a89-86ea-0f50b6991bab tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1691 microversion: 2.1 time: 0.319218 May 21 21:50:32.849444 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2961/6043] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:32 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1691 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:32.856723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d122e08f-8ab4-4053-8493-e2bcec8d9c05 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:50:32.857387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d122e08f-8ab4-4053-8493-e2bcec8d9c05 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:32.865940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d122e08f-8ab4-4053-8493-e2bcec8d9c05 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:32.865940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d122e08f-8ab4-4053-8493-e2bcec8d9c05 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:32.867531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d122e08f-8ab4-4053-8493-e2bcec8d9c05 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:32.868087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d122e08f-8ab4-4053-8493-e2bcec8d9c05 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:33.196571 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d122e08f-8ab4-4053-8493-e2bcec8d9c05 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d/action" status: 204 len: 0 microversion: 2.1 time: 0.344192 May 21 21:50:33.197343 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3083/6044] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:50:32 2022] POST /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d/action => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:50:33.207091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7255f7dd-364e-47b1-927b-41c194ce8dc9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:33.207721 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7255f7dd-364e-47b1-927b-41c194ce8dc9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:33.223523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7255f7dd-364e-47b1-927b-41c194ce8dc9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:33.223995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7255f7dd-364e-47b1-927b-41c194ce8dc9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:33.224829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7255f7dd-364e-47b1-927b-41c194ce8dc9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:33.230532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7255f7dd-364e-47b1-927b-41c194ce8dc9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:34.136200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7255f7dd-364e-47b1-927b-41c194ce8dc9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:34.168058 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7255f7dd-364e-47b1-927b-41c194ce8dc9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1691 microversion: 2.1 time: 0.965832 May 21 21:50:34.181304 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2962/6045] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:33 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1691 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:34.633989 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-afa028dc-01ee-4431-9098-baac9ba7b500 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Action: 'create', calling method: .version_select at 0x7fc82d0ce940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2021794790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEieiGyIe/hPFQ7MC0d0Gu5lLHKJCGKrx2F7j8UaGCGJvDi6CaJD0VXfq5YlKh0rxuEQ+WJWeDCE0WvcrKIW+UfaVsHME6DhK3Loojdc5nZ0tq+QW1wG/IGDGQfN2lMFA=="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:50:34.686170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-afa028dc-01ee-4431-9098-baac9ba7b500 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Getting quotas for project 31d683aab56145779b2614a9a0606556. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:50:34.693192 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-afa028dc-01ee-4431-9098-baac9ba7b500 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Getting quotas for user 1f3a4acfcf07489abcedb1616deb915a and project 31d683aab56145779b2614a9a0606556. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:50:34.839057 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-afa028dc-01ee-4431-9098-baac9ba7b500 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.212901 May 21 21:50:34.840610 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3084/6046] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:50:34 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:50:35.018911 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-98a35bf6-d91d-477e-94b3-e5d194ffa52e req-63bf41d5-b316-4def-a2b0-1b9ebcd10636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5d5ca4-8254-4287-a682-0393951bfb7d", "name": "network-vif-plugged", "status": "completed", "tag": "079739f3-5bd8-4b2e-919a-ddd4ca9e7d87"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:50:35.042138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-98a35bf6-d91d-477e-94b3-e5d194ffa52e req-63bf41d5-b316-4def-a2b0-1b9ebcd10636 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:35.042597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-98a35bf6-d91d-477e-94b3-e5d194ffa52e req-63bf41d5-b316-4def-a2b0-1b9ebcd10636 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:35.065141 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-98a35bf6-d91d-477e-94b3-e5d194ffa52e req-63bf41d5-b316-4def-a2b0-1b9ebcd10636 service nova] Creating event network-vif-plugged:079739f3-5bd8-4b2e-919a-ddd4ca9e7d87 for instance 7b5d5ca4-8254-4287-a682-0393951bfb7d on nch2-master-1 May 21 21:50:35.074560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [req-98a35bf6-d91d-477e-94b3-e5d194ffa52e req-63bf41d5-b316-4def-a2b0-1b9ebcd10636 service nova] Instance 7b5d5ca4-8254-4287-a682-0393951bfb7d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 21:50:35.099053 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-98a35bf6-d91d-477e-94b3-e5d194ffa52e req-63bf41d5-b316-4def-a2b0-1b9ebcd10636 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083583 May 21 21:50:35.100305 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2963/6047] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:50:35.189562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-31758e6a-da80-41b7-a5d7-9ffec83e44ad tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:35.194462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-31758e6a-da80-41b7-a5d7-9ffec83e44ad tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:35.205924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31758e6a-da80-41b7-a5d7-9ffec83e44ad tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:35.209038 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31758e6a-da80-41b7-a5d7-9ffec83e44ad tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:35.213029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31758e6a-da80-41b7-a5d7-9ffec83e44ad tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:35.213796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31758e6a-da80-41b7-a5d7-9ffec83e44ad tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:35.413211 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-31758e6a-da80-41b7-a5d7-9ffec83e44ad tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:35.424803 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-31758e6a-da80-41b7-a5d7-9ffec83e44ad tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1691 microversion: 2.1 time: 0.240754 May 21 21:50:35.426848 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3085/6048] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:35 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1691 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:36.453665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-76046609-761f-4e02-b6a7-59fd4f277713 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:36.454378 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-76046609-761f-4e02-b6a7-59fd4f277713 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:36.463862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-76046609-761f-4e02-b6a7-59fd4f277713 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:36.464347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-76046609-761f-4e02-b6a7-59fd4f277713 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:36.465377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-76046609-761f-4e02-b6a7-59fd4f277713 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:36.465824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-76046609-761f-4e02-b6a7-59fd4f277713 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:36.745359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-76046609-761f-4e02-b6a7-59fd4f277713 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:36.754715 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-76046609-761f-4e02-b6a7-59fd4f277713 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1683 microversion: 2.1 time: 0.307958 May 21 21:50:36.755307 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2964/6049] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:36 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1683 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:38.264069 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-edaba167-55d5-4496-9584-f7fc604c3b5d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-917599946", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "e2f698ff-7e65-477e-a0bb-428076007e2a"}], "key_name": "tempest-TestNetworkBasicOps-2021794790", "security_groups": [{"name": "tempest-secgroup-smoke-176024454"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:50:38.395646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-edaba167-55d5-4496-9584-f7fc604c3b5d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] validate_networks() for [('e2f698ff-7e65-477e-a0bb-428076007e2a', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:50:38.944201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-edaba167-55d5-4496-9584-f7fc604c3b5d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:50:38.944694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-edaba167-55d5-4496-9584-f7fc604c3b5d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:50:38.945364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-edaba167-55d5-4496-9584-f7fc604c3b5d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:50:38.945795 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-edaba167-55d5-4496-9584-f7fc604c3b5d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:50:38.946228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-edaba167-55d5-4496-9584-f7fc604c3b5d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:50:38.955517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-edaba167-55d5-4496-9584-f7fc604c3b5d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:38.955978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-edaba167-55d5-4496-9584-f7fc604c3b5d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:38.956898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-edaba167-55d5-4496-9584-f7fc604c3b5d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:38.957385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-edaba167-55d5-4496-9584-f7fc604c3b5d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:38.975594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-edaba167-55d5-4496-9584-f7fc604c3b5d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Getting quotas for project 31d683aab56145779b2614a9a0606556. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:50:38.981502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-edaba167-55d5-4496-9584-f7fc604c3b5d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Getting quotas for user 1f3a4acfcf07489abcedb1616deb915a and project 31d683aab56145779b2614a9a0606556. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:50:38.995317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-edaba167-55d5-4496-9584-f7fc604c3b5d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:50:38.997670 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-edaba167-55d5-4496-9584-f7fc604c3b5d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 2c8491cf-9f8f-4a29-a1bb-602dead261c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:50:39.108514 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-edaba167-55d5-4496-9584-f7fc604c3b5d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.848552 May 21 21:50:39.109288 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3086/6050] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:50:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:50:39.119473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-64b43eac-6b5a-4a0c-b89c-9cbaf7874d5b tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:39.120854 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-64b43eac-6b5a-4a0c-b89c-9cbaf7874d5b tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 2c8491cf-9f8f-4a29-a1bb-602dead261c6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:39.123950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:50:39.182528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-64b43eac-6b5a-4a0c-b89c-9cbaf7874d5b tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:39.193381 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-64b43eac-6b5a-4a0c-b89c-9cbaf7874d5b tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6" status: 200 len: 1248 microversion: 2.1 time: 0.077629 May 21 21:50:39.194499 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2965/6051] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:39 2022] GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6 => generated 1248 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:40.212499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fa6610e2-4018-4dfb-b9dc-4e9c59c4c3c8 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:40.213709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fa6610e2-4018-4dfb-b9dc-4e9c59c4c3c8 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 2c8491cf-9f8f-4a29-a1bb-602dead261c6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:40.216777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:50:40.222351 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fa6610e2-4018-4dfb-b9dc-4e9c59c4c3c8 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:40.222824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fa6610e2-4018-4dfb-b9dc-4e9c59c4c3c8 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:40.223618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fa6610e2-4018-4dfb-b9dc-4e9c59c4c3c8 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:40.224086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fa6610e2-4018-4dfb-b9dc-4e9c59c4c3c8 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:40.553996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fa6610e2-4018-4dfb-b9dc-4e9c59c4c3c8 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:40.563016 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fa6610e2-4018-4dfb-b9dc-4e9c59c4c3c8 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6" status: 200 len: 1252 microversion: 2.1 time: 0.355792 May 21 21:50:40.563664 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3087/6052] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:40 2022] GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6 => generated 1252 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:41.581139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9bc8e49f-292d-4e5e-ba4d-eb9706fa4721 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:41.581778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9bc8e49f-292d-4e5e-ba4d-eb9706fa4721 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 2c8491cf-9f8f-4a29-a1bb-602dead261c6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:41.589888 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9bc8e49f-292d-4e5e-ba4d-eb9706fa4721 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:41.590343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9bc8e49f-292d-4e5e-ba4d-eb9706fa4721 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:41.591159 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9bc8e49f-292d-4e5e-ba4d-eb9706fa4721 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:41.591605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9bc8e49f-292d-4e5e-ba4d-eb9706fa4721 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:41.779769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9bc8e49f-292d-4e5e-ba4d-eb9706fa4721 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:41.796555 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9bc8e49f-292d-4e5e-ba4d-eb9706fa4721 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6" status: 200 len: 1318 microversion: 2.1 time: 0.219703 May 21 21:50:41.797710 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2966/6053] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:41 2022] GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:42.815114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-11965430-4bee-479e-b8b0-4bd7bfd6839f tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:42.815854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-11965430-4bee-479e-b8b0-4bd7bfd6839f tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 2c8491cf-9f8f-4a29-a1bb-602dead261c6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:42.825062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-11965430-4bee-479e-b8b0-4bd7bfd6839f tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:42.827048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-11965430-4bee-479e-b8b0-4bd7bfd6839f tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:42.827048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-11965430-4bee-479e-b8b0-4bd7bfd6839f tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:42.827429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-11965430-4bee-479e-b8b0-4bd7bfd6839f tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:43.024232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-11965430-4bee-479e-b8b0-4bd7bfd6839f tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:43.034302 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-11965430-4bee-479e-b8b0-4bd7bfd6839f tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6" status: 200 len: 1373 microversion: 2.1 time: 0.223572 May 21 21:50:43.035073 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3088/6054] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:42 2022] GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6 => generated 1373 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:44.052629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c4a1be7c-999a-4319-8599-4014c5e025e1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:44.060552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c4a1be7c-999a-4319-8599-4014c5e025e1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 2c8491cf-9f8f-4a29-a1bb-602dead261c6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:44.070649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4a1be7c-999a-4319-8599-4014c5e025e1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:44.071412 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4a1be7c-999a-4319-8599-4014c5e025e1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:44.072442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4a1be7c-999a-4319-8599-4014c5e025e1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:44.073085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4a1be7c-999a-4319-8599-4014c5e025e1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:44.609433 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c4a1be7c-999a-4319-8599-4014c5e025e1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:44.617798 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c4a1be7c-999a-4319-8599-4014c5e025e1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6" status: 200 len: 1373 microversion: 2.1 time: 0.569384 May 21 21:50:44.618703 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2967/6055] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:44 2022] GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6 => generated 1373 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:44.664221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-fbccbb0c-32c3-431a-9616-ef81653702db req-a04d2a41-0f83-4de9-9c19-65e01ef006d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c8491cf-9f8f-4a29-a1bb-602dead261c6", "tag": "50454762-02de-4c97-9c88-870484e21913"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:50:44.674409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-fbccbb0c-32c3-431a-9616-ef81653702db req-a04d2a41-0f83-4de9-9c19-65e01ef006d4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:44.675108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-fbccbb0c-32c3-431a-9616-ef81653702db req-a04d2a41-0f83-4de9-9c19-65e01ef006d4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:44.697628 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-fbccbb0c-32c3-431a-9616-ef81653702db req-a04d2a41-0f83-4de9-9c19-65e01ef006d4 service nova] Creating event network-changed:50454762-02de-4c97-9c88-870484e21913 for instance 2c8491cf-9f8f-4a29-a1bb-602dead261c6 on nch2-master-1 May 21 21:50:44.705050 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-fbccbb0c-32c3-431a-9616-ef81653702db req-a04d2a41-0f83-4de9-9c19-65e01ef006d4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044127 May 21 21:50:44.706330 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3089/6056] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:50:45.636469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f3879b9a-5274-4dd4-9b12-6d9159a8df83 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:45.637198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f3879b9a-5274-4dd4-9b12-6d9159a8df83 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 2c8491cf-9f8f-4a29-a1bb-602dead261c6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:45.644630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3879b9a-5274-4dd4-9b12-6d9159a8df83 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:45.645168 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3879b9a-5274-4dd4-9b12-6d9159a8df83 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:45.646029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3879b9a-5274-4dd4-9b12-6d9159a8df83 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:45.646647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3879b9a-5274-4dd4-9b12-6d9159a8df83 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:46.021558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f3879b9a-5274-4dd4-9b12-6d9159a8df83 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:46.029933 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f3879b9a-5274-4dd4-9b12-6d9159a8df83 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6" status: 200 len: 1373 microversion: 2.1 time: 0.399036 May 21 21:50:46.030523 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2968/6057] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:45 2022] GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6 => generated 1373 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:47.047644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c9f655fc-6a04-489c-887d-e4176a40b167 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:47.048452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c9f655fc-6a04-489c-887d-e4176a40b167 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 2c8491cf-9f8f-4a29-a1bb-602dead261c6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:47.056976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c9f655fc-6a04-489c-887d-e4176a40b167 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:47.057446 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c9f655fc-6a04-489c-887d-e4176a40b167 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:47.058493 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c9f655fc-6a04-489c-887d-e4176a40b167 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:47.058945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c9f655fc-6a04-489c-887d-e4176a40b167 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:47.217356 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c9f655fc-6a04-489c-887d-e4176a40b167 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:47.226496 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c9f655fc-6a04-489c-887d-e4176a40b167 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6" status: 200 len: 1373 microversion: 2.1 time: 0.182568 May 21 21:50:47.227405 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3090/6058] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:47 2022] GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6 => generated 1373 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:48.243526 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e074360d-82cb-44c5-a8b7-87e7193ad5bc tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:48.244838 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e074360d-82cb-44c5-a8b7-87e7193ad5bc tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 2c8491cf-9f8f-4a29-a1bb-602dead261c6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:48.252742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e074360d-82cb-44c5-a8b7-87e7193ad5bc tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:48.253192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e074360d-82cb-44c5-a8b7-87e7193ad5bc tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:48.254365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e074360d-82cb-44c5-a8b7-87e7193ad5bc tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:48.254708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e074360d-82cb-44c5-a8b7-87e7193ad5bc tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:48.512498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e074360d-82cb-44c5-a8b7-87e7193ad5bc tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:48.521698 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e074360d-82cb-44c5-a8b7-87e7193ad5bc tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6" status: 200 len: 1373 microversion: 2.1 time: 0.282410 May 21 21:50:48.522431 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2969/6059] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:48 2022] GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6 => generated 1373 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:49.539561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-eb2cb8b5-b268-41d8-a943-5b28a601a8af tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:49.540337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-eb2cb8b5-b268-41d8-a943-5b28a601a8af tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 2c8491cf-9f8f-4a29-a1bb-602dead261c6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:49.543318 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:50:49.544034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=10 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:50:49.555996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eb2cb8b5-b268-41d8-a943-5b28a601a8af tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:49.556606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eb2cb8b5-b268-41d8-a943-5b28a601a8af tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:49.557333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eb2cb8b5-b268-41d8-a943-5b28a601a8af tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:49.557772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eb2cb8b5-b268-41d8-a943-5b28a601a8af tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:49.731629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-eb2cb8b5-b268-41d8-a943-5b28a601a8af tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:49.740066 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-eb2cb8b5-b268-41d8-a943-5b28a601a8af tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6" status: 200 len: 1373 microversion: 2.1 time: 0.204849 May 21 21:50:49.740688 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3091/6060] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:49 2022] GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6 => generated 1373 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:50.757898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-deea1468-a986-457c-a3aa-f0a2f33c2088 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:50.759191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-deea1468-a986-457c-a3aa-f0a2f33c2088 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 2c8491cf-9f8f-4a29-a1bb-602dead261c6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:50.765118 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:50:50.768704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-deea1468-a986-457c-a3aa-f0a2f33c2088 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:50.769412 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-deea1468-a986-457c-a3aa-f0a2f33c2088 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:50.770412 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-deea1468-a986-457c-a3aa-f0a2f33c2088 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:50.771141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-deea1468-a986-457c-a3aa-f0a2f33c2088 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:51.086982 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f3ce23fc-4592-40b8-8639-e7056f6e19d0 req-c7aa1881-37f7-477f-9d77-36bac22eab1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c8491cf-9f8f-4a29-a1bb-602dead261c6", "name": "network-vif-plugged", "status": "completed", "tag": "50454762-02de-4c97-9c88-870484e21913"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:50:51.100139 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f3ce23fc-4592-40b8-8639-e7056f6e19d0 req-c7aa1881-37f7-477f-9d77-36bac22eab1e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:51.100799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f3ce23fc-4592-40b8-8639-e7056f6e19d0 req-c7aa1881-37f7-477f-9d77-36bac22eab1e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:51.112536 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f3ce23fc-4592-40b8-8639-e7056f6e19d0 req-c7aa1881-37f7-477f-9d77-36bac22eab1e service nova] Creating event network-vif-plugged:50454762-02de-4c97-9c88-870484e21913 for instance 2c8491cf-9f8f-4a29-a1bb-602dead261c6 on nch2-master-1 May 21 21:50:51.119050 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f3ce23fc-4592-40b8-8639-e7056f6e19d0 req-c7aa1881-37f7-477f-9d77-36bac22eab1e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039051 May 21 21:50:51.119934 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3092/6061] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:50:51.257493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-deea1468-a986-457c-a3aa-f0a2f33c2088 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:51.266709 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-deea1468-a986-457c-a3aa-f0a2f33c2088 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6" status: 200 len: 1373 microversion: 2.1 time: 0.513288 May 21 21:50:51.267773 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2970/6062] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:50 2022] GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6 => generated 1373 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:52.286106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-55e4a0e3-5fb4-4b68-b6d1-32046a59522e tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:52.287770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-55e4a0e3-5fb4-4b68-b6d1-32046a59522e tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 2c8491cf-9f8f-4a29-a1bb-602dead261c6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:52.298663 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-55e4a0e3-5fb4-4b68-b6d1-32046a59522e tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:52.299535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-55e4a0e3-5fb4-4b68-b6d1-32046a59522e tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:52.300868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-55e4a0e3-5fb4-4b68-b6d1-32046a59522e tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:52.300868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-55e4a0e3-5fb4-4b68-b6d1-32046a59522e tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:52.519003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-55e4a0e3-5fb4-4b68-b6d1-32046a59522e tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:52.532633 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-55e4a0e3-5fb4-4b68-b6d1-32046a59522e tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6" status: 200 len: 1373 microversion: 2.1 time: 0.251567 May 21 21:50:52.533481 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3093/6063] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:52 2022] GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6 => generated 1373 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:53.550049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c0d781ad-a853-4c6b-abef-0c22b29be401 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:53.550920 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c0d781ad-a853-4c6b-abef-0c22b29be401 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 2c8491cf-9f8f-4a29-a1bb-602dead261c6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:53.559909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c0d781ad-a853-4c6b-abef-0c22b29be401 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:53.560678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c0d781ad-a853-4c6b-abef-0c22b29be401 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:53.561490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c0d781ad-a853-4c6b-abef-0c22b29be401 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:53.562431 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c0d781ad-a853-4c6b-abef-0c22b29be401 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:53.816609 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c0d781ad-a853-4c6b-abef-0c22b29be401 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:53.820849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:50:53.832517 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c0d781ad-a853-4c6b-abef-0c22b29be401 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6" status: 200 len: 1546 microversion: 2.1 time: 0.279664 May 21 21:50:53.832517 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2971/6064] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:53 2022] GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6 => generated 1546 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:53.842620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bd9c72b4-13f3-4a59-9094-7571626b29db tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:50:53.843264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bd9c72b4-13f3-4a59-9094-7571626b29db tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 2c8491cf-9f8f-4a29-a1bb-602dead261c6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:53.850368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd9c72b4-13f3-4a59-9094-7571626b29db tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:53.851588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd9c72b4-13f3-4a59-9094-7571626b29db tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:53.852602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd9c72b4-13f3-4a59-9094-7571626b29db tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:53.853061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd9c72b4-13f3-4a59-9094-7571626b29db tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:54.092261 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bd9c72b4-13f3-4a59-9094-7571626b29db tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:50:54.100001 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bd9c72b4-13f3-4a59-9094-7571626b29db tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6" status: 200 len: 1546 microversion: 2.1 time: 0.261482 May 21 21:50:54.100668 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3094/6065] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:50:53 2022] GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6 => generated 1546 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:50:56.902619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-ca6ab2f9-4154-4549-ab73-5000504ca372 req-a22c9f49-78b8-4211-9682-21a013d168af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c8491cf-9f8f-4a29-a1bb-602dead261c6", "tag": "50454762-02de-4c97-9c88-870484e21913"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:50:56.912119 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ca6ab2f9-4154-4549-ab73-5000504ca372 req-a22c9f49-78b8-4211-9682-21a013d168af service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:56.912790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ca6ab2f9-4154-4549-ab73-5000504ca372 req-a22c9f49-78b8-4211-9682-21a013d168af service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:56.926403 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-ca6ab2f9-4154-4549-ab73-5000504ca372 req-a22c9f49-78b8-4211-9682-21a013d168af service nova] Creating event network-changed:50454762-02de-4c97-9c88-870484e21913 for instance 2c8491cf-9f8f-4a29-a1bb-602dead261c6 on nch2-master-1 May 21 21:50:56.934246 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-ca6ab2f9-4154-4549-ab73-5000504ca372 req-a22c9f49-78b8-4211-9682-21a013d168af service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034196 May 21 21:50:56.935183 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2972/6066] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:50:56.963029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4d493dbd-6303-4db2-a867-c2aaf67801a5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:50:56.964142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4d493dbd-6303-4db2-a867-c2aaf67801a5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:50:56.973585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d493dbd-6303-4db2-a867-c2aaf67801a5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:56.974158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d493dbd-6303-4db2-a867-c2aaf67801a5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:56.975055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d493dbd-6303-4db2-a867-c2aaf67801a5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:50:56.975723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d493dbd-6303-4db2-a867-c2aaf67801a5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:50:57.044344 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4d493dbd-6303-4db2-a867-c2aaf67801a5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d/action" status: 200 len: 24577 microversion: 2.1 time: 0.090286 May 21 21:50:57.045023 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3095/6067] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:50:56 2022] POST /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d/action => generated 24577 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 21 21:51:03.236959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fc70bb80-711d-4fbb-9075-5c869e04e90d tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:03.237727 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fc70bb80-711d-4fbb-9075-5c869e04e90d tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:03.246123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc70bb80-711d-4fbb-9075-5c869e04e90d tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:03.246591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc70bb80-711d-4fbb-9075-5c869e04e90d tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:03.247536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc70bb80-711d-4fbb-9075-5c869e04e90d tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:03.247977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc70bb80-711d-4fbb-9075-5c869e04e90d tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:03.422869 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fc70bb80-711d-4fbb-9075-5c869e04e90d tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1834 microversion: 2.1 time: 0.191583 May 21 21:51:03.423472 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2973/6068] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:03 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1834 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:51:05.055030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8d1cc6d7-b959-488b-913c-93b7ef71cdbc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:05.055645 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8d1cc6d7-b959-488b-913c-93b7ef71cdbc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:05.056651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-3a9d4337-a379-40bc-80cb-b440833c13a0 req-58371a81-82cf-4bea-8452-9b7f9936d45a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b5d5ca4-8254-4287-a682-0393951bfb7d", "tag": "079739f3-5bd8-4b2e-919a-ddd4ca9e7d87"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:51:05.066301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3a9d4337-a379-40bc-80cb-b440833c13a0 req-58371a81-82cf-4bea-8452-9b7f9936d45a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:05.067033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-3a9d4337-a379-40bc-80cb-b440833c13a0 req-58371a81-82cf-4bea-8452-9b7f9936d45a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:05.072398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8d1cc6d7-b959-488b-913c-93b7ef71cdbc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:05.072398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8d1cc6d7-b959-488b-913c-93b7ef71cdbc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:05.079775 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-3a9d4337-a379-40bc-80cb-b440833c13a0 req-58371a81-82cf-4bea-8452-9b7f9936d45a service nova] Creating event network-changed:079739f3-5bd8-4b2e-919a-ddd4ca9e7d87 for instance 7b5d5ca4-8254-4287-a682-0393951bfb7d on nch2-master-1 May 21 21:51:05.080023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8d1cc6d7-b959-488b-913c-93b7ef71cdbc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:05.080538 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8d1cc6d7-b959-488b-913c-93b7ef71cdbc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:05.090122 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-3a9d4337-a379-40bc-80cb-b440833c13a0 req-58371a81-82cf-4bea-8452-9b7f9936d45a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037295 May 21 21:51:05.093378 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:51:05.105709 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2974/6069] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:51:05.126330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8d1cc6d7-b959-488b-913c-93b7ef71cdbc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:51:05.444674 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8d1cc6d7-b959-488b-913c-93b7ef71cdbc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 204 len: 0 microversion: 2.1 time: 0.392998 May 21 21:51:05.450468 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3096/6070] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:51:05 2022] DELETE /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:51:05.454738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cc5c1007-2bda-4fb7-9fb2-61a50bd4b922 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:05.455688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cc5c1007-2bda-4fb7-9fb2-61a50bd4b922 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:05.466312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cc5c1007-2bda-4fb7-9fb2-61a50bd4b922 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:05.466997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cc5c1007-2bda-4fb7-9fb2-61a50bd4b922 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:05.468002 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cc5c1007-2bda-4fb7-9fb2-61a50bd4b922 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:05.468484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cc5c1007-2bda-4fb7-9fb2-61a50bd4b922 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:05.700454 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cc5c1007-2bda-4fb7-9fb2-61a50bd4b922 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:05.712014 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cc5c1007-2bda-4fb7-9fb2-61a50bd4b922 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1689 microversion: 2.1 time: 0.262079 May 21 21:51:05.715902 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2975/6071] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:05 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1689 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:06.731823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c05d5bc6-f18d-4748-b3f8-8a6bbba4a5c0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:06.733276 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c05d5bc6-f18d-4748-b3f8-8a6bbba4a5c0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:06.743817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c05d5bc6-f18d-4748-b3f8-8a6bbba4a5c0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:06.748091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c05d5bc6-f18d-4748-b3f8-8a6bbba4a5c0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:06.748091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c05d5bc6-f18d-4748-b3f8-8a6bbba4a5c0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:06.748091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c05d5bc6-f18d-4748-b3f8-8a6bbba4a5c0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:07.026164 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c05d5bc6-f18d-4748-b3f8-8a6bbba4a5c0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:07.036426 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c05d5bc6-f18d-4748-b3f8-8a6bbba4a5c0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1689 microversion: 2.1 time: 0.308830 May 21 21:51:07.047204 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3097/6072] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:06 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1689 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:07.634696 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-e2407ff6-81d2-4468-bdc6-7e121a6aa64d req-994e85fd-e0db-4a06-b713-8ee9863bd664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5d5ca4-8254-4287-a682-0393951bfb7d", "name": "network-vif-deleted", "tag": "079739f3-5bd8-4b2e-919a-ddd4ca9e7d87"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:51:07.644679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e2407ff6-81d2-4468-bdc6-7e121a6aa64d req-994e85fd-e0db-4a06-b713-8ee9863bd664 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:07.645130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e2407ff6-81d2-4468-bdc6-7e121a6aa64d req-994e85fd-e0db-4a06-b713-8ee9863bd664 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:07.660882 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-e2407ff6-81d2-4468-bdc6-7e121a6aa64d req-994e85fd-e0db-4a06-b713-8ee9863bd664 service nova] Creating event network-vif-deleted:079739f3-5bd8-4b2e-919a-ddd4ca9e7d87 for instance 7b5d5ca4-8254-4287-a682-0393951bfb7d on nch2-master-1 May 21 21:51:07.670243 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-e2407ff6-81d2-4468-bdc6-7e121a6aa64d req-994e85fd-e0db-4a06-b713-8ee9863bd664 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040015 May 21 21:51:07.670860 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2976/6073] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:51:08.054199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1342e19a-bd0a-4c2e-a395-8dea4f1c4163 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:08.055894 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1342e19a-bd0a-4c2e-a395-8dea4f1c4163 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:08.064666 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1342e19a-bd0a-4c2e-a395-8dea4f1c4163 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:08.064794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1342e19a-bd0a-4c2e-a395-8dea4f1c4163 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:08.065570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1342e19a-bd0a-4c2e-a395-8dea4f1c4163 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:08.066029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1342e19a-bd0a-4c2e-a395-8dea4f1c4163 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:08.100777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1342e19a-bd0a-4c2e-a395-8dea4f1c4163 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:08.101330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1342e19a-bd0a-4c2e-a395-8dea4f1c4163 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:08.101875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-1342e19a-bd0a-4c2e-a395-8dea4f1c4163 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lazy-loading 'fault' on Instance uuid 7b5d5ca4-8254-4287-a682-0393951bfb7d {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:51:08.151364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1342e19a-bd0a-4c2e-a395-8dea4f1c4163 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:08.159595 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1342e19a-bd0a-4c2e-a395-8dea4f1c4163 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 200 len: 1356 microversion: 2.1 time: 0.109411 May 21 21:51:08.160187 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3098/6074] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:08 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:09.179542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-58257dd8-6253-4c6f-8f4c-41b8d7ecfc7e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:09.180168 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-58257dd8-6253-4c6f-8f4c-41b8d7ecfc7e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 7b5d5ca4-8254-4287-a682-0393951bfb7d] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:09.189617 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58257dd8-6253-4c6f-8f4c-41b8d7ecfc7e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:09.190545 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58257dd8-6253-4c6f-8f4c-41b8d7ecfc7e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:09.191569 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58257dd8-6253-4c6f-8f4c-41b8d7ecfc7e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:09.192204 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-58257dd8-6253-4c6f-8f4c-41b8d7ecfc7e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:09.209097 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-58257dd8-6253-4c6f-8f4c-41b8d7ecfc7e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] HTTP exception thrown: Instance 7b5d5ca4-8254-4287-a682-0393951bfb7d could not be found. May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-58257dd8-6253-4c6f-8f4c-41b8d7ecfc7e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Request method failure captured: May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d HTTP/1.1 May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiV5VnUrknEwJKQM-WmDDXb2WufWDMrIUBPERVQo0MOrFG494HmHdgIu5jdLUtPa4_DBj5sq24NqkmSSt6MexXklLlGmt5CTgD8iXAEeAGP0tG9opX27ER-CIt0-AlckG2ItDlVMH5gqQmzk8JSj3q6SbbQAXv8Oz4tAeyuiI7B1mjck May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 3b2e8e3a4821406893ebe9c189311cbf May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1083505785 May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3b2e8e3a4821406893ebe9c189311cbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b2e8e3a4821406893ebe9c189311cbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3b2e8e3a4821406893ebe9c189311cbf", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b2e8e3a4821406893ebe9c189311cbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1083505785 May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 3b2e8e3a4821406893ebe9c189311cbf May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1083505785 May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestNetworkAdvancedServerOps-1083505785-project May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 3083c05994cd4f599a2def7fa1281d60 May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1083505785-project May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 7b5d5ca4-8254-4287-a682-0393951bfb7d could not be found. May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '7b5d5ca4-8254-4287-a682-0393951bfb7d'} May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b5d5ca4-8254-4287-a682-0393951bfb7d could not be found. May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b5d5ca4-8254-4287-a682-0393951bfb7d could not be found. May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:51:09.211961 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:51:09.217488 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:51:09.217488 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:51:09.217488 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:51:09.217488 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:51:09.217488 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:51:09.217488 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:51:09.217488 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b5d5ca4-8254-4287-a682-0393951bfb7d could not be found. May 21 21:51:09.217488 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:51:09.219088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-58257dd8-6253-4c6f-8f4c-41b8d7ecfc7e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Returning 404 to user: Instance 7b5d5ca4-8254-4287-a682-0393951bfb7d could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:51:09.220222 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-58257dd8-6253-4c6f-8f4c-41b8d7ecfc7e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d" status: 404 len: 111 microversion: 2.1 time: 0.046742 May 21 21:51:09.221539 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2977/6075] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:09 2022] GET /compute/v2.1/servers/7b5d5ca4-8254-4287-a682-0393951bfb7d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:51:14.838450 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-12df0925-d4ac-436d-95c1-eee47f0eba0d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '.version_select at 0x7fc81b386a60>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:14.856251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:51:14.940966 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-12df0925-d4ac-436d-95c1-eee47f0eba0d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1291906418" status: 202 len: 0 microversion: 2.1 time: 0.105842 May 21 21:51:14.945359 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3099/6076] 10.222.0.49 () {58 vars in 1283 bytes} [Sat May 21 21:51:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1291906418 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:51:14.973066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9a8c2b95-403b-4407-b203-3422c05bee35 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'create', calling method: .version_select at 0x7fc81a235e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1462823230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNUR/oJBP3VVELizPEta3oH7XM7IhYYeXfl9lp+m+PCxPJr8jCWcS7znu4xKzWnEVcsqJMeILWUhlHsE5hl4NdDo+zoMMSRA+SW8AonOkZEYKVQxZBwusinGxE+ZBFldw=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:51:14.982441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=28 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:51:14.994339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-9a8c2b95-403b-4407-b203-3422c05bee35 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Getting quotas for project 3b2e8e3a4821406893ebe9c189311cbf. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:51:15.001612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-9a8c2b95-403b-4407-b203-3422c05bee35 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Getting quotas for user 3083c05994cd4f599a2def7fa1281d60 and project 3b2e8e3a4821406893ebe9c189311cbf. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:51:15.102050 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9a8c2b95-403b-4407-b203-3422c05bee35 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.131401 May 21 21:51:15.102386 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2978/6077] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:51:14 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:51:17.350367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-08e18bce-c2bc-4477-9a8f-dca320f766f4 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:51:17.351874 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-08e18bce-c2bc-4477-9a8f-dca320f766f4 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 2c8491cf-9f8f-4a29-a1bb-602dead261c6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:17.372617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08e18bce-c2bc-4477-9a8f-dca320f766f4 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:17.374168 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08e18bce-c2bc-4477-9a8f-dca320f766f4 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:17.375084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08e18bce-c2bc-4477-9a8f-dca320f766f4 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:17.376805 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-08e18bce-c2bc-4477-9a8f-dca320f766f4 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:17.432427 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-08e18bce-c2bc-4477-9a8f-dca320f766f4 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "POST /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6/action" status: 200 len: 24574 microversion: 2.1 time: 0.086633 May 21 21:51:17.434120 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3100/6078] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:51:17 2022] POST /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6/action => generated 24574 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:51:25.263539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=20 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:51:25.264671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:51:25.265625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:51:25.271360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5d949def-6206-4e71-b8e9-20793919666e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-169797783", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "ee306bcd-56f2-477f-b92e-e7c2ca4fd7bd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1462823230", "security_groups": [{"name": "tempest-secgroup-smoke-1489035570"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:51:25.446284 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-5d949def-6206-4e71-b8e9-20793919666e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] validate_networks() for [('ee306bcd-56f2-477f-b92e-e7c2ca4fd7bd', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:51:25.963247 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-5d949def-6206-4e71-b8e9-20793919666e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:51:25.963799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-5d949def-6206-4e71-b8e9-20793919666e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:51:25.964392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-5d949def-6206-4e71-b8e9-20793919666e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:51:25.964806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-5d949def-6206-4e71-b8e9-20793919666e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:51:25.965222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-5d949def-6206-4e71-b8e9-20793919666e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:51:25.975536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d949def-6206-4e71-b8e9-20793919666e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:25.976689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d949def-6206-4e71-b8e9-20793919666e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:25.978868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d949def-6206-4e71-b8e9-20793919666e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:25.978868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d949def-6206-4e71-b8e9-20793919666e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:25.997769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-5d949def-6206-4e71-b8e9-20793919666e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Getting quotas for project 3b2e8e3a4821406893ebe9c189311cbf. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:51:26.003253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-5d949def-6206-4e71-b8e9-20793919666e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Getting quotas for user 3083c05994cd4f599a2def7fa1281d60 and project 3b2e8e3a4821406893ebe9c189311cbf. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:51:26.016981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5d949def-6206-4e71-b8e9-20793919666e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:51:26.019310 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5d949def-6206-4e71-b8e9-20793919666e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:51:26.143813 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5d949def-6206-4e71-b8e9-20793919666e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.882316 May 21 21:51:26.145483 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2979/6079] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:51:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:51:26.158734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5482ca6f-485c-4c3e-9eac-043edb39bc36 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:26.160415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5482ca6f-485c-4c3e-9eac-043edb39bc36 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:26.262709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5482ca6f-485c-4c3e-9eac-043edb39bc36 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:26.272852 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5482ca6f-485c-4c3e-9eac-043edb39bc36 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1266 microversion: 2.1 time: 0.118957 May 21 21:51:26.273825 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3101/6080] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:26 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:27.298286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-95f85cd4-e69d-4215-93c3-5e7aef41ac8e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:27.304956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-95f85cd4-e69d-4215-93c3-5e7aef41ac8e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:27.312968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95f85cd4-e69d-4215-93c3-5e7aef41ac8e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:27.313555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95f85cd4-e69d-4215-93c3-5e7aef41ac8e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:27.314499 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95f85cd4-e69d-4215-93c3-5e7aef41ac8e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:27.315275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95f85cd4-e69d-4215-93c3-5e7aef41ac8e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:27.421865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-95f85cd4-e69d-4215-93c3-5e7aef41ac8e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:27.440875 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-95f85cd4-e69d-4215-93c3-5e7aef41ac8e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1270 microversion: 2.1 time: 0.154036 May 21 21:51:27.442038 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2980/6081] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:27 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:28.459860 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2045132d-eefd-45bb-93bb-4634fcf0014d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:28.461448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2045132d-eefd-45bb-93bb-4634fcf0014d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:28.465070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:51:28.471977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2045132d-eefd-45bb-93bb-4634fcf0014d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:28.472496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2045132d-eefd-45bb-93bb-4634fcf0014d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:28.473363 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2045132d-eefd-45bb-93bb-4634fcf0014d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:28.473836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2045132d-eefd-45bb-93bb-4634fcf0014d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:28.588941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2045132d-eefd-45bb-93bb-4634fcf0014d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:28.598602 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2045132d-eefd-45bb-93bb-4634fcf0014d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1326 microversion: 2.1 time: 0.144050 May 21 21:51:28.599274 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3102/6082] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:28 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1326 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:29.624373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-24d1d59d-b8f7-4e9c-a470-a17048e74f18 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:29.624373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-24d1d59d-b8f7-4e9c-a470-a17048e74f18 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:29.636010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24d1d59d-b8f7-4e9c-a470-a17048e74f18 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:29.637264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24d1d59d-b8f7-4e9c-a470-a17048e74f18 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:29.638246 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24d1d59d-b8f7-4e9c-a470-a17048e74f18 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:29.638685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24d1d59d-b8f7-4e9c-a470-a17048e74f18 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:29.803033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-24d1d59d-b8f7-4e9c-a470-a17048e74f18 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:29.811629 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-24d1d59d-b8f7-4e9c-a470-a17048e74f18 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1392 microversion: 2.1 time: 0.195729 May 21 21:51:29.812240 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2981/6083] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:29 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1392 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:30.790312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-2d23f711-0773-474f-b446-123e9eef9487 req-14df3b2c-229d-4139-a5d6-a7ea39ab873e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d0c42d1-f95b-455e-82e7-44bfe6033c19", "tag": "e289a815-e375-4419-ad91-9bc59bc45f55"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:51:30.804113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2d23f711-0773-474f-b446-123e9eef9487 req-14df3b2c-229d-4139-a5d6-a7ea39ab873e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:30.804627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2d23f711-0773-474f-b446-123e9eef9487 req-14df3b2c-229d-4139-a5d6-a7ea39ab873e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:30.816539 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-2d23f711-0773-474f-b446-123e9eef9487 req-14df3b2c-229d-4139-a5d6-a7ea39ab873e service nova] Creating event network-changed:e289a815-e375-4419-ad91-9bc59bc45f55 for instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 on nch1-master-1 May 21 21:51:30.821959 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-2d23f711-0773-474f-b446-123e9eef9487 req-14df3b2c-229d-4139-a5d6-a7ea39ab873e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037363 May 21 21:51:30.822789 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3103/6084] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:51:30.836747 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f3902aa9-498c-415e-b598-fffcbcc9e4e4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:30.837390 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f3902aa9-498c-415e-b598-fffcbcc9e4e4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:30.846724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3902aa9-498c-415e-b598-fffcbcc9e4e4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:30.847186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3902aa9-498c-415e-b598-fffcbcc9e4e4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:30.848140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3902aa9-498c-415e-b598-fffcbcc9e4e4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:30.848628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f3902aa9-498c-415e-b598-fffcbcc9e4e4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:31.320321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f3902aa9-498c-415e-b598-fffcbcc9e4e4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:31.328469 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f3902aa9-498c-415e-b598-fffcbcc9e4e4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1392 microversion: 2.1 time: 0.501952 May 21 21:51:31.329057 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2982/6085] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:30 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1392 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:51:32.347699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2b1df7b5-48cd-4148-8e55-66526ecda0b7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:32.348444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2b1df7b5-48cd-4148-8e55-66526ecda0b7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:32.355519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b1df7b5-48cd-4148-8e55-66526ecda0b7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:32.355979 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b1df7b5-48cd-4148-8e55-66526ecda0b7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:32.356863 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b1df7b5-48cd-4148-8e55-66526ecda0b7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:32.357315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b1df7b5-48cd-4148-8e55-66526ecda0b7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:32.548740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2b1df7b5-48cd-4148-8e55-66526ecda0b7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:32.556618 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2b1df7b5-48cd-4148-8e55-66526ecda0b7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1392 microversion: 2.1 time: 0.214050 May 21 21:51:32.557193 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3104/6086] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:32 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1392 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:33.417461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b5a59078-3ecd-40bf-8cc8-b98630e0f245 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Action: 'create', calling method: .version_select at 0x7fc81ad075e0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1669091276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/+bZjzRo/gtmY2w0ncdEKNgL2Pqx4m166I0ootEGVfm6eDmbdm4V2c63fk0ji2j9+Yt/JNoqsQNAXsUbqd82ibqPoeOZl9SsporQAQCcXolutEg02Of8xhKbFEar/YBg=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:51:33.434313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-b5a59078-3ecd-40bf-8cc8-b98630e0f245 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Getting quotas for project 31d683aab56145779b2614a9a0606556. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:51:33.440557 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-b5a59078-3ecd-40bf-8cc8-b98630e0f245 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Getting quotas for user 1f3a4acfcf07489abcedb1616deb915a and project 31d683aab56145779b2614a9a0606556. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:51:33.574495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8fbb9eed-a630-4f6e-bd37-0f508ffe7840 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:33.575137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8fbb9eed-a630-4f6e-bd37-0f508ffe7840 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:33.581943 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8fbb9eed-a630-4f6e-bd37-0f508ffe7840 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:33.582415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8fbb9eed-a630-4f6e-bd37-0f508ffe7840 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:33.583207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8fbb9eed-a630-4f6e-bd37-0f508ffe7840 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:33.583664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8fbb9eed-a630-4f6e-bd37-0f508ffe7840 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:33.591809 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b5a59078-3ecd-40bf-8cc8-b98630e0f245 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.178466 May 21 21:51:33.593258 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2983/6087] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:51:33 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:51:33.760883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8fbb9eed-a630-4f6e-bd37-0f508ffe7840 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:33.769007 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8fbb9eed-a630-4f6e-bd37-0f508ffe7840 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1392 microversion: 2.1 time: 0.198612 May 21 21:51:33.769605 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3105/6088] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:33 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1392 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:51:34.787547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ff0d1b02-599d-43e2-8c59-2dc29a7d92ec tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:34.794643 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ff0d1b02-599d-43e2-8c59-2dc29a7d92ec tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:34.810026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff0d1b02-599d-43e2-8c59-2dc29a7d92ec tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:34.810485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff0d1b02-599d-43e2-8c59-2dc29a7d92ec tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:34.811290 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff0d1b02-599d-43e2-8c59-2dc29a7d92ec tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:34.811738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff0d1b02-599d-43e2-8c59-2dc29a7d92ec tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:35.018386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ff0d1b02-599d-43e2-8c59-2dc29a7d92ec tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:35.030133 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ff0d1b02-599d-43e2-8c59-2dc29a7d92ec tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1392 microversion: 2.1 time: 0.246853 May 21 21:51:35.030712 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2984/6089] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:34 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1392 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:36.047750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2003d3a4-3348-403e-8563-9d719f9516f7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:36.048446 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2003d3a4-3348-403e-8563-9d719f9516f7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:36.059635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2003d3a4-3348-403e-8563-9d719f9516f7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:36.063844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2003d3a4-3348-403e-8563-9d719f9516f7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:36.063844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2003d3a4-3348-403e-8563-9d719f9516f7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:36.063844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2003d3a4-3348-403e-8563-9d719f9516f7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:36.191840 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:51:36.246284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2003d3a4-3348-403e-8563-9d719f9516f7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:36.267002 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2003d3a4-3348-403e-8563-9d719f9516f7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1392 microversion: 2.1 time: 0.223603 May 21 21:51:36.268658 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3106/6090] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:36 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1392 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:36.336501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-7e8423fc-1982-4ea1-92df-59914f93f0c5 req-7a8138a0-ebdc-4a89-a6aa-b7f011e08087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d0c42d1-f95b-455e-82e7-44bfe6033c19", "name": "network-vif-plugged", "status": "completed", "tag": "e289a815-e375-4419-ad91-9bc59bc45f55"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:51:36.349129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-7e8423fc-1982-4ea1-92df-59914f93f0c5 req-7a8138a0-ebdc-4a89-a6aa-b7f011e08087 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:36.350695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-7e8423fc-1982-4ea1-92df-59914f93f0c5 req-7a8138a0-ebdc-4a89-a6aa-b7f011e08087 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:36.362708 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-7e8423fc-1982-4ea1-92df-59914f93f0c5 req-7a8138a0-ebdc-4a89-a6aa-b7f011e08087 service nova] Creating event network-vif-plugged:e289a815-e375-4419-ad91-9bc59bc45f55 for instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 on nch1-master-1 May 21 21:51:36.368335 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-7e8423fc-1982-4ea1-92df-59914f93f0c5 req-7a8138a0-ebdc-4a89-a6aa-b7f011e08087 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206297 May 21 21:51:36.369033 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2985/6091] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:51:37.014865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ad20c39d-36a6-410f-a200-7778f9bce9a1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-676124070", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "f0f584b4-d374-4f6e-b137-71d240bce530"}], "key_name": "tempest-TestNetworkBasicOps-1669091276", "security_groups": [{"name": "tempest-secgroup-smoke-1336838521"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:51:37.034628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:51:37.127430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-ad20c39d-36a6-410f-a200-7778f9bce9a1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] validate_networks() for [('f0f584b4-d374-4f6e-b137-71d240bce530', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:51:37.287470 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cd03eeae-6982-4ee9-b0a9-f8b3cd37d691 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:37.288718 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cd03eeae-6982-4ee9-b0a9-f8b3cd37d691 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:37.295286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd03eeae-6982-4ee9-b0a9-f8b3cd37d691 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:37.295745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd03eeae-6982-4ee9-b0a9-f8b3cd37d691 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:37.297505 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd03eeae-6982-4ee9-b0a9-f8b3cd37d691 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:37.298509 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd03eeae-6982-4ee9-b0a9-f8b3cd37d691 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:37.478285 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cd03eeae-6982-4ee9-b0a9-f8b3cd37d691 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:37.486359 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cd03eeae-6982-4ee9-b0a9-f8b3cd37d691 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1392 microversion: 2.1 time: 0.204669 May 21 21:51:37.505269 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2986/6092] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:37 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1392 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:37.602977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ad20c39d-36a6-410f-a200-7778f9bce9a1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:51:37.603758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ad20c39d-36a6-410f-a200-7778f9bce9a1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:51:37.604705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ad20c39d-36a6-410f-a200-7778f9bce9a1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:51:37.605139 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ad20c39d-36a6-410f-a200-7778f9bce9a1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:51:37.605599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ad20c39d-36a6-410f-a200-7778f9bce9a1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:51:37.616069 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad20c39d-36a6-410f-a200-7778f9bce9a1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:37.616569 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad20c39d-36a6-410f-a200-7778f9bce9a1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:37.617388 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad20c39d-36a6-410f-a200-7778f9bce9a1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:37.617839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad20c39d-36a6-410f-a200-7778f9bce9a1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:37.636373 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ad20c39d-36a6-410f-a200-7778f9bce9a1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Getting quotas for project 31d683aab56145779b2614a9a0606556. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:51:37.641959 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ad20c39d-36a6-410f-a200-7778f9bce9a1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Getting quotas for user 1f3a4acfcf07489abcedb1616deb915a and project 31d683aab56145779b2614a9a0606556. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:51:37.656427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ad20c39d-36a6-410f-a200-7778f9bce9a1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:51:37.658741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ad20c39d-36a6-410f-a200-7778f9bce9a1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:51:37.790792 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ad20c39d-36a6-410f-a200-7778f9bce9a1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.780098 May 21 21:51:37.791456 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3107/6093] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:51:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:51:37.801922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4aee7f8f-93a4-4bb3-a967-40d80faf9005 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:37.802762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4aee7f8f-93a4-4bb3-a967-40d80faf9005 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:37.863684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4aee7f8f-93a4-4bb3-a967-40d80faf9005 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:37.871096 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4aee7f8f-93a4-4bb3-a967-40d80faf9005 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a" status: 200 len: 1248 microversion: 2.1 time: 0.073235 May 21 21:51:37.871922 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2987/6094] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:37 2022] GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a => generated 1248 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:38.511943 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e756f2e9-0b3b-4642-88a9-67cff956c7a2 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:38.512595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e756f2e9-0b3b-4642-88a9-67cff956c7a2 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:38.521228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e756f2e9-0b3b-4642-88a9-67cff956c7a2 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:38.521492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e756f2e9-0b3b-4642-88a9-67cff956c7a2 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:38.522303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e756f2e9-0b3b-4642-88a9-67cff956c7a2 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:38.522766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e756f2e9-0b3b-4642-88a9-67cff956c7a2 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:38.686668 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e756f2e9-0b3b-4642-88a9-67cff956c7a2 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:38.695666 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e756f2e9-0b3b-4642-88a9-67cff956c7a2 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1565 microversion: 2.1 time: 0.188524 May 21 21:51:38.696339 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3108/6095] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:38 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1565 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:38.712216 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-15276fec-0a2e-4cd9-a77c-a18010f48de0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:38.712877 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-15276fec-0a2e-4cd9-a77c-a18010f48de0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:38.722227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-15276fec-0a2e-4cd9-a77c-a18010f48de0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:38.722580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-15276fec-0a2e-4cd9-a77c-a18010f48de0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:38.723680 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-15276fec-0a2e-4cd9-a77c-a18010f48de0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:38.724736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-15276fec-0a2e-4cd9-a77c-a18010f48de0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:38.879312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-15276fec-0a2e-4cd9-a77c-a18010f48de0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:38.888695 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-255e8ae9-7880-425f-a03c-03e3eb53a582 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:38.889197 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-15276fec-0a2e-4cd9-a77c-a18010f48de0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1565 microversion: 2.1 time: 0.180822 May 21 21:51:38.889790 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2988/6096] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:38 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:38.890292 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-255e8ae9-7880-425f-a03c-03e3eb53a582 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:38.899342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-255e8ae9-7880-425f-a03c-03e3eb53a582 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:38.899342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-255e8ae9-7880-425f-a03c-03e3eb53a582 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:38.899727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-255e8ae9-7880-425f-a03c-03e3eb53a582 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:38.899905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-255e8ae9-7880-425f-a03c-03e3eb53a582 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:38.976508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-255e8ae9-7880-425f-a03c-03e3eb53a582 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:38.984370 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-255e8ae9-7880-425f-a03c-03e3eb53a582 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a" status: 200 len: 1252 microversion: 2.1 time: 0.099919 May 21 21:51:38.985085 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3109/6097] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:38 2022] GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a => generated 1252 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:51:40.002324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-afd7f124-b14a-4da6-9488-1245cce96ed2 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:40.003649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-afd7f124-b14a-4da6-9488-1245cce96ed2 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:40.011624 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-afd7f124-b14a-4da6-9488-1245cce96ed2 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:40.012240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-afd7f124-b14a-4da6-9488-1245cce96ed2 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:40.013158 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-afd7f124-b14a-4da6-9488-1245cce96ed2 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:40.013686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-afd7f124-b14a-4da6-9488-1245cce96ed2 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:40.097135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-afd7f124-b14a-4da6-9488-1245cce96ed2 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:40.107355 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-afd7f124-b14a-4da6-9488-1245cce96ed2 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a" status: 200 len: 1300 microversion: 2.1 time: 0.109170 May 21 21:51:40.107956 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2989/6098] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:39 2022] GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a => generated 1300 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:41.136151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-70157718-e1cd-4c04-a22d-e91f7406be24 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:41.136828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-70157718-e1cd-4c04-a22d-e91f7406be24 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:41.144853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-70157718-e1cd-4c04-a22d-e91f7406be24 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:41.144853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-70157718-e1cd-4c04-a22d-e91f7406be24 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:41.145511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-70157718-e1cd-4c04-a22d-e91f7406be24 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:41.145985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-70157718-e1cd-4c04-a22d-e91f7406be24 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:41.450858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-70157718-e1cd-4c04-a22d-e91f7406be24 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:41.459991 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-70157718-e1cd-4c04-a22d-e91f7406be24 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a" status: 200 len: 1374 microversion: 2.1 time: 0.327484 May 21 21:51:41.464659 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3110/6099] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:41 2022] GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a => generated 1374 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:42.035911 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f0d1cae1-cac5-4416-aabd-94e2e345e173 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:42.036574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f0d1cae1-cac5-4416-aabd-94e2e345e173 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:42.045199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-2cee54cd-7132-4f83-9d87-f0fbec1ec4ae req-f4c4f4c2-6a44-408b-bfa1-a237869019cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d0c42d1-f95b-455e-82e7-44bfe6033c19", "tag": "e289a815-e375-4419-ad91-9bc59bc45f55"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:51:42.055143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0d1cae1-cac5-4416-aabd-94e2e345e173 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:42.055968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0d1cae1-cac5-4416-aabd-94e2e345e173 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:42.057057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0d1cae1-cac5-4416-aabd-94e2e345e173 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:42.057661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f0d1cae1-cac5-4416-aabd-94e2e345e173 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:42.058492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2cee54cd-7132-4f83-9d87-f0fbec1ec4ae req-f4c4f4c2-6a44-408b-bfa1-a237869019cd service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:42.060555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2cee54cd-7132-4f83-9d87-f0fbec1ec4ae req-f4c4f4c2-6a44-408b-bfa1-a237869019cd service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:42.075730 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-2cee54cd-7132-4f83-9d87-f0fbec1ec4ae req-f4c4f4c2-6a44-408b-bfa1-a237869019cd service nova] Creating event network-changed:e289a815-e375-4419-ad91-9bc59bc45f55 for instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 on nch1-master-1 May 21 21:51:42.082451 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-2cee54cd-7132-4f83-9d87-f0fbec1ec4ae req-f4c4f4c2-6a44-408b-bfa1-a237869019cd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040548 May 21 21:51:42.083761 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3111/6100] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:51:42.395368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f0d1cae1-cac5-4416-aabd-94e2e345e173 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:42.414070 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f0d1cae1-cac5-4416-aabd-94e2e345e173 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1565 microversion: 2.1 time: 0.382281 May 21 21:51:42.415123 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2990/6101] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:42 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1565 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:42.480008 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f1df90dc-58dc-4b81-accf-488f56022b55 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:42.481442 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f1df90dc-58dc-4b81-accf-488f56022b55 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:42.494475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1df90dc-58dc-4b81-accf-488f56022b55 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:42.495763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1df90dc-58dc-4b81-accf-488f56022b55 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:42.496962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1df90dc-58dc-4b81-accf-488f56022b55 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:42.498910 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1df90dc-58dc-4b81-accf-488f56022b55 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:42.666922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-097623e0-0dbe-475c-b6fe-5b1ec9bc31d2 req-5728c543-5885-40cc-bdd3-fac13dbf6a0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a", "tag": "56403b36-f7cf-4223-981d-f16319d6c719"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:51:42.682839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-097623e0-0dbe-475c-b6fe-5b1ec9bc31d2 req-5728c543-5885-40cc-bdd3-fac13dbf6a0d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:42.685549 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-097623e0-0dbe-475c-b6fe-5b1ec9bc31d2 req-5728c543-5885-40cc-bdd3-fac13dbf6a0d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:42.711651 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-097623e0-0dbe-475c-b6fe-5b1ec9bc31d2 req-5728c543-5885-40cc-bdd3-fac13dbf6a0d service nova] Creating event network-changed:56403b36-f7cf-4223-981d-f16319d6c719 for instance 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a on nch2-master-1 May 21 21:51:42.717786 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-097623e0-0dbe-475c-b6fe-5b1ec9bc31d2 req-5728c543-5885-40cc-bdd3-fac13dbf6a0d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054475 May 21 21:51:42.719164 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2991/6102] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:51:42.885624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f1df90dc-58dc-4b81-accf-488f56022b55 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:42.894605 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f1df90dc-58dc-4b81-accf-488f56022b55 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a" status: 200 len: 1374 microversion: 2.1 time: 0.420411 May 21 21:51:42.905693 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3112/6103] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:42 2022] GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a => generated 1374 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:43.914014 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5763a69d-ba46-40ae-8769-8e2ff5179ec1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:43.914917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5763a69d-ba46-40ae-8769-8e2ff5179ec1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:43.922660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5763a69d-ba46-40ae-8769-8e2ff5179ec1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:43.923114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5763a69d-ba46-40ae-8769-8e2ff5179ec1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:43.923887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5763a69d-ba46-40ae-8769-8e2ff5179ec1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:43.924356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5763a69d-ba46-40ae-8769-8e2ff5179ec1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:44.074125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5763a69d-ba46-40ae-8769-8e2ff5179ec1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:44.082427 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5763a69d-ba46-40ae-8769-8e2ff5179ec1 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a" status: 200 len: 1374 microversion: 2.1 time: 0.173320 May 21 21:51:44.083019 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2992/6104] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:43 2022] GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:45.099174 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0f24ddc9-a92b-4784-a017-0db38643594d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:45.100594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0f24ddc9-a92b-4784-a017-0db38643594d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:45.107635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f24ddc9-a92b-4784-a017-0db38643594d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:45.111946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f24ddc9-a92b-4784-a017-0db38643594d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:45.111946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f24ddc9-a92b-4784-a017-0db38643594d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:45.111946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f24ddc9-a92b-4784-a017-0db38643594d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:45.264331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0f24ddc9-a92b-4784-a017-0db38643594d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:45.272115 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0f24ddc9-a92b-4784-a017-0db38643594d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a" status: 200 len: 1374 microversion: 2.1 time: 0.176905 May 21 21:51:45.273002 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3113/6105] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:45 2022] GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:46.290487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5ac83a80-e52c-4188-b5f0-7c220c4dba98 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:46.291116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5ac83a80-e52c-4188-b5f0-7c220c4dba98 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:46.298649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ac83a80-e52c-4188-b5f0-7c220c4dba98 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:46.299152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ac83a80-e52c-4188-b5f0-7c220c4dba98 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:46.299937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ac83a80-e52c-4188-b5f0-7c220c4dba98 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:46.300402 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ac83a80-e52c-4188-b5f0-7c220c4dba98 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:46.457064 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5ac83a80-e52c-4188-b5f0-7c220c4dba98 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:46.466856 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5ac83a80-e52c-4188-b5f0-7c220c4dba98 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a" status: 200 len: 1374 microversion: 2.1 time: 0.181431 May 21 21:51:46.467471 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2993/6106] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:46 2022] GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:47.485385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-543c6046-6799-4d6f-9d3e-018b9e7b3643 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:47.486299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-543c6046-6799-4d6f-9d3e-018b9e7b3643 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:47.493575 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:51:47.499513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-543c6046-6799-4d6f-9d3e-018b9e7b3643 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:47.499513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-543c6046-6799-4d6f-9d3e-018b9e7b3643 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:47.499513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-543c6046-6799-4d6f-9d3e-018b9e7b3643 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:47.499513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-543c6046-6799-4d6f-9d3e-018b9e7b3643 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:47.626224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:51:47.649448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:51:47.658992 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-543c6046-6799-4d6f-9d3e-018b9e7b3643 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:47.663063 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-543c6046-6799-4d6f-9d3e-018b9e7b3643 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a" status: 200 len: 1374 microversion: 2.1 time: 0.182848 May 21 21:51:47.663863 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3114/6107] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:47 2022] GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a => generated 1374 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:48.680373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bafcf71c-64c6-4a41-abb7-0adfe7b0d5c5 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:48.681309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bafcf71c-64c6-4a41-abb7-0adfe7b0d5c5 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:48.684832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=12 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:51:48.689891 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bafcf71c-64c6-4a41-abb7-0adfe7b0d5c5 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:48.690347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bafcf71c-64c6-4a41-abb7-0adfe7b0d5c5 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:48.691160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bafcf71c-64c6-4a41-abb7-0adfe7b0d5c5 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:48.691600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bafcf71c-64c6-4a41-abb7-0adfe7b0d5c5 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:48.847425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bafcf71c-64c6-4a41-abb7-0adfe7b0d5c5 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:48.856219 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bafcf71c-64c6-4a41-abb7-0adfe7b0d5c5 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a" status: 200 len: 1374 microversion: 2.1 time: 0.180286 May 21 21:51:48.856847 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2994/6108] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:48 2022] GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:49.262080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-19a6caa7-d07c-4ff5-9f24-28042677823f req-2d63083d-7086-4e57-9818-1806e971f589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a", "name": "network-vif-plugged", "status": "completed", "tag": "56403b36-f7cf-4223-981d-f16319d6c719"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:51:49.272608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-19a6caa7-d07c-4ff5-9f24-28042677823f req-2d63083d-7086-4e57-9818-1806e971f589 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:49.273079 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-19a6caa7-d07c-4ff5-9f24-28042677823f req-2d63083d-7086-4e57-9818-1806e971f589 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:49.284749 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-19a6caa7-d07c-4ff5-9f24-28042677823f req-2d63083d-7086-4e57-9818-1806e971f589 service nova] Creating event network-vif-plugged:56403b36-f7cf-4223-981d-f16319d6c719 for instance 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a on nch2-master-1 May 21 21:51:49.290567 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-19a6caa7-d07c-4ff5-9f24-28042677823f req-2d63083d-7086-4e57-9818-1806e971f589 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032821 May 21 21:51:49.291541 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3115/6109] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:51:49.873784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-640160fd-92f4-4451-81e8-a869cd532318 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:49.874445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-640160fd-92f4-4451-81e8-a869cd532318 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:49.882009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-640160fd-92f4-4451-81e8-a869cd532318 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:49.882986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-640160fd-92f4-4451-81e8-a869cd532318 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:49.883773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-640160fd-92f4-4451-81e8-a869cd532318 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:49.884229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-640160fd-92f4-4451-81e8-a869cd532318 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:50.038166 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-640160fd-92f4-4451-81e8-a869cd532318 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:50.046369 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-640160fd-92f4-4451-81e8-a869cd532318 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a" status: 200 len: 1374 microversion: 2.1 time: 0.176294 May 21 21:51:50.046960 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2995/6110] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:49 2022] GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:51.065273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-18222a2f-7f82-4365-891b-95162f604b95 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:51.065972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-18222a2f-7f82-4365-891b-95162f604b95 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:51.074611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-18222a2f-7f82-4365-891b-95162f604b95 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:51.075086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-18222a2f-7f82-4365-891b-95162f604b95 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:51.076036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-18222a2f-7f82-4365-891b-95162f604b95 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:51.076530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-18222a2f-7f82-4365-891b-95162f604b95 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:51.239939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-18222a2f-7f82-4365-891b-95162f604b95 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:51.248338 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-18222a2f-7f82-4365-891b-95162f604b95 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a" status: 200 len: 1546 microversion: 2.1 time: 0.187544 May 21 21:51:51.248930 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3116/6111] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:51 2022] GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a => generated 1546 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:51:51.264832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f565f15d-53bf-4aaf-8a90-226c062a1e68 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:51:51.265555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f565f15d-53bf-4aaf-8a90-226c062a1e68 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:51:51.273459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f565f15d-53bf-4aaf-8a90-226c062a1e68 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:51.273911 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f565f15d-53bf-4aaf-8a90-226c062a1e68 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:51.274693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f565f15d-53bf-4aaf-8a90-226c062a1e68 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:51:51.275132 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f565f15d-53bf-4aaf-8a90-226c062a1e68 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:51:51.436242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f565f15d-53bf-4aaf-8a90-226c062a1e68 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:51:51.445487 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f565f15d-53bf-4aaf-8a90-226c062a1e68 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a" status: 200 len: 1546 microversion: 2.1 time: 0.184456 May 21 21:51:51.446089 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2996/6112] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:51:51 2022] GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a => generated 1546 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:01.757166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1d18f862-1840-4808-a338-dd074e003196 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:52:01.758129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1d18f862-1840-4808-a338-dd074e003196 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:01.761054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=5 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:52:01.762061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=74 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:52:01.767181 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d18f862-1840-4808-a338-dd074e003196 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:01.767655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d18f862-1840-4808-a338-dd074e003196 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:01.768519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d18f862-1840-4808-a338-dd074e003196 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:01.772785 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d18f862-1840-4808-a338-dd074e003196 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:01.818864 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1d18f862-1840-4808-a338-dd074e003196 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19/action" status: 200 len: 24575 microversion: 2.1 time: 0.065634 May 21 21:52:01.819525 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3117/6113] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:52:01 2022] POST /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19/action => generated 24575 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:52:12.876661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6f1bf2b3-51ea-422a-bc1c-4a4272bb7199 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:12.877332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6f1bf2b3-51ea-422a-bc1c-4a4272bb7199 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:12.879371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:52:12.880099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=84 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:52:12.886148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f1bf2b3-51ea-422a-bc1c-4a4272bb7199 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:12.886602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f1bf2b3-51ea-422a-bc1c-4a4272bb7199 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:12.887370 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f1bf2b3-51ea-422a-bc1c-4a4272bb7199 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:12.887811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f1bf2b3-51ea-422a-bc1c-4a4272bb7199 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:13.032794 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6f1bf2b3-51ea-422a-bc1c-4a4272bb7199 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1835 microversion: 2.1 time: 0.160253 May 21 21:52:13.033371 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2997/6114] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:12 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1835 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:13.050847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4da547db-93ec-41f4-bfa2-2bd809916d54 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:13.052775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4da547db-93ec-41f4-bfa2-2bd809916d54 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:13.063329 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4da547db-93ec-41f4-bfa2-2bd809916d54 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:13.063980 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4da547db-93ec-41f4-bfa2-2bd809916d54 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:13.064649 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4da547db-93ec-41f4-bfa2-2bd809916d54 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:13.065108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4da547db-93ec-41f4-bfa2-2bd809916d54 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:13.224848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4da547db-93ec-41f4-bfa2-2bd809916d54 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:13.232841 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4da547db-93ec-41f4-bfa2-2bd809916d54 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1684 microversion: 2.1 time: 0.187438 May 21 21:52:13.233413 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3118/6115] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:13 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1684 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:13.354434 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8f941e94-e571-4c16-b3df-7c23b2e2009f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:52:13.355966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8f941e94-e571-4c16-b3df-7c23b2e2009f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:13.361648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f941e94-e571-4c16-b3df-7c23b2e2009f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:13.362107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f941e94-e571-4c16-b3df-7c23b2e2009f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:13.362887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f941e94-e571-4c16-b3df-7c23b2e2009f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:13.363337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8f941e94-e571-4c16-b3df-7c23b2e2009f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:13.412869 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8f941e94-e571-4c16-b3df-7c23b2e2009f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19/action" status: 200 len: 32645 microversion: 2.1 time: 0.062352 May 21 21:52:13.413457 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2998/6116] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:52:13 2022] POST /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19/action => generated 32645 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:52:13.574614 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fe18c8f2-8df7-4c4c-b27b-71d70f6a3c43 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:52:13.575209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fe18c8f2-8df7-4c4c-b27b-71d70f6a3c43 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:13.582219 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe18c8f2-8df7-4c4c-b27b-71d70f6a3c43 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:13.583641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe18c8f2-8df7-4c4c-b27b-71d70f6a3c43 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:13.583641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe18c8f2-8df7-4c4c-b27b-71d70f6a3c43 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:13.583962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fe18c8f2-8df7-4c4c-b27b-71d70f6a3c43 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:13.626584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fe18c8f2-8df7-4c4c-b27b-71d70f6a3c43 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '47d30ff01dbb418395eb8e2cf0786616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d91d681971413c9dfb817969f75b95', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:13.627224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fe18c8f2-8df7-4c4c-b27b-71d70f6a3c43 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] flavor_id is None. Assuming migration. {{(pid=131277) resize /opt/stack/nova/nova/compute/api.py:4142}} May 21 21:52:13.627743 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fe18c8f2-8df7-4c4c-b27b-71d70f6a3c43 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131277) resize /opt/stack/nova/nova/compute/api.py:4166}} May 21 21:52:14.071387 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fe18c8f2-8df7-4c4c-b27b-71d70f6a3c43 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19/action" status: 202 len: 0 microversion: 2.1 time: 0.500721 May 21 21:52:14.072101 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3119/6117] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:52:13 2022] POST /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:52:14.080604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b90ceb69-24fa-4017-9684-f3537a4b1dfe tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:14.081972 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b90ceb69-24fa-4017-9684-f3537a4b1dfe tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:14.093728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b90ceb69-24fa-4017-9684-f3537a4b1dfe tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:14.094187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b90ceb69-24fa-4017-9684-f3537a4b1dfe tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:14.094981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b90ceb69-24fa-4017-9684-f3537a4b1dfe tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:14.095426 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b90ceb69-24fa-4017-9684-f3537a4b1dfe tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:14.253022 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b90ceb69-24fa-4017-9684-f3537a4b1dfe tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:14.261909 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b90ceb69-24fa-4017-9684-f3537a4b1dfe tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1693 microversion: 2.1 time: 0.185349 May 21 21:52:14.262800 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 2999/6118] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:14 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1693 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:15.282944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7fe03720-e0e6-47f3-9963-087c70af3231 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:15.283584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7fe03720-e0e6-47f3-9963-087c70af3231 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:15.291768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fe03720-e0e6-47f3-9963-087c70af3231 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:15.298023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fe03720-e0e6-47f3-9963-087c70af3231 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:15.298023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fe03720-e0e6-47f3-9963-087c70af3231 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:15.298023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7fe03720-e0e6-47f3-9963-087c70af3231 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:15.451852 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7fe03720-e0e6-47f3-9963-087c70af3231 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:15.460877 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7fe03720-e0e6-47f3-9963-087c70af3231 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1693 microversion: 2.1 time: 0.182965 May 21 21:52:15.464335 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3120/6119] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:15 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1693 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:16.478976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7302571b-27a9-4050-ac00-87b28ce81417 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:16.479731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7302571b-27a9-4050-ac00-87b28ce81417 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:16.487001 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7302571b-27a9-4050-ac00-87b28ce81417 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:16.487453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7302571b-27a9-4050-ac00-87b28ce81417 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:16.488240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7302571b-27a9-4050-ac00-87b28ce81417 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:16.488732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7302571b-27a9-4050-ac00-87b28ce81417 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:16.653312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7302571b-27a9-4050-ac00-87b28ce81417 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:16.657499 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7302571b-27a9-4050-ac00-87b28ce81417 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1693 microversion: 2.1 time: 0.182653 May 21 21:52:16.658090 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3000/6120] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:16 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1693 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:17.675539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5bca5210-1f1b-4554-8625-3f45708f76f4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:17.676095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5bca5210-1f1b-4554-8625-3f45708f76f4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:17.688378 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5bca5210-1f1b-4554-8625-3f45708f76f4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:17.689021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5bca5210-1f1b-4554-8625-3f45708f76f4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:17.689840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5bca5210-1f1b-4554-8625-3f45708f76f4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:17.690298 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5bca5210-1f1b-4554-8625-3f45708f76f4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:17.852888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5bca5210-1f1b-4554-8625-3f45708f76f4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:17.860807 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5bca5210-1f1b-4554-8625-3f45708f76f4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1693 microversion: 2.1 time: 0.189376 May 21 21:52:17.861387 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3121/6121] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:17 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1693 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:18.516747 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a242a398-2031-4468-a32f-e6d4ce4d5b66 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:18.517271 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a242a398-2031-4468-a32f-e6d4ce4d5b66 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:18.525716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a242a398-2031-4468-a32f-e6d4ce4d5b66 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:18.526178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a242a398-2031-4468-a32f-e6d4ce4d5b66 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:18.527007 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a242a398-2031-4468-a32f-e6d4ce4d5b66 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:18.527460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a242a398-2031-4468-a32f-e6d4ce4d5b66 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:18.562096 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a242a398-2031-4468-a32f-e6d4ce4d5b66 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:52:18.878958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-42db3529-5c8f-40f0-830f-f2dcd39bae8c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:18.880408 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-42db3529-5c8f-40f0-830f-f2dcd39bae8c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:18.888652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42db3529-5c8f-40f0-830f-f2dcd39bae8c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:18.889127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42db3529-5c8f-40f0-830f-f2dcd39bae8c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:18.890651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42db3529-5c8f-40f0-830f-f2dcd39bae8c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:18.891112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42db3529-5c8f-40f0-830f-f2dcd39bae8c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:18.907651 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a242a398-2031-4468-a32f-e6d4ce4d5b66 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "DELETE /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a" status: 204 len: 0 microversion: 2.1 time: 0.394434 May 21 21:52:18.908490 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3001/6122] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:52:18 2022] DELETE /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:52:18.918385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7cccc468-b332-4869-9031-01b6b0156159 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:18.919121 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7cccc468-b332-4869-9031-01b6b0156159 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:18.925362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7cccc468-b332-4869-9031-01b6b0156159 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:18.925832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7cccc468-b332-4869-9031-01b6b0156159 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:18.926628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7cccc468-b332-4869-9031-01b6b0156159 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:18.927079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7cccc468-b332-4869-9031-01b6b0156159 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:19.063105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-42db3529-5c8f-40f0-830f-f2dcd39bae8c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:19.072224 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-42db3529-5c8f-40f0-830f-f2dcd39bae8c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1698 microversion: 2.1 time: 0.197341 May 21 21:52:19.072887 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3122/6123] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:18 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1698 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:52:19.131388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7cccc468-b332-4869-9031-01b6b0156159 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:19.139361 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7cccc468-b332-4869-9031-01b6b0156159 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a" status: 200 len: 1552 microversion: 2.1 time: 0.226439 May 21 21:52:19.140179 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3002/6124] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:18 2022] GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a => generated 1552 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:52:20.090800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-db12d6b3-56a2-4e1e-8a38-ff6abe1b48a4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:20.091430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-db12d6b3-56a2-4e1e-8a38-ff6abe1b48a4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:20.098590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db12d6b3-56a2-4e1e-8a38-ff6abe1b48a4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:20.098999 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db12d6b3-56a2-4e1e-8a38-ff6abe1b48a4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:20.099780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db12d6b3-56a2-4e1e-8a38-ff6abe1b48a4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:20.100243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-db12d6b3-56a2-4e1e-8a38-ff6abe1b48a4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:20.161157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b9cf1bff-ab62-4c97-9bba-0874d779d75a tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:20.161898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b9cf1bff-ab62-4c97-9bba-0874d779d75a tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:20.169061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9cf1bff-ab62-4c97-9bba-0874d779d75a tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:20.171371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9cf1bff-ab62-4c97-9bba-0874d779d75a tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:20.171371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9cf1bff-ab62-4c97-9bba-0874d779d75a tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:20.171371 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9cf1bff-ab62-4c97-9bba-0874d779d75a tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:20.252486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-db12d6b3-56a2-4e1e-8a38-ff6abe1b48a4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:20.261322 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-db12d6b3-56a2-4e1e-8a38-ff6abe1b48a4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1698 microversion: 2.1 time: 0.175010 May 21 21:52:20.261916 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3123/6125] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:20 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1698 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:20.440153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b9cf1bff-ab62-4c97-9bba-0874d779d75a tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:20.448814 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b9cf1bff-ab62-4c97-9bba-0874d779d75a tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a" status: 200 len: 1552 microversion: 2.1 time: 0.291634 May 21 21:52:20.449402 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3003/6126] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:20 2022] GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a => generated 1552 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:52:20.982139 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-61aeec47-cc82-4f63-9326-eabe41ab5acc req-02916eb6-2f6a-4ad6-b194-08f1eb5ae5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a", "name": "network-vif-deleted", "tag": "56403b36-f7cf-4223-981d-f16319d6c719"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:52:21.038312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-61aeec47-cc82-4f63-9326-eabe41ab5acc req-02916eb6-2f6a-4ad6-b194-08f1eb5ae5f1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:21.038312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-61aeec47-cc82-4f63-9326-eabe41ab5acc req-02916eb6-2f6a-4ad6-b194-08f1eb5ae5f1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:21.038312 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-61aeec47-cc82-4f63-9326-eabe41ab5acc req-02916eb6-2f6a-4ad6-b194-08f1eb5ae5f1 service nova] Creating event network-vif-deleted:56403b36-f7cf-4223-981d-f16319d6c719 for instance 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a on nch2-master-1 May 21 21:52:21.038312 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-61aeec47-cc82-4f63-9326-eabe41ab5acc req-02916eb6-2f6a-4ad6-b194-08f1eb5ae5f1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033524 May 21 21:52:21.038312 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3124/6127] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:52:21.279059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4d8897d6-54b4-4b17-b7d6-44d165cddf66 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:21.279690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4d8897d6-54b4-4b17-b7d6-44d165cddf66 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:21.298414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d8897d6-54b4-4b17-b7d6-44d165cddf66 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:21.298876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d8897d6-54b4-4b17-b7d6-44d165cddf66 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:21.299673 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d8897d6-54b4-4b17-b7d6-44d165cddf66 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:21.300123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4d8897d6-54b4-4b17-b7d6-44d165cddf66 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:21.458792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4d8897d6-54b4-4b17-b7d6-44d165cddf66 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:21.467404 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4d8897d6-54b4-4b17-b7d6-44d165cddf66 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1698 microversion: 2.1 time: 0.192354 May 21 21:52:21.467986 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3004/6128] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:21 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1698 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:21.468881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-54ccafcc-cf80-4017-9ace-0075b761a8dd tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:21.469740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-54ccafcc-cf80-4017-9ace-0075b761a8dd tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:21.476216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54ccafcc-cf80-4017-9ace-0075b761a8dd tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:21.477271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54ccafcc-cf80-4017-9ace-0075b761a8dd tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:21.478065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54ccafcc-cf80-4017-9ace-0075b761a8dd tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:21.478518 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54ccafcc-cf80-4017-9ace-0075b761a8dd tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:21.516381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54ccafcc-cf80-4017-9ace-0075b761a8dd tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:21.516723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-54ccafcc-cf80-4017-9ace-0075b761a8dd tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:21.517189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-54ccafcc-cf80-4017-9ace-0075b761a8dd tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lazy-loading 'fault' on Instance uuid 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:52:21.563905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-54ccafcc-cf80-4017-9ace-0075b761a8dd tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:21.572964 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-54ccafcc-cf80-4017-9ace-0075b761a8dd tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a" status: 200 len: 1338 microversion: 2.1 time: 0.109444 May 21 21:52:21.573732 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3125/6129] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:21 2022] GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a => generated 1338 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:52:22.485597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-57c50ecf-9103-4609-a875-ada242a31585 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:22.490469 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-57c50ecf-9103-4609-a875-ada242a31585 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:22.494015 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-57c50ecf-9103-4609-a875-ada242a31585 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:22.494540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-57c50ecf-9103-4609-a875-ada242a31585 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:22.495696 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-57c50ecf-9103-4609-a875-ada242a31585 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:22.496148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-57c50ecf-9103-4609-a875-ada242a31585 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:22.591574 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fa3ea0f3-5684-41e4-b7bf-f719792cba57 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:22.592231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fa3ea0f3-5684-41e4-b7bf-f719792cba57 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:22.599369 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fa3ea0f3-5684-41e4-b7bf-f719792cba57 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:22.599842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fa3ea0f3-5684-41e4-b7bf-f719792cba57 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:22.600861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fa3ea0f3-5684-41e4-b7bf-f719792cba57 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:22.601318 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fa3ea0f3-5684-41e4-b7bf-f719792cba57 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:22.616083 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-fa3ea0f3-5684-41e4-b7bf-f719792cba57 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] HTTP exception thrown: Instance 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a could not be found. May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fa3ea0f3-5684-41e4-b7bf-f719792cba57 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Request method failure captured: May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a HTTP/1.1 May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiV6eBGC5NjaU07rrjOKlxC4YjyI18nt0gDCJ8uUBeHfO5bxMHzm1aSFNe_jNeXQ9qVDU-aWKqChu0VBk59DD9SMjsmqbruEmv5vnwm-VLvpjheXQj5yaeEbVSe45b2X-kvU8fngop8BhGDsCUsgOtiZ5MZc8WugjsDzQ9aRTG_4c_EY May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 31d683aab56145779b2614a9a0606556 May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-TestNetworkBasicOps-1443976949 May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/31d683aab56145779b2614a9a0606556"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/31d683aab56145779b2614a9a0606556"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_31d683aab56145779b2614a9a0606556", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/31d683aab56145779b2614a9a0606556"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-TestNetworkBasicOps-1443976949 May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 31d683aab56145779b2614a9a0606556 May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-TestNetworkBasicOps-1443976949 May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-TestNetworkBasicOps-1443976949-project May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 1f3a4acfcf07489abcedb1616deb915a May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-TestNetworkBasicOps-1443976949-project May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a could not be found. May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a'} May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a could not be found. May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a could not be found. May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:52:22.617870 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:52:22.632759 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:52:22.632759 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:52:22.632759 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:52:22.632759 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:52:22.632759 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:52:22.632759 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a could not be found. May 21 21:52:22.632759 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:52:22.632759 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fa3ea0f3-5684-41e4-b7bf-f719792cba57 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Returning 404 to user: Instance 704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:52:22.632759 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fa3ea0f3-5684-41e4-b7bf-f719792cba57 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a" status: 404 len: 111 microversion: 2.1 time: 0.033478 May 21 21:52:22.632759 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3126/6130] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:22 2022] GET /compute/v2.1/servers/704ab6f0-ecc5-45e7-8c82-f5a5e0d72c8a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 21 21:52:22.832798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-57c50ecf-9103-4609-a875-ada242a31585 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:22.841596 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-57c50ecf-9103-4609-a875-ada242a31585 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1698 microversion: 2.1 time: 0.360582 May 21 21:52:22.842934 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3005/6131] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:22 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1698 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:23.148597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b5b569e2-c991-4442-978c-06c5dff6b2ca tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '.version_select at 0x7fc81b638670>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:23.252016 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b5b569e2-c991-4442-978c-06c5dff6b2ca tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1669091276" status: 202 len: 0 microversion: 2.1 time: 0.107366 May 21 21:52:23.252762 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3127/6132] 10.222.0.49 () {58 vars in 1256 bytes} [Sat May 21 21:52:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1669091276 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:52:23.863658 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b9db4f02-1fef-4c49-91c0-b6d5fffdc0c0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:23.865148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b9db4f02-1fef-4c49-91c0-b6d5fffdc0c0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:23.874542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9db4f02-1fef-4c49-91c0-b6d5fffdc0c0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:23.875975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9db4f02-1fef-4c49-91c0-b6d5fffdc0c0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:23.876956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9db4f02-1fef-4c49-91c0-b6d5fffdc0c0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:23.877481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9db4f02-1fef-4c49-91c0-b6d5fffdc0c0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:24.480957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b9db4f02-1fef-4c49-91c0-b6d5fffdc0c0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:24.489744 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b9db4f02-1fef-4c49-91c0-b6d5fffdc0c0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1698 microversion: 2.1 time: 0.633579 May 21 21:52:24.490319 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3006/6133] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:23 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1698 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:25.513073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bc4f99e8-4d5a-4402-be33-fcaf085bc851 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:25.513716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bc4f99e8-4d5a-4402-be33-fcaf085bc851 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:25.529121 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bc4f99e8-4d5a-4402-be33-fcaf085bc851 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:25.529594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bc4f99e8-4d5a-4402-be33-fcaf085bc851 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:25.530661 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bc4f99e8-4d5a-4402-be33-fcaf085bc851 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:25.531355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bc4f99e8-4d5a-4402-be33-fcaf085bc851 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:26.078336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bc4f99e8-4d5a-4402-be33-fcaf085bc851 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:26.086375 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bc4f99e8-4d5a-4402-be33-fcaf085bc851 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1698 microversion: 2.1 time: 0.578051 May 21 21:52:26.086957 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3128/6134] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:25 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1698 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:26.391593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e6df51ba-cee3-4004-bfcf-7e0906a6e8f4 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:26.392238 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-cf63f9c2-0a6b-4d3c-9338-8ec4cc9a01e8 req-33323d8f-1523-4302-b06e-cc86f0ac7f75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c8491cf-9f8f-4a29-a1bb-602dead261c6", "tag": "50454762-02de-4c97-9c88-870484e21913"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:52:26.396917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e6df51ba-cee3-4004-bfcf-7e0906a6e8f4 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 2c8491cf-9f8f-4a29-a1bb-602dead261c6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:26.404812 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cf63f9c2-0a6b-4d3c-9338-8ec4cc9a01e8 req-33323d8f-1523-4302-b06e-cc86f0ac7f75 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:26.419422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cf63f9c2-0a6b-4d3c-9338-8ec4cc9a01e8 req-33323d8f-1523-4302-b06e-cc86f0ac7f75 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:26.419603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e6df51ba-cee3-4004-bfcf-7e0906a6e8f4 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:26.419603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e6df51ba-cee3-4004-bfcf-7e0906a6e8f4 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:26.419603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e6df51ba-cee3-4004-bfcf-7e0906a6e8f4 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:26.419603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e6df51ba-cee3-4004-bfcf-7e0906a6e8f4 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:26.420520 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-cf63f9c2-0a6b-4d3c-9338-8ec4cc9a01e8 req-33323d8f-1523-4302-b06e-cc86f0ac7f75 service nova] Creating event network-changed:50454762-02de-4c97-9c88-870484e21913 for instance 2c8491cf-9f8f-4a29-a1bb-602dead261c6 on nch2-master-1 May 21 21:52:26.427880 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-cf63f9c2-0a6b-4d3c-9338-8ec4cc9a01e8 req-33323d8f-1523-4302-b06e-cc86f0ac7f75 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039169 May 21 21:52:26.428807 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3129/6135] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:52:26.441366 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e6df51ba-cee3-4004-bfcf-7e0906a6e8f4 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 2c8491cf-9f8f-4a29-a1bb-602dead261c6] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:52:26.778388 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e6df51ba-cee3-4004-bfcf-7e0906a6e8f4 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6" status: 204 len: 0 microversion: 2.1 time: 0.391832 May 21 21:52:26.779255 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3007/6136] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:52:26 2022] DELETE /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:52:26.788194 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-59070b2c-8644-4341-a5a3-9f41cf39895b tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:26.789236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-59070b2c-8644-4341-a5a3-9f41cf39895b tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 2c8491cf-9f8f-4a29-a1bb-602dead261c6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:26.802296 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-59070b2c-8644-4341-a5a3-9f41cf39895b tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:26.802296 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-59070b2c-8644-4341-a5a3-9f41cf39895b tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:26.802296 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-59070b2c-8644-4341-a5a3-9f41cf39895b tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:26.802889 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-59070b2c-8644-4341-a5a3-9f41cf39895b tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:26.966180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-59070b2c-8644-4341-a5a3-9f41cf39895b tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:26.974097 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-59070b2c-8644-4341-a5a3-9f41cf39895b tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6" status: 200 len: 1670 microversion: 2.1 time: 0.190311 May 21 21:52:26.974992 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3130/6137] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:26 2022] GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6 => generated 1670 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:27.105546 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b7ca7f04-cc56-40e8-97bc-541cb10e04bb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:27.106269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b7ca7f04-cc56-40e8-97bc-541cb10e04bb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:27.112576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b7ca7f04-cc56-40e8-97bc-541cb10e04bb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:27.113178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b7ca7f04-cc56-40e8-97bc-541cb10e04bb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:27.113979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b7ca7f04-cc56-40e8-97bc-541cb10e04bb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:27.114427 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b7ca7f04-cc56-40e8-97bc-541cb10e04bb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:27.300310 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b7ca7f04-cc56-40e8-97bc-541cb10e04bb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:27.308428 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b7ca7f04-cc56-40e8-97bc-541cb10e04bb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1698 microversion: 2.1 time: 0.207451 May 21 21:52:27.309110 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3008/6138] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:27 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1698 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:27.991643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f371b4df-225b-419e-aa6e-473b4755aa14 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:27.992262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f371b4df-225b-419e-aa6e-473b4755aa14 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 2c8491cf-9f8f-4a29-a1bb-602dead261c6] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:28.000304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f371b4df-225b-419e-aa6e-473b4755aa14 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:28.000777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f371b4df-225b-419e-aa6e-473b4755aa14 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:28.001573 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f371b4df-225b-419e-aa6e-473b4755aa14 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:28.002026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f371b4df-225b-419e-aa6e-473b4755aa14 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:28.155176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f371b4df-225b-419e-aa6e-473b4755aa14 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:28.163092 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f371b4df-225b-419e-aa6e-473b4755aa14 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6" status: 200 len: 1670 microversion: 2.1 time: 0.175317 May 21 21:52:28.168594 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3131/6139] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:27 2022] GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6 => generated 1670 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:28.326578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a1c95e11-bbe5-4575-bf04-1cee724a9a36 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:28.327197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a1c95e11-bbe5-4575-bf04-1cee724a9a36 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:28.334993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a1c95e11-bbe5-4575-bf04-1cee724a9a36 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:28.335446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a1c95e11-bbe5-4575-bf04-1cee724a9a36 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:28.336226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a1c95e11-bbe5-4575-bf04-1cee724a9a36 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:28.336694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a1c95e11-bbe5-4575-bf04-1cee724a9a36 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:28.580112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a1c95e11-bbe5-4575-bf04-1cee724a9a36 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:28.588534 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a1c95e11-bbe5-4575-bf04-1cee724a9a36 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1698 microversion: 2.1 time: 0.265623 May 21 21:52:28.589121 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3009/6140] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:28 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1698 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:28.784749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-6190be50-6f1c-4258-ba87-b8174f6cd554 req-1b3c08de-3576-4ed4-8320-71d46d176a11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c8491cf-9f8f-4a29-a1bb-602dead261c6", "name": "network-vif-deleted", "tag": "50454762-02de-4c97-9c88-870484e21913"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:52:28.794347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6190be50-6f1c-4258-ba87-b8174f6cd554 req-1b3c08de-3576-4ed4-8320-71d46d176a11 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:28.794802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6190be50-6f1c-4258-ba87-b8174f6cd554 req-1b3c08de-3576-4ed4-8320-71d46d176a11 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:28.807982 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-6190be50-6f1c-4258-ba87-b8174f6cd554 req-1b3c08de-3576-4ed4-8320-71d46d176a11 service nova] Creating event network-vif-deleted:50454762-02de-4c97-9c88-870484e21913 for instance 2c8491cf-9f8f-4a29-a1bb-602dead261c6 on nch2-master-1 May 21 21:52:28.813324 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-6190be50-6f1c-4258-ba87-b8174f6cd554 req-1b3c08de-3576-4ed4-8320-71d46d176a11 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032373 May 21 21:52:28.813925 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3132/6141] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:52:29.181392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c9fa5c26-871b-4204-a019-74ccfa7dbe61 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:29.182153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c9fa5c26-871b-4204-a019-74ccfa7dbe61 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 2c8491cf-9f8f-4a29-a1bb-602dead261c6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:29.189145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9fa5c26-871b-4204-a019-74ccfa7dbe61 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:29.189614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9fa5c26-871b-4204-a019-74ccfa7dbe61 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:29.190544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9fa5c26-871b-4204-a019-74ccfa7dbe61 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:29.190999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9fa5c26-871b-4204-a019-74ccfa7dbe61 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:29.210714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:52:29.225026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9fa5c26-871b-4204-a019-74ccfa7dbe61 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:29.225490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9fa5c26-871b-4204-a019-74ccfa7dbe61 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:29.225950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-c9fa5c26-871b-4204-a019-74ccfa7dbe61 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lazy-loading 'fault' on Instance uuid 2c8491cf-9f8f-4a29-a1bb-602dead261c6 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:52:29.275167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c9fa5c26-871b-4204-a019-74ccfa7dbe61 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:29.283317 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c9fa5c26-871b-4204-a019-74ccfa7dbe61 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6" status: 200 len: 1338 microversion: 2.1 time: 0.106099 May 21 21:52:29.283953 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3010/6142] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:29 2022] GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6 => generated 1338 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:29.609407 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bcbbab4a-84a7-4c14-b984-290cef5f2661 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:29.610132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bcbbab4a-84a7-4c14-b984-290cef5f2661 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:29.616675 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bcbbab4a-84a7-4c14-b984-290cef5f2661 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:29.617197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bcbbab4a-84a7-4c14-b984-290cef5f2661 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:29.622498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bcbbab4a-84a7-4c14-b984-290cef5f2661 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:29.622498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bcbbab4a-84a7-4c14-b984-290cef5f2661 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:29.787929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bcbbab4a-84a7-4c14-b984-290cef5f2661 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:29.815550 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bcbbab4a-84a7-4c14-b984-290cef5f2661 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1698 microversion: 2.1 time: 0.211535 May 21 21:52:29.816171 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3133/6143] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:29 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1698 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:30.301144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-da09e5d8-e370-40e1-936c-b0f3aebdafee tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:30.301778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-da09e5d8-e370-40e1-936c-b0f3aebdafee tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: 2c8491cf-9f8f-4a29-a1bb-602dead261c6] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:30.310763 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da09e5d8-e370-40e1-936c-b0f3aebdafee tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:30.311226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da09e5d8-e370-40e1-936c-b0f3aebdafee tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:30.312022 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da09e5d8-e370-40e1-936c-b0f3aebdafee tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:30.312516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da09e5d8-e370-40e1-936c-b0f3aebdafee tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:30.327581 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-da09e5d8-e370-40e1-936c-b0f3aebdafee tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] HTTP exception thrown: Instance 2c8491cf-9f8f-4a29-a1bb-602dead261c6 could not be found. May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-da09e5d8-e370-40e1-936c-b0f3aebdafee tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Request method failure captured: May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6 HTTP/1.1 May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiV6eBGC5NjaU07rrjOKlxC4YjyI18nt0gDCJ8uUBeHfO5bxMHzm1aSFNe_jNeXQ9qVDU-aWKqChu0VBk59DD9SMjsmqbruEmv5vnwm-VLvpjheXQj5yaeEbVSe45b2X-kvU8fngop8BhGDsCUsgOtiZ5MZc8WugjsDzQ9aRTG_4c_EY May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 31d683aab56145779b2614a9a0606556 May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestNetworkBasicOps-1443976949 May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/31d683aab56145779b2614a9a0606556"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/31d683aab56145779b2614a9a0606556"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_31d683aab56145779b2614a9a0606556", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/31d683aab56145779b2614a9a0606556"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestNetworkBasicOps-1443976949 May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 31d683aab56145779b2614a9a0606556 May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestNetworkBasicOps-1443976949 May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestNetworkBasicOps-1443976949-project May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1f3a4acfcf07489abcedb1616deb915a May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestNetworkBasicOps-1443976949-project May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 2c8491cf-9f8f-4a29-a1bb-602dead261c6 could not be found. May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '2c8491cf-9f8f-4a29-a1bb-602dead261c6'} May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c8491cf-9f8f-4a29-a1bb-602dead261c6 could not be found. May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c8491cf-9f8f-4a29-a1bb-602dead261c6 could not be found. May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:52:30.331532 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:52:30.336949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:52:30.336949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:52:30.336949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:52:30.336949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:52:30.336949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:52:30.336949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c8491cf-9f8f-4a29-a1bb-602dead261c6 could not be found. May 21 21:52:30.336949 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:52:30.336949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-da09e5d8-e370-40e1-936c-b0f3aebdafee tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Returning 404 to user: Instance 2c8491cf-9f8f-4a29-a1bb-602dead261c6 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:52:30.336949 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-da09e5d8-e370-40e1-936c-b0f3aebdafee tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6" status: 404 len: 111 microversion: 2.1 time: 0.033602 May 21 21:52:30.336949 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3011/6144] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:30 2022] GET /compute/v2.1/servers/2c8491cf-9f8f-4a29-a1bb-602dead261c6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:52:30.830896 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-2460b886-9f8f-4635-849c-eef0ee5a9106 req-0225ec27-738e-4717-8fc3-7d32872f654c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d0c42d1-f95b-455e-82e7-44bfe6033c19", "name": "network-vif-unplugged", "status": "completed", "tag": "e289a815-e375-4419-ad91-9bc59bc45f55"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:52:30.834678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ed58b270-3d3e-4ce0-81cc-5d4f244396d4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:30.835339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ed58b270-3d3e-4ce0-81cc-5d4f244396d4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:30.844677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed58b270-3d3e-4ce0-81cc-5d4f244396d4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:30.845647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed58b270-3d3e-4ce0-81cc-5d4f244396d4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:30.845771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2460b886-9f8f-4635-849c-eef0ee5a9106 req-0225ec27-738e-4717-8fc3-7d32872f654c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:30.845870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-2460b886-9f8f-4635-849c-eef0ee5a9106 req-0225ec27-738e-4717-8fc3-7d32872f654c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:30.845965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed58b270-3d3e-4ce0-81cc-5d4f244396d4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:30.846359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed58b270-3d3e-4ce0-81cc-5d4f244396d4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:30.862794 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-2460b886-9f8f-4635-849c-eef0ee5a9106 req-0225ec27-738e-4717-8fc3-7d32872f654c service nova] Creating event network-vif-unplugged:e289a815-e375-4419-ad91-9bc59bc45f55 for instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 on nch2-master-1 May 21 21:52:30.870376 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [req-2460b886-9f8f-4635-849c-eef0ee5a9106 req-0225ec27-738e-4717-8fc3-7d32872f654c service nova] Instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 21:52:30.881692 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-2460b886-9f8f-4635-849c-eef0ee5a9106 req-0225ec27-738e-4717-8fc3-7d32872f654c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056140 May 21 21:52:30.885636 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3134/6145] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:52:30.888690 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ca985aee-7ad3-45b6-b4a0-50ff3af7aff4 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '.version_select at 0x7fc81b1c7ca0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:31.057232 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ca985aee-7ad3-45b6-b4a0-50ff3af7aff4 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2021794790" status: 202 len: 0 microversion: 2.1 time: 0.173448 May 21 21:52:31.064411 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3135/6146] 10.222.0.49 () {58 vars in 1256 bytes} [Sat May 21 21:52:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2021794790 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:52:31.117037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ed58b270-3d3e-4ce0-81cc-5d4f244396d4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:31.130171 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ed58b270-3d3e-4ce0-81cc-5d4f244396d4 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1697 microversion: 2.1 time: 0.300051 May 21 21:52:31.140606 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3012/6147] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:30 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1697 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:52:32.150698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-86b99545-35f0-4a6d-9a8f-2eb4d8966cc6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:32.152509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-86b99545-35f0-4a6d-9a8f-2eb4d8966cc6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:32.161170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86b99545-35f0-4a6d-9a8f-2eb4d8966cc6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:32.161741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86b99545-35f0-4a6d-9a8f-2eb4d8966cc6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:32.162615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86b99545-35f0-4a6d-9a8f-2eb4d8966cc6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:32.163162 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86b99545-35f0-4a6d-9a8f-2eb4d8966cc6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:32.312366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-86b99545-35f0-4a6d-9a8f-2eb4d8966cc6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:32.315993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:52:32.320548 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-86b99545-35f0-4a6d-9a8f-2eb4d8966cc6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1697 microversion: 2.1 time: 0.175183 May 21 21:52:32.321121 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3136/6148] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:32 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1697 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:32.897179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-d9edfded-e9a2-42ed-bc2c-e331cc610117 req-1715315c-e757-4ba0-a407-19a9c4398119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d0c42d1-f95b-455e-82e7-44bfe6033c19", "tag": "e289a815-e375-4419-ad91-9bc59bc45f55"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:52:32.907219 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-d9edfded-e9a2-42ed-bc2c-e331cc610117 req-1715315c-e757-4ba0-a407-19a9c4398119 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:32.907671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-d9edfded-e9a2-42ed-bc2c-e331cc610117 req-1715315c-e757-4ba0-a407-19a9c4398119 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:32.920593 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-d9edfded-e9a2-42ed-bc2c-e331cc610117 req-1715315c-e757-4ba0-a407-19a9c4398119 service nova] Creating event network-changed:e289a815-e375-4419-ad91-9bc59bc45f55 for instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 on nch2-master-1 May 21 21:52:32.926270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [req-d9edfded-e9a2-42ed-bc2c-e331cc610117 req-1715315c-e757-4ba0-a407-19a9c4398119 service nova] Instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 21:52:32.937324 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-d9edfded-e9a2-42ed-bc2c-e331cc610117 req-1715315c-e757-4ba0-a407-19a9c4398119 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043808 May 21 21:52:32.938058 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3013/6149] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:52:33.339416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-adfaa789-bed3-4bee-8e77-8cbc41ced91b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:33.342278 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-adfaa789-bed3-4bee-8e77-8cbc41ced91b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:33.361761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-adfaa789-bed3-4bee-8e77-8cbc41ced91b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:33.362485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-adfaa789-bed3-4bee-8e77-8cbc41ced91b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:33.363738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-adfaa789-bed3-4bee-8e77-8cbc41ced91b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:33.364496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-adfaa789-bed3-4bee-8e77-8cbc41ced91b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:33.742516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-adfaa789-bed3-4bee-8e77-8cbc41ced91b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:33.752229 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-adfaa789-bed3-4bee-8e77-8cbc41ced91b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1695 microversion: 2.1 time: 0.418064 May 21 21:52:33.777067 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3137/6150] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:33 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1695 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:34.782750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d17a8a48-a9ed-4439-84c0-ca4aee194e38 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:34.783473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d17a8a48-a9ed-4439-84c0-ca4aee194e38 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:34.790375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d17a8a48-a9ed-4439-84c0-ca4aee194e38 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:34.797460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d17a8a48-a9ed-4439-84c0-ca4aee194e38 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:34.797460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d17a8a48-a9ed-4439-84c0-ca4aee194e38 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:34.797460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d17a8a48-a9ed-4439-84c0-ca4aee194e38 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:34.995123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d17a8a48-a9ed-4439-84c0-ca4aee194e38 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:35.003343 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d17a8a48-a9ed-4439-84c0-ca4aee194e38 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1692 microversion: 2.1 time: 0.226259 May 21 21:52:35.004047 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3014/6151] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:34 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1692 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:35.022310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1e6f4a4f-a743-4893-a8e5-3ba9517a3df5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:52:35.022951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1e6f4a4f-a743-4893-a8e5-3ba9517a3df5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:35.030022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1e6f4a4f-a743-4893-a8e5-3ba9517a3df5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:35.030501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1e6f4a4f-a743-4893-a8e5-3ba9517a3df5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:35.031293 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1e6f4a4f-a743-4893-a8e5-3ba9517a3df5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:35.031749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1e6f4a4f-a743-4893-a8e5-3ba9517a3df5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:35.468504 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1e6f4a4f-a743-4893-a8e5-3ba9517a3df5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19/action" status: 202 len: 0 microversion: 2.1 time: 0.449845 May 21 21:52:35.478266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-216727b5-9a57-4e69-a49a-287c5d4340b2 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:35.479742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-216727b5-9a57-4e69-a49a-287c5d4340b2 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:35.495065 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3138/6152] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:52:35 2022] POST /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:52:35.499111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-216727b5-9a57-4e69-a49a-287c5d4340b2 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:35.499575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-216727b5-9a57-4e69-a49a-287c5d4340b2 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:35.500403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-216727b5-9a57-4e69-a49a-287c5d4340b2 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:35.501031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-216727b5-9a57-4e69-a49a-287c5d4340b2 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:35.771899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-216727b5-9a57-4e69-a49a-287c5d4340b2 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:35.781612 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-216727b5-9a57-4e69-a49a-287c5d4340b2 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1691 microversion: 2.1 time: 0.307173 May 21 21:52:35.782898 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3015/6153] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:35 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1691 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:36.803526 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bff938b1-23bd-46b0-b6db-398bec933b66 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:36.804260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bff938b1-23bd-46b0-b6db-398bec933b66 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:36.811637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bff938b1-23bd-46b0-b6db-398bec933b66 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:36.812107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bff938b1-23bd-46b0-b6db-398bec933b66 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:36.812989 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bff938b1-23bd-46b0-b6db-398bec933b66 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:36.813474 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bff938b1-23bd-46b0-b6db-398bec933b66 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:37.093886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bff938b1-23bd-46b0-b6db-398bec933b66 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:37.103105 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bff938b1-23bd-46b0-b6db-398bec933b66 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1691 microversion: 2.1 time: 0.304845 May 21 21:52:37.104324 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3139/6154] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:36 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1691 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:37.411382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-54920221-f83e-4b88-a3e2-30d14bb37f5c req-e46009c5-2b9a-4d48-98d5-6be77938cd66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d0c42d1-f95b-455e-82e7-44bfe6033c19", "name": "network-vif-plugged", "status": "completed", "tag": "e289a815-e375-4419-ad91-9bc59bc45f55"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:52:37.423684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-54920221-f83e-4b88-a3e2-30d14bb37f5c req-e46009c5-2b9a-4d48-98d5-6be77938cd66 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:37.424179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-54920221-f83e-4b88-a3e2-30d14bb37f5c req-e46009c5-2b9a-4d48-98d5-6be77938cd66 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:37.437232 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-54920221-f83e-4b88-a3e2-30d14bb37f5c req-e46009c5-2b9a-4d48-98d5-6be77938cd66 service nova] Creating event network-vif-plugged:e289a815-e375-4419-ad91-9bc59bc45f55 for instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 on nch2-master-1 May 21 21:52:37.442768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [req-54920221-f83e-4b88-a3e2-30d14bb37f5c req-e46009c5-2b9a-4d48-98d5-6be77938cd66 service nova] Instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 21:52:37.453765 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-54920221-f83e-4b88-a3e2-30d14bb37f5c req-e46009c5-2b9a-4d48-98d5-6be77938cd66 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046528 May 21 21:52:37.454817 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3016/6155] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:52:38.122653 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-adddba3a-ddb5-41f6-aaec-7fbb08d6f87e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:38.124102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-adddba3a-ddb5-41f6-aaec-7fbb08d6f87e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:38.132154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-adddba3a-ddb5-41f6-aaec-7fbb08d6f87e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:38.132648 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-adddba3a-ddb5-41f6-aaec-7fbb08d6f87e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:38.133823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-adddba3a-ddb5-41f6-aaec-7fbb08d6f87e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:38.134321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-adddba3a-ddb5-41f6-aaec-7fbb08d6f87e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:38.429815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-adddba3a-ddb5-41f6-aaec-7fbb08d6f87e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:38.438442 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-adddba3a-ddb5-41f6-aaec-7fbb08d6f87e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1691 microversion: 2.1 time: 0.321647 May 21 21:52:38.439806 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3140/6156] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:38 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1691 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:39.457635 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5b9c7ba0-e006-4d01-a8eb-ed40ae195c79 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:39.459298 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5b9c7ba0-e006-4d01-a8eb-ed40ae195c79 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:39.467893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5b9c7ba0-e006-4d01-a8eb-ed40ae195c79 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:39.468613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5b9c7ba0-e006-4d01-a8eb-ed40ae195c79 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:39.473511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5b9c7ba0-e006-4d01-a8eb-ed40ae195c79 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:39.473511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5b9c7ba0-e006-4d01-a8eb-ed40ae195c79 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:39.713958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5b9c7ba0-e006-4d01-a8eb-ed40ae195c79 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:39.729218 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5b9c7ba0-e006-4d01-a8eb-ed40ae195c79 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1691 microversion: 2.1 time: 0.274700 May 21 21:52:39.730784 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3017/6157] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:39 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1691 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:40.060322 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-8c1afba0-74da-46b3-80b8-0c90f09f42f6 req-cf2a27f6-5ddf-406a-902d-e914525c8949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d0c42d1-f95b-455e-82e7-44bfe6033c19", "name": "network-vif-unplugged", "status": "completed", "tag": "e289a815-e375-4419-ad91-9bc59bc45f55"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:52:40.069650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8c1afba0-74da-46b3-80b8-0c90f09f42f6 req-cf2a27f6-5ddf-406a-902d-e914525c8949 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:40.070337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8c1afba0-74da-46b3-80b8-0c90f09f42f6 req-cf2a27f6-5ddf-406a-902d-e914525c8949 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:40.085167 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-8c1afba0-74da-46b3-80b8-0c90f09f42f6 req-cf2a27f6-5ddf-406a-902d-e914525c8949 service nova] Creating event network-vif-unplugged:e289a815-e375-4419-ad91-9bc59bc45f55 for instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 on nch1-master-1 May 21 21:52:40.092980 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [req-8c1afba0-74da-46b3-80b8-0c90f09f42f6 req-cf2a27f6-5ddf-406a-902d-e914525c8949 service nova] Instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 21:52:40.105498 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-8c1afba0-74da-46b3-80b8-0c90f09f42f6 req-cf2a27f6-5ddf-406a-902d-e914525c8949 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049803 May 21 21:52:40.106819 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3141/6158] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:52:40.748587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cd5bfa13-1f77-487f-b57a-c2e8cb70237c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:40.749581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cd5bfa13-1f77-487f-b57a-c2e8cb70237c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:40.767182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd5bfa13-1f77-487f-b57a-c2e8cb70237c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:40.768667 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd5bfa13-1f77-487f-b57a-c2e8cb70237c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:40.770586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd5bfa13-1f77-487f-b57a-c2e8cb70237c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:40.772313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd5bfa13-1f77-487f-b57a-c2e8cb70237c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:41.185936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ab0b1db9-10ef-4d36-b9c9-aa9ce64eaa0f tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Action: 'create', calling method: .version_select at 0x7fc81b492550>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1849980444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLdygfPp3DDgUADSPEEGjUHn6Fs4pSKVv8QCi+lf6TVQfuPAnKHA5ewGlLwe969TNUT/f5BlX8/wpy5RnhQui0wCJVrN43iH/xYTMtSM5EomsdGf7r2mE1q5YGIheHKNw=="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:52:41.212362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ab0b1db9-10ef-4d36-b9c9-aa9ce64eaa0f tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Getting quotas for project e89f6a9532254e5e80e19ae3e367bceb. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:52:41.212362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ab0b1db9-10ef-4d36-b9c9-aa9ce64eaa0f tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Getting quotas for user bb0237a781634974ba77b9ef00d52643 and project e89f6a9532254e5e80e19ae3e367bceb. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:52:41.335586 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ab0b1db9-10ef-4d36-b9c9-aa9ce64eaa0f tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.156117 May 21 21:52:41.336681 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3142/6159] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:52:41 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:52:41.422265 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cd5bfa13-1f77-487f-b57a-c2e8cb70237c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:41.450012 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cd5bfa13-1f77-487f-b57a-c2e8cb70237c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1691 microversion: 2.1 time: 0.706786 May 21 21:52:41.460046 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3018/6160] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:40 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1691 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:42.125621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-6360ea6b-3d84-49d9-bd64-ccc7b8852156 req-9fc9d481-25e6-4b6f-a651-2cdfca0336d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d0c42d1-f95b-455e-82e7-44bfe6033c19", "tag": "e289a815-e375-4419-ad91-9bc59bc45f55"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:52:42.161604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6360ea6b-3d84-49d9-bd64-ccc7b8852156 req-9fc9d481-25e6-4b6f-a651-2cdfca0336d0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:42.167556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6360ea6b-3d84-49d9-bd64-ccc7b8852156 req-9fc9d481-25e6-4b6f-a651-2cdfca0336d0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:42.192365 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-6360ea6b-3d84-49d9-bd64-ccc7b8852156 req-9fc9d481-25e6-4b6f-a651-2cdfca0336d0 service nova] Creating event network-changed:e289a815-e375-4419-ad91-9bc59bc45f55 for instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 on nch1-master-1 May 21 21:52:42.201647 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [req-6360ea6b-3d84-49d9-bd64-ccc7b8852156 req-9fc9d481-25e6-4b6f-a651-2cdfca0336d0 service nova] Instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 21:52:42.230078 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-6360ea6b-3d84-49d9-bd64-ccc7b8852156 req-9fc9d481-25e6-4b6f-a651-2cdfca0336d0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111645 May 21 21:52:42.231703 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3143/6161] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:52:42.468352 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5e91ec28-0dcc-4c6b-b724-cd5a8bbdad69 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:42.469665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5e91ec28-0dcc-4c6b-b724-cd5a8bbdad69 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:42.483038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e91ec28-0dcc-4c6b-b724-cd5a8bbdad69 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:42.483523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e91ec28-0dcc-4c6b-b724-cd5a8bbdad69 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:42.484498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e91ec28-0dcc-4c6b-b724-cd5a8bbdad69 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:42.485011 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e91ec28-0dcc-4c6b-b724-cd5a8bbdad69 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:42.867181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5e91ec28-0dcc-4c6b-b724-cd5a8bbdad69 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:42.878028 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5e91ec28-0dcc-4c6b-b724-cd5a8bbdad69 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1691 microversion: 2.1 time: 0.414726 May 21 21:52:42.882158 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3019/6162] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:42 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1691 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:43.897814 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f2c4064d-6328-49ea-b5de-6bcd09532fac tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:43.899282 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f2c4064d-6328-49ea-b5de-6bcd09532fac tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:43.901777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:52:43.912147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2c4064d-6328-49ea-b5de-6bcd09532fac tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:43.916496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2c4064d-6328-49ea-b5de-6bcd09532fac tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:43.916496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2c4064d-6328-49ea-b5de-6bcd09532fac tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:43.916496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2c4064d-6328-49ea-b5de-6bcd09532fac tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:44.343972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f2c4064d-6328-49ea-b5de-6bcd09532fac tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:44.399210 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f2c4064d-6328-49ea-b5de-6bcd09532fac tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1691 microversion: 2.1 time: 0.506270 May 21 21:52:44.401216 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3144/6163] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:43 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1691 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:45.107625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0eae29b7-44cd-4a1a-9c69-8713c369b820 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Action: 'create', calling method: .version_select at 0x7fc82d196af0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-717710223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAap9qQHNrOSI2O4sswMSCBruIw5YrrtT0qDDrTRRypAAP9gNbtpw5G7M1s8aJp1gvdC98gA2EaGbZQKGIYuQGswz4/35CGbd5bZreD1s2W8esUyFGdhxeSvQ/VIvGGS7w=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:52:45.116173 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:52:45.126088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-0eae29b7-44cd-4a1a-9c69-8713c369b820 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Getting quotas for project 31d683aab56145779b2614a9a0606556. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:52:45.139848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-0eae29b7-44cd-4a1a-9c69-8713c369b820 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Getting quotas for user 1f3a4acfcf07489abcedb1616deb915a and project 31d683aab56145779b2614a9a0606556. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:52:45.172173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cb06d6aa-7726-474d-abd0-c17272a4a75e tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-143799712", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "559981b5-4f79-4798-aa87-ec08274169ac", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1849980444", "security_groups": [{"name": "tempest-secgroup-smoke-321909097"}], "networks": [{"uuid": "ab1faa76-9aeb-4e39-965b-17c5b8e31e23"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:52:45.232693 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0eae29b7-44cd-4a1a-9c69-8713c369b820 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.123123 May 21 21:52:45.232693 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3020/6164] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:52:45 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:52:45.311046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-cb06d6aa-7726-474d-abd0-c17272a4a75e tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] validate_networks() for [('ab1faa76-9aeb-4e39-965b-17c5b8e31e23', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:52:45.417607 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1b92acc2-6151-46e7-87e1-1635a7fb55d6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:45.418198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1b92acc2-6151-46e7-87e1-1635a7fb55d6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:45.429883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b92acc2-6151-46e7-87e1-1635a7fb55d6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:45.433181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b92acc2-6151-46e7-87e1-1635a7fb55d6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:45.438143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b92acc2-6151-46e7-87e1-1635a7fb55d6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:45.438764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1b92acc2-6151-46e7-87e1-1635a7fb55d6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:45.647026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1b92acc2-6151-46e7-87e1-1635a7fb55d6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:45.656603 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1b92acc2-6151-46e7-87e1-1635a7fb55d6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1684 microversion: 2.1 time: 0.243197 May 21 21:52:45.662424 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3021/6165] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:45 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1684 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:52:45.928101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-cb06d6aa-7726-474d-abd0-c17272a4a75e tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:52:45.928101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-cb06d6aa-7726-474d-abd0-c17272a4a75e tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:52:45.928101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-cb06d6aa-7726-474d-abd0-c17272a4a75e tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:52:45.928101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-cb06d6aa-7726-474d-abd0-c17272a4a75e tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:52:45.928685 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-cb06d6aa-7726-474d-abd0-c17272a4a75e tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:52:45.941031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb06d6aa-7726-474d-abd0-c17272a4a75e tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:45.941867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb06d6aa-7726-474d-abd0-c17272a4a75e tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:45.943034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb06d6aa-7726-474d-abd0-c17272a4a75e tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:45.943725 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb06d6aa-7726-474d-abd0-c17272a4a75e tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:45.966019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-cb06d6aa-7726-474d-abd0-c17272a4a75e tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Getting quotas for project e89f6a9532254e5e80e19ae3e367bceb. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:52:45.971681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-cb06d6aa-7726-474d-abd0-c17272a4a75e tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Getting quotas for user bb0237a781634974ba77b9ef00d52643 and project e89f6a9532254e5e80e19ae3e367bceb. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:52:46.032894 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cb06d6aa-7726-474d-abd0-c17272a4a75e tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:52:46.035091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cb06d6aa-7726-474d-abd0-c17272a4a75e tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] [instance: f62763ca-182d-4287-acbf-2e90ec712910] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='559981b5-4f79-4798-aa87-ec08274169ac',volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:52:46.556170 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cb06d6aa-7726-474d-abd0-c17272a4a75e tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.387546 May 21 21:52:46.560385 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3145/6166] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:52:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:52:46.576746 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5ad9687b-902d-4f7f-8a48-13ebd9c277ea tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:46.576746 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5ad9687b-902d-4f7f-8a48-13ebd9c277ea tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] [instance: f62763ca-182d-4287-acbf-2e90ec712910] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:46.689263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5ad9687b-902d-4f7f-8a48-13ebd9c277ea tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0237a781634974ba77b9ef00d52643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89f6a9532254e5e80e19ae3e367bceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:46.696810 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5ad9687b-902d-4f7f-8a48-13ebd9c277ea tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] 10.222.0.49 "GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910" status: 200 len: 1098 microversion: 2.1 time: 0.132118 May 21 21:52:46.709074 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3022/6167] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:46 2022] GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910 => generated 1098 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:47.713970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-35c7cd6d-549a-4044-9950-64ffa453d123 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:47.714797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-35c7cd6d-549a-4044-9950-64ffa453d123 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] [instance: f62763ca-182d-4287-acbf-2e90ec712910] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:47.790558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-35c7cd6d-549a-4044-9950-64ffa453d123 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0237a781634974ba77b9ef00d52643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89f6a9532254e5e80e19ae3e367bceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:47.798725 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-35c7cd6d-549a-4044-9950-64ffa453d123 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] 10.222.0.49 "GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910" status: 200 len: 1098 microversion: 2.1 time: 0.088692 May 21 21:52:47.799316 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3146/6168] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:47 2022] GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910 => generated 1098 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:48.346321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-30ce11fd-d40d-40f1-b92e-99923ccd5cb6 req-dad6d47b-c9d2-481e-a8b3-7661fc3c8dfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d0c42d1-f95b-455e-82e7-44bfe6033c19", "name": "network-vif-plugged", "status": "completed", "tag": "e289a815-e375-4419-ad91-9bc59bc45f55"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:52:48.362108 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-30ce11fd-d40d-40f1-b92e-99923ccd5cb6 req-dad6d47b-c9d2-481e-a8b3-7661fc3c8dfc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:48.362764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-30ce11fd-d40d-40f1-b92e-99923ccd5cb6 req-dad6d47b-c9d2-481e-a8b3-7661fc3c8dfc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:48.377072 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-30ce11fd-d40d-40f1-b92e-99923ccd5cb6 req-dad6d47b-c9d2-481e-a8b3-7661fc3c8dfc service nova] Creating event network-vif-plugged:e289a815-e375-4419-ad91-9bc59bc45f55 for instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 on nch1-master-1 May 21 21:52:48.383151 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-30ce11fd-d40d-40f1-b92e-99923ccd5cb6 req-dad6d47b-c9d2-481e-a8b3-7661fc3c8dfc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040426 May 21 21:52:48.384781 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3023/6169] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:52:48.404129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dff93528-8aa1-45e3-9613-8e8219fee0fe tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-686129980", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "0a708f58-09ec-431c-ab0f-fdc8851393b8"}], "key_name": "tempest-TestNetworkBasicOps-717710223", "security_groups": [{"name": "tempest-secgroup-smoke-606865158"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:52:48.526332 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-dff93528-8aa1-45e3-9613-8e8219fee0fe tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] validate_networks() for [('0a708f58-09ec-431c-ab0f-fdc8851393b8', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:52:48.824647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-71e24856-f890-49ce-9dce-1e692a0c8188 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:48.825387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-71e24856-f890-49ce-9dce-1e692a0c8188 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] [instance: f62763ca-182d-4287-acbf-2e90ec712910] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:48.840097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71e24856-f890-49ce-9dce-1e692a0c8188 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:48.840097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71e24856-f890-49ce-9dce-1e692a0c8188 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:48.840097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71e24856-f890-49ce-9dce-1e692a0c8188 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:48.840097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-71e24856-f890-49ce-9dce-1e692a0c8188 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:48.930517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-71e24856-f890-49ce-9dce-1e692a0c8188 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0237a781634974ba77b9ef00d52643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89f6a9532254e5e80e19ae3e367bceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:48.939950 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-71e24856-f890-49ce-9dce-1e692a0c8188 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] 10.222.0.49 "GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910" status: 200 len: 1196 microversion: 2.1 time: 0.126789 May 21 21:52:48.940825 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3024/6170] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:48 2022] GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910 => generated 1196 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:52:49.034338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-dff93528-8aa1-45e3-9613-8e8219fee0fe tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:52:49.035115 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-dff93528-8aa1-45e3-9613-8e8219fee0fe tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:52:49.035622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-dff93528-8aa1-45e3-9613-8e8219fee0fe tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:52:49.036045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-dff93528-8aa1-45e3-9613-8e8219fee0fe tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:52:49.036733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-dff93528-8aa1-45e3-9613-8e8219fee0fe tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:52:49.047575 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dff93528-8aa1-45e3-9613-8e8219fee0fe tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:49.048534 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dff93528-8aa1-45e3-9613-8e8219fee0fe tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:49.051837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dff93528-8aa1-45e3-9613-8e8219fee0fe tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:49.051837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dff93528-8aa1-45e3-9613-8e8219fee0fe tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:49.074748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-dff93528-8aa1-45e3-9613-8e8219fee0fe tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Getting quotas for project 31d683aab56145779b2614a9a0606556. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:52:49.076830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-dff93528-8aa1-45e3-9613-8e8219fee0fe tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Getting quotas for user 1f3a4acfcf07489abcedb1616deb915a and project 31d683aab56145779b2614a9a0606556. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:52:49.090321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dff93528-8aa1-45e3-9613-8e8219fee0fe tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:52:49.092515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dff93528-8aa1-45e3-9613-8e8219fee0fe tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:52:49.246189 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dff93528-8aa1-45e3-9613-8e8219fee0fe tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.846420 May 21 21:52:49.247081 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3147/6171] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:52:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 21 21:52:49.257425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bdb2ed9a-ba46-4eef-b049-53f1d49d9325 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:49.258229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bdb2ed9a-ba46-4eef-b049-53f1d49d9325 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:49.356213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bdb2ed9a-ba46-4eef-b049-53f1d49d9325 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:49.368435 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bdb2ed9a-ba46-4eef-b049-53f1d49d9325 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de" status: 200 len: 1247 microversion: 2.1 time: 0.111095 May 21 21:52:49.368435 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3025/6172] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:49 2022] GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de => generated 1247 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:52:49.959277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-71b3f598-afb9-4c91-9916-64c1bec54f64 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:49.960147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-71b3f598-afb9-4c91-9916-64c1bec54f64 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] [instance: f62763ca-182d-4287-acbf-2e90ec712910] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:49.967701 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-71b3f598-afb9-4c91-9916-64c1bec54f64 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:49.968421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-71b3f598-afb9-4c91-9916-64c1bec54f64 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:49.969410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-71b3f598-afb9-4c91-9916-64c1bec54f64 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:49.970036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-71b3f598-afb9-4c91-9916-64c1bec54f64 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:50.046840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-71b3f598-afb9-4c91-9916-64c1bec54f64 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0237a781634974ba77b9ef00d52643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89f6a9532254e5e80e19ae3e367bceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:50.055478 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-71b3f598-afb9-4c91-9916-64c1bec54f64 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] 10.222.0.49 "GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910" status: 200 len: 1214 microversion: 2.1 time: 0.101223 May 21 21:52:50.056064 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3148/6173] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:49 2022] GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910 => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:50.383177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5be8f5e1-81b1-4ef7-b39e-32076ff5e424 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:50.384633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5be8f5e1-81b1-4ef7-b39e-32076ff5e424 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:50.394575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5be8f5e1-81b1-4ef7-b39e-32076ff5e424 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:50.395042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5be8f5e1-81b1-4ef7-b39e-32076ff5e424 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:50.395846 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5be8f5e1-81b1-4ef7-b39e-32076ff5e424 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:50.396406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5be8f5e1-81b1-4ef7-b39e-32076ff5e424 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:50.491754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5be8f5e1-81b1-4ef7-b39e-32076ff5e424 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:50.501165 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5be8f5e1-81b1-4ef7-b39e-32076ff5e424 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de" status: 200 len: 1251 microversion: 2.1 time: 0.121871 May 21 21:52:50.502121 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3026/6174] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:50 2022] GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de => generated 1251 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:51.077175 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-15e98428-156d-4576-af74-5362c7dc9417 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:51.077842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-15e98428-156d-4576-af74-5362c7dc9417 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] [instance: f62763ca-182d-4287-acbf-2e90ec712910] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:51.085046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15e98428-156d-4576-af74-5362c7dc9417 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:51.085513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15e98428-156d-4576-af74-5362c7dc9417 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:51.086311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15e98428-156d-4576-af74-5362c7dc9417 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:51.086826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-15e98428-156d-4576-af74-5362c7dc9417 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:51.239443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-15e98428-156d-4576-af74-5362c7dc9417 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0237a781634974ba77b9ef00d52643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89f6a9532254e5e80e19ae3e367bceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:51.248414 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-15e98428-156d-4576-af74-5362c7dc9417 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] 10.222.0.49 "GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910" status: 200 len: 1269 microversion: 2.1 time: 0.175059 May 21 21:52:51.251175 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3149/6175] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:51 2022] GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910 => generated 1269 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:51.519721 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0b025dd5-e44e-48d3-b660-34fca45f2bc5 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:51.520532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0b025dd5-e44e-48d3-b660-34fca45f2bc5 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:51.529037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b025dd5-e44e-48d3-b660-34fca45f2bc5 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:51.529497 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b025dd5-e44e-48d3-b660-34fca45f2bc5 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:51.530285 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b025dd5-e44e-48d3-b660-34fca45f2bc5 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:51.530862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b025dd5-e44e-48d3-b660-34fca45f2bc5 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:51.654618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0b025dd5-e44e-48d3-b660-34fca45f2bc5 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:51.675283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-6d5d6b20-b977-40df-a88e-7b07187a0f5d req-ce73f8fd-0124-4f4c-b263-e58a4eb3250a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f62763ca-182d-4287-acbf-2e90ec712910", "tag": "f1aa8f72-5b24-4df3-a09d-7e4ff4e2f403"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:52:51.687927 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0b025dd5-e44e-48d3-b660-34fca45f2bc5 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de" status: 200 len: 1307 microversion: 2.1 time: 0.170750 May 21 21:52:51.688596 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3027/6176] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:51 2022] GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de => generated 1307 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:51.695028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6d5d6b20-b977-40df-a88e-7b07187a0f5d req-ce73f8fd-0124-4f4c-b263-e58a4eb3250a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:51.695572 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6d5d6b20-b977-40df-a88e-7b07187a0f5d req-ce73f8fd-0124-4f4c-b263-e58a4eb3250a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:51.709129 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-6d5d6b20-b977-40df-a88e-7b07187a0f5d req-ce73f8fd-0124-4f4c-b263-e58a4eb3250a service nova] Creating event network-changed:f1aa8f72-5b24-4df3-a09d-7e4ff4e2f403 for instance f62763ca-182d-4287-acbf-2e90ec712910 on nch2-master-1 May 21 21:52:51.714718 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-6d5d6b20-b977-40df-a88e-7b07187a0f5d req-ce73f8fd-0124-4f4c-b263-e58a4eb3250a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067577 May 21 21:52:51.719961 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3150/6177] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:52:52.266048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-822a8685-e67a-444e-860b-47731499e1f0 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:52.266710 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-822a8685-e67a-444e-860b-47731499e1f0 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] [instance: f62763ca-182d-4287-acbf-2e90ec712910] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:52.273076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-822a8685-e67a-444e-860b-47731499e1f0 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:52.280097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-822a8685-e67a-444e-860b-47731499e1f0 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:52.280097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-822a8685-e67a-444e-860b-47731499e1f0 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:52.280097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-822a8685-e67a-444e-860b-47731499e1f0 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:52.544695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-822a8685-e67a-444e-860b-47731499e1f0 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0237a781634974ba77b9ef00d52643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89f6a9532254e5e80e19ae3e367bceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:52.553327 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-822a8685-e67a-444e-860b-47731499e1f0 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] 10.222.0.49 "GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910" status: 200 len: 1269 microversion: 2.1 time: 0.290834 May 21 21:52:52.553952 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3028/6178] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:52 2022] GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910 => generated 1269 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:52.707133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bebb1cd8-279f-4a3c-a156-c8e24597b44c tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:52.708003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bebb1cd8-279f-4a3c-a156-c8e24597b44c tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:52.715670 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bebb1cd8-279f-4a3c-a156-c8e24597b44c tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:52.719903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bebb1cd8-279f-4a3c-a156-c8e24597b44c tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:52.719903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bebb1cd8-279f-4a3c-a156-c8e24597b44c tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:52.719903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bebb1cd8-279f-4a3c-a156-c8e24597b44c tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:52.964905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bebb1cd8-279f-4a3c-a156-c8e24597b44c tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:52.972763 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bebb1cd8-279f-4a3c-a156-c8e24597b44c tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de" status: 200 len: 1372 microversion: 2.1 time: 0.271039 May 21 21:52:52.973414 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3151/6179] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:52 2022] GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de => generated 1372 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:53.540233 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-dbef760b-415a-4ece-9a7b-e9ff3d2a2f6a req-a4e21adc-8da7-4eab-9249-689b2a49eb18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad955ecb-e75a-4004-930b-b1efcf1438de", "tag": "9701496f-20f3-4311-b9d5-292da983b209"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:52:53.555611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-dbef760b-415a-4ece-9a7b-e9ff3d2a2f6a req-a4e21adc-8da7-4eab-9249-689b2a49eb18 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:53.557645 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-dbef760b-415a-4ece-9a7b-e9ff3d2a2f6a req-a4e21adc-8da7-4eab-9249-689b2a49eb18 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:53.571677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-48d2264d-c4bb-476e-a8cf-385bddf2e52d tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:53.572619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-48d2264d-c4bb-476e-a8cf-385bddf2e52d tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] [instance: f62763ca-182d-4287-acbf-2e90ec712910] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:53.577485 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-dbef760b-415a-4ece-9a7b-e9ff3d2a2f6a req-a4e21adc-8da7-4eab-9249-689b2a49eb18 service nova] Creating event network-changed:9701496f-20f3-4311-b9d5-292da983b209 for instance ad955ecb-e75a-4004-930b-b1efcf1438de on nch1-master-1 May 21 21:52:53.579941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48d2264d-c4bb-476e-a8cf-385bddf2e52d tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:53.580666 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48d2264d-c4bb-476e-a8cf-385bddf2e52d tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:53.581492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48d2264d-c4bb-476e-a8cf-385bddf2e52d tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:53.581947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48d2264d-c4bb-476e-a8cf-385bddf2e52d tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:53.582625 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-dbef760b-415a-4ece-9a7b-e9ff3d2a2f6a req-a4e21adc-8da7-4eab-9249-689b2a49eb18 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046016 May 21 21:52:53.583486 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3029/6180] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:52:53.865563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-48d2264d-c4bb-476e-a8cf-385bddf2e52d tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0237a781634974ba77b9ef00d52643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89f6a9532254e5e80e19ae3e367bceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:53.874006 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-48d2264d-c4bb-476e-a8cf-385bddf2e52d tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] 10.222.0.49 "GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910" status: 200 len: 1269 microversion: 2.1 time: 0.306464 May 21 21:52:53.874582 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3152/6181] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:53 2022] GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910 => generated 1269 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:52:53.991445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d7eb396f-871c-4fb9-a8a3-2b661d33e26d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:53.992272 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d7eb396f-871c-4fb9-a8a3-2b661d33e26d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:54.000379 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7eb396f-871c-4fb9-a8a3-2b661d33e26d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:54.000891 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7eb396f-871c-4fb9-a8a3-2b661d33e26d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:54.001774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7eb396f-871c-4fb9-a8a3-2b661d33e26d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:54.002299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d7eb396f-871c-4fb9-a8a3-2b661d33e26d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:54.164643 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d7eb396f-871c-4fb9-a8a3-2b661d33e26d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:54.172373 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d7eb396f-871c-4fb9-a8a3-2b661d33e26d tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de" status: 200 len: 1372 microversion: 2.1 time: 0.185223 May 21 21:52:54.172966 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3030/6182] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:53 2022] GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de => generated 1372 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:54.890877 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6a22c46c-092e-4506-b354-87d1692cfcb6 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:54.891511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6a22c46c-092e-4506-b354-87d1692cfcb6 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] [instance: f62763ca-182d-4287-acbf-2e90ec712910] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:54.898654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6a22c46c-092e-4506-b354-87d1692cfcb6 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:54.899123 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6a22c46c-092e-4506-b354-87d1692cfcb6 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:54.900574 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6a22c46c-092e-4506-b354-87d1692cfcb6 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:54.901037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6a22c46c-092e-4506-b354-87d1692cfcb6 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:55.045350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6a22c46c-092e-4506-b354-87d1692cfcb6 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0237a781634974ba77b9ef00d52643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89f6a9532254e5e80e19ae3e367bceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:55.053162 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6a22c46c-092e-4506-b354-87d1692cfcb6 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] 10.222.0.49 "GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910" status: 200 len: 1269 microversion: 2.1 time: 0.166261 May 21 21:52:55.053736 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3153/6183] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:54 2022] GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910 => generated 1269 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:55.190545 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7fe146c2-1f3e-4a18-8a05-7e6167677327 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:55.191356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7fe146c2-1f3e-4a18-8a05-7e6167677327 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:55.200653 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7fe146c2-1f3e-4a18-8a05-7e6167677327 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:55.201179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7fe146c2-1f3e-4a18-8a05-7e6167677327 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:55.202463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7fe146c2-1f3e-4a18-8a05-7e6167677327 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:55.203122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7fe146c2-1f3e-4a18-8a05-7e6167677327 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:55.359759 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7fe146c2-1f3e-4a18-8a05-7e6167677327 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:55.369635 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7fe146c2-1f3e-4a18-8a05-7e6167677327 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de" status: 200 len: 1372 microversion: 2.1 time: 0.182083 May 21 21:52:55.369886 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3031/6184] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:55 2022] GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:56.069785 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a45a676e-6c2a-445d-a6be-96c1a79fe7de tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:56.070411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a45a676e-6c2a-445d-a6be-96c1a79fe7de tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] [instance: f62763ca-182d-4287-acbf-2e90ec712910] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:56.078618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a45a676e-6c2a-445d-a6be-96c1a79fe7de tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:56.079081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a45a676e-6c2a-445d-a6be-96c1a79fe7de tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:56.079860 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a45a676e-6c2a-445d-a6be-96c1a79fe7de tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:56.080330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a45a676e-6c2a-445d-a6be-96c1a79fe7de tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:56.226126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a45a676e-6c2a-445d-a6be-96c1a79fe7de tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0237a781634974ba77b9ef00d52643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89f6a9532254e5e80e19ae3e367bceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:56.233768 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a45a676e-6c2a-445d-a6be-96c1a79fe7de tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] 10.222.0.49 "GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910" status: 200 len: 1269 microversion: 2.1 time: 0.168230 May 21 21:52:56.234339 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3154/6185] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:56 2022] GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910 => generated 1269 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:56.386889 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2264c350-513d-44ad-93e2-f8a55d702c09 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:56.387513 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2264c350-513d-44ad-93e2-f8a55d702c09 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:56.394791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2264c350-513d-44ad-93e2-f8a55d702c09 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:56.395244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2264c350-513d-44ad-93e2-f8a55d702c09 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:56.396019 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2264c350-513d-44ad-93e2-f8a55d702c09 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:56.396499 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2264c350-513d-44ad-93e2-f8a55d702c09 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:56.415203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:52:56.548106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2264c350-513d-44ad-93e2-f8a55d702c09 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:56.555860 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2264c350-513d-44ad-93e2-f8a55d702c09 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de" status: 200 len: 1372 microversion: 2.1 time: 0.173551 May 21 21:52:56.557372 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3032/6186] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:56 2022] GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:57.250507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e525bcfb-3e34-4cb5-bad1-7865626ba62d tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:57.257878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e525bcfb-3e34-4cb5-bad1-7865626ba62d tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] [instance: f62763ca-182d-4287-acbf-2e90ec712910] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:57.258021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e525bcfb-3e34-4cb5-bad1-7865626ba62d tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:57.258487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e525bcfb-3e34-4cb5-bad1-7865626ba62d tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:57.259324 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e525bcfb-3e34-4cb5-bad1-7865626ba62d tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:57.260033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e525bcfb-3e34-4cb5-bad1-7865626ba62d tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:57.416531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e525bcfb-3e34-4cb5-bad1-7865626ba62d tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0237a781634974ba77b9ef00d52643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89f6a9532254e5e80e19ae3e367bceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:57.424263 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e525bcfb-3e34-4cb5-bad1-7865626ba62d tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] 10.222.0.49 "GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910" status: 200 len: 1269 microversion: 2.1 time: 0.177830 May 21 21:52:57.424920 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3155/6187] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:57 2022] GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910 => generated 1269 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:57.503966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-b76ffced-d564-4fd8-9d43-5faca53d57e4 req-7241477e-82c7-4b27-8313-0078b5e6ce1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f62763ca-182d-4287-acbf-2e90ec712910", "name": "network-vif-plugged", "status": "completed", "tag": "f1aa8f72-5b24-4df3-a09d-7e4ff4e2f403"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:52:57.513811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b76ffced-d564-4fd8-9d43-5faca53d57e4 req-7241477e-82c7-4b27-8313-0078b5e6ce1f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:57.514265 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b76ffced-d564-4fd8-9d43-5faca53d57e4 req-7241477e-82c7-4b27-8313-0078b5e6ce1f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:57.526385 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-b76ffced-d564-4fd8-9d43-5faca53d57e4 req-7241477e-82c7-4b27-8313-0078b5e6ce1f service nova] Creating event network-vif-plugged:f1aa8f72-5b24-4df3-a09d-7e4ff4e2f403 for instance f62763ca-182d-4287-acbf-2e90ec712910 on nch2-master-1 May 21 21:52:57.531282 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-b76ffced-d564-4fd8-9d43-5faca53d57e4 req-7241477e-82c7-4b27-8313-0078b5e6ce1f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031139 May 21 21:52:57.533641 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3033/6188] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:52:57.574599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-70b85ab1-9057-4233-8fce-23d1e5666ad9 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:57.575761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-70b85ab1-9057-4233-8fce-23d1e5666ad9 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:57.581963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-70b85ab1-9057-4233-8fce-23d1e5666ad9 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:57.582434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-70b85ab1-9057-4233-8fce-23d1e5666ad9 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:57.583237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-70b85ab1-9057-4233-8fce-23d1e5666ad9 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:57.583690 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-70b85ab1-9057-4233-8fce-23d1e5666ad9 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:57.600386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:52:57.746622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-70b85ab1-9057-4233-8fce-23d1e5666ad9 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:57.754186 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-70b85ab1-9057-4233-8fce-23d1e5666ad9 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de" status: 200 len: 1372 microversion: 2.1 time: 0.183824 May 21 21:52:57.754837 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3156/6189] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:57 2022] GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:58.442471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7fe51a24-3989-429a-9cf4-58e5b640cc85 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:58.443203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7fe51a24-3989-429a-9cf4-58e5b640cc85 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] [instance: f62763ca-182d-4287-acbf-2e90ec712910] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:58.450659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7fe51a24-3989-429a-9cf4-58e5b640cc85 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:58.451116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7fe51a24-3989-429a-9cf4-58e5b640cc85 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:58.452806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7fe51a24-3989-429a-9cf4-58e5b640cc85 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:58.452806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7fe51a24-3989-429a-9cf4-58e5b640cc85 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:58.607490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7fe51a24-3989-429a-9cf4-58e5b640cc85 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0237a781634974ba77b9ef00d52643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89f6a9532254e5e80e19ae3e367bceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:58.615375 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7fe51a24-3989-429a-9cf4-58e5b640cc85 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] 10.222.0.49 "GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910" status: 200 len: 1269 microversion: 2.1 time: 0.177338 May 21 21:52:58.616008 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3034/6190] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:58 2022] GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910 => generated 1269 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:58.772197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c30cd2f1-50d2-4701-a1a6-25e545f49f6f tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:58.772865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c30cd2f1-50d2-4701-a1a6-25e545f49f6f tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:58.781884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c30cd2f1-50d2-4701-a1a6-25e545f49f6f tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:58.782384 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c30cd2f1-50d2-4701-a1a6-25e545f49f6f tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:58.783328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c30cd2f1-50d2-4701-a1a6-25e545f49f6f tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:58.783991 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c30cd2f1-50d2-4701-a1a6-25e545f49f6f tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:58.940309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c30cd2f1-50d2-4701-a1a6-25e545f49f6f tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:58.948783 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c30cd2f1-50d2-4701-a1a6-25e545f49f6f tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de" status: 200 len: 1372 microversion: 2.1 time: 0.180651 May 21 21:52:58.949368 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3157/6191] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:58 2022] GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:59.631903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eb0068c1-8a05-4e19-85db-b564bfcc6da8 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:59.632549 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-eb0068c1-8a05-4e19-85db-b564bfcc6da8 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] [instance: f62763ca-182d-4287-acbf-2e90ec712910] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:59.635190 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=8 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:52:59.641038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb0068c1-8a05-4e19-85db-b564bfcc6da8 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:59.641500 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb0068c1-8a05-4e19-85db-b564bfcc6da8 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:59.642274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb0068c1-8a05-4e19-85db-b564bfcc6da8 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:59.642719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb0068c1-8a05-4e19-85db-b564bfcc6da8 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:59.791143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-eb0068c1-8a05-4e19-85db-b564bfcc6da8 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0237a781634974ba77b9ef00d52643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89f6a9532254e5e80e19ae3e367bceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:59.798894 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-eb0068c1-8a05-4e19-85db-b564bfcc6da8 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] 10.222.0.49 "GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910" status: 200 len: 1458 microversion: 2.1 time: 0.170940 May 21 21:52:59.799459 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3035/6192] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:59 2022] GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910 => generated 1458 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:52:59.815780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9ce26789-3a15-4ad2-b902-ef4a3f885c1b tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:59.816456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9ce26789-3a15-4ad2-b902-ef4a3f885c1b tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] [instance: f62763ca-182d-4287-acbf-2e90ec712910] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:59.818392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:52:59.819159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=18 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:52:59.825625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ce26789-3a15-4ad2-b902-ef4a3f885c1b tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:59.826344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ce26789-3a15-4ad2-b902-ef4a3f885c1b tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:59.827047 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ce26789-3a15-4ad2-b902-ef4a3f885c1b tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:59.827510 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9ce26789-3a15-4ad2-b902-ef4a3f885c1b tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:59.966424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c467d488-89f5-4995-85fc-707c5aeb3d32 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:52:59.967079 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c467d488-89f5-4995-85fc-707c5aeb3d32 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:52:59.975277 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c467d488-89f5-4995-85fc-707c5aeb3d32 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:59.975277 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c467d488-89f5-4995-85fc-707c5aeb3d32 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:59.975277 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c467d488-89f5-4995-85fc-707c5aeb3d32 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:52:59.975277 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c467d488-89f5-4995-85fc-707c5aeb3d32 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:52:59.975815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9ce26789-3a15-4ad2-b902-ef4a3f885c1b tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0237a781634974ba77b9ef00d52643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89f6a9532254e5e80e19ae3e367bceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:52:59.984471 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9ce26789-3a15-4ad2-b902-ef4a3f885c1b tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] 10.222.0.49 "GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910" status: 200 len: 1458 microversion: 2.1 time: 0.172583 May 21 21:52:59.985055 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3158/6193] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:59 2022] GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910 => generated 1458 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:00.164354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c467d488-89f5-4995-85fc-707c5aeb3d32 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:00.172881 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c467d488-89f5-4995-85fc-707c5aeb3d32 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de" status: 200 len: 1372 microversion: 2.1 time: 0.210840 May 21 21:53:00.173456 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3036/6194] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:52:59 2022] GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de => generated 1372 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:53:00.317734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-443f3b35-07ba-4c2c-9737-9edc503ca342 req-977afc2c-500b-4b87-80d6-4d3ea2b308d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad955ecb-e75a-4004-930b-b1efcf1438de", "name": "network-vif-plugged", "status": "completed", "tag": "9701496f-20f3-4311-b9d5-292da983b209"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:53:00.328855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-443f3b35-07ba-4c2c-9737-9edc503ca342 req-977afc2c-500b-4b87-80d6-4d3ea2b308d4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:00.329319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-443f3b35-07ba-4c2c-9737-9edc503ca342 req-977afc2c-500b-4b87-80d6-4d3ea2b308d4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:00.341404 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-443f3b35-07ba-4c2c-9737-9edc503ca342 req-977afc2c-500b-4b87-80d6-4d3ea2b308d4 service nova] Creating event network-vif-plugged:9701496f-20f3-4311-b9d5-292da983b209 for instance ad955ecb-e75a-4004-930b-b1efcf1438de on nch1-master-1 May 21 21:53:00.346355 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-443f3b35-07ba-4c2c-9737-9edc503ca342 req-977afc2c-500b-4b87-80d6-4d3ea2b308d4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032660 May 21 21:53:00.346977 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3159/6195] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:53:01.190474 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b200b88f-78d6-4dc7-9c21-f9ffc0b18def tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:01.191135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b200b88f-78d6-4dc7-9c21-f9ffc0b18def tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:01.199387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b200b88f-78d6-4dc7-9c21-f9ffc0b18def tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:01.199847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b200b88f-78d6-4dc7-9c21-f9ffc0b18def tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:01.200685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b200b88f-78d6-4dc7-9c21-f9ffc0b18def tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:01.201132 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b200b88f-78d6-4dc7-9c21-f9ffc0b18def tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:01.353707 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b200b88f-78d6-4dc7-9c21-f9ffc0b18def tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:01.362191 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b200b88f-78d6-4dc7-9c21-f9ffc0b18def tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de" status: 200 len: 1372 microversion: 2.1 time: 0.175862 May 21 21:53:01.362820 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3037/6196] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:01 2022] GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:02.380787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4a4cd852-765e-4cdf-ade0-0d046fb5aabd tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:02.381511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4a4cd852-765e-4cdf-ade0-0d046fb5aabd tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:02.388812 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a4cd852-765e-4cdf-ade0-0d046fb5aabd tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:02.389288 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a4cd852-765e-4cdf-ade0-0d046fb5aabd tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:02.390084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a4cd852-765e-4cdf-ade0-0d046fb5aabd tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:02.390569 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a4cd852-765e-4cdf-ade0-0d046fb5aabd tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:02.645080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4a4cd852-765e-4cdf-ade0-0d046fb5aabd tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:02.652791 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4a4cd852-765e-4cdf-ade0-0d046fb5aabd tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de" status: 200 len: 1543 microversion: 2.1 time: 0.277277 May 21 21:53:02.653374 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3160/6197] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:02 2022] GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de => generated 1543 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:02.674514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-692d771c-a68b-432d-9d61-bc4c7596e841 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:02.675190 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-692d771c-a68b-432d-9d61-bc4c7596e841 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:02.683801 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-692d771c-a68b-432d-9d61-bc4c7596e841 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:02.684258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-692d771c-a68b-432d-9d61-bc4c7596e841 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:02.685061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-692d771c-a68b-432d-9d61-bc4c7596e841 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:02.686048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-692d771c-a68b-432d-9d61-bc4c7596e841 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:02.855505 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-692d771c-a68b-432d-9d61-bc4c7596e841 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:02.867609 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-692d771c-a68b-432d-9d61-bc4c7596e841 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de" status: 200 len: 1543 microversion: 2.1 time: 0.194195 May 21 21:53:02.882437 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3038/6198] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:02 2022] GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de => generated 1543 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:02.886314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-37d55ac4-3cb9-40aa-bd7d-57d9a3341dc0 req-4017a5d6-02fd-4da4-8beb-acd19312df35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f62763ca-182d-4287-acbf-2e90ec712910", "tag": "f1aa8f72-5b24-4df3-a09d-7e4ff4e2f403"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:53:02.915320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-37d55ac4-3cb9-40aa-bd7d-57d9a3341dc0 req-4017a5d6-02fd-4da4-8beb-acd19312df35 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:02.916686 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-37d55ac4-3cb9-40aa-bd7d-57d9a3341dc0 req-4017a5d6-02fd-4da4-8beb-acd19312df35 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:02.934039 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-37d55ac4-3cb9-40aa-bd7d-57d9a3341dc0 req-4017a5d6-02fd-4da4-8beb-acd19312df35 service nova] Creating event network-changed:f1aa8f72-5b24-4df3-a09d-7e4ff4e2f403 for instance f62763ca-182d-4287-acbf-2e90ec712910 on nch2-master-1 May 21 21:53:02.941112 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-37d55ac4-3cb9-40aa-bd7d-57d9a3341dc0 req-4017a5d6-02fd-4da4-8beb-acd19312df35 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065342 May 21 21:53:02.942527 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3161/6199] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:53:04.993979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-b1203543-fe0c-4202-a3c5-32c5846b82bc req-0db8360c-140d-4f21-bbe8-77f60fbe99f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f62763ca-182d-4287-acbf-2e90ec712910", "tag": "f1aa8f72-5b24-4df3-a09d-7e4ff4e2f403"}, {"name": "network-changed", "server_uuid": "f62763ca-182d-4287-acbf-2e90ec712910", "tag": "f1aa8f72-5b24-4df3-a09d-7e4ff4e2f403"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:53:05.003614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b1203543-fe0c-4202-a3c5-32c5846b82bc req-0db8360c-140d-4f21-bbe8-77f60fbe99f1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:05.004083 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b1203543-fe0c-4202-a3c5-32c5846b82bc req-0db8360c-140d-4f21-bbe8-77f60fbe99f1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:05.016304 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-b1203543-fe0c-4202-a3c5-32c5846b82bc req-0db8360c-140d-4f21-bbe8-77f60fbe99f1 service nova] Creating event network-changed:f1aa8f72-5b24-4df3-a09d-7e4ff4e2f403 for instance f62763ca-182d-4287-acbf-2e90ec712910 on nch2-master-1 May 21 21:53:05.016844 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-b1203543-fe0c-4202-a3c5-32c5846b82bc req-0db8360c-140d-4f21-bbe8-77f60fbe99f1 service nova] Creating event network-changed:f1aa8f72-5b24-4df3-a09d-7e4ff4e2f403 for instance f62763ca-182d-4287-acbf-2e90ec712910 on nch2-master-1 May 21 21:53:05.022961 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-b1203543-fe0c-4202-a3c5-32c5846b82bc req-0db8360c-140d-4f21-bbe8-77f60fbe99f1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033008 May 21 21:53:05.023411 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3039/6200] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:53:06.704784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-5942a4f3-90ea-4f8c-bde4-d685212649e3 req-1f728e40-ca4b-4f95-9fe4-badb54efd306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad955ecb-e75a-4004-930b-b1efcf1438de", "tag": "9701496f-20f3-4311-b9d5-292da983b209"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:53:06.714484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5942a4f3-90ea-4f8c-bde4-d685212649e3 req-1f728e40-ca4b-4f95-9fe4-badb54efd306 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:06.715301 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5942a4f3-90ea-4f8c-bde4-d685212649e3 req-1f728e40-ca4b-4f95-9fe4-badb54efd306 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:06.728539 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-5942a4f3-90ea-4f8c-bde4-d685212649e3 req-1f728e40-ca4b-4f95-9fe4-badb54efd306 service nova] Creating event network-changed:9701496f-20f3-4311-b9d5-292da983b209 for instance ad955ecb-e75a-4004-930b-b1efcf1438de on nch1-master-1 May 21 21:53:06.733796 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-5942a4f3-90ea-4f8c-bde4-d685212649e3 req-1f728e40-ca4b-4f95-9fe4-badb54efd306 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034693 May 21 21:53:06.735204 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3162/6201] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:53:09.919124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4047a7d5-127f-493f-a5a9-7a7d9f6003f5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:53:09.920187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4047a7d5-127f-493f-a5a9-7a7d9f6003f5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:09.926907 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4047a7d5-127f-493f-a5a9-7a7d9f6003f5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:09.927365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4047a7d5-127f-493f-a5a9-7a7d9f6003f5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:09.928172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4047a7d5-127f-493f-a5a9-7a7d9f6003f5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:09.928706 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4047a7d5-127f-493f-a5a9-7a7d9f6003f5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:09.981748 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4047a7d5-127f-493f-a5a9-7a7d9f6003f5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19/action" status: 200 len: 63188 microversion: 2.1 time: 0.068988 May 21 21:53:09.982331 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3040/6202] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:53:09 2022] POST /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19/action => generated 63188 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:53:16.207563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9a62d842-d41b-499a-8341-a5da916830f4 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:16.208219 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9a62d842-d41b-499a-8341-a5da916830f4 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:16.211048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:53:16.216794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a62d842-d41b-499a-8341-a5da916830f4 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:16.217264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a62d842-d41b-499a-8341-a5da916830f4 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:16.218050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a62d842-d41b-499a-8341-a5da916830f4 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:16.218506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a62d842-d41b-499a-8341-a5da916830f4 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:16.367376 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9a62d842-d41b-499a-8341-a5da916830f4 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1835 microversion: 2.1 time: 0.163999 May 21 21:53:16.369058 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3163/6203] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:16 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1835 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:17.483178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1611ff78-e7d9-482d-a44e-d43e0ceed1f6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:17.484611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1611ff78-e7d9-482d-a44e-d43e0ceed1f6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:17.485193 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f70af2f3-1440-42f9-a991-a407ad48cd8f req-91e93ff4-67f7-4f5e-907b-e401bd68878a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d0c42d1-f95b-455e-82e7-44bfe6033c19", "tag": "e289a815-e375-4419-ad91-9bc59bc45f55"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:53:17.487669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:53:17.493053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1611ff78-e7d9-482d-a44e-d43e0ceed1f6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:17.493769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1611ff78-e7d9-482d-a44e-d43e0ceed1f6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:17.494973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1611ff78-e7d9-482d-a44e-d43e0ceed1f6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:17.495498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1611ff78-e7d9-482d-a44e-d43e0ceed1f6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:17.495630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f70af2f3-1440-42f9-a991-a407ad48cd8f req-91e93ff4-67f7-4f5e-907b-e401bd68878a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:17.495971 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f70af2f3-1440-42f9-a991-a407ad48cd8f req-91e93ff4-67f7-4f5e-907b-e401bd68878a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:17.508258 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f70af2f3-1440-42f9-a991-a407ad48cd8f req-91e93ff4-67f7-4f5e-907b-e401bd68878a service nova] Creating event network-changed:e289a815-e375-4419-ad91-9bc59bc45f55 for instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 on nch1-master-1 May 21 21:53:17.514820 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f70af2f3-1440-42f9-a991-a407ad48cd8f req-91e93ff4-67f7-4f5e-907b-e401bd68878a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033186 May 21 21:53:17.516007 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3164/6204] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:53:17.528516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1611ff78-e7d9-482d-a44e-d43e0ceed1f6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:53:17.824594 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1611ff78-e7d9-482d-a44e-d43e0ceed1f6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 204 len: 0 microversion: 2.1 time: 0.345128 May 21 21:53:17.825398 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3041/6205] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:53:17 2022] DELETE /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:53:17.837538 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f5ac8702-f1f8-4099-89e6-82471c509460 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:17.838255 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f5ac8702-f1f8-4099-89e6-82471c509460 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:17.846278 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5ac8702-f1f8-4099-89e6-82471c509460 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:17.846743 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5ac8702-f1f8-4099-89e6-82471c509460 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:17.847557 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5ac8702-f1f8-4099-89e6-82471c509460 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:17.848041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5ac8702-f1f8-4099-89e6-82471c509460 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:18.005276 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f5ac8702-f1f8-4099-89e6-82471c509460 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:18.013352 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f5ac8702-f1f8-4099-89e6-82471c509460 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1690 microversion: 2.1 time: 0.182477 May 21 21:53:18.013934 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3165/6206] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:17 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1690 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:19.033117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ca7cb8da-9978-4e24-8610-7f450f96a841 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:19.033827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ca7cb8da-9978-4e24-8610-7f450f96a841 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:19.042765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca7cb8da-9978-4e24-8610-7f450f96a841 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:19.045874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca7cb8da-9978-4e24-8610-7f450f96a841 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:19.045874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca7cb8da-9978-4e24-8610-7f450f96a841 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:19.045874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca7cb8da-9978-4e24-8610-7f450f96a841 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:19.197107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ca7cb8da-9978-4e24-8610-7f450f96a841 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:19.205227 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ca7cb8da-9978-4e24-8610-7f450f96a841 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1690 microversion: 2.1 time: 0.176467 May 21 21:53:19.206016 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3042/6207] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:19 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1690 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:19.724183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-ffc3770e-493a-4e0d-818a-26720cda6b82 req-28617e37-d87c-4aaa-b5db-7a1d6901c252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d0c42d1-f95b-455e-82e7-44bfe6033c19", "name": "network-vif-deleted", "tag": "e289a815-e375-4419-ad91-9bc59bc45f55"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:53:19.734029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ffc3770e-493a-4e0d-818a-26720cda6b82 req-28617e37-d87c-4aaa-b5db-7a1d6901c252 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:19.734493 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ffc3770e-493a-4e0d-818a-26720cda6b82 req-28617e37-d87c-4aaa-b5db-7a1d6901c252 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:19.746260 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-ffc3770e-493a-4e0d-818a-26720cda6b82 req-28617e37-d87c-4aaa-b5db-7a1d6901c252 service nova] Creating event network-vif-deleted:e289a815-e375-4419-ad91-9bc59bc45f55 for instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 on nch1-master-1 May 21 21:53:19.751076 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-ffc3770e-493a-4e0d-818a-26720cda6b82 req-28617e37-d87c-4aaa-b5db-7a1d6901c252 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030630 May 21 21:53:19.751658 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3166/6208] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:53:20.222941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b18acb7a-19d1-4252-88e7-6289eb4d5ae0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:20.223569 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b18acb7a-19d1-4252-88e7-6289eb4d5ae0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:20.231213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b18acb7a-19d1-4252-88e7-6289eb4d5ae0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:20.231677 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b18acb7a-19d1-4252-88e7-6289eb4d5ae0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:20.232512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b18acb7a-19d1-4252-88e7-6289eb4d5ae0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:20.232963 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b18acb7a-19d1-4252-88e7-6289eb4d5ae0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:20.265835 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b18acb7a-19d1-4252-88e7-6289eb4d5ae0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:20.266229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b18acb7a-19d1-4252-88e7-6289eb4d5ae0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:20.266692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-b18acb7a-19d1-4252-88e7-6289eb4d5ae0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lazy-loading 'fault' on Instance uuid 9d0c42d1-f95b-455e-82e7-44bfe6033c19 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:53:20.315798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b18acb7a-19d1-4252-88e7-6289eb4d5ae0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:20.324913 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b18acb7a-19d1-4252-88e7-6289eb4d5ae0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 200 len: 1356 microversion: 2.1 time: 0.105832 May 21 21:53:20.325553 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3043/6209] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:20 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:21.344073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e6a7db12-2eba-4ade-9f46-dd2a2d0919ef tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:21.344823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e6a7db12-2eba-4ade-9f46-dd2a2d0919ef tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 9d0c42d1-f95b-455e-82e7-44bfe6033c19] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:21.351361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6a7db12-2eba-4ade-9f46-dd2a2d0919ef tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:21.353099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6a7db12-2eba-4ade-9f46-dd2a2d0919ef tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:21.353099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6a7db12-2eba-4ade-9f46-dd2a2d0919ef tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:21.353099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6a7db12-2eba-4ade-9f46-dd2a2d0919ef tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:21.367428 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-e6a7db12-2eba-4ade-9f46-dd2a2d0919ef tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] HTTP exception thrown: Instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 could not be found. May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e6a7db12-2eba-4ade-9f46-dd2a2d0919ef tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Request method failure captured: May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 HTTP/1.1 May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiV5VnUrknEwJKQM-WmDDXb2WufWDMrIUBPERVQo0MOrFG494HmHdgIu5jdLUtPa4_DBj5sq24NqkmSSt6MexXklLlGmt5CTgD8iXAEeAGP0tG9opX27ER-CIt0-AlckG2ItDlVMH5gqQmzk8JSj3q6SbbQAXv8Oz4tAeyuiI7B1mjck May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 3b2e8e3a4821406893ebe9c189311cbf May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1083505785 May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3b2e8e3a4821406893ebe9c189311cbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b2e8e3a4821406893ebe9c189311cbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3b2e8e3a4821406893ebe9c189311cbf", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b2e8e3a4821406893ebe9c189311cbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1083505785 May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 3b2e8e3a4821406893ebe9c189311cbf May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1083505785 May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-TestNetworkAdvancedServerOps-1083505785-project May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 3083c05994cd4f599a2def7fa1281d60 May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1083505785-project May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 could not be found. May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '9d0c42d1-f95b-455e-82e7-44bfe6033c19'} May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 could not be found. May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 could not be found. May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:53:21.370727 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:53:21.376145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:53:21.376145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:53:21.376145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:53:21.376145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:53:21.376145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:53:21.376145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:53:21.376145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 could not be found. May 21 21:53:21.376145 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:53:21.376145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e6a7db12-2eba-4ade-9f46-dd2a2d0919ef tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Returning 404 to user: Instance 9d0c42d1-f95b-455e-82e7-44bfe6033c19 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:53:21.376145 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e6a7db12-2eba-4ade-9f46-dd2a2d0919ef tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19" status: 404 len: 111 microversion: 2.1 time: 0.032662 May 21 21:53:21.376145 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3167/6210] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:21 2022] GET /compute/v2.1/servers/9d0c42d1-f95b-455e-82e7-44bfe6033c19 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:53:26.034755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-30827499-b651-4c91-8b6f-48e51997ce4c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '.version_select at 0x7fc81b9fcc10>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:26.107817 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-30827499-b651-4c91-8b6f-48e51997ce4c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1462823230" status: 202 len: 0 microversion: 2.1 time: 0.076959 May 21 21:53:26.108492 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3044/6211] 10.222.0.49 () {58 vars in 1283 bytes} [Sat May 21 21:53:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1462823230 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:53:26.145321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-db09bd9b-b0d1-4ac9-924f-3770a5095439 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'create', calling method: .version_select at 0x7fc81b3d1160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1842329667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1Yn7CppwWMSi+9XgmsVIswgxxOKbytu1J41dsZzOGBLnRIGZTu9+3RVGJwGzTvBG3LRnu4c0JmHLMddumJw8CLuIZ08wQbq42SSRBHVxPBT58lvwyWq6AutgcvqidDsA=="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:53:26.161187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-db09bd9b-b0d1-4ac9-924f-3770a5095439 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Getting quotas for project 3b2e8e3a4821406893ebe9c189311cbf. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:53:26.166546 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-db09bd9b-b0d1-4ac9-924f-3770a5095439 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Getting quotas for user 3083c05994cd4f599a2def7fa1281d60 and project 3b2e8e3a4821406893ebe9c189311cbf. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:53:26.250484 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-db09bd9b-b0d1-4ac9-924f-3770a5095439 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.108988 May 21 21:53:26.251732 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3168/6212] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:53:26 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:53:27.064274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a457aae1-e412-43c6-97ae-cb7a7a71c032 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:53:27.065241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a457aae1-e412-43c6-97ae-cb7a7a71c032 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:27.072855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a457aae1-e412-43c6-97ae-cb7a7a71c032 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:27.073373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a457aae1-e412-43c6-97ae-cb7a7a71c032 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:27.074151 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a457aae1-e412-43c6-97ae-cb7a7a71c032 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:27.074592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a457aae1-e412-43c6-97ae-cb7a7a71c032 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:27.078486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:53:27.127578 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a457aae1-e412-43c6-97ae-cb7a7a71c032 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "POST /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de/action" status: 200 len: 24562 microversion: 2.1 time: 0.068442 May 21 21:53:27.128243 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3045/6213] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:53:27 2022] POST /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de/action => generated 24562 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:53:33.646977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=45 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:53:33.656127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7a2e5d50-c9a4-46f6-a370-e9b6c8810009 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:53:33.657472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7a2e5d50-c9a4-46f6-a370-e9b6c8810009 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:33.664487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a2e5d50-c9a4-46f6-a370-e9b6c8810009 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:33.665230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a2e5d50-c9a4-46f6-a370-e9b6c8810009 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:33.669221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a2e5d50-c9a4-46f6-a370-e9b6c8810009 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:33.669934 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a2e5d50-c9a4-46f6-a370-e9b6c8810009 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:33.746031 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7a2e5d50-c9a4-46f6-a370-e9b6c8810009 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "POST /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de/action" status: 200 len: 32637 microversion: 2.1 time: 0.100625 May 21 21:53:33.747086 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3169/6214] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:53:33 2022] POST /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de/action => generated 32637 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:53:35.328774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-101e6389-dab0-43ca-9ef4-a37784041cbc tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:35.330207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-101e6389-dab0-43ca-9ef4-a37784041cbc tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:35.331106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-5b8b017c-db25-4bb8-ad1d-ae807470c17e req-35d5fafc-7c3f-42c0-a502-904bb767d381 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad955ecb-e75a-4004-930b-b1efcf1438de", "tag": "9701496f-20f3-4311-b9d5-292da983b209"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:53:35.342634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-101e6389-dab0-43ca-9ef4-a37784041cbc tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:35.343151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5b8b017c-db25-4bb8-ad1d-ae807470c17e req-35d5fafc-7c3f-42c0-a502-904bb767d381 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:35.343559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-101e6389-dab0-43ca-9ef4-a37784041cbc tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:35.344191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5b8b017c-db25-4bb8-ad1d-ae807470c17e req-35d5fafc-7c3f-42c0-a502-904bb767d381 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:35.344569 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-101e6389-dab0-43ca-9ef4-a37784041cbc tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:35.345129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-101e6389-dab0-43ca-9ef4-a37784041cbc tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:35.361437 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-5b8b017c-db25-4bb8-ad1d-ae807470c17e req-35d5fafc-7c3f-42c0-a502-904bb767d381 service nova] Creating event network-changed:9701496f-20f3-4311-b9d5-292da983b209 for instance ad955ecb-e75a-4004-930b-b1efcf1438de on nch1-master-1 May 21 21:53:35.367559 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-5b8b017c-db25-4bb8-ad1d-ae807470c17e req-35d5fafc-7c3f-42c0-a502-904bb767d381 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040832 May 21 21:53:35.368699 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3170/6215] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:53:35.383480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-101e6389-dab0-43ca-9ef4-a37784041cbc tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:53:35.940668 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-101e6389-dab0-43ca-9ef4-a37784041cbc tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de" status: 204 len: 0 microversion: 2.1 time: 0.616283 May 21 21:53:35.942251 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3046/6216] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:53:35 2022] DELETE /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de => generated 0 bytes in 620 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:53:35.952572 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2b21e3ba-1e96-4524-a45b-86eb245881f7 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:35.953305 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2b21e3ba-1e96-4524-a45b-86eb245881f7 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:35.971633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b21e3ba-1e96-4524-a45b-86eb245881f7 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:35.973579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b21e3ba-1e96-4524-a45b-86eb245881f7 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:35.973579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b21e3ba-1e96-4524-a45b-86eb245881f7 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:35.973579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b21e3ba-1e96-4524-a45b-86eb245881f7 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:36.148927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2b21e3ba-1e96-4524-a45b-86eb245881f7 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:36.157661 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2b21e3ba-1e96-4524-a45b-86eb245881f7 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de" status: 200 len: 1667 microversion: 2.1 time: 0.210481 May 21 21:53:36.158786 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3171/6217] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:35 2022] GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de => generated 1667 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:36.480918 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2ba691c8-997a-4a8b-b391-2bca15d9f595 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-481100354", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "18404f32-f97c-4b80-b023-ec0399d43a26"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1842329667", "security_groups": [{"name": "tempest-secgroup-smoke-223476205"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:53:36.637102 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-2ba691c8-997a-4a8b-b391-2bca15d9f595 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] validate_networks() for [('18404f32-f97c-4b80-b023-ec0399d43a26', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:53:37.178386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-50935461-4c90-441e-ad56-206a89efc981 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:37.180117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-50935461-4c90-441e-ad56-206a89efc981 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:37.204304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:53:37.212545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50935461-4c90-441e-ad56-206a89efc981 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:37.214842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50935461-4c90-441e-ad56-206a89efc981 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:37.223611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50935461-4c90-441e-ad56-206a89efc981 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:37.224753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-50935461-4c90-441e-ad56-206a89efc981 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:37.331306 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-2ba691c8-997a-4a8b-b391-2bca15d9f595 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:53:37.332030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-2ba691c8-997a-4a8b-b391-2bca15d9f595 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:53:37.332404 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-2ba691c8-997a-4a8b-b391-2bca15d9f595 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:53:37.333149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-2ba691c8-997a-4a8b-b391-2bca15d9f595 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:53:37.333798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-2ba691c8-997a-4a8b-b391-2bca15d9f595 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:53:37.349291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2ba691c8-997a-4a8b-b391-2bca15d9f595 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:37.350405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2ba691c8-997a-4a8b-b391-2bca15d9f595 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:37.352028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2ba691c8-997a-4a8b-b391-2bca15d9f595 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:37.353511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2ba691c8-997a-4a8b-b391-2bca15d9f595 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:37.406116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-2ba691c8-997a-4a8b-b391-2bca15d9f595 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Getting quotas for project 3b2e8e3a4821406893ebe9c189311cbf. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:53:37.431518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-2ba691c8-997a-4a8b-b391-2bca15d9f595 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Getting quotas for user 3083c05994cd4f599a2def7fa1281d60 and project 3b2e8e3a4821406893ebe9c189311cbf. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:53:37.457516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2ba691c8-997a-4a8b-b391-2bca15d9f595 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:53:37.460393 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2ba691c8-997a-4a8b-b391-2bca15d9f595 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:53:37.626729 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2ba691c8-997a-4a8b-b391-2bca15d9f595 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.151571 May 21 21:53:37.629241 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3047/6218] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:53:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 21 21:53:37.632432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-50935461-4c90-441e-ad56-206a89efc981 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:37.645471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cfdd00e6-c052-4b63-81b2-222b1bd03596 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:37.646112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cfdd00e6-c052-4b63-81b2-222b1bd03596 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:37.646903 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-50935461-4c90-441e-ad56-206a89efc981 tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de" status: 200 len: 1549 microversion: 2.1 time: 0.474704 May 21 21:53:37.652465 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3172/6219] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:37 2022] GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de => generated 1549 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:37.811295 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cfdd00e6-c052-4b63-81b2-222b1bd03596 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:37.821422 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cfdd00e6-c052-4b63-81b2-222b1bd03596 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1266 microversion: 2.1 time: 0.184411 May 21 21:53:37.831832 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3048/6220] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:37 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:53:38.453465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-70664266-3983-4387-a74e-eb5c34a7ce41 req-f152e85c-cefa-46b5-b392-afe581071ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad955ecb-e75a-4004-930b-b1efcf1438de", "name": "network-vif-deleted", "tag": "9701496f-20f3-4311-b9d5-292da983b209"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:53:38.466189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-70664266-3983-4387-a74e-eb5c34a7ce41 req-f152e85c-cefa-46b5-b392-afe581071ac8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:38.466842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-70664266-3983-4387-a74e-eb5c34a7ce41 req-f152e85c-cefa-46b5-b392-afe581071ac8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:38.481522 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-70664266-3983-4387-a74e-eb5c34a7ce41 req-f152e85c-cefa-46b5-b392-afe581071ac8 service nova] Creating event network-vif-deleted:9701496f-20f3-4311-b9d5-292da983b209 for instance ad955ecb-e75a-4004-930b-b1efcf1438de on nch1-master-1 May 21 21:53:38.488501 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-70664266-3983-4387-a74e-eb5c34a7ce41 req-f152e85c-cefa-46b5-b392-afe581071ac8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038927 May 21 21:53:38.492875 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3173/6221] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:53:38.667098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-660843fe-e743-4f2a-a372-9c8760aecbed tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:38.668353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-660843fe-e743-4f2a-a372-9c8760aecbed tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:38.683164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-660843fe-e743-4f2a-a372-9c8760aecbed tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:38.684239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-660843fe-e743-4f2a-a372-9c8760aecbed tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:38.686135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-660843fe-e743-4f2a-a372-9c8760aecbed tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:38.686750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-660843fe-e743-4f2a-a372-9c8760aecbed tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:38.787833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-660843fe-e743-4f2a-a372-9c8760aecbed tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3a4acfcf07489abcedb1616deb915a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d683aab56145779b2614a9a0606556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:38.796786 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-660843fe-e743-4f2a-a372-9c8760aecbed tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de" status: 200 len: 1332 microversion: 2.1 time: 0.133744 May 21 21:53:38.804783 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3049/6222] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:38 2022] GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de => generated 1332 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:38.840820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-22f36bb0-8cd3-49a4-ba98-ef3260ddd16a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:38.841618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-22f36bb0-8cd3-49a4-ba98-ef3260ddd16a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:38.849130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-22f36bb0-8cd3-49a4-ba98-ef3260ddd16a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:38.849899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-22f36bb0-8cd3-49a4-ba98-ef3260ddd16a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:38.850888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-22f36bb0-8cd3-49a4-ba98-ef3260ddd16a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:38.851503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-22f36bb0-8cd3-49a4-ba98-ef3260ddd16a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:38.951585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-22f36bb0-8cd3-49a4-ba98-ef3260ddd16a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:38.960672 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-22f36bb0-8cd3-49a4-ba98-ef3260ddd16a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1270 microversion: 2.1 time: 0.125259 May 21 21:53:38.961250 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3174/6223] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:38 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1270 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:39.815218 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-30bb4c9f-b404-4c68-901b-20ce8027ee8e tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:39.815973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-30bb4c9f-b404-4c68-901b-20ce8027ee8e tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] [instance: ad955ecb-e75a-4004-930b-b1efcf1438de] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:39.825764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30bb4c9f-b404-4c68-901b-20ce8027ee8e tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:39.825764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30bb4c9f-b404-4c68-901b-20ce8027ee8e tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:39.825764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30bb4c9f-b404-4c68-901b-20ce8027ee8e tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:39.826229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30bb4c9f-b404-4c68-901b-20ce8027ee8e tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:39.841838 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-30bb4c9f-b404-4c68-901b-20ce8027ee8e tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] HTTP exception thrown: Instance ad955ecb-e75a-4004-930b-b1efcf1438de could not be found. May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-30bb4c9f-b404-4c68-901b-20ce8027ee8e tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Request method failure captured: May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de HTTP/1.1 May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiV6eBGC5NjaU07rrjOKlxC4YjyI18nt0gDCJ8uUBeHfO5bxMHzm1aSFNe_jNeXQ9qVDU-aWKqChu0VBk59DD9SMjsmqbruEmv5vnwm-VLvpjheXQj5yaeEbVSe45b2X-kvU8fngop8BhGDsCUsgOtiZ5MZc8WugjsDzQ9aRTG_4c_EY May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 31d683aab56145779b2614a9a0606556 May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestNetworkBasicOps-1443976949 May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/31d683aab56145779b2614a9a0606556"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/31d683aab56145779b2614a9a0606556"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_31d683aab56145779b2614a9a0606556", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/31d683aab56145779b2614a9a0606556"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestNetworkBasicOps-1443976949 May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 31d683aab56145779b2614a9a0606556 May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestNetworkBasicOps-1443976949 May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestNetworkBasicOps-1443976949-project May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1f3a4acfcf07489abcedb1616deb915a May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestNetworkBasicOps-1443976949-project May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance ad955ecb-e75a-4004-930b-b1efcf1438de could not be found. May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'ad955ecb-e75a-4004-930b-b1efcf1438de'} May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad955ecb-e75a-4004-930b-b1efcf1438de could not be found. May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad955ecb-e75a-4004-930b-b1efcf1438de could not be found. May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:53:39.843686 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:53:39.853487 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:53:39.853487 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:53:39.853487 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:53:39.853487 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:53:39.853487 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:53:39.853487 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad955ecb-e75a-4004-930b-b1efcf1438de could not be found. May 21 21:53:39.853487 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:53:39.853487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-30bb4c9f-b404-4c68-901b-20ce8027ee8e tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Returning 404 to user: Instance ad955ecb-e75a-4004-930b-b1efcf1438de could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:53:39.853487 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-30bb4c9f-b404-4c68-901b-20ce8027ee8e tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de" status: 404 len: 111 microversion: 2.1 time: 0.034778 May 21 21:53:39.853487 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3050/6224] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:39 2022] GET /compute/v2.1/servers/ad955ecb-e75a-4004-930b-b1efcf1438de => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:53:39.979740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9d3ad618-9eb3-4528-9eb5-c1d38e4aff12 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:39.980406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9d3ad618-9eb3-4528-9eb5-c1d38e4aff12 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:39.989428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d3ad618-9eb3-4528-9eb5-c1d38e4aff12 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:39.989895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d3ad618-9eb3-4528-9eb5-c1d38e4aff12 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:39.990691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d3ad618-9eb3-4528-9eb5-c1d38e4aff12 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:39.991140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9d3ad618-9eb3-4528-9eb5-c1d38e4aff12 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:40.095864 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9d3ad618-9eb3-4528-9eb5-c1d38e4aff12 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:40.104095 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9d3ad618-9eb3-4528-9eb5-c1d38e4aff12 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1326 microversion: 2.1 time: 0.129179 May 21 21:53:40.104711 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3175/6225] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:39 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1326 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:40.227761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6ab9f890-8541-4a3f-a7ed-0bfe80381e3b tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] Calling method '.version_select at 0x7fc82d19b940>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:40.336307 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6ab9f890-8541-4a3f-a7ed-0bfe80381e3b tempest-TestNetworkBasicOps-1443976949 tempest-TestNetworkBasicOps-1443976949-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-717710223" status: 202 len: 0 microversion: 2.1 time: 0.112802 May 21 21:53:40.341509 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3051/6226] 10.222.0.49 () {58 vars in 1253 bytes} [Sat May 21 21:53:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-717710223 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:53:41.122920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-67b8979d-f873-463f-838c-6e22f2e05798 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:41.124188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-67b8979d-f873-463f-838c-6e22f2e05798 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:41.134541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67b8979d-f873-463f-838c-6e22f2e05798 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:41.135152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67b8979d-f873-463f-838c-6e22f2e05798 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:41.138015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67b8979d-f873-463f-838c-6e22f2e05798 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:41.138015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67b8979d-f873-463f-838c-6e22f2e05798 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:41.402092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-67b8979d-f873-463f-838c-6e22f2e05798 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:41.414456 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-67b8979d-f873-463f-838c-6e22f2e05798 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1391 microversion: 2.1 time: 0.296313 May 21 21:53:41.416815 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3176/6227] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:41 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1391 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:42.326423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-07c77c1d-8057-4cfe-ae2a-bc8ae64a42c1 req-153f7a34-1ba5-4e71-9ed1-929ffd9c0cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f48be87d-208e-484a-8591-b14774f67e28", "tag": "0ece9faa-b2d4-4d55-af66-0a77cceed3b6"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:53:42.344170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-07c77c1d-8057-4cfe-ae2a-bc8ae64a42c1 req-153f7a34-1ba5-4e71-9ed1-929ffd9c0cdd service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:42.344170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-07c77c1d-8057-4cfe-ae2a-bc8ae64a42c1 req-153f7a34-1ba5-4e71-9ed1-929ffd9c0cdd service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:42.355828 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-07c77c1d-8057-4cfe-ae2a-bc8ae64a42c1 req-153f7a34-1ba5-4e71-9ed1-929ffd9c0cdd service nova] Creating event network-changed:0ece9faa-b2d4-4d55-af66-0a77cceed3b6 for instance f48be87d-208e-484a-8591-b14774f67e28 on nch1-master-1 May 21 21:53:42.367967 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-07c77c1d-8057-4cfe-ae2a-bc8ae64a42c1 req-153f7a34-1ba5-4e71-9ed1-929ffd9c0cdd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047485 May 21 21:53:42.369908 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3052/6228] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:53:42.437352 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8bed72fd-7d47-48a0-97c2-1518f3d2e129 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:42.438953 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8bed72fd-7d47-48a0-97c2-1518f3d2e129 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:42.451196 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8bed72fd-7d47-48a0-97c2-1518f3d2e129 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:42.452030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8bed72fd-7d47-48a0-97c2-1518f3d2e129 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:42.453536 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8bed72fd-7d47-48a0-97c2-1518f3d2e129 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:42.455019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8bed72fd-7d47-48a0-97c2-1518f3d2e129 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:43.132348 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8bed72fd-7d47-48a0-97c2-1518f3d2e129 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:43.142149 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8bed72fd-7d47-48a0-97c2-1518f3d2e129 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1391 microversion: 2.1 time: 0.712522 May 21 21:53:43.149323 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3177/6229] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:42 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1391 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:44.167752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9b70aee3-277c-48c4-8677-feda9874c67b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:44.168590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9b70aee3-277c-48c4-8677-feda9874c67b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:44.175043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9b70aee3-277c-48c4-8677-feda9874c67b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:44.175508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9b70aee3-277c-48c4-8677-feda9874c67b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:44.176306 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9b70aee3-277c-48c4-8677-feda9874c67b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:44.176771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9b70aee3-277c-48c4-8677-feda9874c67b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:44.341641 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9b70aee3-277c-48c4-8677-feda9874c67b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:44.350336 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9b70aee3-277c-48c4-8677-feda9874c67b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1391 microversion: 2.1 time: 0.187640 May 21 21:53:44.352327 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3053/6230] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:44 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1391 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:45.367532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-46f570cd-1db1-4f0e-a3c1-98f3ea1530ba tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:45.368170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-46f570cd-1db1-4f0e-a3c1-98f3ea1530ba tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:45.375424 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46f570cd-1db1-4f0e-a3c1-98f3ea1530ba tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:45.375832 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46f570cd-1db1-4f0e-a3c1-98f3ea1530ba tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:45.376709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46f570cd-1db1-4f0e-a3c1-98f3ea1530ba tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:45.377302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46f570cd-1db1-4f0e-a3c1-98f3ea1530ba tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:45.603088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-46f570cd-1db1-4f0e-a3c1-98f3ea1530ba tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:45.611419 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-46f570cd-1db1-4f0e-a3c1-98f3ea1530ba tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1391 microversion: 2.1 time: 0.247993 May 21 21:53:45.612013 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3178/6231] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:45 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1391 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:46.630031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b962700f-8a7f-4c95-88cf-7437e2045ca9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:46.630757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b962700f-8a7f-4c95-88cf-7437e2045ca9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:46.639372 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b962700f-8a7f-4c95-88cf-7437e2045ca9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:46.639830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b962700f-8a7f-4c95-88cf-7437e2045ca9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:46.640667 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b962700f-8a7f-4c95-88cf-7437e2045ca9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:46.641114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b962700f-8a7f-4c95-88cf-7437e2045ca9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:46.805579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b962700f-8a7f-4c95-88cf-7437e2045ca9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:46.813856 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b962700f-8a7f-4c95-88cf-7437e2045ca9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1391 microversion: 2.1 time: 0.188140 May 21 21:53:46.814435 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3054/6232] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:46 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1391 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:47.831487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-02aec6a4-8e17-4a2f-b917-d27316868101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:47.832113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-02aec6a4-8e17-4a2f-b917-d27316868101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:47.835121 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:53:47.840647 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02aec6a4-8e17-4a2f-b917-d27316868101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:47.841125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02aec6a4-8e17-4a2f-b917-d27316868101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:47.841923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02aec6a4-8e17-4a2f-b917-d27316868101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:47.842380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-02aec6a4-8e17-4a2f-b917-d27316868101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:47.996624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-02aec6a4-8e17-4a2f-b917-d27316868101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:48.004344 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-02aec6a4-8e17-4a2f-b917-d27316868101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1391 microversion: 2.1 time: 0.176718 May 21 21:53:48.004913 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3179/6233] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:47 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:49.024634 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d4eb9600-547d-4e6a-8736-f3d6e1bcf444 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:49.035921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d4eb9600-547d-4e6a-8736-f3d6e1bcf444 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:49.035921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:53:49.035921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=8 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:53:49.035921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:53:49.036854 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d4eb9600-547d-4e6a-8736-f3d6e1bcf444 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:49.037442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d4eb9600-547d-4e6a-8736-f3d6e1bcf444 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:49.038382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d4eb9600-547d-4e6a-8736-f3d6e1bcf444 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:49.038830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d4eb9600-547d-4e6a-8736-f3d6e1bcf444 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:49.199212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d4eb9600-547d-4e6a-8736-f3d6e1bcf444 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:49.207542 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d4eb9600-547d-4e6a-8736-f3d6e1bcf444 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1391 microversion: 2.1 time: 0.189984 May 21 21:53:49.208113 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3055/6234] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:49 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1391 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:49.613581 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2a657012-3ae8-4edd-ac49-b032c15f1e02 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Action: 'create', calling method: .version_select at 0x7fc81aac49d0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1701115888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQPyiwonsADGYwbBRzYUt0sPlIZMxKTJZgDur2pamlKCWwN9f0Daw9QkMql/HXvhrw0CaRWDyBudN+ehjKZs7tjVgi0+ClKtZr3Y74Yu5BBCu9egsvGf0Ifm+5e4aAXhg=="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:53:49.628770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-2a657012-3ae8-4edd-ac49-b032c15f1e02 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Getting quotas for project d5756d4186354028bcff9c66712f5c33. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:53:49.634967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-2a657012-3ae8-4edd-ac49-b032c15f1e02 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Getting quotas for user eff8b9d9ac8a487fa0ccc0a37def90ac and project d5756d4186354028bcff9c66712f5c33. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:53:49.736397 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2a657012-3ae8-4edd-ac49-b032c15f1e02 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.293374 May 21 21:53:49.737038 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3180/6235] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:53:49 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:53:50.226186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6417fe1a-a378-4e6d-913b-5acda444b5d7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:50.226938 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6417fe1a-a378-4e6d-913b-5acda444b5d7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:50.236871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6417fe1a-a378-4e6d-913b-5acda444b5d7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:50.237328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6417fe1a-a378-4e6d-913b-5acda444b5d7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:50.238113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6417fe1a-a378-4e6d-913b-5acda444b5d7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:50.238567 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6417fe1a-a378-4e6d-913b-5acda444b5d7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:50.428041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6417fe1a-a378-4e6d-913b-5acda444b5d7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:50.436708 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6417fe1a-a378-4e6d-913b-5acda444b5d7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1391 microversion: 2.1 time: 0.215523 May 21 21:53:50.437300 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3056/6236] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:50 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1391 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:50.632302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-88288fbb-9eff-4a25-9d82-cb89bf4b4815 req-06af37bd-9f6a-467b-b478-7ddd72ff7e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48be87d-208e-484a-8591-b14774f67e28", "name": "network-vif-plugged", "status": "completed", "tag": "0ece9faa-b2d4-4d55-af66-0a77cceed3b6"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:53:50.640682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-88288fbb-9eff-4a25-9d82-cb89bf4b4815 req-06af37bd-9f6a-467b-b478-7ddd72ff7e16 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:50.641167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-88288fbb-9eff-4a25-9d82-cb89bf4b4815 req-06af37bd-9f6a-467b-b478-7ddd72ff7e16 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:50.652303 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-88288fbb-9eff-4a25-9d82-cb89bf4b4815 req-06af37bd-9f6a-467b-b478-7ddd72ff7e16 service nova] Creating event network-vif-plugged:0ece9faa-b2d4-4d55-af66-0a77cceed3b6 for instance f48be87d-208e-484a-8591-b14774f67e28 on nch1-master-1 May 21 21:53:50.657302 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-88288fbb-9eff-4a25-9d82-cb89bf4b4815 req-06af37bd-9f6a-467b-b478-7ddd72ff7e16 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029646 May 21 21:53:50.657920 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3181/6237] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:53:51.453821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-92134051-de27-4515-8881-8e6ca235fa45 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:51.455044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-92134051-de27-4515-8881-8e6ca235fa45 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:51.463560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-92134051-de27-4515-8881-8e6ca235fa45 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:51.467540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-92134051-de27-4515-8881-8e6ca235fa45 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:51.467540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-92134051-de27-4515-8881-8e6ca235fa45 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:51.467540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-92134051-de27-4515-8881-8e6ca235fa45 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:51.618855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-92134051-de27-4515-8881-8e6ca235fa45 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:51.627101 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-92134051-de27-4515-8881-8e6ca235fa45 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1391 microversion: 2.1 time: 0.177368 May 21 21:53:51.627766 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3057/6238] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:51 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:52.645729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7059e42a-f4c5-485e-949a-88b17e887250 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:52.646516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7059e42a-f4c5-485e-949a-88b17e887250 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:52.653300 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7059e42a-f4c5-485e-949a-88b17e887250 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:52.653780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7059e42a-f4c5-485e-949a-88b17e887250 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:52.654609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7059e42a-f4c5-485e-949a-88b17e887250 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:52.655073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7059e42a-f4c5-485e-949a-88b17e887250 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:52.826571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7059e42a-f4c5-485e-949a-88b17e887250 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:52.834922 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7059e42a-f4c5-485e-949a-88b17e887250 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1562 microversion: 2.1 time: 0.194446 May 21 21:53:52.835515 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3182/6239] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:52 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1562 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:52.851854 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6bd05926-b016-4629-81c1-9e894d73428c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:52.854045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6bd05926-b016-4629-81c1-9e894d73428c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:52.860907 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6bd05926-b016-4629-81c1-9e894d73428c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:52.861374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6bd05926-b016-4629-81c1-9e894d73428c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:52.862168 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6bd05926-b016-4629-81c1-9e894d73428c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:52.862754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6bd05926-b016-4629-81c1-9e894d73428c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:53.086232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6bd05926-b016-4629-81c1-9e894d73428c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:53.099117 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6bd05926-b016-4629-81c1-9e894d73428c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1562 microversion: 2.1 time: 0.251183 May 21 21:53:53.099714 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3058/6240] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:52 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1562 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:53:56.312772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-924fe3a2-e647-4137-8f9f-d50352612b64 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:53:56.318389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-924fe3a2-e647-4137-8f9f-d50352612b64 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:53:56.326337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-924fe3a2-e647-4137-8f9f-d50352612b64 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:56.327230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-924fe3a2-e647-4137-8f9f-d50352612b64 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:56.329323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-924fe3a2-e647-4137-8f9f-d50352612b64 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:56.330012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-924fe3a2-e647-4137-8f9f-d50352612b64 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:56.445667 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-f38fa33f-4aab-4d46-8480-22fa17f7655e req-6c807f24-5699-4c60-b2a0-d3aa64344f79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f48be87d-208e-484a-8591-b14774f67e28", "tag": "0ece9faa-b2d4-4d55-af66-0a77cceed3b6"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:53:56.485612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f38fa33f-4aab-4d46-8480-22fa17f7655e req-6c807f24-5699-4c60-b2a0-d3aa64344f79 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:56.494875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f38fa33f-4aab-4d46-8480-22fa17f7655e req-6c807f24-5699-4c60-b2a0-d3aa64344f79 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:56.506978 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-f38fa33f-4aab-4d46-8480-22fa17f7655e req-6c807f24-5699-4c60-b2a0-d3aa64344f79 service nova] Creating event network-changed:0ece9faa-b2d4-4d55-af66-0a77cceed3b6 for instance f48be87d-208e-484a-8591-b14774f67e28 on nch1-master-1 May 21 21:53:56.520399 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-f38fa33f-4aab-4d46-8480-22fa17f7655e req-6c807f24-5699-4c60-b2a0-d3aa64344f79 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203867 May 21 21:53:56.521386 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3059/6241] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:53:56.789473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-924fe3a2-e647-4137-8f9f-d50352612b64 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:53:56.807888 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-924fe3a2-e647-4137-8f9f-d50352612b64 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1562 microversion: 2.1 time: 0.498433 May 21 21:53:56.821694 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3183/6242] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:53:56 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1562 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:53:59.254521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8c448dd1-7e7f-4fb6-923a-f709093103f8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1840850631-access_point-680484791", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "34f9728d-0faa-4ff5-9513-4f63d6072291"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1701115888", "security_groups": [{"name": "tempest-secgroup_access--911690128"}, {"name": "tempest-secgroup_general--274356060"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:53:59.441488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-8c448dd1-7e7f-4fb6-923a-f709093103f8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] validate_networks() for [('34f9728d-0faa-4ff5-9513-4f63d6072291', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:53:59.960849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-8c448dd1-7e7f-4fb6-923a-f709093103f8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:53:59.961413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-8c448dd1-7e7f-4fb6-923a-f709093103f8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:53:59.961955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-8c448dd1-7e7f-4fb6-923a-f709093103f8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:53:59.962373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-8c448dd1-7e7f-4fb6-923a-f709093103f8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:53:59.962822 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-8c448dd1-7e7f-4fb6-923a-f709093103f8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:53:59.986870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c448dd1-7e7f-4fb6-923a-f709093103f8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:59.987339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c448dd1-7e7f-4fb6-923a-f709093103f8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:53:59.988170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c448dd1-7e7f-4fb6-923a-f709093103f8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:53:59.988639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c448dd1-7e7f-4fb6-923a-f709093103f8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:00.009187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-8c448dd1-7e7f-4fb6-923a-f709093103f8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Getting quotas for project d5756d4186354028bcff9c66712f5c33. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:54:00.015091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-8c448dd1-7e7f-4fb6-923a-f709093103f8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Getting quotas for user eff8b9d9ac8a487fa0ccc0a37def90ac and project d5756d4186354028bcff9c66712f5c33. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:54:00.031457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8c448dd1-7e7f-4fb6-923a-f709093103f8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:54:00.031457 ncdv-master-1 devstack@n-api.service[131278]: WARNING nova.utils [None req-8c448dd1-7e7f-4fb6-923a-f709093103f8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1840850631-access_point-680484791 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1840850631-ac May 21 21:54:00.031747 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8c448dd1-7e7f-4fb6-923a-f709093103f8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 00720d70-9f60-4833-898c-7fa8d5ecdc70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:54:00.177788 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8c448dd1-7e7f-4fb6-923a-f709093103f8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 0.929059 May 21 21:54:00.178716 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3060/6243] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:53:59 2022] POST /compute/v2.1/servers => generated 456 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:54:00.191476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0b57f887-7beb-48ee-8d47-cb95db11d65f tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:00.194623 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0b57f887-7beb-48ee-8d47-cb95db11d65f tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 00720d70-9f60-4833-898c-7fa8d5ecdc70] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:00.199190 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:54:00.261508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0b57f887-7beb-48ee-8d47-cb95db11d65f tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:00.270495 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0b57f887-7beb-48ee-8d47-cb95db11d65f tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70" status: 200 len: 1294 microversion: 2.1 time: 0.084014 May 21 21:54:00.271120 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3184/6244] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:00 2022] GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70 => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:01.289082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bb6aeceb-a9c6-49cf-9509-759ed674d01a tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:01.290537 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bb6aeceb-a9c6-49cf-9509-759ed674d01a tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 00720d70-9f60-4833-898c-7fa8d5ecdc70] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:01.359891 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bb6aeceb-a9c6-49cf-9509-759ed674d01a tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:01.366991 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bb6aeceb-a9c6-49cf-9509-759ed674d01a tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70" status: 200 len: 1294 microversion: 2.1 time: 0.083854 May 21 21:54:01.368095 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3061/6245] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:01 2022] GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70 => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:02.385731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-39d71293-c0ab-4398-ba21-f4e921da4ab4 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:02.386372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-39d71293-c0ab-4398-ba21-f4e921da4ab4 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 00720d70-9f60-4833-898c-7fa8d5ecdc70] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:02.394078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39d71293-c0ab-4398-ba21-f4e921da4ab4 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:02.394545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39d71293-c0ab-4398-ba21-f4e921da4ab4 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:02.395326 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39d71293-c0ab-4398-ba21-f4e921da4ab4 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:02.395775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39d71293-c0ab-4398-ba21-f4e921da4ab4 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:02.468562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-39d71293-c0ab-4398-ba21-f4e921da4ab4 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:02.476386 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-39d71293-c0ab-4398-ba21-f4e921da4ab4 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70" status: 200 len: 1346 microversion: 2.1 time: 0.095124 May 21 21:54:02.476965 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3185/6246] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:02 2022] GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70 => generated 1346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:03.496554 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-72adbc3a-a25f-45cd-a92c-4e53d55bffd5 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:03.506446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-72adbc3a-a25f-45cd-a92c-4e53d55bffd5 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 00720d70-9f60-4833-898c-7fa8d5ecdc70] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:03.512739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72adbc3a-a25f-45cd-a92c-4e53d55bffd5 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:03.513193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72adbc3a-a25f-45cd-a92c-4e53d55bffd5 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:03.514197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72adbc3a-a25f-45cd-a92c-4e53d55bffd5 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:03.514648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72adbc3a-a25f-45cd-a92c-4e53d55bffd5 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:03.750040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-72adbc3a-a25f-45cd-a92c-4e53d55bffd5 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:03.758259 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-72adbc3a-a25f-45cd-a92c-4e53d55bffd5 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70" status: 200 len: 1470 microversion: 2.1 time: 0.268678 May 21 21:54:03.758853 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3062/6247] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:03 2022] GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70 => generated 1470 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:04.672196 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-33c38482-eba4-4dce-a146-11e49925a73a req-832a6251-0eba-49f2-a6bf-8b2f1dbf6b16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00720d70-9f60-4833-898c-7fa8d5ecdc70", "tag": "1eb2ca65-79b7-4006-bb0e-1a0e8f150851"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:54:04.688368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-33c38482-eba4-4dce-a146-11e49925a73a req-832a6251-0eba-49f2-a6bf-8b2f1dbf6b16 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:04.688368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-33c38482-eba4-4dce-a146-11e49925a73a req-832a6251-0eba-49f2-a6bf-8b2f1dbf6b16 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:04.700114 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-33c38482-eba4-4dce-a146-11e49925a73a req-832a6251-0eba-49f2-a6bf-8b2f1dbf6b16 service nova] Creating event network-changed:1eb2ca65-79b7-4006-bb0e-1a0e8f150851 for instance 00720d70-9f60-4833-898c-7fa8d5ecdc70 on nch2-master-1 May 21 21:54:04.705484 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-33c38482-eba4-4dce-a146-11e49925a73a req-832a6251-0eba-49f2-a6bf-8b2f1dbf6b16 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044218 May 21 21:54:04.706100 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3186/6248] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:54:04.781593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f35c0e4f-9bcd-4141-a80a-6cee638dc063 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:04.785971 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f35c0e4f-9bcd-4141-a80a-6cee638dc063 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 00720d70-9f60-4833-898c-7fa8d5ecdc70] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:04.789726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f35c0e4f-9bcd-4141-a80a-6cee638dc063 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:04.790793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f35c0e4f-9bcd-4141-a80a-6cee638dc063 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:04.791913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f35c0e4f-9bcd-4141-a80a-6cee638dc063 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:04.792398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f35c0e4f-9bcd-4141-a80a-6cee638dc063 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:05.099879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f35c0e4f-9bcd-4141-a80a-6cee638dc063 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:05.107974 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f35c0e4f-9bcd-4141-a80a-6cee638dc063 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70" status: 200 len: 1470 microversion: 2.1 time: 0.331404 May 21 21:54:05.108607 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3063/6249] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:04 2022] GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70 => generated 1470 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:06.126604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-96479a44-7267-4b39-94a8-5f0ca896dcb2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:06.127333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-96479a44-7267-4b39-94a8-5f0ca896dcb2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 00720d70-9f60-4833-898c-7fa8d5ecdc70] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:06.133760 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96479a44-7267-4b39-94a8-5f0ca896dcb2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:06.135294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96479a44-7267-4b39-94a8-5f0ca896dcb2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:06.136085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96479a44-7267-4b39-94a8-5f0ca896dcb2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:06.136570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96479a44-7267-4b39-94a8-5f0ca896dcb2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:06.139304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=79 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:54:06.299848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-96479a44-7267-4b39-94a8-5f0ca896dcb2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:06.308559 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-96479a44-7267-4b39-94a8-5f0ca896dcb2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70" status: 200 len: 1470 microversion: 2.1 time: 0.187042 May 21 21:54:06.309150 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3187/6250] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:06 2022] GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70 => generated 1470 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:07.326809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bd3ec750-4e9d-4436-abfb-430576730d2a tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:07.327349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bd3ec750-4e9d-4436-abfb-430576730d2a tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 00720d70-9f60-4833-898c-7fa8d5ecdc70] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:07.334803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bd3ec750-4e9d-4436-abfb-430576730d2a tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:07.335268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bd3ec750-4e9d-4436-abfb-430576730d2a tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:07.336078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bd3ec750-4e9d-4436-abfb-430576730d2a tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:07.336565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bd3ec750-4e9d-4436-abfb-430576730d2a tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:07.342553 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:54:07.509392 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bd3ec750-4e9d-4436-abfb-430576730d2a tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:07.517163 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bd3ec750-4e9d-4436-abfb-430576730d2a tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70" status: 200 len: 1470 microversion: 2.1 time: 0.195312 May 21 21:54:07.517752 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3064/6251] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:07 2022] GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70 => generated 1470 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:08.534195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-622436b2-652c-4948-953d-11c72550de6e tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:08.534728 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-622436b2-652c-4948-953d-11c72550de6e tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 00720d70-9f60-4833-898c-7fa8d5ecdc70] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:08.542679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-622436b2-652c-4948-953d-11c72550de6e tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:08.543143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-622436b2-652c-4948-953d-11c72550de6e tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:08.543926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-622436b2-652c-4948-953d-11c72550de6e tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:08.544411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-622436b2-652c-4948-953d-11c72550de6e tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:08.707173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-622436b2-652c-4948-953d-11c72550de6e tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:08.715923 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-622436b2-652c-4948-953d-11c72550de6e tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70" status: 200 len: 1470 microversion: 2.1 time: 0.185628 May 21 21:54:08.716383 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3188/6252] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:08 2022] GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70 => generated 1470 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:09.733310 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-df2d3717-cd4f-4ffe-99c6-c577b7f6ffab tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:09.733942 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-df2d3717-cd4f-4ffe-99c6-c577b7f6ffab tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 00720d70-9f60-4833-898c-7fa8d5ecdc70] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:09.741336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df2d3717-cd4f-4ffe-99c6-c577b7f6ffab tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:09.741795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df2d3717-cd4f-4ffe-99c6-c577b7f6ffab tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:09.742749 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df2d3717-cd4f-4ffe-99c6-c577b7f6ffab tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:09.743213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df2d3717-cd4f-4ffe-99c6-c577b7f6ffab tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:09.859308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-9827947d-1446-4c05-a3da-1cee6cd30e7e req-24ab6336-68b1-4e68-bb0a-9c72a202e5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00720d70-9f60-4833-898c-7fa8d5ecdc70", "name": "network-vif-plugged", "status": "completed", "tag": "1eb2ca65-79b7-4006-bb0e-1a0e8f150851"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:54:09.870386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-9827947d-1446-4c05-a3da-1cee6cd30e7e req-24ab6336-68b1-4e68-bb0a-9c72a202e5d6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:09.870852 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-9827947d-1446-4c05-a3da-1cee6cd30e7e req-24ab6336-68b1-4e68-bb0a-9c72a202e5d6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:09.882648 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-9827947d-1446-4c05-a3da-1cee6cd30e7e req-24ab6336-68b1-4e68-bb0a-9c72a202e5d6 service nova] Creating event network-vif-plugged:1eb2ca65-79b7-4006-bb0e-1a0e8f150851 for instance 00720d70-9f60-4833-898c-7fa8d5ecdc70 on nch2-master-1 May 21 21:54:09.888373 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-9827947d-1446-4c05-a3da-1cee6cd30e7e req-24ab6336-68b1-4e68-bb0a-9c72a202e5d6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033527 May 21 21:54:09.888989 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3189/6253] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:54:09.906876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-df2d3717-cd4f-4ffe-99c6-c577b7f6ffab tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:09.916642 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-df2d3717-cd4f-4ffe-99c6-c577b7f6ffab tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70" status: 200 len: 1470 microversion: 2.1 time: 0.187976 May 21 21:54:09.917243 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3065/6254] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:09 2022] GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70 => generated 1470 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:54:10.934080 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ae5e1053-9773-4c25-96c0-97ce95980696 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:10.934786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ae5e1053-9773-4c25-96c0-97ce95980696 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 00720d70-9f60-4833-898c-7fa8d5ecdc70] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:10.937107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:54:10.943392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ae5e1053-9773-4c25-96c0-97ce95980696 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:10.943776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ae5e1053-9773-4c25-96c0-97ce95980696 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:10.944574 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ae5e1053-9773-4c25-96c0-97ce95980696 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:10.945023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ae5e1053-9773-4c25-96c0-97ce95980696 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:11.114616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ae5e1053-9773-4c25-96c0-97ce95980696 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:11.122955 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ae5e1053-9773-4c25-96c0-97ce95980696 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70" status: 200 len: 1470 microversion: 2.1 time: 0.193698 May 21 21:54:11.123543 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3190/6255] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:10 2022] GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70 => generated 1470 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:12.139784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-714c25e9-95ce-453b-b266-b6f2342a4a1d tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:12.140437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-714c25e9-95ce-453b-b266-b6f2342a4a1d tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 00720d70-9f60-4833-898c-7fa8d5ecdc70] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:12.142359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:54:12.143863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=8 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:54:12.148914 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-714c25e9-95ce-453b-b266-b6f2342a4a1d tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:12.149418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-714c25e9-95ce-453b-b266-b6f2342a4a1d tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:12.150308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-714c25e9-95ce-453b-b266-b6f2342a4a1d tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:12.150751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-714c25e9-95ce-453b-b266-b6f2342a4a1d tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:12.315673 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-714c25e9-95ce-453b-b266-b6f2342a4a1d tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:12.324511 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-714c25e9-95ce-453b-b266-b6f2342a4a1d tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70" status: 200 len: 1642 microversion: 2.1 time: 0.188524 May 21 21:54:12.325105 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3066/6256] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:12 2022] GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70 => generated 1642 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:12.344943 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6ee32a5b-057b-4cee-b358-660dc36b2066 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:12.345576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6ee32a5b-057b-4cee-b358-660dc36b2066 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 00720d70-9f60-4833-898c-7fa8d5ecdc70] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:12.353321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ee32a5b-057b-4cee-b358-660dc36b2066 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:12.353784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ee32a5b-057b-4cee-b358-660dc36b2066 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:12.354570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ee32a5b-057b-4cee-b358-660dc36b2066 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:12.355029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ee32a5b-057b-4cee-b358-660dc36b2066 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:12.520700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6ee32a5b-057b-4cee-b358-660dc36b2066 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:12.529103 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6ee32a5b-057b-4cee-b358-660dc36b2066 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70" status: 200 len: 1642 microversion: 2.1 time: 0.188127 May 21 21:54:12.529684 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3191/6257] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:12 2022] GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70 => generated 1642 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:12.545860 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-782f2079-8006-490b-a8a0-a1c818ac6f1c tempest-TestSecurityGroupsBasicOps-1465440884 tempest-TestSecurityGroupsBasicOps-1465440884-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:12.547313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-782f2079-8006-490b-a8a0-a1c818ac6f1c tempest-TestSecurityGroupsBasicOps-1465440884 tempest-TestSecurityGroupsBasicOps-1465440884-project-admin] [instance: 00720d70-9f60-4833-898c-7fa8d5ecdc70] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:12.552734 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-782f2079-8006-490b-a8a0-a1c818ac6f1c tempest-TestSecurityGroupsBasicOps-1465440884 tempest-TestSecurityGroupsBasicOps-1465440884-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:12.553183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-782f2079-8006-490b-a8a0-a1c818ac6f1c tempest-TestSecurityGroupsBasicOps-1465440884 tempest-TestSecurityGroupsBasicOps-1465440884-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:12.553947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-782f2079-8006-490b-a8a0-a1c818ac6f1c tempest-TestSecurityGroupsBasicOps-1465440884 tempest-TestSecurityGroupsBasicOps-1465440884-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:12.554387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-782f2079-8006-490b-a8a0-a1c818ac6f1c tempest-TestSecurityGroupsBasicOps-1465440884 tempest-TestSecurityGroupsBasicOps-1465440884-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:12.898149 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-782f2079-8006-490b-a8a0-a1c818ac6f1c tempest-TestSecurityGroupsBasicOps-1465440884 tempest-TestSecurityGroupsBasicOps-1465440884-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70" status: 200 len: 1793 microversion: 2.1 time: 0.355958 May 21 21:54:12.898736 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3067/6258] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:12 2022] GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70 => generated 1793 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:15.522948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-640bde95-4670-4f0e-bd5e-87376c6f4869 req-e1521d54-e0de-411f-8fe9-6558d91e1b8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00720d70-9f60-4833-898c-7fa8d5ecdc70", "tag": "1eb2ca65-79b7-4006-bb0e-1a0e8f150851"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:54:15.533505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-640bde95-4670-4f0e-bd5e-87376c6f4869 req-e1521d54-e0de-411f-8fe9-6558d91e1b8e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:15.534309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-640bde95-4670-4f0e-bd5e-87376c6f4869 req-e1521d54-e0de-411f-8fe9-6558d91e1b8e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:15.547847 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-640bde95-4670-4f0e-bd5e-87376c6f4869 req-e1521d54-e0de-411f-8fe9-6558d91e1b8e service nova] Creating event network-changed:1eb2ca65-79b7-4006-bb0e-1a0e8f150851 for instance 00720d70-9f60-4833-898c-7fa8d5ecdc70 on nch2-master-1 May 21 21:54:15.554169 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-640bde95-4670-4f0e-bd5e-87376c6f4869 req-e1521d54-e0de-411f-8fe9-6558d91e1b8e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035066 May 21 21:54:15.555171 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3192/6259] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:54:17.354275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-482fd926-cea9-41b4-8760-545d76671725 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:54:17.355312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-482fd926-cea9-41b4-8760-545d76671725 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:17.361639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-482fd926-cea9-41b4-8760-545d76671725 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:17.369590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-482fd926-cea9-41b4-8760-545d76671725 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:17.369590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-482fd926-cea9-41b4-8760-545d76671725 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:17.369590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-482fd926-cea9-41b4-8760-545d76671725 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:17.464560 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-482fd926-cea9-41b4-8760-545d76671725 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28/action" status: 200 len: 24569 microversion: 2.1 time: 0.219391 May 21 21:54:17.465137 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3068/6260] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:54:17 2022] POST /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28/action => generated 24569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:54:23.911672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1e252820-252d-43cc-bb8c-59a2abc2af3c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:23.912415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1e252820-252d-43cc-bb8c-59a2abc2af3c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:23.914487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:54:23.919749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1e252820-252d-43cc-bb8c-59a2abc2af3c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:23.920451 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1e252820-252d-43cc-bb8c-59a2abc2af3c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:23.924892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1e252820-252d-43cc-bb8c-59a2abc2af3c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:23.924892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1e252820-252d-43cc-bb8c-59a2abc2af3c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:24.075498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1e252820-252d-43cc-bb8c-59a2abc2af3c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:24.083221 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1e252820-252d-43cc-bb8c-59a2abc2af3c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1681 microversion: 2.1 time: 0.177044 May 21 21:54:24.083790 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3193/6261] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:23 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:24.188857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8c49c97a-749c-4a06-8983-1395cca9d8c8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:54:24.189915 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8c49c97a-749c-4a06-8983-1395cca9d8c8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:24.192921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:54:24.198934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c49c97a-749c-4a06-8983-1395cca9d8c8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:24.202004 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c49c97a-749c-4a06-8983-1395cca9d8c8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:24.202004 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c49c97a-749c-4a06-8983-1395cca9d8c8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:24.202004 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8c49c97a-749c-4a06-8983-1395cca9d8c8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:24.253213 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8c49c97a-749c-4a06-8983-1395cca9d8c8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28/action" status: 200 len: 32636 microversion: 2.1 time: 0.069355 May 21 21:54:24.253886 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3069/6262] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:54:24 2022] POST /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28/action => generated 32636 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:54:24.561540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-600dad38-0027-47ba-a95e-8f3b70240e01 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:24.562307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-600dad38-0027-47ba-a95e-8f3b70240e01 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:24.568457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-600dad38-0027-47ba-a95e-8f3b70240e01 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:24.568925 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-600dad38-0027-47ba-a95e-8f3b70240e01 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:24.569694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-600dad38-0027-47ba-a95e-8f3b70240e01 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:24.570143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-600dad38-0027-47ba-a95e-8f3b70240e01 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:24.719878 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-600dad38-0027-47ba-a95e-8f3b70240e01 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1832 microversion: 2.1 time: 0.281079 May 21 21:54:24.722415 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3194/6263] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:24 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1832 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:24.737066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d791af9e-4af1-40ca-ad19-c51f5e2b0f28 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:54:24.738307 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d791af9e-4af1-40ca-ad19-c51f5e2b0f28 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:24.745921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d791af9e-4af1-40ca-ad19-c51f5e2b0f28 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:24.746376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d791af9e-4af1-40ca-ad19-c51f5e2b0f28 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:24.747153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d791af9e-4af1-40ca-ad19-c51f5e2b0f28 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:24.747598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d791af9e-4af1-40ca-ad19-c51f5e2b0f28 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:24.773660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-d791af9e-4af1-40ca-ad19-c51f5e2b0f28 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lazy-loading 'flavor' on Instance uuid f48be87d-208e-484a-8591-b14774f67e28 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:54:24.786657 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d791af9e-4af1-40ca-ad19-c51f5e2b0f28 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] [instance: f48be87d-208e-484a-8591-b14774f67e28] Going to try to live migrate instance to another host {{(pid=131278) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 21 21:54:27.517656 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d791af9e-4af1-40ca-ad19-c51f5e2b0f28 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28/action" status: 202 len: 0 microversion: 2.1 time: 2.784618 May 21 21:54:27.518312 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3070/6264] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:54:24 2022] POST /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28/action => generated 0 bytes in 2786 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:54:27.526639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-153ca223-b9bf-4081-b5a5-5ff677ea44af tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:27.528436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-153ca223-b9bf-4081-b5a5-5ff677ea44af tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:27.534334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-153ca223-b9bf-4081-b5a5-5ff677ea44af tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:27.534798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-153ca223-b9bf-4081-b5a5-5ff677ea44af tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:27.535573 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-153ca223-b9bf-4081-b5a5-5ff677ea44af tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:27.536028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-153ca223-b9bf-4081-b5a5-5ff677ea44af tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:27.693414 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-153ca223-b9bf-4081-b5a5-5ff677ea44af tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:27.701693 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-153ca223-b9bf-4081-b5a5-5ff677ea44af tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1691 microversion: 2.1 time: 0.179087 May 21 21:54:27.702622 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3195/6265] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:27 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1691 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:28.719361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-90331ff1-5e00-4ba6-883b-312a380e24c9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:28.719938 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-90331ff1-5e00-4ba6-883b-312a380e24c9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:28.727687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-90331ff1-5e00-4ba6-883b-312a380e24c9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:28.728145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-90331ff1-5e00-4ba6-883b-312a380e24c9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:28.728966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-90331ff1-5e00-4ba6-883b-312a380e24c9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:28.729764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-90331ff1-5e00-4ba6-883b-312a380e24c9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:29.000853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-90331ff1-5e00-4ba6-883b-312a380e24c9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:29.008564 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-90331ff1-5e00-4ba6-883b-312a380e24c9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1691 microversion: 2.1 time: 0.293264 May 21 21:54:29.009152 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3071/6266] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:28 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1691 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:29.119024 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-ed017e73-2dc1-4f13-8104-70f1ddf3beeb req-a8779c1d-e6a9-4a70-87e9-671ccfda0a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48be87d-208e-484a-8591-b14774f67e28", "name": "network-vif-unplugged", "status": "completed", "tag": "0ece9faa-b2d4-4d55-af66-0a77cceed3b6"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:54:29.129124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ed017e73-2dc1-4f13-8104-70f1ddf3beeb req-a8779c1d-e6a9-4a70-87e9-671ccfda0a7d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:29.129588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ed017e73-2dc1-4f13-8104-70f1ddf3beeb req-a8779c1d-e6a9-4a70-87e9-671ccfda0a7d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:29.141790 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-ed017e73-2dc1-4f13-8104-70f1ddf3beeb req-a8779c1d-e6a9-4a70-87e9-671ccfda0a7d service nova] Creating event network-vif-unplugged:0ece9faa-b2d4-4d55-af66-0a77cceed3b6 for instance f48be87d-208e-484a-8591-b14774f67e28 on nch1-master-1 May 21 21:54:29.146859 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-ed017e73-2dc1-4f13-8104-70f1ddf3beeb req-a8779c1d-e6a9-4a70-87e9-671ccfda0a7d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031574 May 21 21:54:29.147452 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3196/6267] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:54:30.026190 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f81b7bfe-1253-44e9-a351-9f6a60eb057d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:30.027069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f81b7bfe-1253-44e9-a351-9f6a60eb057d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:30.035251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f81b7bfe-1253-44e9-a351-9f6a60eb057d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:30.035830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f81b7bfe-1253-44e9-a351-9f6a60eb057d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:30.036724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f81b7bfe-1253-44e9-a351-9f6a60eb057d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:30.037242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f81b7bfe-1253-44e9-a351-9f6a60eb057d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:30.190777 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f81b7bfe-1253-44e9-a351-9f6a60eb057d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:30.198979 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f81b7bfe-1253-44e9-a351-9f6a60eb057d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1691 microversion: 2.1 time: 0.176762 May 21 21:54:30.199564 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3072/6268] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:30 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:31.162323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-c91bd56f-e409-4a6e-82bb-21b8d46923f3 req-70eaeee8-e54f-420c-964e-26ab2b600fec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f48be87d-208e-484a-8591-b14774f67e28", "tag": "0ece9faa-b2d4-4d55-af66-0a77cceed3b6"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:54:31.172324 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c91bd56f-e409-4a6e-82bb-21b8d46923f3 req-70eaeee8-e54f-420c-964e-26ab2b600fec service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:31.172820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c91bd56f-e409-4a6e-82bb-21b8d46923f3 req-70eaeee8-e54f-420c-964e-26ab2b600fec service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:31.183696 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-c91bd56f-e409-4a6e-82bb-21b8d46923f3 req-70eaeee8-e54f-420c-964e-26ab2b600fec service nova] Creating event network-changed:0ece9faa-b2d4-4d55-af66-0a77cceed3b6 for instance f48be87d-208e-484a-8591-b14774f67e28 on nch1-master-1 May 21 21:54:31.188946 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-c91bd56f-e409-4a6e-82bb-21b8d46923f3 req-70eaeee8-e54f-420c-964e-26ab2b600fec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030776 May 21 21:54:31.189529 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3197/6269] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:54:31.216437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-72df56b6-59da-45fc-ae23-09d99ee6cf90 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:31.217186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-72df56b6-59da-45fc-ae23-09d99ee6cf90 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:31.224480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72df56b6-59da-45fc-ae23-09d99ee6cf90 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:31.224943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72df56b6-59da-45fc-ae23-09d99ee6cf90 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:31.225731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72df56b6-59da-45fc-ae23-09d99ee6cf90 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:31.226182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-72df56b6-59da-45fc-ae23-09d99ee6cf90 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:31.383687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-72df56b6-59da-45fc-ae23-09d99ee6cf90 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:31.392412 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-72df56b6-59da-45fc-ae23-09d99ee6cf90 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1691 microversion: 2.1 time: 0.180480 May 21 21:54:31.396929 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3073/6270] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:31 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:32.411834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8c1f19d3-fdf7-40ff-866c-1a6e85ce9732 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:32.412574 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8c1f19d3-fdf7-40ff-866c-1a6e85ce9732 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:32.419645 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c1f19d3-fdf7-40ff-866c-1a6e85ce9732 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:32.420104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c1f19d3-fdf7-40ff-866c-1a6e85ce9732 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:32.420916 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c1f19d3-fdf7-40ff-866c-1a6e85ce9732 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:32.421369 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c1f19d3-fdf7-40ff-866c-1a6e85ce9732 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:32.574519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8c1f19d3-fdf7-40ff-866c-1a6e85ce9732 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:32.582245 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8c1f19d3-fdf7-40ff-866c-1a6e85ce9732 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1691 microversion: 2.1 time: 0.175568 May 21 21:54:32.582827 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3198/6271] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:32 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:33.600810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6d7c1da4-8646-431a-9fbf-3b45e80a53c8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:33.601417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6d7c1da4-8646-431a-9fbf-3b45e80a53c8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:33.609238 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d7c1da4-8646-431a-9fbf-3b45e80a53c8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:33.609700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d7c1da4-8646-431a-9fbf-3b45e80a53c8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:33.610476 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d7c1da4-8646-431a-9fbf-3b45e80a53c8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:33.610918 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d7c1da4-8646-431a-9fbf-3b45e80a53c8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:33.766234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6d7c1da4-8646-431a-9fbf-3b45e80a53c8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:33.773911 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6d7c1da4-8646-431a-9fbf-3b45e80a53c8 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1691 microversion: 2.1 time: 0.177119 May 21 21:54:33.774860 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3074/6272] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:33 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:34.790901 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3190dd45-cb77-4895-aac6-8a123ebc46cd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:34.791542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3190dd45-cb77-4895-aac6-8a123ebc46cd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:34.799641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3190dd45-cb77-4895-aac6-8a123ebc46cd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:34.800110 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3190dd45-cb77-4895-aac6-8a123ebc46cd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:34.800928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3190dd45-cb77-4895-aac6-8a123ebc46cd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:34.801386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3190dd45-cb77-4895-aac6-8a123ebc46cd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:34.951525 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3190dd45-cb77-4895-aac6-8a123ebc46cd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:34.959282 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3190dd45-cb77-4895-aac6-8a123ebc46cd tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1691 microversion: 2.1 time: 0.172315 May 21 21:54:34.959919 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3199/6273] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:34 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:35.528232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-ec9f444c-1fe9-4d86-8cd8-37f93b70ac2a req-8a16534c-db79-488c-9a74-236229ec35c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48be87d-208e-484a-8591-b14774f67e28", "name": "network-vif-unplugged", "status": "completed", "tag": "0ece9faa-b2d4-4d55-af66-0a77cceed3b6"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:54:35.536592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ec9f444c-1fe9-4d86-8cd8-37f93b70ac2a req-8a16534c-db79-488c-9a74-236229ec35c8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:35.537038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ec9f444c-1fe9-4d86-8cd8-37f93b70ac2a req-8a16534c-db79-488c-9a74-236229ec35c8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:35.548304 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-ec9f444c-1fe9-4d86-8cd8-37f93b70ac2a req-8a16534c-db79-488c-9a74-236229ec35c8 service nova] Creating event network-vif-unplugged:0ece9faa-b2d4-4d55-af66-0a77cceed3b6 for instance f48be87d-208e-484a-8591-b14774f67e28 on nch1-master-1 May 21 21:54:35.553614 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-ec9f444c-1fe9-4d86-8cd8-37f93b70ac2a req-8a16534c-db79-488c-9a74-236229ec35c8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095974 May 21 21:54:35.554406 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3075/6274] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:54:35.977430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-42501781-07b3-4ae7-890c-f8c857088a92 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:35.978087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-42501781-07b3-4ae7-890c-f8c857088a92 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:36.008730 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42501781-07b3-4ae7-890c-f8c857088a92 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:36.009207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42501781-07b3-4ae7-890c-f8c857088a92 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:36.010012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42501781-07b3-4ae7-890c-f8c857088a92 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:36.010467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42501781-07b3-4ae7-890c-f8c857088a92 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:36.169969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-42501781-07b3-4ae7-890c-f8c857088a92 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:36.179338 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-42501781-07b3-4ae7-890c-f8c857088a92 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1691 microversion: 2.1 time: 0.205996 May 21 21:54:36.179988 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3200/6275] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:35 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1691 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:37.199343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-66d211a0-bfda-460d-aba6-f504a9966f8b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:37.200457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-66d211a0-bfda-460d-aba6-f504a9966f8b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:37.207751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66d211a0-bfda-460d-aba6-f504a9966f8b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:37.208207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66d211a0-bfda-460d-aba6-f504a9966f8b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:37.209028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66d211a0-bfda-460d-aba6-f504a9966f8b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:37.209470 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-66d211a0-bfda-460d-aba6-f504a9966f8b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:37.457318 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-66d211a0-bfda-460d-aba6-f504a9966f8b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:37.459714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:54:37.465771 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-66d211a0-bfda-460d-aba6-f504a9966f8b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1691 microversion: 2.1 time: 0.271580 May 21 21:54:37.470850 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3076/6276] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:37 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1691 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:38.484294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8701b2d4-e30b-42a4-b6b5-f7bea886bbf1 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:38.484975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8701b2d4-e30b-42a4-b6b5-f7bea886bbf1 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:38.492354 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8701b2d4-e30b-42a4-b6b5-f7bea886bbf1 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:38.492840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8701b2d4-e30b-42a4-b6b5-f7bea886bbf1 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:38.493641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8701b2d4-e30b-42a4-b6b5-f7bea886bbf1 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:38.494101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8701b2d4-e30b-42a4-b6b5-f7bea886bbf1 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:38.497435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=68 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:54:38.655930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8701b2d4-e30b-42a4-b6b5-f7bea886bbf1 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:38.663963 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8701b2d4-e30b-42a4-b6b5-f7bea886bbf1 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1681 microversion: 2.1 time: 0.184567 May 21 21:54:38.664588 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3201/6277] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:38 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:38.681193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-be0420b0-e844-48c1-9b40-427c61359a77 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:38.681938 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-be0420b0-e844-48c1-9b40-427c61359a77 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:38.690808 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be0420b0-e844-48c1-9b40-427c61359a77 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:38.691311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be0420b0-e844-48c1-9b40-427c61359a77 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:38.692115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be0420b0-e844-48c1-9b40-427c61359a77 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:38.692589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be0420b0-e844-48c1-9b40-427c61359a77 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:38.838141 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-be0420b0-e844-48c1-9b40-427c61359a77 tempest-TestNetworkAdvancedServerOps-410171962 tempest-TestNetworkAdvancedServerOps-410171962-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1832 microversion: 2.1 time: 0.160721 May 21 21:54:38.838714 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3077/6278] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:38 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1832 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:38.854406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b965f8ae-be4a-4c11-a473-d089c5118cfc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:38.855040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b965f8ae-be4a-4c11-a473-d089c5118cfc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:38.862075 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b965f8ae-be4a-4c11-a473-d089c5118cfc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:38.862537 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b965f8ae-be4a-4c11-a473-d089c5118cfc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:38.863441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b965f8ae-be4a-4c11-a473-d089c5118cfc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:38.863931 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b965f8ae-be4a-4c11-a473-d089c5118cfc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:39.010251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b965f8ae-be4a-4c11-a473-d089c5118cfc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:39.018241 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b965f8ae-be4a-4c11-a473-d089c5118cfc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1681 microversion: 2.1 time: 0.167786 May 21 21:54:39.018966 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3202/6279] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:38 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:41.131903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e4deb7f6-0d86-41f9-b9c9-b601d309eff7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:54:41.132876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e4deb7f6-0d86-41f9-b9c9-b601d309eff7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:41.140340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e4deb7f6-0d86-41f9-b9c9-b601d309eff7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:41.140802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e4deb7f6-0d86-41f9-b9c9-b601d309eff7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:41.141612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e4deb7f6-0d86-41f9-b9c9-b601d309eff7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:41.142055 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e4deb7f6-0d86-41f9-b9c9-b601d309eff7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:41.191828 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e4deb7f6-0d86-41f9-b9c9-b601d309eff7 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28/action" status: 200 len: 38656 microversion: 2.1 time: 0.064066 May 21 21:54:41.192529 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3078/6280] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:54:41 2022] POST /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28/action => generated 38656 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:54:42.369151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a496cee6-1821-4fc5-a86c-124a6c73e70a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:42.369676 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a496cee6-1821-4fc5-a86c-124a6c73e70a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:42.371994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-f37fe6ae-6cbf-4357-930d-a7cf1a5ead26 req-e336b5aa-360b-4b9f-b6f2-c070fd3cc46a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f48be87d-208e-484a-8591-b14774f67e28", "tag": "0ece9faa-b2d4-4d55-af66-0a77cceed3b6"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:54:42.377789 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a496cee6-1821-4fc5-a86c-124a6c73e70a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:42.378268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a496cee6-1821-4fc5-a86c-124a6c73e70a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:42.379088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a496cee6-1821-4fc5-a86c-124a6c73e70a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:42.379547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a496cee6-1821-4fc5-a86c-124a6c73e70a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:42.386298 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f37fe6ae-6cbf-4357-930d-a7cf1a5ead26 req-e336b5aa-360b-4b9f-b6f2-c070fd3cc46a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:42.386851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f37fe6ae-6cbf-4357-930d-a7cf1a5ead26 req-e336b5aa-360b-4b9f-b6f2-c070fd3cc46a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:42.403774 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-f37fe6ae-6cbf-4357-930d-a7cf1a5ead26 req-e336b5aa-360b-4b9f-b6f2-c070fd3cc46a service nova] Creating event network-changed:0ece9faa-b2d4-4d55-af66-0a77cceed3b6 for instance f48be87d-208e-484a-8591-b14774f67e28 on nch2-master-1 May 21 21:54:42.409760 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-f37fe6ae-6cbf-4357-930d-a7cf1a5ead26 req-e336b5aa-360b-4b9f-b6f2-c070fd3cc46a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042207 May 21 21:54:42.410651 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3079/6281] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:54:42.411336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a496cee6-1821-4fc5-a86c-124a6c73e70a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:54:42.769403 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a496cee6-1821-4fc5-a86c-124a6c73e70a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 204 len: 0 microversion: 2.1 time: 0.404011 May 21 21:54:42.773258 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3203/6282] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:54:42 2022] DELETE /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:54:42.782455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-753abdb2-aeec-46a2-af23-e5cbb5010422 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:42.783198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-753abdb2-aeec-46a2-af23-e5cbb5010422 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:42.790354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-753abdb2-aeec-46a2-af23-e5cbb5010422 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:42.790807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-753abdb2-aeec-46a2-af23-e5cbb5010422 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:42.791585 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-753abdb2-aeec-46a2-af23-e5cbb5010422 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:42.792027 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-753abdb2-aeec-46a2-af23-e5cbb5010422 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:42.958092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-753abdb2-aeec-46a2-af23-e5cbb5010422 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:42.966080 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-753abdb2-aeec-46a2-af23-e5cbb5010422 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1687 microversion: 2.1 time: 0.190819 May 21 21:54:42.976409 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3080/6283] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:42 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1687 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:43.887296 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-85919fb4-0576-4c9c-9c0e-74f15092ad9b req-340fd4a2-8a36-4524-92eb-7e338e733582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48be87d-208e-484a-8591-b14774f67e28", "name": "network-vif-deleted", "tag": "0ece9faa-b2d4-4d55-af66-0a77cceed3b6"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:54:43.900926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-85919fb4-0576-4c9c-9c0e-74f15092ad9b req-340fd4a2-8a36-4524-92eb-7e338e733582 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:43.901493 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-85919fb4-0576-4c9c-9c0e-74f15092ad9b req-340fd4a2-8a36-4524-92eb-7e338e733582 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:43.913186 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-85919fb4-0576-4c9c-9c0e-74f15092ad9b req-340fd4a2-8a36-4524-92eb-7e338e733582 service nova] Creating event network-vif-deleted:0ece9faa-b2d4-4d55-af66-0a77cceed3b6 for instance f48be87d-208e-484a-8591-b14774f67e28 on nch2-master-1 May 21 21:54:43.918172 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-85919fb4-0576-4c9c-9c0e-74f15092ad9b req-340fd4a2-8a36-4524-92eb-7e338e733582 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036387 May 21 21:54:43.918792 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3204/6284] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:54:43.983167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ccd8f27c-0717-42b0-8241-2d368bdc6f8b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:43.983719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ccd8f27c-0717-42b0-8241-2d368bdc6f8b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:43.991221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ccd8f27c-0717-42b0-8241-2d368bdc6f8b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:43.991684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ccd8f27c-0717-42b0-8241-2d368bdc6f8b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:43.992507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ccd8f27c-0717-42b0-8241-2d368bdc6f8b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:43.992958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ccd8f27c-0717-42b0-8241-2d368bdc6f8b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:44.068904 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ccd8f27c-0717-42b0-8241-2d368bdc6f8b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:54:44.079695 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ccd8f27c-0717-42b0-8241-2d368bdc6f8b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 200 len: 1501 microversion: 2.1 time: 0.097899 May 21 21:54:44.079695 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3081/6285] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:43 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 1501 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:54:45.096673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0f98baeb-f4cb-47de-ad50-a8a91536e08d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:45.097321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0f98baeb-f4cb-47de-ad50-a8a91536e08d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: f48be87d-208e-484a-8591-b14774f67e28] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:54:45.103914 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f98baeb-f4cb-47de-ad50-a8a91536e08d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:45.104410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f98baeb-f4cb-47de-ad50-a8a91536e08d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:45.105244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f98baeb-f4cb-47de-ad50-a8a91536e08d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:54:45.105795 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f98baeb-f4cb-47de-ad50-a8a91536e08d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:54:45.119504 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-0f98baeb-f4cb-47de-ad50-a8a91536e08d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] HTTP exception thrown: Instance f48be87d-208e-484a-8591-b14774f67e28 could not be found. May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0f98baeb-f4cb-47de-ad50-a8a91536e08d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Request method failure captured: May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 HTTP/1.1 May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiV5VnUrknEwJKQM-WmDDXb2WufWDMrIUBPERVQo0MOrFG494HmHdgIu5jdLUtPa4_DBj5sq24NqkmSSt6MexXklLlGmt5CTgD8iXAEeAGP0tG9opX27ER-CIt0-AlckG2ItDlVMH5gqQmzk8JSj3q6SbbQAXv8Oz4tAeyuiI7B1mjck May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 3b2e8e3a4821406893ebe9c189311cbf May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1083505785 May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3b2e8e3a4821406893ebe9c189311cbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b2e8e3a4821406893ebe9c189311cbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3b2e8e3a4821406893ebe9c189311cbf", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b2e8e3a4821406893ebe9c189311cbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1083505785 May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 3b2e8e3a4821406893ebe9c189311cbf May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1083505785 May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-TestNetworkAdvancedServerOps-1083505785-project May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 3083c05994cd4f599a2def7fa1281d60 May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1083505785-project May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance f48be87d-208e-484a-8591-b14774f67e28 could not be found. May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'f48be87d-208e-484a-8591-b14774f67e28'} May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f48be87d-208e-484a-8591-b14774f67e28 could not be found. May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f48be87d-208e-484a-8591-b14774f67e28 could not be found. May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:54:45.123250 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:54:45.129850 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:54:45.129850 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:54:45.129850 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:54:45.129850 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:54:45.129850 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:54:45.129850 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:54:45.129850 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f48be87d-208e-484a-8591-b14774f67e28 could not be found. May 21 21:54:45.129850 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:54:45.129850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0f98baeb-f4cb-47de-ad50-a8a91536e08d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Returning 404 to user: Instance f48be87d-208e-484a-8591-b14774f67e28 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:54:45.129850 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0f98baeb-f4cb-47de-ad50-a8a91536e08d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28" status: 404 len: 111 microversion: 2.1 time: 0.031850 May 21 21:54:45.129850 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3205/6286] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:54:45 2022] GET /compute/v2.1/servers/f48be87d-208e-484a-8591-b14774f67e28 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:54:49.568095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d791ee10-8607-432a-b799-8524a2b2213a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '.version_select at 0x7fc81bc7b670>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:54:49.658372 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d791ee10-8607-432a-b799-8524a2b2213a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1842329667" status: 202 len: 0 microversion: 2.1 time: 0.097755 May 21 21:54:49.658981 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3082/6287] 10.222.0.49 () {58 vars in 1283 bytes} [Sat May 21 21:54:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1842329667 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:54:49.689946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-505dbc2e-c052-4316-981f-f1d4aeb9d366 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'create', calling method: .version_select at 0x7fc81aa381f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2051519271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7plBZrsPghCn3gDwxtdRY4V7JmSd+WcpbmGU9xc/tyLV7YYGzc8X3Sp0K3rgCiO+SzXgizOJwKEuCeT18Xx5vBzzLISib3Gq4IkM8hgizt7bimxExTW+PRWLQI4TcdXw=="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:54:49.706799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-505dbc2e-c052-4316-981f-f1d4aeb9d366 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Getting quotas for project 3b2e8e3a4821406893ebe9c189311cbf. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:54:49.712332 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-505dbc2e-c052-4316-981f-f1d4aeb9d366 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Getting quotas for user 3083c05994cd4f599a2def7fa1281d60 and project 3b2e8e3a4821406893ebe9c189311cbf. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:54:49.812080 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-505dbc2e-c052-4316-981f-f1d4aeb9d366 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.126451 May 21 21:54:49.813436 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3206/6288] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 21:54:49 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:54:59.450605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=25 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:54:59.456646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cdfb6327-8e8b-42ba-9ca9-7eb7841c93f2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1757243977", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "a798d87f-b23c-4990-88d6-9c454bccc785"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1701115888", "security_groups": []}, "os:scheduler_hints": {"different_host": ["00720d70-9f60-4833-898c-7fa8d5ecdc70"]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:54:59.496155 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:54:59.599699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-cdfb6327-8e8b-42ba-9ca9-7eb7841c93f2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] validate_networks() for [('a798d87f-b23c-4990-88d6-9c454bccc785', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:55:00.656619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-cdfb6327-8e8b-42ba-9ca9-7eb7841c93f2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:55:00.657404 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-cdfb6327-8e8b-42ba-9ca9-7eb7841c93f2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:55:00.657913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-cdfb6327-8e8b-42ba-9ca9-7eb7841c93f2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:55:00.660422 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-cdfb6327-8e8b-42ba-9ca9-7eb7841c93f2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:55:00.661156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-cdfb6327-8e8b-42ba-9ca9-7eb7841c93f2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:55:00.692271 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cdfb6327-8e8b-42ba-9ca9-7eb7841c93f2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:00.692754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cdfb6327-8e8b-42ba-9ca9-7eb7841c93f2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:00.699840 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cdfb6327-8e8b-42ba-9ca9-7eb7841c93f2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:00.700379 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cdfb6327-8e8b-42ba-9ca9-7eb7841c93f2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:00.747341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-cdfb6327-8e8b-42ba-9ca9-7eb7841c93f2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Getting quotas for project d5756d4186354028bcff9c66712f5c33. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:55:00.754030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-cdfb6327-8e8b-42ba-9ca9-7eb7841c93f2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Getting quotas for user eff8b9d9ac8a487fa0ccc0a37def90ac and project d5756d4186354028bcff9c66712f5c33. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:55:00.773351 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cdfb6327-8e8b-42ba-9ca9-7eb7841c93f2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:55:00.776727 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cdfb6327-8e8b-42ba-9ca9-7eb7841c93f2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:55:01.020432 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cdfb6327-8e8b-42ba-9ca9-7eb7841c93f2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.572062 May 21 21:55:01.030887 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3083/6289] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:54:59 2022] POST /compute/v2.1/servers => generated 361 bytes in 1584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:55:01.039209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:55:01.040911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:55:01.044578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:55:01.052247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-df3583e7-3b64-4b5a-9ab0-27dcc0fde2d1 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:01.052921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-df3583e7-3b64-4b5a-9ab0-27dcc0fde2d1 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:01.251248 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-df3583e7-3b64-4b5a-9ab0-27dcc0fde2d1 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:01.264172 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-df3583e7-3b64-4b5a-9ab0-27dcc0fde2d1 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 200 len: 1242 microversion: 2.1 time: 0.226726 May 21 21:55:01.266067 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3207/6290] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:01 2022] GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 1242 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:01.922508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c5d069f8-5991-435b-9026-1048f349b101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-364893729", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "92eb1406-2f2a-4f16-99dc-742c1e75b07b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2051519271", "security_groups": [{"name": "tempest-secgroup-smoke-1043001658"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:55:02.057961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-c5d069f8-5991-435b-9026-1048f349b101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] validate_networks() for [('92eb1406-2f2a-4f16-99dc-742c1e75b07b', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:55:02.286030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f1dcda21-160a-4037-b072-4194463d5673 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:02.289164 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f1dcda21-160a-4037-b072-4194463d5673 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:02.458277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f1dcda21-160a-4037-b072-4194463d5673 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:02.466311 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f1dcda21-160a-4037-b072-4194463d5673 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 200 len: 1242 microversion: 2.1 time: 0.187247 May 21 21:55:02.470948 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3208/6291] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:02 2022] GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 1242 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:02.894770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-c5d069f8-5991-435b-9026-1048f349b101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:55:02.895206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-c5d069f8-5991-435b-9026-1048f349b101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:55:02.895694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-c5d069f8-5991-435b-9026-1048f349b101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:55:02.896111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-c5d069f8-5991-435b-9026-1048f349b101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:55:02.896767 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-c5d069f8-5991-435b-9026-1048f349b101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:55:02.909389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5d069f8-5991-435b-9026-1048f349b101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:02.909848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5d069f8-5991-435b-9026-1048f349b101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:02.910665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5d069f8-5991-435b-9026-1048f349b101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:02.911422 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5d069f8-5991-435b-9026-1048f349b101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:02.973848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-c5d069f8-5991-435b-9026-1048f349b101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Getting quotas for project 3b2e8e3a4821406893ebe9c189311cbf. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:55:02.990831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-c5d069f8-5991-435b-9026-1048f349b101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Getting quotas for user 3083c05994cd4f599a2def7fa1281d60 and project 3b2e8e3a4821406893ebe9c189311cbf. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:55:03.014164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c5d069f8-5991-435b-9026-1048f349b101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:55:03.017716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c5d069f8-5991-435b-9026-1048f349b101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:55:03.212379 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c5d069f8-5991-435b-9026-1048f349b101 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.295501 May 21 21:55:03.219706 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3084/6292] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:55:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:55:03.224624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4fbb5932-064d-441b-aa7a-1ae0854b1aee tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:03.228028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4fbb5932-064d-441b-aa7a-1ae0854b1aee tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:03.325511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4fbb5932-064d-441b-aa7a-1ae0854b1aee tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:03.336223 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4fbb5932-064d-441b-aa7a-1ae0854b1aee tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1266 microversion: 2.1 time: 0.114651 May 21 21:55:03.340401 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3209/6293] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:03 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1266 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:55:03.493093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f89ff242-5030-4392-b31e-8fff49fb77c6 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:03.493998 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f89ff242-5030-4392-b31e-8fff49fb77c6 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:03.502022 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f89ff242-5030-4392-b31e-8fff49fb77c6 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:03.502485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f89ff242-5030-4392-b31e-8fff49fb77c6 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:03.506185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f89ff242-5030-4392-b31e-8fff49fb77c6 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:03.509146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f89ff242-5030-4392-b31e-8fff49fb77c6 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:03.594551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f89ff242-5030-4392-b31e-8fff49fb77c6 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:03.609376 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f89ff242-5030-4392-b31e-8fff49fb77c6 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 200 len: 1294 microversion: 2.1 time: 0.126166 May 21 21:55:03.610074 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3085/6294] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:03 2022] GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 1294 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:04.353758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-669afd1b-11f8-4694-802a-eb012073e9c1 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:04.354539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-669afd1b-11f8-4694-802a-eb012073e9c1 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:04.445686 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-669afd1b-11f8-4694-802a-eb012073e9c1 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:04.456870 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-669afd1b-11f8-4694-802a-eb012073e9c1 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1266 microversion: 2.1 time: 0.106775 May 21 21:55:04.458223 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3210/6295] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:04 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:04.627385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-04514bb7-fe86-46d0-8b89-67c628c11916 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:04.628070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-04514bb7-fe86-46d0-8b89-67c628c11916 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:04.635296 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04514bb7-fe86-46d0-8b89-67c628c11916 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:04.635754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04514bb7-fe86-46d0-8b89-67c628c11916 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:04.636847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04514bb7-fe86-46d0-8b89-67c628c11916 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:04.637102 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04514bb7-fe86-46d0-8b89-67c628c11916 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:04.759804 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-04514bb7-fe86-46d0-8b89-67c628c11916 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:04.778484 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-04514bb7-fe86-46d0-8b89-67c628c11916 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 200 len: 1300 microversion: 2.1 time: 0.155139 May 21 21:55:04.779722 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3086/6296] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:04 2022] GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 1300 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:05.476861 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-24931602-b87f-4814-9c08-44de09faf947 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:05.478524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-24931602-b87f-4814-9c08-44de09faf947 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:05.488582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24931602-b87f-4814-9c08-44de09faf947 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:05.489493 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24931602-b87f-4814-9c08-44de09faf947 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:05.490567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24931602-b87f-4814-9c08-44de09faf947 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:05.491306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-24931602-b87f-4814-9c08-44de09faf947 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:05.617323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-24931602-b87f-4814-9c08-44de09faf947 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:05.629021 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-24931602-b87f-4814-9c08-44de09faf947 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1318 microversion: 2.1 time: 0.157207 May 21 21:55:05.629605 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3211/6297] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:05 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:05.795712 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d5aadb62-b183-4ce4-81e1-d40dfbe3d776 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:05.796659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d5aadb62-b183-4ce4-81e1-d40dfbe3d776 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:05.804152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5aadb62-b183-4ce4-81e1-d40dfbe3d776 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:05.804902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5aadb62-b183-4ce4-81e1-d40dfbe3d776 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:05.805875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5aadb62-b183-4ce4-81e1-d40dfbe3d776 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:05.806500 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5aadb62-b183-4ce4-81e1-d40dfbe3d776 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:05.983094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d5aadb62-b183-4ce4-81e1-d40dfbe3d776 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:05.994784 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d5aadb62-b183-4ce4-81e1-d40dfbe3d776 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 200 len: 1300 microversion: 2.1 time: 0.202887 May 21 21:55:05.995379 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3087/6298] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:05 2022] GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 1300 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:06.649620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b0659968-621f-45c3-88a3-7848af57110d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:06.650935 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b0659968-621f-45c3-88a3-7848af57110d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:06.659842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0659968-621f-45c3-88a3-7848af57110d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:06.660538 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0659968-621f-45c3-88a3-7848af57110d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:06.667486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0659968-621f-45c3-88a3-7848af57110d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:06.667894 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0659968-621f-45c3-88a3-7848af57110d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:06.798137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b0659968-621f-45c3-88a3-7848af57110d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:06.806378 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b0659968-621f-45c3-88a3-7848af57110d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1324 microversion: 2.1 time: 0.161590 May 21 21:55:06.806982 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3212/6299] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:06 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1324 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:07.013316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2b27c7fb-f1fe-4824-8a83-5ff846567730 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:07.014577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2b27c7fb-f1fe-4824-8a83-5ff846567730 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:07.020382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f02e9309-bf83-4184-b633-01b4b9583f4a req-73980132-5254-4121-9d15-495c88db63a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb", "tag": "333fd57a-ea3a-4a3d-9352-b4f9136af3fc"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:55:07.037671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b27c7fb-f1fe-4824-8a83-5ff846567730 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:07.038158 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b27c7fb-f1fe-4824-8a83-5ff846567730 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:07.040037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f02e9309-bf83-4184-b633-01b4b9583f4a req-73980132-5254-4121-9d15-495c88db63a1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:07.040037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f02e9309-bf83-4184-b633-01b4b9583f4a req-73980132-5254-4121-9d15-495c88db63a1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:07.040257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b27c7fb-f1fe-4824-8a83-5ff846567730 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:07.040257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b27c7fb-f1fe-4824-8a83-5ff846567730 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:07.072069 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f02e9309-bf83-4184-b633-01b4b9583f4a req-73980132-5254-4121-9d15-495c88db63a1 service nova] Creating event network-changed:333fd57a-ea3a-4a3d-9352-b4f9136af3fc for instance 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb on nch1-master-1 May 21 21:55:07.097481 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f02e9309-bf83-4184-b633-01b4b9583f4a req-73980132-5254-4121-9d15-495c88db63a1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069138 May 21 21:55:07.098171 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3213/6300] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:55:07.199975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2b27c7fb-f1fe-4824-8a83-5ff846567730 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:07.211638 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2b27c7fb-f1fe-4824-8a83-5ff846567730 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 200 len: 1300 microversion: 2.1 time: 0.202104 May 21 21:55:07.219579 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3088/6301] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:07 2022] GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 1300 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:07.710726 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 21:55:07.711329 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 21:55:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 21:55:07.825147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2f1f841b-2f16-44aa-93d2-8cff450e0c16 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:07.825907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2f1f841b-2f16-44aa-93d2-8cff450e0c16 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:07.834411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f1f841b-2f16-44aa-93d2-8cff450e0c16 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:07.834834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f1f841b-2f16-44aa-93d2-8cff450e0c16 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:07.835629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f1f841b-2f16-44aa-93d2-8cff450e0c16 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:07.836081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f1f841b-2f16-44aa-93d2-8cff450e0c16 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:07.930617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2f1f841b-2f16-44aa-93d2-8cff450e0c16 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:07.938958 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2f1f841b-2f16-44aa-93d2-8cff450e0c16 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1324 microversion: 2.1 time: 0.118308 May 21 21:55:07.939536 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3214/6302] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:07 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1324 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:08.228629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a56a13f6-ff76-4a83-a719-e8368ac76459 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:08.235085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a56a13f6-ff76-4a83-a719-e8368ac76459 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:08.244552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a56a13f6-ff76-4a83-a719-e8368ac76459 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:08.245428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a56a13f6-ff76-4a83-a719-e8368ac76459 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:08.246459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a56a13f6-ff76-4a83-a719-e8368ac76459 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:08.247102 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a56a13f6-ff76-4a83-a719-e8368ac76459 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:08.349102 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a56a13f6-ff76-4a83-a719-e8368ac76459 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:08.359736 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a56a13f6-ff76-4a83-a719-e8368ac76459 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 200 len: 1300 microversion: 2.1 time: 0.135125 May 21 21:55:08.360384 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3089/6303] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:08 2022] GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 1300 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:08.955862 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f3680199-c489-463e-9c2a-bd086fd8949e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:08.956676 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f3680199-c489-463e-9c2a-bd086fd8949e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:08.963745 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3680199-c489-463e-9c2a-bd086fd8949e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:08.964343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3680199-c489-463e-9c2a-bd086fd8949e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:08.965021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3680199-c489-463e-9c2a-bd086fd8949e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:08.965512 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f3680199-c489-463e-9c2a-bd086fd8949e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:09.233660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f3680199-c489-463e-9c2a-bd086fd8949e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:09.242140 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f3680199-c489-463e-9c2a-bd086fd8949e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1392 microversion: 2.1 time: 0.290702 May 21 21:55:09.243751 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3215/6304] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:08 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1392 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:09.377642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ba2de4db-a3a4-45cc-8899-998435659c09 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:09.378267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ba2de4db-a3a4-45cc-8899-998435659c09 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:09.385464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba2de4db-a3a4-45cc-8899-998435659c09 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:09.385920 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba2de4db-a3a4-45cc-8899-998435659c09 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:09.386696 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba2de4db-a3a4-45cc-8899-998435659c09 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:09.387141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba2de4db-a3a4-45cc-8899-998435659c09 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:09.480727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-45f9232c-f292-4fe1-9736-b665d81567b8 req-68c81d4f-f8c8-419a-95ea-28508709081d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "760451e4-7a52-41d2-8a82-9596c147aeb2", "tag": "94ca576f-fd14-4ad4-aa22-7b6a584e886e"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:55:09.482186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ba2de4db-a3a4-45cc-8899-998435659c09 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:09.491219 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-45f9232c-f292-4fe1-9736-b665d81567b8 req-68c81d4f-f8c8-419a-95ea-28508709081d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:09.491993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-45f9232c-f292-4fe1-9736-b665d81567b8 req-68c81d4f-f8c8-419a-95ea-28508709081d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:09.496456 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ba2de4db-a3a4-45cc-8899-998435659c09 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 200 len: 1300 microversion: 2.1 time: 0.123474 May 21 21:55:09.506579 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-45f9232c-f292-4fe1-9736-b665d81567b8 req-68c81d4f-f8c8-419a-95ea-28508709081d service nova] Creating event network-changed:94ca576f-fd14-4ad4-aa22-7b6a584e886e for instance 760451e4-7a52-41d2-8a82-9596c147aeb2 on nch1-master-1 May 21 21:55:09.507274 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3090/6305] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:09 2022] GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 1300 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:09.512217 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-45f9232c-f292-4fe1-9736-b665d81567b8 req-68c81d4f-f8c8-419a-95ea-28508709081d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035494 May 21 21:55:09.513228 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3216/6306] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:55:10.259689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a5400ac9-359b-498b-a509-358df256e121 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:10.260345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a5400ac9-359b-498b-a509-358df256e121 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:10.266687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5400ac9-359b-498b-a509-358df256e121 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:10.267148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5400ac9-359b-498b-a509-358df256e121 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:10.267938 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5400ac9-359b-498b-a509-358df256e121 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:10.268424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5400ac9-359b-498b-a509-358df256e121 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:10.424864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a5400ac9-359b-498b-a509-358df256e121 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:10.433731 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a5400ac9-359b-498b-a509-358df256e121 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1392 microversion: 2.1 time: 0.177888 May 21 21:55:10.434314 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3091/6307] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:10 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:10.515654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-989cbd0e-e2d4-4a60-a31e-837a961763a2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:10.516595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-989cbd0e-e2d4-4a60-a31e-837a961763a2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:10.523161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-989cbd0e-e2d4-4a60-a31e-837a961763a2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:10.523624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-989cbd0e-e2d4-4a60-a31e-837a961763a2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:10.524436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-989cbd0e-e2d4-4a60-a31e-837a961763a2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:10.524886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-989cbd0e-e2d4-4a60-a31e-837a961763a2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:10.617831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-989cbd0e-e2d4-4a60-a31e-837a961763a2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:10.625986 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-989cbd0e-e2d4-4a60-a31e-837a961763a2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 200 len: 1300 microversion: 2.1 time: 0.116268 May 21 21:55:10.626550 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3217/6308] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:10 2022] GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 1300 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:55:11.451554 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aa627c33-8108-4ec8-bd71-0f8d73d3fb05 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:11.452897 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-aa627c33-8108-4ec8-bd71-0f8d73d3fb05 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:11.460114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aa627c33-8108-4ec8-bd71-0f8d73d3fb05 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:11.460598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aa627c33-8108-4ec8-bd71-0f8d73d3fb05 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:11.461367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aa627c33-8108-4ec8-bd71-0f8d73d3fb05 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:11.461804 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aa627c33-8108-4ec8-bd71-0f8d73d3fb05 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:11.613537 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-aa627c33-8108-4ec8-bd71-0f8d73d3fb05 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:11.621757 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-aa627c33-8108-4ec8-bd71-0f8d73d3fb05 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1392 microversion: 2.1 time: 0.174067 May 21 21:55:11.622338 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3092/6309] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:11 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:11.643212 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b1390f14-406e-4ce9-b2f2-34ac7740776b tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:11.643842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b1390f14-406e-4ce9-b2f2-34ac7740776b tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:11.651067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1390f14-406e-4ce9-b2f2-34ac7740776b tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:11.651535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1390f14-406e-4ce9-b2f2-34ac7740776b tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:11.652337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1390f14-406e-4ce9-b2f2-34ac7740776b tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:11.652791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1390f14-406e-4ce9-b2f2-34ac7740776b tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:11.741409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b1390f14-406e-4ce9-b2f2-34ac7740776b tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:11.749667 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b1390f14-406e-4ce9-b2f2-34ac7740776b tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 200 len: 1300 microversion: 2.1 time: 0.110568 May 21 21:55:11.750285 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3218/6310] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:11 2022] GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 1300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:12.639350 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0be732f3-fcaf-4995-b403-9ba7c9bc6579 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:12.644667 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0be732f3-fcaf-4995-b403-9ba7c9bc6579 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:12.648502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0be732f3-fcaf-4995-b403-9ba7c9bc6579 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:12.648965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0be732f3-fcaf-4995-b403-9ba7c9bc6579 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:12.649748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0be732f3-fcaf-4995-b403-9ba7c9bc6579 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:12.650198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0be732f3-fcaf-4995-b403-9ba7c9bc6579 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:12.767404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-87a6cd24-353d-4814-bcce-ba14d51f1d6c tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:12.767972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-87a6cd24-353d-4814-bcce-ba14d51f1d6c tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:12.774715 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87a6cd24-353d-4814-bcce-ba14d51f1d6c tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:12.775189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87a6cd24-353d-4814-bcce-ba14d51f1d6c tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:12.775988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87a6cd24-353d-4814-bcce-ba14d51f1d6c tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:12.776476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87a6cd24-353d-4814-bcce-ba14d51f1d6c tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:12.813336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0be732f3-fcaf-4995-b403-9ba7c9bc6579 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:12.821294 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0be732f3-fcaf-4995-b403-9ba7c9bc6579 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1392 microversion: 2.1 time: 0.185910 May 21 21:55:12.821886 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3093/6311] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:12 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1392 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:12.873623 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-87a6cd24-353d-4814-bcce-ba14d51f1d6c tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:12.881812 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-87a6cd24-353d-4814-bcce-ba14d51f1d6c tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 200 len: 1300 microversion: 2.1 time: 0.118955 May 21 21:55:12.882549 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3219/6312] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:12 2022] GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 1300 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:13.838736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ba1b9ad9-b075-420e-8cb1-479cef77f480 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:13.839355 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ba1b9ad9-b075-420e-8cb1-479cef77f480 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:13.841279 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:55:13.841978 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=12 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:55:13.849142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba1b9ad9-b075-420e-8cb1-479cef77f480 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:13.854097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba1b9ad9-b075-420e-8cb1-479cef77f480 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:13.854097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba1b9ad9-b075-420e-8cb1-479cef77f480 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:13.854097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ba1b9ad9-b075-420e-8cb1-479cef77f480 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:13.898952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-65259920-5e68-4886-aa4a-08b6997fbd83 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:13.899583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-65259920-5e68-4886-aa4a-08b6997fbd83 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:13.907394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65259920-5e68-4886-aa4a-08b6997fbd83 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:13.907859 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65259920-5e68-4886-aa4a-08b6997fbd83 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:13.908692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65259920-5e68-4886-aa4a-08b6997fbd83 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:13.909143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-65259920-5e68-4886-aa4a-08b6997fbd83 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:14.004429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-65259920-5e68-4886-aa4a-08b6997fbd83 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:14.006251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ba1b9ad9-b075-420e-8cb1-479cef77f480 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:14.012517 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-65259920-5e68-4886-aa4a-08b6997fbd83 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 200 len: 1300 microversion: 2.1 time: 0.117335 May 21 21:55:14.013141 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3220/6313] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:13 2022] GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 1300 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:55:14.016338 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ba1b9ad9-b075-420e-8cb1-479cef77f480 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1392 microversion: 2.1 time: 0.179448 May 21 21:55:14.016338 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3094/6314] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:13 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:15.030447 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0c6fa9f3-3c1a-40ed-9a02-669438b876bb tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:15.031241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-16ffc7a5-7da2-456d-8cdc-ff31df0ece06 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:15.031861 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-16ffc7a5-7da2-456d-8cdc-ff31df0ece06 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:15.040206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-16ffc7a5-7da2-456d-8cdc-ff31df0ece06 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:15.040779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0c6fa9f3-3c1a-40ed-9a02-669438b876bb tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:15.046905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=8 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:55:15.050739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-16ffc7a5-7da2-456d-8cdc-ff31df0ece06 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:15.051613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-16ffc7a5-7da2-456d-8cdc-ff31df0ece06 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:15.051978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0c6fa9f3-3c1a-40ed-9a02-669438b876bb tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:15.052140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-16ffc7a5-7da2-456d-8cdc-ff31df0ece06 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:15.052813 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0c6fa9f3-3c1a-40ed-9a02-669438b876bb tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:15.056465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0c6fa9f3-3c1a-40ed-9a02-669438b876bb tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:15.056465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0c6fa9f3-3c1a-40ed-9a02-669438b876bb tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:15.178121 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0c6fa9f3-3c1a-40ed-9a02-669438b876bb tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:15.180982 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0c6fa9f3-3c1a-40ed-9a02-669438b876bb tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 200 len: 1300 microversion: 2.1 time: 0.154945 May 21 21:55:15.182134 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3221/6315] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:15 2022] GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 1300 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:15.187233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-00533b10-adf1-4f5f-9146-67d96b10157f req-a2363d86-2ac6-408d-98e5-4e5cc4696fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb", "name": "network-vif-plugged", "status": "completed", "tag": "333fd57a-ea3a-4a3d-9352-b4f9136af3fc"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:55:15.195265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-00533b10-adf1-4f5f-9146-67d96b10157f req-a2363d86-2ac6-408d-98e5-4e5cc4696fa4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:15.195790 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-00533b10-adf1-4f5f-9146-67d96b10157f req-a2363d86-2ac6-408d-98e5-4e5cc4696fa4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:15.208604 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-00533b10-adf1-4f5f-9146-67d96b10157f req-a2363d86-2ac6-408d-98e5-4e5cc4696fa4 service nova] Creating event network-vif-plugged:333fd57a-ea3a-4a3d-9352-b4f9136af3fc for instance 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb on nch1-master-1 May 21 21:55:15.213623 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-00533b10-adf1-4f5f-9146-67d96b10157f req-a2363d86-2ac6-408d-98e5-4e5cc4696fa4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030246 May 21 21:55:15.214324 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3222/6316] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:55:15.223739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-16ffc7a5-7da2-456d-8cdc-ff31df0ece06 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:15.232647 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-16ffc7a5-7da2-456d-8cdc-ff31df0ece06 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1392 microversion: 2.1 time: 0.205378 May 21 21:55:15.234093 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3095/6317] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:15 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1392 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:55:16.200921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b881897e-708c-47d6-84ca-b797d40ba573 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:16.201652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b881897e-708c-47d6-84ca-b797d40ba573 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:16.209082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b881897e-708c-47d6-84ca-b797d40ba573 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:16.209653 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b881897e-708c-47d6-84ca-b797d40ba573 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:16.210324 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b881897e-708c-47d6-84ca-b797d40ba573 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:16.210779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b881897e-708c-47d6-84ca-b797d40ba573 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:16.252246 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f170e691-71e3-4127-8344-d2ef842f5969 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:16.252886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f170e691-71e3-4127-8344-d2ef842f5969 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:16.262914 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f170e691-71e3-4127-8344-d2ef842f5969 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:16.263372 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f170e691-71e3-4127-8344-d2ef842f5969 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:16.264161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f170e691-71e3-4127-8344-d2ef842f5969 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:16.264659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f170e691-71e3-4127-8344-d2ef842f5969 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:16.317885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b881897e-708c-47d6-84ca-b797d40ba573 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:16.329614 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b881897e-708c-47d6-84ca-b797d40ba573 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 200 len: 1300 microversion: 2.1 time: 0.134533 May 21 21:55:16.338928 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3223/6318] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:16 2022] GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 1300 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:16.427588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f170e691-71e3-4127-8344-d2ef842f5969 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:16.435440 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f170e691-71e3-4127-8344-d2ef842f5969 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1392 microversion: 2.1 time: 0.187937 May 21 21:55:16.436017 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3096/6319] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:16 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1392 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:55:17.228891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-22ee774a-bf02-43e8-956c-1ae14253af9e req-2786684d-e6ef-43ca-9df2-c4b65603b8db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760451e4-7a52-41d2-8a82-9596c147aeb2", "name": "network-vif-plugged", "status": "completed", "tag": "94ca576f-fd14-4ad4-aa22-7b6a584e886e"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:55:17.239221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-22ee774a-bf02-43e8-956c-1ae14253af9e req-2786684d-e6ef-43ca-9df2-c4b65603b8db service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:17.239742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-22ee774a-bf02-43e8-956c-1ae14253af9e req-2786684d-e6ef-43ca-9df2-c4b65603b8db service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:17.251233 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-22ee774a-bf02-43e8-956c-1ae14253af9e req-2786684d-e6ef-43ca-9df2-c4b65603b8db service nova] Creating event network-vif-plugged:94ca576f-fd14-4ad4-aa22-7b6a584e886e for instance 760451e4-7a52-41d2-8a82-9596c147aeb2 on nch1-master-1 May 21 21:55:17.256438 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-22ee774a-bf02-43e8-956c-1ae14253af9e req-2786684d-e6ef-43ca-9df2-c4b65603b8db service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031528 May 21 21:55:17.261691 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3224/6320] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:55:17.347487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-348c3ed6-815f-454e-9908-cf643b9aab90 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:17.348445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-348c3ed6-815f-454e-9908-cf643b9aab90 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:17.355990 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-348c3ed6-815f-454e-9908-cf643b9aab90 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:17.374520 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-348c3ed6-815f-454e-9908-cf643b9aab90 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:17.374520 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-348c3ed6-815f-454e-9908-cf643b9aab90 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:17.374520 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-348c3ed6-815f-454e-9908-cf643b9aab90 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:17.483740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-348c3ed6-815f-454e-9908-cf643b9aab90 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:17.483956 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4c2e773e-dbf3-4b0a-bfb1-542c5dae77d1 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:17.483956 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4c2e773e-dbf3-4b0a-bfb1-542c5dae77d1 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:17.484172 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-348c3ed6-815f-454e-9908-cf643b9aab90 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 200 len: 1472 microversion: 2.1 time: 0.117473 May 21 21:55:17.484172 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3097/6321] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:17 2022] GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 1472 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:17.484392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4c2e773e-dbf3-4b0a-bfb1-542c5dae77d1 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:17.484392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4c2e773e-dbf3-4b0a-bfb1-542c5dae77d1 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:17.484392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4c2e773e-dbf3-4b0a-bfb1-542c5dae77d1 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:17.484392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4c2e773e-dbf3-4b0a-bfb1-542c5dae77d1 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:17.484771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4886a90a-08fd-4860-b442-9352e395167c tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:17.484771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4886a90a-08fd-4860-b442-9352e395167c tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:17.485018 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4886a90a-08fd-4860-b442-9352e395167c tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:17.485493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4886a90a-08fd-4860-b442-9352e395167c tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:17.486149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4886a90a-08fd-4860-b442-9352e395167c tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:17.486581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4886a90a-08fd-4860-b442-9352e395167c tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:17.579361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4886a90a-08fd-4860-b442-9352e395167c tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:17.587443 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4886a90a-08fd-4860-b442-9352e395167c tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 200 len: 1472 microversion: 2.1 time: 0.113376 May 21 21:55:17.588133 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3098/6322] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:17 2022] GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 1472 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:55:17.603551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-146abfb3-abf6-4cf6-9cd2-5fa206a85f1e tempest-TestSecurityGroupsBasicOps-1465440884 tempest-TestSecurityGroupsBasicOps-1465440884-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:17.606960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-146abfb3-abf6-4cf6-9cd2-5fa206a85f1e tempest-TestSecurityGroupsBasicOps-1465440884 tempest-TestSecurityGroupsBasicOps-1465440884-project-admin] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:17.611139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-146abfb3-abf6-4cf6-9cd2-5fa206a85f1e tempest-TestSecurityGroupsBasicOps-1465440884 tempest-TestSecurityGroupsBasicOps-1465440884-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:17.611797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-146abfb3-abf6-4cf6-9cd2-5fa206a85f1e tempest-TestSecurityGroupsBasicOps-1465440884 tempest-TestSecurityGroupsBasicOps-1465440884-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:17.612680 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-146abfb3-abf6-4cf6-9cd2-5fa206a85f1e tempest-TestSecurityGroupsBasicOps-1465440884 tempest-TestSecurityGroupsBasicOps-1465440884-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:17.613296 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-146abfb3-abf6-4cf6-9cd2-5fa206a85f1e tempest-TestSecurityGroupsBasicOps-1465440884 tempest-TestSecurityGroupsBasicOps-1465440884-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:17.614615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4c2e773e-dbf3-4b0a-bfb1-542c5dae77d1 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:17.622960 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4c2e773e-dbf3-4b0a-bfb1-542c5dae77d1 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1392 microversion: 2.1 time: 0.173398 May 21 21:55:17.623552 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3225/6323] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:17 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:55:17.714260 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-146abfb3-abf6-4cf6-9cd2-5fa206a85f1e tempest-TestSecurityGroupsBasicOps-1465440884 tempest-TestSecurityGroupsBasicOps-1465440884-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 200 len: 1623 microversion: 2.1 time: 0.114184 May 21 21:55:17.714836 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3099/6324] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:17 2022] GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 1623 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:55:17.729916 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5dfed3c2-6247-40f5-996a-03b3f6370575 tempest-TestSecurityGroupsBasicOps-1465440884 tempest-TestSecurityGroupsBasicOps-1465440884-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:17.730559 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5dfed3c2-6247-40f5-996a-03b3f6370575 tempest-TestSecurityGroupsBasicOps-1465440884 tempest-TestSecurityGroupsBasicOps-1465440884-project-admin] [instance: 00720d70-9f60-4833-898c-7fa8d5ecdc70] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:17.742726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5dfed3c2-6247-40f5-996a-03b3f6370575 tempest-TestSecurityGroupsBasicOps-1465440884 tempest-TestSecurityGroupsBasicOps-1465440884-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:17.742726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5dfed3c2-6247-40f5-996a-03b3f6370575 tempest-TestSecurityGroupsBasicOps-1465440884 tempest-TestSecurityGroupsBasicOps-1465440884-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:17.742726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5dfed3c2-6247-40f5-996a-03b3f6370575 tempest-TestSecurityGroupsBasicOps-1465440884 tempest-TestSecurityGroupsBasicOps-1465440884-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:17.742726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5dfed3c2-6247-40f5-996a-03b3f6370575 tempest-TestSecurityGroupsBasicOps-1465440884 tempest-TestSecurityGroupsBasicOps-1465440884-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:17.893418 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5dfed3c2-6247-40f5-996a-03b3f6370575 tempest-TestSecurityGroupsBasicOps-1465440884 tempest-TestSecurityGroupsBasicOps-1465440884-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70" status: 200 len: 1912 microversion: 2.1 time: 0.167350 May 21 21:55:17.894014 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3226/6325] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:17 2022] GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70 => generated 1912 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:17.962078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9c2276f3-3046-484c-8974-e494709568b0 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:17.962586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9c2276f3-3046-484c-8974-e494709568b0 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:17.969417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c2276f3-3046-484c-8974-e494709568b0 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:17.969870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c2276f3-3046-484c-8974-e494709568b0 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:17.970640 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c2276f3-3046-484c-8974-e494709568b0 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:17.971080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9c2276f3-3046-484c-8974-e494709568b0 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:17.996856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9c2276f3-3046-484c-8974-e494709568b0 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:55:17.999504 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=100 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:55:18.239596 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9c2276f3-3046-484c-8974-e494709568b0 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 204 len: 0 microversion: 2.1 time: 0.280872 May 21 21:55:18.240270 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3100/6326] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:55:17 2022] DELETE /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:55:18.262113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cb0ae8b8-dc01-4fad-9423-98db6fb59b40 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:18.262113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cb0ae8b8-dc01-4fad-9423-98db6fb59b40 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:18.263612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb0ae8b8-dc01-4fad-9423-98db6fb59b40 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:18.264078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb0ae8b8-dc01-4fad-9423-98db6fb59b40 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:18.264903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb0ae8b8-dc01-4fad-9423-98db6fb59b40 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:18.265577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cb0ae8b8-dc01-4fad-9423-98db6fb59b40 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:18.356104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cb0ae8b8-dc01-4fad-9423-98db6fb59b40 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:18.364417 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cb0ae8b8-dc01-4fad-9423-98db6fb59b40 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 200 len: 1478 microversion: 2.1 time: 0.112514 May 21 21:55:18.365430 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3227/6327] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:18 2022] GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 1478 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:18.643078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-275543c7-6383-4b8f-b2e3-4e84b7cf5e1f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:18.643828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-275543c7-6383-4b8f-b2e3-4e84b7cf5e1f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:18.651035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-275543c7-6383-4b8f-b2e3-4e84b7cf5e1f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:18.653691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-275543c7-6383-4b8f-b2e3-4e84b7cf5e1f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:18.653691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-275543c7-6383-4b8f-b2e3-4e84b7cf5e1f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:18.653691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-275543c7-6383-4b8f-b2e3-4e84b7cf5e1f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:18.802800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-275543c7-6383-4b8f-b2e3-4e84b7cf5e1f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:18.810709 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-275543c7-6383-4b8f-b2e3-4e84b7cf5e1f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1392 microversion: 2.1 time: 0.173146 May 21 21:55:18.811289 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3101/6328] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:18 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:19.381926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-edaefe2d-5c6d-4f04-aee5-9e8050483ad2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:19.382571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-edaefe2d-5c6d-4f04-aee5-9e8050483ad2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:19.389777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-edaefe2d-5c6d-4f04-aee5-9e8050483ad2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:19.390947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-edaefe2d-5c6d-4f04-aee5-9e8050483ad2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:19.391907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-edaefe2d-5c6d-4f04-aee5-9e8050483ad2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:19.392392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-edaefe2d-5c6d-4f04-aee5-9e8050483ad2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:19.482604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-edaefe2d-5c6d-4f04-aee5-9e8050483ad2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:19.491158 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-edaefe2d-5c6d-4f04-aee5-9e8050483ad2 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 200 len: 1478 microversion: 2.1 time: 0.113176 May 21 21:55:19.491729 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3228/6329] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:19 2022] GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 1478 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:19.829801 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-73ee6e76-ec8c-45ce-99c6-e6a557a02550 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:19.832914 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-73ee6e76-ec8c-45ce-99c6-e6a557a02550 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:19.840676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-73ee6e76-ec8c-45ce-99c6-e6a557a02550 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:19.841124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-73ee6e76-ec8c-45ce-99c6-e6a557a02550 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:19.841908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-73ee6e76-ec8c-45ce-99c6-e6a557a02550 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:19.842347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-73ee6e76-ec8c-45ce-99c6-e6a557a02550 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:19.992383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-73ee6e76-ec8c-45ce-99c6-e6a557a02550 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:20.012247 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-73ee6e76-ec8c-45ce-99c6-e6a557a02550 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1563 microversion: 2.1 time: 0.175211 May 21 21:55:20.012247 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3102/6330] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:19 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1563 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:20.018009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2703559a-bc93-4d0c-88eb-6c35845d8ef5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:20.018716 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2703559a-bc93-4d0c-88eb-6c35845d8ef5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:20.025308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2703559a-bc93-4d0c-88eb-6c35845d8ef5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:20.025786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2703559a-bc93-4d0c-88eb-6c35845d8ef5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:20.026596 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2703559a-bc93-4d0c-88eb-6c35845d8ef5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:20.027056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2703559a-bc93-4d0c-88eb-6c35845d8ef5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:20.258171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2703559a-bc93-4d0c-88eb-6c35845d8ef5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:20.266820 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2703559a-bc93-4d0c-88eb-6c35845d8ef5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1563 microversion: 2.1 time: 0.252855 May 21 21:55:20.267409 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3229/6331] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:20 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1563 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:20.511313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-609218f1-c188-4926-a424-b1d4b1c7df05 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:20.512031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-609218f1-c188-4926-a424-b1d4b1c7df05 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:20.529449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-609218f1-c188-4926-a424-b1d4b1c7df05 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:20.530517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-609218f1-c188-4926-a424-b1d4b1c7df05 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:20.532263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-609218f1-c188-4926-a424-b1d4b1c7df05 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:20.532811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-609218f1-c188-4926-a424-b1d4b1c7df05 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:20.558502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-63a7739e-533a-4582-a0b9-58cb425d5d71 req-96456f39-76da-4fb8-836c-186f51acb65a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb", "name": "network-vif-deleted", "tag": "333fd57a-ea3a-4a3d-9352-b4f9136af3fc"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:55:20.570863 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-63a7739e-533a-4582-a0b9-58cb425d5d71 req-96456f39-76da-4fb8-836c-186f51acb65a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:20.571706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-63a7739e-533a-4582-a0b9-58cb425d5d71 req-96456f39-76da-4fb8-836c-186f51acb65a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:20.585637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=100 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:55:20.600759 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-63a7739e-533a-4582-a0b9-58cb425d5d71 req-96456f39-76da-4fb8-836c-186f51acb65a service nova] Creating event network-vif-deleted:333fd57a-ea3a-4a3d-9352-b4f9136af3fc for instance 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb on nch1-master-1 May 21 21:55:20.606313 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-63a7739e-533a-4582-a0b9-58cb425d5d71 req-96456f39-76da-4fb8-836c-186f51acb65a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052371 May 21 21:55:20.607548 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3230/6332] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:55:20.654153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-609218f1-c188-4926-a424-b1d4b1c7df05 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:20.664489 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-609218f1-c188-4926-a424-b1d4b1c7df05 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 200 len: 1478 microversion: 2.1 time: 0.157619 May 21 21:55:20.665948 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3103/6333] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:20 2022] GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 1478 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:21.683033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d5ccd0a0-5f7d-4350-ba72-8e9e60512dcd tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:21.692762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d5ccd0a0-5f7d-4350-ba72-8e9e60512dcd tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:21.693452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5ccd0a0-5f7d-4350-ba72-8e9e60512dcd tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:21.693452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5ccd0a0-5f7d-4350-ba72-8e9e60512dcd tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:21.694047 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5ccd0a0-5f7d-4350-ba72-8e9e60512dcd tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:21.694509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5ccd0a0-5f7d-4350-ba72-8e9e60512dcd tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:21.709143 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-d5ccd0a0-5f7d-4350-ba72-8e9e60512dcd tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] HTTP exception thrown: Instance 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb could not be found. May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d5ccd0a0-5f7d-4350-ba72-8e9e60512dcd tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Request method failure captured: May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb HTTP/1.1 May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiV9rwaNf5LlpspIwXq2SLBWW88u_c1tSJnN3hl9gfl2pzV_MxI3qk4fZxoMZ4dV-w24FbuEpHx3eet7hWVgwow5XZ7cXyVo21IG7t333vZrHDFEa_Q6_nFn_I7688QFPCetgqDui_VNSEIazipXuylhLmSefojJKQo0ruFGl6_L4PRk May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: d5756d4186354028bcff9c66712f5c33 May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1840850631 May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d5756d4186354028bcff9c66712f5c33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d5756d4186354028bcff9c66712f5c33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d5756d4186354028bcff9c66712f5c33", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d5756d4186354028bcff9c66712f5c33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1840850631 May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: d5756d4186354028bcff9c66712f5c33 May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1840850631 May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-TestSecurityGroupsBasicOps-1840850631-project May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: eff8b9d9ac8a487fa0ccc0a37def90ac May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1840850631-project May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb could not be found. May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb'} May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb could not be found. May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb could not be found. May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:55:21.710835 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:55:21.725458 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:55:21.725458 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:55:21.725458 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:55:21.725458 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:55:21.725458 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:55:21.725458 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb could not be found. May 21 21:55:21.725458 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:55:21.725458 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d5ccd0a0-5f7d-4350-ba72-8e9e60512dcd tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Returning 404 to user: Instance 5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:55:21.725458 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d5ccd0a0-5f7d-4350-ba72-8e9e60512dcd tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb" status: 404 len: 111 microversion: 2.1 time: 0.033780 May 21 21:55:21.725458 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3231/6334] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:21 2022] GET /compute/v2.1/servers/5e43f372-a32f-4a02-9fdd-ac6c85ee5cbb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:55:23.090647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9ba65723-4d63-4f66-a4f1-42a2d5ce03d0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:23.091275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9ba65723-4d63-4f66-a4f1-42a2d5ce03d0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:23.105635 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ba65723-4d63-4f66-a4f1-42a2d5ce03d0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:23.106372 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ba65723-4d63-4f66-a4f1-42a2d5ce03d0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:23.107361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ba65723-4d63-4f66-a4f1-42a2d5ce03d0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:23.108242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ba65723-4d63-4f66-a4f1-42a2d5ce03d0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:23.108928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-8230ce60-cf3a-4af2-9c24-82db2fde396c req-8f4c5b3f-9247-482b-a944-e53ab47a3caf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "760451e4-7a52-41d2-8a82-9596c147aeb2", "tag": "94ca576f-fd14-4ad4-aa22-7b6a584e886e"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:55:23.126306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8230ce60-cf3a-4af2-9c24-82db2fde396c req-8f4c5b3f-9247-482b-a944-e53ab47a3caf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:23.127071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8230ce60-cf3a-4af2-9c24-82db2fde396c req-8f4c5b3f-9247-482b-a944-e53ab47a3caf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:23.146644 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-8230ce60-cf3a-4af2-9c24-82db2fde396c req-8f4c5b3f-9247-482b-a944-e53ab47a3caf service nova] Creating event network-changed:94ca576f-fd14-4ad4-aa22-7b6a584e886e for instance 760451e4-7a52-41d2-8a82-9596c147aeb2 on nch1-master-1 May 21 21:55:23.153827 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-8230ce60-cf3a-4af2-9c24-82db2fde396c req-8f4c5b3f-9247-482b-a944-e53ab47a3caf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048437 May 21 21:55:23.154638 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3232/6335] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:55:23.412848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9ba65723-4d63-4f66-a4f1-42a2d5ce03d0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:23.426200 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9ba65723-4d63-4f66-a4f1-42a2d5ce03d0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1563 microversion: 2.1 time: 0.339353 May 21 21:55:23.428553 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3104/6336] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:23 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1563 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:27.891001 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-493d78b3-c817-4c9b-8aa9-2bb38637eccc tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:27.891744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-493d78b3-c817-4c9b-8aa9-2bb38637eccc tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 00720d70-9f60-4833-898c-7fa8d5ecdc70] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:27.892074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-9ded6d22-f152-45ef-8733-d09da14a10a1 req-5e03fc8f-27a2-4bcb-9cb5-97e4c0eac4ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00720d70-9f60-4833-898c-7fa8d5ecdc70", "tag": "1eb2ca65-79b7-4006-bb0e-1a0e8f150851"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:55:27.899222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-493d78b3-c817-4c9b-8aa9-2bb38637eccc tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:27.899814 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-493d78b3-c817-4c9b-8aa9-2bb38637eccc tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:27.900886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-493d78b3-c817-4c9b-8aa9-2bb38637eccc tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:27.901485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-493d78b3-c817-4c9b-8aa9-2bb38637eccc tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:27.901940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9ded6d22-f152-45ef-8733-d09da14a10a1 req-5e03fc8f-27a2-4bcb-9cb5-97e4c0eac4ef service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:27.902503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9ded6d22-f152-45ef-8733-d09da14a10a1 req-5e03fc8f-27a2-4bcb-9cb5-97e4c0eac4ef service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:27.919207 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-9ded6d22-f152-45ef-8733-d09da14a10a1 req-5e03fc8f-27a2-4bcb-9cb5-97e4c0eac4ef service nova] Creating event network-changed:1eb2ca65-79b7-4006-bb0e-1a0e8f150851 for instance 00720d70-9f60-4833-898c-7fa8d5ecdc70 on nch2-master-1 May 21 21:55:27.925129 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-9ded6d22-f152-45ef-8733-d09da14a10a1 req-5e03fc8f-27a2-4bcb-9cb5-97e4c0eac4ef service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037014 May 21 21:55:27.926045 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3105/6337] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:55:27.945579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-493d78b3-c817-4c9b-8aa9-2bb38637eccc tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 00720d70-9f60-4833-898c-7fa8d5ecdc70] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:55:28.297080 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-493d78b3-c817-4c9b-8aa9-2bb38637eccc tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "DELETE /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70" status: 204 len: 0 microversion: 2.1 time: 0.409882 May 21 21:55:28.303647 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3233/6338] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:55:27 2022] DELETE /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:55:28.314333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f2c5aedb-bd64-4983-b217-7822578b586a tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:28.315387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f2c5aedb-bd64-4983-b217-7822578b586a tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 00720d70-9f60-4833-898c-7fa8d5ecdc70] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:28.326388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2c5aedb-bd64-4983-b217-7822578b586a tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:28.326854 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2c5aedb-bd64-4983-b217-7822578b586a tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:28.328528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2c5aedb-bd64-4983-b217-7822578b586a tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:28.328970 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2c5aedb-bd64-4983-b217-7822578b586a tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:28.537974 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f2c5aedb-bd64-4983-b217-7822578b586a tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:28.546389 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f2c5aedb-bd64-4983-b217-7822578b586a tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70" status: 200 len: 1767 microversion: 2.1 time: 0.243281 May 21 21:55:28.547116 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3106/6339] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:28 2022] GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70 => generated 1767 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:29.566112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1a59eda1-e542-44b9-89ce-6ab90f6ea613 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:29.567022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1a59eda1-e542-44b9-89ce-6ab90f6ea613 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 00720d70-9f60-4833-898c-7fa8d5ecdc70] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:29.574782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a59eda1-e542-44b9-89ce-6ab90f6ea613 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:29.575247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a59eda1-e542-44b9-89ce-6ab90f6ea613 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:29.576046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a59eda1-e542-44b9-89ce-6ab90f6ea613 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:29.576569 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1a59eda1-e542-44b9-89ce-6ab90f6ea613 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:29.747466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1a59eda1-e542-44b9-89ce-6ab90f6ea613 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:29.755892 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1a59eda1-e542-44b9-89ce-6ab90f6ea613 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70" status: 200 len: 1648 microversion: 2.1 time: 0.195315 May 21 21:55:29.756553 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3234/6340] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:29 2022] GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70 => generated 1648 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:30.250418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-6e9d204e-50c6-4ada-abfa-b153ac93cc21 req-6cfeba49-5375-4f28-84aa-372bf381653d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00720d70-9f60-4833-898c-7fa8d5ecdc70", "name": "network-vif-deleted", "tag": "1eb2ca65-79b7-4006-bb0e-1a0e8f150851"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:55:30.255802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:55:30.261474 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6e9d204e-50c6-4ada-abfa-b153ac93cc21 req-6cfeba49-5375-4f28-84aa-372bf381653d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:30.261956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6e9d204e-50c6-4ada-abfa-b153ac93cc21 req-6cfeba49-5375-4f28-84aa-372bf381653d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:30.275299 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-6e9d204e-50c6-4ada-abfa-b153ac93cc21 req-6cfeba49-5375-4f28-84aa-372bf381653d service nova] Creating event network-vif-deleted:1eb2ca65-79b7-4006-bb0e-1a0e8f150851 for instance 00720d70-9f60-4833-898c-7fa8d5ecdc70 on nch2-master-1 May 21 21:55:30.281046 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-6e9d204e-50c6-4ada-abfa-b153ac93cc21 req-6cfeba49-5375-4f28-84aa-372bf381653d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033790 May 21 21:55:30.283534 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3107/6341] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:55:30.773625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f24ffaf0-207a-4777-b362-4e6759917815 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:30.774171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f24ffaf0-207a-4777-b362-4e6759917815 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 00720d70-9f60-4833-898c-7fa8d5ecdc70] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:30.781508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f24ffaf0-207a-4777-b362-4e6759917815 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:30.781979 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f24ffaf0-207a-4777-b362-4e6759917815 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:30.782772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f24ffaf0-207a-4777-b362-4e6759917815 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:30.783233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f24ffaf0-207a-4777-b362-4e6759917815 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:30.815691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f24ffaf0-207a-4777-b362-4e6759917815 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:30.816160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f24ffaf0-207a-4777-b362-4e6759917815 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:30.816668 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-f24ffaf0-207a-4777-b362-4e6759917815 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lazy-loading 'fault' on Instance uuid 00720d70-9f60-4833-898c-7fa8d5ecdc70 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:55:30.862996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f24ffaf0-207a-4777-b362-4e6759917815 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff8b9d9ac8a487fa0ccc0a37def90ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5756d4186354028bcff9c66712f5c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:30.870636 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f24ffaf0-207a-4777-b362-4e6759917815 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70" status: 200 len: 1384 microversion: 2.1 time: 0.101064 May 21 21:55:30.871212 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3235/6342] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:30 2022] GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70 => generated 1384 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:31.888263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ae163914-d1a4-4e8b-be49-2fd901af22d8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:31.889012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ae163914-d1a4-4e8b-be49-2fd901af22d8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] [instance: 00720d70-9f60-4833-898c-7fa8d5ecdc70] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:31.896945 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ae163914-d1a4-4e8b-be49-2fd901af22d8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:31.897401 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ae163914-d1a4-4e8b-be49-2fd901af22d8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:31.898182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ae163914-d1a4-4e8b-be49-2fd901af22d8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:31.898627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ae163914-d1a4-4e8b-be49-2fd901af22d8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:31.912605 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-ae163914-d1a4-4e8b-be49-2fd901af22d8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] HTTP exception thrown: Instance 00720d70-9f60-4833-898c-7fa8d5ecdc70 could not be found. May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ae163914-d1a4-4e8b-be49-2fd901af22d8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Request method failure captured: May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70 HTTP/1.1 May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiV9rwaNf5LlpspIwXq2SLBWW88u_c1tSJnN3hl9gfl2pzV_MxI3qk4fZxoMZ4dV-w24FbuEpHx3eet7hWVgwow5XZ7cXyVo21IG7t333vZrHDFEa_Q6_nFn_I7688QFPCetgqDui_VNSEIazipXuylhLmSefojJKQo0ruFGl6_L4PRk May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: d5756d4186354028bcff9c66712f5c33 May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1840850631 May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d5756d4186354028bcff9c66712f5c33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d5756d4186354028bcff9c66712f5c33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d5756d4186354028bcff9c66712f5c33", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d5756d4186354028bcff9c66712f5c33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1840850631 May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: d5756d4186354028bcff9c66712f5c33 May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1840850631 May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestSecurityGroupsBasicOps-1840850631-project May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: eff8b9d9ac8a487fa0ccc0a37def90ac May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1840850631-project May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 00720d70-9f60-4833-898c-7fa8d5ecdc70 could not be found. May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '00720d70-9f60-4833-898c-7fa8d5ecdc70'} May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00720d70-9f60-4833-898c-7fa8d5ecdc70 could not be found. May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00720d70-9f60-4833-898c-7fa8d5ecdc70 could not be found. May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:55:31.914245 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:55:31.919660 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:55:31.919660 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:55:31.919660 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:55:31.919660 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:55:31.919660 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:55:31.919660 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00720d70-9f60-4833-898c-7fa8d5ecdc70 could not be found. May 21 21:55:31.919660 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:55:31.919660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ae163914-d1a4-4e8b-be49-2fd901af22d8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Returning 404 to user: Instance 00720d70-9f60-4833-898c-7fa8d5ecdc70 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:55:31.919660 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ae163914-d1a4-4e8b-be49-2fd901af22d8 tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70" status: 404 len: 111 microversion: 2.1 time: 0.031717 May 21 21:55:31.919660 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3108/6343] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:31 2022] GET /compute/v2.1/servers/00720d70-9f60-4833-898c-7fa8d5ecdc70 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:55:36.467871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f25fbd57-6987-490c-8bc8-dbaa6551d5fd tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] Calling method '.version_select at 0x7fc81bb82160>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:36.476074 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:55:36.591723 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f25fbd57-6987-490c-8bc8-dbaa6551d5fd tempest-TestSecurityGroupsBasicOps-1840850631 tempest-TestSecurityGroupsBasicOps-1840850631-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1701115888" status: 202 len: 0 microversion: 2.1 time: 0.127976 May 21 21:55:36.592259 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3236/6344] 10.222.0.49 () {58 vars in 1277 bytes} [Sat May 21 21:55:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1701115888 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:55:42.901716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5da94eec-7f13-4c10-8db9-bccfe17492ff tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:55:42.902650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5da94eec-7f13-4c10-8db9-bccfe17492ff tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:42.905792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:55:42.911188 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5da94eec-7f13-4c10-8db9-bccfe17492ff tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:42.911643 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5da94eec-7f13-4c10-8db9-bccfe17492ff tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:42.912455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5da94eec-7f13-4c10-8db9-bccfe17492ff tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:42.912898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5da94eec-7f13-4c10-8db9-bccfe17492ff tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:42.966352 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5da94eec-7f13-4c10-8db9-bccfe17492ff tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2/action" status: 200 len: 24566 microversion: 2.1 time: 0.068393 May 21 21:55:42.966916 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3109/6345] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:55:42 2022] POST /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2/action => generated 24566 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:55:53.921451 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:55:53.926712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-51c691e1-37aa-4383-ae73-85281f909b04 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:55:53.939620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-51c691e1-37aa-4383-ae73-85281f909b04 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:53.939620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-51c691e1-37aa-4383-ae73-85281f909b04 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:53.939620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-51c691e1-37aa-4383-ae73-85281f909b04 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:53.939620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-51c691e1-37aa-4383-ae73-85281f909b04 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:53.939620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-51c691e1-37aa-4383-ae73-85281f909b04 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:54.248662 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-51c691e1-37aa-4383-ae73-85281f909b04 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:55:54.249096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-51c691e1-37aa-4383-ae73-85281f909b04 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:55:54.249583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-51c691e1-37aa-4383-ae73-85281f909b04 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:55:54.250003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-51c691e1-37aa-4383-ae73-85281f909b04 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:55:54.250429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-51c691e1-37aa-4383-ae73-85281f909b04 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:55:54.425112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-51c691e1-37aa-4383-ae73-85281f909b04 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:54.431403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-51c691e1-37aa-4383-ae73-85281f909b04 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:54.431873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-51c691e1-37aa-4383-ae73-85281f909b04 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:54.432691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-51c691e1-37aa-4383-ae73-85281f909b04 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:54.433144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-51c691e1-37aa-4383-ae73-85281f909b04 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:54.463517 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-51c691e1-37aa-4383-ae73-85281f909b04 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2/action" status: 202 len: 1136 microversion: 2.1 time: 0.543637 May 21 21:55:54.464173 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3237/6346] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:55:53 2022] POST /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2/action => generated 1136 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 21 21:55:54.480467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2df2434c-95b2-41e5-852b-cc7c0d37114e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:54.481262 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2df2434c-95b2-41e5-852b-cc7c0d37114e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:54.490918 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2df2434c-95b2-41e5-852b-cc7c0d37114e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:54.492336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2df2434c-95b2-41e5-852b-cc7c0d37114e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:54.492336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2df2434c-95b2-41e5-852b-cc7c0d37114e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:54.492701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2df2434c-95b2-41e5-852b-cc7c0d37114e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:54.772368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2df2434c-95b2-41e5-852b-cc7c0d37114e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:54.779902 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2df2434c-95b2-41e5-852b-cc7c0d37114e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1691 microversion: 2.1 time: 0.304637 May 21 21:55:54.780490 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3110/6347] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:54 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1691 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:55.798956 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-57ba3ec1-4c4a-4c39-b2c4-e824abad7cb6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:55.799730 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-57ba3ec1-4c4a-4c39-b2c4-e824abad7cb6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:55.806555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57ba3ec1-4c4a-4c39-b2c4-e824abad7cb6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:55.807018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57ba3ec1-4c4a-4c39-b2c4-e824abad7cb6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:55.807787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57ba3ec1-4c4a-4c39-b2c4-e824abad7cb6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:55.808235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-57ba3ec1-4c4a-4c39-b2c4-e824abad7cb6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:55.955050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-57ba3ec1-4c4a-4c39-b2c4-e824abad7cb6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:55.962868 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-57ba3ec1-4c4a-4c39-b2c4-e824abad7cb6 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1691 microversion: 2.1 time: 0.168470 May 21 21:55:55.970642 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3238/6348] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:55 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:56.980758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ed5e9e37-d7b6-4f2b-b4a1-9b6a1b910bdc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:56.981385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ed5e9e37-d7b6-4f2b-b4a1-9b6a1b910bdc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:56.989943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed5e9e37-d7b6-4f2b-b4a1-9b6a1b910bdc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:56.990612 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed5e9e37-d7b6-4f2b-b4a1-9b6a1b910bdc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:56.991382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed5e9e37-d7b6-4f2b-b4a1-9b6a1b910bdc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:56.991831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ed5e9e37-d7b6-4f2b-b4a1-9b6a1b910bdc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:57.138230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ed5e9e37-d7b6-4f2b-b4a1-9b6a1b910bdc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:57.146152 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ed5e9e37-d7b6-4f2b-b4a1-9b6a1b910bdc tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1691 microversion: 2.1 time: 0.169256 May 21 21:55:57.146727 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3111/6349] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:56 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:58.162954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c1df5af5-f1ab-4648-9231-595520450dac tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:58.163606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c1df5af5-f1ab-4648-9231-595520450dac tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:58.170528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1df5af5-f1ab-4648-9231-595520450dac tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:58.171004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1df5af5-f1ab-4648-9231-595520450dac tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:58.171823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1df5af5-f1ab-4648-9231-595520450dac tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:58.172308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1df5af5-f1ab-4648-9231-595520450dac tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:58.324095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c1df5af5-f1ab-4648-9231-595520450dac tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:58.332562 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c1df5af5-f1ab-4648-9231-595520450dac tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1691 microversion: 2.1 time: 0.173493 May 21 21:55:58.333140 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3239/6350] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:58 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:55:59.350162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9f10e2cd-5069-4713-ad80-f46f88dd426e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:55:59.350726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9f10e2cd-5069-4713-ad80-f46f88dd426e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:55:59.358274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f10e2cd-5069-4713-ad80-f46f88dd426e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:59.358728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f10e2cd-5069-4713-ad80-f46f88dd426e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:59.359528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f10e2cd-5069-4713-ad80-f46f88dd426e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:55:59.359967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9f10e2cd-5069-4713-ad80-f46f88dd426e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:55:59.508649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9f10e2cd-5069-4713-ad80-f46f88dd426e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:55:59.516236 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9f10e2cd-5069-4713-ad80-f46f88dd426e tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1691 microversion: 2.1 time: 0.170182 May 21 21:55:59.516840 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3112/6351] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:55:59 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:56:00.534127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-357aff7c-b20d-4c1d-8076-fffcc96ca6e9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:56:00.534926 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-357aff7c-b20d-4c1d-8076-fffcc96ca6e9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:56:00.541968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-357aff7c-b20d-4c1d-8076-fffcc96ca6e9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:00.542440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-357aff7c-b20d-4c1d-8076-fffcc96ca6e9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:00.543231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-357aff7c-b20d-4c1d-8076-fffcc96ca6e9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:00.543688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-357aff7c-b20d-4c1d-8076-fffcc96ca6e9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:00.698953 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-357aff7c-b20d-4c1d-8076-fffcc96ca6e9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:56:00.706755 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-357aff7c-b20d-4c1d-8076-fffcc96ca6e9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1691 microversion: 2.1 time: 0.176702 May 21 21:56:00.707326 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3240/6352] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:56:00 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:56:01.724529 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-051aada0-ec12-4635-a6e3-aa3b37ec8027 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:56:01.725177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-051aada0-ec12-4635-a6e3-aa3b37ec8027 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:56:01.732289 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-051aada0-ec12-4635-a6e3-aa3b37ec8027 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:01.733136 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-051aada0-ec12-4635-a6e3-aa3b37ec8027 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:01.733521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-051aada0-ec12-4635-a6e3-aa3b37ec8027 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:01.733962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-051aada0-ec12-4635-a6e3-aa3b37ec8027 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:01.881046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-051aada0-ec12-4635-a6e3-aa3b37ec8027 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:56:01.889001 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-051aada0-ec12-4635-a6e3-aa3b37ec8027 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1691 microversion: 2.1 time: 0.169036 May 21 21:56:01.889587 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3113/6353] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:56:01 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:56:02.906754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-78590575-fbae-49b0-b73b-c969c8d679ff tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:56:02.907398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-78590575-fbae-49b0-b73b-c969c8d679ff tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:56:02.914673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78590575-fbae-49b0-b73b-c969c8d679ff tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:02.915144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78590575-fbae-49b0-b73b-c969c8d679ff tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:02.915940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78590575-fbae-49b0-b73b-c969c8d679ff tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:02.916424 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-78590575-fbae-49b0-b73b-c969c8d679ff tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:03.070586 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-78590575-fbae-49b0-b73b-c969c8d679ff tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:56:03.078532 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-78590575-fbae-49b0-b73b-c969c8d679ff tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1691 microversion: 2.1 time: 0.175818 May 21 21:56:03.079115 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3241/6354] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:56:02 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:56:04.096320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1784f7f9-e6dc-47de-9335-e63a657c8330 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:56:04.096934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1784f7f9-e6dc-47de-9335-e63a657c8330 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:56:04.104937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1784f7f9-e6dc-47de-9335-e63a657c8330 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:04.105542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1784f7f9-e6dc-47de-9335-e63a657c8330 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:04.106379 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1784f7f9-e6dc-47de-9335-e63a657c8330 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:04.106853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1784f7f9-e6dc-47de-9335-e63a657c8330 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:04.254982 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1784f7f9-e6dc-47de-9335-e63a657c8330 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:56:04.264325 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1784f7f9-e6dc-47de-9335-e63a657c8330 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1691 microversion: 2.1 time: 0.172038 May 21 21:56:04.265105 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3114/6355] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:56:04 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:56:05.282124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e896d461-06f9-464f-919a-fa499643050d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:56:05.282706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e896d461-06f9-464f-919a-fa499643050d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:56:05.289992 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e896d461-06f9-464f-919a-fa499643050d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:05.290462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e896d461-06f9-464f-919a-fa499643050d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:05.291243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e896d461-06f9-464f-919a-fa499643050d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:05.291703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e896d461-06f9-464f-919a-fa499643050d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:05.441490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e896d461-06f9-464f-919a-fa499643050d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:56:05.449883 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e896d461-06f9-464f-919a-fa499643050d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1691 microversion: 2.1 time: 0.171758 May 21 21:56:05.451264 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3242/6356] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:56:05 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:56:06.467602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-199f5b84-259d-48a8-a81c-3716701843a0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:56:06.468217 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-199f5b84-259d-48a8-a81c-3716701843a0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:56:06.475902 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-199f5b84-259d-48a8-a81c-3716701843a0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:06.476405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-199f5b84-259d-48a8-a81c-3716701843a0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:06.477234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-199f5b84-259d-48a8-a81c-3716701843a0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:06.477688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-199f5b84-259d-48a8-a81c-3716701843a0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:06.632058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-199f5b84-259d-48a8-a81c-3716701843a0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:56:06.639764 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-199f5b84-259d-48a8-a81c-3716701843a0 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1691 microversion: 2.1 time: 0.176309 May 21 21:56:06.640379 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3115/6357] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:56:06 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:56:07.657295 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3490f0df-1ebc-441c-953c-f2e8877be403 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:56:07.657951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3490f0df-1ebc-441c-953c-f2e8877be403 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:56:07.666064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3490f0df-1ebc-441c-953c-f2e8877be403 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:07.669018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3490f0df-1ebc-441c-953c-f2e8877be403 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:07.669018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3490f0df-1ebc-441c-953c-f2e8877be403 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:07.669018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3490f0df-1ebc-441c-953c-f2e8877be403 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:07.822043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3490f0df-1ebc-441c-953c-f2e8877be403 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:56:07.830099 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3490f0df-1ebc-441c-953c-f2e8877be403 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1691 microversion: 2.1 time: 0.176723 May 21 21:56:07.830706 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3243/6358] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:56:07 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:56:08.846738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a334272a-d9ae-450d-99cd-d362a4505b4f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:56:08.847391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a334272a-d9ae-450d-99cd-d362a4505b4f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:56:08.855369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a334272a-d9ae-450d-99cd-d362a4505b4f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:08.856809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a334272a-d9ae-450d-99cd-d362a4505b4f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:08.856809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a334272a-d9ae-450d-99cd-d362a4505b4f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:08.857081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a334272a-d9ae-450d-99cd-d362a4505b4f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:09.003886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a334272a-d9ae-450d-99cd-d362a4505b4f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:56:09.013186 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a334272a-d9ae-450d-99cd-d362a4505b4f tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1691 microversion: 2.1 time: 0.170416 May 21 21:56:09.013773 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3116/6359] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:56:08 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:56:10.030659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4b8673f2-fc1d-44c9-ab98-f681e7698a6b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:56:10.031219 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4b8673f2-fc1d-44c9-ab98-f681e7698a6b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:56:10.039298 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4b8673f2-fc1d-44c9-ab98-f681e7698a6b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:10.039770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4b8673f2-fc1d-44c9-ab98-f681e7698a6b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:10.040598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4b8673f2-fc1d-44c9-ab98-f681e7698a6b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:10.041082 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4b8673f2-fc1d-44c9-ab98-f681e7698a6b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:10.187201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4b8673f2-fc1d-44c9-ab98-f681e7698a6b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:56:10.196171 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4b8673f2-fc1d-44c9-ab98-f681e7698a6b tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1691 microversion: 2.1 time: 0.169558 May 21 21:56:10.196777 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3244/6360] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:56:10 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:56:11.214101 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2704cb3f-ea5b-42e8-84bb-fbb2dcb150d9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:56:11.214714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2704cb3f-ea5b-42e8-84bb-fbb2dcb150d9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:56:11.224668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2704cb3f-ea5b-42e8-84bb-fbb2dcb150d9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:11.224668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2704cb3f-ea5b-42e8-84bb-fbb2dcb150d9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:11.224668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2704cb3f-ea5b-42e8-84bb-fbb2dcb150d9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:11.224668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2704cb3f-ea5b-42e8-84bb-fbb2dcb150d9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:11.377648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2704cb3f-ea5b-42e8-84bb-fbb2dcb150d9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:56:11.385482 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2704cb3f-ea5b-42e8-84bb-fbb2dcb150d9 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1691 microversion: 2.1 time: 0.175418 May 21 21:56:11.386053 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3117/6361] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:56:11 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:56:12.402970 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-499c7737-e3bc-4db2-b815-9713098c620a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:56:12.403629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-499c7737-e3bc-4db2-b815-9713098c620a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:56:12.410852 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-499c7737-e3bc-4db2-b815-9713098c620a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:12.411318 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-499c7737-e3bc-4db2-b815-9713098c620a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:12.412103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-499c7737-e3bc-4db2-b815-9713098c620a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:12.412588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-499c7737-e3bc-4db2-b815-9713098c620a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:12.561767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-499c7737-e3bc-4db2-b815-9713098c620a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:56:12.570186 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-499c7737-e3bc-4db2-b815-9713098c620a tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1697 microversion: 2.1 time: 0.170909 May 21 21:56:12.570781 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3245/6362] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:56:12 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:56:13.588462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4089dd10-80c8-4d1a-870c-b64102733b27 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:56:13.589089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4089dd10-80c8-4d1a-870c-b64102733b27 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:56:13.596310 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4089dd10-80c8-4d1a-870c-b64102733b27 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:13.602257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4089dd10-80c8-4d1a-870c-b64102733b27 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:13.602257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4089dd10-80c8-4d1a-870c-b64102733b27 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:13.602257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4089dd10-80c8-4d1a-870c-b64102733b27 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:13.746083 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4089dd10-80c8-4d1a-870c-b64102733b27 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:56:13.754087 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4089dd10-80c8-4d1a-870c-b64102733b27 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1697 microversion: 2.1 time: 0.169682 May 21 21:56:13.754704 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3118/6363] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:56:13 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:56:14.772476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aed953ef-1f7b-494f-b115-1b0faa555d96 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:56:14.773113 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aed953ef-1f7b-494f-b115-1b0faa555d96 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:56:14.779988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aed953ef-1f7b-494f-b115-1b0faa555d96 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:14.780510 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aed953ef-1f7b-494f-b115-1b0faa555d96 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:14.781301 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aed953ef-1f7b-494f-b115-1b0faa555d96 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:14.781886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aed953ef-1f7b-494f-b115-1b0faa555d96 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:14.933219 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aed953ef-1f7b-494f-b115-1b0faa555d96 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:56:14.941393 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aed953ef-1f7b-494f-b115-1b0faa555d96 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1682 microversion: 2.1 time: 0.173620 May 21 21:56:14.941910 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3246/6364] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:56:14 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:56:15.124535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-581f06c7-ca49-41de-aec5-dcc3aff26e6d req-9092a122-74e7-44af-a414-9717197e5560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760451e4-7a52-41d2-8a82-9596c147aeb2", "name": "network-vif-unplugged", "status": "completed", "tag": "94ca576f-fd14-4ad4-aa22-7b6a584e886e"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:56:15.133950 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-581f06c7-ca49-41de-aec5-dcc3aff26e6d req-9092a122-74e7-44af-a414-9717197e5560 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:15.134404 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-581f06c7-ca49-41de-aec5-dcc3aff26e6d req-9092a122-74e7-44af-a414-9717197e5560 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:15.149474 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-581f06c7-ca49-41de-aec5-dcc3aff26e6d req-9092a122-74e7-44af-a414-9717197e5560 service nova] Creating event network-vif-unplugged:94ca576f-fd14-4ad4-aa22-7b6a584e886e for instance 760451e4-7a52-41d2-8a82-9596c147aeb2 on nch1-master-1 May 21 21:56:15.154770 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-581f06c7-ca49-41de-aec5-dcc3aff26e6d req-9092a122-74e7-44af-a414-9717197e5560 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034024 May 21 21:56:15.155747 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3119/6365] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:56:17.175775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-ac0ee599-d83e-43e3-9680-2acd2a2bcfaa req-c92cb7a9-8905-428e-9adb-8e4191cf9dde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760451e4-7a52-41d2-8a82-9596c147aeb2", "name": "network-vif-plugged", "status": "completed", "tag": "94ca576f-fd14-4ad4-aa22-7b6a584e886e"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:56:17.186057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ac0ee599-d83e-43e3-9680-2acd2a2bcfaa req-c92cb7a9-8905-428e-9adb-8e4191cf9dde service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:17.186526 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ac0ee599-d83e-43e3-9680-2acd2a2bcfaa req-c92cb7a9-8905-428e-9adb-8e4191cf9dde service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:17.199403 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-ac0ee599-d83e-43e3-9680-2acd2a2bcfaa req-c92cb7a9-8905-428e-9adb-8e4191cf9dde service nova] Creating event network-vif-plugged:94ca576f-fd14-4ad4-aa22-7b6a584e886e for instance 760451e4-7a52-41d2-8a82-9596c147aeb2 on nch1-master-1 May 21 21:56:17.205254 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-ac0ee599-d83e-43e3-9680-2acd2a2bcfaa req-c92cb7a9-8905-428e-9adb-8e4191cf9dde service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032744 May 21 21:56:17.205254 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3247/6366] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:56:39.155341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=25 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:56:39.157117 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=60 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:56:39.162526 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4cb487d2-5e34-4a32-8b59-a67a9fbf2ccb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:56:39.163758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4cb487d2-5e34-4a32-8b59-a67a9fbf2ccb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:56:39.171009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cb487d2-5e34-4a32-8b59-a67a9fbf2ccb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:39.171474 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cb487d2-5e34-4a32-8b59-a67a9fbf2ccb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:39.172267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cb487d2-5e34-4a32-8b59-a67a9fbf2ccb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:39.172872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cb487d2-5e34-4a32-8b59-a67a9fbf2ccb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:39.226944 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4cb487d2-5e34-4a32-8b59-a67a9fbf2ccb tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "POST /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2/action" status: 200 len: 24570 microversion: 2.1 time: 0.074759 May 21 21:56:39.227644 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3120/6367] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:56:39 2022] POST /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2/action => generated 24570 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 21:56:46.640856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:56:46.642575 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:56:46.646249 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d52dd268-64b9-4c9c-9cf3-bde1bcc50d72 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:56:46.646483 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-59d4c396-6e40-49fd-9b6a-a0c374b198bf req-76acd54e-4268-4188-ae62-7621811a7348 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "760451e4-7a52-41d2-8a82-9596c147aeb2", "tag": "94ca576f-fd14-4ad4-aa22-7b6a584e886e"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:56:46.646917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d52dd268-64b9-4c9c-9cf3-bde1bcc50d72 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:56:46.654252 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d52dd268-64b9-4c9c-9cf3-bde1bcc50d72 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:46.655044 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d52dd268-64b9-4c9c-9cf3-bde1bcc50d72 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:46.656066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d52dd268-64b9-4c9c-9cf3-bde1bcc50d72 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:46.656560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d52dd268-64b9-4c9c-9cf3-bde1bcc50d72 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:46.658500 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-59d4c396-6e40-49fd-9b6a-a0c374b198bf req-76acd54e-4268-4188-ae62-7621811a7348 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:46.658915 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-59d4c396-6e40-49fd-9b6a-a0c374b198bf req-76acd54e-4268-4188-ae62-7621811a7348 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:46.676982 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-59d4c396-6e40-49fd-9b6a-a0c374b198bf req-76acd54e-4268-4188-ae62-7621811a7348 service nova] Creating event network-changed:94ca576f-fd14-4ad4-aa22-7b6a584e886e for instance 760451e4-7a52-41d2-8a82-9596c147aeb2 on nch1-master-1 May 21 21:56:46.684644 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-59d4c396-6e40-49fd-9b6a-a0c374b198bf req-76acd54e-4268-4188-ae62-7621811a7348 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042693 May 21 21:56:46.686471 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3121/6368] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:56:46.690818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d52dd268-64b9-4c9c-9cf3-bde1bcc50d72 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:56:47.079513 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d52dd268-64b9-4c9c-9cf3-bde1bcc50d72 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "DELETE /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 204 len: 0 microversion: 2.1 time: 0.440861 May 21 21:56:47.083919 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3248/6369] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:56:46 2022] DELETE /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:56:47.092517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6e4dc46b-0dff-4d42-967d-67c2e97db4bf tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:56:47.093316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6e4dc46b-0dff-4d42-967d-67c2e97db4bf tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:56:47.104336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e4dc46b-0dff-4d42-967d-67c2e97db4bf tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:47.107467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e4dc46b-0dff-4d42-967d-67c2e97db4bf tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:47.108214 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e4dc46b-0dff-4d42-967d-67c2e97db4bf tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:47.109234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e4dc46b-0dff-4d42-967d-67c2e97db4bf tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:47.273030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6e4dc46b-0dff-4d42-967d-67c2e97db4bf tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:56:47.281994 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6e4dc46b-0dff-4d42-967d-67c2e97db4bf tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1688 microversion: 2.1 time: 0.196212 May 21 21:56:47.282568 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3122/6370] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:56:47 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1688 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:56:48.301387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-20552fdc-c0e4-4378-9b11-8f2c2b9ba46d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:56:48.302095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-20552fdc-c0e4-4378-9b11-8f2c2b9ba46d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:56:48.310526 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20552fdc-c0e4-4378-9b11-8f2c2b9ba46d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:48.310998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20552fdc-c0e4-4378-9b11-8f2c2b9ba46d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:48.311807 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20552fdc-c0e4-4378-9b11-8f2c2b9ba46d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:48.312272 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20552fdc-c0e4-4378-9b11-8f2c2b9ba46d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:48.513747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-20552fdc-c0e4-4378-9b11-8f2c2b9ba46d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:56:48.522378 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-20552fdc-c0e4-4378-9b11-8f2c2b9ba46d tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1688 microversion: 2.1 time: 0.225332 May 21 21:56:48.533115 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3249/6371] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:56:48 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1688 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:56:49.100616 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-80af136f-69d2-404d-b0fd-5d0fd116790f req-3c6d7a45-52a3-4ea7-846e-8776959d0158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760451e4-7a52-41d2-8a82-9596c147aeb2", "name": "network-vif-deleted", "tag": "94ca576f-fd14-4ad4-aa22-7b6a584e886e"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:56:49.110394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-80af136f-69d2-404d-b0fd-5d0fd116790f req-3c6d7a45-52a3-4ea7-846e-8776959d0158 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:49.110846 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-80af136f-69d2-404d-b0fd-5d0fd116790f req-3c6d7a45-52a3-4ea7-846e-8776959d0158 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:49.122061 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-80af136f-69d2-404d-b0fd-5d0fd116790f req-3c6d7a45-52a3-4ea7-846e-8776959d0158 service nova] Creating event network-vif-deleted:94ca576f-fd14-4ad4-aa22-7b6a584e886e for instance 760451e4-7a52-41d2-8a82-9596c147aeb2 on nch1-master-1 May 21 21:56:49.126993 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-80af136f-69d2-404d-b0fd-5d0fd116790f req-3c6d7a45-52a3-4ea7-846e-8776959d0158 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030240 May 21 21:56:49.127583 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3123/6372] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:56:49.548225 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-43e8001c-f570-4ad0-848a-b178c687c511 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:56:49.548873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-43e8001c-f570-4ad0-848a-b178c687c511 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:56:49.557098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43e8001c-f570-4ad0-848a-b178c687c511 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:49.557563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43e8001c-f570-4ad0-848a-b178c687c511 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:49.558336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43e8001c-f570-4ad0-848a-b178c687c511 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:49.558823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43e8001c-f570-4ad0-848a-b178c687c511 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:49.591200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43e8001c-f570-4ad0-848a-b178c687c511 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:49.591660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-43e8001c-f570-4ad0-848a-b178c687c511 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:49.592121 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-43e8001c-f570-4ad0-848a-b178c687c511 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lazy-loading 'fault' on Instance uuid 760451e4-7a52-41d2-8a82-9596c147aeb2 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:56:49.638774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-43e8001c-f570-4ad0-848a-b178c687c511 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3083c05994cd4f599a2def7fa1281d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2e8e3a4821406893ebe9c189311cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:56:49.645413 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-43e8001c-f570-4ad0-848a-b178c687c511 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 200 len: 1356 microversion: 2.1 time: 0.101089 May 21 21:56:49.645986 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3250/6373] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:56:49 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 1356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:56:50.664818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b65bf2c9-0334-4b87-85db-42b10dd260d5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:56:50.665559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b65bf2c9-0334-4b87-85db-42b10dd260d5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] [instance: 760451e4-7a52-41d2-8a82-9596c147aeb2] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:56:50.672197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b65bf2c9-0334-4b87-85db-42b10dd260d5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:50.677155 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b65bf2c9-0334-4b87-85db-42b10dd260d5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:50.677155 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b65bf2c9-0334-4b87-85db-42b10dd260d5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:56:50.677155 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b65bf2c9-0334-4b87-85db-42b10dd260d5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:56:50.689381 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-b65bf2c9-0334-4b87-85db-42b10dd260d5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] HTTP exception thrown: Instance 760451e4-7a52-41d2-8a82-9596c147aeb2 could not be found. May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b65bf2c9-0334-4b87-85db-42b10dd260d5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Request method failure captured: May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 HTTP/1.1 May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiV5VnUrknEwJKQM-WmDDXb2WufWDMrIUBPERVQo0MOrFG494HmHdgIu5jdLUtPa4_DBj5sq24NqkmSSt6MexXklLlGmt5CTgD8iXAEeAGP0tG9opX27ER-CIt0-AlckG2ItDlVMH5gqQmzk8JSj3q6SbbQAXv8Oz4tAeyuiI7B1mjck May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 3b2e8e3a4821406893ebe9c189311cbf May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1083505785 May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3b2e8e3a4821406893ebe9c189311cbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b2e8e3a4821406893ebe9c189311cbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3b2e8e3a4821406893ebe9c189311cbf", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3b2e8e3a4821406893ebe9c189311cbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1083505785 May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 3b2e8e3a4821406893ebe9c189311cbf May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1083505785 May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestNetworkAdvancedServerOps-1083505785-project May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 3083c05994cd4f599a2def7fa1281d60 May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1083505785-project May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 760451e4-7a52-41d2-8a82-9596c147aeb2 could not be found. May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '760451e4-7a52-41d2-8a82-9596c147aeb2'} May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 760451e4-7a52-41d2-8a82-9596c147aeb2 could not be found. May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 760451e4-7a52-41d2-8a82-9596c147aeb2 could not be found. May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:56:50.691029 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:56:50.696851 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:56:50.696851 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:56:50.696851 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:56:50.696851 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:56:50.696851 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:56:50.696851 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:56:50.696851 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 760451e4-7a52-41d2-8a82-9596c147aeb2 could not be found. May 21 21:56:50.696851 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:56:50.696851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b65bf2c9-0334-4b87-85db-42b10dd260d5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Returning 404 to user: Instance 760451e4-7a52-41d2-8a82-9596c147aeb2 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:56:50.696851 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b65bf2c9-0334-4b87-85db-42b10dd260d5 tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2" status: 404 len: 111 microversion: 2.1 time: 0.033697 May 21 21:56:50.696851 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3124/6374] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:56:50 2022] GET /compute/v2.1/servers/760451e4-7a52-41d2-8a82-9596c147aeb2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:56:54.874160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-966b3339-d2ed-4352-8a83-5cb011448a6c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] Calling method '.version_select at 0x7fc81b3cae50>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:56:54.944737 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-966b3339-d2ed-4352-8a83-5cb011448a6c tempest-TestNetworkAdvancedServerOps-1083505785 tempest-TestNetworkAdvancedServerOps-1083505785-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2051519271" status: 202 len: 0 microversion: 2.1 time: 0.074391 May 21 21:56:54.945847 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3251/6375] 10.222.0.49 () {58 vars in 1283 bytes} [Sat May 21 21:56:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2051519271 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:57:26.324143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:57:26.324881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-65a0a027-8009-4d4a-934a-808486afbd26 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:57:26.325326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-65a0a027-8009-4d4a-934a-808486afbd26 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] [instance: f62763ca-182d-4287-acbf-2e90ec712910] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:57:26.325915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:57:26.329412 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=10 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:57:26.330077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=16 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:57:26.330220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-61376869-0ce9-4400-89bc-1c49f63c2d3d req-df71fdee-f7a5-40d7-8d61-a933fd9120d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f62763ca-182d-4287-acbf-2e90ec712910", "tag": "f1aa8f72-5b24-4df3-a09d-7e4ff4e2f403"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:57:26.334310 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65a0a027-8009-4d4a-934a-808486afbd26 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:57:26.334993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65a0a027-8009-4d4a-934a-808486afbd26 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:57:26.336592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65a0a027-8009-4d4a-934a-808486afbd26 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:57:26.337162 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65a0a027-8009-4d4a-934a-808486afbd26 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:57:26.340431 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-61376869-0ce9-4400-89bc-1c49f63c2d3d req-df71fdee-f7a5-40d7-8d61-a933fd9120d7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:57:26.342126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-61376869-0ce9-4400-89bc-1c49f63c2d3d req-df71fdee-f7a5-40d7-8d61-a933fd9120d7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:57:26.352214 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-61376869-0ce9-4400-89bc-1c49f63c2d3d req-df71fdee-f7a5-40d7-8d61-a933fd9120d7 service nova] Creating event network-changed:f1aa8f72-5b24-4df3-a09d-7e4ff4e2f403 for instance f62763ca-182d-4287-acbf-2e90ec712910 on nch2-master-1 May 21 21:57:26.358337 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-61376869-0ce9-4400-89bc-1c49f63c2d3d req-df71fdee-f7a5-40d7-8d61-a933fd9120d7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035977 May 21 21:57:26.358939 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3252/6376] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:57:26.366968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-65a0a027-8009-4d4a-934a-808486afbd26 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] [instance: f62763ca-182d-4287-acbf-2e90ec712910] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:57:26.704986 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-65a0a027-8009-4d4a-934a-808486afbd26 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910" status: 204 len: 0 microversion: 2.1 time: 0.384078 May 21 21:57:26.706034 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3125/6377] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:57:26 2022] DELETE /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:57:26.715134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ce35236a-0c52-4b84-b04e-e57c1c324f54 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:57:26.719638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ce35236a-0c52-4b84-b04e-e57c1c324f54 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] [instance: f62763ca-182d-4287-acbf-2e90ec712910] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:57:26.725659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce35236a-0c52-4b84-b04e-e57c1c324f54 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:57:26.726166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce35236a-0c52-4b84-b04e-e57c1c324f54 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:57:26.727201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce35236a-0c52-4b84-b04e-e57c1c324f54 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:57:26.727653 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce35236a-0c52-4b84-b04e-e57c1c324f54 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:57:26.891015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ce35236a-0c52-4b84-b04e-e57c1c324f54 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0237a781634974ba77b9ef00d52643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89f6a9532254e5e80e19ae3e367bceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:57:26.898683 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ce35236a-0c52-4b84-b04e-e57c1c324f54 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] 10.222.0.49 "GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910" status: 200 len: 1583 microversion: 2.1 time: 0.188238 May 21 21:57:26.899256 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3253/6378] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:57:26 2022] GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910 => generated 1583 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:57:27.917952 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-61268588-5115-4431-9b53-55eeb3b5fe28 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:57:27.918699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-61268588-5115-4431-9b53-55eeb3b5fe28 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] [instance: f62763ca-182d-4287-acbf-2e90ec712910] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:57:27.925796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61268588-5115-4431-9b53-55eeb3b5fe28 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:57:27.926255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61268588-5115-4431-9b53-55eeb3b5fe28 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:57:27.927030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61268588-5115-4431-9b53-55eeb3b5fe28 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:57:27.927468 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-61268588-5115-4431-9b53-55eeb3b5fe28 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:57:28.074733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-61268588-5115-4431-9b53-55eeb3b5fe28 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0237a781634974ba77b9ef00d52643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89f6a9532254e5e80e19ae3e367bceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:57:28.082376 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-61268588-5115-4431-9b53-55eeb3b5fe28 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] 10.222.0.49 "GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910" status: 200 len: 1464 microversion: 2.1 time: 0.168935 May 21 21:57:28.082949 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3126/6379] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:57:27 2022] GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910 => generated 1464 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:57:28.883426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-1b26798f-c799-4879-8dea-ad4854cbe614 req-75b5b2a6-b11f-4148-9196-df3ba0acda84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f62763ca-182d-4287-acbf-2e90ec712910", "name": "network-vif-deleted", "tag": "f1aa8f72-5b24-4df3-a09d-7e4ff4e2f403"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:57:28.892519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-1b26798f-c799-4879-8dea-ad4854cbe614 req-75b5b2a6-b11f-4148-9196-df3ba0acda84 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:57:28.895340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-1b26798f-c799-4879-8dea-ad4854cbe614 req-75b5b2a6-b11f-4148-9196-df3ba0acda84 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:57:28.905054 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-1b26798f-c799-4879-8dea-ad4854cbe614 req-75b5b2a6-b11f-4148-9196-df3ba0acda84 service nova] Creating event network-vif-deleted:f1aa8f72-5b24-4df3-a09d-7e4ff4e2f403 for instance f62763ca-182d-4287-acbf-2e90ec712910 on nch2-master-1 May 21 21:57:28.909971 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-1b26798f-c799-4879-8dea-ad4854cbe614 req-75b5b2a6-b11f-4148-9196-df3ba0acda84 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030388 May 21 21:57:28.910552 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3254/6380] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:57:29.100150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c4a30dc8-ef5e-427a-b96e-4acc6a8e1130 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:57:29.100802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c4a30dc8-ef5e-427a-b96e-4acc6a8e1130 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] [instance: f62763ca-182d-4287-acbf-2e90ec712910] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:57:29.107922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4a30dc8-ef5e-427a-b96e-4acc6a8e1130 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:57:29.108523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4a30dc8-ef5e-427a-b96e-4acc6a8e1130 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:57:29.109244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4a30dc8-ef5e-427a-b96e-4acc6a8e1130 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:57:29.109691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4a30dc8-ef5e-427a-b96e-4acc6a8e1130 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:57:29.182008 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c4a30dc8-ef5e-427a-b96e-4acc6a8e1130 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0237a781634974ba77b9ef00d52643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e89f6a9532254e5e80e19ae3e367bceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:57:29.190992 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c4a30dc8-ef5e-427a-b96e-4acc6a8e1130 tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] 10.222.0.49 "GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910" status: 200 len: 1229 microversion: 2.1 time: 0.094704 May 21 21:57:29.192323 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3127/6381] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:57:29 2022] GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910 => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:57:30.210767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4e0aad8f-570f-413c-b0fb-f3b89df5bebf tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:57:30.211392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4e0aad8f-570f-413c-b0fb-f3b89df5bebf tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] [instance: f62763ca-182d-4287-acbf-2e90ec712910] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:57:30.218998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e0aad8f-570f-413c-b0fb-f3b89df5bebf tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:57:30.219461 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e0aad8f-570f-413c-b0fb-f3b89df5bebf tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:57:30.220240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e0aad8f-570f-413c-b0fb-f3b89df5bebf tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:57:30.220724 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e0aad8f-570f-413c-b0fb-f3b89df5bebf tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:57:30.234510 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-4e0aad8f-570f-413c-b0fb-f3b89df5bebf tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] HTTP exception thrown: Instance f62763ca-182d-4287-acbf-2e90ec712910 could not be found. May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4e0aad8f-570f-413c-b0fb-f3b89df5bebf tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Request method failure captured: May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910 HTTP/1.1 May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiV7JfqFlN6WxPZ8q-nixL8-xR_OQ5BNeP8JIUBglpA9BacBTkHnftfr_LYDuzn8noTZsglic_wvMLXFRTiRO0zemDuTV3cILvPPI1OFnhjlvXAjdauxSqmefOUCnQinxqRVbUoL_bc0rXjfHnQY_dZnAu-IGz76wR4ocRNU0OALrQn0 May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: e89f6a9532254e5e80e19ae3e367bceb May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-TestVolumeBackupRestore-1087879388 May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e89f6a9532254e5e80e19ae3e367bceb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e89f6a9532254e5e80e19ae3e367bceb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e89f6a9532254e5e80e19ae3e367bceb", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e89f6a9532254e5e80e19ae3e367bceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-TestVolumeBackupRestore-1087879388 May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: e89f6a9532254e5e80e19ae3e367bceb May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1087879388 May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-TestVolumeBackupRestore-1087879388-project May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: bb0237a781634974ba77b9ef00d52643 May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-TestVolumeBackupRestore-1087879388-project May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance f62763ca-182d-4287-acbf-2e90ec712910 could not be found. May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'f62763ca-182d-4287-acbf-2e90ec712910'} May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f62763ca-182d-4287-acbf-2e90ec712910 could not be found. May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f62763ca-182d-4287-acbf-2e90ec712910 could not be found. May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:57:30.236164 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:57:30.241854 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:57:30.241854 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:57:30.241854 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:57:30.241854 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:57:30.241854 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:57:30.241854 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f62763ca-182d-4287-acbf-2e90ec712910 could not be found. May 21 21:57:30.241854 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:57:30.241854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4e0aad8f-570f-413c-b0fb-f3b89df5bebf tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Returning 404 to user: Instance f62763ca-182d-4287-acbf-2e90ec712910 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:57:30.241854 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4e0aad8f-570f-413c-b0fb-f3b89df5bebf tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] 10.222.0.49 "GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910" status: 404 len: 111 microversion: 2.1 time: 0.032549 May 21 21:57:30.241854 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3255/6382] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:57:30 2022] GET /compute/v2.1/servers/f62763ca-182d-4287-acbf-2e90ec712910 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:57:30.508251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5c88c875-79d8-4108-9c64-d2897aba537f tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] Calling method '.version_select at 0x7fc819f1b700>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:57:30.595672 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5c88c875-79d8-4108-9c64-d2897aba537f tempest-TestVolumeBackupRestore-1087879388 tempest-TestVolumeBackupRestore-1087879388-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1849980444" status: 202 len: 0 microversion: 2.1 time: 0.091390 May 21 21:57:30.596368 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3128/6383] 10.222.0.49 () {58 vars in 1268 bytes} [Sat May 21 21:57:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1849980444 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:58:06.102600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=8 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:58:06.103302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=12 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:58:06.216952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-86426dcc-e94f-44a7-8455-ace636106a9a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1346860982", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:58:06.268880 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-86426dcc-e94f-44a7-8455-ace636106a9a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] validate_networks() for None {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:58:06.615911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-86426dcc-e94f-44a7-8455-ace636106a9a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:58:06.616403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-86426dcc-e94f-44a7-8455-ace636106a9a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:58:06.616937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-86426dcc-e94f-44a7-8455-ace636106a9a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:58:06.617370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-86426dcc-e94f-44a7-8455-ace636106a9a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:58:06.617839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-86426dcc-e94f-44a7-8455-ace636106a9a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:58:06.627191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86426dcc-e94f-44a7-8455-ace636106a9a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:06.627682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86426dcc-e94f-44a7-8455-ace636106a9a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:06.628553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86426dcc-e94f-44a7-8455-ace636106a9a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:06.629014 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-86426dcc-e94f-44a7-8455-ace636106a9a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:06.646322 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-86426dcc-e94f-44a7-8455-ace636106a9a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Getting quotas for project 4e7c578e48404ccaa1e26d49c6d21711. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:58:06.652636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-86426dcc-e94f-44a7-8455-ace636106a9a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Getting quotas for user 20da1409d6444f58b86ef5800d9c5d26 and project 4e7c578e48404ccaa1e26d49c6d21711. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:58:06.665349 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-86426dcc-e94f-44a7-8455-ace636106a9a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:58:06.668497 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-86426dcc-e94f-44a7-8455-ace636106a9a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:58:06.766541 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-86426dcc-e94f-44a7-8455-ace636106a9a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668919 May 21 21:58:06.767198 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3256/6384] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:58:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:58:06.776885 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:58:06.777831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:58:06.782725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-56cb8bbd-e405-4da9-b435-291dbb94b03c tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:06.783361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-56cb8bbd-e405-4da9-b435-291dbb94b03c tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:06.842779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-56cb8bbd-e405-4da9-b435-291dbb94b03c tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da1409d6444f58b86ef5800d9c5d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c578e48404ccaa1e26d49c6d21711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:06.851819 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-56cb8bbd-e405-4da9-b435-291dbb94b03c tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] 10.222.0.49 "GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81" status: 200 len: 1222 microversion: 2.1 time: 0.078315 May 21 21:58:06.852817 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3129/6385] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:06 2022] GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:07.871176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ab05e934-13f3-418d-a34c-1122f277cc07 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:07.871854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ab05e934-13f3-418d-a34c-1122f277cc07 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:07.928119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ab05e934-13f3-418d-a34c-1122f277cc07 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da1409d6444f58b86ef5800d9c5d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c578e48404ccaa1e26d49c6d21711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:07.936561 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ab05e934-13f3-418d-a34c-1122f277cc07 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] 10.222.0.49 "GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81" status: 200 len: 1222 microversion: 2.1 time: 0.071064 May 21 21:58:07.937147 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3257/6386] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:07 2022] GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81 => generated 1222 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:08.954916 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8960c0a6-eeee-4af6-9caa-4c3ba0683ea6 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:08.955496 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8960c0a6-eeee-4af6-9caa-4c3ba0683ea6 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:08.964984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8960c0a6-eeee-4af6-9caa-4c3ba0683ea6 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:08.965440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8960c0a6-eeee-4af6-9caa-4c3ba0683ea6 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:08.966225 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8960c0a6-eeee-4af6-9caa-4c3ba0683ea6 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:08.966660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8960c0a6-eeee-4af6-9caa-4c3ba0683ea6 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:09.047799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8960c0a6-eeee-4af6-9caa-4c3ba0683ea6 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da1409d6444f58b86ef5800d9c5d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c578e48404ccaa1e26d49c6d21711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:09.057825 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8960c0a6-eeee-4af6-9caa-4c3ba0683ea6 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] 10.222.0.49 "GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81" status: 200 len: 1282 microversion: 2.1 time: 0.106776 May 21 21:58:09.058943 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3130/6387] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:08 2022] GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81 => generated 1282 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:10.084948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-48b9996b-d28a-4797-8e5a-b53821106970 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:10.085565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-48b9996b-d28a-4797-8e5a-b53821106970 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:10.093463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48b9996b-d28a-4797-8e5a-b53821106970 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:10.094028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48b9996b-d28a-4797-8e5a-b53821106970 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:10.094925 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48b9996b-d28a-4797-8e5a-b53821106970 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:10.095653 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-48b9996b-d28a-4797-8e5a-b53821106970 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:10.256826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-48b9996b-d28a-4797-8e5a-b53821106970 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da1409d6444f58b86ef5800d9c5d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c578e48404ccaa1e26d49c6d21711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:10.264963 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-48b9996b-d28a-4797-8e5a-b53821106970 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] 10.222.0.49 "GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81" status: 200 len: 1322 microversion: 2.1 time: 0.184667 May 21 21:58:10.265730 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3258/6388] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:10 2022] GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:11.201893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-07a8b9d7-a756-4703-9cc8-ba70ba4d4929 req-0c6af555-a7af-46c3-917c-d67be76a4b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4ae57eb-6c99-479a-9510-15b753b1ff81", "tag": "69fd5c25-6b34-4e63-a69a-3e8cc29178e2"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:58:11.213690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-07a8b9d7-a756-4703-9cc8-ba70ba4d4929 req-0c6af555-a7af-46c3-917c-d67be76a4b71 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:11.214240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-07a8b9d7-a756-4703-9cc8-ba70ba4d4929 req-0c6af555-a7af-46c3-917c-d67be76a4b71 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:11.225675 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-07a8b9d7-a756-4703-9cc8-ba70ba4d4929 req-0c6af555-a7af-46c3-917c-d67be76a4b71 service nova] Creating event network-changed:69fd5c25-6b34-4e63-a69a-3e8cc29178e2 for instance d4ae57eb-6c99-479a-9510-15b753b1ff81 on nch1-master-1 May 21 21:58:11.231851 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-07a8b9d7-a756-4703-9cc8-ba70ba4d4929 req-0c6af555-a7af-46c3-917c-d67be76a4b71 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033570 May 21 21:58:11.232268 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3131/6389] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:58:11.282555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ecfd35c5-90de-49ea-847d-22289ac2e268 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:11.283798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ecfd35c5-90de-49ea-847d-22289ac2e268 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:11.291655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ecfd35c5-90de-49ea-847d-22289ac2e268 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:11.292379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ecfd35c5-90de-49ea-847d-22289ac2e268 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:11.293186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ecfd35c5-90de-49ea-847d-22289ac2e268 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:11.293634 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ecfd35c5-90de-49ea-847d-22289ac2e268 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:11.542386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ecfd35c5-90de-49ea-847d-22289ac2e268 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da1409d6444f58b86ef5800d9c5d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c578e48404ccaa1e26d49c6d21711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:11.550302 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ecfd35c5-90de-49ea-847d-22289ac2e268 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] 10.222.0.49 "GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81" status: 200 len: 1322 microversion: 2.1 time: 0.271651 May 21 21:58:11.555606 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3259/6390] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:11 2022] GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:12.568899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-04864667-61f3-4d3b-9d26-fc64ff0c880b tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:12.569636 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-04864667-61f3-4d3b-9d26-fc64ff0c880b tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:12.576544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04864667-61f3-4d3b-9d26-fc64ff0c880b tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:12.577000 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04864667-61f3-4d3b-9d26-fc64ff0c880b tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:12.577765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04864667-61f3-4d3b-9d26-fc64ff0c880b tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:12.578203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04864667-61f3-4d3b-9d26-fc64ff0c880b tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:12.722248 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-04864667-61f3-4d3b-9d26-fc64ff0c880b tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da1409d6444f58b86ef5800d9c5d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c578e48404ccaa1e26d49c6d21711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:12.730327 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-04864667-61f3-4d3b-9d26-fc64ff0c880b tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] 10.222.0.49 "GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81" status: 200 len: 1322 microversion: 2.1 time: 0.166555 May 21 21:58:12.730899 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3132/6391] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:12 2022] GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:13.747700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0d2cdfea-de65-41f5-9973-af3c9f9c32e5 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:13.748260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0d2cdfea-de65-41f5-9973-af3c9f9c32e5 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:13.755128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d2cdfea-de65-41f5-9973-af3c9f9c32e5 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:13.755592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d2cdfea-de65-41f5-9973-af3c9f9c32e5 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:13.756409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d2cdfea-de65-41f5-9973-af3c9f9c32e5 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:13.756868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d2cdfea-de65-41f5-9973-af3c9f9c32e5 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:13.901451 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0d2cdfea-de65-41f5-9973-af3c9f9c32e5 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da1409d6444f58b86ef5800d9c5d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c578e48404ccaa1e26d49c6d21711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:13.909179 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0d2cdfea-de65-41f5-9973-af3c9f9c32e5 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] 10.222.0.49 "GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81" status: 200 len: 1322 microversion: 2.1 time: 0.166013 May 21 21:58:13.909747 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3260/6392] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:13 2022] GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:14.926846 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c10a3fb4-5df9-4a5e-a0e9-9dbba0e475bc tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:14.927470 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c10a3fb4-5df9-4a5e-a0e9-9dbba0e475bc tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:14.934663 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c10a3fb4-5df9-4a5e-a0e9-9dbba0e475bc tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:14.935068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c10a3fb4-5df9-4a5e-a0e9-9dbba0e475bc tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:14.935886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c10a3fb4-5df9-4a5e-a0e9-9dbba0e475bc tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:14.936364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c10a3fb4-5df9-4a5e-a0e9-9dbba0e475bc tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:15.089030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c10a3fb4-5df9-4a5e-a0e9-9dbba0e475bc tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da1409d6444f58b86ef5800d9c5d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c578e48404ccaa1e26d49c6d21711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:15.096503 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c10a3fb4-5df9-4a5e-a0e9-9dbba0e475bc tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] 10.222.0.49 "GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81" status: 200 len: 1322 microversion: 2.1 time: 0.173625 May 21 21:58:15.097074 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3133/6393] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:14 2022] GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:16.113720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7cf4cc0a-e8a4-42ad-8a97-c4c1ebdaef20 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:16.114328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7cf4cc0a-e8a4-42ad-8a97-c4c1ebdaef20 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:16.121618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7cf4cc0a-e8a4-42ad-8a97-c4c1ebdaef20 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:16.122086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7cf4cc0a-e8a4-42ad-8a97-c4c1ebdaef20 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:16.122872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7cf4cc0a-e8a4-42ad-8a97-c4c1ebdaef20 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:16.123336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7cf4cc0a-e8a4-42ad-8a97-c4c1ebdaef20 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:16.271659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7cf4cc0a-e8a4-42ad-8a97-c4c1ebdaef20 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da1409d6444f58b86ef5800d9c5d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c578e48404ccaa1e26d49c6d21711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:16.271659 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7cf4cc0a-e8a4-42ad-8a97-c4c1ebdaef20 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] 10.222.0.49 "GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81" status: 200 len: 1322 microversion: 2.1 time: 0.160472 May 21 21:58:16.271659 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3261/6394] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:16 2022] GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:17.287175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e0ca80cf-eedd-43c6-80a4-a41da954e176 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:17.287736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e0ca80cf-eedd-43c6-80a4-a41da954e176 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:17.290651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:58:17.296268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0ca80cf-eedd-43c6-80a4-a41da954e176 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:17.296749 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0ca80cf-eedd-43c6-80a4-a41da954e176 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:17.297515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0ca80cf-eedd-43c6-80a4-a41da954e176 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:17.297954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0ca80cf-eedd-43c6-80a4-a41da954e176 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:17.444792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e0ca80cf-eedd-43c6-80a4-a41da954e176 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da1409d6444f58b86ef5800d9c5d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c578e48404ccaa1e26d49c6d21711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:17.453095 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e0ca80cf-eedd-43c6-80a4-a41da954e176 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] 10.222.0.49 "GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81" status: 200 len: 1322 microversion: 2.1 time: 0.170015 May 21 21:58:17.453679 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3134/6395] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:17 2022] GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:17.628898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:58:17.694037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-4e3f2f92-3367-487e-8410-77615dad43f2 req-96d0a191-e498-4675-8f0b-c04e14696194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ae57eb-6c99-479a-9510-15b753b1ff81", "name": "network-vif-plugged", "status": "completed", "tag": "69fd5c25-6b34-4e63-a69a-3e8cc29178e2"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:58:17.703738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-4e3f2f92-3367-487e-8410-77615dad43f2 req-96d0a191-e498-4675-8f0b-c04e14696194 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:17.704233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-4e3f2f92-3367-487e-8410-77615dad43f2 req-96d0a191-e498-4675-8f0b-c04e14696194 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:17.715312 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-4e3f2f92-3367-487e-8410-77615dad43f2 req-96d0a191-e498-4675-8f0b-c04e14696194 service nova] Creating event network-vif-plugged:69fd5c25-6b34-4e63-a69a-3e8cc29178e2 for instance d4ae57eb-6c99-479a-9510-15b753b1ff81 on nch1-master-1 May 21 21:58:17.720413 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-4e3f2f92-3367-487e-8410-77615dad43f2 req-96d0a191-e498-4675-8f0b-c04e14696194 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096137 May 21 21:58:17.721001 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3262/6396] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:58:18.470009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ceb061f7-0036-47b3-8b3e-833e743b674d tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:18.470631 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ceb061f7-0036-47b3-8b3e-833e743b674d tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:18.477762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ceb061f7-0036-47b3-8b3e-833e743b674d tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:18.478217 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ceb061f7-0036-47b3-8b3e-833e743b674d tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:18.482203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ceb061f7-0036-47b3-8b3e-833e743b674d tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:18.482203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ceb061f7-0036-47b3-8b3e-833e743b674d tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:18.625553 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ceb061f7-0036-47b3-8b3e-833e743b674d tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da1409d6444f58b86ef5800d9c5d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c578e48404ccaa1e26d49c6d21711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:18.633187 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ceb061f7-0036-47b3-8b3e-833e743b674d tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] 10.222.0.49 "GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81" status: 200 len: 1322 microversion: 2.1 time: 0.167164 May 21 21:58:18.633769 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3135/6397] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:18 2022] GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:19.648235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=8 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:58:19.654144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-87e9211f-40be-4d4b-9c41-d2144410710d tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:19.654867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-87e9211f-40be-4d4b-9c41-d2144410710d tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:19.661287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87e9211f-40be-4d4b-9c41-d2144410710d tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:19.663410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87e9211f-40be-4d4b-9c41-d2144410710d tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:19.663410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87e9211f-40be-4d4b-9c41-d2144410710d tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:19.663410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87e9211f-40be-4d4b-9c41-d2144410710d tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:19.805960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-87e9211f-40be-4d4b-9c41-d2144410710d tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da1409d6444f58b86ef5800d9c5d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c578e48404ccaa1e26d49c6d21711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:19.817481 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-87e9211f-40be-4d4b-9c41-d2144410710d tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] 10.222.0.49 "GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81" status: 200 len: 1472 microversion: 2.1 time: 0.170122 May 21 21:58:19.818246 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3263/6398] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:19 2022] GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81 => generated 1472 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:19.894123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-536a6b3e-778d-44c7-ba86-bceb9aed93c0 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Calling method '.version_select at 0x7fc819eae280>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:19.959691 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-536a6b3e-778d-44c7-ba86-bceb9aed93c0 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/6e962318915949c892ed4db958164f10" status: 200 len: 371 microversion: 2.1 time: 0.125694 May 21 21:58:19.960264 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3136/6399] 10.222.0.49 () {58 vars in 1241 bytes} [Sat May 21 21:58:19 2022] GET /compute/v2.1/os-quota-sets/6e962318915949c892ed4db958164f10 => generated 371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:58:19.970804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ea4cf33d-50ca-40fe-8084-93d331dd6f1e tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1488637293", "id": 101066095, "os-flavor-access:is_public": "True"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:58:19.972423 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:58:19.972423 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:58:20.039938 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ea4cf33d-50ca-40fe-8084-93d331dd6f1e tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.072828 May 21 21:58:20.040532 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3264/6400] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:58:19 2022] POST /compute/v2.1/flavors => generated 435 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:58:20.051185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d0950faf-0dee-41da-8130-ca87d93464df tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "101066095"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:58:20.052160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d0950faf-0dee-41da-8130-ca87d93464df tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:20.058368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0950faf-0dee-41da-8130-ca87d93464df tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:20.059763 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0950faf-0dee-41da-8130-ca87d93464df tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:20.060566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0950faf-0dee-41da-8130-ca87d93464df tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:20.061012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0950faf-0dee-41da-8130-ca87d93464df tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:20.166018 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d0950faf-0dee-41da-8130-ca87d93464df tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c700b303e37843d2b95e9b55e5c6b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e962318915949c892ed4db958164f10', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:20.173341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d0950faf-0dee-41da-8130-ca87d93464df tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1488637293 {{(pid=131278) resize /opt/stack/nova/nova/compute/api.py:4166}} May 21 21:58:20.180093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0950faf-0dee-41da-8130-ca87d93464df tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:20.180575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0950faf-0dee-41da-8130-ca87d93464df tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:20.181386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0950faf-0dee-41da-8130-ca87d93464df tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:20.181828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0950faf-0dee-41da-8130-ca87d93464df tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:20.203320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-d0950faf-0dee-41da-8130-ca87d93464df tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Getting quotas for project 4e7c578e48404ccaa1e26d49c6d21711. Resources: {'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:58:20.208585 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-d0950faf-0dee-41da-8130-ca87d93464df tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Getting quotas for user 20da1409d6444f58b86ef5800d9c5d26 and project 4e7c578e48404ccaa1e26d49c6d21711. Resources: {'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:58:20.221272 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.compute.api [None req-d0950faf-0dee-41da-8130-ca87d93464df tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] ram quota exceeded for 6e962318915949c892ed4db958164f10, tried to resize instance. May 21 21:58:20.221830 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-d0950faf-0dee-41da-8130-ca87d93464df tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d0950faf-0dee-41da-8130-ca87d93464df tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Request method failure captured: May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81/action HTTP/1.1 May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 38 May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWBtM6qMe9apcSuhySSMF7Fhf6nW-jVYs4jxyYsfMMSjrUOljgv5a4iAr1ZUH_RgRJlFfYwMmyIAWqnMeo5BES2X0PB-euh0lU9vqcPkQwOveJPXHeT0QvLcuDd5ny9FR2hKxL7LZsRdFJvaLa9biwZpTYidQAlVivj7HE7YMKPs-W4 May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 6e962318915949c892ed4db958164f10 May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-500399099 May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,admin,member May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,admin,member May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6e962318915949c892ed4db958164f10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6e962318915949c892ed4db958164f10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6e962318915949c892ed4db958164f10", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6e962318915949c892ed4db958164f10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersAdminNegativeTestJSON-500399099 May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 6e962318915949c892ed4db958164f10 May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-500399099 May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersAdminNegativeTestJSON-500399099-project-admin May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c700b303e37843d2b95e9b55e5c6b220 May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersAdminNegativeTestJSON-500399099-project-admin May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: {"resize": {"flavorRef": "101066095"}} May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'd4ae57eb-6c99-479a-9510-15b753b1ff81', 'body': {'resize': {'flavorRef': '101066095'}}} May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:58:20.223956 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d0950faf-0dee-41da-8130-ca87d93464df tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d0950faf-0dee-41da-8130-ca87d93464df tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81/action" status: 403 len: 118 microversion: 2.1 time: 0.178240 May 21 21:58:20.229668 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3137/6401] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:58:20 2022] POST /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81/action => generated 118 bytes in 179 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 21 21:58:20.235213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3b401201-c581-42b0-b638-9c0380de6beb tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:20.236001 ncdv-master-1 devstack@n-api.service[131277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:58:20.236001 ncdv-master-1 devstack@n-api.service[131277]: warnings.warn(msg) May 21 21:58:20.315216 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3b401201-c581-42b0-b638-9c0380de6beb tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/101066095" status: 202 len: 0 microversion: 2.1 time: 0.083764 May 21 21:58:20.315801 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3265/6402] 10.222.0.49 () {58 vars in 1157 bytes} [Sat May 21 21:58:20 2022] DELETE /compute/v2.1/flavors/101066095 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:58:20.323823 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9e0c5cfd-a4d9-4e4c-9b23-833e29bf1edf tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:20.343825 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9e0c5cfd-a4d9-4e4c-9b23-833e29bf1edf tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023695 May 21 21:58:20.344414 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3138/6403] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:58:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:20.361875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-133da66e-3341-4cc2-b12f-3fbdef243d72 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Calling method '.version_select at 0x7fc81b4ba1f0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:20.430415 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-133da66e-3341-4cc2-b12f-3fbdef243d72 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/6e962318915949c892ed4db958164f10" status: 200 len: 371 microversion: 2.1 time: 0.072219 May 21 21:58:20.430993 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3266/6404] 10.222.0.49 () {58 vars in 1241 bytes} [Sat May 21 21:58:20 2022] GET /compute/v2.1/os-quota-sets/6e962318915949c892ed4db958164f10 => generated 371 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:58:20.442013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0649e886-92da-4ccb-9af3-fd454459c307 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-29558412", "id": 778320941, "os-flavor-access:is_public": "True"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:58:20.443633 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:58:20.443633 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:58:20.542341 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0649e886-92da-4ccb-9af3-fd454459c307 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.104213 May 21 21:58:20.543949 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3139/6405] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:58:20 2022] POST /compute/v2.1/flavors => generated 432 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:58:20.554230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9605245e-3f99-4627-8ff8-9800d423c484 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "778320941"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:58:20.555270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9605245e-3f99-4627-8ff8-9800d423c484 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:20.562158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9605245e-3f99-4627-8ff8-9800d423c484 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:20.562635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9605245e-3f99-4627-8ff8-9800d423c484 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:20.563723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9605245e-3f99-4627-8ff8-9800d423c484 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:20.564171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9605245e-3f99-4627-8ff8-9800d423c484 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:20.709796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9605245e-3f99-4627-8ff8-9800d423c484 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c700b303e37843d2b95e9b55e5c6b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e962318915949c892ed4db958164f10', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:20.717637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9605245e-3f99-4627-8ff8-9800d423c484 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-29558412 {{(pid=131277) resize /opt/stack/nova/nova/compute/api.py:4166}} May 21 21:58:20.729292 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9605245e-3f99-4627-8ff8-9800d423c484 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:20.729753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9605245e-3f99-4627-8ff8-9800d423c484 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:20.731773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9605245e-3f99-4627-8ff8-9800d423c484 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:20.732231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9605245e-3f99-4627-8ff8-9800d423c484 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:20.753676 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-9605245e-3f99-4627-8ff8-9800d423c484 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Getting quotas for project 4e7c578e48404ccaa1e26d49c6d21711. Resources: {'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:58:20.758821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-9605245e-3f99-4627-8ff8-9800d423c484 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Getting quotas for user 20da1409d6444f58b86ef5800d9c5d26 and project 4e7c578e48404ccaa1e26d49c6d21711. Resources: {'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:58:20.771418 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.compute.api [None req-9605245e-3f99-4627-8ff8-9800d423c484 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] cores quota exceeded for 6e962318915949c892ed4db958164f10, tried to resize instance. May 21 21:58:20.771979 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-9605245e-3f99-4627-8ff8-9800d423c484 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9605245e-3f99-4627-8ff8-9800d423c484 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Request method failure captured: May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81/action HTTP/1.1 May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 38 May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiWBtM6qMe9apcSuhySSMF7Fhf6nW-jVYs4jxyYsfMMSjrUOljgv5a4iAr1ZUH_RgRJlFfYwMmyIAWqnMeo5BES2X0PB-euh0lU9vqcPkQwOveJPXHeT0QvLcuDd5ny9FR2hKxL7LZsRdFJvaLa9biwZpTYidQAlVivj7HE7YMKPs-W4 May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 6e962318915949c892ed4db958164f10 May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-500399099 May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,admin,member May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,admin,member May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6e962318915949c892ed4db958164f10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6e962318915949c892ed4db958164f10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6e962318915949c892ed4db958164f10", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6e962318915949c892ed4db958164f10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersAdminNegativeTestJSON-500399099 May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 6e962318915949c892ed4db958164f10 May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-500399099 May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersAdminNegativeTestJSON-500399099-project-admin May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: c700b303e37843d2b95e9b55e5c6b220 May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersAdminNegativeTestJSON-500399099-project-admin May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: {"resize": {"flavorRef": "778320941"}} May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'd4ae57eb-6c99-479a-9510-15b753b1ff81', 'body': {'resize': {'flavorRef': '778320941'}}} May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:58:20.774120 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9605245e-3f99-4627-8ff8-9800d423c484 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9605245e-3f99-4627-8ff8-9800d423c484 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81/action" status: 403 len: 113 microversion: 2.1 time: 0.225246 May 21 21:58:20.780096 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3267/6406] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:58:20 2022] POST /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81/action => generated 113 bytes in 226 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 21 21:58:20.789501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a5e710e7-7330-43c3-ade3-4b5b4cba28be tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:20.790266 ncdv-master-1 devstack@n-api.service[131278]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 21 21:58:20.790266 ncdv-master-1 devstack@n-api.service[131278]: warnings.warn(msg) May 21 21:58:20.852044 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a5e710e7-7330-43c3-ade3-4b5b4cba28be tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/778320941" status: 202 len: 0 microversion: 2.1 time: 0.066173 May 21 21:58:20.852673 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3140/6407] 10.222.0.49 () {58 vars in 1157 bytes} [Sat May 21 21:58:20 2022] DELETE /compute/v2.1/flavors/778320941 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:58:20.861755 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8455dc33-3997-4da1-b221-c254a5a7d720 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:20.881111 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8455dc33-3997-4da1-b221-c254a5a7d720 tempest-ServersAdminNegativeTestJSON-500399099 tempest-ServersAdminNegativeTestJSON-500399099-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022983 May 21 21:58:20.881666 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3268/6408] 10.222.0.49 () {58 vars in 1145 bytes} [Sat May 21 21:58:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:20.898820 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cd3283db-2dc1-4f6e-a626-bfcd153497e0 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:20.899313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cd3283db-2dc1-4f6e-a626-bfcd153497e0 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:20.906914 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd3283db-2dc1-4f6e-a626-bfcd153497e0 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:20.907374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd3283db-2dc1-4f6e-a626-bfcd153497e0 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:20.908148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd3283db-2dc1-4f6e-a626-bfcd153497e0 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:20.908621 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd3283db-2dc1-4f6e-a626-bfcd153497e0 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:20.932954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cd3283db-2dc1-4f6e-a626-bfcd153497e0 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:58:21.172039 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cd3283db-2dc1-4f6e-a626-bfcd153497e0 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81" status: 204 len: 0 microversion: 2.1 time: 0.276905 May 21 21:58:21.172651 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3141/6409] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:58:20 2022] DELETE /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 21:58:21.180642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a51ad64e-4ef8-4e5b-b06e-f11ef5591f82 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:21.183042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a51ad64e-4ef8-4e5b-b06e-f11ef5591f82 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:21.188461 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a51ad64e-4ef8-4e5b-b06e-f11ef5591f82 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:21.188924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a51ad64e-4ef8-4e5b-b06e-f11ef5591f82 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:21.189699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a51ad64e-4ef8-4e5b-b06e-f11ef5591f82 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:21.190147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a51ad64e-4ef8-4e5b-b06e-f11ef5591f82 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:21.334194 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a51ad64e-4ef8-4e5b-b06e-f11ef5591f82 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da1409d6444f58b86ef5800d9c5d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c578e48404ccaa1e26d49c6d21711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:21.342019 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a51ad64e-4ef8-4e5b-b06e-f11ef5591f82 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] 10.222.0.49 "GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81" status: 200 len: 1478 microversion: 2.1 time: 0.165259 May 21 21:58:21.342601 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3269/6410] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:21 2022] GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81 => generated 1478 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:22.360729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dbcb6caf-9f80-4ee9-afa3-54cce9299d5a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:22.361486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dbcb6caf-9f80-4ee9-afa3-54cce9299d5a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:22.368550 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbcb6caf-9f80-4ee9-afa3-54cce9299d5a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:22.369002 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbcb6caf-9f80-4ee9-afa3-54cce9299d5a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:22.369765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbcb6caf-9f80-4ee9-afa3-54cce9299d5a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:22.370199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dbcb6caf-9f80-4ee9-afa3-54cce9299d5a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:22.524087 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dbcb6caf-9f80-4ee9-afa3-54cce9299d5a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da1409d6444f58b86ef5800d9c5d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c578e48404ccaa1e26d49c6d21711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:22.532241 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dbcb6caf-9f80-4ee9-afa3-54cce9299d5a tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] 10.222.0.49 "GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81" status: 200 len: 1478 microversion: 2.1 time: 0.176706 May 21 21:58:22.532941 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3142/6411] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:22 2022] GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81 => generated 1478 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:23.550371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8baf543b-ee96-49b3-836e-00d9edba08f2 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:23.550988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8baf543b-ee96-49b3-836e-00d9edba08f2 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:23.558220 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8baf543b-ee96-49b3-836e-00d9edba08f2 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:23.558762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8baf543b-ee96-49b3-836e-00d9edba08f2 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:23.559601 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8baf543b-ee96-49b3-836e-00d9edba08f2 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:23.560055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8baf543b-ee96-49b3-836e-00d9edba08f2 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:23.651808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8baf543b-ee96-49b3-836e-00d9edba08f2 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20da1409d6444f58b86ef5800d9c5d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7c578e48404ccaa1e26d49c6d21711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:23.661614 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8baf543b-ee96-49b3-836e-00d9edba08f2 tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] 10.222.0.49 "GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81" status: 200 len: 1436 microversion: 2.1 time: 0.115117 May 21 21:58:23.662807 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3270/6412] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:23 2022] GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81 => generated 1436 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:23.696646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-4c8918b1-433a-4eb9-9962-8906c179fd52 req-ccd31c89-c920-4b09-8dd5-c9c6419816c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ae57eb-6c99-479a-9510-15b753b1ff81", "name": "network-vif-deleted", "tag": "69fd5c25-6b34-4e63-a69a-3e8cc29178e2"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:58:23.707072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4c8918b1-433a-4eb9-9962-8906c179fd52 req-ccd31c89-c920-4b09-8dd5-c9c6419816c7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:23.707523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4c8918b1-433a-4eb9-9962-8906c179fd52 req-ccd31c89-c920-4b09-8dd5-c9c6419816c7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:23.720240 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-4c8918b1-433a-4eb9-9962-8906c179fd52 req-ccd31c89-c920-4b09-8dd5-c9c6419816c7 service nova] Creating event network-vif-deleted:69fd5c25-6b34-4e63-a69a-3e8cc29178e2 for instance d4ae57eb-6c99-479a-9510-15b753b1ff81 on nch1-master-1 May 21 21:58:23.725383 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-4c8918b1-433a-4eb9-9962-8906c179fd52 req-ccd31c89-c920-4b09-8dd5-c9c6419816c7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032597 May 21 21:58:23.725991 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3143/6413] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:58:24.679165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ca998e4e-e918-4aed-a83b-094fd6fe149f tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:24.679809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ca998e4e-e918-4aed-a83b-094fd6fe149f tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] [instance: d4ae57eb-6c99-479a-9510-15b753b1ff81] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:24.687380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca998e4e-e918-4aed-a83b-094fd6fe149f tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:24.687864 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca998e4e-e918-4aed-a83b-094fd6fe149f tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:24.688944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca998e4e-e918-4aed-a83b-094fd6fe149f tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:24.689400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca998e4e-e918-4aed-a83b-094fd6fe149f tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:24.703865 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-ca998e4e-e918-4aed-a83b-094fd6fe149f tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] HTTP exception thrown: Instance d4ae57eb-6c99-479a-9510-15b753b1ff81 could not be found. May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ca998e4e-e918-4aed-a83b-094fd6fe149f tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Request method failure captured: May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81 HTTP/1.1 May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiWBtzti-w3Ku3qXdBzodh4SxF0-vEOCyf5l9vvDr9-F5eEViV59L83MgIr4NltA7lcUFj1uv6iIZErgHzNI4RX89eQPcHZI9JmBFNs3GnLE41Z7CG8Uj8xXMP4APfTXFf85802fncBntK4JHDh_1aouD0QvthHVlXtifutOjwXq9eSQ May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 4e7c578e48404ccaa1e26d49c6d21711 May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-940332427 May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4e7c578e48404ccaa1e26d49c6d21711"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4e7c578e48404ccaa1e26d49c6d21711"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4e7c578e48404ccaa1e26d49c6d21711", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4e7c578e48404ccaa1e26d49c6d21711"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersAdminNegativeTestJSON-940332427 May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 4e7c578e48404ccaa1e26d49c6d21711 May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-940332427 May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersAdminNegativeTestJSON-940332427-project May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 20da1409d6444f58b86ef5800d9c5d26 May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersAdminNegativeTestJSON-940332427-project May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance d4ae57eb-6c99-479a-9510-15b753b1ff81 could not be found. May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'd4ae57eb-6c99-479a-9510-15b753b1ff81'} May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4ae57eb-6c99-479a-9510-15b753b1ff81 could not be found. May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4ae57eb-6c99-479a-9510-15b753b1ff81 could not be found. May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:58:24.705448 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:58:24.711514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:58:24.711514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:58:24.711514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:58:24.711514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:58:24.711514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:58:24.711514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4ae57eb-6c99-479a-9510-15b753b1ff81 could not be found. May 21 21:58:24.711514 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:58:24.711514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ca998e4e-e918-4aed-a83b-094fd6fe149f tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] Returning 404 to user: Instance d4ae57eb-6c99-479a-9510-15b753b1ff81 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:58:24.711514 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ca998e4e-e918-4aed-a83b-094fd6fe149f tempest-ServersAdminNegativeTestJSON-940332427 tempest-ServersAdminNegativeTestJSON-940332427-project] 10.222.0.49 "GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81" status: 404 len: 111 microversion: 2.1 time: 0.031780 May 21 21:58:24.711514 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3271/6414] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:24 2022] GET /compute/v2.1/servers/d4ae57eb-6c99-479a-9510-15b753b1ff81 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:58:29.401733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b5644ed5-66dd-42f9-9974-c0d3509420db tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1167019336", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "328a8b22-afbf-4427-a3f3-04839b959a65"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:58:29.453098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-b5644ed5-66dd-42f9-9974-c0d3509420db tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] validate_networks() for [('328a8b22-afbf-4427-a3f3-04839b959a65', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:58:29.872194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-b5644ed5-66dd-42f9-9974-c0d3509420db tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:58:29.872657 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-b5644ed5-66dd-42f9-9974-c0d3509420db tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:58:29.873140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-b5644ed5-66dd-42f9-9974-c0d3509420db tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:58:29.873554 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-b5644ed5-66dd-42f9-9974-c0d3509420db tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:58:29.873968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-b5644ed5-66dd-42f9-9974-c0d3509420db tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:58:29.882975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5644ed5-66dd-42f9-9974-c0d3509420db tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:29.885866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5644ed5-66dd-42f9-9974-c0d3509420db tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:29.885866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5644ed5-66dd-42f9-9974-c0d3509420db tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:29.885866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5644ed5-66dd-42f9-9974-c0d3509420db tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:29.901795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-b5644ed5-66dd-42f9-9974-c0d3509420db tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Getting quotas for project b571311d2f7f4720b3ab1ab73b9c32bc. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:58:29.907484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-b5644ed5-66dd-42f9-9974-c0d3509420db tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Getting quotas for user 938e7d5d20dc4a2ba5c70050511ccf15 and project b571311d2f7f4720b3ab1ab73b9c32bc. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:58:29.920804 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b5644ed5-66dd-42f9-9974-c0d3509420db tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:58:29.923147 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b5644ed5-66dd-42f9-9974-c0d3509420db tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:58:30.042087 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b5644ed5-66dd-42f9-9974-c0d3509420db tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762448 May 21 21:58:30.043422 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3144/6415] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:58:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:58:30.053507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d0a4f8f1-769f-4801-be0e-6da64105ea40 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:30.054230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d0a4f8f1-769f-4801-be0e-6da64105ea40 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:30.114722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d0a4f8f1-769f-4801-be0e-6da64105ea40 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:30.123427 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d0a4f8f1-769f-4801-be0e-6da64105ea40 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1215 microversion: 2.1 time: 0.073757 May 21 21:58:30.124017 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3272/6416] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:30 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:31.141558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0e4ec8de-c981-46bf-b634-ae17ffd8dc1f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:31.142179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0e4ec8de-c981-46bf-b634-ae17ffd8dc1f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:31.199858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0e4ec8de-c981-46bf-b634-ae17ffd8dc1f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:31.206924 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0e4ec8de-c981-46bf-b634-ae17ffd8dc1f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1215 microversion: 2.1 time: 0.071061 May 21 21:58:31.207535 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3145/6417] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:31 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:32.223532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-00397f4d-27b9-4add-9579-237468742187 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:32.224170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-00397f4d-27b9-4add-9579-237468742187 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:32.226216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:58:32.233383 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00397f4d-27b9-4add-9579-237468742187 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:32.233857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00397f4d-27b9-4add-9579-237468742187 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:32.234652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00397f4d-27b9-4add-9579-237468742187 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:32.235111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-00397f4d-27b9-4add-9579-237468742187 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:32.305715 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-00397f4d-27b9-4add-9579-237468742187 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:32.313815 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-00397f4d-27b9-4add-9579-237468742187 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1219 microversion: 2.1 time: 0.093911 May 21 21:58:32.314379 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3273/6418] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:32 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:33.330376 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1690e4f6-153a-4118-baa0-2e2a6efab6bb tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:33.330936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1690e4f6-153a-4118-baa0-2e2a6efab6bb tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:33.338187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1690e4f6-153a-4118-baa0-2e2a6efab6bb tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:33.338750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1690e4f6-153a-4118-baa0-2e2a6efab6bb tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:33.339514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1690e4f6-153a-4118-baa0-2e2a6efab6bb tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:33.343540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1690e4f6-153a-4118-baa0-2e2a6efab6bb tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:33.418792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1690e4f6-153a-4118-baa0-2e2a6efab6bb tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:33.427749 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1690e4f6-153a-4118-baa0-2e2a6efab6bb tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1275 microversion: 2.1 time: 0.100654 May 21 21:58:33.427749 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3146/6419] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:33 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1275 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:34.444754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-26ea0bd6-12fb-4e0c-b923-60485afc55b6 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:34.445707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-26ea0bd6-12fb-4e0c-b923-60485afc55b6 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:34.453222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-26ea0bd6-12fb-4e0c-b923-60485afc55b6 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:34.456088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-26ea0bd6-12fb-4e0c-b923-60485afc55b6 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:34.456088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-26ea0bd6-12fb-4e0c-b923-60485afc55b6 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:34.456088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-26ea0bd6-12fb-4e0c-b923-60485afc55b6 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:34.717010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-26ea0bd6-12fb-4e0c-b923-60485afc55b6 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:34.724671 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-26ea0bd6-12fb-4e0c-b923-60485afc55b6 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1315 microversion: 2.1 time: 0.283878 May 21 21:58:34.725248 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3274/6420] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:34 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:35.298873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-ac6ddf1d-cf6c-4fb7-82ba-b505c3312c93 req-c8e96d91-aaf9-482b-a493-b83618ea6541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f", "tag": "8e720d56-1b91-4599-be3d-5f1667eb34b9"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:58:35.309077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ac6ddf1d-cf6c-4fb7-82ba-b505c3312c93 req-c8e96d91-aaf9-482b-a493-b83618ea6541 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:35.309811 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ac6ddf1d-cf6c-4fb7-82ba-b505c3312c93 req-c8e96d91-aaf9-482b-a493-b83618ea6541 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:35.322951 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-ac6ddf1d-cf6c-4fb7-82ba-b505c3312c93 req-c8e96d91-aaf9-482b-a493-b83618ea6541 service nova] Creating event network-changed:8e720d56-1b91-4599-be3d-5f1667eb34b9 for instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f on nch1-master-1 May 21 21:58:35.328738 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-ac6ddf1d-cf6c-4fb7-82ba-b505c3312c93 req-c8e96d91-aaf9-482b-a493-b83618ea6541 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035155 May 21 21:58:35.329346 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3147/6421] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:58:35.742503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b1ea7a7c-cf68-4107-a003-e69a9cb20266 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:35.743143 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b1ea7a7c-cf68-4107-a003-e69a9cb20266 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:35.751067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1ea7a7c-cf68-4107-a003-e69a9cb20266 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:35.751533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1ea7a7c-cf68-4107-a003-e69a9cb20266 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:35.752386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1ea7a7c-cf68-4107-a003-e69a9cb20266 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:35.752852 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1ea7a7c-cf68-4107-a003-e69a9cb20266 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:35.981004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b1ea7a7c-cf68-4107-a003-e69a9cb20266 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:35.988575 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b1ea7a7c-cf68-4107-a003-e69a9cb20266 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1315 microversion: 2.1 time: 0.250050 May 21 21:58:35.989770 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3275/6422] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:35 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:37.006919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-582e1db6-d802-499f-ad13-87d8c929539f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:37.007540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-582e1db6-d802-499f-ad13-87d8c929539f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:37.014832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-582e1db6-d802-499f-ad13-87d8c929539f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:37.015290 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-582e1db6-d802-499f-ad13-87d8c929539f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:37.016063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-582e1db6-d802-499f-ad13-87d8c929539f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:37.016546 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-582e1db6-d802-499f-ad13-87d8c929539f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:37.167443 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-582e1db6-d802-499f-ad13-87d8c929539f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:37.176152 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-582e1db6-d802-499f-ad13-87d8c929539f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1315 microversion: 2.1 time: 0.174481 May 21 21:58:37.176809 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3148/6423] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:37 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:38.193838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5d9846b2-3cd7-4f90-851e-76ba2e1c9848 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:38.194406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5d9846b2-3cd7-4f90-851e-76ba2e1c9848 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:38.197129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:58:38.202452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d9846b2-3cd7-4f90-851e-76ba2e1c9848 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:38.202922 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d9846b2-3cd7-4f90-851e-76ba2e1c9848 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:38.203709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d9846b2-3cd7-4f90-851e-76ba2e1c9848 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:38.204165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d9846b2-3cd7-4f90-851e-76ba2e1c9848 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:38.208422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=80 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:58:38.350642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5d9846b2-3cd7-4f90-851e-76ba2e1c9848 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:38.359061 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5d9846b2-3cd7-4f90-851e-76ba2e1c9848 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1315 microversion: 2.1 time: 0.169148 May 21 21:58:38.359656 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3276/6424] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:38 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:39.376768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b8063df3-257a-4f77-9f79-b192eff92989 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:39.381808 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b8063df3-257a-4f77-9f79-b192eff92989 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:39.384443 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b8063df3-257a-4f77-9f79-b192eff92989 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:39.384899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b8063df3-257a-4f77-9f79-b192eff92989 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:39.385671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b8063df3-257a-4f77-9f79-b192eff92989 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:39.386113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b8063df3-257a-4f77-9f79-b192eff92989 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:39.391154 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:58:39.533274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b8063df3-257a-4f77-9f79-b192eff92989 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:39.540934 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b8063df3-257a-4f77-9f79-b192eff92989 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1315 microversion: 2.1 time: 0.168051 May 21 21:58:39.541522 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3149/6425] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:39 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:40.559320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-039a2225-5a4d-4ada-bdeb-b93dade5d882 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:40.560047 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-039a2225-5a4d-4ada-bdeb-b93dade5d882 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:40.562582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:58:40.567713 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-039a2225-5a4d-4ada-bdeb-b93dade5d882 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:40.568165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-039a2225-5a4d-4ada-bdeb-b93dade5d882 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:40.568968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-039a2225-5a4d-4ada-bdeb-b93dade5d882 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:40.569419 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-039a2225-5a4d-4ada-bdeb-b93dade5d882 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:40.719636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-039a2225-5a4d-4ada-bdeb-b93dade5d882 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:40.727297 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-039a2225-5a4d-4ada-bdeb-b93dade5d882 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1315 microversion: 2.1 time: 0.172585 May 21 21:58:40.727858 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3277/6426] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:40 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:41.659822 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-8586bff7-4f96-4ebc-8bbc-dc4ee1736660 req-f5a4b702-1bf4-41ef-871e-03c2bb73099a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f", "name": "network-vif-plugged", "status": "completed", "tag": "8e720d56-1b91-4599-be3d-5f1667eb34b9"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:58:41.663524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=5 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:58:41.665087 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=10 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:58:41.665974 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:58:41.673678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-8586bff7-4f96-4ebc-8bbc-dc4ee1736660 req-f5a4b702-1bf4-41ef-871e-03c2bb73099a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:41.681070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-8586bff7-4f96-4ebc-8bbc-dc4ee1736660 req-f5a4b702-1bf4-41ef-871e-03c2bb73099a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:41.685644 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-8586bff7-4f96-4ebc-8bbc-dc4ee1736660 req-f5a4b702-1bf4-41ef-871e-03c2bb73099a service nova] Creating event network-vif-plugged:8e720d56-1b91-4599-be3d-5f1667eb34b9 for instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f on nch1-master-1 May 21 21:58:41.692778 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-8586bff7-4f96-4ebc-8bbc-dc4ee1736660 req-f5a4b702-1bf4-41ef-871e-03c2bb73099a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036407 May 21 21:58:41.693454 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3150/6427] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:58:41.744919 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ef5b6b0d-eb8b-4a19-9a5f-a4bc7fc9bfd4 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:41.745549 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ef5b6b0d-eb8b-4a19-9a5f-a4bc7fc9bfd4 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:41.752612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef5b6b0d-eb8b-4a19-9a5f-a4bc7fc9bfd4 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:41.753138 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef5b6b0d-eb8b-4a19-9a5f-a4bc7fc9bfd4 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:41.753967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef5b6b0d-eb8b-4a19-9a5f-a4bc7fc9bfd4 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:41.754454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef5b6b0d-eb8b-4a19-9a5f-a4bc7fc9bfd4 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:41.987625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ef5b6b0d-eb8b-4a19-9a5f-a4bc7fc9bfd4 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:41.995542 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ef5b6b0d-eb8b-4a19-9a5f-a4bc7fc9bfd4 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1315 microversion: 2.1 time: 0.254411 May 21 21:58:41.996116 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3278/6428] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:41 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:43.013473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ee332c42-ef84-424f-a201-89caca896809 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:43.014085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ee332c42-ef84-424f-a201-89caca896809 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:43.022885 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee332c42-ef84-424f-a201-89caca896809 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:43.023338 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee332c42-ef84-424f-a201-89caca896809 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:43.024114 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee332c42-ef84-424f-a201-89caca896809 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:43.024587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee332c42-ef84-424f-a201-89caca896809 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:43.177740 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ee332c42-ef84-424f-a201-89caca896809 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:43.186213 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ee332c42-ef84-424f-a201-89caca896809 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1315 microversion: 2.1 time: 0.178243 May 21 21:58:43.186804 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3151/6429] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:43 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:44.202787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5d4fab70-9944-463e-bab0-6b1589476737 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:44.203404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5d4fab70-9944-463e-bab0-6b1589476737 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:44.210525 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d4fab70-9944-463e-bab0-6b1589476737 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:44.210999 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d4fab70-9944-463e-bab0-6b1589476737 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:44.211782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d4fab70-9944-463e-bab0-6b1589476737 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:44.212236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5d4fab70-9944-463e-bab0-6b1589476737 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:44.355048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5d4fab70-9944-463e-bab0-6b1589476737 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:44.363377 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5d4fab70-9944-463e-bab0-6b1589476737 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1503 microversion: 2.1 time: 0.164563 May 21 21:58:44.363950 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3279/6430] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:44 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:44.381420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c959f411-ea38-4620-81fe-74e29e236f8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:58:44.382481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c959f411-ea38-4620-81fe-74e29e236f8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:44.389493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c959f411-ea38-4620-81fe-74e29e236f8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:44.389944 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c959f411-ea38-4620-81fe-74e29e236f8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:44.390712 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c959f411-ea38-4620-81fe-74e29e236f8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:44.391153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c959f411-ea38-4620-81fe-74e29e236f8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:44.419951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c959f411-ea38-4620-81fe-74e29e236f8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:44.425856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c959f411-ea38-4620-81fe-74e29e236f8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Old instance type m1.heat2, new instance type m1.heat {{(pid=131278) resize /opt/stack/nova/nova/compute/api.py:4166}} May 21 21:58:44.432090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-c959f411-ea38-4620-81fe-74e29e236f8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:58:44.432552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-c959f411-ea38-4620-81fe-74e29e236f8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:58:44.433040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-c959f411-ea38-4620-81fe-74e29e236f8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:58:44.433455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-c959f411-ea38-4620-81fe-74e29e236f8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:58:44.434430 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-c959f411-ea38-4620-81fe-74e29e236f8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:58:44.672388 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c959f411-ea38-4620-81fe-74e29e236f8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "POST /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f/action" status: 202 len: 0 microversion: 2.1 time: 0.294875 May 21 21:58:44.673010 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3152/6431] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:58:44 2022] POST /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:58:44.686135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5c15371e-a754-431a-b553-9693be5b6579 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:44.686770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5c15371e-a754-431a-b553-9693be5b6579 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:44.693727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c15371e-a754-431a-b553-9693be5b6579 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:44.694183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c15371e-a754-431a-b553-9693be5b6579 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:44.694973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c15371e-a754-431a-b553-9693be5b6579 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:44.695458 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c15371e-a754-431a-b553-9693be5b6579 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:44.844925 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5c15371e-a754-431a-b553-9693be5b6579 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:44.852790 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5c15371e-a754-431a-b553-9693be5b6579 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1512 microversion: 2.1 time: 0.175524 May 21 21:58:44.853364 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3280/6432] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:44 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:45.870528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-55aa675a-1a80-46c8-9133-fb779018c048 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:45.871940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-55aa675a-1a80-46c8-9133-fb779018c048 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:45.878133 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-55aa675a-1a80-46c8-9133-fb779018c048 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:45.878582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-55aa675a-1a80-46c8-9133-fb779018c048 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:45.879344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-55aa675a-1a80-46c8-9133-fb779018c048 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:45.879783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-55aa675a-1a80-46c8-9133-fb779018c048 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:46.029963 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-55aa675a-1a80-46c8-9133-fb779018c048 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:46.037982 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-55aa675a-1a80-46c8-9133-fb779018c048 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1512 microversion: 2.1 time: 0.172383 May 21 21:58:46.038569 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3153/6433] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:45 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:47.057024 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0caeea5c-0d5d-4957-8f41-eaf1d32755a9 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:47.057657 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0caeea5c-0d5d-4957-8f41-eaf1d32755a9 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:47.065771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0caeea5c-0d5d-4957-8f41-eaf1d32755a9 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:47.066240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0caeea5c-0d5d-4957-8f41-eaf1d32755a9 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:47.067035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0caeea5c-0d5d-4957-8f41-eaf1d32755a9 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:47.067489 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0caeea5c-0d5d-4957-8f41-eaf1d32755a9 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:47.317256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0caeea5c-0d5d-4957-8f41-eaf1d32755a9 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:47.325565 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0caeea5c-0d5d-4957-8f41-eaf1d32755a9 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1512 microversion: 2.1 time: 0.273449 May 21 21:58:47.326353 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3281/6434] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:47 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1512 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:48.343562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-21db1c31-3469-4866-9704-74a4ce15b5df tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:48.344186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-21db1c31-3469-4866-9704-74a4ce15b5df tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:48.351269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21db1c31-3469-4866-9704-74a4ce15b5df tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:48.356878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21db1c31-3469-4866-9704-74a4ce15b5df tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:48.356878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21db1c31-3469-4866-9704-74a4ce15b5df tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:48.356878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21db1c31-3469-4866-9704-74a4ce15b5df tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:48.496024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-21db1c31-3469-4866-9704-74a4ce15b5df tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:48.504502 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-21db1c31-3469-4866-9704-74a4ce15b5df tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1517 microversion: 2.1 time: 0.165722 May 21 21:58:48.510582 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3154/6435] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:48 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:49.523526 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-eaf08690-8b62-4420-b5ee-90637c85a41e tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:49.524163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-eaf08690-8b62-4420-b5ee-90637c85a41e tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:49.531892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eaf08690-8b62-4420-b5ee-90637c85a41e tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:49.532400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eaf08690-8b62-4420-b5ee-90637c85a41e tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:49.533191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eaf08690-8b62-4420-b5ee-90637c85a41e tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:49.533642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-eaf08690-8b62-4420-b5ee-90637c85a41e tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:49.693543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-eaf08690-8b62-4420-b5ee-90637c85a41e tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:49.702021 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-eaf08690-8b62-4420-b5ee-90637c85a41e tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1517 microversion: 2.1 time: 0.182412 May 21 21:58:49.702602 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3282/6436] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:49 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1517 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:50.720263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-523ee4a3-ac44-4bee-9770-50fff4282d44 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:50.720985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-523ee4a3-ac44-4bee-9770-50fff4282d44 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:50.728408 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-523ee4a3-ac44-4bee-9770-50fff4282d44 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:50.728864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-523ee4a3-ac44-4bee-9770-50fff4282d44 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:50.729645 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-523ee4a3-ac44-4bee-9770-50fff4282d44 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:50.730274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-523ee4a3-ac44-4bee-9770-50fff4282d44 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:50.886105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-523ee4a3-ac44-4bee-9770-50fff4282d44 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:50.894472 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-523ee4a3-ac44-4bee-9770-50fff4282d44 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1517 microversion: 2.1 time: 0.179987 May 21 21:58:50.895052 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3155/6437] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:50 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:51.911720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-612e87f1-e59c-4b88-ac3f-aee8b9c86dfb tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:51.912371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-612e87f1-e59c-4b88-ac3f-aee8b9c86dfb tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:51.919521 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-612e87f1-e59c-4b88-ac3f-aee8b9c86dfb tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:51.919986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-612e87f1-e59c-4b88-ac3f-aee8b9c86dfb tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:51.920794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-612e87f1-e59c-4b88-ac3f-aee8b9c86dfb tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:51.921250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-612e87f1-e59c-4b88-ac3f-aee8b9c86dfb tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:52.065128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-612e87f1-e59c-4b88-ac3f-aee8b9c86dfb tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:52.072829 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-612e87f1-e59c-4b88-ac3f-aee8b9c86dfb tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1517 microversion: 2.1 time: 0.164988 May 21 21:58:52.073402 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3283/6438] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:51 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:53.090535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8e3b72dc-ec4a-4204-8569-67c83debcc8c tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:53.091266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8e3b72dc-ec4a-4204-8569-67c83debcc8c tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:53.098758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e3b72dc-ec4a-4204-8569-67c83debcc8c tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:53.099211 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e3b72dc-ec4a-4204-8569-67c83debcc8c tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:53.099980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e3b72dc-ec4a-4204-8569-67c83debcc8c tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:53.100466 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8e3b72dc-ec4a-4204-8569-67c83debcc8c tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:53.245697 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8e3b72dc-ec4a-4204-8569-67c83debcc8c tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:53.253412 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8e3b72dc-ec4a-4204-8569-67c83debcc8c tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1517 microversion: 2.1 time: 0.167433 May 21 21:58:53.253995 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3156/6439] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:53 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:54.270911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-797e894a-38c5-4f7c-956a-554c8b47fb8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:54.271522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-797e894a-38c5-4f7c-956a-554c8b47fb8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:54.279108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-797e894a-38c5-4f7c-956a-554c8b47fb8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:54.279571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-797e894a-38c5-4f7c-956a-554c8b47fb8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:54.280403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-797e894a-38c5-4f7c-956a-554c8b47fb8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:54.280859 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-797e894a-38c5-4f7c-956a-554c8b47fb8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:54.423202 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-797e894a-38c5-4f7c-956a-554c8b47fb8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:54.430959 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-797e894a-38c5-4f7c-956a-554c8b47fb8d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1517 microversion: 2.1 time: 0.163933 May 21 21:58:54.431541 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3284/6440] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:54 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:55.450779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7bdb5f1f-126c-4477-a9a9-dc0dce209e8f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:55.451676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7bdb5f1f-126c-4477-a9a9-dc0dce209e8f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:55.459129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7bdb5f1f-126c-4477-a9a9-dc0dce209e8f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:55.459580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7bdb5f1f-126c-4477-a9a9-dc0dce209e8f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:55.460658 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7bdb5f1f-126c-4477-a9a9-dc0dce209e8f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:55.461222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7bdb5f1f-126c-4477-a9a9-dc0dce209e8f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:55.610962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7bdb5f1f-126c-4477-a9a9-dc0dce209e8f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:55.618530 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7bdb5f1f-126c-4477-a9a9-dc0dce209e8f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1517 microversion: 2.1 time: 0.173699 May 21 21:58:55.619094 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3157/6441] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:55 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:56.635804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-35d429d4-cb5e-443e-b4bf-02c90e640ebf tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:56.636503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-35d429d4-cb5e-443e-b4bf-02c90e640ebf tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:56.644099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35d429d4-cb5e-443e-b4bf-02c90e640ebf tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:56.644595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35d429d4-cb5e-443e-b4bf-02c90e640ebf tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:56.645374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35d429d4-cb5e-443e-b4bf-02c90e640ebf tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:56.645824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-35d429d4-cb5e-443e-b4bf-02c90e640ebf tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:56.792455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-35d429d4-cb5e-443e-b4bf-02c90e640ebf tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:56.800943 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-35d429d4-cb5e-443e-b4bf-02c90e640ebf tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1517 microversion: 2.1 time: 0.169223 May 21 21:58:56.801553 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3285/6442] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:56 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:58:57.819460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-02f68e5b-433c-4702-a26a-19aa7037b66a tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:57.820078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-02f68e5b-433c-4702-a26a-19aa7037b66a tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:57.827807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02f68e5b-433c-4702-a26a-19aa7037b66a tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:57.828259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02f68e5b-433c-4702-a26a-19aa7037b66a tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:57.829082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02f68e5b-433c-4702-a26a-19aa7037b66a tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:57.829521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-02f68e5b-433c-4702-a26a-19aa7037b66a tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:57.971364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-02f68e5b-433c-4702-a26a-19aa7037b66a tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:57.979012 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-02f68e5b-433c-4702-a26a-19aa7037b66a tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1517 microversion: 2.1 time: 0.163534 May 21 21:58:57.979592 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3158/6443] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:57 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:58:58.996646 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-27415371-fe3b-4c15-b6a4-9f03fa5b4d3d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:58:58.997987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-27415371-fe3b-4c15-b6a4-9f03fa5b4d3d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:58:59.004941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27415371-fe3b-4c15-b6a4-9f03fa5b4d3d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:59.005415 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27415371-fe3b-4c15-b6a4-9f03fa5b4d3d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:59.006205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27415371-fe3b-4c15-b6a4-9f03fa5b4d3d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:58:59.006698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27415371-fe3b-4c15-b6a4-9f03fa5b4d3d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:58:59.149278 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-27415371-fe3b-4c15-b6a4-9f03fa5b4d3d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:58:59.157204 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-27415371-fe3b-4c15-b6a4-9f03fa5b4d3d tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1517 microversion: 2.1 time: 0.164691 May 21 21:58:59.157783 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3286/6444] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:58:58 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:00.174291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2edf5856-d93e-4b1e-906d-b049e081bde6 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:00.174922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2edf5856-d93e-4b1e-906d-b049e081bde6 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:00.182014 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2edf5856-d93e-4b1e-906d-b049e081bde6 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:00.182473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2edf5856-d93e-4b1e-906d-b049e081bde6 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:00.183247 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2edf5856-d93e-4b1e-906d-b049e081bde6 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:00.183693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2edf5856-d93e-4b1e-906d-b049e081bde6 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:00.330641 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2edf5856-d93e-4b1e-906d-b049e081bde6 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:00.338360 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2edf5856-d93e-4b1e-906d-b049e081bde6 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1517 microversion: 2.1 time: 0.168065 May 21 21:59:00.343408 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3159/6445] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:00 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:01.356589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9748bac8-8f45-4ec0-b2d5-3dc928bd8b6c tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:01.357337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9748bac8-8f45-4ec0-b2d5-3dc928bd8b6c tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:01.364337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9748bac8-8f45-4ec0-b2d5-3dc928bd8b6c tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:01.364803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9748bac8-8f45-4ec0-b2d5-3dc928bd8b6c tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:01.365583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9748bac8-8f45-4ec0-b2d5-3dc928bd8b6c tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:01.366031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9748bac8-8f45-4ec0-b2d5-3dc928bd8b6c tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:01.515722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9748bac8-8f45-4ec0-b2d5-3dc928bd8b6c tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:01.523422 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9748bac8-8f45-4ec0-b2d5-3dc928bd8b6c tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1517 microversion: 2.1 time: 0.171181 May 21 21:59:01.523990 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3287/6446] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:01 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:02.541257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6e9c0575-17e7-42b2-a2ae-81f76bd744cc tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:02.541873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6e9c0575-17e7-42b2-a2ae-81f76bd744cc tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:02.549477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e9c0575-17e7-42b2-a2ae-81f76bd744cc tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:02.549953 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e9c0575-17e7-42b2-a2ae-81f76bd744cc tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:02.550716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e9c0575-17e7-42b2-a2ae-81f76bd744cc tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:02.551151 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e9c0575-17e7-42b2-a2ae-81f76bd744cc tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:02.695990 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6e9c0575-17e7-42b2-a2ae-81f76bd744cc tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:02.703780 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6e9c0575-17e7-42b2-a2ae-81f76bd744cc tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1517 microversion: 2.1 time: 0.166453 May 21 21:59:02.704371 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3160/6447] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:02 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:03.721321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c21d9e2d-1453-4273-8a85-0eebaa67d2fe tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:03.721958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c21d9e2d-1453-4273-8a85-0eebaa67d2fe tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:03.729040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c21d9e2d-1453-4273-8a85-0eebaa67d2fe tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:03.729514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c21d9e2d-1453-4273-8a85-0eebaa67d2fe tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:03.730302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c21d9e2d-1453-4273-8a85-0eebaa67d2fe tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:03.730759 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c21d9e2d-1453-4273-8a85-0eebaa67d2fe tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:03.874537 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c21d9e2d-1453-4273-8a85-0eebaa67d2fe tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:03.882206 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c21d9e2d-1453-4273-8a85-0eebaa67d2fe tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1517 microversion: 2.1 time: 0.164808 May 21 21:59:03.882772 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3288/6448] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:03 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:04.902237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-413fff06-5b19-4e6b-8607-32a71f7e6f69 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:04.902237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-413fff06-5b19-4e6b-8607-32a71f7e6f69 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:04.921396 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-413fff06-5b19-4e6b-8607-32a71f7e6f69 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:04.921856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-413fff06-5b19-4e6b-8607-32a71f7e6f69 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:04.922647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-413fff06-5b19-4e6b-8607-32a71f7e6f69 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:04.923085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-413fff06-5b19-4e6b-8607-32a71f7e6f69 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:05.087156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-413fff06-5b19-4e6b-8607-32a71f7e6f69 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:05.095958 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-413fff06-5b19-4e6b-8607-32a71f7e6f69 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1516 microversion: 2.1 time: 0.200661 May 21 21:59:05.097316 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3161/6449] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:04 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1516 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 21:59:05.681095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-b8457a8c-528f-4ba3-82e4-c7907db875d1 req-500f2825-7255-43b6-a1fa-16d4b9ebadd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f", "name": "network-vif-unplugged", "status": "completed", "tag": "8e720d56-1b91-4599-be3d-5f1667eb34b9"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:59:05.690104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b8457a8c-528f-4ba3-82e4-c7907db875d1 req-500f2825-7255-43b6-a1fa-16d4b9ebadd1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:05.690568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b8457a8c-528f-4ba3-82e4-c7907db875d1 req-500f2825-7255-43b6-a1fa-16d4b9ebadd1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:05.703294 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-b8457a8c-528f-4ba3-82e4-c7907db875d1 req-500f2825-7255-43b6-a1fa-16d4b9ebadd1 service nova] Creating event network-vif-unplugged:8e720d56-1b91-4599-be3d-5f1667eb34b9 for instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f on nch2-master-1 May 21 21:59:05.708967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [req-b8457a8c-528f-4ba3-82e4-c7907db875d1 req-500f2825-7255-43b6-a1fa-16d4b9ebadd1 service nova] Instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 21:59:05.719813 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-b8457a8c-528f-4ba3-82e4-c7907db875d1 req-500f2825-7255-43b6-a1fa-16d4b9ebadd1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112059 May 21 21:59:05.720454 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3289/6450] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:59:06.113744 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-30ac1fd7-7253-4e45-92c6-85b58b6b5411 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:06.114908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-30ac1fd7-7253-4e45-92c6-85b58b6b5411 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:06.122436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30ac1fd7-7253-4e45-92c6-85b58b6b5411 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:06.123028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30ac1fd7-7253-4e45-92c6-85b58b6b5411 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:06.123815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30ac1fd7-7253-4e45-92c6-85b58b6b5411 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:06.124261 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30ac1fd7-7253-4e45-92c6-85b58b6b5411 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:06.396364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-30ac1fd7-7253-4e45-92c6-85b58b6b5411 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:06.404677 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-30ac1fd7-7253-4e45-92c6-85b58b6b5411 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1516 microversion: 2.1 time: 0.294808 May 21 21:59:06.405281 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3162/6451] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:06 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1516 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:07.423960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4ab548af-1bfa-4bee-a08f-1ce5fa5b5e21 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:07.424708 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4ab548af-1bfa-4bee-a08f-1ce5fa5b5e21 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:07.431085 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ab548af-1bfa-4bee-a08f-1ce5fa5b5e21 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:07.431551 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ab548af-1bfa-4bee-a08f-1ce5fa5b5e21 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:07.432359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ab548af-1bfa-4bee-a08f-1ce5fa5b5e21 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:07.432821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ab548af-1bfa-4bee-a08f-1ce5fa5b5e21 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:07.581003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4ab548af-1bfa-4bee-a08f-1ce5fa5b5e21 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:07.588791 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4ab548af-1bfa-4bee-a08f-1ce5fa5b5e21 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1514 microversion: 2.1 time: 0.170172 May 21 21:59:07.589371 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3290/6452] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:07 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:07.736152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-6d651991-8828-4a3c-9858-f699c365e2ad req-f83af608-52f4-4ba3-bc40-40aa253fdfd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f", "tag": "8e720d56-1b91-4599-be3d-5f1667eb34b9"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:59:07.745191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6d651991-8828-4a3c-9858-f699c365e2ad req-f83af608-52f4-4ba3-bc40-40aa253fdfd3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:07.745632 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6d651991-8828-4a3c-9858-f699c365e2ad req-f83af608-52f4-4ba3-bc40-40aa253fdfd3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:07.757719 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-6d651991-8828-4a3c-9858-f699c365e2ad req-f83af608-52f4-4ba3-bc40-40aa253fdfd3 service nova] Creating event network-changed:8e720d56-1b91-4599-be3d-5f1667eb34b9 for instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f on nch2-master-1 May 21 21:59:07.763791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [req-6d651991-8828-4a3c-9858-f699c365e2ad req-f83af608-52f4-4ba3-bc40-40aa253fdfd3 service nova] Instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 21:59:07.774337 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-6d651991-8828-4a3c-9858-f699c365e2ad req-f83af608-52f4-4ba3-bc40-40aa253fdfd3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041911 May 21 21:59:07.774933 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3163/6453] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 21:59:08.606932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e6265e44-7d2a-43ff-b86c-df5101cf542b tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:08.607693 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e6265e44-7d2a-43ff-b86c-df5101cf542b tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:08.610687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=30 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:59:08.615736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6265e44-7d2a-43ff-b86c-df5101cf542b tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:08.616274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6265e44-7d2a-43ff-b86c-df5101cf542b tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:08.617204 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6265e44-7d2a-43ff-b86c-df5101cf542b tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:08.617667 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6265e44-7d2a-43ff-b86c-df5101cf542b tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:08.624124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=88 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:59:08.767149 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e6265e44-7d2a-43ff-b86c-df5101cf542b tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:08.775243 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e6265e44-7d2a-43ff-b86c-df5101cf542b tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1511 microversion: 2.1 time: 0.172885 May 21 21:59:08.776047 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3291/6454] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:08 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:08.794991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-965626c5-4ec3-491e-bc10-e0aa540aa390 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:08.795591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-965626c5-4ec3-491e-bc10-e0aa540aa390 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:08.802421 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-965626c5-4ec3-491e-bc10-e0aa540aa390 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:08.802878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-965626c5-4ec3-491e-bc10-e0aa540aa390 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:08.803661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-965626c5-4ec3-491e-bc10-e0aa540aa390 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:08.804102 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-965626c5-4ec3-491e-bc10-e0aa540aa390 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:08.832177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-965626c5-4ec3-491e-bc10-e0aa540aa390 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 21:59:08.858123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:59:08.941040 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.compute.api [None req-965626c5-4ec3-491e-bc10-e0aa540aa390 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Found an unconfirmed migration during delete, id: 16, status: finished May 21 21:59:10.959229 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-965626c5-4ec3-491e-bc10-e0aa540aa390 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 204 len: 0 microversion: 2.1 time: 2.170164 May 21 21:59:10.959928 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3164/6455] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:59:08 2022] DELETE /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 0 bytes in 2172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 21:59:10.968755 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a2db0402-3db1-47f6-84f9-3bf4f2bdac27 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:10.969519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a2db0402-3db1-47f6-84f9-3bf4f2bdac27 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:10.977607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a2db0402-3db1-47f6-84f9-3bf4f2bdac27 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:10.978069 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a2db0402-3db1-47f6-84f9-3bf4f2bdac27 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:10.978854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a2db0402-3db1-47f6-84f9-3bf4f2bdac27 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:10.979306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a2db0402-3db1-47f6-84f9-3bf4f2bdac27 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:11.132314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a2db0402-3db1-47f6-84f9-3bf4f2bdac27 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:11.140660 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a2db0402-3db1-47f6-84f9-3bf4f2bdac27 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1503 microversion: 2.1 time: 0.176524 May 21 21:59:11.141238 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3292/6456] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:10 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:12.158033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2cba0818-fff2-4dd2-b085-a532fe4389f3 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:12.158807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2cba0818-fff2-4dd2-b085-a532fe4389f3 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:12.166454 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2cba0818-fff2-4dd2-b085-a532fe4389f3 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:12.166910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2cba0818-fff2-4dd2-b085-a532fe4389f3 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:12.167686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2cba0818-fff2-4dd2-b085-a532fe4389f3 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:12.168130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2cba0818-fff2-4dd2-b085-a532fe4389f3 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:12.422502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2cba0818-fff2-4dd2-b085-a532fe4389f3 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:12.430274 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2cba0818-fff2-4dd2-b085-a532fe4389f3 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1503 microversion: 2.1 time: 0.276770 May 21 21:59:12.430865 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3165/6457] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:12 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1503 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:12.896101 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-82c41ef5-2985-4179-a4c3-4c2e9d188572 req-ad6fbe9a-ea09-4876-a155-707a08dfd915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f", "name": "network-vif-deleted", "tag": "8e720d56-1b91-4599-be3d-5f1667eb34b9"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:59:12.905618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-82c41ef5-2985-4179-a4c3-4c2e9d188572 req-ad6fbe9a-ea09-4876-a155-707a08dfd915 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:12.906084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-82c41ef5-2985-4179-a4c3-4c2e9d188572 req-ad6fbe9a-ea09-4876-a155-707a08dfd915 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:12.917023 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-82c41ef5-2985-4179-a4c3-4c2e9d188572 req-ad6fbe9a-ea09-4876-a155-707a08dfd915 service nova] Creating event network-vif-deleted:8e720d56-1b91-4599-be3d-5f1667eb34b9 for instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f on nch2-master-1 May 21 21:59:12.923189 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-82c41ef5-2985-4179-a4c3-4c2e9d188572 req-ad6fbe9a-ea09-4876-a155-707a08dfd915 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030952 May 21 21:59:12.923779 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3293/6458] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:59:13.447671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dc221080-ab11-4192-9db6-d7920adb0871 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:13.448385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dc221080-ab11-4192-9db6-d7920adb0871 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:13.451326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:59:13.457608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc221080-ab11-4192-9db6-d7920adb0871 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:13.458990 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc221080-ab11-4192-9db6-d7920adb0871 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:13.458990 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc221080-ab11-4192-9db6-d7920adb0871 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:13.459368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc221080-ab11-4192-9db6-d7920adb0871 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:13.494255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc221080-ab11-4192-9db6-d7920adb0871 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:13.494720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc221080-ab11-4192-9db6-d7920adb0871 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:13.495186 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-dc221080-ab11-4192-9db6-d7920adb0871 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lazy-loading 'fault' on Instance uuid 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 21:59:13.540933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dc221080-ab11-4192-9db6-d7920adb0871 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938e7d5d20dc4a2ba5c70050511ccf15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b571311d2f7f4720b3ab1ab73b9c32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:13.549327 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dc221080-ab11-4192-9db6-d7920adb0871 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 200 len: 1305 microversion: 2.1 time: 0.105963 May 21 21:59:13.549912 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3166/6459] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:13 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 1305 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:14.568888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3e014ea2-85b0-473b-bc85-3cc1d6f4ff8b tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:14.569605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3e014ea2-85b0-473b-bc85-3cc1d6f4ff8b tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:14.576036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e014ea2-85b0-473b-bc85-3cc1d6f4ff8b tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:14.576704 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e014ea2-85b0-473b-bc85-3cc1d6f4ff8b tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:14.577492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e014ea2-85b0-473b-bc85-3cc1d6f4ff8b tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:14.577949 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e014ea2-85b0-473b-bc85-3cc1d6f4ff8b tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:14.591056 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-3e014ea2-85b0-473b-bc85-3cc1d6f4ff8b tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] HTTP exception thrown: Instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f could not be found. May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3e014ea2-85b0-473b-bc85-3cc1d6f4ff8b tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Request method failure captured: May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f HTTP/1.1 May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiWCFzMFJTKoMg_G9ifft6CbHefOZjynE42BjOidFM0TPbDmoSYF5fVu98qtYUwH2GzceRCPgWV419q0SBkSY-HdEcimL31PDRoMkz4QZQ6v2HieR8ET9Eas9gFT2BmRMQpYY5mgd9wZ85l-ad6-u-d5KhdpRlhzVz5FQeazuMxI-OZc May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: b571311d2f7f4720b3ab1ab73b9c32bc May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-DeleteServersTestJSON-1463857619 May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b571311d2f7f4720b3ab1ab73b9c32bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b571311d2f7f4720b3ab1ab73b9c32bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b571311d2f7f4720b3ab1ab73b9c32bc", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b571311d2f7f4720b3ab1ab73b9c32bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-DeleteServersTestJSON-1463857619 May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: b571311d2f7f4720b3ab1ab73b9c32bc May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-DeleteServersTestJSON-1463857619 May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-DeleteServersTestJSON-1463857619-project May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 938e7d5d20dc4a2ba5c70050511ccf15 May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-DeleteServersTestJSON-1463857619-project May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f could not be found. May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f'} May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f could not be found. May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f could not be found. May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:59:14.592948 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:59:14.598264 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:59:14.598264 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:59:14.598264 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:59:14.598264 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:59:14.598264 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:59:14.598264 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f could not be found. May 21 21:59:14.598264 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:59:14.598264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3e014ea2-85b0-473b-bc85-3cc1d6f4ff8b tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Returning 404 to user: Instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:59:14.598264 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3e014ea2-85b0-473b-bc85-3cc1d6f4ff8b tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 404 len: 111 microversion: 2.1 time: 0.031054 May 21 21:59:14.598264 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3294/6460] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:14 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:59:14.609312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d3b930bd-0d44-46ea-93fe-0eb675a1985f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:14.609869 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d3b930bd-0d44-46ea-93fe-0eb675a1985f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:14.617471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3b930bd-0d44-46ea-93fe-0eb675a1985f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:14.617931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3b930bd-0d44-46ea-93fe-0eb675a1985f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:14.618702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3b930bd-0d44-46ea-93fe-0eb675a1985f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:14.619143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3b930bd-0d44-46ea-93fe-0eb675a1985f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:14.633460 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-d3b930bd-0d44-46ea-93fe-0eb675a1985f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] HTTP exception thrown: Instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f could not be found. May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d3b930bd-0d44-46ea-93fe-0eb675a1985f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Request method failure captured: May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f HTTP/1.1 May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWCFzMFJTKoMg_G9ifft6CbHefOZjynE42BjOidFM0TPbDmoSYF5fVu98qtYUwH2GzceRCPgWV419q0SBkSY-HdEcimL31PDRoMkz4QZQ6v2HieR8ET9Eas9gFT2BmRMQpYY5mgd9wZ85l-ad6-u-d5KhdpRlhzVz5FQeazuMxI-OZc May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: b571311d2f7f4720b3ab1ab73b9c32bc May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-DeleteServersTestJSON-1463857619 May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b571311d2f7f4720b3ab1ab73b9c32bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b571311d2f7f4720b3ab1ab73b9c32bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b571311d2f7f4720b3ab1ab73b9c32bc", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b571311d2f7f4720b3ab1ab73b9c32bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-DeleteServersTestJSON-1463857619 May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: b571311d2f7f4720b3ab1ab73b9c32bc May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-DeleteServersTestJSON-1463857619 May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-DeleteServersTestJSON-1463857619-project May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 938e7d5d20dc4a2ba5c70050511ccf15 May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-DeleteServersTestJSON-1463857619-project May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f could not be found. May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f'} May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f could not be found. May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:59:14.635201 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:59:14.641326 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f could not be found. May 21 21:59:14.641326 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:59:14.641326 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:59:14.641326 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:59:14.641326 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:59:14.641326 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:59:14.641326 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:59:14.641326 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:59:14.641326 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:59:14.641326 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f could not be found. May 21 21:59:14.641326 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 21:59:14.641326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d3b930bd-0d44-46ea-93fe-0eb675a1985f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Returning 404 to user: Instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:59:14.641326 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d3b930bd-0d44-46ea-93fe-0eb675a1985f tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 404 len: 111 microversion: 2.1 time: 0.032076 May 21 21:59:14.641326 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3167/6461] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 21:59:14 2022] DELETE /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:59:14.649250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4c66c622-3f08-41e2-a1d1-0494b2341326 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:14.649250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4c66c622-3f08-41e2-a1d1-0494b2341326 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] [instance: 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:14.653071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4c66c622-3f08-41e2-a1d1-0494b2341326 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:14.653541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4c66c622-3f08-41e2-a1d1-0494b2341326 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:14.654558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4c66c622-3f08-41e2-a1d1-0494b2341326 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:14.655012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4c66c622-3f08-41e2-a1d1-0494b2341326 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:14.668568 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-4c66c622-3f08-41e2-a1d1-0494b2341326 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] HTTP exception thrown: Instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f could not be found. May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4c66c622-3f08-41e2-a1d1-0494b2341326 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Request method failure captured: May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f HTTP/1.1 May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiWCFzMFJTKoMg_G9ifft6CbHefOZjynE42BjOidFM0TPbDmoSYF5fVu98qtYUwH2GzceRCPgWV419q0SBkSY-HdEcimL31PDRoMkz4QZQ6v2HieR8ET9Eas9gFT2BmRMQpYY5mgd9wZ85l-ad6-u-d5KhdpRlhzVz5FQeazuMxI-OZc May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: b571311d2f7f4720b3ab1ab73b9c32bc May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-DeleteServersTestJSON-1463857619 May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b571311d2f7f4720b3ab1ab73b9c32bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b571311d2f7f4720b3ab1ab73b9c32bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b571311d2f7f4720b3ab1ab73b9c32bc", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b571311d2f7f4720b3ab1ab73b9c32bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-DeleteServersTestJSON-1463857619 May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: b571311d2f7f4720b3ab1ab73b9c32bc May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-DeleteServersTestJSON-1463857619 May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-DeleteServersTestJSON-1463857619-project May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 938e7d5d20dc4a2ba5c70050511ccf15 May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-DeleteServersTestJSON-1463857619-project May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f could not be found. May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f'} May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f could not be found. May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f could not be found. May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 21:59:14.670677 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:59:14.676387 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 21:59:14.676387 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 21:59:14.676387 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 21:59:14.676387 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 21:59:14.676387 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 21:59:14.676387 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f could not be found. May 21 21:59:14.676387 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 21:59:14.676387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4c66c622-3f08-41e2-a1d1-0494b2341326 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] Returning 404 to user: Instance 3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 21:59:14.676387 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4c66c622-3f08-41e2-a1d1-0494b2341326 tempest-DeleteServersTestJSON-1463857619 tempest-DeleteServersTestJSON-1463857619-project] 10.222.0.49 "GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f" status: 404 len: 111 microversion: 2.1 time: 0.029563 May 21 21:59:14.676387 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3295/6462] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:14 2022] GET /compute/v2.1/servers/3ba3e99f-e817-4df8-b4c3-1dcdfdef3f2f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 21:59:18.696567 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-036159bb-3ec3-4699-bb8b-0281020c484b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1705328962", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "457b1f52-f9a5-426d-8a0f-69f511671f2e"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:59:18.747922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-036159bb-3ec3-4699-bb8b-0281020c484b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] validate_networks() for [('457b1f52-f9a5-426d-8a0f-69f511671f2e', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 21:59:19.156305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-036159bb-3ec3-4699-bb8b-0281020c484b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:59:19.156748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-036159bb-3ec3-4699-bb8b-0281020c484b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:59:19.157228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-036159bb-3ec3-4699-bb8b-0281020c484b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:59:19.157642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-036159bb-3ec3-4699-bb8b-0281020c484b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:59:19.158059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-036159bb-3ec3-4699-bb8b-0281020c484b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:59:19.167061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-036159bb-3ec3-4699-bb8b-0281020c484b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:19.167511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-036159bb-3ec3-4699-bb8b-0281020c484b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:19.168336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-036159bb-3ec3-4699-bb8b-0281020c484b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:19.168775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-036159bb-3ec3-4699-bb8b-0281020c484b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:19.186196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-036159bb-3ec3-4699-bb8b-0281020c484b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Getting quotas for project 7dde694e9c6c4bb2ae2bf8b74cba293f. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 21:59:19.191704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-036159bb-3ec3-4699-bb8b-0281020c484b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Getting quotas for user daa1b4cc4b4241c3b45f6be15bd99789 and project 7dde694e9c6c4bb2ae2bf8b74cba293f. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 21:59:19.204043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-036159bb-3ec3-4699-bb8b-0281020c484b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 21:59:19.206357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-036159bb-3ec3-4699-bb8b-0281020c484b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 21:59:19.321017 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-036159bb-3ec3-4699-bb8b-0281020c484b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.742102 May 21 21:59:19.321685 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3168/6463] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 21:59:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 21:59:19.331800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1881008c-93ad-441f-adb8-95918b2f86e8 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:19.332681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1881008c-93ad-441f-adb8-95918b2f86e8 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:19.394650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1881008c-93ad-441f-adb8-95918b2f86e8 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:19.405959 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1881008c-93ad-441f-adb8-95918b2f86e8 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1218 microversion: 2.1 time: 0.077115 May 21 21:59:19.406585 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3296/6464] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:19 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:20.424684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-08189985-0e75-41c8-8479-1a38f1b16300 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:20.425362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-08189985-0e75-41c8-8479-1a38f1b16300 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:20.435524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-08189985-0e75-41c8-8479-1a38f1b16300 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:20.436590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-08189985-0e75-41c8-8479-1a38f1b16300 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:20.437506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-08189985-0e75-41c8-8479-1a38f1b16300 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:20.437968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-08189985-0e75-41c8-8479-1a38f1b16300 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:20.504478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-08189985-0e75-41c8-8479-1a38f1b16300 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:20.512156 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-08189985-0e75-41c8-8479-1a38f1b16300 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1222 microversion: 2.1 time: 0.093149 May 21 21:59:20.512774 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3169/6465] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:20 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:21.532903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7f6f2894-6af0-43be-a4d5-19d67ec25fc5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:21.533593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7f6f2894-6af0-43be-a4d5-19d67ec25fc5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:21.540416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f6f2894-6af0-43be-a4d5-19d67ec25fc5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:21.540863 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f6f2894-6af0-43be-a4d5-19d67ec25fc5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:21.541666 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f6f2894-6af0-43be-a4d5-19d67ec25fc5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:21.542123 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f6f2894-6af0-43be-a4d5-19d67ec25fc5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:21.615005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7f6f2894-6af0-43be-a4d5-19d67ec25fc5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:21.622798 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7f6f2894-6af0-43be-a4d5-19d67ec25fc5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1278 microversion: 2.1 time: 0.097445 May 21 21:59:21.624001 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3297/6466] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:21 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:22.641237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-06838c28-50f3-429f-a56a-2ac7805530e8 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:22.642481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-06838c28-50f3-429f-a56a-2ac7805530e8 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:22.649705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06838c28-50f3-429f-a56a-2ac7805530e8 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:22.650157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06838c28-50f3-429f-a56a-2ac7805530e8 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:22.650927 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06838c28-50f3-429f-a56a-2ac7805530e8 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:22.651366 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06838c28-50f3-429f-a56a-2ac7805530e8 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:23.242419 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-06838c28-50f3-429f-a56a-2ac7805530e8 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:23.250170 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-06838c28-50f3-429f-a56a-2ac7805530e8 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1318 microversion: 2.1 time: 0.613500 May 21 21:59:23.250755 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3170/6467] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:22 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:23.798927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-6cf521b5-1f37-4187-b76f-00cfc7319bb8 req-30f87f4f-a118-47f1-a929-c9b07ff161c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5512332e-e9c6-427b-b59a-733fe00c9148", "tag": "5cceb294-d007-49c4-b8d9-9fad8db1fa90"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:59:23.809005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6cf521b5-1f37-4187-b76f-00cfc7319bb8 req-30f87f4f-a118-47f1-a929-c9b07ff161c8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:23.809467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6cf521b5-1f37-4187-b76f-00cfc7319bb8 req-30f87f4f-a118-47f1-a929-c9b07ff161c8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:23.822815 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-6cf521b5-1f37-4187-b76f-00cfc7319bb8 req-30f87f4f-a118-47f1-a929-c9b07ff161c8 service nova] Creating event network-changed:5cceb294-d007-49c4-b8d9-9fad8db1fa90 for instance 5512332e-e9c6-427b-b59a-733fe00c9148 on nch2-master-1 May 21 21:59:23.828960 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-6cf521b5-1f37-4187-b76f-00cfc7319bb8 req-30f87f4f-a118-47f1-a929-c9b07ff161c8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034403 May 21 21:59:23.830014 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3298/6468] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:59:24.268628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-464d1a03-33aa-4523-a7a5-42bf5b4c2a0b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:24.269253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-464d1a03-33aa-4523-a7a5-42bf5b4c2a0b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:24.276322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-464d1a03-33aa-4523-a7a5-42bf5b4c2a0b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:24.276792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-464d1a03-33aa-4523-a7a5-42bf5b4c2a0b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:24.277588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-464d1a03-33aa-4523-a7a5-42bf5b4c2a0b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:24.278035 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-464d1a03-33aa-4523-a7a5-42bf5b4c2a0b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:24.555883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-464d1a03-33aa-4523-a7a5-42bf5b4c2a0b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:24.564542 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-464d1a03-33aa-4523-a7a5-42bf5b4c2a0b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1318 microversion: 2.1 time: 0.300658 May 21 21:59:24.565142 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3171/6469] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:24 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:25.583073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2011180b-3dcb-492e-a910-8ac2e63126d5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:25.583784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2011180b-3dcb-492e-a910-8ac2e63126d5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:25.590982 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2011180b-3dcb-492e-a910-8ac2e63126d5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:25.591445 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2011180b-3dcb-492e-a910-8ac2e63126d5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:25.592880 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2011180b-3dcb-492e-a910-8ac2e63126d5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:25.593333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2011180b-3dcb-492e-a910-8ac2e63126d5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:25.740038 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2011180b-3dcb-492e-a910-8ac2e63126d5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:25.747704 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2011180b-3dcb-492e-a910-8ac2e63126d5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1318 microversion: 2.1 time: 0.168869 May 21 21:59:25.748875 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3299/6470] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:25 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:26.765716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2e38e635-5af4-49ff-a3d7-8a52a0100116 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:26.766410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2e38e635-5af4-49ff-a3d7-8a52a0100116 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:26.773595 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e38e635-5af4-49ff-a3d7-8a52a0100116 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:26.774056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e38e635-5af4-49ff-a3d7-8a52a0100116 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:26.775033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e38e635-5af4-49ff-a3d7-8a52a0100116 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:26.775696 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e38e635-5af4-49ff-a3d7-8a52a0100116 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:26.918717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2e38e635-5af4-49ff-a3d7-8a52a0100116 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:26.926560 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2e38e635-5af4-49ff-a3d7-8a52a0100116 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1318 microversion: 2.1 time: 0.164914 May 21 21:59:26.927126 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3172/6471] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:26 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:27.943308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d0f8b47d-8403-4a52-9a9b-a0c776714588 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:27.943939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d0f8b47d-8403-4a52-9a9b-a0c776714588 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:27.951034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d0f8b47d-8403-4a52-9a9b-a0c776714588 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:27.951759 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d0f8b47d-8403-4a52-9a9b-a0c776714588 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:27.952576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d0f8b47d-8403-4a52-9a9b-a0c776714588 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:27.953037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d0f8b47d-8403-4a52-9a9b-a0c776714588 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:28.091514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d0f8b47d-8403-4a52-9a9b-a0c776714588 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:28.099835 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d0f8b47d-8403-4a52-9a9b-a0c776714588 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1318 microversion: 2.1 time: 0.160498 May 21 21:59:28.100429 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3300/6472] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:27 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:29.117241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7afd111d-b601-4756-b8d5-6d012642e40a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:29.117877 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7afd111d-b601-4756-b8d5-6d012642e40a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:29.125847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7afd111d-b601-4756-b8d5-6d012642e40a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:29.126308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7afd111d-b601-4756-b8d5-6d012642e40a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:29.127086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7afd111d-b601-4756-b8d5-6d012642e40a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:29.127533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7afd111d-b601-4756-b8d5-6d012642e40a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:29.177279 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:59:29.198672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:59:29.270654 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7afd111d-b601-4756-b8d5-6d012642e40a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:29.278255 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7afd111d-b601-4756-b8d5-6d012642e40a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1318 microversion: 2.1 time: 0.164916 May 21 21:59:29.278832 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3173/6473] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:29 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:29.461764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-3b49503d-4125-449f-a956-bd378d80c146 req-8acecdb0-ffc5-417c-8c6d-af6878b64253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5512332e-e9c6-427b-b59a-733fe00c9148", "name": "network-vif-plugged", "status": "completed", "tag": "5cceb294-d007-49c4-b8d9-9fad8db1fa90"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:59:29.467669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:59:29.473145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-3b49503d-4125-449f-a956-bd378d80c146 req-8acecdb0-ffc5-417c-8c6d-af6878b64253 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:29.473669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-3b49503d-4125-449f-a956-bd378d80c146 req-8acecdb0-ffc5-417c-8c6d-af6878b64253 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:29.485516 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-3b49503d-4125-449f-a956-bd378d80c146 req-8acecdb0-ffc5-417c-8c6d-af6878b64253 service nova] Creating event network-vif-plugged:5cceb294-d007-49c4-b8d9-9fad8db1fa90 for instance 5512332e-e9c6-427b-b59a-733fe00c9148 on nch2-master-1 May 21 21:59:29.490547 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-3b49503d-4125-449f-a956-bd378d80c146 req-8acecdb0-ffc5-417c-8c6d-af6878b64253 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032623 May 21 21:59:29.491134 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3301/6474] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 21:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 21:59:30.295110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c907d4b8-fbaf-4392-8750-c57eeb29ec2b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:30.295730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c907d4b8-fbaf-4392-8750-c57eeb29ec2b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:30.302761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c907d4b8-fbaf-4392-8750-c57eeb29ec2b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:30.303242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c907d4b8-fbaf-4392-8750-c57eeb29ec2b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:30.304009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c907d4b8-fbaf-4392-8750-c57eeb29ec2b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:30.304525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c907d4b8-fbaf-4392-8750-c57eeb29ec2b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:30.447616 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c907d4b8-fbaf-4392-8750-c57eeb29ec2b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:30.456221 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c907d4b8-fbaf-4392-8750-c57eeb29ec2b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1318 microversion: 2.1 time: 0.165057 May 21 21:59:30.456821 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3174/6475] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:30 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:31.475140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e314de7f-9482-4897-a841-1da27586c600 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:31.475893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e314de7f-9482-4897-a841-1da27586c600 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:31.482860 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e314de7f-9482-4897-a841-1da27586c600 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:31.483323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e314de7f-9482-4897-a841-1da27586c600 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:31.484130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e314de7f-9482-4897-a841-1da27586c600 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:31.484611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e314de7f-9482-4897-a841-1da27586c600 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:31.632203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e314de7f-9482-4897-a841-1da27586c600 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:31.640732 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e314de7f-9482-4897-a841-1da27586c600 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1506 microversion: 2.1 time: 0.171111 May 21 21:59:31.641314 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3302/6476] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:31 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:31.657561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d4dacce7-a9fa-4d40-859e-30f5b6b11797 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:31.658179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d4dacce7-a9fa-4d40-859e-30f5b6b11797 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:31.665245 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d4dacce7-a9fa-4d40-859e-30f5b6b11797 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:31.665694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d4dacce7-a9fa-4d40-859e-30f5b6b11797 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:31.666478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d4dacce7-a9fa-4d40-859e-30f5b6b11797 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:31.666913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d4dacce7-a9fa-4d40-859e-30f5b6b11797 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:31.819209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d4dacce7-a9fa-4d40-859e-30f5b6b11797 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:31.827618 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d4dacce7-a9fa-4d40-859e-30f5b6b11797 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1506 microversion: 2.1 time: 0.174689 May 21 21:59:31.828197 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3175/6477] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:31 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:31.843544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-33aaf69b-a927-4b16-b9df-370ad40bbab4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:59:31.844823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-33aaf69b-a927-4b16-b9df-370ad40bbab4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:31.851356 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33aaf69b-a927-4b16-b9df-370ad40bbab4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:31.851828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33aaf69b-a927-4b16-b9df-370ad40bbab4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:31.852649 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33aaf69b-a927-4b16-b9df-370ad40bbab4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:31.853109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-33aaf69b-a927-4b16-b9df-370ad40bbab4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:32.008704 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-33aaf69b-a927-4b16-b9df-370ad40bbab4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "PUT /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1078 microversion: 2.1 time: 0.168974 May 21 21:59:32.009248 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3303/6478] 10.222.0.49 () {60 vars in 1255 bytes} [Sat May 21 21:59:31 2022] PUT /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1078 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:32.023539 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c9f2fec6-4bc5-4eed-893f-694d85744386 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:32.024165 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c9f2fec6-4bc5-4eed-893f-694d85744386 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:32.030406 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9f2fec6-4bc5-4eed-893f-694d85744386 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:32.030870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9f2fec6-4bc5-4eed-893f-694d85744386 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:32.031644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9f2fec6-4bc5-4eed-893f-694d85744386 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:32.032089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9f2fec6-4bc5-4eed-893f-694d85744386 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:32.172488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c9f2fec6-4bc5-4eed-893f-694d85744386 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:32.180108 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c9f2fec6-4bc5-4eed-893f-694d85744386 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1504 microversion: 2.1 time: 0.160422 May 21 21:59:32.180725 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3176/6479] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:32 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:32.196754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e4994496-a0b0-487d-86ab-4a2709b04eb6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:32.197410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e4994496-a0b0-487d-86ab-4a2709b04eb6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:32.204513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e4994496-a0b0-487d-86ab-4a2709b04eb6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:32.204976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e4994496-a0b0-487d-86ab-4a2709b04eb6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:32.205745 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e4994496-a0b0-487d-86ab-4a2709b04eb6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:32.206192 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e4994496-a0b0-487d-86ab-4a2709b04eb6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:32.348508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e4994496-a0b0-487d-86ab-4a2709b04eb6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:32.356300 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e4994496-a0b0-487d-86ab-4a2709b04eb6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1504 microversion: 2.1 time: 0.163467 May 21 21:59:32.356885 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3304/6480] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:32 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:32.372613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bab811e3-2a10-4ca2-b5e9-02a9cf559c5f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 21:59:32.373733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bab811e3-2a10-4ca2-b5e9-02a9cf559c5f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:32.380069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bab811e3-2a10-4ca2-b5e9-02a9cf559c5f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:32.380568 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bab811e3-2a10-4ca2-b5e9-02a9cf559c5f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:32.381359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bab811e3-2a10-4ca2-b5e9-02a9cf559c5f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:32.381807 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bab811e3-2a10-4ca2-b5e9-02a9cf559c5f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:32.411618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bab811e3-2a10-4ca2-b5e9-02a9cf559c5f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:32.417718 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bab811e3-2a10-4ca2-b5e9-02a9cf559c5f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Old instance type m1.heat2, new instance type m1.heat {{(pid=131278) resize /opt/stack/nova/nova/compute/api.py:4166}} May 21 21:59:32.423967 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-bab811e3-2a10-4ca2-b5e9-02a9cf559c5f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 21:59:32.424431 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-bab811e3-2a10-4ca2-b5e9-02a9cf559c5f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 21:59:32.424921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-bab811e3-2a10-4ca2-b5e9-02a9cf559c5f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 21:59:32.425340 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-bab811e3-2a10-4ca2-b5e9-02a9cf559c5f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 21:59:32.425763 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-bab811e3-2a10-4ca2-b5e9-02a9cf559c5f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 21:59:32.648681 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bab811e3-2a10-4ca2-b5e9-02a9cf559c5f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "POST /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148/action" status: 202 len: 0 microversion: 2.1 time: 0.279948 May 21 21:59:32.649309 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3177/6481] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 21:59:32 2022] POST /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 21:59:32.657866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-60c24cdd-411b-4150-8d86-3cabbbaa370c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:32.659257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-60c24cdd-411b-4150-8d86-3cabbbaa370c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:32.667399 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-60c24cdd-411b-4150-8d86-3cabbbaa370c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:32.667920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-60c24cdd-411b-4150-8d86-3cabbbaa370c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:32.669532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-60c24cdd-411b-4150-8d86-3cabbbaa370c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:32.669532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-60c24cdd-411b-4150-8d86-3cabbbaa370c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:32.816785 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-60c24cdd-411b-4150-8d86-3cabbbaa370c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:32.824631 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-60c24cdd-411b-4150-8d86-3cabbbaa370c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1515 microversion: 2.1 time: 0.170909 May 21 21:59:32.825276 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3305/6482] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:32 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:33.843773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d8a24e61-1956-4b15-ab5b-04d08bccd945 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:33.844519 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d8a24e61-1956-4b15-ab5b-04d08bccd945 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:33.850711 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8a24e61-1956-4b15-ab5b-04d08bccd945 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:33.851168 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8a24e61-1956-4b15-ab5b-04d08bccd945 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:33.851941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8a24e61-1956-4b15-ab5b-04d08bccd945 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:33.852414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d8a24e61-1956-4b15-ab5b-04d08bccd945 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:34.001816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d8a24e61-1956-4b15-ab5b-04d08bccd945 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:34.009638 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d8a24e61-1956-4b15-ab5b-04d08bccd945 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1515 microversion: 2.1 time: 0.171474 May 21 21:59:34.010227 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3178/6483] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:33 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:35.027132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6dde53a2-e62c-46fa-9fc4-12314487e629 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:35.027770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6dde53a2-e62c-46fa-9fc4-12314487e629 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:35.036073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6dde53a2-e62c-46fa-9fc4-12314487e629 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:35.036575 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6dde53a2-e62c-46fa-9fc4-12314487e629 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:35.037370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6dde53a2-e62c-46fa-9fc4-12314487e629 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:35.037830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6dde53a2-e62c-46fa-9fc4-12314487e629 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:35.188179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6dde53a2-e62c-46fa-9fc4-12314487e629 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:35.196758 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6dde53a2-e62c-46fa-9fc4-12314487e629 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1515 microversion: 2.1 time: 0.173571 May 21 21:59:35.197334 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3306/6484] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:35 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:36.214575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-25d00f26-1801-478f-aa65-e4048301a684 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:36.215200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-25d00f26-1801-478f-aa65-e4048301a684 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:36.222426 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25d00f26-1801-478f-aa65-e4048301a684 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:36.222881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25d00f26-1801-478f-aa65-e4048301a684 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:36.223660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25d00f26-1801-478f-aa65-e4048301a684 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:36.224102 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25d00f26-1801-478f-aa65-e4048301a684 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:36.239009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:59:36.374522 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-25d00f26-1801-478f-aa65-e4048301a684 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:36.382211 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-25d00f26-1801-478f-aa65-e4048301a684 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.171587 May 21 21:59:36.382795 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3179/6485] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:36 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:37.400341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a2a7916a-6fc7-435e-aaed-deb609f2aef6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:37.400969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a2a7916a-6fc7-435e-aaed-deb609f2aef6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:37.408918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a2a7916a-6fc7-435e-aaed-deb609f2aef6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:37.409385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a2a7916a-6fc7-435e-aaed-deb609f2aef6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:37.410163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a2a7916a-6fc7-435e-aaed-deb609f2aef6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:37.410614 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a2a7916a-6fc7-435e-aaed-deb609f2aef6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:37.890335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a2a7916a-6fc7-435e-aaed-deb609f2aef6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:37.898172 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a2a7916a-6fc7-435e-aaed-deb609f2aef6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.501734 May 21 21:59:37.898750 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3307/6486] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:37 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:38.914993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9a9fca14-5287-4ae5-bf34-780bb90a289e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:38.915608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9a9fca14-5287-4ae5-bf34-780bb90a289e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:38.922843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a9fca14-5287-4ae5-bf34-780bb90a289e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:38.923296 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a9fca14-5287-4ae5-bf34-780bb90a289e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:38.924067 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a9fca14-5287-4ae5-bf34-780bb90a289e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:38.924536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a9fca14-5287-4ae5-bf34-780bb90a289e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:39.069450 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9a9fca14-5287-4ae5-bf34-780bb90a289e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:39.077233 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9a9fca14-5287-4ae5-bf34-780bb90a289e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.166050 May 21 21:59:39.077809 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3180/6487] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:38 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:40.094195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-07c3de43-0a66-47b7-88d3-1f297c91c40e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:40.094742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-07c3de43-0a66-47b7-88d3-1f297c91c40e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:40.097650 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=36 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:59:40.102542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07c3de43-0a66-47b7-88d3-1f297c91c40e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:40.102996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07c3de43-0a66-47b7-88d3-1f297c91c40e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:40.103774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07c3de43-0a66-47b7-88d3-1f297c91c40e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:40.104252 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07c3de43-0a66-47b7-88d3-1f297c91c40e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:40.108225 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:59:40.248313 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-07c3de43-0a66-47b7-88d3-1f297c91c40e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:40.256138 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-07c3de43-0a66-47b7-88d3-1f297c91c40e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.165933 May 21 21:59:40.256753 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3308/6488] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:40 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:41.273405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-28617a81-f6de-45fd-8529-0b4e9b17d5fc tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:41.274034 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-28617a81-f6de-45fd-8529-0b4e9b17d5fc tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:41.281857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28617a81-f6de-45fd-8529-0b4e9b17d5fc tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:41.282309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28617a81-f6de-45fd-8529-0b4e9b17d5fc tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:41.283074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28617a81-f6de-45fd-8529-0b4e9b17d5fc tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:41.283511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28617a81-f6de-45fd-8529-0b4e9b17d5fc tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:41.433495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-28617a81-f6de-45fd-8529-0b4e9b17d5fc tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:41.443351 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-28617a81-f6de-45fd-8529-0b4e9b17d5fc tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.173901 May 21 21:59:41.443948 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3181/6489] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:41 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:42.461766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a1129c91-e14c-42ac-8d1b-5e418b865a2d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:42.462398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a1129c91-e14c-42ac-8d1b-5e418b865a2d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:42.470586 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1129c91-e14c-42ac-8d1b-5e418b865a2d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:42.471058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1129c91-e14c-42ac-8d1b-5e418b865a2d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:42.471847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1129c91-e14c-42ac-8d1b-5e418b865a2d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:42.472378 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1129c91-e14c-42ac-8d1b-5e418b865a2d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:42.620341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a1129c91-e14c-42ac-8d1b-5e418b865a2d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:42.628509 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a1129c91-e14c-42ac-8d1b-5e418b865a2d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.171115 May 21 21:59:42.629095 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3309/6490] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:42 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:43.645312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-23d84c2a-e623-4736-a78e-091467e68c74 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:43.645929 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-23d84c2a-e623-4736-a78e-091467e68c74 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:43.653094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-23d84c2a-e623-4736-a78e-091467e68c74 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:43.653551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-23d84c2a-e623-4736-a78e-091467e68c74 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:43.654319 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-23d84c2a-e623-4736-a78e-091467e68c74 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:43.654773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-23d84c2a-e623-4736-a78e-091467e68c74 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:43.798094 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-23d84c2a-e623-4736-a78e-091467e68c74 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:43.805759 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-23d84c2a-e623-4736-a78e-091467e68c74 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.164367 May 21 21:59:43.806343 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3182/6491] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:43 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:44.823713 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d1da5007-9ec4-424b-9773-34a1ab7655c4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:44.824410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d1da5007-9ec4-424b-9773-34a1ab7655c4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:44.832509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d1da5007-9ec4-424b-9773-34a1ab7655c4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:44.832974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d1da5007-9ec4-424b-9773-34a1ab7655c4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:44.833786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d1da5007-9ec4-424b-9773-34a1ab7655c4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:44.834235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d1da5007-9ec4-424b-9773-34a1ab7655c4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:44.974898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d1da5007-9ec4-424b-9773-34a1ab7655c4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:44.982559 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d1da5007-9ec4-424b-9773-34a1ab7655c4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.162717 May 21 21:59:44.983664 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3310/6492] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:44 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:46.001087 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-398f97e6-5a5c-4f6e-9cb5-6fad1e4e81c2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:46.001631 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-398f97e6-5a5c-4f6e-9cb5-6fad1e4e81c2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:46.008686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-398f97e6-5a5c-4f6e-9cb5-6fad1e4e81c2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:46.009143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-398f97e6-5a5c-4f6e-9cb5-6fad1e4e81c2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:46.009914 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-398f97e6-5a5c-4f6e-9cb5-6fad1e4e81c2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:46.010357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-398f97e6-5a5c-4f6e-9cb5-6fad1e4e81c2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:46.150960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-398f97e6-5a5c-4f6e-9cb5-6fad1e4e81c2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:46.159090 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-398f97e6-5a5c-4f6e-9cb5-6fad1e4e81c2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.162929 May 21 21:59:46.159666 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3183/6493] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:45 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:47.176567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-39e80482-979a-4b56-91f4-3d26ff5c2257 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:47.177200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-39e80482-979a-4b56-91f4-3d26ff5c2257 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:47.184223 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39e80482-979a-4b56-91f4-3d26ff5c2257 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:47.184722 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39e80482-979a-4b56-91f4-3d26ff5c2257 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:47.185504 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39e80482-979a-4b56-91f4-3d26ff5c2257 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:47.186513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39e80482-979a-4b56-91f4-3d26ff5c2257 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:47.331678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-39e80482-979a-4b56-91f4-3d26ff5c2257 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:47.339422 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-39e80482-979a-4b56-91f4-3d26ff5c2257 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.166802 May 21 21:59:47.339996 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3311/6494] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:47 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:48.357493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-67afae45-3ede-4e58-9148-7a0d8fbf7df5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:48.358199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-67afae45-3ede-4e58-9148-7a0d8fbf7df5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:48.365710 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-67afae45-3ede-4e58-9148-7a0d8fbf7df5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:48.366157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-67afae45-3ede-4e58-9148-7a0d8fbf7df5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:48.366925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-67afae45-3ede-4e58-9148-7a0d8fbf7df5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:48.367359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-67afae45-3ede-4e58-9148-7a0d8fbf7df5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:48.518605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-67afae45-3ede-4e58-9148-7a0d8fbf7df5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:48.526197 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-67afae45-3ede-4e58-9148-7a0d8fbf7df5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.172710 May 21 21:59:48.526771 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3184/6495] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:48 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:49.545443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c3c4fdcd-fbaa-4b63-9f3e-30e6a677fcce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:49.546123 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c3c4fdcd-fbaa-4b63-9f3e-30e6a677fcce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:49.553183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c3c4fdcd-fbaa-4b63-9f3e-30e6a677fcce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:49.553658 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c3c4fdcd-fbaa-4b63-9f3e-30e6a677fcce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:49.554436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c3c4fdcd-fbaa-4b63-9f3e-30e6a677fcce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:49.554890 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c3c4fdcd-fbaa-4b63-9f3e-30e6a677fcce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:49.699593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c3c4fdcd-fbaa-4b63-9f3e-30e6a677fcce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:49.707285 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c3c4fdcd-fbaa-4b63-9f3e-30e6a677fcce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.165913 May 21 21:59:49.707861 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3312/6496] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:49 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:50.724431 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7adf6bab-cc79-4405-ac4e-3f075fc781fa tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:50.725056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7adf6bab-cc79-4405-ac4e-3f075fc781fa tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:50.727820 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:59:50.732778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7adf6bab-cc79-4405-ac4e-3f075fc781fa tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:50.733414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7adf6bab-cc79-4405-ac4e-3f075fc781fa tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:50.734195 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7adf6bab-cc79-4405-ac4e-3f075fc781fa tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:50.734639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7adf6bab-cc79-4405-ac4e-3f075fc781fa tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:50.879356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7adf6bab-cc79-4405-ac4e-3f075fc781fa tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:50.886940 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7adf6bab-cc79-4405-ac4e-3f075fc781fa tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.166457 May 21 21:59:50.887509 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3185/6497] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:50 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:51.904367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9862af69-63dc-41b7-9b0b-f1eb4467c0c6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:51.905702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9862af69-63dc-41b7-9b0b-f1eb4467c0c6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:51.912873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9862af69-63dc-41b7-9b0b-f1eb4467c0c6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:51.916990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9862af69-63dc-41b7-9b0b-f1eb4467c0c6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:51.916990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9862af69-63dc-41b7-9b0b-f1eb4467c0c6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:51.916990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9862af69-63dc-41b7-9b0b-f1eb4467c0c6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:52.054779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9862af69-63dc-41b7-9b0b-f1eb4467c0c6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:52.063258 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9862af69-63dc-41b7-9b0b-f1eb4467c0c6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.162854 May 21 21:59:52.064094 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3313/6498] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:51 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:53.081524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2a700367-29c8-4b2c-b519-d469de8412d6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:53.082098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2a700367-29c8-4b2c-b519-d469de8412d6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:53.089238 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a700367-29c8-4b2c-b519-d469de8412d6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:53.089685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a700367-29c8-4b2c-b519-d469de8412d6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:53.090482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a700367-29c8-4b2c-b519-d469de8412d6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:53.090920 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a700367-29c8-4b2c-b519-d469de8412d6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:53.237722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2a700367-29c8-4b2c-b519-d469de8412d6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:53.245422 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2a700367-29c8-4b2c-b519-d469de8412d6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.168113 May 21 21:59:53.246001 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3186/6499] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:53 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:54.262473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b96893be-5504-49f7-9e43-d3ac2859796f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:54.263105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b96893be-5504-49f7-9e43-d3ac2859796f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:54.270995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b96893be-5504-49f7-9e43-d3ac2859796f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:54.271459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b96893be-5504-49f7-9e43-d3ac2859796f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:54.272247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b96893be-5504-49f7-9e43-d3ac2859796f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:54.272729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b96893be-5504-49f7-9e43-d3ac2859796f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:54.431384 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b96893be-5504-49f7-9e43-d3ac2859796f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:54.440086 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b96893be-5504-49f7-9e43-d3ac2859796f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.181531 May 21 21:59:54.440683 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3314/6500] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:54 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:55.462721 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d0a8b3d2-958a-47bf-96a6-1efbb67e1c13 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:55.463254 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d0a8b3d2-958a-47bf-96a6-1efbb67e1c13 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:55.470741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0a8b3d2-958a-47bf-96a6-1efbb67e1c13 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:55.471189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0a8b3d2-958a-47bf-96a6-1efbb67e1c13 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:55.471954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0a8b3d2-958a-47bf-96a6-1efbb67e1c13 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:55.472422 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0a8b3d2-958a-47bf-96a6-1efbb67e1c13 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:55.637275 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d0a8b3d2-958a-47bf-96a6-1efbb67e1c13 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:55.645444 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d0a8b3d2-958a-47bf-96a6-1efbb67e1c13 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.186888 May 21 21:59:55.646021 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3187/6501] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:55 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:56.663043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-da2fb058-fc34-4b41-8775-d37deab64aa7 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:56.663674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-da2fb058-fc34-4b41-8775-d37deab64aa7 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:56.671805 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da2fb058-fc34-4b41-8775-d37deab64aa7 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:56.672289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da2fb058-fc34-4b41-8775-d37deab64aa7 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:56.673105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da2fb058-fc34-4b41-8775-d37deab64aa7 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:56.673571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da2fb058-fc34-4b41-8775-d37deab64aa7 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:56.818668 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-da2fb058-fc34-4b41-8775-d37deab64aa7 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:56.828025 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-da2fb058-fc34-4b41-8775-d37deab64aa7 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.168912 May 21 21:59:56.828698 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3315/6502] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:56 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:57.845403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-571850db-a8e7-4faf-8d31-d33c87c01960 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:57.846030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-571850db-a8e7-4faf-8d31-d33c87c01960 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:57.853220 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-571850db-a8e7-4faf-8d31-d33c87c01960 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:57.853683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-571850db-a8e7-4faf-8d31-d33c87c01960 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:57.854462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-571850db-a8e7-4faf-8d31-d33c87c01960 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:57.854907 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-571850db-a8e7-4faf-8d31-d33c87c01960 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:58.000268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-571850db-a8e7-4faf-8d31-d33c87c01960 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:58.007831 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-571850db-a8e7-4faf-8d31-d33c87c01960 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.167128 May 21 21:59:58.008437 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3188/6503] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:57 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 21:59:59.025100 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c8de8141-bb0f-4460-bb52-49c97723aa2c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 21:59:59.025684 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c8de8141-bb0f-4460-bb52-49c97723aa2c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 21:59:59.033245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c8de8141-bb0f-4460-bb52-49c97723aa2c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:59.033714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c8de8141-bb0f-4460-bb52-49c97723aa2c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:59.034508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c8de8141-bb0f-4460-bb52-49c97723aa2c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 21:59:59.034955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c8de8141-bb0f-4460-bb52-49c97723aa2c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 21:59:59.180084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c8de8141-bb0f-4460-bb52-49c97723aa2c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 21:59:59.188184 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c8de8141-bb0f-4460-bb52-49c97723aa2c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.167109 May 21 21:59:59.189047 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3316/6504] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 21:59:59 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:00.205620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7122c2b4-4d42-4140-ad00-8c89b6f0d853 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:00.206244 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7122c2b4-4d42-4140-ad00-8c89b6f0d853 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:00.213253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7122c2b4-4d42-4140-ad00-8c89b6f0d853 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:00.213705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7122c2b4-4d42-4140-ad00-8c89b6f0d853 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:00.214468 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7122c2b4-4d42-4140-ad00-8c89b6f0d853 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:00.214909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7122c2b4-4d42-4140-ad00-8c89b6f0d853 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:00.362583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7122c2b4-4d42-4140-ad00-8c89b6f0d853 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:00.370337 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7122c2b4-4d42-4140-ad00-8c89b6f0d853 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.168732 May 21 22:00:00.370918 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3189/6505] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:00 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:01.387425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-59376849-6d87-4a73-aa93-abd1c92ff33a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:01.387980 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-59376849-6d87-4a73-aa93-abd1c92ff33a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:01.395640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-59376849-6d87-4a73-aa93-abd1c92ff33a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:01.396104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-59376849-6d87-4a73-aa93-abd1c92ff33a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:01.396907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-59376849-6d87-4a73-aa93-abd1c92ff33a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:01.397408 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-59376849-6d87-4a73-aa93-abd1c92ff33a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:01.546051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-59376849-6d87-4a73-aa93-abd1c92ff33a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:01.553678 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-59376849-6d87-4a73-aa93-abd1c92ff33a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.170184 May 21 22:00:01.554259 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3317/6506] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:01 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:00:02.571254 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f8f03a43-b5a7-4c3d-b3fa-f85198588e7a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:02.571875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f8f03a43-b5a7-4c3d-b3fa-f85198588e7a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:02.579606 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f8f03a43-b5a7-4c3d-b3fa-f85198588e7a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:02.580062 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f8f03a43-b5a7-4c3d-b3fa-f85198588e7a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:02.580859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f8f03a43-b5a7-4c3d-b3fa-f85198588e7a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:02.581302 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f8f03a43-b5a7-4c3d-b3fa-f85198588e7a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:02.724846 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f8f03a43-b5a7-4c3d-b3fa-f85198588e7a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:02.732733 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f8f03a43-b5a7-4c3d-b3fa-f85198588e7a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1520 microversion: 2.1 time: 0.165359 May 21 22:00:02.733318 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3190/6507] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:02 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:03.749171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8ee9b25b-5179-49f3-b465-881a9e04062f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:03.749811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8ee9b25b-5179-49f3-b465-881a9e04062f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:03.757209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ee9b25b-5179-49f3-b465-881a9e04062f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:03.757683 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ee9b25b-5179-49f3-b465-881a9e04062f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:03.758513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ee9b25b-5179-49f3-b465-881a9e04062f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:03.759457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ee9b25b-5179-49f3-b465-881a9e04062f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:03.977257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8ee9b25b-5179-49f3-b465-881a9e04062f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:03.985777 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8ee9b25b-5179-49f3-b465-881a9e04062f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1519 microversion: 2.1 time: 0.240682 May 21 22:00:03.986358 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3318/6508] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:03 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1519 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:04.000792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-a5d0b3c7-0318-4b19-bfd7-52cfc627a483 req-050486b4-0ece-41b3-ab9e-12f382fcd2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5512332e-e9c6-427b-b59a-733fe00c9148", "name": "network-vif-unplugged", "status": "completed", "tag": "5cceb294-d007-49c4-b8d9-9fad8db1fa90"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:00:04.008896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a5d0b3c7-0318-4b19-bfd7-52cfc627a483 req-050486b4-0ece-41b3-ab9e-12f382fcd2f1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:04.018916 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a5d0b3c7-0318-4b19-bfd7-52cfc627a483 req-050486b4-0ece-41b3-ab9e-12f382fcd2f1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:04.021627 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-a5d0b3c7-0318-4b19-bfd7-52cfc627a483 req-050486b4-0ece-41b3-ab9e-12f382fcd2f1 service nova] Creating event network-vif-unplugged:5cceb294-d007-49c4-b8d9-9fad8db1fa90 for instance 5512332e-e9c6-427b-b59a-733fe00c9148 on nch1-master-1 May 21 22:00:04.026973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [req-a5d0b3c7-0318-4b19-bfd7-52cfc627a483 req-050486b4-0ece-41b3-ab9e-12f382fcd2f1 service nova] Instance 5512332e-e9c6-427b-b59a-733fe00c9148 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 22:00:04.038593 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-a5d0b3c7-0318-4b19-bfd7-52cfc627a483 req-050486b4-0ece-41b3-ab9e-12f382fcd2f1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109343 May 21 22:00:04.039383 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3191/6509] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:00:05.004235 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f2cd90af-f06f-45a0-bc56-7628dcf7c8b1 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:05.004895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f2cd90af-f06f-45a0-bc56-7628dcf7c8b1 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:05.012172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2cd90af-f06f-45a0-bc56-7628dcf7c8b1 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:05.012944 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2cd90af-f06f-45a0-bc56-7628dcf7c8b1 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:05.014341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2cd90af-f06f-45a0-bc56-7628dcf7c8b1 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:05.014829 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2cd90af-f06f-45a0-bc56-7628dcf7c8b1 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:05.178786 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f2cd90af-f06f-45a0-bc56-7628dcf7c8b1 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:05.186796 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f2cd90af-f06f-45a0-bc56-7628dcf7c8b1 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1519 microversion: 2.1 time: 0.186490 May 21 22:00:05.187951 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3319/6510] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:04 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:06.056682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-51023e3c-3810-403e-92a3-1413ebc4acef req-4c5862c9-6769-4612-a36f-f318d767d9ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5512332e-e9c6-427b-b59a-733fe00c9148", "tag": "5cceb294-d007-49c4-b8d9-9fad8db1fa90"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:00:06.066296 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-51023e3c-3810-403e-92a3-1413ebc4acef req-4c5862c9-6769-4612-a36f-f318d767d9ad service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:06.066745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-51023e3c-3810-403e-92a3-1413ebc4acef req-4c5862c9-6769-4612-a36f-f318d767d9ad service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:06.078765 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-51023e3c-3810-403e-92a3-1413ebc4acef req-4c5862c9-6769-4612-a36f-f318d767d9ad service nova] Creating event network-changed:5cceb294-d007-49c4-b8d9-9fad8db1fa90 for instance 5512332e-e9c6-427b-b59a-733fe00c9148 on nch1-master-1 May 21 22:00:06.084023 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [req-51023e3c-3810-403e-92a3-1413ebc4acef req-4c5862c9-6769-4612-a36f-f318d767d9ad service nova] Instance 5512332e-e9c6-427b-b59a-733fe00c9148 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 22:00:06.095438 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-51023e3c-3810-403e-92a3-1413ebc4acef req-4c5862c9-6769-4612-a36f-f318d767d9ad service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043721 May 21 22:00:06.096353 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3192/6511] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:00:06.204735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0af4b963-da52-4da4-a548-23e61ed2e2e2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:06.205375 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0af4b963-da52-4da4-a548-23e61ed2e2e2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:06.212443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0af4b963-da52-4da4-a548-23e61ed2e2e2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:06.212920 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0af4b963-da52-4da4-a548-23e61ed2e2e2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:06.213708 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0af4b963-da52-4da4-a548-23e61ed2e2e2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:06.214165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0af4b963-da52-4da4-a548-23e61ed2e2e2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:06.394000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0af4b963-da52-4da4-a548-23e61ed2e2e2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:06.402537 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0af4b963-da52-4da4-a548-23e61ed2e2e2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1517 microversion: 2.1 time: 0.201804 May 21 22:00:06.409933 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3320/6512] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:06 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1517 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:06.513084 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:00:06.514304 ncdv-master-1 devstack@n-api.service[131278]: Sat May 21 22:00:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:00:07.421440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a6da45d6-6a8a-43e5-b02b-7408e7f6b57c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:07.422145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a6da45d6-6a8a-43e5-b02b-7408e7f6b57c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:07.429848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a6da45d6-6a8a-43e5-b02b-7408e7f6b57c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:07.430305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a6da45d6-6a8a-43e5-b02b-7408e7f6b57c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:07.431065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a6da45d6-6a8a-43e5-b02b-7408e7f6b57c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:07.431503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a6da45d6-6a8a-43e5-b02b-7408e7f6b57c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:07.435591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=78 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:00:07.495715 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:00:07.496258 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 22:00:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:00:07.591836 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a6da45d6-6a8a-43e5-b02b-7408e7f6b57c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:07.599674 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a6da45d6-6a8a-43e5-b02b-7408e7f6b57c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1514 microversion: 2.1 time: 0.182531 May 21 22:00:07.600249 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3193/6513] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:07 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:07.616266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-adaa3c35-4e22-4211-acb8-945a9b8355a0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:00:07.616921 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-adaa3c35-4e22-4211-acb8-945a9b8355a0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:07.624157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-adaa3c35-4e22-4211-acb8-945a9b8355a0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:07.624660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-adaa3c35-4e22-4211-acb8-945a9b8355a0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:07.625452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-adaa3c35-4e22-4211-acb8-945a9b8355a0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:07.625908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-adaa3c35-4e22-4211-acb8-945a9b8355a0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:07.720445 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:00:07.720609 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 22:00:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148/action (ip 10.222.0.49) !!! May 21 22:00:07.854596 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-adaa3c35-4e22-4211-acb8-945a9b8355a0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "POST /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148/action" status: 204 len: 0 microversion: 2.1 time: 0.242007 May 21 22:00:07.855282 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3321/6514] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:00:07 2022] POST /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148/action => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:00:07.865310 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d2f96d68-87e1-47f3-8fac-edbef494494b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:07.867293 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d2f96d68-87e1-47f3-8fac-edbef494494b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:07.876188 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2f96d68-87e1-47f3-8fac-edbef494494b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:07.876803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2f96d68-87e1-47f3-8fac-edbef494494b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:07.877608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2f96d68-87e1-47f3-8fac-edbef494494b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:07.878029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2f96d68-87e1-47f3-8fac-edbef494494b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:08.082924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d2f96d68-87e1-47f3-8fac-edbef494494b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:08.093367 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d2f96d68-87e1-47f3-8fac-edbef494494b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1514 microversion: 2.1 time: 0.233098 May 21 22:00:08.094090 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3194/6515] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:07 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:09.112875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8c0ca4ee-f581-422d-8d2c-293523b55bca tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:09.113594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8c0ca4ee-f581-422d-8d2c-293523b55bca tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:09.119913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c0ca4ee-f581-422d-8d2c-293523b55bca tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:09.120417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c0ca4ee-f581-422d-8d2c-293523b55bca tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:09.121211 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c0ca4ee-f581-422d-8d2c-293523b55bca tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:09.121668 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8c0ca4ee-f581-422d-8d2c-293523b55bca tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:09.271378 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8c0ca4ee-f581-422d-8d2c-293523b55bca tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:09.279531 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8c0ca4ee-f581-422d-8d2c-293523b55bca tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1514 microversion: 2.1 time: 0.172079 May 21 22:00:09.280132 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3322/6516] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:09 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:10.237803 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-22a14cf3-26cc-480e-bab0-e2d761935c5b req-421e5bb1-0abd-43eb-a3b3-7dbb8737dbb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5512332e-e9c6-427b-b59a-733fe00c9148", "name": "network-vif-plugged", "status": "completed", "tag": "5cceb294-d007-49c4-b8d9-9fad8db1fa90"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:00:10.246845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-22a14cf3-26cc-480e-bab0-e2d761935c5b req-421e5bb1-0abd-43eb-a3b3-7dbb8737dbb5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:10.247238 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-22a14cf3-26cc-480e-bab0-e2d761935c5b req-421e5bb1-0abd-43eb-a3b3-7dbb8737dbb5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:10.261894 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-22a14cf3-26cc-480e-bab0-e2d761935c5b req-421e5bb1-0abd-43eb-a3b3-7dbb8737dbb5 service nova] Creating event network-vif-plugged:5cceb294-d007-49c4-b8d9-9fad8db1fa90 for instance 5512332e-e9c6-427b-b59a-733fe00c9148 on nch1-master-1 May 21 22:00:10.267462 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-22a14cf3-26cc-480e-bab0-e2d761935c5b req-421e5bb1-0abd-43eb-a3b3-7dbb8737dbb5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033626 May 21 22:00:10.268064 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3195/6517] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:00:10.296698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-27fbdd0b-e241-4161-bf97-39dd72cf50e2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:10.297324 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-27fbdd0b-e241-4161-bf97-39dd72cf50e2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:10.300096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=30 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:00:10.304983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27fbdd0b-e241-4161-bf97-39dd72cf50e2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:10.305446 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27fbdd0b-e241-4161-bf97-39dd72cf50e2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:10.306221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27fbdd0b-e241-4161-bf97-39dd72cf50e2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:10.306670 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27fbdd0b-e241-4161-bf97-39dd72cf50e2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:10.325866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:00:10.455204 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-27fbdd0b-e241-4161-bf97-39dd72cf50e2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:10.463227 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-27fbdd0b-e241-4161-bf97-39dd72cf50e2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1506 microversion: 2.1 time: 0.170957 May 21 22:00:10.463792 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3323/6518] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:10 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:10.480033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f6310972-1ba5-477c-a1e5-736e4a57f50d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:10.480770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f6310972-1ba5-477c-a1e5-736e4a57f50d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:10.487804 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6310972-1ba5-477c-a1e5-736e4a57f50d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:10.488236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6310972-1ba5-477c-a1e5-736e4a57f50d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:10.489031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6310972-1ba5-477c-a1e5-736e4a57f50d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:10.489474 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f6310972-1ba5-477c-a1e5-736e4a57f50d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:10.632372 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f6310972-1ba5-477c-a1e5-736e4a57f50d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:10.640038 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f6310972-1ba5-477c-a1e5-736e4a57f50d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1506 microversion: 2.1 time: 0.164179 May 21 22:00:10.640629 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3196/6519] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:10 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:10.656114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a13e4d7b-4436-4504-8ea6-347f0afcae5c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:10.656775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a13e4d7b-4436-4504-8ea6-347f0afcae5c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:10.663052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a13e4d7b-4436-4504-8ea6-347f0afcae5c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:10.663531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a13e4d7b-4436-4504-8ea6-347f0afcae5c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:10.664343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a13e4d7b-4436-4504-8ea6-347f0afcae5c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:10.664801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a13e4d7b-4436-4504-8ea6-347f0afcae5c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:10.806644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a13e4d7b-4436-4504-8ea6-347f0afcae5c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:10.814958 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a13e4d7b-4436-4504-8ea6-347f0afcae5c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 200 len: 1506 microversion: 2.1 time: 0.163301 May 21 22:00:10.815522 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3324/6520] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:10 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:10.830999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fa2a1eab-f220-4d6e-8b62-7cabca5673fa tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:10.831535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fa2a1eab-f220-4d6e-8b62-7cabca5673fa tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:10.837579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa2a1eab-f220-4d6e-8b62-7cabca5673fa tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:10.838030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa2a1eab-f220-4d6e-8b62-7cabca5673fa tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:10.838790 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa2a1eab-f220-4d6e-8b62-7cabca5673fa tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:10.839229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa2a1eab-f220-4d6e-8b62-7cabca5673fa tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:10.865671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fa2a1eab-f220-4d6e-8b62-7cabca5673fa tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 22:00:11.169604 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fa2a1eab-f220-4d6e-8b62-7cabca5673fa tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 204 len: 0 microversion: 2.1 time: 0.342604 May 21 22:00:11.170199 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3197/6521] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:00:10 2022] DELETE /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:00:11.225260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8831b225-23a0-498c-ad9c-d7574e0f2bce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1105267279", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "457b1f52-f9a5-426d-8a0f-69f511671f2e"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:00:11.281613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-8831b225-23a0-498c-ad9c-d7574e0f2bce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] validate_networks() for [('457b1f52-f9a5-426d-8a0f-69f511671f2e', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 22:00:11.713365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-8831b225-23a0-498c-ad9c-d7574e0f2bce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:00:11.713912 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-8831b225-23a0-498c-ad9c-d7574e0f2bce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:00:11.714317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-8831b225-23a0-498c-ad9c-d7574e0f2bce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:00:11.714741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-8831b225-23a0-498c-ad9c-d7574e0f2bce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:00:11.715165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-8831b225-23a0-498c-ad9c-d7574e0f2bce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:00:11.724949 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8831b225-23a0-498c-ad9c-d7574e0f2bce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:11.725409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8831b225-23a0-498c-ad9c-d7574e0f2bce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:11.726222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8831b225-23a0-498c-ad9c-d7574e0f2bce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:11.726670 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8831b225-23a0-498c-ad9c-d7574e0f2bce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:11.743486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-8831b225-23a0-498c-ad9c-d7574e0f2bce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Getting quotas for project 7dde694e9c6c4bb2ae2bf8b74cba293f. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:00:11.749365 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-8831b225-23a0-498c-ad9c-d7574e0f2bce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Getting quotas for user daa1b4cc4b4241c3b45f6be15bd99789 and project 7dde694e9c6c4bb2ae2bf8b74cba293f. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:00:11.761784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8831b225-23a0-498c-ad9c-d7574e0f2bce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 22:00:11.764086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8831b225-23a0-498c-ad9c-d7574e0f2bce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 22:00:11.875148 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8831b225-23a0-498c-ad9c-d7574e0f2bce tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653774 May 21 22:00:11.876043 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3325/6522] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 22:00:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 22:00:11.886554 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4e04cf6b-109f-4fa1-8eae-790350074c3f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:11.887266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4e04cf6b-109f-4fa1-8eae-790350074c3f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:11.948965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4e04cf6b-109f-4fa1-8eae-790350074c3f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:11.957990 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4e04cf6b-109f-4fa1-8eae-790350074c3f tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1218 microversion: 2.1 time: 0.075753 May 21 22:00:11.959687 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3198/6523] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:11 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:12.977060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0abaf5f0-f836-4eec-8ca4-18734bf0d5e9 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:12.977721 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0abaf5f0-f836-4eec-8ca4-18734bf0d5e9 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:12.985418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0abaf5f0-f836-4eec-8ca4-18734bf0d5e9 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:12.987325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0abaf5f0-f836-4eec-8ca4-18734bf0d5e9 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:12.987325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0abaf5f0-f836-4eec-8ca4-18734bf0d5e9 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:12.987325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0abaf5f0-f836-4eec-8ca4-18734bf0d5e9 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:13.078767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0abaf5f0-f836-4eec-8ca4-18734bf0d5e9 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:13.088379 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0abaf5f0-f836-4eec-8ca4-18734bf0d5e9 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1222 microversion: 2.1 time: 0.116268 May 21 22:00:13.089482 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3326/6524] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:12 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:13.135309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-df73479a-3e30-4af6-82e4-8c51b2091c48 req-ca8df9d8-dc0d-4a51-9813-d0bc9f004dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5512332e-e9c6-427b-b59a-733fe00c9148", "name": "network-vif-deleted", "tag": "5cceb294-d007-49c4-b8d9-9fad8db1fa90"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:00:13.147187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-df73479a-3e30-4af6-82e4-8c51b2091c48 req-ca8df9d8-dc0d-4a51-9813-d0bc9f004dd6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:13.147880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-df73479a-3e30-4af6-82e4-8c51b2091c48 req-ca8df9d8-dc0d-4a51-9813-d0bc9f004dd6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:13.163417 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-df73479a-3e30-4af6-82e4-8c51b2091c48 req-ca8df9d8-dc0d-4a51-9813-d0bc9f004dd6 service nova] Creating event network-vif-deleted:5cceb294-d007-49c4-b8d9-9fad8db1fa90 for instance 5512332e-e9c6-427b-b59a-733fe00c9148 on nch1-master-1 May 21 22:00:13.171444 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-df73479a-3e30-4af6-82e4-8c51b2091c48 req-ca8df9d8-dc0d-4a51-9813-d0bc9f004dd6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038505 May 21 22:00:13.171444 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3199/6525] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:00:14.106655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f5fb9802-bf70-473d-8c9a-0f196abae0b5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:14.107241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f5fb9802-bf70-473d-8c9a-0f196abae0b5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:14.114449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5fb9802-bf70-473d-8c9a-0f196abae0b5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:14.115239 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5fb9802-bf70-473d-8c9a-0f196abae0b5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:14.116043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5fb9802-bf70-473d-8c9a-0f196abae0b5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:14.116528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f5fb9802-bf70-473d-8c9a-0f196abae0b5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:14.198559 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f5fb9802-bf70-473d-8c9a-0f196abae0b5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:14.206877 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f5fb9802-bf70-473d-8c9a-0f196abae0b5 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1276 microversion: 2.1 time: 0.104239 May 21 22:00:14.207448 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3327/6526] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:14 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1276 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:15.226128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d18e1073-745c-421c-b3b4-b9717206a8dc tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:15.226845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d18e1073-745c-421c-b3b4-b9717206a8dc tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:15.233339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d18e1073-745c-421c-b3b4-b9717206a8dc tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:15.233805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d18e1073-745c-421c-b3b4-b9717206a8dc tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:15.234587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d18e1073-745c-421c-b3b4-b9717206a8dc tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:15.235090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d18e1073-745c-421c-b3b4-b9717206a8dc tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:15.386228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d18e1073-745c-421c-b3b4-b9717206a8dc tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:15.394765 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d18e1073-745c-421c-b3b4-b9717206a8dc tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1318 microversion: 2.1 time: 0.173938 May 21 22:00:15.395410 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3200/6527] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:15 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:15.671228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-5f407997-8713-4885-bd56-900142dd5324 req-183057c4-d1e0-40bb-ba84-379c334ce68f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e118e4-0f33-4e8d-a193-07a0914520cd", "tag": "d514b962-c048-4d6e-a368-f2a322372615"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:00:15.680740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5f407997-8713-4885-bd56-900142dd5324 req-183057c4-d1e0-40bb-ba84-379c334ce68f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:15.681517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5f407997-8713-4885-bd56-900142dd5324 req-183057c4-d1e0-40bb-ba84-379c334ce68f service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:15.698466 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-5f407997-8713-4885-bd56-900142dd5324 req-183057c4-d1e0-40bb-ba84-379c334ce68f service nova] Creating event network-changed:d514b962-c048-4d6e-a368-f2a322372615 for instance 33e118e4-0f33-4e8d-a193-07a0914520cd on nch1-master-1 May 21 22:00:15.703228 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-5f407997-8713-4885-bd56-900142dd5324 req-183057c4-d1e0-40bb-ba84-379c334ce68f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036492 May 21 22:00:15.703896 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3328/6528] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:00:16.412321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0dda21b0-3424-419d-bf2b-5b2fe5cea354 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:16.412872 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0dda21b0-3424-419d-bf2b-5b2fe5cea354 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:16.419999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0dda21b0-3424-419d-bf2b-5b2fe5cea354 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:16.420487 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0dda21b0-3424-419d-bf2b-5b2fe5cea354 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:16.422206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0dda21b0-3424-419d-bf2b-5b2fe5cea354 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:16.422206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0dda21b0-3424-419d-bf2b-5b2fe5cea354 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:16.568039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0dda21b0-3424-419d-bf2b-5b2fe5cea354 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:16.575793 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0dda21b0-3424-419d-bf2b-5b2fe5cea354 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1318 microversion: 2.1 time: 0.167524 May 21 22:00:16.576389 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3201/6529] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:16 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:17.595460 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b0224aed-9076-4f33-85e4-c08921e78ac0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:17.596087 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b0224aed-9076-4f33-85e4-c08921e78ac0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:17.602599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0224aed-9076-4f33-85e4-c08921e78ac0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:17.603067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0224aed-9076-4f33-85e4-c08921e78ac0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:17.603855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0224aed-9076-4f33-85e4-c08921e78ac0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:17.604394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b0224aed-9076-4f33-85e4-c08921e78ac0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:17.751528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b0224aed-9076-4f33-85e4-c08921e78ac0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:17.759153 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b0224aed-9076-4f33-85e4-c08921e78ac0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1318 microversion: 2.1 time: 0.169520 May 21 22:00:17.759732 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3329/6530] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:17 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:18.776656 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-30bc5a9d-6090-4820-bd8c-dca22a55f630 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:18.777290 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-30bc5a9d-6090-4820-bd8c-dca22a55f630 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:18.784674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30bc5a9d-6090-4820-bd8c-dca22a55f630 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:18.785138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30bc5a9d-6090-4820-bd8c-dca22a55f630 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:18.785919 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30bc5a9d-6090-4820-bd8c-dca22a55f630 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:18.786365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-30bc5a9d-6090-4820-bd8c-dca22a55f630 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:18.926199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-30bc5a9d-6090-4820-bd8c-dca22a55f630 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:18.933863 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-30bc5a9d-6090-4820-bd8c-dca22a55f630 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1318 microversion: 2.1 time: 0.161159 May 21 22:00:18.934372 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3202/6531] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:18 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:19.951090 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bd328b8a-fc05-47f4-a5f0-334a7a4c59e6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:19.952441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bd328b8a-fc05-47f4-a5f0-334a7a4c59e6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:19.959396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd328b8a-fc05-47f4-a5f0-334a7a4c59e6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:19.959864 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd328b8a-fc05-47f4-a5f0-334a7a4c59e6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:19.960683 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd328b8a-fc05-47f4-a5f0-334a7a4c59e6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:19.961140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd328b8a-fc05-47f4-a5f0-334a7a4c59e6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:20.105962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bd328b8a-fc05-47f4-a5f0-334a7a4c59e6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:20.114365 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bd328b8a-fc05-47f4-a5f0-334a7a4c59e6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1318 microversion: 2.1 time: 0.167265 May 21 22:00:20.114951 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3330/6532] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:19 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:21.131976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c41765e2-8520-45c6-a736-13202ed16f09 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:21.132628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c41765e2-8520-45c6-a736-13202ed16f09 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:21.135560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:00:21.141193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c41765e2-8520-45c6-a736-13202ed16f09 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:21.141649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c41765e2-8520-45c6-a736-13202ed16f09 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:21.142451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c41765e2-8520-45c6-a736-13202ed16f09 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:21.142892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c41765e2-8520-45c6-a736-13202ed16f09 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:21.292865 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c41765e2-8520-45c6-a736-13202ed16f09 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:21.300613 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c41765e2-8520-45c6-a736-13202ed16f09 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1318 microversion: 2.1 time: 0.172601 May 21 22:00:21.301194 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3203/6533] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:21 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:22.286803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f53323f1-190e-487c-ab52-9f58f94ee894 req-31f17fac-d48e-4f07-bc08-55c4f6ae775a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e118e4-0f33-4e8d-a193-07a0914520cd", "name": "network-vif-plugged", "status": "completed", "tag": "d514b962-c048-4d6e-a368-f2a322372615"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:00:22.291323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:00:22.292065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:00:22.298959 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f53323f1-190e-487c-ab52-9f58f94ee894 req-31f17fac-d48e-4f07-bc08-55c4f6ae775a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:22.299419 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f53323f1-190e-487c-ab52-9f58f94ee894 req-31f17fac-d48e-4f07-bc08-55c4f6ae775a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:22.312169 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f53323f1-190e-487c-ab52-9f58f94ee894 req-31f17fac-d48e-4f07-bc08-55c4f6ae775a service nova] Creating event network-vif-plugged:d514b962-c048-4d6e-a368-f2a322372615 for instance 33e118e4-0f33-4e8d-a193-07a0914520cd on nch1-master-1 May 21 22:00:22.317640 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f53323f1-190e-487c-ab52-9f58f94ee894 req-31f17fac-d48e-4f07-bc08-55c4f6ae775a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034812 May 21 22:00:22.318398 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3331/6534] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:00:22.318758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5d26821c-1396-427c-8efb-bfca0db9e59b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:22.319563 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5d26821c-1396-427c-8efb-bfca0db9e59b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:22.326644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:00:22.328358 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d26821c-1396-427c-8efb-bfca0db9e59b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:22.329049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d26821c-1396-427c-8efb-bfca0db9e59b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:22.330011 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d26821c-1396-427c-8efb-bfca0db9e59b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:22.330460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5d26821c-1396-427c-8efb-bfca0db9e59b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:22.490462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5d26821c-1396-427c-8efb-bfca0db9e59b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:22.498223 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5d26821c-1396-427c-8efb-bfca0db9e59b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1318 microversion: 2.1 time: 0.183705 May 21 22:00:22.499558 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3204/6535] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:22 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:00:23.517751 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b72d1a32-89fd-4f78-9820-0e93ed61cc10 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:23.518615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b72d1a32-89fd-4f78-9820-0e93ed61cc10 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:23.526033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b72d1a32-89fd-4f78-9820-0e93ed61cc10 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:23.526493 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b72d1a32-89fd-4f78-9820-0e93ed61cc10 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:23.527269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b72d1a32-89fd-4f78-9820-0e93ed61cc10 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:23.527719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b72d1a32-89fd-4f78-9820-0e93ed61cc10 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:23.689467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b72d1a32-89fd-4f78-9820-0e93ed61cc10 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:23.699395 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b72d1a32-89fd-4f78-9820-0e93ed61cc10 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1318 microversion: 2.1 time: 0.187718 May 21 22:00:23.700273 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3332/6536] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:23 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:24.716669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fc3e6757-3730-4977-828a-b39fb66dadc3 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:24.717914 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fc3e6757-3730-4977-828a-b39fb66dadc3 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:24.724922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc3e6757-3730-4977-828a-b39fb66dadc3 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:24.725374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc3e6757-3730-4977-828a-b39fb66dadc3 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:24.726138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc3e6757-3730-4977-828a-b39fb66dadc3 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:24.726575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc3e6757-3730-4977-828a-b39fb66dadc3 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:24.873685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fc3e6757-3730-4977-828a-b39fb66dadc3 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:24.881429 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fc3e6757-3730-4977-828a-b39fb66dadc3 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1507 microversion: 2.1 time: 0.168895 May 21 22:00:24.882003 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3205/6537] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:24 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:24.898277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-07342a9b-97c0-4a2b-b448-a9b6de697d22 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:24.898917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-07342a9b-97c0-4a2b-b448-a9b6de697d22 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:24.906675 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07342a9b-97c0-4a2b-b448-a9b6de697d22 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:24.907142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07342a9b-97c0-4a2b-b448-a9b6de697d22 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:24.907939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07342a9b-97c0-4a2b-b448-a9b6de697d22 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:24.908470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07342a9b-97c0-4a2b-b448-a9b6de697d22 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:25.053658 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-07342a9b-97c0-4a2b-b448-a9b6de697d22 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:25.061837 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-07342a9b-97c0-4a2b-b448-a9b6de697d22 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1507 microversion: 2.1 time: 0.167401 May 21 22:00:25.062420 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3333/6538] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:24 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:25.078530 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-490c18df-1180-4fdb-a701-783f27535733 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:00:25.079666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-490c18df-1180-4fdb-a701-783f27535733 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:25.086006 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-490c18df-1180-4fdb-a701-783f27535733 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:25.086465 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-490c18df-1180-4fdb-a701-783f27535733 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:25.087239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-490c18df-1180-4fdb-a701-783f27535733 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:25.087690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-490c18df-1180-4fdb-a701-783f27535733 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:25.115570 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-490c18df-1180-4fdb-a701-783f27535733 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:25.121438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-490c18df-1180-4fdb-a701-783f27535733 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Old instance type m1.heat2, new instance type m1.heat {{(pid=131278) resize /opt/stack/nova/nova/compute/api.py:4166}} May 21 22:00:25.128419 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-490c18df-1180-4fdb-a701-783f27535733 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:00:25.128844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-490c18df-1180-4fdb-a701-783f27535733 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:00:25.129325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-490c18df-1180-4fdb-a701-783f27535733 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:00:25.130066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-490c18df-1180-4fdb-a701-783f27535733 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:00:25.130159 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-490c18df-1180-4fdb-a701-783f27535733 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:00:25.332416 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-490c18df-1180-4fdb-a701-783f27535733 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "POST /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd/action" status: 202 len: 0 microversion: 2.1 time: 0.258181 May 21 22:00:25.332956 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3206/6539] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:00:25 2022] POST /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:00:25.341276 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1d1b72fb-889d-4a49-948f-762b21806349 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:25.341951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1d1b72fb-889d-4a49-948f-762b21806349 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:25.349798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d1b72fb-889d-4a49-948f-762b21806349 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:25.349798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d1b72fb-889d-4a49-948f-762b21806349 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:25.350095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d1b72fb-889d-4a49-948f-762b21806349 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:25.350471 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d1b72fb-889d-4a49-948f-762b21806349 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:25.494522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1d1b72fb-889d-4a49-948f-762b21806349 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:25.503123 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1d1b72fb-889d-4a49-948f-762b21806349 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1514 microversion: 2.1 time: 0.165832 May 21 22:00:25.510141 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3334/6540] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:25 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:00:26.522506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4bfdf7fa-4aca-4b1f-bb28-84631e737007 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:26.523134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4bfdf7fa-4aca-4b1f-bb28-84631e737007 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:26.529365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bfdf7fa-4aca-4b1f-bb28-84631e737007 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:26.529814 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bfdf7fa-4aca-4b1f-bb28-84631e737007 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:26.530578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bfdf7fa-4aca-4b1f-bb28-84631e737007 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:26.531017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bfdf7fa-4aca-4b1f-bb28-84631e737007 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:26.677384 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4bfdf7fa-4aca-4b1f-bb28-84631e737007 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:26.691340 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4bfdf7fa-4aca-4b1f-bb28-84631e737007 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1514 microversion: 2.1 time: 0.173695 May 21 22:00:26.691974 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3207/6541] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:26 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:27.710150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-74f1e9e3-2929-4902-b57b-4c19bcf1d4d8 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:27.710797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-74f1e9e3-2929-4902-b57b-4c19bcf1d4d8 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:27.718364 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-74f1e9e3-2929-4902-b57b-4c19bcf1d4d8 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:27.718846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-74f1e9e3-2929-4902-b57b-4c19bcf1d4d8 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:27.719635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-74f1e9e3-2929-4902-b57b-4c19bcf1d4d8 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:27.720145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-74f1e9e3-2929-4902-b57b-4c19bcf1d4d8 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:27.976728 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-74f1e9e3-2929-4902-b57b-4c19bcf1d4d8 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:27.985064 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-74f1e9e3-2929-4902-b57b-4c19bcf1d4d8 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1514 microversion: 2.1 time: 0.279054 May 21 22:00:27.985710 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3335/6542] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:27 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1514 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:29.002530 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-83e43615-a078-437c-998f-0f1aaab891ba tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:29.003153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-83e43615-a078-437c-998f-0f1aaab891ba tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:29.010284 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-83e43615-a078-437c-998f-0f1aaab891ba tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:29.010745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-83e43615-a078-437c-998f-0f1aaab891ba tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:29.011527 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-83e43615-a078-437c-998f-0f1aaab891ba tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:29.011976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-83e43615-a078-437c-998f-0f1aaab891ba tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:29.166112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-83e43615-a078-437c-998f-0f1aaab891ba tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:29.174352 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-83e43615-a078-437c-998f-0f1aaab891ba tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.176177 May 21 22:00:29.174930 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3208/6543] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:28 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:30.191968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6ee81451-3fe6-464b-922c-42b8bd9de7a0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:30.192633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6ee81451-3fe6-464b-922c-42b8bd9de7a0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:30.199708 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ee81451-3fe6-464b-922c-42b8bd9de7a0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:30.200167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ee81451-3fe6-464b-922c-42b8bd9de7a0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:30.200980 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ee81451-3fe6-464b-922c-42b8bd9de7a0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:30.201428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ee81451-3fe6-464b-922c-42b8bd9de7a0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:30.344210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6ee81451-3fe6-464b-922c-42b8bd9de7a0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:30.352128 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6ee81451-3fe6-464b-922c-42b8bd9de7a0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.165125 May 21 22:00:30.352754 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3336/6544] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:30 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:31.369388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-574b8c96-7f6f-46d7-8e8c-6b965e612530 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:31.370012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-574b8c96-7f6f-46d7-8e8c-6b965e612530 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:31.377547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-574b8c96-7f6f-46d7-8e8c-6b965e612530 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:31.378077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-574b8c96-7f6f-46d7-8e8c-6b965e612530 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:31.378851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-574b8c96-7f6f-46d7-8e8c-6b965e612530 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:31.379291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-574b8c96-7f6f-46d7-8e8c-6b965e612530 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:31.381944 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:00:31.523264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-574b8c96-7f6f-46d7-8e8c-6b965e612530 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:31.531563 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-574b8c96-7f6f-46d7-8e8c-6b965e612530 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.166070 May 21 22:00:31.532140 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3209/6545] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:31 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:32.548635 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f1f460bb-2c36-40ea-92f4-2ad3b16a2961 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:32.549286 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f1f460bb-2c36-40ea-92f4-2ad3b16a2961 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:32.556321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1f460bb-2c36-40ea-92f4-2ad3b16a2961 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:32.556798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1f460bb-2c36-40ea-92f4-2ad3b16a2961 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:32.557581 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1f460bb-2c36-40ea-92f4-2ad3b16a2961 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:32.558039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1f460bb-2c36-40ea-92f4-2ad3b16a2961 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:32.709521 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f1f460bb-2c36-40ea-92f4-2ad3b16a2961 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:32.717136 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f1f460bb-2c36-40ea-92f4-2ad3b16a2961 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.172584 May 21 22:00:32.718260 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3337/6546] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:32 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:33.735240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c8c62217-3fe3-4e7d-bf8a-6fde835205b3 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:33.735795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c8c62217-3fe3-4e7d-bf8a-6fde835205b3 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:33.743015 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8c62217-3fe3-4e7d-bf8a-6fde835205b3 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:33.743473 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8c62217-3fe3-4e7d-bf8a-6fde835205b3 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:33.744253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8c62217-3fe3-4e7d-bf8a-6fde835205b3 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:33.744725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8c62217-3fe3-4e7d-bf8a-6fde835205b3 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:33.888484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c8c62217-3fe3-4e7d-bf8a-6fde835205b3 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:33.896525 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c8c62217-3fe3-4e7d-bf8a-6fde835205b3 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.165117 May 21 22:00:33.897107 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3210/6547] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:33 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:34.914434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-64c016d3-ed2a-4944-8302-5e02d7f13bde tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:34.915058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-64c016d3-ed2a-4944-8302-5e02d7f13bde tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:34.922999 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-64c016d3-ed2a-4944-8302-5e02d7f13bde tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:34.923462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-64c016d3-ed2a-4944-8302-5e02d7f13bde tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:34.924233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-64c016d3-ed2a-4944-8302-5e02d7f13bde tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:34.924705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-64c016d3-ed2a-4944-8302-5e02d7f13bde tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:35.066639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-64c016d3-ed2a-4944-8302-5e02d7f13bde tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:35.074756 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-64c016d3-ed2a-4944-8302-5e02d7f13bde tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.164295 May 21 22:00:35.075340 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3338/6548] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:34 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:36.092386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b3c56a16-d96e-4884-a985-82d2e65d9223 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:36.092934 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b3c56a16-d96e-4884-a985-82d2e65d9223 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:36.100824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3c56a16-d96e-4884-a985-82d2e65d9223 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:36.101270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3c56a16-d96e-4884-a985-82d2e65d9223 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:36.102034 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3c56a16-d96e-4884-a985-82d2e65d9223 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:36.102471 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3c56a16-d96e-4884-a985-82d2e65d9223 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:36.248731 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b3c56a16-d96e-4884-a985-82d2e65d9223 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:36.256690 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b3c56a16-d96e-4884-a985-82d2e65d9223 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.168213 May 21 22:00:36.257317 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3211/6549] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:36 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:37.273797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4a073c7f-5eaa-45f8-ad70-43ecfaeab93d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:37.274423 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4a073c7f-5eaa-45f8-ad70-43ecfaeab93d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:37.282179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a073c7f-5eaa-45f8-ad70-43ecfaeab93d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:37.282642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a073c7f-5eaa-45f8-ad70-43ecfaeab93d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:37.283423 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a073c7f-5eaa-45f8-ad70-43ecfaeab93d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:37.283869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4a073c7f-5eaa-45f8-ad70-43ecfaeab93d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:37.428825 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4a073c7f-5eaa-45f8-ad70-43ecfaeab93d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:37.436546 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4a073c7f-5eaa-45f8-ad70-43ecfaeab93d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.166625 May 21 22:00:37.437110 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3339/6550] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:37 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:38.455168 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4c086266-43b0-4273-ae64-945c33fd4a77 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:38.455791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4c086266-43b0-4273-ae64-945c33fd4a77 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:38.462859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4c086266-43b0-4273-ae64-945c33fd4a77 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:38.463317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4c086266-43b0-4273-ae64-945c33fd4a77 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:38.464088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4c086266-43b0-4273-ae64-945c33fd4a77 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:38.464556 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4c086266-43b0-4273-ae64-945c33fd4a77 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:38.623260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4c086266-43b0-4273-ae64-945c33fd4a77 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:38.632515 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4c086266-43b0-4273-ae64-945c33fd4a77 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.181746 May 21 22:00:38.633110 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3212/6551] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:38 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:39.650586 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e3436ad4-b07c-4191-adc6-38cad786a699 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:39.651218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e3436ad4-b07c-4191-adc6-38cad786a699 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:39.658463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3436ad4-b07c-4191-adc6-38cad786a699 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:39.658929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3436ad4-b07c-4191-adc6-38cad786a699 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:39.659711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3436ad4-b07c-4191-adc6-38cad786a699 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:39.660166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3436ad4-b07c-4191-adc6-38cad786a699 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:39.805193 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e3436ad4-b07c-4191-adc6-38cad786a699 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:39.812826 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e3436ad4-b07c-4191-adc6-38cad786a699 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.166142 May 21 22:00:39.814502 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3340/6552] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:39 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:40.831185 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-77d03d2a-24d3-4077-972f-127aea2562e0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:40.831801 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-77d03d2a-24d3-4077-972f-127aea2562e0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:40.838843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-77d03d2a-24d3-4077-972f-127aea2562e0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:40.839294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-77d03d2a-24d3-4077-972f-127aea2562e0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:40.840059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-77d03d2a-24d3-4077-972f-127aea2562e0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:40.840526 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-77d03d2a-24d3-4077-972f-127aea2562e0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:40.987722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-77d03d2a-24d3-4077-972f-127aea2562e0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:40.993118 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-77d03d2a-24d3-4077-972f-127aea2562e0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.165959 May 21 22:00:40.993688 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3213/6553] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:40 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:42.010609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bce418bb-35da-44cf-b45e-e0a55f66f8f7 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:42.011203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bce418bb-35da-44cf-b45e-e0a55f66f8f7 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:42.014072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:00:42.019136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bce418bb-35da-44cf-b45e-e0a55f66f8f7 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:42.019605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bce418bb-35da-44cf-b45e-e0a55f66f8f7 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:42.020418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bce418bb-35da-44cf-b45e-e0a55f66f8f7 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:42.020879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bce418bb-35da-44cf-b45e-e0a55f66f8f7 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:42.024941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=93 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:00:42.171939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bce418bb-35da-44cf-b45e-e0a55f66f8f7 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:42.174638 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bce418bb-35da-44cf-b45e-e0a55f66f8f7 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.167974 May 21 22:00:42.175228 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3341/6554] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:42 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:43.191742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dab3a196-43dd-489a-acb2-857657abc9ba tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:43.192432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dab3a196-43dd-489a-acb2-857657abc9ba tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:43.199817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dab3a196-43dd-489a-acb2-857657abc9ba tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:43.200269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dab3a196-43dd-489a-acb2-857657abc9ba tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:43.201069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dab3a196-43dd-489a-acb2-857657abc9ba tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:43.201507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dab3a196-43dd-489a-acb2-857657abc9ba tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:43.378850 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dab3a196-43dd-489a-acb2-857657abc9ba tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:43.386872 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dab3a196-43dd-489a-acb2-857657abc9ba tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.199545 May 21 22:00:43.387583 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3214/6555] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:43 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:44.417250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-61248b6e-2517-43d4-bf19-c01a41c83847 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:44.417876 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-61248b6e-2517-43d4-bf19-c01a41c83847 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:44.426466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61248b6e-2517-43d4-bf19-c01a41c83847 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:44.426933 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61248b6e-2517-43d4-bf19-c01a41c83847 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:44.427726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61248b6e-2517-43d4-bf19-c01a41c83847 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:44.428168 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61248b6e-2517-43d4-bf19-c01a41c83847 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:44.575962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-61248b6e-2517-43d4-bf19-c01a41c83847 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:44.583563 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-61248b6e-2517-43d4-bf19-c01a41c83847 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.170371 May 21 22:00:44.584123 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3342/6556] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:44 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:45.603268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d0eec1e0-d11e-4848-85d7-e82408cbde64 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:45.603791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d0eec1e0-d11e-4848-85d7-e82408cbde64 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:45.611774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0eec1e0-d11e-4848-85d7-e82408cbde64 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:45.612235 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0eec1e0-d11e-4848-85d7-e82408cbde64 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:45.613060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0eec1e0-d11e-4848-85d7-e82408cbde64 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:45.613508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d0eec1e0-d11e-4848-85d7-e82408cbde64 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:45.755861 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d0eec1e0-d11e-4848-85d7-e82408cbde64 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:45.763534 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d0eec1e0-d11e-4848-85d7-e82408cbde64 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.166668 May 21 22:00:45.764122 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3215/6557] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:45 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:46.781215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-600f39d0-0bb7-430f-8f6b-b89f1d362145 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:46.782357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-600f39d0-0bb7-430f-8f6b-b89f1d362145 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:46.789553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-600f39d0-0bb7-430f-8f6b-b89f1d362145 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:46.790019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-600f39d0-0bb7-430f-8f6b-b89f1d362145 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:46.790804 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-600f39d0-0bb7-430f-8f6b-b89f1d362145 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:46.791260 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-600f39d0-0bb7-430f-8f6b-b89f1d362145 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:46.933841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-600f39d0-0bb7-430f-8f6b-b89f1d362145 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:46.942038 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-600f39d0-0bb7-430f-8f6b-b89f1d362145 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.164798 May 21 22:00:46.942615 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3343/6558] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:46 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:47.960119 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fc2b38ba-6ed6-4c27-9c86-a43218003723 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:47.960686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fc2b38ba-6ed6-4c27-9c86-a43218003723 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:47.967844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc2b38ba-6ed6-4c27-9c86-a43218003723 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:47.968324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc2b38ba-6ed6-4c27-9c86-a43218003723 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:47.969727 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc2b38ba-6ed6-4c27-9c86-a43218003723 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:47.970172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc2b38ba-6ed6-4c27-9c86-a43218003723 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:48.129618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fc2b38ba-6ed6-4c27-9c86-a43218003723 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:48.137392 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fc2b38ba-6ed6-4c27-9c86-a43218003723 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.181300 May 21 22:00:48.137960 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3216/6559] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:47 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:49.154901 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d0ca028b-1c3e-4f10-9c38-b1dc622550bf tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:49.155527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d0ca028b-1c3e-4f10-9c38-b1dc622550bf tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:49.163275 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d0ca028b-1c3e-4f10-9c38-b1dc622550bf tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:49.168073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d0ca028b-1c3e-4f10-9c38-b1dc622550bf tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:49.168073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d0ca028b-1c3e-4f10-9c38-b1dc622550bf tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:49.168073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d0ca028b-1c3e-4f10-9c38-b1dc622550bf tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:49.310125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d0ca028b-1c3e-4f10-9c38-b1dc622550bf tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:49.318222 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d0ca028b-1c3e-4f10-9c38-b1dc622550bf tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.167217 May 21 22:00:49.318803 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3344/6560] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:49 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:50.335222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f08c5aee-67d7-4b80-842c-b81e6f5a388a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:50.335835 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f08c5aee-67d7-4b80-842c-b81e6f5a388a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:50.342893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f08c5aee-67d7-4b80-842c-b81e6f5a388a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:50.343352 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f08c5aee-67d7-4b80-842c-b81e6f5a388a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:50.344913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f08c5aee-67d7-4b80-842c-b81e6f5a388a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:50.352565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f08c5aee-67d7-4b80-842c-b81e6f5a388a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:50.489337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f08c5aee-67d7-4b80-842c-b81e6f5a388a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:50.497057 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f08c5aee-67d7-4b80-842c-b81e6f5a388a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.165687 May 21 22:00:50.497624 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3217/6561] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:50 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:51.514302 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f84184c4-f634-4815-a58c-8c2de13fe6f4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:51.514938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f84184c4-f634-4815-a58c-8c2de13fe6f4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:51.522233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f84184c4-f634-4815-a58c-8c2de13fe6f4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:51.522711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f84184c4-f634-4815-a58c-8c2de13fe6f4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:51.523499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f84184c4-f634-4815-a58c-8c2de13fe6f4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:51.523958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f84184c4-f634-4815-a58c-8c2de13fe6f4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:51.676030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f84184c4-f634-4815-a58c-8c2de13fe6f4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:51.684377 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f84184c4-f634-4815-a58c-8c2de13fe6f4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.173434 May 21 22:00:51.684512 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3345/6562] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:51 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:52.701904 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-466699bc-5414-4807-aa78-99ec8039ae3d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:52.702532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-466699bc-5414-4807-aa78-99ec8039ae3d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:52.705982 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=34 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:00:52.710990 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-466699bc-5414-4807-aa78-99ec8039ae3d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:52.711453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-466699bc-5414-4807-aa78-99ec8039ae3d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:52.712237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-466699bc-5414-4807-aa78-99ec8039ae3d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:52.712713 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-466699bc-5414-4807-aa78-99ec8039ae3d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:52.863843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-466699bc-5414-4807-aa78-99ec8039ae3d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:52.871972 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-466699bc-5414-4807-aa78-99ec8039ae3d tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.173929 May 21 22:00:52.872505 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3218/6563] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:52 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:53.890290 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b42dbcd0-4df6-4630-92c0-38bdcdc5644a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:53.891027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b42dbcd0-4df6-4630-92c0-38bdcdc5644a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:53.898229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b42dbcd0-4df6-4630-92c0-38bdcdc5644a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:53.898711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b42dbcd0-4df6-4630-92c0-38bdcdc5644a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:53.899540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b42dbcd0-4df6-4630-92c0-38bdcdc5644a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:53.900001 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b42dbcd0-4df6-4630-92c0-38bdcdc5644a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:54.134322 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b42dbcd0-4df6-4630-92c0-38bdcdc5644a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:54.142012 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b42dbcd0-4df6-4630-92c0-38bdcdc5644a tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.255601 May 21 22:00:54.142727 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3346/6564] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:53 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:55.160306 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a40376c6-028d-4479-b04a-c00bab15dbb0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:55.160961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a40376c6-028d-4479-b04a-c00bab15dbb0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:55.167956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a40376c6-028d-4479-b04a-c00bab15dbb0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:55.168460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a40376c6-028d-4479-b04a-c00bab15dbb0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:55.169249 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a40376c6-028d-4479-b04a-c00bab15dbb0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:55.169694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a40376c6-028d-4479-b04a-c00bab15dbb0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:55.376305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a40376c6-028d-4479-b04a-c00bab15dbb0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:55.383805 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a40376c6-028d-4479-b04a-c00bab15dbb0 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1519 microversion: 2.1 time: 0.228765 May 21 22:00:55.384385 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3219/6565] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:55 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1519 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:56.276805 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-33128fc6-e8d5-473b-883d-2712de230ded req-33da235e-7845-43b0-9764-db89e5f01eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e118e4-0f33-4e8d-a193-07a0914520cd", "name": "network-vif-unplugged", "status": "completed", "tag": "d514b962-c048-4d6e-a368-f2a322372615"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:00:56.286007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-33128fc6-e8d5-473b-883d-2712de230ded req-33da235e-7845-43b0-9764-db89e5f01eff service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:56.286480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-33128fc6-e8d5-473b-883d-2712de230ded req-33da235e-7845-43b0-9764-db89e5f01eff service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:56.299057 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-33128fc6-e8d5-473b-883d-2712de230ded req-33da235e-7845-43b0-9764-db89e5f01eff service nova] Creating event network-vif-unplugged:d514b962-c048-4d6e-a368-f2a322372615 for instance 33e118e4-0f33-4e8d-a193-07a0914520cd on nch2-master-1 May 21 22:00:56.304500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [req-33128fc6-e8d5-473b-883d-2712de230ded req-33da235e-7845-43b0-9764-db89e5f01eff service nova] Instance 33e118e4-0f33-4e8d-a193-07a0914520cd is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 22:00:56.316724 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-33128fc6-e8d5-473b-883d-2712de230ded req-33da235e-7845-43b0-9764-db89e5f01eff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044132 May 21 22:00:56.317419 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3347/6566] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:00:56.402459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-976b9f62-6c9e-4705-bc45-7fddb7c3e9a6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:56.403091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-976b9f62-6c9e-4705-bc45-7fddb7c3e9a6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:56.411265 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-976b9f62-6c9e-4705-bc45-7fddb7c3e9a6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:56.416792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-976b9f62-6c9e-4705-bc45-7fddb7c3e9a6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:56.416792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-976b9f62-6c9e-4705-bc45-7fddb7c3e9a6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:56.416792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-976b9f62-6c9e-4705-bc45-7fddb7c3e9a6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:56.645213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-976b9f62-6c9e-4705-bc45-7fddb7c3e9a6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:56.652833 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-976b9f62-6c9e-4705-bc45-7fddb7c3e9a6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1518 microversion: 2.1 time: 0.254366 May 21 22:00:56.653618 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3220/6567] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:56 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1518 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:57.673771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-875fe79d-765a-4058-9e51-9af68f9b8490 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:57.674826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-875fe79d-765a-4058-9e51-9af68f9b8490 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:57.683811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-875fe79d-765a-4058-9e51-9af68f9b8490 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:57.684298 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-875fe79d-765a-4058-9e51-9af68f9b8490 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:57.688083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-875fe79d-765a-4058-9e51-9af68f9b8490 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:57.688083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-875fe79d-765a-4058-9e51-9af68f9b8490 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:57.832966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-875fe79d-765a-4058-9e51-9af68f9b8490 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:57.840579 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-875fe79d-765a-4058-9e51-9af68f9b8490 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1516 microversion: 2.1 time: 0.172912 May 21 22:00:57.841166 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3348/6568] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:57 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:00:58.331304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-fa3c2b1a-c9b8-42d3-8d36-d8bc9ae908a5 req-51819da8-1342-4fb3-a071-c5c0966f1c65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e118e4-0f33-4e8d-a193-07a0914520cd", "tag": "d514b962-c048-4d6e-a368-f2a322372615"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:00:58.340577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-fa3c2b1a-c9b8-42d3-8d36-d8bc9ae908a5 req-51819da8-1342-4fb3-a071-c5c0966f1c65 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:58.341028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-fa3c2b1a-c9b8-42d3-8d36-d8bc9ae908a5 req-51819da8-1342-4fb3-a071-c5c0966f1c65 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:58.353600 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-fa3c2b1a-c9b8-42d3-8d36-d8bc9ae908a5 req-51819da8-1342-4fb3-a071-c5c0966f1c65 service nova] Creating event network-changed:d514b962-c048-4d6e-a368-f2a322372615 for instance 33e118e4-0f33-4e8d-a193-07a0914520cd on nch2-master-1 May 21 22:00:58.359064 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [req-fa3c2b1a-c9b8-42d3-8d36-d8bc9ae908a5 req-51819da8-1342-4fb3-a071-c5c0966f1c65 service nova] Instance 33e118e4-0f33-4e8d-a193-07a0914520cd is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 22:00:58.369663 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-fa3c2b1a-c9b8-42d3-8d36-d8bc9ae908a5 req-51819da8-1342-4fb3-a071-c5c0966f1c65 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042545 May 21 22:00:58.370259 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3221/6569] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:00:58.858969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5dbfc119-da20-45fd-9ece-2f6c0e680e56 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:00:58.860941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5dbfc119-da20-45fd-9ece-2f6c0e680e56 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:00:58.868703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5dbfc119-da20-45fd-9ece-2f6c0e680e56 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:58.869426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5dbfc119-da20-45fd-9ece-2f6c0e680e56 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:58.870222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5dbfc119-da20-45fd-9ece-2f6c0e680e56 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:00:58.870673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5dbfc119-da20-45fd-9ece-2f6c0e680e56 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:00:59.045381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5dbfc119-da20-45fd-9ece-2f6c0e680e56 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:00:59.053479 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5dbfc119-da20-45fd-9ece-2f6c0e680e56 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1516 microversion: 2.1 time: 0.198631 May 21 22:00:59.054067 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3349/6570] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:00:58 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1516 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:00.071853 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2db99717-e520-48a9-b408-9f2cc10f9d42 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:00.072506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2db99717-e520-48a9-b408-9f2cc10f9d42 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:00.079437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2db99717-e520-48a9-b408-9f2cc10f9d42 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:00.079883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2db99717-e520-48a9-b408-9f2cc10f9d42 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:00.080669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2db99717-e520-48a9-b408-9f2cc10f9d42 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:00.081105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2db99717-e520-48a9-b408-9f2cc10f9d42 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:00.224356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2db99717-e520-48a9-b408-9f2cc10f9d42 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:00.231946 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2db99717-e520-48a9-b408-9f2cc10f9d42 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1513 microversion: 2.1 time: 0.165318 May 21 22:01:00.232552 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3222/6571] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:00 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:00.248271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-249d6bf7-0e18-4fe7-8a16-838f9d7792e4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:01:00.248874 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-249d6bf7-0e18-4fe7-8a16-838f9d7792e4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:00.256685 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-249d6bf7-0e18-4fe7-8a16-838f9d7792e4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:00.257468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-249d6bf7-0e18-4fe7-8a16-838f9d7792e4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:00.258251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-249d6bf7-0e18-4fe7-8a16-838f9d7792e4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:00.258702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-249d6bf7-0e18-4fe7-8a16-838f9d7792e4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:00.401543 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-249d6bf7-0e18-4fe7-8a16-838f9d7792e4 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "POST /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd/action" status: 204 len: 0 microversion: 2.1 time: 0.157030 May 21 22:01:00.402182 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3350/6572] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:01:00 2022] POST /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd/action => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:01:00.410424 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5360d05e-9265-48df-adcb-85961275cc10 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:00.412370 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5360d05e-9265-48df-adcb-85961275cc10 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:00.417509 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5360d05e-9265-48df-adcb-85961275cc10 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:00.417985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5360d05e-9265-48df-adcb-85961275cc10 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:00.418796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5360d05e-9265-48df-adcb-85961275cc10 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:00.419285 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5360d05e-9265-48df-adcb-85961275cc10 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:00.573048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5360d05e-9265-48df-adcb-85961275cc10 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:00.581173 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5360d05e-9265-48df-adcb-85961275cc10 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1513 microversion: 2.1 time: 0.174686 May 21 22:01:00.581781 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3223/6573] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:00 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:01.599908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-53ef0c48-b1ec-4e22-9d10-ef2c7a4ecb78 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:01.600574 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-53ef0c48-b1ec-4e22-9d10-ef2c7a4ecb78 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:01.607068 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53ef0c48-b1ec-4e22-9d10-ef2c7a4ecb78 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:01.611096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53ef0c48-b1ec-4e22-9d10-ef2c7a4ecb78 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:01.611096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53ef0c48-b1ec-4e22-9d10-ef2c7a4ecb78 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:01.611096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-53ef0c48-b1ec-4e22-9d10-ef2c7a4ecb78 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:01.763721 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-53ef0c48-b1ec-4e22-9d10-ef2c7a4ecb78 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:01.772802 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-53ef0c48-b1ec-4e22-9d10-ef2c7a4ecb78 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1513 microversion: 2.1 time: 0.178059 May 21 22:01:01.783806 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3351/6574] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:01 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:02.790993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4a785555-8ecc-4fc8-a842-d9e9d2c67578 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:02.791616 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4a785555-8ecc-4fc8-a842-d9e9d2c67578 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:02.799547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4a785555-8ecc-4fc8-a842-d9e9d2c67578 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:02.800003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4a785555-8ecc-4fc8-a842-d9e9d2c67578 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:02.800822 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4a785555-8ecc-4fc8-a842-d9e9d2c67578 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:02.801269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4a785555-8ecc-4fc8-a842-d9e9d2c67578 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:02.804038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=88 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:01:02.944116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4a785555-8ecc-4fc8-a842-d9e9d2c67578 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:02.951663 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4a785555-8ecc-4fc8-a842-d9e9d2c67578 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1505 microversion: 2.1 time: 0.164642 May 21 22:01:02.952246 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3224/6575] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:02 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:02.967736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3e0a3801-4f27-460a-a6a2-24d5bfad0b4e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:02.968462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3e0a3801-4f27-460a-a6a2-24d5bfad0b4e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:02.975463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e0a3801-4f27-460a-a6a2-24d5bfad0b4e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:02.975932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e0a3801-4f27-460a-a6a2-24d5bfad0b4e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:02.976750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e0a3801-4f27-460a-a6a2-24d5bfad0b4e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:02.977214 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e0a3801-4f27-460a-a6a2-24d5bfad0b4e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:03.119240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3e0a3801-4f27-460a-a6a2-24d5bfad0b4e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:03.127204 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3e0a3801-4f27-460a-a6a2-24d5bfad0b4e tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1505 microversion: 2.1 time: 0.163310 May 21 22:01:03.127775 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3352/6576] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:02 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:03.143441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-09c5b15d-bc3e-417c-adc1-2e0ff3a1a48c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:03.144063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-09c5b15d-bc3e-417c-adc1-2e0ff3a1a48c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:03.150304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-09c5b15d-bc3e-417c-adc1-2e0ff3a1a48c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:03.150794 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-09c5b15d-bc3e-417c-adc1-2e0ff3a1a48c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:03.151659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-09c5b15d-bc3e-417c-adc1-2e0ff3a1a48c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:03.152006 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-09c5b15d-bc3e-417c-adc1-2e0ff3a1a48c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:03.295735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-09c5b15d-bc3e-417c-adc1-2e0ff3a1a48c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:03.304079 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-09c5b15d-bc3e-417c-adc1-2e0ff3a1a48c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1505 microversion: 2.1 time: 0.164586 May 21 22:01:03.304708 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3225/6577] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:03 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:03.331560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-39a16f05-c0b2-4057-a09c-921a4d60fd8b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:03.332295 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-39a16f05-c0b2-4057-a09c-921a4d60fd8b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:03.340129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39a16f05-c0b2-4057-a09c-921a4d60fd8b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:03.340662 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39a16f05-c0b2-4057-a09c-921a4d60fd8b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:03.341463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39a16f05-c0b2-4057-a09c-921a4d60fd8b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:03.341923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-39a16f05-c0b2-4057-a09c-921a4d60fd8b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:03.367678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-39a16f05-c0b2-4057-a09c-921a4d60fd8b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 22:01:03.619310 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-39a16f05-c0b2-4057-a09c-921a4d60fd8b tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "DELETE /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 204 len: 0 microversion: 2.1 time: 0.293025 May 21 22:01:03.619969 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3353/6578] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:01:03 2022] DELETE /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:01:03.637615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-170b99c4-63b5-4c7f-b863-149fa70cdaa2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:03.638126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-170b99c4-63b5-4c7f-b863-149fa70cdaa2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:03.645559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-170b99c4-63b5-4c7f-b863-149fa70cdaa2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:03.646033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-170b99c4-63b5-4c7f-b863-149fa70cdaa2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:03.646812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-170b99c4-63b5-4c7f-b863-149fa70cdaa2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:03.647286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-170b99c4-63b5-4c7f-b863-149fa70cdaa2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:03.674498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-170b99c4-63b5-4c7f-b863-149fa70cdaa2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 22:01:03.770471 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.compute.api [None req-170b99c4-63b5-4c7f-b863-149fa70cdaa2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Instance is already in deleting state, ignoring this request May 21 22:01:03.771305 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-170b99c4-63b5-4c7f-b863-149fa70cdaa2 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "DELETE /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 204 len: 0 microversion: 2.1 time: 0.137748 May 21 22:01:03.771871 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3226/6579] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:01:03 2022] DELETE /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:01:03.780496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0b477de1-a9f6-442a-a98d-c3a4ec6c3045 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:03.781426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0b477de1-a9f6-442a-a98d-c3a4ec6c3045 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:03.787516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b477de1-a9f6-442a-a98d-c3a4ec6c3045 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:03.787979 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b477de1-a9f6-442a-a98d-c3a4ec6c3045 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:03.788784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b477de1-a9f6-442a-a98d-c3a4ec6c3045 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:03.789341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b477de1-a9f6-442a-a98d-c3a4ec6c3045 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:03.942541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0b477de1-a9f6-442a-a98d-c3a4ec6c3045 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:03.950163 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0b477de1-a9f6-442a-a98d-c3a4ec6c3045 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1511 microversion: 2.1 time: 0.173859 May 21 22:01:03.950738 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3354/6580] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:03 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:04.056781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-8d662a34-4e35-44a4-b1ea-27e2ef3c6243 req-3d81cb73-21cc-4b4b-b60f-0d710ba5b728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e118e4-0f33-4e8d-a193-07a0914520cd", "name": "network-vif-plugged", "status": "completed", "tag": "d514b962-c048-4d6e-a368-f2a322372615"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:01:04.066868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-8d662a34-4e35-44a4-b1ea-27e2ef3c6243 req-3d81cb73-21cc-4b4b-b60f-0d710ba5b728 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:04.067328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-8d662a34-4e35-44a4-b1ea-27e2ef3c6243 req-3d81cb73-21cc-4b4b-b60f-0d710ba5b728 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:04.078853 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-8d662a34-4e35-44a4-b1ea-27e2ef3c6243 req-3d81cb73-21cc-4b4b-b60f-0d710ba5b728 service nova] Creating event network-vif-plugged:d514b962-c048-4d6e-a368-f2a322372615 for instance 33e118e4-0f33-4e8d-a193-07a0914520cd on nch2-master-1 May 21 22:01:04.083832 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-8d662a34-4e35-44a4-b1ea-27e2ef3c6243 req-3d81cb73-21cc-4b4b-b60f-0d710ba5b728 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030808 May 21 22:01:04.086548 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3227/6581] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:01:04.974316 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-83c79eb7-8ffb-4c6b-856d-334f0b3cf9c6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:04.974936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-83c79eb7-8ffb-4c6b-856d-334f0b3cf9c6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:04.981873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-83c79eb7-8ffb-4c6b-856d-334f0b3cf9c6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:04.982344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-83c79eb7-8ffb-4c6b-856d-334f0b3cf9c6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:04.983136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-83c79eb7-8ffb-4c6b-856d-334f0b3cf9c6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:04.983602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-83c79eb7-8ffb-4c6b-856d-334f0b3cf9c6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:04.988426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:01:05.140958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-83c79eb7-8ffb-4c6b-856d-334f0b3cf9c6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa1b4cc4b4241c3b45f6be15bd99789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dde694e9c6c4bb2ae2bf8b74cba293f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:05.140958 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-83c79eb7-8ffb-4c6b-856d-334f0b3cf9c6 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 200 len: 1511 microversion: 2.1 time: 0.170120 May 21 22:01:05.143844 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3355/6582] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:04 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:05.586606 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-bcb2f40b-991f-4f76-a178-af8986725439 req-7bf86e1c-2c7e-49c8-8bc9-f5efaf6da714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e118e4-0f33-4e8d-a193-07a0914520cd", "name": "network-vif-deleted", "tag": "d514b962-c048-4d6e-a368-f2a322372615"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:01:05.595884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-bcb2f40b-991f-4f76-a178-af8986725439 req-7bf86e1c-2c7e-49c8-8bc9-f5efaf6da714 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:05.596390 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-bcb2f40b-991f-4f76-a178-af8986725439 req-7bf86e1c-2c7e-49c8-8bc9-f5efaf6da714 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:05.607345 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-bcb2f40b-991f-4f76-a178-af8986725439 req-7bf86e1c-2c7e-49c8-8bc9-f5efaf6da714 service nova] Creating event network-vif-deleted:d514b962-c048-4d6e-a368-f2a322372615 for instance 33e118e4-0f33-4e8d-a193-07a0914520cd on nch2-master-1 May 21 22:01:05.612907 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-bcb2f40b-991f-4f76-a178-af8986725439 req-7bf86e1c-2c7e-49c8-8bc9-f5efaf6da714 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032516 May 21 22:01:05.613550 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3228/6583] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:01:06.158114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c07372b4-cef6-468f-a1ee-6a17b987a07c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:06.158754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c07372b4-cef6-468f-a1ee-6a17b987a07c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 33e118e4-0f33-4e8d-a193-07a0914520cd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:06.166271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c07372b4-cef6-468f-a1ee-6a17b987a07c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:06.166738 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c07372b4-cef6-468f-a1ee-6a17b987a07c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:06.167567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c07372b4-cef6-468f-a1ee-6a17b987a07c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:06.168028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c07372b4-cef6-468f-a1ee-6a17b987a07c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:06.181948 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-c07372b4-cef6-468f-a1ee-6a17b987a07c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] HTTP exception thrown: Instance 33e118e4-0f33-4e8d-a193-07a0914520cd could not be found. May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c07372b4-cef6-468f-a1ee-6a17b987a07c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Request method failure captured: May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd HTTP/1.1 May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiWC2fTmus2MDigrZc10qgTPXC6LnIWCTpxwJiVmdheo79Jec6aCRtGfGb99qHVxXwo37wzevg1Yx5NtXjAL3Ve0oloHs4duuF4zdNrQVAKsm3tp_bBZjLmcZR47PNJyssFBbSp4jrLxEd6RaX5b9mtz-fdj_pm6hdtaHMW9Dc_4sik8 May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 7dde694e9c6c4bb2ae2bf8b74cba293f May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerDiskConfigTestJSON-573407424 May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7dde694e9c6c4bb2ae2bf8b74cba293f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7dde694e9c6c4bb2ae2bf8b74cba293f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7dde694e9c6c4bb2ae2bf8b74cba293f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7dde694e9c6c4bb2ae2bf8b74cba293f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerDiskConfigTestJSON-573407424 May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 7dde694e9c6c4bb2ae2bf8b74cba293f May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-573407424 May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerDiskConfigTestJSON-573407424-project May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: daa1b4cc4b4241c3b45f6be15bd99789 May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerDiskConfigTestJSON-573407424-project May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 33e118e4-0f33-4e8d-a193-07a0914520cd could not be found. May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '33e118e4-0f33-4e8d-a193-07a0914520cd'} May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33e118e4-0f33-4e8d-a193-07a0914520cd could not be found. May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e118e4-0f33-4e8d-a193-07a0914520cd could not be found. May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:01:06.183668 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:01:06.189333 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:01:06.189333 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:01:06.189333 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:01:06.189333 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:01:06.189333 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:01:06.189333 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e118e4-0f33-4e8d-a193-07a0914520cd could not be found. May 21 22:01:06.189333 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:01:06.189333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c07372b4-cef6-468f-a1ee-6a17b987a07c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Returning 404 to user: Instance 33e118e4-0f33-4e8d-a193-07a0914520cd could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:01:06.189333 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c07372b4-cef6-468f-a1ee-6a17b987a07c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd" status: 404 len: 111 microversion: 2.1 time: 0.031501 May 21 22:01:06.189333 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3356/6584] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:06 2022] GET /compute/v2.1/servers/33e118e4-0f33-4e8d-a193-07a0914520cd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:01:06.195597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-57461fe2-5173-4ae2-9e3f-aaae03c25f9c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:06.196181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-57461fe2-5173-4ae2-9e3f-aaae03c25f9c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:06.203320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-57461fe2-5173-4ae2-9e3f-aaae03c25f9c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:06.203854 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-57461fe2-5173-4ae2-9e3f-aaae03c25f9c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:06.204692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-57461fe2-5173-4ae2-9e3f-aaae03c25f9c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:06.205132 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-57461fe2-5173-4ae2-9e3f-aaae03c25f9c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:06.222145 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-57461fe2-5173-4ae2-9e3f-aaae03c25f9c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] HTTP exception thrown: Instance 5512332e-e9c6-427b-b59a-733fe00c9148 could not be found. May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-57461fe2-5173-4ae2-9e3f-aaae03c25f9c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Request method failure captured: May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 HTTP/1.1 May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWC2fTmus2MDigrZc10qgTPXC6LnIWCTpxwJiVmdheo79Jec6aCRtGfGb99qHVxXwo37wzevg1Yx5NtXjAL3Ve0oloHs4duuF4zdNrQVAKsm3tp_bBZjLmcZR47PNJyssFBbSp4jrLxEd6RaX5b9mtz-fdj_pm6hdtaHMW9Dc_4sik8 May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 7dde694e9c6c4bb2ae2bf8b74cba293f May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerDiskConfigTestJSON-573407424 May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7dde694e9c6c4bb2ae2bf8b74cba293f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7dde694e9c6c4bb2ae2bf8b74cba293f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7dde694e9c6c4bb2ae2bf8b74cba293f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7dde694e9c6c4bb2ae2bf8b74cba293f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerDiskConfigTestJSON-573407424 May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 7dde694e9c6c4bb2ae2bf8b74cba293f May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-573407424 May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerDiskConfigTestJSON-573407424-project May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: daa1b4cc4b4241c3b45f6be15bd99789 May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerDiskConfigTestJSON-573407424-project May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 5512332e-e9c6-427b-b59a-733fe00c9148 could not be found. May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '5512332e-e9c6-427b-b59a-733fe00c9148'} May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5512332e-e9c6-427b-b59a-733fe00c9148 could not be found. May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:01:06.223850 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:01:06.227264 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5512332e-e9c6-427b-b59a-733fe00c9148 could not be found. May 21 22:01:06.227264 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:01:06.227264 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:01:06.227264 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:01:06.227264 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:01:06.227264 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:01:06.227264 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:01:06.227264 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:01:06.227264 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:01:06.227264 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5512332e-e9c6-427b-b59a-733fe00c9148 could not be found. May 21 22:01:06.227264 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:01:06.227264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-57461fe2-5173-4ae2-9e3f-aaae03c25f9c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Returning 404 to user: Instance 5512332e-e9c6-427b-b59a-733fe00c9148 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:01:06.227264 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-57461fe2-5173-4ae2-9e3f-aaae03c25f9c tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 404 len: 111 microversion: 2.1 time: 0.033920 May 21 22:01:06.227264 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3229/6585] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:01:06 2022] DELETE /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:01:06.234100 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8cd73b86-30ca-4c9a-8bb4-7dddccad4337 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:06.234758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8cd73b86-30ca-4c9a-8bb4-7dddccad4337 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] [instance: 5512332e-e9c6-427b-b59a-733fe00c9148] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:06.241022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8cd73b86-30ca-4c9a-8bb4-7dddccad4337 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:06.241496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8cd73b86-30ca-4c9a-8bb4-7dddccad4337 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:06.242281 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8cd73b86-30ca-4c9a-8bb4-7dddccad4337 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:06.242737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8cd73b86-30ca-4c9a-8bb4-7dddccad4337 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:06.257416 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-8cd73b86-30ca-4c9a-8bb4-7dddccad4337 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] HTTP exception thrown: Instance 5512332e-e9c6-427b-b59a-733fe00c9148 could not be found. May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8cd73b86-30ca-4c9a-8bb4-7dddccad4337 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Request method failure captured: May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 HTTP/1.1 May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiWC2fTmus2MDigrZc10qgTPXC6LnIWCTpxwJiVmdheo79Jec6aCRtGfGb99qHVxXwo37wzevg1Yx5NtXjAL3Ve0oloHs4duuF4zdNrQVAKsm3tp_bBZjLmcZR47PNJyssFBbSp4jrLxEd6RaX5b9mtz-fdj_pm6hdtaHMW9Dc_4sik8 May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 7dde694e9c6c4bb2ae2bf8b74cba293f May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerDiskConfigTestJSON-573407424 May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7dde694e9c6c4bb2ae2bf8b74cba293f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7dde694e9c6c4bb2ae2bf8b74cba293f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7dde694e9c6c4bb2ae2bf8b74cba293f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7dde694e9c6c4bb2ae2bf8b74cba293f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerDiskConfigTestJSON-573407424 May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 7dde694e9c6c4bb2ae2bf8b74cba293f May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-573407424 May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerDiskConfigTestJSON-573407424-project May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: daa1b4cc4b4241c3b45f6be15bd99789 May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerDiskConfigTestJSON-573407424-project May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 5512332e-e9c6-427b-b59a-733fe00c9148 could not be found. May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '5512332e-e9c6-427b-b59a-733fe00c9148'} May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5512332e-e9c6-427b-b59a-733fe00c9148 could not be found. May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5512332e-e9c6-427b-b59a-733fe00c9148 could not be found. May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:01:06.259077 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:01:06.263117 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:01:06.263117 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:01:06.263117 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:01:06.263117 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:01:06.263117 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:01:06.263117 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5512332e-e9c6-427b-b59a-733fe00c9148 could not be found. May 21 22:01:06.263117 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:01:06.263117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8cd73b86-30ca-4c9a-8bb4-7dddccad4337 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] Returning 404 to user: Instance 5512332e-e9c6-427b-b59a-733fe00c9148 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:01:06.263117 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8cd73b86-30ca-4c9a-8bb4-7dddccad4337 tempest-ServerDiskConfigTestJSON-573407424 tempest-ServerDiskConfigTestJSON-573407424-project] 10.222.0.49 "GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148" status: 404 len: 111 microversion: 2.1 time: 0.030323 May 21 22:01:06.263117 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3357/6586] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:06 2022] GET /compute/v2.1/servers/5512332e-e9c6-427b-b59a-733fe00c9148 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:01:14.916023 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1b7d1da5-2e7e-4823-baf1-119467b0ee8b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Action: 'create', calling method: .version_select at 0x7fc819e76ca0>, body: {"keypair": {"name": "tempest-keypair-937962467", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOh6k074VXddtiLR0IG38MfSr09jSJ6kmk02iUY0IK/IYiNUDAnxTkK1wIgKA4Mv7IJFwOA6xuRMj8pb2zHMavq1ePEXcdFggwdxd/UZw6EhGDrnEZtBsnOLlwuy2YZrNg=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:01:14.930937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-1b7d1da5-2e7e-4823-baf1-119467b0ee8b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Getting quotas for project cb9f2d0a8dca4c85a47c2d138d1b39cd. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:01:14.936334 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-1b7d1da5-2e7e-4823-baf1-119467b0ee8b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Getting quotas for user 1fd1bb72fc464808988a1579524c7939 and project cb9f2d0a8dca4c85a47c2d138d1b39cd. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:01:15.055227 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1b7d1da5-2e7e-4823-baf1-119467b0ee8b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.256296 May 21 22:01:15.055863 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3230/6587] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 22:01:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:01:17.511122 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-add23a1e-1a6a-45c6-9f53-e6b6a9fed59e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1912340835", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3293c92c-e4b2-4bbe-993a-802603a2deb4"}], "security_groups": [{"name": "tempest-securitygroup--889871437"}], "key_name": "tempest-keypair-937962467", "user_data": "}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:01:17.520034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:01:17.520780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=8 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:01:17.649777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-add23a1e-1a6a-45c6-9f53-e6b6a9fed59e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] validate_networks() for [('3293c92c-e4b2-4bbe-993a-802603a2deb4', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 22:01:18.118846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-add23a1e-1a6a-45c6-9f53-e6b6a9fed59e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:01:18.119267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-add23a1e-1a6a-45c6-9f53-e6b6a9fed59e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:01:18.119770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-add23a1e-1a6a-45c6-9f53-e6b6a9fed59e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:01:18.120203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-add23a1e-1a6a-45c6-9f53-e6b6a9fed59e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:01:18.120860 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-add23a1e-1a6a-45c6-9f53-e6b6a9fed59e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:01:18.131076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-add23a1e-1a6a-45c6-9f53-e6b6a9fed59e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:18.131547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-add23a1e-1a6a-45c6-9f53-e6b6a9fed59e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:18.132419 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-add23a1e-1a6a-45c6-9f53-e6b6a9fed59e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:18.132880 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-add23a1e-1a6a-45c6-9f53-e6b6a9fed59e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:18.151181 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-add23a1e-1a6a-45c6-9f53-e6b6a9fed59e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Getting quotas for project cb9f2d0a8dca4c85a47c2d138d1b39cd. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:01:18.157044 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-add23a1e-1a6a-45c6-9f53-e6b6a9fed59e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Getting quotas for user 1fd1bb72fc464808988a1579524c7939 and project cb9f2d0a8dca4c85a47c2d138d1b39cd. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:01:18.170447 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-add23a1e-1a6a-45c6-9f53-e6b6a9fed59e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 22:01:18.172893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-add23a1e-1a6a-45c6-9f53-e6b6a9fed59e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 22:01:18.296886 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-add23a1e-1a6a-45c6-9f53-e6b6a9fed59e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.790619 May 21 22:01:18.299281 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3358/6588] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 22:01:17 2022] POST /compute/v2.1/servers => generated 408 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 22:01:18.306955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:01:18.311706 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0461f7e9-d147-435a-b6d7-3207c06670b7 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:18.312345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0461f7e9-d147-435a-b6d7-3207c06670b7 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:18.377468 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0461f7e9-d147-435a-b6d7-3207c06670b7 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:18.384419 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0461f7e9-d147-435a-b6d7-3207c06670b7 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1238 microversion: 2.1 time: 0.079134 May 21 22:01:18.385255 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3231/6589] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:18 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1238 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:19.401624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0cfa2598-f3ef-45b4-b674-c5acd749cb37 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:19.402349 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0cfa2598-f3ef-45b4-b674-c5acd749cb37 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:19.411346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0cfa2598-f3ef-45b4-b674-c5acd749cb37 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:19.411697 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0cfa2598-f3ef-45b4-b674-c5acd749cb37 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:19.412728 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0cfa2598-f3ef-45b4-b674-c5acd749cb37 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:19.413660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0cfa2598-f3ef-45b4-b674-c5acd749cb37 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:19.488971 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0cfa2598-f3ef-45b4-b674-c5acd749cb37 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:19.497129 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0cfa2598-f3ef-45b4-b674-c5acd749cb37 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1242 microversion: 2.1 time: 0.099388 May 21 22:01:19.497706 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3359/6590] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:19 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1242 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:20.518397 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-acf7e18d-5224-4a79-9fbd-8a9395c365ee tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:20.519027 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-acf7e18d-5224-4a79-9fbd-8a9395c365ee tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:20.526332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-acf7e18d-5224-4a79-9fbd-8a9395c365ee tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:20.530532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-acf7e18d-5224-4a79-9fbd-8a9395c365ee tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:20.530532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-acf7e18d-5224-4a79-9fbd-8a9395c365ee tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:20.530532 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-acf7e18d-5224-4a79-9fbd-8a9395c365ee tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:20.602065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-acf7e18d-5224-4a79-9fbd-8a9395c365ee tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:20.610124 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-acf7e18d-5224-4a79-9fbd-8a9395c365ee tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1298 microversion: 2.1 time: 0.096279 May 21 22:01:20.610702 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3232/6591] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:20 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1298 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:21.630668 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c1c73161-ec25-4168-8d9e-5c969b79f138 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:21.631252 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c1c73161-ec25-4168-8d9e-5c969b79f138 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:21.638845 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1c73161-ec25-4168-8d9e-5c969b79f138 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:21.639310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1c73161-ec25-4168-8d9e-5c969b79f138 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:21.640092 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1c73161-ec25-4168-8d9e-5c969b79f138 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:21.640561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1c73161-ec25-4168-8d9e-5c969b79f138 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:21.895497 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c1c73161-ec25-4168-8d9e-5c969b79f138 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:21.903207 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c1c73161-ec25-4168-8d9e-5c969b79f138 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1363 microversion: 2.1 time: 0.276510 May 21 22:01:21.903777 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3360/6592] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:21 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1363 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:22.419848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-a77a9b90-feb6-4318-87c3-b711a9338208 req-8c59ba71-b788-4672-8d8a-574b7c5ab132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f6ddb6-057f-49df-9afd-fc86189f2f3e", "tag": "7e9114ae-aefc-4952-ad06-def4e163bf9b"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:01:22.432016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a77a9b90-feb6-4318-87c3-b711a9338208 req-8c59ba71-b788-4672-8d8a-574b7c5ab132 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:22.432490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a77a9b90-feb6-4318-87c3-b711a9338208 req-8c59ba71-b788-4672-8d8a-574b7c5ab132 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:22.446641 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-a77a9b90-feb6-4318-87c3-b711a9338208 req-8c59ba71-b788-4672-8d8a-574b7c5ab132 service nova] Creating event network-changed:7e9114ae-aefc-4952-ad06-def4e163bf9b for instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e on nch1-master-1 May 21 22:01:22.452129 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-a77a9b90-feb6-4318-87c3-b711a9338208 req-8c59ba71-b788-4672-8d8a-574b7c5ab132 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038556 May 21 22:01:22.454078 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3233/6593] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:01:22.921176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fecccb7f-3d2b-4bd4-8849-d7fd15c3376d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:22.921928 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fecccb7f-3d2b-4bd4-8849-d7fd15c3376d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:22.929875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fecccb7f-3d2b-4bd4-8849-d7fd15c3376d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:22.930345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fecccb7f-3d2b-4bd4-8849-d7fd15c3376d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:22.931135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fecccb7f-3d2b-4bd4-8849-d7fd15c3376d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:22.931589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fecccb7f-3d2b-4bd4-8849-d7fd15c3376d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:23.354659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fecccb7f-3d2b-4bd4-8849-d7fd15c3376d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:23.363186 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fecccb7f-3d2b-4bd4-8849-d7fd15c3376d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1363 microversion: 2.1 time: 0.446246 May 21 22:01:23.363766 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3361/6594] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:22 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1363 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:24.382891 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f94df44f-9e1a-4fd4-abec-7592392e823f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:24.383719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f94df44f-9e1a-4fd4-abec-7592392e823f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:24.386314 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:01:24.400176 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f94df44f-9e1a-4fd4-abec-7592392e823f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:24.404029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f94df44f-9e1a-4fd4-abec-7592392e823f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:24.404029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f94df44f-9e1a-4fd4-abec-7592392e823f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:24.404029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f94df44f-9e1a-4fd4-abec-7592392e823f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:24.556176 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f94df44f-9e1a-4fd4-abec-7592392e823f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:24.564576 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f94df44f-9e1a-4fd4-abec-7592392e823f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1363 microversion: 2.1 time: 0.186099 May 21 22:01:24.565165 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3234/6595] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:24 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:25.581490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-52cae18e-3b54-461e-9564-1c4b0600d69b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:25.582039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-52cae18e-3b54-461e-9564-1c4b0600d69b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:25.589281 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-52cae18e-3b54-461e-9564-1c4b0600d69b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:25.589755 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-52cae18e-3b54-461e-9564-1c4b0600d69b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:25.590602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-52cae18e-3b54-461e-9564-1c4b0600d69b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:25.591067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-52cae18e-3b54-461e-9564-1c4b0600d69b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:25.739417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-52cae18e-3b54-461e-9564-1c4b0600d69b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:25.747106 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-52cae18e-3b54-461e-9564-1c4b0600d69b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1363 microversion: 2.1 time: 0.170074 May 21 22:01:25.747665 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3362/6596] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:25 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:01:26.763258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7e9d49db-5481-4853-a93e-9e517fc542ed tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:26.763886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7e9d49db-5481-4853-a93e-9e517fc542ed tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:26.771311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e9d49db-5481-4853-a93e-9e517fc542ed tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:26.771774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e9d49db-5481-4853-a93e-9e517fc542ed tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:26.772601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e9d49db-5481-4853-a93e-9e517fc542ed tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:26.773034 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7e9d49db-5481-4853-a93e-9e517fc542ed tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:26.918106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7e9d49db-5481-4853-a93e-9e517fc542ed tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:26.927415 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7e9d49db-5481-4853-a93e-9e517fc542ed tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1363 microversion: 2.1 time: 0.167829 May 21 22:01:26.931539 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3235/6597] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:26 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:27.945340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2d3fe009-7dcf-4b25-92fc-bb5a60d6a084 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:27.946001 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2d3fe009-7dcf-4b25-92fc-bb5a60d6a084 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:27.953528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2d3fe009-7dcf-4b25-92fc-bb5a60d6a084 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:27.954198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2d3fe009-7dcf-4b25-92fc-bb5a60d6a084 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:27.955054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2d3fe009-7dcf-4b25-92fc-bb5a60d6a084 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:27.955516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2d3fe009-7dcf-4b25-92fc-bb5a60d6a084 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:28.094938 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2d3fe009-7dcf-4b25-92fc-bb5a60d6a084 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:28.102535 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2d3fe009-7dcf-4b25-92fc-bb5a60d6a084 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1363 microversion: 2.1 time: 0.161528 May 21 22:01:28.103103 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3363/6598] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:27 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:28.656674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-fc5f2210-04dd-4b36-8e45-589861e58201 req-86e8393b-4014-4412-8dd4-9c94f05ea629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f6ddb6-057f-49df-9afd-fc86189f2f3e", "name": "network-vif-plugged", "status": "completed", "tag": "7e9114ae-aefc-4952-ad06-def4e163bf9b"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:01:28.656674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:01:28.660785 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-fc5f2210-04dd-4b36-8e45-589861e58201 req-86e8393b-4014-4412-8dd4-9c94f05ea629 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:28.661235 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-fc5f2210-04dd-4b36-8e45-589861e58201 req-86e8393b-4014-4412-8dd4-9c94f05ea629 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:28.673355 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-fc5f2210-04dd-4b36-8e45-589861e58201 req-86e8393b-4014-4412-8dd4-9c94f05ea629 service nova] Creating event network-vif-plugged:7e9114ae-aefc-4952-ad06-def4e163bf9b for instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e on nch1-master-1 May 21 22:01:28.678378 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-fc5f2210-04dd-4b36-8e45-589861e58201 req-86e8393b-4014-4412-8dd4-9c94f05ea629 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031712 May 21 22:01:28.679008 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3236/6599] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:01:29.120026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-31c5aeb2-3565-452c-945e-b3dac2e6346c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:29.121172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-31c5aeb2-3565-452c-945e-b3dac2e6346c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:29.122795 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:01:29.123498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:01:29.130379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31c5aeb2-3565-452c-945e-b3dac2e6346c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:29.130858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31c5aeb2-3565-452c-945e-b3dac2e6346c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:29.131656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31c5aeb2-3565-452c-945e-b3dac2e6346c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:29.132115 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31c5aeb2-3565-452c-945e-b3dac2e6346c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:29.276749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-31c5aeb2-3565-452c-945e-b3dac2e6346c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:29.284909 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-31c5aeb2-3565-452c-945e-b3dac2e6346c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1363 microversion: 2.1 time: 0.168746 May 21 22:01:29.285473 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3364/6600] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:29 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:30.303346 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-99a81107-888f-4776-8cc1-502271bcbb88 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:30.304056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-99a81107-888f-4776-8cc1-502271bcbb88 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:30.310880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99a81107-888f-4776-8cc1-502271bcbb88 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:30.311339 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99a81107-888f-4776-8cc1-502271bcbb88 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:30.312112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99a81107-888f-4776-8cc1-502271bcbb88 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:30.313100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99a81107-888f-4776-8cc1-502271bcbb88 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:30.459225 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-99a81107-888f-4776-8cc1-502271bcbb88 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:30.467153 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-99a81107-888f-4776-8cc1-502271bcbb88 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1550 microversion: 2.1 time: 0.168967 May 21 22:01:30.467739 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3237/6601] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:30 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1550 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:30.483208 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-413b581a-e7b0-4bbd-a8fe-b628992461f0 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:30.483805 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-413b581a-e7b0-4bbd-a8fe-b628992461f0 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:30.491253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-413b581a-e7b0-4bbd-a8fe-b628992461f0 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:30.491725 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-413b581a-e7b0-4bbd-a8fe-b628992461f0 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:30.492539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-413b581a-e7b0-4bbd-a8fe-b628992461f0 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:30.492993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-413b581a-e7b0-4bbd-a8fe-b628992461f0 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:30.616088 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-413b581a-e7b0-4bbd-a8fe-b628992461f0 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.136688 May 21 22:01:30.616752 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3365/6602] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 22:01:30 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:01:31.798729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3367c77c-2ef8-434a-8df8-6b9630f52c41 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:31.799462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3367c77c-2ef8-434a-8df8-6b9630f52c41 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:31.805263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-8529a4a6-bce7-4529-93fc-1d852460cf35 req-b01bc698-b5bc-48ae-a66a-26973fe6301e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f6ddb6-057f-49df-9afd-fc86189f2f3e", "tag": "7e9114ae-aefc-4952-ad06-def4e163bf9b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:01:31.806878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3367c77c-2ef8-434a-8df8-6b9630f52c41 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:31.807337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3367c77c-2ef8-434a-8df8-6b9630f52c41 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:31.808124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3367c77c-2ef8-434a-8df8-6b9630f52c41 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:31.808591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3367c77c-2ef8-434a-8df8-6b9630f52c41 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:31.814385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8529a4a6-bce7-4529-93fc-1d852460cf35 req-b01bc698-b5bc-48ae-a66a-26973fe6301e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:31.814889 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-8529a4a6-bce7-4529-93fc-1d852460cf35 req-b01bc698-b5bc-48ae-a66a-26973fe6301e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:31.827421 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-8529a4a6-bce7-4529-93fc-1d852460cf35 req-b01bc698-b5bc-48ae-a66a-26973fe6301e service nova] Creating event network-changed:7e9114ae-aefc-4952-ad06-def4e163bf9b for instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e on nch1-master-1 May 21 22:01:31.833694 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-8529a4a6-bce7-4529-93fc-1d852460cf35 req-b01bc698-b5bc-48ae-a66a-26973fe6301e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032811 May 21 22:01:31.834485 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3366/6603] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:01:31.965935 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3367c77c-2ef8-434a-8df8-6b9630f52c41 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:31.974343 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3367c77c-2ef8-434a-8df8-6b9630f52c41 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1550 microversion: 2.1 time: 0.180472 May 21 22:01:31.975244 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3238/6604] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:31 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1550 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:31.991221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d2202fbf-a466-41e8-a099-6329db8ded7d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:31.991947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d2202fbf-a466-41e8-a099-6329db8ded7d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:31.998647 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d2202fbf-a466-41e8-a099-6329db8ded7d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:31.999366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d2202fbf-a466-41e8-a099-6329db8ded7d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:32.000459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d2202fbf-a466-41e8-a099-6329db8ded7d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:32.000918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d2202fbf-a466-41e8-a099-6329db8ded7d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:32.251614 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d2202fbf-a466-41e8-a099-6329db8ded7d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:32.259644 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d2202fbf-a466-41e8-a099-6329db8ded7d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1550 microversion: 2.1 time: 0.272589 May 21 22:01:32.260445 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3367/6605] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:31 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1550 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:33.277054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-be864016-c762-4b9c-ac17-336132453b84 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:33.277720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-be864016-c762-4b9c-ac17-336132453b84 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:33.285575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be864016-c762-4b9c-ac17-336132453b84 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:33.286036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be864016-c762-4b9c-ac17-336132453b84 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:33.286818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be864016-c762-4b9c-ac17-336132453b84 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:33.287266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-be864016-c762-4b9c-ac17-336132453b84 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:33.432768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-be864016-c762-4b9c-ac17-336132453b84 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:33.440831 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-be864016-c762-4b9c-ac17-336132453b84 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1669 microversion: 2.1 time: 0.167653 May 21 22:01:33.441420 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3239/6606] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:33 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1669 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:33.457688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3e1bbbf2-6760-48c0-beeb-cdfb8b28a40a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:33.458328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3e1bbbf2-6760-48c0-beeb-cdfb8b28a40a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:33.465492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e1bbbf2-6760-48c0-beeb-cdfb8b28a40a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:33.465966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e1bbbf2-6760-48c0-beeb-cdfb8b28a40a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:33.466798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e1bbbf2-6760-48c0-beeb-cdfb8b28a40a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:33.467256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3e1bbbf2-6760-48c0-beeb-cdfb8b28a40a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:33.612309 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3e1bbbf2-6760-48c0-beeb-cdfb8b28a40a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:33.619949 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3e1bbbf2-6760-48c0-beeb-cdfb8b28a40a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1669 microversion: 2.1 time: 0.166763 May 21 22:01:33.620556 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3368/6607] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:33 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1669 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:33.636018 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f2613a00-1436-4db2-88d1-34fbfd1d8d45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:01:33.637040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f2613a00-1436-4db2-88d1-34fbfd1d8d45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:33.643661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2613a00-1436-4db2-88d1-34fbfd1d8d45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:33.644111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2613a00-1436-4db2-88d1-34fbfd1d8d45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:33.644918 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2613a00-1436-4db2-88d1-34fbfd1d8d45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:33.645361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f2613a00-1436-4db2-88d1-34fbfd1d8d45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:33.674033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f2613a00-1436-4db2-88d1-34fbfd1d8d45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:33.680382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f2613a00-1436-4db2-88d1-34fbfd1d8d45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Old instance type m1.heat2, new instance type m1.heat {{(pid=131278) resize /opt/stack/nova/nova/compute/api.py:4166}} May 21 22:01:33.691435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f2613a00-1436-4db2-88d1-34fbfd1d8d45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:01:33.691435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f2613a00-1436-4db2-88d1-34fbfd1d8d45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:01:33.691435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f2613a00-1436-4db2-88d1-34fbfd1d8d45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:01:33.691435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f2613a00-1436-4db2-88d1-34fbfd1d8d45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:01:33.691435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-f2613a00-1436-4db2-88d1-34fbfd1d8d45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:01:33.862866 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f2613a00-1436-4db2-88d1-34fbfd1d8d45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "POST /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e/action" status: 202 len: 0 microversion: 2.1 time: 0.230743 May 21 22:01:33.863494 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3240/6608] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:01:33 2022] POST /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:01:33.871677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4ae36073-76aa-4d33-b5db-d6c9c48fa247 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:33.872346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4ae36073-76aa-4d33-b5db-d6c9c48fa247 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:33.879094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ae36073-76aa-4d33-b5db-d6c9c48fa247 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:33.879572 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ae36073-76aa-4d33-b5db-d6c9c48fa247 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:33.880408 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ae36073-76aa-4d33-b5db-d6c9c48fa247 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:33.880870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4ae36073-76aa-4d33-b5db-d6c9c48fa247 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:34.028587 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4ae36073-76aa-4d33-b5db-d6c9c48fa247 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:34.036527 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4ae36073-76aa-4d33-b5db-d6c9c48fa247 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1678 microversion: 2.1 time: 0.168677 May 21 22:01:34.037107 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3369/6609] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:33 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:35.055649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-87191f34-3cb3-4f25-a79b-0454b2eb18f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:35.056196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-87191f34-3cb3-4f25-a79b-0454b2eb18f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:35.064002 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87191f34-3cb3-4f25-a79b-0454b2eb18f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:35.064593 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87191f34-3cb3-4f25-a79b-0454b2eb18f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:35.065375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87191f34-3cb3-4f25-a79b-0454b2eb18f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:35.065844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-87191f34-3cb3-4f25-a79b-0454b2eb18f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:35.215500 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-87191f34-3cb3-4f25-a79b-0454b2eb18f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:35.223965 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-87191f34-3cb3-4f25-a79b-0454b2eb18f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1678 microversion: 2.1 time: 0.173456 May 21 22:01:35.224835 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3241/6610] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:35 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:36.241866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7a14204f-29ba-4f34-be7a-bf3429db11bd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:36.242589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7a14204f-29ba-4f34-be7a-bf3429db11bd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:36.249887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a14204f-29ba-4f34-be7a-bf3429db11bd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:36.250455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a14204f-29ba-4f34-be7a-bf3429db11bd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:36.251933 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a14204f-29ba-4f34-be7a-bf3429db11bd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:36.252427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7a14204f-29ba-4f34-be7a-bf3429db11bd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:36.449122 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7a14204f-29ba-4f34-be7a-bf3429db11bd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:36.458244 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7a14204f-29ba-4f34-be7a-bf3429db11bd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1678 microversion: 2.1 time: 0.220172 May 21 22:01:36.468324 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3370/6611] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:36 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1678 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:37.475984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4f693cda-dd0a-4c69-be75-7b76545ac364 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:37.481822 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4f693cda-dd0a-4c69-be75-7b76545ac364 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:37.483868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f693cda-dd0a-4c69-be75-7b76545ac364 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:37.484362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f693cda-dd0a-4c69-be75-7b76545ac364 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:37.485786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f693cda-dd0a-4c69-be75-7b76545ac364 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:37.486284 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4f693cda-dd0a-4c69-be75-7b76545ac364 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:37.627418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4f693cda-dd0a-4c69-be75-7b76545ac364 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:37.635076 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4f693cda-dd0a-4c69-be75-7b76545ac364 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1683 microversion: 2.1 time: 0.163268 May 21 22:01:37.635659 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3242/6612] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:37 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:38.656180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-da24fc25-af59-4112-96a5-32169056a9a5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:38.656853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-da24fc25-af59-4112-96a5-32169056a9a5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:38.665550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da24fc25-af59-4112-96a5-32169056a9a5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:38.666029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da24fc25-af59-4112-96a5-32169056a9a5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:38.666844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da24fc25-af59-4112-96a5-32169056a9a5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:38.667337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-da24fc25-af59-4112-96a5-32169056a9a5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:38.821290 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-da24fc25-af59-4112-96a5-32169056a9a5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:38.829547 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-da24fc25-af59-4112-96a5-32169056a9a5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1683 microversion: 2.1 time: 0.176835 May 21 22:01:38.832110 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3371/6613] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:38 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:01:39.847698 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ac7ecb41-370f-4a40-9d2c-458589d46291 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:39.848353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ac7ecb41-370f-4a40-9d2c-458589d46291 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:39.855418 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ac7ecb41-370f-4a40-9d2c-458589d46291 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:39.855878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ac7ecb41-370f-4a40-9d2c-458589d46291 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:39.856691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ac7ecb41-370f-4a40-9d2c-458589d46291 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:39.857139 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ac7ecb41-370f-4a40-9d2c-458589d46291 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:40.009786 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ac7ecb41-370f-4a40-9d2c-458589d46291 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:40.018086 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ac7ecb41-370f-4a40-9d2c-458589d46291 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1683 microversion: 2.1 time: 0.175158 May 21 22:01:40.018668 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3243/6614] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:39 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:01:41.035707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f494a6e3-15c9-4cad-a8da-a6bb6699dd23 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:41.036330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f494a6e3-15c9-4cad-a8da-a6bb6699dd23 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:41.043647 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f494a6e3-15c9-4cad-a8da-a6bb6699dd23 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:41.044117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f494a6e3-15c9-4cad-a8da-a6bb6699dd23 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:41.044947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f494a6e3-15c9-4cad-a8da-a6bb6699dd23 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:41.045423 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f494a6e3-15c9-4cad-a8da-a6bb6699dd23 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:41.191883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f494a6e3-15c9-4cad-a8da-a6bb6699dd23 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:41.199549 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f494a6e3-15c9-4cad-a8da-a6bb6699dd23 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1683 microversion: 2.1 time: 0.168437 May 21 22:01:41.200115 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3372/6615] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:41 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:42.217234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e9483b31-adb6-4e90-97ef-93dfcdec1ef8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:42.217912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e9483b31-adb6-4e90-97ef-93dfcdec1ef8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:42.225236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9483b31-adb6-4e90-97ef-93dfcdec1ef8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:42.225690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9483b31-adb6-4e90-97ef-93dfcdec1ef8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:42.226458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9483b31-adb6-4e90-97ef-93dfcdec1ef8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:42.226899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9483b31-adb6-4e90-97ef-93dfcdec1ef8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:42.367674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e9483b31-adb6-4e90-97ef-93dfcdec1ef8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:42.376397 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e9483b31-adb6-4e90-97ef-93dfcdec1ef8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1683 microversion: 2.1 time: 0.162666 May 21 22:01:42.377049 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3244/6616] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:42 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:01:43.395106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-64264b0c-7665-4a58-9c1d-ae194192baad tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:43.395792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-64264b0c-7665-4a58-9c1d-ae194192baad tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:43.402500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-64264b0c-7665-4a58-9c1d-ae194192baad tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:43.402966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-64264b0c-7665-4a58-9c1d-ae194192baad tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:43.403748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-64264b0c-7665-4a58-9c1d-ae194192baad tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:43.404199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-64264b0c-7665-4a58-9c1d-ae194192baad tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:43.552639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-64264b0c-7665-4a58-9c1d-ae194192baad tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:43.560268 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-64264b0c-7665-4a58-9c1d-ae194192baad tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1683 microversion: 2.1 time: 0.170550 May 21 22:01:43.560857 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3373/6617] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:43 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:44.579090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-74c021b0-2f52-4e1f-ae1d-997bce41e711 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:44.579645 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-74c021b0-2f52-4e1f-ae1d-997bce41e711 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:44.586747 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-74c021b0-2f52-4e1f-ae1d-997bce41e711 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:44.587205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-74c021b0-2f52-4e1f-ae1d-997bce41e711 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:44.587981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-74c021b0-2f52-4e1f-ae1d-997bce41e711 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:44.588454 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-74c021b0-2f52-4e1f-ae1d-997bce41e711 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:44.738835 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-74c021b0-2f52-4e1f-ae1d-997bce41e711 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:44.747925 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-74c021b0-2f52-4e1f-ae1d-997bce41e711 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1683 microversion: 2.1 time: 0.173003 May 21 22:01:44.748844 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3245/6618] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:44 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:45.768251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c4614290-c9e9-43c4-89d7-36dd173eb428 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:45.768908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c4614290-c9e9-43c4-89d7-36dd173eb428 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:45.775980 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4614290-c9e9-43c4-89d7-36dd173eb428 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:45.776483 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4614290-c9e9-43c4-89d7-36dd173eb428 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:45.777272 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4614290-c9e9-43c4-89d7-36dd173eb428 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:45.777725 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4614290-c9e9-43c4-89d7-36dd173eb428 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:45.928472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c4614290-c9e9-43c4-89d7-36dd173eb428 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:45.936069 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c4614290-c9e9-43c4-89d7-36dd173eb428 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1683 microversion: 2.1 time: 0.172207 May 21 22:01:45.936615 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3374/6619] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:45 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:46.954446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d471eab4-6b0f-468e-9918-fc483fe3b586 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:46.955017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d471eab4-6b0f-468e-9918-fc483fe3b586 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:46.962056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d471eab4-6b0f-468e-9918-fc483fe3b586 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:46.962505 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d471eab4-6b0f-468e-9918-fc483fe3b586 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:46.963268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d471eab4-6b0f-468e-9918-fc483fe3b586 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:46.963705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d471eab4-6b0f-468e-9918-fc483fe3b586 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:47.111036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d471eab4-6b0f-468e-9918-fc483fe3b586 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:47.118790 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d471eab4-6b0f-468e-9918-fc483fe3b586 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1683 microversion: 2.1 time: 0.168950 May 21 22:01:47.119367 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3246/6620] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:46 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:48.136615 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fbad2b39-db4e-4166-b56f-bb628076211f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:48.137248 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fbad2b39-db4e-4166-b56f-bb628076211f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:48.140040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:01:48.145939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbad2b39-db4e-4166-b56f-bb628076211f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:48.146410 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbad2b39-db4e-4166-b56f-bb628076211f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:48.147190 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbad2b39-db4e-4166-b56f-bb628076211f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:48.147643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fbad2b39-db4e-4166-b56f-bb628076211f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:48.151641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=93 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:01:48.294051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fbad2b39-db4e-4166-b56f-bb628076211f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:48.301822 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fbad2b39-db4e-4166-b56f-bb628076211f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1683 microversion: 2.1 time: 0.169219 May 21 22:01:48.303994 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3375/6621] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:48 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:49.319205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-08586354-c0fe-49c3-876c-4f44a305c673 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:49.327103 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-08586354-c0fe-49c3-876c-4f44a305c673 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:49.327103 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-08586354-c0fe-49c3-876c-4f44a305c673 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:49.327417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-08586354-c0fe-49c3-876c-4f44a305c673 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:49.328642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-08586354-c0fe-49c3-876c-4f44a305c673 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:49.329089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-08586354-c0fe-49c3-876c-4f44a305c673 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:49.333269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:01:49.480968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-08586354-c0fe-49c3-876c-4f44a305c673 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:49.489375 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-08586354-c0fe-49c3-876c-4f44a305c673 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1683 microversion: 2.1 time: 0.174093 May 21 22:01:49.489964 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3247/6622] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:49 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:50.507187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-930158ab-05af-43ed-861e-7926651f8b2a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:50.507819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-930158ab-05af-43ed-861e-7926651f8b2a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:50.514847 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-930158ab-05af-43ed-861e-7926651f8b2a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:50.515316 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-930158ab-05af-43ed-861e-7926651f8b2a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:50.516308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-930158ab-05af-43ed-861e-7926651f8b2a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:50.516780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-930158ab-05af-43ed-861e-7926651f8b2a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:50.657035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-930158ab-05af-43ed-861e-7926651f8b2a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:50.664661 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-930158ab-05af-43ed-861e-7926651f8b2a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1683 microversion: 2.1 time: 0.161398 May 21 22:01:50.665229 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3376/6623] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:50 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:51.683011 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3b0be3fe-a4bf-430b-afeb-8112905cf789 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:51.683719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3b0be3fe-a4bf-430b-afeb-8112905cf789 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:51.691724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b0be3fe-a4bf-430b-afeb-8112905cf789 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:51.692216 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b0be3fe-a4bf-430b-afeb-8112905cf789 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:51.693023 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b0be3fe-a4bf-430b-afeb-8112905cf789 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:51.693480 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3b0be3fe-a4bf-430b-afeb-8112905cf789 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:51.839598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3b0be3fe-a4bf-430b-afeb-8112905cf789 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:51.847491 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3b0be3fe-a4bf-430b-afeb-8112905cf789 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1683 microversion: 2.1 time: 0.168405 May 21 22:01:51.848092 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3248/6624] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:51 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:52.865429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f6aab2c1-f379-4dc5-8dc4-baecfab5f541 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:52.866060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f6aab2c1-f379-4dc5-8dc4-baecfab5f541 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:52.873391 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6aab2c1-f379-4dc5-8dc4-baecfab5f541 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:52.873873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6aab2c1-f379-4dc5-8dc4-baecfab5f541 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:52.874668 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6aab2c1-f379-4dc5-8dc4-baecfab5f541 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:52.875841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f6aab2c1-f379-4dc5-8dc4-baecfab5f541 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:53.023874 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f6aab2c1-f379-4dc5-8dc4-baecfab5f541 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:53.032912 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f6aab2c1-f379-4dc5-8dc4-baecfab5f541 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1683 microversion: 2.1 time: 0.171307 May 21 22:01:53.033526 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3377/6625] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:52 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:54.050537 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-628832c7-43d4-47f8-aa60-e8fb3f118fca tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:54.051131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-628832c7-43d4-47f8-aa60-e8fb3f118fca tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:54.063586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-628832c7-43d4-47f8-aa60-e8fb3f118fca tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:54.066388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-628832c7-43d4-47f8-aa60-e8fb3f118fca tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:54.067403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-628832c7-43d4-47f8-aa60-e8fb3f118fca tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:54.067845 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-628832c7-43d4-47f8-aa60-e8fb3f118fca tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:54.214792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-628832c7-43d4-47f8-aa60-e8fb3f118fca tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:54.222371 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-628832c7-43d4-47f8-aa60-e8fb3f118fca tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1683 microversion: 2.1 time: 0.175949 May 21 22:01:54.222949 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3249/6626] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:54 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:55.239633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f31aa1d4-94b5-414f-b41d-0ff96b3a85bc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:55.240270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f31aa1d4-94b5-414f-b41d-0ff96b3a85bc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:55.247417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f31aa1d4-94b5-414f-b41d-0ff96b3a85bc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:55.247888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f31aa1d4-94b5-414f-b41d-0ff96b3a85bc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:55.248717 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f31aa1d4-94b5-414f-b41d-0ff96b3a85bc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:55.249180 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f31aa1d4-94b5-414f-b41d-0ff96b3a85bc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:55.393061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f31aa1d4-94b5-414f-b41d-0ff96b3a85bc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:55.400728 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f31aa1d4-94b5-414f-b41d-0ff96b3a85bc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1683 microversion: 2.1 time: 0.165066 May 21 22:01:55.401291 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3378/6627] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:55 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:56.417932 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4bcef7ac-6cd5-42ba-b4ab-0e0c549dad44 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:56.418559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4bcef7ac-6cd5-42ba-b4ab-0e0c549dad44 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:56.421369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=36 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:01:56.426373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bcef7ac-6cd5-42ba-b4ab-0e0c549dad44 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:56.426834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bcef7ac-6cd5-42ba-b4ab-0e0c549dad44 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:56.427622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bcef7ac-6cd5-42ba-b4ab-0e0c549dad44 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:56.428068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4bcef7ac-6cd5-42ba-b4ab-0e0c549dad44 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:56.575100 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4bcef7ac-6cd5-42ba-b4ab-0e0c549dad44 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:56.582952 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4bcef7ac-6cd5-42ba-b4ab-0e0c549dad44 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1683 microversion: 2.1 time: 0.169040 May 21 22:01:56.583532 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3250/6628] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:56 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:57.599905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ac619a7e-d183-476f-8e3e-0da4a8f01986 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:57.600468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ac619a7e-d183-476f-8e3e-0da4a8f01986 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:57.607142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ac619a7e-d183-476f-8e3e-0da4a8f01986 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:57.607618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ac619a7e-d183-476f-8e3e-0da4a8f01986 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:57.608421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ac619a7e-d183-476f-8e3e-0da4a8f01986 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:57.608879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ac619a7e-d183-476f-8e3e-0da4a8f01986 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:57.755733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ac619a7e-d183-476f-8e3e-0da4a8f01986 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:57.763346 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ac619a7e-d183-476f-8e3e-0da4a8f01986 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1683 microversion: 2.1 time: 0.167666 May 21 22:01:57.763913 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3379/6629] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:57 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:01:58.781209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c6f0d9cb-dff1-4a4f-8ca7-8c4d0bf66e0c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:58.782615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c6f0d9cb-dff1-4a4f-8ca7-8c4d0bf66e0c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:58.789775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c6f0d9cb-dff1-4a4f-8ca7-8c4d0bf66e0c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:58.790233 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c6f0d9cb-dff1-4a4f-8ca7-8c4d0bf66e0c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:58.791013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c6f0d9cb-dff1-4a4f-8ca7-8c4d0bf66e0c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:58.791458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c6f0d9cb-dff1-4a4f-8ca7-8c4d0bf66e0c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:58.939668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c6f0d9cb-dff1-4a4f-8ca7-8c4d0bf66e0c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:01:58.947397 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c6f0d9cb-dff1-4a4f-8ca7-8c4d0bf66e0c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1683 microversion: 2.1 time: 0.170147 May 21 22:01:58.947976 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3251/6630] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:58 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:01:59.557007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-5caa6832-89d3-42f4-8445-4c3964d9f3db req-a7787c39-d130-4289-859b-94efba677515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f6ddb6-057f-49df-9afd-fc86189f2f3e", "name": "network-vif-unplugged", "status": "completed", "tag": "7e9114ae-aefc-4952-ad06-def4e163bf9b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:01:59.566685 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5caa6832-89d3-42f4-8445-4c3964d9f3db req-a7787c39-d130-4289-859b-94efba677515 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:59.567146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5caa6832-89d3-42f4-8445-4c3964d9f3db req-a7787c39-d130-4289-859b-94efba677515 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:59.579760 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-5caa6832-89d3-42f4-8445-4c3964d9f3db req-a7787c39-d130-4289-859b-94efba677515 service nova] Creating event network-vif-unplugged:7e9114ae-aefc-4952-ad06-def4e163bf9b for instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e on nch2-master-1 May 21 22:01:59.585436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [req-5caa6832-89d3-42f4-8445-4c3964d9f3db req-a7787c39-d130-4289-859b-94efba677515 service nova] Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 22:01:59.602933 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-5caa6832-89d3-42f4-8445-4c3964d9f3db req-a7787c39-d130-4289-859b-94efba677515 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049837 May 21 22:01:59.603542 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3380/6631] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:01:59.964972 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-329875e4-df42-44ba-9330-5620f0c8256e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:01:59.965601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-329875e4-df42-44ba-9330-5620f0c8256e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:01:59.973460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-329875e4-df42-44ba-9330-5620f0c8256e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:59.974024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-329875e4-df42-44ba-9330-5620f0c8256e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:01:59.974795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-329875e4-df42-44ba-9330-5620f0c8256e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:01:59.975147 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-329875e4-df42-44ba-9330-5620f0c8256e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:00.155488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-329875e4-df42-44ba-9330-5620f0c8256e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:00.167872 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-329875e4-df42-44ba-9330-5620f0c8256e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1682 microversion: 2.1 time: 0.206983 May 21 22:02:00.168498 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3252/6632] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:01:59 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1682 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:01.187491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-437b9d07-8e30-4d06-a749-a32a710daef3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:01.192776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-437b9d07-8e30-4d06-a749-a32a710daef3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:01.195102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-437b9d07-8e30-4d06-a749-a32a710daef3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:01.195572 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-437b9d07-8e30-4d06-a749-a32a710daef3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:01.196386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-437b9d07-8e30-4d06-a749-a32a710daef3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:01.196890 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-437b9d07-8e30-4d06-a749-a32a710daef3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:01.347047 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-437b9d07-8e30-4d06-a749-a32a710daef3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:01.354893 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-437b9d07-8e30-4d06-a749-a32a710daef3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1680 microversion: 2.1 time: 0.172485 May 21 22:02:01.355482 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3381/6633] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:01 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:01.618074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-e28bec48-3584-4bf9-8a4d-753c8a4d722d req-06b5a3fe-25b0-4875-a1a2-b5cf6760e3b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f6ddb6-057f-49df-9afd-fc86189f2f3e", "tag": "7e9114ae-aefc-4952-ad06-def4e163bf9b"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:02:01.627877 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e28bec48-3584-4bf9-8a4d-753c8a4d722d req-06b5a3fe-25b0-4875-a1a2-b5cf6760e3b0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:01.628350 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e28bec48-3584-4bf9-8a4d-753c8a4d722d req-06b5a3fe-25b0-4875-a1a2-b5cf6760e3b0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:01.639858 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-e28bec48-3584-4bf9-8a4d-753c8a4d722d req-06b5a3fe-25b0-4875-a1a2-b5cf6760e3b0 service nova] Creating event network-changed:7e9114ae-aefc-4952-ad06-def4e163bf9b for instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e on nch2-master-1 May 21 22:02:01.645324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [req-e28bec48-3584-4bf9-8a4d-753c8a4d722d req-06b5a3fe-25b0-4875-a1a2-b5cf6760e3b0 service nova] Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 22:02:01.656030 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-e28bec48-3584-4bf9-8a4d-753c8a4d722d req-06b5a3fe-25b0-4875-a1a2-b5cf6760e3b0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041971 May 21 22:02:01.656692 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3253/6634] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:02:02.375838 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2de38384-3ec2-412e-83a9-2b4545fb10ac tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:02.376506 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2de38384-3ec2-412e-83a9-2b4545fb10ac tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:02.383469 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2de38384-3ec2-412e-83a9-2b4545fb10ac tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:02.383941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2de38384-3ec2-412e-83a9-2b4545fb10ac tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:02.384771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2de38384-3ec2-412e-83a9-2b4545fb10ac tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:02.385238 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2de38384-3ec2-412e-83a9-2b4545fb10ac tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:02.548173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2de38384-3ec2-412e-83a9-2b4545fb10ac tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:02.556149 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2de38384-3ec2-412e-83a9-2b4545fb10ac tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1680 microversion: 2.1 time: 0.184327 May 21 22:02:02.556752 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3382/6635] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:02 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:03.575190 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-82478c47-521f-4832-8a07-0d6635613480 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:03.575819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-82478c47-521f-4832-8a07-0d6635613480 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:03.582455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-82478c47-521f-4832-8a07-0d6635613480 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:03.582914 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-82478c47-521f-4832-8a07-0d6635613480 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:03.583696 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-82478c47-521f-4832-8a07-0d6635613480 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:03.584138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-82478c47-521f-4832-8a07-0d6635613480 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:03.735750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-82478c47-521f-4832-8a07-0d6635613480 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:03.743479 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-82478c47-521f-4832-8a07-0d6635613480 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1677 microversion: 2.1 time: 0.173602 May 21 22:02:03.744057 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3254/6636] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:03 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:03.760176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bf9cc0d7-2e6e-4337-b6ff-e9b37d25a0e3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:02:03.760756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bf9cc0d7-2e6e-4337-b6ff-e9b37d25a0e3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:03.768460 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bf9cc0d7-2e6e-4337-b6ff-e9b37d25a0e3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:03.768927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bf9cc0d7-2e6e-4337-b6ff-e9b37d25a0e3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:03.769710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bf9cc0d7-2e6e-4337-b6ff-e9b37d25a0e3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:03.770165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bf9cc0d7-2e6e-4337-b6ff-e9b37d25a0e3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:03.937032 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bf9cc0d7-2e6e-4337-b6ff-e9b37d25a0e3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "POST /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e/action" status: 204 len: 0 microversion: 2.1 time: 0.180554 May 21 22:02:03.938444 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3383/6637] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:02:03 2022] POST /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e/action => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:02:03.947959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d22c29a3-96e2-4b97-9777-170c123356cd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:03.948637 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d22c29a3-96e2-4b97-9777-170c123356cd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:03.954910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d22c29a3-96e2-4b97-9777-170c123356cd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:03.955363 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d22c29a3-96e2-4b97-9777-170c123356cd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:03.956141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d22c29a3-96e2-4b97-9777-170c123356cd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:03.956620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d22c29a3-96e2-4b97-9777-170c123356cd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:04.109002 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d22c29a3-96e2-4b97-9777-170c123356cd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:04.117818 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d22c29a3-96e2-4b97-9777-170c123356cd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1677 microversion: 2.1 time: 0.174152 May 21 22:02:04.118410 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3255/6638] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:03 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:05.143598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-41e8f56d-9d2d-4e44-9fae-5198e23c6013 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:05.144391 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-41e8f56d-9d2d-4e44-9fae-5198e23c6013 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:05.150815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-41e8f56d-9d2d-4e44-9fae-5198e23c6013 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:05.151281 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-41e8f56d-9d2d-4e44-9fae-5198e23c6013 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:05.152068 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-41e8f56d-9d2d-4e44-9fae-5198e23c6013 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:05.152555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-41e8f56d-9d2d-4e44-9fae-5198e23c6013 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:05.310746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-41e8f56d-9d2d-4e44-9fae-5198e23c6013 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:05.319946 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-41e8f56d-9d2d-4e44-9fae-5198e23c6013 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1677 microversion: 2.1 time: 0.182721 May 21 22:02:05.320559 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3384/6639] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:05 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:06.337793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-289a35bf-25f6-4cb2-92f6-087af0626ca4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:06.338416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-289a35bf-25f6-4cb2-92f6-087af0626ca4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:06.345936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-289a35bf-25f6-4cb2-92f6-087af0626ca4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:06.350093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-289a35bf-25f6-4cb2-92f6-087af0626ca4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:06.350093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-289a35bf-25f6-4cb2-92f6-087af0626ca4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:06.350093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-289a35bf-25f6-4cb2-92f6-087af0626ca4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:06.492934 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-98431dae-9f92-48b6-93a7-a3740bab3b26 req-a68b5c08-dc85-4db0-a80c-0e07d31e8078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f6ddb6-057f-49df-9afd-fc86189f2f3e", "name": "network-vif-plugged", "status": "completed", "tag": "7e9114ae-aefc-4952-ad06-def4e163bf9b"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:02:06.502572 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-98431dae-9f92-48b6-93a7-a3740bab3b26 req-a68b5c08-dc85-4db0-a80c-0e07d31e8078 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:06.508630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-289a35bf-25f6-4cb2-92f6-087af0626ca4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:06.508781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-98431dae-9f92-48b6-93a7-a3740bab3b26 req-a68b5c08-dc85-4db0-a80c-0e07d31e8078 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:06.510997 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-289a35bf-25f6-4cb2-92f6-087af0626ca4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1669 microversion: 2.1 time: 0.177139 May 21 22:02:06.511662 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3256/6640] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:06 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1669 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:06.514796 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-98431dae-9f92-48b6-93a7-a3740bab3b26 req-a68b5c08-dc85-4db0-a80c-0e07d31e8078 service nova] Creating event network-vif-plugged:7e9114ae-aefc-4952-ad06-def4e163bf9b for instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e on nch2-master-1 May 21 22:02:06.525070 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-98431dae-9f92-48b6-93a7-a3740bab3b26 req-a68b5c08-dc85-4db0-a80c-0e07d31e8078 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036896 May 21 22:02:06.525945 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3385/6641] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:02:06.528057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ab1677a2-83b6-408f-93b9-84455326cc22 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:06.528741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ab1677a2-83b6-408f-93b9-84455326cc22 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:06.535336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab1677a2-83b6-408f-93b9-84455326cc22 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:06.535818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab1677a2-83b6-408f-93b9-84455326cc22 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:06.537672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab1677a2-83b6-408f-93b9-84455326cc22 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:06.537672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab1677a2-83b6-408f-93b9-84455326cc22 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:06.681515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ab1677a2-83b6-408f-93b9-84455326cc22 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:06.690591 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ab1677a2-83b6-408f-93b9-84455326cc22 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1669 microversion: 2.1 time: 0.166413 May 21 22:02:06.691165 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3257/6642] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:06 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1669 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:02:06.707009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ae512603-25e2-42b1-91dd-22392b38ec83 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:06.707754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ae512603-25e2-42b1-91dd-22392b38ec83 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:06.714238 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ae512603-25e2-42b1-91dd-22392b38ec83 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:06.714715 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ae512603-25e2-42b1-91dd-22392b38ec83 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:06.715535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ae512603-25e2-42b1-91dd-22392b38ec83 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:06.715995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ae512603-25e2-42b1-91dd-22392b38ec83 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:06.859672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ae512603-25e2-42b1-91dd-22392b38ec83 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:06.868502 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ae512603-25e2-42b1-91dd-22392b38ec83 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1669 microversion: 2.1 time: 0.165822 May 21 22:02:06.869071 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3386/6643] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:06 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:06.884249 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-058a89e9-eb0a-47fe-a4ee-ea89d986fabc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:06.884779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-058a89e9-eb0a-47fe-a4ee-ea89d986fabc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:06.890848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-058a89e9-eb0a-47fe-a4ee-ea89d986fabc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:06.891297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-058a89e9-eb0a-47fe-a4ee-ea89d986fabc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:06.892081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-058a89e9-eb0a-47fe-a4ee-ea89d986fabc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:06.892639 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-058a89e9-eb0a-47fe-a4ee-ea89d986fabc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:06.917503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-058a89e9-eb0a-47fe-a4ee-ea89d986fabc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 22:02:07.149177 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-058a89e9-eb0a-47fe-a4ee-ea89d986fabc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "DELETE /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 204 len: 0 microversion: 2.1 time: 0.268444 May 21 22:02:07.149785 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3258/6644] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:02:06 2022] DELETE /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:02:07.158894 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-14ca8179-7f6a-4288-a4a3-7512129bd070 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:07.159402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-14ca8179-7f6a-4288-a4a3-7512129bd070 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:07.165778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14ca8179-7f6a-4288-a4a3-7512129bd070 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:07.166242 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14ca8179-7f6a-4288-a4a3-7512129bd070 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:07.167022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14ca8179-7f6a-4288-a4a3-7512129bd070 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:07.167473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-14ca8179-7f6a-4288-a4a3-7512129bd070 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:07.309541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-14ca8179-7f6a-4288-a4a3-7512129bd070 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:07.317654 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-14ca8179-7f6a-4288-a4a3-7512129bd070 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1675 microversion: 2.1 time: 0.163486 May 21 22:02:07.318658 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3387/6645] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:07 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:08.336565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2410a306-2ae1-4712-96a8-db9a5ef4606e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:08.337353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2410a306-2ae1-4712-96a8-db9a5ef4606e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:08.344264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2410a306-2ae1-4712-96a8-db9a5ef4606e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:08.344745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2410a306-2ae1-4712-96a8-db9a5ef4606e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:08.346029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2410a306-2ae1-4712-96a8-db9a5ef4606e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:08.346479 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2410a306-2ae1-4712-96a8-db9a5ef4606e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:08.540886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2410a306-2ae1-4712-96a8-db9a5ef4606e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:08.548748 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2410a306-2ae1-4712-96a8-db9a5ef4606e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1675 microversion: 2.1 time: 0.216450 May 21 22:02:08.549337 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3259/6646] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:08 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1675 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:09.565558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-20c3ebae-da7f-4669-acb3-42e90fd88da9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:09.566188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-20c3ebae-da7f-4669-acb3-42e90fd88da9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:09.573416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20c3ebae-da7f-4669-acb3-42e90fd88da9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:09.573901 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20c3ebae-da7f-4669-acb3-42e90fd88da9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:09.574711 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20c3ebae-da7f-4669-acb3-42e90fd88da9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:09.575177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-20c3ebae-da7f-4669-acb3-42e90fd88da9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:09.655176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-20c3ebae-da7f-4669-acb3-42e90fd88da9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:09.664301 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-20c3ebae-da7f-4669-acb3-42e90fd88da9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 200 len: 1608 microversion: 2.1 time: 0.102895 May 21 22:02:09.665106 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3388/6647] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:09 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 1608 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:09.920588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-e8771bea-23e1-4f50-a0b4-e05e7e86552a req-f6eb8141-a245-4ffd-a05f-3d70a9910f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f6ddb6-057f-49df-9afd-fc86189f2f3e", "name": "network-vif-deleted", "tag": "7e9114ae-aefc-4952-ad06-def4e163bf9b"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:02:09.930252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e8771bea-23e1-4f50-a0b4-e05e7e86552a req-f6eb8141-a245-4ffd-a05f-3d70a9910f03 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:09.930849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e8771bea-23e1-4f50-a0b4-e05e7e86552a req-f6eb8141-a245-4ffd-a05f-3d70a9910f03 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:09.943111 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-e8771bea-23e1-4f50-a0b4-e05e7e86552a req-f6eb8141-a245-4ffd-a05f-3d70a9910f03 service nova] Creating event network-vif-deleted:7e9114ae-aefc-4952-ad06-def4e163bf9b for instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e on nch2-master-1 May 21 22:02:09.948387 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-e8771bea-23e1-4f50-a0b4-e05e7e86552a req-f6eb8141-a245-4ffd-a05f-3d70a9910f03 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032539 May 21 22:02:09.949001 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3260/6648] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:02:10.682371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-74358569-c929-47ec-ad7e-4749e744280a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:10.683013 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-74358569-c929-47ec-ad7e-4749e744280a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:10.691035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-74358569-c929-47ec-ad7e-4749e744280a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:10.691542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-74358569-c929-47ec-ad7e-4749e744280a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:10.692395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-74358569-c929-47ec-ad7e-4749e744280a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:10.692857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-74358569-c929-47ec-ad7e-4749e744280a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:10.707322 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-74358569-c929-47ec-ad7e-4749e744280a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] HTTP exception thrown: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-74358569-c929-47ec-ad7e-4749e744280a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Request method failure captured: May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e HTTP/1.1 May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiWEqg4H5ib8lBeBY5hWnlzTjb_0SYMAu1PXPchB7RzXjO9Fc2uRmCYI6YXq0eyS1H44OjCoLWXG04d9ut0CknArKFnB7d8KFC2oZLDhogrvccuHSLlGl5ORpF14bspFXBZezQCKhKDgRiiLFY_0g2s6h-a-kpGbnJaHmPkp_ile5A_0 May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb9f2d0a8dca4c85a47c2d138d1b39cd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerActionsTestJSON-532218768 May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerActionsTestJSON-532218768-project May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 1fd1bb72fc464808988a1579524c7939 May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerActionsTestJSON-532218768-project May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '93f6ddb6-057f-49df-9afd-fc86189f2f3e'} May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:02:10.708995 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:02:10.712579 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:02:10.712579 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:02:10.712579 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:02:10.712579 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:02:10.712579 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:02:10.712579 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. May 21 22:02:10.712579 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:02:10.712579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-74358569-c929-47ec-ad7e-4749e744280a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Returning 404 to user: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:02:10.712579 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-74358569-c929-47ec-ad7e-4749e744280a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 404 len: 111 microversion: 2.1 time: 0.032080 May 21 22:02:10.712579 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3389/6649] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:10 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:02:10.728407 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a5892795-6b4c-4603-8cfa-4a29542f01d8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:10.729331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a5892795-6b4c-4603-8cfa-4a29542f01d8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:10.736128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5892795-6b4c-4603-8cfa-4a29542f01d8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:10.736753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5892795-6b4c-4603-8cfa-4a29542f01d8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:10.737543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5892795-6b4c-4603-8cfa-4a29542f01d8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:10.737988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5892795-6b4c-4603-8cfa-4a29542f01d8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:10.752617 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-a5892795-6b4c-4603-8cfa-4a29542f01d8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] HTTP exception thrown: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a5892795-6b4c-4603-8cfa-4a29542f01d8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Request method failure captured: May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e HTTP/1.1 May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWEqg4H5ib8lBeBY5hWnlzTjb_0SYMAu1PXPchB7RzXjO9Fc2uRmCYI6YXq0eyS1H44OjCoLWXG04d9ut0CknArKFnB7d8KFC2oZLDhogrvccuHSLlGl5ORpF14bspFXBZezQCKhKDgRiiLFY_0g2s6h-a-kpGbnJaHmPkp_ile5A_0 May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb9f2d0a8dca4c85a47c2d138d1b39cd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerActionsTestJSON-532218768 May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerActionsTestJSON-532218768-project May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1fd1bb72fc464808988a1579524c7939 May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerActionsTestJSON-532218768-project May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '93f6ddb6-057f-49df-9afd-fc86189f2f3e'} May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:02:10.754503 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:02:10.757882 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:02:10.757882 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:02:10.757882 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:02:10.757882 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:02:10.757882 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:02:10.757882 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. May 21 22:02:10.757882 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:02:10.757882 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a5892795-6b4c-4603-8cfa-4a29542f01d8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Returning 404 to user: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:02:10.757882 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a5892795-6b4c-4603-8cfa-4a29542f01d8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 404 len: 111 microversion: 2.1 time: 0.031915 May 21 22:02:10.757882 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3261/6650] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:10 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:02:10.806556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ca40b111-fbaf-4808-8588-69e0c31d19c8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1625312342", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "3293c92c-e4b2-4bbe-993a-802603a2deb4"}], "security_groups": [{"name": "tempest-securitygroup--889871437"}], "key_name": "tempest-keypair-937962467", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:02:10.920837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-ca40b111-fbaf-4808-8588-69e0c31d19c8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] validate_networks() for [('3293c92c-e4b2-4bbe-993a-802603a2deb4', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 22:02:11.379708 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ca40b111-fbaf-4808-8588-69e0c31d19c8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:02:11.380269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ca40b111-fbaf-4808-8588-69e0c31d19c8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:02:11.380917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ca40b111-fbaf-4808-8588-69e0c31d19c8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:02:11.381359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ca40b111-fbaf-4808-8588-69e0c31d19c8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:02:11.381796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ca40b111-fbaf-4808-8588-69e0c31d19c8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:02:11.391492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca40b111-fbaf-4808-8588-69e0c31d19c8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:11.392638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca40b111-fbaf-4808-8588-69e0c31d19c8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:11.397631 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca40b111-fbaf-4808-8588-69e0c31d19c8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:11.397631 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ca40b111-fbaf-4808-8588-69e0c31d19c8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:11.411833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ca40b111-fbaf-4808-8588-69e0c31d19c8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Getting quotas for project cb9f2d0a8dca4c85a47c2d138d1b39cd. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:02:11.417296 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ca40b111-fbaf-4808-8588-69e0c31d19c8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Getting quotas for user 1fd1bb72fc464808988a1579524c7939 and project cb9f2d0a8dca4c85a47c2d138d1b39cd. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:02:11.430134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ca40b111-fbaf-4808-8588-69e0c31d19c8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 22:02:11.432508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ca40b111-fbaf-4808-8588-69e0c31d19c8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 22:02:11.591494 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ca40b111-fbaf-4808-8588-69e0c31d19c8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.789994 May 21 22:02:11.592011 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3390/6651] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 22:02:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 22:02:11.604429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4d8ede25-b140-4898-a2df-bc48b3fdd496 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:11.604429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4d8ede25-b140-4898-a2df-bc48b3fdd496 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:11.671527 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4d8ede25-b140-4898-a2df-bc48b3fdd496 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:11.680272 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4d8ede25-b140-4898-a2df-bc48b3fdd496 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1238 microversion: 2.1 time: 0.080913 May 21 22:02:11.688440 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3262/6652] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:11 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:12.699279 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e44cc295-9ae0-4942-9ee0-52570416fff8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:12.699913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e44cc295-9ae0-4942-9ee0-52570416fff8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:12.707661 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e44cc295-9ae0-4942-9ee0-52570416fff8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:12.708130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e44cc295-9ae0-4942-9ee0-52570416fff8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:12.708958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e44cc295-9ae0-4942-9ee0-52570416fff8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:12.709423 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e44cc295-9ae0-4942-9ee0-52570416fff8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:12.776480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e44cc295-9ae0-4942-9ee0-52570416fff8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:12.784300 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e44cc295-9ae0-4942-9ee0-52570416fff8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1234 microversion: 2.1 time: 0.089805 May 21 22:02:12.785008 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3391/6653] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:12 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1234 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:13.803272 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-813debd4-f052-46c4-b5bd-d67c0cc80ec4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:13.803970 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-813debd4-f052-46c4-b5bd-d67c0cc80ec4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:13.810976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-813debd4-f052-46c4-b5bd-d67c0cc80ec4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:13.811430 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-813debd4-f052-46c4-b5bd-d67c0cc80ec4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:13.812202 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-813debd4-f052-46c4-b5bd-d67c0cc80ec4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:13.812831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-813debd4-f052-46c4-b5bd-d67c0cc80ec4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:13.889769 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-813debd4-f052-46c4-b5bd-d67c0cc80ec4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:13.897884 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-813debd4-f052-46c4-b5bd-d67c0cc80ec4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1296 microversion: 2.1 time: 0.099532 May 21 22:02:13.898460 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3263/6654] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:13 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1296 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:14.916489 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f2221463-ec6c-45bd-9af2-ffec31fd7312 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:14.917367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f2221463-ec6c-45bd-9af2-ffec31fd7312 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:14.925165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2221463-ec6c-45bd-9af2-ffec31fd7312 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:14.925659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2221463-ec6c-45bd-9af2-ffec31fd7312 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:14.926437 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2221463-ec6c-45bd-9af2-ffec31fd7312 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:14.926883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f2221463-ec6c-45bd-9af2-ffec31fd7312 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:15.088954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f2221463-ec6c-45bd-9af2-ffec31fd7312 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:15.093426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:02:15.098991 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f2221463-ec6c-45bd-9af2-ffec31fd7312 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1363 microversion: 2.1 time: 0.186491 May 21 22:02:15.104312 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3392/6655] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:14 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:15.266656 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-c50083e8-70e4-438c-9228-27ee35b7b32b req-0240432d-974c-4200-a10b-5cdfa709cfe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a924b75f-2e0c-4b96-91db-d9e415a8d092", "tag": "50027e8e-2348-48a4-92ab-d7e071762905"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:02:15.283230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c50083e8-70e4-438c-9228-27ee35b7b32b req-0240432d-974c-4200-a10b-5cdfa709cfe7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:15.283230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-c50083e8-70e4-438c-9228-27ee35b7b32b req-0240432d-974c-4200-a10b-5cdfa709cfe7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:15.292036 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-c50083e8-70e4-438c-9228-27ee35b7b32b req-0240432d-974c-4200-a10b-5cdfa709cfe7 service nova] Creating event network-changed:50027e8e-2348-48a4-92ab-d7e071762905 for instance a924b75f-2e0c-4b96-91db-d9e415a8d092 on nch2-master-1 May 21 22:02:15.297790 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-c50083e8-70e4-438c-9228-27ee35b7b32b req-0240432d-974c-4200-a10b-5cdfa709cfe7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036524 May 21 22:02:15.298802 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3264/6656] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:02:16.117061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ee291dc1-8503-4726-94b1-23ba6b9701e7 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:16.117689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ee291dc1-8503-4726-94b1-23ba6b9701e7 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:16.125538 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee291dc1-8503-4726-94b1-23ba6b9701e7 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:16.131643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee291dc1-8503-4726-94b1-23ba6b9701e7 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:16.131643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee291dc1-8503-4726-94b1-23ba6b9701e7 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:16.131643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ee291dc1-8503-4726-94b1-23ba6b9701e7 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:16.272560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ee291dc1-8503-4726-94b1-23ba6b9701e7 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:16.280158 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ee291dc1-8503-4726-94b1-23ba6b9701e7 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1363 microversion: 2.1 time: 0.167048 May 21 22:02:16.280790 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3393/6657] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:16 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:17.298614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-86b144b8-b4cb-4dc2-82a3-4ccf0d4b2fbd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:17.299357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-86b144b8-b4cb-4dc2-82a3-4ccf0d4b2fbd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:17.306613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86b144b8-b4cb-4dc2-82a3-4ccf0d4b2fbd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:17.307063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86b144b8-b4cb-4dc2-82a3-4ccf0d4b2fbd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:17.307823 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86b144b8-b4cb-4dc2-82a3-4ccf0d4b2fbd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:17.308260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86b144b8-b4cb-4dc2-82a3-4ccf0d4b2fbd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:17.326142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:02:17.458598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-86b144b8-b4cb-4dc2-82a3-4ccf0d4b2fbd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:17.466210 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-86b144b8-b4cb-4dc2-82a3-4ccf0d4b2fbd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1363 microversion: 2.1 time: 0.172276 May 21 22:02:17.466785 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3265/6658] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:17 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:18.483782 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-194ae61c-7054-48ad-862e-04123631a34d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:18.484460 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-194ae61c-7054-48ad-862e-04123631a34d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:18.487264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:02:18.492259 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-194ae61c-7054-48ad-862e-04123631a34d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:18.492776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-194ae61c-7054-48ad-862e-04123631a34d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:18.493554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-194ae61c-7054-48ad-862e-04123631a34d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:18.494023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-194ae61c-7054-48ad-862e-04123631a34d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:18.640240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-194ae61c-7054-48ad-862e-04123631a34d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:18.648450 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-194ae61c-7054-48ad-862e-04123631a34d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1363 microversion: 2.1 time: 0.168903 May 21 22:02:18.649041 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3394/6659] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:18 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:19.668023 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b9e167e3-7a13-46cd-8c10-11462ec60f45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:19.668882 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b9e167e3-7a13-46cd-8c10-11462ec60f45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:19.676822 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9e167e3-7a13-46cd-8c10-11462ec60f45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:19.677283 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9e167e3-7a13-46cd-8c10-11462ec60f45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:19.678118 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9e167e3-7a13-46cd-8c10-11462ec60f45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:19.678523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b9e167e3-7a13-46cd-8c10-11462ec60f45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:19.821618 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b9e167e3-7a13-46cd-8c10-11462ec60f45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:19.829367 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b9e167e3-7a13-46cd-8c10-11462ec60f45 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1363 microversion: 2.1 time: 0.166252 May 21 22:02:19.829941 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3266/6660] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:19 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:20.847231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b4953ece-02f4-4c6f-a294-6138749d925c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:20.847908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b4953ece-02f4-4c6f-a294-6138749d925c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:20.855440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b4953ece-02f4-4c6f-a294-6138749d925c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:20.855905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b4953ece-02f4-4c6f-a294-6138749d925c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:20.856715 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b4953ece-02f4-4c6f-a294-6138749d925c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:20.857168 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b4953ece-02f4-4c6f-a294-6138749d925c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:21.009831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b4953ece-02f4-4c6f-a294-6138749d925c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:21.017801 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b4953ece-02f4-4c6f-a294-6138749d925c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1363 microversion: 2.1 time: 0.174840 May 21 22:02:21.020460 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3395/6661] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:20 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:22.035383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-86c48c60-dbb5-41ae-be4e-e42bc798738b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:22.035910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-86c48c60-dbb5-41ae-be4e-e42bc798738b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:22.038703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:02:22.043665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86c48c60-dbb5-41ae-be4e-e42bc798738b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:22.044949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86c48c60-dbb5-41ae-be4e-e42bc798738b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:22.044949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86c48c60-dbb5-41ae-be4e-e42bc798738b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:22.045391 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-86c48c60-dbb5-41ae-be4e-e42bc798738b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:22.196591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-86c48c60-dbb5-41ae-be4e-e42bc798738b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:22.204919 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-86c48c60-dbb5-41ae-be4e-e42bc798738b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1363 microversion: 2.1 time: 0.172953 May 21 22:02:22.205495 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3267/6662] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:22 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:22.533529 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-b5e78723-ec36-4fe2-97d7-63cbc351afa1 req-2c6ee3c6-357b-402f-8912-2e2c47d9d500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a924b75f-2e0c-4b96-91db-d9e415a8d092", "name": "network-vif-plugged", "status": "completed", "tag": "50027e8e-2348-48a4-92ab-d7e071762905"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:02:22.538252 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:02:22.538953 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:02:22.543748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b5e78723-ec36-4fe2-97d7-63cbc351afa1 req-2c6ee3c6-357b-402f-8912-2e2c47d9d500 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:22.544202 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-b5e78723-ec36-4fe2-97d7-63cbc351afa1 req-2c6ee3c6-357b-402f-8912-2e2c47d9d500 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:22.555791 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-b5e78723-ec36-4fe2-97d7-63cbc351afa1 req-2c6ee3c6-357b-402f-8912-2e2c47d9d500 service nova] Creating event network-vif-plugged:50027e8e-2348-48a4-92ab-d7e071762905 for instance a924b75f-2e0c-4b96-91db-d9e415a8d092 on nch2-master-1 May 21 22:02:22.560926 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-b5e78723-ec36-4fe2-97d7-63cbc351afa1 req-2c6ee3c6-357b-402f-8912-2e2c47d9d500 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031147 May 21 22:02:22.561448 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3396/6663] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:02:23.221810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ffdba683-4f97-45e6-8b87-90a7d2047d78 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:23.222439 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ffdba683-4f97-45e6-8b87-90a7d2047d78 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:23.229602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffdba683-4f97-45e6-8b87-90a7d2047d78 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:23.230064 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffdba683-4f97-45e6-8b87-90a7d2047d78 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:23.230849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffdba683-4f97-45e6-8b87-90a7d2047d78 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:23.231296 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffdba683-4f97-45e6-8b87-90a7d2047d78 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:23.378730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ffdba683-4f97-45e6-8b87-90a7d2047d78 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:23.386446 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ffdba683-4f97-45e6-8b87-90a7d2047d78 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1363 microversion: 2.1 time: 0.168524 May 21 22:02:23.387018 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3268/6664] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:23 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:24.406652 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6d1c9f3d-e3ee-4ea3-8ae7-5e7d26a1c4cc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:24.407902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6d1c9f3d-e3ee-4ea3-8ae7-5e7d26a1c4cc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:24.414931 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d1c9f3d-e3ee-4ea3-8ae7-5e7d26a1c4cc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:24.415403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d1c9f3d-e3ee-4ea3-8ae7-5e7d26a1c4cc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:24.416195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d1c9f3d-e3ee-4ea3-8ae7-5e7d26a1c4cc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:24.416678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6d1c9f3d-e3ee-4ea3-8ae7-5e7d26a1c4cc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:24.559688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6d1c9f3d-e3ee-4ea3-8ae7-5e7d26a1c4cc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:24.568310 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6d1c9f3d-e3ee-4ea3-8ae7-5e7d26a1c4cc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1549 microversion: 2.1 time: 0.167820 May 21 22:02:24.568886 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3397/6665] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:24 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:24.585190 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d5bb11c3-493b-4f49-9e0f-5ceddde433c9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:24.585687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d5bb11c3-493b-4f49-9e0f-5ceddde433c9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:24.592574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5bb11c3-493b-4f49-9e0f-5ceddde433c9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:24.593040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5bb11c3-493b-4f49-9e0f-5ceddde433c9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:24.593823 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5bb11c3-493b-4f49-9e0f-5ceddde433c9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:24.594270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d5bb11c3-493b-4f49-9e0f-5ceddde433c9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:24.684045 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d5bb11c3-493b-4f49-9e0f-5ceddde433c9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099449 May 21 22:02:24.684045 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3269/6666] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 22:02:24 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:02:25.893382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-6c9cc6ff-174c-4135-afa6-d87571dc42a8 req-d6d4376b-0274-4248-a879-7e091465b6bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a924b75f-2e0c-4b96-91db-d9e415a8d092", "tag": "50027e8e-2348-48a4-92ab-d7e071762905"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:02:25.903370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6c9cc6ff-174c-4135-afa6-d87571dc42a8 req-d6d4376b-0274-4248-a879-7e091465b6bf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:25.903827 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6c9cc6ff-174c-4135-afa6-d87571dc42a8 req-d6d4376b-0274-4248-a879-7e091465b6bf service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:25.916333 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-6c9cc6ff-174c-4135-afa6-d87571dc42a8 req-d6d4376b-0274-4248-a879-7e091465b6bf service nova] Creating event network-changed:50027e8e-2348-48a4-92ab-d7e071762905 for instance a924b75f-2e0c-4b96-91db-d9e415a8d092 on nch2-master-1 May 21 22:02:25.923372 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-6c9cc6ff-174c-4135-afa6-d87571dc42a8 req-d6d4376b-0274-4248-a879-7e091465b6bf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033349 May 21 22:02:25.923372 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3398/6667] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:02:55.646749 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:02:55.647570 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=25 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:02:55.652874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-14a33811-2499-41fd-a916-691fae38bf6e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:02:55.660413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14a33811-2499-41fd-a916-691fae38bf6e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:55.660881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14a33811-2499-41fd-a916-691fae38bf6e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:55.687835 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-14a33811-2499-41fd-a916-691fae38bf6e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Going to try to stop instance {{(pid=131278) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 21 22:02:55.849371 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-14a33811-2499-41fd-a916-691fae38bf6e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "POST /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092/action" status: 202 len: 0 microversion: 2.1 time: 0.204946 May 21 22:02:55.850023 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3270/6668] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:02:55 2022] POST /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:02:55.856822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=9 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:02:55.857611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=28 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:02:55.861873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-98fb1c07-5679-4973-922d-e5cbef6fa54c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:55.862630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-98fb1c07-5679-4973-922d-e5cbef6fa54c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:55.868870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98fb1c07-5679-4973-922d-e5cbef6fa54c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:55.869338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98fb1c07-5679-4973-922d-e5cbef6fa54c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:55.870128 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98fb1c07-5679-4973-922d-e5cbef6fa54c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:55.870583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98fb1c07-5679-4973-922d-e5cbef6fa54c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:56.023440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-98fb1c07-5679-4973-922d-e5cbef6fa54c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:56.034816 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-98fb1c07-5679-4973-922d-e5cbef6fa54c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1678 microversion: 2.1 time: 0.180160 May 21 22:02:56.036785 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3399/6669] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:55 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:57.054809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-82d227c2-0a79-4257-9120-829d67d5a408 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:57.055672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-82d227c2-0a79-4257-9120-829d67d5a408 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:57.061933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-82d227c2-0a79-4257-9120-829d67d5a408 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:57.062379 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-82d227c2-0a79-4257-9120-829d67d5a408 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:57.063155 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-82d227c2-0a79-4257-9120-829d67d5a408 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:57.065971 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-82d227c2-0a79-4257-9120-829d67d5a408 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:57.212061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-82d227c2-0a79-4257-9120-829d67d5a408 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:57.220355 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-82d227c2-0a79-4257-9120-829d67d5a408 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1678 microversion: 2.1 time: 0.170154 May 21 22:02:57.220929 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3271/6670] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:57 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:58.238694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d8948a9b-a859-4fe5-85c9-9d9522e67902 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:58.249552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d8948a9b-a859-4fe5-85c9-9d9522e67902 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:58.249552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8948a9b-a859-4fe5-85c9-9d9522e67902 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:58.249552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8948a9b-a859-4fe5-85c9-9d9522e67902 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:58.249552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8948a9b-a859-4fe5-85c9-9d9522e67902 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:58.249552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8948a9b-a859-4fe5-85c9-9d9522e67902 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:58.392242 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d8948a9b-a859-4fe5-85c9-9d9522e67902 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:58.397510 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d8948a9b-a859-4fe5-85c9-9d9522e67902 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1678 microversion: 2.1 time: 0.163641 May 21 22:02:58.398087 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3400/6671] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:58 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:02:59.415005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-10e41ac2-692b-4818-a767-fb7e214a2a47 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:02:59.415625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-10e41ac2-692b-4818-a767-fb7e214a2a47 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:02:59.423229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-10e41ac2-692b-4818-a767-fb7e214a2a47 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:59.423751 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-10e41ac2-692b-4818-a767-fb7e214a2a47 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:59.424555 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-10e41ac2-692b-4818-a767-fb7e214a2a47 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:02:59.424998 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-10e41ac2-692b-4818-a767-fb7e214a2a47 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:02:59.565883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-10e41ac2-692b-4818-a767-fb7e214a2a47 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:02:59.573556 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-10e41ac2-692b-4818-a767-fb7e214a2a47 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1678 microversion: 2.1 time: 0.162516 May 21 22:02:59.574138 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3272/6672] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:02:59 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:00.589963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0e24df51-10c0-4244-b5ba-238425b9d2f2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:00.590598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0e24df51-10c0-4244-b5ba-238425b9d2f2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:00.598110 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e24df51-10c0-4244-b5ba-238425b9d2f2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:00.598583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e24df51-10c0-4244-b5ba-238425b9d2f2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:00.599370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e24df51-10c0-4244-b5ba-238425b9d2f2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:00.599831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e24df51-10c0-4244-b5ba-238425b9d2f2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:00.744600 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0e24df51-10c0-4244-b5ba-238425b9d2f2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:00.753060 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0e24df51-10c0-4244-b5ba-238425b9d2f2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1678 microversion: 2.1 time: 0.167051 May 21 22:03:00.753652 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3401/6673] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:00 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:01.770309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d25c231e-82cd-4ea1-b53a-3da0a99cf24f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:01.770926 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d25c231e-82cd-4ea1-b53a-3da0a99cf24f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:01.778168 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d25c231e-82cd-4ea1-b53a-3da0a99cf24f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:01.778655 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d25c231e-82cd-4ea1-b53a-3da0a99cf24f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:01.779438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d25c231e-82cd-4ea1-b53a-3da0a99cf24f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:01.779887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d25c231e-82cd-4ea1-b53a-3da0a99cf24f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:01.928899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d25c231e-82cd-4ea1-b53a-3da0a99cf24f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:01.936534 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d25c231e-82cd-4ea1-b53a-3da0a99cf24f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1678 microversion: 2.1 time: 0.170667 May 21 22:03:01.937050 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3273/6674] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:01 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:02.955175 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d1fb7622-d43f-4a99-9990-d998cbf966b9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:02.955740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d1fb7622-d43f-4a99-9990-d998cbf966b9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:02.963836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d1fb7622-d43f-4a99-9990-d998cbf966b9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:02.964355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d1fb7622-d43f-4a99-9990-d998cbf966b9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:02.965157 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d1fb7622-d43f-4a99-9990-d998cbf966b9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:02.965621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d1fb7622-d43f-4a99-9990-d998cbf966b9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:03.111455 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d1fb7622-d43f-4a99-9990-d998cbf966b9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:03.119181 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d1fb7622-d43f-4a99-9990-d998cbf966b9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1678 microversion: 2.1 time: 0.168478 May 21 22:03:03.119765 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3402/6675] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:02 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:04.136336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2f04ca2d-8f2c-4c14-b2aa-e41049fe3c39 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:04.136960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2f04ca2d-8f2c-4c14-b2aa-e41049fe3c39 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:04.144008 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f04ca2d-8f2c-4c14-b2aa-e41049fe3c39 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:04.144500 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f04ca2d-8f2c-4c14-b2aa-e41049fe3c39 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:04.145267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f04ca2d-8f2c-4c14-b2aa-e41049fe3c39 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:04.145715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2f04ca2d-8f2c-4c14-b2aa-e41049fe3c39 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:04.290514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2f04ca2d-8f2c-4c14-b2aa-e41049fe3c39 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:04.298826 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2f04ca2d-8f2c-4c14-b2aa-e41049fe3c39 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1678 microversion: 2.1 time: 0.166519 May 21 22:03:04.306089 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3274/6676] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:04 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:05.316849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e6716601-b30b-4361-87ab-cca6432f5d73 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:05.317479 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e6716601-b30b-4361-87ab-cca6432f5d73 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:05.324559 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6716601-b30b-4361-87ab-cca6432f5d73 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:05.325026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6716601-b30b-4361-87ab-cca6432f5d73 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:05.325807 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6716601-b30b-4361-87ab-cca6432f5d73 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:05.326259 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e6716601-b30b-4361-87ab-cca6432f5d73 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:05.476616 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e6716601-b30b-4361-87ab-cca6432f5d73 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:05.484432 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e6716601-b30b-4361-87ab-cca6432f5d73 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1678 microversion: 2.1 time: 0.172735 May 21 22:03:05.485035 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3403/6677] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:05 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:06.502194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7cb269ad-cca8-4c6f-b38d-3af0f8047c8b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:06.502818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7cb269ad-cca8-4c6f-b38d-3af0f8047c8b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:06.509734 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7cb269ad-cca8-4c6f-b38d-3af0f8047c8b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:06.510190 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7cb269ad-cca8-4c6f-b38d-3af0f8047c8b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:06.510957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7cb269ad-cca8-4c6f-b38d-3af0f8047c8b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:06.511403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7cb269ad-cca8-4c6f-b38d-3af0f8047c8b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:06.658236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7cb269ad-cca8-4c6f-b38d-3af0f8047c8b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:06.666078 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7cb269ad-cca8-4c6f-b38d-3af0f8047c8b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1655 microversion: 2.1 time: 0.167839 May 21 22:03:06.666667 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3275/6678] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:06 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1655 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:06.683033 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-861a7944-5de9-4b71-ad1b-454fad91c61c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:03:06.684036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-861a7944-5de9-4b71-ad1b-454fad91c61c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:06.691542 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-861a7944-5de9-4b71-ad1b-454fad91c61c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:06.692005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-861a7944-5de9-4b71-ad1b-454fad91c61c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:06.692830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-861a7944-5de9-4b71-ad1b-454fad91c61c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:06.693289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-861a7944-5de9-4b71-ad1b-454fad91c61c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:06.721319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-861a7944-5de9-4b71-ad1b-454fad91c61c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:06.727129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-861a7944-5de9-4b71-ad1b-454fad91c61c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Old instance type m1.heat2, new instance type m1.heat {{(pid=131277) resize /opt/stack/nova/nova/compute/api.py:4166}} May 21 22:03:06.733477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-861a7944-5de9-4b71-ad1b-454fad91c61c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:03:06.733917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-861a7944-5de9-4b71-ad1b-454fad91c61c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:03:06.734411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-861a7944-5de9-4b71-ad1b-454fad91c61c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:03:06.734848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-861a7944-5de9-4b71-ad1b-454fad91c61c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:03:06.735280 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-861a7944-5de9-4b71-ad1b-454fad91c61c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:03:06.894202 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-861a7944-5de9-4b71-ad1b-454fad91c61c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "POST /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092/action" status: 202 len: 0 microversion: 2.1 time: 0.215050 May 21 22:03:06.894820 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3404/6679] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:03:06 2022] POST /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:03:06.902933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2eeb136a-a86d-4806-8e99-a5b718e101c1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:06.903704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2eeb136a-a86d-4806-8e99-a5b718e101c1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:06.910716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2eeb136a-a86d-4806-8e99-a5b718e101c1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:06.911175 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2eeb136a-a86d-4806-8e99-a5b718e101c1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:06.911959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2eeb136a-a86d-4806-8e99-a5b718e101c1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:06.912434 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2eeb136a-a86d-4806-8e99-a5b718e101c1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:07.057155 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2eeb136a-a86d-4806-8e99-a5b718e101c1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:07.065444 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2eeb136a-a86d-4806-8e99-a5b718e101c1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1678 microversion: 2.1 time: 0.166417 May 21 22:03:07.069542 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3276/6680] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:06 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:08.084427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-83800e23-4eb9-496c-adb9-e2f74042aae9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:08.085236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-83800e23-4eb9-496c-adb9-e2f74042aae9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:08.091632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-83800e23-4eb9-496c-adb9-e2f74042aae9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:08.092105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-83800e23-4eb9-496c-adb9-e2f74042aae9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:08.092932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-83800e23-4eb9-496c-adb9-e2f74042aae9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:08.093394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-83800e23-4eb9-496c-adb9-e2f74042aae9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:08.243140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-83800e23-4eb9-496c-adb9-e2f74042aae9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:08.251094 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-83800e23-4eb9-496c-adb9-e2f74042aae9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1678 microversion: 2.1 time: 0.172544 May 21 22:03:08.252034 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3405/6681] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:08 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:09.268583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a4dc0d71-8490-4140-bfae-a3931e385661 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:09.269338 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a4dc0d71-8490-4140-bfae-a3931e385661 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:09.276517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4dc0d71-8490-4140-bfae-a3931e385661 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:09.276973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4dc0d71-8490-4140-bfae-a3931e385661 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:09.277745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4dc0d71-8490-4140-bfae-a3931e385661 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:09.278187 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a4dc0d71-8490-4140-bfae-a3931e385661 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:09.509981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a4dc0d71-8490-4140-bfae-a3931e385661 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:09.517627 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a4dc0d71-8490-4140-bfae-a3931e385661 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1678 microversion: 2.1 time: 0.252952 May 21 22:03:09.518253 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3277/6682] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:09 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1678 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:10.534691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6f0e07d9-0937-47fb-9ad1-643ee0e9ec7b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:10.535974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6f0e07d9-0937-47fb-9ad1-643ee0e9ec7b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:10.542968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f0e07d9-0937-47fb-9ad1-643ee0e9ec7b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:10.543429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f0e07d9-0937-47fb-9ad1-643ee0e9ec7b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:10.544209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f0e07d9-0937-47fb-9ad1-643ee0e9ec7b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:10.544691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f0e07d9-0937-47fb-9ad1-643ee0e9ec7b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:10.690466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6f0e07d9-0937-47fb-9ad1-643ee0e9ec7b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:10.698251 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6f0e07d9-0937-47fb-9ad1-643ee0e9ec7b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1683 microversion: 2.1 time: 0.167656 May 21 22:03:10.698820 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3406/6683] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:10 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:11.716299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1f9a347e-1500-4b39-b202-495da392ddce tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:11.716940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1f9a347e-1500-4b39-b202-495da392ddce tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:11.729213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f9a347e-1500-4b39-b202-495da392ddce tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:11.729681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f9a347e-1500-4b39-b202-495da392ddce tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:11.730495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f9a347e-1500-4b39-b202-495da392ddce tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:11.734039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1f9a347e-1500-4b39-b202-495da392ddce tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:11.883859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1f9a347e-1500-4b39-b202-495da392ddce tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:11.891630 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1f9a347e-1500-4b39-b202-495da392ddce tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1683 microversion: 2.1 time: 0.179391 May 21 22:03:11.892608 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3278/6684] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:11 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:12.705159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-ed5c9b84-9e1c-4fd3-8370-1e16ccf1946b req-c8a96825-1f38-4523-9b80-96f241e94f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a924b75f-2e0c-4b96-91db-d9e415a8d092", "name": "network-vif-unplugged", "status": "completed", "tag": "50027e8e-2348-48a4-92ab-d7e071762905"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:03:12.714337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ed5c9b84-9e1c-4fd3-8370-1e16ccf1946b req-c8a96825-1f38-4523-9b80-96f241e94f37 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:12.714820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ed5c9b84-9e1c-4fd3-8370-1e16ccf1946b req-c8a96825-1f38-4523-9b80-96f241e94f37 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:12.730133 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-ed5c9b84-9e1c-4fd3-8370-1e16ccf1946b req-c8a96825-1f38-4523-9b80-96f241e94f37 service nova] Creating event network-vif-unplugged:50027e8e-2348-48a4-92ab-d7e071762905 for instance a924b75f-2e0c-4b96-91db-d9e415a8d092 on nch1-master-1 May 21 22:03:12.735701 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [req-ed5c9b84-9e1c-4fd3-8370-1e16ccf1946b req-c8a96825-1f38-4523-9b80-96f241e94f37 service nova] Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 22:03:12.747342 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-ed5c9b84-9e1c-4fd3-8370-1e16ccf1946b req-c8a96825-1f38-4523-9b80-96f241e94f37 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046547 May 21 22:03:12.747942 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3407/6685] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:03:12.908447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7bc8f957-062b-428c-9949-29b680ea8ddc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:12.909706 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7bc8f957-062b-428c-9949-29b680ea8ddc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:12.918851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7bc8f957-062b-428c-9949-29b680ea8ddc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:12.919401 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7bc8f957-062b-428c-9949-29b680ea8ddc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:12.920201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7bc8f957-062b-428c-9949-29b680ea8ddc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:12.920682 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7bc8f957-062b-428c-9949-29b680ea8ddc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:13.076404 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7bc8f957-062b-428c-9949-29b680ea8ddc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:13.084811 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7bc8f957-062b-428c-9949-29b680ea8ddc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1682 microversion: 2.1 time: 0.180416 May 21 22:03:13.085392 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3279/6686] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:12 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:14.104269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9c29b2b2-89c1-4f89-84fb-99bd5fd700f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:14.105020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9c29b2b2-89c1-4f89-84fb-99bd5fd700f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:14.111370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c29b2b2-89c1-4f89-84fb-99bd5fd700f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:14.111837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c29b2b2-89c1-4f89-84fb-99bd5fd700f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:14.112642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c29b2b2-89c1-4f89-84fb-99bd5fd700f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:14.113094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c29b2b2-89c1-4f89-84fb-99bd5fd700f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:14.259508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9c29b2b2-89c1-4f89-84fb-99bd5fd700f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:14.267936 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9c29b2b2-89c1-4f89-84fb-99bd5fd700f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1682 microversion: 2.1 time: 0.168581 May 21 22:03:14.268545 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3408/6687] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:14 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:14.761894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-0a01207c-83f4-4dc1-a338-63f953e6eef9 req-724e22c0-65f4-42e2-b6de-6a6f95b1d1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a924b75f-2e0c-4b96-91db-d9e415a8d092", "tag": "50027e8e-2348-48a4-92ab-d7e071762905"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:03:14.770996 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0a01207c-83f4-4dc1-a338-63f953e6eef9 req-724e22c0-65f4-42e2-b6de-6a6f95b1d1f9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:14.771440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0a01207c-83f4-4dc1-a338-63f953e6eef9 req-724e22c0-65f4-42e2-b6de-6a6f95b1d1f9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:14.783220 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-0a01207c-83f4-4dc1-a338-63f953e6eef9 req-724e22c0-65f4-42e2-b6de-6a6f95b1d1f9 service nova] Creating event network-changed:50027e8e-2348-48a4-92ab-d7e071762905 for instance a924b75f-2e0c-4b96-91db-d9e415a8d092 on nch1-master-1 May 21 22:03:14.789592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [req-0a01207c-83f4-4dc1-a338-63f953e6eef9 req-724e22c0-65f4-42e2-b6de-6a6f95b1d1f9 service nova] Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 22:03:14.800175 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-0a01207c-83f4-4dc1-a338-63f953e6eef9 req-724e22c0-65f4-42e2-b6de-6a6f95b1d1f9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041986 May 21 22:03:14.802765 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3280/6688] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:03:15.285344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9a0b579f-3d97-4928-aa33-b0195958dc6e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:15.285990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9a0b579f-3d97-4928-aa33-b0195958dc6e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:15.305762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a0b579f-3d97-4928-aa33-b0195958dc6e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:15.312337 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a0b579f-3d97-4928-aa33-b0195958dc6e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:15.313209 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a0b579f-3d97-4928-aa33-b0195958dc6e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:15.313679 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a0b579f-3d97-4928-aa33-b0195958dc6e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:15.548025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9a0b579f-3d97-4928-aa33-b0195958dc6e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:15.557215 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9a0b579f-3d97-4928-aa33-b0195958dc6e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1680 microversion: 2.1 time: 0.275547 May 21 22:03:15.557729 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3409/6689] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:15 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1680 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:16.577097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a65bd733-0605-4711-9013-b2d088675559 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:16.577850 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a65bd733-0605-4711-9013-b2d088675559 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:16.584852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a65bd733-0605-4711-9013-b2d088675559 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:16.585310 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a65bd733-0605-4711-9013-b2d088675559 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:16.586240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a65bd733-0605-4711-9013-b2d088675559 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:16.586687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a65bd733-0605-4711-9013-b2d088675559 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:16.731728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a65bd733-0605-4711-9013-b2d088675559 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:16.739525 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a65bd733-0605-4711-9013-b2d088675559 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1676 microversion: 2.1 time: 0.168027 May 21 22:03:16.740110 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3281/6690] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:16 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:16.756098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d63f0bcf-c779-4da8-9e74-c79afd1d67b6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:03:16.756691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d63f0bcf-c779-4da8-9e74-c79afd1d67b6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:16.764968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d63f0bcf-c779-4da8-9e74-c79afd1d67b6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:16.765439 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d63f0bcf-c779-4da8-9e74-c79afd1d67b6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:16.766633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d63f0bcf-c779-4da8-9e74-c79afd1d67b6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:16.766747 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d63f0bcf-c779-4da8-9e74-c79afd1d67b6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:16.896554 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d63f0bcf-c779-4da8-9e74-c79afd1d67b6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "POST /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092/action" status: 204 len: 0 microversion: 2.1 time: 0.143522 May 21 22:03:16.897333 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3410/6691] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:03:16 2022] POST /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092/action => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:03:16.906501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c4366d08-e691-4f91-9bce-3f8e30b07f38 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:16.907124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c4366d08-e691-4f91-9bce-3f8e30b07f38 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:16.914198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4366d08-e691-4f91-9bce-3f8e30b07f38 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:16.914651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4366d08-e691-4f91-9bce-3f8e30b07f38 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:16.915432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4366d08-e691-4f91-9bce-3f8e30b07f38 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:16.915877 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c4366d08-e691-4f91-9bce-3f8e30b07f38 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:17.483511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c4366d08-e691-4f91-9bce-3f8e30b07f38 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:17.491759 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c4366d08-e691-4f91-9bce-3f8e30b07f38 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1676 microversion: 2.1 time: 0.590224 May 21 22:03:17.501761 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3282/6692] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:16 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1676 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:18.511419 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-23ab73a6-b063-4f6a-9935-4146a2f78aa9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:18.512184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-23ab73a6-b063-4f6a-9935-4146a2f78aa9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:18.518764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23ab73a6-b063-4f6a-9935-4146a2f78aa9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:18.519245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23ab73a6-b063-4f6a-9935-4146a2f78aa9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:18.520043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23ab73a6-b063-4f6a-9935-4146a2f78aa9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:18.520550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-23ab73a6-b063-4f6a-9935-4146a2f78aa9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:18.674440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-23ab73a6-b063-4f6a-9935-4146a2f78aa9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:18.683671 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-23ab73a6-b063-4f6a-9935-4146a2f78aa9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1676 microversion: 2.1 time: 0.177342 May 21 22:03:18.684435 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3411/6693] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:18 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:19.220019 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-738d3b51-c390-4616-9f58-9ad9fffd6a16 req-8b3d33a7-1dd1-424f-8443-ea2bbce2e82e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a924b75f-2e0c-4b96-91db-d9e415a8d092", "name": "network-vif-plugged", "status": "completed", "tag": "50027e8e-2348-48a4-92ab-d7e071762905"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:03:19.229896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-738d3b51-c390-4616-9f58-9ad9fffd6a16 req-8b3d33a7-1dd1-424f-8443-ea2bbce2e82e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:19.230346 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-738d3b51-c390-4616-9f58-9ad9fffd6a16 req-8b3d33a7-1dd1-424f-8443-ea2bbce2e82e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:19.242968 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-738d3b51-c390-4616-9f58-9ad9fffd6a16 req-8b3d33a7-1dd1-424f-8443-ea2bbce2e82e service nova] Creating event network-vif-plugged:50027e8e-2348-48a4-92ab-d7e071762905 for instance a924b75f-2e0c-4b96-91db-d9e415a8d092 on nch1-master-1 May 21 22:03:19.248190 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-738d3b51-c390-4616-9f58-9ad9fffd6a16 req-8b3d33a7-1dd1-424f-8443-ea2bbce2e82e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100046 May 21 22:03:19.249029 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3283/6694] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:03:19.702491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f0a7e460-63fd-4dea-ab35-ca748f107af8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:19.703121 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f0a7e460-63fd-4dea-ab35-ca748f107af8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:19.711271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0a7e460-63fd-4dea-ab35-ca748f107af8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:19.711769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0a7e460-63fd-4dea-ab35-ca748f107af8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:19.712602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0a7e460-63fd-4dea-ab35-ca748f107af8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:19.713064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f0a7e460-63fd-4dea-ab35-ca748f107af8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:19.855677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f0a7e460-63fd-4dea-ab35-ca748f107af8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:19.863408 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f0a7e460-63fd-4dea-ab35-ca748f107af8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1655 microversion: 2.1 time: 0.164904 May 21 22:03:19.863977 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3412/6695] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:19 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1655 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:19.880764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-24011f4f-a986-4e56-ae67-0f8b03765d40 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:19.881666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-24011f4f-a986-4e56-ae67-0f8b03765d40 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:19.888019 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24011f4f-a986-4e56-ae67-0f8b03765d40 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:19.888516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24011f4f-a986-4e56-ae67-0f8b03765d40 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:19.889296 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24011f4f-a986-4e56-ae67-0f8b03765d40 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:19.889746 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24011f4f-a986-4e56-ae67-0f8b03765d40 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:20.031750 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-24011f4f-a986-4e56-ae67-0f8b03765d40 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:20.039515 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-24011f4f-a986-4e56-ae67-0f8b03765d40 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1655 microversion: 2.1 time: 0.163550 May 21 22:03:20.040090 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3284/6696] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:19 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1655 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:20.055353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3f40df84-a366-4bfb-bcfb-10aba653db6f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:03:20.061566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f40df84-a366-4bfb-bcfb-10aba653db6f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:20.062040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f40df84-a366-4bfb-bcfb-10aba653db6f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:20.076322 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:03:20.085522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3f40df84-a366-4bfb-bcfb-10aba653db6f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Going to try to start instance {{(pid=131277) start /opt/stack/nova/nova/compute/api.py:2730}} May 21 22:03:20.247656 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3f40df84-a366-4bfb-bcfb-10aba653db6f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "POST /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092/action" status: 202 len: 0 microversion: 2.1 time: 0.195809 May 21 22:03:20.248185 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3413/6697] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:03:20 2022] POST /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:03:20.260969 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-05e71dac-0c61-4763-a5a8-ae050b4c565e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:20.265922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-05e71dac-0c61-4763-a5a8-ae050b4c565e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:20.268512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05e71dac-0c61-4763-a5a8-ae050b4c565e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:20.268966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05e71dac-0c61-4763-a5a8-ae050b4c565e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:20.269749 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05e71dac-0c61-4763-a5a8-ae050b4c565e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:20.270193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05e71dac-0c61-4763-a5a8-ae050b4c565e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:20.421120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-05e71dac-0c61-4763-a5a8-ae050b4c565e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:20.429774 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-05e71dac-0c61-4763-a5a8-ae050b4c565e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1664 microversion: 2.1 time: 0.172891 May 21 22:03:20.430358 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3285/6698] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:20 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1664 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:21.449485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2bc9fb54-abed-4922-ae38-ecee34965f24 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:21.450206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2bc9fb54-abed-4922-ae38-ecee34965f24 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:21.456709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2bc9fb54-abed-4922-ae38-ecee34965f24 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:21.457186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2bc9fb54-abed-4922-ae38-ecee34965f24 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:21.457972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2bc9fb54-abed-4922-ae38-ecee34965f24 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:21.459056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2bc9fb54-abed-4922-ae38-ecee34965f24 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:21.604563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2bc9fb54-abed-4922-ae38-ecee34965f24 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:21.612174 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2bc9fb54-abed-4922-ae38-ecee34965f24 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1664 microversion: 2.1 time: 0.168305 May 21 22:03:21.612830 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3414/6699] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:21 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1664 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:22.629227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2afed532-af31-4759-ab9f-730ee7a2d081 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:22.629859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2afed532-af31-4759-ab9f-730ee7a2d081 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:22.638084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2afed532-af31-4759-ab9f-730ee7a2d081 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:22.638541 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2afed532-af31-4759-ab9f-730ee7a2d081 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:22.639354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2afed532-af31-4759-ab9f-730ee7a2d081 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:22.639797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2afed532-af31-4759-ab9f-730ee7a2d081 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:22.658631 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:03:22.784130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2afed532-af31-4759-ab9f-730ee7a2d081 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:22.792634 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2afed532-af31-4759-ab9f-730ee7a2d081 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1668 microversion: 2.1 time: 0.167343 May 21 22:03:22.793226 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3286/6700] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:22 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1668 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:22.809528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-27df7f25-eb3c-4869-9218-55fa3e999f78 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:22.810056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-27df7f25-eb3c-4869-9218-55fa3e999f78 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:22.818214 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27df7f25-eb3c-4869-9218-55fa3e999f78 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:22.818766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27df7f25-eb3c-4869-9218-55fa3e999f78 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:22.819563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27df7f25-eb3c-4869-9218-55fa3e999f78 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:22.820018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-27df7f25-eb3c-4869-9218-55fa3e999f78 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:22.845589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-27df7f25-eb3c-4869-9218-55fa3e999f78 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 22:03:23.118877 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-27df7f25-eb3c-4869-9218-55fa3e999f78 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 204 len: 0 microversion: 2.1 time: 0.313056 May 21 22:03:23.119478 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3415/6701] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:03:22 2022] DELETE /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 22:03:23.127643 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6b7806d5-2216-4b3a-b53c-dc11e00f8928 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:23.128367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6b7806d5-2216-4b3a-b53c-dc11e00f8928 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:23.135272 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b7806d5-2216-4b3a-b53c-dc11e00f8928 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:23.135722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b7806d5-2216-4b3a-b53c-dc11e00f8928 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:23.136521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b7806d5-2216-4b3a-b53c-dc11e00f8928 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:23.136961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b7806d5-2216-4b3a-b53c-dc11e00f8928 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:23.285374 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6b7806d5-2216-4b3a-b53c-dc11e00f8928 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:23.294368 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6b7806d5-2216-4b3a-b53c-dc11e00f8928 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1674 microversion: 2.1 time: 0.170549 May 21 22:03:23.294980 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3287/6702] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:23 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:24.312869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c850e44a-667b-46c4-9d45-3f023e4ac6da tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:24.313585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c850e44a-667b-46c4-9d45-3f023e4ac6da tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:24.321374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c850e44a-667b-46c4-9d45-3f023e4ac6da tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:24.321837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c850e44a-667b-46c4-9d45-3f023e4ac6da tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:24.322619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c850e44a-667b-46c4-9d45-3f023e4ac6da tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:24.323066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c850e44a-667b-46c4-9d45-3f023e4ac6da tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:24.517268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c850e44a-667b-46c4-9d45-3f023e4ac6da tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:24.525930 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c850e44a-667b-46c4-9d45-3f023e4ac6da tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1674 microversion: 2.1 time: 0.217383 May 21 22:03:24.526741 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3416/6703] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:24 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1674 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:25.540993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-f2479795-e277-409e-84fd-bba70ffdab9f req-248ecc96-3254-47fc-9e91-b5e51bde4e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a924b75f-2e0c-4b96-91db-d9e415a8d092", "name": "network-vif-deleted", "tag": "50027e8e-2348-48a4-92ab-d7e071762905"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:03:25.544003 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bebfbb8c-5ff8-4685-a212-3637e63cbc43 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:25.556136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bebfbb8c-5ff8-4685-a212-3637e63cbc43 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:25.556272 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f2479795-e277-409e-84fd-bba70ffdab9f req-248ecc96-3254-47fc-9e91-b5e51bde4e00 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:25.556272 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f2479795-e277-409e-84fd-bba70ffdab9f req-248ecc96-3254-47fc-9e91-b5e51bde4e00 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:25.556470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bebfbb8c-5ff8-4685-a212-3637e63cbc43 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:25.556470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bebfbb8c-5ff8-4685-a212-3637e63cbc43 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:25.556470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bebfbb8c-5ff8-4685-a212-3637e63cbc43 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:25.556470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bebfbb8c-5ff8-4685-a212-3637e63cbc43 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:25.565354 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-f2479795-e277-409e-84fd-bba70ffdab9f req-248ecc96-3254-47fc-9e91-b5e51bde4e00 service nova] Creating event network-vif-deleted:50027e8e-2348-48a4-92ab-d7e071762905 for instance a924b75f-2e0c-4b96-91db-d9e415a8d092 on nch1-master-1 May 21 22:03:25.570843 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-f2479795-e277-409e-84fd-bba70ffdab9f req-248ecc96-3254-47fc-9e91-b5e51bde4e00 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036014 May 21 22:03:25.571685 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3288/6704] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:03:25.642438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bebfbb8c-5ff8-4685-a212-3637e63cbc43 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:25.649008 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bebfbb8c-5ff8-4685-a212-3637e63cbc43 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1607 microversion: 2.1 time: 0.108966 May 21 22:03:25.649601 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3417/6705] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:25 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1607 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:26.674347 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3cf7059f-af15-4919-b517-cf9f1e308d82 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:26.678258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3cf7059f-af15-4919-b517-cf9f1e308d82 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:26.687629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=39 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:03:26.692536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cf7059f-af15-4919-b517-cf9f1e308d82 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:26.692536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cf7059f-af15-4919-b517-cf9f1e308d82 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:26.693428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cf7059f-af15-4919-b517-cf9f1e308d82 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:26.693873 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cf7059f-af15-4919-b517-cf9f1e308d82 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:26.727560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cf7059f-af15-4919-b517-cf9f1e308d82 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:26.728012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cf7059f-af15-4919-b517-cf9f1e308d82 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:26.728671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-3cf7059f-af15-4919-b517-cf9f1e308d82 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lazy-loading 'fault' on Instance uuid a924b75f-2e0c-4b96-91db-d9e415a8d092 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 22:03:26.780492 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3cf7059f-af15-4919-b517-cf9f1e308d82 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:26.788056 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3cf7059f-af15-4919-b517-cf9f1e308d82 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 200 len: 1328 microversion: 2.1 time: 0.124250 May 21 22:03:26.788664 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3289/6706] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:26 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 1328 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:27.504472 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:03:27.505506 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 22:03:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:03:27.805849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2f35afbe-32b9-4346-859d-e811f8f7744c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:27.806403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2f35afbe-32b9-4346-859d-e811f8f7744c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:27.808936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:03:27.813849 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f35afbe-32b9-4346-859d-e811f8f7744c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:27.814588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f35afbe-32b9-4346-859d-e811f8f7744c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:27.815375 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f35afbe-32b9-4346-859d-e811f8f7744c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:27.815832 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2f35afbe-32b9-4346-859d-e811f8f7744c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:27.829905 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-2f35afbe-32b9-4346-859d-e811f8f7744c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] HTTP exception thrown: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2f35afbe-32b9-4346-859d-e811f8f7744c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Request method failure captured: May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 HTTP/1.1 May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiWEqg4H5ib8lBeBY5hWnlzTjb_0SYMAu1PXPchB7RzXjO9Fc2uRmCYI6YXq0eyS1H44OjCoLWXG04d9ut0CknArKFnB7d8KFC2oZLDhogrvccuHSLlGl5ORpF14bspFXBZezQCKhKDgRiiLFY_0g2s6h-a-kpGbnJaHmPkp_ile5A_0 May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb9f2d0a8dca4c85a47c2d138d1b39cd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerActionsTestJSON-532218768 May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerActionsTestJSON-532218768-project May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 1fd1bb72fc464808988a1579524c7939 May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerActionsTestJSON-532218768-project May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'a924b75f-2e0c-4b96-91db-d9e415a8d092'} May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:03:27.831564 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:03:27.835984 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:03:27.835984 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:03:27.835984 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:03:27.835984 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:03:27.835984 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:03:27.835984 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. May 21 22:03:27.835984 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:03:27.835984 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2f35afbe-32b9-4346-859d-e811f8f7744c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Returning 404 to user: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:03:27.835984 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2f35afbe-32b9-4346-859d-e811f8f7744c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 404 len: 111 microversion: 2.1 time: 0.031831 May 21 22:03:27.835984 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3418/6707] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:27 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:03:27.850085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0fef8b43-fc5a-413d-8941-0e831491163a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:27.850702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0fef8b43-fc5a-413d-8941-0e831491163a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:27.857816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fef8b43-fc5a-413d-8941-0e831491163a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:27.858264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fef8b43-fc5a-413d-8941-0e831491163a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:27.859029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fef8b43-fc5a-413d-8941-0e831491163a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:27.859467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0fef8b43-fc5a-413d-8941-0e831491163a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:27.873225 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-0fef8b43-fc5a-413d-8941-0e831491163a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] HTTP exception thrown: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0fef8b43-fc5a-413d-8941-0e831491163a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Request method failure captured: May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 HTTP/1.1 May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWEqg4H5ib8lBeBY5hWnlzTjb_0SYMAu1PXPchB7RzXjO9Fc2uRmCYI6YXq0eyS1H44OjCoLWXG04d9ut0CknArKFnB7d8KFC2oZLDhogrvccuHSLlGl5ORpF14bspFXBZezQCKhKDgRiiLFY_0g2s6h-a-kpGbnJaHmPkp_ile5A_0 May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb9f2d0a8dca4c85a47c2d138d1b39cd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerActionsTestJSON-532218768 May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerActionsTestJSON-532218768-project May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1fd1bb72fc464808988a1579524c7939 May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerActionsTestJSON-532218768-project May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'a924b75f-2e0c-4b96-91db-d9e415a8d092'} May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:03:27.874875 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:03:27.878742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:03:27.878742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:03:27.878742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:03:27.878742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:03:27.878742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:03:27.878742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. May 21 22:03:27.878742 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:03:27.878742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0fef8b43-fc5a-413d-8941-0e831491163a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Returning 404 to user: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:03:27.878742 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0fef8b43-fc5a-413d-8941-0e831491163a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 404 len: 111 microversion: 2.1 time: 0.030097 May 21 22:03:27.878742 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3290/6708] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:27 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:03:27.930278 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ef006ae8-def3-4526-ba25-24a6d41157f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2033443226", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "3293c92c-e4b2-4bbe-993a-802603a2deb4"}], "security_groups": [{"name": "tempest-securitygroup--889871437"}], "key_name": "tempest-keypair-937962467", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:03:28.053794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-ef006ae8-def3-4526-ba25-24a6d41157f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] validate_networks() for [('3293c92c-e4b2-4bbe-993a-802603a2deb4', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 22:03:28.550007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ef006ae8-def3-4526-ba25-24a6d41157f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:03:28.550578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ef006ae8-def3-4526-ba25-24a6d41157f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:03:28.550971 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ef006ae8-def3-4526-ba25-24a6d41157f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:03:28.551400 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ef006ae8-def3-4526-ba25-24a6d41157f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:03:28.552088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ef006ae8-def3-4526-ba25-24a6d41157f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:03:28.561527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef006ae8-def3-4526-ba25-24a6d41157f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:28.562026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef006ae8-def3-4526-ba25-24a6d41157f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:28.568773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef006ae8-def3-4526-ba25-24a6d41157f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:28.568773 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ef006ae8-def3-4526-ba25-24a6d41157f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:28.580986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ef006ae8-def3-4526-ba25-24a6d41157f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Getting quotas for project cb9f2d0a8dca4c85a47c2d138d1b39cd. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:03:28.587013 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-ef006ae8-def3-4526-ba25-24a6d41157f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Getting quotas for user 1fd1bb72fc464808988a1579524c7939 and project cb9f2d0a8dca4c85a47c2d138d1b39cd. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:03:28.600627 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ef006ae8-def3-4526-ba25-24a6d41157f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 22:03:28.602972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ef006ae8-def3-4526-ba25-24a6d41157f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 22:03:28.732990 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ef006ae8-def3-4526-ba25-24a6d41157f6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.807061 May 21 22:03:28.733542 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3419/6709] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 22:03:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 21 22:03:28.743708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b18b867e-f6b6-4f80-bcd3-3bb078cc13fd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:28.744504 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b18b867e-f6b6-4f80-bcd3-3bb078cc13fd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:28.803425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b18b867e-f6b6-4f80-bcd3-3bb078cc13fd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:28.810502 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b18b867e-f6b6-4f80-bcd3-3bb078cc13fd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1238 microversion: 2.1 time: 0.070722 May 21 22:03:28.814287 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3291/6710] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:28 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:29.829529 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9c6c6341-d11b-4268-b7a3-6575e331c313 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:29.830168 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9c6c6341-d11b-4268-b7a3-6575e331c313 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:29.840610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c6c6341-d11b-4268-b7a3-6575e331c313 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:29.844068 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c6c6341-d11b-4268-b7a3-6575e331c313 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:29.844068 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c6c6341-d11b-4268-b7a3-6575e331c313 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:29.844068 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c6c6341-d11b-4268-b7a3-6575e331c313 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:29.908191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9c6c6341-d11b-4268-b7a3-6575e331c313 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:29.916816 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9c6c6341-d11b-4268-b7a3-6575e331c313 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1242 microversion: 2.1 time: 0.092134 May 21 22:03:29.924423 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3420/6711] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:29 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:30.935150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-24c611d8-47ef-4899-af19-067d9b16a713 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:30.935779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-24c611d8-47ef-4899-af19-067d9b16a713 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:30.944882 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24c611d8-47ef-4899-af19-067d9b16a713 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:30.949630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24c611d8-47ef-4899-af19-067d9b16a713 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:30.949630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24c611d8-47ef-4899-af19-067d9b16a713 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:30.949630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-24c611d8-47ef-4899-af19-067d9b16a713 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:31.014286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-24c611d8-47ef-4899-af19-067d9b16a713 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:31.023351 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-24c611d8-47ef-4899-af19-067d9b16a713 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1296 microversion: 2.1 time: 0.092271 May 21 22:03:31.023934 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3292/6712] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:30 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:03:32.044645 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6fe0ccfe-1a26-40d7-95b3-d56608245a31 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:32.045319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6fe0ccfe-1a26-40d7-95b3-d56608245a31 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:32.053427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6fe0ccfe-1a26-40d7-95b3-d56608245a31 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:32.053904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6fe0ccfe-1a26-40d7-95b3-d56608245a31 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:32.054700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6fe0ccfe-1a26-40d7-95b3-d56608245a31 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:32.055163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6fe0ccfe-1a26-40d7-95b3-d56608245a31 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:32.294509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6fe0ccfe-1a26-40d7-95b3-d56608245a31 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:32.302594 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6fe0ccfe-1a26-40d7-95b3-d56608245a31 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1363 microversion: 2.1 time: 0.261916 May 21 22:03:32.303393 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3421/6713] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:32 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:32.513192 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-59746af0-e4ca-4750-a65e-79b551db2cf5 req-9def67bf-1b1a-4b05-aa53-e5cb7a412e13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27a14db0-90ed-4356-aa6e-d9c46b27f98b", "tag": "4a2f0762-44b8-4bf7-9be2-01a8d07dc61e"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:03:32.527652 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-59746af0-e4ca-4750-a65e-79b551db2cf5 req-9def67bf-1b1a-4b05-aa53-e5cb7a412e13 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:32.528107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-59746af0-e4ca-4750-a65e-79b551db2cf5 req-9def67bf-1b1a-4b05-aa53-e5cb7a412e13 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:32.540516 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-59746af0-e4ca-4750-a65e-79b551db2cf5 req-9def67bf-1b1a-4b05-aa53-e5cb7a412e13 service nova] Creating event network-changed:4a2f0762-44b8-4bf7-9be2-01a8d07dc61e for instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b on nch1-master-1 May 21 22:03:32.545338 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-59746af0-e4ca-4750-a65e-79b551db2cf5 req-9def67bf-1b1a-4b05-aa53-e5cb7a412e13 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036026 May 21 22:03:32.545977 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3293/6714] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:03:33.321258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8b57c89d-eca0-45e8-9bc3-cd56dc6fda99 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:33.321818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8b57c89d-eca0-45e8-9bc3-cd56dc6fda99 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:33.329200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b57c89d-eca0-45e8-9bc3-cd56dc6fda99 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:33.329678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b57c89d-eca0-45e8-9bc3-cd56dc6fda99 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:33.330485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b57c89d-eca0-45e8-9bc3-cd56dc6fda99 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:33.330963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8b57c89d-eca0-45e8-9bc3-cd56dc6fda99 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:33.478761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8b57c89d-eca0-45e8-9bc3-cd56dc6fda99 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:33.486577 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8b57c89d-eca0-45e8-9bc3-cd56dc6fda99 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1363 microversion: 2.1 time: 0.170034 May 21 22:03:33.487147 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3422/6715] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:33 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:34.505742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-675fdf8c-e74d-445c-b5f3-1cf9bedc2eb8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:34.506453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-675fdf8c-e74d-445c-b5f3-1cf9bedc2eb8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:34.512996 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-675fdf8c-e74d-445c-b5f3-1cf9bedc2eb8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:34.513457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-675fdf8c-e74d-445c-b5f3-1cf9bedc2eb8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:34.514256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-675fdf8c-e74d-445c-b5f3-1cf9bedc2eb8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:34.514708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-675fdf8c-e74d-445c-b5f3-1cf9bedc2eb8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:34.664864 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-675fdf8c-e74d-445c-b5f3-1cf9bedc2eb8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:34.672757 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-675fdf8c-e74d-445c-b5f3-1cf9bedc2eb8 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1363 microversion: 2.1 time: 0.172245 May 21 22:03:34.673374 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3294/6716] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:34 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:35.690654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-662c4826-3faa-4bc1-a590-af8da3e89388 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:35.691286 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-662c4826-3faa-4bc1-a590-af8da3e89388 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:35.698639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-662c4826-3faa-4bc1-a590-af8da3e89388 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:35.699081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-662c4826-3faa-4bc1-a590-af8da3e89388 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:35.699885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-662c4826-3faa-4bc1-a590-af8da3e89388 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:35.700374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-662c4826-3faa-4bc1-a590-af8da3e89388 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:35.844536 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-662c4826-3faa-4bc1-a590-af8da3e89388 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:35.852739 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-662c4826-3faa-4bc1-a590-af8da3e89388 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1363 microversion: 2.1 time: 0.166434 May 21 22:03:35.853413 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3423/6717] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:35 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:36.869985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e146602d-6594-4af6-a7f1-cf1c26429a24 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:36.870615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e146602d-6594-4af6-a7f1-cf1c26429a24 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:36.877709 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e146602d-6594-4af6-a7f1-cf1c26429a24 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:36.878177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e146602d-6594-4af6-a7f1-cf1c26429a24 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:36.878959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e146602d-6594-4af6-a7f1-cf1c26429a24 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:36.879409 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e146602d-6594-4af6-a7f1-cf1c26429a24 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:37.019294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e146602d-6594-4af6-a7f1-cf1c26429a24 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:37.027255 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e146602d-6594-4af6-a7f1-cf1c26429a24 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1363 microversion: 2.1 time: 0.161154 May 21 22:03:37.027840 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3295/6718] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:36 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:38.045565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-399d58b0-105d-44d6-9c91-38fae8a86a31 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:38.046218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-399d58b0-105d-44d6-9c91-38fae8a86a31 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:38.053868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-399d58b0-105d-44d6-9c91-38fae8a86a31 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:38.054340 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-399d58b0-105d-44d6-9c91-38fae8a86a31 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:38.055159 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-399d58b0-105d-44d6-9c91-38fae8a86a31 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:38.055612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-399d58b0-105d-44d6-9c91-38fae8a86a31 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:38.201274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-399d58b0-105d-44d6-9c91-38fae8a86a31 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:38.209354 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-399d58b0-105d-44d6-9c91-38fae8a86a31 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1363 microversion: 2.1 time: 0.167722 May 21 22:03:38.209921 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3424/6719] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:38 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:39.227642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9640be8c-b043-457a-93c3-4ae81b775fc1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:39.228272 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9640be8c-b043-457a-93c3-4ae81b775fc1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:39.231360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:03:39.236755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9640be8c-b043-457a-93c3-4ae81b775fc1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:39.237216 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9640be8c-b043-457a-93c3-4ae81b775fc1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:39.238006 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9640be8c-b043-457a-93c3-4ae81b775fc1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:39.238449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9640be8c-b043-457a-93c3-4ae81b775fc1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:39.269776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-07380006-010c-4864-b5dd-765abaa51979 req-7bf8ec72-c94b-4827-a1f0-4e9e654b9679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27a14db0-90ed-4356-aa6e-d9c46b27f98b", "name": "network-vif-plugged", "status": "completed", "tag": "4a2f0762-44b8-4bf7-9be2-01a8d07dc61e"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:03:39.274264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:03:39.275153 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:03:39.281790 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-07380006-010c-4864-b5dd-765abaa51979 req-7bf8ec72-c94b-4827-a1f0-4e9e654b9679 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:39.282273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-07380006-010c-4864-b5dd-765abaa51979 req-7bf8ec72-c94b-4827-a1f0-4e9e654b9679 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:39.297773 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-07380006-010c-4864-b5dd-765abaa51979 req-7bf8ec72-c94b-4827-a1f0-4e9e654b9679 service nova] Creating event network-vif-plugged:4a2f0762-44b8-4bf7-9be2-01a8d07dc61e for instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b on nch1-master-1 May 21 22:03:39.300158 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-07380006-010c-4864-b5dd-765abaa51979 req-7bf8ec72-c94b-4827-a1f0-4e9e654b9679 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034812 May 21 22:03:39.300864 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3425/6720] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:03:39.395926 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9640be8c-b043-457a-93c3-4ae81b775fc1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:39.405137 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9640be8c-b043-457a-93c3-4ae81b775fc1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1363 microversion: 2.1 time: 0.182178 May 21 22:03:39.406459 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3296/6721] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:39 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:40.428307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4cd44db8-7369-46ca-8e45-163e662f3f19 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:40.429051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4cd44db8-7369-46ca-8e45-163e662f3f19 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:40.436201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cd44db8-7369-46ca-8e45-163e662f3f19 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:40.437992 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cd44db8-7369-46ca-8e45-163e662f3f19 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:40.437992 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cd44db8-7369-46ca-8e45-163e662f3f19 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:40.437992 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4cd44db8-7369-46ca-8e45-163e662f3f19 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:40.600434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4cd44db8-7369-46ca-8e45-163e662f3f19 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:40.609013 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4cd44db8-7369-46ca-8e45-163e662f3f19 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1363 microversion: 2.1 time: 0.188090 May 21 22:03:40.611974 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3426/6722] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:40 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:41.629870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-855c486b-2b8a-41e2-8020-2911e1a7f8cf tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:41.631026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-855c486b-2b8a-41e2-8020-2911e1a7f8cf tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:41.638577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-855c486b-2b8a-41e2-8020-2911e1a7f8cf tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:41.639028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-855c486b-2b8a-41e2-8020-2911e1a7f8cf tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:41.639793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-855c486b-2b8a-41e2-8020-2911e1a7f8cf tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:41.640229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-855c486b-2b8a-41e2-8020-2911e1a7f8cf tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:41.788717 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-855c486b-2b8a-41e2-8020-2911e1a7f8cf tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:03:41.796362 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-855c486b-2b8a-41e2-8020-2911e1a7f8cf tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1549 microversion: 2.1 time: 0.171012 May 21 22:03:41.796939 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3297/6723] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:03:41 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:03:41.813624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b374072e-a685-47eb-92ef-ede69dd9ff54 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:03:41.814488 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b374072e-a685-47eb-92ef-ede69dd9ff54 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:03:41.822052 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b374072e-a685-47eb-92ef-ede69dd9ff54 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:41.822519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b374072e-a685-47eb-92ef-ede69dd9ff54 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:41.823297 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b374072e-a685-47eb-92ef-ede69dd9ff54 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:41.823751 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b374072e-a685-47eb-92ef-ede69dd9ff54 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:41.913857 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b374072e-a685-47eb-92ef-ede69dd9ff54 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103994 May 21 22:03:41.914448 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3427/6724] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 22:03:41 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:03:43.428951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-dc47764e-621e-47f2-87ff-127d934eec7c req-0be9cef2-a6ee-499c-8ec1-7f88cb2afe06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27a14db0-90ed-4356-aa6e-d9c46b27f98b", "tag": "4a2f0762-44b8-4bf7-9be2-01a8d07dc61e"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:03:43.438230 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-dc47764e-621e-47f2-87ff-127d934eec7c req-0be9cef2-a6ee-499c-8ec1-7f88cb2afe06 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:03:43.438763 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-dc47764e-621e-47f2-87ff-127d934eec7c req-0be9cef2-a6ee-499c-8ec1-7f88cb2afe06 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:03:43.454089 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-dc47764e-621e-47f2-87ff-127d934eec7c req-0be9cef2-a6ee-499c-8ec1-7f88cb2afe06 service nova] Creating event network-changed:4a2f0762-44b8-4bf7-9be2-01a8d07dc61e for instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b on nch1-master-1 May 21 22:03:43.459452 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-dc47764e-621e-47f2-87ff-127d934eec7c req-0be9cef2-a6ee-499c-8ec1-7f88cb2afe06 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034588 May 21 22:03:43.460082 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3298/6725] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:04:20.544979 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:04:20.545769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:04:20.549793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-598f5d4f-a29c-400b-86de-729ed83ef93a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:04:20.550779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-598f5d4f-a29c-400b-86de-729ed83ef93a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:20.557848 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-598f5d4f-a29c-400b-86de-729ed83ef93a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:20.559841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-598f5d4f-a29c-400b-86de-729ed83ef93a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:20.559841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-598f5d4f-a29c-400b-86de-729ed83ef93a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:20.559841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-598f5d4f-a29c-400b-86de-729ed83ef93a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:20.588676 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-598f5d4f-a29c-400b-86de-729ed83ef93a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:20.594514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-598f5d4f-a29c-400b-86de-729ed83ef93a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Old instance type m1.heat2, new instance type m1.heat {{(pid=131277) resize /opt/stack/nova/nova/compute/api.py:4166}} May 21 22:04:20.601339 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-598f5d4f-a29c-400b-86de-729ed83ef93a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:04:20.601778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-598f5d4f-a29c-400b-86de-729ed83ef93a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:04:20.602271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-598f5d4f-a29c-400b-86de-729ed83ef93a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:04:20.602700 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-598f5d4f-a29c-400b-86de-729ed83ef93a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:04:20.603126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-598f5d4f-a29c-400b-86de-729ed83ef93a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:04:20.745367 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-598f5d4f-a29c-400b-86de-729ed83ef93a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "POST /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b/action" status: 202 len: 0 microversion: 2.1 time: 0.202464 May 21 22:04:20.746064 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3428/6726] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:04:20 2022] POST /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:04:20.755054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-980ee489-5d75-45e9-a01e-5ef31b7fa33d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:20.755898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-980ee489-5d75-45e9-a01e-5ef31b7fa33d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:20.759819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=23 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:04:20.760620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=54 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:04:20.764465 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-980ee489-5d75-45e9-a01e-5ef31b7fa33d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:20.764929 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-980ee489-5d75-45e9-a01e-5ef31b7fa33d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:20.765742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-980ee489-5d75-45e9-a01e-5ef31b7fa33d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:20.766181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-980ee489-5d75-45e9-a01e-5ef31b7fa33d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:20.911947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-980ee489-5d75-45e9-a01e-5ef31b7fa33d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:20.920508 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-980ee489-5d75-45e9-a01e-5ef31b7fa33d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1677 microversion: 2.1 time: 0.170036 May 21 22:04:20.921457 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3299/6727] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:20 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:21.938484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-25fa15b1-43fb-42e6-960f-f623f27ccd00 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:21.939366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-25fa15b1-43fb-42e6-960f-f623f27ccd00 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:21.947409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-25fa15b1-43fb-42e6-960f-f623f27ccd00 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:21.947884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-25fa15b1-43fb-42e6-960f-f623f27ccd00 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:21.948731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-25fa15b1-43fb-42e6-960f-f623f27ccd00 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:21.949191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-25fa15b1-43fb-42e6-960f-f623f27ccd00 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:22.097044 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-25fa15b1-43fb-42e6-960f-f623f27ccd00 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:22.104894 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-25fa15b1-43fb-42e6-960f-f623f27ccd00 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1677 microversion: 2.1 time: 0.170494 May 21 22:04:22.105471 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3429/6728] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:21 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:23.122949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6f3e1fac-c309-4050-9b19-d75e4734125a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:23.124017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6f3e1fac-c309-4050-9b19-d75e4734125a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:23.130879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f3e1fac-c309-4050-9b19-d75e4734125a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:23.131343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f3e1fac-c309-4050-9b19-d75e4734125a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:23.132317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f3e1fac-c309-4050-9b19-d75e4734125a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:23.132757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6f3e1fac-c309-4050-9b19-d75e4734125a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:23.285206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6f3e1fac-c309-4050-9b19-d75e4734125a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:23.293733 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6f3e1fac-c309-4050-9b19-d75e4734125a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1677 microversion: 2.1 time: 0.174808 May 21 22:04:23.294319 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3300/6729] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:23 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:24.311010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-94d7ea9a-2911-482e-af52-00004571efae tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:24.311704 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-94d7ea9a-2911-482e-af52-00004571efae tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:24.319048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94d7ea9a-2911-482e-af52-00004571efae tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:24.320069 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94d7ea9a-2911-482e-af52-00004571efae tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:24.320850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94d7ea9a-2911-482e-af52-00004571efae tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:24.321286 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-94d7ea9a-2911-482e-af52-00004571efae tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:24.469405 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-94d7ea9a-2911-482e-af52-00004571efae tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:24.477958 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-94d7ea9a-2911-482e-af52-00004571efae tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1682 microversion: 2.1 time: 0.170908 May 21 22:04:24.478544 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3430/6730] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:24 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:25.495886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6c92b01e-9b3e-4ee1-a5ae-9f1cc0180622 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:25.496533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6c92b01e-9b3e-4ee1-a5ae-9f1cc0180622 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:25.503423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c92b01e-9b3e-4ee1-a5ae-9f1cc0180622 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:25.503819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c92b01e-9b3e-4ee1-a5ae-9f1cc0180622 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:25.504616 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c92b01e-9b3e-4ee1-a5ae-9f1cc0180622 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:25.505059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c92b01e-9b3e-4ee1-a5ae-9f1cc0180622 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:25.646518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6c92b01e-9b3e-4ee1-a5ae-9f1cc0180622 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:25.657637 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6c92b01e-9b3e-4ee1-a5ae-9f1cc0180622 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1682 microversion: 2.1 time: 0.166295 May 21 22:04:25.658222 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3301/6731] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:25 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:26.677163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7238264b-6292-451d-b86b-abb1bd88129a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:26.677858 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7238264b-6292-451d-b86b-abb1bd88129a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:26.685962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7238264b-6292-451d-b86b-abb1bd88129a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:26.686431 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7238264b-6292-451d-b86b-abb1bd88129a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:26.687231 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7238264b-6292-451d-b86b-abb1bd88129a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:26.687687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7238264b-6292-451d-b86b-abb1bd88129a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:26.830807 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7238264b-6292-451d-b86b-abb1bd88129a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:26.839455 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7238264b-6292-451d-b86b-abb1bd88129a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1682 microversion: 2.1 time: 0.166260 May 21 22:04:26.840028 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3431/6732] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:26 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:27.856924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-43136161-5129-4f62-baff-f4b3f722b88b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:27.857458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-43136161-5129-4f62-baff-f4b3f722b88b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:27.866781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-43136161-5129-4f62-baff-f4b3f722b88b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:27.867239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-43136161-5129-4f62-baff-f4b3f722b88b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:27.869295 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-43136161-5129-4f62-baff-f4b3f722b88b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:27.869754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-43136161-5129-4f62-baff-f4b3f722b88b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:28.019911 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-43136161-5129-4f62-baff-f4b3f722b88b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:28.028477 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-43136161-5129-4f62-baff-f4b3f722b88b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1682 microversion: 2.1 time: 0.175553 May 21 22:04:28.029078 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3302/6733] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:27 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:29.045750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0f0ada62-c282-42c2-ae91-3d4d6228e94f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:29.046381 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0f0ada62-c282-42c2-ae91-3d4d6228e94f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:29.053277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f0ada62-c282-42c2-ae91-3d4d6228e94f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:29.054801 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f0ada62-c282-42c2-ae91-3d4d6228e94f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:29.055599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f0ada62-c282-42c2-ae91-3d4d6228e94f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:29.056055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f0ada62-c282-42c2-ae91-3d4d6228e94f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:29.205468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0f0ada62-c282-42c2-ae91-3d4d6228e94f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:29.213674 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0f0ada62-c282-42c2-ae91-3d4d6228e94f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1682 microversion: 2.1 time: 0.171934 May 21 22:04:29.214246 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3432/6734] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:29 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:30.231208 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f9c3fcd2-b195-408e-b77e-140e02ed63b6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:30.231869 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f9c3fcd2-b195-408e-b77e-140e02ed63b6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:30.238819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f9c3fcd2-b195-408e-b77e-140e02ed63b6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:30.239268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f9c3fcd2-b195-408e-b77e-140e02ed63b6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:30.240033 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f9c3fcd2-b195-408e-b77e-140e02ed63b6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:30.240498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f9c3fcd2-b195-408e-b77e-140e02ed63b6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:30.385124 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f9c3fcd2-b195-408e-b77e-140e02ed63b6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:30.393055 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f9c3fcd2-b195-408e-b77e-140e02ed63b6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1682 microversion: 2.1 time: 0.165827 May 21 22:04:30.393624 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3303/6735] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:30 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:31.410382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b8482ed4-8969-4fce-9783-ae9a4c4b539e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:31.411016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b8482ed4-8969-4fce-9783-ae9a4c4b539e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:31.418894 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8482ed4-8969-4fce-9783-ae9a4c4b539e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:31.419362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8482ed4-8969-4fce-9783-ae9a4c4b539e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:31.420153 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8482ed4-8969-4fce-9783-ae9a4c4b539e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:31.420649 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b8482ed4-8969-4fce-9783-ae9a4c4b539e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:31.567843 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b8482ed4-8969-4fce-9783-ae9a4c4b539e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:31.575781 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b8482ed4-8969-4fce-9783-ae9a4c4b539e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1682 microversion: 2.1 time: 0.169343 May 21 22:04:31.576377 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3433/6736] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:31 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:32.593943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b6d54cd6-09b5-4f11-a8fd-5cb4c8cf4b20 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:32.594580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b6d54cd6-09b5-4f11-a8fd-5cb4c8cf4b20 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:32.602742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6d54cd6-09b5-4f11-a8fd-5cb4c8cf4b20 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:32.603198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6d54cd6-09b5-4f11-a8fd-5cb4c8cf4b20 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:32.603959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6d54cd6-09b5-4f11-a8fd-5cb4c8cf4b20 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:32.604432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b6d54cd6-09b5-4f11-a8fd-5cb4c8cf4b20 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:32.746477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b6d54cd6-09b5-4f11-a8fd-5cb4c8cf4b20 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:32.754096 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b6d54cd6-09b5-4f11-a8fd-5cb4c8cf4b20 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1682 microversion: 2.1 time: 0.164056 May 21 22:04:32.754812 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3304/6737] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:32 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:33.771338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0888af25-c51c-417c-beac-bb2149a4a100 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:33.771986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0888af25-c51c-417c-beac-bb2149a4a100 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:33.779516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0888af25-c51c-417c-beac-bb2149a4a100 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:33.780050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0888af25-c51c-417c-beac-bb2149a4a100 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:33.780891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0888af25-c51c-417c-beac-bb2149a4a100 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:33.781354 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0888af25-c51c-417c-beac-bb2149a4a100 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:33.993618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0888af25-c51c-417c-beac-bb2149a4a100 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:34.001418 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0888af25-c51c-417c-beac-bb2149a4a100 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1682 microversion: 2.1 time: 0.234196 May 21 22:04:34.002222 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3434/6738] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:33 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1682 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:35.019075 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-63ab4d26-dbd7-4677-9adb-e6d2e25433de tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:35.019622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-63ab4d26-dbd7-4677-9adb-e6d2e25433de tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:35.026977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63ab4d26-dbd7-4677-9adb-e6d2e25433de tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:35.027435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63ab4d26-dbd7-4677-9adb-e6d2e25433de tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:35.028206 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63ab4d26-dbd7-4677-9adb-e6d2e25433de tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:35.028674 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-63ab4d26-dbd7-4677-9adb-e6d2e25433de tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:35.175700 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-63ab4d26-dbd7-4677-9adb-e6d2e25433de tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:35.184297 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-63ab4d26-dbd7-4677-9adb-e6d2e25433de tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1682 microversion: 2.1 time: 0.169259 May 21 22:04:35.185065 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3305/6739] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:35 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:36.202240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fc07917d-86a6-4c4a-acdf-ee136cfd853d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:36.202895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fc07917d-86a6-4c4a-acdf-ee136cfd853d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:36.210528 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc07917d-86a6-4c4a-acdf-ee136cfd853d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:36.210995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc07917d-86a6-4c4a-acdf-ee136cfd853d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:36.211779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc07917d-86a6-4c4a-acdf-ee136cfd853d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:36.212229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc07917d-86a6-4c4a-acdf-ee136cfd853d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:36.363559 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fc07917d-86a6-4c4a-acdf-ee136cfd853d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:36.372680 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fc07917d-86a6-4c4a-acdf-ee136cfd853d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1681 microversion: 2.1 time: 0.174312 May 21 22:04:36.373817 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3435/6740] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:36 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:36.532044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-98eec68c-1933-4126-9ae3-b3083d7a1952 req-505f6eb9-8ee5-48c9-a589-cf0213cae44e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27a14db0-90ed-4356-aa6e-d9c46b27f98b", "name": "network-vif-unplugged", "status": "completed", "tag": "4a2f0762-44b8-4bf7-9be2-01a8d07dc61e"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:04:36.541876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-98eec68c-1933-4126-9ae3-b3083d7a1952 req-505f6eb9-8ee5-48c9-a589-cf0213cae44e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:36.542331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-98eec68c-1933-4126-9ae3-b3083d7a1952 req-505f6eb9-8ee5-48c9-a589-cf0213cae44e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:36.555201 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-98eec68c-1933-4126-9ae3-b3083d7a1952 req-505f6eb9-8ee5-48c9-a589-cf0213cae44e service nova] Creating event network-vif-unplugged:4a2f0762-44b8-4bf7-9be2-01a8d07dc61e for instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b on nch2-master-1 May 21 22:04:36.566132 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [req-98eec68c-1933-4126-9ae3-b3083d7a1952 req-505f6eb9-8ee5-48c9-a589-cf0213cae44e service nova] Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 22:04:36.573544 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-98eec68c-1933-4126-9ae3-b3083d7a1952 req-505f6eb9-8ee5-48c9-a589-cf0213cae44e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118840 May 21 22:04:36.574331 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3306/6741] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:04:37.391988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0d854a94-a8bb-4403-834d-a6b2b9a7181c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:37.392663 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0d854a94-a8bb-4403-834d-a6b2b9a7181c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:37.400671 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d854a94-a8bb-4403-834d-a6b2b9a7181c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:37.401150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d854a94-a8bb-4403-834d-a6b2b9a7181c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:37.401973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d854a94-a8bb-4403-834d-a6b2b9a7181c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:37.402428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0d854a94-a8bb-4403-834d-a6b2b9a7181c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:37.552123 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0d854a94-a8bb-4403-834d-a6b2b9a7181c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:37.560815 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0d854a94-a8bb-4403-834d-a6b2b9a7181c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1681 microversion: 2.1 time: 0.172673 May 21 22:04:37.561326 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3436/6742] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:37 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:38.580061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a15c2a91-13be-4d90-9a4a-6392607b458e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:38.580808 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a15c2a91-13be-4d90-9a4a-6392607b458e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:38.587632 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a15c2a91-13be-4d90-9a4a-6392607b458e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:38.588091 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a15c2a91-13be-4d90-9a4a-6392607b458e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:38.588830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-d5a3458b-17f3-41a7-926d-222926293c71 req-be8eba55-fda0-48e2-a781-dc8776300cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27a14db0-90ed-4356-aa6e-d9c46b27f98b", "tag": "4a2f0762-44b8-4bf7-9be2-01a8d07dc61e"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:04:38.589250 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a15c2a91-13be-4d90-9a4a-6392607b458e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:38.589341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a15c2a91-13be-4d90-9a4a-6392607b458e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:38.597784 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d5a3458b-17f3-41a7-926d-222926293c71 req-be8eba55-fda0-48e2-a781-dc8776300cd9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:38.598244 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d5a3458b-17f3-41a7-926d-222926293c71 req-be8eba55-fda0-48e2-a781-dc8776300cd9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:38.610480 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-d5a3458b-17f3-41a7-926d-222926293c71 req-be8eba55-fda0-48e2-a781-dc8776300cd9 service nova] Creating event network-changed:4a2f0762-44b8-4bf7-9be2-01a8d07dc61e for instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b on nch2-master-1 May 21 22:04:38.616526 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [req-d5a3458b-17f3-41a7-926d-222926293c71 req-be8eba55-fda0-48e2-a781-dc8776300cd9 service nova] Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 22:04:38.628039 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-d5a3458b-17f3-41a7-926d-222926293c71 req-be8eba55-fda0-48e2-a781-dc8776300cd9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043104 May 21 22:04:38.628862 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3437/6743] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:04:38.750126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a15c2a91-13be-4d90-9a4a-6392607b458e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:38.758493 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a15c2a91-13be-4d90-9a4a-6392607b458e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1679 microversion: 2.1 time: 0.183679 May 21 22:04:38.759087 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3307/6744] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:38 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:39.777398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a1b08fa7-ecb5-4681-9e29-441c83512558 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:39.778035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a1b08fa7-ecb5-4681-9e29-441c83512558 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:39.785367 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1b08fa7-ecb5-4681-9e29-441c83512558 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:39.785834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1b08fa7-ecb5-4681-9e29-441c83512558 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:39.786618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1b08fa7-ecb5-4681-9e29-441c83512558 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:39.787070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a1b08fa7-ecb5-4681-9e29-441c83512558 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:39.932221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a1b08fa7-ecb5-4681-9e29-441c83512558 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:39.940348 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a1b08fa7-ecb5-4681-9e29-441c83512558 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1676 microversion: 2.1 time: 0.167426 May 21 22:04:39.940912 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3438/6745] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:39 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:39.963628 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f5c5b936-10ec-48e9-8032-37b9b0168881 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:04:39.964173 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f5c5b936-10ec-48e9-8032-37b9b0168881 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:39.971493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5c5b936-10ec-48e9-8032-37b9b0168881 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:39.971949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5c5b936-10ec-48e9-8032-37b9b0168881 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:39.972757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5c5b936-10ec-48e9-8032-37b9b0168881 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:39.973196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5c5b936-10ec-48e9-8032-37b9b0168881 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:40.011006 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5c5b936-10ec-48e9-8032-37b9b0168881 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:40.011459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5c5b936-10ec-48e9-8032-37b9b0168881 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:40.012253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5c5b936-10ec-48e9-8032-37b9b0168881 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:40.012714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5c5b936-10ec-48e9-8032-37b9b0168881 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:40.033694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-f5c5b936-10ec-48e9-8032-37b9b0168881 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Getting quotas for project cb9f2d0a8dca4c85a47c2d138d1b39cd. Resources: {'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:04:40.039443 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-f5c5b936-10ec-48e9-8032-37b9b0168881 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Getting quotas for user 1fd1bb72fc464808988a1579524c7939 and project cb9f2d0a8dca4c85a47c2d138d1b39cd. Resources: {'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:04:40.366993 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f5c5b936-10ec-48e9-8032-37b9b0168881 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "POST /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b/action" status: 202 len: 0 microversion: 2.1 time: 0.407215 May 21 22:04:40.367600 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3308/6746] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:04:39 2022] POST /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:04:40.375798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7f30a20e-1df6-43ca-a099-dc77c318eecc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:40.376472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7f30a20e-1df6-43ca-a099-dc77c318eecc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:40.382843 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f30a20e-1df6-43ca-a099-dc77c318eecc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:40.386688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f30a20e-1df6-43ca-a099-dc77c318eecc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:40.386688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f30a20e-1df6-43ca-a099-dc77c318eecc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:40.386688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f30a20e-1df6-43ca-a099-dc77c318eecc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:40.533335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7f30a20e-1df6-43ca-a099-dc77c318eecc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:40.541882 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7f30a20e-1df6-43ca-a099-dc77c318eecc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1675 microversion: 2.1 time: 0.170021 May 21 22:04:40.547105 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3439/6747] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:40 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:41.561221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8bee823a-6cb4-4eb4-9b76-49de79333639 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:41.567528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8bee823a-6cb4-4eb4-9b76-49de79333639 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:41.569482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8bee823a-6cb4-4eb4-9b76-49de79333639 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:41.569947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8bee823a-6cb4-4eb4-9b76-49de79333639 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:41.570725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8bee823a-6cb4-4eb4-9b76-49de79333639 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:41.571172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8bee823a-6cb4-4eb4-9b76-49de79333639 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:41.719781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8bee823a-6cb4-4eb4-9b76-49de79333639 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:41.728680 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8bee823a-6cb4-4eb4-9b76-49de79333639 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1675 microversion: 2.1 time: 0.173437 May 21 22:04:41.729277 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3309/6748] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:41 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:42.746967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-42c272c5-5b4f-4c52-8bdb-e8aa76f3c601 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:42.747717 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-42c272c5-5b4f-4c52-8bdb-e8aa76f3c601 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:42.754576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42c272c5-5b4f-4c52-8bdb-e8aa76f3c601 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:42.755049 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42c272c5-5b4f-4c52-8bdb-e8aa76f3c601 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:42.755837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42c272c5-5b4f-4c52-8bdb-e8aa76f3c601 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:42.756325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-42c272c5-5b4f-4c52-8bdb-e8aa76f3c601 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:42.900572 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-42c272c5-5b4f-4c52-8bdb-e8aa76f3c601 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:42.908146 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-42c272c5-5b4f-4c52-8bdb-e8aa76f3c601 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1675 microversion: 2.1 time: 0.165426 May 21 22:04:42.908750 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3440/6749] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:42 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:43.926066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ff3a886a-d883-40c7-ab94-f66fe6813b1d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:43.927322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ff3a886a-d883-40c7-ab94-f66fe6813b1d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:43.934756 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff3a886a-d883-40c7-ab94-f66fe6813b1d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:43.935210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff3a886a-d883-40c7-ab94-f66fe6813b1d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:43.935993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff3a886a-d883-40c7-ab94-f66fe6813b1d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:43.936467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ff3a886a-d883-40c7-ab94-f66fe6813b1d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:44.088388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ff3a886a-d883-40c7-ab94-f66fe6813b1d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:44.096763 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ff3a886a-d883-40c7-ab94-f66fe6813b1d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1675 microversion: 2.1 time: 0.174502 May 21 22:04:44.097479 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3310/6750] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:43 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:44.720142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-7dd7a642-8934-4d90-8194-d01ced1a5be1 req-315fee6a-db13-495a-b46d-8e0d61773fea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27a14db0-90ed-4356-aa6e-d9c46b27f98b", "tag": "4a2f0762-44b8-4bf7-9be2-01a8d07dc61e"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:04:44.733545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7dd7a642-8934-4d90-8194-d01ced1a5be1 req-315fee6a-db13-495a-b46d-8e0d61773fea service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:44.734036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7dd7a642-8934-4d90-8194-d01ced1a5be1 req-315fee6a-db13-495a-b46d-8e0d61773fea service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:44.748330 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-7dd7a642-8934-4d90-8194-d01ced1a5be1 req-315fee6a-db13-495a-b46d-8e0d61773fea service nova] Creating event network-changed:4a2f0762-44b8-4bf7-9be2-01a8d07dc61e for instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b on nch1-master-1 May 21 22:04:44.754665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [req-7dd7a642-8934-4d90-8194-d01ced1a5be1 req-315fee6a-db13-495a-b46d-8e0d61773fea service nova] Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 22:04:44.766693 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-7dd7a642-8934-4d90-8194-d01ced1a5be1 req-315fee6a-db13-495a-b46d-8e0d61773fea service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056846 May 21 22:04:44.767358 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3441/6751] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:04:45.114544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f36eb37a-8e25-420f-b36d-772810fac4db tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:45.115210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f36eb37a-8e25-420f-b36d-772810fac4db tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:45.122153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f36eb37a-8e25-420f-b36d-772810fac4db tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:45.122642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f36eb37a-8e25-420f-b36d-772810fac4db tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:45.123606 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f36eb37a-8e25-420f-b36d-772810fac4db tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:45.124046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f36eb37a-8e25-420f-b36d-772810fac4db tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:45.368181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f36eb37a-8e25-420f-b36d-772810fac4db tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:45.376179 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f36eb37a-8e25-420f-b36d-772810fac4db tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1675 microversion: 2.1 time: 0.265653 May 21 22:04:45.376807 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3311/6752] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:45 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1675 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:46.395256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0e54bb5c-95fe-41bc-813b-49caa72d895a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:46.396023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0e54bb5c-95fe-41bc-813b-49caa72d895a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:46.402551 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e54bb5c-95fe-41bc-813b-49caa72d895a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:46.403029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e54bb5c-95fe-41bc-813b-49caa72d895a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:46.403818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e54bb5c-95fe-41bc-813b-49caa72d895a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:46.404274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e54bb5c-95fe-41bc-813b-49caa72d895a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:46.649040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0e54bb5c-95fe-41bc-813b-49caa72d895a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:46.657599 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0e54bb5c-95fe-41bc-813b-49caa72d895a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1675 microversion: 2.1 time: 0.267106 May 21 22:04:46.663962 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3442/6753] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:46 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1675 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:47.676943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-276ebcca-4dc7-4296-81f0-276e3a32eed3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:47.678288 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-276ebcca-4dc7-4296-81f0-276e3a32eed3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:47.686895 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-276ebcca-4dc7-4296-81f0-276e3a32eed3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:47.687556 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-276ebcca-4dc7-4296-81f0-276e3a32eed3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:47.688377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-276ebcca-4dc7-4296-81f0-276e3a32eed3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:47.688825 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-276ebcca-4dc7-4296-81f0-276e3a32eed3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:47.838956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-276ebcca-4dc7-4296-81f0-276e3a32eed3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:47.842630 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:04:47.847024 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-276ebcca-4dc7-4296-81f0-276e3a32eed3 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1668 microversion: 2.1 time: 0.174151 May 21 22:04:47.847600 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3312/6754] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:47 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1668 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:47.864043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6211509c-1e9c-4967-8fbb-e022f5ff8ae4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:47.864707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6211509c-1e9c-4967-8fbb-e022f5ff8ae4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:47.872846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6211509c-1e9c-4967-8fbb-e022f5ff8ae4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:47.873317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6211509c-1e9c-4967-8fbb-e022f5ff8ae4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:47.874111 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6211509c-1e9c-4967-8fbb-e022f5ff8ae4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:47.874571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6211509c-1e9c-4967-8fbb-e022f5ff8ae4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:48.020692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6211509c-1e9c-4967-8fbb-e022f5ff8ae4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:48.024463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:04:48.028937 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6211509c-1e9c-4967-8fbb-e022f5ff8ae4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1668 microversion: 2.1 time: 0.168801 May 21 22:04:48.029580 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3443/6755] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:47 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:48.045575 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-65cb49d3-7929-4aa9-aeaa-3f2d657cd3a2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:48.052680 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-65cb49d3-7929-4aa9-aeaa-3f2d657cd3a2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:48.052957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65cb49d3-7929-4aa9-aeaa-3f2d657cd3a2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:48.053407 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65cb49d3-7929-4aa9-aeaa-3f2d657cd3a2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:48.054801 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65cb49d3-7929-4aa9-aeaa-3f2d657cd3a2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:48.055236 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-65cb49d3-7929-4aa9-aeaa-3f2d657cd3a2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:48.206836 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-65cb49d3-7929-4aa9-aeaa-3f2d657cd3a2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:48.214996 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-65cb49d3-7929-4aa9-aeaa-3f2d657cd3a2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1668 microversion: 2.1 time: 0.173250 May 21 22:04:48.215582 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3313/6756] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:48 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1668 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:48.232178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-002474bb-3999-4089-948e-2c0ea2e393e4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:48.232802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-002474bb-3999-4089-948e-2c0ea2e393e4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:48.239331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-002474bb-3999-4089-948e-2c0ea2e393e4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:48.239809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-002474bb-3999-4089-948e-2c0ea2e393e4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:48.240639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-002474bb-3999-4089-948e-2c0ea2e393e4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:48.241109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-002474bb-3999-4089-948e-2c0ea2e393e4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:48.266472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-002474bb-3999-4089-948e-2c0ea2e393e4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 22:04:48.524359 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-002474bb-3999-4089-948e-2c0ea2e393e4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "DELETE /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 204 len: 0 microversion: 2.1 time: 0.295070 May 21 22:04:48.525007 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3444/6757] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:04:48 2022] DELETE /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:04:48.533917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-82d13435-7c1d-4143-a5f0-f7bd093baec4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:48.534606 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-82d13435-7c1d-4143-a5f0-f7bd093baec4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:48.541825 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-82d13435-7c1d-4143-a5f0-f7bd093baec4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:48.542284 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-82d13435-7c1d-4143-a5f0-f7bd093baec4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:48.543130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-82d13435-7c1d-4143-a5f0-f7bd093baec4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:48.543579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-82d13435-7c1d-4143-a5f0-f7bd093baec4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:48.688121 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-82d13435-7c1d-4143-a5f0-f7bd093baec4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:48.696649 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-82d13435-7c1d-4143-a5f0-f7bd093baec4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1674 microversion: 2.1 time: 0.167296 May 21 22:04:48.697267 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3314/6758] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:48 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:49.643251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-3465b0d7-88f9-4ece-a495-8d819b7163ae req-b238ba4b-6321-425f-8733-00766fd5ed68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27a14db0-90ed-4356-aa6e-d9c46b27f98b", "name": "network-vif-plugged", "status": "completed", "tag": "4a2f0762-44b8-4bf7-9be2-01a8d07dc61e"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:04:49.653378 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-3465b0d7-88f9-4ece-a495-8d819b7163ae req-b238ba4b-6321-425f-8733-00766fd5ed68 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:49.653916 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-3465b0d7-88f9-4ece-a495-8d819b7163ae req-b238ba4b-6321-425f-8733-00766fd5ed68 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:49.665738 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-3465b0d7-88f9-4ece-a495-8d819b7163ae req-b238ba4b-6321-425f-8733-00766fd5ed68 service nova] Creating event network-vif-plugged:4a2f0762-44b8-4bf7-9be2-01a8d07dc61e for instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b on nch1-master-1 May 21 22:04:49.670700 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-3465b0d7-88f9-4ece-a495-8d819b7163ae req-b238ba4b-6321-425f-8733-00766fd5ed68 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031651 May 21 22:04:49.671311 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3445/6759] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:04:49.713922 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-11be1226-7e78-4b43-a67e-694f558550c5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:49.714724 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-11be1226-7e78-4b43-a67e-694f558550c5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:49.721924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11be1226-7e78-4b43-a67e-694f558550c5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:49.722387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11be1226-7e78-4b43-a67e-694f558550c5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:49.723170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11be1226-7e78-4b43-a67e-694f558550c5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:49.723626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11be1226-7e78-4b43-a67e-694f558550c5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:49.880883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-11be1226-7e78-4b43-a67e-694f558550c5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:49.890382 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-11be1226-7e78-4b43-a67e-694f558550c5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1674 microversion: 2.1 time: 0.180845 May 21 22:04:49.892727 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3315/6760] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:49 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1674 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:50.910905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-978ed0d5-5bc7-4add-81b7-35d4ea650a64 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:50.911567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-978ed0d5-5bc7-4add-81b7-35d4ea650a64 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:50.913887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:04:50.919269 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-978ed0d5-5bc7-4add-81b7-35d4ea650a64 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:50.926131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-978ed0d5-5bc7-4add-81b7-35d4ea650a64 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:50.926131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-978ed0d5-5bc7-4add-81b7-35d4ea650a64 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:50.926131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-978ed0d5-5bc7-4add-81b7-35d4ea650a64 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:51.142981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-978ed0d5-5bc7-4add-81b7-35d4ea650a64 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:51.151654 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-978ed0d5-5bc7-4add-81b7-35d4ea650a64 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 200 len: 1607 microversion: 2.1 time: 0.246154 May 21 22:04:51.152272 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3446/6761] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:50 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 1607 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:51.225159 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-6516f6f8-c83d-4050-a60f-8ce6a857e181 req-260b84a3-61a4-4ba4-b7fa-0c1eaa42d64d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27a14db0-90ed-4356-aa6e-d9c46b27f98b", "name": "network-vif-deleted", "tag": "4a2f0762-44b8-4bf7-9be2-01a8d07dc61e"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:04:51.229398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:04:51.234788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:04:51.236501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6516f6f8-c83d-4050-a60f-8ce6a857e181 req-260b84a3-61a4-4ba4-b7fa-0c1eaa42d64d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:51.236954 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6516f6f8-c83d-4050-a60f-8ce6a857e181 req-260b84a3-61a4-4ba4-b7fa-0c1eaa42d64d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:51.249086 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-6516f6f8-c83d-4050-a60f-8ce6a857e181 req-260b84a3-61a4-4ba4-b7fa-0c1eaa42d64d service nova] Creating event network-vif-deleted:4a2f0762-44b8-4bf7-9be2-01a8d07dc61e for instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b on nch1-master-1 May 21 22:04:51.254381 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-6516f6f8-c83d-4050-a60f-8ce6a857e181 req-260b84a3-61a4-4ba4-b7fa-0c1eaa42d64d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034087 May 21 22:04:51.255074 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3316/6762] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:04:52.170890 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-059a8602-1951-405e-82b9-0893ed55547f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:52.170890 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-059a8602-1951-405e-82b9-0893ed55547f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:52.178030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-059a8602-1951-405e-82b9-0893ed55547f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:52.178872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-059a8602-1951-405e-82b9-0893ed55547f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:52.179718 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-059a8602-1951-405e-82b9-0893ed55547f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:52.180215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-059a8602-1951-405e-82b9-0893ed55547f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:52.197429 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-059a8602-1951-405e-82b9-0893ed55547f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] HTTP exception thrown: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-059a8602-1951-405e-82b9-0893ed55547f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Request method failure captured: May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b HTTP/1.1 May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiWEqg4H5ib8lBeBY5hWnlzTjb_0SYMAu1PXPchB7RzXjO9Fc2uRmCYI6YXq0eyS1H44OjCoLWXG04d9ut0CknArKFnB7d8KFC2oZLDhogrvccuHSLlGl5ORpF14bspFXBZezQCKhKDgRiiLFY_0g2s6h-a-kpGbnJaHmPkp_ile5A_0 May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb9f2d0a8dca4c85a47c2d138d1b39cd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerActionsTestJSON-532218768 May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerActionsTestJSON-532218768-project May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 1fd1bb72fc464808988a1579524c7939 May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerActionsTestJSON-532218768-project May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '27a14db0-90ed-4356-aa6e-d9c46b27f98b'} May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:04:52.199150 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:04:52.208769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:04:52.208769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:04:52.208769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:04:52.208769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:04:52.208769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:04:52.208769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. May 21 22:04:52.208769 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:04:52.208769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-059a8602-1951-405e-82b9-0893ed55547f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Returning 404 to user: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:04:52.208769 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-059a8602-1951-405e-82b9-0893ed55547f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 404 len: 111 microversion: 2.1 time: 0.034798 May 21 22:04:52.208769 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3447/6763] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:52 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:04:52.220995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7c70d954-3d0b-4d3f-8c3c-2834db66632e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:52.221715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7c70d954-3d0b-4d3f-8c3c-2834db66632e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:52.230010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c70d954-3d0b-4d3f-8c3c-2834db66632e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:52.230626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c70d954-3d0b-4d3f-8c3c-2834db66632e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:52.231252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c70d954-3d0b-4d3f-8c3c-2834db66632e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:52.231702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7c70d954-3d0b-4d3f-8c3c-2834db66632e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:52.246893 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-7c70d954-3d0b-4d3f-8c3c-2834db66632e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] HTTP exception thrown: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7c70d954-3d0b-4d3f-8c3c-2834db66632e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Request method failure captured: May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b HTTP/1.1 May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWEqg4H5ib8lBeBY5hWnlzTjb_0SYMAu1PXPchB7RzXjO9Fc2uRmCYI6YXq0eyS1H44OjCoLWXG04d9ut0CknArKFnB7d8KFC2oZLDhogrvccuHSLlGl5ORpF14bspFXBZezQCKhKDgRiiLFY_0g2s6h-a-kpGbnJaHmPkp_ile5A_0 May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb9f2d0a8dca4c85a47c2d138d1b39cd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerActionsTestJSON-532218768 May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerActionsTestJSON-532218768-project May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1fd1bb72fc464808988a1579524c7939 May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerActionsTestJSON-532218768-project May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '27a14db0-90ed-4356-aa6e-d9c46b27f98b'} May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:04:52.248613 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:04:52.255689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:04:52.255689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:04:52.255689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:04:52.255689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:04:52.255689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:04:52.255689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. May 21 22:04:52.255689 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:04:52.255689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7c70d954-3d0b-4d3f-8c3c-2834db66632e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Returning 404 to user: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:04:52.255689 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7c70d954-3d0b-4d3f-8c3c-2834db66632e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 404 len: 111 microversion: 2.1 time: 0.034117 May 21 22:04:52.255689 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3317/6764] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:52 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:04:52.299985 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f717e855-7e0e-4ef7-9f76-46e01ff66bec tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-789440093", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "3293c92c-e4b2-4bbe-993a-802603a2deb4"}], "security_groups": [{"name": "tempest-securitygroup--889871437"}], "key_name": "tempest-keypair-937962467", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:04:52.414132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-f717e855-7e0e-4ef7-9f76-46e01ff66bec tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] validate_networks() for [('3293c92c-e4b2-4bbe-993a-802603a2deb4', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 22:04:52.847070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-f717e855-7e0e-4ef7-9f76-46e01ff66bec tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:04:52.847510 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-f717e855-7e0e-4ef7-9f76-46e01ff66bec tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:04:52.848008 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-f717e855-7e0e-4ef7-9f76-46e01ff66bec tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:04:52.848465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-f717e855-7e0e-4ef7-9f76-46e01ff66bec tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:04:52.848894 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-f717e855-7e0e-4ef7-9f76-46e01ff66bec tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:04:52.858553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f717e855-7e0e-4ef7-9f76-46e01ff66bec tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:52.859019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f717e855-7e0e-4ef7-9f76-46e01ff66bec tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:52.859836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f717e855-7e0e-4ef7-9f76-46e01ff66bec tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:52.860315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f717e855-7e0e-4ef7-9f76-46e01ff66bec tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:52.877637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-f717e855-7e0e-4ef7-9f76-46e01ff66bec tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Getting quotas for project cb9f2d0a8dca4c85a47c2d138d1b39cd. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:04:52.882986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-f717e855-7e0e-4ef7-9f76-46e01ff66bec tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Getting quotas for user 1fd1bb72fc464808988a1579524c7939 and project cb9f2d0a8dca4c85a47c2d138d1b39cd. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:04:52.895353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f717e855-7e0e-4ef7-9f76-46e01ff66bec tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 22:04:52.898185 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f717e855-7e0e-4ef7-9f76-46e01ff66bec tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 22:04:53.009618 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f717e855-7e0e-4ef7-9f76-46e01ff66bec tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.713590 May 21 22:04:53.010280 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3448/6765] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 22:04:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 22:04:53.020870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-12f5fa8d-7a80-4849-b1c5-c37a4e376900 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:53.021493 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-12f5fa8d-7a80-4849-b1c5-c37a4e376900 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:53.082632 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-12f5fa8d-7a80-4849-b1c5-c37a4e376900 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:53.090796 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-12f5fa8d-7a80-4849-b1c5-c37a4e376900 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1237 microversion: 2.1 time: 0.074247 May 21 22:04:53.091597 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3318/6766] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:53 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1237 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:54.109167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e66da58f-b0bb-48dd-b17b-0f20be3b046b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:54.109802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e66da58f-b0bb-48dd-b17b-0f20be3b046b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:54.117882 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e66da58f-b0bb-48dd-b17b-0f20be3b046b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:54.118385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e66da58f-b0bb-48dd-b17b-0f20be3b046b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:54.128330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e66da58f-b0bb-48dd-b17b-0f20be3b046b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:54.128330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e66da58f-b0bb-48dd-b17b-0f20be3b046b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:54.191885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e66da58f-b0bb-48dd-b17b-0f20be3b046b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:54.195374 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e66da58f-b0bb-48dd-b17b-0f20be3b046b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1241 microversion: 2.1 time: 0.090526 May 21 22:04:54.195983 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3449/6767] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:54 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:55.212925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-16ff5017-90c2-47a0-b9ed-49227a8ae3f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:55.213542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-16ff5017-90c2-47a0-b9ed-49227a8ae3f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:55.221556 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-16ff5017-90c2-47a0-b9ed-49227a8ae3f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:55.227624 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-16ff5017-90c2-47a0-b9ed-49227a8ae3f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:55.227624 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-16ff5017-90c2-47a0-b9ed-49227a8ae3f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:55.227624 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-16ff5017-90c2-47a0-b9ed-49227a8ae3f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:55.290795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-16ff5017-90c2-47a0-b9ed-49227a8ae3f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:55.299411 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-16ff5017-90c2-47a0-b9ed-49227a8ae3f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1295 microversion: 2.1 time: 0.090831 May 21 22:04:55.300205 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3319/6768] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:55 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1295 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:56.318472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-838ab39a-6f6d-4315-92fb-784cae6cf48d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:56.319150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-838ab39a-6f6d-4315-92fb-784cae6cf48d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:56.326417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-838ab39a-6f6d-4315-92fb-784cae6cf48d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:56.326889 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-838ab39a-6f6d-4315-92fb-784cae6cf48d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:56.327678 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-838ab39a-6f6d-4315-92fb-784cae6cf48d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:56.328133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-838ab39a-6f6d-4315-92fb-784cae6cf48d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:56.523345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-838ab39a-6f6d-4315-92fb-784cae6cf48d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:56.531700 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-838ab39a-6f6d-4315-92fb-784cae6cf48d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1362 microversion: 2.1 time: 0.217420 May 21 22:04:56.533904 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3450/6769] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:56 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:04:56.915596 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-2b35fc25-dfaf-45de-85b8-2eaf4433187b req-4e06ea24-e96b-4133-8d4d-b0f5df90699d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e70a824f-5304-4114-9966-3dca15d418cc", "tag": "75426369-ef84-45f7-a4a1-136620ca3579"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:04:56.927785 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2b35fc25-dfaf-45de-85b8-2eaf4433187b req-4e06ea24-e96b-4133-8d4d-b0f5df90699d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:56.927785 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-2b35fc25-dfaf-45de-85b8-2eaf4433187b req-4e06ea24-e96b-4133-8d4d-b0f5df90699d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:56.945725 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-2b35fc25-dfaf-45de-85b8-2eaf4433187b req-4e06ea24-e96b-4133-8d4d-b0f5df90699d service nova] Creating event network-changed:75426369-ef84-45f7-a4a1-136620ca3579 for instance e70a824f-5304-4114-9966-3dca15d418cc on nch1-master-1 May 21 22:04:56.951886 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-2b35fc25-dfaf-45de-85b8-2eaf4433187b req-4e06ea24-e96b-4133-8d4d-b0f5df90699d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040665 May 21 22:04:56.952654 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3320/6770] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:04:57.551366 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d5bc138e-811e-49a6-9764-7aea415abfbd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:57.552077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d5bc138e-811e-49a6-9764-7aea415abfbd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:57.561636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5bc138e-811e-49a6-9764-7aea415abfbd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:57.562117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5bc138e-811e-49a6-9764-7aea415abfbd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:57.562934 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5bc138e-811e-49a6-9764-7aea415abfbd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:57.563395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5bc138e-811e-49a6-9764-7aea415abfbd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:57.809053 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d5bc138e-811e-49a6-9764-7aea415abfbd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:57.817008 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d5bc138e-811e-49a6-9764-7aea415abfbd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1362 microversion: 2.1 time: 0.270506 May 21 22:04:57.817589 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3451/6771] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:57 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:04:58.836782 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e71e069d-9152-471e-bbd7-80dd502872e6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:04:58.837489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e71e069d-9152-471e-bbd7-80dd502872e6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:04:58.843781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e71e069d-9152-471e-bbd7-80dd502872e6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:58.844237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e71e069d-9152-471e-bbd7-80dd502872e6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:58.845032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e71e069d-9152-471e-bbd7-80dd502872e6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:04:58.845477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e71e069d-9152-471e-bbd7-80dd502872e6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:04:58.991961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e71e069d-9152-471e-bbd7-80dd502872e6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:04:58.999993 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e71e069d-9152-471e-bbd7-80dd502872e6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1362 microversion: 2.1 time: 0.169080 May 21 22:04:59.000604 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3321/6772] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:04:58 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:05:00.017895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a5211bba-ea52-4161-9b36-8a7c99fbea36 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:05:00.018437 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a5211bba-ea52-4161-9b36-8a7c99fbea36 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:05:00.025689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5211bba-ea52-4161-9b36-8a7c99fbea36 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:00.026154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5211bba-ea52-4161-9b36-8a7c99fbea36 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:00.026934 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5211bba-ea52-4161-9b36-8a7c99fbea36 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:00.027388 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a5211bba-ea52-4161-9b36-8a7c99fbea36 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:00.172475 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a5211bba-ea52-4161-9b36-8a7c99fbea36 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:05:00.181167 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a5211bba-ea52-4161-9b36-8a7c99fbea36 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1362 microversion: 2.1 time: 0.167252 May 21 22:05:00.181724 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3452/6773] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:05:00 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:05:01.199058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cefafd17-a1a2-4db2-84e6-0680dc29a255 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:05:01.199686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cefafd17-a1a2-4db2-84e6-0680dc29a255 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:05:01.206898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cefafd17-a1a2-4db2-84e6-0680dc29a255 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:01.207360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cefafd17-a1a2-4db2-84e6-0680dc29a255 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:01.208137 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cefafd17-a1a2-4db2-84e6-0680dc29a255 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:01.208614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cefafd17-a1a2-4db2-84e6-0680dc29a255 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:01.359436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cefafd17-a1a2-4db2-84e6-0680dc29a255 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:05:01.367353 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cefafd17-a1a2-4db2-84e6-0680dc29a255 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1362 microversion: 2.1 time: 0.172214 May 21 22:05:01.367940 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3322/6774] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:05:01 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:05:02.385311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d12cece8-def1-47ef-9be1-eeb2968a8238 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:05:02.385946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d12cece8-def1-47ef-9be1-eeb2968a8238 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:05:02.393061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d12cece8-def1-47ef-9be1-eeb2968a8238 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:02.393530 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d12cece8-def1-47ef-9be1-eeb2968a8238 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:02.394377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d12cece8-def1-47ef-9be1-eeb2968a8238 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:02.394776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d12cece8-def1-47ef-9be1-eeb2968a8238 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:02.539524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d12cece8-def1-47ef-9be1-eeb2968a8238 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:05:02.547085 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d12cece8-def1-47ef-9be1-eeb2968a8238 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1362 microversion: 2.1 time: 0.166334 May 21 22:05:02.547662 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3453/6775] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:05:02 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:05:03.565917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0e8a7d88-cd1f-4137-a846-709874ea628a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:05:03.570558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0e8a7d88-cd1f-4137-a846-709874ea628a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:05:03.570558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:05:03.575154 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e8a7d88-cd1f-4137-a846-709874ea628a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:03.575605 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e8a7d88-cd1f-4137-a846-709874ea628a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:03.576417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e8a7d88-cd1f-4137-a846-709874ea628a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:03.576856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e8a7d88-cd1f-4137-a846-709874ea628a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:03.729161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0e8a7d88-cd1f-4137-a846-709874ea628a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:05:03.737269 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0e8a7d88-cd1f-4137-a846-709874ea628a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1362 microversion: 2.1 time: 0.176047 May 21 22:05:03.737877 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3323/6776] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:05:03 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:05:03.841418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-20fc3ad7-4463-4ea2-ae4d-f199288ca9f8 req-951910de-bb03-47ac-91df-2e33f2c58d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e70a824f-5304-4114-9966-3dca15d418cc", "name": "network-vif-plugged", "status": "completed", "tag": "75426369-ef84-45f7-a4a1-136620ca3579"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:05:03.845060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:05:03.845771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:05:03.851828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-20fc3ad7-4463-4ea2-ae4d-f199288ca9f8 req-951910de-bb03-47ac-91df-2e33f2c58d83 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:03.854591 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-20fc3ad7-4463-4ea2-ae4d-f199288ca9f8 req-951910de-bb03-47ac-91df-2e33f2c58d83 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:03.863522 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-20fc3ad7-4463-4ea2-ae4d-f199288ca9f8 req-951910de-bb03-47ac-91df-2e33f2c58d83 service nova] Creating event network-vif-plugged:75426369-ef84-45f7-a4a1-136620ca3579 for instance e70a824f-5304-4114-9966-3dca15d418cc on nch1-master-1 May 21 22:05:03.868852 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-20fc3ad7-4463-4ea2-ae4d-f199288ca9f8 req-951910de-bb03-47ac-91df-2e33f2c58d83 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031136 May 21 22:05:03.870850 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3454/6777] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:05:04.754961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f1981a01-e540-4d13-9bc1-07ca832a7bd9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:05:04.755592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f1981a01-e540-4d13-9bc1-07ca832a7bd9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:05:04.762849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1981a01-e540-4d13-9bc1-07ca832a7bd9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:04.763311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1981a01-e540-4d13-9bc1-07ca832a7bd9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:04.764092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1981a01-e540-4d13-9bc1-07ca832a7bd9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:04.764566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f1981a01-e540-4d13-9bc1-07ca832a7bd9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:04.909566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f1981a01-e540-4d13-9bc1-07ca832a7bd9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:05:04.918018 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f1981a01-e540-4d13-9bc1-07ca832a7bd9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1362 microversion: 2.1 time: 0.167145 May 21 22:05:04.918606 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3324/6778] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:05:04 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:05:05.937757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-981ce3e3-efc5-401d-b9bc-7001a96809cb tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:05:05.938484 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-981ce3e3-efc5-401d-b9bc-7001a96809cb tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:05:05.945752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-981ce3e3-efc5-401d-b9bc-7001a96809cb tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:05.946227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-981ce3e3-efc5-401d-b9bc-7001a96809cb tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:05.947025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-981ce3e3-efc5-401d-b9bc-7001a96809cb tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:05.947486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-981ce3e3-efc5-401d-b9bc-7001a96809cb tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:06.091459 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-981ce3e3-efc5-401d-b9bc-7001a96809cb tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:05:06.099211 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-981ce3e3-efc5-401d-b9bc-7001a96809cb tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1548 microversion: 2.1 time: 0.167311 May 21 22:05:06.099780 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3455/6779] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:05:05 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1548 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:05:06.117135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-423547a7-6184-4a41-a0f0-84e88353dfaf tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:05:06.117761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-423547a7-6184-4a41-a0f0-84e88353dfaf tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:05:06.124852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-423547a7-6184-4a41-a0f0-84e88353dfaf tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:06.125313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-423547a7-6184-4a41-a0f0-84e88353dfaf tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:06.126086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-423547a7-6184-4a41-a0f0-84e88353dfaf tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:06.126530 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-423547a7-6184-4a41-a0f0-84e88353dfaf tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:06.211930 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-423547a7-6184-4a41-a0f0-84e88353dfaf tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099360 May 21 22:05:06.212848 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3325/6780] 10.222.0.49 () {58 vars in 1274 bytes} [Sat May 21 22:05:06 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:05:07.461929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-0ee9ae1b-e11d-4ea6-a35f-93c4f1b4c9ec req-261e9ccd-3943-4987-8a62-730b284e88ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e70a824f-5304-4114-9966-3dca15d418cc", "tag": "75426369-ef84-45f7-a4a1-136620ca3579"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:05:07.470268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-0ee9ae1b-e11d-4ea6-a35f-93c4f1b4c9ec req-261e9ccd-3943-4987-8a62-730b284e88ba service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:07.470667 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-0ee9ae1b-e11d-4ea6-a35f-93c4f1b4c9ec req-261e9ccd-3943-4987-8a62-730b284e88ba service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:07.482070 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-0ee9ae1b-e11d-4ea6-a35f-93c4f1b4c9ec req-261e9ccd-3943-4987-8a62-730b284e88ba service nova] Creating event network-changed:75426369-ef84-45f7-a4a1-136620ca3579 for instance e70a824f-5304-4114-9966-3dca15d418cc on nch1-master-1 May 21 22:05:07.487382 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-0ee9ae1b-e11d-4ea6-a35f-93c4f1b4c9ec req-261e9ccd-3943-4987-8a62-730b284e88ba service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098713 May 21 22:05:07.488676 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3456/6781] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:05:43.199305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=21 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:05:43.200005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=58 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:05:43.203916 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-35ebcc56-4547-4496-b236-547b7fdacf7e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:05:43.204637 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-35ebcc56-4547-4496-b236-547b7fdacf7e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:05:43.211122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35ebcc56-4547-4496-b236-547b7fdacf7e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:43.211576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35ebcc56-4547-4496-b236-547b7fdacf7e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:43.212378 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35ebcc56-4547-4496-b236-547b7fdacf7e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:43.212822 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-35ebcc56-4547-4496-b236-547b7fdacf7e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:43.357827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-35ebcc56-4547-4496-b236-547b7fdacf7e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:05:43.365449 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-35ebcc56-4547-4496-b236-547b7fdacf7e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1667 microversion: 2.1 time: 0.168219 May 21 22:05:43.366054 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3326/6782] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:05:43 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1667 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:05:43.382778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6ee50af8-e283-471c-9392-3b66f6b7075f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f320a0f-8268-4b9e-b044-577130bdcaa2"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:05:43.384707 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6ee50af8-e283-471c-9392-3b66f6b7075f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:05:43.387287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:05:43.387988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:05:43.393246 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ee50af8-e283-471c-9392-3b66f6b7075f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:43.395102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ee50af8-e283-471c-9392-3b66f6b7075f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:43.395102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ee50af8-e283-471c-9392-3b66f6b7075f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:43.395102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ee50af8-e283-471c-9392-3b66f6b7075f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:44.216543 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6ee50af8-e283-471c-9392-3b66f6b7075f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "POST /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.838358 May 21 22:05:44.217168 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3457/6783] 10.222.0.49 () {60 vars in 1322 bytes} [Sat May 21 22:05:43 2022] POST /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc/os-volume_attachments => generated 194 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:05:47.521891 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:05:47.524463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:05:47.530854 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:47.531316 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:47.532092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:47.532567 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:47.561573 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:05:47.567597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Old instance type m1.heat2, new instance type m1.heat {{(pid=131278) resize /opt/stack/nova/nova/compute/api.py:4166}} May 21 22:05:47.575385 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:05:47.575821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:05:47.576333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:05:47.576761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:05:47.577183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:05:47.746235 ncdv-master-1 devstack@n-api.service[131278]: ERROR oslo.messaging._drivers.impl_rabbit [None req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [1b412268-ab2f-4c7b-98cb-684224764859] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 21 22:05:48.754895 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [None req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [1b412268-ab2f-4c7b-98cb-684224764859] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 39048. May 21 22:05:48.758814 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "POST /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc/action" status: 202 len: 0 microversion: 2.1 time: 1.240993 May 21 22:05:48.759604 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3327/6784] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:05:47 2022] POST /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc/action => generated 0 bytes in 1242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:05:48.772725 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5fe43dc4-59ce-4fce-ba93-82c785e468dd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:05:48.773428 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5fe43dc4-59ce-4fce-ba93-82c785e468dd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:05:48.780161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5fe43dc4-59ce-4fce-ba93-82c785e468dd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:48.780681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5fe43dc4-59ce-4fce-ba93-82c785e468dd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:48.781492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5fe43dc4-59ce-4fce-ba93-82c785e468dd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:48.781958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5fe43dc4-59ce-4fce-ba93-82c785e468dd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:48.949748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5fe43dc4-59ce-4fce-ba93-82c785e468dd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:05:48.959503 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5fe43dc4-59ce-4fce-ba93-82c785e468dd tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1722 microversion: 2.1 time: 0.194768 May 21 22:05:48.961107 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3458/6785] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:05:48 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:05:49.978997 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5bd0799a-4489-443e-8f75-f2e155d9e634 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:05:49.983363 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5bd0799a-4489-443e-8f75-f2e155d9e634 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:05:49.989758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5bd0799a-4489-443e-8f75-f2e155d9e634 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:49.990223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5bd0799a-4489-443e-8f75-f2e155d9e634 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:49.991070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5bd0799a-4489-443e-8f75-f2e155d9e634 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:49.992234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5bd0799a-4489-443e-8f75-f2e155d9e634 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:50.145390 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5bd0799a-4489-443e-8f75-f2e155d9e634 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:05:50.153816 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5bd0799a-4489-443e-8f75-f2e155d9e634 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1722 microversion: 2.1 time: 0.179597 May 21 22:05:50.154398 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3328/6786] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:05:49 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:05:51.171206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3179a1b4-8780-4da4-80ec-875335b15dab tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:05:51.171846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3179a1b4-8780-4da4-80ec-875335b15dab tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:05:51.178886 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3179a1b4-8780-4da4-80ec-875335b15dab tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:51.179359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3179a1b4-8780-4da4-80ec-875335b15dab tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:51.180900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3179a1b4-8780-4da4-80ec-875335b15dab tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:51.181363 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3179a1b4-8780-4da4-80ec-875335b15dab tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:51.402048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3179a1b4-8780-4da4-80ec-875335b15dab tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:05:51.410278 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3179a1b4-8780-4da4-80ec-875335b15dab tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1722 microversion: 2.1 time: 0.243146 May 21 22:05:51.410798 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3459/6787] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:05:51 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:05:52.427016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2e695cb1-b619-4d2d-adc2-485b044f5581 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:05:52.427643 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2e695cb1-b619-4d2d-adc2-485b044f5581 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:05:52.435009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e695cb1-b619-4d2d-adc2-485b044f5581 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:52.435472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e695cb1-b619-4d2d-adc2-485b044f5581 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:52.436253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e695cb1-b619-4d2d-adc2-485b044f5581 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:52.436730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e695cb1-b619-4d2d-adc2-485b044f5581 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:52.581662 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2e695cb1-b619-4d2d-adc2-485b044f5581 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:05:52.590361 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2e695cb1-b619-4d2d-adc2-485b044f5581 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1727 microversion: 2.1 time: 0.167288 May 21 22:05:52.590929 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3329/6788] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:05:52 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:05:53.607723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-99e0dce1-0659-449a-b9e0-7666c599d5c7 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:05:53.608389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-99e0dce1-0659-449a-b9e0-7666c599d5c7 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:05:53.615659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-99e0dce1-0659-449a-b9e0-7666c599d5c7 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:53.616127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-99e0dce1-0659-449a-b9e0-7666c599d5c7 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:53.617091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-99e0dce1-0659-449a-b9e0-7666c599d5c7 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:53.617547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-99e0dce1-0659-449a-b9e0-7666c599d5c7 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:53.769182 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-99e0dce1-0659-449a-b9e0-7666c599d5c7 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:05:53.778031 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-99e0dce1-0659-449a-b9e0-7666c599d5c7 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1727 microversion: 2.1 time: 0.174376 May 21 22:05:53.778619 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3460/6789] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:05:53 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:05:54.795683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-28ce0dbb-6ccc-48a6-a126-b4100ee3bd7b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:05:54.796335 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-28ce0dbb-6ccc-48a6-a126-b4100ee3bd7b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:05:54.803353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28ce0dbb-6ccc-48a6-a126-b4100ee3bd7b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:54.803812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28ce0dbb-6ccc-48a6-a126-b4100ee3bd7b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:54.804623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28ce0dbb-6ccc-48a6-a126-b4100ee3bd7b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:54.805935 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28ce0dbb-6ccc-48a6-a126-b4100ee3bd7b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:55.008733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-28ce0dbb-6ccc-48a6-a126-b4100ee3bd7b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:05:55.016873 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-28ce0dbb-6ccc-48a6-a126-b4100ee3bd7b tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1727 microversion: 2.1 time: 0.225089 May 21 22:05:55.017459 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3330/6790] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:05:54 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1727 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:05:56.034444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0e794c6a-fd93-4770-9466-29bf88814cab tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:05:56.034993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0e794c6a-fd93-4770-9466-29bf88814cab tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:05:56.042890 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e794c6a-fd93-4770-9466-29bf88814cab tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:56.043369 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e794c6a-fd93-4770-9466-29bf88814cab tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:56.044166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e794c6a-fd93-4770-9466-29bf88814cab tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:56.044661 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e794c6a-fd93-4770-9466-29bf88814cab tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:56.241429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0e794c6a-fd93-4770-9466-29bf88814cab tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:05:56.250558 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0e794c6a-fd93-4770-9466-29bf88814cab tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1727 microversion: 2.1 time: 0.220216 May 21 22:05:56.251133 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3461/6791] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:05:56 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1727 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:05:57.267784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-934365e8-6b19-44c8-bc7d-85c8fa07f40f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:05:57.268365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-934365e8-6b19-44c8-bc7d-85c8fa07f40f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:05:57.276373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-934365e8-6b19-44c8-bc7d-85c8fa07f40f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:57.276824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-934365e8-6b19-44c8-bc7d-85c8fa07f40f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:57.277591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-934365e8-6b19-44c8-bc7d-85c8fa07f40f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:57.278029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-934365e8-6b19-44c8-bc7d-85c8fa07f40f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:57.420448 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-934365e8-6b19-44c8-bc7d-85c8fa07f40f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:05:57.428464 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-934365e8-6b19-44c8-bc7d-85c8fa07f40f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1727 microversion: 2.1 time: 0.164613 May 21 22:05:57.429032 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3331/6792] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:05:57 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:05:58.448178 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8ee77462-7899-4992-bdde-1b6574b22e62 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:05:58.448888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8ee77462-7899-4992-bdde-1b6574b22e62 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:05:58.455702 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ee77462-7899-4992-bdde-1b6574b22e62 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:58.456170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ee77462-7899-4992-bdde-1b6574b22e62 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:58.456994 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ee77462-7899-4992-bdde-1b6574b22e62 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:58.457450 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8ee77462-7899-4992-bdde-1b6574b22e62 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:58.602204 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8ee77462-7899-4992-bdde-1b6574b22e62 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:05:58.610375 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8ee77462-7899-4992-bdde-1b6574b22e62 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1727 microversion: 2.1 time: 0.166852 May 21 22:05:58.610944 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3462/6793] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:05:58 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:05:59.628084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5e3443a4-9de2-4198-bd2d-c5943475d164 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:05:59.628829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5e3443a4-9de2-4198-bd2d-c5943475d164 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:05:59.636181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e3443a4-9de2-4198-bd2d-c5943475d164 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:59.636675 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e3443a4-9de2-4198-bd2d-c5943475d164 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:59.637454 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e3443a4-9de2-4198-bd2d-c5943475d164 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:05:59.637935 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5e3443a4-9de2-4198-bd2d-c5943475d164 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:05:59.783160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5e3443a4-9de2-4198-bd2d-c5943475d164 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:05:59.791645 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5e3443a4-9de2-4198-bd2d-c5943475d164 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1727 microversion: 2.1 time: 0.167515 May 21 22:05:59.792259 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3332/6794] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:05:59 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:00.810009 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-644864ae-01d2-4a66-a40b-ab4f246d0917 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:00.810638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-644864ae-01d2-4a66-a40b-ab4f246d0917 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:00.817976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-644864ae-01d2-4a66-a40b-ab4f246d0917 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:00.818442 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-644864ae-01d2-4a66-a40b-ab4f246d0917 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:00.819264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-644864ae-01d2-4a66-a40b-ab4f246d0917 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:00.819725 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-644864ae-01d2-4a66-a40b-ab4f246d0917 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:00.964837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-644864ae-01d2-4a66-a40b-ab4f246d0917 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:00.973581 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-644864ae-01d2-4a66-a40b-ab4f246d0917 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1727 microversion: 2.1 time: 0.167491 May 21 22:06:00.974184 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3463/6795] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:00 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:02.002912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-17a439fa-871f-4e46-a6b4-4235f30786c2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:02.002912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-17a439fa-871f-4e46-a6b4-4235f30786c2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:02.002912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17a439fa-871f-4e46-a6b4-4235f30786c2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:02.002912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17a439fa-871f-4e46-a6b4-4235f30786c2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:02.002912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17a439fa-871f-4e46-a6b4-4235f30786c2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:02.002912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-17a439fa-871f-4e46-a6b4-4235f30786c2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:02.148996 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-17a439fa-871f-4e46-a6b4-4235f30786c2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:02.157145 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-17a439fa-871f-4e46-a6b4-4235f30786c2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1727 microversion: 2.1 time: 0.167962 May 21 22:06:02.157749 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3333/6796] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:01 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:03.175438 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9c5d30ae-6c72-4c4e-976e-7a88d0fc6956 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:03.176104 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9c5d30ae-6c72-4c4e-976e-7a88d0fc6956 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:03.183544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c5d30ae-6c72-4c4e-976e-7a88d0fc6956 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:03.184021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c5d30ae-6c72-4c4e-976e-7a88d0fc6956 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:03.184853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c5d30ae-6c72-4c4e-976e-7a88d0fc6956 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:03.185314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c5d30ae-6c72-4c4e-976e-7a88d0fc6956 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:03.329706 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9c5d30ae-6c72-4c4e-976e-7a88d0fc6956 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:03.338289 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9c5d30ae-6c72-4c4e-976e-7a88d0fc6956 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1727 microversion: 2.1 time: 0.167146 May 21 22:06:03.338884 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3464/6797] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:03 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:04.355447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0ee96f51-9e2f-4b77-80ec-73c9c8b8d898 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:04.356075 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0ee96f51-9e2f-4b77-80ec-73c9c8b8d898 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:04.363299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ee96f51-9e2f-4b77-80ec-73c9c8b8d898 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:04.363758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ee96f51-9e2f-4b77-80ec-73c9c8b8d898 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:04.364579 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ee96f51-9e2f-4b77-80ec-73c9c8b8d898 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:04.365022 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0ee96f51-9e2f-4b77-80ec-73c9c8b8d898 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:04.512514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0ee96f51-9e2f-4b77-80ec-73c9c8b8d898 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:04.520713 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0ee96f51-9e2f-4b77-80ec-73c9c8b8d898 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1727 microversion: 2.1 time: 0.169893 May 21 22:06:04.521293 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3334/6798] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:04 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:05.538496 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-979c1be7-7324-41a9-aa57-092cb3c37b12 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:05.539312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-979c1be7-7324-41a9-aa57-092cb3c37b12 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:05.546867 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-979c1be7-7324-41a9-aa57-092cb3c37b12 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:05.547345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-979c1be7-7324-41a9-aa57-092cb3c37b12 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:05.548147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-979c1be7-7324-41a9-aa57-092cb3c37b12 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:05.548645 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-979c1be7-7324-41a9-aa57-092cb3c37b12 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:05.697327 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-979c1be7-7324-41a9-aa57-092cb3c37b12 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:05.705471 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-979c1be7-7324-41a9-aa57-092cb3c37b12 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1727 microversion: 2.1 time: 0.170955 May 21 22:06:05.706044 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3465/6799] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:05 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:06.722599 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3669fcc4-b750-42fe-9f2c-146875f514e5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:06.723217 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3669fcc4-b750-42fe-9f2c-146875f514e5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:06.730456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3669fcc4-b750-42fe-9f2c-146875f514e5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:06.730910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3669fcc4-b750-42fe-9f2c-146875f514e5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:06.731688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3669fcc4-b750-42fe-9f2c-146875f514e5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:06.732127 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3669fcc4-b750-42fe-9f2c-146875f514e5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:06.884947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3669fcc4-b750-42fe-9f2c-146875f514e5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:06.893323 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3669fcc4-b750-42fe-9f2c-146875f514e5 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1727 microversion: 2.1 time: 0.174644 May 21 22:06:06.894099 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3335/6800] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:06 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:07.911765 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b19f72e1-4637-4de8-b077-7a6026837708 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:07.912435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b19f72e1-4637-4de8-b077-7a6026837708 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:07.919750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b19f72e1-4637-4de8-b077-7a6026837708 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:07.920224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b19f72e1-4637-4de8-b077-7a6026837708 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:07.921049 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b19f72e1-4637-4de8-b077-7a6026837708 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:07.921511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b19f72e1-4637-4de8-b077-7a6026837708 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:08.066918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b19f72e1-4637-4de8-b077-7a6026837708 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:08.075657 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b19f72e1-4637-4de8-b077-7a6026837708 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1727 microversion: 2.1 time: 0.167902 May 21 22:06:08.076236 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3466/6801] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:07 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:09.092878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9dfe624f-49b5-46db-8de2-3f817364990d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:09.093460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9dfe624f-49b5-46db-8de2-3f817364990d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:09.100620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9dfe624f-49b5-46db-8de2-3f817364990d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:09.101589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9dfe624f-49b5-46db-8de2-3f817364990d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:09.102475 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9dfe624f-49b5-46db-8de2-3f817364990d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:09.102924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9dfe624f-49b5-46db-8de2-3f817364990d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:09.246132 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9dfe624f-49b5-46db-8de2-3f817364990d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:09.254260 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9dfe624f-49b5-46db-8de2-3f817364990d tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1727 microversion: 2.1 time: 0.165381 May 21 22:06:09.254835 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3336/6802] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:09 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:10.271491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-84a768f0-d1ed-4e64-a89c-21ceacd16026 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:10.272047 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-84a768f0-d1ed-4e64-a89c-21ceacd16026 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:10.279535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84a768f0-d1ed-4e64-a89c-21ceacd16026 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:10.281470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84a768f0-d1ed-4e64-a89c-21ceacd16026 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:10.281470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84a768f0-d1ed-4e64-a89c-21ceacd16026 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:10.281935 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84a768f0-d1ed-4e64-a89c-21ceacd16026 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:10.436004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-84a768f0-d1ed-4e64-a89c-21ceacd16026 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:10.444757 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-84a768f0-d1ed-4e64-a89c-21ceacd16026 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1726 microversion: 2.1 time: 0.177110 May 21 22:06:10.445370 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3467/6803] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:10 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:10.980263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-ca84c8f3-9aa3-48f2-8be0-abff41fc4e12 req-53c1906c-c1dc-46a1-949b-631470d61ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e70a824f-5304-4114-9966-3dca15d418cc", "name": "network-vif-unplugged", "status": "completed", "tag": "75426369-ef84-45f7-a4a1-136620ca3579"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:06:10.989429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ca84c8f3-9aa3-48f2-8be0-abff41fc4e12 req-53c1906c-c1dc-46a1-949b-631470d61ac7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:10.989880 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-ca84c8f3-9aa3-48f2-8be0-abff41fc4e12 req-53c1906c-c1dc-46a1-949b-631470d61ac7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:11.001914 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-ca84c8f3-9aa3-48f2-8be0-abff41fc4e12 req-53c1906c-c1dc-46a1-949b-631470d61ac7 service nova] Creating event network-vif-unplugged:75426369-ef84-45f7-a4a1-136620ca3579 for instance e70a824f-5304-4114-9966-3dca15d418cc on nch2-master-1 May 21 22:06:11.007208 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [req-ca84c8f3-9aa3-48f2-8be0-abff41fc4e12 req-53c1906c-c1dc-46a1-949b-631470d61ac7 service nova] Instance e70a824f-5304-4114-9966-3dca15d418cc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 22:06:11.019215 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-ca84c8f3-9aa3-48f2-8be0-abff41fc4e12 req-53c1906c-c1dc-46a1-949b-631470d61ac7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043318 May 21 22:06:11.019824 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3337/6804] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:06:11.463449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f1363685-98a7-4428-9099-f65556724662 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:11.464610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f1363685-98a7-4428-9099-f65556724662 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:11.471967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1363685-98a7-4428-9099-f65556724662 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:11.472884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1363685-98a7-4428-9099-f65556724662 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:11.473839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1363685-98a7-4428-9099-f65556724662 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:11.474308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f1363685-98a7-4428-9099-f65556724662 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:11.623785 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f1363685-98a7-4428-9099-f65556724662 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:11.632630 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f1363685-98a7-4428-9099-f65556724662 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1726 microversion: 2.1 time: 0.173524 May 21 22:06:11.634464 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3468/6805] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:11 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:12.652714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c8340e3f-673d-4e46-a30c-3513f57b3f23 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:12.653425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c8340e3f-673d-4e46-a30c-3513f57b3f23 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:12.660053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8340e3f-673d-4e46-a30c-3513f57b3f23 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:12.660542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8340e3f-673d-4e46-a30c-3513f57b3f23 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:12.661334 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8340e3f-673d-4e46-a30c-3513f57b3f23 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:12.661774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c8340e3f-673d-4e46-a30c-3513f57b3f23 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:12.812329 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c8340e3f-673d-4e46-a30c-3513f57b3f23 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:12.821215 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c8340e3f-673d-4e46-a30c-3513f57b3f23 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1726 microversion: 2.1 time: 0.173214 May 21 22:06:12.821848 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3338/6806] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:12 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:13.034433 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-e58f8bb7-b0b9-4e58-ad64-03b1b221122a req-a7db45fe-47a6-4106-a1eb-554fa11b2dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e70a824f-5304-4114-9966-3dca15d418cc", "tag": "75426369-ef84-45f7-a4a1-136620ca3579"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:06:13.045124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-e58f8bb7-b0b9-4e58-ad64-03b1b221122a req-a7db45fe-47a6-4106-a1eb-554fa11b2dc3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:13.045592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-e58f8bb7-b0b9-4e58-ad64-03b1b221122a req-a7db45fe-47a6-4106-a1eb-554fa11b2dc3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:13.057887 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-e58f8bb7-b0b9-4e58-ad64-03b1b221122a req-a7db45fe-47a6-4106-a1eb-554fa11b2dc3 service nova] Creating event network-changed:75426369-ef84-45f7-a4a1-136620ca3579 for instance e70a824f-5304-4114-9966-3dca15d418cc on nch2-master-1 May 21 22:06:13.063353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [req-e58f8bb7-b0b9-4e58-ad64-03b1b221122a req-a7db45fe-47a6-4106-a1eb-554fa11b2dc3 service nova] Instance e70a824f-5304-4114-9966-3dca15d418cc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 22:06:13.074609 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-e58f8bb7-b0b9-4e58-ad64-03b1b221122a req-a7db45fe-47a6-4106-a1eb-554fa11b2dc3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044260 May 21 22:06:13.075222 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3469/6807] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:06:13.838586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-09510346-5e3d-4a27-b11f-012e46660def tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:13.839138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-09510346-5e3d-4a27-b11f-012e46660def tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:13.841962 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=31 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:06:13.846943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-09510346-5e3d-4a27-b11f-012e46660def tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:13.847401 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-09510346-5e3d-4a27-b11f-012e46660def tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:13.848173 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-09510346-5e3d-4a27-b11f-012e46660def tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:13.848768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-09510346-5e3d-4a27-b11f-012e46660def tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:13.852917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:06:13.998294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-09510346-5e3d-4a27-b11f-012e46660def tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:14.006582 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-09510346-5e3d-4a27-b11f-012e46660def tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1724 microversion: 2.1 time: 0.172076 May 21 22:06:14.007185 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3339/6808] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:13 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:15.074862 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ed926825-cf1d-4e79-95d4-25a2b2a7a9df tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:15.075584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ed926825-cf1d-4e79-95d4-25a2b2a7a9df tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:15.077664 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=27 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:06:15.082851 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed926825-cf1d-4e79-95d4-25a2b2a7a9df tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:15.083324 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed926825-cf1d-4e79-95d4-25a2b2a7a9df tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:15.084110 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed926825-cf1d-4e79-95d4-25a2b2a7a9df tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:15.084598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ed926825-cf1d-4e79-95d4-25a2b2a7a9df tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:15.089514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:06:15.238774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ed926825-cf1d-4e79-95d4-25a2b2a7a9df tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:15.247801 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ed926825-cf1d-4e79-95d4-25a2b2a7a9df tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1724 microversion: 2.1 time: 0.226791 May 21 22:06:15.248393 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3470/6809] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:15 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:16.264515 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-48b6b6c7-f4df-4f8a-9e91-30b004749240 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:16.265140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-48b6b6c7-f4df-4f8a-9e91-30b004749240 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:16.272732 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-48b6b6c7-f4df-4f8a-9e91-30b004749240 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:16.273189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-48b6b6c7-f4df-4f8a-9e91-30b004749240 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:16.273973 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-48b6b6c7-f4df-4f8a-9e91-30b004749240 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:16.274416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-48b6b6c7-f4df-4f8a-9e91-30b004749240 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:16.427842 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-48b6b6c7-f4df-4f8a-9e91-30b004749240 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:16.436681 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-48b6b6c7-f4df-4f8a-9e91-30b004749240 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1724 microversion: 2.1 time: 0.176078 May 21 22:06:16.437270 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3340/6810] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:16 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:17.454812 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-569189b5-ce5f-43ba-b997-fa880deea3ca tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:17.455456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-569189b5-ce5f-43ba-b997-fa880deea3ca tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:17.464102 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-569189b5-ce5f-43ba-b997-fa880deea3ca tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:17.464649 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-569189b5-ce5f-43ba-b997-fa880deea3ca tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:17.465597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-569189b5-ce5f-43ba-b997-fa880deea3ca tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:17.466097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-569189b5-ce5f-43ba-b997-fa880deea3ca tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:17.612006 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-569189b5-ce5f-43ba-b997-fa880deea3ca tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:17.620554 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-569189b5-ce5f-43ba-b997-fa880deea3ca tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1721 microversion: 2.1 time: 0.169827 May 21 22:06:17.621132 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3471/6811] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:17 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:17.637151 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fba2b5fb-3498-4a24-a01a-2c700041349e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:06:17.637726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fba2b5fb-3498-4a24-a01a-2c700041349e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:17.644869 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fba2b5fb-3498-4a24-a01a-2c700041349e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:17.645330 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fba2b5fb-3498-4a24-a01a-2c700041349e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:17.646108 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fba2b5fb-3498-4a24-a01a-2c700041349e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:17.646554 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fba2b5fb-3498-4a24-a01a-2c700041349e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:17.685545 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fba2b5fb-3498-4a24-a01a-2c700041349e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:17.693308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fba2b5fb-3498-4a24-a01a-2c700041349e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:17.693308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fba2b5fb-3498-4a24-a01a-2c700041349e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:17.693308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fba2b5fb-3498-4a24-a01a-2c700041349e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:17.708671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-fba2b5fb-3498-4a24-a01a-2c700041349e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Getting quotas for project cb9f2d0a8dca4c85a47c2d138d1b39cd. Resources: {'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:06:17.714587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-fba2b5fb-3498-4a24-a01a-2c700041349e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Getting quotas for user 1fd1bb72fc464808988a1579524c7939 and project cb9f2d0a8dca4c85a47c2d138d1b39cd. Resources: {'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:06:18.136461 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fba2b5fb-3498-4a24-a01a-2c700041349e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "POST /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc/action" status: 202 len: 0 microversion: 2.1 time: 0.503270 May 21 22:06:18.137075 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3341/6812] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:06:17 2022] POST /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:06:18.145465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-95a96f92-0889-43b5-b50f-a0459480e1dc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:18.150204 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-95a96f92-0889-43b5-b50f-a0459480e1dc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:18.153145 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-95a96f92-0889-43b5-b50f-a0459480e1dc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:18.153619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-95a96f92-0889-43b5-b50f-a0459480e1dc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:18.154421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-95a96f92-0889-43b5-b50f-a0459480e1dc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:18.154902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-95a96f92-0889-43b5-b50f-a0459480e1dc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:18.302587 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-95a96f92-0889-43b5-b50f-a0459480e1dc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:18.310929 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-95a96f92-0889-43b5-b50f-a0459480e1dc tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1720 microversion: 2.1 time: 0.169518 May 21 22:06:18.311599 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3472/6813] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:18 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:19.330233 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ca3d290d-99d5-4fae-b41f-9ffdce34bf77 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:19.331059 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ca3d290d-99d5-4fae-b41f-9ffdce34bf77 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:19.338501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca3d290d-99d5-4fae-b41f-9ffdce34bf77 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:19.338956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca3d290d-99d5-4fae-b41f-9ffdce34bf77 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:19.339729 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca3d290d-99d5-4fae-b41f-9ffdce34bf77 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:19.340172 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca3d290d-99d5-4fae-b41f-9ffdce34bf77 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:19.482397 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ca3d290d-99d5-4fae-b41f-9ffdce34bf77 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:19.490612 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ca3d290d-99d5-4fae-b41f-9ffdce34bf77 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1720 microversion: 2.1 time: 0.165463 May 21 22:06:19.491190 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3342/6814] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:19 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:20.512255 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a4c41458-5da5-415f-8cdd-26514fe16a33 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:20.514055 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a4c41458-5da5-415f-8cdd-26514fe16a33 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:20.521519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a4c41458-5da5-415f-8cdd-26514fe16a33 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:20.521998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a4c41458-5da5-415f-8cdd-26514fe16a33 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:20.522808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a4c41458-5da5-415f-8cdd-26514fe16a33 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:20.523809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a4c41458-5da5-415f-8cdd-26514fe16a33 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:20.677632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a4c41458-5da5-415f-8cdd-26514fe16a33 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:20.686297 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a4c41458-5da5-415f-8cdd-26514fe16a33 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1720 microversion: 2.1 time: 0.181000 May 21 22:06:20.686916 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3473/6815] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:20 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:21.704270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-06102dd2-ea65-4896-9bfb-c7e306ea5900 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:21.704935 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-06102dd2-ea65-4896-9bfb-c7e306ea5900 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:21.712147 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06102dd2-ea65-4896-9bfb-c7e306ea5900 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:21.712635 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06102dd2-ea65-4896-9bfb-c7e306ea5900 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:21.713410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06102dd2-ea65-4896-9bfb-c7e306ea5900 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:21.713856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-06102dd2-ea65-4896-9bfb-c7e306ea5900 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:21.863982 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-06102dd2-ea65-4896-9bfb-c7e306ea5900 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:21.873578 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-06102dd2-ea65-4896-9bfb-c7e306ea5900 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1720 microversion: 2.1 time: 0.173005 May 21 22:06:21.874160 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3343/6816] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:21 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:22.890889 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4d37c862-11ff-4fb9-b80e-79792e0137f4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:22.891520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4d37c862-11ff-4fb9-b80e-79792e0137f4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:22.899729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d37c862-11ff-4fb9-b80e-79792e0137f4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:22.900266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d37c862-11ff-4fb9-b80e-79792e0137f4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:22.901049 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d37c862-11ff-4fb9-b80e-79792e0137f4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:22.901509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4d37c862-11ff-4fb9-b80e-79792e0137f4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:23.183463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4d37c862-11ff-4fb9-b80e-79792e0137f4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:23.192758 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4d37c862-11ff-4fb9-b80e-79792e0137f4 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1720 microversion: 2.1 time: 0.305675 May 21 22:06:23.193340 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3474/6817] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:22 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1720 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:23.471969 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-9690868a-e021-404d-b598-586346a6ffae req-9f36c66d-bca9-4c16-9225-94d811c433e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e70a824f-5304-4114-9966-3dca15d418cc", "tag": "75426369-ef84-45f7-a4a1-136620ca3579"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:06:23.495755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9690868a-e021-404d-b598-586346a6ffae req-9f36c66d-bca9-4c16-9225-94d811c433e5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:23.495755 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9690868a-e021-404d-b598-586346a6ffae req-9f36c66d-bca9-4c16-9225-94d811c433e5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:23.509534 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-9690868a-e021-404d-b598-586346a6ffae req-9f36c66d-bca9-4c16-9225-94d811c433e5 service nova] Creating event network-changed:75426369-ef84-45f7-a4a1-136620ca3579 for instance e70a824f-5304-4114-9966-3dca15d418cc on nch1-master-1 May 21 22:06:23.516586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [req-9690868a-e021-404d-b598-586346a6ffae req-9f36c66d-bca9-4c16-9225-94d811c433e5 service nova] Instance e70a824f-5304-4114-9966-3dca15d418cc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 22:06:23.530010 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-9690868a-e021-404d-b598-586346a6ffae req-9f36c66d-bca9-4c16-9225-94d811c433e5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061976 May 21 22:06:23.531029 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3344/6818] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:06:24.210930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e1134baf-c360-430b-a7a4-2c1206c8b531 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:24.211568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e1134baf-c360-430b-a7a4-2c1206c8b531 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:24.218501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1134baf-c360-430b-a7a4-2c1206c8b531 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:24.219168 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1134baf-c360-430b-a7a4-2c1206c8b531 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:24.219975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1134baf-c360-430b-a7a4-2c1206c8b531 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:24.220487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e1134baf-c360-430b-a7a4-2c1206c8b531 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:24.487673 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e1134baf-c360-430b-a7a4-2c1206c8b531 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:24.497348 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e1134baf-c360-430b-a7a4-2c1206c8b531 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1720 microversion: 2.1 time: 0.290920 May 21 22:06:24.498022 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3475/6819] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:24 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1720 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:25.516002 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1241a520-a7c3-4b1a-aac1-45c8fb66a6db tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:25.516666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1241a520-a7c3-4b1a-aac1-45c8fb66a6db tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:25.523861 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1241a520-a7c3-4b1a-aac1-45c8fb66a6db tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:25.524349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1241a520-a7c3-4b1a-aac1-45c8fb66a6db tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:25.525127 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1241a520-a7c3-4b1a-aac1-45c8fb66a6db tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:25.525601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1241a520-a7c3-4b1a-aac1-45c8fb66a6db tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:25.667829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1241a520-a7c3-4b1a-aac1-45c8fb66a6db tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:25.676033 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1241a520-a7c3-4b1a-aac1-45c8fb66a6db tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1720 microversion: 2.1 time: 0.165244 May 21 22:06:25.676638 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3345/6820] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:25 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:26.693486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9c9bcf42-7bd2-4f85-a0c7-fa6a44193079 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:26.694112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9c9bcf42-7bd2-4f85-a0c7-fa6a44193079 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:26.702026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c9bcf42-7bd2-4f85-a0c7-fa6a44193079 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:26.702490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c9bcf42-7bd2-4f85-a0c7-fa6a44193079 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:26.703267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c9bcf42-7bd2-4f85-a0c7-fa6a44193079 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:26.703720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9c9bcf42-7bd2-4f85-a0c7-fa6a44193079 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:26.844669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9c9bcf42-7bd2-4f85-a0c7-fa6a44193079 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:26.853420 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9c9bcf42-7bd2-4f85-a0c7-fa6a44193079 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1720 microversion: 2.1 time: 0.164167 May 21 22:06:26.854009 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3476/6821] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:26 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:27.871805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bb327974-0b15-48fa-8cfc-4713675597d9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:27.877144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bb327974-0b15-48fa-8cfc-4713675597d9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:27.877144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:06:27.880721 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb327974-0b15-48fa-8cfc-4713675597d9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:27.881233 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb327974-0b15-48fa-8cfc-4713675597d9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:27.882135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb327974-0b15-48fa-8cfc-4713675597d9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:27.882686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb327974-0b15-48fa-8cfc-4713675597d9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:28.041529 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bb327974-0b15-48fa-8cfc-4713675597d9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:28.050951 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bb327974-0b15-48fa-8cfc-4713675597d9 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1720 microversion: 2.1 time: 0.183982 May 21 22:06:28.054576 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3346/6822] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:27 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:29.069223 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-674ad346-9d2a-4300-9d15-6082c34f5e7f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:29.070555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-674ad346-9d2a-4300-9d15-6082c34f5e7f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:29.077223 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-674ad346-9d2a-4300-9d15-6082c34f5e7f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:29.077692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-674ad346-9d2a-4300-9d15-6082c34f5e7f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:29.078482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-674ad346-9d2a-4300-9d15-6082c34f5e7f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:29.078943 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-674ad346-9d2a-4300-9d15-6082c34f5e7f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:29.224981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-674ad346-9d2a-4300-9d15-6082c34f5e7f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:29.233668 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-674ad346-9d2a-4300-9d15-6082c34f5e7f tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1713 microversion: 2.1 time: 0.168650 May 21 22:06:29.234272 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3477/6823] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:29 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1713 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:29.250456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d3b02980-4603-4004-a8d7-1df8798c3c00 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:29.251081 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d3b02980-4603-4004-a8d7-1df8798c3c00 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:29.258088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3b02980-4603-4004-a8d7-1df8798c3c00 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:29.258544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3b02980-4603-4004-a8d7-1df8798c3c00 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:29.259324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3b02980-4603-4004-a8d7-1df8798c3c00 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:29.259777 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3b02980-4603-4004-a8d7-1df8798c3c00 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:29.407356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d3b02980-4603-4004-a8d7-1df8798c3c00 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:29.416191 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d3b02980-4603-4004-a8d7-1df8798c3c00 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1713 microversion: 2.1 time: 0.169650 May 21 22:06:29.420994 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3347/6824] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:29 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1713 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:29.435384 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cd7fc665-6a85-4c68-94cb-e04aad3db79a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:29.436018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cd7fc665-6a85-4c68-94cb-e04aad3db79a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:29.442516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd7fc665-6a85-4c68-94cb-e04aad3db79a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:29.442981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd7fc665-6a85-4c68-94cb-e04aad3db79a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:29.443768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd7fc665-6a85-4c68-94cb-e04aad3db79a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:29.444232 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd7fc665-6a85-4c68-94cb-e04aad3db79a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:29.592828 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cd7fc665-6a85-4c68-94cb-e04aad3db79a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:29.601671 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cd7fc665-6a85-4c68-94cb-e04aad3db79a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1713 microversion: 2.1 time: 0.169477 May 21 22:06:29.602171 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3478/6825] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:29 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1713 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:29.618173 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-03a0902f-2721-4596-a8aa-696695ed2cba tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:29.618683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-03a0902f-2721-4596-a8aa-696695ed2cba tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:29.624984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03a0902f-2721-4596-a8aa-696695ed2cba tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:29.625442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03a0902f-2721-4596-a8aa-696695ed2cba tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:29.626223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03a0902f-2721-4596-a8aa-696695ed2cba tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:29.626693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-03a0902f-2721-4596-a8aa-696695ed2cba tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:29.652767 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-03a0902f-2721-4596-a8aa-696695ed2cba tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 22:06:29.869386 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-03a0902f-2721-4596-a8aa-696695ed2cba tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 204 len: 0 microversion: 2.1 time: 0.255029 May 21 22:06:29.878605 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3348/6826] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:06:29 2022] DELETE /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 21 22:06:29.878732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2a62f774-85e3-4ba9-b852-e72d6bd7e8c2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:29.879283 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2a62f774-85e3-4ba9-b852-e72d6bd7e8c2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:29.886968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a62f774-85e3-4ba9-b852-e72d6bd7e8c2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:29.887705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a62f774-85e3-4ba9-b852-e72d6bd7e8c2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:29.888704 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a62f774-85e3-4ba9-b852-e72d6bd7e8c2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:29.889195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a62f774-85e3-4ba9-b852-e72d6bd7e8c2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:30.039663 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2a62f774-85e3-4ba9-b852-e72d6bd7e8c2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:30.047874 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2a62f774-85e3-4ba9-b852-e72d6bd7e8c2 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1719 microversion: 2.1 time: 0.173414 May 21 22:06:30.057931 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3479/6827] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:29 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:31.067427 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-14a31f82-3517-41d1-aa5a-66162fb3464a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:31.068161 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-14a31f82-3517-41d1-aa5a-66162fb3464a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:31.076989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14a31f82-3517-41d1-aa5a-66162fb3464a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:31.077439 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14a31f82-3517-41d1-aa5a-66162fb3464a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:31.078209 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14a31f82-3517-41d1-aa5a-66162fb3464a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:31.078644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-14a31f82-3517-41d1-aa5a-66162fb3464a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:31.222897 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-14a31f82-3517-41d1-aa5a-66162fb3464a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:31.231665 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-14a31f82-3517-41d1-aa5a-66162fb3464a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1719 microversion: 2.1 time: 0.168889 May 21 22:06:31.232240 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3349/6828] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:31 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:06:32.249213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0a0257be-f445-41fe-8f26-83ff9f1e872a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:32.249860 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0a0257be-f445-41fe-8f26-83ff9f1e872a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:32.256984 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a0257be-f445-41fe-8f26-83ff9f1e872a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:32.257462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a0257be-f445-41fe-8f26-83ff9f1e872a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:32.258272 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a0257be-f445-41fe-8f26-83ff9f1e872a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:32.258731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0a0257be-f445-41fe-8f26-83ff9f1e872a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:32.370163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0a0257be-f445-41fe-8f26-83ff9f1e872a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:32.382302 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0a0257be-f445-41fe-8f26-83ff9f1e872a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1652 microversion: 2.1 time: 0.136568 May 21 22:06:32.392237 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3480/6829] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:32 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1652 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:32.588646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-a5654e2d-de16-4a31-a333-a71a7a0f5b5f req-2c2ef541-2569-4f6c-a0c1-f42e91ed1b48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e70a824f-5304-4114-9966-3dca15d418cc", "name": "network-vif-deleted", "tag": "75426369-ef84-45f7-a4a1-136620ca3579"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:06:32.597923 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a5654e2d-de16-4a31-a333-a71a7a0f5b5f req-2c2ef541-2569-4f6c-a0c1-f42e91ed1b48 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:32.598369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a5654e2d-de16-4a31-a333-a71a7a0f5b5f req-2c2ef541-2569-4f6c-a0c1-f42e91ed1b48 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:32.609719 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-a5654e2d-de16-4a31-a333-a71a7a0f5b5f req-2c2ef541-2569-4f6c-a0c1-f42e91ed1b48 service nova] Creating event network-vif-deleted:75426369-ef84-45f7-a4a1-136620ca3579 for instance e70a824f-5304-4114-9966-3dca15d418cc on nch1-master-1 May 21 22:06:32.614708 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-a5654e2d-de16-4a31-a333-a71a7a0f5b5f req-2c2ef541-2569-4f6c-a0c1-f42e91ed1b48 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030323 May 21 22:06:32.615362 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3350/6830] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:06:33.399993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d7ac3756-63a0-4c98-b38a-7c17d1625348 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:33.400665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d7ac3756-63a0-4c98-b38a-7c17d1625348 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:33.407981 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7ac3756-63a0-4c98-b38a-7c17d1625348 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:33.408493 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7ac3756-63a0-4c98-b38a-7c17d1625348 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:33.409424 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7ac3756-63a0-4c98-b38a-7c17d1625348 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:33.409822 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7ac3756-63a0-4c98-b38a-7c17d1625348 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:33.443074 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7ac3756-63a0-4c98-b38a-7c17d1625348 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:33.444370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d7ac3756-63a0-4c98-b38a-7c17d1625348 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:33.444370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-d7ac3756-63a0-4c98-b38a-7c17d1625348 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lazy-loading 'fault' on Instance uuid e70a824f-5304-4114-9966-3dca15d418cc {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 22:06:33.498531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d7ac3756-63a0-4c98-b38a-7c17d1625348 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1bb72fc464808988a1579524c7939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9f2d0a8dca4c85a47c2d138d1b39cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:33.507899 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d7ac3756-63a0-4c98-b38a-7c17d1625348 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 200 len: 1373 microversion: 2.1 time: 0.112461 May 21 22:06:33.511637 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3481/6831] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:33 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 1373 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:34.525896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4cb26464-f821-42a9-90f5-5ebdb7c29808 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:34.526611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4cb26464-f821-42a9-90f5-5ebdb7c29808 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:34.533686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cb26464-f821-42a9-90f5-5ebdb7c29808 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:34.534142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cb26464-f821-42a9-90f5-5ebdb7c29808 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:34.534916 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cb26464-f821-42a9-90f5-5ebdb7c29808 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:34.535360 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cb26464-f821-42a9-90f5-5ebdb7c29808 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:34.549197 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-4cb26464-f821-42a9-90f5-5ebdb7c29808 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] HTTP exception thrown: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4cb26464-f821-42a9-90f5-5ebdb7c29808 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Request method failure captured: May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc HTTP/1.1 May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWEqg4H5ib8lBeBY5hWnlzTjb_0SYMAu1PXPchB7RzXjO9Fc2uRmCYI6YXq0eyS1H44OjCoLWXG04d9ut0CknArKFnB7d8KFC2oZLDhogrvccuHSLlGl5ORpF14bspFXBZezQCKhKDgRiiLFY_0g2s6h-a-kpGbnJaHmPkp_ile5A_0 May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb9f2d0a8dca4c85a47c2d138d1b39cd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerActionsTestJSON-532218768 May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerActionsTestJSON-532218768-project May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1fd1bb72fc464808988a1579524c7939 May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerActionsTestJSON-532218768-project May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'e70a824f-5304-4114-9966-3dca15d418cc'} May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:06:34.550806 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:34.556050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:34.556050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:06:34.556050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:06:34.556050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:06:34.556050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:06:34.556050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. May 21 22:06:34.556050 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:34.556050 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4cb26464-f821-42a9-90f5-5ebdb7c29808 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Returning 404 to user: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:06:34.556050 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4cb26464-f821-42a9-90f5-5ebdb7c29808 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 404 len: 111 microversion: 2.1 time: 0.030678 May 21 22:06:34.556050 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3351/6832] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:34 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:06:34.609667 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-869742c8-1357-4d3e-936c-3f6657b3540e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:34.610681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-869742c8-1357-4d3e-936c-3f6657b3540e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:34.618256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-869742c8-1357-4d3e-936c-3f6657b3540e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:34.618735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-869742c8-1357-4d3e-936c-3f6657b3540e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:34.619517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-869742c8-1357-4d3e-936c-3f6657b3540e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:34.619976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-869742c8-1357-4d3e-936c-3f6657b3540e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:34.632706 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-869742c8-1357-4d3e-936c-3f6657b3540e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] HTTP exception thrown: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-869742c8-1357-4d3e-936c-3f6657b3540e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Request method failure captured: May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc/os-volume_attachments HTTP/1.1 May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiWEqg4H5ib8lBeBY5hWnlzTjb_0SYMAu1PXPchB7RzXjO9Fc2uRmCYI6YXq0eyS1H44OjCoLWXG04d9ut0CknArKFnB7d8KFC2oZLDhogrvccuHSLlGl5ORpF14bspFXBZezQCKhKDgRiiLFY_0g2s6h-a-kpGbnJaHmPkp_ile5A_0 May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb9f2d0a8dca4c85a47c2d138d1b39cd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerActionsTestJSON-532218768 May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerActionsTestJSON-532218768-project May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 1fd1bb72fc464808988a1579524c7939 May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerActionsTestJSON-532218768-project May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'server_id': 'e70a824f-5304-4114-9966-3dca15d418cc'} May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:06:34.634396 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. May 21 22:06:34.638468 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:34.638468 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:06:34.638468 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:34.638468 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:34.638468 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:06:34.638468 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:06:34.638468 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:06:34.638468 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:06:34.638468 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. May 21 22:06:34.638468 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:34.638468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-869742c8-1357-4d3e-936c-3f6657b3540e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Returning 404 to user: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:06:34.638468 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-869742c8-1357-4d3e-936c-3f6657b3540e tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030199 May 21 22:06:34.638468 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3482/6833] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 22:06:34 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:06:38.078341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-df4251c3-308a-480c-a26b-c230816a578a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:38.078977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-df4251c3-308a-480c-a26b-c230816a578a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:38.087112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df4251c3-308a-480c-a26b-c230816a578a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:38.087571 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df4251c3-308a-480c-a26b-c230816a578a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:38.088377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df4251c3-308a-480c-a26b-c230816a578a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:38.088826 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-df4251c3-308a-480c-a26b-c230816a578a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:38.102992 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-df4251c3-308a-480c-a26b-c230816a578a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] HTTP exception thrown: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-df4251c3-308a-480c-a26b-c230816a578a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Request method failure captured: May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc HTTP/1.1 May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWEqg4H5ib8lBeBY5hWnlzTjb_0SYMAu1PXPchB7RzXjO9Fc2uRmCYI6YXq0eyS1H44OjCoLWXG04d9ut0CknArKFnB7d8KFC2oZLDhogrvccuHSLlGl5ORpF14bspFXBZezQCKhKDgRiiLFY_0g2s6h-a-kpGbnJaHmPkp_ile5A_0 May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb9f2d0a8dca4c85a47c2d138d1b39cd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerActionsTestJSON-532218768-project May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1fd1bb72fc464808988a1579524c7939 May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerActionsTestJSON-532218768-project May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'e70a824f-5304-4114-9966-3dca15d418cc'} May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:06:38.104650 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:06:38.108590 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. May 21 22:06:38.108590 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:38.108590 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:06:38.108590 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:38.108590 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.108590 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:06:38.108590 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:06:38.108590 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:06:38.108590 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:06:38.108590 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. May 21 22:06:38.108590 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:38.108590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-df4251c3-308a-480c-a26b-c230816a578a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Returning 404 to user: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:06:38.108590 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-df4251c3-308a-480c-a26b-c230816a578a tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 404 len: 111 microversion: 2.1 time: 0.031661 May 21 22:06:38.108590 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3352/6834] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:06:38 2022] DELETE /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:06:38.114727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9f1c6811-1efe-4d0d-9c2c-faf69f7714ce tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:38.115361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9f1c6811-1efe-4d0d-9c2c-faf69f7714ce tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: e70a824f-5304-4114-9966-3dca15d418cc] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:38.123074 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f1c6811-1efe-4d0d-9c2c-faf69f7714ce tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:38.123611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f1c6811-1efe-4d0d-9c2c-faf69f7714ce tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:38.124363 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f1c6811-1efe-4d0d-9c2c-faf69f7714ce tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:38.124815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9f1c6811-1efe-4d0d-9c2c-faf69f7714ce tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:38.139446 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-9f1c6811-1efe-4d0d-9c2c-faf69f7714ce tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] HTTP exception thrown: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9f1c6811-1efe-4d0d-9c2c-faf69f7714ce tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Request method failure captured: May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc HTTP/1.1 May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiWEqg4H5ib8lBeBY5hWnlzTjb_0SYMAu1PXPchB7RzXjO9Fc2uRmCYI6YXq0eyS1H44OjCoLWXG04d9ut0CknArKFnB7d8KFC2oZLDhogrvccuHSLlGl5ORpF14bspFXBZezQCKhKDgRiiLFY_0g2s6h-a-kpGbnJaHmPkp_ile5A_0 May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb9f2d0a8dca4c85a47c2d138d1b39cd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerActionsTestJSON-532218768-project May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 1fd1bb72fc464808988a1579524c7939 May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerActionsTestJSON-532218768-project May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'e70a824f-5304-4114-9966-3dca15d418cc'} May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:06:38.141023 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:38.145391 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.145391 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:06:38.145391 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:06:38.145391 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:06:38.145391 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:06:38.145391 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. May 21 22:06:38.145391 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:38.145391 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9f1c6811-1efe-4d0d-9c2c-faf69f7714ce tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Returning 404 to user: Instance e70a824f-5304-4114-9966-3dca15d418cc could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:06:38.145391 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9f1c6811-1efe-4d0d-9c2c-faf69f7714ce tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc" status: 404 len: 111 microversion: 2.1 time: 0.031650 May 21 22:06:38.145391 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3483/6835] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:38 2022] GET /compute/v2.1/servers/e70a824f-5304-4114-9966-3dca15d418cc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:06:38.151619 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-41051231-37e5-46da-b23e-9215ec4f4414 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:38.152122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-41051231-37e5-46da-b23e-9215ec4f4414 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:38.158337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41051231-37e5-46da-b23e-9215ec4f4414 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:38.158798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41051231-37e5-46da-b23e-9215ec4f4414 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:38.159664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41051231-37e5-46da-b23e-9215ec4f4414 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:38.160111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-41051231-37e5-46da-b23e-9215ec4f4414 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:38.174187 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-41051231-37e5-46da-b23e-9215ec4f4414 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] HTTP exception thrown: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-41051231-37e5-46da-b23e-9215ec4f4414 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Request method failure captured: May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b HTTP/1.1 May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWEqg4H5ib8lBeBY5hWnlzTjb_0SYMAu1PXPchB7RzXjO9Fc2uRmCYI6YXq0eyS1H44OjCoLWXG04d9ut0CknArKFnB7d8KFC2oZLDhogrvccuHSLlGl5ORpF14bspFXBZezQCKhKDgRiiLFY_0g2s6h-a-kpGbnJaHmPkp_ile5A_0 May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb9f2d0a8dca4c85a47c2d138d1b39cd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerActionsTestJSON-532218768-project May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1fd1bb72fc464808988a1579524c7939 May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerActionsTestJSON-532218768-project May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '27a14db0-90ed-4356-aa6e-d9c46b27f98b'} May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:06:38.175714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:06:38.180129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. May 21 22:06:38.180129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:38.180129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:06:38.180129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:38.180129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.180129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:06:38.180129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:06:38.180129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:06:38.180129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:06:38.180129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. May 21 22:06:38.180129 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:38.180129 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-41051231-37e5-46da-b23e-9215ec4f4414 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Returning 404 to user: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:06:38.180129 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-41051231-37e5-46da-b23e-9215ec4f4414 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "DELETE /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 404 len: 111 microversion: 2.1 time: 0.030149 May 21 22:06:38.180129 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3353/6836] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:06:38 2022] DELETE /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:06:38.186062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-263b3c52-1ddb-4542-9c7b-06f131617bd6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:38.186689 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-263b3c52-1ddb-4542-9c7b-06f131617bd6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 27a14db0-90ed-4356-aa6e-d9c46b27f98b] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:38.193189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-263b3c52-1ddb-4542-9c7b-06f131617bd6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:38.193597 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-263b3c52-1ddb-4542-9c7b-06f131617bd6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:38.194925 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-263b3c52-1ddb-4542-9c7b-06f131617bd6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:38.195955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-263b3c52-1ddb-4542-9c7b-06f131617bd6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:38.209255 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-263b3c52-1ddb-4542-9c7b-06f131617bd6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] HTTP exception thrown: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-263b3c52-1ddb-4542-9c7b-06f131617bd6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Request method failure captured: May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b HTTP/1.1 May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiWEqg4H5ib8lBeBY5hWnlzTjb_0SYMAu1PXPchB7RzXjO9Fc2uRmCYI6YXq0eyS1H44OjCoLWXG04d9ut0CknArKFnB7d8KFC2oZLDhogrvccuHSLlGl5ORpF14bspFXBZezQCKhKDgRiiLFY_0g2s6h-a-kpGbnJaHmPkp_ile5A_0 May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb9f2d0a8dca4c85a47c2d138d1b39cd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerActionsTestJSON-532218768-project May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 1fd1bb72fc464808988a1579524c7939 May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerActionsTestJSON-532218768-project May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '27a14db0-90ed-4356-aa6e-d9c46b27f98b'} May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:06:38.211314 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:38.215776 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.215776 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:06:38.215776 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:06:38.215776 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:06:38.215776 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:06:38.215776 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. May 21 22:06:38.215776 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:38.215776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-263b3c52-1ddb-4542-9c7b-06f131617bd6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Returning 404 to user: Instance 27a14db0-90ed-4356-aa6e-d9c46b27f98b could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:06:38.215776 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-263b3c52-1ddb-4542-9c7b-06f131617bd6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b" status: 404 len: 111 microversion: 2.1 time: 0.030537 May 21 22:06:38.215776 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3484/6837] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:38 2022] GET /compute/v2.1/servers/27a14db0-90ed-4356-aa6e-d9c46b27f98b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:06:38.221301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9a4c5667-d4e4-4557-b29d-9b16f6cb00f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:38.221868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9a4c5667-d4e4-4557-b29d-9b16f6cb00f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:38.228893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a4c5667-d4e4-4557-b29d-9b16f6cb00f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:38.229355 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a4c5667-d4e4-4557-b29d-9b16f6cb00f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:38.230237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a4c5667-d4e4-4557-b29d-9b16f6cb00f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:38.230689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a4c5667-d4e4-4557-b29d-9b16f6cb00f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:38.234857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:06:38.245047 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-9a4c5667-d4e4-4557-b29d-9b16f6cb00f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] HTTP exception thrown: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9a4c5667-d4e4-4557-b29d-9b16f6cb00f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Request method failure captured: May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 HTTP/1.1 May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWEqg4H5ib8lBeBY5hWnlzTjb_0SYMAu1PXPchB7RzXjO9Fc2uRmCYI6YXq0eyS1H44OjCoLWXG04d9ut0CknArKFnB7d8KFC2oZLDhogrvccuHSLlGl5ORpF14bspFXBZezQCKhKDgRiiLFY_0g2s6h-a-kpGbnJaHmPkp_ile5A_0 May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb9f2d0a8dca4c85a47c2d138d1b39cd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerActionsTestJSON-532218768-project May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1fd1bb72fc464808988a1579524c7939 May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerActionsTestJSON-532218768-project May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'a924b75f-2e0c-4b96-91db-d9e415a8d092'} May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:06:38.246584 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:06:38.250888 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. May 21 22:06:38.250888 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:38.250888 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:06:38.250888 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:38.250888 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.250888 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:06:38.250888 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:06:38.250888 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:06:38.250888 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:06:38.250888 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. May 21 22:06:38.250888 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:38.250888 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9a4c5667-d4e4-4557-b29d-9b16f6cb00f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Returning 404 to user: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:06:38.250888 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9a4c5667-d4e4-4557-b29d-9b16f6cb00f1 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 404 len: 111 microversion: 2.1 time: 0.030620 May 21 22:06:38.250888 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3354/6838] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:06:38 2022] DELETE /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:06:38.256502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-358f3a1c-b647-42e4-a3cc-f3c2f5ff017c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:38.257399 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-358f3a1c-b647-42e4-a3cc-f3c2f5ff017c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: a924b75f-2e0c-4b96-91db-d9e415a8d092] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:38.263667 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-358f3a1c-b647-42e4-a3cc-f3c2f5ff017c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:38.264141 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-358f3a1c-b647-42e4-a3cc-f3c2f5ff017c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:38.264962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-358f3a1c-b647-42e4-a3cc-f3c2f5ff017c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:38.265426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-358f3a1c-b647-42e4-a3cc-f3c2f5ff017c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:38.279114 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-358f3a1c-b647-42e4-a3cc-f3c2f5ff017c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] HTTP exception thrown: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-358f3a1c-b647-42e4-a3cc-f3c2f5ff017c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Request method failure captured: May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 HTTP/1.1 May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiWEqg4H5ib8lBeBY5hWnlzTjb_0SYMAu1PXPchB7RzXjO9Fc2uRmCYI6YXq0eyS1H44OjCoLWXG04d9ut0CknArKFnB7d8KFC2oZLDhogrvccuHSLlGl5ORpF14bspFXBZezQCKhKDgRiiLFY_0g2s6h-a-kpGbnJaHmPkp_ile5A_0 May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb9f2d0a8dca4c85a47c2d138d1b39cd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerActionsTestJSON-532218768-project May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 1fd1bb72fc464808988a1579524c7939 May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerActionsTestJSON-532218768-project May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'a924b75f-2e0c-4b96-91db-d9e415a8d092'} May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:06:38.280709 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:38.284401 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.284401 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:06:38.284401 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:06:38.284401 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:06:38.284401 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:06:38.284401 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. May 21 22:06:38.284401 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:38.284401 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-358f3a1c-b647-42e4-a3cc-f3c2f5ff017c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Returning 404 to user: Instance a924b75f-2e0c-4b96-91db-d9e415a8d092 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:06:38.284401 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-358f3a1c-b647-42e4-a3cc-f3c2f5ff017c tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092" status: 404 len: 111 microversion: 2.1 time: 0.029591 May 21 22:06:38.284401 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3485/6839] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:38 2022] GET /compute/v2.1/servers/a924b75f-2e0c-4b96-91db-d9e415a8d092 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:06:38.291503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c184791e-f4ba-4504-aa5c-efa83a8e1110 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:38.292003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c184791e-f4ba-4504-aa5c-efa83a8e1110 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:38.298846 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c184791e-f4ba-4504-aa5c-efa83a8e1110 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:38.299294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c184791e-f4ba-4504-aa5c-efa83a8e1110 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:38.300054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c184791e-f4ba-4504-aa5c-efa83a8e1110 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:38.300523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c184791e-f4ba-4504-aa5c-efa83a8e1110 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:38.317557 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-c184791e-f4ba-4504-aa5c-efa83a8e1110 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] HTTP exception thrown: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c184791e-f4ba-4504-aa5c-efa83a8e1110 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Request method failure captured: May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e HTTP/1.1 May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWEqg4H5ib8lBeBY5hWnlzTjb_0SYMAu1PXPchB7RzXjO9Fc2uRmCYI6YXq0eyS1H44OjCoLWXG04d9ut0CknArKFnB7d8KFC2oZLDhogrvccuHSLlGl5ORpF14bspFXBZezQCKhKDgRiiLFY_0g2s6h-a-kpGbnJaHmPkp_ile5A_0 May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb9f2d0a8dca4c85a47c2d138d1b39cd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServerActionsTestJSON-532218768-project May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1fd1bb72fc464808988a1579524c7939 May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServerActionsTestJSON-532218768-project May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '93f6ddb6-057f-49df-9afd-fc86189f2f3e'} May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:06:38.319074 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:06:38.324651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. May 21 22:06:38.324651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:38.324651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:06:38.324651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:38.324651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.324651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:06:38.324651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:06:38.324651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:06:38.324651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:06:38.324651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. May 21 22:06:38.324651 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:06:38.324651 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c184791e-f4ba-4504-aa5c-efa83a8e1110 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Returning 404 to user: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:06:38.324651 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c184791e-f4ba-4504-aa5c-efa83a8e1110 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "DELETE /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 404 len: 111 microversion: 2.1 time: 0.034177 May 21 22:06:38.324651 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3355/6840] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:06:38 2022] DELETE /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:06:38.329682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9dc935f3-488c-402f-94f1-2097a6444bf0 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:38.330319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9dc935f3-488c-402f-94f1-2097a6444bf0 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [instance: 93f6ddb6-057f-49df-9afd-fc86189f2f3e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:38.336593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9dc935f3-488c-402f-94f1-2097a6444bf0 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:38.337066 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9dc935f3-488c-402f-94f1-2097a6444bf0 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:38.337856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9dc935f3-488c-402f-94f1-2097a6444bf0 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:38.338315 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9dc935f3-488c-402f-94f1-2097a6444bf0 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:38.352541 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-9dc935f3-488c-402f-94f1-2097a6444bf0 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] HTTP exception thrown: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9dc935f3-488c-402f-94f1-2097a6444bf0 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Request method failure captured: May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e HTTP/1.1 May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiWEqg4H5ib8lBeBY5hWnlzTjb_0SYMAu1PXPchB7RzXjO9Fc2uRmCYI6YXq0eyS1H44OjCoLWXG04d9ut0CknArKFnB7d8KFC2oZLDhogrvccuHSLlGl5ORpF14bspFXBZezQCKhKDgRiiLFY_0g2s6h-a-kpGbnJaHmPkp_ile5A_0 May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb9f2d0a8dca4c85a47c2d138d1b39cd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb9f2d0a8dca4c85a47c2d138d1b39cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: cb9f2d0a8dca4c85a47c2d138d1b39cd May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServerActionsTestJSON-532218768 May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServerActionsTestJSON-532218768-project May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: 1fd1bb72fc464808988a1579524c7939 May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServerActionsTestJSON-532218768-project May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '93f6ddb6-057f-49df-9afd-fc86189f2f3e'} May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:06:38.354078 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:38.358436 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:06:38.358436 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:06:38.358436 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:06:38.358436 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:06:38.358436 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:06:38.358436 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. May 21 22:06:38.358436 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:06:38.358436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9dc935f3-488c-402f-94f1-2097a6444bf0 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Returning 404 to user: Instance 93f6ddb6-057f-49df-9afd-fc86189f2f3e could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:06:38.358436 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9dc935f3-488c-402f-94f1-2097a6444bf0 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e" status: 404 len: 111 microversion: 2.1 time: 0.029747 May 21 22:06:38.358436 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3486/6841] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:38 2022] GET /compute/v2.1/servers/93f6ddb6-057f-49df-9afd-fc86189f2f3e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:06:38.363994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ed65f6a4-5753-4f50-a47a-dd9a56da2cf6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] Calling method '.version_select at 0x7fc819cec550>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:38.367852 ncdv-master-1 devstack@n-api.service[131278]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ed65f6a4-5753-4f50-a47a-dd9a56da2cf6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [757ee1d9-e142-49b6-8af4-504059748295] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 21 22:06:39.374874 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [None req-ed65f6a4-5753-4f50-a47a-dd9a56da2cf6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] [757ee1d9-e142-49b6-8af4-504059748295] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 39284. May 21 22:06:39.452591 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ed65f6a4-5753-4f50-a47a-dd9a56da2cf6 tempest-ServerActionsTestJSON-532218768 tempest-ServerActionsTestJSON-532218768-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-937962467" status: 202 len: 0 microversion: 2.1 time: 1.092172 May 21 22:06:39.453358 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3356/6842] 10.222.0.49 () {58 vars in 1217 bytes} [Sat May 21 22:06:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-937962467 => generated 0 bytes in 1094 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:06:47.513402 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:06:47.513975 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 22:06:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:06:48.040010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-add9e004-738c-450e-943d-f794f20893e4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1366398308", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "93d4537a-8df0-4fb5-9451-66dc597a12ed"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:06:48.046797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=36 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:06:48.093857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-add9e004-738c-450e-943d-f794f20893e4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] validate_networks() for [('93d4537a-8df0-4fb5-9451-66dc597a12ed', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 22:06:48.342820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=83 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:06:48.508552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-add9e004-738c-450e-943d-f794f20893e4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:06:48.509021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-add9e004-738c-450e-943d-f794f20893e4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:06:48.509508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-add9e004-738c-450e-943d-f794f20893e4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:06:48.509931 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-add9e004-738c-450e-943d-f794f20893e4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:06:48.510356 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-add9e004-738c-450e-943d-f794f20893e4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:06:48.519570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-add9e004-738c-450e-943d-f794f20893e4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:48.520163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-add9e004-738c-450e-943d-f794f20893e4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:48.521022 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-add9e004-738c-450e-943d-f794f20893e4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:48.521501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-add9e004-738c-450e-943d-f794f20893e4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:48.539524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-add9e004-738c-450e-943d-f794f20893e4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Getting quotas for project f52a8a4868e04868b55ac2181775afbd. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:06:48.545051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-add9e004-738c-450e-943d-f794f20893e4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Getting quotas for user cfaa37a1e079462aa50ec96d3ee3f235 and project f52a8a4868e04868b55ac2181775afbd. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:06:48.557763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-add9e004-738c-450e-943d-f794f20893e4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 22:06:48.560061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-add9e004-738c-450e-943d-f794f20893e4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 22:06:48.681916 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-add9e004-738c-450e-943d-f794f20893e4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760899 May 21 22:06:48.682739 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3487/6843] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 22:06:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 21 22:06:48.691000 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:06:48.696545 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-02fd5fc3-6253-4eeb-87d7-4e55948accb9 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:48.697170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-02fd5fc3-6253-4eeb-87d7-4e55948accb9 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:48.700056 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:06:48.756200 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-02fd5fc3-6253-4eeb-87d7-4e55948accb9 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:48.763738 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-02fd5fc3-6253-4eeb-87d7-4e55948accb9 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 200 len: 1217 microversion: 2.1 time: 0.075080 May 21 22:06:48.764346 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3357/6844] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:48 2022] GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:49.784803 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-378042fb-f57b-4fb4-a513-528b67dee49b tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:49.785955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-378042fb-f57b-4fb4-a513-528b67dee49b tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:49.794108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-378042fb-f57b-4fb4-a513-528b67dee49b tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:49.794566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-378042fb-f57b-4fb4-a513-528b67dee49b tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:49.795356 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-378042fb-f57b-4fb4-a513-528b67dee49b tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:49.795806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-378042fb-f57b-4fb4-a513-528b67dee49b tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:49.871556 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-378042fb-f57b-4fb4-a513-528b67dee49b tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:49.879713 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-378042fb-f57b-4fb4-a513-528b67dee49b tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 200 len: 1221 microversion: 2.1 time: 0.101769 May 21 22:06:49.880331 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3488/6845] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:49 2022] GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 1221 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:50.899337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b5dc1cb2-0319-4773-9988-3d67705de47f tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:50.899955 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b5dc1cb2-0319-4773-9988-3d67705de47f tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:50.907716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5dc1cb2-0319-4773-9988-3d67705de47f tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:50.908169 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5dc1cb2-0319-4773-9988-3d67705de47f tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:50.908981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5dc1cb2-0319-4773-9988-3d67705de47f tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:50.909427 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5dc1cb2-0319-4773-9988-3d67705de47f tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:50.981282 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b5dc1cb2-0319-4773-9988-3d67705de47f tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:50.991918 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b5dc1cb2-0319-4773-9988-3d67705de47f tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 200 len: 1277 microversion: 2.1 time: 0.095809 May 21 22:06:50.992774 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3358/6846] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:50 2022] GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 1277 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:52.010448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-06ad9d8d-da1b-481e-92b7-50f7d4a61234 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:52.011819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-06ad9d8d-da1b-481e-92b7-50f7d4a61234 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:52.019095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06ad9d8d-da1b-481e-92b7-50f7d4a61234 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:52.019561 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06ad9d8d-da1b-481e-92b7-50f7d4a61234 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:52.020383 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06ad9d8d-da1b-481e-92b7-50f7d4a61234 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:52.020845 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-06ad9d8d-da1b-481e-92b7-50f7d4a61234 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:52.210039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-06ad9d8d-da1b-481e-92b7-50f7d4a61234 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:52.218238 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-06ad9d8d-da1b-481e-92b7-50f7d4a61234 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 200 len: 1317 microversion: 2.1 time: 0.212495 May 21 22:06:52.218822 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3489/6847] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:52 2022] GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:53.082276 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-563c086c-a18f-4303-8c1b-f461bd86331f req-56fe43e9-a8ec-45b8-9a09-686079347ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0eab27a-ca74-4b94-873f-3474d1645fbd", "tag": "350a0766-2d50-4c29-961f-72a5623b4d85"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:06:53.092867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-563c086c-a18f-4303-8c1b-f461bd86331f req-56fe43e9-a8ec-45b8-9a09-686079347ff6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:53.093437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-563c086c-a18f-4303-8c1b-f461bd86331f req-56fe43e9-a8ec-45b8-9a09-686079347ff6 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:53.105658 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-563c086c-a18f-4303-8c1b-f461bd86331f req-56fe43e9-a8ec-45b8-9a09-686079347ff6 service nova] Creating event network-changed:350a0766-2d50-4c29-961f-72a5623b4d85 for instance a0eab27a-ca74-4b94-873f-3474d1645fbd on nch1-master-1 May 21 22:06:53.110616 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-563c086c-a18f-4303-8c1b-f461bd86331f req-56fe43e9-a8ec-45b8-9a09-686079347ff6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032951 May 21 22:06:53.111353 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3359/6848] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:06:53.235179 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-80bd56d3-eaee-4d50-8686-7cea3b77952d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:53.235840 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-80bd56d3-eaee-4d50-8686-7cea3b77952d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:53.244406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80bd56d3-eaee-4d50-8686-7cea3b77952d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:53.244873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80bd56d3-eaee-4d50-8686-7cea3b77952d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:53.245666 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80bd56d3-eaee-4d50-8686-7cea3b77952d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:53.246119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80bd56d3-eaee-4d50-8686-7cea3b77952d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:53.492734 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-80bd56d3-eaee-4d50-8686-7cea3b77952d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:53.500943 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-80bd56d3-eaee-4d50-8686-7cea3b77952d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 200 len: 1317 microversion: 2.1 time: 0.269686 May 21 22:06:53.501511 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3490/6849] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:53 2022] GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:54.519797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0754bd51-0226-48f3-905d-e0cb23d9f5c5 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:54.520533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0754bd51-0226-48f3-905d-e0cb23d9f5c5 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:54.527279 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0754bd51-0226-48f3-905d-e0cb23d9f5c5 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:54.527735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0754bd51-0226-48f3-905d-e0cb23d9f5c5 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:54.528549 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0754bd51-0226-48f3-905d-e0cb23d9f5c5 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:54.528994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0754bd51-0226-48f3-905d-e0cb23d9f5c5 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:54.673743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0754bd51-0226-48f3-905d-e0cb23d9f5c5 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:54.682046 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0754bd51-0226-48f3-905d-e0cb23d9f5c5 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 200 len: 1317 microversion: 2.1 time: 0.167718 May 21 22:06:54.682625 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3360/6850] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:54 2022] GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:55.699456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3dec13f0-db74-4bb9-ab1d-86de0376f3a6 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:55.700119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3dec13f0-db74-4bb9-ab1d-86de0376f3a6 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:55.707275 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3dec13f0-db74-4bb9-ab1d-86de0376f3a6 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:55.707740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3dec13f0-db74-4bb9-ab1d-86de0376f3a6 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:55.708540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3dec13f0-db74-4bb9-ab1d-86de0376f3a6 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:55.708995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3dec13f0-db74-4bb9-ab1d-86de0376f3a6 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:55.854134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3dec13f0-db74-4bb9-ab1d-86de0376f3a6 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:55.861761 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3dec13f0-db74-4bb9-ab1d-86de0376f3a6 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 200 len: 1317 microversion: 2.1 time: 0.166307 May 21 22:06:55.862330 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3491/6851] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:55 2022] GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:56.878966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e68e88b5-a6a5-4908-88f0-ea8e22089887 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:56.879582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e68e88b5-a6a5-4908-88f0-ea8e22089887 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:56.886778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e68e88b5-a6a5-4908-88f0-ea8e22089887 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:56.887225 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e68e88b5-a6a5-4908-88f0-ea8e22089887 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:56.887989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e68e88b5-a6a5-4908-88f0-ea8e22089887 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:56.888461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e68e88b5-a6a5-4908-88f0-ea8e22089887 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:57.036828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e68e88b5-a6a5-4908-88f0-ea8e22089887 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:57.041294 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e68e88b5-a6a5-4908-88f0-ea8e22089887 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 200 len: 1317 microversion: 2.1 time: 0.166231 May 21 22:06:57.041867 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3361/6852] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:56 2022] GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:06:58.058398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-df29cb71-886a-4548-a5f2-efdc3ad6fd70 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:58.059028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-df29cb71-886a-4548-a5f2-efdc3ad6fd70 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:58.066172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-df29cb71-886a-4548-a5f2-efdc3ad6fd70 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:58.066638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-df29cb71-886a-4548-a5f2-efdc3ad6fd70 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:58.067425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-df29cb71-886a-4548-a5f2-efdc3ad6fd70 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:58.067877 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-df29cb71-886a-4548-a5f2-efdc3ad6fd70 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:58.144214 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-7f6b1bf4-6709-4c0b-acec-d01fd3211efb req-45aa5012-5dd3-4afd-8130-2139055c071c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0eab27a-ca74-4b94-873f-3474d1645fbd", "name": "network-vif-plugged", "status": "completed", "tag": "350a0766-2d50-4c29-961f-72a5623b4d85"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:06:58.154629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-7f6b1bf4-6709-4c0b-acec-d01fd3211efb req-45aa5012-5dd3-4afd-8130-2139055c071c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:58.155084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-7f6b1bf4-6709-4c0b-acec-d01fd3211efb req-45aa5012-5dd3-4afd-8130-2139055c071c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:58.166864 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-7f6b1bf4-6709-4c0b-acec-d01fd3211efb req-45aa5012-5dd3-4afd-8130-2139055c071c service nova] Creating event network-vif-plugged:350a0766-2d50-4c29-961f-72a5623b4d85 for instance a0eab27a-ca74-4b94-873f-3474d1645fbd on nch1-master-1 May 21 22:06:58.171754 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-7f6b1bf4-6709-4c0b-acec-d01fd3211efb req-45aa5012-5dd3-4afd-8130-2139055c071c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031327 May 21 22:06:58.172395 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3362/6853] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:06:58.231598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-df29cb71-886a-4548-a5f2-efdc3ad6fd70 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:58.240114 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-df29cb71-886a-4548-a5f2-efdc3ad6fd70 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 200 len: 1317 microversion: 2.1 time: 0.185958 May 21 22:06:58.241110 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3492/6854] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:58 2022] GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:06:59.254508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:06:59.259736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2b3ba18a-823f-47f8-a821-fb331a4d6792 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:06:59.264589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2b3ba18a-823f-47f8-a821-fb331a4d6792 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:06:59.267058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b3ba18a-823f-47f8-a821-fb331a4d6792 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:59.267547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b3ba18a-823f-47f8-a821-fb331a4d6792 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:59.268353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b3ba18a-823f-47f8-a821-fb331a4d6792 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:06:59.268802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2b3ba18a-823f-47f8-a821-fb331a4d6792 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:06:59.416168 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2b3ba18a-823f-47f8-a821-fb331a4d6792 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:06:59.423977 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2b3ba18a-823f-47f8-a821-fb331a4d6792 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 200 len: 1317 microversion: 2.1 time: 0.170529 May 21 22:06:59.424584 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3363/6855] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:06:59 2022] GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:00.441892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6fab080c-1f0b-43bd-b713-cd0a3c8fa4d4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:00.442452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6fab080c-1f0b-43bd-b713-cd0a3c8fa4d4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:00.444902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:07:00.445947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:07:00.451987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6fab080c-1f0b-43bd-b713-cd0a3c8fa4d4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:00.452524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6fab080c-1f0b-43bd-b713-cd0a3c8fa4d4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:00.453319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6fab080c-1f0b-43bd-b713-cd0a3c8fa4d4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:00.453783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6fab080c-1f0b-43bd-b713-cd0a3c8fa4d4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:00.596809 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6fab080c-1f0b-43bd-b713-cd0a3c8fa4d4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:00.604588 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6fab080c-1f0b-43bd-b713-cd0a3c8fa4d4 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 200 len: 1506 microversion: 2.1 time: 0.166972 May 21 22:07:00.605173 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3493/6856] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:00 2022] GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:00.659462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-11bd27db-f5cb-4d1f-9685-0ec2381856bf tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-613904979", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "93d4537a-8df0-4fb5-9451-66dc597a12ed"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:07:00.715247 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-11bd27db-f5cb-4d1f-9685-0ec2381856bf tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] validate_networks() for [('93d4537a-8df0-4fb5-9451-66dc597a12ed', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 22:07:01.219047 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-11bd27db-f5cb-4d1f-9685-0ec2381856bf tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:07:01.219047 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-11bd27db-f5cb-4d1f-9685-0ec2381856bf tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:07:01.219047 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-11bd27db-f5cb-4d1f-9685-0ec2381856bf tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:07:01.219047 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-11bd27db-f5cb-4d1f-9685-0ec2381856bf tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:07:01.219047 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-11bd27db-f5cb-4d1f-9685-0ec2381856bf tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:07:01.221571 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11bd27db-f5cb-4d1f-9685-0ec2381856bf tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:01.222039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11bd27db-f5cb-4d1f-9685-0ec2381856bf tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:01.222856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11bd27db-f5cb-4d1f-9685-0ec2381856bf tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:01.223303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-11bd27db-f5cb-4d1f-9685-0ec2381856bf tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:01.240810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-11bd27db-f5cb-4d1f-9685-0ec2381856bf tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Getting quotas for project f52a8a4868e04868b55ac2181775afbd. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:07:01.246291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-11bd27db-f5cb-4d1f-9685-0ec2381856bf tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Getting quotas for user cfaa37a1e079462aa50ec96d3ee3f235 and project f52a8a4868e04868b55ac2181775afbd. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:07:01.259754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-11bd27db-f5cb-4d1f-9685-0ec2381856bf tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 22:07:01.262131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-11bd27db-f5cb-4d1f-9685-0ec2381856bf tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a7c99645-69b8-40ae-8cc8-4c774665c126] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 22:07:01.379269 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-11bd27db-f5cb-4d1f-9685-0ec2381856bf tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723417 May 21 22:07:01.379944 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3364/6857] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 22:07:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 22:07:01.390834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1a95de77-9b94-4745-9f1a-33f77945952a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:01.391468 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1a95de77-9b94-4745-9f1a-33f77945952a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a7c99645-69b8-40ae-8cc8-4c774665c126] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:01.450426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1a95de77-9b94-4745-9f1a-33f77945952a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:01.458481 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1a95de77-9b94-4745-9f1a-33f77945952a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126" status: 200 len: 1216 microversion: 2.1 time: 0.071631 May 21 22:07:01.459206 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3494/6858] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:01 2022] GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 => generated 1216 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:02.475892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-91659dc3-a788-4209-b019-16076f91d5a7 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:02.476577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-91659dc3-a788-4209-b019-16076f91d5a7 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a7c99645-69b8-40ae-8cc8-4c774665c126] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:02.483800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-91659dc3-a788-4209-b019-16076f91d5a7 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:02.484248 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-91659dc3-a788-4209-b019-16076f91d5a7 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:02.485077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-91659dc3-a788-4209-b019-16076f91d5a7 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:02.485517 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-91659dc3-a788-4209-b019-16076f91d5a7 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:02.559701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-91659dc3-a788-4209-b019-16076f91d5a7 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:02.571789 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-91659dc3-a788-4209-b019-16076f91d5a7 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126" status: 200 len: 1220 microversion: 2.1 time: 0.099717 May 21 22:07:02.572755 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3365/6859] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:02 2022] GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:03.593978 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ce0d2cf6-5151-4b3a-8d6f-5f3d6b691f56 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:03.594532 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ce0d2cf6-5151-4b3a-8d6f-5f3d6b691f56 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a7c99645-69b8-40ae-8cc8-4c774665c126] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:03.602766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce0d2cf6-5151-4b3a-8d6f-5f3d6b691f56 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:03.603243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce0d2cf6-5151-4b3a-8d6f-5f3d6b691f56 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:03.604061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce0d2cf6-5151-4b3a-8d6f-5f3d6b691f56 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:03.604554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ce0d2cf6-5151-4b3a-8d6f-5f3d6b691f56 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:03.675966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ce0d2cf6-5151-4b3a-8d6f-5f3d6b691f56 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:03.691821 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ce0d2cf6-5151-4b3a-8d6f-5f3d6b691f56 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126" status: 200 len: 1286 microversion: 2.1 time: 0.101932 May 21 22:07:03.692462 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3495/6860] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:03 2022] GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 => generated 1286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:04.709039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5c6c6d1f-cd6b-4360-b072-56895a5f6bfc tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:04.710159 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5c6c6d1f-cd6b-4360-b072-56895a5f6bfc tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a7c99645-69b8-40ae-8cc8-4c774665c126] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:04.717255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c6c6d1f-cd6b-4360-b072-56895a5f6bfc tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:04.717710 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c6c6d1f-cd6b-4360-b072-56895a5f6bfc tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:04.718496 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c6c6d1f-cd6b-4360-b072-56895a5f6bfc tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:04.718937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5c6c6d1f-cd6b-4360-b072-56895a5f6bfc tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:04.937133 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5c6c6d1f-cd6b-4360-b072-56895a5f6bfc tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:04.945649 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5c6c6d1f-cd6b-4360-b072-56895a5f6bfc tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126" status: 200 len: 1316 microversion: 2.1 time: 0.240462 May 21 22:07:04.946209 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3366/6861] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:04 2022] GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:05.259422 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-9e87be2c-9233-4bd5-9bd8-fdfb20beea42 req-0af42d70-ea99-4001-8780-324cde63a67d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c99645-69b8-40ae-8cc8-4c774665c126", "tag": "a022928f-fd42-45a8-87fe-229ac7e6f749"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:07:05.269413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-9e87be2c-9233-4bd5-9bd8-fdfb20beea42 req-0af42d70-ea99-4001-8780-324cde63a67d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:05.269878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-9e87be2c-9233-4bd5-9bd8-fdfb20beea42 req-0af42d70-ea99-4001-8780-324cde63a67d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:05.282402 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-9e87be2c-9233-4bd5-9bd8-fdfb20beea42 req-0af42d70-ea99-4001-8780-324cde63a67d service nova] Creating event network-changed:a022928f-fd42-45a8-87fe-229ac7e6f749 for instance a7c99645-69b8-40ae-8cc8-4c774665c126 on nch2-master-1 May 21 22:07:05.289625 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-9e87be2c-9233-4bd5-9bd8-fdfb20beea42 req-0af42d70-ea99-4001-8780-324cde63a67d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035110 May 21 22:07:05.292208 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3496/6862] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:07:05.963688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fa8be9ef-61bd-43b6-8967-ce11d8534a01 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:05.964378 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fa8be9ef-61bd-43b6-8967-ce11d8534a01 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a7c99645-69b8-40ae-8cc8-4c774665c126] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:05.971472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa8be9ef-61bd-43b6-8967-ce11d8534a01 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:05.971930 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa8be9ef-61bd-43b6-8967-ce11d8534a01 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:05.972758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa8be9ef-61bd-43b6-8967-ce11d8534a01 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:05.973214 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fa8be9ef-61bd-43b6-8967-ce11d8534a01 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:06.150422 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fa8be9ef-61bd-43b6-8967-ce11d8534a01 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:06.158061 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fa8be9ef-61bd-43b6-8967-ce11d8534a01 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126" status: 200 len: 1316 microversion: 2.1 time: 0.199210 May 21 22:07:06.158631 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3367/6863] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:05 2022] GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 => generated 1316 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:07.176562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0f30c833-908e-4b0c-b258-87c376c3c052 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:07.177281 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0f30c833-908e-4b0c-b258-87c376c3c052 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a7c99645-69b8-40ae-8cc8-4c774665c126] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:07.184333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f30c833-908e-4b0c-b258-87c376c3c052 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:07.184808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f30c833-908e-4b0c-b258-87c376c3c052 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:07.185592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f30c833-908e-4b0c-b258-87c376c3c052 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:07.186050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f30c833-908e-4b0c-b258-87c376c3c052 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:07.334140 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0f30c833-908e-4b0c-b258-87c376c3c052 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:07.342078 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0f30c833-908e-4b0c-b258-87c376c3c052 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126" status: 200 len: 1316 microversion: 2.1 time: 0.170754 May 21 22:07:07.342643 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3497/6864] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:07 2022] GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:08.359442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-95c34e53-1db4-413b-a768-ab8aeff6d94e tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:08.360063 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-95c34e53-1db4-413b-a768-ab8aeff6d94e tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a7c99645-69b8-40ae-8cc8-4c774665c126] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:08.367188 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95c34e53-1db4-413b-a768-ab8aeff6d94e tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:08.367643 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95c34e53-1db4-413b-a768-ab8aeff6d94e tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:08.368460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95c34e53-1db4-413b-a768-ab8aeff6d94e tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:08.368935 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-95c34e53-1db4-413b-a768-ab8aeff6d94e tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:08.509988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-95c34e53-1db4-413b-a768-ab8aeff6d94e tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:08.517637 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-95c34e53-1db4-413b-a768-ab8aeff6d94e tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126" status: 200 len: 1316 microversion: 2.1 time: 0.162110 May 21 22:07:08.518208 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3368/6865] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:08 2022] GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:09.535118 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-61dfa727-1ddd-4e99-8d38-1e454f4ccad5 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:09.535745 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-61dfa727-1ddd-4e99-8d38-1e454f4ccad5 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a7c99645-69b8-40ae-8cc8-4c774665c126] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:09.543421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61dfa727-1ddd-4e99-8d38-1e454f4ccad5 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:09.543881 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61dfa727-1ddd-4e99-8d38-1e454f4ccad5 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:09.544690 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61dfa727-1ddd-4e99-8d38-1e454f4ccad5 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:09.545142 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-61dfa727-1ddd-4e99-8d38-1e454f4ccad5 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:09.687969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-61dfa727-1ddd-4e99-8d38-1e454f4ccad5 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:09.695989 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-61dfa727-1ddd-4e99-8d38-1e454f4ccad5 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126" status: 200 len: 1316 microversion: 2.1 time: 0.164888 May 21 22:07:09.696597 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3498/6866] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:09 2022] GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:10.713240 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7636aa0f-3425-4638-9191-c78966f30e4a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:10.714013 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7636aa0f-3425-4638-9191-c78966f30e4a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a7c99645-69b8-40ae-8cc8-4c774665c126] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:10.721110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7636aa0f-3425-4638-9191-c78966f30e4a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:10.721570 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7636aa0f-3425-4638-9191-c78966f30e4a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:10.722350 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7636aa0f-3425-4638-9191-c78966f30e4a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:10.722796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7636aa0f-3425-4638-9191-c78966f30e4a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:10.869827 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7636aa0f-3425-4638-9191-c78966f30e4a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:10.877363 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7636aa0f-3425-4638-9191-c78966f30e4a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126" status: 200 len: 1316 microversion: 2.1 time: 0.168597 May 21 22:07:10.877937 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3369/6867] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:10 2022] GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:11.893691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9aa42a39-77c1-4443-ba87-19da696a2c0e tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:11.894383 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9aa42a39-77c1-4443-ba87-19da696a2c0e tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a7c99645-69b8-40ae-8cc8-4c774665c126] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:11.897568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:07:11.902359 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9aa42a39-77c1-4443-ba87-19da696a2c0e tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:11.902831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9aa42a39-77c1-4443-ba87-19da696a2c0e tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:11.903653 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9aa42a39-77c1-4443-ba87-19da696a2c0e tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:11.904112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9aa42a39-77c1-4443-ba87-19da696a2c0e tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:11.975600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-db57fbdc-f7b9-4b02-ba4d-a61acdc590fa req-fe6fa3f0-06ee-4647-97fc-5863f3366fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c99645-69b8-40ae-8cc8-4c774665c126", "name": "network-vif-plugged", "status": "completed", "tag": "a022928f-fd42-45a8-87fe-229ac7e6f749"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:07:11.979664 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:07:11.980562 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:07:11.987357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-db57fbdc-f7b9-4b02-ba4d-a61acdc590fa req-fe6fa3f0-06ee-4647-97fc-5863f3366fdc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:11.987818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-db57fbdc-f7b9-4b02-ba4d-a61acdc590fa req-fe6fa3f0-06ee-4647-97fc-5863f3366fdc service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:12.000184 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-db57fbdc-f7b9-4b02-ba4d-a61acdc590fa req-fe6fa3f0-06ee-4647-97fc-5863f3366fdc service nova] Creating event network-vif-plugged:a022928f-fd42-45a8-87fe-229ac7e6f749 for instance a7c99645-69b8-40ae-8cc8-4c774665c126 on nch2-master-1 May 21 22:07:12.005698 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-db57fbdc-f7b9-4b02-ba4d-a61acdc590fa req-fe6fa3f0-06ee-4647-97fc-5863f3366fdc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035374 May 21 22:07:12.006369 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3370/6868] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:07:12.063553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9aa42a39-77c1-4443-ba87-19da696a2c0e tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:12.073498 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9aa42a39-77c1-4443-ba87-19da696a2c0e tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126" status: 200 len: 1316 microversion: 2.1 time: 0.183687 May 21 22:07:12.074242 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3499/6869] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:11 2022] GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 => generated 1316 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:07:13.092351 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-36f9a804-3947-4f3a-8c86-986551ce11c2 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:13.093699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-36f9a804-3947-4f3a-8c86-986551ce11c2 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a7c99645-69b8-40ae-8cc8-4c774665c126] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:13.102852 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36f9a804-3947-4f3a-8c86-986551ce11c2 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:13.103309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36f9a804-3947-4f3a-8c86-986551ce11c2 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:13.104138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36f9a804-3947-4f3a-8c86-986551ce11c2 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:13.104604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-36f9a804-3947-4f3a-8c86-986551ce11c2 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:13.260164 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-36f9a804-3947-4f3a-8c86-986551ce11c2 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:13.269081 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-36f9a804-3947-4f3a-8c86-986551ce11c2 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126" status: 200 len: 1316 microversion: 2.1 time: 0.181572 May 21 22:07:13.269680 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3371/6870] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:13 2022] GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:14.286779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1403b273-f280-4e85-a669-87401a52f761 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:14.287411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1403b273-f280-4e85-a669-87401a52f761 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a7c99645-69b8-40ae-8cc8-4c774665c126] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:14.294876 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1403b273-f280-4e85-a669-87401a52f761 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:14.295346 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1403b273-f280-4e85-a669-87401a52f761 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:14.296134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1403b273-f280-4e85-a669-87401a52f761 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:14.296701 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1403b273-f280-4e85-a669-87401a52f761 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:14.437548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1403b273-f280-4e85-a669-87401a52f761 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:14.445588 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1403b273-f280-4e85-a669-87401a52f761 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126" status: 200 len: 1506 microversion: 2.1 time: 0.162781 May 21 22:07:14.446154 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3500/6871] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:14 2022] GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:14.462028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a0f7d156-9fca-4d4d-8a22-8f1106d7ec48 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:14.462527 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a0f7d156-9fca-4d4d-8a22-8f1106d7ec48 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a7c99645-69b8-40ae-8cc8-4c774665c126] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:14.469506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a0f7d156-9fca-4d4d-8a22-8f1106d7ec48 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:14.469961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a0f7d156-9fca-4d4d-8a22-8f1106d7ec48 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:14.470735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a0f7d156-9fca-4d4d-8a22-8f1106d7ec48 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:14.471176 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a0f7d156-9fca-4d4d-8a22-8f1106d7ec48 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:14.496519 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a0f7d156-9fca-4d4d-8a22-8f1106d7ec48 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a7c99645-69b8-40ae-8cc8-4c774665c126] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 22:07:14.782333 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a0f7d156-9fca-4d4d-8a22-8f1106d7ec48 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126" status: 204 len: 0 microversion: 2.1 time: 0.324506 May 21 22:07:14.782942 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3372/6872] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:07:14 2022] DELETE /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:07:14.791562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-77750b65-61c5-4a9e-b56d-2646ea6f614a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:14.792207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-77750b65-61c5-4a9e-b56d-2646ea6f614a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a7c99645-69b8-40ae-8cc8-4c774665c126] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:14.798513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-77750b65-61c5-4a9e-b56d-2646ea6f614a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:14.798982 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-77750b65-61c5-4a9e-b56d-2646ea6f614a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:14.799767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-77750b65-61c5-4a9e-b56d-2646ea6f614a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:14.800218 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-77750b65-61c5-4a9e-b56d-2646ea6f614a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:14.955059 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-77750b65-61c5-4a9e-b56d-2646ea6f614a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:14.963543 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-77750b65-61c5-4a9e-b56d-2646ea6f614a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126" status: 200 len: 1512 microversion: 2.1 time: 0.176498 May 21 22:07:14.968235 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3501/6873] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:14 2022] GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:15.981300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-944f3bd0-2e5d-4105-befb-c0337eebdbab tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:15.981974 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-944f3bd0-2e5d-4105-befb-c0337eebdbab tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a7c99645-69b8-40ae-8cc8-4c774665c126] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:15.988999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-944f3bd0-2e5d-4105-befb-c0337eebdbab tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:15.989459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-944f3bd0-2e5d-4105-befb-c0337eebdbab tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:15.990238 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-944f3bd0-2e5d-4105-befb-c0337eebdbab tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:15.990686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-944f3bd0-2e5d-4105-befb-c0337eebdbab tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:16.208785 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-944f3bd0-2e5d-4105-befb-c0337eebdbab tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:16.216606 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-944f3bd0-2e5d-4105-befb-c0337eebdbab tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126" status: 200 len: 1512 microversion: 2.1 time: 0.239708 May 21 22:07:16.217205 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3373/6874] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:15 2022] GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 => generated 1512 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:16.709793 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-72d4cd6e-dfcd-4421-9fba-baf91de09071 req-ae48f259-6eb7-43c2-997d-8b559d95ec7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c99645-69b8-40ae-8cc8-4c774665c126", "name": "network-vif-deleted", "tag": "a022928f-fd42-45a8-87fe-229ac7e6f749"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:07:16.720457 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-72d4cd6e-dfcd-4421-9fba-baf91de09071 req-ae48f259-6eb7-43c2-997d-8b559d95ec7d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:16.720964 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-72d4cd6e-dfcd-4421-9fba-baf91de09071 req-ae48f259-6eb7-43c2-997d-8b559d95ec7d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:16.738121 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-72d4cd6e-dfcd-4421-9fba-baf91de09071 req-ae48f259-6eb7-43c2-997d-8b559d95ec7d service nova] Creating event network-vif-deleted:a022928f-fd42-45a8-87fe-229ac7e6f749 for instance a7c99645-69b8-40ae-8cc8-4c774665c126 on nch2-master-1 May 21 22:07:16.747085 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-72d4cd6e-dfcd-4421-9fba-baf91de09071 req-ae48f259-6eb7-43c2-997d-8b559d95ec7d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041108 May 21 22:07:16.754468 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3502/6875] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:07:17.235415 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fbd2ff64-02a2-40d1-be79-64d6e7ffda91 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:17.236042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fbd2ff64-02a2-40d1-be79-64d6e7ffda91 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a7c99645-69b8-40ae-8cc8-4c774665c126] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:17.245080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fbd2ff64-02a2-40d1-be79-64d6e7ffda91 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:17.245534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fbd2ff64-02a2-40d1-be79-64d6e7ffda91 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:17.246322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fbd2ff64-02a2-40d1-be79-64d6e7ffda91 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:17.246761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fbd2ff64-02a2-40d1-be79-64d6e7ffda91 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:17.279273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fbd2ff64-02a2-40d1-be79-64d6e7ffda91 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:17.279734 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fbd2ff64-02a2-40d1-be79-64d6e7ffda91 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:17.280196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-fbd2ff64-02a2-40d1-be79-64d6e7ffda91 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lazy-loading 'fault' on Instance uuid a7c99645-69b8-40ae-8cc8-4c774665c126 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 22:07:17.327177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fbd2ff64-02a2-40d1-be79-64d6e7ffda91 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:17.334964 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fbd2ff64-02a2-40d1-be79-64d6e7ffda91 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126" status: 200 len: 1306 microversion: 2.1 time: 0.104313 May 21 22:07:17.336021 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3374/6876] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:17 2022] GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 => generated 1306 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:18.354724 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f8dd0a52-398a-4382-b4dc-f57edfbc5f54 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:18.355453 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f8dd0a52-398a-4382-b4dc-f57edfbc5f54 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a7c99645-69b8-40ae-8cc8-4c774665c126] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:18.358382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:07:18.363562 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f8dd0a52-398a-4382-b4dc-f57edfbc5f54 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:18.364031 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f8dd0a52-398a-4382-b4dc-f57edfbc5f54 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:18.364856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f8dd0a52-398a-4382-b4dc-f57edfbc5f54 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:18.365317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f8dd0a52-398a-4382-b4dc-f57edfbc5f54 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:18.379356 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-f8dd0a52-398a-4382-b4dc-f57edfbc5f54 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] HTTP exception thrown: Instance a7c99645-69b8-40ae-8cc8-4c774665c126 could not be found. May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f8dd0a52-398a-4382-b4dc-f57edfbc5f54 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Request method failure captured: May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 HTTP/1.1 May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiWJ3_Yg-_a9AIgyvkGLcFySoDePjl7sts7zXMJbd-Kz_UL_rhjJ5KMZRJMvAlTa8xC2fkgUsQFxlTWFEs3UjCYGj_B_jSmIGzDKenqkmT1q5dpRZb8kYCQc0LFuJc2ELMNXc0nelqlE46kAKEklknkFnOOv0B88uTY8D71sRy3PXe9I May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: f52a8a4868e04868b55ac2181775afbd May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-188366416 May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f52a8a4868e04868b55ac2181775afbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f52a8a4868e04868b55ac2181775afbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f52a8a4868e04868b55ac2181775afbd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f52a8a4868e04868b55ac2181775afbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-188366416 May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: f52a8a4868e04868b55ac2181775afbd May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-188366416 May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-188366416-project May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: cfaa37a1e079462aa50ec96d3ee3f235 May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-188366416-project May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance a7c99645-69b8-40ae-8cc8-4c774665c126 could not be found. May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'a7c99645-69b8-40ae-8cc8-4c774665c126'} May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7c99645-69b8-40ae-8cc8-4c774665c126 could not be found. May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c99645-69b8-40ae-8cc8-4c774665c126 could not be found. May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:07:18.381035 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:18.386379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:07:18.386379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:07:18.386379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:07:18.386379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:07:18.386379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:07:18.386379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c99645-69b8-40ae-8cc8-4c774665c126 could not be found. May 21 22:07:18.386379 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:18.386379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f8dd0a52-398a-4382-b4dc-f57edfbc5f54 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Returning 404 to user: Instance a7c99645-69b8-40ae-8cc8-4c774665c126 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:07:18.386379 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f8dd0a52-398a-4382-b4dc-f57edfbc5f54 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126" status: 404 len: 111 microversion: 2.1 time: 0.032232 May 21 22:07:18.386379 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3503/6877] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:18 2022] GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:07:18.392170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-83a2376a-5dfb-495a-b02a-75ae879fbafc tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:18.392848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-83a2376a-5dfb-495a-b02a-75ae879fbafc tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:18.400000 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-83a2376a-5dfb-495a-b02a-75ae879fbafc tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:18.400495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-83a2376a-5dfb-495a-b02a-75ae879fbafc tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:18.401274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-83a2376a-5dfb-495a-b02a-75ae879fbafc tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:18.401722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-83a2376a-5dfb-495a-b02a-75ae879fbafc tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:18.405959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:07:18.554253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-83a2376a-5dfb-495a-b02a-75ae879fbafc tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:18.562642 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-83a2376a-5dfb-495a-b02a-75ae879fbafc tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 200 len: 1506 microversion: 2.1 time: 0.174353 May 21 22:07:18.563220 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3375/6878] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:18 2022] GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:18.580815 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-27ed28d2-590e-473b-b740-a13388bb755d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:07:18.582030 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-27ed28d2-590e-473b-b740-a13388bb755d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: 91481c9d-027d-48a2-9792-0f8de3c19f29] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:18.588501 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-27ed28d2-590e-473b-b740-a13388bb755d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] HTTP exception thrown: Instance 91481c9d-027d-48a2-9792-0f8de3c19f29 could not be found. May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-27ed28d2-590e-473b-b740-a13388bb755d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Request method failure captured: May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/91481c9d-027d-48a2-9792-0f8de3c19f29/action HTTP/1.1 May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 32 May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiWJ3_Yg-_a9AIgyvkGLcFySoDePjl7sts7zXMJbd-Kz_UL_rhjJ5KMZRJMvAlTa8xC2fkgUsQFxlTWFEs3UjCYGj_B_jSmIGzDKenqkmT1q5dpRZb8kYCQc0LFuJc2ELMNXc0nelqlE46kAKEklknkFnOOv0B88uTY8D71sRy3PXe9I May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: f52a8a4868e04868b55ac2181775afbd May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-188366416 May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f52a8a4868e04868b55ac2181775afbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f52a8a4868e04868b55ac2181775afbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f52a8a4868e04868b55ac2181775afbd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f52a8a4868e04868b55ac2181775afbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-188366416 May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: f52a8a4868e04868b55ac2181775afbd May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-188366416 May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-188366416-project May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: cfaa37a1e079462aa50ec96d3ee3f235 May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-188366416-project May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: {"resize": {"flavorRef": "452"}} May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 91481c9d-027d-48a2-9792-0f8de3c19f29 could not be found. May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '91481c9d-027d-48a2-9792-0f8de3c19f29', 'body': {'resize': {'flavorRef': '452'}}} May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91481c9d-027d-48a2-9792-0f8de3c19f29 could not be found. May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:07:18.590165 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:07:18.604024 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91481c9d-027d-48a2-9792-0f8de3c19f29 could not be found. May 21 22:07:18.604024 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:18.604024 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:07:18.604024 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:18.604024 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:07:18.604024 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:07:18.604024 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:07:18.604024 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:07:18.604024 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:07:18.604024 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91481c9d-027d-48a2-9792-0f8de3c19f29 could not be found. May 21 22:07:18.604024 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:18.604024 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-27ed28d2-590e-473b-b740-a13388bb755d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Returning 404 to user: Instance 91481c9d-027d-48a2-9792-0f8de3c19f29 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:07:18.604024 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-27ed28d2-590e-473b-b740-a13388bb755d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "POST /compute/v2.1/servers/91481c9d-027d-48a2-9792-0f8de3c19f29/action" status: 404 len: 111 microversion: 2.1 time: 0.015784 May 21 22:07:18.604024 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3504/6879] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:07:18 2022] POST /compute/v2.1/servers/91481c9d-027d-48a2-9792-0f8de3c19f29/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:07:18.608145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-08c21856-0b9b-4877-9479-1373b6094007 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:18.609203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-08c21856-0b9b-4877-9479-1373b6094007 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:18.616675 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-08c21856-0b9b-4877-9479-1373b6094007 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:18.617745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-08c21856-0b9b-4877-9479-1373b6094007 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:18.618661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-08c21856-0b9b-4877-9479-1373b6094007 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:18.619113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-08c21856-0b9b-4877-9479-1373b6094007 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:18.766971 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-08c21856-0b9b-4877-9479-1373b6094007 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:18.775159 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-08c21856-0b9b-4877-9479-1373b6094007 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 200 len: 1506 microversion: 2.1 time: 0.171408 May 21 22:07:18.775731 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3376/6880] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:18 2022] GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:18.792208 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-32e903f3-5454-414d-9722-7116b9c04314 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:18.793057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-32e903f3-5454-414d-9722-7116b9c04314 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:18.800585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32e903f3-5454-414d-9722-7116b9c04314 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:18.801047 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32e903f3-5454-414d-9722-7116b9c04314 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:18.801819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32e903f3-5454-414d-9722-7116b9c04314 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:18.802270 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32e903f3-5454-414d-9722-7116b9c04314 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:18.807037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=81 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:07:18.949007 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-32e903f3-5454-414d-9722-7116b9c04314 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:18.956690 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-32e903f3-5454-414d-9722-7116b9c04314 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 200 len: 1506 microversion: 2.1 time: 0.168633 May 21 22:07:18.957246 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3505/6881] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:18 2022] GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:18.972993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2d3226d0-1170-48e8-af59-ffdcdf6d123d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "d920b5f1-6149-4370-a617-f85f1ea30c86"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:07:18.973966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2d3226d0-1170-48e8-af59-ffdcdf6d123d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:18.980034 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2d3226d0-1170-48e8-af59-ffdcdf6d123d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:18.980526 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2d3226d0-1170-48e8-af59-ffdcdf6d123d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:18.981295 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2d3226d0-1170-48e8-af59-ffdcdf6d123d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:18.981735 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2d3226d0-1170-48e8-af59-ffdcdf6d123d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:19.010283 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2d3226d0-1170-48e8-af59-ffdcdf6d123d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:19.015420 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-2d3226d0-1170-48e8-af59-ffdcdf6d123d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] HTTP exception thrown: Flavor d920b5f1-6149-4370-a617-f85f1ea30c86 could not be found. May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2d3226d0-1170-48e8-af59-ffdcdf6d123d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Request method failure captured: May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: request: POST /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd/action HTTP/1.1 May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 65 May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWJ3_Yg-_a9AIgyvkGLcFySoDePjl7sts7zXMJbd-Kz_UL_rhjJ5KMZRJMvAlTa8xC2fkgUsQFxlTWFEs3UjCYGj_B_jSmIGzDKenqkmT1q5dpRZb8kYCQc0LFuJc2ELMNXc0nelqlE46kAKEklknkFnOOv0B88uTY8D71sRy3PXe9I May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: f52a8a4868e04868b55ac2181775afbd May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-188366416 May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f52a8a4868e04868b55ac2181775afbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f52a8a4868e04868b55ac2181775afbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f52a8a4868e04868b55ac2181775afbd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f52a8a4868e04868b55ac2181775afbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-188366416 May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: f52a8a4868e04868b55ac2181775afbd May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-188366416 May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-188366416-project May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: cfaa37a1e079462aa50ec96d3ee3f235 May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-188366416-project May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: {"resize": {"flavorRef": "d920b5f1-6149-4370-a617-f85f1ea30c86"}} May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: exception: Flavor d920b5f1-6149-4370-a617-f85f1ea30c86 could not be found. May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'a0eab27a-ca74-4b94-873f-3474d1645fbd', 'body': {'resize': {'flavorRef': 'd920b5f1-6149-4370-a617-f85f1ea30c86'}}} May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 21 22:07:19.017338 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor d920b5f1-6149-4370-a617-f85f1ea30c86 could not be found. May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor d920b5f1-6149-4370-a617-f85f1ea30c86 could not be found. May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor d920b5f1-6149-4370-a617-f85f1ea30c86 could not be found. May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2d3226d0-1170-48e8-af59-ffdcdf6d123d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Returning 400 to user: Flavor d920b5f1-6149-4370-a617-f85f1ea30c86 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2d3226d0-1170-48e8-af59-ffdcdf6d123d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "POST /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd/action" status: 400 len: 107 microversion: 2.1 time: 0.049655 May 21 22:07:19.020876 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3377/6882] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:07:18 2022] POST /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd/action => generated 107 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 22:07:19.027620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-246bc2c0-63f8-4b7d-9db3-4edee1dc6f9c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:19.029073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-246bc2c0-63f8-4b7d-9db3-4edee1dc6f9c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:19.034437 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-246bc2c0-63f8-4b7d-9db3-4edee1dc6f9c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:19.034908 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-246bc2c0-63f8-4b7d-9db3-4edee1dc6f9c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:19.035694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-246bc2c0-63f8-4b7d-9db3-4edee1dc6f9c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:19.036153 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-246bc2c0-63f8-4b7d-9db3-4edee1dc6f9c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:19.205998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-246bc2c0-63f8-4b7d-9db3-4edee1dc6f9c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:19.213620 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-246bc2c0-63f8-4b7d-9db3-4edee1dc6f9c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 200 len: 1506 microversion: 2.1 time: 0.189887 May 21 22:07:19.214194 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3506/6883] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:19 2022] GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:19.231030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bc5a35a2-8fd5-4817-8d93-25aaf4e0e9dd tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:19.231647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bc5a35a2-8fd5-4817-8d93-25aaf4e0e9dd tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:19.237741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc5a35a2-8fd5-4817-8d93-25aaf4e0e9dd tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:19.238189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc5a35a2-8fd5-4817-8d93-25aaf4e0e9dd tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:19.238951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc5a35a2-8fd5-4817-8d93-25aaf4e0e9dd tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:19.239386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bc5a35a2-8fd5-4817-8d93-25aaf4e0e9dd tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:19.379843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bc5a35a2-8fd5-4817-8d93-25aaf4e0e9dd tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:19.387585 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bc5a35a2-8fd5-4817-8d93-25aaf4e0e9dd tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 200 len: 1506 microversion: 2.1 time: 0.160385 May 21 22:07:19.388158 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3378/6884] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:19 2022] GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:07:19.404077 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8addf2f4-6142-4f53-8142-24ee7f4703d9 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8addf2f4-6142-4f53-8142-24ee7f4703d9 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Request method failure captured: May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: request: POST /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd/action HTTP/1.1 May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 29 May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiWJ3_Yg-_a9AIgyvkGLcFySoDePjl7sts7zXMJbd-Kz_UL_rhjJ5KMZRJMvAlTa8xC2fkgUsQFxlTWFEs3UjCYGj_B_jSmIGzDKenqkmT1q5dpRZb8kYCQc0LFuJc2ELMNXc0nelqlE46kAKEklknkFnOOv0B88uTY8D71sRy3PXe9I May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: f52a8a4868e04868b55ac2181775afbd May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-188366416 May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f52a8a4868e04868b55ac2181775afbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f52a8a4868e04868b55ac2181775afbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f52a8a4868e04868b55ac2181775afbd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f52a8a4868e04868b55ac2181775afbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-188366416 May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: f52a8a4868e04868b55ac2181775afbd May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-188366416 May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-188366416-project May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: cfaa37a1e079462aa50ec96d3ee3f235 May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-188366416-project May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: {"resize": {"flavorRef": ""}} May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'a0eab27a-ca74-4b94-873f-3474d1645fbd', 'body': {'resize': {'flavorRef': ''}}} May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise error May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi On instance['resize']: May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi '' May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:07:19.406355 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:19.410481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:07:19.410481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:07:19.410481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:07:19.410481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 21 22:07:19.410481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 21 22:07:19.410481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short May 21 22:07:19.410481 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:19.410481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8addf2f4-6142-4f53-8142-24ee7f4703d9 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:07:19.410481 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8addf2f4-6142-4f53-8142-24ee7f4703d9 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "POST /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd/action" status: 400 len: 113 microversion: 2.1 time: 0.007801 May 21 22:07:19.410481 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3507/6885] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:07:19 2022] POST /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd/action => generated 113 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 21 22:07:19.416592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-84555891-b510-4f20-a0d3-e7d03d074d49 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:19.417215 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-84555891-b510-4f20-a0d3-e7d03d074d49 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:19.424154 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-84555891-b510-4f20-a0d3-e7d03d074d49 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:19.424648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-84555891-b510-4f20-a0d3-e7d03d074d49 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:19.425456 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-84555891-b510-4f20-a0d3-e7d03d074d49 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:19.425901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-84555891-b510-4f20-a0d3-e7d03d074d49 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:19.572649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-84555891-b510-4f20-a0d3-e7d03d074d49 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:19.580493 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-84555891-b510-4f20-a0d3-e7d03d074d49 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 200 len: 1506 microversion: 2.1 time: 0.168157 May 21 22:07:19.581075 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3379/6886] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:19 2022] GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:19.601765 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ad42b955-f40f-4744-82eb-13a7bccd483d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:19.602290 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ad42b955-f40f-4744-82eb-13a7bccd483d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a7c99645-69b8-40ae-8cc8-4c774665c126] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:19.609783 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad42b955-f40f-4744-82eb-13a7bccd483d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:19.610257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad42b955-f40f-4744-82eb-13a7bccd483d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:19.611043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad42b955-f40f-4744-82eb-13a7bccd483d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:19.611503 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ad42b955-f40f-4744-82eb-13a7bccd483d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:19.625381 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-ad42b955-f40f-4744-82eb-13a7bccd483d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] HTTP exception thrown: Instance a7c99645-69b8-40ae-8cc8-4c774665c126 could not be found. May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ad42b955-f40f-4744-82eb-13a7bccd483d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Request method failure captured: May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: request: DELETE /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 HTTP/1.1 May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiWJ3_Yg-_a9AIgyvkGLcFySoDePjl7sts7zXMJbd-Kz_UL_rhjJ5KMZRJMvAlTa8xC2fkgUsQFxlTWFEs3UjCYGj_B_jSmIGzDKenqkmT1q5dpRZb8kYCQc0LFuJc2ELMNXc0nelqlE46kAKEklknkFnOOv0B88uTY8D71sRy3PXe9I May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: f52a8a4868e04868b55ac2181775afbd May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-ServersNegativeTestJSON-188366416 May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f52a8a4868e04868b55ac2181775afbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f52a8a4868e04868b55ac2181775afbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f52a8a4868e04868b55ac2181775afbd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f52a8a4868e04868b55ac2181775afbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-ServersNegativeTestJSON-188366416 May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: f52a8a4868e04868b55ac2181775afbd May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-188366416 May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-ServersNegativeTestJSON-188366416-project May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: cfaa37a1e079462aa50ec96d3ee3f235 May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-ServersNegativeTestJSON-188366416-project May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance a7c99645-69b8-40ae-8cc8-4c774665c126 could not be found. May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': 'a7c99645-69b8-40ae-8cc8-4c774665c126'} May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7c99645-69b8-40ae-8cc8-4c774665c126 could not be found. May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:07:19.626963 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:07:19.630726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c99645-69b8-40ae-8cc8-4c774665c126 could not be found. May 21 22:07:19.630726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:19.630726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:07:19.630726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:19.630726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:07:19.630726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:07:19.630726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:07:19.630726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:07:19.630726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:07:19.630726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c99645-69b8-40ae-8cc8-4c774665c126 could not be found. May 21 22:07:19.630726 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:07:19.630726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ad42b955-f40f-4744-82eb-13a7bccd483d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Returning 404 to user: Instance a7c99645-69b8-40ae-8cc8-4c774665c126 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:07:19.630726 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ad42b955-f40f-4744-82eb-13a7bccd483d tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126" status: 404 len: 111 microversion: 2.1 time: 0.031505 May 21 22:07:19.630726 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3508/6887] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:07:19 2022] DELETE /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:07:19.637587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f5ef496e-4b70-47c9-969e-9df4c8413ff3 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:19.642455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f5ef496e-4b70-47c9-969e-9df4c8413ff3 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a7c99645-69b8-40ae-8cc8-4c774665c126] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:19.644604 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5ef496e-4b70-47c9-969e-9df4c8413ff3 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:19.645069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5ef496e-4b70-47c9-969e-9df4c8413ff3 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:19.645843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5ef496e-4b70-47c9-969e-9df4c8413ff3 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:19.646287 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f5ef496e-4b70-47c9-969e-9df4c8413ff3 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:19.659871 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-f5ef496e-4b70-47c9-969e-9df4c8413ff3 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] HTTP exception thrown: Instance a7c99645-69b8-40ae-8cc8-4c774665c126 could not be found. May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f5ef496e-4b70-47c9-969e-9df4c8413ff3 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Request method failure captured: May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 HTTP/1.1 May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWJ3_Yg-_a9AIgyvkGLcFySoDePjl7sts7zXMJbd-Kz_UL_rhjJ5KMZRJMvAlTa8xC2fkgUsQFxlTWFEs3UjCYGj_B_jSmIGzDKenqkmT1q5dpRZb8kYCQc0LFuJc2ELMNXc0nelqlE46kAKEklknkFnOOv0B88uTY8D71sRy3PXe9I May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: f52a8a4868e04868b55ac2181775afbd May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-188366416 May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f52a8a4868e04868b55ac2181775afbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f52a8a4868e04868b55ac2181775afbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f52a8a4868e04868b55ac2181775afbd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f52a8a4868e04868b55ac2181775afbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-188366416 May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: f52a8a4868e04868b55ac2181775afbd May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-188366416 May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-188366416-project May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: cfaa37a1e079462aa50ec96d3ee3f235 May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-188366416-project May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance a7c99645-69b8-40ae-8cc8-4c774665c126 could not be found. May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'a7c99645-69b8-40ae-8cc8-4c774665c126'} May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7c99645-69b8-40ae-8cc8-4c774665c126 could not be found. May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c99645-69b8-40ae-8cc8-4c774665c126 could not be found. May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:07:19.663932 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:07:19.668095 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:07:19.668095 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:07:19.668095 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:07:19.668095 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:07:19.668095 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:07:19.668095 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c99645-69b8-40ae-8cc8-4c774665c126 could not be found. May 21 22:07:19.668095 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:07:19.668095 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f5ef496e-4b70-47c9-969e-9df4c8413ff3 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Returning 404 to user: Instance a7c99645-69b8-40ae-8cc8-4c774665c126 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:07:19.668095 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f5ef496e-4b70-47c9-969e-9df4c8413ff3 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126" status: 404 len: 111 microversion: 2.1 time: 0.029109 May 21 22:07:19.668095 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3380/6888] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:19 2022] GET /compute/v2.1/servers/a7c99645-69b8-40ae-8cc8-4c774665c126 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:07:19.671672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0eccefd9-48a2-481d-9349-4d9ff532442c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:19.672221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0eccefd9-48a2-481d-9349-4d9ff532442c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:19.678473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0eccefd9-48a2-481d-9349-4d9ff532442c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:19.678941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0eccefd9-48a2-481d-9349-4d9ff532442c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:19.680306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0eccefd9-48a2-481d-9349-4d9ff532442c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:19.680759 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0eccefd9-48a2-481d-9349-4d9ff532442c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:19.707228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0eccefd9-48a2-481d-9349-4d9ff532442c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 22:07:19.977188 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0eccefd9-48a2-481d-9349-4d9ff532442c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 204 len: 0 microversion: 2.1 time: 0.309101 May 21 22:07:19.977753 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3509/6889] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:07:19 2022] DELETE /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:07:19.985808 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-25d2f449-dde6-4100-a307-be9a2c24086c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:19.987398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-25d2f449-dde6-4100-a307-be9a2c24086c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:19.992940 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25d2f449-dde6-4100-a307-be9a2c24086c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:19.993399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25d2f449-dde6-4100-a307-be9a2c24086c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:19.994179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25d2f449-dde6-4100-a307-be9a2c24086c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:19.994629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-25d2f449-dde6-4100-a307-be9a2c24086c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:20.137160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-25d2f449-dde6-4100-a307-be9a2c24086c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:20.144748 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-25d2f449-dde6-4100-a307-be9a2c24086c tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 200 len: 1512 microversion: 2.1 time: 0.162883 May 21 22:07:20.145308 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3381/6890] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:19 2022] GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:21.163774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2acf1c56-4c7e-4e84-a4d2-8799044cf87a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:21.164531 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2acf1c56-4c7e-4e84-a4d2-8799044cf87a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:21.171735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2acf1c56-4c7e-4e84-a4d2-8799044cf87a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:21.172212 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2acf1c56-4c7e-4e84-a4d2-8799044cf87a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:21.173032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2acf1c56-4c7e-4e84-a4d2-8799044cf87a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:21.173491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2acf1c56-4c7e-4e84-a4d2-8799044cf87a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:21.332923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2acf1c56-4c7e-4e84-a4d2-8799044cf87a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:21.341083 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2acf1c56-4c7e-4e84-a4d2-8799044cf87a tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 200 len: 1512 microversion: 2.1 time: 0.181712 May 21 22:07:21.341658 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3510/6891] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:21 2022] GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:21.966058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-e5732364-7881-4bde-a0b4-6e00e1610d84 req-2ab535e0-4d63-4f98-90ac-f33e3cc00431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0eab27a-ca74-4b94-873f-3474d1645fbd", "name": "network-vif-deleted", "tag": "350a0766-2d50-4c29-961f-72a5623b4d85"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:07:21.975380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e5732364-7881-4bde-a0b4-6e00e1610d84 req-2ab535e0-4d63-4f98-90ac-f33e3cc00431 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:21.976892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-e5732364-7881-4bde-a0b4-6e00e1610d84 req-2ab535e0-4d63-4f98-90ac-f33e3cc00431 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:21.988964 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-e5732364-7881-4bde-a0b4-6e00e1610d84 req-2ab535e0-4d63-4f98-90ac-f33e3cc00431 service nova] Creating event network-vif-deleted:350a0766-2d50-4c29-961f-72a5623b4d85 for instance a0eab27a-ca74-4b94-873f-3474d1645fbd on nch1-master-1 May 21 22:07:21.994640 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-e5732364-7881-4bde-a0b4-6e00e1610d84 req-2ab535e0-4d63-4f98-90ac-f33e3cc00431 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032404 May 21 22:07:21.995254 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3382/6892] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:07:22.358326 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aa1b8e48-d8e4-4b50-be2d-74df9734e783 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:22.358995 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aa1b8e48-d8e4-4b50-be2d-74df9734e783 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:22.366221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa1b8e48-d8e4-4b50-be2d-74df9734e783 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:22.366717 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa1b8e48-d8e4-4b50-be2d-74df9734e783 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:22.367538 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa1b8e48-d8e4-4b50-be2d-74df9734e783 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:22.367993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa1b8e48-d8e4-4b50-be2d-74df9734e783 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:22.402765 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa1b8e48-d8e4-4b50-be2d-74df9734e783 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:22.403236 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aa1b8e48-d8e4-4b50-be2d-74df9734e783 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:22.403713 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-aa1b8e48-d8e4-4b50-be2d-74df9734e783 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lazy-loading 'fault' on Instance uuid a0eab27a-ca74-4b94-873f-3474d1645fbd {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 22:07:22.451580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aa1b8e48-d8e4-4b50-be2d-74df9734e783 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfaa37a1e079462aa50ec96d3ee3f235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52a8a4868e04868b55ac2181775afbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:07:22.459279 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aa1b8e48-d8e4-4b50-be2d-74df9734e783 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 200 len: 1307 microversion: 2.1 time: 0.104983 May 21 22:07:22.459851 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3511/6893] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:22 2022] GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 1307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:07:23.478528 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fd7decb9-023a-403d-a146-04a1036058c8 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:07:23.479241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fd7decb9-023a-403d-a146-04a1036058c8 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] [instance: a0eab27a-ca74-4b94-873f-3474d1645fbd] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:07:23.485771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fd7decb9-023a-403d-a146-04a1036058c8 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:23.486221 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fd7decb9-023a-403d-a146-04a1036058c8 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:23.487005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fd7decb9-023a-403d-a146-04a1036058c8 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:07:23.487449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fd7decb9-023a-403d-a146-04a1036058c8 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:07:23.501837 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-fd7decb9-023a-403d-a146-04a1036058c8 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] HTTP exception thrown: Instance a0eab27a-ca74-4b94-873f-3474d1645fbd could not be found. May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fd7decb9-023a-403d-a146-04a1036058c8 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Request method failure captured: May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd HTTP/1.1 May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWJ3_Yg-_a9AIgyvkGLcFySoDePjl7sts7zXMJbd-Kz_UL_rhjJ5KMZRJMvAlTa8xC2fkgUsQFxlTWFEs3UjCYGj_B_jSmIGzDKenqkmT1q5dpRZb8kYCQc0LFuJc2ELMNXc0nelqlE46kAKEklknkFnOOv0B88uTY8D71sRy3PXe9I May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: f52a8a4868e04868b55ac2181775afbd May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-ServersNegativeTestJSON-188366416 May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f52a8a4868e04868b55ac2181775afbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f52a8a4868e04868b55ac2181775afbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f52a8a4868e04868b55ac2181775afbd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f52a8a4868e04868b55ac2181775afbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-ServersNegativeTestJSON-188366416 May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: f52a8a4868e04868b55ac2181775afbd May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-188366416 May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-ServersNegativeTestJSON-188366416-project May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: cfaa37a1e079462aa50ec96d3ee3f235 May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-ServersNegativeTestJSON-188366416-project May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance a0eab27a-ca74-4b94-873f-3474d1645fbd could not be found. May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'a0eab27a-ca74-4b94-873f-3474d1645fbd'} May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0eab27a-ca74-4b94-873f-3474d1645fbd could not be found. May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0eab27a-ca74-4b94-873f-3474d1645fbd could not be found. May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:07:23.503491 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:07:23.508863 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:07:23.508863 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:07:23.508863 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:07:23.508863 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:07:23.508863 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:07:23.508863 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0eab27a-ca74-4b94-873f-3474d1645fbd could not be found. May 21 22:07:23.508863 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:07:23.508863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fd7decb9-023a-403d-a146-04a1036058c8 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] Returning 404 to user: Instance a0eab27a-ca74-4b94-873f-3474d1645fbd could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:07:23.508863 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fd7decb9-023a-403d-a146-04a1036058c8 tempest-ServersNegativeTestJSON-188366416 tempest-ServersNegativeTestJSON-188366416-project] 10.222.0.49 "GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd" status: 404 len: 111 microversion: 2.1 time: 0.031673 May 21 22:07:23.508863 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3383/6894] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:07:23 2022] GET /compute/v2.1/servers/a0eab27a-ca74-4b94-873f-3474d1645fbd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:08:20.498992 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3b1d5e7c-794a-41f2-8ed9-779b2e06e14a tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Action: 'create', calling method: .version_select at 0x7fc81b576940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-587110979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIx8emwCh8gCbiJ+kjEB5lrwu7Aub04hTLvgYYj8+Q5dQv1etGs2CbAooCaHuCeQN8tiCaKhmlgxWQRUrrgA4ni8+EEDY5h7KCV9lc0bJuRVeVSGUopFfjhy2k2KJjC2Q=="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:08:20.503517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:08:20.504203 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:08:20.515584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-3b1d5e7c-794a-41f2-8ed9-779b2e06e14a tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Getting quotas for project 06eadd4f12e0405b851488d45af54d4d. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:08:20.521093 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-3b1d5e7c-794a-41f2-8ed9-779b2e06e14a tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Getting quotas for user cd056abbbc444b36aad548923b8ff985 and project 06eadd4f12e0405b851488d45af54d4d. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:08:20.609102 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3b1d5e7c-794a-41f2-8ed9-779b2e06e14a tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.114166 May 21 22:08:20.609784 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3512/6895] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 22:08:20 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:08:20.659396 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fc119ad8-b7bb-4e41-a9ee-050a1edce0f3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1496431947", "imageRef": "0d9350b0-fb3a-45bf-8e61-3b87775a0e06", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-587110979", "networks": [{"uuid": "4d65fe61-463d-489e-9f4b-1ec1e2713cda"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:08:20.667772 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:08:20.668453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=38 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:08:20.906048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-fc119ad8-b7bb-4e41-a9ee-050a1edce0f3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] validate_networks() for [('4d65fe61-463d-489e-9f4b-1ec1e2713cda', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 22:08:21.341313 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-fc119ad8-b7bb-4e41-a9ee-050a1edce0f3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:08:21.341860 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-fc119ad8-b7bb-4e41-a9ee-050a1edce0f3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:08:21.342343 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-fc119ad8-b7bb-4e41-a9ee-050a1edce0f3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:08:21.342754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-fc119ad8-b7bb-4e41-a9ee-050a1edce0f3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:08:21.343170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-fc119ad8-b7bb-4e41-a9ee-050a1edce0f3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:08:21.352408 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc119ad8-b7bb-4e41-a9ee-050a1edce0f3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:21.353009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc119ad8-b7bb-4e41-a9ee-050a1edce0f3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:21.353851 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc119ad8-b7bb-4e41-a9ee-050a1edce0f3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:21.354282 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fc119ad8-b7bb-4e41-a9ee-050a1edce0f3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:21.379799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-fc119ad8-b7bb-4e41-a9ee-050a1edce0f3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Getting quotas for project 06eadd4f12e0405b851488d45af54d4d. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:08:21.381086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-fc119ad8-b7bb-4e41-a9ee-050a1edce0f3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Getting quotas for user cd056abbbc444b36aad548923b8ff985 and project 06eadd4f12e0405b851488d45af54d4d. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:08:21.394762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fc119ad8-b7bb-4e41-a9ee-050a1edce0f3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 22:08:21.397045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fc119ad8-b7bb-4e41-a9ee-050a1edce0f3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d9350b0-fb3a-45bf-8e61-3b87775a0e06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 22:08:21.496653 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fc119ad8-b7bb-4e41-a9ee-050a1edce0f3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.841050 May 21 22:08:21.497311 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3384/6896] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 22:08:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 22:08:21.509395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-860712a2-0230-4922-bf1d-e13ac41efdda tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:21.510039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-860712a2-0230-4922-bf1d-e13ac41efdda tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:21.747694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-860712a2-0230-4922-bf1d-e13ac41efdda tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:21.754709 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-860712a2-0230-4922-bf1d-e13ac41efdda tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1258 microversion: 2.1 time: 0.251338 May 21 22:08:21.755341 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3513/6897] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:08:21 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1258 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:08:22.773835 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-50140b17-e052-4303-81b0-1ac78b0a40db tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:22.774453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-50140b17-e052-4303-81b0-1ac78b0a40db tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:22.780722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50140b17-e052-4303-81b0-1ac78b0a40db tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:22.786805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50140b17-e052-4303-81b0-1ac78b0a40db tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:22.786805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50140b17-e052-4303-81b0-1ac78b0a40db tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:22.786805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-50140b17-e052-4303-81b0-1ac78b0a40db tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:22.854140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-50140b17-e052-4303-81b0-1ac78b0a40db tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:22.862915 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-50140b17-e052-4303-81b0-1ac78b0a40db tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1262 microversion: 2.1 time: 0.094372 May 21 22:08:22.863487 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3385/6898] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:08:22 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1262 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:08:23.879515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a981ea36-16a3-4c98-90b5-a06c6fe01da3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:23.881191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a981ea36-16a3-4c98-90b5-a06c6fe01da3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:23.889686 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a981ea36-16a3-4c98-90b5-a06c6fe01da3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:23.890148 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a981ea36-16a3-4c98-90b5-a06c6fe01da3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:23.891063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a981ea36-16a3-4c98-90b5-a06c6fe01da3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:23.891825 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a981ea36-16a3-4c98-90b5-a06c6fe01da3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:23.973586 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a981ea36-16a3-4c98-90b5-a06c6fe01da3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:23.983345 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a981ea36-16a3-4c98-90b5-a06c6fe01da3 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1316 microversion: 2.1 time: 0.107685 May 21 22:08:23.983942 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3514/6899] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:08:23 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1316 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:08:25.001685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b82ecbd5-baae-4882-ace7-c782475abf46 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:25.002965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b82ecbd5-baae-4882-ace7-c782475abf46 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:25.011312 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b82ecbd5-baae-4882-ace7-c782475abf46 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:25.011870 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b82ecbd5-baae-4882-ace7-c782475abf46 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:25.012759 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b82ecbd5-baae-4882-ace7-c782475abf46 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:25.013198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b82ecbd5-baae-4882-ace7-c782475abf46 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:25.173907 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b82ecbd5-baae-4882-ace7-c782475abf46 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:25.182538 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b82ecbd5-baae-4882-ace7-c782475abf46 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1358 microversion: 2.1 time: 0.184836 May 21 22:08:25.183742 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3386/6900] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:08:24 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:08:26.204196 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-98e2bee9-50e7-4664-9c3a-f8840e16f1e8 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:26.205125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-98e2bee9-50e7-4664-9c3a-f8840e16f1e8 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:26.214752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98e2bee9-50e7-4664-9c3a-f8840e16f1e8 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:26.215770 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98e2bee9-50e7-4664-9c3a-f8840e16f1e8 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:26.216948 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98e2bee9-50e7-4664-9c3a-f8840e16f1e8 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:26.217685 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-98e2bee9-50e7-4664-9c3a-f8840e16f1e8 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:26.411765 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-98e2bee9-50e7-4664-9c3a-f8840e16f1e8 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:26.421291 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-98e2bee9-50e7-4664-9c3a-f8840e16f1e8 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1358 microversion: 2.1 time: 0.221547 May 21 22:08:26.478795 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3515/6901] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:08:26 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:08:27.468137 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3cc592ee-45ee-464d-a8ae-687ac11139b8 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:27.468801 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3cc592ee-45ee-464d-a8ae-687ac11139b8 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:27.476127 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cc592ee-45ee-464d-a8ae-687ac11139b8 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:27.476647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cc592ee-45ee-464d-a8ae-687ac11139b8 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:27.477444 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cc592ee-45ee-464d-a8ae-687ac11139b8 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:27.477913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3cc592ee-45ee-464d-a8ae-687ac11139b8 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:27.639252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3cc592ee-45ee-464d-a8ae-687ac11139b8 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:27.647005 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3cc592ee-45ee-464d-a8ae-687ac11139b8 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1358 microversion: 2.1 time: 0.183749 May 21 22:08:27.647800 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3387/6902] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:08:27 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:08:28.664498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2fc1eec5-dae2-4aa0-9c89-0eea829787f5 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:28.666458 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2fc1eec5-dae2-4aa0-9c89-0eea829787f5 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:28.673841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fc1eec5-dae2-4aa0-9c89-0eea829787f5 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:28.674654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fc1eec5-dae2-4aa0-9c89-0eea829787f5 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:28.675693 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fc1eec5-dae2-4aa0-9c89-0eea829787f5 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:28.677000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2fc1eec5-dae2-4aa0-9c89-0eea829787f5 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:28.830107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2fc1eec5-dae2-4aa0-9c89-0eea829787f5 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:28.839096 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2fc1eec5-dae2-4aa0-9c89-0eea829787f5 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1358 microversion: 2.1 time: 0.178643 May 21 22:08:28.839698 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3516/6903] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:08:28 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:08:29.856602 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9670b56a-aa38-439e-ac6c-4cb1e705753d tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:29.857258 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9670b56a-aa38-439e-ac6c-4cb1e705753d tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:29.865152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9670b56a-aa38-439e-ac6c-4cb1e705753d tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:29.865621 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9670b56a-aa38-439e-ac6c-4cb1e705753d tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:29.866489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9670b56a-aa38-439e-ac6c-4cb1e705753d tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:29.867078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9670b56a-aa38-439e-ac6c-4cb1e705753d tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:30.038437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9670b56a-aa38-439e-ac6c-4cb1e705753d tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:30.047556 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9670b56a-aa38-439e-ac6c-4cb1e705753d tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1358 microversion: 2.1 time: 0.195292 May 21 22:08:30.048454 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3388/6904] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:08:29 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:08:31.065669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d5102f81-ef31-4978-851d-4a1eaaaefa21 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:31.110640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d5102f81-ef31-4978-851d-4a1eaaaefa21 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:31.110640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5102f81-ef31-4978-851d-4a1eaaaefa21 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:31.110640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5102f81-ef31-4978-851d-4a1eaaaefa21 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:31.110640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5102f81-ef31-4978-851d-4a1eaaaefa21 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:31.110640 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d5102f81-ef31-4978-851d-4a1eaaaefa21 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:31.262123 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d5102f81-ef31-4978-851d-4a1eaaaefa21 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:31.270786 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d5102f81-ef31-4978-851d-4a1eaaaefa21 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1358 microversion: 2.1 time: 0.209283 May 21 22:08:31.271389 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3517/6905] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:08:31 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:08:32.287181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-10271c0c-b7f2-4369-a0e2-8a34518793b9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:32.287958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-10271c0c-b7f2-4369-a0e2-8a34518793b9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:32.290911 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:08:32.291598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:08:32.296561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-10271c0c-b7f2-4369-a0e2-8a34518793b9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:32.297019 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-10271c0c-b7f2-4369-a0e2-8a34518793b9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:32.297974 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-10271c0c-b7f2-4369-a0e2-8a34518793b9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:32.298513 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-10271c0c-b7f2-4369-a0e2-8a34518793b9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:32.444167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-10271c0c-b7f2-4369-a0e2-8a34518793b9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:32.452427 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-10271c0c-b7f2-4369-a0e2-8a34518793b9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1358 microversion: 2.1 time: 0.169151 May 21 22:08:32.453228 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3389/6906] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:08:32 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:08:32.825442 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-5ea0f88d-0644-4320-ac51-33a3e5b92f6c req-34105c2b-a25b-40f3-a584-00cbda737dff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2a2e888-71ce-4335-b41b-14a015e8cb26", "tag": "ed869fdc-b06a-45da-a88d-a77a6c616e4a"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:08:32.834946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:08:32.839777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5ea0f88d-0644-4320-ac51-33a3e5b92f6c req-34105c2b-a25b-40f3-a584-00cbda737dff service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:32.840355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5ea0f88d-0644-4320-ac51-33a3e5b92f6c req-34105c2b-a25b-40f3-a584-00cbda737dff service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:32.853429 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-5ea0f88d-0644-4320-ac51-33a3e5b92f6c req-34105c2b-a25b-40f3-a584-00cbda737dff service nova] Creating event network-changed:ed869fdc-b06a-45da-a88d-a77a6c616e4a for instance f2a2e888-71ce-4335-b41b-14a015e8cb26 on nch1-master-1 May 21 22:08:32.858911 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-5ea0f88d-0644-4320-ac51-33a3e5b92f6c req-34105c2b-a25b-40f3-a584-00cbda737dff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041354 May 21 22:08:32.861302 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3518/6907] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:08:33.470044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3d9fbdbf-ba8f-4426-9aa2-770b4658da33 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:33.471142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3d9fbdbf-ba8f-4426-9aa2-770b4658da33 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:33.478798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d9fbdbf-ba8f-4426-9aa2-770b4658da33 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:33.481578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d9fbdbf-ba8f-4426-9aa2-770b4658da33 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:33.481578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d9fbdbf-ba8f-4426-9aa2-770b4658da33 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:33.481578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3d9fbdbf-ba8f-4426-9aa2-770b4658da33 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:33.640780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3d9fbdbf-ba8f-4426-9aa2-770b4658da33 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:33.648645 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3d9fbdbf-ba8f-4426-9aa2-770b4658da33 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1358 microversion: 2.1 time: 0.182856 May 21 22:08:33.649219 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3390/6908] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:08:33 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:08:34.675251 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-df7a1917-b28d-4905-ad72-3891d8d8d016 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:34.675983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-df7a1917-b28d-4905-ad72-3891d8d8d016 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:34.684581 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-df7a1917-b28d-4905-ad72-3891d8d8d016 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:34.685061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-df7a1917-b28d-4905-ad72-3891d8d8d016 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:34.685868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-df7a1917-b28d-4905-ad72-3891d8d8d016 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:34.686335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-df7a1917-b28d-4905-ad72-3891d8d8d016 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:34.831657 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-df7a1917-b28d-4905-ad72-3891d8d8d016 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:34.840154 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-df7a1917-b28d-4905-ad72-3891d8d8d016 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1358 microversion: 2.1 time: 0.177245 May 21 22:08:34.840758 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3519/6909] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:08:34 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:08:35.857702 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2493349b-ceb4-4d95-a61d-78579ed04b97 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:35.858317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2493349b-ceb4-4d95-a61d-78579ed04b97 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:35.865089 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2493349b-ceb4-4d95-a61d-78579ed04b97 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:35.865540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2493349b-ceb4-4d95-a61d-78579ed04b97 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:35.866300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2493349b-ceb4-4d95-a61d-78579ed04b97 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:35.866736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2493349b-ceb4-4d95-a61d-78579ed04b97 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:36.309946 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2493349b-ceb4-4d95-a61d-78579ed04b97 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:36.318237 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2493349b-ceb4-4d95-a61d-78579ed04b97 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1358 microversion: 2.1 time: 0.464940 May 21 22:08:36.318847 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3391/6910] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:08:35 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1358 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:08:37.335486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-18d1f97a-1896-419b-ab01-1e693c4368f0 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:37.336053 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-18d1f97a-1896-419b-ab01-1e693c4368f0 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:37.344262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-18d1f97a-1896-419b-ab01-1e693c4368f0 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:37.344763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-18d1f97a-1896-419b-ab01-1e693c4368f0 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:37.345564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-18d1f97a-1896-419b-ab01-1e693c4368f0 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:37.346027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-18d1f97a-1896-419b-ab01-1e693c4368f0 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:37.529891 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-18d1f97a-1896-419b-ab01-1e693c4368f0 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:37.537879 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-18d1f97a-1896-419b-ab01-1e693c4368f0 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1358 microversion: 2.1 time: 0.206484 May 21 22:08:37.538451 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3520/6911] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:08:37 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:08:38.558332 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-daf0bae1-b5b7-4306-b2b1-592362f82fbd tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:38.558332 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-daf0bae1-b5b7-4306-b2b1-592362f82fbd tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:38.561853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-daf0bae1-b5b7-4306-b2b1-592362f82fbd tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:38.562322 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-daf0bae1-b5b7-4306-b2b1-592362f82fbd tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:38.563213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-daf0bae1-b5b7-4306-b2b1-592362f82fbd tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:38.563665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-daf0bae1-b5b7-4306-b2b1-592362f82fbd tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:38.614265 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-23a23ce3-40c7-4d77-b1e2-2ae662356d4b req-0b2405cd-beee-4d1a-9a2d-f9eb52f67b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a2e888-71ce-4335-b41b-14a015e8cb26", "name": "network-vif-plugged", "status": "completed", "tag": "ed869fdc-b06a-45da-a88d-a77a6c616e4a"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:08:38.623425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-23a23ce3-40c7-4d77-b1e2-2ae662356d4b req-0b2405cd-beee-4d1a-9a2d-f9eb52f67b24 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:38.624043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-23a23ce3-40c7-4d77-b1e2-2ae662356d4b req-0b2405cd-beee-4d1a-9a2d-f9eb52f67b24 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:38.636541 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-23a23ce3-40c7-4d77-b1e2-2ae662356d4b req-0b2405cd-beee-4d1a-9a2d-f9eb52f67b24 service nova] Creating event network-vif-plugged:ed869fdc-b06a-45da-a88d-a77a6c616e4a for instance f2a2e888-71ce-4335-b41b-14a015e8cb26 on nch1-master-1 May 21 22:08:38.645497 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-23a23ce3-40c7-4d77-b1e2-2ae662356d4b req-0b2405cd-beee-4d1a-9a2d-f9eb52f67b24 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099422 May 21 22:08:38.646267 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3392/6912] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:08:38.741398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-daf0bae1-b5b7-4306-b2b1-592362f82fbd tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:38.750224 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-daf0bae1-b5b7-4306-b2b1-592362f82fbd tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1358 microversion: 2.1 time: 0.200193 May 21 22:08:38.750845 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3521/6913] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:08:38 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:08:39.769499 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b59b5cf6-ab98-420c-af9f-144dc38ce0a9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:39.770211 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b59b5cf6-ab98-420c-af9f-144dc38ce0a9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:39.777296 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b59b5cf6-ab98-420c-af9f-144dc38ce0a9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:39.777753 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b59b5cf6-ab98-420c-af9f-144dc38ce0a9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:39.778523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b59b5cf6-ab98-420c-af9f-144dc38ce0a9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:39.778964 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b59b5cf6-ab98-420c-af9f-144dc38ce0a9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:39.927140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b59b5cf6-ab98-420c-af9f-144dc38ce0a9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:39.934925 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b59b5cf6-ab98-420c-af9f-144dc38ce0a9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1358 microversion: 2.1 time: 0.170451 May 21 22:08:39.935422 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3393/6914] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:08:39 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:08:40.952439 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-071a183a-22fd-40fc-9e41-ea1f95135167 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:40.953086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-071a183a-22fd-40fc-9e41-ea1f95135167 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:40.960243 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-071a183a-22fd-40fc-9e41-ea1f95135167 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:40.960754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-071a183a-22fd-40fc-9e41-ea1f95135167 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:40.961547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-071a183a-22fd-40fc-9e41-ea1f95135167 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:40.962054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-071a183a-22fd-40fc-9e41-ea1f95135167 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:41.104900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-071a183a-22fd-40fc-9e41-ea1f95135167 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:41.112678 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-071a183a-22fd-40fc-9e41-ea1f95135167 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1548 microversion: 2.1 time: 0.164605 May 21 22:08:41.113250 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3522/6915] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:08:40 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:08:41.129286 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-847cd865-f71c-4003-97ef-ad0925b56404 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:41.129939 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-847cd865-f71c-4003-97ef-ad0925b56404 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:41.137278 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-847cd865-f71c-4003-97ef-ad0925b56404 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:41.137774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-847cd865-f71c-4003-97ef-ad0925b56404 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:41.138554 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-847cd865-f71c-4003-97ef-ad0925b56404 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:41.139136 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-847cd865-f71c-4003-97ef-ad0925b56404 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:41.282868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-847cd865-f71c-4003-97ef-ad0925b56404 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:41.290823 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-847cd865-f71c-4003-97ef-ad0925b56404 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1548 microversion: 2.1 time: 0.165280 May 21 22:08:41.295391 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3394/6916] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:08:41 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:08:41.306721 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2618b4b0-5e4e-470d-a81f-d6913623b99e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:41.310048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2618b4b0-5e4e-470d-a81f-d6913623b99e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:41.310827 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2618b4b0-5e4e-470d-a81f-d6913623b99e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Searching by: {'deleted': False, 'project_id': '06eadd4f12e0405b851488d45af54d4d'} {{(pid=131277) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 21 22:08:41.316659 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2618b4b0-5e4e-470d-a81f-d6913623b99e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:41.325070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2618b4b0-5e4e-470d-a81f-d6913623b99e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:41.325070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2618b4b0-5e4e-470d-a81f-d6913623b99e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:41.325070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2618b4b0-5e4e-470d-a81f-d6913623b99e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:41.342819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.multi_cell_list [None req-2618b4b0-5e4e-470d-a81f-d6913623b99e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131277) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 21 22:08:41.369568 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2618b4b0-5e4e-470d-a81f-d6913623b99e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.066749 May 21 22:08:41.370152 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3523/6917] 10.222.0.49 () {58 vars in 1124 bytes} [Sat May 21 22:08:41 2022] GET /compute/v2.1/servers => generated 343 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:08:41.381123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8d644956-7982-4a10-8bcf-9264576e27f6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:41.381924 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8d644956-7982-4a10-8bcf-9264576e27f6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:41.388838 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d644956-7982-4a10-8bcf-9264576e27f6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:41.389300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d644956-7982-4a10-8bcf-9264576e27f6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:41.390122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d644956-7982-4a10-8bcf-9264576e27f6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:41.390572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8d644956-7982-4a10-8bcf-9264576e27f6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:41.532207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8d644956-7982-4a10-8bcf-9264576e27f6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:41.540250 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8d644956-7982-4a10-8bcf-9264576e27f6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1548 microversion: 2.1 time: 0.163536 May 21 22:08:41.540882 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3395/6918] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:08:41 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:08:43.411933 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4aa0af82-2be8-48dd-b4a6-f1bf45505121 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05c746d6-3606-4737-8f9e-b03843e60040"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:08:43.413034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4aa0af82-2be8-48dd-b4a6-f1bf45505121 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:43.419827 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4aa0af82-2be8-48dd-b4a6-f1bf45505121 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:43.420321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4aa0af82-2be8-48dd-b4a6-f1bf45505121 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:43.421107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4aa0af82-2be8-48dd-b4a6-f1bf45505121 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:43.421567 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4aa0af82-2be8-48dd-b4a6-f1bf45505121 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:44.165143 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4aa0af82-2be8-48dd-b4a6-f1bf45505121 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "POST /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.757073 May 21 22:08:44.166464 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3524/6919] 10.222.0.49 () {60 vars in 1322 bytes} [Sat May 21 22:08:43 2022] POST /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26/os-volume_attachments => generated 194 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:08:47.494482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-784267ab-192d-43ac-ba8c-77c977388c76 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:47.495103 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-784267ab-192d-43ac-ba8c-77c977388c76 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:47.502267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-784267ab-192d-43ac-ba8c-77c977388c76 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:47.502720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-784267ab-192d-43ac-ba8c-77c977388c76 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:47.503488 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-784267ab-192d-43ac-ba8c-77c977388c76 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:47.503927 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-784267ab-192d-43ac-ba8c-77c977388c76 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:47.647543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-784267ab-192d-43ac-ba8c-77c977388c76 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:47.656201 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-784267ab-192d-43ac-ba8c-77c977388c76 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1594 microversion: 2.1 time: 0.165350 May 21 22:08:47.656817 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3396/6920] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:08:47 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1594 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:08:50.032910 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f47afb8f-50eb-4c94-9b76-54cc2a882152 req-70b926b5-848b-4932-9fc8-2e02f7a193f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2a2e888-71ce-4335-b41b-14a015e8cb26", "tag": "ed869fdc-b06a-45da-a88d-a77a6c616e4a"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:08:50.041771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f47afb8f-50eb-4c94-9b76-54cc2a882152 req-70b926b5-848b-4932-9fc8-2e02f7a193f4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:50.042240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f47afb8f-50eb-4c94-9b76-54cc2a882152 req-70b926b5-848b-4932-9fc8-2e02f7a193f4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:50.055029 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f47afb8f-50eb-4c94-9b76-54cc2a882152 req-70b926b5-848b-4932-9fc8-2e02f7a193f4 service nova] Creating event network-changed:ed869fdc-b06a-45da-a88d-a77a6c616e4a for instance f2a2e888-71ce-4335-b41b-14a015e8cb26 on nch1-master-1 May 21 22:08:50.061272 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f47afb8f-50eb-4c94-9b76-54cc2a882152 req-70b926b5-848b-4932-9fc8-2e02f7a193f4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084179 May 21 22:08:50.062485 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3525/6921] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:08:52.407373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cae456c5-d7ea-47c0-a256-816141c3bcd6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1902506440"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:08:52.410876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cae456c5-d7ea-47c0-a256-816141c3bcd6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:52.410876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:08:52.415800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cae456c5-d7ea-47c0-a256-816141c3bcd6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:52.416265 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cae456c5-d7ea-47c0-a256-816141c3bcd6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:52.417070 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cae456c5-d7ea-47c0-a256-816141c3bcd6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:52.417552 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cae456c5-d7ea-47c0-a256-816141c3bcd6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:52.421281 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=71 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:08:52.579189 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.network.security_group_api [None req-cae456c5-d7ea-47c0-a256-816141c3bcd6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Adding security group 91a3bb65-b697-41f0-b29f-19c06cd5bd21 to port ed869fdc-b06a-45da-a88d-a77a6c616e4a May 21 22:08:53.425157 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cae456c5-d7ea-47c0-a256-816141c3bcd6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "POST /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26/action" status: 202 len: 0 microversion: 2.1 time: 1.021708 May 21 22:08:53.428609 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3397/6922] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:08:52 2022] POST /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26/action => generated 0 bytes in 1025 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 21 22:08:53.435798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:08:53.440824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-946d9b2b-4a0b-4554-b589-a1b88d20245d tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:08:53.453136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-946d9b2b-4a0b-4554-b589-a1b88d20245d tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:08:53.457194 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:08:53.471419 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-946d9b2b-4a0b-4554-b589-a1b88d20245d tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:53.472300 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-946d9b2b-4a0b-4554-b589-a1b88d20245d tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:53.473268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-946d9b2b-4a0b-4554-b589-a1b88d20245d tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:53.473789 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-946d9b2b-4a0b-4554-b589-a1b88d20245d tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:53.515058 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:08:53.607874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-227a77ae-9473-48c1-b249-7a29de89c823 req-8cd7f6be-9d7c-46d9-a1fa-aace07caa210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2a2e888-71ce-4335-b41b-14a015e8cb26", "tag": "ed869fdc-b06a-45da-a88d-a77a6c616e4a"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:08:53.621697 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-227a77ae-9473-48c1-b249-7a29de89c823 req-8cd7f6be-9d7c-46d9-a1fa-aace07caa210 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:08:53.622477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-227a77ae-9473-48c1-b249-7a29de89c823 req-8cd7f6be-9d7c-46d9-a1fa-aace07caa210 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:08:53.639659 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-227a77ae-9473-48c1-b249-7a29de89c823 req-8cd7f6be-9d7c-46d9-a1fa-aace07caa210 service nova] Creating event network-changed:ed869fdc-b06a-45da-a88d-a77a6c616e4a for instance f2a2e888-71ce-4335-b41b-14a015e8cb26 on nch1-master-1 May 21 22:08:53.645834 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-227a77ae-9473-48c1-b249-7a29de89c823 req-8cd7f6be-9d7c-46d9-a1fa-aace07caa210 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131164 May 21 22:08:53.653846 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3398/6923] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:08:53.754027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-946d9b2b-4a0b-4554-b589-a1b88d20245d tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:08:53.763014 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-946d9b2b-4a0b-4554-b589-a1b88d20245d tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1760 microversion: 2.1 time: 0.328963 May 21 22:08:53.764187 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3526/6924] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:08:53 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1760 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:09:16.385194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:09:16.386848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=5 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:09:16.391345 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-efdf2907-7529-4713-8d97-88ca6f01ebf9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:09:16.392411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-efdf2907-7529-4713-8d97-88ca6f01ebf9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:09:16.401481 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efdf2907-7529-4713-8d97-88ca6f01ebf9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:16.402173 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efdf2907-7529-4713-8d97-88ca6f01ebf9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:16.403205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efdf2907-7529-4713-8d97-88ca6f01ebf9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:16.403644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-efdf2907-7529-4713-8d97-88ca6f01ebf9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:16.638807 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-efdf2907-7529-4713-8d97-88ca6f01ebf9 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "POST /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26/action" status: 202 len: 0 microversion: 2.1 time: 0.255247 May 21 22:09:16.639396 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3399/6925] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:09:16 2022] POST /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:09:16.647630 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-930cf5c9-b61f-4f61-ba0d-99097a35dea6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:09:16.648267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-930cf5c9-b61f-4f61-ba0d-99097a35dea6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:09:16.651739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:09:16.659368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-930cf5c9-b61f-4f61-ba0d-99097a35dea6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:16.661507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-930cf5c9-b61f-4f61-ba0d-99097a35dea6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:16.661507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-930cf5c9-b61f-4f61-ba0d-99097a35dea6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:16.661507 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-930cf5c9-b61f-4f61-ba0d-99097a35dea6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:16.880010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-930cf5c9-b61f-4f61-ba0d-99097a35dea6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:09:16.888682 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-930cf5c9-b61f-4f61-ba0d-99097a35dea6 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1752 microversion: 2.1 time: 0.244967 May 21 22:09:16.889315 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3527/6926] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:09:16 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1752 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:09:17.907425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-39b1a66c-dc68-4e3f-b361-d4a45f6547b7 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:09:17.908134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-39b1a66c-dc68-4e3f-b361-d4a45f6547b7 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:09:17.914565 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39b1a66c-dc68-4e3f-b361-d4a45f6547b7 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:17.915019 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39b1a66c-dc68-4e3f-b361-d4a45f6547b7 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:17.915788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39b1a66c-dc68-4e3f-b361-d4a45f6547b7 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:17.916229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39b1a66c-dc68-4e3f-b361-d4a45f6547b7 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:18.077134 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-39b1a66c-dc68-4e3f-b361-d4a45f6547b7 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:09:18.091766 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-39b1a66c-dc68-4e3f-b361-d4a45f6547b7 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1757 microversion: 2.1 time: 0.189375 May 21 22:09:18.092368 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3400/6927] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:09:17 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:09:19.109950 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3a65cc9f-3664-489e-a926-3d3ded5e3639 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:09:19.110591 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3a65cc9f-3664-489e-a926-3d3ded5e3639 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:09:19.117687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a65cc9f-3664-489e-a926-3d3ded5e3639 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:19.118151 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a65cc9f-3664-489e-a926-3d3ded5e3639 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:19.118937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a65cc9f-3664-489e-a926-3d3ded5e3639 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:19.119394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3a65cc9f-3664-489e-a926-3d3ded5e3639 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:19.277956 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3a65cc9f-3664-489e-a926-3d3ded5e3639 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:09:19.286457 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3a65cc9f-3664-489e-a926-3d3ded5e3639 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1757 microversion: 2.1 time: 0.180486 May 21 22:09:19.287028 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3528/6928] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:09:19 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:09:20.303981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e38c79f9-ee7b-4e56-884b-5edf13fa6cd1 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:09:20.304641 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e38c79f9-ee7b-4e56-884b-5edf13fa6cd1 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:09:20.312373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e38c79f9-ee7b-4e56-884b-5edf13fa6cd1 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:20.312826 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e38c79f9-ee7b-4e56-884b-5edf13fa6cd1 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:20.313617 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e38c79f9-ee7b-4e56-884b-5edf13fa6cd1 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:20.314315 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e38c79f9-ee7b-4e56-884b-5edf13fa6cd1 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:20.474394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e38c79f9-ee7b-4e56-884b-5edf13fa6cd1 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:09:20.483103 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e38c79f9-ee7b-4e56-884b-5edf13fa6cd1 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1757 microversion: 2.1 time: 0.182993 May 21 22:09:20.483661 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3401/6929] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:09:20 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:09:21.500723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-79891d97-79e0-4444-b3cf-3ae1e20609f4 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:09:21.501380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-79891d97-79e0-4444-b3cf-3ae1e20609f4 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:09:21.508467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-79891d97-79e0-4444-b3cf-3ae1e20609f4 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:21.508943 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-79891d97-79e0-4444-b3cf-3ae1e20609f4 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:21.509733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-79891d97-79e0-4444-b3cf-3ae1e20609f4 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:21.510197 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-79891d97-79e0-4444-b3cf-3ae1e20609f4 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:21.680452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-79891d97-79e0-4444-b3cf-3ae1e20609f4 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:09:21.689649 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-79891d97-79e0-4444-b3cf-3ae1e20609f4 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1757 microversion: 2.1 time: 0.192889 May 21 22:09:21.690227 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3529/6930] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:09:21 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:09:22.707097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d4fa079e-0954-4020-ac39-c9d862d100cb tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:09:22.707716 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d4fa079e-0954-4020-ac39-c9d862d100cb tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:09:22.715512 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d4fa079e-0954-4020-ac39-c9d862d100cb tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:22.715966 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d4fa079e-0954-4020-ac39-c9d862d100cb tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:22.716774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d4fa079e-0954-4020-ac39-c9d862d100cb tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:22.717213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d4fa079e-0954-4020-ac39-c9d862d100cb tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:22.872239 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d4fa079e-0954-4020-ac39-c9d862d100cb tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:09:22.880390 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d4fa079e-0954-4020-ac39-c9d862d100cb tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1757 microversion: 2.1 time: 0.177221 May 21 22:09:22.880957 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3402/6931] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:09:22 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:09:23.898308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0e986c35-76e9-4986-b1bd-c9fada7da107 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:09:23.898937 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0e986c35-76e9-4986-b1bd-c9fada7da107 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:09:23.906587 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e986c35-76e9-4986-b1bd-c9fada7da107 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:23.907048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e986c35-76e9-4986-b1bd-c9fada7da107 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:23.907827 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e986c35-76e9-4986-b1bd-c9fada7da107 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:23.908299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0e986c35-76e9-4986-b1bd-c9fada7da107 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:24.067005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0e986c35-76e9-4986-b1bd-c9fada7da107 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:09:24.075403 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0e986c35-76e9-4986-b1bd-c9fada7da107 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1757 microversion: 2.1 time: 0.181035 May 21 22:09:24.075985 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3530/6932] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:09:23 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:09:25.092898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d2e52bfa-1aa3-420f-bc5d-17f77e0e5596 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:09:25.093449 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d2e52bfa-1aa3-420f-bc5d-17f77e0e5596 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:09:25.100443 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2e52bfa-1aa3-420f-bc5d-17f77e0e5596 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:25.100900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2e52bfa-1aa3-420f-bc5d-17f77e0e5596 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:25.101678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2e52bfa-1aa3-420f-bc5d-17f77e0e5596 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:25.102119 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d2e52bfa-1aa3-420f-bc5d-17f77e0e5596 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:25.276331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d2e52bfa-1aa3-420f-bc5d-17f77e0e5596 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:09:25.284663 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d2e52bfa-1aa3-420f-bc5d-17f77e0e5596 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1757 microversion: 2.1 time: 0.196057 May 21 22:09:25.285232 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3403/6933] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:09:25 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:09:26.302238 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2b76b10b-662d-4aec-aca0-648e4f4c242e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:09:26.302791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2b76b10b-662d-4aec-aca0-648e4f4c242e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:09:26.310163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b76b10b-662d-4aec-aca0-648e4f4c242e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:26.310653 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b76b10b-662d-4aec-aca0-648e4f4c242e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:26.311406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b76b10b-662d-4aec-aca0-648e4f4c242e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:26.311854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b76b10b-662d-4aec-aca0-648e4f4c242e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:26.475392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2b76b10b-662d-4aec-aca0-648e4f4c242e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:09:26.483875 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2b76b10b-662d-4aec-aca0-648e4f4c242e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1757 microversion: 2.1 time: 0.185795 May 21 22:09:26.484491 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3531/6934] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:09:26 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:09:27.501304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-39c4fffd-c2a3-4969-b678-e531d2e71cc1 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:09:27.501920 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-39c4fffd-c2a3-4969-b678-e531d2e71cc1 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:09:27.509148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39c4fffd-c2a3-4969-b678-e531d2e71cc1 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:27.509594 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39c4fffd-c2a3-4969-b678-e531d2e71cc1 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:27.510368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39c4fffd-c2a3-4969-b678-e531d2e71cc1 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:27.510828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-39c4fffd-c2a3-4969-b678-e531d2e71cc1 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:27.668407 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-39c4fffd-c2a3-4969-b678-e531d2e71cc1 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:09:27.676608 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-39c4fffd-c2a3-4969-b678-e531d2e71cc1 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1757 microversion: 2.1 time: 0.179163 May 21 22:09:27.677601 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3404/6935] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:09:27 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:09:28.694222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e8bd14ba-fe07-4284-8516-d17244798f34 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:09:28.694866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e8bd14ba-fe07-4284-8516-d17244798f34 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:09:28.701947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8bd14ba-fe07-4284-8516-d17244798f34 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:28.702425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8bd14ba-fe07-4284-8516-d17244798f34 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:28.703219 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8bd14ba-fe07-4284-8516-d17244798f34 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:28.703680 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8bd14ba-fe07-4284-8516-d17244798f34 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:28.867898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e8bd14ba-fe07-4284-8516-d17244798f34 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:09:28.876262 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e8bd14ba-fe07-4284-8516-d17244798f34 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1757 microversion: 2.1 time: 0.186045 May 21 22:09:28.876872 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3532/6936] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:09:28 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:09:29.893661 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6c45a3b9-01b4-4ea1-82d9-dba777017376 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:09:29.894280 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6c45a3b9-01b4-4ea1-82d9-dba777017376 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:09:29.902358 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c45a3b9-01b4-4ea1-82d9-dba777017376 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:29.902817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c45a3b9-01b4-4ea1-82d9-dba777017376 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:29.903600 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c45a3b9-01b4-4ea1-82d9-dba777017376 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:29.904647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6c45a3b9-01b4-4ea1-82d9-dba777017376 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:30.071545 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6c45a3b9-01b4-4ea1-82d9-dba777017376 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:09:30.079949 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6c45a3b9-01b4-4ea1-82d9-dba777017376 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1757 microversion: 2.1 time: 0.190152 May 21 22:09:30.080558 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3405/6937] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:09:29 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:09:31.098154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e594a103-b018-443d-a62a-0411b3992270 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:09:31.098697 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e594a103-b018-443d-a62a-0411b3992270 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:09:31.106824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e594a103-b018-443d-a62a-0411b3992270 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:31.107289 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e594a103-b018-443d-a62a-0411b3992270 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:31.108129 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e594a103-b018-443d-a62a-0411b3992270 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:31.108677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e594a103-b018-443d-a62a-0411b3992270 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:31.268329 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e594a103-b018-443d-a62a-0411b3992270 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:09:31.278663 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e594a103-b018-443d-a62a-0411b3992270 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1757 microversion: 2.1 time: 0.184577 May 21 22:09:31.279255 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3533/6938] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:09:31 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:09:32.296576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2e546784-bc56-432d-b9c8-b5a4d87e2ceb tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:09:32.297203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2e546784-bc56-432d-b9c8-b5a4d87e2ceb tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:09:32.304266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e546784-bc56-432d-b9c8-b5a4d87e2ceb tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:32.304752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e546784-bc56-432d-b9c8-b5a4d87e2ceb tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:32.305526 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e546784-bc56-432d-b9c8-b5a4d87e2ceb tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:32.305971 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2e546784-bc56-432d-b9c8-b5a4d87e2ceb tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:32.463191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2e546784-bc56-432d-b9c8-b5a4d87e2ceb tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:09:32.471997 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2e546784-bc56-432d-b9c8-b5a4d87e2ceb tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1757 microversion: 2.1 time: 0.180092 May 21 22:09:32.472620 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3406/6939] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:09:32 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:09:33.490107 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3b64df03-a54b-4319-b05f-026680abe2b0 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:09:33.490930 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3b64df03-a54b-4319-b05f-026680abe2b0 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:09:33.499050 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b64df03-a54b-4319-b05f-026680abe2b0 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:33.499516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b64df03-a54b-4319-b05f-026680abe2b0 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:33.500342 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b64df03-a54b-4319-b05f-026680abe2b0 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:09:33.500799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3b64df03-a54b-4319-b05f-026680abe2b0 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:09:33.665379 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3b64df03-a54b-4319-b05f-026680abe2b0 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:09:33.674315 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3b64df03-a54b-4319-b05f-026680abe2b0 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1760 microversion: 2.1 time: 0.188142 May 21 22:09:33.674891 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3534/6940] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:09:33 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1760 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:10:05.785887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d649e24c-6ed0-40c7-b6ed-3c09c52e550b tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1902506440"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:10:05.786548 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d649e24c-6ed0-40c7-b6ed-3c09c52e550b tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:05.788642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=16 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:10:05.789305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:10:05.794073 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d649e24c-6ed0-40c7-b6ed-3c09c52e550b tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:05.794521 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d649e24c-6ed0-40c7-b6ed-3c09c52e550b tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:05.795290 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d649e24c-6ed0-40c7-b6ed-3c09c52e550b tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:05.795721 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d649e24c-6ed0-40c7-b6ed-3c09c52e550b tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:05.939912 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.network.security_group_api [None req-d649e24c-6ed0-40c7-b6ed-3c09c52e550b tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Removing security group 91a3bb65-b697-41f0-b29f-19c06cd5bd21 from port ed869fdc-b06a-45da-a88d-a77a6c616e4a May 21 22:10:06.469161 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d649e24c-6ed0-40c7-b6ed-3c09c52e550b tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "POST /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26/action" status: 202 len: 0 microversion: 2.1 time: 0.687492 May 21 22:10:06.473046 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3407/6941] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:10:05 2022] POST /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26/action => generated 0 bytes in 689 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:10:06.473751 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-7c81ba6f-1e5f-4649-abc6-aeabbedb7bbe req-fa23121e-5457-4225-8980-aeea2eb8acb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2a2e888-71ce-4335-b41b-14a015e8cb26", "tag": "ed869fdc-b06a-45da-a88d-a77a6c616e4a"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:10:06.482412 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=16 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:10:06.483380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=53 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:10:06.485685 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7c81ba6f-1e5f-4649-abc6-aeabbedb7bbe req-fa23121e-5457-4225-8980-aeea2eb8acb2 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:06.486354 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7c81ba6f-1e5f-4649-abc6-aeabbedb7bbe req-fa23121e-5457-4225-8980-aeea2eb8acb2 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:06.513116 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-7c81ba6f-1e5f-4649-abc6-aeabbedb7bbe req-fa23121e-5457-4225-8980-aeea2eb8acb2 service nova] Creating event network-changed:ed869fdc-b06a-45da-a88d-a77a6c616e4a for instance f2a2e888-71ce-4335-b41b-14a015e8cb26 on nch1-master-1 May 21 22:10:06.525852 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-7c81ba6f-1e5f-4649-abc6-aeabbedb7bbe req-fa23121e-5457-4225-8980-aeea2eb8acb2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056456 May 21 22:10:06.527634 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3535/6942] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:10:07.735222 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:10:07.735887 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 22:10:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:10:08.070293 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0967dfa8-f47a-4c15-9b77-1d5703dc0a6e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:08.070833 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0967dfa8-f47a-4c15-9b77-1d5703dc0a6e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:08.077189 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0967dfa8-f47a-4c15-9b77-1d5703dc0a6e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:08.077656 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0967dfa8-f47a-4c15-9b77-1d5703dc0a6e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:08.078448 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0967dfa8-f47a-4c15-9b77-1d5703dc0a6e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:08.078903 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0967dfa8-f47a-4c15-9b77-1d5703dc0a6e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:08.162453 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-0967dfa8-f47a-4c15-9b77-1d5703dc0a6e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lazy-loading 'services' on Instance uuid f2a2e888-71ce-4335-b41b-14a015e8cb26 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 22:10:08.366144 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0967dfa8-f47a-4c15-9b77-1d5703dc0a6e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26/os-volume_attachments/05c746d6-3606-4737-8f9e-b03843e60040" status: 202 len: 0 microversion: 2.1 time: 0.301019 May 21 22:10:08.366887 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3408/6943] 10.222.0.49 () {58 vars in 1415 bytes} [Sat May 21 22:10:08 2022] DELETE /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26/os-volume_attachments/05c746d6-3606-4737-8f9e-b03843e60040 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:10:08.375966 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-05490d26-4bf0-46bb-b69c-f828b914d50b tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:08.377256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-05490d26-4bf0-46bb-b69c-f828b914d50b tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:08.389171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-05490d26-4bf0-46bb-b69c-f828b914d50b tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:08.389647 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-05490d26-4bf0-46bb-b69c-f828b914d50b tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:08.390451 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-05490d26-4bf0-46bb-b69c-f828b914d50b tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:08.390922 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-05490d26-4bf0-46bb-b69c-f828b914d50b tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:08.422746 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-05490d26-4bf0-46bb-b69c-f828b914d50b tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051126 May 21 22:10:08.423310 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3536/6944] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 22:10:08 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:10:08.549065 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-4345475b-a396-4457-b02c-b6669f734318 req-2f1f43a0-4053-4222-9824-5a3db6cc9318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2a2e888-71ce-4335-b41b-14a015e8cb26", "tag": "ed869fdc-b06a-45da-a88d-a77a6c616e4a"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:10:08.558491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4345475b-a396-4457-b02c-b6669f734318 req-2f1f43a0-4053-4222-9824-5a3db6cc9318 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:08.558896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-4345475b-a396-4457-b02c-b6669f734318 req-2f1f43a0-4053-4222-9824-5a3db6cc9318 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:08.570409 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-4345475b-a396-4457-b02c-b6669f734318 req-2f1f43a0-4053-4222-9824-5a3db6cc9318 service nova] Creating event network-changed:ed869fdc-b06a-45da-a88d-a77a6c616e4a for instance f2a2e888-71ce-4335-b41b-14a015e8cb26 on nch1-master-1 May 21 22:10:08.575509 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-4345475b-a396-4457-b02c-b6669f734318 req-2f1f43a0-4053-4222-9824-5a3db6cc9318 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030577 May 21 22:10:08.581545 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3409/6945] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:10:09.435437 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-339ea4ae-cb4f-425d-80c9-d551c03f64ef tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:09.436417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-339ea4ae-cb4f-425d-80c9-d551c03f64ef tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:09.444517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-339ea4ae-cb4f-425d-80c9-d551c03f64ef tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:09.444991 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-339ea4ae-cb4f-425d-80c9-d551c03f64ef tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:09.445775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-339ea4ae-cb4f-425d-80c9-d551c03f64ef tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:09.446233 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-339ea4ae-cb4f-425d-80c9-d551c03f64ef tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:09.474184 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-339ea4ae-cb4f-425d-80c9-d551c03f64ef tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042900 May 21 22:10:09.474739 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3537/6946] 10.222.0.49 () {58 vars in 1301 bytes} [Sat May 21 22:10:09 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 21 22:10:09.485989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7550cf12-bcdf-4839-b2f8-c5efc098dfab tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:09.486595 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7550cf12-bcdf-4839-b2f8-c5efc098dfab tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:09.496116 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7550cf12-bcdf-4839-b2f8-c5efc098dfab tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:09.496623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7550cf12-bcdf-4839-b2f8-c5efc098dfab tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:09.497414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7550cf12-bcdf-4839-b2f8-c5efc098dfab tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:09.497878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7550cf12-bcdf-4839-b2f8-c5efc098dfab tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:09.576370 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-7550cf12-bcdf-4839-b2f8-c5efc098dfab tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] HTTP exception thrown: Instance f2a2e888-71ce-4335-b41b-14a015e8cb26 is not attached to volume 05c746d6-3606-4737-8f9e-b03843e60040 May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7550cf12-bcdf-4839-b2f8-c5efc098dfab tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Request method failure captured: May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: request: DELETE /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26/os-volume_attachments/05c746d6-3606-4737-8f9e-b03843e60040 HTTP/1.1 May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWLBum7oa8YH5JG8wpoI0hl0KsttXKZ5hRpFoQGxFfZvsx_YrZ8Gyo9qi3lEHlrUScAmddC3mZzwVCWMqNawpMBPY-oKQgeFrgepTjXinDCQSlrnpUbrSyADOoj-PSZ40G60yWzeofnQ4qqy2nH0VKLC53VwGKtSWXqmGfZh3lcP4DU May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 06eadd4f12e0405b851488d45af54d4d May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestMinimumBasicScenario-1935883925 May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/06eadd4f12e0405b851488d45af54d4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/06eadd4f12e0405b851488d45af54d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_06eadd4f12e0405b851488d45af54d4d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/06eadd4f12e0405b851488d45af54d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestMinimumBasicScenario-1935883925 May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 06eadd4f12e0405b851488d45af54d4d May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1935883925 May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestMinimumBasicScenario-1935883925-project May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: cd056abbbc444b36aad548923b8ff985 May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestMinimumBasicScenario-1935883925-project May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance f2a2e888-71ce-4335-b41b-14a015e8cb26 is not attached to volume 05c746d6-3606-4737-8f9e-b03843e60040 May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'server_id': 'f2a2e888-71ce-4335-b41b-14a015e8cb26', 'id': '05c746d6-3606-4737-8f9e-b03843e60040'} May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 05c746d6-3606-4737-8f9e-b03843e60040. May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2a2e888-71ce-4335-b41b-14a015e8cb26 is not attached to volume 05c746d6-3606-4737-8f9e-b03843e60040 May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:10:09.585788 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:10:09.590194 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:10:09.590194 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:10:09.590194 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2a2e888-71ce-4335-b41b-14a015e8cb26 is not attached to volume 05c746d6-3606-4737-8f9e-b03843e60040 May 21 22:10:09.590194 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:10:09.590194 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7550cf12-bcdf-4839-b2f8-c5efc098dfab tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Returning 404 to user: Instance f2a2e888-71ce-4335-b41b-14a015e8cb26 is not attached to volume 05c746d6-3606-4737-8f9e-b03843e60040 {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:10:09.590194 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7550cf12-bcdf-4839-b2f8-c5efc098dfab tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26/os-volume_attachments/05c746d6-3606-4737-8f9e-b03843e60040" status: 404 len: 154 microversion: 2.1 time: 0.106543 May 21 22:10:09.591406 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3410/6947] 10.222.0.49 () {58 vars in 1415 bytes} [Sat May 21 22:10:09 2022] DELETE /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26/os-volume_attachments/05c746d6-3606-4737-8f9e-b03843e60040 => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:10:12.970230 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7af5c8e1-0456-4b59-b396-c9f678074a40 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:12.970772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7af5c8e1-0456-4b59-b396-c9f678074a40 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:12.978034 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7af5c8e1-0456-4b59-b396-c9f678074a40 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:12.978498 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7af5c8e1-0456-4b59-b396-c9f678074a40 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:12.979276 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7af5c8e1-0456-4b59-b396-c9f678074a40 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:12.979727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7af5c8e1-0456-4b59-b396-c9f678074a40 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:13.005037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7af5c8e1-0456-4b59-b396-c9f678074a40 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 22:10:13.307272 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7af5c8e1-0456-4b59-b396-c9f678074a40 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 204 len: 0 microversion: 2.1 time: 0.340757 May 21 22:10:13.307804 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3538/6948] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:10:12 2022] DELETE /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:10:13.316678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c5c044ec-2f5a-49d0-a869-f255cb26c8c4 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:13.317320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c5c044ec-2f5a-49d0-a869-f255cb26c8c4 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:13.324757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5c044ec-2f5a-49d0-a869-f255cb26c8c4 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:13.325216 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5c044ec-2f5a-49d0-a869-f255cb26c8c4 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:13.326061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5c044ec-2f5a-49d0-a869-f255cb26c8c4 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:13.326507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c5c044ec-2f5a-49d0-a869-f255cb26c8c4 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:13.474182 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c5c044ec-2f5a-49d0-a869-f255cb26c8c4 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:10:13.482099 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c5c044ec-2f5a-49d0-a869-f255cb26c8c4 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1554 microversion: 2.1 time: 0.169835 May 21 22:10:13.482893 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3411/6949] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:10:13 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:10:14.501048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3efbe841-7e01-4b35-b037-128b90d53c2e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:14.501761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3efbe841-7e01-4b35-b037-128b90d53c2e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:14.512893 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3efbe841-7e01-4b35-b037-128b90d53c2e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:14.513356 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3efbe841-7e01-4b35-b037-128b90d53c2e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:14.514133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3efbe841-7e01-4b35-b037-128b90d53c2e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:14.514584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3efbe841-7e01-4b35-b037-128b90d53c2e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:14.655644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3efbe841-7e01-4b35-b037-128b90d53c2e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:10:14.663622 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3efbe841-7e01-4b35-b037-128b90d53c2e tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1554 microversion: 2.1 time: 0.166873 May 21 22:10:14.664201 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3539/6950] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:10:14 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:10:15.512968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-6caa9827-1fb6-47c6-9b20-7163020e98cd req-a50d075d-a8c4-4708-b4f2-7ab6b0506a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a2e888-71ce-4335-b41b-14a015e8cb26", "name": "network-vif-deleted", "tag": "ed869fdc-b06a-45da-a88d-a77a6c616e4a"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:10:15.522231 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6caa9827-1fb6-47c6-9b20-7163020e98cd req-a50d075d-a8c4-4708-b4f2-7ab6b0506a27 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:15.522901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-6caa9827-1fb6-47c6-9b20-7163020e98cd req-a50d075d-a8c4-4708-b4f2-7ab6b0506a27 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:15.534242 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-6caa9827-1fb6-47c6-9b20-7163020e98cd req-a50d075d-a8c4-4708-b4f2-7ab6b0506a27 service nova] Creating event network-vif-deleted:ed869fdc-b06a-45da-a88d-a77a6c616e4a for instance f2a2e888-71ce-4335-b41b-14a015e8cb26 on nch1-master-1 May 21 22:10:15.539324 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-6caa9827-1fb6-47c6-9b20-7163020e98cd req-a50d075d-a8c4-4708-b4f2-7ab6b0506a27 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030097 May 21 22:10:15.539916 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3412/6951] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:10:15.681539 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-90702425-21dd-492c-a9a6-c02e36173ac7 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:15.682186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-90702425-21dd-492c-a9a6-c02e36173ac7 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:15.689727 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90702425-21dd-492c-a9a6-c02e36173ac7 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:15.690334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90702425-21dd-492c-a9a6-c02e36173ac7 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:15.691133 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90702425-21dd-492c-a9a6-c02e36173ac7 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:15.691590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-90702425-21dd-492c-a9a6-c02e36173ac7 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:15.758866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-90702425-21dd-492c-a9a6-c02e36173ac7 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd056abbbc444b36aad548923b8ff985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06eadd4f12e0405b851488d45af54d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:10:15.766619 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-90702425-21dd-492c-a9a6-c02e36173ac7 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 200 len: 1343 microversion: 2.1 time: 0.089789 May 21 22:10:15.776114 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3540/6952] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:10:15 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 1343 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:10:16.784560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-082649ed-568e-41aa-b02a-edde230e5530 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:16.785299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-082649ed-568e-41aa-b02a-edde230e5530 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] [instance: f2a2e888-71ce-4335-b41b-14a015e8cb26] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:16.791795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-082649ed-568e-41aa-b02a-edde230e5530 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:16.792248 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-082649ed-568e-41aa-b02a-edde230e5530 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:16.793041 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-082649ed-568e-41aa-b02a-edde230e5530 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:16.793485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-082649ed-568e-41aa-b02a-edde230e5530 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:16.807815 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-082649ed-568e-41aa-b02a-edde230e5530 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] HTTP exception thrown: Instance f2a2e888-71ce-4335-b41b-14a015e8cb26 could not be found. May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-082649ed-568e-41aa-b02a-edde230e5530 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Request method failure captured: May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 HTTP/1.1 May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWLBum7oa8YH5JG8wpoI0hl0KsttXKZ5hRpFoQGxFfZvsx_YrZ8Gyo9qi3lEHlrUScAmddC3mZzwVCWMqNawpMBPY-oKQgeFrgepTjXinDCQSlrnpUbrSyADOoj-PSZ40G60yWzeofnQ4qqy2nH0VKLC53VwGKtSWXqmGfZh3lcP4DU May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 06eadd4f12e0405b851488d45af54d4d May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestMinimumBasicScenario-1935883925 May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/06eadd4f12e0405b851488d45af54d4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/06eadd4f12e0405b851488d45af54d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_06eadd4f12e0405b851488d45af54d4d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/06eadd4f12e0405b851488d45af54d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestMinimumBasicScenario-1935883925 May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 06eadd4f12e0405b851488d45af54d4d May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1935883925 May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestMinimumBasicScenario-1935883925-project May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: cd056abbbc444b36aad548923b8ff985 May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestMinimumBasicScenario-1935883925-project May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance f2a2e888-71ce-4335-b41b-14a015e8cb26 could not be found. May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'f2a2e888-71ce-4335-b41b-14a015e8cb26'} May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2a2e888-71ce-4335-b41b-14a015e8cb26 could not be found. May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2a2e888-71ce-4335-b41b-14a015e8cb26 could not be found. May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:10:16.809477 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:10:16.814299 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:10:16.814299 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:10:16.814299 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:10:16.814299 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:10:16.814299 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:10:16.814299 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2a2e888-71ce-4335-b41b-14a015e8cb26 could not be found. May 21 22:10:16.814299 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:10:16.814299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-082649ed-568e-41aa-b02a-edde230e5530 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Returning 404 to user: Instance f2a2e888-71ce-4335-b41b-14a015e8cb26 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:10:16.814299 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-082649ed-568e-41aa-b02a-edde230e5530 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26" status: 404 len: 111 microversion: 2.1 time: 0.031625 May 21 22:10:16.814299 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3413/6953] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:10:16 2022] GET /compute/v2.1/servers/f2a2e888-71ce-4335-b41b-14a015e8cb26 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:10:16.820781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9e4225d9-ff42-40c1-8feb-729f43d749b0 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] Calling method '.version_select at 0x7fc82d11f940>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:16.932068 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9e4225d9-ff42-40c1-8feb-729f43d749b0 tempest-TestMinimumBasicScenario-1935883925 tempest-TestMinimumBasicScenario-1935883925-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-587110979" status: 202 len: 0 microversion: 2.1 time: 0.115800 May 21 22:10:16.932688 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3541/6954] 10.222.0.49 () {58 vars in 1268 bytes} [Sat May 21 22:10:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-587110979 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 21 22:10:29.555660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=14 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:10:29.556444 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:10:29.717569 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-630aa296-37f9-4ed9-a3be-38d8a847f93b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'create', calling method: .version_select at 0x7fc819c205e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-435354002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbx5JigX9sPc9BntaihdgzCaadux5XhWT2E5VSJSGEUJ/t9T4rYvq2a3KXmE4zo4FczEbSbrXCb5ia2sbwg1akqik87niNOXCphIsH9POMTuBNy0IGPfh7FTL9ryV+URA=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:10:29.734398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-630aa296-37f9-4ed9-a3be-38d8a847f93b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Getting quotas for project 10c1d1acf8134ddab4e11e933dbeb571. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:10:29.740335 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-630aa296-37f9-4ed9-a3be-38d8a847f93b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Getting quotas for user c726d5d196d64ef3a2470ebc855b00f0 and project 10c1d1acf8134ddab4e11e933dbeb571. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:10:29.827781 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-630aa296-37f9-4ed9-a3be-38d8a847f93b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.277764 May 21 22:10:29.828342 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3414/6955] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 22:10:29 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:10:39.853154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:10:39.854042 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:10:39.858046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-446e5e9d-7e92-40ce-83c8-32072d06bef3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1692188333", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "952f23be-4cac-4421-b787-9d7566461ea6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-435354002", "security_groups": [{"name": "tempest-secgroup-smoke-698789233"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:10:39.973880 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-446e5e9d-7e92-40ce-83c8-32072d06bef3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] validate_networks() for [('952f23be-4cac-4421-b787-9d7566461ea6', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 22:10:40.515207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-446e5e9d-7e92-40ce-83c8-32072d06bef3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:10:40.515763 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-446e5e9d-7e92-40ce-83c8-32072d06bef3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:10:40.516271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-446e5e9d-7e92-40ce-83c8-32072d06bef3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:10:40.516729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-446e5e9d-7e92-40ce-83c8-32072d06bef3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:10:40.517170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-446e5e9d-7e92-40ce-83c8-32072d06bef3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:10:40.529254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-446e5e9d-7e92-40ce-83c8-32072d06bef3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:40.529732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-446e5e9d-7e92-40ce-83c8-32072d06bef3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:40.530565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-446e5e9d-7e92-40ce-83c8-32072d06bef3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:40.531026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-446e5e9d-7e92-40ce-83c8-32072d06bef3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:40.551911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-446e5e9d-7e92-40ce-83c8-32072d06bef3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Getting quotas for project 10c1d1acf8134ddab4e11e933dbeb571. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:10:40.558941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-446e5e9d-7e92-40ce-83c8-32072d06bef3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Getting quotas for user c726d5d196d64ef3a2470ebc855b00f0 and project 10c1d1acf8134ddab4e11e933dbeb571. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:10:40.572998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-446e5e9d-7e92-40ce-83c8-32072d06bef3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 22:10:40.575374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-446e5e9d-7e92-40ce-83c8-32072d06bef3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 22:10:40.698580 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-446e5e9d-7e92-40ce-83c8-32072d06bef3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.847867 May 21 22:10:40.699430 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3542/6956] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 22:10:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 22:10:40.707504 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:10:40.708274 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:10:40.713726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1fad27a7-5c1e-4958-9388-2b2b2438cbd8 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:40.714364 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1fad27a7-5c1e-4958-9388-2b2b2438cbd8 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:40.781224 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1fad27a7-5c1e-4958-9388-2b2b2438cbd8 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:10:40.791682 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1fad27a7-5c1e-4958-9388-2b2b2438cbd8 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 200 len: 1266 microversion: 2.1 time: 0.085907 May 21 22:10:40.801570 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3415/6957] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:10:40 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:10:41.811240 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-17fc5cb0-dd63-43cf-843f-52cbfe98e7b2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:41.811806 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-17fc5cb0-dd63-43cf-843f-52cbfe98e7b2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:41.872868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-17fc5cb0-dd63-43cf-843f-52cbfe98e7b2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:10:41.881240 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-17fc5cb0-dd63-43cf-843f-52cbfe98e7b2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 200 len: 1266 microversion: 2.1 time: 0.074848 May 21 22:10:41.882115 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3543/6958] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:10:41 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 1266 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:10:42.899067 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b38e1582-d529-48b4-9a60-55311aa3fc2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:42.899771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b38e1582-d529-48b4-9a60-55311aa3fc2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:42.908712 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b38e1582-d529-48b4-9a60-55311aa3fc2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:42.909167 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b38e1582-d529-48b4-9a60-55311aa3fc2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:42.909972 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b38e1582-d529-48b4-9a60-55311aa3fc2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:42.910416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b38e1582-d529-48b4-9a60-55311aa3fc2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:42.984849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b38e1582-d529-48b4-9a60-55311aa3fc2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:10:42.992694 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b38e1582-d529-48b4-9a60-55311aa3fc2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 200 len: 1318 microversion: 2.1 time: 0.097617 May 21 22:10:42.993264 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3416/6959] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:10:42 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 1318 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:10:44.015533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-30b73231-6dad-4974-8ca8-977a7be3a719 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:44.016171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-30b73231-6dad-4974-8ca8-977a7be3a719 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:44.028355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-30b73231-6dad-4974-8ca8-977a7be3a719 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:44.028830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-30b73231-6dad-4974-8ca8-977a7be3a719 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:44.029888 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-30b73231-6dad-4974-8ca8-977a7be3a719 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:44.030343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-30b73231-6dad-4974-8ca8-977a7be3a719 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:44.263175 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-30b73231-6dad-4974-8ca8-977a7be3a719 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:10:44.270985 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-30b73231-6dad-4974-8ca8-977a7be3a719 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 200 len: 1391 microversion: 2.1 time: 0.259649 May 21 22:10:44.271593 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3544/6960] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:10:44 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 1391 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:10:45.093393 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-da08ecbf-69b5-46f9-980d-8c3e5f503329 req-9764351a-0a3e-4021-8272-cfbed863d50d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0f104c1-3fec-4877-bd5d-0ca40bdca1e1", "tag": "0595db7f-db59-493a-8a6c-3edce076f3c6"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:10:45.102926 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-da08ecbf-69b5-46f9-980d-8c3e5f503329 req-9764351a-0a3e-4021-8272-cfbed863d50d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:45.103428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-da08ecbf-69b5-46f9-980d-8c3e5f503329 req-9764351a-0a3e-4021-8272-cfbed863d50d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:45.115661 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-da08ecbf-69b5-46f9-980d-8c3e5f503329 req-9764351a-0a3e-4021-8272-cfbed863d50d service nova] Creating event network-changed:0595db7f-db59-493a-8a6c-3edce076f3c6 for instance a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 on nch1-master-1 May 21 22:10:45.121241 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-da08ecbf-69b5-46f9-980d-8c3e5f503329 req-9764351a-0a3e-4021-8272-cfbed863d50d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032387 May 21 22:10:45.122186 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3417/6961] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:10:45.289425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-650ad644-0956-436b-aeef-d9eb27a01a86 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:45.290216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-650ad644-0956-436b-aeef-d9eb27a01a86 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:45.297699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-650ad644-0956-436b-aeef-d9eb27a01a86 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:45.298273 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-650ad644-0956-436b-aeef-d9eb27a01a86 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:45.299277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-650ad644-0956-436b-aeef-d9eb27a01a86 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:45.299962 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-650ad644-0956-436b-aeef-d9eb27a01a86 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:45.549147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-650ad644-0956-436b-aeef-d9eb27a01a86 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:10:45.557626 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-650ad644-0956-436b-aeef-d9eb27a01a86 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 200 len: 1391 microversion: 2.1 time: 0.273136 May 21 22:10:45.558559 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3545/6962] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:10:45 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 1391 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:10:46.576611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ca8f3751-85a6-45b7-8f71-536d10d0b000 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:46.577261 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ca8f3751-85a6-45b7-8f71-536d10d0b000 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:46.583572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca8f3751-85a6-45b7-8f71-536d10d0b000 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:46.584030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca8f3751-85a6-45b7-8f71-536d10d0b000 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:46.585701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca8f3751-85a6-45b7-8f71-536d10d0b000 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:46.585701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca8f3751-85a6-45b7-8f71-536d10d0b000 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:46.732874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ca8f3751-85a6-45b7-8f71-536d10d0b000 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:10:46.740437 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ca8f3751-85a6-45b7-8f71-536d10d0b000 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 200 len: 1391 microversion: 2.1 time: 0.169031 May 21 22:10:46.741005 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3418/6963] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:10:46 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:10:47.758476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-457040a7-2521-4297-a73f-ec1460879e66 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:47.759045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-457040a7-2521-4297-a73f-ec1460879e66 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:47.766131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-457040a7-2521-4297-a73f-ec1460879e66 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:47.766642 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-457040a7-2521-4297-a73f-ec1460879e66 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:47.767441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-457040a7-2521-4297-a73f-ec1460879e66 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:47.767907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-457040a7-2521-4297-a73f-ec1460879e66 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:47.916731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-457040a7-2521-4297-a73f-ec1460879e66 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:10:47.924426 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-457040a7-2521-4297-a73f-ec1460879e66 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 200 len: 1391 microversion: 2.1 time: 0.170554 May 21 22:10:47.925005 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3546/6964] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:10:47 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:10:48.941725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4e328be0-c408-4946-a4f2-207f7a9596c0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:48.942353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4e328be0-c408-4946-a4f2-207f7a9596c0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:48.949733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e328be0-c408-4946-a4f2-207f7a9596c0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:48.950197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e328be0-c408-4946-a4f2-207f7a9596c0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:48.951049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e328be0-c408-4946-a4f2-207f7a9596c0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:48.951501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4e328be0-c408-4946-a4f2-207f7a9596c0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:49.104304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4e328be0-c408-4946-a4f2-207f7a9596c0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:10:49.112072 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4e328be0-c408-4946-a4f2-207f7a9596c0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 200 len: 1391 microversion: 2.1 time: 0.174490 May 21 22:10:49.112716 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3419/6965] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:10:48 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:10:50.129154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ff7d298e-80f4-4763-9f4b-c95c243f690f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:50.129791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ff7d298e-80f4-4763-9f4b-c95c243f690f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:50.137265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff7d298e-80f4-4763-9f4b-c95c243f690f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:50.137740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff7d298e-80f4-4763-9f4b-c95c243f690f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:50.138536 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff7d298e-80f4-4763-9f4b-c95c243f690f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:50.138993 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ff7d298e-80f4-4763-9f4b-c95c243f690f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:50.284347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ff7d298e-80f4-4763-9f4b-c95c243f690f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:10:50.292017 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ff7d298e-80f4-4763-9f4b-c95c243f690f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 200 len: 1391 microversion: 2.1 time: 0.166789 May 21 22:10:50.296444 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3547/6966] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:10:50 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:10:51.261795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:10:51.309223 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2ee1b2aa-38e0-4ca6-9411-23cc4e2cd3a9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:51.310207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2ee1b2aa-38e0-4ca6-9411-23cc4e2cd3a9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:51.316819 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:10:51.317650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-f2bf00ee-e687-4f50-91e8-f146c2530c92 req-53dd83d4-2498-4c4f-af39-40880daf24ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0f104c1-3fec-4877-bd5d-0ca40bdca1e1", "name": "network-vif-plugged", "status": "completed", "tag": "0595db7f-db59-493a-8a6c-3edce076f3c6"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:10:51.319499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2ee1b2aa-38e0-4ca6-9411-23cc4e2cd3a9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:51.320494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2ee1b2aa-38e0-4ca6-9411-23cc4e2cd3a9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:51.321044 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2ee1b2aa-38e0-4ca6-9411-23cc4e2cd3a9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:51.321690 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2ee1b2aa-38e0-4ca6-9411-23cc4e2cd3a9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:51.326931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f2bf00ee-e687-4f50-91e8-f146c2530c92 req-53dd83d4-2498-4c4f-af39-40880daf24ce service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:51.327349 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f2bf00ee-e687-4f50-91e8-f146c2530c92 req-53dd83d4-2498-4c4f-af39-40880daf24ce service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:51.341377 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-f2bf00ee-e687-4f50-91e8-f146c2530c92 req-53dd83d4-2498-4c4f-af39-40880daf24ce service nova] Creating event network-vif-plugged:0595db7f-db59-493a-8a6c-3edce076f3c6 for instance a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 on nch1-master-1 May 21 22:10:51.347644 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-f2bf00ee-e687-4f50-91e8-f146c2530c92 req-53dd83d4-2498-4c4f-af39-40880daf24ce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091095 May 21 22:10:51.348701 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3420/6967] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:10:51.545281 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2ee1b2aa-38e0-4ca6-9411-23cc4e2cd3a9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:10:51.553695 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2ee1b2aa-38e0-4ca6-9411-23cc4e2cd3a9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 200 len: 1391 microversion: 2.1 time: 0.247960 May 21 22:10:51.554240 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3548/6968] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:10:51 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 1391 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:10:52.572681 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e0227e30-8f71-49d4-8481-f18c811b86ca tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:52.573412 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e0227e30-8f71-49d4-8481-f18c811b86ca tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:52.581144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0227e30-8f71-49d4-8481-f18c811b86ca tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:52.583583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0227e30-8f71-49d4-8481-f18c811b86ca tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:52.583583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0227e30-8f71-49d4-8481-f18c811b86ca tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:52.583583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e0227e30-8f71-49d4-8481-f18c811b86ca tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:52.732883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e0227e30-8f71-49d4-8481-f18c811b86ca tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:10:52.740917 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e0227e30-8f71-49d4-8481-f18c811b86ca tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 200 len: 1391 microversion: 2.1 time: 0.173871 May 21 22:10:52.742029 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3421/6969] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:10:52 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:10:53.758911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-592b6b0f-66eb-4560-acde-0a1dc32a9cee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:53.759555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-592b6b0f-66eb-4560-acde-0a1dc32a9cee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:53.763338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=8 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:10:53.770215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-592b6b0f-66eb-4560-acde-0a1dc32a9cee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:53.770694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-592b6b0f-66eb-4560-acde-0a1dc32a9cee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:53.774150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-592b6b0f-66eb-4560-acde-0a1dc32a9cee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:53.774150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-592b6b0f-66eb-4560-acde-0a1dc32a9cee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:53.918217 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-592b6b0f-66eb-4560-acde-0a1dc32a9cee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:10:53.925940 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-592b6b0f-66eb-4560-acde-0a1dc32a9cee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 200 len: 1562 microversion: 2.1 time: 0.171995 May 21 22:10:53.926525 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3549/6970] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:10:53 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 1562 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:10:53.942572 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f8afe12c-f3c5-4f0f-bae2-faf1bb1dc25d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:53.943196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f8afe12c-f3c5-4f0f-bae2-faf1bb1dc25d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:53.950384 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f8afe12c-f3c5-4f0f-bae2-faf1bb1dc25d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:53.950839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f8afe12c-f3c5-4f0f-bae2-faf1bb1dc25d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:53.951611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f8afe12c-f3c5-4f0f-bae2-faf1bb1dc25d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:53.952057 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f8afe12c-f3c5-4f0f-bae2-faf1bb1dc25d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:54.109207 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f8afe12c-f3c5-4f0f-bae2-faf1bb1dc25d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:10:54.117547 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f8afe12c-f3c5-4f0f-bae2-faf1bb1dc25d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 200 len: 1562 microversion: 2.1 time: 0.178867 May 21 22:10:54.118127 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3422/6971] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:10:53 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 1562 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:10:56.445903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5aec8e83-4ab2-46f5-93cd-559bb7cb1228 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:10:56.446580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5aec8e83-4ab2-46f5-93cd-559bb7cb1228 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:10:56.447986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-9a55123d-e2db-4e5d-879f-06e71908ae5f req-31f2c6b2-5832-4bad-be05-c2ce7873d046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0f104c1-3fec-4877-bd5d-0ca40bdca1e1", "tag": "0595db7f-db59-493a-8a6c-3edce076f3c6"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:10:56.454829 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5aec8e83-4ab2-46f5-93cd-559bb7cb1228 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:56.455317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5aec8e83-4ab2-46f5-93cd-559bb7cb1228 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:56.456190 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5aec8e83-4ab2-46f5-93cd-559bb7cb1228 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:56.456692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5aec8e83-4ab2-46f5-93cd-559bb7cb1228 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:56.457963 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9a55123d-e2db-4e5d-879f-06e71908ae5f req-31f2c6b2-5832-4bad-be05-c2ce7873d046 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:10:56.458494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-9a55123d-e2db-4e5d-879f-06e71908ae5f req-31f2c6b2-5832-4bad-be05-c2ce7873d046 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:10:56.471454 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-9a55123d-e2db-4e5d-879f-06e71908ae5f req-31f2c6b2-5832-4bad-be05-c2ce7873d046 service nova] Creating event network-changed:0595db7f-db59-493a-8a6c-3edce076f3c6 for instance a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 on nch1-master-1 May 21 22:10:56.477321 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-9a55123d-e2db-4e5d-879f-06e71908ae5f req-31f2c6b2-5832-4bad-be05-c2ce7873d046 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033958 May 21 22:10:56.478042 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3423/6972] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:10:56.727868 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5aec8e83-4ab2-46f5-93cd-559bb7cb1228 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:10:56.738159 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5aec8e83-4ab2-46f5-93cd-559bb7cb1228 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 200 len: 1562 microversion: 2.1 time: 0.297367 May 21 22:10:56.739496 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3550/6973] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:10:56 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 1562 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:11:18.063341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3a605063-2f81-4ba1-81e9-49713c466ce5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:11:18.064566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3a605063-2f81-4ba1-81e9-49713c466ce5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:18.067323 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=20 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:11:18.068015 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=36 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:11:18.073627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a605063-2f81-4ba1-81e9-49713c466ce5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:18.074088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a605063-2f81-4ba1-81e9-49713c466ce5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:18.074859 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a605063-2f81-4ba1-81e9-49713c466ce5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:18.075300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a605063-2f81-4ba1-81e9-49713c466ce5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:18.123492 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3a605063-2f81-4ba1-81e9-49713c466ce5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1/action" status: 200 len: 24575 microversion: 2.1 time: 0.064308 May 21 22:11:18.124177 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3424/6974] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:11:18 2022] POST /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1/action => generated 24575 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 22:11:24.521317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-517ed949-7fdd-4688-baf6-254db554ed92 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:11:24.521895 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-517ed949-7fdd-4688-baf6-254db554ed92 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:24.524852 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:11:24.525546 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=44 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:11:24.530480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-517ed949-7fdd-4688-baf6-254db554ed92 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:24.530952 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-517ed949-7fdd-4688-baf6-254db554ed92 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:24.531741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-517ed949-7fdd-4688-baf6-254db554ed92 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:24.532198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-517ed949-7fdd-4688-baf6-254db554ed92 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:24.719756 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-517ed949-7fdd-4688-baf6-254db554ed92 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1/action" status: 202 len: 0 microversion: 2.1 time: 0.202373 May 21 22:11:24.723518 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3551/6975] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:11:24 2022] POST /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:11:24.730840 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-74fe62d9-b6a6-4635-b38c-9b7bfe581b6a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:11:24.731654 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-74fe62d9-b6a6-4635-b38c-9b7bfe581b6a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:24.739140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-74fe62d9-b6a6-4635-b38c-9b7bfe581b6a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:24.739597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-74fe62d9-b6a6-4635-b38c-9b7bfe581b6a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:24.740511 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-74fe62d9-b6a6-4635-b38c-9b7bfe581b6a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:24.740951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-74fe62d9-b6a6-4635-b38c-9b7bfe581b6a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:24.897793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-74fe62d9-b6a6-4635-b38c-9b7bfe581b6a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:11:24.906197 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-74fe62d9-b6a6-4635-b38c-9b7bfe581b6a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 200 len: 1686 microversion: 2.1 time: 0.180979 May 21 22:11:24.906774 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3425/6976] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:11:24 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 1686 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:11:25.926109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9bffec91-694e-4000-9db0-da56d7a5ebea tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:11:25.926750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9bffec91-694e-4000-9db0-da56d7a5ebea tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:25.933371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9bffec91-694e-4000-9db0-da56d7a5ebea tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:25.933842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9bffec91-694e-4000-9db0-da56d7a5ebea tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:25.934632 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9bffec91-694e-4000-9db0-da56d7a5ebea tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:25.935086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9bffec91-694e-4000-9db0-da56d7a5ebea tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:26.089951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9bffec91-694e-4000-9db0-da56d7a5ebea tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:11:26.097827 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9bffec91-694e-4000-9db0-da56d7a5ebea tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 200 len: 1666 microversion: 2.1 time: 0.177146 May 21 22:11:26.098407 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3552/6977] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:11:25 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 1666 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:11:27.197451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-40e4f066-9d67-48f6-84b4-7c915542c2ef tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:11:27.198387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-40e4f066-9d67-48f6-84b4-7c915542c2ef tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:27.206193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40e4f066-9d67-48f6-84b4-7c915542c2ef tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:27.206649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40e4f066-9d67-48f6-84b4-7c915542c2ef tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:27.207459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40e4f066-9d67-48f6-84b4-7c915542c2ef tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:27.207896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40e4f066-9d67-48f6-84b4-7c915542c2ef tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:27.256237 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-40e4f066-9d67-48f6-84b4-7c915542c2ef tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1/action" status: 200 len: 32651 microversion: 2.1 time: 0.062668 May 21 22:11:27.256899 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3426/6978] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:11:27 2022] POST /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1/action => generated 32651 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 22:11:27.267947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-73479acf-301e-4b6b-b31d-80790b632fe9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:11:27.268554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-73479acf-301e-4b6b-b31d-80790b632fe9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:27.276026 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-73479acf-301e-4b6b-b31d-80790b632fe9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:27.280015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-73479acf-301e-4b6b-b31d-80790b632fe9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:27.280015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-73479acf-301e-4b6b-b31d-80790b632fe9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:27.280015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-73479acf-301e-4b6b-b31d-80790b632fe9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:27.488711 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-73479acf-301e-4b6b-b31d-80790b632fe9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1/action" status: 202 len: 0 microversion: 2.1 time: 0.224388 May 21 22:11:27.489341 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3553/6979] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:11:27 2022] POST /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:11:27.498779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-356495df-f129-4135-939a-f656b11e1639 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:11:27.499335 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-356495df-f129-4135-939a-f656b11e1639 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:27.506625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-356495df-f129-4135-939a-f656b11e1639 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:27.509273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-356495df-f129-4135-939a-f656b11e1639 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:27.509273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-356495df-f129-4135-939a-f656b11e1639 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:27.509273 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-356495df-f129-4135-939a-f656b11e1639 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:27.663120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-356495df-f129-4135-939a-f656b11e1639 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:11:27.671047 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-356495df-f129-4135-939a-f656b11e1639 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 200 len: 1673 microversion: 2.1 time: 0.176871 May 21 22:11:27.671632 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3427/6980] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:11:27 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 1673 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:11:28.689674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5c98df96-5e7b-4da5-95e9-2b9082d42366 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:11:28.690392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5c98df96-5e7b-4da5-95e9-2b9082d42366 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:28.697997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c98df96-5e7b-4da5-95e9-2b9082d42366 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:28.698464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c98df96-5e7b-4da5-95e9-2b9082d42366 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:28.699241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c98df96-5e7b-4da5-95e9-2b9082d42366 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:28.699694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5c98df96-5e7b-4da5-95e9-2b9082d42366 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:29.181017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5c98df96-5e7b-4da5-95e9-2b9082d42366 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:11:29.189188 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5c98df96-5e7b-4da5-95e9-2b9082d42366 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 200 len: 1681 microversion: 2.1 time: 0.504005 May 21 22:11:29.189767 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3554/6981] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:11:28 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 1681 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:11:29.303353 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5dc1f3f9-e6f2-408a-bb2f-f0148c329777 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:11:29.304348 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5dc1f3f9-e6f2-408a-bb2f-f0148c329777 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:29.313108 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5dc1f3f9-e6f2-408a-bb2f-f0148c329777 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:29.314042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5dc1f3f9-e6f2-408a-bb2f-f0148c329777 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:29.314703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5dc1f3f9-e6f2-408a-bb2f-f0148c329777 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:29.315157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5dc1f3f9-e6f2-408a-bb2f-f0148c329777 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:29.369417 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5dc1f3f9-e6f2-408a-bb2f-f0148c329777 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1/action" status: 200 len: 35886 microversion: 2.1 time: 0.069962 May 21 22:11:29.370187 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3428/6982] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:11:29 2022] POST /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1/action => generated 35886 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 22:11:30.626017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f57997a9-a91c-4516-9f59-b5436412ae5c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:11:30.626545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f57997a9-a91c-4516-9f59-b5436412ae5c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:30.629373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-009a41e7-3748-4bd6-9ba7-b447ff9cddee req-873ea755-7da1-46f2-a0a4-de25c17427c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0f104c1-3fec-4877-bd5d-0ca40bdca1e1", "tag": "0595db7f-db59-493a-8a6c-3edce076f3c6"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:11:30.638882 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f57997a9-a91c-4516-9f59-b5436412ae5c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:30.639363 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f57997a9-a91c-4516-9f59-b5436412ae5c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:30.640176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f57997a9-a91c-4516-9f59-b5436412ae5c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:30.640462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-009a41e7-3748-4bd6-9ba7-b447ff9cddee req-873ea755-7da1-46f2-a0a4-de25c17427c5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:30.640971 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-f57997a9-a91c-4516-9f59-b5436412ae5c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:30.641217 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-009a41e7-3748-4bd6-9ba7-b447ff9cddee req-873ea755-7da1-46f2-a0a4-de25c17427c5 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:30.654386 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-009a41e7-3748-4bd6-9ba7-b447ff9cddee req-873ea755-7da1-46f2-a0a4-de25c17427c5 service nova] Creating event network-changed:0595db7f-db59-493a-8a6c-3edce076f3c6 for instance a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 on nch1-master-1 May 21 22:11:30.660040 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-009a41e7-3748-4bd6-9ba7-b447ff9cddee req-873ea755-7da1-46f2-a0a4-de25c17427c5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035806 May 21 22:11:30.664436 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3429/6983] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:11:30.672896 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f57997a9-a91c-4516-9f59-b5436412ae5c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 22:11:30.971197 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f57997a9-a91c-4516-9f59-b5436412ae5c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 204 len: 0 microversion: 2.1 time: 0.349122 May 21 22:11:30.972088 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3555/6984] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:11:30 2022] DELETE /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:11:30.982570 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-909f15a0-44f1-4742-9624-c451537d29d2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:11:30.983638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-909f15a0-44f1-4742-9624-c451537d29d2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:30.990332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-909f15a0-44f1-4742-9624-c451537d29d2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:30.991097 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-909f15a0-44f1-4742-9624-c451537d29d2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:30.992160 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-909f15a0-44f1-4742-9624-c451537d29d2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:30.992772 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-909f15a0-44f1-4742-9624-c451537d29d2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:31.151578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-909f15a0-44f1-4742-9624-c451537d29d2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:11:31.159423 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-909f15a0-44f1-4742-9624-c451537d29d2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 200 len: 1687 microversion: 2.1 time: 0.182945 May 21 22:11:31.159999 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3430/6985] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:11:30 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 1687 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:11:32.177633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ae560a3c-d550-4df3-8e3a-622fed9ba875 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:11:32.178392 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ae560a3c-d550-4df3-8e3a-622fed9ba875 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:32.186292 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ae560a3c-d550-4df3-8e3a-622fed9ba875 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:32.186761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ae560a3c-d550-4df3-8e3a-622fed9ba875 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:32.187564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ae560a3c-d550-4df3-8e3a-622fed9ba875 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:32.188005 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ae560a3c-d550-4df3-8e3a-622fed9ba875 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:32.386777 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ae560a3c-d550-4df3-8e3a-622fed9ba875 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:11:32.394699 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ae560a3c-d550-4df3-8e3a-622fed9ba875 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 200 len: 1687 microversion: 2.1 time: 0.221568 May 21 22:11:32.395268 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3556/6986] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:11:32 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 1687 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:11:33.413015 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0c06a1ce-9ad5-4179-ac52-ad344b3b8caa tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:11:33.413560 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0c06a1ce-9ad5-4179-ac52-ad344b3b8caa tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:33.421556 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c06a1ce-9ad5-4179-ac52-ad344b3b8caa tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:33.421987 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c06a1ce-9ad5-4179-ac52-ad344b3b8caa tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:33.422773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c06a1ce-9ad5-4179-ac52-ad344b3b8caa tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:33.423222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c06a1ce-9ad5-4179-ac52-ad344b3b8caa tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:33.519398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0c06a1ce-9ad5-4179-ac52-ad344b3b8caa tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:11:33.520268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-cb6e699e-86b8-43f4-af40-8d700980cbb4 req-dd2fbbe7-ab42-42d8-bdd2-3d8b96cab31e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0f104c1-3fec-4877-bd5d-0ca40bdca1e1", "name": "network-vif-deleted", "tag": "0595db7f-db59-493a-8a6c-3edce076f3c6"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:11:33.528045 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0c06a1ce-9ad5-4179-ac52-ad344b3b8caa tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 200 len: 1501 microversion: 2.1 time: 0.119170 May 21 22:11:33.533089 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3431/6987] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:11:33 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 1501 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:11:33.535440 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cb6e699e-86b8-43f4-af40-8d700980cbb4 req-dd2fbbe7-ab42-42d8-bdd2-3d8b96cab31e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:33.535914 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cb6e699e-86b8-43f4-af40-8d700980cbb4 req-dd2fbbe7-ab42-42d8-bdd2-3d8b96cab31e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:33.548823 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-cb6e699e-86b8-43f4-af40-8d700980cbb4 req-dd2fbbe7-ab42-42d8-bdd2-3d8b96cab31e service nova] Creating event network-vif-deleted:0595db7f-db59-493a-8a6c-3edce076f3c6 for instance a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 on nch1-master-1 May 21 22:11:33.554410 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-cb6e699e-86b8-43f4-af40-8d700980cbb4 req-dd2fbbe7-ab42-42d8-bdd2-3d8b96cab31e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037776 May 21 22:11:33.555149 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3557/6988] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:11:34.545757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-69e3f401-c14b-40cf-836a-45a4838ed11d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:11:34.546383 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-69e3f401-c14b-40cf-836a-45a4838ed11d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: a0f104c1-3fec-4877-bd5d-0ca40bdca1e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:34.553472 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69e3f401-c14b-40cf-836a-45a4838ed11d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:34.553931 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69e3f401-c14b-40cf-836a-45a4838ed11d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:34.554752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69e3f401-c14b-40cf-836a-45a4838ed11d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:34.555764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-69e3f401-c14b-40cf-836a-45a4838ed11d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:34.569554 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-69e3f401-c14b-40cf-836a-45a4838ed11d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] HTTP exception thrown: Instance a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 could not be found. May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-69e3f401-c14b-40cf-836a-45a4838ed11d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Request method failure captured: May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 HTTP/1.1 May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWNUii8Zq6WOyAgXHmbJ3sC5wa94C74ELxknXQJ_SM32Jav6JyvMpyYMVSFhYJ3s1YN1udNzGY1HshTj3s7GT-R1gCzdtKT1r559qWDXMdRUrYXCdFe0fnjc0pP6_57YeQK7_51zGtHqPFGJn1yY7YonKAJ0n7bgpG0NA9tWLAWZZZY May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 10c1d1acf8134ddab4e11e933dbeb571 May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-351207300 May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/10c1d1acf8134ddab4e11e933dbeb571"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10c1d1acf8134ddab4e11e933dbeb571"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_10c1d1acf8134ddab4e11e933dbeb571", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10c1d1acf8134ddab4e11e933dbeb571"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestNetworkAdvancedServerOps-351207300 May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 10c1d1acf8134ddab4e11e933dbeb571 May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-351207300 May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestNetworkAdvancedServerOps-351207300-project May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c726d5d196d64ef3a2470ebc855b00f0 May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestNetworkAdvancedServerOps-351207300-project May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 could not be found. May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': 'a0f104c1-3fec-4877-bd5d-0ca40bdca1e1'} May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 could not be found. May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 could not be found. May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:11:34.571921 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:11:34.579714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:11:34.579714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:11:34.579714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:11:34.579714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:11:34.579714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:11:34.579714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 could not be found. May 21 22:11:34.579714 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:11:34.579714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-69e3f401-c14b-40cf-836a-45a4838ed11d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Returning 404 to user: Instance a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:11:34.579714 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-69e3f401-c14b-40cf-836a-45a4838ed11d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1" status: 404 len: 111 microversion: 2.1 time: 0.031691 May 21 22:11:34.579714 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3432/6989] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:11:34 2022] GET /compute/v2.1/servers/a0f104c1-3fec-4877-bd5d-0ca40bdca1e1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:11:38.641025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0ed5e0e1-8d2a-459f-8ed7-75c292e17ad5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '.version_select at 0x7fc82d0e1f70>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:11:38.737444 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0ed5e0e1-8d2a-459f-8ed7-75c292e17ad5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-435354002" status: 202 len: 0 microversion: 2.1 time: 0.102791 May 21 22:11:38.738047 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3558/6990] 10.222.0.49 () {58 vars in 1280 bytes} [Sat May 21 22:11:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-435354002 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:11:38.765798 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-27378984-29da-46d8-a09f-4678adbfdc11 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'create', calling method: .version_select at 0x7fc819c678b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1355256356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYSjWNWpbLtA/EzbgOJt6plEhBUBLgYcwG6oASO72rrXLDp6+fnXIEmSWtS6p9pjcW0WuwwGjCtB/glTAgXntxtqiGJZssurhCNmLQHGy4H/rzCXdlCMZC/0K5AMQuiZQ=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:11:38.781450 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-27378984-29da-46d8-a09f-4678adbfdc11 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Getting quotas for project 10c1d1acf8134ddab4e11e933dbeb571. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:11:38.787583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-27378984-29da-46d8-a09f-4678adbfdc11 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Getting quotas for user c726d5d196d64ef3a2470ebc855b00f0 and project 10c1d1acf8134ddab4e11e933dbeb571. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:11:38.865983 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-27378984-29da-46d8-a09f-4678adbfdc11 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.104126 May 21 22:11:38.866585 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3433/6991] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 22:11:38 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:11:48.121743 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:11:48.126395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6837eb09-3dd6-47cb-af3e-3cb49cd0e0d9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-325759859", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "66b3a9fe-9a90-4a4b-8d81-bcf057e52e08"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1355256356", "security_groups": [{"name": "tempest-secgroup-smoke-607374419"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:11:48.254093 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-6837eb09-3dd6-47cb-af3e-3cb49cd0e0d9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] validate_networks() for [('66b3a9fe-9a90-4a4b-8d81-bcf057e52e08', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 22:11:48.791912 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6837eb09-3dd6-47cb-af3e-3cb49cd0e0d9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:11:48.792655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6837eb09-3dd6-47cb-af3e-3cb49cd0e0d9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:11:48.793326 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6837eb09-3dd6-47cb-af3e-3cb49cd0e0d9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:11:48.793910 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6837eb09-3dd6-47cb-af3e-3cb49cd0e0d9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:11:48.794502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-6837eb09-3dd6-47cb-af3e-3cb49cd0e0d9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:11:48.806413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6837eb09-3dd6-47cb-af3e-3cb49cd0e0d9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:48.807521 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6837eb09-3dd6-47cb-af3e-3cb49cd0e0d9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:48.808563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6837eb09-3dd6-47cb-af3e-3cb49cd0e0d9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:48.809204 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6837eb09-3dd6-47cb-af3e-3cb49cd0e0d9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:48.830988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-6837eb09-3dd6-47cb-af3e-3cb49cd0e0d9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Getting quotas for project 10c1d1acf8134ddab4e11e933dbeb571. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:11:48.839406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-6837eb09-3dd6-47cb-af3e-3cb49cd0e0d9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Getting quotas for user c726d5d196d64ef3a2470ebc855b00f0 and project 10c1d1acf8134ddab4e11e933dbeb571. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:11:48.855205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6837eb09-3dd6-47cb-af3e-3cb49cd0e0d9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 22:11:48.857692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6837eb09-3dd6-47cb-af3e-3cb49cd0e0d9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 22:11:48.991244 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6837eb09-3dd6-47cb-af3e-3cb49cd0e0d9 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.871233 May 21 22:11:48.992167 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3559/6992] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 22:11:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 22:11:49.003344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aa57b951-ff8a-4024-a955-51498c180be0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:11:49.004073 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-aa57b951-ff8a-4024-a955-51498c180be0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:49.011111 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=40 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:11:49.013866 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:11:49.015491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:11:49.074894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-aa57b951-ff8a-4024-a955-51498c180be0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:11:49.083740 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-aa57b951-ff8a-4024-a955-51498c180be0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1266 microversion: 2.1 time: 0.084557 May 21 22:11:49.094176 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3434/6993] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:11:48 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:11:50.109955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-620a8ea1-812c-46c0-863b-4d66e976b1c2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:11:50.110612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-620a8ea1-812c-46c0-863b-4d66e976b1c2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:50.123213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-620a8ea1-812c-46c0-863b-4d66e976b1c2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:50.130951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-620a8ea1-812c-46c0-863b-4d66e976b1c2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:50.130951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-620a8ea1-812c-46c0-863b-4d66e976b1c2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:50.130951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-620a8ea1-812c-46c0-863b-4d66e976b1c2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:50.203880 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-620a8ea1-812c-46c0-863b-4d66e976b1c2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:11:50.213199 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-620a8ea1-812c-46c0-863b-4d66e976b1c2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1270 microversion: 2.1 time: 0.115518 May 21 22:11:50.214336 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3560/6994] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:11:50 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1270 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:11:51.231933 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f581444f-b0ed-4952-8e30-46b94927f9d7 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:11:51.232706 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f581444f-b0ed-4952-8e30-46b94927f9d7 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:51.241220 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f581444f-b0ed-4952-8e30-46b94927f9d7 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:51.241760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f581444f-b0ed-4952-8e30-46b94927f9d7 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:51.242611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f581444f-b0ed-4952-8e30-46b94927f9d7 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:51.243130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f581444f-b0ed-4952-8e30-46b94927f9d7 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:51.330120 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f581444f-b0ed-4952-8e30-46b94927f9d7 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:11:51.339343 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f581444f-b0ed-4952-8e30-46b94927f9d7 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1326 microversion: 2.1 time: 0.112632 May 21 22:11:51.340235 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3435/6995] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:11:51 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1326 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:11:52.357884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-040ef72e-a46c-4531-bbe8-f20b98667845 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:11:52.358656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-040ef72e-a46c-4531-bbe8-f20b98667845 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:52.366038 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-040ef72e-a46c-4531-bbe8-f20b98667845 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:52.366791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-040ef72e-a46c-4531-bbe8-f20b98667845 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:52.367844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-040ef72e-a46c-4531-bbe8-f20b98667845 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:52.368416 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-040ef72e-a46c-4531-bbe8-f20b98667845 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:52.524976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-040ef72e-a46c-4531-bbe8-f20b98667845 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:11:52.532744 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-040ef72e-a46c-4531-bbe8-f20b98667845 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1391 microversion: 2.1 time: 0.179522 May 21 22:11:52.533327 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3561/6996] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:11:52 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:11:53.252947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-270c54ac-b8a3-4fca-8adb-b0687ad8f454 req-f1e98afb-2e4c-4245-ac9f-4020c0803257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "948d9b42-ef29-489e-9f78-75d2a51ab003", "tag": "c9767077-441d-4004-b1ee-bb678badda5f"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:11:53.265359 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-270c54ac-b8a3-4fca-8adb-b0687ad8f454 req-f1e98afb-2e4c-4245-ac9f-4020c0803257 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:53.265819 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-270c54ac-b8a3-4fca-8adb-b0687ad8f454 req-f1e98afb-2e4c-4245-ac9f-4020c0803257 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:53.278797 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-270c54ac-b8a3-4fca-8adb-b0687ad8f454 req-f1e98afb-2e4c-4245-ac9f-4020c0803257 service nova] Creating event network-changed:c9767077-441d-4004-b1ee-bb678badda5f for instance 948d9b42-ef29-489e-9f78-75d2a51ab003 on nch1-master-1 May 21 22:11:53.285556 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-270c54ac-b8a3-4fca-8adb-b0687ad8f454 req-f1e98afb-2e4c-4245-ac9f-4020c0803257 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036254 May 21 22:11:53.286242 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3436/6997] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:11:53.549399 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-dbb1f41c-37bd-49de-a0d8-9867f1a1705e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:11:53.550146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-dbb1f41c-37bd-49de-a0d8-9867f1a1705e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:53.557967 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dbb1f41c-37bd-49de-a0d8-9867f1a1705e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:53.558501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dbb1f41c-37bd-49de-a0d8-9867f1a1705e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:53.559312 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dbb1f41c-37bd-49de-a0d8-9867f1a1705e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:53.560424 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-dbb1f41c-37bd-49de-a0d8-9867f1a1705e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:53.721227 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-dbb1f41c-37bd-49de-a0d8-9867f1a1705e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:11:53.729606 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-dbb1f41c-37bd-49de-a0d8-9867f1a1705e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1391 microversion: 2.1 time: 0.184289 May 21 22:11:53.730182 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3562/6998] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:11:53 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1391 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:11:54.749929 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-21163568-fdd4-45dd-adb5-3e3ffdb80d6d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:11:54.750778 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-21163568-fdd4-45dd-adb5-3e3ffdb80d6d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:54.757659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21163568-fdd4-45dd-adb5-3e3ffdb80d6d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:54.758115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21163568-fdd4-45dd-adb5-3e3ffdb80d6d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:54.758901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21163568-fdd4-45dd-adb5-3e3ffdb80d6d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:54.759969 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-21163568-fdd4-45dd-adb5-3e3ffdb80d6d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:54.932767 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-21163568-fdd4-45dd-adb5-3e3ffdb80d6d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:11:54.941996 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-21163568-fdd4-45dd-adb5-3e3ffdb80d6d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1391 microversion: 2.1 time: 0.198000 May 21 22:11:54.942514 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3437/6999] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:11:54 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1391 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:11:55.961155 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3f16f994-9bf7-44ca-8fdf-c1f1918dc60f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:11:55.961799 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3f16f994-9bf7-44ca-8fdf-c1f1918dc60f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:55.964832 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:11:55.969769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f16f994-9bf7-44ca-8fdf-c1f1918dc60f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:55.970253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f16f994-9bf7-44ca-8fdf-c1f1918dc60f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:55.971049 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f16f994-9bf7-44ca-8fdf-c1f1918dc60f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:55.971512 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3f16f994-9bf7-44ca-8fdf-c1f1918dc60f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:56.123699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3f16f994-9bf7-44ca-8fdf-c1f1918dc60f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:11:56.131236 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3f16f994-9bf7-44ca-8fdf-c1f1918dc60f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1391 microversion: 2.1 time: 0.174039 May 21 22:11:56.131815 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3563/7000] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:11:55 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:11:57.148421 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-42e76c9b-07fb-4571-9da3-cbefb0f535b1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:11:57.149008 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-42e76c9b-07fb-4571-9da3-cbefb0f535b1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:57.156066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42e76c9b-07fb-4571-9da3-cbefb0f535b1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:57.156558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42e76c9b-07fb-4571-9da3-cbefb0f535b1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:57.157326 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42e76c9b-07fb-4571-9da3-cbefb0f535b1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:57.157774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-42e76c9b-07fb-4571-9da3-cbefb0f535b1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:57.302388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-42e76c9b-07fb-4571-9da3-cbefb0f535b1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:11:57.310603 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-42e76c9b-07fb-4571-9da3-cbefb0f535b1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1391 microversion: 2.1 time: 0.166187 May 21 22:11:57.311201 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3438/7001] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:11:57 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:11:58.327939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c008f48d-c09e-4e71-879f-a1ace2e5594f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:11:58.328592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c008f48d-c09e-4e71-879f-a1ace2e5594f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:58.335538 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c008f48d-c09e-4e71-879f-a1ace2e5594f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:58.335997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c008f48d-c09e-4e71-879f-a1ace2e5594f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:58.336817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c008f48d-c09e-4e71-879f-a1ace2e5594f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:58.337266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c008f48d-c09e-4e71-879f-a1ace2e5594f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:58.482098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c008f48d-c09e-4e71-879f-a1ace2e5594f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:11:58.489720 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c008f48d-c09e-4e71-879f-a1ace2e5594f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1391 microversion: 2.1 time: 0.165561 May 21 22:11:58.490291 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3564/7002] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:11:58 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:11:59.507006 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-94d69467-f628-44bd-b6a1-bd3291c98057 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:11:59.507640 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-94d69467-f628-44bd-b6a1-bd3291c98057 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:11:59.515498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94d69467-f628-44bd-b6a1-bd3291c98057 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:59.515984 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94d69467-f628-44bd-b6a1-bd3291c98057 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:59.516846 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94d69467-f628-44bd-b6a1-bd3291c98057 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:59.517294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94d69467-f628-44bd-b6a1-bd3291c98057 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:59.539063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-e319f68d-4ac2-4022-b730-4d2e9f2ca80b req-6b6dd308-226b-41a7-9e0a-779e5fd86a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "948d9b42-ef29-489e-9f78-75d2a51ab003", "name": "network-vif-plugged", "status": "completed", "tag": "c9767077-441d-4004-b1ee-bb678badda5f"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:11:59.544611 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:11:59.545571 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:11:59.552049 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-e319f68d-4ac2-4022-b730-4d2e9f2ca80b req-6b6dd308-226b-41a7-9e0a-779e5fd86a46 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:11:59.552743 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-e319f68d-4ac2-4022-b730-4d2e9f2ca80b req-6b6dd308-226b-41a7-9e0a-779e5fd86a46 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:11:59.565310 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-e319f68d-4ac2-4022-b730-4d2e9f2ca80b req-6b6dd308-226b-41a7-9e0a-779e5fd86a46 service nova] Creating event network-vif-plugged:c9767077-441d-4004-b1ee-bb678badda5f for instance 948d9b42-ef29-489e-9f78-75d2a51ab003 on nch1-master-1 May 21 22:11:59.570916 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-e319f68d-4ac2-4022-b730-4d2e9f2ca80b req-6b6dd308-226b-41a7-9e0a-779e5fd86a46 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036627 May 21 22:11:59.571610 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3565/7003] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:11:59.724055 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-94d69467-f628-44bd-b6a1-bd3291c98057 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:11:59.733190 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-94d69467-f628-44bd-b6a1-bd3291c98057 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1391 microversion: 2.1 time: 0.230146 May 21 22:11:59.733798 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3439/7004] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:11:59 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1391 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:12:00.753017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8e11360b-d373-492e-9b5b-077742c2c27b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:12:00.753665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8e11360b-d373-492e-9b5b-077742c2c27b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:12:00.761585 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8e11360b-d373-492e-9b5b-077742c2c27b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:00.762056 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8e11360b-d373-492e-9b5b-077742c2c27b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:00.762851 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8e11360b-d373-492e-9b5b-077742c2c27b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:00.763304 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8e11360b-d373-492e-9b5b-077742c2c27b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:00.914409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8e11360b-d373-492e-9b5b-077742c2c27b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:12:00.922861 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8e11360b-d373-492e-9b5b-077742c2c27b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1391 microversion: 2.1 time: 0.175524 May 21 22:12:00.923455 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3566/7005] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:12:00 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:12:01.941105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-038bb117-55a1-4fbb-8590-e408f511e477 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:12:01.941656 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-038bb117-55a1-4fbb-8590-e408f511e477 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:12:01.944482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:12:01.950075 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-038bb117-55a1-4fbb-8590-e408f511e477 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:01.950580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-038bb117-55a1-4fbb-8590-e408f511e477 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:01.951318 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-038bb117-55a1-4fbb-8590-e408f511e477 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:01.951800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-038bb117-55a1-4fbb-8590-e408f511e477 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:02.095558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-038bb117-55a1-4fbb-8590-e408f511e477 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:12:02.103266 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-038bb117-55a1-4fbb-8590-e408f511e477 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1563 microversion: 2.1 time: 0.166439 May 21 22:12:02.103847 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3440/7006] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:12:01 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:12:02.120239 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e8f4daaf-7e24-4718-ad11-4e9ca2ff3921 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:12:02.120904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e8f4daaf-7e24-4718-ad11-4e9ca2ff3921 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:12:02.127834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8f4daaf-7e24-4718-ad11-4e9ca2ff3921 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:02.128331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8f4daaf-7e24-4718-ad11-4e9ca2ff3921 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:02.129130 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8f4daaf-7e24-4718-ad11-4e9ca2ff3921 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:02.129589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e8f4daaf-7e24-4718-ad11-4e9ca2ff3921 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:02.279081 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e8f4daaf-7e24-4718-ad11-4e9ca2ff3921 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:12:02.286959 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e8f4daaf-7e24-4718-ad11-4e9ca2ff3921 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1563 microversion: 2.1 time: 0.171157 May 21 22:12:02.287536 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3567/7007] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:12:02 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:12:04.927403 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-3a25ea0f-647b-4f52-b160-436c7c33c9d7 req-58ffc17f-65b1-4c5b-b012-a1e3942e580b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "948d9b42-ef29-489e-9f78-75d2a51ab003", "tag": "c9767077-441d-4004-b1ee-bb678badda5f"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:12:04.930181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c35ab894-ccf6-4cdf-b50d-b2497199b2a2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:12:04.930813 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c35ab894-ccf6-4cdf-b50d-b2497199b2a2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:12:04.938774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c35ab894-ccf6-4cdf-b50d-b2497199b2a2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:04.939450 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c35ab894-ccf6-4cdf-b50d-b2497199b2a2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:04.940607 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c35ab894-ccf6-4cdf-b50d-b2497199b2a2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:04.941156 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c35ab894-ccf6-4cdf-b50d-b2497199b2a2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:04.944160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-3a25ea0f-647b-4f52-b160-436c7c33c9d7 req-58ffc17f-65b1-4c5b-b012-a1e3942e580b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:04.944870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-3a25ea0f-647b-4f52-b160-436c7c33c9d7 req-58ffc17f-65b1-4c5b-b012-a1e3942e580b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:04.957635 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-3a25ea0f-647b-4f52-b160-436c7c33c9d7 req-58ffc17f-65b1-4c5b-b012-a1e3942e580b service nova] Creating event network-changed:c9767077-441d-4004-b1ee-bb678badda5f for instance 948d9b42-ef29-489e-9f78-75d2a51ab003 on nch1-master-1 May 21 22:12:04.963681 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-3a25ea0f-647b-4f52-b160-436c7c33c9d7 req-58ffc17f-65b1-4c5b-b012-a1e3942e580b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039314 May 21 22:12:04.964338 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3568/7008] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:12:05.212128 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c35ab894-ccf6-4cdf-b50d-b2497199b2a2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:12:05.223605 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c35ab894-ccf6-4cdf-b50d-b2497199b2a2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1563 microversion: 2.1 time: 0.303460 May 21 22:12:05.224492 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3441/7009] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:12:04 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1563 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:12:26.483427 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d35b3745-0f06-41db-abb0-aa96305bbdc1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:12:26.484494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d35b3745-0f06-41db-abb0-aa96305bbdc1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:12:26.487595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=11 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:12:26.488298 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=48 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:12:26.493477 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d35b3745-0f06-41db-abb0-aa96305bbdc1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:26.493947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d35b3745-0f06-41db-abb0-aa96305bbdc1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:26.494735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d35b3745-0f06-41db-abb0-aa96305bbdc1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:26.495254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d35b3745-0f06-41db-abb0-aa96305bbdc1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:26.544540 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d35b3745-0f06-41db-abb0-aa96305bbdc1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003/action" status: 200 len: 24570 microversion: 2.1 time: 0.065201 May 21 22:12:26.545249 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3569/7010] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:12:26 2022] POST /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003/action => generated 24570 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 22:12:32.946909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e22ddbac-8a75-4fdf-adb3-dd602636fe32 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:12:32.947879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e22ddbac-8a75-4fdf-adb3-dd602636fe32 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:12:32.950629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=18 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:12:32.951461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=38 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:12:32.956975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e22ddbac-8a75-4fdf-adb3-dd602636fe32 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:32.957436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e22ddbac-8a75-4fdf-adb3-dd602636fe32 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:32.958216 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e22ddbac-8a75-4fdf-adb3-dd602636fe32 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:32.958666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e22ddbac-8a75-4fdf-adb3-dd602636fe32 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:33.128160 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e22ddbac-8a75-4fdf-adb3-dd602636fe32 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003/action" status: 202 len: 0 microversion: 2.1 time: 0.184244 May 21 22:12:33.128966 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3442/7011] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:12:32 2022] POST /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:12:33.137792 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4067c56d-506d-4311-a07a-da9725dcfbc5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:12:33.139491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4067c56d-506d-4311-a07a-da9725dcfbc5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:12:33.147152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4067c56d-506d-4311-a07a-da9725dcfbc5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:33.147625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4067c56d-506d-4311-a07a-da9725dcfbc5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:33.148464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4067c56d-506d-4311-a07a-da9725dcfbc5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:33.148931 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4067c56d-506d-4311-a07a-da9725dcfbc5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:33.302456 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-4067c56d-506d-4311-a07a-da9725dcfbc5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:12:33.310494 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4067c56d-506d-4311-a07a-da9725dcfbc5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1673 microversion: 2.1 time: 0.177044 May 21 22:12:33.311428 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3570/7012] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:12:33 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1673 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:12:34.330825 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-44429987-6b6c-4f15-b336-4c4ff23df127 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:12:34.331566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-44429987-6b6c-4f15-b336-4c4ff23df127 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:12:34.337991 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44429987-6b6c-4f15-b336-4c4ff23df127 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:34.338440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44429987-6b6c-4f15-b336-4c4ff23df127 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:34.339205 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44429987-6b6c-4f15-b336-4c4ff23df127 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:34.339646 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-44429987-6b6c-4f15-b336-4c4ff23df127 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:34.501534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-44429987-6b6c-4f15-b336-4c4ff23df127 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:12:34.509695 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-44429987-6b6c-4f15-b336-4c4ff23df127 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1678 microversion: 2.1 time: 0.184212 May 21 22:12:34.510282 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3443/7013] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:12:34 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:12:35.528272 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9712babe-4f68-4b8e-825d-1208cf2a7966 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:12:35.528871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9712babe-4f68-4b8e-825d-1208cf2a7966 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:12:35.536480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9712babe-4f68-4b8e-825d-1208cf2a7966 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:35.537040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9712babe-4f68-4b8e-825d-1208cf2a7966 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:35.537750 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9712babe-4f68-4b8e-825d-1208cf2a7966 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:35.538207 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9712babe-4f68-4b8e-825d-1208cf2a7966 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:35.688972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9712babe-4f68-4b8e-825d-1208cf2a7966 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:12:35.697029 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9712babe-4f68-4b8e-825d-1208cf2a7966 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1678 microversion: 2.1 time: 0.173113 May 21 22:12:35.697594 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3571/7014] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:12:35 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:12:36.714267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ab4b43af-a269-426a-addd-3b77830a5776 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:12:36.714895 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ab4b43af-a269-426a-addd-3b77830a5776 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:12:36.722479 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab4b43af-a269-426a-addd-3b77830a5776 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:36.723816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab4b43af-a269-426a-addd-3b77830a5776 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:36.723816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab4b43af-a269-426a-addd-3b77830a5776 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:36.724142 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ab4b43af-a269-426a-addd-3b77830a5776 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:36.869006 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ab4b43af-a269-426a-addd-3b77830a5776 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:12:36.876728 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ab4b43af-a269-426a-addd-3b77830a5776 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1678 microversion: 2.1 time: 0.166481 May 21 22:12:36.877339 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3444/7015] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:12:36 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:12:37.894576 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-81576a49-c4ca-4643-b780-7964f7e811ba tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:12:37.895208 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-81576a49-c4ca-4643-b780-7964f7e811ba tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:12:37.902411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81576a49-c4ca-4643-b780-7964f7e811ba tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:37.902883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81576a49-c4ca-4643-b780-7964f7e811ba tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:37.903705 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81576a49-c4ca-4643-b780-7964f7e811ba tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:37.904553 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81576a49-c4ca-4643-b780-7964f7e811ba tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:38.053426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-81576a49-c4ca-4643-b780-7964f7e811ba tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:12:38.061840 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-81576a49-c4ca-4643-b780-7964f7e811ba tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1678 microversion: 2.1 time: 0.171259 May 21 22:12:38.062411 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3572/7016] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:12:37 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:12:39.079466 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-04654367-1703-4a5e-ab1d-8f19a9c74516 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:12:39.080016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-04654367-1703-4a5e-ab1d-8f19a9c74516 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:12:39.087248 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04654367-1703-4a5e-ab1d-8f19a9c74516 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:39.087708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04654367-1703-4a5e-ab1d-8f19a9c74516 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:39.088513 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04654367-1703-4a5e-ab1d-8f19a9c74516 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:39.088959 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-04654367-1703-4a5e-ab1d-8f19a9c74516 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:39.233346 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-04654367-1703-4a5e-ab1d-8f19a9c74516 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:12:39.239876 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-04654367-1703-4a5e-ab1d-8f19a9c74516 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1678 microversion: 2.1 time: 0.164435 May 21 22:12:39.240473 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3445/7017] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:12:39 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:12:40.257965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-62878d9f-bbd2-4d2a-902b-599693f60ebd tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:12:40.258644 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-62878d9f-bbd2-4d2a-902b-599693f60ebd tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:12:40.265694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-62878d9f-bbd2-4d2a-902b-599693f60ebd tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:40.266161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-62878d9f-bbd2-4d2a-902b-599693f60ebd tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:40.266942 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-62878d9f-bbd2-4d2a-902b-599693f60ebd tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:40.267397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-62878d9f-bbd2-4d2a-902b-599693f60ebd tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:40.416795 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-62878d9f-bbd2-4d2a-902b-599693f60ebd tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:12:40.425568 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-62878d9f-bbd2-4d2a-902b-599693f60ebd tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1678 microversion: 2.1 time: 0.171645 May 21 22:12:40.426158 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3573/7018] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:12:40 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:12:41.443892 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-76290d57-eb6f-4d9f-8f5d-2b2160810166 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:12:41.444620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-76290d57-eb6f-4d9f-8f5d-2b2160810166 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:12:41.451660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-76290d57-eb6f-4d9f-8f5d-2b2160810166 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:41.452122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-76290d57-eb6f-4d9f-8f5d-2b2160810166 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:41.452944 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-76290d57-eb6f-4d9f-8f5d-2b2160810166 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:41.453412 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-76290d57-eb6f-4d9f-8f5d-2b2160810166 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:41.606649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-76290d57-eb6f-4d9f-8f5d-2b2160810166 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:12:41.615216 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-76290d57-eb6f-4d9f-8f5d-2b2160810166 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1678 microversion: 2.1 time: 0.176280 May 21 22:12:41.615801 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3446/7019] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:12:41 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:12:42.633122 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2ae0abde-0cd6-44b6-909b-88a0032f250b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:12:42.633757 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2ae0abde-0cd6-44b6-909b-88a0032f250b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:12:42.640913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2ae0abde-0cd6-44b6-909b-88a0032f250b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:42.641384 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2ae0abde-0cd6-44b6-909b-88a0032f250b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:42.642176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2ae0abde-0cd6-44b6-909b-88a0032f250b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:42.642669 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2ae0abde-0cd6-44b6-909b-88a0032f250b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:42.806721 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2ae0abde-0cd6-44b6-909b-88a0032f250b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:12:42.814415 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2ae0abde-0cd6-44b6-909b-88a0032f250b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1678 microversion: 2.1 time: 0.185330 May 21 22:12:42.815851 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3574/7020] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:12:42 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:12:43.833524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-acf44e28-5662-46b0-93ac-12bfda11ccc7 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:12:43.834181 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-acf44e28-5662-46b0-93ac-12bfda11ccc7 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:12:43.841351 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-acf44e28-5662-46b0-93ac-12bfda11ccc7 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:43.841809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-acf44e28-5662-46b0-93ac-12bfda11ccc7 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:43.842585 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-acf44e28-5662-46b0-93ac-12bfda11ccc7 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:43.843030 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-acf44e28-5662-46b0-93ac-12bfda11ccc7 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:43.992324 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-acf44e28-5662-46b0-93ac-12bfda11ccc7 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:12:44.000014 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-acf44e28-5662-46b0-93ac-12bfda11ccc7 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1678 microversion: 2.1 time: 0.171157 May 21 22:12:44.000626 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3447/7021] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:12:43 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:12:45.018000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-aee08993-770f-4395-8e08-6b525d023ea5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:12:45.018550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-aee08993-770f-4395-8e08-6b525d023ea5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:12:45.025787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aee08993-770f-4395-8e08-6b525d023ea5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:45.026256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aee08993-770f-4395-8e08-6b525d023ea5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:45.027114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aee08993-770f-4395-8e08-6b525d023ea5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:12:45.027569 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-aee08993-770f-4395-8e08-6b525d023ea5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:12:45.171131 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-aee08993-770f-4395-8e08-6b525d023ea5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:12:45.179498 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-aee08993-770f-4395-8e08-6b525d023ea5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1681 microversion: 2.1 time: 0.165586 May 21 22:12:45.180076 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3575/7022] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:12:45 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:13:09.382180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9bc75fa8-b1db-4ebb-86db-b5636ded1dc6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:13:09.383131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9bc75fa8-b1db-4ebb-86db-b5636ded1dc6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:09.385622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=12 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:13:09.386440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:13:09.391288 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9bc75fa8-b1db-4ebb-86db-b5636ded1dc6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:09.391746 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9bc75fa8-b1db-4ebb-86db-b5636ded1dc6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:09.392586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9bc75fa8-b1db-4ebb-86db-b5636ded1dc6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:09.393034 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9bc75fa8-b1db-4ebb-86db-b5636ded1dc6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:09.447858 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9bc75fa8-b1db-4ebb-86db-b5636ded1dc6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003/action" status: 200 len: 69105 microversion: 2.1 time: 0.070216 May 21 22:13:09.448559 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3448/7023] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:13:09 2022] POST /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003/action => generated 69105 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 22:13:16.773091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-21164625-94c4-47ae-b104-be8091fc39a4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:16.773724 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-21164625-94c4-47ae-b104-be8091fc39a4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:16.775585 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-603fdd15-79ea-4d75-885c-5a57e64da10a req-2e21cc23-8f67-4f9a-8938-ff03fe5b6c4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "948d9b42-ef29-489e-9f78-75d2a51ab003", "tag": "c9767077-441d-4004-b1ee-bb678badda5f"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:13:16.777999 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=14 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:13:16.778708 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=40 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:13:16.783875 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21164625-94c4-47ae-b104-be8091fc39a4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:16.786554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21164625-94c4-47ae-b104-be8091fc39a4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:16.786554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21164625-94c4-47ae-b104-be8091fc39a4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:16.786554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21164625-94c4-47ae-b104-be8091fc39a4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:16.788260 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-603fdd15-79ea-4d75-885c-5a57e64da10a req-2e21cc23-8f67-4f9a-8938-ff03fe5b6c4b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:16.788743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-603fdd15-79ea-4d75-885c-5a57e64da10a req-2e21cc23-8f67-4f9a-8938-ff03fe5b6c4b service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:16.800479 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-603fdd15-79ea-4d75-885c-5a57e64da10a req-2e21cc23-8f67-4f9a-8938-ff03fe5b6c4b service nova] Creating event network-changed:c9767077-441d-4004-b1ee-bb678badda5f for instance 948d9b42-ef29-489e-9f78-75d2a51ab003 on nch1-master-1 May 21 22:13:16.806876 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-603fdd15-79ea-4d75-885c-5a57e64da10a req-2e21cc23-8f67-4f9a-8938-ff03fe5b6c4b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035249 May 21 22:13:16.807488 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3449/7024] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:13:16.815421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-21164625-94c4-47ae-b104-be8091fc39a4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 22:13:17.145555 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-21164625-94c4-47ae-b104-be8091fc39a4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "DELETE /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 204 len: 0 microversion: 2.1 time: 0.375925 May 21 22:13:17.146275 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3576/7025] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:13:16 2022] DELETE /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:13:17.156259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-de9adc37-4c98-4db6-800c-df396168e23a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:17.157170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-de9adc37-4c98-4db6-800c-df396168e23a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:17.176461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de9adc37-4c98-4db6-800c-df396168e23a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:17.176461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de9adc37-4c98-4db6-800c-df396168e23a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:17.176461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de9adc37-4c98-4db6-800c-df396168e23a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:17.176461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de9adc37-4c98-4db6-800c-df396168e23a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:17.314380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-de9adc37-4c98-4db6-800c-df396168e23a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:13:17.323146 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-de9adc37-4c98-4db6-800c-df396168e23a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1687 microversion: 2.1 time: 0.172490 May 21 22:13:17.323724 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3450/7026] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:13:17 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:13:18.341955 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c1157a40-2aa4-41d3-b165-d2ef3c59a537 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:18.343320 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c1157a40-2aa4-41d3-b165-d2ef3c59a537 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:18.351277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1157a40-2aa4-41d3-b165-d2ef3c59a537 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:18.351748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1157a40-2aa4-41d3-b165-d2ef3c59a537 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:18.352580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1157a40-2aa4-41d3-b165-d2ef3c59a537 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:18.353041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c1157a40-2aa4-41d3-b165-d2ef3c59a537 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:18.501550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c1157a40-2aa4-41d3-b165-d2ef3c59a537 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:13:18.509480 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c1157a40-2aa4-41d3-b165-d2ef3c59a537 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1687 microversion: 2.1 time: 0.171801 May 21 22:13:18.510068 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3577/7027] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:13:18 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:13:19.200387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-85d5c0a2-9df4-4e11-84b4-76d72f1a651d req-a007583f-12ab-4ed3-beb6-f8c935147fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "948d9b42-ef29-489e-9f78-75d2a51ab003", "name": "network-vif-deleted", "tag": "c9767077-441d-4004-b1ee-bb678badda5f"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:13:19.209644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-85d5c0a2-9df4-4e11-84b4-76d72f1a651d req-a007583f-12ab-4ed3-beb6-f8c935147fd1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:19.210122 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-85d5c0a2-9df4-4e11-84b4-76d72f1a651d req-a007583f-12ab-4ed3-beb6-f8c935147fd1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:19.221105 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-85d5c0a2-9df4-4e11-84b4-76d72f1a651d req-a007583f-12ab-4ed3-beb6-f8c935147fd1 service nova] Creating event network-vif-deleted:c9767077-441d-4004-b1ee-bb678badda5f for instance 948d9b42-ef29-489e-9f78-75d2a51ab003 on nch1-master-1 May 21 22:13:19.226205 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-85d5c0a2-9df4-4e11-84b4-76d72f1a651d req-a007583f-12ab-4ed3-beb6-f8c935147fd1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029623 May 21 22:13:19.226782 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3451/7028] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:13:19.526853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3360e15f-98b6-49ed-8ea1-02a9481583a6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:19.528120 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3360e15f-98b6-49ed-8ea1-02a9481583a6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:19.536202 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3360e15f-98b6-49ed-8ea1-02a9481583a6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:19.536776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3360e15f-98b6-49ed-8ea1-02a9481583a6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:19.542116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3360e15f-98b6-49ed-8ea1-02a9481583a6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:19.542116 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3360e15f-98b6-49ed-8ea1-02a9481583a6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:19.572480 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3360e15f-98b6-49ed-8ea1-02a9481583a6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:19.572958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3360e15f-98b6-49ed-8ea1-02a9481583a6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:19.573444 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-3360e15f-98b6-49ed-8ea1-02a9481583a6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lazy-loading 'fault' on Instance uuid 948d9b42-ef29-489e-9f78-75d2a51ab003 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 22:13:19.621491 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3360e15f-98b6-49ed-8ea1-02a9481583a6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:13:19.629841 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3360e15f-98b6-49ed-8ea1-02a9481583a6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 200 len: 1356 microversion: 2.1 time: 0.106278 May 21 22:13:19.630421 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3578/7029] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:13:19 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:13:20.647841 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ccbb90e4-1076-46ee-adb2-d4c0b5d16a10 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:20.648858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ccbb90e4-1076-46ee-adb2-d4c0b5d16a10 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 948d9b42-ef29-489e-9f78-75d2a51ab003] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:20.660547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ccbb90e4-1076-46ee-adb2-d4c0b5d16a10 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:20.661027 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ccbb90e4-1076-46ee-adb2-d4c0b5d16a10 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:20.661876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ccbb90e4-1076-46ee-adb2-d4c0b5d16a10 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:20.662336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ccbb90e4-1076-46ee-adb2-d4c0b5d16a10 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:20.681164 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-ccbb90e4-1076-46ee-adb2-d4c0b5d16a10 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] HTTP exception thrown: Instance 948d9b42-ef29-489e-9f78-75d2a51ab003 could not be found. May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ccbb90e4-1076-46ee-adb2-d4c0b5d16a10 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Request method failure captured: May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 HTTP/1.1 May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWNUii8Zq6WOyAgXHmbJ3sC5wa94C74ELxknXQJ_SM32Jav6JyvMpyYMVSFhYJ3s1YN1udNzGY1HshTj3s7GT-R1gCzdtKT1r559qWDXMdRUrYXCdFe0fnjc0pP6_57YeQK7_51zGtHqPFGJn1yY7YonKAJ0n7bgpG0NA9tWLAWZZZY May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 10c1d1acf8134ddab4e11e933dbeb571 May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-351207300 May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/10c1d1acf8134ddab4e11e933dbeb571"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10c1d1acf8134ddab4e11e933dbeb571"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_10c1d1acf8134ddab4e11e933dbeb571", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10c1d1acf8134ddab4e11e933dbeb571"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestNetworkAdvancedServerOps-351207300 May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 10c1d1acf8134ddab4e11e933dbeb571 May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-351207300 May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestNetworkAdvancedServerOps-351207300-project May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c726d5d196d64ef3a2470ebc855b00f0 May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestNetworkAdvancedServerOps-351207300-project May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 948d9b42-ef29-489e-9f78-75d2a51ab003 could not be found. May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '948d9b42-ef29-489e-9f78-75d2a51ab003'} May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 948d9b42-ef29-489e-9f78-75d2a51ab003 could not be found. May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 948d9b42-ef29-489e-9f78-75d2a51ab003 could not be found. May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:13:20.683504 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:13:20.689195 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:13:20.689195 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:13:20.689195 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:13:20.689195 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:13:20.689195 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:13:20.689195 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 948d9b42-ef29-489e-9f78-75d2a51ab003 could not be found. May 21 22:13:20.689195 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:13:20.689195 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ccbb90e4-1076-46ee-adb2-d4c0b5d16a10 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Returning 404 to user: Instance 948d9b42-ef29-489e-9f78-75d2a51ab003 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:13:20.689195 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ccbb90e4-1076-46ee-adb2-d4c0b5d16a10 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003" status: 404 len: 111 microversion: 2.1 time: 0.042772 May 21 22:13:20.689195 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3452/7030] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:13:20 2022] GET /compute/v2.1/servers/948d9b42-ef29-489e-9f78-75d2a51ab003 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:13:24.726983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f90595f4-8dbc-49e7-8bbb-81ca403dc345 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '.version_select at 0x7fc81b2df1f0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:24.811364 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f90595f4-8dbc-49e7-8bbb-81ca403dc345 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1355256356" status: 202 len: 0 microversion: 2.1 time: 0.088325 May 21 22:13:24.811959 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3579/7031] 10.222.0.49 () {58 vars in 1283 bytes} [Sat May 21 22:13:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1355256356 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:13:24.841782 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e8b5b820-b3ea-4c61-b1e9-3a9073033f10 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'create', calling method: .version_select at 0x7fc81bc45160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1499160801", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqicjZpChUbbZjGEanaTq7Sue1pYwWLT2ZD3FyjSRvnL/oCRGz1bOYESLFCdv8S9K4ELsOPqFGrnXro+Rgv/JEfHHLlQzk+x9QPvL7Wa76c6HFyzn5X83t2nF/9gOAekg=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:13:24.856805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-e8b5b820-b3ea-4c61-b1e9-3a9073033f10 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Getting quotas for project 10c1d1acf8134ddab4e11e933dbeb571. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:13:24.862981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-e8b5b820-b3ea-4c61-b1e9-3a9073033f10 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Getting quotas for user c726d5d196d64ef3a2470ebc855b00f0 and project 10c1d1acf8134ddab4e11e933dbeb571. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:13:24.976827 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e8b5b820-b3ea-4c61-b1e9-3a9073033f10 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.138947 May 21 22:13:24.977389 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3453/7032] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 22:13:24 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:13:26.640629 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:13:26.641276 ncdv-master-1 devstack@n-api.service[131278]: Sat May 21 22:13:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:13:33.971418 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:13:33.977036 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c2141f68-4fe5-40b0-aeb9-04190a0be94c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1092206804", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "f7482cfd-1193-4ca4-8ded-c52b71d6ada0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1499160801", "security_groups": [{"name": "tempest-secgroup-smoke-1240885852"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:13:34.668610 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-c2141f68-4fe5-40b0-aeb9-04190a0be94c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] validate_networks() for [('f7482cfd-1193-4ca4-8ded-c52b71d6ada0', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 22:13:35.122032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c2141f68-4fe5-40b0-aeb9-04190a0be94c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:13:35.122612 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c2141f68-4fe5-40b0-aeb9-04190a0be94c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:13:35.122997 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c2141f68-4fe5-40b0-aeb9-04190a0be94c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:13:35.123598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c2141f68-4fe5-40b0-aeb9-04190a0be94c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:13:35.124222 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-c2141f68-4fe5-40b0-aeb9-04190a0be94c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:13:35.135025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2141f68-4fe5-40b0-aeb9-04190a0be94c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:35.135504 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2141f68-4fe5-40b0-aeb9-04190a0be94c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:35.136356 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2141f68-4fe5-40b0-aeb9-04190a0be94c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:35.136818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c2141f68-4fe5-40b0-aeb9-04190a0be94c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:35.158866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-c2141f68-4fe5-40b0-aeb9-04190a0be94c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Getting quotas for project 10c1d1acf8134ddab4e11e933dbeb571. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:13:35.164150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-c2141f68-4fe5-40b0-aeb9-04190a0be94c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Getting quotas for user c726d5d196d64ef3a2470ebc855b00f0 and project 10c1d1acf8134ddab4e11e933dbeb571. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:13:35.177021 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c2141f68-4fe5-40b0-aeb9-04190a0be94c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 22:13:35.179487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c2141f68-4fe5-40b0-aeb9-04190a0be94c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 22:13:35.301826 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c2141f68-4fe5-40b0-aeb9-04190a0be94c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.332272 May 21 22:13:35.307432 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3580/7033] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 22:13:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 22:13:35.314331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3348910f-a72c-4d9b-b977-d66c8a0d1e1b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:35.314965 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3348910f-a72c-4d9b-b977-d66c8a0d1e1b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:35.318867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=16 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:13:35.319813 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:13:35.320914 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:13:35.433564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3348910f-a72c-4d9b-b977-d66c8a0d1e1b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:13:35.442009 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3348910f-a72c-4d9b-b977-d66c8a0d1e1b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1267 microversion: 2.1 time: 0.132051 May 21 22:13:35.442676 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3454/7034] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:13:35 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1267 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:13:36.462386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-13f640fd-8ee3-4698-b9bb-8339e6661905 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:36.463097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-13f640fd-8ee3-4698-b9bb-8339e6661905 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:36.522389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-13f640fd-8ee3-4698-b9bb-8339e6661905 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:13:36.529504 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-13f640fd-8ee3-4698-b9bb-8339e6661905 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1267 microversion: 2.1 time: 0.072754 May 21 22:13:36.530083 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3581/7035] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:13:36 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1267 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:13:37.546726 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-06f9afe7-e138-46e7-953d-36233231d1a0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:37.548645 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-06f9afe7-e138-46e7-953d-36233231d1a0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:37.617513 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-06f9afe7-e138-46e7-953d-36233231d1a0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:13:37.625918 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-06f9afe7-e138-46e7-953d-36233231d1a0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1267 microversion: 2.1 time: 0.083557 May 21 22:13:37.626504 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3455/7036] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:13:37 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:13:38.643125 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-116484dc-879d-4dfe-a224-02fffcad5cf2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:38.643769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-116484dc-879d-4dfe-a224-02fffcad5cf2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:38.706476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-116484dc-879d-4dfe-a224-02fffcad5cf2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:13:38.723856 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-116484dc-879d-4dfe-a224-02fffcad5cf2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1267 microversion: 2.1 time: 0.084176 May 21 22:13:38.726567 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3582/7037] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:13:38 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:13:39.743764 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-da18c677-b1bf-4a94-9a41-4be529fe5e70 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:39.744445 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-da18c677-b1bf-4a94-9a41-4be529fe5e70 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:39.752044 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da18c677-b1bf-4a94-9a41-4be529fe5e70 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:39.752558 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da18c677-b1bf-4a94-9a41-4be529fe5e70 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:39.753333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da18c677-b1bf-4a94-9a41-4be529fe5e70 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:39.753775 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-da18c677-b1bf-4a94-9a41-4be529fe5e70 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:39.819170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-da18c677-b1bf-4a94-9a41-4be529fe5e70 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:13:39.826969 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-da18c677-b1bf-4a94-9a41-4be529fe5e70 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1271 microversion: 2.1 time: 0.087876 May 21 22:13:39.827531 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3456/7038] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:13:39 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:13:40.844603 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-32d219d3-e8dd-49d5-94e9-dbd95d776d35 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:40.845160 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-32d219d3-e8dd-49d5-94e9-dbd95d776d35 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:40.852772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32d219d3-e8dd-49d5-94e9-dbd95d776d35 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:40.853247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32d219d3-e8dd-49d5-94e9-dbd95d776d35 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:40.854047 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32d219d3-e8dd-49d5-94e9-dbd95d776d35 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:40.854524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32d219d3-e8dd-49d5-94e9-dbd95d776d35 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:40.923633 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-32d219d3-e8dd-49d5-94e9-dbd95d776d35 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:13:40.931730 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-32d219d3-e8dd-49d5-94e9-dbd95d776d35 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1319 microversion: 2.1 time: 0.091281 May 21 22:13:40.932402 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3583/7039] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:13:40 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1319 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:13:41.948938 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a5096f3a-1f67-4353-a326-6dd909235218 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:41.949583 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a5096f3a-1f67-4353-a326-6dd909235218 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:41.956719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5096f3a-1f67-4353-a326-6dd909235218 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:41.960136 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5096f3a-1f67-4353-a326-6dd909235218 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:41.960136 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5096f3a-1f67-4353-a326-6dd909235218 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:41.960136 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5096f3a-1f67-4353-a326-6dd909235218 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:42.111082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a5096f3a-1f67-4353-a326-6dd909235218 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:13:42.121115 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a5096f3a-1f67-4353-a326-6dd909235218 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1393 microversion: 2.1 time: 0.176329 May 21 22:13:42.122053 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3457/7040] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:13:41 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1393 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:13:43.139474 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c4c60599-f962-4d87-ac62-35bacb77c34c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:43.140154 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c4c60599-f962-4d87-ac62-35bacb77c34c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:43.147264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4c60599-f962-4d87-ac62-35bacb77c34c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:43.147686 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4c60599-f962-4d87-ac62-35bacb77c34c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:43.148516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4c60599-f962-4d87-ac62-35bacb77c34c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:43.148999 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c4c60599-f962-4d87-ac62-35bacb77c34c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:43.272037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-455e1836-647b-4aa1-83b8-0166ac5273d7 req-278fcb85-b899-45ff-8553-f86b37dc3b3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "648edf97-aa44-4150-be59-f44788c5e6e1", "tag": "90137940-e45b-4dfe-930c-4e72abbb912a"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:13:43.283592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-455e1836-647b-4aa1-83b8-0166ac5273d7 req-278fcb85-b899-45ff-8553-f86b37dc3b3a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:43.284356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-455e1836-647b-4aa1-83b8-0166ac5273d7 req-278fcb85-b899-45ff-8553-f86b37dc3b3a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:43.298900 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-455e1836-647b-4aa1-83b8-0166ac5273d7 req-278fcb85-b899-45ff-8553-f86b37dc3b3a service nova] Creating event network-changed:90137940-e45b-4dfe-930c-4e72abbb912a for instance 648edf97-aa44-4150-be59-f44788c5e6e1 on nch1-master-1 May 21 22:13:43.305299 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-455e1836-647b-4aa1-83b8-0166ac5273d7 req-278fcb85-b899-45ff-8553-f86b37dc3b3a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038365 May 21 22:13:43.306378 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3458/7041] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:13:43.401857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c4c60599-f962-4d87-ac62-35bacb77c34c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:13:43.410556 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c4c60599-f962-4d87-ac62-35bacb77c34c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1393 microversion: 2.1 time: 0.275221 May 21 22:13:43.411183 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3584/7042] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:13:43 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1393 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:13:44.429721 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-789b5ab1-8d4f-48c9-a10f-8a4c1e02b601 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:44.430452 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-789b5ab1-8d4f-48c9-a10f-8a4c1e02b601 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:44.436817 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-789b5ab1-8d4f-48c9-a10f-8a4c1e02b601 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:44.437268 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-789b5ab1-8d4f-48c9-a10f-8a4c1e02b601 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:44.438039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-789b5ab1-8d4f-48c9-a10f-8a4c1e02b601 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:44.438478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-789b5ab1-8d4f-48c9-a10f-8a4c1e02b601 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:44.588078 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-789b5ab1-8d4f-48c9-a10f-8a4c1e02b601 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:13:44.595655 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-789b5ab1-8d4f-48c9-a10f-8a4c1e02b601 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1393 microversion: 2.1 time: 0.171084 May 21 22:13:44.596226 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3459/7043] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:13:44 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:13:45.613625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b22030db-7dc7-4ea7-890e-aac0d8fee16c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:45.614263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b22030db-7dc7-4ea7-890e-aac0d8fee16c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:45.617719 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:13:45.622776 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b22030db-7dc7-4ea7-890e-aac0d8fee16c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:45.623253 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b22030db-7dc7-4ea7-890e-aac0d8fee16c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:45.624048 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b22030db-7dc7-4ea7-890e-aac0d8fee16c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:45.624608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b22030db-7dc7-4ea7-890e-aac0d8fee16c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:45.773361 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b22030db-7dc7-4ea7-890e-aac0d8fee16c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:13:45.781003 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b22030db-7dc7-4ea7-890e-aac0d8fee16c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1393 microversion: 2.1 time: 0.171338 May 21 22:13:45.782697 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3585/7044] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:13:45 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1393 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:13:46.798022 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-675c6ac3-b4f0-4778-812e-ca0bafec8f47 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:46.798644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-675c6ac3-b4f0-4778-812e-ca0bafec8f47 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:46.806394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-675c6ac3-b4f0-4778-812e-ca0bafec8f47 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:46.806848 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-675c6ac3-b4f0-4778-812e-ca0bafec8f47 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:46.807620 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-675c6ac3-b4f0-4778-812e-ca0bafec8f47 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:46.808064 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-675c6ac3-b4f0-4778-812e-ca0bafec8f47 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:46.952476 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-675c6ac3-b4f0-4778-812e-ca0bafec8f47 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:13:46.960431 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-675c6ac3-b4f0-4778-812e-ca0bafec8f47 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1393 microversion: 2.1 time: 0.166317 May 21 22:13:46.961008 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3460/7045] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:13:46 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:13:47.977533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9b06ba99-4141-44a0-a436-b59f7fcd4511 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:47.978070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9b06ba99-4141-44a0-a436-b59f7fcd4511 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:47.980907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:13:47.985897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b06ba99-4141-44a0-a436-b59f7fcd4511 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:47.986368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b06ba99-4141-44a0-a436-b59f7fcd4511 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:47.987163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b06ba99-4141-44a0-a436-b59f7fcd4511 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:47.987622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9b06ba99-4141-44a0-a436-b59f7fcd4511 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:48.016549 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-629ab495-d6b4-4263-931b-5d83e00512df req-e5edb093-e43f-4361-a961-604a048ca647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "648edf97-aa44-4150-be59-f44788c5e6e1", "name": "network-vif-plugged", "status": "completed", "tag": "90137940-e45b-4dfe-930c-4e72abbb912a"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:13:48.022436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:13:48.027644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-629ab495-d6b4-4263-931b-5d83e00512df req-e5edb093-e43f-4361-a961-604a048ca647 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:48.028171 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-629ab495-d6b4-4263-931b-5d83e00512df req-e5edb093-e43f-4361-a961-604a048ca647 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:48.040515 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-629ab495-d6b4-4263-931b-5d83e00512df req-e5edb093-e43f-4361-a961-604a048ca647 service nova] Creating event network-vif-plugged:90137940-e45b-4dfe-930c-4e72abbb912a for instance 648edf97-aa44-4150-be59-f44788c5e6e1 on nch1-master-1 May 21 22:13:48.050530 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-629ab495-d6b4-4263-931b-5d83e00512df req-e5edb093-e43f-4361-a961-604a048ca647 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033077 May 21 22:13:48.050530 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3461/7046] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:13:48.183780 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9b06ba99-4141-44a0-a436-b59f7fcd4511 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:13:48.191797 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9b06ba99-4141-44a0-a436-b59f7fcd4511 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1393 microversion: 2.1 time: 0.218374 May 21 22:13:48.202119 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3586/7047] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:13:47 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1393 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:13:49.212170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eb7e0da4-4aa4-4fba-9169-b0718c0a569c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:49.212909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-eb7e0da4-4aa4-4fba-9169-b0718c0a569c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:49.219402 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb7e0da4-4aa4-4fba-9169-b0718c0a569c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:49.219856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb7e0da4-4aa4-4fba-9169-b0718c0a569c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:49.220715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb7e0da4-4aa4-4fba-9169-b0718c0a569c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:49.221158 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb7e0da4-4aa4-4fba-9169-b0718c0a569c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:49.376132 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-eb7e0da4-4aa4-4fba-9169-b0718c0a569c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:13:49.384322 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-eb7e0da4-4aa4-4fba-9169-b0718c0a569c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1393 microversion: 2.1 time: 0.178170 May 21 22:13:49.384901 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3462/7048] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:13:49 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1393 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:13:50.400665 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5ab5ee20-68d1-4c69-902d-448903d9e710 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:50.401292 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5ab5ee20-68d1-4c69-902d-448903d9e710 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:50.403490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=10 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:13:50.409584 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ab5ee20-68d1-4c69-902d-448903d9e710 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:50.414039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ab5ee20-68d1-4c69-902d-448903d9e710 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:50.414039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ab5ee20-68d1-4c69-902d-448903d9e710 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:50.414039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5ab5ee20-68d1-4c69-902d-448903d9e710 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:50.557878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5ab5ee20-68d1-4c69-902d-448903d9e710 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:13:50.567085 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5ab5ee20-68d1-4c69-902d-448903d9e710 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1565 microversion: 2.1 time: 0.170287 May 21 22:13:50.576924 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3587/7049] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:13:50 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:13:50.585322 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0b22e8f2-9787-46a7-a27c-e7e1fc081ba4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:50.585958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0b22e8f2-9787-46a7-a27c-e7e1fc081ba4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:50.593455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b22e8f2-9787-46a7-a27c-e7e1fc081ba4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:50.593915 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b22e8f2-9787-46a7-a27c-e7e1fc081ba4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:50.594715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b22e8f2-9787-46a7-a27c-e7e1fc081ba4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:50.595170 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0b22e8f2-9787-46a7-a27c-e7e1fc081ba4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:50.742241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0b22e8f2-9787-46a7-a27c-e7e1fc081ba4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:13:50.749892 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0b22e8f2-9787-46a7-a27c-e7e1fc081ba4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1565 microversion: 2.1 time: 0.169678 May 21 22:13:50.750470 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3463/7050] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:13:50 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:13:53.213538 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a780556b-6422-4650-93e0-1627c8ca2ff5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:13:53.214171 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a780556b-6422-4650-93e0-1627c8ca2ff5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:13:53.222647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-82458a73-63f4-4c3e-b3d5-b0f227181a9e req-7647c1a9-692e-4606-bad2-fcf47e3582ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "648edf97-aa44-4150-be59-f44788c5e6e1", "tag": "90137940-e45b-4dfe-930c-4e72abbb912a"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:13:53.232947 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a780556b-6422-4650-93e0-1627c8ca2ff5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:53.233131 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-82458a73-63f4-4c3e-b3d5-b0f227181a9e req-7647c1a9-692e-4606-bad2-fcf47e3582ea service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:53.233413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a780556b-6422-4650-93e0-1627c8ca2ff5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:53.233805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-82458a73-63f4-4c3e-b3d5-b0f227181a9e req-7647c1a9-692e-4606-bad2-fcf47e3582ea service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:53.234592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a780556b-6422-4650-93e0-1627c8ca2ff5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:13:53.235047 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a780556b-6422-4650-93e0-1627c8ca2ff5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:13:53.252039 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-82458a73-63f4-4c3e-b3d5-b0f227181a9e req-7647c1a9-692e-4606-bad2-fcf47e3582ea service nova] Creating event network-changed:90137940-e45b-4dfe-930c-4e72abbb912a for instance 648edf97-aa44-4150-be59-f44788c5e6e1 on nch1-master-1 May 21 22:13:53.256184 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-82458a73-63f4-4c3e-b3d5-b0f227181a9e req-7647c1a9-692e-4606-bad2-fcf47e3582ea service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037168 May 21 22:13:53.257216 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3464/7051] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:13:53.438976 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a780556b-6422-4650-93e0-1627c8ca2ff5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:13:53.448228 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a780556b-6422-4650-93e0-1627c8ca2ff5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1565 microversion: 2.1 time: 0.238705 May 21 22:13:53.449064 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3588/7052] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:13:53 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1565 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:14:13.791820 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=26 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:14:13.792626 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=42 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:14:13.796879 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-de9466f8-33f5-43e9-a48a-3c678d2be6d2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:14:13.797893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-de9466f8-33f5-43e9-a48a-3c678d2be6d2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:13.804107 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de9466f8-33f5-43e9-a48a-3c678d2be6d2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:13.807779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de9466f8-33f5-43e9-a48a-3c678d2be6d2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:13.807779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de9466f8-33f5-43e9-a48a-3c678d2be6d2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:13.807779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de9466f8-33f5-43e9-a48a-3c678d2be6d2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:13.855210 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-de9466f8-33f5-43e9-a48a-3c678d2be6d2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1/action" status: 200 len: 24572 microversion: 2.1 time: 0.065288 May 21 22:14:13.855878 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3465/7053] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:14:13 2022] POST /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1/action => generated 24572 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 22:14:24.922814 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ea18954a-ea6e-4de0-8bcc-82ea381b0409 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:14:24.923859 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ea18954a-ea6e-4de0-8bcc-82ea381b0409 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:24.926282 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=5 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:14:24.927070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=38 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:14:24.932551 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea18954a-ea6e-4de0-8bcc-82ea381b0409 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:24.933020 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea18954a-ea6e-4de0-8bcc-82ea381b0409 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:24.939015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea18954a-ea6e-4de0-8bcc-82ea381b0409 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:24.939015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ea18954a-ea6e-4de0-8bcc-82ea381b0409 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:24.975353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ea18954a-ea6e-4de0-8bcc-82ea381b0409 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:24.982731 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ea18954a-ea6e-4de0-8bcc-82ea381b0409 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Old instance type m1.heat2, new instance type m1.heat {{(pid=131277) resize /opt/stack/nova/nova/compute/api.py:4166}} May 21 22:14:24.989520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ea18954a-ea6e-4de0-8bcc-82ea381b0409 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:14:24.989954 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ea18954a-ea6e-4de0-8bcc-82ea381b0409 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:14:24.990449 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ea18954a-ea6e-4de0-8bcc-82ea381b0409 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:14:24.990876 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ea18954a-ea6e-4de0-8bcc-82ea381b0409 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:14:24.991297 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-ea18954a-ea6e-4de0-8bcc-82ea381b0409 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:14:25.221155 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ea18954a-ea6e-4de0-8bcc-82ea381b0409 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1/action" status: 202 len: 0 microversion: 2.1 time: 0.302242 May 21 22:14:25.225013 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3589/7054] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:14:24 2022] POST /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:14:25.231784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9124056d-44b5-48f6-91c1-471f2718e8f2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:25.232586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9124056d-44b5-48f6-91c1-471f2718e8f2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:25.235534 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:14:25.241504 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9124056d-44b5-48f6-91c1-471f2718e8f2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:25.241982 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9124056d-44b5-48f6-91c1-471f2718e8f2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:25.242780 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9124056d-44b5-48f6-91c1-471f2718e8f2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:25.243226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9124056d-44b5-48f6-91c1-471f2718e8f2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:25.398138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9124056d-44b5-48f6-91c1-471f2718e8f2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:25.406625 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9124056d-44b5-48f6-91c1-471f2718e8f2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1693 microversion: 2.1 time: 0.180399 May 21 22:14:25.407192 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3466/7055] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:25 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1693 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:14:26.425463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-87af65ac-aee0-453f-8349-ab93603a47dd tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:26.426106 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-87af65ac-aee0-453f-8349-ab93603a47dd tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:26.435883 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87af65ac-aee0-453f-8349-ab93603a47dd tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:26.436409 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87af65ac-aee0-453f-8349-ab93603a47dd tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:26.438404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87af65ac-aee0-453f-8349-ab93603a47dd tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:26.438880 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87af65ac-aee0-453f-8349-ab93603a47dd tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:26.597500 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-87af65ac-aee0-453f-8349-ab93603a47dd tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:26.605507 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-87af65ac-aee0-453f-8349-ab93603a47dd tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1693 microversion: 2.1 time: 0.185141 May 21 22:14:26.606085 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3590/7056] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:26 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1693 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:14:27.623591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b46b6426-6763-4f83-80fa-877faf0e0e2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:27.624237 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b46b6426-6763-4f83-80fa-877faf0e0e2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:27.631715 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b46b6426-6763-4f83-80fa-877faf0e0e2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:27.632173 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b46b6426-6763-4f83-80fa-877faf0e0e2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:27.633003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b46b6426-6763-4f83-80fa-877faf0e0e2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:27.634000 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b46b6426-6763-4f83-80fa-877faf0e0e2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:27.790369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b46b6426-6763-4f83-80fa-877faf0e0e2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:27.798342 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b46b6426-6763-4f83-80fa-877faf0e0e2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1693 microversion: 2.1 time: 0.178789 May 21 22:14:27.798913 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3467/7057] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:27 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:14:28.817189 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1d9ed0b7-4bee-4f0b-aa0c-0b826a9d9c2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:28.817818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1d9ed0b7-4bee-4f0b-aa0c-0b826a9d9c2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:28.825482 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d9ed0b7-4bee-4f0b-aa0c-0b826a9d9c2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:28.825961 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d9ed0b7-4bee-4f0b-aa0c-0b826a9d9c2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:28.826758 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d9ed0b7-4bee-4f0b-aa0c-0b826a9d9c2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:28.827223 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1d9ed0b7-4bee-4f0b-aa0c-0b826a9d9c2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:28.976563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1d9ed0b7-4bee-4f0b-aa0c-0b826a9d9c2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:28.984232 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1d9ed0b7-4bee-4f0b-aa0c-0b826a9d9c2e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1698 microversion: 2.1 time: 0.171196 May 21 22:14:28.984834 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3591/7058] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:28 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1698 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:14:30.002043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b176dc67-d195-4d0e-8346-50a257dbf071 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:30.002573 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b176dc67-d195-4d0e-8346-50a257dbf071 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:30.010361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b176dc67-d195-4d0e-8346-50a257dbf071 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:30.010813 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b176dc67-d195-4d0e-8346-50a257dbf071 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:30.011581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b176dc67-d195-4d0e-8346-50a257dbf071 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:30.012025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b176dc67-d195-4d0e-8346-50a257dbf071 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:30.158941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b176dc67-d195-4d0e-8346-50a257dbf071 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:30.167031 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b176dc67-d195-4d0e-8346-50a257dbf071 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1698 microversion: 2.1 time: 0.169012 May 21 22:14:30.167601 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3468/7059] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:29 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1698 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:14:31.184331 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7692e02f-e8b2-44b8-9a5a-72d56678c3d0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:31.184972 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7692e02f-e8b2-44b8-9a5a-72d56678c3d0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:31.192263 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7692e02f-e8b2-44b8-9a5a-72d56678c3d0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:31.192767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7692e02f-e8b2-44b8-9a5a-72d56678c3d0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:31.193563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7692e02f-e8b2-44b8-9a5a-72d56678c3d0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:31.194025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7692e02f-e8b2-44b8-9a5a-72d56678c3d0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:31.341830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7692e02f-e8b2-44b8-9a5a-72d56678c3d0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:31.349692 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7692e02f-e8b2-44b8-9a5a-72d56678c3d0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1698 microversion: 2.1 time: 0.170250 May 21 22:14:31.350272 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3592/7060] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:31 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1698 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:14:32.366832 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e8586953-5747-459c-9797-4f301be2b1ee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:32.367457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e8586953-5747-459c-9797-4f301be2b1ee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:32.374914 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e8586953-5747-459c-9797-4f301be2b1ee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:32.375370 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e8586953-5747-459c-9797-4f301be2b1ee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:32.376138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e8586953-5747-459c-9797-4f301be2b1ee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:32.376616 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e8586953-5747-459c-9797-4f301be2b1ee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:32.522888 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e8586953-5747-459c-9797-4f301be2b1ee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:32.531030 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e8586953-5747-459c-9797-4f301be2b1ee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1698 microversion: 2.1 time: 0.168242 May 21 22:14:32.531601 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3469/7061] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:32 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1698 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:14:33.548696 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9a612d86-b655-470d-a886-758e1d5604ce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:33.549371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9a612d86-b655-470d-a886-758e1d5604ce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:33.557076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a612d86-b655-470d-a886-758e1d5604ce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:33.557548 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a612d86-b655-470d-a886-758e1d5604ce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:33.558345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a612d86-b655-470d-a886-758e1d5604ce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:33.558807 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a612d86-b655-470d-a886-758e1d5604ce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:33.710703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9a612d86-b655-470d-a886-758e1d5604ce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:33.718589 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9a612d86-b655-470d-a886-758e1d5604ce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1698 microversion: 2.1 time: 0.173974 May 21 22:14:33.719204 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3593/7062] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:33 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1698 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:14:34.736464 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9a58f4b2-a7d3-4419-9ab7-b51b7ae0fcc3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:34.737086 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9a58f4b2-a7d3-4419-9ab7-b51b7ae0fcc3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:34.744784 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a58f4b2-a7d3-4419-9ab7-b51b7ae0fcc3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:34.745234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a58f4b2-a7d3-4419-9ab7-b51b7ae0fcc3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:34.746003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a58f4b2-a7d3-4419-9ab7-b51b7ae0fcc3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:34.746438 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9a58f4b2-a7d3-4419-9ab7-b51b7ae0fcc3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:34.893482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9a58f4b2-a7d3-4419-9ab7-b51b7ae0fcc3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:34.902071 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9a58f4b2-a7d3-4419-9ab7-b51b7ae0fcc3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1698 microversion: 2.1 time: 0.169590 May 21 22:14:34.902645 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3470/7063] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:34 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1698 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:14:35.919606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-81d4763b-da7d-48b7-a3a6-712c80f1f7d0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:35.920184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-81d4763b-da7d-48b7-a3a6-712c80f1f7d0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:35.927390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81d4763b-da7d-48b7-a3a6-712c80f1f7d0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:35.927857 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81d4763b-da7d-48b7-a3a6-712c80f1f7d0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:35.928708 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81d4763b-da7d-48b7-a3a6-712c80f1f7d0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:35.929163 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-81d4763b-da7d-48b7-a3a6-712c80f1f7d0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:36.080638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-81d4763b-da7d-48b7-a3a6-712c80f1f7d0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:36.088831 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-81d4763b-da7d-48b7-a3a6-712c80f1f7d0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1698 microversion: 2.1 time: 0.173270 May 21 22:14:36.089406 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3594/7064] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:35 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1698 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:14:37.105676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-856c3cf8-0bdd-42ea-8a43-fdc4875a932f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:37.106222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-856c3cf8-0bdd-42ea-8a43-fdc4875a932f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:37.113503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-856c3cf8-0bdd-42ea-8a43-fdc4875a932f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:37.113961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-856c3cf8-0bdd-42ea-8a43-fdc4875a932f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:37.114741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-856c3cf8-0bdd-42ea-8a43-fdc4875a932f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:37.115178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-856c3cf8-0bdd-42ea-8a43-fdc4875a932f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:37.267420 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-856c3cf8-0bdd-42ea-8a43-fdc4875a932f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:37.273299 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-856c3cf8-0bdd-42ea-8a43-fdc4875a932f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1698 microversion: 2.1 time: 0.171809 May 21 22:14:37.274414 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3471/7065] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:37 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1698 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:14:38.291271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-29b344dc-6ce9-40e7-a1a7-be9feb496245 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:38.291855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-29b344dc-6ce9-40e7-a1a7-be9feb496245 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:38.298905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29b344dc-6ce9-40e7-a1a7-be9feb496245 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:38.299374 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29b344dc-6ce9-40e7-a1a7-be9feb496245 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:38.300170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29b344dc-6ce9-40e7-a1a7-be9feb496245 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:38.300648 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29b344dc-6ce9-40e7-a1a7-be9feb496245 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:38.449195 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-29b344dc-6ce9-40e7-a1a7-be9feb496245 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:38.456927 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-29b344dc-6ce9-40e7-a1a7-be9feb496245 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1698 microversion: 2.1 time: 0.169899 May 21 22:14:38.457503 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3595/7066] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:38 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1698 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:14:39.474636 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ca960472-352f-43a9-8825-dfe5c4909360 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:39.475266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ca960472-352f-43a9-8825-dfe5c4909360 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:39.483051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca960472-352f-43a9-8825-dfe5c4909360 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:39.483508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca960472-352f-43a9-8825-dfe5c4909360 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:39.484302 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca960472-352f-43a9-8825-dfe5c4909360 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:39.484756 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ca960472-352f-43a9-8825-dfe5c4909360 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:39.645174 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ca960472-352f-43a9-8825-dfe5c4909360 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:39.653552 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ca960472-352f-43a9-8825-dfe5c4909360 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1698 microversion: 2.1 time: 0.182860 May 21 22:14:39.654133 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3472/7067] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:39 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1698 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:14:40.671626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-704501db-a164-4f36-b675-4d187348bd4b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:40.672224 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-704501db-a164-4f36-b675-4d187348bd4b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:40.684714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-704501db-a164-4f36-b675-4d187348bd4b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:40.685105 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-704501db-a164-4f36-b675-4d187348bd4b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:40.685942 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-704501db-a164-4f36-b675-4d187348bd4b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:40.686672 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-704501db-a164-4f36-b675-4d187348bd4b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:40.845325 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-704501db-a164-4f36-b675-4d187348bd4b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:40.854007 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-704501db-a164-4f36-b675-4d187348bd4b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1697 microversion: 2.1 time: 0.186325 May 21 22:14:40.854748 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3596/7068] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:40 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1697 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:14:41.486009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-7e95bdee-3c8a-4826-89da-9a5f94247a63 req-f03bc888-8625-4349-8c17-22ff1985925d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "648edf97-aa44-4150-be59-f44788c5e6e1", "name": "network-vif-unplugged", "status": "completed", "tag": "90137940-e45b-4dfe-930c-4e72abbb912a"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:14:41.494818 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-7e95bdee-3c8a-4826-89da-9a5f94247a63 req-f03bc888-8625-4349-8c17-22ff1985925d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:41.495281 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-7e95bdee-3c8a-4826-89da-9a5f94247a63 req-f03bc888-8625-4349-8c17-22ff1985925d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:41.507578 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-7e95bdee-3c8a-4826-89da-9a5f94247a63 req-f03bc888-8625-4349-8c17-22ff1985925d service nova] Creating event network-vif-unplugged:90137940-e45b-4dfe-930c-4e72abbb912a for instance 648edf97-aa44-4150-be59-f44788c5e6e1 on nch2-master-1 May 21 22:14:41.513725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [req-7e95bdee-3c8a-4826-89da-9a5f94247a63 req-f03bc888-8625-4349-8c17-22ff1985925d service nova] Instance 648edf97-aa44-4150-be59-f44788c5e6e1 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 22:14:41.525286 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-7e95bdee-3c8a-4826-89da-9a5f94247a63 req-f03bc888-8625-4349-8c17-22ff1985925d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108738 May 21 22:14:41.525910 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3473/7069] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:14:41.873069 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-55f2c03d-05e8-4b02-b756-352c3622df32 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:41.873823 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-55f2c03d-05e8-4b02-b756-352c3622df32 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:41.881097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-55f2c03d-05e8-4b02-b756-352c3622df32 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:41.881564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-55f2c03d-05e8-4b02-b756-352c3622df32 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:41.882360 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-55f2c03d-05e8-4b02-b756-352c3622df32 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:41.882814 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-55f2c03d-05e8-4b02-b756-352c3622df32 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:42.034568 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-55f2c03d-05e8-4b02-b756-352c3622df32 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:42.044116 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-55f2c03d-05e8-4b02-b756-352c3622df32 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1697 microversion: 2.1 time: 0.175652 May 21 22:14:42.045267 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3597/7070] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:41 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:14:43.063080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-644e3610-2d90-460c-bae3-3149f1ef35f4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:43.063806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-644e3610-2d90-460c-bae3-3149f1ef35f4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:43.070413 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-644e3610-2d90-460c-bae3-3149f1ef35f4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:43.070937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-644e3610-2d90-460c-bae3-3149f1ef35f4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:43.072388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-644e3610-2d90-460c-bae3-3149f1ef35f4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:43.072844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-644e3610-2d90-460c-bae3-3149f1ef35f4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:43.219678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-644e3610-2d90-460c-bae3-3149f1ef35f4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:43.228314 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-644e3610-2d90-460c-bae3-3149f1ef35f4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1695 microversion: 2.1 time: 0.170355 May 21 22:14:43.228884 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3474/7071] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:43 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:14:43.543606 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-dcf34c66-e245-4aad-a8b4-a08df8aa43ce req-2d7dc2db-596d-4b5a-a9aa-48a3ffc6c7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "648edf97-aa44-4150-be59-f44788c5e6e1", "tag": "90137940-e45b-4dfe-930c-4e72abbb912a"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:14:43.552544 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-dcf34c66-e245-4aad-a8b4-a08df8aa43ce req-2d7dc2db-596d-4b5a-a9aa-48a3ffc6c7a8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:43.553018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-dcf34c66-e245-4aad-a8b4-a08df8aa43ce req-2d7dc2db-596d-4b5a-a9aa-48a3ffc6c7a8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:43.564719 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-dcf34c66-e245-4aad-a8b4-a08df8aa43ce req-2d7dc2db-596d-4b5a-a9aa-48a3ffc6c7a8 service nova] Creating event network-changed:90137940-e45b-4dfe-930c-4e72abbb912a for instance 648edf97-aa44-4150-be59-f44788c5e6e1 on nch2-master-1 May 21 22:14:43.570088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [req-dcf34c66-e245-4aad-a8b4-a08df8aa43ce req-2d7dc2db-596d-4b5a-a9aa-48a3ffc6c7a8 service nova] Instance 648edf97-aa44-4150-be59-f44788c5e6e1 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 21 22:14:43.581849 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-dcf34c66-e245-4aad-a8b4-a08df8aa43ce req-2d7dc2db-596d-4b5a-a9aa-48a3ffc6c7a8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042437 May 21 22:14:43.582438 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3598/7072] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:14:44.249441 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-28d10a40-c233-4115-8a2a-4ab149006ccc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:44.251519 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-28d10a40-c233-4115-8a2a-4ab149006ccc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:44.259696 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28d10a40-c233-4115-8a2a-4ab149006ccc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:44.260544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28d10a40-c233-4115-8a2a-4ab149006ccc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:44.261704 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28d10a40-c233-4115-8a2a-4ab149006ccc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:44.262983 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-28d10a40-c233-4115-8a2a-4ab149006ccc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:44.497658 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-28d10a40-c233-4115-8a2a-4ab149006ccc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:44.505686 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-28d10a40-c233-4115-8a2a-4ab149006ccc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1695 microversion: 2.1 time: 0.261657 May 21 22:14:44.506205 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3475/7073] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:44 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1695 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:14:45.525247 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-83866800-d3f5-4e69-a3c4-cdda8f17ef3e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:45.525932 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-83866800-d3f5-4e69-a3c4-cdda8f17ef3e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:45.532341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-83866800-d3f5-4e69-a3c4-cdda8f17ef3e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:45.532820 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-83866800-d3f5-4e69-a3c4-cdda8f17ef3e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:45.533620 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-83866800-d3f5-4e69-a3c4-cdda8f17ef3e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:45.534083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-83866800-d3f5-4e69-a3c4-cdda8f17ef3e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:45.688144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-83866800-d3f5-4e69-a3c4-cdda8f17ef3e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:45.696721 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-83866800-d3f5-4e69-a3c4-cdda8f17ef3e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1692 microversion: 2.1 time: 0.176655 May 21 22:14:45.702348 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3599/7074] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:45 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:14:45.714394 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d3a6a4ea-7f29-4bc1-9e6d-c2e42f4ea75b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:14:45.714951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d3a6a4ea-7f29-4bc1-9e6d-c2e42f4ea75b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:45.722042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3a6a4ea-7f29-4bc1-9e6d-c2e42f4ea75b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:45.722508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3a6a4ea-7f29-4bc1-9e6d-c2e42f4ea75b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:45.723296 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3a6a4ea-7f29-4bc1-9e6d-c2e42f4ea75b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:45.723749 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d3a6a4ea-7f29-4bc1-9e6d-c2e42f4ea75b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:45.945617 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d3a6a4ea-7f29-4bc1-9e6d-c2e42f4ea75b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1/action" status: 204 len: 0 microversion: 2.1 time: 0.235921 May 21 22:14:45.946872 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3476/7075] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:14:45 2022] POST /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1/action => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:14:45.955826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1cc1008f-417f-406b-9bd2-7fbe6f795d2f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:45.956508 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1cc1008f-417f-406b-9bd2-7fbe6f795d2f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:45.964074 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1cc1008f-417f-406b-9bd2-7fbe6f795d2f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:45.964594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1cc1008f-417f-406b-9bd2-7fbe6f795d2f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:45.965404 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1cc1008f-417f-406b-9bd2-7fbe6f795d2f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:45.965865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1cc1008f-417f-406b-9bd2-7fbe6f795d2f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:46.167975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1cc1008f-417f-406b-9bd2-7fbe6f795d2f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:46.176440 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1cc1008f-417f-406b-9bd2-7fbe6f795d2f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1692 microversion: 2.1 time: 0.224620 May 21 22:14:46.177339 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3600/7076] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:45 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1692 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:14:46.194040 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1fbfed12-184c-4ef1-91da-f2323e3f57ce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:46.194752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1fbfed12-184c-4ef1-91da-f2323e3f57ce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:46.201657 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1fbfed12-184c-4ef1-91da-f2323e3f57ce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:46.202046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1fbfed12-184c-4ef1-91da-f2323e3f57ce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:46.202824 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1fbfed12-184c-4ef1-91da-f2323e3f57ce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:46.203263 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1fbfed12-184c-4ef1-91da-f2323e3f57ce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:46.369303 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1fbfed12-184c-4ef1-91da-f2323e3f57ce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:46.377867 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1fbfed12-184c-4ef1-91da-f2323e3f57ce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1692 microversion: 2.1 time: 0.188110 May 21 22:14:46.378768 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3477/7077] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:46 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1692 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:14:47.396343 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0262e4f0-66ea-4e31-ba9a-fc0cbb49264b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:47.396988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0262e4f0-66ea-4e31-ba9a-fc0cbb49264b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:47.404794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0262e4f0-66ea-4e31-ba9a-fc0cbb49264b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:47.405264 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0262e4f0-66ea-4e31-ba9a-fc0cbb49264b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:47.406089 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0262e4f0-66ea-4e31-ba9a-fc0cbb49264b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:47.406554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0262e4f0-66ea-4e31-ba9a-fc0cbb49264b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:47.562321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0262e4f0-66ea-4e31-ba9a-fc0cbb49264b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:47.569979 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0262e4f0-66ea-4e31-ba9a-fc0cbb49264b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1692 microversion: 2.1 time: 0.177570 May 21 22:14:47.570561 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3601/7078] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:47 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:14:48.490642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-51182f81-1143-492c-b106-7846a83ad7d9 req-b5b9c378-499f-4c5a-b24d-aeb1d11cc722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "648edf97-aa44-4150-be59-f44788c5e6e1", "name": "network-vif-plugged", "status": "completed", "tag": "90137940-e45b-4dfe-930c-4e72abbb912a"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:14:48.496309 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-51182f81-1143-492c-b106-7846a83ad7d9 req-b5b9c378-499f-4c5a-b24d-aeb1d11cc722 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:48.496782 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-51182f81-1143-492c-b106-7846a83ad7d9 req-b5b9c378-499f-4c5a-b24d-aeb1d11cc722 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:48.507896 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-51182f81-1143-492c-b106-7846a83ad7d9 req-b5b9c378-499f-4c5a-b24d-aeb1d11cc722 service nova] Creating event network-vif-plugged:90137940-e45b-4dfe-930c-4e72abbb912a for instance 648edf97-aa44-4150-be59-f44788c5e6e1 on nch2-master-1 May 21 22:14:48.513931 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-51182f81-1143-492c-b106-7846a83ad7d9 req-b5b9c378-499f-4c5a-b24d-aeb1d11cc722 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030985 May 21 22:14:48.517915 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3478/7079] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:14:48.587837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8546cec0-3bf1-42b3-aa2c-8b4a8b8d0476 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:14:48.588594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8546cec0-3bf1-42b3-aa2c-8b4a8b8d0476 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:14:48.596443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8546cec0-3bf1-42b3-aa2c-8b4a8b8d0476 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:48.596916 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8546cec0-3bf1-42b3-aa2c-8b4a8b8d0476 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:48.597712 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8546cec0-3bf1-42b3-aa2c-8b4a8b8d0476 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:14:48.598167 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8546cec0-3bf1-42b3-aa2c-8b4a8b8d0476 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:14:48.744200 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8546cec0-3bf1-42b3-aa2c-8b4a8b8d0476 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:14:48.752068 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8546cec0-3bf1-42b3-aa2c-8b4a8b8d0476 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1684 microversion: 2.1 time: 0.168280 May 21 22:14:48.752704 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3602/7080] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:14:48 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:15:08.939333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=26 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:15:08.940098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:15:08.944414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a42794fa-d46d-4c85-a4f0-7509463413dc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:15:08.945436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a42794fa-d46d-4c85-a4f0-7509463413dc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:15:08.952641 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a42794fa-d46d-4c85-a4f0-7509463413dc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:08.953365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a42794fa-d46d-4c85-a4f0-7509463413dc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:08.954193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a42794fa-d46d-4c85-a4f0-7509463413dc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:08.954648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a42794fa-d46d-4c85-a4f0-7509463413dc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:09.007744 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a42794fa-d46d-4c85-a4f0-7509463413dc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1/action" status: 200 len: 24568 microversion: 2.1 time: 0.071028 May 21 22:15:09.008721 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3479/7081] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:15:08 2022] POST /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1/action => generated 24568 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 22:15:16.691629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3d0dd9b7-9032-42fe-8c8a-d24ed620c91f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:15:16.692527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3d0dd9b7-9032-42fe-8c8a-d24ed620c91f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:15:16.694768 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=32 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:15:16.695915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:15:16.701284 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d0dd9b7-9032-42fe-8c8a-d24ed620c91f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:16.708788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d0dd9b7-9032-42fe-8c8a-d24ed620c91f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:16.708788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d0dd9b7-9032-42fe-8c8a-d24ed620c91f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:16.708788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3d0dd9b7-9032-42fe-8c8a-d24ed620c91f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:16.732463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3d0dd9b7-9032-42fe-8c8a-d24ed620c91f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 22:15:16.766608 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-40a10f2b-b46b-4017-ab27-b668878fe573 req-3e54e264-1c75-4e6b-ae2d-fa4e3a6c1759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "648edf97-aa44-4150-be59-f44788c5e6e1", "tag": "90137940-e45b-4dfe-930c-4e72abbb912a"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:15:16.777380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-40a10f2b-b46b-4017-ab27-b668878fe573 req-3e54e264-1c75-4e6b-ae2d-fa4e3a6c1759 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:16.778060 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-40a10f2b-b46b-4017-ab27-b668878fe573 req-3e54e264-1c75-4e6b-ae2d-fa4e3a6c1759 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:16.790365 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-40a10f2b-b46b-4017-ab27-b668878fe573 req-3e54e264-1c75-4e6b-ae2d-fa4e3a6c1759 service nova] Creating event network-changed:90137940-e45b-4dfe-930c-4e72abbb912a for instance 648edf97-aa44-4150-be59-f44788c5e6e1 on nch2-master-1 May 21 22:15:16.796167 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-40a10f2b-b46b-4017-ab27-b668878fe573 req-3e54e264-1c75-4e6b-ae2d-fa4e3a6c1759 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105883 May 21 22:15:16.797141 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3480/7082] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:15:17.040905 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3d0dd9b7-9032-42fe-8c8a-d24ed620c91f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "DELETE /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 204 len: 0 microversion: 2.1 time: 0.353130 May 21 22:15:17.041553 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3603/7083] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:15:16 2022] DELETE /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:15:17.051613 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e102fc26-c8da-492b-b8d5-fdad0dbcf4b5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:15:17.052372 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e102fc26-c8da-492b-b8d5-fdad0dbcf4b5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:15:17.059010 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e102fc26-c8da-492b-b8d5-fdad0dbcf4b5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:17.059476 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e102fc26-c8da-492b-b8d5-fdad0dbcf4b5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:17.060318 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e102fc26-c8da-492b-b8d5-fdad0dbcf4b5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:17.060958 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e102fc26-c8da-492b-b8d5-fdad0dbcf4b5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:17.208862 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e102fc26-c8da-492b-b8d5-fdad0dbcf4b5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:15:17.217001 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e102fc26-c8da-492b-b8d5-fdad0dbcf4b5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1690 microversion: 2.1 time: 0.170710 May 21 22:15:17.218091 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3481/7084] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:15:17 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:15:18.236502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8675a846-0df0-4b09-a8bf-660456f09843 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:15:18.237221 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8675a846-0df0-4b09-a8bf-660456f09843 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:15:18.244357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8675a846-0df0-4b09-a8bf-660456f09843 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:18.244826 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8675a846-0df0-4b09-a8bf-660456f09843 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:18.245609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8675a846-0df0-4b09-a8bf-660456f09843 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:18.246099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8675a846-0df0-4b09-a8bf-660456f09843 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:18.395079 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8675a846-0df0-4b09-a8bf-660456f09843 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:15:18.402889 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8675a846-0df0-4b09-a8bf-660456f09843 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1690 microversion: 2.1 time: 0.171251 May 21 22:15:18.406433 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3604/7085] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:15:18 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:15:19.326087 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-885f6f0f-50de-4164-9a14-d8e60aab3685 req-801d0c41-782a-4ffb-8259-4cf959e35e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "648edf97-aa44-4150-be59-f44788c5e6e1", "name": "network-vif-deleted", "tag": "90137940-e45b-4dfe-930c-4e72abbb912a"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:15:19.335388 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-885f6f0f-50de-4164-9a14-d8e60aab3685 req-801d0c41-782a-4ffb-8259-4cf959e35e2d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:19.335839 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-885f6f0f-50de-4164-9a14-d8e60aab3685 req-801d0c41-782a-4ffb-8259-4cf959e35e2d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:19.347572 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-885f6f0f-50de-4164-9a14-d8e60aab3685 req-801d0c41-782a-4ffb-8259-4cf959e35e2d service nova] Creating event network-vif-deleted:90137940-e45b-4dfe-930c-4e72abbb912a for instance 648edf97-aa44-4150-be59-f44788c5e6e1 on nch2-master-1 May 21 22:15:19.352676 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-885f6f0f-50de-4164-9a14-d8e60aab3685 req-801d0c41-782a-4ffb-8259-4cf959e35e2d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030510 May 21 22:15:19.353323 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3482/7086] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:15:19.420323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-121c5de7-24eb-4c4e-9a98-80a2197a0aca tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:15:19.421008 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-121c5de7-24eb-4c4e-9a98-80a2197a0aca tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:15:19.428064 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-121c5de7-24eb-4c4e-9a98-80a2197a0aca tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:19.431198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-121c5de7-24eb-4c4e-9a98-80a2197a0aca tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:19.431198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-121c5de7-24eb-4c4e-9a98-80a2197a0aca tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:19.431198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-121c5de7-24eb-4c4e-9a98-80a2197a0aca tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:19.504663 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-121c5de7-24eb-4c4e-9a98-80a2197a0aca tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:15:19.512760 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-121c5de7-24eb-4c4e-9a98-80a2197a0aca tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 200 len: 1503 microversion: 2.1 time: 0.096444 May 21 22:15:19.513351 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3605/7087] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:15:19 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 1503 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:15:20.533744 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-99549544-b064-4393-a5e4-2d688729ef6e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:15:20.534460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-99549544-b064-4393-a5e4-2d688729ef6e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 648edf97-aa44-4150-be59-f44788c5e6e1] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:15:20.540948 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99549544-b064-4393-a5e4-2d688729ef6e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:20.541414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99549544-b064-4393-a5e4-2d688729ef6e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:20.542193 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99549544-b064-4393-a5e4-2d688729ef6e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:20.542640 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-99549544-b064-4393-a5e4-2d688729ef6e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:20.556841 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-99549544-b064-4393-a5e4-2d688729ef6e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] HTTP exception thrown: Instance 648edf97-aa44-4150-be59-f44788c5e6e1 could not be found. May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-99549544-b064-4393-a5e4-2d688729ef6e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Request method failure captured: May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 HTTP/1.1 May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWNUii8Zq6WOyAgXHmbJ3sC5wa94C74ELxknXQJ_SM32Jav6JyvMpyYMVSFhYJ3s1YN1udNzGY1HshTj3s7GT-R1gCzdtKT1r559qWDXMdRUrYXCdFe0fnjc0pP6_57YeQK7_51zGtHqPFGJn1yY7YonKAJ0n7bgpG0NA9tWLAWZZZY May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 10c1d1acf8134ddab4e11e933dbeb571 May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-351207300 May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/10c1d1acf8134ddab4e11e933dbeb571"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10c1d1acf8134ddab4e11e933dbeb571"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_10c1d1acf8134ddab4e11e933dbeb571", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10c1d1acf8134ddab4e11e933dbeb571"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestNetworkAdvancedServerOps-351207300 May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 10c1d1acf8134ddab4e11e933dbeb571 May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-351207300 May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestNetworkAdvancedServerOps-351207300-project May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c726d5d196d64ef3a2470ebc855b00f0 May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestNetworkAdvancedServerOps-351207300-project May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 648edf97-aa44-4150-be59-f44788c5e6e1 could not be found. May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '648edf97-aa44-4150-be59-f44788c5e6e1'} May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 648edf97-aa44-4150-be59-f44788c5e6e1 could not be found. May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 648edf97-aa44-4150-be59-f44788c5e6e1 could not be found. May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:15:20.558482 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:15:20.563858 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:15:20.563858 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:15:20.563858 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:15:20.563858 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:15:20.563858 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:15:20.563858 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 648edf97-aa44-4150-be59-f44788c5e6e1 could not be found. May 21 22:15:20.563858 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:15:20.563858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-99549544-b064-4393-a5e4-2d688729ef6e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Returning 404 to user: Instance 648edf97-aa44-4150-be59-f44788c5e6e1 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:15:20.563858 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-99549544-b064-4393-a5e4-2d688729ef6e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1" status: 404 len: 111 microversion: 2.1 time: 0.031888 May 21 22:15:20.563858 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3483/7088] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:15:20 2022] GET /compute/v2.1/servers/648edf97-aa44-4150-be59-f44788c5e6e1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:15:24.551836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f8a1d4c5-2171-4d29-a6a0-8bdfeae4bd5d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '.version_select at 0x7fc81a59cdc0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:15:24.627932 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f8a1d4c5-2171-4d29-a6a0-8bdfeae4bd5d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1499160801" status: 202 len: 0 microversion: 2.1 time: 0.080056 May 21 22:15:24.628577 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3606/7089] 10.222.0.49 () {58 vars in 1283 bytes} [Sat May 21 22:15:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1499160801 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:15:24.658403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4f48428a-4bb9-4500-8448-05e083b77c26 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'create', calling method: .version_select at 0x7fc819ed2040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1251237519", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP78ekK3ZOAs+enuwlWw1KtdLkuQixeJoZVFMbyH7oKAwGgDi64MOQB47LOE0i/C7/wJD9qCr6aP4Pf1gRMzn8nEX1A8aNBStMbN7UvP3LxvYB0sh+Rhy7A66PYY/uRPSg=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:15:24.673858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-4f48428a-4bb9-4500-8448-05e083b77c26 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Getting quotas for project 10c1d1acf8134ddab4e11e933dbeb571. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:15:24.680373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-4f48428a-4bb9-4500-8448-05e083b77c26 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Getting quotas for user c726d5d196d64ef3a2470ebc855b00f0 and project 10c1d1acf8134ddab4e11e933dbeb571. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:15:24.788212 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4f48428a-4bb9-4500-8448-05e083b77c26 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.134701 May 21 22:15:24.788851 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3484/7090] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 22:15:24 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:15:33.980817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7eb747e8-10f0-4abf-99af-73b79fc9add4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1589542063", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "1e7bba7d-b75b-4344-bfe5-a610ad19090f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1251237519", "security_groups": [{"name": "tempest-secgroup-smoke-57850228"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:15:33.991215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:15:34.136173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-7eb747e8-10f0-4abf-99af-73b79fc9add4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] validate_networks() for [('1e7bba7d-b75b-4344-bfe5-a610ad19090f', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 22:15:34.621876 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-7eb747e8-10f0-4abf-99af-73b79fc9add4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:15:34.622323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-7eb747e8-10f0-4abf-99af-73b79fc9add4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:15:34.622959 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-7eb747e8-10f0-4abf-99af-73b79fc9add4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:15:34.623396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-7eb747e8-10f0-4abf-99af-73b79fc9add4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:15:34.623833 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-7eb747e8-10f0-4abf-99af-73b79fc9add4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:15:34.633626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7eb747e8-10f0-4abf-99af-73b79fc9add4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:34.634097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7eb747e8-10f0-4abf-99af-73b79fc9add4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:34.635433 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7eb747e8-10f0-4abf-99af-73b79fc9add4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:34.635554 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7eb747e8-10f0-4abf-99af-73b79fc9add4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:34.659216 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-7eb747e8-10f0-4abf-99af-73b79fc9add4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Getting quotas for project 10c1d1acf8134ddab4e11e933dbeb571. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:15:34.665406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-7eb747e8-10f0-4abf-99af-73b79fc9add4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Getting quotas for user c726d5d196d64ef3a2470ebc855b00f0 and project 10c1d1acf8134ddab4e11e933dbeb571. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:15:34.679604 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7eb747e8-10f0-4abf-99af-73b79fc9add4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 22:15:34.682019 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7eb747e8-10f0-4abf-99af-73b79fc9add4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 22:15:34.774602 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7eb747e8-10f0-4abf-99af-73b79fc9add4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.797874 May 21 22:15:34.780469 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3607/7091] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 22:15:33 2022] POST /compute/v2.1/servers => generated 404 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 22:15:34.790659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0977efcd-ad08-4729-aff5-6cbc4b50f891 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:15:34.790659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0977efcd-ad08-4729-aff5-6cbc4b50f891 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:15:34.790659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=16 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:15:34.790659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=4 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:15:34.790659 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:15:34.858154 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0977efcd-ad08-4729-aff5-6cbc4b50f891 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:15:34.870765 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0977efcd-ad08-4729-aff5-6cbc4b50f891 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1267 microversion: 2.1 time: 0.088876 May 21 22:15:34.882634 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3485/7092] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:15:34 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:15:35.893377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-84459689-06ac-43e7-ab87-f45595ead956 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:15:35.893377 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-84459689-06ac-43e7-ab87-f45595ead956 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:15:35.904927 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84459689-06ac-43e7-ab87-f45595ead956 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:35.906300 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84459689-06ac-43e7-ab87-f45595ead956 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:35.907589 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84459689-06ac-43e7-ab87-f45595ead956 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:35.908046 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-84459689-06ac-43e7-ab87-f45595ead956 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:35.986990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-84459689-06ac-43e7-ab87-f45595ead956 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:15:35.991498 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-84459689-06ac-43e7-ab87-f45595ead956 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1271 microversion: 2.1 time: 0.104945 May 21 22:15:36.001035 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3608/7093] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:15:35 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1271 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:15:37.010145 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4ecd25c1-75de-4be3-a959-52fb5bd55b41 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:15:37.010691 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4ecd25c1-75de-4be3-a959-52fb5bd55b41 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:15:37.022191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4ecd25c1-75de-4be3-a959-52fb5bd55b41 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:37.022665 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4ecd25c1-75de-4be3-a959-52fb5bd55b41 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:37.023459 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4ecd25c1-75de-4be3-a959-52fb5bd55b41 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:37.023936 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4ecd25c1-75de-4be3-a959-52fb5bd55b41 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:37.103489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4ecd25c1-75de-4be3-a959-52fb5bd55b41 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:15:37.111037 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4ecd25c1-75de-4be3-a959-52fb5bd55b41 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1327 microversion: 2.1 time: 0.105866 May 21 22:15:37.111644 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3486/7094] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:15:37 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:15:38.128322 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-95bf2b73-6e1a-4e46-a46e-6fc11307dbef tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:15:38.128964 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-95bf2b73-6e1a-4e46-a46e-6fc11307dbef tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:15:38.136070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-95bf2b73-6e1a-4e46-a46e-6fc11307dbef tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:38.136577 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-95bf2b73-6e1a-4e46-a46e-6fc11307dbef tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:38.137391 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-95bf2b73-6e1a-4e46-a46e-6fc11307dbef tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:38.137841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-95bf2b73-6e1a-4e46-a46e-6fc11307dbef tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:38.294389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-95bf2b73-6e1a-4e46-a46e-6fc11307dbef tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:15:38.302727 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-95bf2b73-6e1a-4e46-a46e-6fc11307dbef tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1391 microversion: 2.1 time: 0.178410 May 21 22:15:38.303295 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3609/7095] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:15:38 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1391 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:15:39.008705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-b4f36e5b-1027-4637-b75f-6c6b78ce1f4f req-b1ccd63e-c9e4-4d1b-89cf-54d1b4bb88ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50547fc3-4ed2-44bf-bae3-cdf757b7d65e", "tag": "b227673d-5ca6-4383-962b-179b0b291140"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:15:39.020794 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b4f36e5b-1027-4637-b75f-6c6b78ce1f4f req-b1ccd63e-c9e4-4d1b-89cf-54d1b4bb88ff service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:39.021247 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-b4f36e5b-1027-4637-b75f-6c6b78ce1f4f req-b1ccd63e-c9e4-4d1b-89cf-54d1b4bb88ff service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:39.035577 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-b4f36e5b-1027-4637-b75f-6c6b78ce1f4f req-b1ccd63e-c9e4-4d1b-89cf-54d1b4bb88ff service nova] Creating event network-changed:b227673d-5ca6-4383-962b-179b0b291140 for instance 50547fc3-4ed2-44bf-bae3-cdf757b7d65e on nch2-master-1 May 21 22:15:39.041000 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-b4f36e5b-1027-4637-b75f-6c6b78ce1f4f req-b1ccd63e-c9e4-4d1b-89cf-54d1b4bb88ff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039761 May 21 22:15:39.041617 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3487/7096] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:15:39.319313 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-21104959-2a7c-4184-bd03-fb475884ad37 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:15:39.319975 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-21104959-2a7c-4184-bd03-fb475884ad37 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:15:39.327982 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21104959-2a7c-4184-bd03-fb475884ad37 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:39.328478 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21104959-2a7c-4184-bd03-fb475884ad37 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:39.329292 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21104959-2a7c-4184-bd03-fb475884ad37 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:39.329744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-21104959-2a7c-4184-bd03-fb475884ad37 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:39.485605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-21104959-2a7c-4184-bd03-fb475884ad37 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:15:39.493775 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-21104959-2a7c-4184-bd03-fb475884ad37 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1391 microversion: 2.1 time: 0.178557 May 21 22:15:39.494410 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3610/7097] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:15:39 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1391 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:15:40.511451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c3189a33-ab80-4806-abf3-421dc4057ca3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:15:40.512119 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c3189a33-ab80-4806-abf3-421dc4057ca3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:15:40.519589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3189a33-ab80-4806-abf3-421dc4057ca3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:40.520043 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3189a33-ab80-4806-abf3-421dc4057ca3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:40.520874 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3189a33-ab80-4806-abf3-421dc4057ca3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:40.521315 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c3189a33-ab80-4806-abf3-421dc4057ca3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:40.670317 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c3189a33-ab80-4806-abf3-421dc4057ca3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:15:40.678739 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c3189a33-ab80-4806-abf3-421dc4057ca3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1391 microversion: 2.1 time: 0.171635 May 21 22:15:40.679334 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3488/7098] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:15:40 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:15:41.696041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-29610598-7b8c-4463-89d1-81678046b583 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:15:41.698821 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-29610598-7b8c-4463-89d1-81678046b583 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:15:41.704272 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29610598-7b8c-4463-89d1-81678046b583 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:41.704736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29610598-7b8c-4463-89d1-81678046b583 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:41.706097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29610598-7b8c-4463-89d1-81678046b583 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:41.706564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-29610598-7b8c-4463-89d1-81678046b583 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:41.855245 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-29610598-7b8c-4463-89d1-81678046b583 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:15:41.863587 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-29610598-7b8c-4463-89d1-81678046b583 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1391 microversion: 2.1 time: 0.171462 May 21 22:15:41.864188 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3611/7099] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:15:41 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:15:42.880649 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-9ecad87d-2723-4cb3-991a-7405b0c0e790 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:15:42.881354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-9ecad87d-2723-4cb3-991a-7405b0c0e790 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:15:42.888623 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ecad87d-2723-4cb3-991a-7405b0c0e790 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:42.889084 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ecad87d-2723-4cb3-991a-7405b0c0e790 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:42.889877 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ecad87d-2723-4cb3-991a-7405b0c0e790 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:42.890357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-9ecad87d-2723-4cb3-991a-7405b0c0e790 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:43.045545 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-9ecad87d-2723-4cb3-991a-7405b0c0e790 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:15:43.054241 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-9ecad87d-2723-4cb3-991a-7405b0c0e790 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1391 microversion: 2.1 time: 0.177968 May 21 22:15:43.054828 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3489/7100] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:15:42 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:15:44.071336 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0ab34935-689d-4312-a669-4e2a8e2aecce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:15:44.071917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0ab34935-689d-4312-a669-4e2a8e2aecce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:15:44.079358 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ab34935-689d-4312-a669-4e2a8e2aecce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:44.079829 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ab34935-689d-4312-a669-4e2a8e2aecce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:44.080687 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ab34935-689d-4312-a669-4e2a8e2aecce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:44.081146 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0ab34935-689d-4312-a669-4e2a8e2aecce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:44.243794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0ab34935-689d-4312-a669-4e2a8e2aecce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:15:44.251587 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0ab34935-689d-4312-a669-4e2a8e2aecce tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1391 microversion: 2.1 time: 0.184419 May 21 22:15:44.252181 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3612/7101] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:15:44 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1391 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:15:44.789093 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-f34317c9-c28d-40ba-a695-a3470f43ef14 req-449ff603-50bd-40ba-a71a-89648b59fb51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50547fc3-4ed2-44bf-bae3-cdf757b7d65e", "name": "network-vif-plugged", "status": "completed", "tag": "b227673d-5ca6-4383-962b-179b0b291140"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:15:44.798112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f34317c9-c28d-40ba-a695-a3470f43ef14 req-449ff603-50bd-40ba-a71a-89648b59fb51 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:44.798574 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f34317c9-c28d-40ba-a695-a3470f43ef14 req-449ff603-50bd-40ba-a71a-89648b59fb51 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:44.810840 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-f34317c9-c28d-40ba-a695-a3470f43ef14 req-449ff603-50bd-40ba-a71a-89648b59fb51 service nova] Creating event network-vif-plugged:b227673d-5ca6-4383-962b-179b0b291140 for instance 50547fc3-4ed2-44bf-bae3-cdf757b7d65e on nch2-master-1 May 21 22:15:44.817117 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-f34317c9-c28d-40ba-a695-a3470f43ef14 req-449ff603-50bd-40ba-a71a-89648b59fb51 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031287 May 21 22:15:44.817390 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3490/7102] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:15:45.269467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-424219a7-1d3e-490a-aa9e-3a1b52604546 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:15:45.270112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-424219a7-1d3e-490a-aa9e-3a1b52604546 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:15:45.272065 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:15:45.272778 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:15:45.278605 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-424219a7-1d3e-490a-aa9e-3a1b52604546 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:45.281303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-424219a7-1d3e-490a-aa9e-3a1b52604546 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:45.281303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-424219a7-1d3e-490a-aa9e-3a1b52604546 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:45.281303 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-424219a7-1d3e-490a-aa9e-3a1b52604546 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:45.432582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-424219a7-1d3e-490a-aa9e-3a1b52604546 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:15:45.440183 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-424219a7-1d3e-490a-aa9e-3a1b52604546 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1391 microversion: 2.1 time: 0.174791 May 21 22:15:45.442387 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3613/7103] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:15:45 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:15:46.459448 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-47d8564c-e4d8-43e2-be46-6faa1245d223 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:15:46.460105 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-47d8564c-e4d8-43e2-be46-6faa1245d223 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:15:46.466518 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-47d8564c-e4d8-43e2-be46-6faa1245d223 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:46.466968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-47d8564c-e4d8-43e2-be46-6faa1245d223 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:46.467739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-47d8564c-e4d8-43e2-be46-6faa1245d223 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:46.468183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-47d8564c-e4d8-43e2-be46-6faa1245d223 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:46.621344 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-47d8564c-e4d8-43e2-be46-6faa1245d223 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:15:46.629366 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-47d8564c-e4d8-43e2-be46-6faa1245d223 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1563 microversion: 2.1 time: 0.175200 May 21 22:15:46.629947 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3491/7104] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:15:46 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1563 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:15:46.645744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-96bba5f9-220c-4a65-b503-0582e6762cc8 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:15:46.646375 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-96bba5f9-220c-4a65-b503-0582e6762cc8 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:15:46.653441 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96bba5f9-220c-4a65-b503-0582e6762cc8 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:46.657710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96bba5f9-220c-4a65-b503-0582e6762cc8 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:46.657710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96bba5f9-220c-4a65-b503-0582e6762cc8 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:46.657710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-96bba5f9-220c-4a65-b503-0582e6762cc8 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:46.819323 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-96bba5f9-220c-4a65-b503-0582e6762cc8 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:15:46.827529 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-96bba5f9-220c-4a65-b503-0582e6762cc8 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1563 microversion: 2.1 time: 0.185806 May 21 22:15:46.828211 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3614/7105] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:15:46 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1563 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:15:49.073992 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-81754b0d-c705-46c7-a969-50f4f215dbc4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:15:49.075038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-81754b0d-c705-46c7-a969-50f4f215dbc4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:15:49.076348 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-5bf8b375-e757-4e98-9e5c-363bce286af1 req-d7d7e20a-aa71-4574-8099-860f203ccc50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50547fc3-4ed2-44bf-bae3-cdf757b7d65e", "tag": "b227673d-5ca6-4383-962b-179b0b291140"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:15:49.078400 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:15:49.083040 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:15:49.083547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81754b0d-c705-46c7-a969-50f4f215dbc4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:49.084217 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81754b0d-c705-46c7-a969-50f4f215dbc4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:49.085133 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81754b0d-c705-46c7-a969-50f4f215dbc4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:49.085586 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-81754b0d-c705-46c7-a969-50f4f215dbc4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:49.088205 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5bf8b375-e757-4e98-9e5c-363bce286af1 req-d7d7e20a-aa71-4574-8099-860f203ccc50 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:15:49.089095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-5bf8b375-e757-4e98-9e5c-363bce286af1 req-d7d7e20a-aa71-4574-8099-860f203ccc50 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:15:49.102126 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-5bf8b375-e757-4e98-9e5c-363bce286af1 req-d7d7e20a-aa71-4574-8099-860f203ccc50 service nova] Creating event network-changed:b227673d-5ca6-4383-962b-179b0b291140 for instance 50547fc3-4ed2-44bf-bae3-cdf757b7d65e on nch2-master-1 May 21 22:15:49.108683 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-5bf8b375-e757-4e98-9e5c-363bce286af1 req-d7d7e20a-aa71-4574-8099-860f203ccc50 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036741 May 21 22:15:49.109496 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3615/7106] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:15:49.360398 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-81754b0d-c705-46c7-a969-50f4f215dbc4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:15:49.370477 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-81754b0d-c705-46c7-a969-50f4f215dbc4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1563 microversion: 2.1 time: 0.300662 May 21 22:15:49.371041 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3492/7107] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:15:49 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1563 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:16:10.685394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=46 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:16:10.690137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-56754ea1-9a98-4089-b2eb-48058a653249 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:16:10.691198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-56754ea1-9a98-4089-b2eb-48058a653249 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:16:10.698844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56754ea1-9a98-4089-b2eb-48058a653249 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:10.699316 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56754ea1-9a98-4089-b2eb-48058a653249 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:10.700402 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56754ea1-9a98-4089-b2eb-48058a653249 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:10.700860 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-56754ea1-9a98-4089-b2eb-48058a653249 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:10.749938 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-56754ea1-9a98-4089-b2eb-48058a653249 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e/action" status: 200 len: 24572 microversion: 2.1 time: 0.066355 May 21 22:16:10.750587 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3616/7108] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:16:10 2022] POST /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e/action => generated 24572 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 22:16:21.805119 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1bec4afc-5c48-461e-9755-dba0a9d62617 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:16:21.807494 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=18 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:16:21.807858 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=34 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:16:21.812868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1bec4afc-5c48-461e-9755-dba0a9d62617 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:21.816559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1bec4afc-5c48-461e-9755-dba0a9d62617 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:21.837590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1bec4afc-5c48-461e-9755-dba0a9d62617 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Going to try to stop instance {{(pid=131278) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 21 22:16:22.009529 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1bec4afc-5c48-461e-9755-dba0a9d62617 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e/action" status: 202 len: 0 microversion: 2.1 time: 0.209164 May 21 22:16:22.010135 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3493/7109] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:16:21 2022] POST /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:16:22.019262 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1c7872dc-27cb-4950-81cd-041e64816998 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:16:22.019639 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1c7872dc-27cb-4950-81cd-041e64816998 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:16:22.023629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:16:22.029570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1c7872dc-27cb-4950-81cd-041e64816998 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:22.032490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1c7872dc-27cb-4950-81cd-041e64816998 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:22.032490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1c7872dc-27cb-4950-81cd-041e64816998 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:22.032490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1c7872dc-27cb-4950-81cd-041e64816998 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:22.178830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1c7872dc-27cb-4950-81cd-041e64816998 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:16:22.186526 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1c7872dc-27cb-4950-81cd-041e64816998 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1692 microversion: 2.1 time: 0.171893 May 21 22:16:22.190678 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3617/7110] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:16:22 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:16:23.204988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-474f2755-9368-4142-8a02-1aa94563d19a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:16:23.205695 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-474f2755-9368-4142-8a02-1aa94563d19a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:16:23.213906 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-474f2755-9368-4142-8a02-1aa94563d19a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:23.214357 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-474f2755-9368-4142-8a02-1aa94563d19a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:23.215130 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-474f2755-9368-4142-8a02-1aa94563d19a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:23.215647 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-474f2755-9368-4142-8a02-1aa94563d19a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:23.365196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-474f2755-9368-4142-8a02-1aa94563d19a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:16:23.373009 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-474f2755-9368-4142-8a02-1aa94563d19a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1692 microversion: 2.1 time: 0.172664 May 21 22:16:23.373584 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3494/7111] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:16:23 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:16:24.391667 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0f4d0534-9ef1-4a6d-a836-129577662797 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:16:24.392317 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0f4d0534-9ef1-4a6d-a836-129577662797 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:16:24.400237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f4d0534-9ef1-4a6d-a836-129577662797 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:24.403527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f4d0534-9ef1-4a6d-a836-129577662797 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:24.403527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f4d0534-9ef1-4a6d-a836-129577662797 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:24.403527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0f4d0534-9ef1-4a6d-a836-129577662797 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:24.552732 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0f4d0534-9ef1-4a6d-a836-129577662797 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:16:24.560705 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0f4d0534-9ef1-4a6d-a836-129577662797 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1692 microversion: 2.1 time: 0.173578 May 21 22:16:24.561284 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3618/7112] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:16:24 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:16:25.578381 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5ac38cba-5d2f-45ca-be98-891db40f2860 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:16:25.579028 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5ac38cba-5d2f-45ca-be98-891db40f2860 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:16:25.585843 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ac38cba-5d2f-45ca-be98-891db40f2860 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:25.586318 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ac38cba-5d2f-45ca-be98-891db40f2860 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:25.587077 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ac38cba-5d2f-45ca-be98-891db40f2860 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:25.587524 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ac38cba-5d2f-45ca-be98-891db40f2860 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:25.734467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5ac38cba-5d2f-45ca-be98-891db40f2860 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:16:25.742232 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5ac38cba-5d2f-45ca-be98-891db40f2860 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1692 microversion: 2.1 time: 0.168032 May 21 22:16:25.743749 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3495/7113] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:16:25 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:16:26.760505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-420492dd-abbb-4792-80ea-b4b62fb8ce4d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:16:26.761170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-420492dd-abbb-4792-80ea-b4b62fb8ce4d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:16:26.768353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-420492dd-abbb-4792-80ea-b4b62fb8ce4d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:26.768836 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-420492dd-abbb-4792-80ea-b4b62fb8ce4d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:26.769622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-420492dd-abbb-4792-80ea-b4b62fb8ce4d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:26.770079 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-420492dd-abbb-4792-80ea-b4b62fb8ce4d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:26.918413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-420492dd-abbb-4792-80ea-b4b62fb8ce4d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:16:26.926059 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-420492dd-abbb-4792-80ea-b4b62fb8ce4d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1692 microversion: 2.1 time: 0.169693 May 21 22:16:26.926628 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3619/7114] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:16:26 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:16:27.943136 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ee8235bd-e22a-4e4e-a971-0aa4527668ee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:16:27.943730 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ee8235bd-e22a-4e4e-a971-0aa4527668ee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:16:27.951622 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee8235bd-e22a-4e4e-a971-0aa4527668ee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:27.952076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee8235bd-e22a-4e4e-a971-0aa4527668ee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:27.952881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee8235bd-e22a-4e4e-a971-0aa4527668ee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:27.953323 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ee8235bd-e22a-4e4e-a971-0aa4527668ee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:28.106765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ee8235bd-e22a-4e4e-a971-0aa4527668ee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:16:28.114451 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ee8235bd-e22a-4e4e-a971-0aa4527668ee tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1692 microversion: 2.1 time: 0.175367 May 21 22:16:28.115029 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3496/7115] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:16:27 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1692 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:16:29.131045 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d9b16a41-6686-4bc9-81ef-1814588a7cc8 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:16:29.131674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d9b16a41-6686-4bc9-81ef-1814588a7cc8 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:16:29.138579 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d9b16a41-6686-4bc9-81ef-1814588a7cc8 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:29.139037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d9b16a41-6686-4bc9-81ef-1814588a7cc8 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:29.139812 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d9b16a41-6686-4bc9-81ef-1814588a7cc8 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:29.140258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d9b16a41-6686-4bc9-81ef-1814588a7cc8 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:29.289907 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d9b16a41-6686-4bc9-81ef-1814588a7cc8 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:16:29.298141 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d9b16a41-6686-4bc9-81ef-1814588a7cc8 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1692 microversion: 2.1 time: 0.171131 May 21 22:16:29.298724 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3620/7116] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:16:29 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:16:30.315976 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-de9f9c19-113e-4d94-be3e-b3077d644d8b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:16:30.316629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-de9f9c19-113e-4d94-be3e-b3077d644d8b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:16:30.324550 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de9f9c19-113e-4d94-be3e-b3077d644d8b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:30.325009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de9f9c19-113e-4d94-be3e-b3077d644d8b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:30.326049 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de9f9c19-113e-4d94-be3e-b3077d644d8b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:30.326609 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-de9f9c19-113e-4d94-be3e-b3077d644d8b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:30.481882 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-de9f9c19-113e-4d94-be3e-b3077d644d8b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:16:30.489709 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-de9f9c19-113e-4d94-be3e-b3077d644d8b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1692 microversion: 2.1 time: 0.177701 May 21 22:16:30.490290 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3497/7117] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:16:30 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:16:31.507271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fc0165da-1fde-4b52-8652-2ec24223b500 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:16:31.507807 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fc0165da-1fde-4b52-8652-2ec24223b500 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:16:31.515476 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc0165da-1fde-4b52-8652-2ec24223b500 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:31.515936 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc0165da-1fde-4b52-8652-2ec24223b500 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:31.516740 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc0165da-1fde-4b52-8652-2ec24223b500 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:31.517191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fc0165da-1fde-4b52-8652-2ec24223b500 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:31.662307 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fc0165da-1fde-4b52-8652-2ec24223b500 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:16:31.670159 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fc0165da-1fde-4b52-8652-2ec24223b500 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1692 microversion: 2.1 time: 0.166834 May 21 22:16:31.670743 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3621/7118] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:16:31 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:16:32.687165 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-fe673d08-9c9e-4aa9-bf1d-3acb9fabcc22 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:16:32.687795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-fe673d08-9c9e-4aa9-bf1d-3acb9fabcc22 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:16:32.694995 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fe673d08-9c9e-4aa9-bf1d-3acb9fabcc22 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:32.695451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fe673d08-9c9e-4aa9-bf1d-3acb9fabcc22 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:32.696227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fe673d08-9c9e-4aa9-bf1d-3acb9fabcc22 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:32.696773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-fe673d08-9c9e-4aa9-bf1d-3acb9fabcc22 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:32.852399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-fe673d08-9c9e-4aa9-bf1d-3acb9fabcc22 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:16:32.860227 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-fe673d08-9c9e-4aa9-bf1d-3acb9fabcc22 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1692 microversion: 2.1 time: 0.177064 May 21 22:16:32.860820 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3498/7119] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:16:32 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:16:33.878710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6f2cc3bc-0c3f-4ed2-a5dd-45a84a106804 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:16:33.879486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6f2cc3bc-0c3f-4ed2-a5dd-45a84a106804 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:16:33.887032 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f2cc3bc-0c3f-4ed2-a5dd-45a84a106804 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:33.887505 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f2cc3bc-0c3f-4ed2-a5dd-45a84a106804 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:33.888308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f2cc3bc-0c3f-4ed2-a5dd-45a84a106804 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:33.888772 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6f2cc3bc-0c3f-4ed2-a5dd-45a84a106804 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:34.036963 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6f2cc3bc-0c3f-4ed2-a5dd-45a84a106804 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:16:34.045165 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6f2cc3bc-0c3f-4ed2-a5dd-45a84a106804 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1692 microversion: 2.1 time: 0.170246 May 21 22:16:34.045412 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3622/7120] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:16:33 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:16:35.064683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-adff1d6f-2219-4be2-9316-9490f6131aa3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:16:35.065440 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-adff1d6f-2219-4be2-9316-9490f6131aa3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:16:35.072985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-adff1d6f-2219-4be2-9316-9490f6131aa3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:35.073452 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-adff1d6f-2219-4be2-9316-9490f6131aa3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:35.074252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-adff1d6f-2219-4be2-9316-9490f6131aa3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:35.074723 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-adff1d6f-2219-4be2-9316-9490f6131aa3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:35.222812 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-adff1d6f-2219-4be2-9316-9490f6131aa3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:16:35.230891 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-adff1d6f-2219-4be2-9316-9490f6131aa3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1692 microversion: 2.1 time: 0.170367 May 21 22:16:35.231465 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3499/7121] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:16:35 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:16:36.248398 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7f0c6d33-5feb-4bd3-bf6b-e0ed385eab8c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:16:36.249023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7f0c6d33-5feb-4bd3-bf6b-e0ed385eab8c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:16:36.256330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f0c6d33-5feb-4bd3-bf6b-e0ed385eab8c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:36.256808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f0c6d33-5feb-4bd3-bf6b-e0ed385eab8c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:36.257588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f0c6d33-5feb-4bd3-bf6b-e0ed385eab8c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:36.258043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f0c6d33-5feb-4bd3-bf6b-e0ed385eab8c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:36.407070 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7f0c6d33-5feb-4bd3-bf6b-e0ed385eab8c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:16:36.414800 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7f0c6d33-5feb-4bd3-bf6b-e0ed385eab8c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1692 microversion: 2.1 time: 0.170393 May 21 22:16:36.415454 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3623/7122] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:16:36 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:16:37.432743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2cad19ec-df2c-4852-9201-3ef572af1795 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:16:37.433411 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2cad19ec-df2c-4852-9201-3ef572af1795 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:16:37.440766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2cad19ec-df2c-4852-9201-3ef572af1795 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:37.441227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2cad19ec-df2c-4852-9201-3ef572af1795 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:37.442022 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2cad19ec-df2c-4852-9201-3ef572af1795 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:37.442451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2cad19ec-df2c-4852-9201-3ef572af1795 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:37.597863 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2cad19ec-df2c-4852-9201-3ef572af1795 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:16:37.605969 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2cad19ec-df2c-4852-9201-3ef572af1795 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1692 microversion: 2.1 time: 0.177624 May 21 22:16:37.606549 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3500/7123] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:16:37 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:16:38.623072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-595d245a-a58b-4ef9-8194-d287b2aea5a5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:16:38.623713 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-595d245a-a58b-4ef9-8194-d287b2aea5a5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:16:38.630913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-595d245a-a58b-4ef9-8194-d287b2aea5a5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:38.631389 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-595d245a-a58b-4ef9-8194-d287b2aea5a5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:38.632194 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-595d245a-a58b-4ef9-8194-d287b2aea5a5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:38.632681 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-595d245a-a58b-4ef9-8194-d287b2aea5a5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:38.783817 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-595d245a-a58b-4ef9-8194-d287b2aea5a5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:16:38.792694 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-595d245a-a58b-4ef9-8194-d287b2aea5a5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1669 microversion: 2.1 time: 0.173594 May 21 22:16:38.793282 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3624/7124] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:16:38 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1669 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:16:39.893451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cc04b55f-22f0-413f-8ae1-96ad30b00683 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:16:39.894403 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cc04b55f-22f0-413f-8ae1-96ad30b00683 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:16:39.902336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cc04b55f-22f0-413f-8ae1-96ad30b00683 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:39.902805 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cc04b55f-22f0-413f-8ae1-96ad30b00683 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:39.903584 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cc04b55f-22f0-413f-8ae1-96ad30b00683 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:39.904053 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cc04b55f-22f0-413f-8ae1-96ad30b00683 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:39.952817 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cc04b55f-22f0-413f-8ae1-96ad30b00683 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e/action" status: 200 len: 38443 microversion: 2.1 time: 0.063011 May 21 22:16:39.953408 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3501/7125] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:16:39 2022] POST /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e/action => generated 38443 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 22:16:39.965166 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cd1f8757-5a9c-46bc-a80a-ace82303187d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:16:39.972176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd1f8757-5a9c-46bc-a80a-ace82303187d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:39.972748 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cd1f8757-5a9c-46bc-a80a-ace82303187d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:39.994945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cd1f8757-5a9c-46bc-a80a-ace82303187d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Going to try to start instance {{(pid=131277) start /opt/stack/nova/nova/compute/api.py:2730}} May 21 22:16:40.216687 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cd1f8757-5a9c-46bc-a80a-ace82303187d tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e/action" status: 202 len: 0 microversion: 2.1 time: 0.255685 May 21 22:16:40.217253 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3625/7126] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:16:39 2022] POST /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:16:40.226088 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ae89e02e-5492-4455-8fe4-49bc9dd4ac6e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:16:40.226808 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ae89e02e-5492-4455-8fe4-49bc9dd4ac6e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:16:40.235284 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ae89e02e-5492-4455-8fe4-49bc9dd4ac6e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:40.235743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ae89e02e-5492-4455-8fe4-49bc9dd4ac6e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:40.236559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ae89e02e-5492-4455-8fe4-49bc9dd4ac6e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:40.237002 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ae89e02e-5492-4455-8fe4-49bc9dd4ac6e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:40.390680 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ae89e02e-5492-4455-8fe4-49bc9dd4ac6e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:16:40.398872 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ae89e02e-5492-4455-8fe4-49bc9dd4ac6e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1678 microversion: 2.1 time: 0.176967 May 21 22:16:40.399481 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3502/7127] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:16:40 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:16:41.419435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-746bca94-cb40-414f-abbe-ad3b1e2e803e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:16:41.420153 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-746bca94-cb40-414f-abbe-ad3b1e2e803e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:16:41.426593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-746bca94-cb40-414f-abbe-ad3b1e2e803e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:41.427060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-746bca94-cb40-414f-abbe-ad3b1e2e803e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:41.427842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-746bca94-cb40-414f-abbe-ad3b1e2e803e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:41.428316 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-746bca94-cb40-414f-abbe-ad3b1e2e803e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:41.580464 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-746bca94-cb40-414f-abbe-ad3b1e2e803e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:16:41.589109 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-746bca94-cb40-414f-abbe-ad3b1e2e803e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1678 microversion: 2.1 time: 0.175488 May 21 22:16:41.589709 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3626/7128] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:16:41 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:16:42.606705 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6b6bc836-193e-46ce-b94b-639539a45a9e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:16:42.607335 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6b6bc836-193e-46ce-b94b-639539a45a9e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:16:42.614457 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b6bc836-193e-46ce-b94b-639539a45a9e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:42.614917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b6bc836-193e-46ce-b94b-639539a45a9e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:42.615692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b6bc836-193e-46ce-b94b-639539a45a9e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:16:42.616140 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6b6bc836-193e-46ce-b94b-639539a45a9e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:16:42.764269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6b6bc836-193e-46ce-b94b-639539a45a9e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:16:42.772143 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6b6bc836-193e-46ce-b94b-639539a45a9e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1682 microversion: 2.1 time: 0.169485 May 21 22:16:42.772743 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3503/7129] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:16:42 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:16:46.649105 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:16:46.649851 ncdv-master-1 devstack@n-api.service[131278]: Sat May 21 22:16:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:17:06.964964 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e192eda7-bc61-4700-9480-191744900001 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:17:06.965845 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e192eda7-bc61-4700-9480-191744900001 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:17:06.968837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=23 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:17:06.969660 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:17:06.974490 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e192eda7-bc61-4700-9480-191744900001 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:06.974965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e192eda7-bc61-4700-9480-191744900001 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:06.975755 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e192eda7-bc61-4700-9480-191744900001 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:06.976215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e192eda7-bc61-4700-9480-191744900001 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:07.026980 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e192eda7-bc61-4700-9480-191744900001 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e/action" status: 200 len: 62995 microversion: 2.1 time: 0.066130 May 21 22:17:07.027631 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3627/7130] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:17:06 2022] POST /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e/action => generated 62995 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 22:17:14.398699 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dc1233b8-6946-45a3-8844-e6b7c78712b0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:17:14.399284 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dc1233b8-6946-45a3-8844-e6b7c78712b0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:17:14.401744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f5a40778-6590-4326-9961-942ae17b9172 req-39b1b4da-aa8b-409b-8839-11f116f190bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50547fc3-4ed2-44bf-bae3-cdf757b7d65e", "tag": "b227673d-5ca6-4383-962b-179b0b291140"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:17:14.402428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=22 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:17:14.403210 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:17:14.409266 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc1233b8-6946-45a3-8844-e6b7c78712b0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:14.409722 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc1233b8-6946-45a3-8844-e6b7c78712b0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:14.410508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc1233b8-6946-45a3-8844-e6b7c78712b0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:14.410951 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dc1233b8-6946-45a3-8844-e6b7c78712b0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:14.412629 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f5a40778-6590-4326-9961-942ae17b9172 req-39b1b4da-aa8b-409b-8839-11f116f190bb service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:14.413333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f5a40778-6590-4326-9961-942ae17b9172 req-39b1b4da-aa8b-409b-8839-11f116f190bb service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:14.425558 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f5a40778-6590-4326-9961-942ae17b9172 req-39b1b4da-aa8b-409b-8839-11f116f190bb service nova] Creating event network-changed:b227673d-5ca6-4383-962b-179b0b291140 for instance 50547fc3-4ed2-44bf-bae3-cdf757b7d65e on nch2-master-1 May 21 22:17:14.430918 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f5a40778-6590-4326-9961-942ae17b9172 req-39b1b4da-aa8b-409b-8839-11f116f190bb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033464 May 21 22:17:14.431919 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3628/7131] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:17:14.442888 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dc1233b8-6946-45a3-8844-e6b7c78712b0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 22:17:14.814009 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dc1233b8-6946-45a3-8844-e6b7c78712b0 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "DELETE /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 204 len: 0 microversion: 2.1 time: 0.419098 May 21 22:17:14.814975 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3504/7132] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:17:14 2022] DELETE /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:17:14.825587 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-330bcc72-1c8a-4ab8-a855-609f43d4f48c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:17:14.826349 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-330bcc72-1c8a-4ab8-a855-609f43d4f48c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:17:14.834499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-330bcc72-1c8a-4ab8-a855-609f43d4f48c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:14.835076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-330bcc72-1c8a-4ab8-a855-609f43d4f48c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:14.835951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-330bcc72-1c8a-4ab8-a855-609f43d4f48c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:14.836698 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-330bcc72-1c8a-4ab8-a855-609f43d4f48c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:14.990275 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-330bcc72-1c8a-4ab8-a855-609f43d4f48c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:17:14.998568 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-330bcc72-1c8a-4ab8-a855-609f43d4f48c tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1688 microversion: 2.1 time: 0.178617 May 21 22:17:14.999422 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3629/7133] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:17:14 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:17:16.018844 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6eb57d26-dab5-4ef9-84a3-96311118bd68 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:17:16.019533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6eb57d26-dab5-4ef9-84a3-96311118bd68 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:17:16.026592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6eb57d26-dab5-4ef9-84a3-96311118bd68 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:16.030442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6eb57d26-dab5-4ef9-84a3-96311118bd68 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:16.030442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6eb57d26-dab5-4ef9-84a3-96311118bd68 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:16.030442 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6eb57d26-dab5-4ef9-84a3-96311118bd68 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:16.207795 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6eb57d26-dab5-4ef9-84a3-96311118bd68 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:17:16.215600 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6eb57d26-dab5-4ef9-84a3-96311118bd68 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1688 microversion: 2.1 time: 0.201400 May 21 22:17:16.216169 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3505/7134] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:17:16 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1688 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:17:17.224038 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-ba6a30a4-32f8-4ca9-be67-68a133d7aeb4 req-1665610d-f765-4a47-9110-80105592fac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50547fc3-4ed2-44bf-bae3-cdf757b7d65e", "name": "network-vif-deleted", "tag": "b227673d-5ca6-4383-962b-179b0b291140"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:17:17.233525 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-20bc9b02-fcc7-4232-bc3b-be2f5022c60f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:17:17.234098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-20bc9b02-fcc7-4232-bc3b-be2f5022c60f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:17:17.235527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ba6a30a4-32f8-4ca9-be67-68a133d7aeb4 req-1665610d-f765-4a47-9110-80105592fac8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:17.236000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-ba6a30a4-32f8-4ca9-be67-68a133d7aeb4 req-1665610d-f765-4a47-9110-80105592fac8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:17.241264 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20bc9b02-fcc7-4232-bc3b-be2f5022c60f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:17.241725 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20bc9b02-fcc7-4232-bc3b-be2f5022c60f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:17.242513 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20bc9b02-fcc7-4232-bc3b-be2f5022c60f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:17.242968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-20bc9b02-fcc7-4232-bc3b-be2f5022c60f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:17.248454 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-ba6a30a4-32f8-4ca9-be67-68a133d7aeb4 req-1665610d-f765-4a47-9110-80105592fac8 service nova] Creating event network-vif-deleted:b227673d-5ca6-4383-962b-179b0b291140 for instance 50547fc3-4ed2-44bf-bae3-cdf757b7d65e on nch2-master-1 May 21 22:17:17.253935 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-ba6a30a4-32f8-4ca9-be67-68a133d7aeb4 req-1665610d-f765-4a47-9110-80105592fac8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033784 May 21 22:17:17.255287 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3630/7135] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:17:17.317627 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-20bc9b02-fcc7-4232-bc3b-be2f5022c60f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:17:17.325438 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-20bc9b02-fcc7-4232-bc3b-be2f5022c60f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 200 len: 1503 microversion: 2.1 time: 0.096790 May 21 22:17:17.326098 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3506/7136] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:17:17 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 1503 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:17:18.343636 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ba1b8473-c1ba-4bc7-b67d-aca56f1cee2b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:17:18.344523 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ba1b8473-c1ba-4bc7-b67d-aca56f1cee2b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 50547fc3-4ed2-44bf-bae3-cdf757b7d65e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:17:18.351744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba1b8473-c1ba-4bc7-b67d-aca56f1cee2b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:18.352215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba1b8473-c1ba-4bc7-b67d-aca56f1cee2b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:18.353028 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba1b8473-c1ba-4bc7-b67d-aca56f1cee2b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:18.353486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ba1b8473-c1ba-4bc7-b67d-aca56f1cee2b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:18.367160 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-ba1b8473-c1ba-4bc7-b67d-aca56f1cee2b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] HTTP exception thrown: Instance 50547fc3-4ed2-44bf-bae3-cdf757b7d65e could not be found. May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ba1b8473-c1ba-4bc7-b67d-aca56f1cee2b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Request method failure captured: May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e HTTP/1.1 May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiWNUii8Zq6WOyAgXHmbJ3sC5wa94C74ELxknXQJ_SM32Jav6JyvMpyYMVSFhYJ3s1YN1udNzGY1HshTj3s7GT-R1gCzdtKT1r559qWDXMdRUrYXCdFe0fnjc0pP6_57YeQK7_51zGtHqPFGJn1yY7YonKAJ0n7bgpG0NA9tWLAWZZZY May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: 10c1d1acf8134ddab4e11e933dbeb571 May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-351207300 May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/10c1d1acf8134ddab4e11e933dbeb571"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10c1d1acf8134ddab4e11e933dbeb571"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_10c1d1acf8134ddab4e11e933dbeb571", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10c1d1acf8134ddab4e11e933dbeb571"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-TestNetworkAdvancedServerOps-351207300 May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: 10c1d1acf8134ddab4e11e933dbeb571 May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-351207300 May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-TestNetworkAdvancedServerOps-351207300-project May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: c726d5d196d64ef3a2470ebc855b00f0 May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-TestNetworkAdvancedServerOps-351207300-project May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 50547fc3-4ed2-44bf-bae3-cdf757b7d65e could not be found. May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '50547fc3-4ed2-44bf-bae3-cdf757b7d65e'} May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50547fc3-4ed2-44bf-bae3-cdf757b7d65e could not be found. May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50547fc3-4ed2-44bf-bae3-cdf757b7d65e could not be found. May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:17:18.368855 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:17:18.374266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:17:18.374266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:17:18.374266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:17:18.374266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:17:18.374266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:17:18.374266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50547fc3-4ed2-44bf-bae3-cdf757b7d65e could not be found. May 21 22:17:18.374266 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:17:18.374266 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ba1b8473-c1ba-4bc7-b67d-aca56f1cee2b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Returning 404 to user: Instance 50547fc3-4ed2-44bf-bae3-cdf757b7d65e could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:17:18.374266 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ba1b8473-c1ba-4bc7-b67d-aca56f1cee2b tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e" status: 404 len: 111 microversion: 2.1 time: 0.031163 May 21 22:17:18.374266 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3631/7137] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:17:18 2022] GET /compute/v2.1/servers/50547fc3-4ed2-44bf-bae3-cdf757b7d65e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:17:22.812029 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6ad0f760-1d49-4a02-b62a-b6a66c6a44b7 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '.version_select at 0x7fc81b497550>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:17:22.893512 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6ad0f760-1d49-4a02-b62a-b6a66c6a44b7 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1251237519" status: 202 len: 0 microversion: 2.1 time: 0.086255 May 21 22:17:22.894125 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3507/7138] 10.222.0.49 () {58 vars in 1283 bytes} [Sat May 21 22:17:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1251237519 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:17:22.928390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-72fc6f4d-080d-4c2d-b98d-8161f29dcc1e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'create', calling method: .version_select at 0x7fc81a5deca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1169912674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCQGPhBEALfP3g76JL9uW4nWicymPgvX4Dn6PGRmIiBJcg3Z26LMAe2yCW/Vwj35Ny2ZExCnga4CDoxcOED4vfYXmDFuBQjmMcIiSoksSkKkQS2k6IvrbTMuFJ4aBC6eg=="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:17:22.944108 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-72fc6f4d-080d-4c2d-b98d-8161f29dcc1e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Getting quotas for project 10c1d1acf8134ddab4e11e933dbeb571. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:17:22.949350 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-72fc6f4d-080d-4c2d-b98d-8161f29dcc1e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Getting quotas for user c726d5d196d64ef3a2470ebc855b00f0 and project 10c1d1acf8134ddab4e11e933dbeb571. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:17:23.036309 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-72fc6f4d-080d-4c2d-b98d-8161f29dcc1e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.111814 May 21 22:17:23.036921 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3632/7139] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 22:17:22 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:17:31.604461 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:17:31.613989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-68910c4b-f6e4-4bd4-9f7a-b6024efaafa2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-502365902", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "networks": [{"uuid": "ea27f7ce-3eec-44a1-a226-397f7f07472c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1169912674", "security_groups": [{"name": "tempest-secgroup-smoke-2054615376"}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:17:31.769943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-68910c4b-f6e4-4bd4-9f7a-b6024efaafa2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] validate_networks() for [('ea27f7ce-3eec-44a1-a226-397f7f07472c', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 22:17:32.365797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-68910c4b-f6e4-4bd4-9f7a-b6024efaafa2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:17:32.365797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-68910c4b-f6e4-4bd4-9f7a-b6024efaafa2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:17:32.366577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-68910c4b-f6e4-4bd4-9f7a-b6024efaafa2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:17:32.367102 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-68910c4b-f6e4-4bd4-9f7a-b6024efaafa2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:17:32.367589 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-68910c4b-f6e4-4bd4-9f7a-b6024efaafa2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:17:32.379003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-68910c4b-f6e4-4bd4-9f7a-b6024efaafa2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:32.379546 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-68910c4b-f6e4-4bd4-9f7a-b6024efaafa2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:32.380490 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-68910c4b-f6e4-4bd4-9f7a-b6024efaafa2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:32.381014 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-68910c4b-f6e4-4bd4-9f7a-b6024efaafa2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:32.401355 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-68910c4b-f6e4-4bd4-9f7a-b6024efaafa2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Getting quotas for project 10c1d1acf8134ddab4e11e933dbeb571. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:17:32.407380 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-68910c4b-f6e4-4bd4-9f7a-b6024efaafa2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Getting quotas for user c726d5d196d64ef3a2470ebc855b00f0 and project 10c1d1acf8134ddab4e11e933dbeb571. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:17:32.420544 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-68910c4b-f6e4-4bd4-9f7a-b6024efaafa2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 22:17:32.423588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-68910c4b-f6e4-4bd4-9f7a-b6024efaafa2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 22:17:32.540018 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-68910c4b-f6e4-4bd4-9f7a-b6024efaafa2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.937877 May 21 22:17:32.540905 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3508/7140] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 22:17:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 22:17:32.548870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=16 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:17:32.553061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0ad285a5-b782-4896-9445-f46d8912537e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:17:32.553699 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0ad285a5-b782-4896-9445-f46d8912537e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:17:32.630913 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0ad285a5-b782-4896-9445-f46d8912537e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:17:32.639197 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0ad285a5-b782-4896-9445-f46d8912537e tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 200 len: 1266 microversion: 2.1 time: 0.092392 May 21 22:17:32.640846 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3633/7141] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:17:32 2022] GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:17:33.659208 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b5c147ed-27e5-4196-8534-f9071c94dc59 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:17:33.659799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b5c147ed-27e5-4196-8534-f9071c94dc59 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:17:33.668069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5c147ed-27e5-4196-8534-f9071c94dc59 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:33.668561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5c147ed-27e5-4196-8534-f9071c94dc59 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:33.669356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5c147ed-27e5-4196-8534-f9071c94dc59 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:33.669810 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b5c147ed-27e5-4196-8534-f9071c94dc59 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:33.738718 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b5c147ed-27e5-4196-8534-f9071c94dc59 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:17:33.747026 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b5c147ed-27e5-4196-8534-f9071c94dc59 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 200 len: 1270 microversion: 2.1 time: 0.092977 May 21 22:17:33.747716 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3509/7142] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:17:33 2022] GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:17:34.764527 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e3cb7b14-cb72-4d47-95c5-d1f0ee947f2a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:17:34.765987 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e3cb7b14-cb72-4d47-95c5-d1f0ee947f2a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:17:34.773904 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3cb7b14-cb72-4d47-95c5-d1f0ee947f2a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:34.774376 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3cb7b14-cb72-4d47-95c5-d1f0ee947f2a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:34.775172 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3cb7b14-cb72-4d47-95c5-d1f0ee947f2a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:34.775657 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e3cb7b14-cb72-4d47-95c5-d1f0ee947f2a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:34.885099 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e3cb7b14-cb72-4d47-95c5-d1f0ee947f2a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:17:34.894582 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e3cb7b14-cb72-4d47-95c5-d1f0ee947f2a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 200 len: 1336 microversion: 2.1 time: 0.133928 May 21 22:17:34.895601 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3634/7143] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:17:34 2022] GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 1336 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:17:35.912678 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bba10c9a-fce0-4cd6-adeb-e91b8e43b590 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:17:35.913297 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bba10c9a-fce0-4cd6-adeb-e91b8e43b590 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:17:35.921005 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bba10c9a-fce0-4cd6-adeb-e91b8e43b590 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:35.922002 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bba10c9a-fce0-4cd6-adeb-e91b8e43b590 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:35.923032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bba10c9a-fce0-4cd6-adeb-e91b8e43b590 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:35.923650 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bba10c9a-fce0-4cd6-adeb-e91b8e43b590 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:36.090304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bba10c9a-fce0-4cd6-adeb-e91b8e43b590 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:17:36.098052 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bba10c9a-fce0-4cd6-adeb-e91b8e43b590 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 200 len: 1392 microversion: 2.1 time: 0.189716 May 21 22:17:36.098636 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3510/7144] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:17:35 2022] GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:17:36.699181 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-7d89bd57-2c24-43ba-9f79-58e005e66c04 req-a54bff7b-bf69-45e6-bd89-c0bb2c27ac2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62b5de77-04bb-4fef-8655-13635fec8e8c", "tag": "f118d9a2-d872-43da-baa6-b05514a3cd97"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:17:36.712360 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7d89bd57-2c24-43ba-9f79-58e005e66c04 req-a54bff7b-bf69-45e6-bd89-c0bb2c27ac2a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:36.713015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-7d89bd57-2c24-43ba-9f79-58e005e66c04 req-a54bff7b-bf69-45e6-bd89-c0bb2c27ac2a service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:36.725731 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-7d89bd57-2c24-43ba-9f79-58e005e66c04 req-a54bff7b-bf69-45e6-bd89-c0bb2c27ac2a service nova] Creating event network-changed:f118d9a2-d872-43da-baa6-b05514a3cd97 for instance 62b5de77-04bb-4fef-8655-13635fec8e8c on nch1-master-1 May 21 22:17:36.730844 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-7d89bd57-2c24-43ba-9f79-58e005e66c04 req-a54bff7b-bf69-45e6-bd89-c0bb2c27ac2a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035870 May 21 22:17:36.731720 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3635/7145] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:17:37.115369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4cd17a04-3e1f-412a-8c90-ffcbdb9634cc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:17:37.116003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4cd17a04-3e1f-412a-8c90-ffcbdb9634cc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:17:37.123414 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cd17a04-3e1f-412a-8c90-ffcbdb9634cc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:37.123875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cd17a04-3e1f-412a-8c90-ffcbdb9634cc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:37.124794 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cd17a04-3e1f-412a-8c90-ffcbdb9634cc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:37.125311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4cd17a04-3e1f-412a-8c90-ffcbdb9634cc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:37.289234 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4cd17a04-3e1f-412a-8c90-ffcbdb9634cc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:17:37.300439 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4cd17a04-3e1f-412a-8c90-ffcbdb9634cc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 200 len: 1392 microversion: 2.1 time: 0.188462 May 21 22:17:37.301271 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3511/7146] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:17:37 2022] GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:17:38.319535 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bcef60e8-de3f-46c6-ad70-6ef2b24e3109 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:17:38.320341 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bcef60e8-de3f-46c6-ad70-6ef2b24e3109 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:17:38.322354 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:17:38.328198 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bcef60e8-de3f-46c6-ad70-6ef2b24e3109 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:38.328691 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bcef60e8-de3f-46c6-ad70-6ef2b24e3109 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:38.329467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bcef60e8-de3f-46c6-ad70-6ef2b24e3109 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:38.329918 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bcef60e8-de3f-46c6-ad70-6ef2b24e3109 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:38.478900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bcef60e8-de3f-46c6-ad70-6ef2b24e3109 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:17:38.486876 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bcef60e8-de3f-46c6-ad70-6ef2b24e3109 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 200 len: 1392 microversion: 2.1 time: 0.172380 May 21 22:17:38.487470 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3636/7147] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:17:38 2022] GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:17:39.504771 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d87822f5-34c6-49a9-bb0e-ec736c3ea2db tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:17:39.505460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d87822f5-34c6-49a9-bb0e-ec736c3ea2db tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:17:39.512946 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d87822f5-34c6-49a9-bb0e-ec736c3ea2db tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:39.513484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d87822f5-34c6-49a9-bb0e-ec736c3ea2db tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:39.514519 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d87822f5-34c6-49a9-bb0e-ec736c3ea2db tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:39.515703 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d87822f5-34c6-49a9-bb0e-ec736c3ea2db tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:39.676369 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d87822f5-34c6-49a9-bb0e-ec736c3ea2db tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:17:39.684549 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d87822f5-34c6-49a9-bb0e-ec736c3ea2db tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 200 len: 1392 microversion: 2.1 time: 0.184110 May 21 22:17:39.684907 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3512/7148] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:17:39 2022] GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:17:40.702265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0985b793-51b6-4d63-8516-2b828a788941 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:17:40.703136 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0985b793-51b6-4d63-8516-2b828a788941 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:17:40.710382 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0985b793-51b6-4d63-8516-2b828a788941 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:40.710787 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0985b793-51b6-4d63-8516-2b828a788941 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:40.711582 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0985b793-51b6-4d63-8516-2b828a788941 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:40.712015 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0985b793-51b6-4d63-8516-2b828a788941 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:40.862347 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0985b793-51b6-4d63-8516-2b828a788941 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:17:40.869998 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0985b793-51b6-4d63-8516-2b828a788941 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 200 len: 1392 microversion: 2.1 time: 0.171729 May 21 22:17:40.870552 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3637/7149] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:17:40 2022] GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:17:41.183477 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-04ceaa63-1ba3-4dfb-aaf9-546868042eea req-9d9f8791-ca70-4d3b-b411-21e66c25b5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b5de77-04bb-4fef-8655-13635fec8e8c", "name": "network-vif-plugged", "status": "completed", "tag": "f118d9a2-d872-43da-baa6-b05514a3cd97"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:17:41.192569 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-04ceaa63-1ba3-4dfb-aaf9-546868042eea req-9d9f8791-ca70-4d3b-b411-21e66c25b5d7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:41.193031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-04ceaa63-1ba3-4dfb-aaf9-546868042eea req-9d9f8791-ca70-4d3b-b411-21e66c25b5d7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:41.204941 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-04ceaa63-1ba3-4dfb-aaf9-546868042eea req-9d9f8791-ca70-4d3b-b411-21e66c25b5d7 service nova] Creating event network-vif-plugged:f118d9a2-d872-43da-baa6-b05514a3cd97 for instance 62b5de77-04bb-4fef-8655-13635fec8e8c on nch1-master-1 May 21 22:17:41.209956 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-04ceaa63-1ba3-4dfb-aaf9-546868042eea req-9d9f8791-ca70-4d3b-b411-21e66c25b5d7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081574 May 21 22:17:41.210547 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3513/7150] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:17:41.887638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1de24142-73f8-4144-a196-430388a01bf3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:17:41.888513 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1de24142-73f8-4144-a196-430388a01bf3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:17:41.896124 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1de24142-73f8-4144-a196-430388a01bf3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:41.896634 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1de24142-73f8-4144-a196-430388a01bf3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:41.897411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1de24142-73f8-4144-a196-430388a01bf3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:41.897865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1de24142-73f8-4144-a196-430388a01bf3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:42.045621 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1de24142-73f8-4144-a196-430388a01bf3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:17:42.053980 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1de24142-73f8-4144-a196-430388a01bf3 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 200 len: 1392 microversion: 2.1 time: 0.170281 May 21 22:17:42.055509 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3638/7151] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:17:41 2022] GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:17:43.069141 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:17:43.069886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:17:43.074023 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1786c33a-7bd1-4a0a-8082-08a456003df2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:17:43.077638 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1786c33a-7bd1-4a0a-8082-08a456003df2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:17:43.081566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1786c33a-7bd1-4a0a-8082-08a456003df2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:43.082034 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1786c33a-7bd1-4a0a-8082-08a456003df2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:43.082820 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1786c33a-7bd1-4a0a-8082-08a456003df2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:43.083280 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-1786c33a-7bd1-4a0a-8082-08a456003df2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:43.239256 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1786c33a-7bd1-4a0a-8082-08a456003df2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:17:43.246880 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1786c33a-7bd1-4a0a-8082-08a456003df2 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 200 len: 1564 microversion: 2.1 time: 0.179795 May 21 22:17:43.247461 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3514/7152] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:17:43 2022] GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 1564 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:17:43.263533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d8d240c6-b34f-4249-931e-e4c4a07552c5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:17:43.264161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d8d240c6-b34f-4249-931e-e4c4a07552c5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:17:43.266421 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:17:43.271839 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8d240c6-b34f-4249-931e-e4c4a07552c5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:43.272329 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8d240c6-b34f-4249-931e-e4c4a07552c5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:43.273117 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8d240c6-b34f-4249-931e-e4c4a07552c5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:43.273565 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d8d240c6-b34f-4249-931e-e4c4a07552c5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:43.419915 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d8d240c6-b34f-4249-931e-e4c4a07552c5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:17:43.427772 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d8d240c6-b34f-4249-931e-e4c4a07552c5 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 200 len: 1564 microversion: 2.1 time: 0.168318 May 21 22:17:43.428431 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3639/7153] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:17:43 2022] GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:17:45.721508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ffb7ba4d-41c2-4e70-9543-097972d967f6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:17:45.722138 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ffb7ba4d-41c2-4e70-9543-097972d967f6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:17:45.725470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-0aa819b9-e6da-4852-959e-25fb7271a71b req-bc41df87-3c75-4cff-bc3b-de78b227a968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62b5de77-04bb-4fef-8655-13635fec8e8c", "tag": "f118d9a2-d872-43da-baa6-b05514a3cd97"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:17:45.732556 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:17:45.732556 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffb7ba4d-41c2-4e70-9543-097972d967f6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:45.732556 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffb7ba4d-41c2-4e70-9543-097972d967f6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:45.732556 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffb7ba4d-41c2-4e70-9543-097972d967f6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:45.733216 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ffb7ba4d-41c2-4e70-9543-097972d967f6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:45.735277 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-0aa819b9-e6da-4852-959e-25fb7271a71b req-bc41df87-3c75-4cff-bc3b-de78b227a968 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:17:45.735742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-0aa819b9-e6da-4852-959e-25fb7271a71b req-bc41df87-3c75-4cff-bc3b-de78b227a968 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:17:45.748149 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-0aa819b9-e6da-4852-959e-25fb7271a71b req-bc41df87-3c75-4cff-bc3b-de78b227a968 service nova] Creating event network-changed:f118d9a2-d872-43da-baa6-b05514a3cd97 for instance 62b5de77-04bb-4fef-8655-13635fec8e8c on nch1-master-1 May 21 22:17:45.753620 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-0aa819b9-e6da-4852-959e-25fb7271a71b req-bc41df87-3c75-4cff-bc3b-de78b227a968 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031835 May 21 22:17:45.759300 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3640/7154] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:17:45.899614 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-ffb7ba4d-41c2-4e70-9543-097972d967f6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:17:45.908898 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ffb7ba4d-41c2-4e70-9543-097972d967f6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 200 len: 1564 microversion: 2.1 time: 0.192327 May 21 22:17:45.920454 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3515/7155] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:17:45 2022] GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 1564 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:18:07.172742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=9 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:18:07.173598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=34 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:18:07.178884 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fdbb4168-a3c6-4b2e-9351-70a787df33a4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:18:07.179951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fdbb4168-a3c6-4b2e-9351-70a787df33a4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:18:07.186212 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fdbb4168-a3c6-4b2e-9351-70a787df33a4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:07.188394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fdbb4168-a3c6-4b2e-9351-70a787df33a4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:07.188394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fdbb4168-a3c6-4b2e-9351-70a787df33a4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:07.188394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fdbb4168-a3c6-4b2e-9351-70a787df33a4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:07.237009 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fdbb4168-a3c6-4b2e-9351-70a787df33a4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c/action" status: 200 len: 24562 microversion: 2.1 time: 0.066125 May 21 22:18:07.238455 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3641/7156] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:18:07 2022] POST /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c/action => generated 24562 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 22:18:18.309115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4fe6b531-1ea6-4e1a-9bd2-64ff60a740e4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:18:18.309765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4fe6b531-1ea6-4e1a-9bd2-64ff60a740e4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:18:18.312085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=40 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:18:18.317884 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4fe6b531-1ea6-4e1a-9bd2-64ff60a740e4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:18.318523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4fe6b531-1ea6-4e1a-9bd2-64ff60a740e4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:18.319321 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4fe6b531-1ea6-4e1a-9bd2-64ff60a740e4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:18.319766 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4fe6b531-1ea6-4e1a-9bd2-64ff60a740e4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:18.344799 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-4fe6b531-1ea6-4e1a-9bd2-64ff60a740e4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lazy-loading 'flavor' on Instance uuid 62b5de77-04bb-4fef-8655-13635fec8e8c {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 22:18:18.605186 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4fe6b531-1ea6-4e1a-9bd2-64ff60a740e4 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c/action" status: 202 len: 0 microversion: 2.1 time: 0.300393 May 21 22:18:18.605766 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3516/7157] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:18:18 2022] POST /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:18:18.614753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e0d18ca2-0cb1-46aa-a863-e7123a309967 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:18:18.615515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e0d18ca2-0cb1-46aa-a863-e7123a309967 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:18:18.618594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:18:18.619559 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=4 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:18:18.625462 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e0d18ca2-0cb1-46aa-a863-e7123a309967 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:18.627098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e0d18ca2-0cb1-46aa-a863-e7123a309967 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:18.627098 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e0d18ca2-0cb1-46aa-a863-e7123a309967 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:18.627305 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e0d18ca2-0cb1-46aa-a863-e7123a309967 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:18.783754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e0d18ca2-0cb1-46aa-a863-e7123a309967 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:18:18.792594 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e0d18ca2-0cb1-46aa-a863-e7123a309967 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 200 len: 1691 microversion: 2.1 time: 0.182199 May 21 22:18:18.793184 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3642/7158] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:18:18 2022] GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:18:19.812257 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-907737c4-3ee7-4682-817b-1cbd40984a45 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:18:19.812926 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-907737c4-3ee7-4682-817b-1cbd40984a45 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:18:19.819423 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-907737c4-3ee7-4682-817b-1cbd40984a45 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:19.819887 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-907737c4-3ee7-4682-817b-1cbd40984a45 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:19.820701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-907737c4-3ee7-4682-817b-1cbd40984a45 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:19.821178 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-907737c4-3ee7-4682-817b-1cbd40984a45 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:19.972485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-907737c4-3ee7-4682-817b-1cbd40984a45 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:18:19.980372 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-907737c4-3ee7-4682-817b-1cbd40984a45 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 200 len: 1674 microversion: 2.1 time: 0.173445 May 21 22:18:19.980947 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3517/7159] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:18:19 2022] GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:18:21.076175 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-905db9a4-0fdc-494f-9aa1-454921d5dc7f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:18:21.077067 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-905db9a4-0fdc-494f-9aa1-454921d5dc7f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:18:21.084443 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-905db9a4-0fdc-494f-9aa1-454921d5dc7f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:21.086598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-905db9a4-0fdc-494f-9aa1-454921d5dc7f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:21.086598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-905db9a4-0fdc-494f-9aa1-454921d5dc7f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:21.086598 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-905db9a4-0fdc-494f-9aa1-454921d5dc7f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:21.136108 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-905db9a4-0fdc-494f-9aa1-454921d5dc7f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c/action" status: 200 len: 38410 microversion: 2.1 time: 0.063772 May 21 22:18:21.137106 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3643/7160] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:18:21 2022] POST /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c/action => generated 38410 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 22:18:21.148179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-aecc123e-51f5-4363-8319-dbd933a855b1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:18:21.148762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-aecc123e-51f5-4363-8319-dbd933a855b1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:18:21.155871 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aecc123e-51f5-4363-8319-dbd933a855b1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:21.156362 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aecc123e-51f5-4363-8319-dbd933a855b1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:21.157152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aecc123e-51f5-4363-8319-dbd933a855b1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:21.157603 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-aecc123e-51f5-4363-8319-dbd933a855b1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:21.376210 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-aecc123e-51f5-4363-8319-dbd933a855b1 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c/action" status: 202 len: 0 microversion: 2.1 time: 0.231835 May 21 22:18:21.377468 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3518/7161] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:18:21 2022] POST /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:18:21.385812 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2a60687d-fbff-44bf-a221-ae6cffd37cbe tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:18:21.386560 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2a60687d-fbff-44bf-a221-ae6cffd37cbe tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:18:21.393790 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a60687d-fbff-44bf-a221-ae6cffd37cbe tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:21.397761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a60687d-fbff-44bf-a221-ae6cffd37cbe tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:21.397761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a60687d-fbff-44bf-a221-ae6cffd37cbe tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:21.397761 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2a60687d-fbff-44bf-a221-ae6cffd37cbe tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:21.579860 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2a60687d-fbff-44bf-a221-ae6cffd37cbe tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:18:21.588128 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2a60687d-fbff-44bf-a221-ae6cffd37cbe tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 200 len: 1680 microversion: 2.1 time: 0.206503 May 21 22:18:21.588774 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3644/7162] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:18:21 2022] GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 1680 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:18:22.607597 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f4da94db-57f4-436b-8de2-7a5932d2debc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:18:22.608334 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f4da94db-57f4-436b-8de2-7a5932d2debc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:18:22.615356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f4da94db-57f4-436b-8de2-7a5932d2debc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:22.615825 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f4da94db-57f4-436b-8de2-7a5932d2debc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:22.616668 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f4da94db-57f4-436b-8de2-7a5932d2debc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:22.617147 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f4da94db-57f4-436b-8de2-7a5932d2debc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:22.769909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f4da94db-57f4-436b-8de2-7a5932d2debc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:18:22.778573 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f4da94db-57f4-436b-8de2-7a5932d2debc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 200 len: 1680 microversion: 2.1 time: 0.176135 May 21 22:18:22.779160 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3519/7163] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:18:22 2022] GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:18:23.797095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cab728cd-bc30-4b7f-b460-af357eeb4f4a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:18:23.797676 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cab728cd-bc30-4b7f-b460-af357eeb4f4a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:18:23.805516 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cab728cd-bc30-4b7f-b460-af357eeb4f4a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:23.810385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cab728cd-bc30-4b7f-b460-af357eeb4f4a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:23.810385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cab728cd-bc30-4b7f-b460-af357eeb4f4a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:23.810385 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cab728cd-bc30-4b7f-b460-af357eeb4f4a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:23.952434 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cab728cd-bc30-4b7f-b460-af357eeb4f4a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:18:23.961312 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cab728cd-bc30-4b7f-b460-af357eeb4f4a tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 200 len: 1683 microversion: 2.1 time: 0.168331 May 21 22:18:23.961877 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3645/7164] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:18:23 2022] GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:18:24.063214 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5548ce5d-007c-4af7-a78d-b506cc985da6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:18:24.064083 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5548ce5d-007c-4af7-a78d-b506cc985da6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:18:24.070742 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5548ce5d-007c-4af7-a78d-b506cc985da6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:24.071197 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5548ce5d-007c-4af7-a78d-b506cc985da6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:24.071972 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5548ce5d-007c-4af7-a78d-b506cc985da6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:24.072466 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5548ce5d-007c-4af7-a78d-b506cc985da6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:24.117044 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5548ce5d-007c-4af7-a78d-b506cc985da6 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "POST /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c/action" status: 200 len: 38410 microversion: 2.1 time: 0.057889 May 21 22:18:24.117943 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3520/7165] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:18:24 2022] POST /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c/action => generated 38410 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 22:18:25.566514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-46aa0e2c-d3ef-41ee-beb7-14fc185a5a91 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:18:25.567259 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-46aa0e2c-d3ef-41ee-beb7-14fc185a5a91 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:18:25.570066 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-f715d5cd-b894-42ca-a4a1-d09a29ca2e92 req-66f80e39-d480-4e92-85bf-a0f75e5e9aca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62b5de77-04bb-4fef-8655-13635fec8e8c", "tag": "f118d9a2-d872-43da-baa6-b05514a3cd97"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:18:25.575335 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46aa0e2c-d3ef-41ee-beb7-14fc185a5a91 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:25.575878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46aa0e2c-d3ef-41ee-beb7-14fc185a5a91 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:25.576779 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46aa0e2c-d3ef-41ee-beb7-14fc185a5a91 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:25.577419 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-46aa0e2c-d3ef-41ee-beb7-14fc185a5a91 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:25.580251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f715d5cd-b894-42ca-a4a1-d09a29ca2e92 req-66f80e39-d480-4e92-85bf-a0f75e5e9aca service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:25.580847 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f715d5cd-b894-42ca-a4a1-d09a29ca2e92 req-66f80e39-d480-4e92-85bf-a0f75e5e9aca service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:25.593072 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-f715d5cd-b894-42ca-a4a1-d09a29ca2e92 req-66f80e39-d480-4e92-85bf-a0f75e5e9aca service nova] Creating event network-changed:f118d9a2-d872-43da-baa6-b05514a3cd97 for instance 62b5de77-04bb-4fef-8655-13635fec8e8c on nch1-master-1 May 21 22:18:25.598732 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-f715d5cd-b894-42ca-a4a1-d09a29ca2e92 req-66f80e39-d480-4e92-85bf-a0f75e5e9aca service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033607 May 21 22:18:25.599965 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3521/7166] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:18:25.606114 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-46aa0e2c-d3ef-41ee-beb7-14fc185a5a91 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 22:18:25.916434 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-46aa0e2c-d3ef-41ee-beb7-14fc185a5a91 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "DELETE /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 204 len: 0 microversion: 2.1 time: 0.352930 May 21 22:18:25.916434 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3646/7167] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:18:25 2022] DELETE /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:18:25.926429 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5ac5e5bc-18de-440c-9812-c483db4dd51f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:18:25.928310 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5ac5e5bc-18de-440c-9812-c483db4dd51f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:18:25.935027 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ac5e5bc-18de-440c-9812-c483db4dd51f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:25.935680 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ac5e5bc-18de-440c-9812-c483db4dd51f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:25.939390 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ac5e5bc-18de-440c-9812-c483db4dd51f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:25.939390 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5ac5e5bc-18de-440c-9812-c483db4dd51f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:26.097252 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5ac5e5bc-18de-440c-9812-c483db4dd51f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:18:26.105847 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5ac5e5bc-18de-440c-9812-c483db4dd51f tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 200 len: 1689 microversion: 2.1 time: 0.184320 May 21 22:18:26.106600 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3522/7168] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:18:25 2022] GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:18:27.126435 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-80819935-186a-41c4-9fc4-6d55fc13b2fc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:18:27.128451 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-80819935-186a-41c4-9fc4-6d55fc13b2fc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:18:27.134429 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80819935-186a-41c4-9fc4-6d55fc13b2fc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:27.134898 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80819935-186a-41c4-9fc4-6d55fc13b2fc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:27.135769 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80819935-186a-41c4-9fc4-6d55fc13b2fc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:27.136228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-80819935-186a-41c4-9fc4-6d55fc13b2fc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:27.420090 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-80819935-186a-41c4-9fc4-6d55fc13b2fc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:18:27.429197 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-80819935-186a-41c4-9fc4-6d55fc13b2fc tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 200 len: 1689 microversion: 2.1 time: 0.307190 May 21 22:18:27.438167 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3647/7169] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:18:27 2022] GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 1689 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:18:27.750834 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:18:27.751077 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 22:18:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:18:27.991018 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-f8c01190-7dd3-4d69-a39b-4ffacd1fbca9 req-5680e3e8-4f6d-482d-841b-c794629a4436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b5de77-04bb-4fef-8655-13635fec8e8c", "name": "network-vif-deleted", "tag": "f118d9a2-d872-43da-baa6-b05514a3cd97"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:18:28.000815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f8c01190-7dd3-4d69-a39b-4ffacd1fbca9 req-5680e3e8-4f6d-482d-841b-c794629a4436 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:28.002354 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-f8c01190-7dd3-4d69-a39b-4ffacd1fbca9 req-5680e3e8-4f6d-482d-841b-c794629a4436 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:28.013415 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-f8c01190-7dd3-4d69-a39b-4ffacd1fbca9 req-5680e3e8-4f6d-482d-841b-c794629a4436 service nova] Creating event network-vif-deleted:f118d9a2-d872-43da-baa6-b05514a3cd97 for instance 62b5de77-04bb-4fef-8655-13635fec8e8c on nch1-master-1 May 21 22:18:28.018474 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-f8c01190-7dd3-4d69-a39b-4ffacd1fbca9 req-5680e3e8-4f6d-482d-841b-c794629a4436 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031734 May 21 22:18:28.019069 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3523/7170] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:18:28.446183 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7ac5838a-3fe4-4b9b-ba7f-75a923bdb0de tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:18:28.446816 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7ac5838a-3fe4-4b9b-ba7f-75a923bdb0de tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:18:28.453880 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ac5838a-3fe4-4b9b-ba7f-75a923bdb0de tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:28.454638 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ac5838a-3fe4-4b9b-ba7f-75a923bdb0de tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:28.455413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ac5838a-3fe4-4b9b-ba7f-75a923bdb0de tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:28.455865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ac5838a-3fe4-4b9b-ba7f-75a923bdb0de tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:28.491824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ac5838a-3fe4-4b9b-ba7f-75a923bdb0de tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:28.492305 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7ac5838a-3fe4-4b9b-ba7f-75a923bdb0de tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:28.492818 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-7ac5838a-3fe4-4b9b-ba7f-75a923bdb0de tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lazy-loading 'fault' on Instance uuid 62b5de77-04bb-4fef-8655-13635fec8e8c {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 22:18:28.538265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7ac5838a-3fe4-4b9b-ba7f-75a923bdb0de tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c726d5d196d64ef3a2470ebc855b00f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c1d1acf8134ddab4e11e933dbeb571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:18:28.545758 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7ac5838a-3fe4-4b9b-ba7f-75a923bdb0de tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 200 len: 1356 microversion: 2.1 time: 0.103828 May 21 22:18:28.546322 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3648/7171] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:18:28 2022] GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 1356 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:18:29.563719 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ec313de1-208b-4e3b-afa0-eff2b737ff82 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:18:29.564458 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-ec313de1-208b-4e3b-afa0-eff2b737ff82 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] [instance: 62b5de77-04bb-4fef-8655-13635fec8e8c] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:18:29.572545 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ec313de1-208b-4e3b-afa0-eff2b737ff82 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:29.572999 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ec313de1-208b-4e3b-afa0-eff2b737ff82 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:29.573779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ec313de1-208b-4e3b-afa0-eff2b737ff82 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:29.574223 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-ec313de1-208b-4e3b-afa0-eff2b737ff82 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:29.588068 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-ec313de1-208b-4e3b-afa0-eff2b737ff82 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] HTTP exception thrown: Instance 62b5de77-04bb-4fef-8655-13635fec8e8c could not be found. May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ec313de1-208b-4e3b-afa0-eff2b737ff82 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Request method failure captured: May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c HTTP/1.1 May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWNUii8Zq6WOyAgXHmbJ3sC5wa94C74ELxknXQJ_SM32Jav6JyvMpyYMVSFhYJ3s1YN1udNzGY1HshTj3s7GT-R1gCzdtKT1r559qWDXMdRUrYXCdFe0fnjc0pP6_57YeQK7_51zGtHqPFGJn1yY7YonKAJ0n7bgpG0NA9tWLAWZZZY May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: 10c1d1acf8134ddab4e11e933dbeb571 May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-351207300 May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/10c1d1acf8134ddab4e11e933dbeb571"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10c1d1acf8134ddab4e11e933dbeb571"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_10c1d1acf8134ddab4e11e933dbeb571", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10c1d1acf8134ddab4e11e933dbeb571"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestNetworkAdvancedServerOps-351207300 May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: 10c1d1acf8134ddab4e11e933dbeb571 May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-351207300 May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestNetworkAdvancedServerOps-351207300-project May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: c726d5d196d64ef3a2470ebc855b00f0 May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestNetworkAdvancedServerOps-351207300-project May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 62b5de77-04bb-4fef-8655-13635fec8e8c could not be found. May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '62b5de77-04bb-4fef-8655-13635fec8e8c'} May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62b5de77-04bb-4fef-8655-13635fec8e8c could not be found. May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62b5de77-04bb-4fef-8655-13635fec8e8c could not be found. May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:18:29.589738 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:18:29.594693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:18:29.594693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:18:29.594693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:18:29.594693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:18:29.594693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:18:29.594693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62b5de77-04bb-4fef-8655-13635fec8e8c could not be found. May 21 22:18:29.594693 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:18:29.594693 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-ec313de1-208b-4e3b-afa0-eff2b737ff82 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Returning 404 to user: Instance 62b5de77-04bb-4fef-8655-13635fec8e8c could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:18:29.594693 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-ec313de1-208b-4e3b-afa0-eff2b737ff82 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c" status: 404 len: 111 microversion: 2.1 time: 0.031733 May 21 22:18:29.594693 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3524/7172] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:18:29 2022] GET /compute/v2.1/servers/62b5de77-04bb-4fef-8655-13635fec8e8c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:18:34.023622 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-62651958-f15d-422d-b3ac-6851fef63735 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] Calling method '.version_select at 0x7fc82cfda3a0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:18:34.099478 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-62651958-f15d-422d-b3ac-6851fef63735 tempest-TestNetworkAdvancedServerOps-351207300 tempest-TestNetworkAdvancedServerOps-351207300-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1169912674" status: 202 len: 0 microversion: 2.1 time: 0.079881 May 21 22:18:34.100076 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3649/7173] 10.222.0.49 () {58 vars in 1283 bytes} [Sat May 21 22:18:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1169912674 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:18:50.197947 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=19 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:18:50.199382 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:18:50.392561 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bff17397-a7b5-4d0f-a284-c1e588ef14d5 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Action: 'create', calling method: .version_select at 0x7fc81ae3a1f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-480713996", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsWS3dsVTSEFMFqn+I3f/WFxRpxdfOUyy2F/2yquuatWYL/DKUm4Z+Y+WIOQeSeAuS6ArcIILamxJpAxy8Q/a2xfbCHM5JzdcJzQo9V8MUB/0mmLV7QzoDAqIJE2/8akw=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:18:50.408083 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-bff17397-a7b5-4d0f-a284-c1e588ef14d5 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Getting quotas for project e815c24f93db46a691126111c7d92a1f. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:18:50.413594 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-bff17397-a7b5-4d0f-a284-c1e588ef14d5 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Getting quotas for user cacdb9b294ad482ba157fbb6ba4889ae and project e815c24f93db46a691126111c7d92a1f. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:18:50.517780 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bff17397-a7b5-4d0f-a284-c1e588ef14d5 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.325865 May 21 22:18:50.521399 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3525/7174] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 22:18:50 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:18:52.928248 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:18:52.929355 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:18:52.933413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e9bf7811-c20d-450d-9252-907a91c07c70 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1138255727", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-480713996", "security_groups": [{"name": "tempest-secgroup-smoke-536338877"}], "networks": [{"uuid": "0a9fca03-59b5-46c9-b88c-7fc8d8b126e5"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:18:53.168590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-e9bf7811-c20d-450d-9252-907a91c07c70 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] validate_networks() for [('0a9fca03-59b5-46c9-b88c-7fc8d8b126e5', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 22:18:53.719931 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e9bf7811-c20d-450d-9252-907a91c07c70 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:18:53.720405 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e9bf7811-c20d-450d-9252-907a91c07c70 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:18:53.720929 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e9bf7811-c20d-450d-9252-907a91c07c70 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:18:53.721357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e9bf7811-c20d-450d-9252-907a91c07c70 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:18:53.721789 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-e9bf7811-c20d-450d-9252-907a91c07c70 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:18:53.731083 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9bf7811-c20d-450d-9252-907a91c07c70 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:53.736917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9bf7811-c20d-450d-9252-907a91c07c70 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:53.736917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9bf7811-c20d-450d-9252-907a91c07c70 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:53.736917 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9bf7811-c20d-450d-9252-907a91c07c70 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:53.752186 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-e9bf7811-c20d-450d-9252-907a91c07c70 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Getting quotas for project e815c24f93db46a691126111c7d92a1f. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:18:53.758744 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-e9bf7811-c20d-450d-9252-907a91c07c70 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Getting quotas for user cacdb9b294ad482ba157fbb6ba4889ae and project e815c24f93db46a691126111c7d92a1f. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:18:53.772829 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e9bf7811-c20d-450d-9252-907a91c07c70 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 22:18:53.775184 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e9bf7811-c20d-450d-9252-907a91c07c70 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 22:18:53.910401 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e9bf7811-c20d-450d-9252-907a91c07c70 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.984137 May 21 22:18:53.911514 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3650/7175] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 22:18:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 22:18:53.922599 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8127fe13-9644-4371-b34f-5e1b688e24a9 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:18:53.923669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8127fe13-9644-4371-b34f-5e1b688e24a9 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:18:54.076994 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8127fe13-9644-4371-b34f-5e1b688e24a9 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:18:54.085887 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8127fe13-9644-4371-b34f-5e1b688e24a9 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1246 microversion: 2.1 time: 0.167283 May 21 22:18:54.086795 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3526/7176] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:18:53 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1246 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:18:55.103448 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-f6077d44-4d54-43fa-8742-50e8e4389087 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:18:55.104762 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-f6077d44-4d54-43fa-8742-50e8e4389087 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:18:55.167805 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-f6077d44-4d54-43fa-8742-50e8e4389087 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:18:55.175528 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-f6077d44-4d54-43fa-8742-50e8e4389087 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1246 microversion: 2.1 time: 0.076515 May 21 22:18:55.176651 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3651/7177] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:18:55 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1246 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:18:56.192942 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dea0376d-8f3d-4c98-a92e-a2e755228f6f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:18:56.193489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dea0376d-8f3d-4c98-a92e-a2e755228f6f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:18:56.202017 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dea0376d-8f3d-4c98-a92e-a2e755228f6f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:56.202483 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dea0376d-8f3d-4c98-a92e-a2e755228f6f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:56.203282 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dea0376d-8f3d-4c98-a92e-a2e755228f6f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:56.203779 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dea0376d-8f3d-4c98-a92e-a2e755228f6f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:56.310006 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dea0376d-8f3d-4c98-a92e-a2e755228f6f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:18:56.317662 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dea0376d-8f3d-4c98-a92e-a2e755228f6f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1306 microversion: 2.1 time: 0.128856 May 21 22:18:56.318251 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3527/7178] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:18:56 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1306 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:18:57.335296 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-935e9736-937c-471c-af56-f1cac3efc6b3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:18:57.342311 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-935e9736-937c-471c-af56-f1cac3efc6b3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:18:57.349609 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-935e9736-937c-471c-af56-f1cac3efc6b3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:57.350271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-935e9736-937c-471c-af56-f1cac3efc6b3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:57.351299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-935e9736-937c-471c-af56-f1cac3efc6b3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:57.351746 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-935e9736-937c-471c-af56-f1cac3efc6b3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:57.505704 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-935e9736-937c-471c-af56-f1cac3efc6b3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:18:57.514153 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-935e9736-937c-471c-af56-f1cac3efc6b3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1371 microversion: 2.1 time: 0.182682 May 21 22:18:57.515091 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3652/7179] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:18:57 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:18:58.266797 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-59bc0c19-5132-4a0d-94fa-f8fcefa72025 req-88bf23fa-b6ed-4109-ba5e-e26d65e105b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b2bd928-bd54-49e2-a296-bce2ddcdb570", "tag": "00e8d23c-9fc1-469c-912c-137643ebc893"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:18:58.274467 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-59bc0c19-5132-4a0d-94fa-f8fcefa72025 req-88bf23fa-b6ed-4109-ba5e-e26d65e105b3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:58.275183 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-59bc0c19-5132-4a0d-94fa-f8fcefa72025 req-88bf23fa-b6ed-4109-ba5e-e26d65e105b3 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:58.290224 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-59bc0c19-5132-4a0d-94fa-f8fcefa72025 req-88bf23fa-b6ed-4109-ba5e-e26d65e105b3 service nova] Creating event network-changed:00e8d23c-9fc1-469c-912c-137643ebc893 for instance 3b2bd928-bd54-49e2-a296-bce2ddcdb570 on nch1-master-1 May 21 22:18:58.295617 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-59bc0c19-5132-4a0d-94fa-f8fcefa72025 req-88bf23fa-b6ed-4109-ba5e-e26d65e105b3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037618 May 21 22:18:58.296198 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3528/7180] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:18:58.531682 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a4bd0495-c2d7-4213-b290-a9469ceb37e2 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:18:58.532370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a4bd0495-c2d7-4213-b290-a9469ceb37e2 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:18:58.540767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a4bd0495-c2d7-4213-b290-a9469ceb37e2 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:58.541558 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a4bd0495-c2d7-4213-b290-a9469ceb37e2 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:58.542029 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a4bd0495-c2d7-4213-b290-a9469ceb37e2 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:58.542514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a4bd0495-c2d7-4213-b290-a9469ceb37e2 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:58.694110 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a4bd0495-c2d7-4213-b290-a9469ceb37e2 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:18:58.702050 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a4bd0495-c2d7-4213-b290-a9469ceb37e2 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1371 microversion: 2.1 time: 0.174436 May 21 22:18:58.702620 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3653/7181] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:18:58 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:18:59.720498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-43f61d56-5f49-4557-9d67-edb5fce3e883 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:18:59.721212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-43f61d56-5f49-4557-9d67-edb5fce3e883 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:18:59.729320 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-43f61d56-5f49-4557-9d67-edb5fce3e883 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:59.741301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-43f61d56-5f49-4557-9d67-edb5fce3e883 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:59.741301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-43f61d56-5f49-4557-9d67-edb5fce3e883 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:18:59.741301 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-43f61d56-5f49-4557-9d67-edb5fce3e883 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:18:59.879024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-43f61d56-5f49-4557-9d67-edb5fce3e883 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:18:59.887135 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-43f61d56-5f49-4557-9d67-edb5fce3e883 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1371 microversion: 2.1 time: 0.170978 May 21 22:18:59.887711 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3529/7182] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:18:59 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:19:00.904796 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a6aecb4e-a7ea-4bc6-83fb-f92f19607d62 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:19:00.905425 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a6aecb4e-a7ea-4bc6-83fb-f92f19607d62 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:19:00.912486 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a6aecb4e-a7ea-4bc6-83fb-f92f19607d62 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:19:00.912951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a6aecb4e-a7ea-4bc6-83fb-f92f19607d62 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:19:00.913733 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a6aecb4e-a7ea-4bc6-83fb-f92f19607d62 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:19:00.915372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a6aecb4e-a7ea-4bc6-83fb-f92f19607d62 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:19:01.068044 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a6aecb4e-a7ea-4bc6-83fb-f92f19607d62 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:19:01.076024 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a6aecb4e-a7ea-4bc6-83fb-f92f19607d62 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1371 microversion: 2.1 time: 0.175148 May 21 22:19:01.080762 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3654/7183] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:19:00 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:19:02.093909 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-837f2265-3058-4840-b783-467ccc7b98da tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:19:02.094543 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-837f2265-3058-4840-b783-467ccc7b98da tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:19:02.101889 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-837f2265-3058-4840-b783-467ccc7b98da tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:19:02.102332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-837f2265-3058-4840-b783-467ccc7b98da tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:19:02.103115 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-837f2265-3058-4840-b783-467ccc7b98da tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:19:02.103564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-837f2265-3058-4840-b783-467ccc7b98da tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:19:02.260800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-837f2265-3058-4840-b783-467ccc7b98da tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:19:02.268578 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-837f2265-3058-4840-b783-467ccc7b98da tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1371 microversion: 2.1 time: 0.178581 May 21 22:19:02.269163 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3530/7184] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:19:02 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:19:03.286119 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-5cbcb360-cb82-4983-b789-4cd5f92170fa tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:19:03.286735 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-5cbcb360-cb82-4983-b789-4cd5f92170fa tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:19:03.294545 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5cbcb360-cb82-4983-b789-4cd5f92170fa tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:19:03.295011 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5cbcb360-cb82-4983-b789-4cd5f92170fa tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:19:03.295797 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5cbcb360-cb82-4983-b789-4cd5f92170fa tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:19:03.296250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-5cbcb360-cb82-4983-b789-4cd5f92170fa tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:19:03.444710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-5cbcb360-cb82-4983-b789-4cd5f92170fa tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:19:03.453187 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-5cbcb360-cb82-4983-b789-4cd5f92170fa tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1371 microversion: 2.1 time: 0.170959 May 21 22:19:03.453824 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3655/7185] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:19:03 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:19:03.547426 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-06680166-9add-4888-b9b7-b2ea243c74c2 req-ffdebfdc-8d6e-4a70-b8b3-e54876bcbc07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2bd928-bd54-49e2-a296-bce2ddcdb570", "name": "network-vif-plugged", "status": "completed", "tag": "00e8d23c-9fc1-469c-912c-137643ebc893"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:19:03.558110 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-06680166-9add-4888-b9b7-b2ea243c74c2 req-ffdebfdc-8d6e-4a70-b8b3-e54876bcbc07 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:19:03.558514 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-06680166-9add-4888-b9b7-b2ea243c74c2 req-ffdebfdc-8d6e-4a70-b8b3-e54876bcbc07 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:19:03.570108 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-06680166-9add-4888-b9b7-b2ea243c74c2 req-ffdebfdc-8d6e-4a70-b8b3-e54876bcbc07 service nova] Creating event network-vif-plugged:00e8d23c-9fc1-469c-912c-137643ebc893 for instance 3b2bd928-bd54-49e2-a296-bce2ddcdb570 on nch1-master-1 May 21 22:19:03.576685 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-06680166-9add-4888-b9b7-b2ea243c74c2 req-ffdebfdc-8d6e-4a70-b8b3-e54876bcbc07 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033154 May 21 22:19:03.577383 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3531/7186] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:19:04.471095 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-37328e2b-de65-4f21-9b7d-ec100849e737 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:19:04.471737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-37328e2b-de65-4f21-9b7d-ec100849e737 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:19:04.473739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:19:04.480628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-37328e2b-de65-4f21-9b7d-ec100849e737 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:19:04.481097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-37328e2b-de65-4f21-9b7d-ec100849e737 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:19:04.487850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-37328e2b-de65-4f21-9b7d-ec100849e737 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:19:04.487850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-37328e2b-de65-4f21-9b7d-ec100849e737 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:19:04.648212 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-37328e2b-de65-4f21-9b7d-ec100849e737 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:19:04.656895 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-37328e2b-de65-4f21-9b7d-ec100849e737 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1371 microversion: 2.1 time: 0.189730 May 21 22:19:04.657468 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3656/7187] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:19:04 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:19:05.672460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:19:05.677460 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cff5447e-bad0-481a-b2b7-b853501fe96f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:19:05.678253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cff5447e-bad0-481a-b2b7-b853501fe96f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:19:05.685407 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cff5447e-bad0-481a-b2b7-b853501fe96f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:19:05.685531 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cff5447e-bad0-481a-b2b7-b853501fe96f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:19:05.686218 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cff5447e-bad0-481a-b2b7-b853501fe96f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:19:05.686666 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cff5447e-bad0-481a-b2b7-b853501fe96f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:19:05.932590 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cff5447e-bad0-481a-b2b7-b853501fe96f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:19:05.940255 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cff5447e-bad0-481a-b2b7-b853501fe96f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1555 microversion: 2.1 time: 0.268948 May 21 22:19:05.940849 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3532/7188] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:19:05 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1555 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:19:05.956869 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fab76fa9-7bcf-4ecf-9e4e-d9b67de802a3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:19:05.957489 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-fab76fa9-7bcf-4ecf-9e4e-d9b67de802a3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:19:05.959393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=8 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:19:05.966275 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fab76fa9-7bcf-4ecf-9e4e-d9b67de802a3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:19:05.966739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fab76fa9-7bcf-4ecf-9e4e-d9b67de802a3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:19:05.968578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fab76fa9-7bcf-4ecf-9e4e-d9b67de802a3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:19:05.968578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-fab76fa9-7bcf-4ecf-9e4e-d9b67de802a3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:19:06.115536 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-fab76fa9-7bcf-4ecf-9e4e-d9b67de802a3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:19:06.123477 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fab76fa9-7bcf-4ecf-9e4e-d9b67de802a3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1555 microversion: 2.1 time: 0.170866 May 21 22:19:06.124082 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3657/7189] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:19:05 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:19:08.356996 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-36e066ed-905d-416b-a710-b6ce77552479 req-f431ad82-8f9d-4f79-819f-1c9de253a644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b2bd928-bd54-49e2-a296-bce2ddcdb570", "tag": "00e8d23c-9fc1-469c-912c-137643ebc893"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:19:08.366121 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-36e066ed-905d-416b-a710-b6ce77552479 req-f431ad82-8f9d-4f79-819f-1c9de253a644 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:19:08.366592 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-36e066ed-905d-416b-a710-b6ce77552479 req-f431ad82-8f9d-4f79-819f-1c9de253a644 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:19:08.378202 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-36e066ed-905d-416b-a710-b6ce77552479 req-f431ad82-8f9d-4f79-819f-1c9de253a644 service nova] Creating event network-changed:00e8d23c-9fc1-469c-912c-137643ebc893 for instance 3b2bd928-bd54-49e2-a296-bce2ddcdb570 on nch1-master-1 May 21 22:19:08.383618 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-36e066ed-905d-416b-a710-b6ce77552479 req-f431ad82-8f9d-4f79-819f-1c9de253a644 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031298 May 21 22:19:08.385324 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3533/7190] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:20:06.657852 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:20:06.658462 ncdv-master-1 devstack@n-api.service[131278]: Sat May 21 22:20:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:20:45.037178 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:20:45.037742 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 22:20:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:21:02.597632 ncdv-master-1 devstack@n-api.service[131277]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5f720f21-082c-449e-9bd7-36d6581a2009] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 21 22:21:02.598977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:21:02.599903 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=38 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:21:02.603865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-552295a1-57c9-4446-86fa-6fc1200d7247 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:21:02.604550 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-552295a1-57c9-4446-86fa-6fc1200d7247 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:02.610686 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-552295a1-57c9-4446-86fa-6fc1200d7247 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:02.611161 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-552295a1-57c9-4446-86fa-6fc1200d7247 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:02.611949 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-552295a1-57c9-4446-86fa-6fc1200d7247 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:02.612450 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-552295a1-57c9-4446-86fa-6fc1200d7247 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:02.636357 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-552295a1-57c9-4446-86fa-6fc1200d7247 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lazy-loading 'flavor' on Instance uuid 3b2bd928-bd54-49e2-a296-bce2ddcdb570 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 22:21:03.282241 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-552295a1-57c9-4446-86fa-6fc1200d7247 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "POST /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570/action" status: 202 len: 0 microversion: 2.1 time: 0.686566 May 21 22:21:03.283082 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3658/7191] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:21:02 2022] POST /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570/action => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:21:03.290174 ncdv-master-1 devstack@n-api.service[131278]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c228418-8689-4977-b0bb-d0fe96d67aa9] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 21 22:21:03.291066 ncdv-master-1 devstack@n-api.service[131278]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7e4f995f-1c03-418a-9049-52ff0456baf3] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 21 22:21:03.291684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:21:03.292484 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=30 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:21:03.297015 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b2294fce-4a42-4f7b-abcf-58ba6203ef6f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:03.297727 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b2294fce-4a42-4f7b-abcf-58ba6203ef6f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:03.304643 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2294fce-4a42-4f7b-abcf-58ba6203ef6f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:03.306080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2294fce-4a42-4f7b-abcf-58ba6203ef6f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:03.306080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2294fce-4a42-4f7b-abcf-58ba6203ef6f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:03.306455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b2294fce-4a42-4f7b-abcf-58ba6203ef6f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:03.456979 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b2294fce-4a42-4f7b-abcf-58ba6203ef6f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:03.465590 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b2294fce-4a42-4f7b-abcf-58ba6203ef6f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1679 microversion: 2.1 time: 0.177486 May 21 22:21:03.466232 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3534/7192] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:03 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:04.485765 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bcbdf20e-f853-4668-814a-5786761c34ff tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:04.486518 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bcbdf20e-f853-4668-814a-5786761c34ff tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:04.495063 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bcbdf20e-f853-4668-814a-5786761c34ff tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:04.495564 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bcbdf20e-f853-4668-814a-5786761c34ff tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:04.496388 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bcbdf20e-f853-4668-814a-5786761c34ff tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:04.496853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bcbdf20e-f853-4668-814a-5786761c34ff tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:04.502704 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] [5f720f21-082c-449e-9bd7-36d6581a2009] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 41850. May 21 22:21:04.648945 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bcbdf20e-f853-4668-814a-5786761c34ff tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:04.657321 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bcbdf20e-f853-4668-814a-5786761c34ff tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1679 microversion: 2.1 time: 0.177228 May 21 22:21:04.657939 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3659/7193] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:04 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:05.675112 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7aec3a96-25f7-4ff7-a781-0caab4b981fa tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:05.675688 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7aec3a96-25f7-4ff7-a781-0caab4b981fa tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:05.695037 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7aec3a96-25f7-4ff7-a781-0caab4b981fa tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:05.699669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7aec3a96-25f7-4ff7-a781-0caab4b981fa tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:05.699669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7aec3a96-25f7-4ff7-a781-0caab4b981fa tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:05.699669 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7aec3a96-25f7-4ff7-a781-0caab4b981fa tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:05.699669 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] [7e4f995f-1c03-418a-9049-52ff0456baf3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 41858. May 21 22:21:05.703485 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c228418-8689-4977-b0bb-d0fe96d67aa9] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 41856. May 21 22:21:05.849733 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7aec3a96-25f7-4ff7-a781-0caab4b981fa tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:05.857681 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7aec3a96-25f7-4ff7-a781-0caab4b981fa tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1679 microversion: 2.1 time: 0.186593 May 21 22:21:05.858297 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3535/7194] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:05 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1679 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:06.875654 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bd6579f4-eb4e-44db-88ba-19d0c4950bb6 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:06.876308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bd6579f4-eb4e-44db-88ba-19d0c4950bb6 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:06.884249 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd6579f4-eb4e-44db-88ba-19d0c4950bb6 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:06.884741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd6579f4-eb4e-44db-88ba-19d0c4950bb6 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:06.885524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd6579f4-eb4e-44db-88ba-19d0c4950bb6 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:06.885973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bd6579f4-eb4e-44db-88ba-19d0c4950bb6 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:07.034314 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bd6579f4-eb4e-44db-88ba-19d0c4950bb6 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:07.042060 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bd6579f4-eb4e-44db-88ba-19d0c4950bb6 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1679 microversion: 2.1 time: 0.170310 May 21 22:21:07.042634 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3660/7195] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:06 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:08.061248 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f44812d7-8d33-4779-805f-5088246a6570 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:08.062278 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f44812d7-8d33-4779-805f-5088246a6570 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:08.073250 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f44812d7-8d33-4779-805f-5088246a6570 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:08.073949 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f44812d7-8d33-4779-805f-5088246a6570 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:08.075291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f44812d7-8d33-4779-805f-5088246a6570 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:08.076001 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-f44812d7-8d33-4779-805f-5088246a6570 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:08.222683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f44812d7-8d33-4779-805f-5088246a6570 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:08.231324 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f44812d7-8d33-4779-805f-5088246a6570 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1679 microversion: 2.1 time: 0.175894 May 21 22:21:08.231907 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3536/7196] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:08 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:09.248655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d35bb708-ed63-416c-a18d-33cb8134cbf1 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:09.249288 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d35bb708-ed63-416c-a18d-33cb8134cbf1 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:09.257051 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d35bb708-ed63-416c-a18d-33cb8134cbf1 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:09.257520 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d35bb708-ed63-416c-a18d-33cb8134cbf1 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:09.258308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d35bb708-ed63-416c-a18d-33cb8134cbf1 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:09.258764 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d35bb708-ed63-416c-a18d-33cb8134cbf1 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:09.410333 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d35bb708-ed63-416c-a18d-33cb8134cbf1 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:09.421737 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d35bb708-ed63-416c-a18d-33cb8134cbf1 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1679 microversion: 2.1 time: 0.176842 May 21 22:21:09.422371 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3661/7197] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:09 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:10.443251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-feca9286-0873-4946-83b4-2336cd965ab0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:10.443883 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-feca9286-0873-4946-83b4-2336cd965ab0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:10.451291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-feca9286-0873-4946-83b4-2336cd965ab0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:10.451761 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-feca9286-0873-4946-83b4-2336cd965ab0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:10.452582 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-feca9286-0873-4946-83b4-2336cd965ab0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:10.453032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-feca9286-0873-4946-83b4-2336cd965ab0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:10.614113 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-feca9286-0873-4946-83b4-2336cd965ab0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:10.621797 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-feca9286-0873-4946-83b4-2336cd965ab0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1679 microversion: 2.1 time: 0.182666 May 21 22:21:10.622369 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3537/7198] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:10 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:11.639086 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-82cf2163-c0ef-4fc6-9d3a-33fdbe906f0c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:11.639775 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-82cf2163-c0ef-4fc6-9d3a-33fdbe906f0c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:11.647478 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82cf2163-c0ef-4fc6-9d3a-33fdbe906f0c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:11.647939 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82cf2163-c0ef-4fc6-9d3a-33fdbe906f0c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:11.648851 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82cf2163-c0ef-4fc6-9d3a-33fdbe906f0c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:11.649306 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-82cf2163-c0ef-4fc6-9d3a-33fdbe906f0c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:11.799583 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-82cf2163-c0ef-4fc6-9d3a-33fdbe906f0c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:11.807279 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-82cf2163-c0ef-4fc6-9d3a-33fdbe906f0c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1679 microversion: 2.1 time: 0.172152 May 21 22:21:11.807850 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3662/7199] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:11 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:12.824708 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-728c5bda-9354-4b84-8fa5-261d22f3801c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:12.825332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-728c5bda-9354-4b84-8fa5-261d22f3801c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:12.832482 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-728c5bda-9354-4b84-8fa5-261d22f3801c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:12.833436 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-728c5bda-9354-4b84-8fa5-261d22f3801c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:12.833970 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-728c5bda-9354-4b84-8fa5-261d22f3801c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:12.834415 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-728c5bda-9354-4b84-8fa5-261d22f3801c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:12.980890 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-728c5bda-9354-4b84-8fa5-261d22f3801c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:12.989178 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-728c5bda-9354-4b84-8fa5-261d22f3801c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1679 microversion: 2.1 time: 0.167774 May 21 22:21:12.989937 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3538/7200] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:12 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:14.007470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-32dbe96a-b96b-40d0-94c2-a84f3bd72b39 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:14.008103 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-32dbe96a-b96b-40d0-94c2-a84f3bd72b39 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:14.015465 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32dbe96a-b96b-40d0-94c2-a84f3bd72b39 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:14.015934 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32dbe96a-b96b-40d0-94c2-a84f3bd72b39 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:14.016753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32dbe96a-b96b-40d0-94c2-a84f3bd72b39 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:14.017213 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32dbe96a-b96b-40d0-94c2-a84f3bd72b39 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:14.162902 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-32dbe96a-b96b-40d0-94c2-a84f3bd72b39 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:14.170572 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-32dbe96a-b96b-40d0-94c2-a84f3bd72b39 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1700 microversion: 2.1 time: 0.167842 May 21 22:21:14.171355 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3663/7201] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:14 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1700 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:15.187752 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-56a9ac52-a45e-4a1c-8cb5-9c4b81b73db0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:15.188419 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-56a9ac52-a45e-4a1c-8cb5-9c4b81b73db0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:15.195836 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-56a9ac52-a45e-4a1c-8cb5-9c4b81b73db0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:15.196294 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-56a9ac52-a45e-4a1c-8cb5-9c4b81b73db0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:15.197080 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-56a9ac52-a45e-4a1c-8cb5-9c4b81b73db0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:15.197529 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-56a9ac52-a45e-4a1c-8cb5-9c4b81b73db0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:15.343069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-56a9ac52-a45e-4a1c-8cb5-9c4b81b73db0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:15.351469 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-56a9ac52-a45e-4a1c-8cb5-9c4b81b73db0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1700 microversion: 2.1 time: 0.167656 May 21 22:21:15.352046 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3539/7202] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:15 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1700 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:16.368703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-67cfa890-bb42-45d0-b1d4-4ba4cf2bfa1d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:16.369344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-67cfa890-bb42-45d0-b1d4-4ba4cf2bfa1d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:16.376923 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67cfa890-bb42-45d0-b1d4-4ba4cf2bfa1d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:16.377391 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67cfa890-bb42-45d0-b1d4-4ba4cf2bfa1d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:16.378193 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67cfa890-bb42-45d0-b1d4-4ba4cf2bfa1d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:16.378655 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-67cfa890-bb42-45d0-b1d4-4ba4cf2bfa1d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:16.538662 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-67cfa890-bb42-45d0-b1d4-4ba4cf2bfa1d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:16.548054 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-67cfa890-bb42-45d0-b1d4-4ba4cf2bfa1d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1695 microversion: 2.1 time: 0.183252 May 21 22:21:16.548804 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3664/7203] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:16 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1695 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:21:17.566970 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0cd2fd41-77db-47e4-b53e-b8f0e08eafdb tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:17.568226 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0cd2fd41-77db-47e4-b53e-b8f0e08eafdb tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:17.576672 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd41-77db-47e4-b53e-b8f0e08eafdb tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:17.577368 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd41-77db-47e4-b53e-b8f0e08eafdb tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:17.578351 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd41-77db-47e4-b53e-b8f0e08eafdb tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:17.578792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd41-77db-47e4-b53e-b8f0e08eafdb tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:17.757533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0cd2fd41-77db-47e4-b53e-b8f0e08eafdb tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:17.765609 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0cd2fd41-77db-47e4-b53e-b8f0e08eafdb tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1695 microversion: 2.1 time: 0.202537 May 21 22:21:17.775260 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3540/7204] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:17 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1695 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:18.107192 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-587643e7-08a9-46ae-a681-df80abae9ec3 req-25604105-9bc1-465b-b5ac-39653e3919b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2bd928-bd54-49e2-a296-bce2ddcdb570", "name": "network-vif-plugged", "status": "completed", "tag": "00e8d23c-9fc1-469c-912c-137643ebc893"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:21:18.118470 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-587643e7-08a9-46ae-a681-df80abae9ec3 req-25604105-9bc1-465b-b5ac-39653e3919b1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:18.119279 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-587643e7-08a9-46ae-a681-df80abae9ec3 req-25604105-9bc1-465b-b5ac-39653e3919b1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:18.134038 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-587643e7-08a9-46ae-a681-df80abae9ec3 req-25604105-9bc1-465b-b5ac-39653e3919b1 service nova] Creating event network-vif-plugged:00e8d23c-9fc1-469c-912c-137643ebc893 for instance 3b2bd928-bd54-49e2-a296-bce2ddcdb570 on nch1-master-1 May 21 22:21:18.141490 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-587643e7-08a9-46ae-a681-df80abae9ec3 req-25604105-9bc1-465b-b5ac-39653e3919b1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042607 May 21 22:21:18.142403 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3665/7205] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:21:18.783328 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2c7b8dd2-43f7-412f-a5d6-7c4df5f9dee5 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:18.784267 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2c7b8dd2-43f7-412f-a5d6-7c4df5f9dee5 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:18.792171 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c7b8dd2-43f7-412f-a5d6-7c4df5f9dee5 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:18.792684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c7b8dd2-43f7-412f-a5d6-7c4df5f9dee5 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:18.793503 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c7b8dd2-43f7-412f-a5d6-7c4df5f9dee5 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:18.794304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2c7b8dd2-43f7-412f-a5d6-7c4df5f9dee5 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:18.952096 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2c7b8dd2-43f7-412f-a5d6-7c4df5f9dee5 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:18.964809 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2c7b8dd2-43f7-412f-a5d6-7c4df5f9dee5 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1695 microversion: 2.1 time: 0.185667 May 21 22:21:18.974361 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3541/7206] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:18 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1695 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:19.983397 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d16e6eaa-e1b5-48cb-beee-d2488b850055 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:19.985072 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d16e6eaa-e1b5-48cb-beee-d2488b850055 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:19.992760 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d16e6eaa-e1b5-48cb-beee-d2488b850055 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:19.993229 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d16e6eaa-e1b5-48cb-beee-d2488b850055 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:19.994025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d16e6eaa-e1b5-48cb-beee-d2488b850055 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:19.994511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d16e6eaa-e1b5-48cb-beee-d2488b850055 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:20.186069 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d16e6eaa-e1b5-48cb-beee-d2488b850055 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:20.199957 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d16e6eaa-e1b5-48cb-beee-d2488b850055 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1695 microversion: 2.1 time: 0.221574 May 21 22:21:20.200910 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3666/7207] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:19 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1695 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:21.219020 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-33e1e8c2-d354-4e01-b37c-ca5abed41879 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:21.220379 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-33e1e8c2-d354-4e01-b37c-ca5abed41879 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:21.231437 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33e1e8c2-d354-4e01-b37c-ca5abed41879 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:21.231960 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33e1e8c2-d354-4e01-b37c-ca5abed41879 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:21.232829 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33e1e8c2-d354-4e01-b37c-ca5abed41879 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:21.233283 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-33e1e8c2-d354-4e01-b37c-ca5abed41879 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:21.403332 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-33e1e8c2-d354-4e01-b37c-ca5abed41879 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:21.411360 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-33e1e8c2-d354-4e01-b37c-ca5abed41879 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1695 microversion: 2.1 time: 0.196195 May 21 22:21:21.412243 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3542/7208] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:21 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1695 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:22.429911 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d3bf6f12-05a3-4c83-8add-b0638381af38 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:22.430536 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d3bf6f12-05a3-4c83-8add-b0638381af38 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:22.438035 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3bf6f12-05a3-4c83-8add-b0638381af38 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:22.438509 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3bf6f12-05a3-4c83-8add-b0638381af38 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:22.439344 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3bf6f12-05a3-4c83-8add-b0638381af38 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:22.439800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d3bf6f12-05a3-4c83-8add-b0638381af38 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:22.601871 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d3bf6f12-05a3-4c83-8add-b0638381af38 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:22.612153 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d3bf6f12-05a3-4c83-8add-b0638381af38 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1695 microversion: 2.1 time: 0.186256 May 21 22:21:22.612818 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3667/7209] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:22 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:23.630720 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-47a9cf4a-64d1-4ccd-bc8a-a73e44f20726 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:23.632331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-47a9cf4a-64d1-4ccd-bc8a-a73e44f20726 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:23.639123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-47a9cf4a-64d1-4ccd-bc8a-a73e44f20726 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:23.639679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-47a9cf4a-64d1-4ccd-bc8a-a73e44f20726 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:23.640576 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-47a9cf4a-64d1-4ccd-bc8a-a73e44f20726 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:23.641238 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-47a9cf4a-64d1-4ccd-bc8a-a73e44f20726 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:23.828683 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-47a9cf4a-64d1-4ccd-bc8a-a73e44f20726 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:23.838375 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-47a9cf4a-64d1-4ccd-bc8a-a73e44f20726 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1695 microversion: 2.1 time: 0.212156 May 21 22:21:23.848114 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3543/7210] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:23 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1695 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:24.855467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d6eb7bf0-70ff-4ea3-a4ad-2f6900724082 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:24.856754 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d6eb7bf0-70ff-4ea3-a4ad-2f6900724082 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:24.864390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6eb7bf0-70ff-4ea3-a4ad-2f6900724082 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:24.864856 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6eb7bf0-70ff-4ea3-a4ad-2f6900724082 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:24.865677 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6eb7bf0-70ff-4ea3-a4ad-2f6900724082 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:24.866518 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6eb7bf0-70ff-4ea3-a4ad-2f6900724082 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:25.032305 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d6eb7bf0-70ff-4ea3-a4ad-2f6900724082 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:25.041129 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d6eb7bf0-70ff-4ea3-a4ad-2f6900724082 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1695 microversion: 2.1 time: 0.189650 May 21 22:21:25.042073 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3668/7211] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:24 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1695 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:26.058378 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6207e58d-a59c-4d5e-99a1-fc62ec8b9ac0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:26.059082 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6207e58d-a59c-4d5e-99a1-fc62ec8b9ac0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:26.077895 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6207e58d-a59c-4d5e-99a1-fc62ec8b9ac0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:26.078365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6207e58d-a59c-4d5e-99a1-fc62ec8b9ac0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:26.079180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6207e58d-a59c-4d5e-99a1-fc62ec8b9ac0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:26.079635 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6207e58d-a59c-4d5e-99a1-fc62ec8b9ac0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:26.250365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6207e58d-a59c-4d5e-99a1-fc62ec8b9ac0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:26.259042 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6207e58d-a59c-4d5e-99a1-fc62ec8b9ac0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1695 microversion: 2.1 time: 0.204926 May 21 22:21:26.259639 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3544/7212] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:26 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1695 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:27.277983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1817ebd7-8ae0-46f3-9562-e2b506d1bb05 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:27.278618 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1817ebd7-8ae0-46f3-9562-e2b506d1bb05 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:27.285767 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1817ebd7-8ae0-46f3-9562-e2b506d1bb05 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:27.286237 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1817ebd7-8ae0-46f3-9562-e2b506d1bb05 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:27.287023 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1817ebd7-8ae0-46f3-9562-e2b506d1bb05 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:27.287591 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-1817ebd7-8ae0-46f3-9562-e2b506d1bb05 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:27.435463 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1817ebd7-8ae0-46f3-9562-e2b506d1bb05 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:27.443202 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1817ebd7-8ae0-46f3-9562-e2b506d1bb05 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1695 microversion: 2.1 time: 0.169204 May 21 22:21:27.444561 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3669/7213] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:27 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:28.462496 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-adddb531-ef44-4e23-8c14-b8d48537a448 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:28.463121 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-adddb531-ef44-4e23-8c14-b8d48537a448 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:28.470229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-adddb531-ef44-4e23-8c14-b8d48537a448 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:28.470710 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-adddb531-ef44-4e23-8c14-b8d48537a448 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:28.471551 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-adddb531-ef44-4e23-8c14-b8d48537a448 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:28.471993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-adddb531-ef44-4e23-8c14-b8d48537a448 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:28.623447 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-adddb531-ef44-4e23-8c14-b8d48537a448 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:28.631729 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-adddb531-ef44-4e23-8c14-b8d48537a448 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1677 microversion: 2.1 time: 0.174001 May 21 22:21:28.632447 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3545/7214] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:28 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:29.648827 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d6b56bdb-df62-43a8-9cc7-efba04112c29 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:29.649504 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d6b56bdb-df62-43a8-9cc7-efba04112c29 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:29.656578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6b56bdb-df62-43a8-9cc7-efba04112c29 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:29.659519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6b56bdb-df62-43a8-9cc7-efba04112c29 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:29.659519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6b56bdb-df62-43a8-9cc7-efba04112c29 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:29.659519 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d6b56bdb-df62-43a8-9cc7-efba04112c29 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:29.812396 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d6b56bdb-df62-43a8-9cc7-efba04112c29 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:29.821118 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d6b56bdb-df62-43a8-9cc7-efba04112c29 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1677 microversion: 2.1 time: 0.176394 May 21 22:21:29.821648 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3670/7215] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:29 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:30.839417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e857eff7-039e-4051-9d2a-839a4081956e tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:30.840051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e857eff7-039e-4051-9d2a-839a4081956e tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:30.847305 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e857eff7-039e-4051-9d2a-839a4081956e tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:30.847758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e857eff7-039e-4051-9d2a-839a4081956e tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:30.848567 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e857eff7-039e-4051-9d2a-839a4081956e tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:30.849015 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e857eff7-039e-4051-9d2a-839a4081956e tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:30.992980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e857eff7-039e-4051-9d2a-839a4081956e tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:31.000619 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e857eff7-039e-4051-9d2a-839a4081956e tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1620 microversion: 2.1 time: 0.165250 May 21 22:21:31.001198 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3546/7216] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:30 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1620 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:31.017703 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-4e88feb5-b4a8-4105-9007-bd985f5fa3e2 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:21:31.018301 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-4e88feb5-b4a8-4105-9007-bd985f5fa3e2 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:31.026158 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e88feb5-b4a8-4105-9007-bd985f5fa3e2 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:31.026628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e88feb5-b4a8-4105-9007-bd985f5fa3e2 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:31.027414 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e88feb5-b4a8-4105-9007-bd985f5fa3e2 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:31.027882 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-4e88feb5-b4a8-4105-9007-bd985f5fa3e2 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:31.320656 ncdv-master-1 devstack@n-api.service[131277]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4e88feb5-b4a8-4105-9007-bd985f5fa3e2 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [b1d94092-e38a-4843-b35e-bbe70f3a0443] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 21 22:21:32.080068 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-67b52e75-1279-4a55-876d-cf0bae7a1e32 req-a83e2063-bad8-4851-a30f-b1e744fcef13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2bd928-bd54-49e2-a296-bce2ddcdb570", "name": "network-vif-unplugged", "status": "completed", "tag": "00e8d23c-9fc1-469c-912c-137643ebc893"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:21:32.089912 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-67b52e75-1279-4a55-876d-cf0bae7a1e32 req-a83e2063-bad8-4851-a30f-b1e744fcef13 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:32.090455 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-67b52e75-1279-4a55-876d-cf0bae7a1e32 req-a83e2063-bad8-4851-a30f-b1e744fcef13 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:32.102144 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.compute.server_external_events [req-67b52e75-1279-4a55-876d-cf0bae7a1e32 req-a83e2063-bad8-4851-a30f-b1e744fcef13 service nova] Unable to find a host for instance 3b2bd928-bd54-49e2-a296-bce2ddcdb570. Dropping event network-vif-unplugged {{(pid=131278) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 21 22:21:32.103042 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-67b52e75-1279-4a55-876d-cf0bae7a1e32 req-a83e2063-bad8-4851-a30f-b1e744fcef13 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027298 May 21 22:21:32.103639 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3547/7217] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 21 22:21:32.329110 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [None req-4e88feb5-b4a8-4105-9007-bd985f5fa3e2 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [b1d94092-e38a-4843-b35e-bbe70f3a0443] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 41960. May 21 22:21:32.332187 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-4e88feb5-b4a8-4105-9007-bd985f5fa3e2 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "POST /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570/action" status: 202 len: 0 microversion: 2.1 time: 1.318460 May 21 22:21:32.333733 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3671/7218] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:21:31 2022] POST /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570/action => generated 0 bytes in 1321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:21:32.342163 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6e92974f-5ad1-4ac7-acbe-42a7a4c0187c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:32.342802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6e92974f-5ad1-4ac7-acbe-42a7a4c0187c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:32.348972 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e92974f-5ad1-4ac7-acbe-42a7a4c0187c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:32.349435 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e92974f-5ad1-4ac7-acbe-42a7a4c0187c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:32.350760 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e92974f-5ad1-4ac7-acbe-42a7a4c0187c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:32.351213 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6e92974f-5ad1-4ac7-acbe-42a7a4c0187c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:32.505377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6e92974f-5ad1-4ac7-acbe-42a7a4c0187c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:32.513696 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6e92974f-5ad1-4ac7-acbe-42a7a4c0187c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1628 microversion: 2.1 time: 0.175522 May 21 22:21:32.514279 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3548/7219] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:32 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1628 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:33.532177 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bb35d63d-bd46-4d6e-b485-ed68e9ca88b1 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:33.532842 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bb35d63d-bd46-4d6e-b485-ed68e9ca88b1 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:33.535737 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=31 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:21:33.541407 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb35d63d-bd46-4d6e-b485-ed68e9ca88b1 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:33.541885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb35d63d-bd46-4d6e-b485-ed68e9ca88b1 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:33.543352 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb35d63d-bd46-4d6e-b485-ed68e9ca88b1 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:33.543811 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bb35d63d-bd46-4d6e-b485-ed68e9ca88b1 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:33.549328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:21:33.697518 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bb35d63d-bd46-4d6e-b485-ed68e9ca88b1 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:33.705228 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bb35d63d-bd46-4d6e-b485-ed68e9ca88b1 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1628 microversion: 2.1 time: 0.178032 May 21 22:21:33.709707 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3672/7220] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:33 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1628 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:21:34.723025 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-8ef8cca2-2779-4852-b34a-8cc60277578c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:34.723788 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-8ef8cca2-2779-4852-b34a-8cc60277578c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:34.728306 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=31 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:21:34.731886 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8ef8cca2-2779-4852-b34a-8cc60277578c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:34.732373 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8ef8cca2-2779-4852-b34a-8cc60277578c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:34.733180 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8ef8cca2-2779-4852-b34a-8cc60277578c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:34.733637 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-8ef8cca2-2779-4852-b34a-8cc60277578c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:34.737913 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=87 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:21:34.891417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-8ef8cca2-2779-4852-b34a-8cc60277578c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:34.899921 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-8ef8cca2-2779-4852-b34a-8cc60277578c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1686 microversion: 2.1 time: 0.180872 May 21 22:21:34.900536 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3549/7221] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:34 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1686 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:35.918649 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c6d2c8f9-6a0e-4b81-8c69-742f8d405b03 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:35.919281 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c6d2c8f9-6a0e-4b81-8c69-742f8d405b03 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:35.926472 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6d2c8f9-6a0e-4b81-8c69-742f8d405b03 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:35.926946 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6d2c8f9-6a0e-4b81-8c69-742f8d405b03 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:35.927788 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6d2c8f9-6a0e-4b81-8c69-742f8d405b03 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:35.928257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c6d2c8f9-6a0e-4b81-8c69-742f8d405b03 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:36.104575 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c6d2c8f9-6a0e-4b81-8c69-742f8d405b03 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:36.112513 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c6d2c8f9-6a0e-4b81-8c69-742f8d405b03 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1686 microversion: 2.1 time: 0.198218 May 21 22:21:36.113099 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3673/7222] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:35 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1686 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:37.133153 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3c511980-0e6d-4a94-a351-bbcf0b7b39a3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:37.137092 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3c511980-0e6d-4a94-a351-bbcf0b7b39a3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:37.140609 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3c511980-0e6d-4a94-a351-bbcf0b7b39a3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:37.141071 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3c511980-0e6d-4a94-a351-bbcf0b7b39a3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:37.141857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3c511980-0e6d-4a94-a351-bbcf0b7b39a3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:37.142304 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3c511980-0e6d-4a94-a351-bbcf0b7b39a3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:37.296491 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3c511980-0e6d-4a94-a351-bbcf0b7b39a3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:37.305263 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3c511980-0e6d-4a94-a351-bbcf0b7b39a3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1686 microversion: 2.1 time: 0.176583 May 21 22:21:37.305810 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3550/7223] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:37 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1686 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:38.322730 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-994fe082-2965-49d7-8b09-f7cba7f5636a tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:38.323271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-994fe082-2965-49d7-8b09-f7cba7f5636a tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:38.330387 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-994fe082-2965-49d7-8b09-f7cba7f5636a tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:38.330851 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-994fe082-2965-49d7-8b09-f7cba7f5636a tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:38.331625 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-994fe082-2965-49d7-8b09-f7cba7f5636a tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:38.332076 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-994fe082-2965-49d7-8b09-f7cba7f5636a tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:38.514594 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-994fe082-2965-49d7-8b09-f7cba7f5636a tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:38.529193 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-994fe082-2965-49d7-8b09-f7cba7f5636a tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1686 microversion: 2.1 time: 0.208239 May 21 22:21:38.540396 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3674/7224] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:38 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1686 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:39.552253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-256a90fd-ef62-4c8f-81b9-d3ca9b870757 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:39.554308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-256a90fd-ef62-4c8f-81b9-d3ca9b870757 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:39.563957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-256a90fd-ef62-4c8f-81b9-d3ca9b870757 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:39.565039 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-256a90fd-ef62-4c8f-81b9-d3ca9b870757 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:39.565917 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-256a90fd-ef62-4c8f-81b9-d3ca9b870757 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:39.566559 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-256a90fd-ef62-4c8f-81b9-d3ca9b870757 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:39.741284 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-256a90fd-ef62-4c8f-81b9-d3ca9b870757 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:39.749351 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-256a90fd-ef62-4c8f-81b9-d3ca9b870757 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1686 microversion: 2.1 time: 0.205417 May 21 22:21:39.750004 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3551/7225] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:39 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1686 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:40.769281 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-d03e6d4d-794a-4d07-9b6f-5b13a8f22292 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:40.770091 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-d03e6d4d-794a-4d07-9b6f-5b13a8f22292 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:40.778717 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d03e6d4d-794a-4d07-9b6f-5b13a8f22292 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:40.779256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d03e6d4d-794a-4d07-9b6f-5b13a8f22292 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:40.780004 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d03e6d4d-794a-4d07-9b6f-5b13a8f22292 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:40.780581 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-d03e6d4d-794a-4d07-9b6f-5b13a8f22292 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:40.945210 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-d03e6d4d-794a-4d07-9b6f-5b13a8f22292 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:40.955475 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-d03e6d4d-794a-4d07-9b6f-5b13a8f22292 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1686 microversion: 2.1 time: 0.189898 May 21 22:21:40.961689 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3675/7226] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:40 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1686 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:41.974325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-5507f2c2-130d-4bac-b9d2-9bb22f7492f3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:41.975212 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-5507f2c2-130d-4bac-b9d2-9bb22f7492f3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:41.987516 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5507f2c2-130d-4bac-b9d2-9bb22f7492f3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:41.989508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5507f2c2-130d-4bac-b9d2-9bb22f7492f3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:41.989508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5507f2c2-130d-4bac-b9d2-9bb22f7492f3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:41.989508 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-5507f2c2-130d-4bac-b9d2-9bb22f7492f3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:42.143196 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-5507f2c2-130d-4bac-b9d2-9bb22f7492f3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:42.152515 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-5507f2c2-130d-4bac-b9d2-9bb22f7492f3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1686 microversion: 2.1 time: 0.182029 May 21 22:21:42.153105 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3552/7227] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:41 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1686 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:43.170656 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-509dc309-e6e1-403f-a1bb-3bb52a9d83d3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:43.171285 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-509dc309-e6e1-403f-a1bb-3bb52a9d83d3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:43.178844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-509dc309-e6e1-403f-a1bb-3bb52a9d83d3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:43.179294 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-509dc309-e6e1-403f-a1bb-3bb52a9d83d3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:43.180073 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-509dc309-e6e1-403f-a1bb-3bb52a9d83d3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:43.180549 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-509dc309-e6e1-403f-a1bb-3bb52a9d83d3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:43.331413 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-509dc309-e6e1-403f-a1bb-3bb52a9d83d3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:43.339591 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-509dc309-e6e1-403f-a1bb-3bb52a9d83d3 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1686 microversion: 2.1 time: 0.172993 May 21 22:21:43.340165 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3676/7228] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:43 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:44.356856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4ea68bbb-a74d-4940-bb23-c3b5adb4e8a9 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:44.357415 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-4ea68bbb-a74d-4940-bb23-c3b5adb4e8a9 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:44.364506 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4ea68bbb-a74d-4940-bb23-c3b5adb4e8a9 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:44.365495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4ea68bbb-a74d-4940-bb23-c3b5adb4e8a9 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:44.366462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4ea68bbb-a74d-4940-bb23-c3b5adb4e8a9 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:44.366908 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-4ea68bbb-a74d-4940-bb23-c3b5adb4e8a9 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:44.515727 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-4ea68bbb-a74d-4940-bb23-c3b5adb4e8a9 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:44.524598 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4ea68bbb-a74d-4940-bb23-c3b5adb4e8a9 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1686 microversion: 2.1 time: 0.171822 May 21 22:21:44.525314 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3553/7229] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:44 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:45.542176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-cf98c4fe-628e-4531-a566-578fd8dedcea tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:45.543060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-cf98c4fe-628e-4531-a566-578fd8dedcea tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:45.550196 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cf98c4fe-628e-4531-a566-578fd8dedcea tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:45.550662 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cf98c4fe-628e-4531-a566-578fd8dedcea tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:45.551511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cf98c4fe-628e-4531-a566-578fd8dedcea tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:45.551971 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-cf98c4fe-628e-4531-a566-578fd8dedcea tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:45.702905 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-cf98c4fe-628e-4531-a566-578fd8dedcea tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:45.711630 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-cf98c4fe-628e-4531-a566-578fd8dedcea tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1686 microversion: 2.1 time: 0.173573 May 21 22:21:45.712214 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3677/7230] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:45 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1686 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:21:46.548388 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:21:46.548966 ncdv-master-1 devstack@n-api.service[131278]: Sat May 21 22:21:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:21:46.729149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-52a2f9a0-be4e-4d39-ade4-2e8282d77214 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:46.729773 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-52a2f9a0-be4e-4d39-ade4-2e8282d77214 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:46.736501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-52a2f9a0-be4e-4d39-ade4-2e8282d77214 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:46.744367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-52a2f9a0-be4e-4d39-ade4-2e8282d77214 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:46.744367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-52a2f9a0-be4e-4d39-ade4-2e8282d77214 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:46.744367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-52a2f9a0-be4e-4d39-ade4-2e8282d77214 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:46.894361 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-52a2f9a0-be4e-4d39-ade4-2e8282d77214 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:46.902606 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-52a2f9a0-be4e-4d39-ade4-2e8282d77214 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1686 microversion: 2.1 time: 0.177908 May 21 22:21:46.903183 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3554/7231] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:46 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1686 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:21:47.535049 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:21:47.535644 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 22:21:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:21:47.919053 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9a16f50b-22c1-458b-9911-983f1e66925d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:47.919713 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9a16f50b-22c1-458b-9911-983f1e66925d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:47.926890 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a16f50b-22c1-458b-9911-983f1e66925d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:47.927369 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a16f50b-22c1-458b-9911-983f1e66925d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:47.928187 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a16f50b-22c1-458b-9911-983f1e66925d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:47.928674 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9a16f50b-22c1-458b-9911-983f1e66925d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:48.074590 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9a16f50b-22c1-458b-9911-983f1e66925d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:48.082465 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9a16f50b-22c1-458b-9911-983f1e66925d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1686 microversion: 2.1 time: 0.167265 May 21 22:21:48.083276 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3678/7232] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:47 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:49.101188 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c9c9406d-db41-4726-8cf2-ee54a268fb0a tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:49.101728 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c9c9406d-db41-4726-8cf2-ee54a268fb0a tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:49.108837 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9c9406d-db41-4726-8cf2-ee54a268fb0a tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:49.109291 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9c9406d-db41-4726-8cf2-ee54a268fb0a tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:49.110051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9c9406d-db41-4726-8cf2-ee54a268fb0a tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:49.110489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c9c9406d-db41-4726-8cf2-ee54a268fb0a tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:49.255203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-c9c9406d-db41-4726-8cf2-ee54a268fb0a tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:49.263206 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c9c9406d-db41-4726-8cf2-ee54a268fb0a tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1686 microversion: 2.1 time: 0.166612 May 21 22:21:49.263782 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3555/7233] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:49 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:50.252188 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-628e0c25-6455-4526-b481-0ad10f094de6 req-b4f1e886-e1e0-4a45-89d6-e9715379fc56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2bd928-bd54-49e2-a296-bce2ddcdb570", "name": "network-vif-plugged", "status": "completed", "tag": "00e8d23c-9fc1-469c-912c-137643ebc893"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:21:50.261420 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-628e0c25-6455-4526-b481-0ad10f094de6 req-b4f1e886-e1e0-4a45-89d6-e9715379fc56 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:50.261879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-628e0c25-6455-4526-b481-0ad10f094de6 req-b4f1e886-e1e0-4a45-89d6-e9715379fc56 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:50.274173 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-628e0c25-6455-4526-b481-0ad10f094de6 req-b4f1e886-e1e0-4a45-89d6-e9715379fc56 service nova] Creating event network-vif-plugged:00e8d23c-9fc1-469c-912c-137643ebc893 for instance 3b2bd928-bd54-49e2-a296-bce2ddcdb570 on nch1-master-1 May 21 22:21:50.279610 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-628e0c25-6455-4526-b481-0ad10f094de6 req-b4f1e886-e1e0-4a45-89d6-e9715379fc56 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031101 May 21 22:21:50.280200 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3679/7234] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:21:50.281051 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cf679cef-1ea5-4e02-8be9-e4f237431926 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:50.281687 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cf679cef-1ea5-4e02-8be9-e4f237431926 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:50.289617 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf679cef-1ea5-4e02-8be9-e4f237431926 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:50.290083 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf679cef-1ea5-4e02-8be9-e4f237431926 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:50.290881 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf679cef-1ea5-4e02-8be9-e4f237431926 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:50.291337 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cf679cef-1ea5-4e02-8be9-e4f237431926 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:50.453796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cf679cef-1ea5-4e02-8be9-e4f237431926 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:50.463114 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cf679cef-1ea5-4e02-8be9-e4f237431926 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1686 microversion: 2.1 time: 0.186043 May 21 22:21:50.463913 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3556/7235] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:50 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1686 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:21:51.483321 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-87d8171b-f5cd-4f63-bef6-9db3da04ce0e tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:51.483942 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-87d8171b-f5cd-4f63-bef6-9db3da04ce0e tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:51.491000 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87d8171b-f5cd-4f63-bef6-9db3da04ce0e tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:51.491474 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87d8171b-f5cd-4f63-bef6-9db3da04ce0e tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:51.492299 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87d8171b-f5cd-4f63-bef6-9db3da04ce0e tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:51.492766 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-87d8171b-f5cd-4f63-bef6-9db3da04ce0e tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:51.649720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-87d8171b-f5cd-4f63-bef6-9db3da04ce0e tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:51.657821 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-87d8171b-f5cd-4f63-bef6-9db3da04ce0e tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1686 microversion: 2.1 time: 0.180033 May 21 22:21:51.658576 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3680/7236] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:51 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1686 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:52.675690 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3a859b6a-80b4-4268-91b8-cac4e1796de8 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:52.676397 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3a859b6a-80b4-4268-91b8-cac4e1796de8 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:52.684242 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a859b6a-80b4-4268-91b8-cac4e1796de8 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:52.684937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a859b6a-80b4-4268-91b8-cac4e1796de8 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:52.685498 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a859b6a-80b4-4268-91b8-cac4e1796de8 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:52.685943 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3a859b6a-80b4-4268-91b8-cac4e1796de8 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:52.834915 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3a859b6a-80b4-4268-91b8-cac4e1796de8 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:52.842759 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3a859b6a-80b4-4268-91b8-cac4e1796de8 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1686 microversion: 2.1 time: 0.171010 May 21 22:21:52.843344 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3557/7237] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:52 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:21:53.860850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-89df715d-6434-4b6f-90b2-aab4bd19c740 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:21:53.861495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-89df715d-6434-4b6f-90b2-aab4bd19c740 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:21:53.870013 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89df715d-6434-4b6f-90b2-aab4bd19c740 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:53.870844 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89df715d-6434-4b6f-90b2-aab4bd19c740 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:53.871914 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89df715d-6434-4b6f-90b2-aab4bd19c740 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:21:53.872408 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89df715d-6434-4b6f-90b2-aab4bd19c740 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:21:54.024088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-89df715d-6434-4b6f-90b2-aab4bd19c740 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:21:54.031770 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-89df715d-6434-4b6f-90b2-aab4bd19c740 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1673 microversion: 2.1 time: 0.174932 May 21 22:21:54.032365 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3681/7238] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:21:53 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:22:08.991651 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:22:08.992233 ncdv-master-1 devstack@n-api.service[131278]: Sat May 21 22:22:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:23:05.173849 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=17 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:23:05.174631 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=53 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:23:05.178878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b749d9d5-7f4f-4721-9c31-323d22fd47f8 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:23:05.179390 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b749d9d5-7f4f-4721-9c31-323d22fd47f8 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:23:05.182226 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=19 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:23:05.183541 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=55 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:23:05.186222 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b749d9d5-7f4f-4721-9c31-323d22fd47f8 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:05.186673 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b749d9d5-7f4f-4721-9c31-323d22fd47f8 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:05.187470 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b749d9d5-7f4f-4721-9c31-323d22fd47f8 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:05.187925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b749d9d5-7f4f-4721-9c31-323d22fd47f8 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:05.216739 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b749d9d5-7f4f-4721-9c31-323d22fd47f8 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 22:23:05.249555 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-f698d256-c294-4bf9-ad9d-13236a1e53f3 req-a45ca7fb-4de6-4f8c-85fb-0245f087d229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b2bd928-bd54-49e2-a296-bce2ddcdb570", "tag": "00e8d23c-9fc1-469c-912c-137643ebc893"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:23:05.264998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f698d256-c294-4bf9-ad9d-13236a1e53f3 req-a45ca7fb-4de6-4f8c-85fb-0245f087d229 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:05.264998 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-f698d256-c294-4bf9-ad9d-13236a1e53f3 req-a45ca7fb-4de6-4f8c-85fb-0245f087d229 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:05.274085 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-f698d256-c294-4bf9-ad9d-13236a1e53f3 req-a45ca7fb-4de6-4f8c-85fb-0245f087d229 service nova] Creating event network-changed:00e8d23c-9fc1-469c-912c-137643ebc893 for instance 3b2bd928-bd54-49e2-a296-bce2ddcdb570 on nch1-master-1 May 21 22:23:05.280433 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-f698d256-c294-4bf9-ad9d-13236a1e53f3 req-a45ca7fb-4de6-4f8c-85fb-0245f087d229 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104151 May 21 22:23:05.281050 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3682/7239] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:23:05.559926 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b749d9d5-7f4f-4721-9c31-323d22fd47f8 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 204 len: 0 microversion: 2.1 time: 0.387738 May 21 22:23:05.560872 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3558/7240] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:23:05 2022] DELETE /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:23:05.575054 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-9e75fb58-30ef-43c8-b6d4-405f2ed2ac15 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:23:05.575794 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-9e75fb58-30ef-43c8-b6d4-405f2ed2ac15 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:23:05.584060 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e75fb58-30ef-43c8-b6d4-405f2ed2ac15 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:05.584566 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e75fb58-30ef-43c8-b6d4-405f2ed2ac15 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:05.585771 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e75fb58-30ef-43c8-b6d4-405f2ed2ac15 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:05.586485 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-9e75fb58-30ef-43c8-b6d4-405f2ed2ac15 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:05.786308 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-9e75fb58-30ef-43c8-b6d4-405f2ed2ac15 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:23:05.795768 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-9e75fb58-30ef-43c8-b6d4-405f2ed2ac15 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1679 microversion: 2.1 time: 0.225807 May 21 22:23:05.796621 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3683/7241] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:23:05 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1679 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:23:06.815809 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0e1c0c16-1a3d-465c-98b7-ba687e467640 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:23:06.816701 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0e1c0c16-1a3d-465c-98b7-ba687e467640 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:23:06.826016 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e1c0c16-1a3d-465c-98b7-ba687e467640 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:06.826774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e1c0c16-1a3d-465c-98b7-ba687e467640 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:06.827993 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e1c0c16-1a3d-465c-98b7-ba687e467640 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:06.828501 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0e1c0c16-1a3d-465c-98b7-ba687e467640 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:07.138648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0e1c0c16-1a3d-465c-98b7-ba687e467640 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:23:07.147039 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0e1c0c16-1a3d-465c-98b7-ba687e467640 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1679 microversion: 2.1 time: 0.336193 May 21 22:23:07.147786 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3559/7242] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:23:06 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1679 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:23:07.577008 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-edaf71fc-1713-464a-b032-49f29b75fbb5 req-87edf853-4111-44a2-b421-8ce010f7683c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2bd928-bd54-49e2-a296-bce2ddcdb570", "name": "network-vif-deleted", "tag": "00e8d23c-9fc1-469c-912c-137643ebc893"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:23:07.586736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-edaf71fc-1713-464a-b032-49f29b75fbb5 req-87edf853-4111-44a2-b421-8ce010f7683c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:07.587191 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-edaf71fc-1713-464a-b032-49f29b75fbb5 req-87edf853-4111-44a2-b421-8ce010f7683c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:07.598638 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-edaf71fc-1713-464a-b032-49f29b75fbb5 req-87edf853-4111-44a2-b421-8ce010f7683c service nova] Creating event network-vif-deleted:00e8d23c-9fc1-469c-912c-137643ebc893 for instance 3b2bd928-bd54-49e2-a296-bce2ddcdb570 on nch1-master-1 May 21 22:23:07.603814 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-edaf71fc-1713-464a-b032-49f29b75fbb5 req-87edf853-4111-44a2-b421-8ce010f7683c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031368 May 21 22:23:07.604896 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3684/7243] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:23:08.165245 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-7335c71d-d4f9-4b37-a1c9-1909f9d7a835 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:23:08.165860 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-7335c71d-d4f9-4b37-a1c9-1909f9d7a835 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:23:08.175198 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7335c71d-d4f9-4b37-a1c9-1909f9d7a835 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:08.175767 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7335c71d-d4f9-4b37-a1c9-1909f9d7a835 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:08.176718 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7335c71d-d4f9-4b37-a1c9-1909f9d7a835 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:08.177259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7335c71d-d4f9-4b37-a1c9-1909f9d7a835 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:08.208925 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7335c71d-d4f9-4b37-a1c9-1909f9d7a835 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:08.209378 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-7335c71d-d4f9-4b37-a1c9-1909f9d7a835 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:08.209828 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.objects.instance [None req-7335c71d-d4f9-4b37-a1c9-1909f9d7a835 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lazy-loading 'fault' on Instance uuid 3b2bd928-bd54-49e2-a296-bce2ddcdb570 {{(pid=131278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 22:23:08.257148 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-7335c71d-d4f9-4b37-a1c9-1909f9d7a835 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:23:08.265647 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-7335c71d-d4f9-4b37-a1c9-1909f9d7a835 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 200 len: 1336 microversion: 2.1 time: 0.104156 May 21 22:23:08.266249 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3560/7244] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:23:08 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 1336 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:23:09.284897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-911bf019-06e1-4f1a-8565-727c87e9ea1f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:23:09.285617 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-911bf019-06e1-4f1a-8565-727c87e9ea1f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 3b2bd928-bd54-49e2-a296-bce2ddcdb570] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:23:09.292204 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-911bf019-06e1-4f1a-8565-727c87e9ea1f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:09.292710 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-911bf019-06e1-4f1a-8565-727c87e9ea1f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:09.293499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-911bf019-06e1-4f1a-8565-727c87e9ea1f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:09.293956 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-911bf019-06e1-4f1a-8565-727c87e9ea1f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:09.307311 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.wsgi [None req-911bf019-06e1-4f1a-8565-727c87e9ea1f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] HTTP exception thrown: Instance 3b2bd928-bd54-49e2-a296-bce2ddcdb570 could not be found. May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-911bf019-06e1-4f1a-8565-727c87e9ea1f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Request method failure captured: May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: request: GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 HTTP/1.1 May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: Accept: application/json May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: Accept-Encoding: identity May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: Connection: close May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: Content-Length: 0 May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: Content-Type: application/json May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: Host: 10.222.0.49 May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: Openstack-System-Scope: None May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: User-Agent: python-urllib3/1.26.9 May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: X-Auth-Token: gAAAAABiiWVDPzP5MycZ7VcbEvPYu5nF4dnnpJYwAb76HTWuVdzx7AnXgdlM_HcWVyPBT2koNjiojsmpbdHrrNTjz3MC543DIUv9C13KddPlu4pozcajamiN1sQCgr0EEE7TNjfxUDiUwpTK6aKFIcXwO34Z-KdnWBqXE9YQllpDoAikBKL-YAI May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Id: None May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: X-Domain-Name: None May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: X-Identity-Status: Confirmed May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: X-Is-Admin-Project: True May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Id: default May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Domain-Name: Default May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Id: e815c24f93db46a691126111c7d92a1f May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: X-Project-Name: tempest-TestShelveInstance-602987168 May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: X-Role: reader,member May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: X-Roles: reader,member May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e815c24f93db46a691126111c7d92a1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e815c24f93db46a691126111c7d92a1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e815c24f93db46a691126111c7d92a1f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e815c24f93db46a691126111c7d92a1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant: tempest-TestShelveInstance-602987168 May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Id: e815c24f93db46a691126111c7d92a1f May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: X-Tenant-Name: tempest-TestShelveInstance-602987168 May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: X-User: tempest-TestShelveInstance-602987168-project May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Id: default May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: X-User-Domain-Name: Default May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: X-User-Id: cacdb9b294ad482ba157fbb6ba4889ae May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: X-User-Name: tempest-TestShelveInstance-602987168-project May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: method: > May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: exception: Instance 3b2bd928-bd54-49e2-a296-bce2ddcdb570 could not be found. May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: action_args: {'id': '3b2bd928-bd54-49e2-a296-bce2ddcdb570'} May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b2bd928-bd54-49e2-a296-bce2ddcdb570 could not be found. May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b2bd928-bd54-49e2-a296-bce2ddcdb570 could not be found. May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:23:09.308988 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:23:09.314411 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:23:09.314411 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:23:09.314411 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:23:09.314411 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:23:09.314411 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:23:09.314411 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b2bd928-bd54-49e2-a296-bce2ddcdb570 could not be found. May 21 22:23:09.314411 ncdv-master-1 devstack@n-api.service[131277]: ERROR nova.api.openstack.wsgi May 21 22:23:09.314411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-911bf019-06e1-4f1a-8565-727c87e9ea1f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Returning 404 to user: Instance 3b2bd928-bd54-49e2-a296-bce2ddcdb570 could not be found. {{(pid=131277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:23:09.314411 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-911bf019-06e1-4f1a-8565-727c87e9ea1f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570" status: 404 len: 111 microversion: 2.1 time: 0.030715 May 21 22:23:09.314411 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3685/7245] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:23:09 2022] GET /compute/v2.1/servers/3b2bd928-bd54-49e2-a296-bce2ddcdb570 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:23:09.541054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-4bfa9af6-8951-4e3a-b6ff-bf2324d8119e tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '.version_select at 0x7fc82d084d30>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:23:09.600471 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-4bfa9af6-8951-4e3a-b6ff-bf2324d8119e tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-480713996" status: 202 len: 0 microversion: 2.1 time: 0.063350 May 21 22:23:09.601107 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3561/7246] 10.222.0.49 () {58 vars in 1250 bytes} [Sat May 21 22:23:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-480713996 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 21 22:23:09.626808 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-824ef4ca-2b99-4028-9b71-79d31ba7bbc0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Action: 'create', calling method: .version_select at 0x7fc8182c1e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1522372516", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAPBWPxIcQ++MHesBpJXoH7pbqYgCgv5KLZfvYYuMQSY9hac4owSDoTszO6I+Hiy6TCWlweHkNhYme8J8sxpZ6GHoa/NOhcTGCZnlKFhEK2L0arSScNSYX8mxbNnxV2pg=="}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:23:09.641951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-824ef4ca-2b99-4028-9b71-79d31ba7bbc0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Getting quotas for project e815c24f93db46a691126111c7d92a1f. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:23:09.647599 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-824ef4ca-2b99-4028-9b71-79d31ba7bbc0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Getting quotas for user cacdb9b294ad482ba157fbb6ba4889ae and project e815c24f93db46a691126111c7d92a1f. Resources: {'key_pairs'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:23:09.778527 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-824ef4ca-2b99-4028-9b71-79d31ba7bbc0 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.155718 May 21 22:23:09.779140 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3686/7247] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 22:23:09 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:23:16.030038 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d23b1690-189a-43a1-9704-ad9309e2f049 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-264334695", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1522372516", "security_groups": [{"name": "tempest-secgroup-smoke-247237847"}], "networks": [{"uuid": "0a9fca03-59b5-46c9-b88c-7fc8d8b126e5"}], "block_device_mapping_v2": [{"uuid": "620904ee-0a1f-40d1-8c74-79af6b3c3f40", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:23:16.149537 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.network.neutron [None req-d23b1690-189a-43a1-9704-ad9309e2f049 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] validate_networks() for [('0a9fca03-59b5-46c9-b88c-7fc8d8b126e5', None, None, None, None, None)] {{(pid=131278) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 22:23:16.622231 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d23b1690-189a-43a1-9704-ad9309e2f049 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Flavor limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:23:16.622694 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d23b1690-189a-43a1-9704-ad9309e2f049 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Image limits 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:23:16.623179 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d23b1690-189a-43a1-9704-ad9309e2f049 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Flavor pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:23:16.623595 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d23b1690-189a-43a1-9704-ad9309e2f049 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Image pref 0:0:0 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:23:16.624012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.virt.hardware [None req-d23b1690-189a-43a1-9704-ad9309e2f049 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:23:16.633486 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d23b1690-189a-43a1-9704-ad9309e2f049 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:16.633942 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d23b1690-189a-43a1-9704-ad9309e2f049 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:16.634754 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d23b1690-189a-43a1-9704-ad9309e2f049 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:16.635228 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d23b1690-189a-43a1-9704-ad9309e2f049 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:16.653098 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-d23b1690-189a-43a1-9704-ad9309e2f049 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Getting quotas for project e815c24f93db46a691126111c7d92a1f. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:23:16.658535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-d23b1690-189a-43a1-9704-ad9309e2f049 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Getting quotas for user cacdb9b294ad482ba157fbb6ba4889ae and project e815c24f93db46a691126111c7d92a1f. Resources: {'instances', 'cores', 'ram'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:23:16.718637 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d23b1690-189a-43a1-9704-ad9309e2f049 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Going to run 1 instances... {{(pid=131278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 22:23:16.720796 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d23b1690-189a-43a1-9704-ad9309e2f049 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='620904ee-0a1f-40d1-8c74-79af6b3c3f40',volume_size=None,volume_type=None)] {{(pid=131278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 22:23:17.009647 ncdv-master-1 devstack@n-api.service[131278]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d23b1690-189a-43a1-9704-ad9309e2f049 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [1b412268-ab2f-4c7b-98cb-684224764859] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 21 22:23:18.017452 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [None req-d23b1690-189a-43a1-9704-ad9309e2f049 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [1b412268-ab2f-4c7b-98cb-684224764859] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42284. May 21 22:23:18.021475 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d23b1690-189a-43a1-9704-ad9309e2f049 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.996497 May 21 22:23:18.022136 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3562/7248] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 22:23:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 22:23:18.033651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-1da7c271-f362-4587-9b35-697dc5108683 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:23:18.034280 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-1da7c271-f362-4587-9b35-697dc5108683 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:23:18.095521 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-1da7c271-f362-4587-9b35-697dc5108683 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:23:18.102496 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-1da7c271-f362-4587-9b35-697dc5108683 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e" status: 200 len: 1088 microversion: 2.1 time: 0.073836 May 21 22:23:18.103072 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3687/7249] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:23:18 2022] GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:23:19.121149 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-dd166f97-e309-4b2c-bda0-b487ff266b37 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:23:19.121791 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-dd166f97-e309-4b2c-bda0-b487ff266b37 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:23:19.128308 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd166f97-e309-4b2c-bda0-b487ff266b37 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:19.128772 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd166f97-e309-4b2c-bda0-b487ff266b37 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:19.129584 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd166f97-e309-4b2c-bda0-b487ff266b37 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:19.130042 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-dd166f97-e309-4b2c-bda0-b487ff266b37 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:19.205660 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-dd166f97-e309-4b2c-bda0-b487ff266b37 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:23:19.213634 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-dd166f97-e309-4b2c-bda0-b487ff266b37 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e" status: 200 len: 1138 microversion: 2.1 time: 0.098123 May 21 22:23:19.214172 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3563/7250] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:23:19 2022] GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e => generated 1138 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:23:20.230287 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-ffe8d91c-49ed-4eea-a246-2d576c98ecba tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:23:20.230872 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-ffe8d91c-49ed-4eea-a246-2d576c98ecba tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:23:20.233742 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=12 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:23:20.238854 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffe8d91c-49ed-4eea-a246-2d576c98ecba tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:20.239330 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffe8d91c-49ed-4eea-a246-2d576c98ecba tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:20.240132 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffe8d91c-49ed-4eea-a246-2d576c98ecba tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:20.240631 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-ffe8d91c-49ed-4eea-a246-2d576c98ecba tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:20.323310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-ffe8d91c-49ed-4eea-a246-2d576c98ecba tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:23:20.333454 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-ffe8d91c-49ed-4eea-a246-2d576c98ecba tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e" status: 200 len: 1204 microversion: 2.1 time: 0.107182 May 21 22:23:20.334643 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3688/7251] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:23:20 2022] GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e => generated 1204 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:23:21.351495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-05da7d8a-c418-46fd-ae6b-26a9d6a7708b tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:23:21.352067 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-05da7d8a-c418-46fd-ae6b-26a9d6a7708b tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:23:21.359076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05da7d8a-c418-46fd-ae6b-26a9d6a7708b tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:21.359536 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05da7d8a-c418-46fd-ae6b-26a9d6a7708b tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:21.360367 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05da7d8a-c418-46fd-ae6b-26a9d6a7708b tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:21.360821 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-05da7d8a-c418-46fd-ae6b-26a9d6a7708b tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:21.603526 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-05da7d8a-c418-46fd-ae6b-26a9d6a7708b tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:23:21.609963 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-05da7d8a-c418-46fd-ae6b-26a9d6a7708b tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e" status: 200 len: 1271 microversion: 2.1 time: 0.262576 May 21 22:23:21.610554 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3564/7252] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:23:21 2022] GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e => generated 1271 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:23:22.227395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-571a7e71-f355-4a3e-9fb2-8dc8ef2bdf9f req-f1a8a14f-9132-48a8-91a7-c25a18160076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c80876-cb95-4bec-8048-2d23ef15bd6e", "tag": "a93ef22b-0630-4bd7-b30d-58a1e8337f02"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:23:22.236641 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-571a7e71-f355-4a3e-9fb2-8dc8ef2bdf9f req-f1a8a14f-9132-48a8-91a7-c25a18160076 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:22.237110 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-571a7e71-f355-4a3e-9fb2-8dc8ef2bdf9f req-f1a8a14f-9132-48a8-91a7-c25a18160076 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:22.249095 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-571a7e71-f355-4a3e-9fb2-8dc8ef2bdf9f req-f1a8a14f-9132-48a8-91a7-c25a18160076 service nova] Creating event network-changed:a93ef22b-0630-4bd7-b30d-58a1e8337f02 for instance 47c80876-cb95-4bec-8048-2d23ef15bd6e on nch2-master-1 May 21 22:23:22.254244 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-571a7e71-f355-4a3e-9fb2-8dc8ef2bdf9f req-f1a8a14f-9132-48a8-91a7-c25a18160076 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095239 May 21 22:23:22.254902 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3689/7253] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:23:22.627462 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-667d28d8-4aba-4393-9ede-5c1b3d590a26 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:23:22.628090 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-667d28d8-4aba-4393-9ede-5c1b3d590a26 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:23:22.635158 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-667d28d8-4aba-4393-9ede-5c1b3d590a26 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:22.635617 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-667d28d8-4aba-4393-9ede-5c1b3d590a26 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:22.636430 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-667d28d8-4aba-4393-9ede-5c1b3d590a26 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:22.636878 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-667d28d8-4aba-4393-9ede-5c1b3d590a26 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:22.904662 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-667d28d8-4aba-4393-9ede-5c1b3d590a26 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:23:22.912395 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-667d28d8-4aba-4393-9ede-5c1b3d590a26 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e" status: 200 len: 1259 microversion: 2.1 time: 0.288888 May 21 22:23:22.912989 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3565/7254] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:23:22 2022] GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e => generated 1259 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:23:23.931736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-0b5cf086-3535-4c72-b1cd-fc420ca5c836 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:23:23.932487 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-0b5cf086-3535-4c72-b1cd-fc420ca5c836 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:23:23.939170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b5cf086-3535-4c72-b1cd-fc420ca5c836 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:23.939631 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b5cf086-3535-4c72-b1cd-fc420ca5c836 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:23.940432 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b5cf086-3535-4c72-b1cd-fc420ca5c836 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:23.940885 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-0b5cf086-3535-4c72-b1cd-fc420ca5c836 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:24.090417 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-0b5cf086-3535-4c72-b1cd-fc420ca5c836 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:23:24.099006 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-0b5cf086-3535-4c72-b1cd-fc420ca5c836 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e" status: 200 len: 1259 microversion: 2.1 time: 0.172391 May 21 22:23:24.099585 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3690/7255] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:23:23 2022] GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:23:25.116584 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-728a8496-ed75-423b-9908-d70d09749a7b tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:23:25.117241 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-728a8496-ed75-423b-9908-d70d09749a7b tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:23:25.125157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-728a8496-ed75-423b-9908-d70d09749a7b tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:25.125633 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-728a8496-ed75-423b-9908-d70d09749a7b tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:25.126386 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-728a8496-ed75-423b-9908-d70d09749a7b tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:25.126830 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-728a8496-ed75-423b-9908-d70d09749a7b tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:25.276554 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-728a8496-ed75-423b-9908-d70d09749a7b tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:23:25.284845 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-728a8496-ed75-423b-9908-d70d09749a7b tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e" status: 200 len: 1259 microversion: 2.1 time: 0.172371 May 21 22:23:25.287155 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3566/7256] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:23:25 2022] GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:23:26.302870 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-3c470d88-c14b-4395-baae-651b819b9709 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:23:26.303454 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-3c470d88-c14b-4395-baae-651b819b9709 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:23:26.310791 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c470d88-c14b-4395-baae-651b819b9709 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:26.311338 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c470d88-c14b-4395-baae-651b819b9709 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:26.312135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c470d88-c14b-4395-baae-651b819b9709 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:26.312628 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-3c470d88-c14b-4395-baae-651b819b9709 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:26.471147 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-3c470d88-c14b-4395-baae-651b819b9709 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:23:26.478824 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-3c470d88-c14b-4395-baae-651b819b9709 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e" status: 200 len: 1259 microversion: 2.1 time: 0.179954 May 21 22:23:26.479396 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3691/7257] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:23:26 2022] GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:23:27.496689 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d610a6c8-1c26-41d5-85ff-52db74963435 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:23:27.497981 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d610a6c8-1c26-41d5-85ff-52db74963435 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:23:27.500876 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:23:27.501587 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:23:27.506671 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d610a6c8-1c26-41d5-85ff-52db74963435 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:27.507417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d610a6c8-1c26-41d5-85ff-52db74963435 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:27.508901 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d610a6c8-1c26-41d5-85ff-52db74963435 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:27.509714 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d610a6c8-1c26-41d5-85ff-52db74963435 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:27.692935 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d610a6c8-1c26-41d5-85ff-52db74963435 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:23:27.701972 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d610a6c8-1c26-41d5-85ff-52db74963435 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e" status: 200 len: 1259 microversion: 2.1 time: 0.208812 May 21 22:23:27.702553 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3567/7258] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:23:27 2022] GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e => generated 1259 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:23:28.719010 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-a7f2f01a-5c42-4f48-b010-536681d9ae2d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:23:28.719648 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-a7f2f01a-5c42-4f48-b010-536681d9ae2d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:23:28.722586 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:23:28.727580 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7f2f01a-5c42-4f48-b010-536681d9ae2d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:28.734394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7f2f01a-5c42-4f48-b010-536681d9ae2d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:28.734394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7f2f01a-5c42-4f48-b010-536681d9ae2d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:28.734394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-a7f2f01a-5c42-4f48-b010-536681d9ae2d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:28.882380 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-a7f2f01a-5c42-4f48-b010-536681d9ae2d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:23:28.890859 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-a7f2f01a-5c42-4f48-b010-536681d9ae2d tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e" status: 200 len: 1259 microversion: 2.1 time: 0.175784 May 21 22:23:28.891438 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3692/7259] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:23:28 2022] GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:23:29.154986 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-0ef1efce-5391-4a77-bb24-bc8dd0aa3532 req-c2413796-8647-46a6-9f44-3369c5e498a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c80876-cb95-4bec-8048-2d23ef15bd6e", "name": "network-vif-plugged", "status": "completed", "tag": "a93ef22b-0630-4bd7-b30d-58a1e8337f02"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:23:29.163553 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0ef1efce-5391-4a77-bb24-bc8dd0aa3532 req-c2413796-8647-46a6-9f44-3369c5e498a9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:29.164022 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-0ef1efce-5391-4a77-bb24-bc8dd0aa3532 req-c2413796-8647-46a6-9f44-3369c5e498a9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:29.175562 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-0ef1efce-5391-4a77-bb24-bc8dd0aa3532 req-c2413796-8647-46a6-9f44-3369c5e498a9 service nova] Creating event network-vif-plugged:a93ef22b-0630-4bd7-b30d-58a1e8337f02 for instance 47c80876-cb95-4bec-8048-2d23ef15bd6e on nch2-master-1 May 21 22:23:29.180782 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-0ef1efce-5391-4a77-bb24-bc8dd0aa3532 req-c2413796-8647-46a6-9f44-3369c5e498a9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096649 May 21 22:23:29.181441 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3568/7260] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:23:29.908510 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-31b7e889-af47-498a-ad1a-0226316a9fba tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:23:29.909150 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-31b7e889-af47-498a-ad1a-0226316a9fba tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:23:29.916215 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31b7e889-af47-498a-ad1a-0226316a9fba tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:29.916720 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31b7e889-af47-498a-ad1a-0226316a9fba tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:29.917511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31b7e889-af47-498a-ad1a-0226316a9fba tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:29.917965 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-31b7e889-af47-498a-ad1a-0226316a9fba tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:30.061846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-31b7e889-af47-498a-ad1a-0226316a9fba tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:23:30.069505 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-31b7e889-af47-498a-ad1a-0226316a9fba tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e" status: 200 len: 1259 microversion: 2.1 time: 0.165203 May 21 22:23:30.070078 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3693/7261] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:23:29 2022] GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:23:31.086738 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-746ea3a0-4544-42fa-bc15-16f811e8d470 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:23:31.087446 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-746ea3a0-4544-42fa-bc15-16f811e8d470 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:23:31.095331 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-746ea3a0-4544-42fa-bc15-16f811e8d470 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:31.095783 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-746ea3a0-4544-42fa-bc15-16f811e8d470 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:31.096580 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-746ea3a0-4544-42fa-bc15-16f811e8d470 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:31.097024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-746ea3a0-4544-42fa-bc15-16f811e8d470 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:31.250916 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-746ea3a0-4544-42fa-bc15-16f811e8d470 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:23:31.258833 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-746ea3a0-4544-42fa-bc15-16f811e8d470 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e" status: 200 len: 1443 microversion: 2.1 time: 0.176548 May 21 22:23:31.259365 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3569/7262] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:23:31 2022] GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e => generated 1443 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:23:31.274749 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b31988a6-815d-4166-a17e-5027e838628c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:23:31.275395 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b31988a6-815d-4166-a17e-5027e838628c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:23:31.283688 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b31988a6-815d-4166-a17e-5027e838628c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:31.284176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b31988a6-815d-4166-a17e-5027e838628c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:31.285018 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b31988a6-815d-4166-a17e-5027e838628c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:31.285479 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b31988a6-815d-4166-a17e-5027e838628c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:31.437824 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b31988a6-815d-4166-a17e-5027e838628c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:23:31.445558 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b31988a6-815d-4166-a17e-5027e838628c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e" status: 200 len: 1443 microversion: 2.1 time: 0.174711 May 21 22:23:31.446162 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3694/7263] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:23:31 2022] GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e => generated 1443 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:23:33.911341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-08c18d37-1ea6-4c3f-a7dd-052f542b5e9e req-364b6c6e-1488-40e9-afc6-9e1455bfc9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c80876-cb95-4bec-8048-2d23ef15bd6e", "tag": "a93ef22b-0630-4bd7-b30d-58a1e8337f02"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:23:33.921072 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-08c18d37-1ea6-4c3f-a7dd-052f542b5e9e req-364b6c6e-1488-40e9-afc6-9e1455bfc9f9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:23:33.921542 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-08c18d37-1ea6-4c3f-a7dd-052f542b5e9e req-364b6c6e-1488-40e9-afc6-9e1455bfc9f9 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:23:33.933087 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-08c18d37-1ea6-4c3f-a7dd-052f542b5e9e req-364b6c6e-1488-40e9-afc6-9e1455bfc9f9 service nova] Creating event network-changed:a93ef22b-0630-4bd7-b30d-58a1e8337f02 for instance 47c80876-cb95-4bec-8048-2d23ef15bd6e on nch2-master-1 May 21 22:23:33.938474 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-08c18d37-1ea6-4c3f-a7dd-052f542b5e9e req-364b6c6e-1488-40e9-afc6-9e1455bfc9f9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031092 May 21 22:23:33.939100 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3570/7264] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:25:45.046905 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:25:45.047737 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 22:25:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:26:47.764787 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:26:47.765470 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 22:26:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:27:04.212414 ncdv-master-1 devstack@n-api.service[131277]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5f720f21-082c-449e-9bd7-36d6581a2009] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 21 22:27:04.213884 ncdv-master-1 devstack@n-api.service[131277]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f14f1b38-6a99-4d58-b2cc-323ca7840d25] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 21 22:27:04.216096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:27:04.216096 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=38 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:27:04.284941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-40737350-9697-4691-a88f-6a1f9dfc0dd4 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:27:04.285887 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-40737350-9697-4691-a88f-6a1f9dfc0dd4 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:27:04.292781 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-40737350-9697-4691-a88f-6a1f9dfc0dd4 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:04.304043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-40737350-9697-4691-a88f-6a1f9dfc0dd4 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:04.304043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-40737350-9697-4691-a88f-6a1f9dfc0dd4 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:04.304043 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-40737350-9697-4691-a88f-6a1f9dfc0dd4 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:05.223092 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] [5f720f21-082c-449e-9bd7-36d6581a2009] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42478. May 21 22:27:05.223870 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] [f14f1b38-6a99-4d58-b2cc-323ca7840d25] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42480. May 21 22:27:05.228072 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-40737350-9697-4691-a88f-6a1f9dfc0dd4 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "POST /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e/action" status: 200 len: 24572 microversion: 2.1 time: 1.017441 May 21 22:27:05.228753 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3695/7265] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:27:04 2022] POST /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e/action => generated 24572 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 21 22:27:06.320255 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b82e814c-a7e6-42d9-a8ac-fae12535f96c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:27:06.329507 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b82e814c-a7e6-42d9-a8ac-fae12535f96c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:27:06.329643 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-c9cb0866-3ee3-462b-88c9-5902a6eb3341 req-a2c577be-3a0c-4053-af18-d9e169f5133d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c80876-cb95-4bec-8048-2d23ef15bd6e", "tag": "a93ef22b-0630-4bd7-b30d-58a1e8337f02"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:27:06.330069 ncdv-master-1 devstack@n-api.service[131278]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c228418-8689-4977-b0bb-d0fe96d67aa9] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 21 22:27:06.330069 ncdv-master-1 devstack@n-api.service[131278]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7e4f995f-1c03-418a-9049-52ff0456baf3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 21 22:27:06.330069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:27:06.330069 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:27:06.331857 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b82e814c-a7e6-42d9-a8ac-fae12535f96c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:06.332432 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b82e814c-a7e6-42d9-a8ac-fae12535f96c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:06.332591 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c9cb0866-3ee3-462b-88c9-5902a6eb3341 req-a2c577be-3a0c-4053-af18-d9e169f5133d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:06.333039 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-c9cb0866-3ee3-462b-88c9-5902a6eb3341 req-a2c577be-3a0c-4053-af18-d9e169f5133d service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:06.333389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b82e814c-a7e6-42d9-a8ac-fae12535f96c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:06.333910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b82e814c-a7e6-42d9-a8ac-fae12535f96c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:06.350454 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-c9cb0866-3ee3-462b-88c9-5902a6eb3341 req-a2c577be-3a0c-4053-af18-d9e169f5133d service nova] Creating event network-changed:a93ef22b-0630-4bd7-b30d-58a1e8337f02 for instance 47c80876-cb95-4bec-8048-2d23ef15bd6e on nch2-master-1 May 21 22:27:06.356941 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-c9cb0866-3ee3-462b-88c9-5902a6eb3341 req-a2c577be-3a0c-4053-af18-d9e169f5133d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038455 May 21 22:27:06.357875 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3696/7266] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:27:06.362893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b82e814c-a7e6-42d9-a8ac-fae12535f96c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 22:27:06.694566 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b82e814c-a7e6-42d9-a8ac-fae12535f96c tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "DELETE /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e" status: 204 len: 0 microversion: 2.1 time: 0.379856 May 21 22:27:06.695165 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3571/7267] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:27:06 2022] DELETE /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:27:06.705271 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e9a3f123-4301-41ee-8ddf-419619b84e3f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:27:06.706497 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e9a3f123-4301-41ee-8ddf-419619b84e3f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:27:06.714228 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9a3f123-4301-41ee-8ddf-419619b84e3f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:06.714704 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9a3f123-4301-41ee-8ddf-419619b84e3f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:06.715499 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9a3f123-4301-41ee-8ddf-419619b84e3f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:06.715940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e9a3f123-4301-41ee-8ddf-419619b84e3f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:06.926126 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e9a3f123-4301-41ee-8ddf-419619b84e3f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:27:06.934209 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e9a3f123-4301-41ee-8ddf-419619b84e3f tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e" status: 200 len: 1568 microversion: 2.1 time: 0.234450 May 21 22:27:06.934838 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3697/7268] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:27:06 2022] GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:27:07.953132 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-e9564b37-7444-4bd0-9c9e-ce77632c01fe tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:27:07.954400 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-e9564b37-7444-4bd0-9c9e-ce77632c01fe tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:27:07.966125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9564b37-7444-4bd0-9c9e-ce77632c01fe tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:07.966585 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9564b37-7444-4bd0-9c9e-ce77632c01fe tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:07.967372 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9564b37-7444-4bd0-9c9e-ce77632c01fe tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:07.967815 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-e9564b37-7444-4bd0-9c9e-ce77632c01fe tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:07.975183 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c228418-8689-4977-b0bb-d0fe96d67aa9] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42498. May 21 22:27:07.976017 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] [7e4f995f-1c03-418a-9049-52ff0456baf3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42500. May 21 22:27:08.166802 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-e9564b37-7444-4bd0-9c9e-ce77632c01fe tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:27:08.175401 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-e9564b37-7444-4bd0-9c9e-ce77632c01fe tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e" status: 200 len: 1568 microversion: 2.1 time: 0.227164 May 21 22:27:08.176055 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3572/7269] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:27:07 2022] GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:27:08.958971 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-48692b67-91b5-44d8-a676-e591fe19ef6f req-79fbc5df-34e2-4f38-be05-f56ce9b04a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c80876-cb95-4bec-8048-2d23ef15bd6e", "name": "network-vif-deleted", "tag": "a93ef22b-0630-4bd7-b30d-58a1e8337f02"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:27:08.967924 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-48692b67-91b5-44d8-a676-e591fe19ef6f req-79fbc5df-34e2-4f38-be05-f56ce9b04a03 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:08.968411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-48692b67-91b5-44d8-a676-e591fe19ef6f req-79fbc5df-34e2-4f38-be05-f56ce9b04a03 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:08.983532 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-48692b67-91b5-44d8-a676-e591fe19ef6f req-79fbc5df-34e2-4f38-be05-f56ce9b04a03 service nova] Creating event network-vif-deleted:a93ef22b-0630-4bd7-b30d-58a1e8337f02 for instance 47c80876-cb95-4bec-8048-2d23ef15bd6e on nch2-master-1 May 21 22:27:08.989436 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-48692b67-91b5-44d8-a676-e591fe19ef6f req-79fbc5df-34e2-4f38-be05-f56ce9b04a03 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035144 May 21 22:27:08.990049 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3698/7270] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:27:09.196535 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-d1fdc906-4298-49b4-a672-2a2e22a28105 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:27:09.197229 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-d1fdc906-4298-49b4-a672-2a2e22a28105 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:27:09.206126 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d1fdc906-4298-49b4-a672-2a2e22a28105 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:09.207032 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d1fdc906-4298-49b4-a672-2a2e22a28105 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:09.208269 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d1fdc906-4298-49b4-a672-2a2e22a28105 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:09.208956 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-d1fdc906-4298-49b4-a672-2a2e22a28105 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:09.282478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-d1fdc906-4298-49b4-a672-2a2e22a28105 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:27:09.291856 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-d1fdc906-4298-49b4-a672-2a2e22a28105 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e" status: 200 len: 1219 microversion: 2.1 time: 0.099338 May 21 22:27:09.292476 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3573/7271] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:27:09 2022] GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:27:10.311853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8a3dd0f0-ebbb-4b5a-bd9e-cd17468b5645 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:27:10.312613 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8a3dd0f0-ebbb-4b5a-bd9e-cd17468b5645 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:27:10.319592 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a3dd0f0-ebbb-4b5a-bd9e-cd17468b5645 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:10.320061 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a3dd0f0-ebbb-4b5a-bd9e-cd17468b5645 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:10.320900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a3dd0f0-ebbb-4b5a-bd9e-cd17468b5645 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:10.321363 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a3dd0f0-ebbb-4b5a-bd9e-cd17468b5645 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:10.353433 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a3dd0f0-ebbb-4b5a-bd9e-cd17468b5645 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:10.353899 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8a3dd0f0-ebbb-4b5a-bd9e-cd17468b5645 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:10.354394 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-8a3dd0f0-ebbb-4b5a-bd9e-cd17468b5645 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lazy-loading 'fault' on Instance uuid 47c80876-cb95-4bec-8048-2d23ef15bd6e {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 22:27:10.403250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8a3dd0f0-ebbb-4b5a-bd9e-cd17468b5645 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdb9b294ad482ba157fbb6ba4889ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e815c24f93db46a691126111c7d92a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:27:10.410914 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8a3dd0f0-ebbb-4b5a-bd9e-cd17468b5645 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e" status: 200 len: 1178 microversion: 2.1 time: 0.104286 May 21 22:27:10.411489 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3699/7272] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:27:10 2022] GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e => generated 1178 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:27:11.430201 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bb74e67e-c072-4365-adb4-89ee7f6dc996 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:27:11.430834 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bb74e67e-c072-4365-adb4-89ee7f6dc996 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] [instance: 47c80876-cb95-4bec-8048-2d23ef15bd6e] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:27:11.438232 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb74e67e-c072-4365-adb4-89ee7f6dc996 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:11.438822 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb74e67e-c072-4365-adb4-89ee7f6dc996 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:11.439611 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb74e67e-c072-4365-adb4-89ee7f6dc996 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:11.440157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bb74e67e-c072-4365-adb4-89ee7f6dc996 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:11.453842 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-bb74e67e-c072-4365-adb4-89ee7f6dc996 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] HTTP exception thrown: Instance 47c80876-cb95-4bec-8048-2d23ef15bd6e could not be found. May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bb74e67e-c072-4365-adb4-89ee7f6dc996 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Request method failure captured: May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e HTTP/1.1 May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWVDPzP5MycZ7VcbEvPYu5nF4dnnpJYwAb76HTWuVdzx7AnXgdlM_HcWVyPBT2koNjiojsmpbdHrrNTjz3MC543DIUv9C13KddPlu4pozcajamiN1sQCgr0EEE7TNjfxUDiUwpTK6aKFIcXwO34Z-KdnWBqXE9YQllpDoAikBKL-YAI May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: e815c24f93db46a691126111c7d92a1f May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestShelveInstance-602987168 May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e815c24f93db46a691126111c7d92a1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e815c24f93db46a691126111c7d92a1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e815c24f93db46a691126111c7d92a1f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e815c24f93db46a691126111c7d92a1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestShelveInstance-602987168 May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: e815c24f93db46a691126111c7d92a1f May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestShelveInstance-602987168 May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestShelveInstance-602987168-project May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: cacdb9b294ad482ba157fbb6ba4889ae May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestShelveInstance-602987168-project May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 47c80876-cb95-4bec-8048-2d23ef15bd6e could not be found. May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '47c80876-cb95-4bec-8048-2d23ef15bd6e'} May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47c80876-cb95-4bec-8048-2d23ef15bd6e could not be found. May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c80876-cb95-4bec-8048-2d23ef15bd6e could not be found. May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:27:11.455578 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:27:11.460428 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:27:11.460428 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:27:11.460428 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:27:11.460428 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:27:11.460428 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:27:11.460428 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c80876-cb95-4bec-8048-2d23ef15bd6e could not be found. May 21 22:27:11.460428 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:27:11.460428 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bb74e67e-c072-4365-adb4-89ee7f6dc996 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Returning 404 to user: Instance 47c80876-cb95-4bec-8048-2d23ef15bd6e could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:27:11.460428 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bb74e67e-c072-4365-adb4-89ee7f6dc996 tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e" status: 404 len: 111 microversion: 2.1 time: 0.030859 May 21 22:27:11.460428 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3574/7273] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:27:11 2022] GET /compute/v2.1/servers/47c80876-cb95-4bec-8048-2d23ef15bd6e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:27:11.798173 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-fb42212a-9e94-481f-b0e7-644b2f07d0da tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] Calling method '.version_select at 0x7fc81a5a5af0>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:27:11.878375 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-fb42212a-9e94-481f-b0e7-644b2f07d0da tempest-TestShelveInstance-602987168 tempest-TestShelveInstance-602987168-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1522372516" status: 202 len: 0 microversion: 2.1 time: 0.085472 May 21 22:27:11.879543 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3700/7274] 10.222.0.49 () {58 vars in 1253 bytes} [Sat May 21 22:27:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1522372516 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:27:36.476868 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:27:36.477644 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:27:36.691253 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bd6ba398-8779-47dc-8dcd-d9d7941a37a1 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Action: 'create', calling method: .version_select at 0x7fc819fd6c10>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-525148446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsObIed98h72gn/1vuzld1WTkN1bqoRGF1k2gm8bk5WUujol7Ac5rJ1AdVQd6AqWziS8kh2l7jG3l0z5PeFKMG5oSAyzbVFBKCIVVlW8OwWfZxL55s3C4ya6IK/9Dh4UA=="}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:27:36.707774 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-bd6ba398-8779-47dc-8dcd-d9d7941a37a1 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Getting quotas for project dfb3f27e6ae5446a98281f445844b6e7. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:27:36.713770 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.quota [None req-bd6ba398-8779-47dc-8dcd-d9d7941a37a1 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Getting quotas for user 1927faa22e714e0a8743bf1f0a9d5c38 and project dfb3f27e6ae5446a98281f445844b6e7. Resources: {'key_pairs'} {{(pid=131278) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:27:36.799059 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bd6ba398-8779-47dc-8dcd-d9d7941a37a1 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.327562 May 21 22:27:36.804492 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3575/7275] 10.222.0.49 () {60 vars in 1158 bytes} [Sat May 21 22:27:36 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:27:39.348522 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=22 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:27:39.349371 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:27:39.353334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-347aa591-c692-4262-87d2-e8c17cf84de7 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-304252523", "imageRef": "e570f5eb-6047-4214-a420-fdfdbdf19a4c", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-525148446", "security_groups": [{"name": "tempest-secgroup-smoke-1335181649"}], "networks": [{"uuid": "72f12897-55ae-4105-8498-fba5e44cb557"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:27:39.465588 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-347aa591-c692-4262-87d2-e8c17cf84de7 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] validate_networks() for [('72f12897-55ae-4105-8498-fba5e44cb557', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 22:27:40.010426 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-347aa591-c692-4262-87d2-e8c17cf84de7 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:27:40.010866 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-347aa591-c692-4262-87d2-e8c17cf84de7 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:27:40.011386 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-347aa591-c692-4262-87d2-e8c17cf84de7 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:27:40.011830 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-347aa591-c692-4262-87d2-e8c17cf84de7 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:27:40.012254 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-347aa591-c692-4262-87d2-e8c17cf84de7 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:27:40.022265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-347aa591-c692-4262-87d2-e8c17cf84de7 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:40.022726 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-347aa591-c692-4262-87d2-e8c17cf84de7 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:40.023547 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-347aa591-c692-4262-87d2-e8c17cf84de7 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:40.023999 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-347aa591-c692-4262-87d2-e8c17cf84de7 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:40.043094 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-347aa591-c692-4262-87d2-e8c17cf84de7 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Getting quotas for project dfb3f27e6ae5446a98281f445844b6e7. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:27:40.049328 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-347aa591-c692-4262-87d2-e8c17cf84de7 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Getting quotas for user 1927faa22e714e0a8743bf1f0a9d5c38 and project dfb3f27e6ae5446a98281f445844b6e7. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:27:40.063144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-347aa591-c692-4262-87d2-e8c17cf84de7 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 22:27:40.066332 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-347aa591-c692-4262-87d2-e8c17cf84de7 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e570f5eb-6047-4214-a420-fdfdbdf19a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 22:27:40.184037 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-347aa591-c692-4262-87d2-e8c17cf84de7 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.837369 May 21 22:27:40.188469 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3701/7276] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 22:27:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 22:27:40.195352 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-1aad2bb1-084b-4de4-8e30-c5fcc72a8acc tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:27:40.195977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-1aad2bb1-084b-4de4-8e30-c5fcc72a8acc tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:27:40.290018 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-1aad2bb1-084b-4de4-8e30-c5fcc72a8acc tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:27:40.301586 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-1aad2bb1-084b-4de4-8e30-c5fcc72a8acc tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369" status: 200 len: 1247 microversion: 2.1 time: 0.110442 May 21 22:27:40.302176 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3576/7277] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:27:40 2022] GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369 => generated 1247 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:27:41.320514 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-060e03a8-7abb-4756-957c-675cb3f0ed85 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:27:41.321170 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-060e03a8-7abb-4756-957c-675cb3f0ed85 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:27:41.387974 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-060e03a8-7abb-4756-957c-675cb3f0ed85 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:27:41.398587 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-060e03a8-7abb-4756-957c-675cb3f0ed85 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369" status: 200 len: 1247 microversion: 2.1 time: 0.081074 May 21 22:27:41.398587 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3702/7278] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:27:41 2022] GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369 => generated 1247 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:27:42.414293 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-22310367-b75d-4838-8bcb-2a03ad912b87 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:27:42.414921 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-22310367-b75d-4838-8bcb-2a03ad912b87 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:27:42.426287 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22310367-b75d-4838-8bcb-2a03ad912b87 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:42.426686 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22310367-b75d-4838-8bcb-2a03ad912b87 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:42.427547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22310367-b75d-4838-8bcb-2a03ad912b87 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:42.427989 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-22310367-b75d-4838-8bcb-2a03ad912b87 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:42.498642 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-22310367-b75d-4838-8bcb-2a03ad912b87 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:27:42.506558 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-22310367-b75d-4838-8bcb-2a03ad912b87 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369" status: 200 len: 1299 microversion: 2.1 time: 0.096376 May 21 22:27:42.507135 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3577/7279] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:27:42 2022] GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:27:43.523846 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-bbb543c6-f46c-4e90-a236-2f59290dfe46 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:27:43.524517 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-bbb543c6-f46c-4e90-a236-2f59290dfe46 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:27:43.532025 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bbb543c6-f46c-4e90-a236-2f59290dfe46 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:43.532668 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bbb543c6-f46c-4e90-a236-2f59290dfe46 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:43.533651 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bbb543c6-f46c-4e90-a236-2f59290dfe46 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:43.534109 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-bbb543c6-f46c-4e90-a236-2f59290dfe46 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:43.795501 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-bbb543c6-f46c-4e90-a236-2f59290dfe46 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:27:43.802185 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-bbb543c6-f46c-4e90-a236-2f59290dfe46 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369" status: 200 len: 1373 microversion: 2.1 time: 0.282537 May 21 22:27:43.802777 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3703/7280] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:27:43 2022] GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369 => generated 1373 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:27:44.820270 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-eb38be3c-9699-415e-b652-96f74ea98443 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:27:44.820957 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-eb38be3c-9699-415e-b652-96f74ea98443 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:27:44.828015 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb38be3c-9699-415e-b652-96f74ea98443 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:44.829106 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb38be3c-9699-415e-b652-96f74ea98443 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:44.830058 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb38be3c-9699-415e-b652-96f74ea98443 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:44.830529 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-eb38be3c-9699-415e-b652-96f74ea98443 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:44.991393 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-eb38be3c-9699-415e-b652-96f74ea98443 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:27:45.001990 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-eb38be3c-9699-415e-b652-96f74ea98443 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369" status: 200 len: 1373 microversion: 2.1 time: 0.185241 May 21 22:27:45.003007 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3578/7281] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:27:44 2022] GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369 => generated 1373 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:27:45.203795 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-cffd37ac-37a3-47d8-b654-96a4ffe8b8ba req-6a308a1f-fa3e-40e6-97f7-e6be28fe798c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "001a7ebf-cb0b-4b31-a2dc-6df3615df369", "tag": "8c7fc235-5d25-48c6-bbb2-aa56a98421ba"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:27:45.214892 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cffd37ac-37a3-47d8-b654-96a4ffe8b8ba req-6a308a1f-fa3e-40e6-97f7-e6be28fe798c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:45.215951 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-cffd37ac-37a3-47d8-b654-96a4ffe8b8ba req-6a308a1f-fa3e-40e6-97f7-e6be28fe798c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:45.236345 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-cffd37ac-37a3-47d8-b654-96a4ffe8b8ba req-6a308a1f-fa3e-40e6-97f7-e6be28fe798c service nova] Creating event network-changed:8c7fc235-5d25-48c6-bbb2-aa56a98421ba for instance 001a7ebf-cb0b-4b31-a2dc-6df3615df369 on nch1-master-1 May 21 22:27:45.241727 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-cffd37ac-37a3-47d8-b654-96a4ffe8b8ba req-6a308a1f-fa3e-40e6-97f7-e6be28fe798c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044219 May 21 22:27:45.242404 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3704/7282] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:27:46.019792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-47e89b59-a0ed-4a04-bfa1-442d033d260e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:27:46.020443 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-47e89b59-a0ed-4a04-bfa1-442d033d260e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:27:46.027478 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-47e89b59-a0ed-4a04-bfa1-442d033d260e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:46.027914 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-47e89b59-a0ed-4a04-bfa1-442d033d260e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:46.028968 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-47e89b59-a0ed-4a04-bfa1-442d033d260e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:46.029410 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-47e89b59-a0ed-4a04-bfa1-442d033d260e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:46.188930 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-47e89b59-a0ed-4a04-bfa1-442d033d260e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:27:46.196798 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-47e89b59-a0ed-4a04-bfa1-442d033d260e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369" status: 200 len: 1373 microversion: 2.1 time: 0.181431 May 21 22:27:46.197375 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3579/7283] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:27:46 2022] GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369 => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:27:47.214624 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b7c6f965-a3ab-4bd6-abc0-8872b7d49cec tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:27:47.215345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b7c6f965-a3ab-4bd6-abc0-8872b7d49cec tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:27:47.223258 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7c6f965-a3ab-4bd6-abc0-8872b7d49cec tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:47.223729 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7c6f965-a3ab-4bd6-abc0-8872b7d49cec tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:47.224559 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7c6f965-a3ab-4bd6-abc0-8872b7d49cec tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:47.225017 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b7c6f965-a3ab-4bd6-abc0-8872b7d49cec tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:47.379626 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b7c6f965-a3ab-4bd6-abc0-8872b7d49cec tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:27:47.387506 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b7c6f965-a3ab-4bd6-abc0-8872b7d49cec tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369" status: 200 len: 1373 microversion: 2.1 time: 0.177449 May 21 22:27:47.388090 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3705/7284] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:27:47 2022] GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:27:48.404765 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-98cab612-e3be-46dc-8e42-c108a9ecd612 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:27:48.405387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-98cab612-e3be-46dc-8e42-c108a9ecd612 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:27:48.412915 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98cab612-e3be-46dc-8e42-c108a9ecd612 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:48.413375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98cab612-e3be-46dc-8e42-c108a9ecd612 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:48.414199 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98cab612-e3be-46dc-8e42-c108a9ecd612 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:48.414598 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-98cab612-e3be-46dc-8e42-c108a9ecd612 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:48.561395 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-98cab612-e3be-46dc-8e42-c108a9ecd612 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:27:48.569659 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-98cab612-e3be-46dc-8e42-c108a9ecd612 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369" status: 200 len: 1373 microversion: 2.1 time: 0.168887 May 21 22:27:48.570270 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3580/7285] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:27:48 2022] GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369 => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:27:49.587471 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-70666cc7-4ff0-4f56-ae38-ca0f2a8d98b5 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:27:49.588112 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-70666cc7-4ff0-4f56-ae38-ca0f2a8d98b5 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:27:49.595495 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-70666cc7-4ff0-4f56-ae38-ca0f2a8d98b5 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:49.595968 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-70666cc7-4ff0-4f56-ae38-ca0f2a8d98b5 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:49.596798 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-70666cc7-4ff0-4f56-ae38-ca0f2a8d98b5 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:49.597265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-70666cc7-4ff0-4f56-ae38-ca0f2a8d98b5 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:49.743088 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-70666cc7-4ff0-4f56-ae38-ca0f2a8d98b5 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:27:49.751277 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-70666cc7-4ff0-4f56-ae38-ca0f2a8d98b5 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369" status: 200 len: 1373 microversion: 2.1 time: 0.168515 May 21 22:27:49.751896 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3706/7286] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:27:49 2022] GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369 => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:27:50.769529 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3bfdf483-a67b-4e04-89ab-93ce6ec2cfc0 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:27:50.770177 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3bfdf483-a67b-4e04-89ab-93ce6ec2cfc0 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:27:50.773045 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=6 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:27:50.781012 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3bfdf483-a67b-4e04-89ab-93ce6ec2cfc0 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:50.781564 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3bfdf483-a67b-4e04-89ab-93ce6ec2cfc0 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:50.783685 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3bfdf483-a67b-4e04-89ab-93ce6ec2cfc0 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:50.784132 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3bfdf483-a67b-4e04-89ab-93ce6ec2cfc0 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:50.936370 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3bfdf483-a67b-4e04-89ab-93ce6ec2cfc0 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:27:50.944656 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3bfdf483-a67b-4e04-89ab-93ce6ec2cfc0 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369" status: 200 len: 1373 microversion: 2.1 time: 0.180224 May 21 22:27:50.945133 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3581/7287] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:27:50 2022] GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369 => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 21 22:27:51.961919 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-07e457b8-aca7-4f4f-806f-f3c1b57864b6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:27:51.962452 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-07e457b8-aca7-4f4f-806f-f3c1b57864b6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:27:51.964802 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:27:51.966339 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=8 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:27:51.971670 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07e457b8-aca7-4f4f-806f-f3c1b57864b6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:51.972137 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07e457b8-aca7-4f4f-806f-f3c1b57864b6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:51.973115 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07e457b8-aca7-4f4f-806f-f3c1b57864b6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:51.973578 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-07e457b8-aca7-4f4f-806f-f3c1b57864b6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:52.125012 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-07e457b8-aca7-4f4f-806f-f3c1b57864b6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:27:52.133392 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-07e457b8-aca7-4f4f-806f-f3c1b57864b6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369" status: 200 len: 1373 microversion: 2.1 time: 0.175567 May 21 22:27:52.133988 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3707/7288] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:27:51 2022] GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369 => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:27:52.450800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-48e83e14-3412-4676-9a54-6e7ad68c8908 req-981f6759-a511-41f5-8b2d-d790d14e1587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "001a7ebf-cb0b-4b31-a2dc-6df3615df369", "name": "network-vif-plugged", "status": "completed", "tag": "8c7fc235-5d25-48c6-bbb2-aa56a98421ba"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:27:52.460941 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-48e83e14-3412-4676-9a54-6e7ad68c8908 req-981f6759-a511-41f5-8b2d-d790d14e1587 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:52.461387 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-48e83e14-3412-4676-9a54-6e7ad68c8908 req-981f6759-a511-41f5-8b2d-d790d14e1587 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:52.472798 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-48e83e14-3412-4676-9a54-6e7ad68c8908 req-981f6759-a511-41f5-8b2d-d790d14e1587 service nova] Creating event network-vif-plugged:8c7fc235-5d25-48c6-bbb2-aa56a98421ba for instance 001a7ebf-cb0b-4b31-a2dc-6df3615df369 on nch1-master-1 May 21 22:27:52.477834 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-48e83e14-3412-4676-9a54-6e7ad68c8908 req-981f6759-a511-41f5-8b2d-d790d14e1587 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030753 May 21 22:27:52.479089 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3582/7289] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:27:53.150502 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-260e46a0-2a56-4c92-8272-5d7beed8be11 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:27:53.151134 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-260e46a0-2a56-4c92-8272-5d7beed8be11 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:27:53.159334 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-260e46a0-2a56-4c92-8272-5d7beed8be11 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:53.159800 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-260e46a0-2a56-4c92-8272-5d7beed8be11 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:53.160607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-260e46a0-2a56-4c92-8272-5d7beed8be11 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:53.161057 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-260e46a0-2a56-4c92-8272-5d7beed8be11 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:53.313563 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-260e46a0-2a56-4c92-8272-5d7beed8be11 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:27:53.321426 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-260e46a0-2a56-4c92-8272-5d7beed8be11 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369" status: 200 len: 1373 microversion: 2.1 time: 0.174820 May 21 22:27:53.322012 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3708/7290] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:27:53 2022] GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:27:54.340143 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-2a2271f8-3919-4417-891c-fdbddcfcfde0 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:27:54.340897 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-2a2271f8-3919-4417-891c-fdbddcfcfde0 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:27:54.348031 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a2271f8-3919-4417-891c-fdbddcfcfde0 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:54.348523 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a2271f8-3919-4417-891c-fdbddcfcfde0 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:54.349302 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a2271f8-3919-4417-891c-fdbddcfcfde0 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:54.349747 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-2a2271f8-3919-4417-891c-fdbddcfcfde0 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:54.502745 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-2a2271f8-3919-4417-891c-fdbddcfcfde0 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:27:54.510561 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-2a2271f8-3919-4417-891c-fdbddcfcfde0 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369" status: 200 len: 1558 microversion: 2.1 time: 0.176042 May 21 22:27:54.511146 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3583/7291] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:27:54 2022] GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369 => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:27:54.527319 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-6ccb9c72-4263-44cd-af74-01c972bff397 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:27:54.527960 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-6ccb9c72-4263-44cd-af74-01c972bff397 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:27:54.535941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ccb9c72-4263-44cd-af74-01c972bff397 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:54.536447 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ccb9c72-4263-44cd-af74-01c972bff397 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:54.537288 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ccb9c72-4263-44cd-af74-01c972bff397 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:54.537752 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-6ccb9c72-4263-44cd-af74-01c972bff397 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:54.686570 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-6ccb9c72-4263-44cd-af74-01c972bff397 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:27:54.694851 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-6ccb9c72-4263-44cd-af74-01c972bff397 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369" status: 200 len: 1558 microversion: 2.1 time: 0.171484 May 21 22:27:54.695417 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3709/7292] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:27:54 2022] GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:27:56.894036 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-77dda477-e161-41ae-be12-35eb80ae8922 req-8cb271d6-aa4d-4042-b39c-89a2699128e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "001a7ebf-cb0b-4b31-a2dc-6df3615df369", "tag": "8c7fc235-5d25-48c6-bbb2-aa56a98421ba"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:27:56.898856 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-77dda477-e161-41ae-be12-35eb80ae8922 req-8cb271d6-aa4d-4042-b39c-89a2699128e7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:27:56.899311 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-77dda477-e161-41ae-be12-35eb80ae8922 req-8cb271d6-aa4d-4042-b39c-89a2699128e7 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:27:56.911150 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-77dda477-e161-41ae-be12-35eb80ae8922 req-8cb271d6-aa4d-4042-b39c-89a2699128e7 service nova] Creating event network-changed:8c7fc235-5d25-48c6-bbb2-aa56a98421ba for instance 001a7ebf-cb0b-4b31-a2dc-6df3615df369 on nch1-master-1 May 21 22:27:56.916589 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-77dda477-e161-41ae-be12-35eb80ae8922 req-8cb271d6-aa4d-4042-b39c-89a2699128e7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031731 May 21 22:27:56.917289 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3584/7293] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:28:26.672160 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:28:26.672886 ncdv-master-1 devstack@n-api.service[131278]: Sat May 21 22:28:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:29:51.094295 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:29:51.094996 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=40 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:29:51.099074 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-89e3298f-0c49-40a1-adbe-6355e2c39420 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-32104327"}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:29:51.100168 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-89e3298f-0c49-40a1-adbe-6355e2c39420 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:29:51.106370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89e3298f-0c49-40a1-adbe-6355e2c39420 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:29:51.108900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89e3298f-0c49-40a1-adbe-6355e2c39420 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:29:51.108900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89e3298f-0c49-40a1-adbe-6355e2c39420 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:29:51.108900 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-89e3298f-0c49-40a1-adbe-6355e2c39420 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:29:51.646235 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-89e3298f-0c49-40a1-adbe-6355e2c39420 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "POST /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369/action" status: 202 len: 0 microversion: 2.1 time: 0.554171 May 21 22:29:51.646870 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3710/7294] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:29:51 2022] POST /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 21 22:29:58.857845 ncdv-master-1 devstack@n-api.service[131278]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7e4f995f-1c03-418a-9049-52ff0456baf3] AMQP server on 10.222.0.49:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 21 22:29:58.867184 ncdv-master-1 devstack@n-api.service[131278]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c228418-8689-4977-b0bb-d0fe96d67aa9] AMQP server on 10.222.0.49:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 21 22:29:58.867184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:29:58.867184 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=40 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:29:58.940399 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-5732261c-00f1-4c1e-a1f2-9d25a239dafe req-946c8fde-6766-4139-833b-7d8dbce09570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "001a7ebf-cb0b-4b31-a2dc-6df3615df369", "name": "network-vif-plugged", "status": "completed", "tag": "8c7fc235-5d25-48c6-bbb2-aa56a98421ba"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:29:58.964325 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-5732261c-00f1-4c1e-a1f2-9d25a239dafe req-946c8fde-6766-4139-833b-7d8dbce09570 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:29:58.966146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-5732261c-00f1-4c1e-a1f2-9d25a239dafe req-946c8fde-6766-4139-833b-7d8dbce09570 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:29:58.981607 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-5732261c-00f1-4c1e-a1f2-9d25a239dafe req-946c8fde-6766-4139-833b-7d8dbce09570 service nova] Creating event network-vif-plugged:8c7fc235-5d25-48c6-bbb2-aa56a98421ba for instance 001a7ebf-cb0b-4b31-a2dc-6df3615df369 on nch1-master-1 May 21 22:29:58.990631 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-5732261c-00f1-4c1e-a1f2-9d25a239dafe req-946c8fde-6766-4139-833b-7d8dbce09570 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134636 May 21 22:29:58.991267 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3585/7295] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:30:06.563356 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:30:06.564050 ncdv-master-1 devstack@n-api.service[131278]: Sat May 21 22:30:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:30:07.317649 ncdv-master-1 devstack@n-api.service[131277]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5f720f21-082c-449e-9bd7-36d6581a2009] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 21 22:30:07.321595 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2ee93d9d-9380-4e8a-a1b8-5828cf24ebb6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-822307363", "imageRef": "61c1da2c-826b-430c-86c0-8b8aea413bef", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-525148446", "security_groups": [{"name": "tempest-secgroup-smoke-1335181649"}], "networks": [{"uuid": "72f12897-55ae-4105-8498-fba5e44cb557"}]}} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:30:07.329702 ncdv-master-1 devstack@n-api.service[131277]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f14f1b38-6a99-4d58-b2cc-323ca7840d25] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 21 22:30:07.330174 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:30:07.330897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:30:07.442953 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.network.neutron [None req-2ee93d9d-9380-4e8a-a1b8-5828cf24ebb6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] validate_networks() for [('72f12897-55ae-4105-8498-fba5e44cb557', None, None, None, None, None)] {{(pid=131277) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 21 22:30:07.549232 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:30:07.549453 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 22:30:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.49) !!! May 21 22:30:07.773599 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:30:07.773931 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 22:30:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.49) !!! May 21 22:30:07.883481 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-2ee93d9d-9380-4e8a-a1b8-5828cf24ebb6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Flavor limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 21 22:30:07.883916 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-2ee93d9d-9380-4e8a-a1b8-5828cf24ebb6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Image limits 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 21 22:30:07.884439 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-2ee93d9d-9380-4e8a-a1b8-5828cf24ebb6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Flavor pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 21 22:30:07.884865 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-2ee93d9d-9380-4e8a-a1b8-5828cf24ebb6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Image pref 0:0:0 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 21 22:30:07.885295 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.virt.hardware [None req-2ee93d9d-9380-4e8a-a1b8-5828cf24ebb6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 21 22:30:07.894494 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2ee93d9d-9380-4e8a-a1b8-5828cf24ebb6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:07.894958 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2ee93d9d-9380-4e8a-a1b8-5828cf24ebb6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:07.895841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2ee93d9d-9380-4e8a-a1b8-5828cf24ebb6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:07.896310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2ee93d9d-9380-4e8a-a1b8-5828cf24ebb6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:07.914267 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-2ee93d9d-9380-4e8a-a1b8-5828cf24ebb6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Getting quotas for project dfb3f27e6ae5446a98281f445844b6e7. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 21 22:30:07.919723 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.quota [None req-2ee93d9d-9380-4e8a-a1b8-5828cf24ebb6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Getting quotas for user 1927faa22e714e0a8743bf1f0a9d5c38 and project dfb3f27e6ae5446a98281f445844b6e7. Resources: {'instances', 'cores', 'ram'} {{(pid=131277) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 21 22:30:07.932922 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2ee93d9d-9380-4e8a-a1b8-5828cf24ebb6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Going to run 1 instances... {{(pid=131277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 21 22:30:07.939127 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2ee93d9d-9380-4e8a-a1b8-5828cf24ebb6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61c1da2c-826b-430c-86c0-8b8aea413bef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 21 22:30:08.079467 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2ee93d9d-9380-4e8a-a1b8-5828cf24ebb6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.763249 May 21 22:30:08.080124 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3711/7296] 10.222.0.49 () {60 vars in 1146 bytes} [Sat May 21 22:30:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 21 22:30:08.093816 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-f4ee753b-a6bb-46ca-b2a9-ec91c9237189 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:30:08.099259 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-f4ee753b-a6bb-46ca-b2a9-ec91c9237189 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:30:08.112070 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] [7e4f995f-1c03-418a-9049-52ff0456baf3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42982. May 21 22:30:08.127354 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c228418-8689-4977-b0bb-d0fe96d67aa9] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42984. May 21 22:30:08.165540 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-f4ee753b-a6bb-46ca-b2a9-ec91c9237189 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:30:08.176138 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-f4ee753b-a6bb-46ca-b2a9-ec91c9237189 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 200 len: 1247 microversion: 2.1 time: 0.089536 May 21 22:30:08.184532 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3586/7297] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:30:08 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 1247 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:30:09.198206 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e44a1898-d0b6-4a42-b4ba-f2df11e2d6f4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:30:09.198990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e44a1898-d0b6-4a42-b4ba-f2df11e2d6f4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:30:09.211062 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e44a1898-d0b6-4a42-b4ba-f2df11e2d6f4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:09.211850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e44a1898-d0b6-4a42-b4ba-f2df11e2d6f4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:09.213353 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e44a1898-d0b6-4a42-b4ba-f2df11e2d6f4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:09.214274 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e44a1898-d0b6-4a42-b4ba-f2df11e2d6f4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:09.220250 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] [5f720f21-082c-449e-9bd7-36d6581a2009] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43002. May 21 22:30:09.221755 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] [f14f1b38-6a99-4d58-b2cc-323ca7840d25] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43004. May 21 22:30:09.287667 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e44a1898-d0b6-4a42-b4ba-f2df11e2d6f4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:30:09.295397 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e44a1898-d0b6-4a42-b4ba-f2df11e2d6f4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 200 len: 1251 microversion: 2.1 time: 0.104295 May 21 22:30:09.295984 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3712/7298] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:30:09 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 1251 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:30:10.313127 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-94262d88-ec03-47af-b4c6-9728566432e2 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:30:10.316684 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-94262d88-ec03-47af-b4c6-9728566432e2 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:30:10.322762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94262d88-ec03-47af-b4c6-9728566432e2 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:10.323547 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94262d88-ec03-47af-b4c6-9728566432e2 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:10.324251 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94262d88-ec03-47af-b4c6-9728566432e2 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:10.324814 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-94262d88-ec03-47af-b4c6-9728566432e2 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:10.407009 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-94262d88-ec03-47af-b4c6-9728566432e2 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:30:10.415017 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-94262d88-ec03-47af-b4c6-9728566432e2 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 200 len: 1307 microversion: 2.1 time: 0.106427 May 21 22:30:10.415600 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3587/7299] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:30:10 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:30:10.833709 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-6ed56ac4-8c8b-46ca-b718-568ad37a01d1 req-237c5afe-3ed8-47ef-b423-f75adb6b83fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "001a7ebf-cb0b-4b31-a2dc-6df3615df369", "name": "network-vif-unplugged", "status": "completed", "tag": "8c7fc235-5d25-48c6-bbb2-aa56a98421ba"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:30:10.844675 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6ed56ac4-8c8b-46ca-b718-568ad37a01d1 req-237c5afe-3ed8-47ef-b423-f75adb6b83fd service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:10.845144 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-6ed56ac4-8c8b-46ca-b718-568ad37a01d1 req-237c5afe-3ed8-47ef-b423-f75adb6b83fd service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:10.856793 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-6ed56ac4-8c8b-46ca-b718-568ad37a01d1 req-237c5afe-3ed8-47ef-b423-f75adb6b83fd service nova] Creating event network-vif-unplugged:8c7fc235-5d25-48c6-bbb2-aa56a98421ba for instance 001a7ebf-cb0b-4b31-a2dc-6df3615df369 on nch1-master-1 May 21 22:30:10.865379 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-6ed56ac4-8c8b-46ca-b718-568ad37a01d1 req-237c5afe-3ed8-47ef-b423-f75adb6b83fd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032210 May 21 22:30:10.865379 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3713/7300] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:30:11.432356 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-26263b67-d755-490e-8657-c4982f3cda44 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:30:11.432998 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-26263b67-d755-490e-8657-c4982f3cda44 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:30:11.456375 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-26263b67-d755-490e-8657-c4982f3cda44 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:11.456985 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-26263b67-d755-490e-8657-c4982f3cda44 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:11.457820 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-26263b67-d755-490e-8657-c4982f3cda44 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:11.458271 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-26263b67-d755-490e-8657-c4982f3cda44 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:11.671762 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-26263b67-d755-490e-8657-c4982f3cda44 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:30:11.680517 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-26263b67-d755-490e-8657-c4982f3cda44 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 200 len: 1373 microversion: 2.1 time: 0.252258 May 21 22:30:11.683360 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3588/7301] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:30:11 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 1373 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:30:12.702100 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-b1d64ae2-1932-41b4-a870-9b071d53145e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:30:12.703540 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-b1d64ae2-1932-41b4-a870-9b071d53145e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:30:12.725671 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1d64ae2-1932-41b4-a870-9b071d53145e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:12.726436 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1d64ae2-1932-41b4-a870-9b071d53145e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:12.727430 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1d64ae2-1932-41b4-a870-9b071d53145e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:12.728756 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-b1d64ae2-1932-41b4-a870-9b071d53145e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:12.939053 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-b1d64ae2-1932-41b4-a870-9b071d53145e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:30:12.950216 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-b1d64ae2-1932-41b4-a870-9b071d53145e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 200 len: 1373 microversion: 2.1 time: 0.254562 May 21 22:30:12.961006 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3714/7302] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:30:12 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 1373 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:30:13.979927 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-40bd5dd2-cfba-490f-aeb3-1cf7f9b7b35e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:30:13.980737 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-40bd5dd2-cfba-490f-aeb3-1cf7f9b7b35e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:30:13.991389 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40bd5dd2-cfba-490f-aeb3-1cf7f9b7b35e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:13.992152 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40bd5dd2-cfba-490f-aeb3-1cf7f9b7b35e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:13.993341 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40bd5dd2-cfba-490f-aeb3-1cf7f9b7b35e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:13.993961 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-40bd5dd2-cfba-490f-aeb3-1cf7f9b7b35e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:14.173964 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-40bd5dd2-cfba-490f-aeb3-1cf7f9b7b35e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:30:14.186830 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-40bd5dd2-cfba-490f-aeb3-1cf7f9b7b35e tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 200 len: 1373 microversion: 2.1 time: 0.210648 May 21 22:30:14.188198 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3589/7303] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:30:13 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 1373 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:30:15.206097 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-e0d0d098-fa94-4ae1-b6d1-d36a016ee4cd tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:30:15.206850 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-e0d0d098-fa94-4ae1-b6d1-d36a016ee4cd tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:30:15.214250 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e0d0d098-fa94-4ae1-b6d1-d36a016ee4cd tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:15.214831 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e0d0d098-fa94-4ae1-b6d1-d36a016ee4cd tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:15.215897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e0d0d098-fa94-4ae1-b6d1-d36a016ee4cd tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:15.216390 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-e0d0d098-fa94-4ae1-b6d1-d36a016ee4cd tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:15.384973 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-e0d0d098-fa94-4ae1-b6d1-d36a016ee4cd tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:30:15.393939 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-e0d0d098-fa94-4ae1-b6d1-d36a016ee4cd tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 200 len: 1373 microversion: 2.1 time: 0.191788 May 21 22:30:15.403277 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3715/7304] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:30:15 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 1373 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:30:16.411299 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-6d617b2d-487e-478e-ab47-2ef05e60aeed tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:30:16.411942 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-6d617b2d-487e-478e-ab47-2ef05e60aeed tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:30:16.419024 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d617b2d-487e-478e-ab47-2ef05e60aeed tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:16.419485 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d617b2d-487e-478e-ab47-2ef05e60aeed tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:16.420970 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d617b2d-487e-478e-ab47-2ef05e60aeed tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:16.421416 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-6d617b2d-487e-478e-ab47-2ef05e60aeed tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:16.602743 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-6d617b2d-487e-478e-ab47-2ef05e60aeed tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:30:16.611440 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-6d617b2d-487e-478e-ab47-2ef05e60aeed tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 200 len: 1373 microversion: 2.1 time: 0.204013 May 21 22:30:16.618113 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3590/7305] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:30:16 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 1373 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:30:17.629027 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-571e490f-a86f-42f9-b4e0-94d9a4d29d19 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:30:17.629964 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-571e490f-a86f-42f9-b4e0-94d9a4d29d19 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:30:17.638135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-571e490f-a86f-42f9-b4e0-94d9a4d29d19 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:17.639406 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-571e490f-a86f-42f9-b4e0-94d9a4d29d19 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:17.640372 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-571e490f-a86f-42f9-b4e0-94d9a4d29d19 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:17.640774 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-571e490f-a86f-42f9-b4e0-94d9a4d29d19 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:17.814602 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-571e490f-a86f-42f9-b4e0-94d9a4d29d19 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:30:17.822110 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-571e490f-a86f-42f9-b4e0-94d9a4d29d19 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 200 len: 1373 microversion: 2.1 time: 0.197613 May 21 22:30:17.822787 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3716/7306] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:30:17 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 1373 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:30:18.839800 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-a5cb59ab-0f16-46e3-84b9-eccf6763390a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:30:18.842397 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-a5cb59ab-0f16-46e3-84b9-eccf6763390a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:30:18.845425 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell0:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:30:18.851307 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5cb59ab-0f16-46e3-84b9-eccf6763390a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:18.851988 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5cb59ab-0f16-46e3-84b9-eccf6763390a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:18.852980 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5cb59ab-0f16-46e3-84b9-eccf6763390a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:18.853581 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-a5cb59ab-0f16-46e3-84b9-eccf6763390a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:19.135820 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-a5cb59ab-0f16-46e3-84b9-eccf6763390a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:30:19.145908 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-a5cb59ab-0f16-46e3-84b9-eccf6763390a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 200 len: 1373 microversion: 2.1 time: 0.310031 May 21 22:30:19.146714 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3591/7307] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:30:18 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 1373 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:30:19.989071 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=2 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:30:19.992879 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell0:SELECT=6 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:30:20.064741 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-d07649ea-79c7-4234-9493-1936d0c246cc req-6c74e5b1-f6d1-4e7b-b731-a0a24da74ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fc0aca2-1f87-43db-aff6-5459b5b21e55", "tag": "6d66a2b9-9050-4c70-ab1d-23dc6f4f53bb"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:30:20.074466 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d07649ea-79c7-4234-9493-1936d0c246cc req-6c74e5b1-f6d1-4e7b-b731-a0a24da74ec8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:20.075310 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-d07649ea-79c7-4234-9493-1936d0c246cc req-6c74e5b1-f6d1-4e7b-b731-a0a24da74ec8 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:20.088426 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-d07649ea-79c7-4234-9493-1936d0c246cc req-6c74e5b1-f6d1-4e7b-b731-a0a24da74ec8 service nova] Creating event network-changed:6d66a2b9-9050-4c70-ab1d-23dc6f4f53bb for instance 3fc0aca2-1f87-43db-aff6-5459b5b21e55 on nch2-master-1 May 21 22:30:20.095382 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-d07649ea-79c7-4234-9493-1936d0c246cc req-6c74e5b1-f6d1-4e7b-b731-a0a24da74ec8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110746 May 21 22:30:20.096703 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3717/7308] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:30:20.164150 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-bdcad8d7-d15d-487d-841b-710f70c0e93a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:30:20.164831 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-bdcad8d7-d15d-487d-841b-710f70c0e93a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:30:20.173758 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bdcad8d7-d15d-487d-841b-710f70c0e93a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:20.174615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bdcad8d7-d15d-487d-841b-710f70c0e93a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:20.175585 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bdcad8d7-d15d-487d-841b-710f70c0e93a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:20.176099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-bdcad8d7-d15d-487d-841b-710f70c0e93a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:20.402191 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-bdcad8d7-d15d-487d-841b-710f70c0e93a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:30:20.410608 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-bdcad8d7-d15d-487d-841b-710f70c0e93a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 200 len: 1373 microversion: 2.1 time: 0.250740 May 21 22:30:20.411331 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3592/7309] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:30:20 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 1373 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:30:21.431241 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-af48422a-a4d7-43a9-97a0-8e949b5023d5 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:30:21.431969 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-af48422a-a4d7-43a9-97a0-8e949b5023d5 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:30:21.439694 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af48422a-a4d7-43a9-97a0-8e949b5023d5 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:21.440165 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af48422a-a4d7-43a9-97a0-8e949b5023d5 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:21.440986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af48422a-a4d7-43a9-97a0-8e949b5023d5 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:21.441446 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-af48422a-a4d7-43a9-97a0-8e949b5023d5 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:21.597837 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-af48422a-a4d7-43a9-97a0-8e949b5023d5 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:30:21.605632 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-af48422a-a4d7-43a9-97a0-8e949b5023d5 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 200 len: 1373 microversion: 2.1 time: 0.179961 May 21 22:30:21.606204 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3718/7310] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:30:21 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:30:22.623983 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-b3e67fbf-3b20-486d-8f31-e7fc7f898eaf tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:30:22.624640 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-b3e67fbf-3b20-486d-8f31-e7fc7f898eaf tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:30:22.631741 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3e67fbf-3b20-486d-8f31-e7fc7f898eaf tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:22.632203 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3e67fbf-3b20-486d-8f31-e7fc7f898eaf tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:22.633026 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3e67fbf-3b20-486d-8f31-e7fc7f898eaf tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:22.633474 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-b3e67fbf-3b20-486d-8f31-e7fc7f898eaf tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:22.781296 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-b3e67fbf-3b20-486d-8f31-e7fc7f898eaf tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:30:22.789082 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-b3e67fbf-3b20-486d-8f31-e7fc7f898eaf tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 200 len: 1373 microversion: 2.1 time: 0.169664 May 21 22:30:22.789590 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3593/7311] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:30:22 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:30:23.806411 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-2b79df7b-c364-452c-b812-a77cb39cbfa6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:30:23.807037 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-2b79df7b-c364-452c-b812-a77cb39cbfa6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:30:23.814912 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b79df7b-c364-452c-b812-a77cb39cbfa6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:23.815375 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b79df7b-c364-452c-b812-a77cb39cbfa6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:23.816152 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b79df7b-c364-452c-b812-a77cb39cbfa6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:23.816637 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-2b79df7b-c364-452c-b812-a77cb39cbfa6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:23.965608 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-2b79df7b-c364-452c-b812-a77cb39cbfa6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:30:23.973367 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-2b79df7b-c364-452c-b812-a77cb39cbfa6 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 200 len: 1373 microversion: 2.1 time: 0.170824 May 21 22:30:23.973948 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3719/7312] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:30:23 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:30:24.990405 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cbfd7c25-8653-45b6-9964-7bc947d8113a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:30:24.991061 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cbfd7c25-8653-45b6-9964-7bc947d8113a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:30:24.998910 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbfd7c25-8653-45b6-9964-7bc947d8113a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:24.999365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbfd7c25-8653-45b6-9964-7bc947d8113a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:25.000135 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbfd7c25-8653-45b6-9964-7bc947d8113a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:25.000601 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cbfd7c25-8653-45b6-9964-7bc947d8113a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:25.150146 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-cbfd7c25-8653-45b6-9964-7bc947d8113a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:30:25.158677 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cbfd7c25-8653-45b6-9964-7bc947d8113a tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 200 len: 1373 microversion: 2.1 time: 0.172171 May 21 22:30:25.159264 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3594/7313] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:30:24 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:30:25.208016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-9e184ee4-5512-4ccf-9b40-d89af88a3bf3 req-8ffc42a3-03c3-4b63-9147-b22577aadb7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc0aca2-1f87-43db-aff6-5459b5b21e55", "name": "network-vif-plugged", "status": "completed", "tag": "6d66a2b9-9050-4c70-ab1d-23dc6f4f53bb"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:30:25.217473 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-9e184ee4-5512-4ccf-9b40-d89af88a3bf3 req-8ffc42a3-03c3-4b63-9147-b22577aadb7c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:25.217941 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-9e184ee4-5512-4ccf-9b40-d89af88a3bf3 req-8ffc42a3-03c3-4b63-9147-b22577aadb7c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:25.232415 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-9e184ee4-5512-4ccf-9b40-d89af88a3bf3 req-8ffc42a3-03c3-4b63-9147-b22577aadb7c service nova] Creating event network-vif-plugged:6d66a2b9-9050-4c70-ab1d-23dc6f4f53bb for instance 3fc0aca2-1f87-43db-aff6-5459b5b21e55 on nch2-master-1 May 21 22:30:25.234498 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-9e184ee4-5512-4ccf-9b40-d89af88a3bf3 req-8ffc42a3-03c3-4b63-9147-b22577aadb7c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030273 May 21 22:30:25.235077 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3720/7314] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:30:26.176227 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0bcc8e3b-a6b6-4336-9918-08e092705be2 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:30:26.176894 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0bcc8e3b-a6b6-4336-9918-08e092705be2 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:30:26.184157 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bcc8e3b-a6b6-4336-9918-08e092705be2 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:26.184648 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bcc8e3b-a6b6-4336-9918-08e092705be2 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:26.186451 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bcc8e3b-a6b6-4336-9918-08e092705be2 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:26.186896 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0bcc8e3b-a6b6-4336-9918-08e092705be2 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:26.333875 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0bcc8e3b-a6b6-4336-9918-08e092705be2 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:30:26.342132 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0bcc8e3b-a6b6-4336-9918-08e092705be2 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 200 len: 1373 microversion: 2.1 time: 0.169646 May 21 22:30:26.342739 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3595/7315] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:30:26 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:30:27.360515 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-8d827d72-3f87-41a1-a54c-086ce56be3f4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:30:27.361265 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-8d827d72-3f87-41a1-a54c-086ce56be3f4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:30:27.367713 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8d827d72-3f87-41a1-a54c-086ce56be3f4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:27.368176 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8d827d72-3f87-41a1-a54c-086ce56be3f4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:27.368986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8d827d72-3f87-41a1-a54c-086ce56be3f4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:27.369439 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-8d827d72-3f87-41a1-a54c-086ce56be3f4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:27.512593 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-8d827d72-3f87-41a1-a54c-086ce56be3f4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:30:27.521179 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-8d827d72-3f87-41a1-a54c-086ce56be3f4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 200 len: 1558 microversion: 2.1 time: 0.165946 May 21 22:30:27.521743 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3721/7316] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:30:27 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:30:27.537975 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-3e2b1c68-204f-4e15-9040-f6d5560c36b4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:30:27.538629 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-3e2b1c68-204f-4e15-9040-f6d5560c36b4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:30:27.545679 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e2b1c68-204f-4e15-9040-f6d5560c36b4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:27.546123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e2b1c68-204f-4e15-9040-f6d5560c36b4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:27.546893 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e2b1c68-204f-4e15-9040-f6d5560c36b4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:27.547333 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-3e2b1c68-204f-4e15-9040-f6d5560c36b4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:27.696621 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-3e2b1c68-204f-4e15-9040-f6d5560c36b4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:30:27.705129 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-3e2b1c68-204f-4e15-9040-f6d5560c36b4 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 200 len: 1558 microversion: 2.1 time: 0.171022 May 21 22:30:27.705734 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3596/7317] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:30:27 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:30:30.222543 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-1bf110ec-421c-487d-a5c9-e4d00aa6cc0c req-ba85953f-218d-497c-977f-f513f8f3c3c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fc0aca2-1f87-43db-aff6-5459b5b21e55", "tag": "6d66a2b9-9050-4c70-ab1d-23dc6f4f53bb"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:30:30.231949 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-1bf110ec-421c-487d-a5c9-e4d00aa6cc0c req-ba85953f-218d-497c-977f-f513f8f3c3c0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:30:30.232853 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-1bf110ec-421c-487d-a5c9-e4d00aa6cc0c req-ba85953f-218d-497c-977f-f513f8f3c3c0 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:30:30.245372 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-1bf110ec-421c-487d-a5c9-e4d00aa6cc0c req-ba85953f-218d-497c-977f-f513f8f3c3c0 service nova] Creating event network-changed:6d66a2b9-9050-4c70-ab1d-23dc6f4f53bb for instance 3fc0aca2-1f87-43db-aff6-5459b5b21e55 on nch2-master-1 May 21 22:30:30.251389 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-1bf110ec-421c-487d-a5c9-e4d00aa6cc0c req-ba85953f-218d-497c-977f-f513f8f3c3c0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032643 May 21 22:30:30.253412 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3722/7318] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:31:46.680262 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:31:46.680907 ncdv-master-1 devstack@n-api.service[131278]: Sat May 21 22:31:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:31:58.545027 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=26 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:31:58.546085 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=62 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:31:58.550336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-78b43944-5d08-4637-9c48-36aea8e67435 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-796087446"}} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:31:58.551588 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-78b43944-5d08-4637-9c48-36aea8e67435 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:31:58.557900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78b43944-5d08-4637-9c48-36aea8e67435 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:31:58.560692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78b43944-5d08-4637-9c48-36aea8e67435 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:31:58.560692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78b43944-5d08-4637-9c48-36aea8e67435 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:31:58.560692 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-78b43944-5d08-4637-9c48-36aea8e67435 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:31:59.052183 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-78b43944-5d08-4637-9c48-36aea8e67435 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "POST /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55/action" status: 202 len: 0 microversion: 2.1 time: 0.509028 May 21 22:31:59.052963 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3597/7319] 10.222.0.49 () {60 vars in 1277 bytes} [Sat May 21 22:31:58 2022] POST /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 21 22:32:05.651467 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:32:05.652492 ncdv-master-1 devstack@n-api.service[131277]: DEBUG dbcounter [-] [131277] Writing DB stats nova_cell1:SELECT=52 {{(pid=131277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:32:05.657834 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-07f6d337-0326-45da-b71b-e7c5156d318a req-1e581bcb-9116-4e01-90d3-23cd41020553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc0aca2-1f87-43db-aff6-5459b5b21e55", "name": "network-vif-plugged", "status": "completed", "tag": "6d66a2b9-9050-4c70-ab1d-23dc6f4f53bb"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:32:05.670692 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-07f6d337-0326-45da-b71b-e7c5156d318a req-1e581bcb-9116-4e01-90d3-23cd41020553 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:05.671368 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-07f6d337-0326-45da-b71b-e7c5156d318a req-1e581bcb-9116-4e01-90d3-23cd41020553 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:05.686454 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-07f6d337-0326-45da-b71b-e7c5156d318a req-1e581bcb-9116-4e01-90d3-23cd41020553 service nova] Creating event network-vif-plugged:6d66a2b9-9050-4c70-ab1d-23dc6f4f53bb for instance 3fc0aca2-1f87-43db-aff6-5459b5b21e55 on nch2-master-1 May 21 22:32:05.694765 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-07f6d337-0326-45da-b71b-e7c5156d318a req-1e581bcb-9116-4e01-90d3-23cd41020553 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049149 May 21 22:32:05.695384 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3723/7320] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:32:15.676417 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-cd7851dd-58db-4add-894c-9e7a0f69a60d tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:32:15.678577 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cd7851dd-58db-4add-894c-9e7a0f69a60d tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:32:15.683003 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_api:SELECT=2 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:32:15.684123 ncdv-master-1 devstack@n-api.service[131278]: DEBUG dbcounter [-] [131278] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:32:15.693867 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd7851dd-58db-4add-894c-9e7a0f69a60d tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:15.694566 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd7851dd-58db-4add-894c-9e7a0f69a60d tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:15.696495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd7851dd-58db-4add-894c-9e7a0f69a60d tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:15.696495 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-cd7851dd-58db-4add-894c-9e7a0f69a60d tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:15.725748 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-cd7851dd-58db-4add-894c-9e7a0f69a60d tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Going to try to terminate instance {{(pid=131278) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 22:32:15.748739 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-15a80d05-9485-4ae3-b73f-484ab0b11c6d req-9e352a54-ef0a-424f-949c-c7548131e8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fc0aca2-1f87-43db-aff6-5459b5b21e55", "tag": "6d66a2b9-9050-4c70-ab1d-23dc6f4f53bb"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:32:15.758329 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-15a80d05-9485-4ae3-b73f-484ab0b11c6d req-9e352a54-ef0a-424f-949c-c7548131e8e1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:15.758873 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-15a80d05-9485-4ae3-b73f-484ab0b11c6d req-9e352a54-ef0a-424f-949c-c7548131e8e1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:15.772414 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-15a80d05-9485-4ae3-b73f-484ab0b11c6d req-9e352a54-ef0a-424f-949c-c7548131e8e1 service nova] Creating event network-changed:6d66a2b9-9050-4c70-ab1d-23dc6f4f53bb for instance 3fc0aca2-1f87-43db-aff6-5459b5b21e55 on nch2-master-1 May 21 22:32:15.782571 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-15a80d05-9485-4ae3-b73f-484ab0b11c6d req-9e352a54-ef0a-424f-949c-c7548131e8e1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108301 May 21 22:32:15.783195 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3724/7321] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:32:16.000131 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-cd7851dd-58db-4add-894c-9e7a0f69a60d tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 204 len: 0 microversion: 2.1 time: 0.327866 May 21 22:32:16.004075 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3598/7322] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:32:15 2022] DELETE /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:32:16.009986 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-32405f0d-5ee0-46b9-992a-ceea3bd43863 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:32:16.010736 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-32405f0d-5ee0-46b9-992a-ceea3bd43863 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:32:16.018841 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32405f0d-5ee0-46b9-992a-ceea3bd43863 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:16.024753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32405f0d-5ee0-46b9-992a-ceea3bd43863 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:16.024753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32405f0d-5ee0-46b9-992a-ceea3bd43863 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:16.024753 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-32405f0d-5ee0-46b9-992a-ceea3bd43863 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:16.235878 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-32405f0d-5ee0-46b9-992a-ceea3bd43863 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:32:16.244574 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-32405f0d-5ee0-46b9-992a-ceea3bd43863 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 200 len: 1683 microversion: 2.1 time: 0.238987 May 21 22:32:16.245173 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3725/7323] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:32:16 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 1683 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:32:17.263054 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0c03226f-8ef0-4ce2-88ad-b951d43a5a2f tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:32:17.263768 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0c03226f-8ef0-4ce2-88ad-b951d43a5a2f tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:32:17.271676 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c03226f-8ef0-4ce2-88ad-b951d43a5a2f tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:17.272125 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c03226f-8ef0-4ce2-88ad-b951d43a5a2f tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:17.272937 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c03226f-8ef0-4ce2-88ad-b951d43a5a2f tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:17.273377 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c03226f-8ef0-4ce2-88ad-b951d43a5a2f tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:17.552365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-0c03226f-8ef0-4ce2-88ad-b951d43a5a2f tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:32:17.561224 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0c03226f-8ef0-4ce2-88ad-b951d43a5a2f tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 200 len: 1683 microversion: 2.1 time: 0.302151 May 21 22:32:17.572299 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3599/7324] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:32:17 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 1683 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:32:17.585256 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [req-1bd197fd-329d-4b96-be29-6bf718c8e452 req-50640d20-40bc-472d-8c64-2ea2df26a6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc0aca2-1f87-43db-aff6-5459b5b21e55", "name": "network-vif-unplugged", "status": "completed", "tag": "6d66a2b9-9050-4c70-ab1d-23dc6f4f53bb"}]} {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:32:17.595345 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-1bd197fd-329d-4b96-be29-6bf718c8e452 req-50640d20-40bc-472d-8c64-2ea2df26a6d4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:17.596016 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [req-1bd197fd-329d-4b96-be29-6bf718c8e452 req-50640d20-40bc-472d-8c64-2ea2df26a6d4 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:17.609376 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.compute.server_external_events [req-1bd197fd-329d-4b96-be29-6bf718c8e452 req-50640d20-40bc-472d-8c64-2ea2df26a6d4 service nova] Creating event network-vif-unplugged:6d66a2b9-9050-4c70-ab1d-23dc6f4f53bb for instance 3fc0aca2-1f87-43db-aff6-5459b5b21e55 on nch2-master-1 May 21 22:32:17.615970 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [req-1bd197fd-329d-4b96-be29-6bf718c8e452 req-50640d20-40bc-472d-8c64-2ea2df26a6d4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034635 May 21 22:32:17.615970 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3726/7325] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:32:18.146489 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-145af9f7-18bd-4370-a9bf-5e553b19b9a0 req-1f08cbde-61e9-44e0-b980-d7be04b857a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc0aca2-1f87-43db-aff6-5459b5b21e55", "name": "network-vif-deleted", "tag": "6d66a2b9-9050-4c70-ab1d-23dc6f4f53bb"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:32:18.155048 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-145af9f7-18bd-4370-a9bf-5e553b19b9a0 req-1f08cbde-61e9-44e0-b980-d7be04b857a1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:18.155502 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-145af9f7-18bd-4370-a9bf-5e553b19b9a0 req-1f08cbde-61e9-44e0-b980-d7be04b857a1 service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:18.166783 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-145af9f7-18bd-4370-a9bf-5e553b19b9a0 req-1f08cbde-61e9-44e0-b980-d7be04b857a1 service nova] Creating event network-vif-deleted:6d66a2b9-9050-4c70-ab1d-23dc6f4f53bb for instance 3fc0aca2-1f87-43db-aff6-5459b5b21e55 on nch2-master-1 May 21 22:32:18.171782 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-145af9f7-18bd-4370-a9bf-5e553b19b9a0 req-1f08cbde-61e9-44e0-b980-d7be04b857a1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029131 May 21 22:32:18.172392 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3600/7326] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:32:18.579619 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7392f3d4-e311-4383-8341-c9151c8e2a83 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:32:18.580369 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7392f3d4-e311-4383-8341-c9151c8e2a83 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:32:18.587257 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7392f3d4-e311-4383-8341-c9151c8e2a83 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:18.587832 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7392f3d4-e311-4383-8341-c9151c8e2a83 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:18.588533 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7392f3d4-e311-4383-8341-c9151c8e2a83 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:18.588990 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7392f3d4-e311-4383-8341-c9151c8e2a83 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:18.622135 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7392f3d4-e311-4383-8341-c9151c8e2a83 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:18.622607 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7392f3d4-e311-4383-8341-c9151c8e2a83 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:18.623078 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.objects.instance [None req-7392f3d4-e311-4383-8341-c9151c8e2a83 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lazy-loading 'fault' on Instance uuid 3fc0aca2-1f87-43db-aff6-5459b5b21e55 {{(pid=131277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 21 22:32:18.669322 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-7392f3d4-e311-4383-8341-c9151c8e2a83 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:32:18.677891 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7392f3d4-e311-4383-8341-c9151c8e2a83 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 200 len: 1337 microversion: 2.1 time: 0.101806 May 21 22:32:18.678474 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3727/7327] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:32:18 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 1337 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:32:19.697046 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c02e25c6-b30b-4fd9-aa00-b2b060a05248 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:32:19.697757 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-c02e25c6-b30b-4fd9-aa00-b2b060a05248 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 3fc0aca2-1f87-43db-aff6-5459b5b21e55] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:32:19.704099 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c02e25c6-b30b-4fd9-aa00-b2b060a05248 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:19.704591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c02e25c6-b30b-4fd9-aa00-b2b060a05248 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:19.705365 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c02e25c6-b30b-4fd9-aa00-b2b060a05248 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:19.705806 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-c02e25c6-b30b-4fd9-aa00-b2b060a05248 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:19.719795 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-c02e25c6-b30b-4fd9-aa00-b2b060a05248 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] HTTP exception thrown: Instance 3fc0aca2-1f87-43db-aff6-5459b5b21e55 could not be found. May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c02e25c6-b30b-4fd9-aa00-b2b060a05248 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Request method failure captured: May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 HTTP/1.1 May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWdRAn0gQNa19MVmoldKeMb0l8b4boTF4qwi1VX0mAOJYDr3mgnSAEuO0VyYZEcm2LrnoVFqoGCYXcsvqEiqkI6ukgni91keGfQZsYQBSyVENUtjpQIpfrg7F93ahXqJZfUfwBbPMgSBZ-3-0fWVAUYlXSmxdAjastJU5aPRahN7XGQ May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: dfb3f27e6ae5446a98281f445844b6e7 May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestSnapshotPattern-1085614209 May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dfb3f27e6ae5446a98281f445844b6e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dfb3f27e6ae5446a98281f445844b6e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dfb3f27e6ae5446a98281f445844b6e7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dfb3f27e6ae5446a98281f445844b6e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestSnapshotPattern-1085614209 May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: dfb3f27e6ae5446a98281f445844b6e7 May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestSnapshotPattern-1085614209 May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestSnapshotPattern-1085614209-project May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1927faa22e714e0a8743bf1f0a9d5c38 May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestSnapshotPattern-1085614209-project May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 3fc0aca2-1f87-43db-aff6-5459b5b21e55 could not be found. May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '3fc0aca2-1f87-43db-aff6-5459b5b21e55'} May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc0aca2-1f87-43db-aff6-5459b5b21e55 could not be found. May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc0aca2-1f87-43db-aff6-5459b5b21e55 could not be found. May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:32:19.721450 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:32:19.726336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:32:19.726336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:32:19.726336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:32:19.726336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:32:19.726336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:32:19.726336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc0aca2-1f87-43db-aff6-5459b5b21e55 could not be found. May 21 22:32:19.726336 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:32:19.726336 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-c02e25c6-b30b-4fd9-aa00-b2b060a05248 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Returning 404 to user: Instance 3fc0aca2-1f87-43db-aff6-5459b5b21e55 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:32:19.726336 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-c02e25c6-b30b-4fd9-aa00-b2b060a05248 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55" status: 404 len: 111 microversion: 2.1 time: 0.031597 May 21 22:32:19.726336 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3601/7328] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:32:19 2022] GET /compute/v2.1/servers/3fc0aca2-1f87-43db-aff6-5459b5b21e55 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:32:21.950370 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-7f4492fe-d05e-464e-a31e-e2f391eecfec tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:32:21.950897 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7f4492fe-d05e-464e-a31e-e2f391eecfec tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:32:21.952899 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-a9952eba-8eca-4222-be60-1234accd775d req-54ece73c-4dbe-419a-8cc2-8c8ec7df0b3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "001a7ebf-cb0b-4b31-a2dc-6df3615df369", "tag": "8c7fc235-5d25-48c6-bbb2-aa56a98421ba"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:32:21.959714 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f4492fe-d05e-464e-a31e-e2f391eecfec tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:21.960268 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f4492fe-d05e-464e-a31e-e2f391eecfec tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:21.961201 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f4492fe-d05e-464e-a31e-e2f391eecfec tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:21.961940 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-7f4492fe-d05e-464e-a31e-e2f391eecfec tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:21.963792 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a9952eba-8eca-4222-be60-1234accd775d req-54ece73c-4dbe-419a-8cc2-8c8ec7df0b3e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:21.964245 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-a9952eba-8eca-4222-be60-1234accd775d req-54ece73c-4dbe-419a-8cc2-8c8ec7df0b3e service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:21.979934 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-a9952eba-8eca-4222-be60-1234accd775d req-54ece73c-4dbe-419a-8cc2-8c8ec7df0b3e service nova] Creating event network-changed:8c7fc235-5d25-48c6-bbb2-aa56a98421ba for instance 001a7ebf-cb0b-4b31-a2dc-6df3615df369 on nch1-master-1 May 21 22:32:21.985578 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-a9952eba-8eca-4222-be60-1234accd775d req-54ece73c-4dbe-419a-8cc2-8c8ec7df0b3e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036356 May 21 22:32:21.987053 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3602/7329] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 21 22:32:21.990084 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-7f4492fe-d05e-464e-a31e-e2f391eecfec tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] Going to try to terminate instance {{(pid=131277) delete /opt/stack/nova/nova/compute/api.py:2664}} May 21 22:32:22.261938 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-7f4492fe-d05e-464e-a31e-e2f391eecfec tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "DELETE /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369" status: 204 len: 0 microversion: 2.1 time: 0.315583 May 21 22:32:22.263053 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3728/7330] 10.222.0.49 () {58 vars in 1238 bytes} [Sat May 21 22:32:21 2022] DELETE /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 21 22:32:22.272625 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-59112b81-9be1-485b-8ebb-4154f7743817 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:32:22.273463 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-59112b81-9be1-485b-8ebb-4154f7743817 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:32:22.283538 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59112b81-9be1-485b-8ebb-4154f7743817 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:22.287615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59112b81-9be1-485b-8ebb-4154f7743817 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:22.287615 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59112b81-9be1-485b-8ebb-4154f7743817 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:22.289781 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-59112b81-9be1-485b-8ebb-4154f7743817 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:22.465533 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.policy [None req-59112b81-9be1-485b-8ebb-4154f7743817 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131278) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:32:22.474284 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-59112b81-9be1-485b-8ebb-4154f7743817 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369" status: 200 len: 1683 microversion: 2.1 time: 0.206475 May 21 22:32:22.474871 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3603/7331] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:32:22 2022] GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369 => generated 1683 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:32:23.492983 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-c8b4b2d3-da39-4666-8912-aa8c48ea4b2c tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:32:23.493704 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-c8b4b2d3-da39-4666-8912-aa8c48ea4b2c tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:32:23.500810 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c8b4b2d3-da39-4666-8912-aa8c48ea4b2c tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:23.501281 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c8b4b2d3-da39-4666-8912-aa8c48ea4b2c tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:23.502068 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c8b4b2d3-da39-4666-8912-aa8c48ea4b2c tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:23.502524 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-c8b4b2d3-da39-4666-8912-aa8c48ea4b2c tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:23.666393 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-c8b4b2d3-da39-4666-8912-aa8c48ea4b2c tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:32:23.674195 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-c8b4b2d3-da39-4666-8912-aa8c48ea4b2c tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369" status: 200 len: 1683 microversion: 2.1 time: 0.185794 May 21 22:32:23.674793 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3729/7332] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:32:23 2022] GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369 => generated 1683 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:32:24.418900 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [req-1a625e3c-c21f-4580-b5dd-539683ee11c9 req-26957a82-0609-4195-9579-b3030c50ec6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "001a7ebf-cb0b-4b31-a2dc-6df3615df369", "name": "network-vif-deleted", "tag": "8c7fc235-5d25-48c6-bbb2-aa56a98421ba"}]} {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 21 22:32:24.428855 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-1a625e3c-c21f-4580-b5dd-539683ee11c9 req-26957a82-0609-4195-9579-b3030c50ec6c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:24.429595 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [req-1a625e3c-c21f-4580-b5dd-539683ee11c9 req-26957a82-0609-4195-9579-b3030c50ec6c service nova] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:24.442121 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.compute.server_external_events [req-1a625e3c-c21f-4580-b5dd-539683ee11c9 req-26957a82-0609-4195-9579-b3030c50ec6c service nova] Creating event network-vif-deleted:8c7fc235-5d25-48c6-bbb2-aa56a98421ba for instance 001a7ebf-cb0b-4b31-a2dc-6df3615df369 on nch1-master-1 May 21 22:32:24.447629 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [req-1a625e3c-c21f-4580-b5dd-539683ee11c9 req-26957a82-0609-4195-9579-b3030c50ec6c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032367 May 21 22:32:24.448248 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3604/7333] 10.222.0.49 () {64 vars in 1317 bytes} [Sat May 21 22:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 21 22:32:24.691549 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-03f7c9ad-c70f-4083-9629-88b16aaf649f tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:32:24.692199 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.compute.api [None req-03f7c9ad-c70f-4083-9629-88b16aaf649f tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] Fetching instance by UUID {{(pid=131277) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:32:24.700041 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-03f7c9ad-c70f-4083-9629-88b16aaf649f tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:24.700552 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-03f7c9ad-c70f-4083-9629-88b16aaf649f tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:24.701362 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-03f7c9ad-c70f-4083-9629-88b16aaf649f tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:24.701825 ncdv-master-1 devstack@n-api.service[131277]: DEBUG oslo_concurrency.lockutils [None req-03f7c9ad-c70f-4083-9629-88b16aaf649f tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:24.774977 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.policy [None req-03f7c9ad-c70f-4083-9629-88b16aaf649f tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1927faa22e714e0a8743bf1f0a9d5c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb3f27e6ae5446a98281f445844b6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131277) authorize /opt/stack/nova/nova/policy.py:199}} May 21 22:32:24.783516 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-03f7c9ad-c70f-4083-9629-88b16aaf649f tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369" status: 200 len: 1332 microversion: 2.1 time: 0.095867 May 21 22:32:24.784104 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3730/7334] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:32:24 2022] GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369 => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 21 22:32:25.801793 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0c87a057-d5d6-4753-b1a3-cbecc89e9b07 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '>' {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:32:25.802591 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.compute.api [None req-0c87a057-d5d6-4753-b1a3-cbecc89e9b07 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] [instance: 001a7ebf-cb0b-4b31-a2dc-6df3615df369] Fetching instance by UUID {{(pid=131278) get /opt/stack/nova/nova/compute/api.py:2920}} May 21 22:32:25.810076 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c87a057-d5d6-4753-b1a3-cbecc89e9b07 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:25.810527 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c87a057-d5d6-4753-b1a3-cbecc89e9b07 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:25.811300 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c87a057-d5d6-4753-b1a3-cbecc89e9b07 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 21 22:32:25.811736 ncdv-master-1 devstack@n-api.service[131278]: DEBUG oslo_concurrency.lockutils [None req-0c87a057-d5d6-4753-b1a3-cbecc89e9b07 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Lock "4f046ce9-ac6c-44d8-b1fb-b7063eef06e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 21 22:32:25.826069 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.wsgi [None req-0c87a057-d5d6-4753-b1a3-cbecc89e9b07 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] HTTP exception thrown: Instance 001a7ebf-cb0b-4b31-a2dc-6df3615df369 could not be found. May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0c87a057-d5d6-4753-b1a3-cbecc89e9b07 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Request method failure captured: May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: request: GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369 HTTP/1.1 May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: Accept: application/json May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: Accept-Encoding: identity May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: Connection: close May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: Content-Length: 0 May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: Content-Type: application/json May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: Host: 10.222.0.49 May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: Openstack-System-Scope: None May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: User-Agent: python-urllib3/1.26.9 May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: X-Auth-Token: gAAAAABiiWdRAn0gQNa19MVmoldKeMb0l8b4boTF4qwi1VX0mAOJYDr3mgnSAEuO0VyYZEcm2LrnoVFqoGCYXcsvqEiqkI6ukgni91keGfQZsYQBSyVENUtjpQIpfrg7F93ahXqJZfUfwBbPMgSBZ-3-0fWVAUYlXSmxdAjastJU5aPRahN7XGQ May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Id: None May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: X-Domain-Name: None May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: X-Identity-Status: Confirmed May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: X-Is-Admin-Project: True May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Id: default May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Domain-Name: Default May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Id: dfb3f27e6ae5446a98281f445844b6e7 May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: X-Project-Name: tempest-TestSnapshotPattern-1085614209 May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: X-Role: reader,member May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: X-Roles: reader,member May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dfb3f27e6ae5446a98281f445844b6e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dfb3f27e6ae5446a98281f445844b6e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dfb3f27e6ae5446a98281f445844b6e7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dfb3f27e6ae5446a98281f445844b6e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}] May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant: tempest-TestSnapshotPattern-1085614209 May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Id: dfb3f27e6ae5446a98281f445844b6e7 May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: X-Tenant-Name: tempest-TestSnapshotPattern-1085614209 May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: X-User: tempest-TestSnapshotPattern-1085614209-project May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Id: default May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: X-User-Domain-Name: Default May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: X-User-Id: 1927faa22e714e0a8743bf1f0a9d5c38 May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: X-User-Name: tempest-TestSnapshotPattern-1085614209-project May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: method: > May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: exception: Instance 001a7ebf-cb0b-4b31-a2dc-6df3615df369 could not be found. May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: action_args: {'id': '001a7ebf-cb0b-4b31-a2dc-6df3615df369'} May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: {{(pid=131278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 001a7ebf-cb0b-4b31-a2dc-6df3615df369 could not be found. May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 001a7ebf-cb0b-4b31-a2dc-6df3615df369 could not be found. May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 21 22:32:25.830977 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:32:25.836898 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 21 22:32:25.836898 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 21 22:32:25.836898 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 21 22:32:25.836898 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 21 22:32:25.836898 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 21 22:32:25.836898 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 001a7ebf-cb0b-4b31-a2dc-6df3615df369 could not be found. May 21 22:32:25.836898 ncdv-master-1 devstack@n-api.service[131278]: ERROR nova.api.openstack.wsgi May 21 22:32:25.836898 ncdv-master-1 devstack@n-api.service[131278]: DEBUG nova.api.openstack.wsgi [None req-0c87a057-d5d6-4753-b1a3-cbecc89e9b07 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Returning 404 to user: Instance 001a7ebf-cb0b-4b31-a2dc-6df3615df369 could not be found. {{(pid=131278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 21 22:32:25.836898 ncdv-master-1 devstack@n-api.service[131278]: INFO nova.api.openstack.requestlog [None req-0c87a057-d5d6-4753-b1a3-cbecc89e9b07 tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369" status: 404 len: 111 microversion: 2.1 time: 0.031852 May 21 22:32:25.836898 ncdv-master-1 devstack@n-api.service[131278]: [pid: 131278|app: 0|req: 3605/7335] 10.222.0.49 () {58 vars in 1235 bytes} [Sat May 21 22:32:25 2022] GET /compute/v2.1/servers/001a7ebf-cb0b-4b31-a2dc-6df3615df369 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 21 22:32:26.084511 ncdv-master-1 devstack@n-api.service[131277]: DEBUG nova.api.openstack.wsgi [None req-54a8c069-c55f-4c80-bc99-7d2d0334312c tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] Calling method '.version_select at 0x7fc8182b2a60>' {{(pid=131277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 21 22:32:26.159728 ncdv-master-1 devstack@n-api.service[131277]: INFO nova.api.openstack.requestlog [None req-54a8c069-c55f-4c80-bc99-7d2d0334312c tempest-TestSnapshotPattern-1085614209 tempest-TestSnapshotPattern-1085614209-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-525148446" status: 202 len: 0 microversion: 2.1 time: 0.079918 May 21 22:32:26.160346 ncdv-master-1 devstack@n-api.service[131277]: [pid: 131277|app: 0|req: 3731/7336] 10.222.0.49 () {58 vars in 1253 bytes} [Sat May 21 22:32:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-525148446 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 21 22:33:26.571400 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:33:26.571999 ncdv-master-1 devstack@n-api.service[131278]: Sat May 21 22:33:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:33:27.783433 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:33:27.783984 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 22:33:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:35:06.689292 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:35:06.689814 ncdv-master-1 devstack@n-api.service[131278]: Sat May 21 22:35:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:35:29.010179 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:35:29.010923 ncdv-master-1 devstack@n-api.service[131278]: Sat May 21 22:35:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:36:46.579734 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:36:46.580423 ncdv-master-1 devstack@n-api.service[131278]: Sat May 21 22:36:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:36:47.792105 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:36:47.792645 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 22:36:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:37:25.064666 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:37:25.065431 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 22:37:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:38:26.697777 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:38:26.698276 ncdv-master-1 devstack@n-api.service[131278]: Sat May 21 22:38:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:38:27.562753 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:38:27.563349 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 22:38:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:38:49.018589 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:38:49.019171 ncdv-master-1 devstack@n-api.service[131278]: Sat May 21 22:38:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:40:06.588690 ncdv-master-1 devstack@n-api.service[131278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:40:06.589257 ncdv-master-1 devstack@n-api.service[131278]: Sat May 21 22:40:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:40:07.803426 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:40:07.804298 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 22:40:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 21 22:40:45.073586 ncdv-master-1 devstack@n-api.service[131277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 21 22:40:45.074328 ncdv-master-1 devstack@n-api.service[131277]: Sat May 21 22:40:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!